[2025-09-16T17:00:01.382871] [INFO ] [MAIN ] Using last completed trading day: 2025-09-16 [2025-09-16T17:00:01.383276] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-09-16T17:00:01.383369] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-09-16T17:00:01.383408] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-09-16T17:00:03.029584] [DEBUG] [SYMBOL ] Found 2421 valid NYSE symbols. [2025-09-16T17:00:03.029791] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-09-16T17:00:03.029990] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-09-16T17:00:03.030656] [INFO ] [LOCAL ] Symbols cache updated with 2369 symbols. [2025-09-16T17:00:03.030705] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-09-16T17:00:03.030737] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-09-16T17:00:03.030797] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-09-16T17:00:03.030893] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-16T17:00:03.031275] [DEBUG] [LOCAL ] Found 2369 symbols in cached list. [2025-09-16T17:00:03.031310] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-16T17:00:03.031475] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-09-16T17:00:03.031511] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2369 valid symbols. [2025-09-16T17:00:03.031543] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-09-16T17:00:03.031573] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-09-16T17:00:03.060362] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-09-16T17:00:03.085626] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-09-16T17:00:03.085822] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-09-16T17:00:03.085863] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-09-16T17:00:03.085894] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-09-16T17:00:03.086305] [WARN ] [STATE ] State set to: RUNNING [2025-09-16T17:00:03.086488] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-16T17:00:03.086926] [DEBUG] [LOCAL ] Found 2369 symbols in cached list. [2025-09-16T17:00:03.086975] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-16T17:00:03.087008] [INFO ] [MAIN ] Starting incremental update for 2369 symbols. [2025-09-16T17:00:03.087037] [INFO ] [MAIN ] Running in parallel mode [2025-09-16T17:00:03.088349] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2369 symbols [2025-09-16T17:00:03.623978] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:00:03.692446] [DEBUG] [LOCAL ] AA: No existing data file found in primary storage. [2025-09-16T17:00:03.830279] [WARN ] [MAIN ] AA: No existing data found, performing full refresh instead. [2025-09-16T17:00:03.849859] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-09-16T17:00:03.849988] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-09-16T17:00:03.828055] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:00:03.834283] [INFO ] [MAIN ] AACT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:00:03.853543] [DEBUG] [LOCAL ] AA: No primary data file found to delete. [2025-09-16T17:00:03.853360] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:00:03.853806] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-09-16T17:00:03.853867] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-09-16T17:00:03.854798] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-09-16T17:00:03.854747] [DEBUG] [LOCAL ] A: No existing data file found in primary storage. [2025-09-16T17:00:03.855540] [WARN ] [MAIN ] A: No existing data found, performing full refresh instead. [2025-09-16T17:00:03.883160] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-09-16T17:00:03.883314] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-16T17:00:03.889982] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-16T17:00:03.900451] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-09-16T17:00:03.889836] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-09-16T17:00:03.940916] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-09-16T17:00:03.971745] [DEBUG] [LOCAL ] A: No primary data file found to delete. [2025-09-16T17:00:03.998680] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-09-16T17:00:04.031871] [DEBUG] [LOCAL ] AACT: Loaded 7894 existing records from primary storage. [2025-09-16T17:00:04.102408] [INFO ] [MAIN ] AACT: Loaded 7894 existing records. [2025-09-16T17:00:05.010109] [WARN ] [MAIN ] AACT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:00:05.135169] [INFO ] [REMOTE ] AAM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:00:05.174767] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-09-16T17:00:05.154221] [INFO ] [MAIN ] AACT: Wiping existing primary data before full refresh. [2025-09-16T17:00:05.230167] [INFO ] [REMOTE ] A: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:00:05.243867] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-09-16T17:00:05.266469] [INFO ] [LOCAL ] AACT: Starting deletion of primary data. [2025-09-16T17:00:05.272132] [INFO ] [REMOTE ] AA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:00:05.273581] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-09-16T17:00:05.274252] [DEBUG] [LOCAL ] AACT: Deleted primary data file. [2025-09-16T17:00:05.274347] [INFO ] [MAIN ] AACT: Starting full primary refresh. [2025-09-16T17:00:05.658513] [INFO ] [REMOTE ] AACT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:00:05.658924] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-02. [2025-09-16T17:00:05.994792] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-16T17:00:05.995879] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-09-16T17:00:06.311637] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-16T17:00:06.312677] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-09-16T17:00:06.423234] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-16T17:00:06.424194] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-03. [2025-09-16T17:00:06.610501] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-09-16T17:00:06.612048] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-09-16T17:00:06.876113] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-09-16T17:00:06.876995] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-09-16T17:00:07.071122] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-16T17:00:07.081781] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-09-16T17:00:07.168021] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-16T17:00:07.169542] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-04. [2025-09-16T17:00:07.200854] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-16T17:00:07.201804] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-09-16T17:00:07.250545] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-16T17:00:07.261717] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-09-16T17:00:07.574550] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-16T17:00:07.575555] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-09-16T17:00:07.963459] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-16T17:00:07.964708] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-09-16T17:00:08.009408] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-16T17:00:08.011985] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-05. [2025-09-16T17:00:08.586453] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-16T17:00:08.587161] [INFO ] [REMOTE ] AAM: Full fetch complete (703 records). [2025-09-16T17:00:08.587262] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-09-16T17:00:08.587685] [FATAL] [VALIDATOR ] AAM: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:00:08.587776] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:00:08.587824] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:00:08.587882] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-16T17:00:08.587943] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-16T17:00:08.587979] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-09-16T17:00:08.588019] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-09-16T17:00:08.588076] [INFO ] [MAIN ] Update Progress: 1/2369 symbols completed. AAM took 5.4s. Estimated remaining: 3h 37m 6s. Rate: 10.9 symbols/min [2025-09-16T17:00:08.762893] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:00:08.763088] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-09-16T17:00:08.763126] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-09-16T17:00:08.763253] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-09-16T17:00:08.763294] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-16T17:00:08.763336] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-09-16T17:00:08.763369] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-09-16T17:00:08.886749] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-16T17:00:08.977307] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-06. [2025-09-16T17:00:09.141235] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:00:09.141917] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-02. [2025-09-16T17:00:09.185870] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-16T17:00:09.197624] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-09-16T17:00:09.229321] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-16T17:00:09.240779] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-09-16T17:00:09.930856] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-16T17:00:09.935277] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-07. [2025-09-16T17:00:10.162449] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-16T17:00:10.166666] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-03. [2025-09-16T17:00:10.606622] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-16T17:00:10.610906] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-08. [2025-09-16T17:00:10.976818] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-16T17:00:10.981795] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-04. [2025-09-16T17:00:11.090391] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-16T17:00:11.102426] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-09-16T17:00:11.227557] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-16T17:00:11.239348] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-09-16T17:00:12.290380] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-16T17:00:12.294428] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-09. [2025-09-16T17:00:12.432272] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-16T17:00:12.443078] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-05. [2025-09-16T17:00:12.903348] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-16T17:00:12.921683] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-09-16T17:00:13.132980] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-16T17:00:13.144989] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-09-16T17:00:13.684420] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-16T17:00:13.686960] [INFO ] [REMOTE ] AACT: Full fetch complete (9645 records). [2025-09-16T17:00:13.687065] [DEBUG] [VALIDATOR ] AACT: Validating primary data. [2025-09-16T17:00:14.070743] [DEBUG] [VALIDATOR ] AACT: All expected trading days are present. [2025-09-16T17:00:14.070833] [DEBUG] [VALIDATOR ] AACT: Primary data validation passed. [2025-09-16T17:00:14.070993] [INFO ] [MAIN ] AACT: Fetched primary data is valid. [2025-09-16T17:00:14.071050] [DEBUG] [LOCAL ] AACT: Saving primary data. [2025-09-16T17:00:14.071552] [DEBUG] [LOCAL ] AACT: Trimmed 9645 records to 8064 (keeping 150 days of data) [2025-09-16T17:00:14.124476] [DEBUG] [LOCAL ] AACT: Primary data saved (8064 records). [2025-09-16T17:00:14.124606] [INFO ] [MAIN ] AACT: Full history saved. [2025-09-16T17:00:14.124723] [INFO ] [MAIN ] Update Progress: 2/2369 symbols completed. AACT took 11.0s. Estimated remaining: 3h 37m 43s. Rate: 10.9 symbols/min [2025-09-16T17:00:14.299348] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:00:14.299685] [DEBUG] [LOCAL ] AAP: No existing data file found in primary storage. [2025-09-16T17:00:14.299809] [WARN ] [MAIN ] AAP: No existing data found, performing full refresh instead. [2025-09-16T17:00:14.300071] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-09-16T17:00:14.300208] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-09-16T17:00:14.300342] [DEBUG] [LOCAL ] AAP: No primary data file found to delete. [2025-09-16T17:00:14.300413] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-09-16T17:00:14.398265] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-16T17:00:14.431512] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-06. [2025-09-16T17:00:14.685870] [INFO ] [REMOTE ] AAP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:00:14.686194] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-09-16T17:00:14.768608] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-16T17:00:14.779037] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-09-16T17:00:14.808890] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-16T17:00:14.820132] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-09-16T17:00:15.201215] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-16T17:00:15.206227] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-07. [2025-09-16T17:00:16.059045] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-16T17:00:16.065059] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-08. [2025-09-16T17:00:16.464126] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-16T17:00:16.475311] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-09-16T17:00:16.719666] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-16T17:00:16.731337] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-09-16T17:00:16.836841] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-16T17:00:16.848845] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-09-16T17:00:17.064634] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-16T17:00:17.070801] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-09. [2025-09-16T17:00:18.315110] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-16T17:00:18.326352] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-09-16T17:00:18.391193] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-16T17:00:18.403464] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-09-16T17:00:18.614823] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-16T17:00:18.618727] [INFO ] [REMOTE ] AAMI: Full fetch complete (25900 records). [2025-09-16T17:00:18.618859] [DEBUG] [VALIDATOR ] AAMI: Validating primary data. [2025-09-16T17:00:18.619447] [FATAL] [VALIDATOR ] AAMI: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:00:18.619527] [FATAL] [MAIN ] AAMI: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:00:18.619566] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:00:18.619614] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-16T17:00:18.619698] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-09-16T17:00:18.619738] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-09-16T17:00:18.619779] [DEBUG] [LOCAL ] AAMI: No derivative data file found to delete. [2025-09-16T17:00:18.619846] [INFO ] [MAIN ] Update Progress: 3/2369 symbols completed. AAMI took 10.0s. Estimated remaining: 3h 24m 10s. Rate: 11.6 symbols/min [2025-09-16T17:00:18.799498] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:00:18.799719] [DEBUG] [LOCAL ] AAT: No existing data file found in primary storage. [2025-09-16T17:00:18.799761] [WARN ] [MAIN ] AAT: No existing data found, performing full refresh instead. [2025-09-16T17:00:18.799885] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-09-16T17:00:18.799926] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-09-16T17:00:18.799967] [DEBUG] [LOCAL ] AAT: No primary data file found to delete. [2025-09-16T17:00:18.800000] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-09-16T17:00:19.178855] [INFO ] [REMOTE ] AAT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:00:19.179298] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-09-16T17:00:19.239989] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (2.51 seconds). [2025-09-16T17:00:19.250591] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-09-16T17:00:20.124592] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-16T17:00:20.135687] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-09-16T17:00:20.167192] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-16T17:00:20.179034] [INFO ] [REMOTE ] AA: Full fetch complete (58254 records). [2025-09-16T17:00:20.179158] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-09-16T17:00:20.578056] [DEBUG] [VALIDATOR ] AA: All expected trading days are present. [2025-09-16T17:00:20.578257] [DEBUG] [VALIDATOR ] AA: Primary data validation passed. [2025-09-16T17:00:20.578858] [INFO ] [MAIN ] AA: Fetched primary data is valid. [2025-09-16T17:00:20.578951] [DEBUG] [LOCAL ] AA: Saving primary data. [2025-09-16T17:00:20.596380] [DEBUG] [LOCAL ] AA: Trimmed 58254 records to 39972 (keeping 150 days of data) [2025-09-16T17:00:20.597454] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-16T17:00:20.604360] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-09-16T17:00:20.733853] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-16T17:00:20.750622] [INFO ] [REMOTE ] A: Full fetch complete (55297 records). [2025-09-16T17:00:20.757571] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-09-16T17:00:21.304699] [DEBUG] [VALIDATOR ] A: All expected trading days are present. [2025-09-16T17:00:21.305522] [DEBUG] [VALIDATOR ] A: Primary data validation passed. [2025-09-16T17:00:21.306257] [INFO ] [MAIN ] A: Fetched primary data is valid. [2025-09-16T17:00:21.306801] [DEBUG] [LOCAL ] A: Saving primary data. [2025-09-16T17:00:21.312218] [DEBUG] [LOCAL ] A: Trimmed 55297 records to 37747 (keeping 150 days of data) [2025-09-16T17:00:21.451512] [DEBUG] [LOCAL ] AA: Primary data saved (39972 records). [2025-09-16T17:00:21.452572] [INFO ] [MAIN ] AA: Full history saved. [2025-09-16T17:00:21.453181] [INFO ] [MAIN ] Update Progress: 4/2369 symbols completed. AA took 18.4s. Estimated remaining: 3h 0m 59s. Rate: 13.1 symbols/min [2025-09-16T17:00:21.654317] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:00:21.655850] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-09-16T17:00:21.656227] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-09-16T17:00:21.660989] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-09-16T17:00:21.667374] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-16T17:00:21.667469] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-16T17:00:21.667509] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-09-16T17:00:22.148095] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:00:22.150117] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-02. [2025-09-16T17:00:22.172967] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-16T17:00:22.181983] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-09-16T17:00:22.221116] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-16T17:00:22.234850] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-09-16T17:00:22.237664] [DEBUG] [LOCAL ] A: Primary data saved (37747 records). [2025-09-16T17:00:22.237783] [INFO ] [MAIN ] A: Full history saved. [2025-09-16T17:00:22.237878] [INFO ] [MAIN ] Update Progress: 5/2369 symbols completed. A took 19.1s. Estimated remaining: 2h 30m 54s. Rate: 15.7 symbols/min [2025-09-16T17:00:22.397240] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:00:22.416553] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:00:22.416728] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-02 [2025-09-16T17:00:22.417789] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-03. [2025-09-16T17:00:22.435240] [DEBUG] [LOCAL ] AB: Loaded 17717 existing records from primary storage. [2025-09-16T17:00:22.435383] [INFO ] [MAIN ] AB: Loaded 17717 existing records. [2025-09-16T17:00:22.612779] [WARN ] [MAIN ] AB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:00:22.613064] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-09-16T17:00:22.613115] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-09-16T17:00:22.613762] [DEBUG] [LOCAL ] AB: Deleted primary data file. [2025-09-16T17:00:22.613813] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-09-16T17:00:22.694328] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:00:22.715830] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-03 [2025-09-16T17:00:22.731933] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-04. [2025-09-16T17:00:22.974135] [INFO ] [REMOTE ] AB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:00:22.974512] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-09-16T17:00:23.050436] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:00:23.050756] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-04 [2025-09-16T17:00:23.051250] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-05. [2025-09-16T17:00:23.259554] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:00:23.259908] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-05 [2025-09-16T17:00:23.260362] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-06. [2025-09-16T17:00:23.574179] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-16T17:00:23.582597] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-09-16T17:00:24.017743] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-16T17:00:24.029503] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-09-16T17:00:24.190725] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-16T17:00:24.192919] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-07. [2025-09-16T17:00:24.558959] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-16T17:00:24.566250] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-09-16T17:00:24.733851] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-16T17:00:24.742589] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-09-16T17:00:24.952821] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-16T17:00:24.955700] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-08. [2025-09-16T17:00:25.572755] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-16T17:00:25.588425] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-09-16T17:00:25.590167] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-16T17:00:25.594361] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-09. [2025-09-16T17:00:25.823405] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-16T17:00:25.835084] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-09-16T17:00:26.090101] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-16T17:00:26.099810] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-09-16T17:00:26.392939] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-16T17:00:26.395539] [INFO ] [REMOTE ] AAUC: Full fetch complete (6523 records). [2025-09-16T17:00:26.395616] [DEBUG] [VALIDATOR ] AAUC: Validating primary data. [2025-09-16T17:00:26.579090] [WARN ] [VALIDATOR ] AAUC: Validation failed - insufficient historical data. Have 69 unique days, need 150 days [2025-09-16T17:00:26.579389] [FATAL] [MAIN ] AAUC: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:00:26.579561] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:00:26.579621] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-16T17:00:26.579863] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-16T17:00:26.579947] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-09-16T17:00:26.580077] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-09-16T17:00:26.580178] [INFO ] [MAIN ] Update Progress: 6/2369 symbols completed. AAUC took 5.1s. Estimated remaining: 2h 34m 12s. Rate: 15.3 symbols/min [2025-09-16T17:00:26.730850] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-16T17:00:26.782157] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:00:26.782672] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-09-16T17:00:26.827976] [DEBUG] [LOCAL ] ABBV: Loaded 39654 existing records from primary storage. [2025-09-16T17:00:26.828133] [INFO ] [MAIN ] ABBV: Loaded 39654 existing records. [2025-09-16T17:00:27.010457] [WARN ] [MAIN ] ABBV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:00:27.010768] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-09-16T17:00:27.010819] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-09-16T17:00:27.011846] [DEBUG] [LOCAL ] ABBV: Deleted primary data file. [2025-09-16T17:00:27.011899] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-09-16T17:00:27.390391] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:00:27.390786] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-09-16T17:00:27.502616] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-16T17:00:27.513852] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-09-16T17:00:27.621489] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-16T17:00:27.629870] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-09-16T17:00:27.665576] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-16T17:00:27.672471] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-09-16T17:00:28.944463] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-16T17:00:28.954588] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-09-16T17:00:28.992147] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-16T17:00:28.996409] [INFO ] [REMOTE ] AAT: Full fetch complete (32976 records). [2025-09-16T17:00:28.996554] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-09-16T17:00:29.157163] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-16T17:00:29.239163] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-09-16T17:00:29.400520] [DEBUG] [VALIDATOR ] AAT: All expected trading days are present. [2025-09-16T17:00:29.400721] [DEBUG] [VALIDATOR ] AAT: Primary data validation passed. [2025-09-16T17:00:29.401156] [INFO ] [MAIN ] AAT: Fetched primary data is valid. [2025-09-16T17:00:29.401303] [DEBUG] [LOCAL ] AAT: Saving primary data. [2025-09-16T17:00:29.402803] [DEBUG] [LOCAL ] AAT: Trimmed 32976 records to 22530 (keeping 150 days of data) [2025-09-16T17:00:29.522219] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-16T17:00:29.530375] [INFO ] [REMOTE ] AAP: Full fetch complete (56730 records). [2025-09-16T17:00:29.531430] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-09-16T17:00:29.974280] [DEBUG] [VALIDATOR ] AAP: All expected trading days are present. [2025-09-16T17:00:29.974061] [DEBUG] [LOCAL ] AAT: Primary data saved (22530 records). [2025-09-16T17:00:29.974575] [INFO ] [MAIN ] AAT: Full history saved. [2025-09-16T17:00:29.974487] [DEBUG] [VALIDATOR ] AAP: Primary data validation passed. [2025-09-16T17:00:29.975224] [INFO ] [MAIN ] AAP: Fetched primary data is valid. [2025-09-16T17:00:29.975304] [DEBUG] [LOCAL ] AAP: Saving primary data. [2025-09-16T17:00:29.975589] [INFO ] [MAIN ] Update Progress: 7/2369 symbols completed. AAT took 11.4s. Estimated remaining: 2h 31m 13s. Rate: 15.6 symbols/min [2025-09-16T17:00:30.085598] [DEBUG] [LOCAL ] AAP: Trimmed 56730 records to 38811 (keeping 150 days of data) [2025-09-16T17:00:30.261596] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:00:30.297830] [DEBUG] [LOCAL ] ABCB: Loaded 21569 existing records from primary storage. [2025-09-16T17:00:30.298898] [INFO ] [MAIN ] ABCB: Loaded 21569 existing records. [2025-09-16T17:00:30.562605] [WARN ] [MAIN ] ABCB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:00:30.572655] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-09-16T17:00:30.572891] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-09-16T17:00:30.599567] [DEBUG] [LOCAL ] ABCB: Deleted primary data file. [2025-09-16T17:00:30.600201] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-09-16T17:00:30.668558] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-16T17:00:30.733038] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-09-16T17:00:30.936168] [DEBUG] [LOCAL ] AAP: Primary data saved (38811 records). [2025-09-16T17:00:30.939892] [INFO ] [MAIN ] AAP: Full history saved. [2025-09-16T17:00:30.950287] [INFO ] [MAIN ] Update Progress: 8/2369 symbols completed. AAP took 16.8s. Estimated remaining: 2h 17m 3s. Rate: 17.2 symbols/min [2025-09-16T17:00:31.071751] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:00:31.124344] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-09-16T17:00:31.215540] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:00:31.250149] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-16T17:00:31.262277] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-09-16T17:00:31.296875] [DEBUG] [LOCAL ] ABEV: Loaded 39288 existing records from primary storage. [2025-09-16T17:00:31.297046] [INFO ] [MAIN ] ABEV: Loaded 39288 existing records. [2025-09-16T17:00:31.479421] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:00:31.479759] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-09-16T17:00:31.479817] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-09-16T17:00:31.480769] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-09-16T17:00:31.480827] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-09-16T17:00:31.852842] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:00:31.853181] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-09-16T17:00:32.137943] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-16T17:00:32.144755] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-09-16T17:00:32.763991] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-16T17:00:32.770030] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-09-16T17:00:33.261775] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-16T17:00:33.267203] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-09-16T17:00:33.311475] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-16T17:00:33.322863] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-09-16T17:00:33.780183] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-16T17:00:33.787703] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-09-16T17:00:33.848913] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-16T17:00:33.858686] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-09-16T17:00:34.324365] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-16T17:00:34.327690] [INFO ] [REMOTE ] AB: Full fetch complete (33357 records). [2025-09-16T17:00:34.327770] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-09-16T17:00:34.728217] [DEBUG] [VALIDATOR ] AB: All expected trading days are present. [2025-09-16T17:00:34.728299] [DEBUG] [VALIDATOR ] AB: Primary data validation passed. [2025-09-16T17:00:34.728670] [INFO ] [MAIN ] AB: Fetched primary data is valid. [2025-09-16T17:00:34.728717] [DEBUG] [LOCAL ] AB: Saving primary data. [2025-09-16T17:00:34.729448] [DEBUG] [LOCAL ] AB: Trimmed 33357 records to 17872 (keeping 150 days of data) [2025-09-16T17:00:34.838027] [DEBUG] [LOCAL ] AB: Primary data saved (17872 records). [2025-09-16T17:00:34.838159] [INFO ] [MAIN ] AB: Full history saved. [2025-09-16T17:00:34.838245] [INFO ] [MAIN ] Update Progress: 9/2369 symbols completed. AB took 12.6s. Estimated remaining: 2h 18m 46s. Rate: 17.0 symbols/min [2025-09-16T17:00:35.016883] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:00:35.030486] [DEBUG] [LOCAL ] ABG: Loaded 12853 existing records from primary storage. [2025-09-16T17:00:35.030596] [INFO ] [MAIN ] ABG: Loaded 12853 existing records. [2025-09-16T17:00:35.198341] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-16T17:00:35.240421] [WARN ] [MAIN ] ABG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:00:35.240312] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-09-16T17:00:35.241430] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-09-16T17:00:35.241488] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-09-16T17:00:35.241881] [DEBUG] [LOCAL ] ABG: Deleted primary data file. [2025-09-16T17:00:35.241932] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-09-16T17:00:35.652100] [INFO ] [REMOTE ] ABG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:00:35.652563] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-09-16T17:00:35.687323] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-16T17:00:35.725751] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-09-16T17:00:35.728145] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-16T17:00:35.739233] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-09-16T17:00:36.544846] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-16T17:00:36.551070] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-09-16T17:00:36.819268] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-16T17:00:36.822974] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-09-16T17:00:37.183785] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-16T17:00:37.194900] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-09-16T17:00:37.645484] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-16T17:00:37.651580] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-09-16T17:00:37.926261] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-16T17:00:37.932067] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-09-16T17:00:37.974002] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-16T17:00:37.985924] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-09-16T17:00:38.628546] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-16T17:00:38.640033] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-09-16T17:00:38.956965] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-16T17:00:38.964101] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-09-16T17:00:39.046063] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-16T17:00:39.052194] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-09-16T17:00:39.739411] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-16T17:00:39.742981] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-09-16T17:00:39.822859] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-16T17:00:39.860722] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-09-16T17:00:39.863498] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-16T17:00:39.875632] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-09-16T17:00:40.337337] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-16T17:00:40.348836] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-09-16T17:00:40.385714] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-16T17:00:40.391543] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-09-16T17:00:40.947150] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-16T17:00:40.951101] [INFO ] [REMOTE ] ABCB: Full fetch complete (33234 records). [2025-09-16T17:00:40.951202] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-09-16T17:00:41.374282] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-09-16T17:00:41.374369] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-09-16T17:00:41.374818] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-09-16T17:00:41.374904] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-09-16T17:00:41.376024] [DEBUG] [LOCAL ] ABCB: Trimmed 33234 records to 21813 (keeping 150 days of data) [2025-09-16T17:00:41.499223] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-16T17:00:41.506165] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-09-16T17:00:41.536693] [DEBUG] [LOCAL ] ABCB: Primary data saved (21813 records). [2025-09-16T17:00:41.536819] [INFO ] [MAIN ] ABCB: Full history saved. [2025-09-16T17:00:41.536908] [INFO ] [MAIN ] Update Progress: 10/2369 symbols completed. ABCB took 11.6s. Estimated remaining: 2h 31m 10s. Rate: 15.6 symbols/min [2025-09-16T17:00:41.711931] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:00:41.735674] [DEBUG] [LOCAL ] ABM: Loaded 23119 existing records from primary storage. [2025-09-16T17:00:41.735832] [INFO ] [MAIN ] ABM: Loaded 23119 existing records. [2025-09-16T17:00:41.921936] [WARN ] [MAIN ] ABM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:00:41.922234] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-09-16T17:00:41.922372] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-09-16T17:00:41.923010] [DEBUG] [LOCAL ] ABM: Deleted primary data file. [2025-09-16T17:00:41.923071] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-09-16T17:00:42.072515] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-16T17:00:42.151274] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-09-16T17:00:42.332151] [INFO ] [REMOTE ] ABM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:00:42.332570] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-09-16T17:00:42.368289] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-16T17:00:42.380057] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-09-16T17:00:42.464429] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-16T17:00:42.469006] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-09-16T17:00:43.228885] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-16T17:00:43.233912] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-09-16T17:00:43.262630] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-16T17:00:43.265701] [INFO ] [REMOTE ] ABG: Full fetch complete (20403 records). [2025-09-16T17:00:43.265838] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-09-16T17:00:43.660578] [DEBUG] [VALIDATOR ] ABG: All expected trading days are present. [2025-09-16T17:00:43.660687] [DEBUG] [VALIDATOR ] ABG: Primary data validation passed. [2025-09-16T17:00:43.660986] [INFO ] [MAIN ] ABG: Fetched primary data is valid. [2025-09-16T17:00:43.661031] [DEBUG] [LOCAL ] ABG: Saving primary data. [2025-09-16T17:00:43.661777] [DEBUG] [LOCAL ] ABG: Trimmed 20403 records to 12960 (keeping 150 days of data) [2025-09-16T17:00:43.742744] [DEBUG] [LOCAL ] ABG: Primary data saved (12960 records). [2025-09-16T17:00:43.742916] [INFO ] [MAIN ] ABG: Full history saved. [2025-09-16T17:00:43.743027] [INFO ] [MAIN ] Update Progress: 11/2369 symbols completed. ABG took 8.9s. Estimated remaining: 2h 25m 15s. Rate: 16.2 symbols/min [2025-09-16T17:00:43.920755] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:00:43.964823] [DEBUG] [LOCAL ] ABR: Loaded 38398 existing records from primary storage. [2025-09-16T17:00:43.964976] [INFO ] [MAIN ] ABR: Loaded 38398 existing records. [2025-09-16T17:00:44.153571] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:00:44.154125] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-09-16T17:00:44.154272] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-09-16T17:00:44.155278] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-09-16T17:00:44.155356] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-09-16T17:00:44.355312] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-16T17:00:44.433376] [INFO ] [REMOTE ] ABBV: Full fetch complete (58363 records). [2025-09-16T17:00:44.463104] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-09-16T17:00:44.689830] [INFO ] [REMOTE ] ABR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:00:44.706022] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-09-16T17:00:44.911991] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-16T17:00:44.999281] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-09-16T17:00:45.041483] [DEBUG] [VALIDATOR ] ABBV: All expected trading days are present. [2025-09-16T17:00:45.045600] [DEBUG] [VALIDATOR ] ABBV: Primary data validation passed. [2025-09-16T17:00:45.046315] [INFO ] [MAIN ] ABBV: Fetched primary data is valid. [2025-09-16T17:00:45.046708] [DEBUG] [LOCAL ] ABBV: Saving primary data. [2025-09-16T17:00:45.049194] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (2.67 seconds). [2025-09-16T17:00:45.061604] [DEBUG] [LOCAL ] ABBV: Trimmed 58363 records to 40044 (keeping 150 days of data) [2025-09-16T17:00:45.061489] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-09-16T17:00:45.313309] [DEBUG] [LOCAL ] ABBV: Primary data saved (40044 records). [2025-09-16T17:00:45.313444] [INFO ] [MAIN ] ABBV: Full history saved. [2025-09-16T17:00:45.315136] [INFO ] [MAIN ] Update Progress: 12/2369 symbols completed. ABBV took 18.7s. Estimated remaining: 2h 18m 14s. Rate: 17.1 symbols/min [2025-09-16T17:00:45.492109] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:00:45.536730] [DEBUG] [LOCAL ] ABT: Loaded 39593 existing records from primary storage. [2025-09-16T17:00:45.537111] [INFO ] [MAIN ] ABT: Loaded 39593 existing records. [2025-09-16T17:00:45.719178] [WARN ] [MAIN ] ABT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:00:45.719485] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-09-16T17:00:45.719534] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-09-16T17:00:45.720552] [DEBUG] [LOCAL ] ABT: Deleted primary data file. [2025-09-16T17:00:45.720607] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-09-16T17:00:46.076658] [INFO ] [REMOTE ] ABT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:00:46.077005] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-09-16T17:00:46.435311] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-16T17:00:46.445222] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-09-16T17:00:46.621913] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-16T17:00:46.630923] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-09-16T17:00:47.040032] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-16T17:00:47.046670] [INFO ] [REMOTE ] ABEV: Full fetch complete (57904 records). [2025-09-16T17:00:47.046813] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-09-16T17:00:47.462086] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-09-16T17:00:47.462299] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-09-16T17:00:47.462992] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-09-16T17:00:47.463085] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-09-16T17:00:47.464776] [DEBUG] [LOCAL ] ABEV: Trimmed 57904 records to 39678 (keeping 150 days of data) [2025-09-16T17:00:47.592630] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-16T17:00:47.612318] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-09-16T17:00:47.748230] [DEBUG] [LOCAL ] ABEV: Primary data saved (39678 records). [2025-09-16T17:00:47.748455] [INFO ] [MAIN ] ABEV: Full history saved. [2025-09-16T17:00:47.748588] [INFO ] [MAIN ] Update Progress: 13/2369 symbols completed. ABEV took 16.8s. Estimated remaining: 2h 14m 54s. Rate: 17.5 symbols/min [2025-09-16T17:00:47.921848] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:00:47.940768] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-16T17:00:47.946835] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-09-16T17:00:47.962870] [DEBUG] [LOCAL ] ACA: Loaded 16627 existing records from primary storage. [2025-09-16T17:00:47.963068] [INFO ] [MAIN ] ACA: Loaded 16627 existing records. [2025-09-16T17:00:48.164108] [WARN ] [MAIN ] ACA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:00:48.189259] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-09-16T17:00:48.189368] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-09-16T17:00:48.190121] [DEBUG] [LOCAL ] ACA: Deleted primary data file. [2025-09-16T17:00:48.190185] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-09-16T17:00:48.191891] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-16T17:00:48.279366] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-09-16T17:00:48.563613] [INFO ] [REMOTE ] ACA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:00:48.563986] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-09-16T17:00:49.275777] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-16T17:00:49.289361] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-09-16T17:00:49.334310] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-16T17:00:49.341500] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-09-16T17:00:49.783617] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-16T17:00:49.789076] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-09-16T17:00:50.072436] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-16T17:00:50.083708] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-09-16T17:00:50.722820] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-16T17:00:50.741596] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-16T17:00:50.748511] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-09-16T17:00:50.750012] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-09-16T17:00:50.873239] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-16T17:00:50.884738] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-09-16T17:00:51.693234] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-16T17:00:51.705329] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-09-16T17:00:51.914626] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-16T17:00:51.920762] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-09-16T17:00:52.075432] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-16T17:00:52.082512] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-09-16T17:00:52.728030] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-16T17:00:52.739921] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-09-16T17:00:52.766029] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-16T17:00:52.772309] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-09-16T17:00:53.431804] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-16T17:00:53.436611] [INFO ] [REMOTE ] ABM: Full fetch complete (34314 records). [2025-09-16T17:00:53.436723] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-09-16T17:00:53.825115] [DEBUG] [VALIDATOR ] ABM: All expected trading days are present. [2025-09-16T17:00:53.825450] [DEBUG] [VALIDATOR ] ABM: Primary data validation passed. [2025-09-16T17:00:53.826330] [INFO ] [MAIN ] ABM: Fetched primary data is valid. [2025-09-16T17:00:53.826593] [DEBUG] [LOCAL ] ABM: Saving primary data. [2025-09-16T17:00:53.839922] [DEBUG] [LOCAL ] ABM: Trimmed 34314 records to 23397 (keeping 150 days of data) [2025-09-16T17:00:53.843530] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-16T17:00:53.850166] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-09-16T17:00:53.985326] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-09-16T17:00:54.016104] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-09-16T17:00:54.041406] [DEBUG] [LOCAL ] ABM: Primary data saved (23397 records). [2025-09-16T17:00:54.041573] [INFO ] [MAIN ] ABM: Full history saved. [2025-09-16T17:00:54.041705] [INFO ] [MAIN ] Update Progress: 14/2369 symbols completed. ABM took 12.5s. Estimated remaining: 2h 22m 51s. Rate: 16.5 symbols/min [2025-09-16T17:00:54.215556] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:00:54.248681] [DEBUG] [LOCAL ] ACCO: Loaded 27389 existing records from primary storage. [2025-09-16T17:00:54.248840] [INFO ] [MAIN ] ACCO: Loaded 27389 existing records. [2025-09-16T17:00:54.434457] [WARN ] [MAIN ] ACCO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:00:54.434813] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-09-16T17:00:54.434869] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-09-16T17:00:54.435714] [DEBUG] [LOCAL ] ACCO: Deleted primary data file. [2025-09-16T17:00:54.435781] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-09-16T17:00:54.813341] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:00:54.813998] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-09-16T17:00:54.857335] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-16T17:00:54.867413] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-16T17:00:54.878232] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-09-16T17:00:54.880160] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-09-16T17:00:55.631368] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-16T17:00:55.637101] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-09-16T17:00:56.027739] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-16T17:00:56.039503] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-09-16T17:00:56.539457] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-16T17:00:56.547416] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-09-16T17:00:56.584248] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-16T17:00:56.597250] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-09-16T17:00:56.605000] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-16T17:00:56.608054] [INFO ] [REMOTE ] ACA: Full fetch complete (26463 records). [2025-09-16T17:00:56.608232] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-09-16T17:00:56.991436] [DEBUG] [VALIDATOR ] ACA: All expected trading days are present. [2025-09-16T17:00:56.991528] [DEBUG] [VALIDATOR ] ACA: Primary data validation passed. [2025-09-16T17:00:56.991871] [INFO ] [MAIN ] ACA: Fetched primary data is valid. [2025-09-16T17:00:56.991939] [DEBUG] [LOCAL ] ACA: Saving primary data. [2025-09-16T17:00:56.992982] [DEBUG] [LOCAL ] ACA: Trimmed 26463 records to 16738 (keeping 150 days of data) [2025-09-16T17:00:57.096067] [DEBUG] [LOCAL ] ACA: Primary data saved (16738 records). [2025-09-16T17:00:57.096230] [INFO ] [MAIN ] ACA: Full history saved. [2025-09-16T17:00:57.096336] [INFO ] [MAIN ] Update Progress: 15/2369 symbols completed. ACA took 9.3s. Estimated remaining: 2h 21m 16s. Rate: 16.7 symbols/min [2025-09-16T17:00:57.268777] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:00:57.268949] [DEBUG] [LOCAL ] ACEL: No existing data file found in primary storage. [2025-09-16T17:00:57.268988] [WARN ] [MAIN ] ACEL: No existing data found, performing full refresh instead. [2025-09-16T17:00:57.269109] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-09-16T17:00:57.269149] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-09-16T17:00:57.269190] [DEBUG] [LOCAL ] ACEL: No primary data file found to delete. [2025-09-16T17:00:57.269224] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-09-16T17:00:57.659326] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:00:57.659823] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-09-16T17:00:57.723274] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-16T17:00:57.735213] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-09-16T17:00:58.277466] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-16T17:00:58.289006] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-09-16T17:00:58.523978] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-16T17:00:58.533848] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-09-16T17:00:59.248790] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-16T17:00:59.254836] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-09-16T17:00:59.579208] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-16T17:00:59.585522] [INFO ] [REMOTE ] ABR: Full fetch complete (56739 records). [2025-09-16T17:00:59.585741] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-09-16T17:01:00.031766] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-09-16T17:01:00.054334] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-09-16T17:01:00.055452] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-09-16T17:01:00.055703] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-09-16T17:01:00.057569] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-16T17:01:00.067276] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-09-16T17:01:00.067792] [DEBUG] [LOCAL ] ABR: Trimmed 56739 records to 38749 (keeping 150 days of data) [2025-09-16T17:01:00.206092] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-16T17:01:00.223168] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-09-16T17:01:00.341431] [DEBUG] [LOCAL ] ABR: Primary data saved (38749 records). [2025-09-16T17:01:00.358256] [INFO ] [MAIN ] ABR: Full history saved. [2025-09-16T17:01:00.362388] [INFO ] [MAIN ] Update Progress: 16/2369 symbols completed. ABR took 16.6s. Estimated remaining: 2h 20m 23s. Rate: 16.8 symbols/min [2025-09-16T17:01:00.414131] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-16T17:01:00.480261] [INFO ] [REMOTE ] ABT: Full fetch complete (58290 records). [2025-09-16T17:01:00.491079] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-09-16T17:01:00.603222] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:01:00.974852] [DEBUG] [LOCAL ] ACHR: Loaded 39778 existing records from primary storage. [2025-09-16T17:01:00.993497] [INFO ] [MAIN ] ACHR: Loaded 39778 existing records. [2025-09-16T17:01:01.045434] [DEBUG] [VALIDATOR ] ABT: All expected trading days are present. [2025-09-16T17:01:01.088196] [DEBUG] [VALIDATOR ] ABT: Primary data validation passed. [2025-09-16T17:01:01.100697] [INFO ] [MAIN ] ABT: Fetched primary data is valid. [2025-09-16T17:01:01.131190] [DEBUG] [LOCAL ] ABT: Saving primary data. [2025-09-16T17:01:01.193111] [DEBUG] [LOCAL ] ABT: Trimmed 58290 records to 39983 (keeping 150 days of data) [2025-09-16T17:01:01.216607] [WARN ] [MAIN ] ACHR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:01:01.217284] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-09-16T17:01:01.217339] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-09-16T17:01:01.218213] [DEBUG] [LOCAL ] ACHR: Deleted primary data file. [2025-09-16T17:01:01.218272] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-09-16T17:01:01.703271] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:01:01.703924] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-09-16T17:01:01.860169] [DEBUG] [LOCAL ] ABT: Primary data saved (39983 records). [2025-09-16T17:01:01.860355] [INFO ] [MAIN ] ABT: Full history saved. [2025-09-16T17:01:01.861744] [INFO ] [MAIN ] Update Progress: 17/2369 symbols completed. ABT took 16.5s. Estimated remaining: 2h 15m 32s. Rate: 17.4 symbols/min [2025-09-16T17:01:02.037295] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:01:02.037489] [DEBUG] [LOCAL ] ACI: No existing data file found in primary storage. [2025-09-16T17:01:02.037528] [WARN ] [MAIN ] ACI: No existing data found, performing full refresh instead. [2025-09-16T17:01:02.037711] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-09-16T17:01:02.037764] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-09-16T17:01:02.037813] [DEBUG] [LOCAL ] ACI: No primary data file found to delete. [2025-09-16T17:01:02.037847] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-09-16T17:01:02.414595] [INFO ] [REMOTE ] ACI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:01:02.415278] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-09-16T17:01:02.448404] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-09-16T17:01:02.460560] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-09-16T17:01:02.825931] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-09-16T17:01:02.833747] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-09-16T17:01:03.850893] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-16T17:01:03.859687] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-09-16T17:01:03.927345] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-16T17:01:04.125992] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-16T17:01:04.374985] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-09-16T17:01:04.921092] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (3.22 seconds). [2025-09-16T17:01:05.136980] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-16T17:01:05.174935] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-09-16T17:01:05.974941] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-09-16T17:01:06.199699] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-16T17:01:06.774911] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-09-16T17:01:07.343126] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-16T17:01:07.416015] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-16T17:01:07.574923] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-09-16T17:01:08.207935] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-16T17:01:08.374884] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-09-16T17:01:09.063687] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-16T17:01:09.069153] [INFO ] [REMOTE ] ACCO: Full fetch complete (41481 records). [2025-09-16T17:01:09.069413] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-09-16T17:01:09.180599] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-09-16T17:01:09.478221] [DEBUG] [VALIDATOR ] ACCO: All expected trading days are present. [2025-09-16T17:01:09.478338] [DEBUG] [VALIDATOR ] ACCO: Primary data validation passed. [2025-09-16T17:01:09.478974] [INFO ] [MAIN ] ACCO: Fetched primary data is valid. [2025-09-16T17:01:09.479036] [DEBUG] [LOCAL ] ACCO: Saving primary data. [2025-09-16T17:01:09.480264] [DEBUG] [LOCAL ] ACCO: Trimmed 41481 records to 27598 (keeping 150 days of data) [2025-09-16T17:01:09.651009] [DEBUG] [LOCAL ] ACCO: Primary data saved (27598 records). [2025-09-16T17:01:09.651250] [INFO ] [MAIN ] ACCO: Full history saved. [2025-09-16T17:01:09.651379] [INFO ] [MAIN ] Update Progress: 18/2369 symbols completed. ACCO took 15.6s. Estimated remaining: 2h 24m 54s. Rate: 16.2 symbols/min [2025-09-16T17:01:09.841969] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:01:09.890527] [DEBUG] [LOCAL ] ACM: Loaded 31167 existing records from primary storage. [2025-09-16T17:01:09.908682] [INFO ] [MAIN ] ACM: Loaded 31167 existing records. [2025-09-16T17:01:09.983372] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-16T17:01:09.980726] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-09-16T17:01:10.119871] [WARN ] [MAIN ] ACM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:01:10.120224] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-09-16T17:01:10.120278] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-09-16T17:01:10.121289] [DEBUG] [LOCAL ] ACM: Deleted primary data file. [2025-09-16T17:01:10.121356] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-09-16T17:01:10.499705] [INFO ] [REMOTE ] ACM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:01:10.515119] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-16T17:01:10.774919] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-09-16T17:01:11.540332] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-16T17:01:11.574852] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-09-16T17:01:12.287824] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-16T17:01:12.374855] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-09-16T17:01:12.767181] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-16T17:01:13.174921] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-09-16T17:01:13.974972] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-09-16T17:01:14.774886] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-09-16T17:01:15.046471] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.67 seconds). [2025-09-16T17:01:15.151456] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-16T17:01:15.308757] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-16T17:01:15.574905] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-09-16T17:01:15.775481] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-16T17:01:15.778796] [INFO ] [REMOTE ] ACEL: Full fetch complete (30128 records). [2025-09-16T17:01:15.778894] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-09-16T17:01:15.779531] [FATAL] [VALIDATOR ] ACEL: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:01:15.779616] [FATAL] [MAIN ] ACEL: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:01:15.779675] [WARN ] [MAIN ] ACEL: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:01:15.779716] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-09-16T17:01:15.779775] [DEBUG] [LOCAL ] ACEL: No primary data file found to delete. [2025-09-16T17:01:15.779818] [INFO ] [LOCAL ] ACEL: Starting deletion of derivative data. [2025-09-16T17:01:15.779867] [DEBUG] [LOCAL ] ACEL: No derivative data file found to delete. [2025-09-16T17:01:15.779929] [INFO ] [MAIN ] Update Progress: 19/2369 symbols completed. ACEL took 18.7s. Estimated remaining: 2h 29m 51s. Rate: 15.7 symbols/min [2025-09-16T17:01:15.954782] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:01:15.955002] [DEBUG] [LOCAL ] ACN: No existing data file found in primary storage. [2025-09-16T17:01:15.955043] [WARN ] [MAIN ] ACN: No existing data found, performing full refresh instead. [2025-09-16T17:01:15.955174] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-09-16T17:01:15.955221] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-09-16T17:01:15.955266] [DEBUG] [LOCAL ] ACN: No primary data file found to delete. [2025-09-16T17:01:15.955301] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-09-16T17:01:16.316720] [INFO ] [REMOTE ] ACN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:01:16.374894] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-09-16T17:01:16.938783] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-16T17:01:17.174931] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-09-16T17:01:17.974930] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-09-16T17:01:18.203214] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-16T17:01:18.774899] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-09-16T17:01:18.805824] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-16T17:01:19.574892] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-09-16T17:01:19.625220] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-16T17:01:20.374907] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-09-16T17:01:21.127544] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-09-16T17:01:21.174867] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-09-16T17:01:21.472878] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-16T17:01:21.684512] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-16T17:01:21.974974] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-09-16T17:01:22.774937] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-09-16T17:01:23.541142] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-16T17:01:23.574972] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-09-16T17:01:23.711896] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-09-16T17:01:24.374929] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-09-16T17:01:24.638005] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-16T17:01:24.645806] [INFO ] [REMOTE ] ACI: Full fetch complete (57874 records). [2025-09-16T17:01:24.646000] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-09-16T17:01:25.042948] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-09-16T17:01:25.043031] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-09-16T17:01:25.043679] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-09-16T17:01:25.043747] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-09-16T17:01:25.046085] [DEBUG] [LOCAL ] ACI: Trimmed 57874 records to 39673 (keeping 150 days of data) [2025-09-16T17:01:25.175257] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-09-16T17:01:25.303271] [DEBUG] [LOCAL ] ACI: Primary data saved (39673 records). [2025-09-16T17:01:25.303421] [INFO ] [MAIN ] ACI: Full history saved. [2025-09-16T17:01:25.303501] [INFO ] [MAIN ] Update Progress: 20/2369 symbols completed. ACI took 23.4s. Estimated remaining: 2h 40m 56s. Rate: 14.6 symbols/min [2025-09-16T17:01:25.520696] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:01:25.523424] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-16T17:01:25.555824] [DEBUG] [LOCAL ] ACP: Loaded 22894 existing records from primary storage. [2025-09-16T17:01:25.555949] [INFO ] [MAIN ] ACP: Loaded 22894 existing records. [2025-09-16T17:01:25.734665] [WARN ] [MAIN ] ACP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:01:25.734964] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-09-16T17:01:25.735045] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-09-16T17:01:25.735582] [DEBUG] [LOCAL ] ACP: Deleted primary data file. [2025-09-16T17:01:25.735636] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-09-16T17:01:25.979978] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-09-16T17:01:26.102025] [INFO ] [REMOTE ] ACP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:01:26.536102] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-16T17:01:26.774922] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-09-16T17:01:26.829534] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-09-16T17:01:27.574902] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-09-16T17:01:27.846573] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-16T17:01:28.061164] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-16T17:01:28.374917] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-09-16T17:01:29.174921] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-09-16T17:01:29.974914] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-09-16T17:01:30.074354] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-16T17:01:30.100044] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-09-16T17:01:30.106743] [INFO ] [REMOTE ] ACHR: Full fetch complete (58498 records). [2025-09-16T17:01:30.106857] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-09-16T17:01:30.492970] [DEBUG] [VALIDATOR ] ACHR: All expected trading days are present. [2025-09-16T17:01:30.493065] [DEBUG] [VALIDATOR ] ACHR: Primary data validation passed. [2025-09-16T17:01:30.493685] [INFO ] [MAIN ] ACHR: Fetched primary data is valid. [2025-09-16T17:01:30.493746] [DEBUG] [LOCAL ] ACHR: Saving primary data. [2025-09-16T17:01:30.495244] [DEBUG] [LOCAL ] ACHR: Trimmed 58498 records to 40168 (keeping 150 days of data) [2025-09-16T17:01:30.742170] [DEBUG] [LOCAL ] ACHR: Primary data saved (40168 records). [2025-09-16T17:01:30.742312] [INFO ] [MAIN ] ACHR: Full history saved. [2025-09-16T17:01:30.743321] [INFO ] [MAIN ] Update Progress: 21/2369 symbols completed. ACHR took 30.4s. Estimated remaining: 2h 43m 21s. Rate: 14.4 symbols/min [2025-09-16T17:01:30.777038] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-09-16T17:01:30.924948] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:01:30.925168] [DEBUG] [LOCAL ] ACR: No existing data file found in primary storage. [2025-09-16T17:01:30.925241] [WARN ] [MAIN ] ACR: No existing data found, performing full refresh instead. [2025-09-16T17:01:30.925460] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-09-16T17:01:30.925533] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-09-16T17:01:30.925694] [DEBUG] [LOCAL ] ACR: No primary data file found to delete. [2025-09-16T17:01:30.925737] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-09-16T17:01:31.081451] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-16T17:01:31.340102] [INFO ] [REMOTE ] ACR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:01:31.359545] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-16T17:01:31.574907] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-09-16T17:01:32.374893] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-09-16T17:01:32.419817] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-16T17:01:33.174904] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-09-16T17:01:33.388533] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-16T17:01:33.810676] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-16T17:01:33.974947] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-09-16T17:01:34.546868] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-16T17:01:34.553207] [INFO ] [REMOTE ] ACM: Full fetch complete (47212 records). [2025-09-16T17:01:34.553390] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-09-16T17:01:34.780101] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-09-16T17:01:34.959950] [DEBUG] [VALIDATOR ] ACM: All expected trading days are present. [2025-09-16T17:01:34.960088] [DEBUG] [VALIDATOR ] ACM: Primary data validation passed. [2025-09-16T17:01:34.960608] [INFO ] [MAIN ] ACM: Fetched primary data is valid. [2025-09-16T17:01:34.960679] [DEBUG] [LOCAL ] ACM: Saving primary data. [2025-09-16T17:01:34.961917] [DEBUG] [LOCAL ] ACM: Trimmed 47212 records to 31522 (keeping 150 days of data) [2025-09-16T17:01:35.112263] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-16T17:01:35.205634] [DEBUG] [LOCAL ] ACM: Primary data saved (31522 records). [2025-09-16T17:01:35.205862] [INFO ] [MAIN ] ACM: Full history saved. [2025-09-16T17:01:35.207315] [INFO ] [MAIN ] Update Progress: 22/2369 symbols completed. ACM took 25.6s. Estimated remaining: 2h 43m 48s. Rate: 14.3 symbols/min [2025-09-16T17:01:35.383181] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:01:35.383359] [DEBUG] [LOCAL ] ACRE: No existing data file found in primary storage. [2025-09-16T17:01:35.383408] [WARN ] [MAIN ] ACRE: No existing data found, performing full refresh instead. [2025-09-16T17:01:35.383548] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-09-16T17:01:35.383593] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-09-16T17:01:35.383680] [DEBUG] [LOCAL ] ACRE: No primary data file found to delete. [2025-09-16T17:01:35.383733] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-09-16T17:01:35.580111] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-09-16T17:01:35.762537] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:01:36.374951] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-09-16T17:01:36.586715] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-16T17:01:36.944302] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-16T17:01:37.155292] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-16T17:01:37.174913] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-09-16T17:01:37.975014] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-09-16T17:01:38.500032] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-16T17:01:38.774935] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-09-16T17:01:38.858452] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-16T17:01:39.575177] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-09-16T17:01:39.995837] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-16T17:01:40.264730] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-16T17:01:40.374934] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-09-16T17:01:41.174916] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-09-16T17:01:41.397774] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-16T17:01:41.401696] [INFO ] [REMOTE ] ACP: Full fetch complete (34242 records). [2025-09-16T17:01:41.401883] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-09-16T17:01:41.402610] [FATAL] [VALIDATOR ] ACP: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:01:41.402719] [FATAL] [MAIN ] ACP: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:01:41.402807] [WARN ] [MAIN ] ACP: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:01:41.402884] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-09-16T17:01:41.402957] [DEBUG] [LOCAL ] ACP: No primary data file found to delete. [2025-09-16T17:01:41.403014] [INFO ] [LOCAL ] ACP: Starting deletion of derivative data. [2025-09-16T17:01:41.403329] [DEBUG] [LOCAL ] ACP: Deleted derivative data file. [2025-09-16T17:01:41.403422] [INFO ] [MAIN ] Update Progress: 23/2369 symbols completed. ACP took 16.1s. Estimated remaining: 2h 47m 8s. Rate: 14.0 symbols/min [2025-09-16T17:01:41.586795] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:01:41.593191] [DEBUG] [LOCAL ] ACV: Loaded 4587 existing records from primary storage. [2025-09-16T17:01:41.593308] [INFO ] [MAIN ] ACV: Loaded 4587 existing records. [2025-09-16T17:01:41.785229] [WARN ] [MAIN ] ACV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:01:41.785505] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-09-16T17:01:41.785567] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-09-16T17:01:41.785865] [DEBUG] [LOCAL ] ACV: Deleted primary data file. [2025-09-16T17:01:41.785916] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-09-16T17:01:41.980029] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-09-16T17:01:42.166702] [INFO ] [REMOTE ] ACV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:01:42.774897] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-09-16T17:01:43.175859] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-16T17:01:43.184515] [INFO ] [REMOTE ] ACN: Full fetch complete (58032 records). [2025-09-16T17:01:43.184749] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-09-16T17:01:43.442745] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-16T17:01:43.577477] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-09-16T17:01:43.614369] [DEBUG] [VALIDATOR ] ACN: All expected trading days are present. [2025-09-16T17:01:43.614565] [DEBUG] [VALIDATOR ] ACN: Primary data validation passed. [2025-09-16T17:01:43.615249] [INFO ] [MAIN ] ACN: Fetched primary data is valid. [2025-09-16T17:01:43.615358] [DEBUG] [LOCAL ] ACN: Saving primary data. [2025-09-16T17:01:43.637188] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-16T17:01:43.635836] [DEBUG] [LOCAL ] ACN: Trimmed 58032 records to 39800 (keeping 150 days of data) [2025-09-16T17:01:43.923357] [DEBUG] [LOCAL ] ACN: Primary data saved (39800 records). [2025-09-16T17:01:43.923591] [INFO ] [MAIN ] ACN: Full history saved. [2025-09-16T17:01:43.923726] [INFO ] [MAIN ] Update Progress: 24/2369 symbols completed. ACN took 28.1s. Estimated remaining: 2h 44m 13s. Rate: 14.3 symbols/min [2025-09-16T17:01:44.103047] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:01:44.142004] [DEBUG] [LOCAL ] ACVA: Loaded 35821 existing records from primary storage. [2025-09-16T17:01:44.142146] [INFO ] [MAIN ] ACVA: Loaded 35821 existing records. [2025-09-16T17:01:44.327986] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:01:44.328450] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-09-16T17:01:44.328498] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-09-16T17:01:44.329499] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-09-16T17:01:44.329551] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-09-16T17:01:44.384386] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-09-16T17:01:44.471197] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-16T17:01:44.709326] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:01:45.113984] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-16T17:01:45.174889] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-09-16T17:01:45.974927] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-09-16T17:01:46.459511] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-16T17:01:46.774946] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-09-16T17:01:47.374753] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-16T17:01:47.574915] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-09-16T17:01:48.238501] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-16T17:01:48.374918] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-09-16T17:01:48.398518] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-16T17:01:49.174903] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-09-16T17:01:49.721882] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-16T17:01:49.974918] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-09-16T17:01:50.774956] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-09-16T17:01:51.011619] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-16T17:01:51.012404] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-16T17:01:51.574928] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-09-16T17:01:51.678437] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-16T17:01:52.374912] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-09-16T17:01:52.965947] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-16T17:01:53.174912] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-09-16T17:01:53.828144] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-16T17:01:53.974924] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-09-16T17:01:54.042361] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-16T17:01:54.574960] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-16T17:01:54.774907] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-09-16T17:01:55.249138] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-16T17:01:55.574913] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-09-16T17:01:56.146590] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-16T17:01:56.374911] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-09-16T17:01:57.174915] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-09-16T17:01:57.876847] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-16T17:01:57.876634] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-16T17:01:57.885878] [INFO ] [REMOTE ] ACV: Full fetch complete (7400 records). [2025-09-16T17:01:57.886080] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-09-16T17:01:57.979986] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-09-16T17:01:58.249919] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-09-16T17:01:58.250003] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-09-16T17:01:58.250168] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-09-16T17:01:58.250210] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-09-16T17:01:58.250713] [DEBUG] [LOCAL ] ACV: Trimmed 7400 records to 4619 (keeping 150 days of data) [2025-09-16T17:01:58.280544] [DEBUG] [LOCAL ] ACV: Primary data saved (4619 records). [2025-09-16T17:01:58.280717] [INFO ] [MAIN ] ACV: Full history saved. [2025-09-16T17:01:58.280817] [INFO ] [MAIN ] Update Progress: 25/2369 symbols completed. ACV took 16.9s. Estimated remaining: 3h 0m 1s. Rate: 13.0 symbols/min [2025-09-16T17:01:58.455582] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:01:58.455808] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-09-16T17:01:58.455848] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-09-16T17:01:58.455969] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-09-16T17:01:58.456009] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-16T17:01:58.456050] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-16T17:01:58.456083] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-09-16T17:01:58.785099] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-09-16T17:01:58.825519] [INFO ] [REMOTE ] AD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:01:59.177778] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-16T17:01:59.447765] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-16T17:01:59.574875] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-09-16T17:02:00.374895] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-02. [2025-09-16T17:02:01.012629] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-16T17:02:01.016523] [INFO ] [REMOTE ] ACRE: Full fetch complete (37187 records). [2025-09-16T17:02:01.016634] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-09-16T17:02:01.094601] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:02:01.111237] [WARN ] [REMOTE ] AD: No data returned for month 2025-02 [2025-09-16T17:02:01.181266] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-09-16T17:02:01.414026] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-09-16T17:02:01.414111] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-09-16T17:02:01.414506] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-09-16T17:02:01.414549] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-09-16T17:02:01.415404] [DEBUG] [LOCAL ] ACRE: Trimmed 37187 records to 24288 (keeping 150 days of data) [2025-09-16T17:02:01.565109] [DEBUG] [LOCAL ] ACRE: Primary data saved (24288 records). [2025-09-16T17:02:01.565262] [INFO ] [MAIN ] ACRE: Full history saved. [2025-09-16T17:02:01.565344] [INFO ] [MAIN ] Update Progress: 26/2369 symbols completed. ACRE took 26.4s. Estimated remaining: 2h 57m 57s. Rate: 13.2 symbols/min [2025-09-16T17:02:01.766509] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:02:01.807243] [DEBUG] [LOCAL ] ADC: Loaded 34268 existing records from primary storage. [2025-09-16T17:02:01.807392] [INFO ] [MAIN ] ADC: Loaded 34268 existing records. [2025-09-16T17:02:01.989722] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-03. [2025-09-16T17:02:01.994553] [WARN ] [MAIN ] ADC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:02:01.995541] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-09-16T17:02:01.995590] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-09-16T17:02:01.996424] [DEBUG] [LOCAL ] ADC: Deleted primary data file. [2025-09-16T17:02:01.996477] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-09-16T17:02:02.296827] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:02:02.308835] [WARN ] [REMOTE ] AD: No data returned for month 2025-03 [2025-09-16T17:02:02.384267] [INFO ] [REMOTE ] ADC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:02:02.774944] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-04. [2025-09-16T17:02:03.068618] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-16T17:02:03.069815] [INFO ] [REMOTE ] ACR: Full fetch complete (7063 records). [2025-09-16T17:02:03.069887] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-09-16T17:02:03.246491] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:02:03.266834] [WARN ] [REMOTE ] AD: No data returned for month 2025-04 [2025-09-16T17:02:03.463910] [DEBUG] [VALIDATOR ] ACR: All expected trading days are present. [2025-09-16T17:02:03.463994] [DEBUG] [VALIDATOR ] ACR: Primary data validation passed. [2025-09-16T17:02:03.464193] [INFO ] [MAIN ] ACR: Fetched primary data is valid. [2025-09-16T17:02:03.464235] [DEBUG] [LOCAL ] ACR: Saving primary data. [2025-09-16T17:02:03.464676] [DEBUG] [LOCAL ] ACR: Trimmed 7063 records to 4172 (keeping 150 days of data) [2025-09-16T17:02:03.490660] [DEBUG] [LOCAL ] ACR: Primary data saved (4172 records). [2025-09-16T17:02:03.490792] [INFO ] [MAIN ] ACR: Full history saved. [2025-09-16T17:02:03.490882] [INFO ] [MAIN ] Update Progress: 27/2369 symbols completed. ACR took 32.7s. Estimated remaining: 2h 54m 4s. Rate: 13.5 symbols/min [2025-09-16T17:02:03.580140] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-05. [2025-09-16T17:02:03.664629] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:02:03.700561] [DEBUG] [LOCAL ] ADCT: Loaded 25686 existing records from primary storage. [2025-09-16T17:02:03.700720] [INFO ] [MAIN ] ADCT: Loaded 25686 existing records. [2025-09-16T17:02:03.837668] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:02:03.876369] [WARN ] [REMOTE ] AD: No data returned for month 2025-05 [2025-09-16T17:02:03.899698] [WARN ] [MAIN ] ADCT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:02:03.900515] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-09-16T17:02:03.900566] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-09-16T17:02:03.901164] [DEBUG] [LOCAL ] ADCT: Deleted primary data file. [2025-09-16T17:02:03.901218] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-09-16T17:02:04.269457] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:02:04.374898] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-09-16T17:02:05.174951] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-06. [2025-09-16T17:02:05.397534] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:02:05.397924] [WARN ] [REMOTE ] AD: No data returned for month 2025-06 [2025-09-16T17:02:05.697206] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-16T17:02:05.974962] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-07. [2025-09-16T17:02:06.161343] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:02:06.161685] [WARN ] [REMOTE ] AD: No data returned for month 2025-07 [2025-09-16T17:02:06.774906] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-08. [2025-09-16T17:02:07.574921] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-09-16T17:02:07.911385] [INFO ] [REMOTE ] AD: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-16T17:02:08.374973] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-09. [2025-09-16T17:02:08.751860] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-16T17:02:09.174905] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-09-16T17:02:09.498151] [INFO ] [REMOTE ] AD: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-16T17:02:09.502737] [INFO ] [REMOTE ] AD: Full fetch complete (4957 records). [2025-09-16T17:02:09.503017] [DEBUG] [VALIDATOR ] AD: Validating primary data. [2025-09-16T17:02:09.703823] [WARN ] [VALIDATOR ] AD: Validation failed - insufficient historical data. Have 25 unique days, need 150 days [2025-09-16T17:02:09.704072] [FATAL] [MAIN ] AD: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:02:09.704117] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:02:09.704161] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-16T17:02:09.704250] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-16T17:02:09.704290] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-09-16T17:02:09.704331] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-09-16T17:02:09.704391] [INFO ] [MAIN ] Update Progress: 28/2369 symbols completed. AD took 11.4s. Estimated remaining: 2h 56m 26s. Rate: 13.3 symbols/min [2025-09-16T17:02:09.904840] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:02:09.946049] [DEBUG] [LOCAL ] ADM: Loaded 39393 existing records from primary storage. [2025-09-16T17:02:09.946201] [INFO ] [MAIN ] ADM: Loaded 39393 existing records. [2025-09-16T17:02:09.980113] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-09-16T17:02:10.130242] [WARN ] [MAIN ] ADM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:02:10.130482] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-09-16T17:02:10.130537] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-09-16T17:02:10.131558] [DEBUG] [LOCAL ] ADM: Deleted primary data file. [2025-09-16T17:02:10.131620] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-09-16T17:02:10.489160] [INFO ] [REMOTE ] ADM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:02:10.580804] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-16T17:02:10.774932] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-09-16T17:02:11.574937] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-09-16T17:02:12.265438] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-09-16T17:02:12.374982] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-09-16T17:02:12.634579] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-16T17:02:13.174949] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-09-16T17:02:13.260050] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-16T17:02:13.440586] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-16T17:02:13.974922] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-09-16T17:02:14.774912] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-09-16T17:02:14.907456] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-16T17:02:15.235587] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-16T17:02:15.575058] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-09-16T17:02:16.124044] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-16T17:02:16.374985] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-09-16T17:02:17.174964] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-09-16T17:02:17.365936] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-16T17:02:17.687691] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-16T17:02:17.974934] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-09-16T17:02:18.774921] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-09-16T17:02:18.965891] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-16T17:02:19.334316] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-16T17:02:19.574934] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-09-16T17:02:20.374917] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-09-16T17:02:20.538024] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-16T17:02:21.174908] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-09-16T17:02:21.248335] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-16T17:02:21.254499] [INFO ] [REMOTE ] ACVA: Full fetch complete (53622 records). [2025-09-16T17:02:21.254619] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-09-16T17:02:21.665940] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-09-16T17:02:21.666021] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-09-16T17:02:21.666525] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-09-16T17:02:21.666570] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-09-16T17:02:21.667686] [DEBUG] [LOCAL ] ACVA: Trimmed 53622 records to 36184 (keeping 150 days of data) [2025-09-16T17:02:21.886715] [DEBUG] [LOCAL ] ACVA: Primary data saved (36184 records). [2025-09-16T17:02:21.886954] [INFO ] [MAIN ] ACVA: Full history saved. [2025-09-16T17:02:21.887057] [INFO ] [MAIN ] Update Progress: 29/2369 symbols completed. ACVA took 38.0s. Estimated remaining: 3h 6m 40s. Rate: 12.5 symbols/min [2025-09-16T17:02:21.980159] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-09-16T17:02:22.076913] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:02:22.077251] [DEBUG] [LOCAL ] ADNT: No existing data file found in primary storage. [2025-09-16T17:02:22.077323] [WARN ] [MAIN ] ADNT: No existing data found, performing full refresh instead. [2025-09-16T17:02:22.077515] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-09-16T17:02:22.077560] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-09-16T17:02:22.077601] [DEBUG] [LOCAL ] ADNT: No primary data file found to delete. [2025-09-16T17:02:22.077633] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-09-16T17:02:22.413662] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-16T17:02:22.501168] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:02:22.774940] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-09-16T17:02:22.822016] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-16T17:02:23.463537] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-16T17:02:23.574855] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-09-16T17:02:24.375764] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-16T17:02:24.375908] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-09-16T17:02:24.724109] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-16T17:02:25.174927] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-09-16T17:02:25.974952] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-09-16T17:02:26.068790] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-16T17:02:26.780035] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-09-16T17:02:26.802140] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-16T17:02:27.490785] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-16T17:02:27.574866] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-09-16T17:02:28.374878] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-09-16T17:02:28.459478] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-16T17:02:29.040331] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-16T17:02:29.174974] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-09-16T17:02:29.504172] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-16T17:02:29.508467] [INFO ] [REMOTE ] ADCT: Full fetch complete (36479 records). [2025-09-16T17:02:29.508574] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-09-16T17:02:29.888591] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-09-16T17:02:29.888695] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-09-16T17:02:29.889081] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-09-16T17:02:29.889125] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-09-16T17:02:29.889984] [DEBUG] [LOCAL ] ADCT: Trimmed 36479 records to 25885 (keeping 150 days of data) [2025-09-16T17:02:29.975549] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-09-16T17:02:30.040676] [DEBUG] [LOCAL ] ADCT: Primary data saved (25885 records). [2025-09-16T17:02:30.040819] [INFO ] [MAIN ] ADCT: Full history saved. [2025-09-16T17:02:30.040928] [INFO ] [MAIN ] Update Progress: 30/2369 symbols completed. ADCT took 26.5s. Estimated remaining: 3h 10m 57s. Rate: 12.2 symbols/min [2025-09-16T17:02:30.218421] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:02:30.257272] [DEBUG] [LOCAL ] ADT: Loaded 39482 existing records from primary storage. [2025-09-16T17:02:30.257429] [INFO ] [MAIN ] ADT: Loaded 39482 existing records. [2025-09-16T17:02:30.437525] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:02:30.437776] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-09-16T17:02:30.437826] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-09-16T17:02:30.438726] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-09-16T17:02:30.438778] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-09-16T17:02:30.776725] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-09-16T17:02:30.802841] [INFO ] [REMOTE ] ADT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:02:30.866615] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-16T17:02:31.323432] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-16T17:02:31.574952] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-09-16T17:02:32.374941] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-09-16T17:02:32.555576] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-16T17:02:33.174915] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-09-16T17:02:33.216055] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-16T17:02:33.798389] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-16T17:02:33.804481] [INFO ] [REMOTE ] ADC: Full fetch complete (50715 records). [2025-09-16T17:02:33.804674] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-09-16T17:02:33.982873] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-09-16T17:02:34.193108] [DEBUG] [VALIDATOR ] ADC: All expected trading days are present. [2025-09-16T17:02:34.193194] [DEBUG] [VALIDATOR ] ADC: Primary data validation passed. [2025-09-16T17:02:34.193800] [INFO ] [MAIN ] ADC: Fetched primary data is valid. [2025-09-16T17:02:34.193850] [DEBUG] [LOCAL ] ADC: Saving primary data. [2025-09-16T17:02:34.194953] [DEBUG] [LOCAL ] ADC: Trimmed 50715 records to 34611 (keeping 150 days of data) [2025-09-16T17:02:34.414361] [DEBUG] [LOCAL ] ADC: Primary data saved (34611 records). [2025-09-16T17:02:34.414504] [INFO ] [MAIN ] ADC: Full history saved. [2025-09-16T17:02:34.415959] [INFO ] [MAIN ] Update Progress: 31/2369 symbols completed. ADC took 32.9s. Estimated remaining: 3h 10m 13s. Rate: 12.3 symbols/min [2025-09-16T17:02:34.589356] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:02:34.611323] [DEBUG] [LOCAL ] ADX: Loaded 20404 existing records from primary storage. [2025-09-16T17:02:34.611467] [INFO ] [MAIN ] ADX: Loaded 20404 existing records. [2025-09-16T17:02:34.776259] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-09-16T17:02:34.800385] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:02:34.800936] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-09-16T17:02:34.801053] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-09-16T17:02:34.808275] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-09-16T17:02:34.820963] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-09-16T17:02:34.828294] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-16T17:02:34.906626] [INFO ] [REMOTE ] ADM: Full fetch complete (58069 records). [2025-09-16T17:02:34.939014] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-09-16T17:02:35.509508] [INFO ] [REMOTE ] ADX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:02:35.582581] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-09-16T17:02:35.601515] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-09-16T17:02:35.601610] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-09-16T17:02:35.602277] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-09-16T17:02:35.602331] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-09-16T17:02:35.603975] [DEBUG] [LOCAL ] ADM: Trimmed 58069 records to 39782 (keeping 150 days of data) [2025-09-16T17:02:35.760046] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-16T17:02:35.886941] [DEBUG] [LOCAL ] ADM: Primary data saved (39782 records). [2025-09-16T17:02:35.887106] [INFO ] [MAIN ] ADM: Full history saved. [2025-09-16T17:02:35.887199] [INFO ] [MAIN ] Update Progress: 32/2369 symbols completed. ADM took 26.2s. Estimated remaining: 3h 5m 59s. Rate: 12.6 symbols/min [2025-09-16T17:02:36.058549] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:02:36.058732] [DEBUG] [LOCAL ] AEE: No existing data file found in primary storage. [2025-09-16T17:02:36.058772] [WARN ] [MAIN ] AEE: No existing data found, performing full refresh instead. [2025-09-16T17:02:36.058893] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-09-16T17:02:36.058933] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-09-16T17:02:36.058975] [DEBUG] [LOCAL ] AEE: No primary data file found to delete. [2025-09-16T17:02:36.059008] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-09-16T17:02:36.390753] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-09-16T17:02:36.427296] [INFO ] [REMOTE ] AEE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:02:36.457554] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-16T17:02:37.084958] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-16T17:02:37.174909] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-09-16T17:02:37.667283] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-16T17:02:37.974940] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-09-16T17:02:38.760750] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-16T17:02:38.774853] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-09-16T17:02:39.426673] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-16T17:02:39.574935] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-09-16T17:02:40.228462] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-16T17:02:40.374934] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-09-16T17:02:41.174972] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-09-16T17:02:41.248286] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-16T17:02:41.974929] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-09-16T17:02:42.189112] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-16T17:02:42.587226] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-16T17:02:42.774959] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-09-16T17:02:43.443229] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-16T17:02:43.449359] [INFO ] [REMOTE ] ADNT: Full fetch complete (51503 records). [2025-09-16T17:02:43.449546] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-09-16T17:02:43.580093] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-09-16T17:02:43.883149] [DEBUG] [VALIDATOR ] ADNT: All expected trading days are present. [2025-09-16T17:02:43.883273] [DEBUG] [VALIDATOR ] ADNT: Primary data validation passed. [2025-09-16T17:02:43.883904] [INFO ] [MAIN ] ADNT: Fetched primary data is valid. [2025-09-16T17:02:43.883981] [DEBUG] [LOCAL ] ADNT: Saving primary data. [2025-09-16T17:02:43.885255] [DEBUG] [LOCAL ] ADNT: Trimmed 51503 records to 35081 (keeping 150 days of data) [2025-09-16T17:02:44.090467] [DEBUG] [LOCAL ] ADNT: Primary data saved (35081 records). [2025-09-16T17:02:44.090635] [INFO ] [MAIN ] ADNT: Full history saved. [2025-09-16T17:02:44.090742] [INFO ] [MAIN ] Update Progress: 33/2369 symbols completed. ADNT took 22.2s. Estimated remaining: 3h 9m 57s. Rate: 12.3 symbols/min [2025-09-16T17:02:44.268736] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:02:44.275902] [DEBUG] [LOCAL ] AEFC: Loaded 5866 existing records from primary storage. [2025-09-16T17:02:44.276021] [INFO ] [MAIN ] AEFC: Loaded 5866 existing records. [2025-09-16T17:02:44.381132] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-09-16T17:02:44.465176] [WARN ] [MAIN ] AEFC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:02:44.465417] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-09-16T17:02:44.465465] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-09-16T17:02:44.465839] [DEBUG] [LOCAL ] AEFC: Deleted primary data file. [2025-09-16T17:02:44.465887] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-09-16T17:02:44.852793] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:02:44.904664] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-16T17:02:44.905935] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-16T17:02:45.174915] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-09-16T17:02:45.974880] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-09-16T17:02:46.008948] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-16T17:02:46.772230] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-16T17:02:46.774840] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-09-16T17:02:46.932920] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-16T17:02:47.365772] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-16T17:02:47.574937] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-09-16T17:02:48.374910] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-09-16T17:02:48.420312] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-16T17:02:49.174909] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-09-16T17:02:49.974945] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-09-16T17:02:50.039453] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-16T17:02:50.200509] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-16T17:02:50.774918] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-09-16T17:02:51.275744] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-16T17:02:51.491166] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-16T17:02:51.574917] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-09-16T17:02:52.374943] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-09-16T17:02:52.897819] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-16T17:02:53.174927] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-09-16T17:02:53.974912] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-09-16T17:02:54.091098] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-16T17:02:54.479715] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-16T17:02:54.523870] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-16T17:02:54.774913] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-09-16T17:02:55.574895] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-09-16T17:02:55.716673] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-16T17:02:56.374891] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-09-16T17:02:57.174869] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-09-16T17:02:57.269229] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-16T17:02:57.525870] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-16T17:02:57.530082] [INFO ] [REMOTE ] ADX: Full fetch complete (30720 records). [2025-09-16T17:02:57.530190] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-09-16T17:02:57.938134] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-09-16T17:02:57.938234] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-09-16T17:02:57.938622] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-09-16T17:02:57.938686] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-09-16T17:02:57.939616] [DEBUG] [LOCAL ] ADX: Trimmed 30720 records to 20576 (keeping 150 days of data) [2025-09-16T17:02:57.997739] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-09-16T17:02:58.075718] [DEBUG] [LOCAL ] ADX: Primary data saved (20576 records). [2025-09-16T17:02:58.075955] [INFO ] [MAIN ] ADX: Full history saved. [2025-09-16T17:02:58.076113] [INFO ] [MAIN ] Update Progress: 34/2369 symbols completed. ADX took 23.7s. Estimated remaining: 3h 20m 18s. Rate: 11.7 symbols/min [2025-09-16T17:02:58.088746] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-16T17:02:58.264241] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:02:58.309952] [DEBUG] [LOCAL ] AEG: Loaded 36681 existing records from primary storage. [2025-09-16T17:02:58.310112] [INFO ] [MAIN ] AEG: Loaded 36681 existing records. [2025-09-16T17:02:58.490837] [WARN ] [MAIN ] AEG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:02:58.491136] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-09-16T17:02:58.491188] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-09-16T17:02:58.492076] [DEBUG] [LOCAL ] AEG: Deleted primary data file. [2025-09-16T17:02:58.492129] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-09-16T17:02:58.780097] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-09-16T17:02:58.852413] [INFO ] [REMOTE ] AEG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:02:59.575126] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-09-16T17:02:59.824464] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-16T17:03:00.374922] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-09-16T17:03:00.385316] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-16T17:03:00.387291] [INFO ] [REMOTE ] AEFC: Full fetch complete (9465 records). [2025-09-16T17:03:00.387429] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-09-16T17:03:00.776938] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-09-16T17:03:00.777038] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-09-16T17:03:00.777418] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-09-16T17:03:00.777504] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-09-16T17:03:00.778156] [DEBUG] [LOCAL ] AEFC: Trimmed 9465 records to 5914 (keeping 150 days of data) [2025-09-16T17:03:00.841172] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-16T17:03:00.860560] [DEBUG] [LOCAL ] AEFC: Primary data saved (5914 records). [2025-09-16T17:03:00.860718] [INFO ] [MAIN ] AEFC: Full history saved. [2025-09-16T17:03:00.860810] [INFO ] [MAIN ] Update Progress: 35/2369 symbols completed. AEFC took 16.8s. Estimated remaining: 3h 17m 35s. Rate: 11.8 symbols/min [2025-09-16T17:03:01.031433] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:03:01.072995] [DEBUG] [LOCAL ] AEM: Loaded 39467 existing records from primary storage. [2025-09-16T17:03:01.073164] [INFO ] [MAIN ] AEM: Loaded 39467 existing records. [2025-09-16T17:03:01.175148] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-09-16T17:03:01.255894] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:03:01.256113] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-09-16T17:03:01.256159] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-09-16T17:03:01.257121] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-09-16T17:03:01.257173] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-09-16T17:03:01.627084] [INFO ] [REMOTE ] AEM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:03:01.974974] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-09-16T17:03:02.774963] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-09-16T17:03:03.328877] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-16T17:03:03.475676] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (3.10 seconds). [2025-09-16T17:03:03.482314] [INFO ] [REMOTE ] ADT: Full fetch complete (58078 records). [2025-09-16T17:03:03.482425] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-09-16T17:03:03.579983] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-09-16T17:03:03.874602] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-09-16T17:03:03.874698] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-09-16T17:03:03.875305] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-09-16T17:03:03.875351] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-09-16T17:03:03.876554] [DEBUG] [LOCAL ] ADT: Trimmed 58078 records to 39870 (keeping 150 days of data) [2025-09-16T17:03:04.128020] [DEBUG] [LOCAL ] ADT: Primary data saved (39870 records). [2025-09-16T17:03:04.128190] [INFO ] [MAIN ] ADT: Full history saved. [2025-09-16T17:03:04.129128] [INFO ] [MAIN ] Update Progress: 36/2369 symbols completed. ADT took 34.1s. Estimated remaining: 3h 15m 33s. Rate: 11.9 symbols/min [2025-09-16T17:03:04.326773] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:03:04.371735] [DEBUG] [LOCAL ] AEO: Loaded 39531 existing records from primary storage. [2025-09-16T17:03:04.371911] [INFO ] [MAIN ] AEO: Loaded 39531 existing records. [2025-09-16T17:03:04.577701] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:03:04.578005] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-09-16T17:03:04.578058] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-09-16T17:03:04.578983] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-09-16T17:03:04.579034] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-09-16T17:03:04.892792] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-16T17:03:04.968754] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-09-16T17:03:05.046430] [INFO ] [REMOTE ] AEO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:03:05.174946] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-09-16T17:03:05.232983] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-16T17:03:05.757480] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (3.78 seconds). [2025-09-16T17:03:05.974938] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-09-16T17:03:06.774944] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-09-16T17:03:06.955359] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-16T17:03:06.961685] [INFO ] [REMOTE ] AEE: Full fetch complete (54561 records). [2025-09-16T17:03:06.961787] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-09-16T17:03:06.962423] [FATAL] [VALIDATOR ] AEE: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:03:06.962519] [FATAL] [MAIN ] AEE: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:03:06.962556] [WARN ] [MAIN ] AEE: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:03:06.962594] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-09-16T17:03:06.962670] [DEBUG] [LOCAL ] AEE: No primary data file found to delete. [2025-09-16T17:03:06.962710] [INFO ] [LOCAL ] AEE: Starting deletion of derivative data. [2025-09-16T17:03:06.962765] [DEBUG] [LOCAL ] AEE: No derivative data file found to delete. [2025-09-16T17:03:06.962825] [INFO ] [MAIN ] Update Progress: 37/2369 symbols completed. AEE took 31.1s. Estimated remaining: 3h 13m 9s. Rate: 12.1 symbols/min [2025-09-16T17:03:07.658932] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-09-16T17:03:07.669429] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-09-16T17:03:07.701366] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-16T17:03:08.374956] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-09-16T17:03:08.914242] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-16T17:03:09.174984] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-09-16T17:03:09.287146] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-16T17:03:09.679809] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-16T17:03:09.974970] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-09-16T17:03:10.774902] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-09-16T17:03:11.597794] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-09-16T17:03:11.609388] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-09-16T17:03:11.849700] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-16T17:03:12.379702] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-09-16T17:03:12.382064] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-16T17:03:13.174872] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-09-16T17:03:13.348063] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-16T17:03:13.883067] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-16T17:03:13.974886] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-09-16T17:03:14.774912] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-09-16T17:03:15.038049] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-16T17:03:15.574926] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-09-16T17:03:15.923022] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-16T17:03:16.374897] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-09-16T17:03:16.723103] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-16T17:03:17.021040] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-16T17:03:17.174880] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-09-16T17:03:17.974916] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-09-16T17:03:18.864463] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-09-16T17:03:18.881332] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-09-16T17:03:19.420194] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-16T17:03:19.470512] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-16T17:03:19.476974] [INFO ] [REMOTE ] AEG: Full fetch complete (53716 records). [2025-09-16T17:03:19.477138] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-09-16T17:03:19.587221] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-09-16T17:03:19.902159] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-09-16T17:03:19.902239] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-09-16T17:03:19.902787] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-09-16T17:03:19.902836] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-09-16T17:03:19.903898] [DEBUG] [LOCAL ] AEG: Trimmed 53716 records to 37046 (keeping 150 days of data) [2025-09-16T17:03:20.138032] [DEBUG] [LOCAL ] AEG: Primary data saved (37046 records). [2025-09-16T17:03:20.138216] [INFO ] [MAIN ] AEG: Full history saved. [2025-09-16T17:03:20.139360] [INFO ] [MAIN ] Update Progress: 38/2369 symbols completed. AEG took 22.1s. Estimated remaining: 3h 21m 28s. Rate: 11.6 symbols/min [2025-09-16T17:03:20.848536] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-16T17:03:20.861140] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-09-16T17:03:21.792085] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-16T17:03:21.806032] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-09-16T17:03:22.338589] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-16T17:03:22.344601] [INFO ] [REMOTE ] AEM: Full fetch complete (57744 records). [2025-09-16T17:03:22.344750] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-09-16T17:03:22.345524] [FATAL] [VALIDATOR ] AEM: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:03:22.345619] [FATAL] [MAIN ] AEM: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:03:22.345749] [WARN ] [MAIN ] AEM: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:03:22.345797] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-09-16T17:03:22.345862] [DEBUG] [LOCAL ] AEM: No primary data file found to delete. [2025-09-16T17:03:22.345900] [INFO ] [LOCAL ] AEM: Starting deletion of derivative data. [2025-09-16T17:03:22.346176] [DEBUG] [LOCAL ] AEM: Deleted derivative data file. [2025-09-16T17:03:22.348337] [INFO ] [MAIN ] Update Progress: 39/2369 symbols completed. AEM took 21.5s. Estimated remaining: 3h 18m 25s. Rate: 11.7 symbols/min [2025-09-16T17:03:23.957782] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-16T17:03:23.966259] [INFO ] [REMOTE ] AEO: Full fetch complete (58200 records). [2025-09-16T17:03:23.966551] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-09-16T17:03:24.357725] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-09-16T17:03:24.357879] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-09-16T17:03:24.358486] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-09-16T17:03:24.358556] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-09-16T17:03:24.359893] [DEBUG] [LOCAL ] AEO: Trimmed 58200 records to 39921 (keeping 150 days of data) [2025-09-16T17:03:24.606017] [DEBUG] [LOCAL ] AEO: Primary data saved (39921 records). [2025-09-16T17:03:24.606164] [INFO ] [MAIN ] AEO: Full history saved. [2025-09-16T17:03:24.606983] [INFO ] [MAIN ] Update Progress: 40/2369 symbols completed. AEO took 20.5s. Estimated remaining: 3h 15m 33s. Rate: 11.9 symbols/min [2025-09-16T17:03:25.319630] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:03:25.340191] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:03:25.316164] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:03:25.342871] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:03:25.361927] [DEBUG] [LOCAL ] AFB: Loaded 7849 existing records from primary storage. [2025-09-16T17:03:25.362076] [INFO ] [MAIN ] AFB: Loaded 7849 existing records. [2025-09-16T17:03:25.599739] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:03:25.612951] [DEBUG] [LOCAL ] AESI: Loaded 36439 existing records from primary storage. [2025-09-16T17:03:25.614688] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-09-16T17:03:25.614788] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-09-16T17:03:25.614559] [INFO ] [MAIN ] AESI: Loaded 36439 existing records. [2025-09-16T17:03:25.615419] [DEBUG] [LOCAL ] AES: Loaded 39635 existing records from primary storage. [2025-09-16T17:03:25.650720] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-09-16T17:03:25.651473] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-09-16T17:03:25.620713] [INFO ] [MAIN ] AES: Loaded 39635 existing records. [2025-09-16T17:03:25.662775] [DEBUG] [LOCAL ] AER: Loaded 35563 existing records from primary storage. [2025-09-16T17:03:25.697865] [INFO ] [MAIN ] AER: Loaded 35563 existing records. [2025-09-16T17:03:26.285167] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:03:26.460910] [WARN ] [MAIN ] AER: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:03:26.461127] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-09-16T17:03:26.467631] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:03:26.473166] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-09-16T17:03:26.494900] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-09-16T17:03:26.478473] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-09-16T17:03:26.500378] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-09-16T17:03:26.508771] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-09-16T17:03:26.508935] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-09-16T17:03:26.539719] [DEBUG] [LOCAL ] AER: Deleted primary data file. [2025-09-16T17:03:26.550800] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-09-16T17:03:26.539875] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-09-16T17:03:26.668272] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-09-16T17:03:26.748123] [INFO ] [REMOTE ] AFB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:03:26.768151] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-09-16T17:03:26.748203] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-09-16T17:03:27.627880] [INFO ] [REMOTE ] AER: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:03:27.638560] [INFO ] [REMOTE ] AESI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:03:27.655498] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-09-16T17:03:27.656120] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-09-16T17:03:27.719946] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-16T17:03:27.760365] [INFO ] [REMOTE ] AES: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:03:27.760844] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-09-16T17:03:27.761123] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-09-16T17:03:28.739725] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-16T17:03:28.743372] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-09-16T17:03:29.411020] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-16T17:03:29.420316] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-09-16T17:03:29.596379] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-16T17:03:29.606674] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-09-16T17:03:29.619353] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-16T17:03:29.625207] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-09-16T17:03:29.835328] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-16T17:03:29.844938] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-09-16T17:03:30.149839] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-16T17:03:30.152622] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-09-16T17:03:31.052671] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-16T17:03:31.055636] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-09-16T17:03:31.204498] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-16T17:03:31.303442] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-16T17:03:31.391118] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-16T17:03:31.574866] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-09-16T17:03:31.706481] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-16T17:03:32.374961] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-09-16T17:03:33.174912] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-09-16T17:03:33.249909] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-16T17:03:33.812710] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-16T17:03:33.870075] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-16T17:03:33.974873] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-09-16T17:03:34.579194] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-16T17:03:34.580984] [INFO ] [REMOTE ] AFB: Full fetch complete (12387 records). [2025-09-16T17:03:34.581063] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-09-16T17:03:34.781488] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-09-16T17:03:34.959283] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-09-16T17:03:34.959374] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-09-16T17:03:34.959599] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-09-16T17:03:34.959661] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-09-16T17:03:34.960331] [DEBUG] [LOCAL ] AFB: Trimmed 12387 records to 7923 (keeping 150 days of data) [2025-09-16T17:03:35.009325] [DEBUG] [LOCAL ] AFB: Primary data saved (7923 records). [2025-09-16T17:03:35.009472] [INFO ] [MAIN ] AFB: Full history saved. [2025-09-16T17:03:35.009570] [INFO ] [MAIN ] Update Progress: 41/2369 symbols completed. AFB took 10.4s. Estimated remaining: 3h 20m 33s. Rate: 11.6 symbols/min [2025-09-16T17:03:35.182844] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:03:35.208000] [DEBUG] [LOCAL ] AFG: Loaded 23462 existing records from primary storage. [2025-09-16T17:03:35.208147] [INFO ] [MAIN ] AFG: Loaded 23462 existing records. [2025-09-16T17:03:35.391953] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:03:35.392221] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-09-16T17:03:35.392284] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-09-16T17:03:35.392900] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-09-16T17:03:35.392949] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-09-16T17:03:35.580120] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-09-16T17:03:35.757859] [INFO ] [REMOTE ] AFG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:03:36.374905] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-09-16T17:03:36.979335] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-16T17:03:37.174882] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-09-16T17:03:37.257847] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-16T17:03:37.928163] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-16T17:03:37.974858] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-09-16T17:03:38.774910] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-09-16T17:03:38.909115] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-16T17:03:39.452633] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-16T17:03:39.574923] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-09-16T17:03:40.374927] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-09-16T17:03:40.895832] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-16T17:03:41.005150] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-16T17:03:41.174916] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-09-16T17:03:41.539779] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-16T17:03:41.974900] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-09-16T17:03:42.465720] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-16T17:03:42.774921] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-09-16T17:03:43.250368] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-16T17:03:43.574921] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-09-16T17:03:44.375067] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-09-16T17:03:44.716815] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-16T17:03:45.173802] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-16T17:03:45.183045] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-09-16T17:03:45.747938] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-16T17:03:45.974927] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-09-16T17:03:46.774900] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-09-16T17:03:47.038849] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-16T17:03:47.161014] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-16T17:03:47.574944] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-09-16T17:03:48.374946] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-09-16T17:03:48.483023] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-16T17:03:49.012136] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-16T17:03:49.174935] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-09-16T17:03:49.807077] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-16T17:03:49.974904] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-09-16T17:03:50.362096] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-16T17:03:50.367737] [INFO ] [REMOTE ] AESI: Full fetch complete (53514 records). [2025-09-16T17:03:50.367833] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-09-16T17:03:50.368516] [FATAL] [VALIDATOR ] AESI: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:03:50.368596] [FATAL] [MAIN ] AESI: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:03:50.368631] [WARN ] [MAIN ] AESI: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:03:50.368696] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-09-16T17:03:50.368755] [DEBUG] [LOCAL ] AESI: No primary data file found to delete. [2025-09-16T17:03:50.368790] [INFO ] [LOCAL ] AESI: Starting deletion of derivative data. [2025-09-16T17:03:50.369159] [DEBUG] [LOCAL ] AESI: Deleted derivative data file. [2025-09-16T17:03:50.369248] [INFO ] [MAIN ] Update Progress: 42/2369 symbols completed. AESI took 25.8s. Estimated remaining: 3h 29m 53s. Rate: 11.1 symbols/min [2025-09-16T17:03:50.542715] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:03:50.545919] [DEBUG] [LOCAL ] AFGB: Loaded 1640 existing records from primary storage. [2025-09-16T17:03:50.545989] [INFO ] [MAIN ] AFGB: Loaded 1640 existing records. [2025-09-16T17:03:50.720390] [WARN ] [MAIN ] AFGB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:03:50.720682] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-09-16T17:03:50.720730] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-09-16T17:03:50.720926] [DEBUG] [LOCAL ] AFGB: Deleted primary data file. [2025-09-16T17:03:50.720976] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-09-16T17:03:50.784505] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-09-16T17:03:51.089042] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:03:51.517033] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-16T17:03:51.523032] [INFO ] [REMOTE ] AER: Full fetch complete (53195 records). [2025-09-16T17:03:51.523160] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-09-16T17:03:51.586379] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-09-16T17:03:51.902824] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-09-16T17:03:51.902954] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-09-16T17:03:51.903491] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-09-16T17:03:51.903534] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-09-16T17:03:51.904829] [DEBUG] [LOCAL ] AER: Trimmed 53195 records to 35913 (keeping 150 days of data) [2025-09-16T17:03:52.140110] [DEBUG] [LOCAL ] AER: Primary data saved (35913 records). [2025-09-16T17:03:52.140276] [INFO ] [MAIN ] AER: Full history saved. [2025-09-16T17:03:52.140374] [INFO ] [MAIN ] Update Progress: 43/2369 symbols completed. AER took 27.5s. Estimated remaining: 3h 26m 30s. Rate: 11.3 symbols/min [2025-09-16T17:03:52.271983] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-16T17:03:52.328193] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:03:52.332221] [DEBUG] [LOCAL ] AFGC: Loaded 2025 existing records from primary storage. [2025-09-16T17:03:52.332299] [INFO ] [MAIN ] AFGC: Loaded 2025 existing records. [2025-09-16T17:03:52.385351] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-09-16T17:03:52.537871] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-16T17:03:52.541504] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:03:52.549965] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-09-16T17:03:52.550408] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-09-16T17:03:52.551277] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-09-16T17:03:52.551343] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-09-16T17:03:52.904203] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:03:52.973757] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-16T17:03:53.174937] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-09-16T17:03:53.974891] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-09-16T17:03:54.538532] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-16T17:03:54.774905] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-09-16T17:03:55.209558] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-16T17:03:55.574897] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-09-16T17:03:56.093615] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-16T17:03:56.100137] [INFO ] [REMOTE ] AES: Full fetch complete (58353 records). [2025-09-16T17:03:56.100244] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-09-16T17:03:56.380117] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-09-16T17:03:56.529874] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-09-16T17:03:56.529964] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-09-16T17:03:56.530556] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-09-16T17:03:56.530600] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-09-16T17:03:56.532662] [DEBUG] [LOCAL ] AES: Trimmed 58353 records to 40025 (keeping 150 days of data) [2025-09-16T17:03:56.739438] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-16T17:03:56.772164] [INFO ] [REMOTE ] AFG: Full fetch complete (35810 records). [2025-09-16T17:03:56.773312] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-09-16T17:03:56.980574] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-16T17:03:57.186924] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-09-16T17:03:57.184074] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-09-16T17:03:57.187017] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-09-16T17:03:57.188414] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-09-16T17:03:57.189100] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-09-16T17:03:57.196756] [DEBUG] [LOCAL ] AFG: Trimmed 35810 records to 23723 (keeping 150 days of data) [2025-09-16T17:03:57.301721] [DEBUG] [LOCAL ] AES: Primary data saved (40025 records). [2025-09-16T17:03:57.302885] [INFO ] [MAIN ] AES: Full history saved. [2025-09-16T17:03:57.303242] [INFO ] [MAIN ] Update Progress: 44/2369 symbols completed. AES took 32.7s. Estimated remaining: 3h 26m 16s. Rate: 11.3 symbols/min [2025-09-16T17:03:57.494946] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:03:57.496565] [DEBUG] [LOCAL ] AFGD: No existing data file found in primary storage. [2025-09-16T17:03:57.497106] [WARN ] [MAIN ] AFGD: No existing data found, performing full refresh instead. [2025-09-16T17:03:57.498841] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-09-16T17:03:57.499766] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-09-16T17:03:57.500762] [DEBUG] [LOCAL ] AFGD: No primary data file found to delete. [2025-09-16T17:03:57.501419] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-09-16T17:03:57.663255] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-16T17:03:57.833512] [DEBUG] [LOCAL ] AFG: Primary data saved (23723 records). [2025-09-16T17:03:57.843911] [INFO ] [MAIN ] AFG: Full history saved. [2025-09-16T17:03:57.849137] [INFO ] [MAIN ] Update Progress: 45/2369 symbols completed. AFG took 22.8s. Estimated remaining: 3h 22m 4s. Rate: 11.5 symbols/min [2025-09-16T17:03:57.983545] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-09-16T17:03:57.972844] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:03:58.082380] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:03:58.086044] [DEBUG] [LOCAL ] AFGE: Loaded 1879 existing records from primary storage. [2025-09-16T17:03:58.086130] [INFO ] [MAIN ] AFGE: Loaded 1879 existing records. [2025-09-16T17:03:58.259976] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:03:58.260234] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-09-16T17:03:58.260281] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-09-16T17:03:58.260480] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-09-16T17:03:58.260523] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-09-16T17:03:58.540725] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-16T17:03:58.617797] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:03:58.774909] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-09-16T17:03:59.249006] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-16T17:03:59.574920] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-09-16T17:04:00.080861] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-16T17:04:00.374920] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-09-16T17:04:01.072492] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-16T17:04:01.174913] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-09-16T17:04:01.974982] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-09-16T17:04:02.059757] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-16T17:04:02.469246] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-16T17:04:02.774962] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-09-16T17:04:03.218386] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-16T17:04:03.574937] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-09-16T17:04:04.131542] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-16T17:04:04.374951] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-09-16T17:04:04.787671] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-16T17:04:05.174918] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-09-16T17:04:05.702381] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-16T17:04:05.974926] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-09-16T17:04:06.443606] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-16T17:04:06.774913] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-09-16T17:04:07.233934] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-16T17:04:07.574914] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-09-16T17:04:07.971026] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-16T17:04:08.374926] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-09-16T17:04:09.040376] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-16T17:04:09.041457] [INFO ] [REMOTE ] AFGC: Full fetch complete (2690 records). [2025-09-16T17:04:09.041530] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-09-16T17:04:09.191466] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-09-16T17:04:09.419211] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-09-16T17:04:09.419342] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-09-16T17:04:09.419536] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-09-16T17:04:09.419583] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-09-16T17:04:09.420566] [DEBUG] [LOCAL ] AFGC: Trimmed 2690 records to 2047 (keeping 150 days of data) [2025-09-16T17:04:09.434019] [DEBUG] [LOCAL ] AFGC: Primary data saved (2047 records). [2025-09-16T17:04:09.434079] [INFO ] [MAIN ] AFGC: Full history saved. [2025-09-16T17:04:09.434174] [INFO ] [MAIN ] Update Progress: 46/2369 symbols completed. AFGC took 17.3s. Estimated remaining: 3h 27m 21s. Rate: 11.2 symbols/min [2025-09-16T17:04:09.602873] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:04:09.643803] [DEBUG] [LOCAL ] AFL: Loaded 39216 existing records from primary storage. [2025-09-16T17:04:09.643950] [INFO ] [MAIN ] AFL: Loaded 39216 existing records. [2025-09-16T17:04:09.825622] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-16T17:04:09.828823] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:04:09.830354] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-09-16T17:04:09.830430] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-09-16T17:04:09.831414] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-09-16T17:04:09.831466] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-09-16T17:04:09.980858] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-09-16T17:04:10.182388] [INFO ] [REMOTE ] AFL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:04:10.774889] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-09-16T17:04:10.825176] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-16T17:04:11.231576] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-16T17:04:11.574912] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-09-16T17:04:12.035320] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-16T17:04:12.374939] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-09-16T17:04:12.806978] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-16T17:04:13.174955] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-09-16T17:04:13.627753] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-16T17:04:13.974900] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-09-16T17:04:14.417078] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-16T17:04:14.774928] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-09-16T17:04:15.319205] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-16T17:04:15.574909] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-09-16T17:04:16.167949] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-16T17:04:16.168826] [INFO ] [REMOTE ] AFGB: Full fetch complete (2640 records). [2025-09-16T17:04:16.168898] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-09-16T17:04:16.169281] [FATAL] [VALIDATOR ] AFGB: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:04:16.169375] [FATAL] [MAIN ] AFGB: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:04:16.169439] [WARN ] [MAIN ] AFGB: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:04:16.169524] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-09-16T17:04:16.169600] [DEBUG] [LOCAL ] AFGB: No primary data file found to delete. [2025-09-16T17:04:16.169687] [INFO ] [LOCAL ] AFGB: Starting deletion of derivative data. [2025-09-16T17:04:16.170007] [DEBUG] [LOCAL ] AFGB: Deleted derivative data file. [2025-09-16T17:04:16.170119] [INFO ] [MAIN ] Update Progress: 47/2369 symbols completed. AFGB took 25.8s. Estimated remaining: 3h 28m 23s. Rate: 11.1 symbols/min [2025-09-16T17:04:16.339174] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:04:16.379999] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-09-16T17:04:16.382759] [DEBUG] [LOCAL ] AG: Loaded 39606 existing records from primary storage. [2025-09-16T17:04:16.382925] [INFO ] [MAIN ] AG: Loaded 39606 existing records. [2025-09-16T17:04:16.569627] [WARN ] [MAIN ] AG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:04:16.570059] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-09-16T17:04:16.570108] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-09-16T17:04:16.571047] [DEBUG] [LOCAL ] AG: Deleted primary data file. [2025-09-16T17:04:16.571107] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-09-16T17:04:16.937249] [INFO ] [REMOTE ] AG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:04:17.174903] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-09-16T17:04:17.974909] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-09-16T17:04:18.095662] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-16T17:04:18.514699] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-16T17:04:18.515480] [INFO ] [REMOTE ] AFGE: Full fetch complete (2644 records). [2025-09-16T17:04:18.515547] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-09-16T17:04:18.515976] [FATAL] [VALIDATOR ] AFGE: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:04:18.516072] [FATAL] [MAIN ] AFGE: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:04:18.516123] [WARN ] [MAIN ] AFGE: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:04:18.516172] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-09-16T17:04:18.516230] [DEBUG] [LOCAL ] AFGE: No primary data file found to delete. [2025-09-16T17:04:18.516273] [INFO ] [LOCAL ] AFGE: Starting deletion of derivative data. [2025-09-16T17:04:18.516534] [DEBUG] [LOCAL ] AFGE: Deleted derivative data file. [2025-09-16T17:04:18.516612] [INFO ] [MAIN ] Update Progress: 48/2369 symbols completed. AFGE took 20.7s. Estimated remaining: 3h 25m 51s. Rate: 11.3 symbols/min [2025-09-16T17:04:18.692335] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:04:18.727595] [DEBUG] [LOCAL ] AGCO: Loaded 31094 existing records from primary storage. [2025-09-16T17:04:18.727757] [INFO ] [MAIN ] AGCO: Loaded 31094 existing records. [2025-09-16T17:04:18.782562] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-09-16T17:04:18.909123] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:04:18.909361] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-09-16T17:04:18.909408] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-09-16T17:04:18.910167] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-09-16T17:04:18.910229] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-09-16T17:04:19.284135] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:04:19.312114] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-09-16T17:04:19.574913] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-09-16T17:04:20.246989] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-16T17:04:20.374897] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-09-16T17:04:21.174963] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-09-16T17:04:21.430852] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-16T17:04:21.745995] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-16T17:04:21.974899] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-09-16T17:04:22.281913] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-16T17:04:22.774913] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-09-16T17:04:23.574880] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-09-16T17:04:23.835802] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-16T17:04:23.974567] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-16T17:04:24.268574] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-16T17:04:24.374896] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-09-16T17:04:25.174937] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-09-16T17:04:25.974919] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-09-16T17:04:26.327374] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-16T17:04:26.340696] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-16T17:04:26.774864] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-09-16T17:04:26.809968] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-16T17:04:27.574935] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-09-16T17:04:28.126300] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-16T17:04:28.127247] [INFO ] [REMOTE ] AFGD: Full fetch complete (2065 records). [2025-09-16T17:04:28.127315] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-09-16T17:04:28.385076] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-09-16T17:04:28.505524] [DEBUG] [VALIDATOR ] AFGD: All expected trading days are present. [2025-09-16T17:04:28.505760] [DEBUG] [VALIDATOR ] AFGD: Primary data validation passed. [2025-09-16T17:04:28.505935] [INFO ] [MAIN ] AFGD: Fetched primary data is valid. [2025-09-16T17:04:28.506010] [DEBUG] [LOCAL ] AFGD: Saving primary data. [2025-09-16T17:04:28.506542] [DEBUG] [LOCAL ] AFGD: Trimmed 2065 records to 1344 (keeping 150 days of data) [2025-09-16T17:04:28.515797] [DEBUG] [LOCAL ] AFGD: Primary data saved (1344 records). [2025-09-16T17:04:28.516053] [INFO ] [MAIN ] AFGD: Full history saved. [2025-09-16T17:04:28.516156] [INFO ] [MAIN ] Update Progress: 49/2369 symbols completed. AFGD took 31.2s. Estimated remaining: 3h 29m 27s. Rate: 11.1 symbols/min [2025-09-16T17:04:28.636421] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-16T17:04:28.730229] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:04:28.745003] [DEBUG] [LOCAL ] AGD: Loaded 13602 existing records from primary storage. [2025-09-16T17:04:28.745115] [INFO ] [MAIN ] AGD: Loaded 13602 existing records. [2025-09-16T17:04:28.920962] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:04:28.921237] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-09-16T17:04:28.921284] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-09-16T17:04:28.921699] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-09-16T17:04:28.921748] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-09-16T17:04:29.180088] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-09-16T17:04:29.279437] [INFO ] [REMOTE ] AGD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:04:29.966442] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-16T17:04:29.976936] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-09-16T17:04:30.774936] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-09-16T17:04:31.072540] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-16T17:04:31.473175] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-16T17:04:31.574931] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-09-16T17:04:32.279910] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-16T17:04:32.374894] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-09-16T17:04:33.174956] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-09-16T17:04:33.633569] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-16T17:04:33.974956] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-09-16T17:04:34.073962] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-16T17:04:34.165149] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-16T17:04:34.774902] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-09-16T17:04:35.574892] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-09-16T17:04:35.943931] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-16T17:04:35.950319] [INFO ] [REMOTE ] AG: Full fetch complete (58316 records). [2025-09-16T17:04:35.950433] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-09-16T17:04:36.337752] [DEBUG] [VALIDATOR ] AG: All expected trading days are present. [2025-09-16T17:04:36.337882] [DEBUG] [VALIDATOR ] AG: Primary data validation passed. [2025-09-16T17:04:36.338534] [INFO ] [MAIN ] AG: Fetched primary data is valid. [2025-09-16T17:04:36.338590] [DEBUG] [LOCAL ] AG: Saving primary data. [2025-09-16T17:04:36.339895] [DEBUG] [LOCAL ] AG: Trimmed 58316 records to 39996 (keeping 150 days of data) [2025-09-16T17:04:36.403516] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-09-16T17:04:36.459855] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-16T17:04:36.627766] [DEBUG] [LOCAL ] AG: Primary data saved (39996 records). [2025-09-16T17:04:36.627954] [INFO ] [MAIN ] AG: Full history saved. [2025-09-16T17:04:36.628070] [INFO ] [MAIN ] Update Progress: 50/2369 symbols completed. AG took 20.5s. Estimated remaining: 3h 31m 27s. Rate: 11.0 symbols/min [2025-09-16T17:04:36.799988] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:04:36.836696] [DEBUG] [LOCAL ] AGI: Loaded 39404 existing records from primary storage. [2025-09-16T17:04:36.836864] [INFO ] [MAIN ] AGI: Loaded 39404 existing records. [2025-09-16T17:04:37.019798] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:04:37.020120] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-09-16T17:04:37.020175] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-09-16T17:04:37.021258] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-09-16T17:04:37.021314] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-09-16T17:04:37.196777] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-09-16T17:04:37.271560] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-16T17:04:37.434792] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-16T17:04:37.434376] [INFO ] [REMOTE ] AGI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:04:37.974956] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-09-16T17:04:38.569538] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-16T17:04:38.576240] [INFO ] [REMOTE ] AFL: Full fetch complete (57753 records). [2025-09-16T17:04:38.576369] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-09-16T17:04:38.780557] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-09-16T17:04:38.962731] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-09-16T17:04:38.962821] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-09-16T17:04:38.963381] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-09-16T17:04:38.963442] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-09-16T17:04:38.964750] [DEBUG] [LOCAL ] AFL: Trimmed 57753 records to 39605 (keeping 150 days of data) [2025-09-16T17:04:39.222017] [DEBUG] [LOCAL ] AFL: Primary data saved (39605 records). [2025-09-16T17:04:39.222179] [INFO ] [MAIN ] AFL: Full history saved. [2025-09-16T17:04:39.224105] [INFO ] [MAIN ] Update Progress: 51/2369 symbols completed. AFL took 29.8s. Estimated remaining: 3h 29m 11s. Rate: 11.1 symbols/min [2025-09-16T17:04:39.398188] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:04:39.427973] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-16T17:04:39.473446] [DEBUG] [LOCAL ] AGL: Loaded 38685 existing records from primary storage. [2025-09-16T17:04:39.473589] [INFO ] [MAIN ] AGL: Loaded 38685 existing records. [2025-09-16T17:04:39.575237] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-09-16T17:04:39.652136] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:04:39.652402] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-09-16T17:04:39.652453] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-09-16T17:04:39.653278] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-09-16T17:04:39.653341] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-09-16T17:04:40.013723] [INFO ] [REMOTE ] AGL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:04:40.023668] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-16T17:04:40.374892] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-09-16T17:04:41.174879] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-09-16T17:04:41.377867] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-16T17:04:41.539068] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-16T17:04:41.974914] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-09-16T17:04:42.216526] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-16T17:04:42.774938] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-09-16T17:04:43.574878] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-09-16T17:04:43.757059] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-16T17:04:44.011621] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-16T17:04:44.374915] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-09-16T17:04:44.567265] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-16T17:04:45.174930] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-09-16T17:04:45.792994] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-16T17:04:45.798070] [INFO ] [REMOTE ] AGCO: Full fetch complete (46548 records). [2025-09-16T17:04:45.798189] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-09-16T17:04:45.979067] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-09-16T17:04:46.183277] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-09-16T17:04:46.183364] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-09-16T17:04:46.183935] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-09-16T17:04:46.183989] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-09-16T17:04:46.185031] [DEBUG] [LOCAL ] AGCO: Trimmed 46548 records to 31416 (keeping 150 days of data) [2025-09-16T17:04:46.395563] [DEBUG] [LOCAL ] AGCO: Primary data saved (31416 records). [2025-09-16T17:04:46.395785] [INFO ] [MAIN ] AGCO: Full history saved. [2025-09-16T17:04:46.397810] [INFO ] [MAIN ] Update Progress: 52/2369 symbols completed. AGCO took 27.9s. Estimated remaining: 3h 30m 24s. Rate: 11.0 symbols/min [2025-09-16T17:04:46.575387] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:04:46.587423] [DEBUG] [LOCAL ] AGM: Loaded 7961 existing records from primary storage. [2025-09-16T17:04:46.587604] [INFO ] [MAIN ] AGM: Loaded 7961 existing records. [2025-09-16T17:04:46.768385] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:04:46.768777] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-09-16T17:04:46.768938] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-09-16T17:04:46.769407] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-09-16T17:04:46.769506] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-09-16T17:04:46.790119] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-09-16T17:04:47.091836] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-16T17:04:47.192610] [INFO ] [REMOTE ] AGM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:04:47.574913] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-09-16T17:04:47.747191] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-16T17:04:47.926816] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-16T17:04:48.374901] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-09-16T17:04:48.382228] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-16T17:04:49.174909] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-09-16T17:04:49.395633] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-16T17:04:49.974918] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-09-16T17:04:50.633028] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-16T17:04:50.774899] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-09-16T17:04:51.163126] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-16T17:04:51.505377] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-16T17:04:51.508347] [INFO ] [REMOTE ] AGD: Full fetch complete (18772 records). [2025-09-16T17:04:51.508426] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-09-16T17:04:51.580002] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-09-16T17:04:51.906536] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-09-16T17:04:51.906614] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-09-16T17:04:51.906889] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-09-16T17:04:51.906932] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-09-16T17:04:51.907546] [DEBUG] [LOCAL ] AGD: Trimmed 18772 records to 13784 (keeping 150 days of data) [2025-09-16T17:04:51.991552] [DEBUG] [LOCAL ] AGD: Primary data saved (13784 records). [2025-09-16T17:04:51.991724] [INFO ] [MAIN ] AGD: Full history saved. [2025-09-16T17:04:51.991818] [INFO ] [MAIN ] Update Progress: 53/2369 symbols completed. AGD took 23.4s. Estimated remaining: 3h 30m 25s. Rate: 11.0 symbols/min [2025-09-16T17:04:52.172717] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:04:52.194576] [DEBUG] [LOCAL ] AGO: Loaded 20242 existing records from primary storage. [2025-09-16T17:04:52.194799] [INFO ] [MAIN ] AGO: Loaded 20242 existing records. [2025-09-16T17:04:52.375121] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-09-16T17:04:52.375280] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:04:52.376323] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-09-16T17:04:52.376380] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-09-16T17:04:52.376919] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-09-16T17:04:52.376970] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-09-16T17:04:52.508276] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-16T17:04:52.748023] [INFO ] [REMOTE ] AGO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:04:53.174905] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-09-16T17:04:53.824588] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-16T17:04:53.974902] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-09-16T17:04:54.167988] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-16T17:04:54.774970] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-09-16T17:04:54.823785] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-16T17:04:55.574905] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-09-16T17:04:56.357298] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-16T17:04:56.374839] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-09-16T17:04:56.880186] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-16T17:04:56.952566] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-16T17:04:57.174913] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-09-16T17:04:57.974918] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-09-16T17:04:58.068845] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-16T17:04:58.774911] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-09-16T17:04:59.574938] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-09-16T17:04:59.632552] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-16T17:04:59.837630] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-16T17:05:00.375055] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-09-16T17:05:01.174903] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-09-16T17:05:01.419216] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-16T17:05:01.974932] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-09-16T17:05:02.557333] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-16T17:05:02.574490] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-16T17:05:02.576184] [INFO ] [REMOTE ] AGM: Full fetch complete (10310 records). [2025-09-16T17:05:02.576251] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-09-16T17:05:02.780023] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-09-16T17:05:02.943019] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-09-16T17:05:02.943100] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-09-16T17:05:02.943298] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-09-16T17:05:02.943337] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-09-16T17:05:02.943822] [DEBUG] [LOCAL ] AGM: Trimmed 10310 records to 8023 (keeping 150 days of data) [2025-09-16T17:05:02.995675] [DEBUG] [LOCAL ] AGM: Primary data saved (8023 records). [2025-09-16T17:05:02.995808] [INFO ] [MAIN ] AGM: Full history saved. [2025-09-16T17:05:02.995890] [INFO ] [MAIN ] Update Progress: 54/2369 symbols completed. AGM took 16.6s. Estimated remaining: 3h 34m 17s. Rate: 10.8 symbols/min [2025-09-16T17:05:03.164246] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:05:03.187136] [DEBUG] [LOCAL ] AGRO: Loaded 23968 existing records from primary storage. [2025-09-16T17:05:03.187272] [INFO ] [MAIN ] AGRO: Loaded 23968 existing records. [2025-09-16T17:05:03.365069] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:05:03.365307] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-09-16T17:05:03.365373] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-09-16T17:05:03.366008] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-09-16T17:05:03.366060] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-09-16T17:05:03.598160] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-09-16T17:05:03.759876] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:05:03.780845] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-16T17:05:04.374875] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-09-16T17:05:04.818301] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-16T17:05:04.826089] [INFO ] [REMOTE ] AGI: Full fetch complete (58064 records). [2025-09-16T17:05:04.826231] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-09-16T17:05:05.183929] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-09-16T17:05:05.225367] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-09-16T17:05:05.225449] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-09-16T17:05:05.226168] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-09-16T17:05:05.241923] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-09-16T17:05:05.254384] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-16T17:05:05.265441] [DEBUG] [LOCAL ] AGI: Trimmed 58064 records to 39794 (keeping 150 days of data) [2025-09-16T17:05:05.520026] [DEBUG] [LOCAL ] AGI: Primary data saved (39794 records). [2025-09-16T17:05:05.520221] [INFO ] [MAIN ] AGI: Full history saved. [2025-09-16T17:05:05.520337] [INFO ] [MAIN ] Update Progress: 55/2369 symbols completed. AGI took 28.9s. Estimated remaining: 3h 32m 4s. Rate: 10.9 symbols/min [2025-09-16T17:05:05.692183] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:05:05.716340] [DEBUG] [LOCAL ] AGX: Loaded 24492 existing records from primary storage. [2025-09-16T17:05:05.716465] [INFO ] [MAIN ] AGX: Loaded 24492 existing records. [2025-09-16T17:05:05.841836] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-16T17:05:05.918478] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:05:05.918765] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-09-16T17:05:05.918822] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-09-16T17:05:05.919463] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-09-16T17:05:05.919511] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-09-16T17:05:05.982050] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-09-16T17:05:06.277045] [INFO ] [REMOTE ] AGX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:05:06.456196] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-16T17:05:06.774894] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-09-16T17:05:07.204559] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-16T17:05:07.574936] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-09-16T17:05:08.206587] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-16T17:05:08.374923] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-09-16T17:05:09.175020] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-09-16T17:05:09.425001] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-16T17:05:09.927112] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-16T17:05:09.974898] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-09-16T17:05:10.679001] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-16T17:05:10.774912] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-09-16T17:05:11.065217] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-16T17:05:11.574926] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-09-16T17:05:12.247254] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-16T17:05:12.374903] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-09-16T17:05:12.920566] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-16T17:05:13.174955] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-09-16T17:05:13.452630] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-16T17:05:13.974913] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-09-16T17:05:14.778595] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-09-16T17:05:14.780483] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-16T17:05:15.216490] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-16T17:05:15.574902] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-09-16T17:05:16.257918] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-16T17:05:16.374915] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-09-16T17:05:16.560873] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-16T17:05:17.174953] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-09-16T17:05:17.745998] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-16T17:05:17.974905] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-09-16T17:05:18.634182] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-16T17:05:18.774911] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-09-16T17:05:19.066476] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-16T17:05:19.574891] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-09-16T17:05:19.864903] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-16T17:05:19.868520] [INFO ] [REMOTE ] AGO: Full fetch complete (30365 records). [2025-09-16T17:05:19.868617] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-09-16T17:05:20.247325] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-09-16T17:05:20.247442] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-09-16T17:05:20.248019] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-09-16T17:05:20.248109] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-09-16T17:05:20.249374] [DEBUG] [LOCAL ] AGO: Trimmed 30365 records to 20430 (keeping 150 days of data) [2025-09-16T17:05:20.374875] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-09-16T17:05:20.380734] [DEBUG] [LOCAL ] AGO: Primary data saved (20430 records). [2025-09-16T17:05:20.380821] [INFO ] [MAIN ] AGO: Full history saved. [2025-09-16T17:05:20.380911] [INFO ] [MAIN ] Update Progress: 56/2369 symbols completed. AGO took 28.4s. Estimated remaining: 3h 38m 25s. Rate: 10.6 symbols/min [2025-09-16T17:05:20.559570] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:05:20.589816] [DEBUG] [LOCAL ] AHH: Loaded 29529 existing records from primary storage. [2025-09-16T17:05:20.589963] [INFO ] [MAIN ] AHH: Loaded 29529 existing records. [2025-09-16T17:05:20.773271] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:05:20.773557] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-09-16T17:05:20.773606] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-09-16T17:05:20.774263] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-09-16T17:05:20.774325] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-09-16T17:05:21.128696] [INFO ] [REMOTE ] AHH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:05:21.174928] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-09-16T17:05:21.485290] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-16T17:05:21.755714] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-16T17:05:21.760073] [INFO ] [REMOTE ] AGRO: Full fetch complete (37461 records). [2025-09-16T17:05:21.760228] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-09-16T17:05:21.983977] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-09-16T17:05:22.161407] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-09-16T17:05:22.161493] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-09-16T17:05:22.162027] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-09-16T17:05:22.162080] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-09-16T17:05:22.163009] [DEBUG] [LOCAL ] AGRO: Trimmed 37461 records to 24149 (keeping 150 days of data) [2025-09-16T17:05:22.310748] [DEBUG] [LOCAL ] AGRO: Primary data saved (24149 records). [2025-09-16T17:05:22.310915] [INFO ] [MAIN ] AGRO: Full history saved. [2025-09-16T17:05:22.311046] [INFO ] [MAIN ] Update Progress: 57/2369 symbols completed. AGRO took 19.3s. Estimated remaining: 3h 35m 48s. Rate: 10.7 symbols/min [2025-09-16T17:05:22.486259] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:05:22.486440] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-09-16T17:05:22.486480] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-09-16T17:05:22.486732] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-09-16T17:05:22.505325] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-16T17:05:22.505674] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-16T17:05:22.505931] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-09-16T17:05:22.506585] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-16T17:05:22.782019] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-09-16T17:05:22.879053] [INFO ] [REMOTE ] AHL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:05:23.574953] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-02. [2025-09-16T17:05:23.722621] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-16T17:05:23.731309] [INFO ] [REMOTE ] AGL: Full fetch complete (56964 records). [2025-09-16T17:05:23.731456] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-09-16T17:05:23.814495] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:05:23.836706] [WARN ] [REMOTE ] AHL: No data returned for month 2025-02 [2025-09-16T17:05:24.123923] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-09-16T17:05:24.124019] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-09-16T17:05:24.124590] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-09-16T17:05:24.124677] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-09-16T17:05:24.126154] [DEBUG] [LOCAL ] AGL: Trimmed 56964 records to 39074 (keeping 150 days of data) [2025-09-16T17:05:24.356725] [DEBUG] [LOCAL ] AGL: Primary data saved (39074 records). [2025-09-16T17:05:24.356985] [INFO ] [MAIN ] AGL: Full history saved. [2025-09-16T17:05:24.358211] [INFO ] [MAIN ] Update Progress: 58/2369 symbols completed. AGL took 45.1s. Estimated remaining: 3h 33m 21s. Rate: 10.8 symbols/min [2025-09-16T17:05:24.379942] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-09-16T17:05:24.555790] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:05:24.557343] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-16T17:05:24.614429] [DEBUG] [LOCAL ] AHR: Loaded 36372 existing records from primary storage. [2025-09-16T17:05:24.614590] [INFO ] [MAIN ] AHR: Loaded 36372 existing records. [2025-09-16T17:05:24.792864] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:05:24.793110] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-09-16T17:05:24.793159] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-09-16T17:05:24.793991] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-09-16T17:05:24.794068] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-09-16T17:05:25.177080] [INFO ] [REMOTE ] AHR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:05:25.177155] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-03. [2025-09-16T17:05:25.409697] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:05:25.410619] [WARN ] [REMOTE ] AHL: No data returned for month 2025-03 [2025-09-16T17:05:25.475806] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-16T17:05:25.974920] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-09-16T17:05:26.774924] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-09-16T17:05:27.574929] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-09-16T17:05:27.647708] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-16T17:05:28.208843] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-16T17:05:28.374911] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-09-16T17:05:28.653716] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-16T17:05:28.658300] [INFO ] [REMOTE ] AGX: Full fetch complete (36379 records). [2025-09-16T17:05:28.658395] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-09-16T17:05:29.035305] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-09-16T17:05:29.035407] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-09-16T17:05:29.035853] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-09-16T17:05:29.035940] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-09-16T17:05:29.036929] [DEBUG] [LOCAL ] AGX: Trimmed 36379 records to 24652 (keeping 150 days of data) [2025-09-16T17:05:29.184547] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-09-16T17:05:29.202929] [DEBUG] [LOCAL ] AGX: Primary data saved (24652 records). [2025-09-16T17:05:29.203038] [INFO ] [MAIN ] AGX: Full history saved. [2025-09-16T17:05:29.203138] [INFO ] [MAIN ] Update Progress: 59/2369 symbols completed. AGX took 23.7s. Estimated remaining: 3h 32m 48s. Rate: 10.9 symbols/min [2025-09-16T17:05:29.374795] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:05:29.380869] [DEBUG] [LOCAL ] AHT: Loaded 4581 existing records from primary storage. [2025-09-16T17:05:29.380967] [INFO ] [MAIN ] AHT: Loaded 4581 existing records. [2025-09-16T17:05:29.555437] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:05:29.555677] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-09-16T17:05:29.555745] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-09-16T17:05:29.556044] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-09-16T17:05:29.556091] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-09-16T17:05:29.909868] [INFO ] [REMOTE ] AHT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:05:29.934543] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-16T17:05:29.974846] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-09-16T17:05:30.531412] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-16T17:05:30.774898] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-04. [2025-09-16T17:05:30.898273] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-16T17:05:30.963546] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:05:30.963871] [WARN ] [REMOTE ] AHL: No data returned for month 2025-04 [2025-09-16T17:05:31.574903] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-09-16T17:05:32.374968] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-09-16T17:05:33.174906] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-09-16T17:05:33.974874] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-05. [2025-09-16T17:05:34.080790] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-16T17:05:34.698272] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-16T17:05:34.774853] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-09-16T17:05:35.050460] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-16T17:05:35.574926] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-09-16T17:05:35.971667] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-16T17:05:36.374904] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-06. [2025-09-16T17:05:36.846227] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-16T17:05:37.050534] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-16T17:05:37.174914] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-09-16T17:05:37.974952] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-09-16T17:05:38.774896] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-07. [2025-09-16T17:05:38.867502] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-16T17:05:39.292302] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-16T17:05:39.330261] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-16T17:05:39.574948] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-09-16T17:05:40.374947] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-08. [2025-09-16T17:05:41.174935] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-09-16T17:05:41.281094] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-16T17:05:41.307801] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-16T17:05:41.974912] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-09. [2025-09-16T17:05:42.085822] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-16T17:05:42.090064] [INFO ] [REMOTE ] AHH: Full fetch complete (45139 records). [2025-09-16T17:05:42.090149] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-09-16T17:05:42.471948] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-09-16T17:05:42.472051] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-09-16T17:05:42.472578] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-09-16T17:05:42.472625] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-09-16T17:05:42.473881] [DEBUG] [LOCAL ] AHH: Trimmed 45139 records to 29751 (keeping 150 days of data) [2025-09-16T17:05:42.648047] [DEBUG] [LOCAL ] AHH: Primary data saved (29751 records). [2025-09-16T17:05:42.648192] [INFO ] [MAIN ] AHH: Full history saved. [2025-09-16T17:05:42.648287] [INFO ] [MAIN ] Update Progress: 60/2369 symbols completed. AHH took 22.3s. Estimated remaining: 3h 37m 47s. Rate: 10.6 symbols/min [2025-09-16T17:05:42.789175] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-09-16T17:05:42.818786] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:05:42.863517] [DEBUG] [LOCAL ] AI: Loaded 39727 existing records from primary storage. [2025-09-16T17:05:42.863701] [INFO ] [MAIN ] AI: Loaded 39727 existing records. [2025-09-16T17:05:43.042479] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:05:43.042753] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-09-16T17:05:43.042802] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-09-16T17:05:43.043797] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-09-16T17:05:43.043859] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-09-16T17:05:43.308185] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-16T17:05:43.344793] [INFO ] [REMOTE ] AHL: Full fetch complete (15974 records). [2025-09-16T17:05:43.360377] [DEBUG] [VALIDATOR ] AHL: Validating primary data. [2025-09-16T17:05:43.489731] [INFO ] [REMOTE ] AI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:05:43.577685] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-09-16T17:05:43.601524] [WARN ] [VALIDATOR ] AHL: Validation failed - insufficient historical data. Have 90 unique days, need 150 days [2025-09-16T17:05:43.602442] [FATAL] [MAIN ] AHL: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:05:43.602509] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:05:43.602559] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-16T17:05:43.602631] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-16T17:05:43.602697] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-09-16T17:05:43.602751] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-09-16T17:05:43.602813] [INFO ] [MAIN ] Update Progress: 61/2369 symbols completed. AHL took 21.3s. Estimated remaining: 3h 34m 44s. Rate: 10.7 symbols/min [2025-09-16T17:05:43.775901] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:05:43.819251] [DEBUG] [LOCAL ] AIG: Loaded 39454 existing records from primary storage. [2025-09-16T17:05:43.819412] [INFO ] [MAIN ] AIG: Loaded 39454 existing records. [2025-09-16T17:05:43.995393] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:05:43.995692] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-09-16T17:05:43.995742] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-09-16T17:05:43.996690] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-09-16T17:05:43.996747] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-09-16T17:05:44.351161] [INFO ] [REMOTE ] AIG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:05:44.374852] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-09-16T17:05:44.471458] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-16T17:05:45.174915] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-09-16T17:05:46.245057] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (2.67 seconds). [2025-09-16T17:05:46.255182] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-09-16T17:05:46.389812] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-16T17:05:46.395755] [INFO ] [REMOTE ] AHR: Full fetch complete (53661 records). [2025-09-16T17:05:46.395884] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-09-16T17:05:46.772806] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-09-16T17:05:46.772894] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-09-16T17:05:46.773444] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-09-16T17:05:46.773489] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-09-16T17:05:46.775411] [DEBUG] [LOCAL ] AHR: Trimmed 53661 records to 36730 (keeping 150 days of data) [2025-09-16T17:05:47.007132] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (2.63 seconds). [2025-09-16T17:05:47.018307] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-09-16T17:05:47.037376] [DEBUG] [LOCAL ] AHR: Primary data saved (36730 records). [2025-09-16T17:05:47.037545] [INFO ] [MAIN ] AHR: Full history saved. [2025-09-16T17:05:47.039251] [INFO ] [MAIN ] Update Progress: 62/2369 symbols completed. AHR took 22.7s. Estimated remaining: 3h 33m 18s. Rate: 10.8 symbols/min [2025-09-16T17:05:47.212689] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:05:47.212855] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-09-16T17:05:47.212893] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-09-16T17:05:47.213019] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-09-16T17:05:47.213062] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-16T17:05:47.213107] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-16T17:05:47.213141] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-09-16T17:05:47.331675] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (15.76 seconds). [2025-09-16T17:05:47.577300] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-09-16T17:05:47.580547] [INFO ] [REMOTE ] AII: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:05:48.358946] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-16T17:05:48.374847] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-09-16T17:05:48.633252] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-09-16T17:05:48.634032] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-16T17:05:49.174915] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-09-16T17:05:49.777068] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-16T17:05:49.974907] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-09-16T17:05:50.774890] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-09-16T17:05:51.146016] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-16T17:05:51.271444] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-16T17:05:51.574931] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-09-16T17:05:51.752376] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-16T17:05:52.122515] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-16T17:05:52.374946] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-02. [2025-09-16T17:05:52.569774] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:05:52.570067] [WARN ] [REMOTE ] AII: No data returned for month 2025-02 [2025-09-16T17:05:53.174906] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-09-16T17:05:53.974915] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-09-16T17:05:54.623048] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-16T17:05:54.774899] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-03. [2025-09-16T17:05:54.943947] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-16T17:05:55.014036] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:05:55.014303] [WARN ] [REMOTE ] AII: No data returned for month 2025-03 [2025-09-16T17:05:55.574897] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-04. [2025-09-16T17:05:55.795045] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:05:55.795353] [WARN ] [REMOTE ] AII: No data returned for month 2025-04 [2025-09-16T17:05:56.374906] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-09-16T17:05:57.030551] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-16T17:05:57.174894] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-09-16T17:05:57.974899] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-05. [2025-09-16T17:05:58.774889] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-09-16T17:05:58.838300] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-16T17:05:58.875966] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-16T17:05:59.459696] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-16T17:05:59.461124] [INFO ] [REMOTE ] AHT: Full fetch complete (6591 records). [2025-09-16T17:05:59.461193] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-09-16T17:05:59.580001] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-09-16T17:05:59.827831] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-09-16T17:05:59.827908] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-09-16T17:05:59.828096] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-09-16T17:05:59.828170] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-09-16T17:05:59.828573] [DEBUG] [LOCAL ] AHT: Trimmed 6591 records to 4639 (keeping 150 days of data) [2025-09-16T17:05:59.856120] [DEBUG] [LOCAL ] AHT: Primary data saved (4639 records). [2025-09-16T17:05:59.856231] [INFO ] [MAIN ] AHT: Full history saved. [2025-09-16T17:05:59.856331] [INFO ] [MAIN ] Update Progress: 63/2369 symbols completed. AHT took 30.7s. Estimated remaining: 3h 37m 39s. Rate: 10.6 symbols/min [2025-09-16T17:06:00.032883] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:06:00.050905] [DEBUG] [LOCAL ] AIN: Loaded 17889 existing records from primary storage. [2025-09-16T17:06:00.051034] [INFO ] [MAIN ] AIN: Loaded 17889 existing records. [2025-09-16T17:06:00.228248] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:06:00.228492] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-09-16T17:06:00.228545] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-09-16T17:06:00.229036] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-09-16T17:06:00.229082] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-09-16T17:06:00.398015] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-09-16T17:06:00.579573] [INFO ] [REMOTE ] AIN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:06:01.174913] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-09-16T17:06:01.749138] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-16T17:06:01.974912] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-09-16T17:06:02.366914] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-16T17:06:02.774930] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-09-16T17:06:03.266895] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-16T17:06:03.574877] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-06. [2025-09-16T17:06:03.764623] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (3.37 seconds). [2025-09-16T17:06:03.892361] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-16T17:06:04.374965] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-09-16T17:06:04.480090] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-16T17:06:05.174908] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-09-16T17:06:05.638499] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-16T17:06:05.974912] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-09-16T17:06:06.639457] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-16T17:06:06.646952] [INFO ] [REMOTE ] AIG: Full fetch complete (58153 records). [2025-09-16T17:06:06.647206] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-09-16T17:06:06.780253] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-07. [2025-09-16T17:06:07.164497] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-09-16T17:06:07.164620] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-09-16T17:06:07.165583] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-09-16T17:06:07.165674] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-09-16T17:06:07.167410] [DEBUG] [LOCAL ] AIG: Trimmed 58153 records to 39844 (keeping 150 days of data) [2025-09-16T17:06:07.508223] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-16T17:06:07.545038] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-16T17:06:07.566829] [DEBUG] [LOCAL ] AIG: Primary data saved (39844 records). [2025-09-16T17:06:07.567046] [INFO ] [MAIN ] AIG: Full history saved. [2025-09-16T17:06:07.569894] [INFO ] [MAIN ] Update Progress: 64/2369 symbols completed. AIG took 24.0s. Estimated remaining: 3h 38m 47s. Rate: 10.5 symbols/min [2025-09-16T17:06:07.580117] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-09-16T17:06:07.800485] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:06:07.813824] [DEBUG] [LOCAL ] AIO: Loaded 9165 existing records from primary storage. [2025-09-16T17:06:07.814007] [INFO ] [MAIN ] AIO: Loaded 9165 existing records. [2025-09-16T17:06:08.042467] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:06:08.042732] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-09-16T17:06:08.042781] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-09-16T17:06:08.043126] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-09-16T17:06:08.043172] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-09-16T17:06:08.384531] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-08. [2025-09-16T17:06:08.412391] [INFO ] [REMOTE ] AIO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:06:08.816139] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-16T17:06:09.158318] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-16T17:06:09.174846] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-09. [2025-09-16T17:06:09.974945] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-09-16T17:06:10.774921] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-09-16T17:06:11.574975] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-09-16T17:06:12.262307] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-16T17:06:12.380058] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-09-16T17:06:12.404239] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-09-16T17:06:13.174963] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-09-16T17:06:15.439348] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-09-16T17:06:15.450992] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-09-16T17:06:15.956734] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (5.18 seconds). [2025-09-16T17:06:15.962405] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-09-16T17:06:17.162986] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (4.78 seconds). [2025-09-16T17:06:17.166674] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-09-16T17:06:17.199294] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-09 (8.02 seconds). [2025-09-16T17:06:17.202076] [INFO ] [REMOTE ] AII: Full fetch complete (9600 records). [2025-09-16T17:06:17.202199] [DEBUG] [VALIDATOR ] AII: Validating primary data. [2025-09-16T17:06:17.395439] [WARN ] [VALIDATOR ] AII: Validation failed - insufficient historical data. Have 90 unique days, need 150 days [2025-09-16T17:06:17.395777] [FATAL] [MAIN ] AII: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:06:17.395833] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:06:17.395884] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-16T17:06:17.395954] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-16T17:06:17.395994] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-09-16T17:06:17.396037] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-09-16T17:06:17.396102] [INFO ] [MAIN ] Update Progress: 65/2369 symbols completed. AII took 30.4s. Estimated remaining: 3h 41m 8s. Rate: 10.4 symbols/min [2025-09-16T17:06:17.568368] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:06:17.589916] [DEBUG] [LOCAL ] AIR: Loaded 19182 existing records from primary storage. [2025-09-16T17:06:17.590062] [INFO ] [MAIN ] AIR: Loaded 19182 existing records. [2025-09-16T17:06:17.776290] [WARN ] [MAIN ] AIR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:06:17.776737] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-09-16T17:06:17.776854] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-09-16T17:06:17.784123] [DEBUG] [LOCAL ] AIR: Deleted primary data file. [2025-09-16T17:06:17.796359] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-09-16T17:06:17.830605] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-09-16T17:06:17.903935] [INFO ] [REMOTE ] AI: Full fetch complete (58428 records). [2025-09-16T17:06:17.917630] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-09-16T17:06:18.436273] [INFO ] [REMOTE ] AIR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:06:18.475030] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-09-16T17:06:18.529661] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (2.57 seconds). [2025-09-16T17:06:18.593695] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-16T17:06:18.641093] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-09-16T17:06:18.645338] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-09-16T17:06:18.645580] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-09-16T17:06:18.646472] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-09-16T17:06:18.647667] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-09-16T17:06:18.647876] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-09-16T17:06:18.649042] [DEBUG] [LOCAL ] AI: Trimmed 58428 records to 40117 (keeping 150 days of data) [2025-09-16T17:06:18.888424] [DEBUG] [LOCAL ] AI: Primary data saved (40117 records). [2025-09-16T17:06:18.888559] [INFO ] [MAIN ] AI: Full history saved. [2025-09-16T17:06:18.890932] [INFO ] [MAIN ] Update Progress: 66/2369 symbols completed. AI took 36.2s. Estimated remaining: 3h 38m 33s. Rate: 10.5 symbols/min [2025-09-16T17:06:19.060930] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:06:19.081818] [DEBUG] [LOCAL ] AIT: Loaded 20259 existing records from primary storage. [2025-09-16T17:06:19.081978] [INFO ] [MAIN ] AIT: Loaded 20259 existing records. [2025-09-16T17:06:19.263238] [WARN ] [MAIN ] AIT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:06:19.263480] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-09-16T17:06:19.263527] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-09-16T17:06:19.264124] [DEBUG] [LOCAL ] AIT: Deleted primary data file. [2025-09-16T17:06:19.264186] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-09-16T17:06:19.637347] [INFO ] [REMOTE ] AIT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:06:19.638192] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-09-16T17:06:19.638590] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-16T17:06:19.642818] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-09-16T17:06:19.650912] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-16T17:06:19.653701] [INFO ] [REMOTE ] AIN: Full fetch complete (26057 records). [2025-09-16T17:06:19.653774] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-09-16T17:06:19.951087] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-16T17:06:20.034799] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-09-16T17:06:20.034871] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-09-16T17:06:20.035253] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-09-16T17:06:20.035296] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-09-16T17:06:20.035946] [DEBUG] [LOCAL ] AIN: Trimmed 26057 records to 18026 (keeping 150 days of data) [2025-09-16T17:06:20.143183] [DEBUG] [LOCAL ] AIN: Primary data saved (18026 records). [2025-09-16T17:06:20.143327] [INFO ] [MAIN ] AIN: Full history saved. [2025-09-16T17:06:20.143412] [INFO ] [MAIN ] Update Progress: 67/2369 symbols completed. AIN took 20.3s. Estimated remaining: 3h 35m 55s. Rate: 10.7 symbols/min [2025-09-16T17:06:20.314776] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:06:20.324488] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-16T17:06:20.352826] [DEBUG] [LOCAL ] AIV: Loaded 29479 existing records from primary storage. [2025-09-16T17:06:20.352956] [INFO ] [MAIN ] AIV: Loaded 29479 existing records. [2025-09-16T17:06:20.383736] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-09-16T17:06:20.530892] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:06:20.531189] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-09-16T17:06:20.531236] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-09-16T17:06:20.532016] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-09-16T17:06:20.532068] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-09-16T17:06:20.885677] [INFO ] [REMOTE ] AIV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:06:20.899745] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-16T17:06:21.174917] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-09-16T17:06:21.722992] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-16T17:06:21.974880] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-09-16T17:06:22.078605] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-16T17:06:22.774887] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-09-16T17:06:23.264283] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-16T17:06:23.574914] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-09-16T17:06:23.669773] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-16T17:06:24.374887] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-09-16T17:06:24.672135] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-16T17:06:25.107270] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-16T17:06:25.174871] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-09-16T17:06:25.775983] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-16T17:06:25.777815] [INFO ] [REMOTE ] AIO: Full fetch complete (14686 records). [2025-09-16T17:06:25.777888] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-09-16T17:06:25.980024] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-09-16T17:06:26.162609] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-09-16T17:06:26.162781] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-09-16T17:06:26.163049] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-09-16T17:06:26.163092] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-09-16T17:06:26.163772] [DEBUG] [LOCAL ] AIO: Trimmed 14686 records to 9228 (keeping 150 days of data) [2025-09-16T17:06:26.224827] [DEBUG] [LOCAL ] AIO: Primary data saved (9228 records). [2025-09-16T17:06:26.224997] [INFO ] [MAIN ] AIO: Full history saved. [2025-09-16T17:06:26.225109] [INFO ] [MAIN ] Update Progress: 68/2369 symbols completed. AIO took 18.7s. Estimated remaining: 3h 36m 5s. Rate: 10.6 symbols/min [2025-09-16T17:06:26.393956] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:06:26.417386] [DEBUG] [LOCAL ] AIZ: Loaded 22213 existing records from primary storage. [2025-09-16T17:06:26.417528] [INFO ] [MAIN ] AIZ: Loaded 22213 existing records. [2025-09-16T17:06:26.591925] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:06:26.592183] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-09-16T17:06:26.592230] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-09-16T17:06:26.592802] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-09-16T17:06:26.592851] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-09-16T17:06:26.787703] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-09-16T17:06:26.973491] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:06:27.574985] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-09-16T17:06:27.607396] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-16T17:06:27.867999] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-16T17:06:28.374915] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-09-16T17:06:28.455233] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-16T17:06:29.174908] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-09-16T17:06:29.641974] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-16T17:06:29.974907] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-09-16T17:06:30.325882] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-16T17:06:30.774908] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-09-16T17:06:30.983823] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-16T17:06:31.574904] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-09-16T17:06:32.374877] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-09-16T17:06:32.410442] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-16T17:06:33.037888] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-16T17:06:33.174911] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-09-16T17:06:33.615809] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-16T17:06:33.974950] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-09-16T17:06:34.312790] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-16T17:06:34.316327] [INFO ] [REMOTE ] AIR: Full fetch complete (28776 records). [2025-09-16T17:06:34.316418] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-09-16T17:06:34.711078] [DEBUG] [VALIDATOR ] AIR: All expected trading days are present. [2025-09-16T17:06:34.711164] [DEBUG] [VALIDATOR ] AIR: Primary data validation passed. [2025-09-16T17:06:34.711557] [INFO ] [MAIN ] AIR: Fetched primary data is valid. [2025-09-16T17:06:34.711607] [DEBUG] [LOCAL ] AIR: Saving primary data. [2025-09-16T17:06:34.712537] [DEBUG] [LOCAL ] AIR: Trimmed 28776 records to 19453 (keeping 150 days of data) [2025-09-16T17:06:34.795723] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-09-16T17:06:34.828617] [DEBUG] [LOCAL ] AIR: Primary data saved (19453 records). [2025-09-16T17:06:34.828804] [INFO ] [MAIN ] AIR: Full history saved. [2025-09-16T17:06:34.828896] [INFO ] [MAIN ] Update Progress: 69/2369 symbols completed. AIR took 17.4s. Estimated remaining: 3h 37m 38s. Rate: 10.6 symbols/min [2025-09-16T17:06:35.013268] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:06:35.018070] [DEBUG] [LOCAL ] AIZN: Loaded 2612 existing records from primary storage. [2025-09-16T17:06:35.018169] [INFO ] [MAIN ] AIZN: Loaded 2612 existing records. [2025-09-16T17:06:35.206959] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:06:35.207401] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-09-16T17:06:35.207464] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-09-16T17:06:35.207889] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-09-16T17:06:35.207946] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-09-16T17:06:35.276345] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-16T17:06:35.586172] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-09-16T17:06:35.637102] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:06:36.186235] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-16T17:06:36.374928] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-09-16T17:06:36.994722] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-16T17:06:37.118870] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-16T17:06:37.174945] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-09-16T17:06:37.748920] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-16T17:06:37.974961] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-09-16T17:06:38.774936] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-09-16T17:06:39.166913] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-16T17:06:39.555429] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-16T17:06:39.574868] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-09-16T17:06:40.374934] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-09-16T17:06:40.945451] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-16T17:06:41.174917] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-09-16T17:06:41.664701] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-16T17:06:41.937855] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-16T17:06:41.974874] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-09-16T17:06:42.774920] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-09-16T17:06:43.438473] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-16T17:06:43.574889] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-09-16T17:06:43.889098] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-16T17:06:43.894476] [INFO ] [REMOTE ] AIV: Full fetch complete (43626 records). [2025-09-16T17:06:43.894572] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-09-16T17:06:44.276204] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-09-16T17:06:44.276298] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-09-16T17:06:44.276808] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-09-16T17:06:44.276855] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-09-16T17:06:44.277922] [DEBUG] [LOCAL ] AIV: Trimmed 43626 records to 29849 (keeping 150 days of data) [2025-09-16T17:06:44.374955] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-09-16T17:06:44.451882] [DEBUG] [LOCAL ] AIV: Primary data saved (29849 records). [2025-09-16T17:06:44.452048] [INFO ] [MAIN ] AIV: Full history saved. [2025-09-16T17:06:44.452149] [INFO ] [MAIN ] Update Progress: 70/2369 symbols completed. AIV took 24.3s. Estimated remaining: 3h 39m 42s. Rate: 10.5 symbols/min [2025-09-16T17:06:44.625142] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:06:44.660799] [DEBUG] [LOCAL ] AJG: Loaded 34227 existing records from primary storage. [2025-09-16T17:06:44.660961] [INFO ] [MAIN ] AJG: Loaded 34227 existing records. [2025-09-16T17:06:44.840103] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:06:44.840384] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-09-16T17:06:44.840501] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-09-16T17:06:44.841345] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-09-16T17:06:44.841397] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-09-16T17:06:45.046571] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-16T17:06:45.128304] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-16T17:06:45.179948] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-09-16T17:06:45.235379] [INFO ] [REMOTE ] AJG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:06:45.790823] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-16T17:06:45.974923] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-09-16T17:06:46.774938] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-09-16T17:06:47.343803] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-16T17:06:47.400930] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-16T17:06:47.574912] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-09-16T17:06:48.374890] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-09-16T17:06:49.174864] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-09-16T17:06:49.285950] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-16T17:06:49.682373] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-16T17:06:49.871897] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-16T17:06:49.874867] [INFO ] [REMOTE ] AIT: Full fetch complete (30559 records). [2025-09-16T17:06:49.874943] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-09-16T17:06:49.978604] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-09-16T17:06:50.249490] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-09-16T17:06:50.249585] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-09-16T17:06:50.249965] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-09-16T17:06:50.250014] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-09-16T17:06:50.250959] [DEBUG] [LOCAL ] AIT: Trimmed 30559 records to 20432 (keeping 150 days of data) [2025-09-16T17:06:50.386714] [DEBUG] [LOCAL ] AIT: Primary data saved (20432 records). [2025-09-16T17:06:50.386867] [INFO ] [MAIN ] AIT: Full history saved. [2025-09-16T17:06:50.386968] [INFO ] [MAIN ] Update Progress: 71/2369 symbols completed. AIT took 31.5s. Estimated remaining: 3h 39m 43s. Rate: 10.5 symbols/min [2025-09-16T17:06:50.557496] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:06:50.557750] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-09-16T17:06:50.557792] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-09-16T17:06:50.557917] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-09-16T17:06:50.557957] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-16T17:06:50.557999] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-16T17:06:50.558031] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-09-16T17:06:50.784435] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-09-16T17:06:50.851897] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-16T17:06:50.934343] [INFO ] [REMOTE ] AKA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:06:51.574896] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-09-16T17:06:52.374898] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-09-16T17:06:52.759576] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-16T17:06:52.871393] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-16T17:06:52.877678] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-16T17:06:52.884936] [INFO ] [REMOTE ] AIZN: Full fetch complete (4222 records). [2025-09-16T17:06:52.885106] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-09-16T17:06:53.179999] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-09-16T17:06:53.248290] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-09-16T17:06:53.248363] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-09-16T17:06:53.248511] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-09-16T17:06:53.248552] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-09-16T17:06:53.248946] [DEBUG] [LOCAL ] AIZN: Trimmed 4222 records to 2643 (keeping 150 days of data) [2025-09-16T17:06:53.265434] [DEBUG] [LOCAL ] AIZN: Primary data saved (2643 records). [2025-09-16T17:06:53.265500] [INFO ] [MAIN ] AIZN: Full history saved. [2025-09-16T17:06:53.265583] [INFO ] [MAIN ] Update Progress: 72/2369 symbols completed. AIZN took 18.4s. Estimated remaining: 3h 38m 6s. Rate: 10.5 symbols/min [2025-09-16T17:06:53.436874] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:06:53.476706] [DEBUG] [LOCAL ] AKR: Loaded 33836 existing records from primary storage. [2025-09-16T17:06:53.476879] [INFO ] [MAIN ] AKR: Loaded 33836 existing records. [2025-09-16T17:06:53.668395] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:06:53.668657] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-09-16T17:06:53.668738] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-09-16T17:06:53.669552] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-09-16T17:06:53.669602] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-09-16T17:06:53.785964] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-16T17:06:53.983808] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-09-16T17:06:54.101890] [INFO ] [REMOTE ] AKR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:06:54.774908] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-09-16T17:06:55.033416] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-16T17:06:55.574917] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-09-16T17:06:56.011090] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-16T17:06:56.025493] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-16T17:06:56.374915] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-09-16T17:06:56.853381] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-16T17:06:57.174908] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-09-16T17:06:57.721678] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-16T17:06:57.974920] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-09-16T17:06:58.774895] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-09-16T17:06:59.453237] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-16T17:06:59.574907] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-09-16T17:07:00.357590] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-16T17:07:00.374990] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-09-16T17:07:01.174926] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-09-16T17:07:01.181977] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-16T17:07:01.605161] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-16T17:07:01.974934] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-09-16T17:07:02.339217] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-16T17:07:02.774869] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-09-16T17:07:03.236463] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-16T17:07:03.574958] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-09-16T17:07:04.050789] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-16T17:07:04.374873] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-09-16T17:07:04.421266] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-16T17:07:05.174906] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-09-16T17:07:05.536325] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-16T17:07:05.539709] [INFO ] [REMOTE ] AIZ: Full fetch complete (33003 records). [2025-09-16T17:07:05.539781] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-09-16T17:07:05.540409] [FATAL] [VALIDATOR ] AIZ: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:07:05.540500] [FATAL] [MAIN ] AIZ: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:07:05.540545] [WARN ] [MAIN ] AIZ: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:07:05.540585] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-09-16T17:07:05.540667] [DEBUG] [LOCAL ] AIZ: No primary data file found to delete. [2025-09-16T17:07:05.540717] [INFO ] [LOCAL ] AIZ: Starting deletion of derivative data. [2025-09-16T17:07:05.541096] [DEBUG] [LOCAL ] AIZ: Deleted derivative data file. [2025-09-16T17:07:05.541182] [INFO ] [MAIN ] Update Progress: 73/2369 symbols completed. AIZ took 39.3s. Estimated remaining: 3h 41m 27s. Rate: 10.4 symbols/min [2025-09-16T17:07:05.619713] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-16T17:07:05.644785] [INFO ] [REMOTE ] AKA: Full fetch complete (1762 records). [2025-09-16T17:07:05.647099] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-09-16T17:07:05.861553] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:07:05.898261] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 148 unique days, need 150 days [2025-09-16T17:07:05.898795] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:07:05.898976] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:07:05.899049] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-16T17:07:05.899127] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-16T17:07:05.899166] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-09-16T17:07:05.899205] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-09-16T17:07:05.899267] [INFO ] [MAIN ] Update Progress: 74/2369 symbols completed. AKA took 15.5s. Estimated remaining: 3h 38m 33s. Rate: 10.5 symbols/min [2025-09-16T17:07:05.979552] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-09-16T17:07:06.085898] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:07:06.097621] [DEBUG] [LOCAL ] AL: Loaded 32168 existing records from primary storage. [2025-09-16T17:07:06.097798] [INFO ] [MAIN ] AL: Loaded 32168 existing records. [2025-09-16T17:07:06.297275] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:07:06.297555] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-09-16T17:07:06.297606] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-09-16T17:07:06.298378] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-09-16T17:07:06.298431] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-09-16T17:07:06.416409] [DEBUG] [LOCAL ] ALB: Loaded 39419 existing records from primary storage. [2025-09-16T17:07:06.427091] [INFO ] [MAIN ] ALB: Loaded 39419 existing records. [2025-09-16T17:07:06.774945] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-09-16T17:07:06.818670] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:07:06.845344] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-09-16T17:07:06.862854] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-09-16T17:07:06.883413] [INFO ] [REMOTE ] AL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:07:06.884455] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-09-16T17:07:06.884521] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-09-16T17:07:07.297275] [INFO ] [REMOTE ] ALB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:07:07.574899] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-09-16T17:07:07.873266] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-16T17:07:08.245544] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-16T17:07:08.374902] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-09-16T17:07:08.984028] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-16T17:07:09.174908] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-09-16T17:07:09.791809] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-16T17:07:09.974912] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-09-16T17:07:10.744857] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-16T17:07:10.774903] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-09-16T17:07:11.284083] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-16T17:07:11.574962] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-09-16T17:07:12.374937] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-09-16T17:07:12.618405] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-16T17:07:12.624270] [INFO ] [REMOTE ] AJG: Full fetch complete (51437 records). [2025-09-16T17:07:12.624423] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-09-16T17:07:13.031277] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-09-16T17:07:13.031441] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-09-16T17:07:13.032018] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-09-16T17:07:13.032122] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-09-16T17:07:13.033246] [DEBUG] [LOCAL ] AJG: Trimmed 51437 records to 34554 (keeping 150 days of data) [2025-09-16T17:07:13.157711] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-16T17:07:13.174993] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-09-16T17:07:13.292908] [DEBUG] [LOCAL ] AJG: Primary data saved (34554 records). [2025-09-16T17:07:13.293057] [INFO ] [MAIN ] AJG: Full history saved. [2025-09-16T17:07:13.295979] [INFO ] [MAIN ] Update Progress: 75/2369 symbols completed. AJG took 28.8s. Estimated remaining: 3h 39m 19s. Rate: 10.5 symbols/min [2025-09-16T17:07:13.464964] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:07:13.502942] [DEBUG] [LOCAL ] ALC: Loaded 37480 existing records from primary storage. [2025-09-16T17:07:13.503082] [INFO ] [MAIN ] ALC: Loaded 37480 existing records. [2025-09-16T17:07:13.678143] [WARN ] [MAIN ] ALC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:07:13.678395] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-09-16T17:07:13.678449] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-09-16T17:07:13.679215] [DEBUG] [LOCAL ] ALC: Deleted primary data file. [2025-09-16T17:07:13.679270] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-09-16T17:07:13.980038] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-09-16T17:07:14.037637] [INFO ] [REMOTE ] ALC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:07:14.178288] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-16T17:07:14.499966] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-16T17:07:14.774947] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-09-16T17:07:15.340119] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-16T17:07:15.574894] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-09-16T17:07:16.374912] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-09-16T17:07:16.525692] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-16T17:07:16.634703] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-16T17:07:17.174908] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-09-16T17:07:17.983717] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-09-16T17:07:17.988896] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-16T17:07:18.655986] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-16T17:07:18.661444] [INFO ] [REMOTE ] AKR: Full fetch complete (49441 records). [2025-09-16T17:07:18.661554] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-09-16T17:07:18.780059] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-09-16T17:07:19.045882] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-09-16T17:07:19.045990] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-09-16T17:07:19.046507] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-09-16T17:07:19.046549] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-09-16T17:07:19.048102] [DEBUG] [LOCAL ] AKR: Trimmed 49441 records to 34176 (keeping 150 days of data) [2025-09-16T17:07:19.254624] [DEBUG] [LOCAL ] AKR: Primary data saved (34176 records). [2025-09-16T17:07:19.254809] [INFO ] [MAIN ] AKR: Full history saved. [2025-09-16T17:07:19.254904] [INFO ] [MAIN ] Update Progress: 76/2369 symbols completed. AKR took 26.0s. Estimated remaining: 3h 39m 20s. Rate: 10.5 symbols/min [2025-09-16T17:07:19.437328] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:07:19.468415] [DEBUG] [LOCAL ] ALE: Loaded 22355 existing records from primary storage. [2025-09-16T17:07:19.468605] [INFO ] [MAIN ] ALE: Loaded 22355 existing records. [2025-09-16T17:07:19.575169] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-09-16T17:07:19.653332] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:07:19.653965] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-09-16T17:07:19.654060] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-09-16T17:07:19.654736] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-09-16T17:07:19.654790] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-09-16T17:07:19.990059] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-16T17:07:20.084275] [INFO ] [REMOTE ] ALE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:07:20.334923] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-16T17:07:20.374866] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-09-16T17:07:21.174908] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-09-16T17:07:21.320974] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-16T17:07:21.367590] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-16T17:07:21.974929] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-09-16T17:07:22.544111] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-16T17:07:22.774956] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-09-16T17:07:23.186743] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-16T17:07:23.574945] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-09-16T17:07:23.938016] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-16T17:07:24.374962] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-09-16T17:07:24.995728] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-16T17:07:25.165441] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-16T17:07:25.174839] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-09-16T17:07:25.974915] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-09-16T17:07:26.354538] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-16T17:07:26.774939] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-09-16T17:07:27.362956] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-16T17:07:27.369003] [INFO ] [REMOTE ] AL: Full fetch complete (47611 records). [2025-09-16T17:07:27.369095] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-09-16T17:07:27.585944] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-09-16T17:07:27.744524] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-09-16T17:07:27.744621] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-09-16T17:07:27.745149] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-09-16T17:07:27.745195] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-09-16T17:07:27.746795] [DEBUG] [LOCAL ] AL: Trimmed 47611 records to 32517 (keeping 150 days of data) [2025-09-16T17:07:27.889962] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-16T17:07:27.976930] [DEBUG] [LOCAL ] AL: Primary data saved (32517 records). [2025-09-16T17:07:27.977083] [INFO ] [MAIN ] AL: Full history saved. [2025-09-16T17:07:27.977178] [INFO ] [MAIN ] Update Progress: 77/2369 symbols completed. AL took 22.4s. Estimated remaining: 3h 40m 43s. Rate: 10.4 symbols/min [2025-09-16T17:07:28.375004] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-09-16T17:07:29.133791] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-16T17:07:29.174873] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-09-16T17:07:29.450563] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-16T17:07:29.974916] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-09-16T17:07:30.774865] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-09-16T17:07:30.942606] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-16T17:07:31.574880] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-09-16T17:07:31.682998] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-16T17:07:31.772309] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-16T17:07:32.374901] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-09-16T17:07:33.174890] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-09-16T17:07:33.636032] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-16T17:07:33.674159] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-16T17:07:33.974948] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-09-16T17:07:34.354743] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-16T17:07:34.774909] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-09-16T17:07:35.574878] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-09-16T17:07:35.868037] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-16T17:07:35.874500] [INFO ] [REMOTE ] ALB: Full fetch complete (57868 records). [2025-09-16T17:07:35.874768] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-09-16T17:07:35.967390] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-16T17:07:36.016436] [INFO ] [REMOTE ] ALE: Full fetch complete (32061 records). [2025-09-16T17:07:36.026889] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-09-16T17:07:36.567678] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-09-16T17:07:36.583889] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-09-16T17:07:36.592541] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-09-16T17:07:36.594955] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-09-16T17:07:36.671071] [DEBUG] [LOCAL ] ALB: Trimmed 57868 records to 39803 (keeping 150 days of data) [2025-09-16T17:07:36.678975] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-09-16T17:07:36.679037] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-09-16T17:07:36.679682] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-09-16T17:07:36.679924] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-09-16T17:07:36.681287] [DEBUG] [LOCAL ] ALE: Trimmed 32061 records to 22661 (keeping 150 days of data) [2025-09-16T17:07:37.000911] [DEBUG] [LOCAL ] ALE: Primary data saved (22661 records). [2025-09-16T17:07:37.010321] [INFO ] [MAIN ] ALE: Full history saved. [2025-09-16T17:07:37.010634] [INFO ] [MAIN ] Update Progress: 78/2369 symbols completed. ALE took 17.8s. Estimated remaining: 3h 42m 13s. Rate: 10.3 symbols/min [2025-09-16T17:07:37.078167] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-16T17:07:37.091181] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-09-16T17:07:37.112765] [DEBUG] [LOCAL ] ALB: Primary data saved (39803 records). [2025-09-16T17:07:37.112914] [INFO ] [MAIN ] ALB: Full history saved. [2025-09-16T17:07:37.114019] [INFO ] [MAIN ] Update Progress: 79/2369 symbols completed. ALB took 31.2s. Estimated remaining: 3h 39m 21s. Rate: 10.4 symbols/min [2025-09-16T17:07:38.590608] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-16T17:07:38.601537] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-09-16T17:07:40.602743] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-16T17:07:40.608900] [INFO ] [REMOTE ] ALC: Full fetch complete (55382 records). [2025-09-16T17:07:40.609035] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-09-16T17:07:40.992109] [DEBUG] [VALIDATOR ] ALC: All expected trading days are present. [2025-09-16T17:07:40.992212] [DEBUG] [VALIDATOR ] ALC: Primary data validation passed. [2025-09-16T17:07:40.992972] [INFO ] [MAIN ] ALC: Fetched primary data is valid. [2025-09-16T17:07:40.993034] [DEBUG] [LOCAL ] ALC: Saving primary data. [2025-09-16T17:07:40.994400] [DEBUG] [LOCAL ] ALC: Trimmed 55382 records to 37854 (keeping 150 days of data) [2025-09-16T17:07:41.226617] [DEBUG] [LOCAL ] ALC: Primary data saved (37854 records). [2025-09-16T17:07:41.226769] [INFO ] [MAIN ] ALC: Full history saved. [2025-09-16T17:07:41.226880] [INFO ] [MAIN ] Update Progress: 80/2369 symbols completed. ALC took 27.9s. Estimated remaining: 3h 38m 29s. Rate: 10.5 symbols/min [2025-09-16T17:07:41.851289] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:07:41.932469] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:07:41.949360] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:07:41.950263] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:07:41.963407] [DEBUG] [LOCAL ] ALG: Loaded 7302 existing records from primary storage. [2025-09-16T17:07:41.963584] [INFO ] [MAIN ] ALG: Loaded 7302 existing records. [2025-09-16T17:07:42.123685] [DEBUG] [LOCAL ] ALEX: Loaded 21778 existing records from primary storage. [2025-09-16T17:07:42.181175] [INFO ] [MAIN ] ALEX: Loaded 21778 existing records. [2025-09-16T17:07:42.185563] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:07:42.187792] [DEBUG] [LOCAL ] ALK: Loaded 39100 existing records from primary storage. [2025-09-16T17:07:42.228539] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-09-16T17:07:42.228752] [INFO ] [MAIN ] ALK: Loaded 39100 existing records. [2025-09-16T17:07:42.254840] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-09-16T17:07:42.295521] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-09-16T17:07:42.331682] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-09-16T17:07:42.337424] [DEBUG] [LOCAL ] ALIT: Loaded 38839 existing records from primary storage. [2025-09-16T17:07:42.376535] [INFO ] [MAIN ] ALIT: Loaded 38839 existing records. [2025-09-16T17:07:42.704624] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:07:42.781811] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-09-16T17:07:42.781272] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:07:42.798172] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-09-16T17:07:42.836977] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-09-16T17:07:42.849050] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-09-16T17:07:42.876051] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-09-16T17:07:42.876155] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-09-16T17:07:42.897623] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-09-16T17:07:42.910736] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:07:42.971538] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-09-16T17:07:43.093153] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-09-16T17:07:43.147306] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-09-16T17:07:43.209782] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-09-16T17:07:43.266449] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-09-16T17:07:43.739833] [INFO ] [REMOTE ] ALG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:07:43.772386] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-09-16T17:07:44.064154] [INFO ] [REMOTE ] ALK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:07:44.119326] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-09-16T17:07:44.124716] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:07:44.159360] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-09-16T17:07:44.276178] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:07:44.276510] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-09-16T17:07:44.576446] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-16T17:07:44.579322] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-09-16T17:07:45.027683] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-16T17:07:45.035728] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-09-16T17:07:45.157783] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-16T17:07:45.161439] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-09-16T17:07:45.368532] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-16T17:07:45.378350] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-09-16T17:07:45.845708] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-16T17:07:45.848748] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-09-16T17:07:45.915427] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-16T17:07:45.925777] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-09-16T17:07:46.387301] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-16T17:07:46.390241] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-09-16T17:07:46.473215] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-16T17:07:46.733332] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-16T17:07:46.774893] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-09-16T17:07:47.466192] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-16T17:07:47.518418] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-16T17:07:47.574964] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-09-16T17:07:48.331609] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-16T17:07:48.374889] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-09-16T17:07:48.486921] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-16T17:07:49.174923] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-09-16T17:07:49.654377] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-16T17:07:49.887066] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-16T17:07:49.974903] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-09-16T17:07:50.774918] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-09-16T17:07:51.574896] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-09-16T17:07:51.655085] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-16T17:07:52.385880] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-09-16T17:07:52.431091] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-16T17:07:52.791098] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-16T17:07:53.041729] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-16T17:07:53.044201] [INFO ] [REMOTE ] ALG: Full fetch complete (11757 records). [2025-09-16T17:07:53.044318] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-09-16T17:07:53.180097] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-09-16T17:07:53.465275] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-09-16T17:07:53.465361] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-09-16T17:07:53.465613] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-09-16T17:07:53.465677] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-09-16T17:07:53.466274] [DEBUG] [LOCAL ] ALG: Trimmed 11757 records to 7360 (keeping 150 days of data) [2025-09-16T17:07:53.521119] [DEBUG] [LOCAL ] ALG: Primary data saved (7360 records). [2025-09-16T17:07:53.521270] [INFO ] [MAIN ] ALG: Full history saved. [2025-09-16T17:07:53.521404] [INFO ] [MAIN ] Update Progress: 81/2369 symbols completed. ALG took 12.3s. Estimated remaining: 3h 41m 28s. Rate: 10.3 symbols/min [2025-09-16T17:07:53.698759] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:07:53.738129] [DEBUG] [LOCAL ] ALL: Loaded 36718 existing records from primary storage. [2025-09-16T17:07:53.738300] [INFO ] [MAIN ] ALL: Loaded 36718 existing records. [2025-09-16T17:07:53.915840] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:07:53.916076] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-09-16T17:07:53.916148] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-09-16T17:07:53.917318] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-09-16T17:07:53.917373] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-09-16T17:07:53.984692] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-09-16T17:07:54.264058] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-16T17:07:54.325610] [INFO ] [REMOTE ] ALL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:07:54.774898] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-09-16T17:07:55.574915] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-09-16T17:07:55.859491] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-16T17:07:56.374904] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-09-16T17:07:56.452857] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-16T17:07:56.830176] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-16T17:07:57.174901] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-09-16T17:07:57.515370] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-16T17:07:57.974905] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-09-16T17:07:58.478853] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-16T17:07:58.774894] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-09-16T17:07:59.574905] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-09-16T17:07:59.820186] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-16T17:07:59.850341] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-16T17:08:00.374900] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-09-16T17:08:01.174912] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-09-16T17:08:01.317392] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-16T17:08:01.867498] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-16T17:08:01.974909] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-09-16T17:08:02.774908] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-09-16T17:08:03.414865] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-16T17:08:03.556821] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-16T17:08:03.561008] [INFO ] [REMOTE ] ALEX: Full fetch complete (33729 records). [2025-09-16T17:08:03.561098] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-09-16T17:08:03.582665] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-09-16T17:08:03.946400] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-09-16T17:08:03.946499] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-09-16T17:08:03.946946] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-09-16T17:08:03.946992] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-09-16T17:08:03.948035] [DEBUG] [LOCAL ] ALEX: Trimmed 33729 records to 22072 (keeping 150 days of data) [2025-09-16T17:08:04.117280] [DEBUG] [LOCAL ] ALEX: Primary data saved (22072 records). [2025-09-16T17:08:04.117465] [INFO ] [MAIN ] ALEX: Full history saved. [2025-09-16T17:08:04.118211] [INFO ] [MAIN ] Update Progress: 82/2369 symbols completed. ALEX took 22.9s. Estimated remaining: 3h 43m 36s. Rate: 10.2 symbols/min [2025-09-16T17:08:04.119729] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-16T17:08:04.299902] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:08:04.340161] [DEBUG] [LOCAL ] ALLE: Loaded 32812 existing records from primary storage. [2025-09-16T17:08:04.340341] [INFO ] [MAIN ] ALLE: Loaded 32812 existing records. [2025-09-16T17:08:04.383214] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-09-16T17:08:04.520789] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:08:04.521075] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-09-16T17:08:04.521124] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-09-16T17:08:04.522102] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-09-16T17:08:04.522153] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-09-16T17:08:04.875023] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:08:04.951143] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-16T17:08:05.174926] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-09-16T17:08:05.974957] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-09-16T17:08:05.995972] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-16T17:08:06.002306] [INFO ] [REMOTE ] ALIT: Full fetch complete (57360 records). [2025-09-16T17:08:06.002438] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-09-16T17:08:06.395100] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-09-16T17:08:06.395200] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-09-16T17:08:06.395825] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-09-16T17:08:06.395875] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-09-16T17:08:06.397278] [DEBUG] [LOCAL ] ALIT: Trimmed 57360 records to 39226 (keeping 150 days of data) [2025-09-16T17:08:06.676925] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-16T17:08:06.692632] [DEBUG] [LOCAL ] ALIT: Primary data saved (39226 records). [2025-09-16T17:08:06.692821] [INFO ] [MAIN ] ALIT: Full history saved. [2025-09-16T17:08:06.693275] [INFO ] [MAIN ] Update Progress: 83/2369 symbols completed. ALIT took 25.5s. Estimated remaining: 3h 41m 60s. Rate: 10.3 symbols/min [2025-09-16T17:08:06.783200] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-09-16T17:08:06.862965] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:08:06.904480] [DEBUG] [LOCAL ] ALLY: Loaded 39217 existing records from primary storage. [2025-09-16T17:08:06.904623] [INFO ] [MAIN ] ALLY: Loaded 39217 existing records. [2025-09-16T17:08:07.081410] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:08:07.081703] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-09-16T17:08:07.081749] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-09-16T17:08:07.082674] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-09-16T17:08:07.082753] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-09-16T17:08:07.436990] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:08:07.574875] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-09-16T17:08:07.634587] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-16T17:08:08.374913] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-09-16T17:08:08.508069] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-16T17:08:08.893043] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-16T17:08:09.174924] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-09-16T17:08:09.725200] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-16T17:08:09.974954] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-09-16T17:08:10.689451] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-16T17:08:10.774901] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-09-16T17:08:11.300985] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-16T17:08:11.574947] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-09-16T17:08:12.293479] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-16T17:08:12.374865] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-09-16T17:08:12.789481] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-16T17:08:12.795420] [INFO ] [REMOTE ] ALK: Full fetch complete (57265 records). [2025-09-16T17:08:12.795564] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-09-16T17:08:12.796324] [FATAL] [VALIDATOR ] ALK: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:08:12.796407] [FATAL] [MAIN ] ALK: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:08:12.796446] [WARN ] [MAIN ] ALK: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:08:12.796502] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-09-16T17:08:12.796575] [DEBUG] [LOCAL ] ALK: No primary data file found to delete. [2025-09-16T17:08:12.796614] [INFO ] [LOCAL ] ALK: Starting deletion of derivative data. [2025-09-16T17:08:12.797010] [DEBUG] [LOCAL ] ALK: Deleted derivative data file. [2025-09-16T17:08:12.797110] [INFO ] [MAIN ] Update Progress: 84/2369 symbols completed. ALK took 31.6s. Estimated remaining: 3h 42m 1s. Rate: 10.3 symbols/min [2025-09-16T17:08:12.975905] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:08:13.011276] [DEBUG] [LOCAL ] ALSN: Loaded 31418 existing records from primary storage. [2025-09-16T17:08:13.011481] [INFO ] [MAIN ] ALSN: Loaded 31418 existing records. [2025-09-16T17:08:13.181900] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-09-16T17:08:13.196842] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:08:13.197181] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-09-16T17:08:13.197231] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-09-16T17:08:13.198184] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-09-16T17:08:13.198246] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-09-16T17:08:13.578974] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:08:13.974921] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-09-16T17:08:14.043863] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-16T17:08:14.629806] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-16T17:08:14.774883] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-09-16T17:08:15.448466] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-16T17:08:15.454473] [INFO ] [REMOTE ] ALL: Full fetch complete (54492 records). [2025-09-16T17:08:15.454585] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-09-16T17:08:15.579996] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-09-16T17:08:15.837366] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-09-16T17:08:15.837447] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-09-16T17:08:15.838049] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-09-16T17:08:15.838099] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-09-16T17:08:15.839219] [DEBUG] [LOCAL ] ALL: Trimmed 54492 records to 37086 (keeping 150 days of data) [2025-09-16T17:08:16.077180] [DEBUG] [LOCAL ] ALL: Primary data saved (37086 records). [2025-09-16T17:08:16.077335] [INFO ] [MAIN ] ALL: Full history saved. [2025-09-16T17:08:16.077421] [INFO ] [MAIN ] Update Progress: 85/2369 symbols completed. ALL took 22.6s. Estimated remaining: 3h 40m 47s. Rate: 10.3 symbols/min [2025-09-16T17:08:16.251176] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:08:16.251390] [DEBUG] [LOCAL ] ALTG: No existing data file found in primary storage. [2025-09-16T17:08:16.251431] [WARN ] [MAIN ] ALTG: No existing data found, performing full refresh instead. [2025-09-16T17:08:16.251551] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-09-16T17:08:16.251591] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-09-16T17:08:16.251634] [DEBUG] [LOCAL ] ALTG: No primary data file found to delete. [2025-09-16T17:08:16.251689] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-09-16T17:08:16.395857] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-09-16T17:08:16.612371] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:08:16.721598] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-16T17:08:17.162729] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-16T17:08:17.174852] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-09-16T17:08:17.849841] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-16T17:08:17.974899] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-09-16T17:08:18.565252] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-16T17:08:18.774941] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-09-16T17:08:19.442956] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-16T17:08:19.574875] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-09-16T17:08:20.165839] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-16T17:08:20.374911] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-09-16T17:08:21.180021] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-09-16T17:08:21.193574] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-16T17:08:21.978960] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-09-16T17:08:21.998470] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-16T17:08:22.025164] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-16T17:08:22.774947] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-09-16T17:08:23.243457] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-16T17:08:23.248697] [INFO ] [REMOTE ] ALLE: Full fetch complete (49481 records). [2025-09-16T17:08:23.248844] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-09-16T17:08:23.583257] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-09-16T17:08:23.627811] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-09-16T17:08:23.628630] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-09-16T17:08:23.629268] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-09-16T17:08:23.629512] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-09-16T17:08:23.647387] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-16T17:08:23.646697] [DEBUG] [LOCAL ] ALLE: Trimmed 49481 records to 33163 (keeping 150 days of data) [2025-09-16T17:08:23.871015] [DEBUG] [LOCAL ] ALLE: Primary data saved (33163 records). [2025-09-16T17:08:23.871165] [INFO ] [MAIN ] ALLE: Full history saved. [2025-09-16T17:08:23.874234] [INFO ] [MAIN ] Update Progress: 86/2369 symbols completed. ALLE took 19.8s. Estimated remaining: 3h 41m 34s. Rate: 10.3 symbols/min [2025-09-16T17:08:24.045985] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:08:24.056206] [DEBUG] [LOCAL ] ALUR: Loaded 7335 existing records from primary storage. [2025-09-16T17:08:24.056335] [INFO ] [MAIN ] ALUR: Loaded 7335 existing records. [2025-09-16T17:08:24.235299] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:08:24.235554] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-09-16T17:08:24.235601] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-09-16T17:08:24.235945] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-09-16T17:08:24.236005] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-09-16T17:08:24.384887] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-09-16T17:08:24.598112] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:08:25.174914] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-09-16T17:08:25.227266] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-16T17:08:25.698302] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-16T17:08:25.974892] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-09-16T17:08:26.417021] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-16T17:08:26.774911] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-09-16T17:08:27.575021] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-09-16T17:08:27.926367] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-16T17:08:28.300071] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-16T17:08:28.320806] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-16T17:08:28.374930] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-09-16T17:08:29.174910] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-09-16T17:08:29.358728] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-16T17:08:29.974927] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-09-16T17:08:30.774943] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-09-16T17:08:30.816781] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-16T17:08:31.405761] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-16T17:08:31.530071] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-16T17:08:31.574872] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-09-16T17:08:32.374918] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-09-16T17:08:32.702037] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-16T17:08:33.174920] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-09-16T17:08:33.974878] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-09-16T17:08:34.015254] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-16T17:08:34.021608] [INFO ] [REMOTE ] ALLY: Full fetch complete (57839 records). [2025-09-16T17:08:34.021738] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-09-16T17:08:34.414399] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-09-16T17:08:34.414600] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-09-16T17:08:34.415254] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-09-16T17:08:34.415337] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-09-16T17:08:34.429699] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-16T17:08:34.434699] [DEBUG] [LOCAL ] ALLY: Trimmed 57839 records to 39603 (keeping 150 days of data) [2025-09-16T17:08:34.679763] [DEBUG] [LOCAL ] ALLY: Primary data saved (39603 records). [2025-09-16T17:08:34.679932] [INFO ] [MAIN ] ALLY: Full history saved. [2025-09-16T17:08:34.681476] [INFO ] [MAIN ] Update Progress: 87/2369 symbols completed. ALLY took 28.0s. Estimated remaining: 3h 43m 39s. Rate: 10.2 symbols/min [2025-09-16T17:08:34.780757] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-09-16T17:08:34.858540] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:08:34.895316] [DEBUG] [LOCAL ] ALV: Loaded 30747 existing records from primary storage. [2025-09-16T17:08:34.895471] [INFO ] [MAIN ] ALV: Loaded 30747 existing records. [2025-09-16T17:08:35.082032] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:08:35.082299] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-09-16T17:08:35.082348] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-09-16T17:08:35.083164] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-09-16T17:08:35.083216] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-09-16T17:08:35.446244] [INFO ] [REMOTE ] ALV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:08:35.499886] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-16T17:08:35.520121] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-16T17:08:35.574907] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-09-16T17:08:36.374921] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-09-16T17:08:36.960630] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-16T17:08:36.966139] [INFO ] [REMOTE ] ALSN: Full fetch complete (47486 records). [2025-09-16T17:08:36.966229] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-09-16T17:08:37.183226] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-09-16T17:08:37.359773] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-09-16T17:08:37.360628] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-09-16T17:08:37.360991] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-16T17:08:37.361993] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-09-16T17:08:37.364969] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-09-16T17:08:37.366419] [INFO ] [REMOTE ] ALTG: Full fetch complete (26185 records). [2025-09-16T17:08:37.366742] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-09-16T17:08:37.411702] [DEBUG] [LOCAL ] ALSN: Trimmed 47486 records to 31728 (keeping 150 days of data) [2025-09-16T17:08:37.868707] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-09-16T17:08:37.869481] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-09-16T17:08:37.871854] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-09-16T17:08:37.872239] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-09-16T17:08:37.881367] [DEBUG] [LOCAL ] ALTG: Trimmed 26185 records to 17512 (keeping 150 days of data) [2025-09-16T17:08:38.005220] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-09-16T17:08:38.054488] [DEBUG] [LOCAL ] ALSN: Primary data saved (31728 records). [2025-09-16T17:08:38.055458] [INFO ] [MAIN ] ALSN: Full history saved. [2025-09-16T17:08:38.055828] [INFO ] [MAIN ] Update Progress: 88/2369 symbols completed. ALSN took 25.3s. Estimated remaining: 3h 42m 28s. Rate: 10.3 symbols/min [2025-09-16T17:08:38.225399] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-16T17:08:38.253429] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:08:38.262616] [DEBUG] [LOCAL ] ALTG: Primary data saved (17512 records). [2025-09-16T17:08:38.262878] [INFO ] [MAIN ] ALTG: Full history saved. [2025-09-16T17:08:38.263024] [INFO ] [MAIN ] Update Progress: 89/2369 symbols completed. ALTG took 22.2s. Estimated remaining: 3h 39m 58s. Rate: 10.4 symbols/min [2025-09-16T17:08:38.266979] [DEBUG] [LOCAL ] ALX: Loaded 5174 existing records from primary storage. [2025-09-16T17:08:38.311094] [INFO ] [MAIN ] ALX: Loaded 5174 existing records. [2025-09-16T17:08:38.589994] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:08:38.650071] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:08:38.650468] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-09-16T17:08:38.650533] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-09-16T17:08:38.651050] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-09-16T17:08:38.651126] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-09-16T17:08:38.776180] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-09-16T17:08:38.961313] [DEBUG] [LOCAL ] AM: Loaded 38259 existing records from primary storage. [2025-09-16T17:08:38.972116] [INFO ] [MAIN ] AM: Loaded 38259 existing records. [2025-09-16T17:08:39.194380] [INFO ] [REMOTE ] ALX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:08:39.256954] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:08:39.257183] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-09-16T17:08:39.257236] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-09-16T17:08:39.258143] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-09-16T17:08:39.258191] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-09-16T17:08:39.582133] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-09-16T17:08:39.618065] [INFO ] [REMOTE ] AM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:08:39.649087] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-16T17:08:39.684577] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-16T17:08:40.133237] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-16T17:08:40.374909] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-09-16T17:08:40.877207] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-16T17:08:41.174929] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-09-16T17:08:41.948252] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-16T17:08:41.974849] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-09-16T17:08:42.597847] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-16T17:08:42.774913] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-09-16T17:08:43.508579] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-16T17:08:43.574905] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-09-16T17:08:44.205848] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-16T17:08:44.207128] [INFO ] [REMOTE ] ALUR: Full fetch complete (13072 records). [2025-09-16T17:08:44.207202] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-09-16T17:08:44.378009] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-09-16T17:08:44.590458] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-09-16T17:08:44.590534] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-09-16T17:08:44.590776] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-09-16T17:08:44.590819] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-09-16T17:08:44.591279] [DEBUG] [LOCAL ] ALUR: Trimmed 13072 records to 7366 (keeping 150 days of data) [2025-09-16T17:08:44.634020] [DEBUG] [LOCAL ] ALUR: Primary data saved (7366 records). [2025-09-16T17:08:44.634124] [INFO ] [MAIN ] ALUR: Full history saved. [2025-09-16T17:08:44.634210] [INFO ] [MAIN ] Update Progress: 90/2369 symbols completed. ALUR took 20.8s. Estimated remaining: 3h 40m 7s. Rate: 10.4 symbols/min [2025-09-16T17:08:44.801284] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:08:44.826790] [DEBUG] [LOCAL ] AMBC: Loaded 26441 existing records from primary storage. [2025-09-16T17:08:44.826945] [INFO ] [MAIN ] AMBC: Loaded 26441 existing records. [2025-09-16T17:08:45.003759] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:08:45.004041] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-09-16T17:08:45.004089] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-09-16T17:08:45.004770] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-09-16T17:08:45.004822] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-09-16T17:08:45.180123] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-09-16T17:08:45.448871] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:08:45.734263] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-16T17:08:45.974988] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-09-16T17:08:46.239405] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-16T17:08:46.774920] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-09-16T17:08:46.996512] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-16T17:08:47.574910] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-09-16T17:08:48.236189] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-16T17:08:48.374929] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-09-16T17:08:49.027441] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-16T17:08:49.174945] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-09-16T17:08:49.974979] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-09-16T17:08:50.147187] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-16T17:08:50.746092] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-16T17:08:50.774883] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-09-16T17:08:51.000234] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-16T17:08:51.574993] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-09-16T17:08:52.027524] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-16T17:08:52.200655] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-16T17:08:52.374912] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-09-16T17:08:53.174906] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-09-16T17:08:53.846837] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-16T17:08:53.974920] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-09-16T17:08:54.628827] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-16T17:08:54.774910] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-09-16T17:08:54.846486] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-16T17:08:55.574903] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-09-16T17:08:56.283493] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-16T17:08:56.374897] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-09-16T17:08:57.042380] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-16T17:08:57.174879] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-09-16T17:08:57.974905] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-09-16T17:08:58.309622] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-16T17:08:58.642226] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-16T17:08:58.774901] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-09-16T17:08:59.439889] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-16T17:08:59.574879] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-09-16T17:09:00.374886] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-09-16T17:09:00.476100] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-16T17:09:01.174906] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-09-16T17:09:01.222741] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-16T17:09:01.411332] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-16T17:09:01.974893] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-09-16T17:09:02.687449] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-16T17:09:02.774914] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-09-16T17:09:02.856471] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-16T17:09:02.863039] [INFO ] [REMOTE ] AM: Full fetch complete (56821 records). [2025-09-16T17:09:02.863204] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-09-16T17:09:03.259376] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-09-16T17:09:03.259466] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-09-16T17:09:03.260113] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-09-16T17:09:03.260178] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-09-16T17:09:03.261623] [DEBUG] [LOCAL ] AM: Trimmed 56821 records to 38636 (keeping 150 days of data) [2025-09-16T17:09:03.453804] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-16T17:09:03.480112] [INFO ] [REMOTE ] ALX: Full fetch complete (5953 records). [2025-09-16T17:09:03.480939] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-09-16T17:09:03.580018] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-09-16T17:09:03.863396] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-09-16T17:09:03.864257] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-09-16T17:09:03.865157] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-09-16T17:09:03.865512] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-09-16T17:09:03.870821] [DEBUG] [LOCAL ] ALX: Trimmed 5953 records to 5247 (keeping 150 days of data) [2025-09-16T17:09:03.904616] [DEBUG] [LOCAL ] AM: Primary data saved (38636 records). [2025-09-16T17:09:03.904990] [INFO ] [MAIN ] AM: Full history saved. [2025-09-16T17:09:03.905095] [INFO ] [MAIN ] Update Progress: 91/2369 symbols completed. AM took 25.6s. Estimated remaining: 3h 45m 38s. Rate: 10.1 symbols/min [2025-09-16T17:09:04.089814] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:09:04.090729] [DEBUG] [LOCAL ] ALX: Primary data saved (5247 records). [2025-09-16T17:09:04.090913] [INFO ] [MAIN ] ALX: Full history saved. [2025-09-16T17:09:04.091265] [INFO ] [MAIN ] Update Progress: 92/2369 symbols completed. ALX took 26.0s. Estimated remaining: 3h 43m 10s. Rate: 10.2 symbols/min [2025-09-16T17:09:04.283018] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:09:04.283884] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-09-16T17:09:04.292343] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-09-16T17:09:04.294189] [DEBUG] [LOCAL ] AMBP: Loaded 33476 existing records from primary storage. [2025-09-16T17:09:04.294260] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-09-16T17:09:04.294396] [INFO ] [MAIN ] AMBP: Loaded 33476 existing records. [2025-09-16T17:09:04.294450] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-16T17:09:04.366519] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-16T17:09:04.377606] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-09-16T17:09:04.382844] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-09-16T17:09:04.589289] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:09:04.601007] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-09-16T17:09:04.616467] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-09-16T17:09:04.659831] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-09-16T17:09:04.752243] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-09-16T17:09:04.981118] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:09:05.175941] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-02. [2025-09-16T17:09:05.189330] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-16T17:09:05.245269] [INFO ] [REMOTE ] ALV: Full fetch complete (46927 records). [2025-09-16T17:09:05.245844] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-09-16T17:09:05.265397] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:09:05.450729] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:09:05.479113] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-02 [2025-09-16T17:09:05.665347] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-09-16T17:09:05.665445] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-09-16T17:09:05.666047] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-09-16T17:09:05.666158] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-09-16T17:09:05.686663] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-16T17:09:05.693801] [DEBUG] [LOCAL ] ALV: Trimmed 46927 records to 31077 (keeping 150 days of data) [2025-09-16T17:09:05.896400] [DEBUG] [LOCAL ] ALV: Primary data saved (31077 records). [2025-09-16T17:09:05.896572] [INFO ] [MAIN ] ALV: Full history saved. [2025-09-16T17:09:05.897781] [INFO ] [MAIN ] Update Progress: 93/2369 symbols completed. ALV took 31.2s. Estimated remaining: 3h 41m 24s. Rate: 10.3 symbols/min [2025-09-16T17:09:05.980102] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-03. [2025-09-16T17:09:06.070564] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:09:06.111124] [DEBUG] [LOCAL ] AMC: Loaded 39733 existing records from primary storage. [2025-09-16T17:09:06.111285] [INFO ] [MAIN ] AMC: Loaded 39733 existing records. [2025-09-16T17:09:06.268638] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:09:06.287377] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:09:06.287717] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-09-16T17:09:06.287844] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-09-16T17:09:06.287447] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-03 [2025-09-16T17:09:06.288887] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-09-16T17:09:06.288961] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-09-16T17:09:06.641203] [INFO ] [REMOTE ] AMC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:09:06.774901] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-09-16T17:09:07.574924] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-09-16T17:09:08.374953] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-04. [2025-09-16T17:09:08.610331] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:09:08.610734] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-04 [2025-09-16T17:09:09.120821] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-09-16T17:09:09.159077] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-16T17:09:09.174844] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-09-16T17:09:09.974925] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-09-16T17:09:10.664512] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-16T17:09:10.774925] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-09-16T17:09:11.574939] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-05. [2025-09-16T17:09:12.086270] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-16T17:09:12.096363] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:09:12.097229] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-05 [2025-09-16T17:09:12.143250] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-16T17:09:12.374951] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-09-16T17:09:13.174911] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-09-16T17:09:13.881222] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-16T17:09:13.974917] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-09-16T17:09:14.658524] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-16T17:09:14.774909] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-09-16T17:09:14.910075] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-16T17:09:15.574923] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-09-16T17:09:16.374913] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-09-16T17:09:16.431745] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-16T17:09:16.435469] [INFO ] [REMOTE ] AMBC: Full fetch complete (40401 records). [2025-09-16T17:09:16.435571] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-09-16T17:09:16.436193] [FATAL] [VALIDATOR ] AMBC: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:09:16.436275] [FATAL] [MAIN ] AMBC: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:09:16.436313] [WARN ] [MAIN ] AMBC: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:09:16.436351] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-09-16T17:09:16.436409] [DEBUG] [LOCAL ] AMBC: No primary data file found to delete. [2025-09-16T17:09:16.436467] [INFO ] [LOCAL ] AMBC: Starting deletion of derivative data. [2025-09-16T17:09:16.436769] [DEBUG] [LOCAL ] AMBC: Deleted derivative data file. [2025-09-16T17:09:16.436853] [INFO ] [MAIN ] Update Progress: 94/2369 symbols completed. AMBC took 31.8s. Estimated remaining: 3h 43m 12s. Rate: 10.2 symbols/min [2025-09-16T17:09:16.615198] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:09:16.655438] [DEBUG] [LOCAL ] AMCR: Loaded 39632 existing records from primary storage. [2025-09-16T17:09:16.655584] [INFO ] [MAIN ] AMCR: Loaded 39632 existing records. [2025-09-16T17:09:16.841074] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:09:16.841316] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-09-16T17:09:16.841363] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-09-16T17:09:16.842344] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-09-16T17:09:16.842404] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-09-16T17:09:17.185283] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-06. [2025-09-16T17:09:17.212277] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:09:17.246517] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-09-16T17:09:17.405711] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:09:17.406064] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-06 [2025-09-16T17:09:17.473369] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-16T17:09:17.974913] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-09-16T17:09:18.774916] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-09-16T17:09:19.574932] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-07. [2025-09-16T17:09:19.658417] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-16T17:09:20.132272] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-16T17:09:20.374906] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-09-16T17:09:21.094634] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-09-16T17:09:21.174894] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-09-16T17:09:21.856943] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-16T17:09:21.974948] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-08. [2025-09-16T17:09:22.774930] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-09-16T17:09:23.026232] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-16T17:09:23.217006] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-16T17:09:23.574977] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-09-16T17:09:24.159746] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-16T17:09:24.374926] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-09-16T17:09:25.174922] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-09. [2025-09-16T17:09:25.592107] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-16T17:09:25.974914] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-09-16T17:09:26.066166] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-16T17:09:26.069486] [INFO ] [REMOTE ] AMBQ: Full fetch complete (6990 records). [2025-09-16T17:09:26.069555] [DEBUG] [VALIDATOR ] AMBQ: Validating primary data. [2025-09-16T17:09:26.248757] [WARN ] [VALIDATOR ] AMBQ: Validation failed - insufficient historical data. Have 34 unique days, need 150 days [2025-09-16T17:09:26.248988] [FATAL] [MAIN ] AMBQ: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:09:26.249032] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:09:26.249073] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-16T17:09:26.249131] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-16T17:09:26.249169] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-09-16T17:09:26.249213] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-09-16T17:09:26.249275] [INFO ] [MAIN ] Update Progress: 95/2369 symbols completed. AMBQ took 22.2s. Estimated remaining: 3h 44m 40s. Rate: 10.1 symbols/min [2025-09-16T17:09:26.428252] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:09:26.464612] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-16T17:09:26.505145] [DEBUG] [LOCAL ] AME: Loaded 35658 existing records from primary storage. [2025-09-16T17:09:26.505308] [INFO ] [MAIN ] AME: Loaded 35658 existing records. [2025-09-16T17:09:26.679694] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:09:26.679921] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-09-16T17:09:26.679966] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-09-16T17:09:26.681256] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-09-16T17:09:26.681307] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-09-16T17:09:26.779980] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-09-16T17:09:27.031868] [INFO ] [REMOTE ] AME: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:09:27.419856] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-16T17:09:27.424981] [INFO ] [REMOTE ] AMBP: Full fetch complete (49425 records). [2025-09-16T17:09:27.425100] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-09-16T17:09:27.583714] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-09-16T17:09:27.825982] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-09-16T17:09:27.826068] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-09-16T17:09:27.826591] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-09-16T17:09:27.826636] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-09-16T17:09:27.827721] [DEBUG] [LOCAL ] AMBP: Trimmed 49425 records to 33802 (keeping 150 days of data) [2025-09-16T17:09:28.022287] [DEBUG] [LOCAL ] AMBP: Primary data saved (33802 records). [2025-09-16T17:09:28.022437] [INFO ] [MAIN ] AMBP: Full history saved. [2025-09-16T17:09:28.022523] [INFO ] [MAIN ] Update Progress: 96/2369 symbols completed. AMBP took 24.1s. Estimated remaining: 3h 42m 56s. Rate: 10.2 symbols/min [2025-09-16T17:09:28.197261] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:09:28.214296] [DEBUG] [LOCAL ] AMG: Loaded 14410 existing records from primary storage. [2025-09-16T17:09:28.214431] [INFO ] [MAIN ] AMG: Loaded 14410 existing records. [2025-09-16T17:09:28.380898] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-09-16T17:09:28.402346] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:09:28.403423] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-09-16T17:09:28.403485] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-09-16T17:09:28.404251] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-09-16T17:09:28.404324] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-09-16T17:09:28.780578] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-16T17:09:28.821909] [INFO ] [REMOTE ] AMG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:09:29.058745] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-16T17:09:29.174966] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-09-16T17:09:29.974919] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-09-16T17:09:30.342347] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-16T17:09:30.774893] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-09-16T17:09:30.836156] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-16T17:09:31.416321] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-16T17:09:31.574883] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-09-16T17:09:32.374942] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-09-16T17:09:33.174875] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-09-16T17:09:33.200207] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-09-16T17:09:33.206877] [INFO ] [REMOTE ] AMC: Full fetch complete (58433 records). [2025-09-16T17:09:33.206989] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-09-16T17:09:33.595933] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-16T17:09:33.668925] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-09-16T17:09:33.669318] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-09-16T17:09:33.670372] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-09-16T17:09:33.671661] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-09-16T17:09:33.671557] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-16T17:09:33.683544] [DEBUG] [LOCAL ] AMC: Trimmed 58433 records to 40123 (keeping 150 days of data) [2025-09-16T17:09:33.921465] [DEBUG] [LOCAL ] AMC: Primary data saved (40123 records). [2025-09-16T17:09:33.921599] [INFO ] [MAIN ] AMC: Full history saved. [2025-09-16T17:09:33.922601] [INFO ] [MAIN ] Update Progress: 97/2369 symbols completed. AMC took 28.0s. Estimated remaining: 3h 42m 50s. Rate: 10.2 symbols/min [2025-09-16T17:09:33.982168] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-09-16T17:09:34.104630] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:09:34.147604] [DEBUG] [LOCAL ] AMH: Loaded 38075 existing records from primary storage. [2025-09-16T17:09:34.147772] [INFO ] [MAIN ] AMH: Loaded 38075 existing records. [2025-09-16T17:09:34.325792] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:09:34.326077] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-09-16T17:09:34.326136] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-09-16T17:09:34.327083] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-09-16T17:09:34.327151] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-09-16T17:09:34.689813] [INFO ] [REMOTE ] AMH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:09:34.746027] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-16T17:09:34.774870] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-09-16T17:09:35.231974] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-16T17:09:35.574882] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-09-16T17:09:36.147623] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-16T17:09:36.374917] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-09-16T17:09:37.174940] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-09-16T17:09:37.647328] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-16T17:09:37.701387] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-16T17:09:37.974917] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-09-16T17:09:38.769501] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-16T17:09:38.779755] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-09-16T17:09:39.179094] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-16T17:09:39.574915] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-09-16T17:09:40.227572] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-16T17:09:40.374857] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-09-16T17:09:41.174910] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-09-16T17:09:41.337686] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-16T17:09:41.768822] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-16T17:09:41.974902] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-09-16T17:09:42.774923] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-09-16T17:09:43.164654] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-16T17:09:43.574907] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-09-16T17:09:43.613927] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-16T17:09:44.149383] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-16T17:09:44.374902] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-09-16T17:09:45.174895] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-09-16T17:09:45.494020] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-16T17:09:45.500813] [INFO ] [REMOTE ] AMCR: Full fetch complete (58347 records). [2025-09-16T17:09:45.500947] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-09-16T17:09:45.884349] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-09-16T17:09:45.884546] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-09-16T17:09:45.885165] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-09-16T17:09:45.885241] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-09-16T17:09:45.887876] [DEBUG] [LOCAL ] AMCR: Trimmed 58347 records to 40022 (keeping 150 days of data) [2025-09-16T17:09:45.983993] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-09-16T17:09:46.036403] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-16T17:09:46.191086] [DEBUG] [LOCAL ] AMCR: Primary data saved (40022 records). [2025-09-16T17:09:46.191242] [INFO ] [MAIN ] AMCR: Full history saved. [2025-09-16T17:09:46.192323] [INFO ] [MAIN ] Update Progress: 98/2369 symbols completed. AMCR took 29.8s. Estimated remaining: 3h 45m 13s. Rate: 10.1 symbols/min [2025-09-16T17:09:46.364038] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:09:46.383010] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-16T17:09:46.422409] [DEBUG] [LOCAL ] AMN: Loaded 31022 existing records from primary storage. [2025-09-16T17:09:46.422578] [INFO ] [MAIN ] AMN: Loaded 31022 existing records. [2025-09-16T17:09:46.599389] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:09:46.599686] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-09-16T17:09:46.599736] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-09-16T17:09:46.600520] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-09-16T17:09:46.600585] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-09-16T17:09:46.780156] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-09-16T17:09:46.962309] [INFO ] [REMOTE ] AMN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:09:47.574918] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-09-16T17:09:47.723986] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-16T17:09:47.730068] [INFO ] [REMOTE ] AME: Full fetch complete (52766 records). [2025-09-16T17:09:47.730164] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-09-16T17:09:48.051219] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-16T17:09:48.141329] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-09-16T17:09:48.141408] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-09-16T17:09:48.142035] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-09-16T17:09:48.142083] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-09-16T17:09:48.143294] [DEBUG] [LOCAL ] AME: Trimmed 52766 records to 36016 (keeping 150 days of data) [2025-09-16T17:09:48.374940] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-09-16T17:09:48.378733] [DEBUG] [LOCAL ] AME: Primary data saved (36016 records). [2025-09-16T17:09:48.378852] [INFO ] [MAIN ] AME: Full history saved. [2025-09-16T17:09:48.378959] [INFO ] [MAIN ] Update Progress: 99/2369 symbols completed. AME took 22.1s. Estimated remaining: 3h 43m 40s. Rate: 10.1 symbols/min [2025-09-16T17:09:48.548524] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:09:48.572429] [DEBUG] [LOCAL ] AMP: Loaded 23065 existing records from primary storage. [2025-09-16T17:09:48.572560] [INFO ] [MAIN ] AMP: Loaded 23065 existing records. [2025-09-16T17:09:48.751141] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:09:48.751405] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-09-16T17:09:48.751489] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-09-16T17:09:48.752218] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-09-16T17:09:48.752266] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-09-16T17:09:49.112204] [INFO ] [REMOTE ] AMP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:09:49.180749] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-09-16T17:09:49.194093] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-16T17:09:49.511022] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-16T17:09:49.974903] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-09-16T17:09:50.767448] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-16T17:09:50.774833] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-09-16T17:09:51.258134] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-16T17:09:51.574910] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-09-16T17:09:52.223202] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-16T17:09:52.374904] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-09-16T17:09:52.558705] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-16T17:09:53.174911] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-09-16T17:09:53.839613] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-16T17:09:53.974896] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-09-16T17:09:54.078096] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-16T17:09:54.080998] [INFO ] [REMOTE ] AMG: Full fetch complete (22495 records). [2025-09-16T17:09:54.081084] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-09-16T17:09:54.454229] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-09-16T17:09:54.454320] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-09-16T17:09:54.454622] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-09-16T17:09:54.454682] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-09-16T17:09:54.455450] [DEBUG] [LOCAL ] AMG: Trimmed 22495 records to 14556 (keeping 150 days of data) [2025-09-16T17:09:54.552316] [DEBUG] [LOCAL ] AMG: Primary data saved (14556 records). [2025-09-16T17:09:54.552463] [INFO ] [MAIN ] AMG: Full history saved. [2025-09-16T17:09:54.552561] [INFO ] [MAIN ] Update Progress: 100/2369 symbols completed. AMG took 26.5s. Estimated remaining: 3h 43m 40s. Rate: 10.1 symbols/min [2025-09-16T17:09:54.722936] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:09:54.766519] [DEBUG] [LOCAL ] AMPX: Loaded 38648 existing records from primary storage. [2025-09-16T17:09:54.766689] [INFO ] [MAIN ] AMPX: Loaded 38648 existing records. [2025-09-16T17:09:54.780032] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-09-16T17:09:54.949156] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:09:54.949376] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-09-16T17:09:54.949422] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-09-16T17:09:54.950360] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-09-16T17:09:54.950411] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-09-16T17:09:55.318220] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:09:55.338520] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-16T17:09:55.574897] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-09-16T17:09:55.833186] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-16T17:09:56.374891] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-09-16T17:09:56.952884] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-16T17:09:57.174900] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-09-16T17:09:57.765613] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-16T17:09:57.974902] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-09-16T17:09:58.417676] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-16T17:09:58.774941] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-09-16T17:09:59.316025] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-16T17:09:59.574978] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-09-16T17:09:59.755218] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-16T17:10:00.374899] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-09-16T17:10:01.045739] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-16T17:10:01.174893] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-09-16T17:10:01.974906] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-09-16T17:10:02.719754] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-09-16T17:10:02.774867] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-09-16T17:10:03.395374] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-16T17:10:03.574918] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-09-16T17:10:03.729941] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-16T17:10:03.874411] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-16T17:10:04.374909] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-09-16T17:10:05.020517] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-16T17:10:05.174892] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-09-16T17:10:05.974902] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-09-16T17:10:06.307553] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-16T17:10:06.416501] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-16T17:10:06.421821] [INFO ] [REMOTE ] AMN: Full fetch complete (46344 records). [2025-09-16T17:10:06.421965] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-09-16T17:10:06.778267] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-09-16T17:10:06.810738] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-09-16T17:10:06.810810] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-09-16T17:10:06.811343] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-09-16T17:10:06.811386] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-09-16T17:10:06.812718] [DEBUG] [LOCAL ] AMN: Trimmed 46344 records to 31354 (keeping 150 days of data) [2025-09-16T17:10:07.003056] [DEBUG] [LOCAL ] AMN: Primary data saved (31354 records). [2025-09-16T17:10:07.003205] [INFO ] [MAIN ] AMN: Full history saved. [2025-09-16T17:10:07.006342] [INFO ] [MAIN ] Update Progress: 101/2369 symbols completed. AMN took 20.8s. Estimated remaining: 3h 46m 1s. Rate: 10.0 symbols/min [2025-09-16T17:10:07.177482] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:10:07.207820] [DEBUG] [LOCAL ] AMPY: Loaded 27646 existing records from primary storage. [2025-09-16T17:10:07.207995] [INFO ] [MAIN ] AMPY: Loaded 27646 existing records. [2025-09-16T17:10:07.391797] [WARN ] [MAIN ] AMPY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:10:07.392181] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-09-16T17:10:07.392278] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-09-16T17:10:07.402429] [DEBUG] [LOCAL ] AMPY: Deleted primary data file. [2025-09-16T17:10:07.415262] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-09-16T17:10:07.496251] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-16T17:10:07.531734] [INFO ] [REMOTE ] AMH: Full fetch complete (56207 records). [2025-09-16T17:10:07.557999] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-09-16T17:10:07.581394] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-09-16T17:10:07.965874] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:10:08.186451] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-09-16T17:10:08.186534] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-09-16T17:10:08.187154] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-09-16T17:10:08.187202] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-09-16T17:10:08.188390] [DEBUG] [LOCAL ] AMH: Trimmed 56207 records to 38458 (keeping 150 days of data) [2025-09-16T17:10:08.398382] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-09-16T17:10:08.431964] [DEBUG] [LOCAL ] AMH: Primary data saved (38458 records). [2025-09-16T17:10:08.432093] [INFO ] [MAIN ] AMH: Full history saved. [2025-09-16T17:10:08.434736] [INFO ] [MAIN ] Update Progress: 102/2369 symbols completed. AMH took 34.5s. Estimated remaining: 3h 44m 14s. Rate: 10.1 symbols/min [2025-09-16T17:10:08.612825] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:10:08.635829] [DEBUG] [LOCAL ] AMR: Loaded 21277 existing records from primary storage. [2025-09-16T17:10:08.635969] [INFO ] [MAIN ] AMR: Loaded 21277 existing records. [2025-09-16T17:10:08.826294] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:10:08.826751] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-09-16T17:10:08.826821] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-09-16T17:10:08.827679] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-09-16T17:10:08.843164] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-09-16T17:10:08.913175] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-16T17:10:09.179613] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-09-16T17:10:09.232917] [INFO ] [REMOTE ] AMR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:10:09.245178] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-16T17:10:09.249563] [INFO ] [REMOTE ] AMP: Full fetch complete (35692 records). [2025-09-16T17:10:09.249680] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-09-16T17:10:09.650634] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-09-16T17:10:09.651810] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-16T17:10:09.651212] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-09-16T17:10:09.657898] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-09-16T17:10:09.657969] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-09-16T17:10:09.658777] [DEBUG] [LOCAL ] AMP: Trimmed 35692 records to 23302 (keeping 150 days of data) [2025-09-16T17:10:09.810598] [DEBUG] [LOCAL ] AMP: Primary data saved (23302 records). [2025-09-16T17:10:09.810755] [INFO ] [MAIN ] AMP: Full history saved. [2025-09-16T17:10:09.810861] [INFO ] [MAIN ] Update Progress: 103/2369 symbols completed. AMP took 21.4s. Estimated remaining: 3h 42m 28s. Rate: 10.2 symbols/min [2025-09-16T17:10:09.983338] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-09-16T17:10:09.986693] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:10:10.015978] [DEBUG] [LOCAL ] AMRC: Loaded 27480 existing records from primary storage. [2025-09-16T17:10:10.016124] [INFO ] [MAIN ] AMRC: Loaded 27480 existing records. [2025-09-16T17:10:10.199717] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:10:10.199970] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-09-16T17:10:10.200016] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-09-16T17:10:10.200953] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-09-16T17:10:10.201005] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-09-16T17:10:10.567320] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:10:10.774910] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-09-16T17:10:10.983693] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-16T17:10:11.164928] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-16T17:10:11.574917] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-09-16T17:10:12.374902] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-09-16T17:10:12.502116] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-16T17:10:13.174959] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-09-16T17:10:13.824075] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-16T17:10:13.974948] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-09-16T17:10:14.079263] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-09-16T17:10:14.533253] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-16T17:10:14.774901] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-09-16T17:10:15.097253] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-16T17:10:15.574908] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-09-16T17:10:15.926929] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-16T17:10:16.374894] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-09-16T17:10:17.174919] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-09-16T17:10:17.896627] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-16T17:10:17.938495] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-16T17:10:17.974929] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-09-16T17:10:18.362334] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-16T17:10:18.774994] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-09-16T17:10:19.132900] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-16T17:10:19.574974] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-09-16T17:10:19.947216] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-16T17:10:20.374989] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-09-16T17:10:21.174943] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-09-16T17:10:21.438795] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-16T17:10:21.540365] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-16T17:10:21.549341] [INFO ] [REMOTE ] AMPX: Full fetch complete (56252 records). [2025-09-16T17:10:21.549671] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-09-16T17:10:21.963952] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-09-16T17:10:21.964044] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-09-16T17:10:21.964617] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-09-16T17:10:21.964692] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-09-16T17:10:21.965899] [DEBUG] [LOCAL ] AMPX: Trimmed 56252 records to 39038 (keeping 150 days of data) [2025-09-16T17:10:22.017583] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-09-16T17:10:22.207524] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-16T17:10:22.229530] [DEBUG] [LOCAL ] AMPX: Primary data saved (39038 records). [2025-09-16T17:10:22.229720] [INFO ] [MAIN ] AMPX: Full history saved. [2025-09-16T17:10:22.229815] [INFO ] [MAIN ] Update Progress: 104/2369 symbols completed. AMPX took 27.7s. Estimated remaining: 3h 44m 44s. Rate: 10.1 symbols/min [2025-09-16T17:10:22.398397] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:10:22.398592] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-09-16T17:10:22.398632] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-09-16T17:10:22.398774] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-09-16T17:10:22.398814] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-16T17:10:22.398855] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-16T17:10:22.398889] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-09-16T17:10:22.742048] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:10:22.774844] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-02. [2025-09-16T17:10:22.973803] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:10:22.974274] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-02 [2025-09-16T17:10:23.329625] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-16T17:10:23.333889] [INFO ] [REMOTE ] AMPY: Full fetch complete (39702 records). [2025-09-16T17:10:23.334032] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-09-16T17:10:23.580138] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-03. [2025-09-16T17:10:23.761133] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present. [2025-09-16T17:10:23.761226] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed. [2025-09-16T17:10:23.761694] [INFO ] [MAIN ] AMPY: Fetched primary data is valid. [2025-09-16T17:10:23.761742] [DEBUG] [LOCAL ] AMPY: Saving primary data. [2025-09-16T17:10:23.762740] [DEBUG] [LOCAL ] AMPY: Trimmed 39702 records to 27915 (keeping 150 days of data) [2025-09-16T17:10:23.864406] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:10:23.867597] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-03 [2025-09-16T17:10:23.927536] [DEBUG] [LOCAL ] AMPY: Primary data saved (27915 records). [2025-09-16T17:10:23.927770] [INFO ] [MAIN ] AMPY: Full history saved. [2025-09-16T17:10:23.927886] [INFO ] [MAIN ] Update Progress: 105/2369 symbols completed. AMPY took 16.9s. Estimated remaining: 3h 43m 7s. Rate: 10.1 symbols/min [2025-09-16T17:10:24.100681] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:10:24.142131] [DEBUG] [LOCAL ] AMT: Loaded 38572 existing records from primary storage. [2025-09-16T17:10:24.142299] [INFO ] [MAIN ] AMT: Loaded 38572 existing records. [2025-09-16T17:10:24.322929] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:10:24.323188] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-09-16T17:10:24.323235] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-09-16T17:10:24.324357] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-09-16T17:10:24.324409] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-09-16T17:10:24.380070] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-04. [2025-09-16T17:10:24.654575] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:10:24.671899] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-04 [2025-09-16T17:10:24.691995] [INFO ] [REMOTE ] AMT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:10:25.174920] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-09-16T17:10:25.974929] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-09-16T17:10:26.741601] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-16T17:10:26.774856] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-09-16T17:10:27.187339] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-16T17:10:27.575008] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-09-16T17:10:28.057784] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-16T17:10:28.374919] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-09-16T17:10:28.977294] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-16T17:10:29.174945] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-09-16T17:10:29.558878] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-16T17:10:29.974894] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-05. [2025-09-16T17:10:30.011587] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-16T17:10:30.196010] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:10:30.196291] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-05 [2025-09-16T17:10:30.774904] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-09-16T17:10:31.574906] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-06. [2025-09-16T17:10:31.802415] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-16T17:10:32.374908] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-09-16T17:10:32.590566] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-16T17:10:33.174941] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-07. [2025-09-16T17:10:33.745841] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-16T17:10:33.974918] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-09-16T17:10:34.704318] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-16T17:10:34.774871] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-09-16T17:10:35.574906] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-08. [2025-09-16T17:10:35.742887] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-16T17:10:36.267128] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-16T17:10:36.374876] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-09-16T17:10:36.834740] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-16T17:10:37.174898] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-09-16T17:10:37.264903] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-16T17:10:37.974906] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-09-16T17:10:38.774930] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-09-16T17:10:38.996948] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-16T17:10:39.469557] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-16T17:10:39.475287] [INFO ] [REMOTE ] AMRC: Full fetch complete (41400 records). [2025-09-16T17:10:39.475482] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-09-16T17:10:39.580028] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-09. [2025-09-16T17:10:39.872617] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-09-16T17:10:39.872854] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-09-16T17:10:39.873511] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-09-16T17:10:39.873593] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-09-16T17:10:39.875366] [DEBUG] [LOCAL ] AMRC: Trimmed 41400 records to 27742 (keeping 150 days of data) [2025-09-16T17:10:39.957598] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-16T17:10:40.074883] [DEBUG] [LOCAL ] AMRC: Primary data saved (27742 records). [2025-09-16T17:10:40.075029] [INFO ] [MAIN ] AMRC: Full history saved. [2025-09-16T17:10:40.075114] [INFO ] [MAIN ] Update Progress: 106/2369 symbols completed. AMRC took 30.3s. Estimated remaining: 3h 46m 39s. Rate: 10.0 symbols/min [2025-09-16T17:10:40.247727] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:10:40.266166] [DEBUG] [LOCAL ] AMTB: Loaded 15250 existing records from primary storage. [2025-09-16T17:10:40.266316] [INFO ] [MAIN ] AMTB: Loaded 15250 existing records. [2025-09-16T17:10:40.380024] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-09-16T17:10:40.444952] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:10:40.445228] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-09-16T17:10:40.445282] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-09-16T17:10:40.445952] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-09-16T17:10:40.446003] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-09-16T17:10:40.839000] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:10:41.008235] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-16T17:10:41.014924] [INFO ] [REMOTE ] AMRZ: Full fetch complete (22645 records). [2025-09-16T17:10:41.015022] [DEBUG] [VALIDATOR ] AMRZ: Validating primary data. [2025-09-16T17:10:41.180591] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-09-16T17:10:41.213516] [WARN ] [VALIDATOR ] AMRZ: Validation failed - insufficient historical data. Have 60 unique days, need 150 days [2025-09-16T17:10:41.214613] [FATAL] [MAIN ] AMRZ: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:10:41.214690] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:10:41.214739] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-16T17:10:41.214793] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-16T17:10:41.214831] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-09-16T17:10:41.214882] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-09-16T17:10:41.214946] [INFO ] [MAIN ] Update Progress: 107/2369 symbols completed. AMRZ took 19.0s. Estimated remaining: 3h 44m 50s. Rate: 10.1 symbols/min [2025-09-16T17:10:41.394256] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:10:41.404550] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-16T17:10:41.409320] [INFO ] [REMOTE ] AMR: Full fetch complete (31750 records). [2025-09-16T17:10:41.411808] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-09-16T17:10:41.411737] [DEBUG] [LOCAL ] AMTD: Loaded 2875 existing records from primary storage. [2025-09-16T17:10:41.412039] [INFO ] [MAIN ] AMTD: Loaded 2875 existing records. [2025-09-16T17:10:41.771765] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:10:41.848477] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-09-16T17:10:41.854185] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-09-16T17:10:41.880230] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-09-16T17:10:41.880346] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-09-16T17:10:41.977516] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-09-16T17:10:42.069773] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-09-16T17:10:42.075417] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-09-16T17:10:42.091220] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-09-16T17:10:42.130562] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-09-16T17:10:42.253767] [DEBUG] [LOCAL ] AMR: Trimmed 31750 records to 21471 (keeping 150 days of data) [2025-09-16T17:10:42.430670] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:10:42.476624] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-16T17:10:42.505028] [DEBUG] [LOCAL ] AMR: Primary data saved (21471 records). [2025-09-16T17:10:42.505201] [INFO ] [MAIN ] AMR: Full history saved. [2025-09-16T17:10:42.505295] [INFO ] [MAIN ] Update Progress: 108/2369 symbols completed. AMR took 34.1s. Estimated remaining: 3h 43m 6s. Rate: 10.1 symbols/min [2025-09-16T17:10:42.680929] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:10:42.681131] [DEBUG] [LOCAL ] AMTM: No existing data file found in primary storage. [2025-09-16T17:10:42.681170] [WARN ] [MAIN ] AMTM: No existing data found, performing full refresh instead. [2025-09-16T17:10:42.681287] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-09-16T17:10:42.681325] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-09-16T17:10:42.681366] [DEBUG] [LOCAL ] AMTM: No primary data file found to delete. [2025-09-16T17:10:42.681398] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-09-16T17:10:42.779947] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-09-16T17:10:43.044856] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:10:43.574929] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-09-16T17:10:43.801127] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-16T17:10:43.823451] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-16T17:10:44.374883] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-09-16T17:10:45.174897] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-09-16T17:10:45.241704] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-16T17:10:45.584871] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-16T17:10:45.692406] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-16T17:10:45.974917] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-09-16T17:10:46.774912] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-09-16T17:10:47.571297] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-16T17:10:47.581718] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-09-16T17:10:47.601491] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-16T17:10:48.374901] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-09-16T17:10:48.845618] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-16T17:10:48.892085] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-16T17:10:49.174905] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-09-16T17:10:49.618024] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-16T17:10:49.974901] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-09-16T17:10:50.774896] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-09-16T17:10:50.899991] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-16T17:10:51.310018] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-16T17:10:51.574900] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-09-16T17:10:52.086392] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-16T17:10:52.374909] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-09-16T17:10:53.174910] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-09-16T17:10:53.331037] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-16T17:10:53.974922] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-09-16T17:10:54.367106] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-16T17:10:54.480815] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-16T17:10:54.775018] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-09-16T17:10:55.574911] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-09-16T17:10:55.852383] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-16T17:10:56.374931] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-09-16T17:10:57.174906] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-09-16T17:10:57.311421] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-16T17:10:57.317714] [INFO ] [REMOTE ] AMT: Full fetch complete (57037 records). [2025-09-16T17:10:57.317833] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-09-16T17:10:57.700084] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-09-16T17:10:57.700168] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-09-16T17:10:57.700744] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-09-16T17:10:57.700789] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-09-16T17:10:57.702005] [DEBUG] [LOCAL ] AMT: Trimmed 57037 records to 38959 (keeping 150 days of data) [2025-09-16T17:10:57.979048] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-09-16T17:10:57.979242] [DEBUG] [LOCAL ] AMT: Primary data saved (38959 records). [2025-09-16T17:10:57.979510] [INFO ] [MAIN ] AMT: Full history saved. [2025-09-16T17:10:57.981747] [INFO ] [MAIN ] Update Progress: 109/2369 symbols completed. AMT took 34.1s. Estimated remaining: 3h 46m 19s. Rate: 10.0 symbols/min [2025-09-16T17:10:57.989665] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-16T17:10:58.054706] [INFO ] [REMOTE ] AMTB: Full fetch complete (22382 records). [2025-09-16T17:10:58.078388] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-09-16T17:10:58.195082] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:10:58.321379] [DEBUG] [LOCAL ] AMWL: Loaded 6494 existing records from primary storage. [2025-09-16T17:10:58.373893] [INFO ] [MAIN ] AMWL: Loaded 6494 existing records. [2025-09-16T17:10:58.628722] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-16T17:10:58.726851] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-09-16T17:10:58.730567] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:10:58.741066] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-09-16T17:10:58.755965] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-09-16T17:10:58.755850] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-09-16T17:10:58.756159] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-09-16T17:10:58.756246] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-09-16T17:10:58.760056] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-09-16T17:10:58.762198] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-09-16T17:10:58.762338] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-09-16T17:10:58.773118] [DEBUG] [LOCAL ] AMTB: Trimmed 22382 records to 15340 (keeping 150 days of data) [2025-09-16T17:10:58.778585] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-09-16T17:10:59.216869] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:10:59.231043] [DEBUG] [LOCAL ] AMTB: Primary data saved (15340 records). [2025-09-16T17:10:59.231139] [INFO ] [MAIN ] AMTB: Full history saved. [2025-09-16T17:10:59.231215] [INFO ] [MAIN ] Update Progress: 110/2369 symbols completed. AMTB took 19.2s. Estimated remaining: 3h 44m 35s. Rate: 10.1 symbols/min [2025-09-16T17:10:59.399380] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:10:59.435036] [DEBUG] [LOCAL ] AMX: Loaded 36088 existing records from primary storage. [2025-09-16T17:10:59.435173] [INFO ] [MAIN ] AMX: Loaded 36088 existing records. [2025-09-16T17:10:59.537796] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-16T17:10:59.541526] [INFO ] [REMOTE ] AMTD: Full fetch complete (3767 records). [2025-09-16T17:10:59.552110] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-09-16T17:10:59.590534] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-09-16T17:10:59.676979] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:10:59.697486] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-09-16T17:10:59.714277] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-09-16T17:10:59.731503] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-09-16T17:10:59.742013] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-09-16T17:11:00.265753] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-09-16T17:11:00.266026] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-09-16T17:11:00.276526] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-09-16T17:11:00.291894] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-09-16T17:11:00.342064] [INFO ] [REMOTE ] AMX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:11:00.338958] [DEBUG] [LOCAL ] AMTD: Trimmed 3767 records to 2906 (keeping 150 days of data) [2025-09-16T17:11:00.359325] [DEBUG] [LOCAL ] AMTD: Primary data saved (2906 records). [2025-09-16T17:11:00.359391] [INFO ] [MAIN ] AMTD: Full history saved. [2025-09-16T17:11:00.359470] [INFO ] [MAIN ] Update Progress: 111/2369 symbols completed. AMTD took 19.1s. Estimated remaining: 3h 42m 50s. Rate: 10.1 symbols/min [2025-09-16T17:11:00.380058] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-09-16T17:11:00.532911] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:11:00.555440] [DEBUG] [LOCAL ] AN: Loaded 23001 existing records from primary storage. [2025-09-16T17:11:00.555576] [INFO ] [MAIN ] AN: Loaded 23001 existing records. [2025-09-16T17:11:00.736211] [WARN ] [MAIN ] AN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:11:00.736463] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-09-16T17:11:00.736508] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-09-16T17:11:00.737230] [DEBUG] [LOCAL ] AN: Deleted primary data file. [2025-09-16T17:11:00.737280] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-09-16T17:11:01.094905] [INFO ] [REMOTE ] AN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:11:01.174861] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-09-16T17:11:01.695613] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-16T17:11:01.974903] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-09-16T17:11:02.654758] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-09-16T17:11:02.774899] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-09-16T17:11:02.959370] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-16T17:11:03.311397] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-16T17:11:03.574890] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-09-16T17:11:04.042592] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-16T17:11:04.053450] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-16T17:11:04.374906] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-09-16T17:11:05.167989] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-16T17:11:05.174833] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-09-16T17:11:05.905429] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-16T17:11:05.974914] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-09-16T17:11:06.774913] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-09-16T17:11:07.122700] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-16T17:11:07.574909] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-09-16T17:11:08.072733] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-16T17:11:08.374907] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-09-16T17:11:08.942064] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-16T17:11:09.174931] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-09-16T17:11:09.809701] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-16T17:11:09.974917] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-09-16T17:11:10.774879] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-09-16T17:11:11.248901] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-16T17:11:11.574891] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-09-16T17:11:12.018012] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-16T17:11:12.214894] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-16T17:11:12.230061] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-16T17:11:12.374893] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-09-16T17:11:13.174918] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-09-16T17:11:13.799367] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-16T17:11:13.974957] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-09-16T17:11:14.487415] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-16T17:11:14.774918] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-09-16T17:11:15.248113] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-16T17:11:15.574905] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-09-16T17:11:16.201902] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-16T17:11:16.207808] [INFO ] [REMOTE ] AMTM: Full fetch complete (55177 records). [2025-09-16T17:11:16.207926] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-09-16T17:11:16.382308] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-09-16T17:11:16.544699] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-16T17:11:16.639568] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-09-16T17:11:16.639666] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-09-16T17:11:16.640210] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-09-16T17:11:16.640263] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-09-16T17:11:16.641404] [DEBUG] [LOCAL ] AMTM: Trimmed 55177 records to 37550 (keeping 150 days of data) [2025-09-16T17:11:16.868097] [DEBUG] [LOCAL ] AMTM: Primary data saved (37550 records). [2025-09-16T17:11:16.868272] [INFO ] [MAIN ] AMTM: Full history saved. [2025-09-16T17:11:16.868368] [INFO ] [MAIN ] Update Progress: 112/2369 symbols completed. AMTM took 34.4s. Estimated remaining: 3h 46m 18s. Rate: 10.0 symbols/min [2025-09-16T17:11:17.040674] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:11:17.081279] [DEBUG] [LOCAL ] ANET: Loaded 39726 existing records from primary storage. [2025-09-16T17:11:17.081448] [INFO ] [MAIN ] ANET: Loaded 39726 existing records. [2025-09-16T17:11:17.180340] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-09-16T17:11:17.263384] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:11:17.263600] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-09-16T17:11:17.263703] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-09-16T17:11:17.264868] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-09-16T17:11:17.264931] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-09-16T17:11:17.631143] [INFO ] [REMOTE ] ANET: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:11:17.917998] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-16T17:11:17.920081] [INFO ] [REMOTE ] AMWL: Full fetch complete (10072 records). [2025-09-16T17:11:17.920186] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-09-16T17:11:17.920582] [FATAL] [VALIDATOR ] AMWL: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:11:17.920685] [FATAL] [MAIN ] AMWL: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:11:17.920744] [WARN ] [MAIN ] AMWL: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:11:17.920807] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-09-16T17:11:17.920882] [DEBUG] [LOCAL ] AMWL: No primary data file found to delete. [2025-09-16T17:11:17.920947] [INFO ] [LOCAL ] AMWL: Starting deletion of derivative data. [2025-09-16T17:11:17.921285] [DEBUG] [LOCAL ] AMWL: Deleted derivative data file. [2025-09-16T17:11:17.921398] [INFO ] [MAIN ] Update Progress: 113/2369 symbols completed. AMWL took 19.9s. Estimated remaining: 3h 44m 33s. Rate: 10.0 symbols/min [2025-09-16T17:11:17.988363] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-09-16T17:11:18.123450] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:11:18.125121] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-16T17:11:18.175448] [DEBUG] [LOCAL ] ANF: Loaded 38417 existing records from primary storage. [2025-09-16T17:11:18.175591] [INFO ] [MAIN ] ANF: Loaded 38417 existing records. [2025-09-16T17:11:18.350690] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:11:18.350938] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-09-16T17:11:18.350999] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-09-16T17:11:18.352291] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-09-16T17:11:18.352367] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-09-16T17:11:18.739888] [INFO ] [REMOTE ] ANF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:11:18.774901] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-09-16T17:11:19.245577] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-16T17:11:19.574949] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-09-16T17:11:20.374888] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-09-16T17:11:20.635986] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-16T17:11:21.013009] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-16T17:11:21.174870] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-09-16T17:11:21.974926] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-09-16T17:11:22.749287] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-16T17:11:22.779962] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-09-16T17:11:22.797596] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-09-16T17:11:23.574887] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-09-16T17:11:23.651278] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-16T17:11:24.348705] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-16T17:11:24.355569] [INFO ] [REMOTE ] AMX: Full fetch complete (53231 records). [2025-09-16T17:11:24.355799] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-09-16T17:11:24.380087] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-09-16T17:11:24.741282] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-09-16T17:11:24.741383] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-09-16T17:11:24.741987] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-09-16T17:11:24.742056] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-09-16T17:11:24.743186] [DEBUG] [LOCAL ] AMX: Trimmed 53231 records to 36405 (keeping 150 days of data) [2025-09-16T17:11:24.959201] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-16T17:11:24.965315] [INFO ] [REMOTE ] AN: Full fetch complete (35890 records). [2025-09-16T17:11:24.966175] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-09-16T17:11:25.179972] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-09-16T17:11:25.276809] [DEBUG] [LOCAL ] AMX: Primary data saved (36405 records). [2025-09-16T17:11:25.277035] [INFO ] [MAIN ] AMX: Full history saved. [2025-09-16T17:11:25.277422] [INFO ] [MAIN ] Update Progress: 114/2369 symbols completed. AMX took 26.0s. Estimated remaining: 3h 44m 54s. Rate: 10.0 symbols/min [2025-09-16T17:11:25.489776] [DEBUG] [VALIDATOR ] AN: All expected trading days are present. [2025-09-16T17:11:25.490193] [DEBUG] [VALIDATOR ] AN: Primary data validation passed. [2025-09-16T17:11:25.496123] [INFO ] [MAIN ] AN: Fetched primary data is valid. [2025-09-16T17:11:25.501326] [DEBUG] [LOCAL ] AN: Saving primary data. [2025-09-16T17:11:25.565461] [DEBUG] [LOCAL ] AN: Trimmed 35890 records to 23233 (keeping 150 days of data) [2025-09-16T17:11:25.583923] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:11:25.584996] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-09-16T17:11:25.585079] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-09-16T17:11:25.585217] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-09-16T17:11:25.585259] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-16T17:11:25.585300] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-16T17:11:25.585362] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-09-16T17:11:26.081013] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:11:26.085813] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-02. [2025-09-16T17:11:26.105969] [DEBUG] [LOCAL ] AN: Primary data saved (23233 records). [2025-09-16T17:11:26.106111] [INFO ] [MAIN ] AN: Full history saved. [2025-09-16T17:11:26.106207] [INFO ] [MAIN ] Update Progress: 115/2369 symbols completed. AN took 25.7s. Estimated remaining: 3h 43m 7s. Rate: 10.1 symbols/min [2025-09-16T17:11:26.317504] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:11:26.333677] [DEBUG] [LOCAL ] ANRO: Loaded 13456 existing records from primary storage. [2025-09-16T17:11:26.333856] [INFO ] [MAIN ] ANRO: Loaded 13456 existing records. [2025-09-16T17:11:26.380375] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:11:26.405887] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-02 [2025-09-16T17:11:26.544501] [WARN ] [MAIN ] ANRO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:11:26.544823] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-09-16T17:11:26.544919] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-09-16T17:11:26.545521] [DEBUG] [LOCAL ] ANRO: Deleted primary data file. [2025-09-16T17:11:26.545585] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-09-16T17:11:26.786104] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-03. [2025-09-16T17:11:26.936685] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:11:26.971983] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-09-16T17:11:27.046441] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-16T17:11:27.066525] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:11:27.066837] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-03 [2025-09-16T17:11:27.574909] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-04. [2025-09-16T17:11:27.769338] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:11:27.769691] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-04 [2025-09-16T17:11:28.374897] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-09-16T17:11:29.174909] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-05. [2025-09-16T17:11:29.343816] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:11:29.344144] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-05 [2025-09-16T17:11:29.974934] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-09-16T17:11:30.644311] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-16T17:11:30.774901] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-09-16T17:11:31.139155] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-16T17:11:31.574913] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-09-16T17:11:32.374892] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-09-16T17:11:32.761697] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-16T17:11:32.929771] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-16T17:11:33.174930] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-09-16T17:11:33.974885] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-06. [2025-09-16T17:11:34.059418] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-16T17:11:34.215210] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:11:34.215535] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-06 [2025-09-16T17:11:34.332145] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-16T17:11:34.774933] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-07. [2025-09-16T17:11:34.960362] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:11:34.960717] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-07 [2025-09-16T17:11:35.574897] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-08. [2025-09-16T17:11:35.764107] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:11:35.764488] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-08 [2025-09-16T17:11:36.374914] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-09-16T17:11:37.174938] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-09. [2025-09-16T17:11:37.894835] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-16T17:11:37.974923] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-09-16T17:11:38.129820] [INFO ] [REMOTE ] ANGX: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-16T17:11:38.132285] [INFO ] [REMOTE ] ANGX: Full fetch complete (1325 records). [2025-09-16T17:11:38.132360] [DEBUG] [VALIDATOR ] ANGX: Validating primary data. [2025-09-16T17:11:38.325018] [WARN ] [VALIDATOR ] ANGX: Validation failed - insufficient historical data. Have 4 unique days, need 150 days [2025-09-16T17:11:38.325240] [FATAL] [MAIN ] ANGX: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:11:38.325296] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:11:38.325355] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-16T17:11:38.325414] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-16T17:11:38.325459] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-09-16T17:11:38.325507] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-09-16T17:11:38.325584] [INFO ] [MAIN ] Update Progress: 116/2369 symbols completed. ANGX took 13.0s. Estimated remaining: 3h 45m 3s. Rate: 10.0 symbols/min [2025-09-16T17:11:38.501209] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:11:38.520983] [DEBUG] [LOCAL ] ANVS: Loaded 17585 existing records from primary storage. [2025-09-16T17:11:38.521125] [INFO ] [MAIN ] ANVS: Loaded 17585 existing records. [2025-09-16T17:11:38.703845] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:11:38.704117] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-09-16T17:11:38.704165] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-09-16T17:11:38.704875] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-09-16T17:11:38.704926] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-09-16T17:11:38.783228] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-09-16T17:11:39.077108] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:11:39.487383] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-16T17:11:39.574902] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-09-16T17:11:40.374936] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-09-16T17:11:41.172310] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-16T17:11:41.182584] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-09-16T17:11:41.238933] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-09-16T17:11:41.624074] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-16T17:11:41.974900] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-09-16T17:11:42.228265] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-16T17:11:42.774880] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-09-16T17:11:43.168585] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-16T17:11:43.574928] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-09-16T17:11:43.916248] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-16T17:11:44.374910] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-09-16T17:11:45.174905] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-09-16T17:11:45.803471] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-16T17:11:45.826940] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-16T17:11:45.974857] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-09-16T17:11:46.234452] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-16T17:11:46.240527] [INFO ] [REMOTE ] ANF: Full fetch complete (56855 records). [2025-09-16T17:11:46.240636] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-09-16T17:11:46.625230] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-09-16T17:11:46.625351] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-09-16T17:11:46.626130] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-09-16T17:11:46.626293] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-09-16T17:11:46.638193] [DEBUG] [LOCAL ] ANF: Trimmed 56855 records to 38799 (keeping 150 days of data) [2025-09-16T17:11:46.638046] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-16T17:11:46.813817] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-09-16T17:11:46.885975] [DEBUG] [LOCAL ] ANF: Primary data saved (38799 records). [2025-09-16T17:11:46.886193] [INFO ] [MAIN ] ANF: Full history saved. [2025-09-16T17:11:46.886529] [INFO ] [MAIN ] Update Progress: 117/2369 symbols completed. ANF took 29.0s. Estimated remaining: 3h 45m 47s. Rate: 10.0 symbols/min [2025-09-16T17:11:47.515960] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-16T17:11:47.518337] [INFO ] [REMOTE ] ANRO: Full fetch complete (22405 records). [2025-09-16T17:11:47.518492] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-09-16T17:11:47.580145] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-09-16T17:11:48.059976] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present. [2025-09-16T17:11:48.060107] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed. [2025-09-16T17:11:48.060803] [INFO ] [MAIN ] ANRO: Fetched primary data is valid. [2025-09-16T17:11:48.060896] [DEBUG] [LOCAL ] ANRO: Saving primary data. [2025-09-16T17:11:48.062563] [DEBUG] [LOCAL ] ANRO: Trimmed 22405 records to 13497 (keeping 150 days of data) [2025-09-16T17:11:48.160021] [DEBUG] [LOCAL ] ANRO: Primary data saved (13497 records). [2025-09-16T17:11:48.160189] [INFO ] [MAIN ] ANRO: Full history saved. [2025-09-16T17:11:48.160345] [INFO ] [MAIN ] Update Progress: 118/2369 symbols completed. ANRO took 22.1s. Estimated remaining: 3h 44m 10s. Rate: 10.0 symbols/min [2025-09-16T17:11:48.374998] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-09-16T17:11:48.767293] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-16T17:11:49.174956] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-09-16T17:11:49.999885] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-16T17:11:50.005599] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-09-16T17:11:50.697521] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-16T17:11:50.774874] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-09-16T17:11:51.144827] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-16T17:11:51.574932] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-09-16T17:11:52.837634] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-16T17:11:52.843969] [INFO ] [REMOTE ] ANET: Full fetch complete (58446 records). [2025-09-16T17:11:52.844088] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-09-16T17:11:53.191000] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-16T17:11:53.261524] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-09-16T17:11:53.264449] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-09-16T17:11:53.265477] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-09-16T17:11:53.266139] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-09-16T17:11:53.266190] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-09-16T17:11:53.267546] [DEBUG] [LOCAL ] ANET: Trimmed 58446 records to 40116 (keeping 150 days of data) [2025-09-16T17:11:53.515334] [DEBUG] [LOCAL ] ANET: Primary data saved (40116 records). [2025-09-16T17:11:53.515463] [INFO ] [MAIN ] ANET: Full history saved. [2025-09-16T17:11:53.516721] [INFO ] [MAIN ] Update Progress: 119/2369 symbols completed. ANET took 36.6s. Estimated remaining: 3h 43m 52s. Rate: 10.1 symbols/min [2025-09-16T17:11:54.440595] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-16T17:11:54.445910] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-09-16T17:11:55.581464] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-16T17:11:55.584007] [INFO ] [REMOTE ] ANVS: Full fetch complete (26385 records). [2025-09-16T17:11:55.584096] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-09-16T17:11:55.956905] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-09-16T17:11:55.957014] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-09-16T17:11:55.957376] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-09-16T17:11:55.957427] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-09-16T17:11:55.958267] [DEBUG] [LOCAL ] ANVS: Trimmed 26385 records to 17667 (keeping 150 days of data) [2025-09-16T17:11:56.066246] [DEBUG] [LOCAL ] ANVS: Primary data saved (17667 records). [2025-09-16T17:11:56.066398] [INFO ] [MAIN ] ANVS: Full history saved. [2025-09-16T17:11:56.066481] [INFO ] [MAIN ] Update Progress: 120/2369 symbols completed. ANVS took 17.7s. Estimated remaining: 3h 42m 42s. Rate: 10.1 symbols/min [2025-09-16T17:11:56.619061] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:11:56.758784] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:11:56.765389] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-09-16T17:11:56.746823] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:11:56.784826] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-09-16T17:11:56.784747] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:11:56.785581] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-09-16T17:11:56.785661] [DEBUG] [LOCAL ] AOD: No existing data file found in primary storage. [2025-09-16T17:11:56.785752] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-16T17:11:56.785810] [WARN ] [MAIN ] AOD: No existing data found, performing full refresh instead. [2025-09-16T17:11:56.785902] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-16T17:11:56.786175] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-09-16T17:11:56.786234] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-09-16T17:11:56.786303] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-09-16T17:11:56.786356] [DEBUG] [LOCAL ] AOD: No primary data file found to delete. [2025-09-16T17:11:56.798104] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-09-16T17:11:56.919380] [DEBUG] [LOCAL ] AOMR: Loaded 12648 existing records from primary storage. [2025-09-16T17:11:56.954477] [INFO ] [MAIN ] AOMR: Loaded 12648 existing records. [2025-09-16T17:11:57.362909] [DEBUG] [LOCAL ] AON: Loaded 33409 existing records from primary storage. [2025-09-16T17:11:57.397628] [INFO ] [MAIN ] AON: Loaded 33409 existing records. [2025-09-16T17:11:57.609375] [WARN ] [MAIN ] AOMR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:11:57.770684] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-09-16T17:11:57.807589] [INFO ] [REMOTE ] AOD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:11:57.833864] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-09-16T17:11:57.828689] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-09-16T17:11:57.880472] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:11:57.897885] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-02. [2025-09-16T17:11:57.897626] [DEBUG] [LOCAL ] AOMR: Deleted primary data file. [2025-09-16T17:11:57.898043] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-09-16T17:11:57.930370] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:11:57.984749] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-09-16T17:11:58.013343] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-09-16T17:11:58.031680] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-09-16T17:11:58.064614] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-09-16T17:11:58.176054] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:11:58.245088] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-02 [2025-09-16T17:11:58.270305] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-03. [2025-09-16T17:11:58.535665] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:11:58.547399] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-09-16T17:11:58.635677] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:11:58.656759] [INFO ] [REMOTE ] AON: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:11:58.657232] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-09-16T17:11:58.657019] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-03 [2025-09-16T17:11:58.658282] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-04. [2025-09-16T17:11:58.922185] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:11:58.922503] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-04 [2025-09-16T17:11:58.922996] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-05. [2025-09-16T17:11:59.329354] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-16T17:11:59.432854] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-16T17:11:59.574921] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-06. [2025-09-16T17:11:59.590451] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-16T17:12:00.025701] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-16T17:12:00.206995] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-16T17:12:00.374895] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-07. [2025-09-16T17:12:01.174903] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-09-16T17:12:01.217855] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-16T17:12:01.974901] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-09-16T17:12:02.635241] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-16T17:12:02.774919] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-08. [2025-09-16T17:12:03.092233] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-16T17:12:03.214745] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-16T17:12:03.574901] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-09-16T17:12:04.374896] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-09. [2025-09-16T17:12:04.583582] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-16T17:12:04.749678] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-16T17:12:04.750519] [INFO ] [REMOTE ] AOMD: Full fetch complete (1684 records). [2025-09-16T17:12:04.750586] [DEBUG] [VALIDATOR ] AOMD: Validating primary data. [2025-09-16T17:12:04.942388] [WARN ] [VALIDATOR ] AOMD: Validation failed - insufficient historical data. Have 78 unique days, need 150 days [2025-09-16T17:12:04.942566] [FATAL] [MAIN ] AOMD: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:12:04.942635] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:12:04.942721] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-16T17:12:04.942788] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-16T17:12:04.942824] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-09-16T17:12:04.942874] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-09-16T17:12:04.942934] [INFO ] [MAIN ] Update Progress: 121/2369 symbols completed. AOMD took 8.9s. Estimated remaining: 3h 43m 31s. Rate: 10.1 symbols/min [2025-09-16T17:12:05.113056] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:12:05.137175] [DEBUG] [LOCAL ] AORT: Loaded 21502 existing records from primary storage. [2025-09-16T17:12:05.137315] [INFO ] [MAIN ] AORT: Loaded 21502 existing records. [2025-09-16T17:12:05.179992] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-09-16T17:12:05.318742] [WARN ] [MAIN ] AORT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:12:05.318986] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-09-16T17:12:05.319034] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-09-16T17:12:05.319805] [DEBUG] [LOCAL ] AORT: Deleted primary data file. [2025-09-16T17:12:05.319885] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-09-16T17:12:05.676446] [INFO ] [REMOTE ] AORT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:12:05.947949] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-16T17:12:05.974851] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-09-16T17:12:06.751900] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-16T17:12:06.774882] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-09-16T17:12:07.274253] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-16T17:12:07.574936] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-09-16T17:12:08.374884] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-09-16T17:12:09.174911] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-09-16T17:12:09.296885] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-16T17:12:09.806097] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-16T17:12:09.974908] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-09-16T17:12:10.168471] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-16T17:12:10.774868] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-09-16T17:12:11.231966] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-16T17:12:11.574915] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-09-16T17:12:11.652018] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-16T17:12:11.654475] [INFO ] [REMOTE ] AOMR: Full fetch complete (18977 records). [2025-09-16T17:12:11.654563] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-09-16T17:12:12.017830] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-09-16T17:12:12.017908] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-09-16T17:12:12.018182] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-09-16T17:12:12.018223] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-09-16T17:12:12.018776] [DEBUG] [LOCAL ] AOMR: Trimmed 18977 records to 12747 (keeping 150 days of data) [2025-09-16T17:12:12.096271] [DEBUG] [LOCAL ] AOMR: Primary data saved (12747 records). [2025-09-16T17:12:12.096426] [INFO ] [MAIN ] AOMR: Full history saved. [2025-09-16T17:12:12.096514] [INFO ] [MAIN ] Update Progress: 122/2369 symbols completed. AOMR took 16.0s. Estimated remaining: 3h 43m 47s. Rate: 10.0 symbols/min [2025-09-16T17:12:12.269718] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:12:12.312785] [DEBUG] [LOCAL ] AOS: Loaded 36309 existing records from primary storage. [2025-09-16T17:12:12.312920] [INFO ] [MAIN ] AOS: Loaded 36309 existing records. [2025-09-16T17:12:12.380045] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-09-16T17:12:12.496442] [WARN ] [MAIN ] AOS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:12:12.496742] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-09-16T17:12:12.496795] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-09-16T17:12:12.498410] [DEBUG] [LOCAL ] AOS: Deleted primary data file. [2025-09-16T17:12:12.498478] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-09-16T17:12:12.860452] [INFO ] [REMOTE ] AOS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:12:12.876152] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-16T17:12:13.174930] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-09-16T17:12:13.384902] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-16T17:12:13.974926] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-09-16T17:12:14.774900] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-09-16T17:12:14.964700] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-16T17:12:15.002940] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-16T17:12:15.574920] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-09-16T17:12:16.269875] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-16T17:12:16.374951] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-09-16T17:12:16.970964] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-16T17:12:17.174863] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-09-16T17:12:17.627139] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-16T17:12:17.974918] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-09-16T17:12:18.774865] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-09-16T17:12:18.882130] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-16T17:12:19.029258] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-16T17:12:19.033190] [INFO ] [REMOTE ] AOD: Full fetch complete (32982 records). [2025-09-16T17:12:19.033264] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-09-16T17:12:19.400465] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present. [2025-09-16T17:12:19.400542] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed. [2025-09-16T17:12:19.400940] [INFO ] [MAIN ] AOD: Fetched primary data is valid. [2025-09-16T17:12:19.400983] [DEBUG] [LOCAL ] AOD: Saving primary data. [2025-09-16T17:12:19.401761] [DEBUG] [LOCAL ] AOD: Trimmed 32982 records to 22340 (keeping 150 days of data) [2025-09-16T17:12:19.536833] [DEBUG] [LOCAL ] AOD: Primary data saved (22340 records). [2025-09-16T17:12:19.536965] [INFO ] [MAIN ] AOD: Full history saved. [2025-09-16T17:12:19.537040] [INFO ] [MAIN ] Update Progress: 123/2369 symbols completed. AOD took 23.5s. Estimated remaining: 3h 44m 8s. Rate: 10.0 symbols/min [2025-09-16T17:12:19.580038] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-09-16T17:12:19.713373] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:12:19.719961] [DEBUG] [LOCAL ] AP: Loaded 5760 existing records from primary storage. [2025-09-16T17:12:19.720047] [INFO ] [MAIN ] AP: Loaded 5760 existing records. [2025-09-16T17:12:19.894742] [WARN ] [MAIN ] AP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:12:19.895015] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-09-16T17:12:19.895068] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-09-16T17:12:19.895330] [DEBUG] [LOCAL ] AP: Deleted primary data file. [2025-09-16T17:12:19.895374] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-09-16T17:12:20.251264] [INFO ] [REMOTE ] AP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:12:20.380404] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-09-16T17:12:20.394433] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-16T17:12:21.174902] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-09-16T17:12:21.418134] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-16T17:12:21.443251] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-16T17:12:21.722362] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-16T17:12:21.974919] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-09-16T17:12:22.775006] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-09-16T17:12:23.276869] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-16T17:12:23.277359] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-16T17:12:23.574899] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-09-16T17:12:24.374906] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-09-16T17:12:24.922345] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-16T17:12:25.174907] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-09-16T17:12:25.914769] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-16T17:12:25.974865] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-09-16T17:12:26.423341] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-16T17:12:26.774945] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-09-16T17:12:27.563934] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-16T17:12:27.574847] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-09-16T17:12:27.791031] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-16T17:12:28.374891] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-09-16T17:12:29.174934] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-09-16T17:12:29.313103] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-16T17:12:29.834438] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-16T17:12:29.974916] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-09-16T17:12:30.572051] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-16T17:12:30.774914] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-09-16T17:12:31.147697] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-16T17:12:31.219549] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-16T17:12:31.574960] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-09-16T17:12:32.374931] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-09-16T17:12:32.399227] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-16T17:12:33.174917] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-09-16T17:12:33.712894] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-16T17:12:33.717334] [INFO ] [REMOTE ] AORT: Full fetch complete (32583 records). [2025-09-16T17:12:33.717459] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-09-16T17:12:33.983527] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-09-16T17:12:34.132844] [DEBUG] [VALIDATOR ] AORT: All expected trading days are present. [2025-09-16T17:12:34.132931] [DEBUG] [VALIDATOR ] AORT: Primary data validation passed. [2025-09-16T17:12:34.133345] [INFO ] [MAIN ] AORT: Fetched primary data is valid. [2025-09-16T17:12:34.133391] [DEBUG] [LOCAL ] AORT: Saving primary data. [2025-09-16T17:12:34.134318] [DEBUG] [LOCAL ] AORT: Trimmed 32583 records to 21726 (keeping 150 days of data) [2025-09-16T17:12:34.262481] [DEBUG] [LOCAL ] AORT: Primary data saved (21726 records). [2025-09-16T17:12:34.262612] [INFO ] [MAIN ] AORT: Full history saved. [2025-09-16T17:12:34.262713] [INFO ] [MAIN ] Update Progress: 124/2369 symbols completed. AORT took 29.3s. Estimated remaining: 3h 46m 40s. Rate: 9.9 symbols/min [2025-09-16T17:12:34.438330] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:12:34.464695] [DEBUG] [LOCAL ] APAM: Loaded 26710 existing records from primary storage. [2025-09-16T17:12:34.464853] [INFO ] [MAIN ] APAM: Loaded 26710 existing records. [2025-09-16T17:12:34.643042] [WARN ] [MAIN ] APAM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:12:34.643441] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-09-16T17:12:34.643587] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-09-16T17:12:34.649935] [DEBUG] [LOCAL ] APAM: Deleted primary data file. [2025-09-16T17:12:34.658218] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-09-16T17:12:34.664334] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-16T17:12:34.751549] [INFO ] [REMOTE ] AOS: Full fetch complete (53702 records). [2025-09-16T17:12:34.768003] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-09-16T17:12:34.790777] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-09-16T17:12:35.334567] [INFO ] [REMOTE ] APAM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:12:35.426564] [DEBUG] [VALIDATOR ] AOS: All expected trading days are present. [2025-09-16T17:12:35.426757] [DEBUG] [VALIDATOR ] AOS: Primary data validation passed. [2025-09-16T17:12:35.427363] [INFO ] [MAIN ] AOS: Fetched primary data is valid. [2025-09-16T17:12:35.427477] [DEBUG] [LOCAL ] AOS: Saving primary data. [2025-09-16T17:12:35.428744] [DEBUG] [LOCAL ] AOS: Trimmed 53702 records to 36605 (keeping 150 days of data) [2025-09-16T17:12:35.538707] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-16T17:12:35.570792] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-16T17:12:35.579989] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-09-16T17:12:35.710968] [DEBUG] [LOCAL ] AOS: Primary data saved (36605 records). [2025-09-16T17:12:35.711123] [INFO ] [MAIN ] AOS: Full history saved. [2025-09-16T17:12:35.714623] [INFO ] [MAIN ] Update Progress: 125/2369 symbols completed. AOS took 23.6s. Estimated remaining: 3h 45m 11s. Rate: 10.0 symbols/min [2025-09-16T17:12:35.889094] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:12:35.923946] [DEBUG] [LOCAL ] APD: Loaded 33036 existing records from primary storage. [2025-09-16T17:12:35.924094] [INFO ] [MAIN ] APD: Loaded 33036 existing records. [2025-09-16T17:12:36.099169] [WARN ] [MAIN ] APD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:12:36.099434] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-09-16T17:12:36.099479] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-09-16T17:12:36.100829] [DEBUG] [LOCAL ] APD: Deleted primary data file. [2025-09-16T17:12:36.100881] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-09-16T17:12:36.380007] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-09-16T17:12:36.465695] [INFO ] [REMOTE ] APD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:12:37.096523] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-16T17:12:37.174893] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-09-16T17:12:37.728448] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-16T17:12:37.733785] [INFO ] [REMOTE ] AON: Full fetch complete (49473 records). [2025-09-16T17:12:37.733889] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-09-16T17:12:37.986148] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-09-16T17:12:38.121214] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-09-16T17:12:38.121300] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-09-16T17:12:38.121858] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-09-16T17:12:38.121905] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-09-16T17:12:38.122968] [DEBUG] [LOCAL ] AON: Trimmed 49473 records to 33740 (keeping 150 days of data) [2025-09-16T17:12:38.348391] [DEBUG] [LOCAL ] AON: Primary data saved (33740 records). [2025-09-16T17:12:38.348548] [INFO ] [MAIN ] AON: Full history saved. [2025-09-16T17:12:38.351020] [INFO ] [MAIN ] Update Progress: 126/2369 symbols completed. AON took 42.3s. Estimated remaining: 3h 44m 5s. Rate: 10.0 symbols/min [2025-09-16T17:12:38.532524] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-16T17:12:38.549494] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:12:38.603329] [DEBUG] [LOCAL ] APG: Loaded 37503 existing records from primary storage. [2025-09-16T17:12:38.603500] [INFO ] [MAIN ] APG: Loaded 37503 existing records. [2025-09-16T17:12:38.735129] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-16T17:12:38.781426] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-09-16T17:12:38.804164] [WARN ] [MAIN ] APG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:12:38.804434] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-09-16T17:12:38.804482] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-09-16T17:12:38.805979] [DEBUG] [LOCAL ] APG: Deleted primary data file. [2025-09-16T17:12:38.806038] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-09-16T17:12:39.167987] [INFO ] [REMOTE ] APG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:12:39.306279] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-16T17:12:39.574965] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-09-16T17:12:40.374977] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-09-16T17:12:40.935776] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-16T17:12:41.174914] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-09-16T17:12:41.933852] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-16T17:12:41.974887] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-09-16T17:12:42.638226] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-16T17:12:42.774876] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-09-16T17:12:43.574873] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-09-16T17:12:43.665414] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-16T17:12:44.371816] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-16T17:12:44.381418] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-09-16T17:12:44.386368] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-16T17:12:44.387985] [INFO ] [REMOTE ] AP: Full fetch complete (6999 records). [2025-09-16T17:12:44.388286] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-09-16T17:12:44.764702] [DEBUG] [VALIDATOR ] AP: All expected trading days are present. [2025-09-16T17:12:44.764900] [DEBUG] [VALIDATOR ] AP: Primary data validation passed. [2025-09-16T17:12:44.765085] [INFO ] [MAIN ] AP: Fetched primary data is valid. [2025-09-16T17:12:44.765125] [DEBUG] [LOCAL ] AP: Saving primary data. [2025-09-16T17:12:44.765523] [DEBUG] [LOCAL ] AP: Trimmed 6999 records to 5815 (keeping 150 days of data) [2025-09-16T17:12:44.799605] [DEBUG] [LOCAL ] AP: Primary data saved (5815 records). [2025-09-16T17:12:44.799712] [INFO ] [MAIN ] AP: Full history saved. [2025-09-16T17:12:44.799793] [INFO ] [MAIN ] Update Progress: 127/2369 symbols completed. AP took 25.3s. Estimated remaining: 3h 44m 7s. Rate: 10.0 symbols/min [2025-09-16T17:12:44.975775] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:12:45.016760] [DEBUG] [LOCAL ] APH: Loaded 39651 existing records from primary storage. [2025-09-16T17:12:45.016923] [INFO ] [MAIN ] APH: Loaded 39651 existing records. [2025-09-16T17:12:45.177028] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-09-16T17:12:45.200168] [WARN ] [MAIN ] APH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:12:45.200368] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-09-16T17:12:45.200414] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-09-16T17:12:45.202013] [DEBUG] [LOCAL ] APH: Deleted primary data file. [2025-09-16T17:12:45.202068] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-09-16T17:12:45.572583] [INFO ] [REMOTE ] APH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:12:45.962393] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-16T17:12:45.974843] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-09-16T17:12:46.774934] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-09-16T17:12:46.943910] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-16T17:12:47.574903] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-09-16T17:12:47.935971] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-16T17:12:48.017112] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-16T17:12:48.374885] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-09-16T17:12:48.947125] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-16T17:12:49.174898] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-09-16T17:12:49.359404] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-16T17:12:49.974950] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-09-16T17:12:50.774935] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-09-16T17:12:51.042471] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-16T17:12:51.217981] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-16T17:12:51.574900] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-09-16T17:12:52.233301] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-16T17:12:52.374885] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-09-16T17:12:53.060024] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-16T17:12:53.174915] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-09-16T17:12:53.669164] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-16T17:12:53.974907] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-09-16T17:12:54.774902] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-09-16T17:12:55.051805] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-16T17:12:55.212343] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-16T17:12:55.574905] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-09-16T17:12:56.205371] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-16T17:12:56.374892] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-09-16T17:12:56.683875] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-16T17:12:57.174872] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-09-16T17:12:57.649384] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-16T17:12:57.974896] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-09-16T17:12:58.774925] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-09-16T17:12:59.115434] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-16T17:12:59.139030] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-16T17:12:59.143871] [INFO ] [REMOTE ] APD: Full fetch complete (49638 records). [2025-09-16T17:12:59.143961] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-09-16T17:12:59.547550] [DEBUG] [VALIDATOR ] APD: All expected trading days are present. [2025-09-16T17:12:59.547654] [DEBUG] [VALIDATOR ] APD: Primary data validation passed. [2025-09-16T17:12:59.548174] [INFO ] [MAIN ] APD: Fetched primary data is valid. [2025-09-16T17:12:59.548218] [DEBUG] [LOCAL ] APD: Saving primary data. [2025-09-16T17:12:59.549410] [DEBUG] [LOCAL ] APD: Trimmed 49638 records to 33341 (keeping 150 days of data) [2025-09-16T17:12:59.612921] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-09-16T17:12:59.766839] [DEBUG] [LOCAL ] APD: Primary data saved (33341 records). [2025-09-16T17:12:59.767010] [INFO ] [MAIN ] APD: Full history saved. [2025-09-16T17:12:59.768132] [INFO ] [MAIN ] Update Progress: 128/2369 symbols completed. APD took 24.1s. Estimated remaining: 3h 46m 38s. Rate: 9.9 symbols/min [2025-09-16T17:12:59.941779] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:12:59.985744] [DEBUG] [LOCAL ] APLE: Loaded 38334 existing records from primary storage. [2025-09-16T17:12:59.985885] [INFO ] [MAIN ] APLE: Loaded 38334 existing records. [2025-09-16T17:13:00.169788] [WARN ] [MAIN ] APLE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:13:00.170107] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-09-16T17:13:00.170162] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-09-16T17:13:00.171844] [DEBUG] [LOCAL ] APLE: Deleted primary data file. [2025-09-16T17:13:00.171899] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-09-16T17:13:00.380812] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-09-16T17:13:00.389595] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-16T17:13:00.576626] [INFO ] [REMOTE ] APLE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:13:01.174889] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-09-16T17:13:01.493539] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-16T17:13:01.974901] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-09-16T17:13:02.071124] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-16T17:13:02.075072] [INFO ] [REMOTE ] APAM: Full fetch complete (39730 records). [2025-09-16T17:13:02.075188] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-09-16T17:13:02.075729] [FATAL] [VALIDATOR ] APAM: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:13:02.075806] [FATAL] [MAIN ] APAM: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:13:02.075843] [WARN ] [MAIN ] APAM: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:13:02.075889] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-09-16T17:13:02.075946] [DEBUG] [LOCAL ] APAM: No primary data file found to delete. [2025-09-16T17:13:02.075983] [INFO ] [LOCAL ] APAM: Starting deletion of derivative data. [2025-09-16T17:13:02.076292] [DEBUG] [LOCAL ] APAM: Deleted derivative data file. [2025-09-16T17:13:02.076390] [INFO ] [MAIN ] Update Progress: 129/2369 symbols completed. APAM took 27.8s. Estimated remaining: 3h 45m 27s. Rate: 9.9 symbols/min [2025-09-16T17:13:02.248744] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:13:02.293124] [DEBUG] [LOCAL ] APO: Loaded 39369 existing records from primary storage. [2025-09-16T17:13:02.293299] [INFO ] [MAIN ] APO: Loaded 39369 existing records. [2025-09-16T17:13:02.484770] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:13:02.485059] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-09-16T17:13:02.485109] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-09-16T17:13:02.487023] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-09-16T17:13:02.487077] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-09-16T17:13:02.780061] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-09-16T17:13:02.848403] [INFO ] [REMOTE ] APO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:13:03.250283] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-16T17:13:03.256485] [INFO ] [REMOTE ] APG: Full fetch complete (54475 records). [2025-09-16T17:13:03.256590] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-09-16T17:13:03.579367] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-09-16T17:13:03.673872] [DEBUG] [VALIDATOR ] APG: All expected trading days are present. [2025-09-16T17:13:03.673973] [DEBUG] [VALIDATOR ] APG: Primary data validation passed. [2025-09-16T17:13:03.674581] [INFO ] [MAIN ] APG: Fetched primary data is valid. [2025-09-16T17:13:03.674680] [DEBUG] [LOCAL ] APG: Saving primary data. [2025-09-16T17:13:03.676184] [DEBUG] [LOCAL ] APG: Trimmed 54475 records to 37860 (keeping 150 days of data) [2025-09-16T17:13:03.905393] [DEBUG] [LOCAL ] APG: Primary data saved (37860 records). [2025-09-16T17:13:03.905544] [INFO ] [MAIN ] APG: Full history saved. [2025-09-16T17:13:03.905655] [INFO ] [MAIN ] Update Progress: 130/2369 symbols completed. APG took 25.6s. Estimated remaining: 3h 44m 8s. Rate: 10.0 symbols/min [2025-09-16T17:13:04.089963] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:13:04.112433] [DEBUG] [LOCAL ] APOS: Loaded 5181 existing records from primary storage. [2025-09-16T17:13:04.122192] [INFO ] [MAIN ] APOS: Loaded 5181 existing records. [2025-09-16T17:13:04.129507] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-16T17:13:04.294782] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-16T17:13:04.385260] [WARN ] [MAIN ] APOS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:13:04.379990] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-09-16T17:13:04.386432] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-09-16T17:13:04.386498] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-09-16T17:13:04.386869] [DEBUG] [LOCAL ] APOS: Deleted primary data file. [2025-09-16T17:13:04.386929] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-09-16T17:13:04.776899] [INFO ] [REMOTE ] APOS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:13:05.162553] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-16T17:13:05.174853] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-09-16T17:13:05.974873] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-09-16T17:13:06.558583] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-16T17:13:06.774893] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-09-16T17:13:06.819746] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-16T17:13:07.336265] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-16T17:13:07.574906] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-09-16T17:13:08.336069] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-16T17:13:08.374887] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-09-16T17:13:08.697987] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-16T17:13:08.704907] [INFO ] [REMOTE ] APH: Full fetch complete (58371 records). [2025-09-16T17:13:08.705076] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-09-16T17:13:09.083538] [DEBUG] [VALIDATOR ] APH: All expected trading days are present. [2025-09-16T17:13:09.083630] [DEBUG] [VALIDATOR ] APH: Primary data validation passed. [2025-09-16T17:13:09.084306] [INFO ] [MAIN ] APH: Fetched primary data is valid. [2025-09-16T17:13:09.084353] [DEBUG] [LOCAL ] APH: Saving primary data. [2025-09-16T17:13:09.085675] [DEBUG] [LOCAL ] APH: Trimmed 58371 records to 40041 (keeping 150 days of data) [2025-09-16T17:13:09.177328] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-09-16T17:13:09.331948] [DEBUG] [LOCAL ] APH: Primary data saved (40041 records). [2025-09-16T17:13:09.332083] [INFO ] [MAIN ] APH: Full history saved. [2025-09-16T17:13:09.332857] [INFO ] [MAIN ] Update Progress: 131/2369 symbols completed. APH took 24.5s. Estimated remaining: 3h 43m 52s. Rate: 10.0 symbols/min [2025-09-16T17:13:09.506718] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:13:09.545678] [DEBUG] [LOCAL ] APTV: Loaded 38330 existing records from primary storage. [2025-09-16T17:13:09.545822] [INFO ] [MAIN ] APTV: Loaded 38330 existing records. [2025-09-16T17:13:09.720789] [WARN ] [MAIN ] APTV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:13:09.721048] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-09-16T17:13:09.721095] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-09-16T17:13:09.722145] [DEBUG] [LOCAL ] APTV: Deleted primary data file. [2025-09-16T17:13:09.722195] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-09-16T17:13:09.977161] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-09-16T17:13:10.092731] [INFO ] [REMOTE ] APTV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:13:10.135096] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-16T17:13:10.153097] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-16T17:13:10.774915] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-09-16T17:13:11.574914] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-09-16T17:13:11.816138] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-16T17:13:12.374909] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-09-16T17:13:12.461123] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-16T17:13:13.174971] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-09-16T17:13:13.520954] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-16T17:13:13.817196] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-16T17:13:13.916121] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-16T17:13:13.974870] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-09-16T17:13:14.691840] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-16T17:13:14.774898] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-09-16T17:13:15.574905] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-09-16T17:13:15.654546] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-16T17:13:16.374898] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-09-16T17:13:16.998466] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-16T17:13:17.174921] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-09-16T17:13:17.653070] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-16T17:13:17.850299] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-16T17:13:17.974891] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-09-16T17:13:18.774932] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-09-16T17:13:19.563161] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-16T17:13:19.574925] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-09-16T17:13:19.893998] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-16T17:13:20.374928] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-09-16T17:13:21.174933] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-09-16T17:13:21.585658] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-16T17:13:21.667715] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-16T17:13:21.974947] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-09-16T17:13:22.674537] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-16T17:13:22.774891] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-09-16T17:13:23.574979] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-09-16T17:13:23.622090] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-16T17:13:23.919394] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-16T17:13:24.374936] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-09-16T17:13:25.174890] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-09-16T17:13:25.262818] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-16T17:13:25.732263] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-16T17:13:25.974940] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-09-16T17:13:26.497981] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-16T17:13:26.504990] [INFO ] [REMOTE ] APO: Full fetch complete (58036 records). [2025-09-16T17:13:26.505201] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-09-16T17:13:26.777998] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-09-16T17:13:26.817369] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-16T17:13:26.864108] [INFO ] [REMOTE ] APOS: Full fetch complete (8087 records). [2025-09-16T17:13:26.891970] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-09-16T17:13:26.905920] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-09-16T17:13:26.906165] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-09-16T17:13:26.979813] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-09-16T17:13:26.991267] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-09-16T17:13:27.035352] [DEBUG] [LOCAL ] APO: Trimmed 58036 records to 39757 (keeping 150 days of data) [2025-09-16T17:13:27.394860] [DEBUG] [VALIDATOR ] APOS: All expected trading days are present. [2025-09-16T17:13:27.396833] [DEBUG] [VALIDATOR ] APOS: Primary data validation passed. [2025-09-16T17:13:27.399304] [INFO ] [MAIN ] APOS: Fetched primary data is valid. [2025-09-16T17:13:27.400851] [DEBUG] [LOCAL ] APOS: Saving primary data. [2025-09-16T17:13:27.406705] [DEBUG] [LOCAL ] APOS: Trimmed 8087 records to 5235 (keeping 150 days of data) [2025-09-16T17:13:27.451674] [DEBUG] [LOCAL ] APOS: Primary data saved (5235 records). [2025-09-16T17:13:27.456035] [INFO ] [MAIN ] APOS: Full history saved. [2025-09-16T17:13:27.457630] [INFO ] [MAIN ] Update Progress: 132/2369 symbols completed. APOS took 23.6s. Estimated remaining: 3h 47m 12s. Rate: 9.8 symbols/min [2025-09-16T17:13:27.632354] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-09-16T17:13:27.728870] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:13:27.780333] [DEBUG] [LOCAL ] AQN: Loaded 38142 existing records from primary storage. [2025-09-16T17:13:27.782353] [INFO ] [MAIN ] AQN: Loaded 38142 existing records. [2025-09-16T17:13:27.855486] [DEBUG] [LOCAL ] APO: Primary data saved (39757 records). [2025-09-16T17:13:27.877134] [INFO ] [MAIN ] APO: Full history saved. [2025-09-16T17:13:27.887660] [INFO ] [MAIN ] Update Progress: 133/2369 symbols completed. APO took 25.8s. Estimated remaining: 3h 45m 30s. Rate: 9.9 symbols/min [2025-09-16T17:13:28.075207] [WARN ] [MAIN ] AQN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:13:28.080598] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-09-16T17:13:28.091100] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-09-16T17:13:28.107736] [DEBUG] [LOCAL ] AQN: Deleted primary data file. [2025-09-16T17:13:28.149445] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-09-16T17:13:28.150835] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:13:28.256084] [DEBUG] [LOCAL ] AQNB: Loaded 2896 existing records from primary storage. [2025-09-16T17:13:28.266739] [INFO ] [MAIN ] AQNB: Loaded 2896 existing records. [2025-09-16T17:13:28.602604] [WARN ] [MAIN ] AQNB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:13:28.613552] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-09-16T17:13:28.613731] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-09-16T17:13:28.639776] [DEBUG] [LOCAL ] AQNB: Deleted primary data file. [2025-09-16T17:13:28.664206] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-09-16T17:13:28.696279] [INFO ] [REMOTE ] AQN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:13:28.696749] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-09-16T17:13:29.083971] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:13:29.088005] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-16T17:13:29.174930] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-09-16T17:13:29.410166] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-16T17:13:29.416509] [INFO ] [REMOTE ] APLE: Full fetch complete (56360 records). [2025-09-16T17:13:29.416671] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-09-16T17:13:29.740763] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-16T17:13:29.833011] [DEBUG] [VALIDATOR ] APLE: All expected trading days are present. [2025-09-16T17:13:29.833100] [DEBUG] [VALIDATOR ] APLE: Primary data validation passed. [2025-09-16T17:13:29.833727] [INFO ] [MAIN ] APLE: Fetched primary data is valid. [2025-09-16T17:13:29.833779] [DEBUG] [LOCAL ] APLE: Saving primary data. [2025-09-16T17:13:29.835093] [DEBUG] [LOCAL ] APLE: Trimmed 56360 records to 38699 (keeping 150 days of data) [2025-09-16T17:13:30.014872] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-09-16T17:13:30.079405] [DEBUG] [LOCAL ] APLE: Primary data saved (38699 records). [2025-09-16T17:13:30.079549] [INFO ] [MAIN ] APLE: Full history saved. [2025-09-16T17:13:30.080706] [INFO ] [MAIN ] Update Progress: 134/2369 symbols completed. APLE took 30.3s. Estimated remaining: 3h 44m 20s. Rate: 10.0 symbols/min [2025-09-16T17:13:30.258695] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:13:30.305822] [DEBUG] [LOCAL ] AR: Loaded 39562 existing records from primary storage. [2025-09-16T17:13:30.306009] [INFO ] [MAIN ] AR: Loaded 39562 existing records. [2025-09-16T17:13:30.493501] [WARN ] [MAIN ] AR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:13:30.493814] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-09-16T17:13:30.493874] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-09-16T17:13:30.495513] [DEBUG] [LOCAL ] AR: Deleted primary data file. [2025-09-16T17:13:30.495572] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-09-16T17:13:30.783891] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-09-16T17:13:30.909539] [INFO ] [REMOTE ] AR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:13:30.937844] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-09-16T17:13:31.517562] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-16T17:13:31.515223] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-16T17:13:31.574921] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-09-16T17:13:32.374911] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-09-16T17:13:32.969549] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-16T17:13:33.036439] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-16T17:13:33.042941] [INFO ] [REMOTE ] APTV: Full fetch complete (56894 records). [2025-09-16T17:13:33.043076] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-09-16T17:13:33.190758] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-09-16T17:13:33.442119] [DEBUG] [VALIDATOR ] APTV: All expected trading days are present. [2025-09-16T17:13:33.442224] [DEBUG] [VALIDATOR ] APTV: Primary data validation passed. [2025-09-16T17:13:33.442928] [INFO ] [MAIN ] APTV: Fetched primary data is valid. [2025-09-16T17:13:33.442994] [DEBUG] [LOCAL ] APTV: Saving primary data. [2025-09-16T17:13:33.444872] [DEBUG] [LOCAL ] APTV: Trimmed 56894 records to 38716 (keeping 150 days of data) [2025-09-16T17:13:33.679272] [DEBUG] [LOCAL ] APTV: Primary data saved (38716 records). [2025-09-16T17:13:33.679409] [INFO ] [MAIN ] APTV: Full history saved. [2025-09-16T17:13:33.680094] [INFO ] [MAIN ] Update Progress: 135/2369 symbols completed. APTV took 24.3s. Estimated remaining: 3h 43m 34s. Rate: 10.0 symbols/min [2025-09-16T17:13:33.856327] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:13:33.857247] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-16T17:13:33.893051] [DEBUG] [LOCAL ] ARCO: Loaded 32872 existing records from primary storage. [2025-09-16T17:13:33.893209] [INFO ] [MAIN ] ARCO: Loaded 32872 existing records. [2025-09-16T17:13:33.980206] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-09-16T17:13:34.075933] [WARN ] [MAIN ] ARCO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:13:34.076173] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-09-16T17:13:34.076220] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-09-16T17:13:34.077392] [DEBUG] [LOCAL ] ARCO: Deleted primary data file. [2025-09-16T17:13:34.077446] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-09-16T17:13:34.483540] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:13:34.488746] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-16T17:13:34.774894] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-09-16T17:13:35.574902] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-09-16T17:13:35.920263] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-16T17:13:36.092328] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-16T17:13:36.374938] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-09-16T17:13:37.174910] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-09-16T17:13:37.730820] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-16T17:13:37.974905] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-09-16T17:13:38.075159] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-16T17:13:38.463357] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-16T17:13:38.464342] [INFO ] [REMOTE ] AQNB: Full fetch complete (4410 records). [2025-09-16T17:13:38.464410] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-09-16T17:13:38.780006] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-09-16T17:13:38.818947] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-09-16T17:13:38.819035] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-09-16T17:13:38.819238] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-09-16T17:13:38.819289] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-09-16T17:13:38.819916] [DEBUG] [LOCAL ] AQNB: Trimmed 4410 records to 2917 (keeping 150 days of data) [2025-09-16T17:13:38.838957] [DEBUG] [LOCAL ] AQNB: Primary data saved (2917 records). [2025-09-16T17:13:38.839026] [INFO ] [MAIN ] AQNB: Full history saved. [2025-09-16T17:13:38.839122] [INFO ] [MAIN ] Update Progress: 136/2369 symbols completed. AQNB took 11.0s. Estimated remaining: 3h 43m 14s. Rate: 10.0 symbols/min [2025-09-16T17:13:39.008085] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:13:39.023277] [DEBUG] [LOCAL ] ARDC: Loaded 10313 existing records from primary storage. [2025-09-16T17:13:39.023397] [INFO ] [MAIN ] ARDC: Loaded 10313 existing records. [2025-09-16T17:13:39.199525] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:13:39.199767] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-09-16T17:13:39.199812] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-09-16T17:13:39.200363] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-09-16T17:13:39.200409] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-09-16T17:13:39.547631] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:13:39.574861] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-09-16T17:13:40.374905] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-09-16T17:13:40.521449] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-16T17:13:41.174906] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-09-16T17:13:41.381558] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-16T17:13:41.401402] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-16T17:13:41.974908] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-09-16T17:13:42.461337] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-16T17:13:42.779877] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-09-16T17:13:42.784487] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-16T17:13:43.574900] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-09-16T17:13:44.273409] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-16T17:13:44.316256] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-16T17:13:44.374882] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-09-16T17:13:45.174900] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-09-16T17:13:45.781690] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-16T17:13:45.974908] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-09-16T17:13:46.774913] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-09-16T17:13:46.864278] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-16T17:13:47.444685] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-16T17:13:47.574918] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-09-16T17:13:48.374905] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-09-16T17:13:48.649977] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-16T17:13:49.179997] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-09-16T17:13:49.196972] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-16T17:13:49.234454] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-16T17:13:49.974904] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-09-16T17:13:50.657674] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-16T17:13:50.774907] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-09-16T17:13:51.311416] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-16T17:13:51.574972] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-09-16T17:13:52.374971] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-09-16T17:13:52.448747] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-16T17:13:53.133241] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-16T17:13:53.174858] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-09-16T17:13:53.974907] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-09-16T17:13:54.078067] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-16T17:13:54.456028] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-16T17:13:54.714269] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-16T17:13:54.774891] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-09-16T17:13:55.574913] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-09-16T17:13:55.831388] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-16T17:13:56.374896] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-09-16T17:13:56.991766] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-16T17:13:56.997251] [INFO ] [REMOTE ] ARCO: Full fetch complete (48541 records). [2025-09-16T17:13:56.997362] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-09-16T17:13:57.175623] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-09-16T17:13:57.386607] [DEBUG] [VALIDATOR ] ARCO: All expected trading days are present. [2025-09-16T17:13:57.386742] [DEBUG] [VALIDATOR ] ARCO: Primary data validation passed. [2025-09-16T17:13:57.387365] [INFO ] [MAIN ] ARCO: Fetched primary data is valid. [2025-09-16T17:13:57.387418] [DEBUG] [LOCAL ] ARCO: Saving primary data. [2025-09-16T17:13:57.388708] [DEBUG] [LOCAL ] ARCO: Trimmed 48541 records to 33170 (keeping 150 days of data) [2025-09-16T17:13:57.590236] [DEBUG] [LOCAL ] ARCO: Primary data saved (33170 records). [2025-09-16T17:13:57.590391] [INFO ] [MAIN ] ARCO: Full history saved. [2025-09-16T17:13:57.591467] [INFO ] [MAIN ] Update Progress: 137/2369 symbols completed. ARCO took 23.9s. Estimated remaining: 3h 46m 36s. Rate: 9.9 symbols/min [2025-09-16T17:13:57.773715] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:13:57.807243] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-16T17:13:57.831114] [DEBUG] [LOCAL ] ARDT: Loaded 19778 existing records from primary storage. [2025-09-16T17:13:57.831270] [INFO ] [MAIN ] ARDT: Loaded 19778 existing records. [2025-09-16T17:13:57.980491] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-09-16T17:13:58.018780] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:13:58.018986] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-09-16T17:13:58.019048] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-09-16T17:13:58.019684] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-09-16T17:13:58.019741] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-09-16T17:13:58.365064] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-16T17:13:58.388401] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:13:58.774907] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-09-16T17:13:59.574875] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-09-16T17:13:59.776818] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-16T17:14:00.041772] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-16T17:14:00.374907] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-09-16T17:14:01.174921] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-09-16T17:14:01.594171] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-16T17:14:01.601235] [INFO ] [REMOTE ] AQN: Full fetch complete (56582 records). [2025-09-16T17:14:01.601395] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-09-16T17:14:01.740156] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-16T17:14:01.810609] [INFO ] [REMOTE ] ARDC: Full fetch complete (16030 records). [2025-09-16T17:14:01.817745] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-09-16T17:14:01.993921] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-09-16T17:14:02.325194] [DEBUG] [VALIDATOR ] AQN: All expected trading days are present. [2025-09-16T17:14:02.351211] [DEBUG] [VALIDATOR ] AQN: Primary data validation passed. [2025-09-16T17:14:02.354387] [INFO ] [MAIN ] AQN: Fetched primary data is valid. [2025-09-16T17:14:02.354707] [DEBUG] [LOCAL ] AQN: Saving primary data. [2025-09-16T17:14:02.434691] [DEBUG] [LOCAL ] AQN: Trimmed 56582 records to 38517 (keeping 150 days of data) [2025-09-16T17:14:02.434864] [DEBUG] [VALIDATOR ] ARDC: All expected trading days are present. [2025-09-16T17:14:02.434968] [DEBUG] [VALIDATOR ] ARDC: Primary data validation passed. [2025-09-16T17:14:02.435390] [INFO ] [MAIN ] ARDC: Fetched primary data is valid. [2025-09-16T17:14:02.435462] [DEBUG] [LOCAL ] ARDC: Saving primary data. [2025-09-16T17:14:02.436231] [DEBUG] [LOCAL ] ARDC: Trimmed 16030 records to 10395 (keeping 150 days of data) [2025-09-16T17:14:02.607437] [DEBUG] [LOCAL ] ARDC: Primary data saved (10395 records). [2025-09-16T17:14:02.608259] [INFO ] [MAIN ] ARDC: Full history saved. [2025-09-16T17:14:02.608842] [INFO ] [MAIN ] Update Progress: 138/2369 symbols completed. ARDC took 23.8s. Estimated remaining: 3h 46m 12s. Rate: 9.9 symbols/min [2025-09-16T17:14:02.790044] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:14:02.923196] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-16T17:14:02.941200] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-09-16T17:14:02.954922] [DEBUG] [LOCAL ] ARE: Loaded 37553 existing records from primary storage. [2025-09-16T17:14:02.955517] [INFO ] [MAIN ] ARE: Loaded 37553 existing records. [2025-09-16T17:14:03.144268] [WARN ] [MAIN ] ARE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:14:03.145658] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-09-16T17:14:03.146819] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-09-16T17:14:03.151407] [DEBUG] [LOCAL ] ARE: Deleted primary data file. [2025-09-16T17:14:03.153602] [DEBUG] [LOCAL ] AQN: Primary data saved (38517 records). [2025-09-16T17:14:03.153844] [INFO ] [MAIN ] AQN: Full history saved. [2025-09-16T17:14:03.153990] [INFO ] [MAIN ] Update Progress: 139/2369 symbols completed. AQN took 35.7s. Estimated remaining: 3h 44m 37s. Rate: 9.9 symbols/min [2025-09-16T17:14:03.159342] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-09-16T17:14:03.398531] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-16T17:14:03.556365] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:14:03.582602] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-09-16T17:14:03.742700] [INFO ] [REMOTE ] ARE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:14:03.767781] [DEBUG] [LOCAL ] ARES: Loaded 36190 existing records from primary storage. [2025-09-16T17:14:03.767915] [INFO ] [MAIN ] ARES: Loaded 36190 existing records. [2025-09-16T17:14:03.945588] [WARN ] [MAIN ] ARES: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:14:03.945841] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-09-16T17:14:03.945889] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-09-16T17:14:03.947368] [DEBUG] [LOCAL ] ARES: Deleted primary data file. [2025-09-16T17:14:03.947422] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-09-16T17:14:04.307993] [INFO ] [REMOTE ] ARES: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:14:04.374872] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-09-16T17:14:04.548183] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-16T17:14:04.555211] [INFO ] [REMOTE ] AR: Full fetch complete (58263 records). [2025-09-16T17:14:04.555312] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-09-16T17:14:04.950090] [DEBUG] [VALIDATOR ] AR: All expected trading days are present. [2025-09-16T17:14:04.950672] [DEBUG] [VALIDATOR ] AR: Primary data validation passed. [2025-09-16T17:14:04.951264] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-16T17:14:04.952117] [INFO ] [MAIN ] AR: Fetched primary data is valid. [2025-09-16T17:14:04.952206] [DEBUG] [LOCAL ] AR: Saving primary data. [2025-09-16T17:14:04.960766] [DEBUG] [LOCAL ] AR: Trimmed 58263 records to 39952 (keeping 150 days of data) [2025-09-16T17:14:05.176118] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-09-16T17:14:05.198931] [DEBUG] [LOCAL ] AR: Primary data saved (39952 records). [2025-09-16T17:14:05.199035] [INFO ] [MAIN ] AR: Full history saved. [2025-09-16T17:14:05.201924] [INFO ] [MAIN ] Update Progress: 140/2369 symbols completed. AR took 35.1s. Estimated remaining: 3h 43m 28s. Rate: 10.0 symbols/min [2025-09-16T17:14:05.374623] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:14:05.409475] [DEBUG] [LOCAL ] ARI: Loaded 31741 existing records from primary storage. [2025-09-16T17:14:05.409687] [INFO ] [MAIN ] ARI: Loaded 31741 existing records. [2025-09-16T17:14:05.602459] [WARN ] [MAIN ] ARI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:14:05.602700] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-09-16T17:14:05.602750] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-09-16T17:14:05.603765] [DEBUG] [LOCAL ] ARI: Deleted primary data file. [2025-09-16T17:14:05.603821] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-09-16T17:14:05.960234] [INFO ] [REMOTE ] ARI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:14:05.974849] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-09-16T17:14:06.320510] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-16T17:14:06.759396] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-16T17:14:06.774845] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-09-16T17:14:07.387558] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-16T17:14:07.574915] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-09-16T17:14:07.990687] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-16T17:14:08.374947] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-09-16T17:14:09.180253] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-09-16T17:14:09.201599] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-16T17:14:09.895000] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-16T17:14:09.974940] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-09-16T17:14:10.496509] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-16T17:14:10.774954] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-09-16T17:14:11.574948] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-09-16T17:14:11.817540] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-16T17:14:11.954564] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-16T17:14:12.374941] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-09-16T17:14:13.071312] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-16T17:14:13.174924] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-09-16T17:14:13.818629] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-16T17:14:13.942827] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-16T17:14:13.974867] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-09-16T17:14:14.774906] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-09-16T17:14:15.400967] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-16T17:14:15.574895] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-09-16T17:14:16.374910] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-09-16T17:14:16.415211] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-16T17:14:16.684083] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-16T17:14:17.174922] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-09-16T17:14:17.974934] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-09-16T17:14:18.218067] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-16T17:14:18.221426] [INFO ] [REMOTE ] ARDT: Full fetch complete (31416 records). [2025-09-16T17:14:18.221506] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-09-16T17:14:18.548512] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-16T17:14:18.650984] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-09-16T17:14:18.651061] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-09-16T17:14:18.651436] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-09-16T17:14:18.651543] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-09-16T17:14:18.652432] [DEBUG] [LOCAL ] ARDT: Trimmed 31416 records to 20016 (keeping 150 days of data) [2025-09-16T17:14:18.771012] [DEBUG] [LOCAL ] ARDT: Primary data saved (20016 records). [2025-09-16T17:14:18.771138] [INFO ] [MAIN ] ARDT: Full history saved. [2025-09-16T17:14:18.771220] [INFO ] [MAIN ] Update Progress: 141/2369 symbols completed. ARDT took 21.2s. Estimated remaining: 3h 45m 21s. Rate: 9.9 symbols/min [2025-09-16T17:14:18.782592] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-09-16T17:14:18.945667] [INFO ] [MAIN ] ARIS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:14:18.977560] [DEBUG] [LOCAL ] ARIS: Loaded 30434 existing records from primary storage. [2025-09-16T17:14:18.977755] [INFO ] [MAIN ] ARIS: Loaded 30434 existing records. [2025-09-16T17:14:19.155332] [WARN ] [MAIN ] ARIS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:14:19.155611] [INFO ] [MAIN ] ARIS: Wiping existing primary data before full refresh. [2025-09-16T17:14:19.155681] [INFO ] [LOCAL ] ARIS: Starting deletion of primary data. [2025-09-16T17:14:19.156889] [DEBUG] [LOCAL ] ARIS: Deleted primary data file. [2025-09-16T17:14:19.156944] [INFO ] [MAIN ] ARIS: Starting full primary refresh. [2025-09-16T17:14:19.514940] [INFO ] [REMOTE ] ARIS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:14:19.540618] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-16T17:14:19.574890] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-09-16T17:14:20.374874] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-09-16T17:14:20.440739] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-16T17:14:20.944150] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-16T17:14:21.174900] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-09-16T17:14:21.976961] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-02. [2025-09-16T17:14:21.980266] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-16T17:14:22.778299] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-09-16T17:14:22.780821] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-16T17:14:23.509487] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-16T17:14:23.574862] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-03. [2025-09-16T17:14:24.143767] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-16T17:14:24.374913] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-09-16T17:14:24.720417] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-16T17:14:25.174917] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-09-16T17:14:25.934696] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-16T17:14:25.974916] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-09-16T17:14:26.710201] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-16T17:14:26.774920] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-09-16T17:14:27.581566] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-09-16T17:14:27.588884] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-16T17:14:27.597259] [INFO ] [REMOTE ] ARE: Full fetch complete (54815 records). [2025-09-16T17:14:27.597508] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-09-16T17:14:28.014271] [DEBUG] [VALIDATOR ] ARE: All expected trading days are present. [2025-09-16T17:14:28.014378] [DEBUG] [VALIDATOR ] ARE: Primary data validation passed. [2025-09-16T17:14:28.015064] [INFO ] [MAIN ] ARE: Fetched primary data is valid. [2025-09-16T17:14:28.015119] [DEBUG] [LOCAL ] ARE: Saving primary data. [2025-09-16T17:14:28.016531] [DEBUG] [LOCAL ] ARE: Trimmed 54815 records to 37881 (keeping 150 days of data) [2025-09-16T17:14:28.250158] [DEBUG] [LOCAL ] ARE: Primary data saved (37881 records). [2025-09-16T17:14:28.250320] [INFO ] [MAIN ] ARE: Full history saved. [2025-09-16T17:14:28.250410] [INFO ] [MAIN ] Update Progress: 142/2369 symbols completed. ARE took 25.6s. Estimated remaining: 3h 46m 8s. Rate: 9.8 symbols/min [2025-09-16T17:14:28.377449] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-04. [2025-09-16T17:14:28.430884] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:14:28.449252] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-16T17:14:28.455171] [INFO ] [REMOTE ] ARES: Full fetch complete (53920 records). [2025-09-16T17:14:28.455270] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-09-16T17:14:28.755743] [DEBUG] [LOCAL ] ARLO: Loaded 32320 existing records from primary storage. [2025-09-16T17:14:28.774068] [INFO ] [MAIN ] ARLO: Loaded 32320 existing records. [2025-09-16T17:14:28.975223] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present. [2025-09-16T17:14:28.975365] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed. [2025-09-16T17:14:28.976285] [INFO ] [MAIN ] ARES: Fetched primary data is valid. [2025-09-16T17:14:28.981704] [DEBUG] [LOCAL ] ARES: Saving primary data. [2025-09-16T17:14:29.055029] [WARN ] [MAIN ] ARLO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:14:29.055198] [DEBUG] [LOCAL ] ARES: Trimmed 53920 records to 36531 (keeping 150 days of data) [2025-09-16T17:14:29.078477] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-09-16T17:14:29.080860] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-09-16T17:14:29.082215] [DEBUG] [LOCAL ] ARLO: Deleted primary data file. [2025-09-16T17:14:29.084730] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-09-16T17:14:29.084620] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-16T17:14:29.236592] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-09-16T17:14:29.567151] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:14:29.700332] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-16T17:14:29.735478] [DEBUG] [LOCAL ] ARES: Primary data saved (36531 records). [2025-09-16T17:14:29.735697] [INFO ] [MAIN ] ARES: Full history saved. [2025-09-16T17:14:29.735809] [INFO ] [MAIN ] Update Progress: 143/2369 symbols completed. ARES took 26.6s. Estimated remaining: 3h 44m 51s. Rate: 9.9 symbols/min [2025-09-16T17:14:29.907350] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:14:29.946763] [DEBUG] [LOCAL ] ARMK: Loaded 37030 existing records from primary storage. [2025-09-16T17:14:29.946910] [INFO ] [MAIN ] ARMK: Loaded 37030 existing records. [2025-09-16T17:14:29.980129] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-09-16T17:14:30.134070] [WARN ] [MAIN ] ARMK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:14:30.134290] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-09-16T17:14:30.134341] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-09-16T17:14:30.135945] [DEBUG] [LOCAL ] ARMK: Deleted primary data file. [2025-09-16T17:14:30.136001] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-09-16T17:14:30.494921] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:14:30.774937] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-09-16T17:14:30.950768] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-16T17:14:30.956029] [INFO ] [REMOTE ] ARI: Full fetch complete (46884 records). [2025-09-16T17:14:30.956179] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-09-16T17:14:31.366523] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-09-16T17:14:31.366711] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-09-16T17:14:31.367475] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-09-16T17:14:31.367564] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-09-16T17:14:31.369361] [DEBUG] [LOCAL ] ARI: Trimmed 46884 records to 32069 (keeping 150 days of data) [2025-09-16T17:14:31.503168] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-16T17:14:31.576162] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-09-16T17:14:31.598062] [DEBUG] [LOCAL ] ARI: Primary data saved (32069 records). [2025-09-16T17:14:31.598225] [INFO ] [MAIN ] ARI: Full history saved. [2025-09-16T17:14:31.600619] [INFO ] [MAIN ] Update Progress: 144/2369 symbols completed. ARI took 26.4s. Estimated remaining: 3h 43m 40s. Rate: 9.9 symbols/min [2025-09-16T17:14:31.779041] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:14:31.825802] [DEBUG] [LOCAL ] AROC: Loaded 35804 existing records from primary storage. [2025-09-16T17:14:31.825976] [INFO ] [MAIN ] AROC: Loaded 35804 existing records. [2025-09-16T17:14:32.002611] [WARN ] [MAIN ] AROC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:14:32.002881] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-09-16T17:14:32.002928] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-09-16T17:14:32.004204] [DEBUG] [LOCAL ] AROC: Deleted primary data file. [2025-09-16T17:14:32.004257] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-09-16T17:14:32.367379] [INFO ] [REMOTE ] AROC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:14:32.379936] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-09-16T17:14:32.395663] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-16T17:14:33.018077] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-16T17:14:33.175014] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-09-16T17:14:33.761200] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-16T17:14:33.974954] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-09-16T17:14:34.774986] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-09-16T17:14:34.942791] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-16T17:14:35.574875] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-09-16T17:14:35.721555] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-16T17:14:35.863354] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-16T17:14:36.374944] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-09-16T17:14:36.827721] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-16T17:14:37.174981] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-09-16T17:14:37.824796] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-16T17:14:37.974907] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-09-16T17:14:38.612851] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-16T17:14:38.774948] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-09-16T17:14:39.151520] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-16T17:14:39.574925] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-09-16T17:14:40.345546] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-16T17:14:40.374880] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-09-16T17:14:40.908547] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-16T17:14:41.174936] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-05. [2025-09-16T17:14:41.974945] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-09-16T17:14:42.137024] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-16T17:14:42.746721] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-16T17:14:42.774870] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-06. [2025-09-16T17:14:43.261639] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-16T17:14:43.574929] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-09-16T17:14:44.175107] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-16T17:14:44.374970] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-07. [2025-09-16T17:14:44.801872] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-16T17:14:44.808046] [INFO ] [REMOTE ] ARLO: Full fetch complete (47672 records). [2025-09-16T17:14:44.808214] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-09-16T17:14:45.180166] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-09-16T17:14:45.368488] [DEBUG] [VALIDATOR ] ARLO: All expected trading days are present. [2025-09-16T17:14:45.368619] [DEBUG] [VALIDATOR ] ARLO: Primary data validation passed. [2025-09-16T17:14:45.369555] [INFO ] [MAIN ] ARLO: Fetched primary data is valid. [2025-09-16T17:14:45.369620] [DEBUG] [LOCAL ] ARLO: Saving primary data. [2025-09-16T17:14:45.371300] [DEBUG] [LOCAL ] ARLO: Trimmed 47672 records to 32647 (keeping 150 days of data) [2025-09-16T17:14:45.674315] [DEBUG] [LOCAL ] ARLO: Primary data saved (32647 records). [2025-09-16T17:14:45.674566] [INFO ] [MAIN ] ARLO: Full history saved. [2025-09-16T17:14:45.674764] [INFO ] [MAIN ] Update Progress: 145/2369 symbols completed. ARLO took 17.4s. Estimated remaining: 3h 45m 37s. Rate: 9.9 symbols/min [2025-09-16T17:14:45.926402] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:14:45.968410] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-16T17:14:45.978984] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-09-16T17:14:46.025030] [DEBUG] [LOCAL ] ARR: Loaded 38305 existing records from primary storage. [2025-09-16T17:14:46.025428] [INFO ] [MAIN ] ARR: Loaded 38305 existing records. [2025-09-16T17:14:46.216743] [WARN ] [MAIN ] ARR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:14:46.217025] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-09-16T17:14:46.217088] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-09-16T17:14:46.218752] [DEBUG] [LOCAL ] ARR: Deleted primary data file. [2025-09-16T17:14:46.218806] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-09-16T17:14:46.575041] [INFO ] [REMOTE ] ARR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:14:46.774907] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-08. [2025-09-16T17:14:46.941076] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-16T17:14:47.369253] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-16T17:14:47.574891] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-09-16T17:14:48.290400] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-16T17:14:48.374894] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-09. [2025-09-16T17:14:49.174940] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-09-16T17:14:49.335489] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-16T17:14:49.751978] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-16T17:14:49.756882] [INFO ] [REMOTE ] ARIS: Full fetch complete (45271 records). [2025-09-16T17:14:49.756991] [DEBUG] [VALIDATOR ] ARIS: Validating primary data. [2025-09-16T17:14:49.757628] [FATAL] [VALIDATOR ] ARIS: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:14:49.757731] [FATAL] [MAIN ] ARIS: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:14:49.757771] [WARN ] [MAIN ] ARIS: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:14:49.757816] [INFO ] [LOCAL ] ARIS: Starting deletion of primary data. [2025-09-16T17:14:49.757876] [DEBUG] [LOCAL ] ARIS: No primary data file found to delete. [2025-09-16T17:14:49.757914] [INFO ] [LOCAL ] ARIS: Starting deletion of derivative data. [2025-09-16T17:14:49.758268] [DEBUG] [LOCAL ] ARIS: Deleted derivative data file. [2025-09-16T17:14:49.759240] [INFO ] [MAIN ] Update Progress: 146/2369 symbols completed. ARIS took 31.0s. Estimated remaining: 3h 45m 0s. Rate: 9.9 symbols/min [2025-09-16T17:14:49.935995] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:14:49.961047] [DEBUG] [LOCAL ] ARW: Loaded 23693 existing records from primary storage. [2025-09-16T17:14:49.961188] [INFO ] [MAIN ] ARW: Loaded 23693 existing records. [2025-09-16T17:14:49.982367] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-09-16T17:14:50.148116] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:14:50.148400] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-09-16T17:14:50.148449] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-09-16T17:14:50.149592] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-09-16T17:14:50.149672] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-09-16T17:14:50.523430] [INFO ] [REMOTE ] ARW: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:14:50.774977] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-09-16T17:14:50.888763] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-16T17:14:51.574959] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-09-16T17:14:51.763717] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-16T17:14:51.992061] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-16T17:14:52.374994] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-09-16T17:14:52.723734] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-16T17:14:53.174948] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-09-16T17:14:53.974949] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-09-16T17:14:54.074845] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-16T17:14:54.774969] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-09-16T17:14:55.003868] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-16T17:14:55.298974] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-16T17:14:55.304798] [INFO ] [REMOTE ] AROC: Full fetch complete (53272 records). [2025-09-16T17:14:55.304893] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-09-16T17:14:55.580055] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-09-16T17:14:55.691225] [DEBUG] [VALIDATOR ] AROC: All expected trading days are present. [2025-09-16T17:14:55.691315] [DEBUG] [VALIDATOR ] AROC: Primary data validation passed. [2025-09-16T17:14:55.691912] [INFO ] [MAIN ] AROC: Fetched primary data is valid. [2025-09-16T17:14:55.691957] [DEBUG] [LOCAL ] AROC: Saving primary data. [2025-09-16T17:14:55.693102] [DEBUG] [LOCAL ] AROC: Trimmed 53272 records to 36147 (keeping 150 days of data) [2025-09-16T17:14:55.918552] [DEBUG] [LOCAL ] AROC: Primary data saved (36147 records). [2025-09-16T17:14:55.918724] [INFO ] [MAIN ] AROC: Full history saved. [2025-09-16T17:14:55.920228] [INFO ] [MAIN ] Update Progress: 147/2369 symbols completed. AROC took 24.3s. Estimated remaining: 3h 44m 56s. Rate: 9.9 symbols/min [2025-09-16T17:14:56.093158] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:14:56.093406] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-09-16T17:14:56.093445] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-09-16T17:14:56.093587] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-09-16T17:14:56.093660] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-16T17:14:56.093709] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-16T17:14:56.093770] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-09-16T17:14:56.379735] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-09-16T17:14:56.461835] [INFO ] [REMOTE ] ARX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:14:56.464585] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-16T17:14:56.472198] [INFO ] [REMOTE ] ARMK: Full fetch complete (54683 records). [2025-09-16T17:14:56.472358] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-09-16T17:14:56.855522] [DEBUG] [VALIDATOR ] ARMK: All expected trading days are present. [2025-09-16T17:14:56.855623] [DEBUG] [VALIDATOR ] ARMK: Primary data validation passed. [2025-09-16T17:14:56.856233] [INFO ] [MAIN ] ARMK: Fetched primary data is valid. [2025-09-16T17:14:56.856278] [DEBUG] [LOCAL ] ARMK: Saving primary data. [2025-09-16T17:14:56.857498] [DEBUG] [LOCAL ] ARMK: Trimmed 54683 records to 37405 (keeping 150 days of data) [2025-09-16T17:14:57.099219] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-16T17:14:57.128245] [DEBUG] [LOCAL ] ARMK: Primary data saved (37405 records). [2025-09-16T17:14:57.128439] [INFO ] [MAIN ] ARMK: Full history saved. [2025-09-16T17:14:57.128548] [INFO ] [MAIN ] Update Progress: 148/2369 symbols completed. ARMK took 27.4s. Estimated remaining: 3h 43m 37s. Rate: 9.9 symbols/min [2025-09-16T17:14:57.176672] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-09-16T17:14:57.302865] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:14:57.340555] [DEBUG] [LOCAL ] AS: Loaded 39205 existing records from primary storage. [2025-09-16T17:14:57.340737] [INFO ] [MAIN ] AS: Loaded 39205 existing records. [2025-09-16T17:14:57.514864] [WARN ] [MAIN ] AS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:14:57.515149] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-09-16T17:14:57.515202] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-09-16T17:14:57.516806] [DEBUG] [LOCAL ] AS: Deleted primary data file. [2025-09-16T17:14:57.516863] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-09-16T17:14:57.874971] [INFO ] [REMOTE ] AS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:14:57.974856] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-09-16T17:14:58.527183] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-16T17:14:58.566883] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-16T17:14:58.774898] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-09-16T17:14:59.337715] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-16T17:14:59.574897] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-02. [2025-09-16T17:14:59.814611] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:14:59.814900] [WARN ] [REMOTE ] ARX: No data returned for month 2025-02 [2025-09-16T17:15:00.374934] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-09-16T17:15:00.588850] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-16T17:15:01.174913] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-09-16T17:15:01.980166] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-09-16T17:15:01.996028] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-16T17:15:02.774864] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-09-16T17:15:03.352322] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-16T17:15:03.574892] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-03. [2025-09-16T17:15:03.785529] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:15:03.785912] [WARN ] [REMOTE ] ARX: No data returned for month 2025-03 [2025-09-16T17:15:04.298338] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-16T17:15:04.374900] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-04. [2025-09-16T17:15:04.491273] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-09-16T17:15:04.629279] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:15:04.629583] [WARN ] [REMOTE ] ARX: No data returned for month 2025-04 [2025-09-16T17:15:05.174907] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-09-16T17:15:05.974896] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-09-16T17:15:06.774908] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-05. [2025-09-16T17:15:07.012790] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:15:07.013108] [WARN ] [REMOTE ] ARX: No data returned for month 2025-05 [2025-09-16T17:15:07.150735] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-16T17:15:07.316215] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-16T17:15:07.574918] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-09-16T17:15:08.374935] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-09-16T17:15:09.174909] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-09-16T17:15:09.382884] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-16T17:15:09.476367] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-16T17:15:09.974953] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-09-16T17:15:10.752780] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-16T17:15:10.774848] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-09-16T17:15:11.517169] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-16T17:15:11.523326] [INFO ] [REMOTE ] ARR: Full fetch complete (56647 records). [2025-09-16T17:15:11.523422] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-09-16T17:15:11.583073] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-06. [2025-09-16T17:15:11.915524] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:15:11.915710] [DEBUG] [VALIDATOR ] ARR: All expected trading days are present. [2025-09-16T17:15:11.915827] [DEBUG] [VALIDATOR ] ARR: Primary data validation passed. [2025-09-16T17:15:11.916590] [INFO ] [MAIN ] ARR: Fetched primary data is valid. [2025-09-16T17:15:11.916681] [WARN ] [REMOTE ] ARX: No data returned for month 2025-06 [2025-09-16T17:15:11.916823] [DEBUG] [LOCAL ] ARR: Saving primary data. [2025-09-16T17:15:11.918357] [DEBUG] [LOCAL ] ARR: Trimmed 56647 records to 38691 (keeping 150 days of data) [2025-09-16T17:15:12.158444] [DEBUG] [LOCAL ] ARR: Primary data saved (38691 records). [2025-09-16T17:15:12.158591] [INFO ] [MAIN ] ARR: Full history saved. [2025-09-16T17:15:12.158698] [INFO ] [MAIN ] Update Progress: 149/2369 symbols completed. ARR took 26.5s. Estimated remaining: 3h 45m 45s. Rate: 9.8 symbols/min [2025-09-16T17:15:12.350118] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:15:12.362443] [DEBUG] [LOCAL ] ASA: Loaded 10287 existing records from primary storage. [2025-09-16T17:15:12.362578] [INFO ] [MAIN ] ASA: Loaded 10287 existing records. [2025-09-16T17:15:12.383596] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-09-16T17:15:12.568700] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-16T17:15:12.598887] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:15:12.599553] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-09-16T17:15:12.599621] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-09-16T17:15:12.600571] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-09-16T17:15:12.600631] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-09-16T17:15:12.965870] [INFO ] [REMOTE ] ASA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:15:13.174936] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-09-16T17:15:13.614955] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-16T17:15:13.974960] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-09-16T17:15:14.774936] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-09-16T17:15:15.011276] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-16T17:15:15.281083] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-16T17:15:15.286521] [INFO ] [REMOTE ] ARW: Full fetch complete (36010 records). [2025-09-16T17:15:15.286628] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-09-16T17:15:15.575736] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-09-16T17:15:15.660674] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-09-16T17:15:15.660760] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-09-16T17:15:15.661188] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-09-16T17:15:15.661230] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-09-16T17:15:15.662255] [DEBUG] [LOCAL ] ARW: Trimmed 36010 records to 23944 (keeping 150 days of data) [2025-09-16T17:15:15.758877] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-16T17:15:15.818863] [DEBUG] [LOCAL ] ARW: Primary data saved (23944 records). [2025-09-16T17:15:15.818998] [INFO ] [MAIN ] ARW: Full history saved. [2025-09-16T17:15:15.819096] [INFO ] [MAIN ] Update Progress: 150/2369 symbols completed. ARW took 26.1s. Estimated remaining: 3h 45m 2s. Rate: 9.9 symbols/min [2025-09-16T17:15:15.992542] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:15:16.029488] [DEBUG] [LOCAL ] ASAN: Loaded 38828 existing records from primary storage. [2025-09-16T17:15:16.029675] [INFO ] [MAIN ] ASAN: Loaded 38828 existing records. [2025-09-16T17:15:16.219095] [WARN ] [MAIN ] ASAN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:15:16.219386] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-09-16T17:15:16.219433] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-09-16T17:15:16.220687] [DEBUG] [LOCAL ] ASAN: Deleted primary data file. [2025-09-16T17:15:16.220738] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-09-16T17:15:16.385107] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-09-16T17:15:16.572799] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:15:17.174911] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-09-16T17:15:17.183550] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-16T17:15:17.426964] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-16T17:15:17.974937] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-09-16T17:15:18.774953] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-07. [2025-09-16T17:15:18.965064] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-16T17:15:19.024733] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-16T17:15:19.574936] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-09-16T17:15:19.861763] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-16T17:15:20.374951] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-09-16T17:15:21.011958] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-16T17:15:21.020874] [INFO ] [REMOTE ] AS: Full fetch complete (57290 records). [2025-09-16T17:15:21.021064] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-09-16T17:15:21.021932] [FATAL] [VALIDATOR ] AS: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:15:21.022039] [FATAL] [MAIN ] AS: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:15:21.022097] [WARN ] [MAIN ] AS: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:15:21.022360] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-09-16T17:15:21.022438] [DEBUG] [LOCAL ] AS: No primary data file found to delete. [2025-09-16T17:15:21.022490] [INFO ] [LOCAL ] AS: Starting deletion of derivative data. [2025-09-16T17:15:21.022852] [DEBUG] [LOCAL ] AS: Deleted derivative data file. [2025-09-16T17:15:21.022980] [INFO ] [MAIN ] Update Progress: 151/2369 symbols completed. AS took 23.9s. Estimated remaining: 3h 44m 43s. Rate: 9.9 symbols/min [2025-09-16T17:15:21.175587] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-09-16T17:15:21.208210] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:15:21.217338] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-16T17:15:21.253477] [DEBUG] [LOCAL ] ASB: Loaded 36181 existing records from primary storage. [2025-09-16T17:15:21.253623] [INFO ] [MAIN ] ASB: Loaded 36181 existing records. [2025-09-16T17:15:21.439292] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:15:21.439612] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-09-16T17:15:21.439679] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-09-16T17:15:21.441021] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-09-16T17:15:21.441077] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-09-16T17:15:21.803666] [INFO ] [REMOTE ] ASB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:15:21.974893] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-09-16T17:15:22.770445] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-16T17:15:22.774845] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-09-16T17:15:23.079445] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-16T17:15:23.410216] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-16T17:15:23.574955] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-08. [2025-09-16T17:15:24.374966] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-09-16T17:15:24.959795] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-16T17:15:24.999771] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-16T17:15:25.174911] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-09-16T17:15:25.974937] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-09-16T17:15:26.688151] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-16T17:15:26.774951] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-09-16T17:15:27.451571] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-16T17:15:27.574866] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-09-16T17:15:27.712993] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-16T17:15:27.716868] [INFO ] [REMOTE ] ASA: Full fetch complete (14351 records). [2025-09-16T17:15:27.717148] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-09-16T17:15:28.085005] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-09-16T17:15:28.085088] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-09-16T17:15:28.085438] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-09-16T17:15:28.085482] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-09-16T17:15:28.086324] [DEBUG] [LOCAL ] ASA: Trimmed 14351 records to 10444 (keeping 150 days of data) [2025-09-16T17:15:28.147953] [DEBUG] [LOCAL ] ASA: Primary data saved (10444 records). [2025-09-16T17:15:28.148097] [INFO ] [MAIN ] ASA: Full history saved. [2025-09-16T17:15:28.148186] [INFO ] [MAIN ] Update Progress: 152/2369 symbols completed. ASA took 16.0s. Estimated remaining: 3h 44m 53s. Rate: 9.9 symbols/min [2025-09-16T17:15:28.315437] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:15:28.319533] [DEBUG] [LOCAL ] ASBA: Loaded 2512 existing records from primary storage. [2025-09-16T17:15:28.319609] [INFO ] [MAIN ] ASBA: Loaded 2512 existing records. [2025-09-16T17:15:28.381565] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-09-16T17:15:28.495281] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:15:28.495497] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-09-16T17:15:28.495544] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-09-16T17:15:28.495769] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-09-16T17:15:28.495817] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-09-16T17:15:28.849081] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:15:29.186712] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-09-16T17:15:29.193575] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-16T17:15:29.888057] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-16T17:15:29.891258] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-16T17:15:29.974928] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-09-16T17:15:30.774912] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-09. [2025-09-16T17:15:31.415537] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-16T17:15:31.574939] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-09-16T17:15:32.363395] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-16T17:15:32.368445] [INFO ] [REMOTE ] ARX: Full fetch complete (12016 records). [2025-09-16T17:15:32.368515] [DEBUG] [VALIDATOR ] ARX: Validating primary data. [2025-09-16T17:15:32.379955] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-09-16T17:15:32.583815] [WARN ] [VALIDATOR ] ARX: Validation failed - insufficient historical data. Have 38 unique days, need 150 days [2025-09-16T17:15:32.584093] [FATAL] [MAIN ] ARX: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:15:32.584152] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:15:32.584213] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-16T17:15:32.584275] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-16T17:15:32.584311] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-09-16T17:15:32.584356] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-09-16T17:15:32.584413] [INFO ] [MAIN ] Update Progress: 153/2369 symbols completed. ARX took 36.7s. Estimated remaining: 3h 44m 23s. Rate: 9.9 symbols/min [2025-09-16T17:15:32.757293] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:15:32.787794] [DEBUG] [LOCAL ] ASC: Loaded 27506 existing records from primary storage. [2025-09-16T17:15:32.787953] [INFO ] [MAIN ] ASC: Loaded 27506 existing records. [2025-09-16T17:15:32.963926] [WARN ] [MAIN ] ASC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:15:32.966935] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-09-16T17:15:32.967414] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-09-16T17:15:32.967566] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-16T17:15:32.969037] [DEBUG] [LOCAL ] ASC: Deleted primary data file. [2025-09-16T17:15:32.969099] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-09-16T17:15:33.179959] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-09-16T17:15:33.322182] [INFO ] [REMOTE ] ASC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:15:33.579150] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-16T17:15:33.967058] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-16T17:15:33.974869] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-09-16T17:15:34.515784] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-16T17:15:34.774957] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-09-16T17:15:35.574909] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-09-16T17:15:36.048760] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-16T17:15:36.374911] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-09-16T17:15:37.174944] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-09-16T17:15:37.236859] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-16T17:15:37.879466] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-16T17:15:37.974862] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-09-16T17:15:38.774913] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-09-16T17:15:38.949235] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-16T17:15:39.201867] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-16T17:15:39.388267] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-16T17:15:39.574979] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-09-16T17:15:40.201518] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-16T17:15:40.374973] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-09-16T17:15:40.825747] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-16T17:15:41.174909] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-09-16T17:15:41.974898] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-09-16T17:15:42.490028] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-16T17:15:42.587216] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-16T17:15:42.588177] [INFO ] [REMOTE ] ASBA: Full fetch complete (3723 records). [2025-09-16T17:15:42.588247] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-09-16T17:15:42.780071] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-09-16T17:15:42.944913] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-09-16T17:15:42.944992] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-09-16T17:15:42.945149] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-09-16T17:15:42.945197] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-09-16T17:15:42.945556] [DEBUG] [LOCAL ] ASBA: Trimmed 3723 records to 2522 (keeping 150 days of data) [2025-09-16T17:15:42.961868] [DEBUG] [LOCAL ] ASBA: Primary data saved (2522 records). [2025-09-16T17:15:42.961949] [INFO ] [MAIN ] ASBA: Full history saved. [2025-09-16T17:15:42.962039] [INFO ] [MAIN ] Update Progress: 154/2369 symbols completed. ASBA took 14.8s. Estimated remaining: 3h 45m 18s. Rate: 9.8 symbols/min [2025-09-16T17:15:43.137049] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:15:43.155535] [DEBUG] [LOCAL ] ASG: Loaded 14252 existing records from primary storage. [2025-09-16T17:15:43.155667] [INFO ] [MAIN ] ASG: Loaded 14252 existing records. [2025-09-16T17:15:43.331096] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:15:43.331330] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-09-16T17:15:43.331395] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-09-16T17:15:43.332132] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-09-16T17:15:43.332192] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-09-16T17:15:43.580233] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-09-16T17:15:43.687022] [INFO ] [REMOTE ] ASG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:15:44.374885] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-09-16T17:15:44.877452] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-16T17:15:45.174899] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-09-16T17:15:45.322326] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-16T17:15:45.759208] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-16T17:15:45.765246] [INFO ] [REMOTE ] ASB: Full fetch complete (53981 records). [2025-09-16T17:15:45.765409] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-09-16T17:15:45.980130] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-09-16T17:15:46.147059] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-09-16T17:15:46.147131] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-09-16T17:15:46.147700] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-09-16T17:15:46.147745] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-09-16T17:15:46.148813] [DEBUG] [LOCAL ] ASB: Trimmed 53981 records to 36535 (keeping 150 days of data) [2025-09-16T17:15:46.379301] [DEBUG] [LOCAL ] ASB: Primary data saved (36535 records). [2025-09-16T17:15:46.379480] [INFO ] [MAIN ] ASB: Full history saved. [2025-09-16T17:15:46.379656] [INFO ] [MAIN ] Update Progress: 155/2369 symbols completed. ASB took 25.4s. Estimated remaining: 3h 44m 34s. Rate: 9.9 symbols/min [2025-09-16T17:15:46.549111] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:15:46.549273] [DEBUG] [LOCAL ] ASGI: No existing data file found in primary storage. [2025-09-16T17:15:46.549312] [WARN ] [MAIN ] ASGI: No existing data found, performing full refresh instead. [2025-09-16T17:15:46.549432] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-09-16T17:15:46.549471] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-09-16T17:15:46.549512] [DEBUG] [LOCAL ] ASGI: No primary data file found to delete. [2025-09-16T17:15:46.549558] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-09-16T17:15:46.786321] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-09-16T17:15:46.901770] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:15:47.159707] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-16T17:15:47.168617] [INFO ] [REMOTE ] ASAN: Full fetch complete (56978 records). [2025-09-16T17:15:47.168824] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-09-16T17:15:47.169697] [FATAL] [VALIDATOR ] ASAN: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:15:47.169796] [FATAL] [MAIN ] ASAN: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:15:47.169853] [WARN ] [MAIN ] ASAN: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:15:47.169914] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-09-16T17:15:47.170001] [DEBUG] [LOCAL ] ASAN: No primary data file found to delete. [2025-09-16T17:15:47.170055] [INFO ] [LOCAL ] ASAN: Starting deletion of derivative data. [2025-09-16T17:15:47.170346] [DEBUG] [LOCAL ] ASAN: Deleted derivative data file. [2025-09-16T17:15:47.171197] [INFO ] [MAIN ] Update Progress: 156/2369 symbols completed. ASAN took 31.4s. Estimated remaining: 3h 43m 13s. Rate: 9.9 symbols/min [2025-09-16T17:15:47.346508] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:15:47.361963] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-16T17:15:47.391089] [DEBUG] [LOCAL ] ASGN: Loaded 26147 existing records from primary storage. [2025-09-16T17:15:47.391240] [INFO ] [MAIN ] ASGN: Loaded 26147 existing records. [2025-09-16T17:15:47.568621] [WARN ] [MAIN ] ASGN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:15:47.568935] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-09-16T17:15:47.568998] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-09-16T17:15:47.569936] [DEBUG] [LOCAL ] ASGN: Deleted primary data file. [2025-09-16T17:15:47.569999] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-09-16T17:15:47.581251] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-09-16T17:15:47.947474] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:15:48.386695] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-09-16T17:15:48.403813] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-16T17:15:48.673071] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-16T17:15:49.174974] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-09-16T17:15:49.628940] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-16T17:15:49.974919] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-09-16T17:15:50.238203] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-16T17:15:50.774912] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-09-16T17:15:51.212189] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-16T17:15:51.574897] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-09-16T17:15:52.218245] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-16T17:15:52.374914] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-09-16T17:15:52.718716] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-16T17:15:53.087795] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-16T17:15:53.174882] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-09-16T17:15:53.974922] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-09-16T17:15:54.135256] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-16T17:15:54.774896] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-09-16T17:15:55.039058] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-16T17:15:55.574914] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-09-16T17:15:56.089852] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-16T17:15:56.374906] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-09-16T17:15:56.798001] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-16T17:15:57.174905] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-09-16T17:15:57.938821] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-16T17:15:57.974934] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-09-16T17:15:58.750993] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-16T17:15:58.774923] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-09-16T17:15:58.814371] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-16T17:15:59.575883] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-09-16T17:15:59.578082] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-16T17:16:00.374933] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-09-16T17:16:01.174912] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-09-16T17:16:01.193692] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-16T17:16:01.690459] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-16T17:16:01.974926] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-09-16T17:16:02.493017] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-16T17:16:02.774910] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-09-16T17:16:03.574883] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-09-16T17:16:03.682322] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-16T17:16:03.971106] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-16T17:16:04.374870] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-09-16T17:16:04.581076] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-16T17:16:04.583730] [INFO ] [REMOTE ] ASG: Full fetch complete (23124 records). [2025-09-16T17:16:04.583803] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-09-16T17:16:04.953210] [DEBUG] [VALIDATOR ] ASG: All expected trading days are present. [2025-09-16T17:16:04.953285] [DEBUG] [VALIDATOR ] ASG: Primary data validation passed. [2025-09-16T17:16:04.953609] [INFO ] [MAIN ] ASG: Fetched primary data is valid. [2025-09-16T17:16:04.953687] [DEBUG] [LOCAL ] ASG: Saving primary data. [2025-09-16T17:16:04.954461] [DEBUG] [LOCAL ] ASG: Trimmed 23124 records to 14378 (keeping 150 days of data) [2025-09-16T17:16:05.040105] [DEBUG] [LOCAL ] ASG: Primary data saved (14378 records). [2025-09-16T17:16:05.040230] [INFO ] [MAIN ] ASG: Full history saved. [2025-09-16T17:16:05.040312] [INFO ] [MAIN ] Update Progress: 157/2369 symbols completed. ASG took 22.1s. Estimated remaining: 3h 45m 53s. Rate: 9.8 symbols/min [2025-09-16T17:16:05.080166] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-16T17:16:05.174890] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-09-16T17:16:05.974855] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-09-16T17:16:06.232302] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-16T17:16:06.774896] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-09-16T17:16:07.115612] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-16T17:16:07.574960] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-09-16T17:16:07.798420] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-16T17:16:07.802736] [INFO ] [REMOTE ] ASC: Full fetch complete (42056 records). [2025-09-16T17:16:07.802821] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-09-16T17:16:08.174399] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-09-16T17:16:08.174480] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-09-16T17:16:08.175184] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-09-16T17:16:08.175233] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-09-16T17:16:08.176226] [DEBUG] [LOCAL ] ASC: Trimmed 42056 records to 27759 (keeping 150 days of data) [2025-09-16T17:16:08.360885] [DEBUG] [LOCAL ] ASC: Primary data saved (27759 records). [2025-09-16T17:16:08.361021] [INFO ] [MAIN ] ASC: Full history saved. [2025-09-16T17:16:08.361120] [INFO ] [MAIN ] Update Progress: 158/2369 symbols completed. ASC took 35.8s. Estimated remaining: 3h 45m 8s. Rate: 9.8 symbols/min [2025-09-16T17:16:08.374903] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-09-16T17:16:08.576608] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-16T17:16:08.579976] [INFO ] [REMOTE ] ASGI: Full fetch complete (23999 records). [2025-09-16T17:16:08.580048] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-09-16T17:16:08.940065] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-09-16T17:16:08.940141] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-09-16T17:16:08.940468] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-09-16T17:16:08.940509] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-09-16T17:16:08.941117] [DEBUG] [LOCAL ] ASGI: Trimmed 23999 records to 16802 (keeping 150 days of data) [2025-09-16T17:16:09.046615] [DEBUG] [LOCAL ] ASGI: Primary data saved (16802 records). [2025-09-16T17:16:09.046766] [INFO ] [MAIN ] ASGI: Full history saved. [2025-09-16T17:16:09.046842] [INFO ] [MAIN ] Update Progress: 159/2369 symbols completed. ASGI took 22.7s. Estimated remaining: 3h 43m 46s. Rate: 9.9 symbols/min [2025-09-16T17:16:09.499379] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-16T17:16:09.507624] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-09-16T17:16:10.846989] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-16T17:16:10.851092] [INFO ] [REMOTE ] ASGN: Full fetch complete (39422 records). [2025-09-16T17:16:10.851203] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-09-16T17:16:10.851848] [FATAL] [VALIDATOR ] ASGN: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:16:10.851931] [FATAL] [MAIN ] ASGN: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:16:10.851968] [WARN ] [MAIN ] ASGN: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:16:10.852017] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-09-16T17:16:10.852082] [DEBUG] [LOCAL ] ASGN: No primary data file found to delete. [2025-09-16T17:16:10.852134] [INFO ] [LOCAL ] ASGN: Starting deletion of derivative data. [2025-09-16T17:16:10.852436] [DEBUG] [LOCAL ] ASGN: Deleted derivative data file. [2025-09-16T17:16:10.852568] [INFO ] [MAIN ] Update Progress: 160/2369 symbols completed. ASGN took 23.7s. Estimated remaining: 3h 42m 41s. Rate: 9.9 symbols/min [2025-09-16T17:16:11.507514] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:16:11.503321] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:16:11.546357] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:16:11.548283] [DEBUG] [LOCAL ] ASPN: No existing data file found in primary storage. [2025-09-16T17:16:11.548228] [DEBUG] [LOCAL ] ASH: No existing data file found in primary storage. [2025-09-16T17:16:11.547880] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:16:11.548441] [WARN ] [MAIN ] ASH: No existing data found, performing full refresh instead. [2025-09-16T17:16:11.548520] [WARN ] [MAIN ] ASPN: No existing data found, performing full refresh instead. [2025-09-16T17:16:11.548852] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-09-16T17:16:11.548766] [DEBUG] [LOCAL ] ASR: No existing data file found in primary storage. [2025-09-16T17:16:11.548974] [WARN ] [MAIN ] ASR: No existing data found, performing full refresh instead. [2025-09-16T17:16:11.549333] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-09-16T17:16:11.549469] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-09-16T17:16:11.549615] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-09-16T17:16:11.549708] [DEBUG] [LOCAL ] ASR: No primary data file found to delete. [2025-09-16T17:16:11.549765] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-09-16T17:16:11.549526] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-09-16T17:16:11.563101] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-09-16T17:16:11.599375] [DEBUG] [LOCAL ] ASH: No primary data file found to delete. [2025-09-16T17:16:11.608634] [DEBUG] [LOCAL ] ASPN: No primary data file found to delete. [2025-09-16T17:16:11.633627] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-09-16T17:16:11.633541] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-09-16T17:16:11.852867] [DEBUG] [LOCAL ] ASIX: Loaded 16877 existing records from primary storage. [2025-09-16T17:16:11.887295] [INFO ] [MAIN ] ASIX: Loaded 16877 existing records. [2025-09-16T17:16:12.697211] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:16:12.711251] [WARN ] [MAIN ] ASIX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:16:12.727891] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-09-16T17:16:12.765113] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-09-16T17:16:12.748093] [INFO ] [REMOTE ] ASR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:16:12.765503] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-09-16T17:16:12.765584] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-09-16T17:16:12.806851] [DEBUG] [LOCAL ] ASIX: Deleted primary data file. [2025-09-16T17:16:12.826487] [INFO ] [REMOTE ] ASH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:16:12.823315] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-09-16T17:16:12.857513] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-09-16T17:16:13.192310] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:16:13.192672] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-09-16T17:16:13.526924] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-16T17:16:13.528883] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-09-16T17:16:14.140222] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-16T17:16:14.145581] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-09-16T17:16:14.223957] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-16T17:16:14.374203] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-16T17:16:14.567362] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-16T17:16:14.774901] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-09-16T17:16:14.805758] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-16T17:16:15.574912] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-09-16T17:16:15.700437] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-16T17:16:16.374948] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-09-16T17:16:16.678550] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-16T17:16:17.174957] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-09-16T17:16:17.245155] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-16T17:16:17.974955] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-09-16T17:16:18.368075] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-16T17:16:18.774944] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-09-16T17:16:18.835366] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-16T17:16:19.574926] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-09-16T17:16:19.907136] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-16T17:16:20.374927] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-09-16T17:16:21.059446] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-16T17:16:21.174945] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-09-16T17:16:21.295613] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-16T17:16:21.974924] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-09-16T17:16:22.774901] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-09-16T17:16:22.920013] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-16T17:16:22.945720] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-16T17:16:23.533389] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-16T17:16:23.574885] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-09-16T17:16:24.374940] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-09-16T17:16:24.487703] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-16T17:16:25.174914] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-09-16T17:16:25.548721] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-16T17:16:25.974943] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-09-16T17:16:26.459211] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-16T17:16:26.774912] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-09-16T17:16:27.574925] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-09-16T17:16:27.770310] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-16T17:16:27.773312] [INFO ] [REMOTE ] ASIX: Full fetch complete (23888 records). [2025-09-16T17:16:27.773395] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-09-16T17:16:28.189672] [DEBUG] [VALIDATOR ] ASIX: All expected trading days are present. [2025-09-16T17:16:28.189765] [DEBUG] [VALIDATOR ] ASIX: Primary data validation passed. [2025-09-16T17:16:28.190177] [INFO ] [MAIN ] ASIX: Fetched primary data is valid. [2025-09-16T17:16:28.190249] [DEBUG] [LOCAL ] ASIX: Saving primary data. [2025-09-16T17:16:28.191156] [DEBUG] [LOCAL ] ASIX: Trimmed 23888 records to 17000 (keeping 150 days of data) [2025-09-16T17:16:28.219866] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-16T17:16:28.334813] [DEBUG] [LOCAL ] ASIX: Primary data saved (17000 records). [2025-09-16T17:16:28.334959] [INFO ] [MAIN ] ASIX: Full history saved. [2025-09-16T17:16:28.335045] [INFO ] [MAIN ] Update Progress: 161/2369 symbols completed. ASIX took 17.5s. Estimated remaining: 3h 45m 12s. Rate: 9.8 symbols/min [2025-09-16T17:16:28.380036] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-09-16T17:16:28.508120] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:16:28.508287] [DEBUG] [LOCAL ] ASX: No existing data file found in primary storage. [2025-09-16T17:16:28.508325] [WARN ] [MAIN ] ASX: No existing data found, performing full refresh instead. [2025-09-16T17:16:28.508445] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-09-16T17:16:28.508484] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-09-16T17:16:28.508528] [DEBUG] [LOCAL ] ASX: No primary data file found to delete. [2025-09-16T17:16:28.508561] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-09-16T17:16:28.868962] [INFO ] [REMOTE ] ASX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:16:28.916374] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-16T17:16:29.010947] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-16T17:16:29.174975] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-09-16T17:16:29.974942] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-09-16T17:16:30.774909] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-09-16T17:16:30.974433] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-16T17:16:31.512732] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-16T17:16:31.514630] [INFO ] [REMOTE ] ASR: Full fetch complete (9692 records). [2025-09-16T17:16:31.514742] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-09-16T17:16:31.580017] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-09-16T17:16:31.898224] [DEBUG] [VALIDATOR ] ASR: All expected trading days are present. [2025-09-16T17:16:31.898374] [DEBUG] [VALIDATOR ] ASR: Primary data validation passed. [2025-09-16T17:16:31.898717] [INFO ] [MAIN ] ASR: Fetched primary data is valid. [2025-09-16T17:16:31.898781] [DEBUG] [LOCAL ] ASR: Saving primary data. [2025-09-16T17:16:31.899425] [DEBUG] [LOCAL ] ASR: Trimmed 9692 records to 7108 (keeping 150 days of data) [2025-09-16T17:16:31.966265] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-16T17:16:31.983926] [DEBUG] [LOCAL ] ASR: Primary data saved (7108 records). [2025-09-16T17:16:31.984069] [INFO ] [MAIN ] ASR: Full history saved. [2025-09-16T17:16:31.984146] [INFO ] [MAIN ] Update Progress: 162/2369 symbols completed. ASR took 21.1s. Estimated remaining: 3h 44m 32s. Rate: 9.8 symbols/min [2025-09-16T17:16:32.160169] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:16:32.196262] [DEBUG] [LOCAL ] ATEN: Loaded 28427 existing records from primary storage. [2025-09-16T17:16:32.196440] [INFO ] [MAIN ] ATEN: Loaded 28427 existing records. [2025-09-16T17:16:32.384183] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-09-16T17:16:32.392781] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:16:32.394431] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-09-16T17:16:32.394516] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-09-16T17:16:32.396300] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-09-16T17:16:32.396405] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-09-16T17:16:32.943331] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:16:33.174986] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-09-16T17:16:33.260581] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-16T17:16:33.952289] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-16T17:16:33.974887] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-09-16T17:16:34.597893] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-16T17:16:34.774938] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-09-16T17:16:34.953962] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-16T17:16:34.958059] [INFO ] [REMOTE ] ASH: Full fetch complete (41243 records). [2025-09-16T17:16:34.958167] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-09-16T17:16:34.958840] [FATAL] [VALIDATOR ] ASH: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:16:34.958920] [FATAL] [MAIN ] ASH: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:16:34.958958] [WARN ] [MAIN ] ASH: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:16:34.958997] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-09-16T17:16:34.959057] [DEBUG] [LOCAL ] ASH: No primary data file found to delete. [2025-09-16T17:16:34.959096] [INFO ] [LOCAL ] ASH: Starting deletion of derivative data. [2025-09-16T17:16:34.959159] [DEBUG] [LOCAL ] ASH: No derivative data file found to delete. [2025-09-16T17:16:34.959222] [INFO ] [MAIN ] Update Progress: 163/2369 symbols completed. ASH took 24.1s. Estimated remaining: 3h 43m 44s. Rate: 9.9 symbols/min [2025-09-16T17:16:35.134833] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:16:35.160749] [DEBUG] [LOCAL ] ATGE: Loaded 22888 existing records from primary storage. [2025-09-16T17:16:35.160897] [INFO ] [MAIN ] ATGE: Loaded 22888 existing records. [2025-09-16T17:16:35.343786] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:16:35.344067] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-09-16T17:16:35.344132] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-09-16T17:16:35.345395] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-09-16T17:16:35.345470] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-09-16T17:16:35.585536] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-09-16T17:16:35.702485] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:16:36.254825] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-16T17:16:36.374942] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-09-16T17:16:37.174951] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-09-16T17:16:37.261729] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-16T17:16:37.628038] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-16T17:16:37.974914] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-09-16T17:16:38.774925] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-09-16T17:16:39.199860] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-16T17:16:39.504048] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-16T17:16:39.574884] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-09-16T17:16:40.161916] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-16T17:16:40.374913] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-09-16T17:16:40.883540] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-16T17:16:41.174909] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-09-16T17:16:41.974947] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-09-16T17:16:42.217543] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-16T17:16:42.734047] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-16T17:16:42.774882] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-09-16T17:16:43.270138] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-16T17:16:43.574903] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-09-16T17:16:44.105494] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-16T17:16:44.374936] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-09-16T17:16:45.174914] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-09-16T17:16:45.289177] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-16T17:16:45.439212] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-16T17:16:45.974924] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-09-16T17:16:46.264412] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-16T17:16:46.774897] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-09-16T17:16:47.574857] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-09-16T17:16:47.679603] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-16T17:16:47.686600] [INFO ] [REMOTE ] ASPN: Full fetch complete (54248 records). [2025-09-16T17:16:47.686887] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-09-16T17:16:48.077670] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-09-16T17:16:48.077752] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-09-16T17:16:48.078354] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-09-16T17:16:48.078398] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-09-16T17:16:48.079486] [DEBUG] [LOCAL ] ASPN: Trimmed 54248 records to 36948 (keeping 150 days of data) [2025-09-16T17:16:48.289699] [DEBUG] [LOCAL ] ASPN: Primary data saved (36948 records). [2025-09-16T17:16:48.289840] [INFO ] [MAIN ] ASPN: Full history saved. [2025-09-16T17:16:48.289916] [INFO ] [MAIN ] Update Progress: 164/2369 symbols completed. ASPN took 37.4s. Estimated remaining: 3h 45m 15s. Rate: 9.8 symbols/min [2025-09-16T17:16:48.379952] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-09-16T17:16:48.482213] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:16:48.518442] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-16T17:16:48.535763] [DEBUG] [LOCAL ] ATHM: Loaded 22614 existing records from primary storage. [2025-09-16T17:16:48.536256] [INFO ] [MAIN ] ATHM: Loaded 22614 existing records. [2025-09-16T17:16:48.711766] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:16:48.712016] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-09-16T17:16:48.712060] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-09-16T17:16:48.713066] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-09-16T17:16:48.713118] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-09-16T17:16:49.071326] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:16:49.101500] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-16T17:16:49.174875] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-09-16T17:16:49.974886] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-09-16T17:16:50.343047] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-16T17:16:50.471685] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-16T17:16:50.774924] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-09-16T17:16:51.515196] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-16T17:16:51.574923] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-09-16T17:16:51.888057] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-16T17:16:52.374910] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-09-16T17:16:53.006736] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-16T17:16:53.174955] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-09-16T17:16:53.519816] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-16T17:16:53.974949] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-09-16T17:16:54.774946] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-09-16T17:16:54.931899] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-16T17:16:54.938114] [INFO ] [REMOTE ] ASX: Full fetch complete (57562 records). [2025-09-16T17:16:54.938227] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-09-16T17:16:55.152755] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-16T17:16:55.248152] [INFO ] [REMOTE ] ATGE: Full fetch complete (34997 records). [2025-09-16T17:16:55.258674] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-09-16T17:16:55.286621] [FATAL] [VALIDATOR ] ATGE: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:16:55.317904] [FATAL] [MAIN ] ATGE: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:16:55.334852] [WARN ] [MAIN ] ATGE: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:16:55.351769] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-09-16T17:16:55.352008] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-09-16T17:16:55.352204] [DEBUG] [LOCAL ] ATGE: No primary data file found to delete. [2025-09-16T17:16:55.352133] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-09-16T17:16:55.352994] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-09-16T17:16:55.352328] [INFO ] [LOCAL ] ATGE: Starting deletion of derivative data. [2025-09-16T17:16:55.353097] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-09-16T17:16:55.353418] [DEBUG] [LOCAL ] ATGE: Deleted derivative data file. [2025-09-16T17:16:55.353575] [INFO ] [MAIN ] Update Progress: 165/2369 symbols completed. ATGE took 20.4s. Estimated remaining: 3h 45m 21s. Rate: 9.8 symbols/min [2025-09-16T17:16:55.448374] [DEBUG] [LOCAL ] ASX: Trimmed 57562 records to 39389 (keeping 150 days of data) [2025-09-16T17:16:55.589704] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-09-16T17:16:55.620774] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:16:55.622232] [DEBUG] [LOCAL ] ATHS: No existing data file found in primary storage. [2025-09-16T17:16:55.622861] [WARN ] [MAIN ] ATHS: No existing data found, performing full refresh instead. [2025-09-16T17:16:55.624147] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-09-16T17:16:55.625348] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-09-16T17:16:55.626069] [DEBUG] [LOCAL ] ATHS: No primary data file found to delete. [2025-09-16T17:16:55.626841] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-09-16T17:16:56.005008] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:16:56.135620] [DEBUG] [LOCAL ] ASX: Primary data saved (39389 records). [2025-09-16T17:16:56.135835] [INFO ] [MAIN ] ASX: Full history saved. [2025-09-16T17:16:56.135945] [INFO ] [MAIN ] Update Progress: 166/2369 symbols completed. ASX took 27.8s. Estimated remaining: 3h 44m 4s. Rate: 9.8 symbols/min [2025-09-16T17:16:56.306961] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:16:56.329265] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-16T17:16:56.369810] [DEBUG] [LOCAL ] ATI: Loaded 38269 existing records from primary storage. [2025-09-16T17:16:56.369946] [INFO ] [MAIN ] ATI: Loaded 38269 existing records. [2025-09-16T17:16:56.381093] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-09-16T17:16:56.554327] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:16:56.554692] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-09-16T17:16:56.554739] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-09-16T17:16:56.555936] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-09-16T17:16:56.555985] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-09-16T17:16:56.907089] [INFO ] [REMOTE ] ATI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:16:57.174902] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-09-16T17:16:57.263753] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-16T17:16:57.865189] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-16T17:16:57.869730] [INFO ] [REMOTE ] ATEN: Full fetch complete (43673 records). [2025-09-16T17:16:57.869814] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-09-16T17:16:57.981559] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-09-16T17:16:58.262618] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-09-16T17:16:58.262712] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-09-16T17:16:58.263184] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-09-16T17:16:58.263225] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-09-16T17:16:58.264191] [DEBUG] [LOCAL ] ATEN: Trimmed 43673 records to 28678 (keeping 150 days of data) [2025-09-16T17:16:58.451097] [DEBUG] [LOCAL ] ATEN: Primary data saved (28678 records). [2025-09-16T17:16:58.451233] [INFO ] [MAIN ] ATEN: Full history saved. [2025-09-16T17:16:58.453794] [INFO ] [MAIN ] Update Progress: 167/2369 symbols completed. ATEN took 26.5s. Estimated remaining: 3h 43m 8s. Rate: 9.9 symbols/min [2025-09-16T17:16:58.628183] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:16:58.654874] [DEBUG] [LOCAL ] ATKR: Loaded 25276 existing records from primary storage. [2025-09-16T17:16:58.655011] [INFO ] [MAIN ] ATKR: Loaded 25276 existing records. [2025-09-16T17:16:58.775419] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-09-16T17:16:58.841090] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:16:58.841800] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-09-16T17:16:58.841880] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-09-16T17:16:58.843206] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-09-16T17:16:58.843263] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-09-16T17:16:59.142939] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-16T17:16:59.250556] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:16:59.378447] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-16T17:16:59.564938] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-16T17:16:59.574866] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-09-16T17:17:00.092779] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-16T17:17:00.374913] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-09-16T17:17:01.175100] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-09-16T17:17:01.974929] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-09-16T17:17:02.368000] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-16T17:17:02.768461] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-09-16T17:17:02.778782] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-09-16T17:17:03.546185] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-16T17:17:03.574931] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-09-16T17:17:03.663302] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-16T17:17:04.276242] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-16T17:17:04.374868] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-09-16T17:17:05.174890] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-09-16T17:17:05.602025] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-16T17:17:05.974916] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-09-16T17:17:06.228980] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-16T17:17:06.365053] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-16T17:17:06.774964] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-09-16T17:17:07.574949] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-09-16T17:17:08.366525] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-16T17:17:08.376908] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-09-16T17:17:08.893851] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-16T17:17:09.066323] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-16T17:17:09.174919] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-09-16T17:17:09.974917] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-09-16T17:17:10.774873] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-09-16T17:17:10.826095] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-16T17:17:11.161458] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-16T17:17:11.574904] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-09-16T17:17:11.783205] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-16T17:17:12.289917] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-16T17:17:12.291204] [INFO ] [REMOTE ] ATHS: Full fetch complete (7693 records). [2025-09-16T17:17:12.291275] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-09-16T17:17:12.380052] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-09-16T17:17:12.672216] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-09-16T17:17:12.672295] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-09-16T17:17:12.672543] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-09-16T17:17:12.672603] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-09-16T17:17:12.673142] [DEBUG] [LOCAL ] ATHS: Trimmed 7693 records to 4952 (keeping 150 days of data) [2025-09-16T17:17:12.704905] [DEBUG] [LOCAL ] ATHS: Primary data saved (4952 records). [2025-09-16T17:17:12.704983] [INFO ] [MAIN ] ATHS: Full history saved. [2025-09-16T17:17:12.705052] [INFO ] [MAIN ] Update Progress: 168/2369 symbols completed. ATHS took 17.4s. Estimated remaining: 3h 44m 49s. Rate: 9.8 symbols/min [2025-09-16T17:17:12.885871] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:17:12.886102] [DEBUG] [LOCAL ] ATMU: No existing data file found in primary storage. [2025-09-16T17:17:12.886143] [WARN ] [MAIN ] ATMU: No existing data found, performing full refresh instead. [2025-09-16T17:17:12.886282] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-09-16T17:17:12.886324] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-09-16T17:17:12.886370] [DEBUG] [LOCAL ] ATMU: No primary data file found to delete. [2025-09-16T17:17:12.886414] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-09-16T17:17:13.179976] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-09-16T17:17:13.240813] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:17:13.889800] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-16T17:17:13.974851] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-09-16T17:17:14.597012] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-16T17:17:14.774931] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-09-16T17:17:15.517173] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-16T17:17:15.574888] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-09-16T17:17:16.241734] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-16T17:17:16.374948] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-09-16T17:17:17.174929] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-09-16T17:17:17.329199] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-16T17:17:17.752950] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-16T17:17:17.974951] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-09-16T17:17:18.529965] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-16T17:17:18.774921] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-09-16T17:17:19.498457] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-16T17:17:19.574931] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-09-16T17:17:20.042814] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-16T17:17:20.374891] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-09-16T17:17:20.600712] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-16T17:17:20.603846] [INFO ] [REMOTE ] ATHM: Full fetch complete (36762 records). [2025-09-16T17:17:20.603968] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-09-16T17:17:20.604698] [FATAL] [VALIDATOR ] ATHM: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:17:20.604817] [FATAL] [MAIN ] ATHM: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:17:20.604869] [WARN ] [MAIN ] ATHM: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:17:20.604935] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-09-16T17:17:20.605012] [DEBUG] [LOCAL ] ATHM: No primary data file found to delete. [2025-09-16T17:17:20.605051] [INFO ] [LOCAL ] ATHM: Starting deletion of derivative data. [2025-09-16T17:17:20.605593] [DEBUG] [LOCAL ] ATHM: Deleted derivative data file. [2025-09-16T17:17:20.605706] [INFO ] [MAIN ] Update Progress: 169/2369 symbols completed. ATHM took 32.3s. Estimated remaining: 3h 45m 6s. Rate: 9.8 symbols/min [2025-09-16T17:17:20.784913] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:17:20.822575] [DEBUG] [LOCAL ] ATO: Loaded 30687 existing records from primary storage. [2025-09-16T17:17:20.822746] [INFO ] [MAIN ] ATO: Loaded 30687 existing records. [2025-09-16T17:17:21.007782] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:17:21.008077] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-09-16T17:17:21.008141] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-09-16T17:17:21.009785] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-09-16T17:17:21.009849] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-09-16T17:17:21.187173] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-09-16T17:17:21.370296] [INFO ] [REMOTE ] ATO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:17:21.974924] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-09-16T17:17:22.130020] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-16T17:17:22.136994] [INFO ] [REMOTE ] ATI: Full fetch complete (56309 records). [2025-09-16T17:17:22.137116] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-09-16T17:17:22.558781] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-09-16T17:17:22.559431] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-09-16T17:17:22.562525] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-16T17:17:22.560740] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-09-16T17:17:22.567425] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-09-16T17:17:22.568027] [INFO ] [REMOTE ] ATKR: Full fetch complete (39536 records). [2025-09-16T17:17:22.568144] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-09-16T17:17:22.569413] [FATAL] [VALIDATOR ] ATKR: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:17:22.569585] [FATAL] [MAIN ] ATKR: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:17:22.569733] [WARN ] [MAIN ] ATKR: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:17:22.569957] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-09-16T17:17:22.570038] [DEBUG] [LOCAL ] ATKR: No primary data file found to delete. [2025-09-16T17:17:22.570081] [INFO ] [LOCAL ] ATKR: Starting deletion of derivative data. [2025-09-16T17:17:22.570264] [DEBUG] [LOCAL ] ATI: Trimmed 56309 records to 38648 (keeping 150 days of data) [2025-09-16T17:17:22.570765] [DEBUG] [LOCAL ] ATKR: Deleted derivative data file. [2025-09-16T17:17:22.570884] [INFO ] [MAIN ] Update Progress: 170/2369 symbols completed. ATKR took 24.1s. Estimated remaining: 3h 44m 6s. Rate: 9.8 symbols/min [2025-09-16T17:17:22.778706] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-09-16T17:17:22.857120] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:17:22.897813] [DEBUG] [LOCAL ] ATR: Loaded 22944 existing records from primary storage. [2025-09-16T17:17:22.898044] [INFO ] [MAIN ] ATR: Loaded 22944 existing records. [2025-09-16T17:17:23.162059] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:17:23.167151] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-09-16T17:17:23.167758] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-09-16T17:17:23.169553] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-09-16T17:17:23.170111] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-09-16T17:17:23.543363] [INFO ] [REMOTE ] ATR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:17:23.552083] [DEBUG] [LOCAL ] ATI: Primary data saved (38648 records). [2025-09-16T17:17:23.552209] [INFO ] [MAIN ] ATI: Full history saved. [2025-09-16T17:17:23.555623] [INFO ] [MAIN ] Update Progress: 171/2369 symbols completed. ATI took 27.4s. Estimated remaining: 3h 42m 54s. Rate: 9.9 symbols/min [2025-09-16T17:17:23.580043] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-09-16T17:17:23.700290] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-16T17:17:23.764620] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:17:23.781006] [DEBUG] [LOCAL ] ATS: Loaded 12990 existing records from primary storage. [2025-09-16T17:17:23.781173] [INFO ] [MAIN ] ATS: Loaded 12990 existing records. [2025-09-16T17:17:23.960163] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:17:23.960460] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-09-16T17:17:23.960507] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-09-16T17:17:23.961296] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-09-16T17:17:23.961348] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-09-16T17:17:24.326052] [INFO ] [REMOTE ] ATS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:17:24.372184] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-16T17:17:24.379800] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-09-16T17:17:24.693436] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-16T17:17:25.174891] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-09-16T17:17:25.257283] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-16T17:17:25.974962] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-09-16T17:17:26.411128] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-16T17:17:26.774874] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-09-16T17:17:27.076926] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-16T17:17:27.574966] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-09-16T17:17:28.037851] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-16T17:17:28.374870] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-09-16T17:17:29.002979] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-16T17:17:29.174878] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-09-16T17:17:29.670097] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-16T17:17:29.974931] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-09-16T17:17:30.100348] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-16T17:17:30.774899] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-09-16T17:17:31.110483] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-16T17:17:31.574960] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-09-16T17:17:32.124334] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-16T17:17:32.217305] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-16T17:17:32.374925] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-09-16T17:17:33.174916] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-09-16T17:17:33.272773] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-16T17:17:33.974931] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-09-16T17:17:34.284340] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-16T17:17:34.774906] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-09-16T17:17:35.517601] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-16T17:17:35.567931] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-16T17:17:35.574838] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-09-16T17:17:36.374937] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-09-16T17:17:36.511572] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-16T17:17:37.174897] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-09-16T17:17:37.847561] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-16T17:17:37.974887] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-09-16T17:17:38.149769] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-16T17:17:38.151884] [INFO ] [REMOTE ] ATS: Full fetch complete (19547 records). [2025-09-16T17:17:38.151953] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-09-16T17:17:38.513932] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-09-16T17:17:38.514009] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-09-16T17:17:38.514327] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-09-16T17:17:38.514381] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-09-16T17:17:38.515113] [DEBUG] [LOCAL ] ATS: Trimmed 19547 records to 13086 (keeping 150 days of data) [2025-09-16T17:17:38.590684] [DEBUG] [LOCAL ] ATS: Primary data saved (13086 records). [2025-09-16T17:17:38.590821] [INFO ] [MAIN ] ATS: Full history saved. [2025-09-16T17:17:38.590912] [INFO ] [MAIN ] Update Progress: 172/2369 symbols completed. ATS took 15.0s. Estimated remaining: 3h 44m 42s. Rate: 9.8 symbols/min [2025-09-16T17:17:38.758601] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:17:38.779814] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-09-16T17:17:38.796256] [DEBUG] [LOCAL ] ATUS: Loaded 37048 existing records from primary storage. [2025-09-16T17:17:38.796389] [INFO ] [MAIN ] ATUS: Loaded 37048 existing records. [2025-09-16T17:17:38.971357] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:17:38.971581] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-09-16T17:17:38.971628] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-09-16T17:17:38.972873] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-09-16T17:17:38.972925] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-09-16T17:17:39.324878] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:17:39.440886] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-16T17:17:39.574860] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-09-16T17:17:40.266589] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-16T17:17:40.374931] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-09-16T17:17:41.174916] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-09-16T17:17:41.213225] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-16T17:17:41.838783] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-16T17:17:41.974882] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-09-16T17:17:42.465665] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-16T17:17:42.774915] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-09-16T17:17:43.474578] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-16T17:17:43.574935] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-09-16T17:17:43.700191] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-16T17:17:44.374971] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-09-16T17:17:44.843321] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-16T17:17:45.174964] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-09-16T17:17:45.615218] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-16T17:17:45.620423] [INFO ] [REMOTE ] ATO: Full fetch complete (45461 records). [2025-09-16T17:17:45.620927] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-09-16T17:17:45.622429] [FATAL] [VALIDATOR ] ATO: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:17:45.622546] [FATAL] [MAIN ] ATO: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:17:45.622585] [WARN ] [MAIN ] ATO: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:17:45.622633] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-09-16T17:17:45.622719] [DEBUG] [LOCAL ] ATO: No primary data file found to delete. [2025-09-16T17:17:45.622769] [INFO ] [LOCAL ] ATO: Starting deletion of derivative data. [2025-09-16T17:17:45.623127] [DEBUG] [LOCAL ] ATO: Deleted derivative data file. [2025-09-16T17:17:45.624993] [INFO ] [MAIN ] Update Progress: 173/2369 symbols completed. ATO took 25.0s. Estimated remaining: 3h 44m 47s. Rate: 9.8 symbols/min [2025-09-16T17:17:45.796660] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:17:45.838672] [DEBUG] [LOCAL ] AU: Loaded 39087 existing records from primary storage. [2025-09-16T17:17:45.838828] [INFO ] [MAIN ] AU: Loaded 39087 existing records. [2025-09-16T17:17:45.980479] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-09-16T17:17:46.019360] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:17:46.019601] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-09-16T17:17:46.019666] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-09-16T17:17:46.021329] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-09-16T17:17:46.021381] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-09-16T17:17:46.384788] [INFO ] [REMOTE ] AU: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:17:46.436423] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-16T17:17:46.774970] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-09-16T17:17:47.241206] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-16T17:17:47.246681] [INFO ] [REMOTE ] ATMU: Full fetch complete (43354 records). [2025-09-16T17:17:47.246770] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-09-16T17:17:47.580061] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-09-16T17:17:47.618345] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present. [2025-09-16T17:17:47.618429] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed. [2025-09-16T17:17:47.618964] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-09-16T17:17:47.619012] [DEBUG] [LOCAL ] ATMU: Saving primary data. [2025-09-16T17:17:47.620147] [DEBUG] [LOCAL ] ATMU: Trimmed 43354 records to 28708 (keeping 150 days of data) [2025-09-16T17:17:47.798700] [DEBUG] [LOCAL ] ATMU: Primary data saved (28708 records). [2025-09-16T17:17:47.798849] [INFO ] [MAIN ] ATMU: Full history saved. [2025-09-16T17:17:47.798927] [INFO ] [MAIN ] Update Progress: 174/2369 symbols completed. ATMU took 35.1s. Estimated remaining: 3h 43m 51s. Rate: 9.8 symbols/min [2025-09-16T17:17:47.968533] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:17:48.002895] [DEBUG] [LOCAL ] AUB: Loaded 33612 existing records from primary storage. [2025-09-16T17:17:48.003036] [INFO ] [MAIN ] AUB: Loaded 33612 existing records. [2025-09-16T17:17:48.177432] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:17:48.177745] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-09-16T17:17:48.177793] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-09-16T17:17:48.179129] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-09-16T17:17:48.179180] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-09-16T17:17:48.383712] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-09-16T17:17:48.529919] [INFO ] [REMOTE ] AUB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:17:48.893849] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-16T17:17:49.050150] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-16T17:17:49.054275] [INFO ] [REMOTE ] ATR: Full fetch complete (33389 records). [2025-09-16T17:17:49.054365] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-09-16T17:17:49.180039] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-09-16T17:17:49.434280] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-09-16T17:17:49.434365] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-09-16T17:17:49.434829] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-09-16T17:17:49.434876] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-09-16T17:17:49.435790] [DEBUG] [LOCAL ] ATR: Trimmed 33389 records to 23182 (keeping 150 days of data) [2025-09-16T17:17:49.588996] [DEBUG] [LOCAL ] ATR: Primary data saved (23182 records). [2025-09-16T17:17:49.589138] [INFO ] [MAIN ] ATR: Full history saved. [2025-09-16T17:17:49.589249] [INFO ] [MAIN ] Update Progress: 175/2369 symbols completed. ATR took 27.0s. Estimated remaining: 3h 42m 51s. Rate: 9.8 symbols/min [2025-09-16T17:17:49.760493] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:17:49.765558] [DEBUG] [LOCAL ] AUNA: Loaded 3616 existing records from primary storage. [2025-09-16T17:17:49.765668] [INFO ] [MAIN ] AUNA: Loaded 3616 existing records. [2025-09-16T17:17:49.940147] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:17:49.940401] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-09-16T17:17:49.940450] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-09-16T17:17:49.940810] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-09-16T17:17:49.940861] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-09-16T17:17:49.984577] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-09-16T17:17:50.313219] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:17:50.353304] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-16T17:17:50.725709] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-16T17:17:50.774852] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-09-16T17:17:51.574893] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-09-16T17:17:51.667925] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-16T17:17:52.374918] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-09-16T17:17:52.691383] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-16T17:17:53.028680] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-16T17:17:53.081093] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-16T17:17:53.174886] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-09-16T17:17:53.751033] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-16T17:17:53.974912] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-09-16T17:17:54.774905] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-09-16T17:17:55.580134] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-09-16T17:17:55.598905] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-16T17:17:56.374926] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-09-16T17:17:56.811431] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-16T17:17:57.174910] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-09-16T17:17:57.518679] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-16T17:17:57.974909] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-09-16T17:17:58.088137] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-16T17:17:58.709919] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-16T17:17:58.774852] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-09-16T17:17:59.574912] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-09-16T17:18:00.247398] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-09-16T17:18:00.304207] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-16T17:18:00.374855] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-09-16T17:18:01.174925] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-09-16T17:18:01.529716] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-16T17:18:01.974903] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-09-16T17:18:02.407788] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-16T17:18:02.780209] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-09-16T17:18:02.810910] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-16T17:18:03.574934] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-09-16T17:18:03.735392] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-16T17:18:03.741355] [INFO ] [REMOTE ] ATUS: Full fetch complete (53134 records). [2025-09-16T17:18:03.741477] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-09-16T17:18:03.742214] [FATAL] [VALIDATOR ] ATUS: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:18:03.742306] [FATAL] [MAIN ] ATUS: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:18:03.742348] [WARN ] [MAIN ] ATUS: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:18:03.742541] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-09-16T17:18:03.742927] [DEBUG] [LOCAL ] ATUS: No primary data file found to delete. [2025-09-16T17:18:03.742994] [INFO ] [LOCAL ] ATUS: Starting deletion of derivative data. [2025-09-16T17:18:03.743310] [DEBUG] [LOCAL ] ATUS: Deleted derivative data file. [2025-09-16T17:18:03.744340] [INFO ] [MAIN ] Update Progress: 176/2369 symbols completed. ATUS took 25.2s. Estimated remaining: 3h 44m 25s. Rate: 9.8 symbols/min [2025-09-16T17:18:03.920253] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:18:03.954856] [DEBUG] [LOCAL ] AVA: Loaded 28643 existing records from primary storage. [2025-09-16T17:18:03.955011] [INFO ] [MAIN ] AVA: Loaded 28643 existing records. [2025-09-16T17:18:04.135280] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:18:04.135838] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-09-16T17:18:04.135938] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-09-16T17:18:04.137230] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-09-16T17:18:04.137284] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-09-16T17:18:04.331464] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-16T17:18:04.381413] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-09-16T17:18:04.423795] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-16T17:18:04.572108] [INFO ] [REMOTE ] AVA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:18:05.174924] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-09-16T17:18:05.974942] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-09-16T17:18:06.517713] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-16T17:18:06.589374] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-16T17:18:06.655085] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-16T17:18:06.774935] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-09-16T17:18:07.574932] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-09-16T17:18:08.374938] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-09-16T17:18:08.811751] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-16T17:18:08.905713] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-16T17:18:09.136095] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-16T17:18:09.174855] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-09-16T17:18:09.974912] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-09-16T17:18:10.650878] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-16T17:18:10.688782] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-16T17:18:10.774911] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-09-16T17:18:11.574949] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-09-16T17:18:11.975452] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-16T17:18:12.374925] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-09-16T17:18:13.174936] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-09-16T17:18:13.620485] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-16T17:18:13.644251] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-16T17:18:13.650533] [INFO ] [REMOTE ] AU: Full fetch complete (57430 records). [2025-09-16T17:18:13.650664] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-09-16T17:18:13.988486] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-09-16T17:18:14.041877] [DEBUG] [VALIDATOR ] AU: All expected trading days are present. [2025-09-16T17:18:14.041967] [DEBUG] [VALIDATOR ] AU: Primary data validation passed. [2025-09-16T17:18:14.042618] [INFO ] [MAIN ] AU: Fetched primary data is valid. [2025-09-16T17:18:14.042714] [DEBUG] [LOCAL ] AU: Saving primary data. [2025-09-16T17:18:14.044006] [DEBUG] [LOCAL ] AU: Trimmed 57430 records to 39477 (keeping 150 days of data) [2025-09-16T17:18:14.296627] [DEBUG] [LOCAL ] AU: Primary data saved (39477 records). [2025-09-16T17:18:14.296811] [INFO ] [MAIN ] AU: Full history saved. [2025-09-16T17:18:14.296918] [INFO ] [MAIN ] Update Progress: 177/2369 symbols completed. AU took 28.7s. Estimated remaining: 3h 45m 14s. Rate: 9.7 symbols/min [2025-09-16T17:18:14.472075] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:18:14.479942] [DEBUG] [LOCAL ] AVAL: Loaded 5769 existing records from primary storage. [2025-09-16T17:18:14.480116] [INFO ] [MAIN ] AVAL: Loaded 5769 existing records. [2025-09-16T17:18:14.570319] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-16T17:18:14.603420] [INFO ] [REMOTE ] AUB: Full fetch complete (50225 records). [2025-09-16T17:18:14.609530] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-09-16T17:18:14.771297] [WARN ] [MAIN ] AVAL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:18:14.781845] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-09-16T17:18:14.792974] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-09-16T17:18:14.796519] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-09-16T17:18:14.798381] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-16T17:18:14.809079] [DEBUG] [LOCAL ] AVAL: Deleted primary data file. [2025-09-16T17:18:14.814280] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-09-16T17:18:15.336089] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-09-16T17:18:15.347576] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-09-16T17:18:15.364785] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-09-16T17:18:15.372807] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-09-16T17:18:15.490438] [DEBUG] [LOCAL ] AUB: Trimmed 50225 records to 33888 (keeping 150 days of data) [2025-09-16T17:18:15.495111] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:18:15.591180] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-09-16T17:18:15.709760] [DEBUG] [LOCAL ] AUB: Primary data saved (33888 records). [2025-09-16T17:18:15.709919] [INFO ] [MAIN ] AUB: Full history saved. [2025-09-16T17:18:15.710018] [INFO ] [MAIN ] Update Progress: 178/2369 symbols completed. AUB took 27.9s. Estimated remaining: 3h 44m 9s. Rate: 9.8 symbols/min [2025-09-16T17:18:15.878678] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:18:15.911127] [DEBUG] [LOCAL ] AVB: Loaded 30819 existing records from primary storage. [2025-09-16T17:18:15.911275] [INFO ] [MAIN ] AVB: Loaded 30819 existing records. [2025-09-16T17:18:16.086604] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:18:16.086885] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-09-16T17:18:16.086932] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-09-16T17:18:16.088406] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-09-16T17:18:16.088458] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-09-16T17:18:16.379908] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-09-16T17:18:16.441279] [INFO ] [REMOTE ] AVB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:18:16.450714] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-16T17:18:16.477144] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-16T17:18:16.958070] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-16T17:18:16.959289] [INFO ] [REMOTE ] AUNA: Full fetch complete (5195 records). [2025-09-16T17:18:16.959357] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-09-16T17:18:17.180051] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-09-16T17:18:17.321147] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-09-16T17:18:17.321298] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-09-16T17:18:17.321469] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-09-16T17:18:17.321515] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-09-16T17:18:17.321925] [DEBUG] [LOCAL ] AUNA: Trimmed 5195 records to 3645 (keeping 150 days of data) [2025-09-16T17:18:17.343037] [DEBUG] [LOCAL ] AUNA: Primary data saved (3645 records). [2025-09-16T17:18:17.343108] [INFO ] [MAIN ] AUNA: Full history saved. [2025-09-16T17:18:17.343211] [INFO ] [MAIN ] Update Progress: 179/2369 symbols completed. AUNA took 27.8s. Estimated remaining: 3h 43m 8s. Rate: 9.8 symbols/min [2025-09-16T17:18:17.512149] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:18:17.512346] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-09-16T17:18:17.512385] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-09-16T17:18:17.512510] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-09-16T17:18:17.512550] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-16T17:18:17.512592] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-16T17:18:17.512624] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-09-16T17:18:17.865088] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:18:17.974946] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-09-16T17:18:18.579105] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-16T17:18:18.774910] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-09-16T17:18:19.502303] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-16T17:18:19.574856] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-09-16T17:18:20.379949] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-09-16T17:18:20.395302] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-16T17:18:20.795320] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-16T17:18:20.800042] [INFO ] [REMOTE ] AVA: Full fetch complete (42638 records). [2025-09-16T17:18:20.800136] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-09-16T17:18:20.800789] [FATAL] [VALIDATOR ] AVA: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:18:20.800866] [FATAL] [MAIN ] AVA: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:18:20.800903] [WARN ] [MAIN ] AVA: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:18:20.800941] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-09-16T17:18:20.801007] [DEBUG] [LOCAL ] AVA: No primary data file found to delete. [2025-09-16T17:18:20.801052] [INFO ] [LOCAL ] AVA: Starting deletion of derivative data. [2025-09-16T17:18:20.801277] [DEBUG] [LOCAL ] AVA: Deleted derivative data file. [2025-09-16T17:18:20.802547] [INFO ] [MAIN ] Update Progress: 180/2369 symbols completed. AVA took 17.1s. Estimated remaining: 3h 42m 29s. Rate: 9.8 symbols/min [2025-09-16T17:18:20.979520] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:18:21.001982] [DEBUG] [LOCAL ] AVD: Loaded 16275 existing records from primary storage. [2025-09-16T17:18:21.002113] [INFO ] [MAIN ] AVD: Loaded 16275 existing records. [2025-09-16T17:18:21.176807] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:18:21.176632] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-09-16T17:18:21.177805] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-09-16T17:18:21.177864] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-09-16T17:18:21.178576] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-09-16T17:18:21.178624] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-09-16T17:18:21.556828] [INFO ] [REMOTE ] AVD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:18:21.553466] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-16T17:18:21.974918] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-02. [2025-09-16T17:18:22.195193] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:18:22.195502] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-02 [2025-09-16T17:18:22.774903] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-09-16T17:18:22.922869] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-16T17:18:23.352274] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-16T17:18:23.574924] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-03. [2025-09-16T17:18:23.796383] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:18:23.796756] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-03 [2025-09-16T17:18:24.374921] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-09-16T17:18:24.941042] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-16T17:18:25.174901] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-09-16T17:18:25.974857] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-09-16T17:18:26.277931] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-16T17:18:26.774959] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-09-16T17:18:27.112666] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-16T17:18:27.574908] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-09-16T17:18:28.071397] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-16T17:18:28.374869] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-09-16T17:18:28.574562] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-16T17:18:29.174900] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-04. [2025-09-16T17:18:29.361433] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:18:29.361717] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-04 [2025-09-16T17:18:29.564108] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-16T17:18:29.974920] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-09-16T17:18:30.774921] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-09-16T17:18:31.099577] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-16T17:18:31.385968] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-16T17:18:31.574912] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-09-16T17:18:32.295430] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-16T17:18:32.374932] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-09-16T17:18:33.174937] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-09-16T17:18:33.279340] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-16T17:18:33.974924] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-09-16T17:18:34.601935] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-16T17:18:34.727224] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-16T17:18:34.728524] [INFO ] [REMOTE ] AVAL: Full fetch complete (10959 records). [2025-09-16T17:18:34.728597] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-09-16T17:18:34.729181] [FATAL] [VALIDATOR ] AVAL: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:18:34.729264] [FATAL] [MAIN ] AVAL: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:18:34.729303] [WARN ] [MAIN ] AVAL: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:18:34.729355] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-09-16T17:18:34.729434] [DEBUG] [LOCAL ] AVAL: No primary data file found to delete. [2025-09-16T17:18:34.729475] [INFO ] [LOCAL ] AVAL: Starting deletion of derivative data. [2025-09-16T17:18:34.729739] [DEBUG] [LOCAL ] AVAL: Deleted derivative data file. [2025-09-16T17:18:34.729835] [INFO ] [MAIN ] Update Progress: 181/2369 symbols completed. AVAL took 20.4s. Estimated remaining: 3h 43m 58s. Rate: 9.8 symbols/min [2025-09-16T17:18:34.783927] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-09-16T17:18:34.904325] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:18:34.920139] [DEBUG] [LOCAL ] AVK: Loaded 13357 existing records from primary storage. [2025-09-16T17:18:34.920296] [INFO ] [MAIN ] AVK: Loaded 13357 existing records. [2025-09-16T17:18:35.107892] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:18:35.108263] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-09-16T17:18:35.108313] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-09-16T17:18:35.109290] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-09-16T17:18:35.109369] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-09-16T17:18:35.463623] [INFO ] [REMOTE ] AVK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:18:35.574897] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-05. [2025-09-16T17:18:35.714825] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-16T17:18:35.796933] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:18:35.797195] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-05 [2025-09-16T17:18:36.374940] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-09-16T17:18:37.174969] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-09-16T17:18:37.725211] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-16T17:18:37.975040] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-06. [2025-09-16T17:18:38.167605] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:18:38.167956] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-06 [2025-09-16T17:18:38.335116] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-16T17:18:38.774943] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-09-16T17:18:39.574945] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-09-16T17:18:39.618687] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-16T17:18:40.374891] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-09-16T17:18:40.601483] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-16T17:18:40.604117] [INFO ] [REMOTE ] AVD: Full fetch complete (24590 records). [2025-09-16T17:18:40.604208] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-09-16T17:18:40.604779] [FATAL] [VALIDATOR ] AVD: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:18:40.604866] [FATAL] [MAIN ] AVD: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:18:40.604904] [WARN ] [MAIN ] AVD: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:18:40.604950] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-09-16T17:18:40.605008] [DEBUG] [LOCAL ] AVD: No primary data file found to delete. [2025-09-16T17:18:40.605044] [INFO ] [LOCAL ] AVD: Starting deletion of derivative data. [2025-09-16T17:18:40.605317] [DEBUG] [LOCAL ] AVD: Deleted derivative data file. [2025-09-16T17:18:40.605409] [INFO ] [MAIN ] Update Progress: 182/2369 symbols completed. AVD took 19.8s. Estimated remaining: 3h 43m 49s. Rate: 9.8 symbols/min [2025-09-16T17:18:40.775163] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:18:40.797885] [DEBUG] [LOCAL ] AVNS: Loaded 24755 existing records from primary storage. [2025-09-16T17:18:40.798011] [INFO ] [MAIN ] AVNS: Loaded 24755 existing records. [2025-09-16T17:18:40.976624] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:18:40.976877] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-09-16T17:18:40.976923] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-09-16T17:18:40.977881] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-09-16T17:18:40.977932] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-09-16T17:18:41.182355] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-09-16T17:18:41.329484] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:18:41.974869] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-07. [2025-09-16T17:18:42.072283] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-16T17:18:42.199906] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:18:42.200213] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-07 [2025-09-16T17:18:42.256474] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-16T17:18:42.774914] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-09-16T17:18:43.574904] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-08. [2025-09-16T17:18:44.380402] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-09-16T17:18:44.390029] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-16T17:18:44.396143] [INFO ] [REMOTE ] AVB: Full fetch complete (44681 records). [2025-09-16T17:18:44.396251] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-09-16T17:18:44.786442] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-09-16T17:18:44.786544] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-09-16T17:18:44.787158] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-09-16T17:18:44.787299] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-09-16T17:18:44.799483] [INFO ] [REMOTE ] AVBC: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-16T17:18:44.805459] [DEBUG] [LOCAL ] AVB: Trimmed 44681 records to 31165 (keeping 150 days of data) [2025-09-16T17:18:45.032179] [DEBUG] [LOCAL ] AVB: Primary data saved (31165 records). [2025-09-16T17:18:45.032402] [INFO ] [MAIN ] AVB: Full history saved. [2025-09-16T17:18:45.032515] [INFO ] [MAIN ] Update Progress: 183/2369 symbols completed. AVB took 29.3s. Estimated remaining: 3h 43m 22s. Rate: 9.8 symbols/min [2025-09-16T17:18:45.183792] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-09-16T17:18:45.221501] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:18:45.260083] [DEBUG] [LOCAL ] AVNT: Loaded 28547 existing records from primary storage. [2025-09-16T17:18:45.260315] [INFO ] [MAIN ] AVNT: Loaded 28547 existing records. [2025-09-16T17:18:45.449517] [WARN ] [MAIN ] AVNT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:18:45.449840] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-09-16T17:18:45.449892] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-09-16T17:18:45.451517] [DEBUG] [LOCAL ] AVNT: Deleted primary data file. [2025-09-16T17:18:45.451578] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-09-16T17:18:45.812533] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:18:45.850804] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-16T17:18:45.920095] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-16T17:18:45.974905] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-09-16T17:18:46.774911] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-09-16T17:18:46.949603] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-16T17:18:47.574903] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-09-16T17:18:47.965835] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-16T17:18:48.374917] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-09-16T17:18:48.626292] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-16T17:18:49.174909] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-09-16T17:18:49.483838] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-16T17:18:49.974921] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-09-16T17:18:50.762909] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-16T17:18:50.774844] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-09-16T17:18:51.116942] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-16T17:18:51.574909] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-09-16T17:18:52.270931] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-16T17:18:52.374909] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-09-16T17:18:52.540828] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-16T17:18:53.174933] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-09. [2025-09-16T17:18:53.913825] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-16T17:18:53.974919] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-09-16T17:18:54.097394] [INFO ] [REMOTE ] AVBC: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-16T17:18:54.099258] [INFO ] [REMOTE ] AVBC: Full fetch complete (3974 records). [2025-09-16T17:18:54.099326] [DEBUG] [VALIDATOR ] AVBC: Validating primary data. [2025-09-16T17:18:54.099699] [FATAL] [VALIDATOR ] AVBC: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:18:54.099776] [FATAL] [MAIN ] AVBC: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:18:54.099819] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:18:54.099881] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-16T17:18:54.100017] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-16T17:18:54.100074] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-09-16T17:18:54.100135] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-09-16T17:18:54.100207] [INFO ] [MAIN ] Update Progress: 184/2369 symbols completed. AVBC took 36.8s. Estimated remaining: 3h 43m 51s. Rate: 9.8 symbols/min [2025-09-16T17:18:54.274610] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:18:54.321964] [DEBUG] [LOCAL ] AVTR: Loaded 39554 existing records from primary storage. [2025-09-16T17:18:54.322134] [INFO ] [MAIN ] AVTR: Loaded 39554 existing records. [2025-09-16T17:18:54.497370] [WARN ] [MAIN ] AVTR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:18:54.497609] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-09-16T17:18:54.497677] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-09-16T17:18:54.499299] [DEBUG] [LOCAL ] AVTR: Deleted primary data file. [2025-09-16T17:18:54.499352] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-09-16T17:18:54.782695] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-09-16T17:18:54.884931] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:18:54.940774] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-16T17:18:55.574918] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-09-16T17:18:55.665106] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-16T17:18:56.374910] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-09-16T17:18:56.820473] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-16T17:18:57.174905] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-09-16T17:18:57.534665] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-16T17:18:57.537327] [INFO ] [REMOTE ] AVK: Full fetch complete (19702 records). [2025-09-16T17:18:57.537407] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-09-16T17:18:57.897190] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-09-16T17:18:57.897281] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-09-16T17:18:57.897602] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-09-16T17:18:57.897662] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-09-16T17:18:57.898475] [DEBUG] [LOCAL ] AVK: Trimmed 19702 records to 13450 (keeping 150 days of data) [2025-09-16T17:18:57.975156] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-09-16T17:18:57.985403] [DEBUG] [LOCAL ] AVK: Primary data saved (13450 records). [2025-09-16T17:18:57.985496] [INFO ] [MAIN ] AVK: Full history saved. [2025-09-16T17:18:57.985572] [INFO ] [MAIN ] Update Progress: 185/2369 symbols completed. AVK took 23.3s. Estimated remaining: 3h 43m 18s. Rate: 9.8 symbols/min [2025-09-16T17:18:58.162464] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:18:58.162668] [DEBUG] [LOCAL ] AVY: No existing data file found in primary storage. [2025-09-16T17:18:58.162710] [WARN ] [MAIN ] AVY: No existing data found, performing full refresh instead. [2025-09-16T17:18:58.162838] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-09-16T17:18:58.162901] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-09-16T17:18:58.162969] [DEBUG] [LOCAL ] AVY: No primary data file found to delete. [2025-09-16T17:18:58.163015] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-09-16T17:18:58.514169] [INFO ] [REMOTE ] AVY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:18:58.776791] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-09-16T17:18:58.779609] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-16T17:18:59.398520] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-16T17:18:59.574913] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-09-16T17:18:59.756270] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-16T17:19:00.374901] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-09-16T17:19:01.174903] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-09-16T17:19:01.743737] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-16T17:19:01.974901] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-09-16T17:19:02.200737] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-16T17:19:02.386368] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-16T17:19:02.774949] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-09-16T17:19:03.252465] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-16T17:19:03.574949] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-09-16T17:19:04.374913] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-09-16T17:19:04.570467] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-16T17:19:05.174903] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-09-16T17:19:05.212363] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-16T17:19:05.326702] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-16T17:19:05.331219] [INFO ] [REMOTE ] AVNT: Full fetch complete (43059 records). [2025-09-16T17:19:05.331373] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-09-16T17:19:05.700797] [DEBUG] [VALIDATOR ] AVNT: All expected trading days are present. [2025-09-16T17:19:05.700878] [DEBUG] [VALIDATOR ] AVNT: Primary data validation passed. [2025-09-16T17:19:05.701372] [INFO ] [MAIN ] AVNT: Fetched primary data is valid. [2025-09-16T17:19:05.701414] [DEBUG] [LOCAL ] AVNT: Saving primary data. [2025-09-16T17:19:05.702399] [DEBUG] [LOCAL ] AVNT: Trimmed 43059 records to 28832 (keeping 150 days of data) [2025-09-16T17:19:05.880827] [DEBUG] [LOCAL ] AVNT: Primary data saved (28832 records). [2025-09-16T17:19:05.880970] [INFO ] [MAIN ] AVNT: Full history saved. [2025-09-16T17:19:05.881054] [INFO ] [MAIN ] Update Progress: 186/2369 symbols completed. AVNT took 20.8s. Estimated remaining: 3h 43m 32s. Rate: 9.8 symbols/min [2025-09-16T17:19:05.980046] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-09-16T17:19:06.055733] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:19:06.055933] [DEBUG] [LOCAL ] AWF: No existing data file found in primary storage. [2025-09-16T17:19:06.055998] [WARN ] [MAIN ] AWF: No existing data found, performing full refresh instead. [2025-09-16T17:19:06.056123] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-09-16T17:19:06.056164] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-09-16T17:19:06.056205] [DEBUG] [LOCAL ] AWF: No primary data file found to delete. [2025-09-16T17:19:06.056239] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-09-16T17:19:06.426901] [INFO ] [REMOTE ] AWF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:19:06.576097] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-16T17:19:06.580357] [INFO ] [REMOTE ] AVNS: Full fetch complete (36344 records). [2025-09-16T17:19:06.580451] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-09-16T17:19:06.784050] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-09-16T17:19:06.949406] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-09-16T17:19:06.949494] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-09-16T17:19:06.949982] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-09-16T17:19:06.950027] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-09-16T17:19:06.950915] [DEBUG] [LOCAL ] AVNS: Trimmed 36344 records to 25002 (keeping 150 days of data) [2025-09-16T17:19:07.102815] [DEBUG] [LOCAL ] AVNS: Primary data saved (25002 records). [2025-09-16T17:19:07.102953] [INFO ] [MAIN ] AVNS: Full history saved. [2025-09-16T17:19:07.103036] [INFO ] [MAIN ] Update Progress: 187/2369 symbols completed. AVNS took 26.5s. Estimated remaining: 3h 42m 29s. Rate: 9.8 symbols/min [2025-09-16T17:19:07.273265] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:19:07.292422] [DEBUG] [LOCAL ] AWI: Loaded 18971 existing records from primary storage. [2025-09-16T17:19:07.292537] [INFO ] [MAIN ] AWI: Loaded 18971 existing records. [2025-09-16T17:19:07.469561] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:19:07.469825] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-09-16T17:19:07.469871] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-09-16T17:19:07.470814] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-09-16T17:19:07.470864] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-09-16T17:19:07.575399] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-09-16T17:19:07.842782] [INFO ] [REMOTE ] AWI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:19:07.870132] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-16T17:19:08.345255] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-16T17:19:08.374896] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-09-16T17:19:08.656516] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-16T17:19:09.174959] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-09-16T17:19:09.318156] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-16T17:19:09.974874] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-09-16T17:19:10.200220] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-16T17:19:10.774924] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-09-16T17:19:11.455123] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-16T17:19:11.574898] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-09-16T17:19:11.713703] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-16T17:19:12.374908] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-09-16T17:19:12.628820] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-16T17:19:13.175787] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-16T17:19:13.174871] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-09-16T17:19:13.974938] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-09-16T17:19:14.487900] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-16T17:19:14.774867] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-09-16T17:19:14.881988] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-16T17:19:15.574908] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-09-16T17:19:15.896098] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-16T17:19:16.226787] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-16T17:19:16.374869] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-09-16T17:19:17.174897] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-09-16T17:19:17.496979] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-16T17:19:17.974942] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-09-16T17:19:18.518710] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-16T17:19:18.774892] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-09-16T17:19:18.791178] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-16T17:19:19.574899] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-09-16T17:19:19.846294] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-16T17:19:20.374898] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-09-16T17:19:21.174862] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-09-16T17:19:21.335838] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-16T17:19:21.339096] [INFO ] [REMOTE ] AWF: Full fetch complete (26544 records). [2025-09-16T17:19:21.339167] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-09-16T17:19:21.722036] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-09-16T17:19:21.722193] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-09-16T17:19:21.722590] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-09-16T17:19:21.722658] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-09-16T17:19:21.723606] [DEBUG] [LOCAL ] AWF: Trimmed 26544 records to 17033 (keeping 150 days of data) [2025-09-16T17:19:21.830477] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-16T17:19:21.869028] [DEBUG] [LOCAL ] AWF: Primary data saved (17033 records). [2025-09-16T17:19:21.869155] [INFO ] [MAIN ] AWF: Full history saved. [2025-09-16T17:19:21.869235] [INFO ] [MAIN ] Update Progress: 188/2369 symbols completed. AWF took 16.0s. Estimated remaining: 3h 44m 3s. Rate: 9.7 symbols/min [2025-09-16T17:19:21.976286] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-09-16T17:19:22.041771] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:19:22.057853] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-16T17:19:22.096042] [DEBUG] [LOCAL ] AWK: Loaded 35633 existing records from primary storage. [2025-09-16T17:19:22.096175] [INFO ] [MAIN ] AWK: Loaded 35633 existing records. [2025-09-16T17:19:22.278766] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:19:22.279120] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-09-16T17:19:22.279174] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-09-16T17:19:22.280559] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-09-16T17:19:22.280611] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-09-16T17:19:22.631632] [INFO ] [REMOTE ] AWK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:19:22.774896] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-09-16T17:19:23.574879] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-09-16T17:19:23.665265] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-16T17:19:23.715013] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-16T17:19:24.374928] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-09-16T17:19:24.833206] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-16T17:19:24.837819] [INFO ] [REMOTE ] AVY: Full fetch complete (41228 records). [2025-09-16T17:19:24.837907] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-09-16T17:19:25.175556] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-09-16T17:19:25.206814] [DEBUG] [VALIDATOR ] AVY: All expected trading days are present. [2025-09-16T17:19:25.206889] [DEBUG] [VALIDATOR ] AVY: Primary data validation passed. [2025-09-16T17:19:25.207367] [INFO ] [MAIN ] AVY: Fetched primary data is valid. [2025-09-16T17:19:25.207410] [DEBUG] [LOCAL ] AVY: Saving primary data. [2025-09-16T17:19:25.208722] [DEBUG] [LOCAL ] AVY: Trimmed 41228 records to 27220 (keeping 150 days of data) [2025-09-16T17:19:25.387780] [DEBUG] [LOCAL ] AVY: Primary data saved (27220 records). [2025-09-16T17:19:25.388041] [INFO ] [MAIN ] AVY: Full history saved. [2025-09-16T17:19:25.388119] [INFO ] [MAIN ] Update Progress: 189/2369 symbols completed. AVY took 27.4s. Estimated remaining: 3h 43m 26s. Rate: 9.8 symbols/min [2025-09-16T17:19:25.556499] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:19:25.572818] [DEBUG] [LOCAL ] AWP: Loaded 16615 existing records from primary storage. [2025-09-16T17:19:25.572927] [INFO ] [MAIN ] AWP: Loaded 16615 existing records. [2025-09-16T17:19:25.752051] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:19:25.752372] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-09-16T17:19:25.752426] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-09-16T17:19:25.753607] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-09-16T17:19:25.753699] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-09-16T17:19:25.979827] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-09-16T17:19:26.121409] [INFO ] [REMOTE ] AWP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:19:26.177700] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-16T17:19:26.777785] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-09-16T17:19:26.794541] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-16T17:19:27.250706] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-16T17:19:27.574946] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-09-16T17:19:28.374882] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-09-16T17:19:28.458032] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-16T17:19:29.039581] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-16T17:19:29.174925] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-09-16T17:19:29.397360] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-16T17:19:29.400622] [INFO ] [REMOTE ] AWI: Full fetch complete (28462 records). [2025-09-16T17:19:29.400715] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-09-16T17:19:29.767956] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-09-16T17:19:29.768032] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-09-16T17:19:29.768409] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-09-16T17:19:29.768449] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-09-16T17:19:29.769144] [DEBUG] [LOCAL ] AWI: Trimmed 28462 records to 19097 (keeping 150 days of data) [2025-09-16T17:19:29.893531] [DEBUG] [LOCAL ] AWI: Primary data saved (19097 records). [2025-09-16T17:19:29.893732] [INFO ] [MAIN ] AWI: Full history saved. [2025-09-16T17:19:29.893845] [INFO ] [MAIN ] Update Progress: 190/2369 symbols completed. AWI took 22.8s. Estimated remaining: 3h 43m 1s. Rate: 9.8 symbols/min [2025-09-16T17:19:29.980081] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-09-16T17:19:30.072581] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:19:30.090081] [DEBUG] [LOCAL ] AWR: Loaded 16093 existing records from primary storage. [2025-09-16T17:19:30.090744] [INFO ] [MAIN ] AWR: Loaded 16093 existing records. [2025-09-16T17:19:30.275157] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:19:30.275449] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-09-16T17:19:30.275506] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-09-16T17:19:30.276500] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-09-16T17:19:30.276566] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-09-16T17:19:30.777384] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-09-16T17:19:30.840214] [INFO ] [REMOTE ] AWR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:19:30.845703] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-16T17:19:30.917074] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-16T17:19:31.574912] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-09-16T17:19:32.362949] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-16T17:19:32.369572] [INFO ] [REMOTE ] AVTR: Full fetch complete (58235 records). [2025-09-16T17:19:32.369716] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-09-16T17:19:32.382066] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-09-16T17:19:32.768079] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present. [2025-09-16T17:19:32.768208] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed. [2025-09-16T17:19:32.768993] [INFO ] [MAIN ] AVTR: Fetched primary data is valid. [2025-09-16T17:19:32.769065] [DEBUG] [LOCAL ] AVTR: Saving primary data. [2025-09-16T17:19:32.770657] [DEBUG] [LOCAL ] AVTR: Trimmed 58235 records to 39944 (keeping 150 days of data) [2025-09-16T17:19:32.886446] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-16T17:19:33.040414] [DEBUG] [LOCAL ] AVTR: Primary data saved (39944 records). [2025-09-16T17:19:33.040578] [INFO ] [MAIN ] AVTR: Full history saved. [2025-09-16T17:19:33.042847] [INFO ] [MAIN ] Update Progress: 191/2369 symbols completed. AVTR took 38.9s. Estimated remaining: 3h 42m 21s. Rate: 9.8 symbols/min [2025-09-16T17:19:33.185444] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-09-16T17:19:33.217392] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:19:33.238562] [DEBUG] [LOCAL ] AX: Loaded 20149 existing records from primary storage. [2025-09-16T17:19:33.238722] [INFO ] [MAIN ] AX: Loaded 20149 existing records. [2025-09-16T17:19:33.452299] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:19:33.452561] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-09-16T17:19:33.452611] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-09-16T17:19:33.453369] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-09-16T17:19:33.453420] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-09-16T17:19:33.817506] [INFO ] [REMOTE ] AX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:19:33.929754] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-16T17:19:33.974902] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-09-16T17:19:34.178502] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-16T17:19:34.774973] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-09-16T17:19:34.824835] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-16T17:19:35.574905] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-09-16T17:19:36.124564] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-16T17:19:36.318160] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-16T17:19:36.374912] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-09-16T17:19:37.174880] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-09-16T17:19:37.533914] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-16T17:19:37.974921] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-09-16T17:19:38.774926] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-09-16T17:19:38.919376] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-16T17:19:39.351223] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-16T17:19:39.520691] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-16T17:19:39.574869] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-09-16T17:19:40.374911] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-09-16T17:19:40.620987] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-16T17:19:41.174936] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-09-16T17:19:41.438190] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-16T17:19:41.974901] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-09-16T17:19:42.685060] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-16T17:19:42.774866] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-09-16T17:19:43.370117] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-16T17:19:43.574905] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-09-16T17:19:44.374865] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-09-16T17:19:44.483813] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-16T17:19:44.712933] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-16T17:19:45.142352] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-16T17:19:45.174888] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-09-16T17:19:45.974882] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-09-16T17:19:46.206919] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-16T17:19:46.774896] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-09-16T17:19:47.341452] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-16T17:19:47.347135] [INFO ] [REMOTE ] AWK: Full fetch complete (53205 records). [2025-09-16T17:19:47.347249] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-09-16T17:19:47.582777] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-09-16T17:19:47.735629] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-09-16T17:19:47.735730] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-09-16T17:19:47.736416] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-09-16T17:19:47.736461] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-09-16T17:19:47.738302] [DEBUG] [LOCAL ] AWK: Trimmed 53205 records to 35976 (keeping 150 days of data) [2025-09-16T17:19:47.870167] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-16T17:19:47.989563] [DEBUG] [LOCAL ] AWK: Primary data saved (35976 records). [2025-09-16T17:19:47.989726] [INFO ] [MAIN ] AWK: Full history saved. [2025-09-16T17:19:47.989826] [INFO ] [MAIN ] Update Progress: 192/2369 symbols completed. AWK took 26.1s. Estimated remaining: 3h 43m 55s. Rate: 9.7 symbols/min [2025-09-16T17:19:48.161264] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:19:48.195159] [DEBUG] [LOCAL ] AXL: Loaded 37150 existing records from primary storage. [2025-09-16T17:19:48.195334] [INFO ] [MAIN ] AXL: Loaded 37150 existing records. [2025-09-16T17:19:48.370831] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:19:48.371069] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-09-16T17:19:48.371114] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-09-16T17:19:48.372289] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-09-16T17:19:48.372344] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-09-16T17:19:48.383564] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-09-16T17:19:48.726118] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-16T17:19:48.730126] [INFO ] [REMOTE ] AXL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:19:48.733381] [INFO ] [REMOTE ] AWP: Full fetch complete (23923 records). [2025-09-16T17:19:48.733472] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-09-16T17:19:49.111965] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-09-16T17:19:49.112059] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-09-16T17:19:49.112433] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-09-16T17:19:49.112476] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-09-16T17:19:49.113135] [DEBUG] [LOCAL ] AWP: Trimmed 23923 records to 16751 (keeping 150 days of data) [2025-09-16T17:19:49.183396] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-09-16T17:19:49.212346] [DEBUG] [LOCAL ] AWP: Primary data saved (16751 records). [2025-09-16T17:19:49.212481] [INFO ] [MAIN ] AWP: Full history saved. [2025-09-16T17:19:49.212580] [INFO ] [MAIN ] Update Progress: 193/2369 symbols completed. AWP took 23.8s. Estimated remaining: 3h 42m 53s. Rate: 9.8 symbols/min [2025-09-16T17:19:49.400345] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:19:49.400782] [DEBUG] [LOCAL ] AXP: No existing data file found in primary storage. [2025-09-16T17:19:49.400912] [WARN ] [MAIN ] AXP: No existing data found, performing full refresh instead. [2025-09-16T17:19:49.401163] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-09-16T17:19:49.401236] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-09-16T17:19:49.401420] [DEBUG] [LOCAL ] AXP: No primary data file found to delete. [2025-09-16T17:19:49.401552] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-09-16T17:19:49.678872] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-16T17:19:49.781093] [INFO ] [REMOTE ] AXP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:19:49.974898] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-09-16T17:19:50.774909] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-09-16T17:19:51.064577] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-16T17:19:51.574851] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-09-16T17:19:51.646112] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-16T17:19:51.721114] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-16T17:19:52.374905] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-09-16T17:19:53.174875] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-09-16T17:19:53.223081] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-16T17:19:53.974904] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-09-16T17:19:54.341097] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-16T17:19:54.495165] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-16T17:19:54.774950] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-09-16T17:19:54.813812] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-16T17:19:55.574898] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-09-16T17:19:56.374875] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-09-16T17:19:56.690293] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-16T17:19:56.726238] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-16T17:19:56.729934] [INFO ] [REMOTE ] AX: Full fetch complete (31165 records). [2025-09-16T17:19:56.730014] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-09-16T17:19:57.106326] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-09-16T17:19:57.106410] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-09-16T17:19:57.106868] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-09-16T17:19:57.106917] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-09-16T17:19:57.107744] [DEBUG] [LOCAL ] AX: Trimmed 31165 records to 20338 (keeping 150 days of data) [2025-09-16T17:19:57.194513] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-09-16T17:19:57.229015] [DEBUG] [LOCAL ] AX: Primary data saved (20338 records). [2025-09-16T17:19:57.229121] [INFO ] [MAIN ] AX: Full history saved. [2025-09-16T17:19:57.229204] [INFO ] [MAIN ] Update Progress: 194/2369 symbols completed. AX took 24.2s. Estimated remaining: 3h 43m 8s. Rate: 9.7 symbols/min [2025-09-16T17:19:57.400897] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:19:57.404636] [DEBUG] [LOCAL ] AXR: Loaded 2129 existing records from primary storage. [2025-09-16T17:19:57.404733] [INFO ] [MAIN ] AXR: Loaded 2129 existing records. [2025-09-16T17:19:57.586320] [WARN ] [MAIN ] AXR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:19:57.586596] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-09-16T17:19:57.586662] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-09-16T17:19:57.586949] [DEBUG] [LOCAL ] AXR: Deleted primary data file. [2025-09-16T17:19:57.586995] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-09-16T17:19:57.943731] [INFO ] [REMOTE ] AXR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:19:57.974847] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-09-16T17:19:58.081890] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-16T17:19:58.226141] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-16T17:19:58.586302] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-16T17:19:58.774915] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-09-16T17:19:59.166856] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-16T17:19:59.574876] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-09-16T17:20:00.374906] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-09-16T17:20:01.014731] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-16T17:20:01.019435] [INFO ] [REMOTE ] AWR: Full fetch complete (24272 records). [2025-09-16T17:20:01.019560] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-09-16T17:20:01.179998] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-09-16T17:20:01.408077] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-09-16T17:20:01.408166] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-09-16T17:20:01.408541] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-09-16T17:20:01.408586] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-09-16T17:20:01.409518] [DEBUG] [LOCAL ] AWR: Trimmed 24272 records to 16266 (keeping 150 days of data) [2025-09-16T17:20:01.513963] [DEBUG] [LOCAL ] AWR: Primary data saved (16266 records). [2025-09-16T17:20:01.514118] [INFO ] [MAIN ] AWR: Full history saved. [2025-09-16T17:20:01.514206] [INFO ] [MAIN ] Update Progress: 195/2369 symbols completed. AWR took 31.6s. Estimated remaining: 3h 42m 41s. Rate: 9.8 symbols/min [2025-09-16T17:20:01.692851] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:20:01.724597] [DEBUG] [LOCAL ] AXS: Loaded 28095 existing records from primary storage. [2025-09-16T17:20:01.724792] [INFO ] [MAIN ] AXS: Loaded 28095 existing records. [2025-09-16T17:20:01.869954] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-16T17:20:01.967463] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:20:01.967744] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-09-16T17:20:01.967802] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-09-16T17:20:01.968737] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-09-16T17:20:01.968800] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-09-16T17:20:01.981196] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-09-16T17:20:02.374879] [INFO ] [REMOTE ] AXS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:20:02.437243] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-16T17:20:02.774892] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-09-16T17:20:03.574905] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-09-16T17:20:04.118933] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-16T17:20:04.349340] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-16T17:20:04.374853] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-09-16T17:20:04.486673] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-09-16T17:20:05.174925] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-09-16T17:20:05.606860] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-16T17:20:05.974923] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-09-16T17:20:06.754109] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-16T17:20:06.774869] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-09-16T17:20:07.471992] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-16T17:20:07.574940] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-09-16T17:20:07.977272] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-16T17:20:08.374914] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-09-16T17:20:08.560342] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-16T17:20:09.174919] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-09-16T17:20:09.986587] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-09-16T17:20:09.991702] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-16T17:20:10.774944] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-09-16T17:20:11.574958] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-09-16T17:20:11.635853] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-09-16T17:20:11.970138] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-16T17:20:12.228789] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-16T17:20:12.374923] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-09-16T17:20:13.174909] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-09-16T17:20:13.205711] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-16T17:20:13.754603] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-16T17:20:13.974895] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-09-16T17:20:14.411536] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-16T17:20:14.774901] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-09-16T17:20:15.438569] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-16T17:20:15.445139] [INFO ] [REMOTE ] AXP: Full fetch complete (57857 records). [2025-09-16T17:20:15.445290] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-09-16T17:20:15.580004] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-09-16T17:20:15.853393] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present. [2025-09-16T17:20:15.853476] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed. [2025-09-16T17:20:15.854101] [INFO ] [MAIN ] AXP: Fetched primary data is valid. [2025-09-16T17:20:15.854150] [DEBUG] [LOCAL ] AXP: Saving primary data. [2025-09-16T17:20:15.855362] [DEBUG] [LOCAL ] AXP: Trimmed 57857 records to 39661 (keeping 150 days of data) [2025-09-16T17:20:16.107761] [DEBUG] [LOCAL ] AXP: Primary data saved (39661 records). [2025-09-16T17:20:16.107993] [INFO ] [MAIN ] AXP: Full history saved. [2025-09-16T17:20:16.108080] [INFO ] [MAIN ] Update Progress: 196/2369 symbols completed. AXP took 26.9s. Estimated remaining: 3h 44m 8s. Rate: 9.7 symbols/min [2025-09-16T17:20:16.254888] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-16T17:20:16.321141] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:20:16.364065] [DEBUG] [LOCAL ] AXTA: Loaded 38451 existing records from primary storage. [2025-09-16T17:20:16.364248] [INFO ] [MAIN ] AXTA: Loaded 38451 existing records. [2025-09-16T17:20:16.380025] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-09-16T17:20:16.555024] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:20:16.555268] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-09-16T17:20:16.555331] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-09-16T17:20:16.556363] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-09-16T17:20:16.556416] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-09-16T17:20:16.928584] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:20:17.174932] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-09-16T17:20:17.658922] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-16T17:20:17.717674] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-16T17:20:17.718869] [INFO ] [REMOTE ] AXR: Full fetch complete (3351 records). [2025-09-16T17:20:17.718937] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-09-16T17:20:17.980050] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-09-16T17:20:18.082656] [DEBUG] [VALIDATOR ] AXR: All expected trading days are present. [2025-09-16T17:20:18.082742] [DEBUG] [VALIDATOR ] AXR: Primary data validation passed. [2025-09-16T17:20:18.082931] [INFO ] [MAIN ] AXR: Fetched primary data is valid. [2025-09-16T17:20:18.082989] [DEBUG] [LOCAL ] AXR: Saving primary data. [2025-09-16T17:20:18.083360] [DEBUG] [LOCAL ] AXR: Trimmed 3351 records to 2150 (keeping 150 days of data) [2025-09-16T17:20:18.096297] [DEBUG] [LOCAL ] AXR: Primary data saved (2150 records). [2025-09-16T17:20:18.096368] [INFO ] [MAIN ] AXR: Full history saved. [2025-09-16T17:20:18.096470] [INFO ] [MAIN ] Update Progress: 197/2369 symbols completed. AXR took 20.9s. Estimated remaining: 3h 43m 16s. Rate: 9.7 symbols/min [2025-09-16T17:20:18.774934] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-09-16T17:20:18.812546] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (3.23 seconds). [2025-09-16T17:20:18.819223] [INFO ] [REMOTE ] AXL: Full fetch complete (55048 records). [2025-09-16T17:20:18.819343] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-09-16T17:20:19.208372] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-09-16T17:20:19.208472] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-09-16T17:20:19.209227] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-09-16T17:20:19.209288] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-09-16T17:20:19.211036] [DEBUG] [LOCAL ] AXL: Trimmed 55048 records to 37509 (keeping 150 days of data) [2025-09-16T17:20:19.449553] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-16T17:20:19.466188] [DEBUG] [LOCAL ] AXL: Primary data saved (37509 records). [2025-09-16T17:20:19.466288] [INFO ] [MAIN ] AXL: Full history saved. [2025-09-16T17:20:19.466398] [INFO ] [MAIN ] Update Progress: 198/2369 symbols completed. AXL took 31.5s. Estimated remaining: 3h 42m 17s. Rate: 9.8 symbols/min [2025-09-16T17:20:19.574877] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-09-16T17:20:19.939467] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-16T17:20:20.374933] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-09-16T17:20:20.874334] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-16T17:20:21.174910] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-09-16T17:20:21.429722] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-16T17:20:21.433999] [INFO ] [REMOTE ] AXS: Full fetch complete (41191 records). [2025-09-16T17:20:21.434088] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-09-16T17:20:21.434687] [FATAL] [VALIDATOR ] AXS: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:20:21.434761] [FATAL] [MAIN ] AXS: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:20:21.434808] [WARN ] [MAIN ] AXS: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:20:21.434856] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-09-16T17:20:21.434914] [DEBUG] [LOCAL ] AXS: No primary data file found to delete. [2025-09-16T17:20:21.434971] [INFO ] [LOCAL ] AXS: Starting deletion of derivative data. [2025-09-16T17:20:21.435281] [DEBUG] [LOCAL ] AXS: Deleted derivative data file. [2025-09-16T17:20:21.436492] [INFO ] [MAIN ] Update Progress: 199/2369 symbols completed. AXS took 19.9s. Estimated remaining: 3h 41m 26s. Rate: 9.8 symbols/min [2025-09-16T17:20:22.490816] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-16T17:20:22.501749] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-09-16T17:20:25.568239] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (3.07 seconds). [2025-09-16T17:20:25.579774] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-09-16T17:20:26.820176] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-16T17:20:26.830745] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-09-16T17:20:26.938093] [DEBUG] [REMOTE ] AXTA: Error fetching primary data for 2025-07: HTTPSConnectionPool(host='www.alphavantage.co', port=443): Max retries exceeded with url: /query?function=TIME_SERIES_INTRADAY&symbol=AXTA&interval=1min&month=2025-07&outputsize=full&apikey=2N37ABM4OC9PIBKK&extended_hours=false&entitlement=delayed (Caused by SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1032)'))) [2025-09-16T17:20:26.938310] [WARN ] [REMOTE ] AXTA: No data returned for month 2025-07 [2025-09-16T17:20:26.938786] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-09-16T17:20:28.190777] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-16T17:20:28.201923] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-09-16T17:20:29.626924] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-16T17:20:29.633159] [INFO ] [REMOTE ] AXTA: Full fetch complete (48365 records). [2025-09-16T17:20:29.633284] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-09-16T17:20:29.824937] [WARN ] [VALIDATOR ] AXTA: Validation failed - insufficient historical data. Have 128 unique days, need 150 days [2025-09-16T17:20:29.825463] [FATAL] [MAIN ] AXTA: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:20:29.825514] [WARN ] [MAIN ] AXTA: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:20:29.825560] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-09-16T17:20:29.825631] [DEBUG] [LOCAL ] AXTA: No primary data file found to delete. [2025-09-16T17:20:29.825692] [INFO ] [LOCAL ] AXTA: Starting deletion of derivative data. [2025-09-16T17:20:29.825921] [DEBUG] [LOCAL ] AXTA: Deleted derivative data file. [2025-09-16T17:20:29.825999] [INFO ] [MAIN ] Update Progress: 200/2369 symbols completed. AXTA took 13.7s. Estimated remaining: 3h 41m 44s. Rate: 9.8 symbols/min [2025-09-16T17:20:30.429589] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:20:30.499085] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:20:30.554777] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:20:30.576999] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-09-16T17:20:30.579008] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-09-16T17:20:30.578950] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:20:30.579199] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-09-16T17:20:30.579604] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-16T17:20:30.579671] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-16T17:20:30.579708] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-09-16T17:20:30.724497] [DEBUG] [LOCAL ] AYI: Loaded 17494 existing records from primary storage. [2025-09-16T17:20:30.724996] [INFO ] [MAIN ] AYI: Loaded 17494 existing records. [2025-09-16T17:20:30.725227] [DEBUG] [LOCAL ] AZO: Loaded 7801 existing records from primary storage. [2025-09-16T17:20:30.724856] [DEBUG] [LOCAL ] AZZ: Loaded 16542 existing records from primary storage. [2025-09-16T17:20:30.789671] [INFO ] [MAIN ] AZZ: Loaded 16542 existing records. [2025-09-16T17:20:30.789596] [INFO ] [MAIN ] AZO: Loaded 7801 existing records. [2025-09-16T17:20:31.229787] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:20:31.280701] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-09-16T17:20:31.286089] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-09-16T17:20:31.297029] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-09-16T17:20:31.377137] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-09-16T17:20:31.515731] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:20:31.500749] [INFO ] [REMOTE ] B: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:20:31.520049] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:20:31.526211] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-09-16T17:20:31.526129] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-09-16T17:20:31.541911] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-09-16T17:20:31.532233] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-09-16T17:20:31.566919] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-09-16T17:20:31.576014] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-09-16T17:20:31.575963] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-09-16T17:20:31.595418] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-09-16T17:20:31.590229] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-09-16T17:20:32.317547] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:20:32.376314] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-09-16T17:20:32.407507] [INFO ] [REMOTE ] B: Fetching primary data for 2025-03. [2025-09-16T17:20:32.519844] [INFO ] [REMOTE ] AYI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:20:32.561592] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-09-16T17:20:32.615240] [INFO ] [REMOTE ] AZO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:20:32.652071] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:20:32.652436] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-09-16T17:20:32.653427] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-09-16T17:20:32.768196] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:20:32.768526] [WARN ] [REMOTE ] B: No data returned for month 2025-03 [2025-09-16T17:20:32.769035] [INFO ] [REMOTE ] B: Fetching primary data for 2025-04. [2025-09-16T17:20:32.974833] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:20:32.975140] [WARN ] [REMOTE ] B: No data returned for month 2025-04 [2025-09-16T17:20:32.975630] [INFO ] [REMOTE ] B: Fetching primary data for 2025-05. [2025-09-16T17:20:33.472080] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-16T17:20:33.474284] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-09-16T17:20:33.596182] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-16T17:20:33.600811] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-09-16T17:20:33.651553] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-16T17:20:33.657132] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-09-16T17:20:34.261726] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-16T17:20:34.265570] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-09-16T17:20:34.480981] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-16T17:20:34.498262] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-16T17:20:34.667564] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-16T17:20:34.774954] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-09-16T17:20:35.473179] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-16T17:20:35.574951] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-09-16T17:20:35.676375] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-16T17:20:36.374926] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-09-16T17:20:36.603393] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-16T17:20:36.984146] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-16T17:20:37.174922] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-09-16T17:20:37.974894] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-09-16T17:20:38.015044] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-16T17:20:38.651242] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-16T17:20:38.774926] [INFO ] [REMOTE ] B: Fetching primary data for 2025-06. [2025-09-16T17:20:39.574920] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-09-16T17:20:40.210159] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-16T17:20:40.374911] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-09-16T17:20:40.600303] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-16T17:20:41.174920] [INFO ] [REMOTE ] B: Fetching primary data for 2025-07. [2025-09-16T17:20:41.340793] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-16T17:20:41.974911] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-09-16T17:20:42.775096] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-09-16T17:20:42.888450] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-16T17:20:42.963201] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-16T17:20:43.574957] [INFO ] [REMOTE ] B: Fetching primary data for 2025-08. [2025-09-16T17:20:43.787317] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-16T17:20:44.374920] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-09-16T17:20:44.897447] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-16T17:20:45.174926] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-09-16T17:20:45.912228] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-16T17:20:45.974905] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-09-16T17:20:46.421507] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-16T17:20:46.774900] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-09-16T17:20:47.574929] [INFO ] [REMOTE ] B: Fetching primary data for 2025-09. [2025-09-16T17:20:47.685811] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-16T17:20:47.772231] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-16T17:20:48.374931] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-09-16T17:20:49.088439] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-16T17:20:49.090094] [INFO ] [REMOTE ] AZO: Full fetch complete (12142 records). [2025-09-16T17:20:49.090166] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-09-16T17:20:49.090585] [FATAL] [VALIDATOR ] AZO: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:20:49.090678] [FATAL] [MAIN ] AZO: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:20:49.090718] [WARN ] [MAIN ] AZO: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:20:49.090755] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-09-16T17:20:49.090811] [DEBUG] [LOCAL ] AZO: No primary data file found to delete. [2025-09-16T17:20:49.090847] [INFO ] [LOCAL ] AZO: Starting deletion of derivative data. [2025-09-16T17:20:49.091179] [DEBUG] [LOCAL ] AZO: Deleted derivative data file. [2025-09-16T17:20:49.091290] [INFO ] [MAIN ] Update Progress: 201/2369 symbols completed. AZO took 19.3s. Estimated remaining: 3h 43m 59s. Rate: 9.7 symbols/min [2025-09-16T17:20:49.179981] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-09-16T17:20:49.293942] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:20:49.295884] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-16T17:20:49.302236] [INFO ] [REMOTE ] B: Full fetch complete (34240 records). [2025-09-16T17:20:49.302407] [DEBUG] [VALIDATOR ] B: Validating primary data. [2025-09-16T17:20:49.303109] [FATAL] [VALIDATOR ] B: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:20:49.303199] [FATAL] [MAIN ] B: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:20:49.303238] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:20:49.303285] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-16T17:20:49.303391] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-16T17:20:49.303432] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-09-16T17:20:49.303484] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-09-16T17:20:49.303550] [INFO ] [MAIN ] Update Progress: 202/2369 symbols completed. B took 19.5s. Estimated remaining: 3h 42m 49s. Rate: 9.7 symbols/min [2025-09-16T17:20:49.501992] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:20:49.517180] [DEBUG] [LOCAL ] BA: Loaded 39751 existing records from primary storage. [2025-09-16T17:20:49.517404] [INFO ] [MAIN ] BA: Loaded 39751 existing records. [2025-09-16T17:20:49.730181] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:20:49.730463] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-09-16T17:20:49.730518] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-09-16T17:20:49.732068] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-09-16T17:20:49.732138] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-09-16T17:20:49.879857] [DEBUG] [LOCAL ] BABA: Loaded 39780 existing records from primary storage. [2025-09-16T17:20:49.911199] [INFO ] [MAIN ] BABA: Loaded 39780 existing records. [2025-09-16T17:20:50.000279] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-09-16T17:20:50.244355] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:20:50.276536] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-09-16T17:20:50.317415] [INFO ] [REMOTE ] BA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:20:50.312655] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-09-16T17:20:50.324321] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-09-16T17:20:50.329127] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-09-16T17:20:50.367428] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-16T17:20:50.705058] [INFO ] [REMOTE ] BABA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:20:50.774873] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-09-16T17:20:50.843273] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-16T17:20:50.845701] [INFO ] [REMOTE ] AZZ: Full fetch complete (23792 records). [2025-09-16T17:20:50.845773] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-09-16T17:20:50.846235] [FATAL] [VALIDATOR ] AZZ: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:20:50.846312] [FATAL] [MAIN ] AZZ: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:20:50.846349] [WARN ] [MAIN ] AZZ: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:20:50.846387] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-09-16T17:20:50.846445] [DEBUG] [LOCAL ] AZZ: No primary data file found to delete. [2025-09-16T17:20:50.846480] [INFO ] [LOCAL ] AZZ: Starting deletion of derivative data. [2025-09-16T17:20:50.846700] [DEBUG] [LOCAL ] AZZ: Deleted derivative data file. [2025-09-16T17:20:50.846781] [INFO ] [MAIN ] Update Progress: 203/2369 symbols completed. AZZ took 21.0s. Estimated remaining: 3h 41m 54s. Rate: 9.8 symbols/min [2025-09-16T17:20:51.016537] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:20:51.060458] [DEBUG] [LOCAL ] BAC: Loaded 39768 existing records from primary storage. [2025-09-16T17:20:51.060601] [INFO ] [MAIN ] BAC: Loaded 39768 existing records. [2025-09-16T17:20:51.237623] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:20:51.237885] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-09-16T17:20:51.237932] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-09-16T17:20:51.239142] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-09-16T17:20:51.239199] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-09-16T17:20:51.596093] [INFO ] [REMOTE ] BAC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:20:51.575346] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-09-16T17:20:52.374862] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-09-16T17:20:52.609609] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-16T17:20:52.612390] [INFO ] [REMOTE ] AYI: Full fetch complete (27586 records). [2025-09-16T17:20:52.612469] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-09-16T17:20:52.975582] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-09-16T17:20:52.975681] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-09-16T17:20:52.976096] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-09-16T17:20:52.976138] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-09-16T17:20:52.976922] [DEBUG] [LOCAL ] AYI: Trimmed 27586 records to 17656 (keeping 150 days of data) [2025-09-16T17:20:53.091498] [DEBUG] [LOCAL ] AYI: Primary data saved (17656 records). [2025-09-16T17:20:53.091658] [INFO ] [MAIN ] AYI: Full history saved. [2025-09-16T17:20:53.091746] [INFO ] [MAIN ] Update Progress: 204/2369 symbols completed. AYI took 23.3s. Estimated remaining: 3h 41m 6s. Rate: 9.8 symbols/min [2025-09-16T17:20:53.184845] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-09-16T17:20:53.268174] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:20:53.314878] [DEBUG] [LOCAL ] BAH: Loaded 38077 existing records from primary storage. [2025-09-16T17:20:53.315015] [INFO ] [MAIN ] BAH: Loaded 38077 existing records. [2025-09-16T17:20:53.522582] [WARN ] [MAIN ] BAH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:20:53.522947] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-09-16T17:20:53.523375] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-09-16T17:20:53.524443] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.75 seconds). [2025-09-16T17:20:53.533902] [DEBUG] [LOCAL ] BAH: Deleted primary data file. [2025-09-16T17:20:53.534474] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-09-16T17:20:53.884933] [INFO ] [REMOTE ] BAH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:20:53.974902] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-09-16T17:20:54.722800] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-09-16T17:20:54.774858] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-09-16T17:20:55.535147] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-09-16T17:20:55.574880] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-09-16T17:20:56.374914] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-09-16T17:20:56.679507] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.70 seconds). [2025-09-16T17:20:56.860445] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-16T17:20:57.174886] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-09-16T17:20:57.239421] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-16T17:20:57.974907] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-09-16T17:20:58.774966] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-09-16T17:20:58.814681] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-09-16T17:20:59.574932] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-09-16T17:20:59.757803] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-09-16T17:20:59.965692] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-16T17:21:00.374902] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-09-16T17:21:01.174901] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-09-16T17:21:01.784143] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (3.01 seconds). [2025-09-16T17:21:01.974897] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-09-16T17:21:02.497940] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.92 seconds). [2025-09-16T17:21:02.591921] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-16T17:21:02.774892] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-09-16T17:21:03.574894] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-09-16T17:21:04.172536] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (3.00 seconds). [2025-09-16T17:21:04.374911] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-09-16T17:21:04.729471] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (2.75 seconds). [2025-09-16T17:21:05.174871] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-09-16T17:21:05.313609] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-09-16T17:21:05.418772] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-16T17:21:05.974898] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-09-16T17:21:06.655727] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-09-16T17:21:06.774925] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-09-16T17:21:07.217208] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-16T17:21:07.574906] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-09-16T17:21:07.909295] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-16T17:21:08.374916] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-09-16T17:21:08.754818] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-16T17:21:09.174938] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-09-16T17:21:09.974952] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-09-16T17:21:10.182339] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-09-16T17:21:10.774913] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-09-16T17:21:10.847423] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-16T17:21:10.919885] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-09-16T17:21:11.574924] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-09-16T17:21:12.374978] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-09-16T17:21:12.979833] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-16T17:21:13.074844] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (3.10 seconds). [2025-09-16T17:21:13.174926] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-09-16T17:21:13.230806] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-16T17:21:13.974904] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-09-16T17:21:14.556401] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-16T17:21:14.774917] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-09-16T17:21:15.106548] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-16T17:21:15.113037] [INFO ] [REMOTE ] BA: Full fetch complete (58471 records). [2025-09-16T17:21:15.113154] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-09-16T17:21:15.527861] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-09-16T17:21:15.527965] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-09-16T17:21:15.528697] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-09-16T17:21:15.528756] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-09-16T17:21:15.530172] [DEBUG] [LOCAL ] BA: Trimmed 58471 records to 40141 (keeping 150 days of data) [2025-09-16T17:21:15.589198] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-09-16T17:21:15.791905] [DEBUG] [LOCAL ] BA: Primary data saved (40141 records). [2025-09-16T17:21:15.792040] [INFO ] [MAIN ] BA: Full history saved. [2025-09-16T17:21:15.792123] [INFO ] [MAIN ] Update Progress: 205/2369 symbols completed. BA took 26.7s. Estimated remaining: 3h 43m 55s. Rate: 9.7 symbols/min [2025-09-16T17:21:15.969979] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:21:15.998774] [DEBUG] [LOCAL ] BAK: Loaded 28792 existing records from primary storage. [2025-09-16T17:21:15.998906] [INFO ] [MAIN ] BAK: Loaded 28792 existing records. [2025-09-16T17:21:16.177916] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:21:16.178160] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-09-16T17:21:16.178207] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-09-16T17:21:16.179197] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-09-16T17:21:16.179251] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-09-16T17:21:16.538602] [INFO ] [REMOTE ] BAK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:21:16.538928] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-09-16T17:21:16.612708] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-09-16T17:21:16.989109] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-16T17:21:16.995244] [INFO ] [REMOTE ] BAH: Full fetch complete (56050 records). [2025-09-16T17:21:16.995431] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-09-16T17:21:16.996497] [FATAL] [VALIDATOR ] BAH: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:21:16.996579] [FATAL] [MAIN ] BAH: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:21:16.996619] [WARN ] [MAIN ] BAH: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:21:16.996688] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-09-16T17:21:16.996750] [DEBUG] [LOCAL ] BAH: No primary data file found to delete. [2025-09-16T17:21:16.996786] [INFO ] [LOCAL ] BAH: Starting deletion of derivative data. [2025-09-16T17:21:16.997127] [DEBUG] [LOCAL ] BAH: Deleted derivative data file. [2025-09-16T17:21:16.999376] [INFO ] [MAIN ] Update Progress: 206/2369 symbols completed. BAH took 23.9s. Estimated remaining: 3h 42m 56s. Rate: 9.7 symbols/min [2025-09-16T17:21:17.191997] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-09-16T17:21:17.194776] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:21:17.197301] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-09-16T17:21:17.204392] [INFO ] [REMOTE ] BAC: Full fetch complete (58488 records). [2025-09-16T17:21:17.204600] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-09-16T17:21:17.539190] [DEBUG] [LOCAL ] BALL: Loaded 38150 existing records from primary storage. [2025-09-16T17:21:17.544820] [INFO ] [MAIN ] BALL: Loaded 38150 existing records. [2025-09-16T17:21:17.732703] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-09-16T17:21:17.733053] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-09-16T17:21:17.744333] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-09-16T17:21:17.754565] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-09-16T17:21:17.812166] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:21:17.812459] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-09-16T17:21:17.812627] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-09-16T17:21:17.812861] [DEBUG] [LOCAL ] BAC: Trimmed 58488 records to 40158 (keeping 150 days of data) [2025-09-16T17:21:17.813959] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-09-16T17:21:17.814017] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-09-16T17:21:18.310108] [INFO ] [REMOTE ] BALL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:21:18.311407] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-09-16T17:21:18.345341] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-16T17:21:18.509803] [DEBUG] [LOCAL ] BAC: Primary data saved (40158 records). [2025-09-16T17:21:18.509945] [INFO ] [MAIN ] BAC: Full history saved. [2025-09-16T17:21:18.511314] [INFO ] [MAIN ] Update Progress: 207/2369 symbols completed. BAC took 27.7s. Estimated remaining: 3h 42m 1s. Rate: 9.7 symbols/min [2025-09-16T17:21:18.686992] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:21:18.697010] [DEBUG] [LOCAL ] BALY: Loaded 7145 existing records from primary storage. [2025-09-16T17:21:18.697137] [INFO ] [MAIN ] BALY: Loaded 7145 existing records. [2025-09-16T17:21:18.788713] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-09-16T17:21:18.878919] [WARN ] [MAIN ] BALY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:21:18.879163] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-09-16T17:21:18.879214] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-16T17:21:18.879527] [DEBUG] [LOCAL ] BALY: Deleted primary data file. [2025-09-16T17:21:18.879574] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-09-16T17:21:19.228309] [INFO ] [REMOTE ] BALY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:21:19.574943] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-09-16T17:21:19.790174] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-16T17:21:19.835042] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.64 seconds). [2025-09-16T17:21:19.841348] [INFO ] [REMOTE ] BABA: Full fetch complete (58500 records). [2025-09-16T17:21:19.841476] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-09-16T17:21:20.148930] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-16T17:21:20.234085] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-09-16T17:21:20.234168] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-09-16T17:21:20.234826] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-09-16T17:21:20.234873] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-09-16T17:21:20.236775] [DEBUG] [LOCAL ] BABA: Trimmed 58500 records to 40170 (keeping 150 days of data) [2025-09-16T17:21:20.372446] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-16T17:21:20.381686] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-09-16T17:21:20.525624] [DEBUG] [LOCAL ] BABA: Primary data saved (40170 records). [2025-09-16T17:21:20.525774] [INFO ] [MAIN ] BABA: Full history saved. [2025-09-16T17:21:20.527869] [INFO ] [MAIN ] Update Progress: 208/2369 symbols completed. BABA took 31.2s. Estimated remaining: 3h 41m 12s. Rate: 9.8 symbols/min [2025-09-16T17:21:20.696624] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:21:20.735137] [DEBUG] [LOCAL ] BAM: Loaded 38250 existing records from primary storage. [2025-09-16T17:21:20.735283] [INFO ] [MAIN ] BAM: Loaded 38250 existing records. [2025-09-16T17:21:20.917989] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:21:20.918427] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-09-16T17:21:20.918478] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-09-16T17:21:20.919828] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-09-16T17:21:20.919880] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-09-16T17:21:21.182992] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-09-16T17:21:21.212809] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-16T17:21:21.295551] [INFO ] [REMOTE ] BAM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:21:21.974919] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-09-16T17:21:22.651714] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-16T17:21:22.774908] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-09-16T17:21:23.025916] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-16T17:21:23.574897] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-09-16T17:21:24.363814] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-16T17:21:24.374839] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-09-16T17:21:24.900878] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-16T17:21:25.174870] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-09-16T17:21:25.804789] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-16T17:21:25.974941] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-09-16T17:21:26.573156] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-16T17:21:26.608621] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-16T17:21:26.774911] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-09-16T17:21:27.574946] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-09-16T17:21:28.374951] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-09-16T17:21:28.551061] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-16T17:21:28.728185] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-16T17:21:29.174938] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-09-16T17:21:29.432778] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-16T17:21:29.974942] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-09-16T17:21:30.299831] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-16T17:21:30.774933] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-09-16T17:21:31.302256] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-16T17:21:31.574922] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-09-16T17:21:31.842454] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-16T17:21:32.374909] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-09-16T17:21:33.174897] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-09-16T17:21:33.276246] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-16T17:21:33.589534] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-16T17:21:33.594139] [INFO ] [REMOTE ] BAK: Full fetch complete (42228 records). [2025-09-16T17:21:33.594275] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-09-16T17:21:33.977905] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-09-16T17:21:33.978156] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-09-16T17:21:33.979145] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-09-16T17:21:33.979876] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-09-16T17:21:33.980030] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-09-16T17:21:33.981473] [DEBUG] [LOCAL ] BAK: Trimmed 42228 records to 29020 (keeping 150 days of data) [2025-09-16T17:21:34.161973] [DEBUG] [LOCAL ] BAK: Primary data saved (29020 records). [2025-09-16T17:21:34.162136] [INFO ] [MAIN ] BAK: Full history saved. [2025-09-16T17:21:34.162250] [INFO ] [MAIN ] Update Progress: 209/2369 symbols completed. BAK took 18.4s. Estimated remaining: 3h 42m 23s. Rate: 9.7 symbols/min [2025-09-16T17:21:34.339580] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:21:34.377525] [DEBUG] [LOCAL ] BANC: Loaded 37542 existing records from primary storage. [2025-09-16T17:21:34.377714] [INFO ] [MAIN ] BANC: Loaded 37542 existing records. [2025-09-16T17:21:34.559679] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:21:34.560034] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-09-16T17:21:34.560200] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-09-16T17:21:34.561533] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-09-16T17:21:34.561590] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-09-16T17:21:34.777429] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-09-16T17:21:34.973461] [INFO ] [REMOTE ] BANC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:21:34.979312] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-16T17:21:35.509063] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-16T17:21:35.574986] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-09-16T17:21:36.009408] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-16T17:21:36.374955] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-09-16T17:21:37.174871] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-09-16T17:21:37.267443] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-16T17:21:37.974952] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-09-16T17:21:38.118925] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-16T17:21:38.731758] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-16T17:21:38.774919] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-09-16T17:21:39.268074] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-16T17:21:39.574905] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-09-16T17:21:40.097314] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-16T17:21:40.374919] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-09-16T17:21:40.577973] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-16T17:21:41.174879] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-09-16T17:21:41.252181] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-16T17:21:41.254283] [INFO ] [REMOTE ] BALY: Full fetch complete (9127 records). [2025-09-16T17:21:41.254421] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-09-16T17:21:41.636805] [DEBUG] [VALIDATOR ] BALY: All expected trading days are present. [2025-09-16T17:21:41.636900] [DEBUG] [VALIDATOR ] BALY: Primary data validation passed. [2025-09-16T17:21:41.637168] [INFO ] [MAIN ] BALY: Fetched primary data is valid. [2025-09-16T17:21:41.637224] [DEBUG] [LOCAL ] BALY: Saving primary data. [2025-09-16T17:21:41.637800] [DEBUG] [LOCAL ] BALY: Trimmed 9127 records to 7203 (keeping 150 days of data) [2025-09-16T17:21:41.680922] [DEBUG] [LOCAL ] BALY: Primary data saved (7203 records). [2025-09-16T17:21:41.681043] [INFO ] [MAIN ] BALY: Full history saved. [2025-09-16T17:21:41.681140] [INFO ] [MAIN ] Update Progress: 210/2369 symbols completed. BALY took 23.2s. Estimated remaining: 3h 42m 31s. Rate: 9.7 symbols/min [2025-09-16T17:21:41.870515] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:21:41.889927] [DEBUG] [LOCAL ] BAP: Loaded 18874 existing records from primary storage. [2025-09-16T17:21:41.890096] [INFO ] [MAIN ] BAP: Loaded 18874 existing records. [2025-09-16T17:21:41.982171] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-09-16T17:21:42.095859] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:21:42.096115] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-09-16T17:21:42.096162] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-09-16T17:21:42.096955] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-09-16T17:21:42.097007] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-09-16T17:21:42.473758] [INFO ] [REMOTE ] BAP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:21:42.663733] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-16T17:21:42.774900] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-09-16T17:21:43.465959] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-16T17:21:43.574895] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-09-16T17:21:44.306575] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-16T17:21:44.374848] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-09-16T17:21:45.174949] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-09-16T17:21:45.247216] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-16T17:21:45.901187] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-16T17:21:45.907621] [INFO ] [REMOTE ] BAM: Full fetch complete (56556 records). [2025-09-16T17:21:45.907758] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-09-16T17:21:45.983549] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-09-16T17:21:46.292746] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-09-16T17:21:46.292839] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-09-16T17:21:46.293535] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-09-16T17:21:46.293611] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-09-16T17:21:46.294948] [DEBUG] [LOCAL ] BAM: Trimmed 56556 records to 38634 (keeping 150 days of data) [2025-09-16T17:21:46.543375] [DEBUG] [LOCAL ] BAM: Primary data saved (38634 records). [2025-09-16T17:21:46.543512] [INFO ] [MAIN ] BAM: Full history saved. [2025-09-16T17:21:46.543592] [INFO ] [MAIN ] Update Progress: 211/2369 symbols completed. BAM took 26.0s. Estimated remaining: 3h 42m 11s. Rate: 9.7 symbols/min [2025-09-16T17:21:46.714840] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:21:46.715029] [DEBUG] [LOCAL ] BARK: No existing data file found in primary storage. [2025-09-16T17:21:46.715068] [WARN ] [MAIN ] BARK: No existing data found, performing full refresh instead. [2025-09-16T17:21:46.715192] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-09-16T17:21:46.715230] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-09-16T17:21:46.715272] [DEBUG] [LOCAL ] BARK: No primary data file found to delete. [2025-09-16T17:21:46.715304] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-09-16T17:21:46.778767] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-09-16T17:21:47.077826] [INFO ] [REMOTE ] BARK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:21:47.095057] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-16T17:21:47.101207] [INFO ] [REMOTE ] BALL: Full fetch complete (56473 records). [2025-09-16T17:21:47.101335] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-09-16T17:21:47.498766] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-16T17:21:47.501626] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-09-16T17:21:47.507097] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-09-16T17:21:47.507748] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-09-16T17:21:47.507797] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-09-16T17:21:47.508933] [DEBUG] [LOCAL ] BALL: Trimmed 56473 records to 38534 (keeping 150 days of data) [2025-09-16T17:21:47.575604] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-09-16T17:21:47.748031] [DEBUG] [LOCAL ] BALL: Primary data saved (38534 records). [2025-09-16T17:21:47.748186] [INFO ] [MAIN ] BALL: Full history saved. [2025-09-16T17:21:47.749276] [INFO ] [MAIN ] Update Progress: 212/2369 symbols completed. BALL took 30.7s. Estimated remaining: 3h 41m 14s. Rate: 9.7 symbols/min [2025-09-16T17:21:47.924897] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:21:47.925100] [DEBUG] [LOCAL ] BAX: No existing data file found in primary storage. [2025-09-16T17:21:47.925139] [WARN ] [MAIN ] BAX: No existing data found, performing full refresh instead. [2025-09-16T17:21:47.925275] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-09-16T17:21:47.925315] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-09-16T17:21:47.925356] [DEBUG] [LOCAL ] BAX: No primary data file found to delete. [2025-09-16T17:21:47.925389] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-09-16T17:21:48.279792] [INFO ] [REMOTE ] BAX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:21:48.317159] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-16T17:21:48.374906] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-09-16T17:21:49.106356] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-16T17:21:49.174926] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-09-16T17:21:49.895441] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-16T17:21:49.974938] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-09-16T17:21:50.548815] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-16T17:21:50.774900] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-09-16T17:21:51.092145] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-16T17:21:51.574909] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-09-16T17:21:52.374942] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-09-16T17:21:52.739680] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-16T17:21:53.174923] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-09-16T17:21:53.228248] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-16T17:21:53.371043] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-16T17:21:53.974896] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-09-16T17:21:54.374164] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-16T17:21:54.380170] [INFO ] [REMOTE ] BANC: Full fetch complete (55599 records). [2025-09-16T17:21:54.380269] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-09-16T17:21:54.755493] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-09-16T17:21:54.755570] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-09-16T17:21:54.756186] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-09-16T17:21:54.756232] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-09-16T17:21:54.757331] [DEBUG] [LOCAL ] BANC: Trimmed 55599 records to 37899 (keeping 150 days of data) [2025-09-16T17:21:54.813932] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-09-16T17:21:54.884252] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-16T17:21:55.014624] [DEBUG] [LOCAL ] BANC: Primary data saved (37899 records). [2025-09-16T17:21:55.014790] [INFO ] [MAIN ] BANC: Full history saved. [2025-09-16T17:21:55.014890] [INFO ] [MAIN ] Update Progress: 213/2369 symbols completed. BANC took 20.9s. Estimated remaining: 3h 41m 19s. Rate: 9.7 symbols/min [2025-09-16T17:21:55.187753] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:21:55.225490] [DEBUG] [LOCAL ] BB: Loaded 38976 existing records from primary storage. [2025-09-16T17:21:55.225667] [INFO ] [MAIN ] BB: Loaded 38976 existing records. [2025-09-16T17:21:55.401454] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:21:55.401725] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-09-16T17:21:55.401777] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-09-16T17:21:55.403690] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-09-16T17:21:55.403754] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-09-16T17:21:55.581946] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-09-16T17:21:55.756918] [INFO ] [REMOTE ] BB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:21:56.372820] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-16T17:21:56.380692] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-09-16T17:21:57.174871] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-09-16T17:21:57.295907] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-16T17:21:57.374060] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-16T17:21:57.974904] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-09-16T17:21:58.774899] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-09-16T17:21:59.369957] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-09-16T17:21:59.574906] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-09-16T17:21:59.759583] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-16T17:21:59.846594] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-16T17:22:00.374905] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-09-16T17:22:00.516719] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-16T17:22:01.174915] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-09-16T17:22:01.976638] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-09-16T17:22:01.983274] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-16T17:22:02.774891] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-09-16T17:22:02.957772] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-16T17:22:03.238949] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-16T17:22:03.574877] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-09-16T17:22:04.244400] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-16T17:22:04.374945] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-09-16T17:22:04.889605] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-16T17:22:04.893428] [INFO ] [REMOTE ] BAP: Full fetch complete (28711 records). [2025-09-16T17:22:04.893507] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-09-16T17:22:05.181690] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-09-16T17:22:05.290084] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-09-16T17:22:05.290158] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-09-16T17:22:05.290535] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-09-16T17:22:05.290592] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-09-16T17:22:05.291607] [DEBUG] [LOCAL ] BAP: Trimmed 28711 records to 19126 (keeping 150 days of data) [2025-09-16T17:22:05.410054] [DEBUG] [LOCAL ] BAP: Primary data saved (19126 records). [2025-09-16T17:22:05.410194] [INFO ] [MAIN ] BAP: Full history saved. [2025-09-16T17:22:05.410276] [INFO ] [MAIN ] Update Progress: 214/2369 symbols completed. BAP took 23.7s. Estimated remaining: 3h 41m 56s. Rate: 9.7 symbols/min [2025-09-16T17:22:05.579309] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:22:05.622382] [DEBUG] [LOCAL ] BBAI: Loaded 39780 existing records from primary storage. [2025-09-16T17:22:05.622546] [INFO ] [MAIN ] BBAI: Loaded 39780 existing records. [2025-09-16T17:22:05.801458] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:22:05.801746] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-09-16T17:22:05.801801] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-09-16T17:22:05.804324] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-09-16T17:22:05.804400] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-09-16T17:22:05.976128] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-09-16T17:22:06.159017] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:22:06.216412] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-16T17:22:06.774914] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-09-16T17:22:07.136457] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-16T17:22:07.574879] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-09-16T17:22:07.613617] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-16T17:22:08.374994] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-09-16T17:22:09.181154] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-09-16T17:22:09.202353] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-16T17:22:09.343813] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.57 seconds). [2025-09-16T17:22:09.942247] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-16T17:22:09.974864] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-09-16T17:22:10.774949] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-09-16T17:22:11.159724] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-16T17:22:11.192354] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-16T17:22:11.574924] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-09-16T17:22:12.312707] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-16T17:22:12.319197] [INFO ] [REMOTE ] BAX: Full fetch complete (58161 records). [2025-09-16T17:22:12.319306] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-09-16T17:22:12.383822] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-09-16T17:22:12.720786] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present. [2025-09-16T17:22:12.720901] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed. [2025-09-16T17:22:12.722150] [INFO ] [MAIN ] BAX: Fetched primary data is valid. [2025-09-16T17:22:12.722205] [DEBUG] [LOCAL ] BAX: Saving primary data. [2025-09-16T17:22:12.723807] [DEBUG] [LOCAL ] BAX: Trimmed 58161 records to 39905 (keeping 150 days of data) [2025-09-16T17:22:12.964078] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-16T17:22:12.970112] [INFO ] [REMOTE ] BARK: Full fetch complete (42111 records). [2025-09-16T17:22:12.970794] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-09-16T17:22:13.179272] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-09-16T17:22:13.400354] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-09-16T17:22:13.400804] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-09-16T17:22:13.402260] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-09-16T17:22:13.402609] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-09-16T17:22:13.406959] [DEBUG] [LOCAL ] BARK: Trimmed 42111 records to 28629 (keeping 150 days of data) [2025-09-16T17:22:13.500037] [DEBUG] [LOCAL ] BAX: Primary data saved (39905 records). [2025-09-16T17:22:13.502135] [INFO ] [MAIN ] BAX: Full history saved. [2025-09-16T17:22:13.502947] [INFO ] [MAIN ] Update Progress: 215/2369 symbols completed. BAX took 25.8s. Estimated remaining: 3h 42m 9s. Rate: 9.7 symbols/min [2025-09-16T17:22:13.693038] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:22:13.767821] [DEBUG] [LOCAL ] BBAR: Loaded 30538 existing records from primary storage. [2025-09-16T17:22:13.769897] [INFO ] [MAIN ] BBAR: Loaded 30538 existing records. [2025-09-16T17:22:13.960943] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:22:13.969415] [DEBUG] [LOCAL ] BARK: Primary data saved (28629 records). [2025-09-16T17:22:13.969855] [INFO ] [MAIN ] BARK: Full history saved. [2025-09-16T17:22:13.969996] [INFO ] [MAIN ] Update Progress: 216/2369 symbols completed. BARK took 27.4s. Estimated remaining: 3h 41m 6s. Rate: 9.7 symbols/min [2025-09-16T17:22:13.969615] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-09-16T17:22:13.970177] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-09-16T17:22:13.975781] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-09-16T17:22:14.036724] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-09-16T17:22:14.272886] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:22:14.540035] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:22:14.540433] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-09-16T17:22:14.554827] [DEBUG] [LOCAL ] BBD: Loaded 39316 existing records from primary storage. [2025-09-16T17:22:14.554987] [INFO ] [MAIN ] BBD: Loaded 39316 existing records. [2025-09-16T17:22:14.740610] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:22:14.741013] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-09-16T17:22:14.741116] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-09-16T17:22:14.742805] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-09-16T17:22:14.742866] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-09-16T17:22:15.018933] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.64 seconds). [2025-09-16T17:22:15.074348] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-09-16T17:22:15.147867] [INFO ] [REMOTE ] BBD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:22:15.183827] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-16T17:22:15.574908] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-09-16T17:22:15.947149] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-16T17:22:16.374915] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-09-16T17:22:17.175032] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-09-16T17:22:17.313022] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-16T17:22:17.431220] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-16T17:22:17.974908] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-09-16T17:22:18.160622] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-16T17:22:18.370355] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-16T17:22:18.774927] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-09-16T17:22:19.574929] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-09-16T17:22:20.374954] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-09-16T17:22:20.694085] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-16T17:22:20.817233] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.84 seconds). [2025-09-16T17:22:20.920194] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-16T17:22:21.174932] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-09-16T17:22:21.723387] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-16T17:22:21.974914] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-09-16T17:22:22.746742] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-16T17:22:22.774843] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-09-16T17:22:23.574883] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-09-16T17:22:23.985169] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-16T17:22:23.991719] [INFO ] [REMOTE ] BB: Full fetch complete (57610 records). [2025-09-16T17:22:23.991835] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-09-16T17:22:24.382121] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-09-16T17:22:24.384161] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-09-16T17:22:24.384286] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-09-16T17:22:24.385009] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-09-16T17:22:24.385062] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-09-16T17:22:24.387756] [DEBUG] [LOCAL ] BB: Trimmed 57610 records to 39362 (keeping 150 days of data) [2025-09-16T17:22:24.558327] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-16T17:22:24.682984] [DEBUG] [LOCAL ] BB: Primary data saved (39362 records). [2025-09-16T17:22:24.683174] [INFO ] [MAIN ] BB: Full history saved. [2025-09-16T17:22:24.683342] [INFO ] [MAIN ] Update Progress: 217/2369 symbols completed. BB took 29.7s. Estimated remaining: 3h 41m 45s. Rate: 9.7 symbols/min [2025-09-16T17:22:24.861930] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:22:24.888258] [DEBUG] [LOCAL ] BBDC: Loaded 23228 existing records from primary storage. [2025-09-16T17:22:24.888411] [INFO ] [MAIN ] BBDC: Loaded 23228 existing records. [2025-09-16T17:22:25.072227] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:22:25.072502] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-09-16T17:22:25.072551] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-09-16T17:22:25.074123] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-09-16T17:22:25.074194] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-09-16T17:22:25.179980] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-09-16T17:22:25.447378] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:22:25.579371] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-16T17:22:25.974941] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-09-16T17:22:26.205589] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.63 seconds). [2025-09-16T17:22:26.777682] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-09-16T17:22:26.780310] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-16T17:22:27.561168] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-16T17:22:27.574910] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-09-16T17:22:28.375013] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-09-16T17:22:28.952075] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-16T17:22:29.174969] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-09-16T17:22:29.543098] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (2.77 seconds). [2025-09-16T17:22:29.974965] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-09-16T17:22:30.336071] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-16T17:22:30.414118] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-16T17:22:30.774903] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-09-16T17:22:31.574952] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-09-16T17:22:32.324408] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-09-16T17:22:32.363700] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-16T17:22:32.368982] [INFO ] [REMOTE ] BBAR: Full fetch complete (44658 records). [2025-09-16T17:22:32.369082] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-09-16T17:22:32.381288] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-09-16T17:22:32.771177] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-09-16T17:22:32.771393] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-09-16T17:22:32.771974] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-09-16T17:22:32.772031] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-09-16T17:22:32.784079] [DEBUG] [LOCAL ] BBAR: Trimmed 44658 records to 30859 (keeping 150 days of data) [2025-09-16T17:22:32.802083] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-16T17:22:32.997918] [DEBUG] [LOCAL ] BBAR: Primary data saved (30859 records). [2025-09-16T17:22:32.998062] [INFO ] [MAIN ] BBAR: Full history saved. [2025-09-16T17:22:32.999125] [INFO ] [MAIN ] Update Progress: 218/2369 symbols completed. BBAR took 19.5s. Estimated remaining: 3h 41m 60s. Rate: 9.7 symbols/min [2025-09-16T17:22:33.169399] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:22:33.175520] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-09-16T17:22:33.175857] [DEBUG] [LOCAL ] BBDO: Loaded 3549 existing records from primary storage. [2025-09-16T17:22:33.176824] [INFO ] [MAIN ] BBDO: Loaded 3549 existing records. [2025-09-16T17:22:33.356395] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:22:33.356694] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-09-16T17:22:33.356743] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-09-16T17:22:33.357039] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-09-16T17:22:33.357083] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-09-16T17:22:33.723820] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:22:33.896361] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-16T17:22:33.974929] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-09-16T17:22:34.774935] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-09-16T17:22:35.118302] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-16T17:22:35.574926] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-09-16T17:22:35.923880] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (2.75 seconds). [2025-09-16T17:22:35.932370] [INFO ] [REMOTE ] BBAI: Full fetch complete (58500 records). [2025-09-16T17:22:35.932550] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-09-16T17:22:36.238484] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-16T17:22:36.327814] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-09-16T17:22:36.327884] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-09-16T17:22:36.328534] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-09-16T17:22:36.328580] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-09-16T17:22:36.329733] [DEBUG] [LOCAL ] BBAI: Trimmed 58500 records to 40170 (keeping 150 days of data) [2025-09-16T17:22:36.385501] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-09-16T17:22:36.566839] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-16T17:22:36.575212] [INFO ] [REMOTE ] BBD: Full fetch complete (57832 records). [2025-09-16T17:22:36.576170] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-09-16T17:22:37.005281] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-09-16T17:22:37.005778] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-09-16T17:22:37.007266] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-09-16T17:22:37.012813] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-09-16T17:22:37.012948] [DEBUG] [LOCAL ] BBAI: Primary data saved (40170 records). [2025-09-16T17:22:37.013107] [INFO ] [MAIN ] BBAI: Full history saved. [2025-09-16T17:22:37.014762] [INFO ] [MAIN ] Update Progress: 219/2369 symbols completed. BBAI took 31.6s. Estimated remaining: 3h 41m 32s. Rate: 9.7 symbols/min [2025-09-16T17:22:37.065694] [DEBUG] [LOCAL ] BBD: Trimmed 57832 records to 39702 (keeping 150 days of data) [2025-09-16T17:22:37.208217] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-09-16T17:22:37.302934] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:22:37.322224] [DEBUG] [LOCAL ] BBN: Loaded 13404 existing records from primary storage. [2025-09-16T17:22:37.322845] [INFO ] [MAIN ] BBN: Loaded 13404 existing records. [2025-09-16T17:22:37.531441] [WARN ] [MAIN ] BBN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:22:37.533537] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-09-16T17:22:37.534946] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-09-16T17:22:37.537254] [DEBUG] [LOCAL ] BBN: Deleted primary data file. [2025-09-16T17:22:37.537424] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-09-16T17:22:38.015868] [INFO ] [REMOTE ] BBN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:22:38.016610] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-09-16T17:22:38.017096] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-16T17:22:38.046250] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-16T17:22:38.087839] [DEBUG] [LOCAL ] BBD: Primary data saved (39702 records). [2025-09-16T17:22:38.088003] [INFO ] [MAIN ] BBD: Full history saved. [2025-09-16T17:22:38.088093] [INFO ] [MAIN ] Update Progress: 220/2369 symbols completed. BBD took 24.1s. Estimated remaining: 3h 40m 36s. Rate: 9.7 symbols/min [2025-09-16T17:22:38.268229] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:22:38.268446] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-09-16T17:22:38.268485] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-09-16T17:22:38.268607] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-09-16T17:22:38.268666] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-16T17:22:38.268711] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-16T17:22:38.268753] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-09-16T17:22:38.635083] [INFO ] [REMOTE ] BBT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:22:38.762529] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-16T17:22:38.774841] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-09-16T17:22:39.400137] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-16T17:22:39.574878] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-09-16T17:22:40.374937] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-09-16T17:22:40.384773] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-16T17:22:41.174929] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-09-16T17:22:41.271793] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-16T17:22:41.911099] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-16T17:22:41.974878] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-02. [2025-09-16T17:22:42.214918] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:22:42.215222] [WARN ] [REMOTE ] BBT: No data returned for month 2025-02 [2025-09-16T17:22:42.774891] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-03. [2025-09-16T17:22:42.989694] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:22:42.990002] [WARN ] [REMOTE ] BBT: No data returned for month 2025-03 [2025-09-16T17:22:43.574901] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-09-16T17:22:44.374946] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-09-16T17:22:44.506565] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-16T17:22:45.108059] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-16T17:22:45.174911] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-04. [2025-09-16T17:22:45.414475] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:22:45.414808] [WARN ] [REMOTE ] BBT: No data returned for month 2025-04 [2025-09-16T17:22:45.974897] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-09-16T17:22:46.774906] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-09-16T17:22:47.178050] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-16T17:22:47.279506] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-16T17:22:47.574904] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-09-16T17:22:48.374906] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-05. [2025-09-16T17:22:48.482262] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-16T17:22:48.587400] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:22:48.587793] [WARN ] [REMOTE ] BBT: No data returned for month 2025-05 [2025-09-16T17:22:49.174895] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-06. [2025-09-16T17:22:49.449695] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:22:49.450019] [WARN ] [REMOTE ] BBT: No data returned for month 2025-06 [2025-09-16T17:22:49.974900] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-09-16T17:22:50.774937] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-09-16T17:22:50.854592] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-16T17:22:51.203635] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-16T17:22:51.574900] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-09-16T17:22:51.958811] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-16T17:22:52.374905] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-07. [2025-09-16T17:22:52.603204] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:22:52.603503] [WARN ] [REMOTE ] BBT: No data returned for month 2025-07 [2025-09-16T17:22:53.174915] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-09-16T17:22:53.974906] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-09-16T17:22:54.556799] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-16T17:22:54.561331] [INFO ] [REMOTE ] BBDC: Full fetch complete (36808 records). [2025-09-16T17:22:54.561440] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-09-16T17:22:54.780092] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-09-16T17:22:54.953515] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-16T17:22:54.952599] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-09-16T17:22:54.957377] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-09-16T17:22:54.958210] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-09-16T17:22:54.958278] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-09-16T17:22:54.959443] [DEBUG] [LOCAL ] BBDC: Trimmed 36808 records to 23506 (keeping 150 days of data) [2025-09-16T17:22:55.103267] [DEBUG] [LOCAL ] BBDC: Primary data saved (23506 records). [2025-09-16T17:22:55.103402] [INFO ] [MAIN ] BBDC: Full history saved. [2025-09-16T17:22:55.103497] [INFO ] [MAIN ] Update Progress: 221/2369 symbols completed. BBDC took 30.4s. Estimated remaining: 3h 42m 15s. Rate: 9.7 symbols/min [2025-09-16T17:22:55.280196] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:22:55.280396] [DEBUG] [LOCAL ] BBU: No existing data file found in primary storage. [2025-09-16T17:22:55.280437] [WARN ] [MAIN ] BBU: No existing data found, performing full refresh instead. [2025-09-16T17:22:55.280599] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-09-16T17:22:55.280668] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-09-16T17:22:55.280724] [DEBUG] [LOCAL ] BBU: No primary data file found to delete. [2025-09-16T17:22:55.280760] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-09-16T17:22:55.391241] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-16T17:22:55.403223] [INFO ] [REMOTE ] BBDO: Full fetch complete (5511 records). [2025-09-16T17:22:55.418680] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-09-16T17:22:55.591248] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-09-16T17:22:55.949998] [INFO ] [REMOTE ] BBU: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:22:56.027358] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-09-16T17:22:56.027438] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-09-16T17:22:56.027593] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-09-16T17:22:56.027634] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-09-16T17:22:56.028056] [DEBUG] [LOCAL ] BBDO: Trimmed 5511 records to 3607 (keeping 150 days of data) [2025-09-16T17:22:56.050141] [DEBUG] [LOCAL ] BBDO: Primary data saved (3607 records). [2025-09-16T17:22:56.050274] [INFO ] [MAIN ] BBDO: Full history saved. [2025-09-16T17:22:56.050369] [INFO ] [MAIN ] Update Progress: 222/2369 symbols completed. BBDO took 23.1s. Estimated remaining: 3h 41m 18s. Rate: 9.7 symbols/min [2025-09-16T17:22:56.267025] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:22:56.278153] [DEBUG] [LOCAL ] BBUC: Loaded 9248 existing records from primary storage. [2025-09-16T17:22:56.278275] [INFO ] [MAIN ] BBUC: Loaded 9248 existing records. [2025-09-16T17:22:56.379994] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-09-16T17:22:56.469216] [WARN ] [MAIN ] BBUC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:22:56.469604] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-09-16T17:22:56.469686] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-09-16T17:22:56.470160] [DEBUG] [LOCAL ] BBUC: Deleted primary data file. [2025-09-16T17:22:56.470217] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-09-16T17:22:56.595139] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-16T17:22:56.860411] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:22:57.132051] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-16T17:22:57.174899] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-09-16T17:22:57.809093] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-16T17:22:57.974910] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-09-16T17:22:58.774922] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-09-16T17:22:58.798468] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-16T17:22:59.574940] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-08. [2025-09-16T17:23:00.374897] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-09-16T17:23:01.174901] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-09-16T17:23:03.463329] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:23:03.463635] [WARN ] [REMOTE ] BBT: No data returned for month 2025-08 [2025-09-16T17:23:03.464132] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-09. [2025-09-16T17:23:04.516080] [INFO ] [REMOTE ] BBT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-16T17:23:04.521066] [INFO ] [REMOTE ] BBT: Full fetch complete (3381 records). [2025-09-16T17:23:04.521166] [DEBUG] [VALIDATOR ] BBT: Validating primary data. [2025-09-16T17:23:04.641760] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (3.47 seconds). [2025-09-16T17:23:04.643687] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-09-16T17:23:04.730227] [WARN ] [VALIDATOR ] BBT: Validation failed - insufficient historical data. Have 11 unique days, need 150 days [2025-09-16T17:23:04.731098] [FATAL] [MAIN ] BBT: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:23:04.742441] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:23:04.743030] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-16T17:23:04.743466] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (5.97 seconds). [2025-09-16T17:23:04.747699] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-16T17:23:04.748149] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-09-16T17:23:04.748422] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-09-16T17:23:04.748599] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-09-16T17:23:04.749496] [INFO ] [MAIN ] Update Progress: 223/2369 symbols completed. BBT took 26.7s. Estimated remaining: 3h 41m 36s. Rate: 9.7 symbols/min [2025-09-16T17:23:04.929750] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:23:04.968369] [DEBUG] [LOCAL ] BBVA: Loaded 36011 existing records from primary storage. [2025-09-16T17:23:04.968511] [INFO ] [MAIN ] BBVA: Loaded 36011 existing records. [2025-09-16T17:23:05.158627] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-16T17:23:05.163931] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-09-16T17:23:05.164121] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:23:05.165348] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-09-16T17:23:05.173125] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-09-16T17:23:05.175403] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (4.80 seconds). [2025-09-16T17:23:05.178770] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-09-16T17:23:05.179345] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-09-16T17:23:05.179403] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-09-16T17:23:05.541197] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-16T17:23:05.546122] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:23:05.620052] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-16T17:23:05.622735] [INFO ] [REMOTE ] BBN: Full fetch complete (19511 records). [2025-09-16T17:23:05.622813] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-09-16T17:23:05.983768] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-09-16T17:23:05.994020] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-09-16T17:23:06.002008] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-09-16T17:23:06.002371] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-09-16T17:23:06.002849] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-09-16T17:23:06.003111] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-16T17:23:06.007241] [DEBUG] [LOCAL ] BBN: Trimmed 19511 records to 13520 (keeping 150 days of data) [2025-09-16T17:23:06.088978] [DEBUG] [LOCAL ] BBN: Primary data saved (13520 records). [2025-09-16T17:23:06.089111] [INFO ] [MAIN ] BBN: Full history saved. [2025-09-16T17:23:06.089195] [INFO ] [MAIN ] Update Progress: 224/2369 symbols completed. BBN took 29.1s. Estimated remaining: 3h 40m 43s. Rate: 9.7 symbols/min [2025-09-16T17:23:06.262994] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:23:06.280708] [DEBUG] [LOCAL ] BBW: Loaded 18611 existing records from primary storage. [2025-09-16T17:23:06.280820] [INFO ] [MAIN ] BBW: Loaded 18611 existing records. [2025-09-16T17:23:06.454002] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:23:06.454243] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-09-16T17:23:06.454288] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-09-16T17:23:06.454907] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-09-16T17:23:06.454955] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-09-16T17:23:06.783809] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-09-16T17:23:06.802480] [INFO ] [REMOTE ] BBW: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:23:07.294786] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-16T17:23:07.574897] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-09-16T17:23:07.896230] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-16T17:23:08.374869] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-09-16T17:23:08.786383] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-16T17:23:09.165480] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-16T17:23:09.174846] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-09-16T17:23:09.974898] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-09-16T17:23:10.544045] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-16T17:23:10.774907] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-09-16T17:23:10.912185] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-16T17:23:11.574912] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-09-16T17:23:11.920665] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-16T17:23:12.112038] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-16T17:23:12.374924] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-09-16T17:23:13.109005] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-16T17:23:13.174927] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-09-16T17:23:13.795866] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-16T17:23:13.974931] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-09-16T17:23:14.539838] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-16T17:23:14.541688] [INFO ] [REMOTE ] BBUC: Full fetch complete (14114 records). [2025-09-16T17:23:14.541759] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-09-16T17:23:14.779988] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-09-16T17:23:14.914264] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present. [2025-09-16T17:23:14.914341] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed. [2025-09-16T17:23:14.914608] [INFO ] [MAIN ] BBUC: Fetched primary data is valid. [2025-09-16T17:23:14.914668] [DEBUG] [LOCAL ] BBUC: Saving primary data. [2025-09-16T17:23:14.915157] [DEBUG] [LOCAL ] BBUC: Trimmed 14114 records to 9313 (keeping 150 days of data) [2025-09-16T17:23:14.974037] [DEBUG] [LOCAL ] BBUC: Primary data saved (9313 records). [2025-09-16T17:23:14.974193] [INFO ] [MAIN ] BBUC: Full history saved. [2025-09-16T17:23:14.974281] [INFO ] [MAIN ] Update Progress: 225/2369 symbols completed. BBUC took 18.9s. Estimated remaining: 3h 41m 3s. Rate: 9.7 symbols/min [2025-09-16T17:23:15.146860] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:23:15.186024] [DEBUG] [LOCAL ] BBWI: Loaded 39551 existing records from primary storage. [2025-09-16T17:23:15.186198] [INFO ] [MAIN ] BBWI: Loaded 39551 existing records. [2025-09-16T17:23:15.362915] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:23:15.363146] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-09-16T17:23:15.363194] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-09-16T17:23:15.364322] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-09-16T17:23:15.364376] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-09-16T17:23:15.580044] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-09-16T17:23:15.726540] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:23:16.125041] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-16T17:23:16.374912] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-09-16T17:23:16.859579] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-16T17:23:16.860850] [INFO ] [REMOTE ] BBU: Full fetch complete (4407 records). [2025-09-16T17:23:16.860921] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-09-16T17:23:17.186074] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-09-16T17:23:17.223824] [DEBUG] [VALIDATOR ] BBU: All expected trading days are present. [2025-09-16T17:23:17.223989] [DEBUG] [VALIDATOR ] BBU: Primary data validation passed. [2025-09-16T17:23:17.224235] [INFO ] [MAIN ] BBU: Fetched primary data is valid. [2025-09-16T17:23:17.224413] [DEBUG] [LOCAL ] BBU: Saving primary data. [2025-09-16T17:23:17.225031] [DEBUG] [LOCAL ] BBU: Trimmed 4407 records to 3205 (keeping 150 days of data) [2025-09-16T17:23:17.272071] [DEBUG] [LOCAL ] BBU: Primary data saved (3205 records). [2025-09-16T17:23:17.272230] [INFO ] [MAIN ] BBU: Full history saved. [2025-09-16T17:23:17.272395] [INFO ] [MAIN ] Update Progress: 226/2369 symbols completed. BBU took 22.2s. Estimated remaining: 3h 40m 20s. Rate: 9.7 symbols/min [2025-09-16T17:23:17.273965] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-16T17:23:17.459673] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:23:17.459879] [DEBUG] [LOCAL ] BBY: No existing data file found in primary storage. [2025-09-16T17:23:17.459920] [WARN ] [MAIN ] BBY: No existing data found, performing full refresh instead. [2025-09-16T17:23:17.460044] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-09-16T17:23:17.460084] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-09-16T17:23:17.460128] [DEBUG] [LOCAL ] BBY: No primary data file found to delete. [2025-09-16T17:23:17.460164] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-09-16T17:23:17.826572] [INFO ] [REMOTE ] BBY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:23:17.974871] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-09-16T17:23:18.774919] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-09-16T17:23:18.979229] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-16T17:23:19.574951] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-09-16T17:23:19.855933] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-16T17:23:20.374927] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-09-16T17:23:20.536817] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-16T17:23:20.590703] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-16T17:23:21.174973] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-09-16T17:23:21.786104] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-16T17:23:21.974982] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-09-16T17:23:22.744918] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-16T17:23:22.774913] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-09-16T17:23:22.827962] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-16T17:23:23.574904] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-09-16T17:23:23.895473] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-16T17:23:24.374909] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-09-16T17:23:25.174955] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-09-16T17:23:25.288389] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-16T17:23:25.728022] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-16T17:23:25.974916] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-09-16T17:23:26.024292] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-16T17:23:26.774960] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-09-16T17:23:27.434902] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-16T17:23:27.574959] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-09-16T17:23:28.248194] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-16T17:23:28.252620] [INFO ] [REMOTE ] BBW: Full fetch complete (28546 records). [2025-09-16T17:23:28.252783] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-09-16T17:23:28.379995] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-09-16T17:23:28.618125] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-09-16T17:23:28.618200] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-09-16T17:23:28.618569] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-09-16T17:23:28.618610] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-09-16T17:23:28.619272] [DEBUG] [LOCAL ] BBW: Trimmed 28546 records to 18907 (keeping 150 days of data) [2025-09-16T17:23:28.731159] [DEBUG] [LOCAL ] BBW: Primary data saved (18907 records). [2025-09-16T17:23:28.731294] [INFO ] [MAIN ] BBW: Full history saved. [2025-09-16T17:23:28.731375] [INFO ] [MAIN ] Update Progress: 227/2369 symbols completed. BBW took 22.6s. Estimated remaining: 3h 41m 4s. Rate: 9.7 symbols/min [2025-09-16T17:23:28.904447] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:23:28.940105] [DEBUG] [LOCAL ] BC: Loaded 32606 existing records from primary storage. [2025-09-16T17:23:28.940241] [INFO ] [MAIN ] BC: Loaded 32606 existing records. [2025-09-16T17:23:29.116558] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:23:29.116818] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-09-16T17:23:29.116865] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-09-16T17:23:29.117790] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-09-16T17:23:29.117841] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-09-16T17:23:29.180136] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-09-16T17:23:29.474656] [INFO ] [REMOTE ] BC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:23:29.503526] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-16T17:23:29.974905] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-09-16T17:23:30.307491] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-16T17:23:30.774881] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-09-16T17:23:30.989623] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-16T17:23:31.317236] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-16T17:23:31.322945] [INFO ] [REMOTE ] BBVA: Full fetch complete (53901 records). [2025-09-16T17:23:31.323036] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-09-16T17:23:31.580076] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-09-16T17:23:31.703741] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-09-16T17:23:31.703820] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-09-16T17:23:31.704382] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-09-16T17:23:31.704424] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-09-16T17:23:31.705449] [DEBUG] [LOCAL ] BBVA: Trimmed 53901 records to 36371 (keeping 150 days of data) [2025-09-16T17:23:31.926793] [DEBUG] [LOCAL ] BBVA: Primary data saved (36371 records). [2025-09-16T17:23:31.927065] [INFO ] [MAIN ] BBVA: Full history saved. [2025-09-16T17:23:31.927160] [INFO ] [MAIN ] Update Progress: 228/2369 symbols completed. BBVA took 27.2s. Estimated remaining: 3h 40m 30s. Rate: 9.7 symbols/min [2025-09-16T17:23:32.097542] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:23:32.121358] [DEBUG] [LOCAL ] BCAT: Loaded 25058 existing records from primary storage. [2025-09-16T17:23:32.121474] [INFO ] [MAIN ] BCAT: Loaded 25058 existing records. [2025-09-16T17:23:32.296425] [WARN ] [MAIN ] BCAT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:23:32.296680] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-09-16T17:23:32.296724] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-09-16T17:23:32.297601] [DEBUG] [LOCAL ] BCAT: Deleted primary data file. [2025-09-16T17:23:32.297672] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-09-16T17:23:32.387457] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-09-16T17:23:32.658427] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:23:32.693559] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-16T17:23:33.074015] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-16T17:23:33.174859] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-09-16T17:23:33.519982] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-16T17:23:33.974896] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-09-16T17:23:34.774882] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-09-16T17:23:34.809961] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-16T17:23:35.567493] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-16T17:23:35.577817] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-09-16T17:23:36.032436] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-16T17:23:36.374916] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-09-16T17:23:36.781971] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-16T17:23:37.174905] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-09-16T17:23:37.974930] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-09-16T17:23:37.974867] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-16T17:23:38.249999] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-16T17:23:38.774896] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-09-16T17:23:39.577391] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-09-16T17:23:39.579336] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-16T17:23:39.585947] [INFO ] [REMOTE ] BBWI: Full fetch complete (58231 records). [2025-09-16T17:23:39.586050] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-09-16T17:23:40.006206] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-09-16T17:23:40.006424] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-09-16T17:23:40.008183] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-16T17:23:40.007440] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-09-16T17:23:40.008310] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-09-16T17:23:40.016522] [DEBUG] [LOCAL ] BBWI: Trimmed 58231 records to 39941 (keeping 150 days of data) [2025-09-16T17:23:40.259766] [DEBUG] [LOCAL ] BBWI: Primary data saved (39941 records). [2025-09-16T17:23:40.259901] [INFO ] [MAIN ] BBWI: Full history saved. [2025-09-16T17:23:40.261545] [INFO ] [MAIN ] Update Progress: 229/2369 symbols completed. BBWI took 25.3s. Estimated remaining: 3h 40m 43s. Rate: 9.7 symbols/min [2025-09-16T17:23:40.380028] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-09-16T17:23:40.440403] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:23:40.461211] [DEBUG] [LOCAL ] BCC: Loaded 20178 existing records from primary storage. [2025-09-16T17:23:40.461337] [INFO ] [MAIN ] BCC: Loaded 20178 existing records. [2025-09-16T17:23:40.637296] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:23:40.637523] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-09-16T17:23:40.637568] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-09-16T17:23:40.638150] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-09-16T17:23:40.638197] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-09-16T17:23:40.991918] [INFO ] [REMOTE ] BCC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:23:41.174860] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-09-16T17:23:41.220135] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-16T17:23:41.637500] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-16T17:23:41.974914] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-09-16T17:23:42.490236] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-16T17:23:42.774984] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-09-16T17:23:43.228447] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-16T17:23:43.574969] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-09-16T17:23:44.210404] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-16T17:23:44.374876] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-09-16T17:23:44.834394] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-16T17:23:45.174916] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-09-16T17:23:45.880794] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-16T17:23:45.974939] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-09-16T17:23:46.774922] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-09-16T17:23:47.220401] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-16T17:23:47.475815] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-16T17:23:47.567617] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-16T17:23:47.574846] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-09-16T17:23:48.374919] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-09-16T17:23:48.675207] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-16T17:23:49.174954] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-09-16T17:23:49.402816] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-16T17:23:49.974920] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-09-16T17:23:50.774911] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-09-16T17:23:50.807241] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-16T17:23:50.811723] [INFO ] [REMOTE ] BCAT: Full fetch complete (37561 records). [2025-09-16T17:23:50.811844] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-09-16T17:23:51.209812] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present. [2025-09-16T17:23:51.209915] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed. [2025-09-16T17:23:51.210542] [INFO ] [MAIN ] BCAT: Fetched primary data is valid. [2025-09-16T17:23:51.210611] [DEBUG] [LOCAL ] BCAT: Saving primary data. [2025-09-16T17:23:51.211624] [DEBUG] [LOCAL ] BCAT: Trimmed 37561 records to 25335 (keeping 150 days of data) [2025-09-16T17:23:51.332949] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-16T17:23:51.416295] [DEBUG] [LOCAL ] BCAT: Primary data saved (25335 records). [2025-09-16T17:23:51.416453] [INFO ] [MAIN ] BCAT: Full history saved. [2025-09-16T17:23:51.416546] [INFO ] [MAIN ] Update Progress: 230/2369 symbols completed. BCAT took 19.5s. Estimated remaining: 3h 41m 23s. Rate: 9.7 symbols/min [2025-09-16T17:23:51.584055] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-09-16T17:23:51.614143] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:23:51.653025] [DEBUG] [LOCAL ] BCE: Loaded 38550 existing records from primary storage. [2025-09-16T17:23:51.653164] [INFO ] [MAIN ] BCE: Loaded 38550 existing records. [2025-09-16T17:23:51.832149] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:23:51.832553] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-09-16T17:23:51.832754] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-09-16T17:23:51.838857] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-09-16T17:23:51.847171] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-09-16T17:23:51.880920] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-16T17:23:52.213357] [INFO ] [REMOTE ] BCE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:23:52.374889] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-09-16T17:23:53.174950] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-09-16T17:23:53.477566] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-16T17:23:53.974871] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-09-16T17:23:54.002928] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-16T17:23:54.138671] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-16T17:23:54.774902] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-09-16T17:23:55.311690] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-16T17:23:55.574905] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-09-16T17:23:56.046980] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-16T17:23:56.053395] [INFO ] [REMOTE ] BBY: Full fetch complete (58084 records). [2025-09-16T17:23:56.053503] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-09-16T17:23:56.379988] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-09-16T17:23:56.454207] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-09-16T17:23:56.454292] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-09-16T17:23:56.455144] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-09-16T17:23:56.455198] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-09-16T17:23:56.456624] [DEBUG] [LOCAL ] BBY: Trimmed 58084 records to 39860 (keeping 150 days of data) [2025-09-16T17:23:56.701071] [DEBUG] [LOCAL ] BBY: Primary data saved (39860 records). [2025-09-16T17:23:56.701231] [INFO ] [MAIN ] BBY: Full history saved. [2025-09-16T17:23:56.701330] [INFO ] [MAIN ] Update Progress: 231/2369 symbols completed. BBY took 39.4s. Estimated remaining: 3h 41m 9s. Rate: 9.7 symbols/min [2025-09-16T17:23:56.877782] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:23:56.891858] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-16T17:23:56.897084] [INFO ] [REMOTE ] BC: Full fetch complete (48513 records). [2025-09-16T17:23:56.897222] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-09-16T17:23:57.079106] [DEBUG] [LOCAL ] BCH: Loaded 21393 existing records from primary storage. [2025-09-16T17:23:57.085342] [INFO ] [MAIN ] BCH: Loaded 21393 existing records. [2025-09-16T17:23:57.179966] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-09-16T17:23:57.434209] [WARN ] [MAIN ] BCH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:23:57.511874] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-09-16T17:23:57.514395] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-09-16T17:23:57.514484] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-09-16T17:23:57.515243] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-09-16T17:23:57.515198] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-09-16T17:23:57.515342] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-09-16T17:23:57.516086] [DEBUG] [LOCAL ] BCH: Deleted primary data file. [2025-09-16T17:23:57.516171] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-09-16T17:23:57.598678] [DEBUG] [LOCAL ] BC: Trimmed 48513 records to 32937 (keeping 150 days of data) [2025-09-16T17:23:57.638538] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-16T17:23:57.979616] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-09-16T17:23:58.003909] [INFO ] [REMOTE ] BCH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:23:58.113510] [DEBUG] [LOCAL ] BC: Primary data saved (32937 records). [2025-09-16T17:23:58.113680] [INFO ] [MAIN ] BC: Full history saved. [2025-09-16T17:23:58.114490] [INFO ] [MAIN ] Update Progress: 232/2369 symbols completed. BC took 29.4s. Estimated remaining: 3h 40m 18s. Rate: 9.7 symbols/min [2025-09-16T17:23:58.284748] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:23:58.305357] [DEBUG] [LOCAL ] BCO: Loaded 19118 existing records from primary storage. [2025-09-16T17:23:58.305503] [INFO ] [MAIN ] BCO: Loaded 19118 existing records. [2025-09-16T17:23:58.487183] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:23:58.487430] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-09-16T17:23:58.487492] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-09-16T17:23:58.488064] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-09-16T17:23:58.488123] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-09-16T17:23:58.779936] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-09-16T17:23:58.852219] [INFO ] [REMOTE ] BCO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:23:58.931837] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-16T17:23:58.996383] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-16T17:23:58.999687] [INFO ] [REMOTE ] BCC: Full fetch complete (30866 records). [2025-09-16T17:23:58.999769] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-09-16T17:23:59.000292] [FATAL] [VALIDATOR ] BCC: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:23:59.000370] [FATAL] [MAIN ] BCC: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:23:59.000406] [WARN ] [MAIN ] BCC: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:23:59.000445] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-09-16T17:23:59.000503] [DEBUG] [LOCAL ] BCC: No primary data file found to delete. [2025-09-16T17:23:59.000549] [INFO ] [LOCAL ] BCC: Starting deletion of derivative data. [2025-09-16T17:23:59.000924] [DEBUG] [LOCAL ] BCC: Deleted derivative data file. [2025-09-16T17:23:59.001006] [INFO ] [MAIN ] Update Progress: 233/2369 symbols completed. BCC took 18.7s. Estimated remaining: 3h 39m 24s. Rate: 9.7 symbols/min [2025-09-16T17:23:59.172996] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:23:59.173176] [DEBUG] [LOCAL ] BCS: No existing data file found in primary storage. [2025-09-16T17:23:59.173213] [WARN ] [MAIN ] BCS: No existing data found, performing full refresh instead. [2025-09-16T17:23:59.173329] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-09-16T17:23:59.173373] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-09-16T17:23:59.173414] [DEBUG] [LOCAL ] BCS: No primary data file found to delete. [2025-09-16T17:23:59.173447] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-09-16T17:23:59.525708] [INFO ] [REMOTE ] BCS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:23:59.574853] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-09-16T17:24:00.080388] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-16T17:24:00.374892] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-09-16T17:24:01.174900] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-09-16T17:24:01.329620] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-16T17:24:01.821384] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-16T17:24:01.947052] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-16T17:24:01.974844] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-09-16T17:24:02.774917] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-09-16T17:24:03.242187] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-16T17:24:03.574965] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-09-16T17:24:04.212353] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-16T17:24:04.374907] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-09-16T17:24:04.834786] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-16T17:24:05.174942] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-09-16T17:24:05.662329] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-16T17:24:05.974903] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-09-16T17:24:06.571117] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-16T17:24:06.774932] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-09-16T17:24:07.349757] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-16T17:24:07.574347] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-16T17:24:07.580222] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-09-16T17:24:08.374906] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-09-16T17:24:09.174906] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-09-16T17:24:09.459417] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-16T17:24:09.516601] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-16T17:24:09.974903] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-09-16T17:24:10.183761] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-16T17:24:10.774908] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-09-16T17:24:11.455467] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-16T17:24:11.574911] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-09-16T17:24:12.034472] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-16T17:24:12.374912] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-09-16T17:24:13.174889] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-09-16T17:24:13.231819] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-16T17:24:13.395222] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-16T17:24:13.974968] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-09-16T17:24:14.725507] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-16T17:24:14.765350] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-16T17:24:14.774926] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-09-16T17:24:15.444263] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-16T17:24:15.574907] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-09-16T17:24:16.374921] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-09-16T17:24:17.174925] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-09-16T17:24:17.524692] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-16T17:24:17.920376] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-16T17:24:17.971476] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-16T17:24:17.974782] [INFO ] [REMOTE ] BCO: Full fetch complete (28711 records). [2025-09-16T17:24:17.974928] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-09-16T17:24:17.976297] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-09-16T17:24:18.362714] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-09-16T17:24:18.362813] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-09-16T17:24:18.363278] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-09-16T17:24:18.363338] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-09-16T17:24:18.364441] [DEBUG] [LOCAL ] BCO: Trimmed 28711 records to 19242 (keeping 150 days of data) [2025-09-16T17:24:18.495404] [DEBUG] [LOCAL ] BCO: Primary data saved (19242 records). [2025-09-16T17:24:18.495553] [INFO ] [MAIN ] BCO: Full history saved. [2025-09-16T17:24:18.495664] [INFO ] [MAIN ] Update Progress: 234/2369 symbols completed. BCO took 20.4s. Estimated remaining: 3h 41m 19s. Rate: 9.6 symbols/min [2025-09-16T17:24:18.664496] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:24:18.683502] [DEBUG] [LOCAL ] BCSF: Loaded 19270 existing records from primary storage. [2025-09-16T17:24:18.683610] [INFO ] [MAIN ] BCSF: Loaded 19270 existing records. [2025-09-16T17:24:18.781894] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-09-16T17:24:18.862418] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:24:18.862677] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-09-16T17:24:18.862724] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-09-16T17:24:18.863265] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-09-16T17:24:18.863311] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-09-16T17:24:19.218401] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:24:19.318621] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-16T17:24:19.322677] [INFO ] [REMOTE ] BCH: Full fetch complete (32024 records). [2025-09-16T17:24:19.322763] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-09-16T17:24:19.580122] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-09-16T17:24:19.691502] [DEBUG] [VALIDATOR ] BCH: All expected trading days are present. [2025-09-16T17:24:19.691587] [DEBUG] [VALIDATOR ] BCH: Primary data validation passed. [2025-09-16T17:24:19.692031] [INFO ] [MAIN ] BCH: Fetched primary data is valid. [2025-09-16T17:24:19.692075] [DEBUG] [LOCAL ] BCH: Saving primary data. [2025-09-16T17:24:19.692922] [DEBUG] [LOCAL ] BCH: Trimmed 32024 records to 21687 (keeping 150 days of data) [2025-09-16T17:24:19.818551] [DEBUG] [LOCAL ] BCH: Primary data saved (21687 records). [2025-09-16T17:24:19.818694] [INFO ] [MAIN ] BCH: Full history saved. [2025-09-16T17:24:19.818784] [INFO ] [MAIN ] Update Progress: 235/2369 symbols completed. BCH took 23.1s. Estimated remaining: 3h 40m 28s. Rate: 9.7 symbols/min [2025-09-16T17:24:19.986507] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:24:20.001573] [DEBUG] [LOCAL ] BCX: Loaded 15307 existing records from primary storage. [2025-09-16T17:24:20.001713] [INFO ] [MAIN ] BCX: Loaded 15307 existing records. [2025-09-16T17:24:20.182696] [WARN ] [MAIN ] BCX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:24:20.182970] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-09-16T17:24:20.183032] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-09-16T17:24:20.183459] [DEBUG] [LOCAL ] BCX: Deleted primary data file. [2025-09-16T17:24:20.183503] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-09-16T17:24:20.390060] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-09-16T17:24:20.540383] [INFO ] [REMOTE ] BCX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:24:20.586033] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-16T17:24:20.949388] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-16T17:24:21.174917] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-09-16T17:24:21.601549] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-16T17:24:21.974953] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-09-16T17:24:22.774874] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-09-16T17:24:22.824252] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-16T17:24:22.920934] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-16T17:24:23.574902] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-09-16T17:24:24.173833] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-16T17:24:24.179669] [INFO ] [REMOTE ] BCS: Full fetch complete (57755 records). [2025-09-16T17:24:24.179765] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-09-16T17:24:24.180427] [FATAL] [VALIDATOR ] BCS: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:24:24.180504] [FATAL] [MAIN ] BCS: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:24:24.180565] [WARN ] [MAIN ] BCS: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:24:24.180612] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-09-16T17:24:24.180703] [DEBUG] [LOCAL ] BCS: No primary data file found to delete. [2025-09-16T17:24:24.180741] [INFO ] [LOCAL ] BCS: Starting deletion of derivative data. [2025-09-16T17:24:24.180790] [DEBUG] [LOCAL ] BCS: No derivative data file found to delete. [2025-09-16T17:24:24.180854] [INFO ] [MAIN ] Update Progress: 236/2369 symbols completed. BCS took 25.2s. Estimated remaining: 3h 40m 6s. Rate: 9.7 symbols/min [2025-09-16T17:24:24.349453] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:24:24.367501] [DEBUG] [LOCAL ] BDC: Loaded 17657 existing records from primary storage. [2025-09-16T17:24:24.367611] [INFO ] [MAIN ] BDC: Loaded 17657 existing records. [2025-09-16T17:24:24.380157] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-09-16T17:24:24.544565] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:24:24.544822] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-09-16T17:24:24.544867] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-09-16T17:24:24.545506] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-09-16T17:24:24.545553] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-09-16T17:24:24.901746] [INFO ] [REMOTE ] BDC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:24:25.174912] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-09-16T17:24:25.192250] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-16T17:24:25.198026] [INFO ] [REMOTE ] BCE: Full fetch complete (56612 records). [2025-09-16T17:24:25.198156] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-09-16T17:24:25.198791] [FATAL] [VALIDATOR ] BCE: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:24:25.198869] [FATAL] [MAIN ] BCE: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:24:25.198906] [WARN ] [MAIN ] BCE: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:24:25.198965] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-09-16T17:24:25.199025] [DEBUG] [LOCAL ] BCE: No primary data file found to delete. [2025-09-16T17:24:25.199090] [INFO ] [LOCAL ] BCE: Starting deletion of derivative data. [2025-09-16T17:24:25.199328] [DEBUG] [LOCAL ] BCE: Deleted derivative data file. [2025-09-16T17:24:25.199458] [INFO ] [MAIN ] Update Progress: 237/2369 symbols completed. BCE took 33.8s. Estimated remaining: 3h 39m 13s. Rate: 9.7 symbols/min [2025-09-16T17:24:25.826413] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-16T17:24:25.974951] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-09-16T17:24:26.417225] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-16T17:24:26.774912] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-09-16T17:24:27.304683] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-16T17:24:27.484089] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-16T17:24:27.574869] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-09-16T17:24:28.374923] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-09-16T17:24:28.726908] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-16T17:24:29.174871] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-09-16T17:24:29.561867] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-16T17:24:29.777925] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-16T17:24:29.974904] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-09-16T17:24:30.774900] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-09-16T17:24:31.058850] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-16T17:24:31.548498] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-16T17:24:31.574845] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-09-16T17:24:32.374868] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-09-16T17:24:32.696393] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-16T17:24:33.174903] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-09-16T17:24:33.396773] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-16T17:24:33.974893] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-09-16T17:24:33.986967] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-16T17:24:34.774912] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-09-16T17:24:35.010878] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-16T17:24:35.574910] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-09-16T17:24:35.695340] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-16T17:24:35.697922] [INFO ] [REMOTE ] BCX: Full fetch complete (24154 records). [2025-09-16T17:24:35.697995] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-09-16T17:24:36.064424] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-09-16T17:24:36.064508] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-09-16T17:24:36.064951] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-09-16T17:24:36.065002] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-09-16T17:24:36.065910] [DEBUG] [LOCAL ] BCX: Trimmed 24154 records to 15406 (keeping 150 days of data) [2025-09-16T17:24:36.169034] [DEBUG] [LOCAL ] BCX: Primary data saved (15406 records). [2025-09-16T17:24:36.169180] [INFO ] [MAIN ] BCX: Full history saved. [2025-09-16T17:24:36.169305] [INFO ] [MAIN ] Update Progress: 238/2369 symbols completed. BCX took 16.4s. Estimated remaining: 3h 39m 50s. Rate: 9.7 symbols/min [2025-09-16T17:24:36.374981] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-09-16T17:24:36.602138] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-16T17:24:37.174960] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-09-16T17:24:37.346194] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-16T17:24:37.974856] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-09-16T17:24:38.356128] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-16T17:24:38.359566] [INFO ] [REMOTE ] BCSF: Full fetch complete (29771 records). [2025-09-16T17:24:38.359728] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-09-16T17:24:38.730580] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-09-16T17:24:38.730686] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-09-16T17:24:38.731099] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-09-16T17:24:38.731150] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-09-16T17:24:38.732114] [DEBUG] [LOCAL ] BCSF: Trimmed 29771 records to 19518 (keeping 150 days of data) [2025-09-16T17:24:38.807130] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-16T17:24:38.839076] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-09-16T17:24:38.870787] [DEBUG] [LOCAL ] BCSF: Primary data saved (19518 records). [2025-09-16T17:24:38.870899] [INFO ] [MAIN ] BCSF: Full history saved. [2025-09-16T17:24:38.870988] [INFO ] [MAIN ] Update Progress: 239/2369 symbols completed. BCSF took 20.4s. Estimated remaining: 3h 39m 12s. Rate: 9.7 symbols/min [2025-09-16T17:24:39.979580] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-16T17:24:39.987376] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-09-16T17:24:41.171415] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-16T17:24:41.177311] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-09-16T17:24:42.284331] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-16T17:24:42.290045] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-09-16T17:24:43.436774] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-16T17:24:43.439816] [INFO ] [REMOTE ] BDC: Full fetch complete (27297 records). [2025-09-16T17:24:43.439899] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-09-16T17:24:43.801853] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-09-16T17:24:43.801932] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-09-16T17:24:43.802309] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-09-16T17:24:43.802350] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-09-16T17:24:43.803034] [DEBUG] [LOCAL ] BDC: Trimmed 27297 records to 17786 (keeping 150 days of data) [2025-09-16T17:24:43.919893] [DEBUG] [LOCAL ] BDC: Primary data saved (17786 records). [2025-09-16T17:24:43.920086] [INFO ] [MAIN ] BDC: Full history saved. [2025-09-16T17:24:43.920175] [INFO ] [MAIN ] Update Progress: 240/2369 symbols completed. BDC took 19.7s. Estimated remaining: 3h 38m 56s. Rate: 9.7 symbols/min [2025-09-16T17:24:44.543542] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:24:44.631243] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:24:44.714804] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:24:44.718635] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:24:44.772879] [DEBUG] [LOCAL ] BDJ: Loaded 21245 existing records from primary storage. [2025-09-16T17:24:44.773157] [INFO ] [MAIN ] BDJ: Loaded 21245 existing records. [2025-09-16T17:24:44.886865] [DEBUG] [LOCAL ] BDN: Loaded 34811 existing records from primary storage. [2025-09-16T17:24:44.901610] [INFO ] [MAIN ] BDN: Loaded 34811 existing records. [2025-09-16T17:24:44.914228] [DEBUG] [LOCAL ] BE: Loaded 39622 existing records from primary storage. [2025-09-16T17:24:44.962492] [INFO ] [MAIN ] BE: Loaded 39622 existing records. [2025-09-16T17:24:45.110690] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:24:45.182360] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-09-16T17:24:45.187631] [DEBUG] [LOCAL ] BDX: Loaded 38949 existing records from primary storage. [2025-09-16T17:24:45.193504] [INFO ] [MAIN ] BDX: Loaded 38949 existing records. [2025-09-16T17:24:45.253924] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-09-16T17:24:45.374774] [WARN ] [MAIN ] BDN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:24:45.395836] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-09-16T17:24:45.463506] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-09-16T17:24:45.478788] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-09-16T17:24:45.482236] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-09-16T17:24:45.473543] [WARN ] [MAIN ] BE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:24:45.516537] [DEBUG] [LOCAL ] BDN: Deleted primary data file. [2025-09-16T17:24:45.547407] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-09-16T17:24:45.542200] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-09-16T17:24:45.576029] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-09-16T17:24:45.695708] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:24:45.706963] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-09-16T17:24:45.725956] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-09-16T17:24:45.690364] [DEBUG] [LOCAL ] BE: Deleted primary data file. [2025-09-16T17:24:45.763552] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-09-16T17:24:45.763725] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-09-16T17:24:45.774502] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-09-16T17:24:46.738540] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:24:46.824457] [INFO ] [REMOTE ] BDN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:24:46.829923] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-09-16T17:24:46.866425] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-09-16T17:24:47.039527] [INFO ] [REMOTE ] BDX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:24:47.045694] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-09-16T17:24:47.064995] [INFO ] [REMOTE ] BE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:24:47.066986] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-09-16T17:24:48.234858] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-16T17:24:48.243923] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-09-16T17:24:48.371095] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-16T17:24:48.380231] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-09-16T17:24:48.755911] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-16T17:24:48.766177] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-09-16T17:24:48.826945] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-16T17:24:48.837784] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-09-16T17:24:49.169632] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-16T17:24:49.176110] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-09-16T17:24:49.827942] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-16T17:24:49.838072] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-09-16T17:24:49.941328] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-16T17:24:49.974864] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-09-16T17:24:50.497977] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-16T17:24:50.657088] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-16T17:24:50.774891] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-09-16T17:24:51.582303] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-09-16T17:24:51.602884] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-16T17:24:51.791450] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-16T17:24:52.380007] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-09-16T17:24:52.394111] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-16T17:24:52.718895] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-16T17:24:53.174900] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-09-16T17:24:53.731152] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-16T17:24:53.974869] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-09-16T17:24:54.120843] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-16T17:24:54.774906] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-09-16T17:24:55.574894] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-09-16T17:24:56.006249] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-16T17:24:56.274855] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-16T17:24:56.374914] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-09-16T17:24:56.842302] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-16T17:24:57.174899] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-09-16T17:24:57.357528] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-16T17:24:57.974904] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-09-16T17:24:58.779989] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-09-16T17:24:58.798075] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-16T17:24:59.574902] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-09-16T17:24:59.772600] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-16T17:24:59.912487] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-16T17:25:00.374919] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-09-16T17:25:01.174903] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-09-16T17:25:01.436135] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-16T17:25:01.610287] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-16T17:25:01.614314] [INFO ] [REMOTE ] BDJ: Full fetch complete (31704 records). [2025-09-16T17:25:01.614450] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-09-16T17:25:01.979982] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-09-16T17:25:02.024352] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-09-16T17:25:02.024453] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-09-16T17:25:02.025057] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-09-16T17:25:02.025156] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-09-16T17:25:02.026330] [DEBUG] [LOCAL ] BDJ: Trimmed 31704 records to 21383 (keeping 150 days of data) [2025-09-16T17:25:02.162754] [DEBUG] [LOCAL ] BDJ: Primary data saved (21383 records). [2025-09-16T17:25:02.162887] [INFO ] [MAIN ] BDJ: Full history saved. [2025-09-16T17:25:02.162973] [INFO ] [MAIN ] Update Progress: 241/2369 symbols completed. BDJ took 18.2s. Estimated remaining: 3h 40m 37s. Rate: 9.6 symbols/min [2025-09-16T17:25:02.334266] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:25:02.334478] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-09-16T17:25:02.334518] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-09-16T17:25:02.334640] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-09-16T17:25:02.334700] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-16T17:25:02.334741] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-16T17:25:02.334773] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-09-16T17:25:02.690238] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:25:02.774896] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-09-16T17:25:03.574932] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-09-16T17:25:04.006357] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-16T17:25:04.374948] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-09-16T17:25:04.698803] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-16T17:25:04.775687] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-16T17:25:05.174912] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-09-16T17:25:05.472479] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-09-16T17:25:05.974924] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-09-16T17:25:06.071543] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (4.90 seconds). [2025-09-16T17:25:06.303508] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-16T17:25:06.774927] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-09-16T17:25:07.094583] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (5.11 seconds). [2025-09-16T17:25:07.574966] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-09-16T17:25:08.374872] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-09-16T17:25:08.453235] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-16T17:25:09.167993] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-16T17:25:09.173738] [INFO ] [REMOTE ] BDX: Full fetch complete (56535 records). [2025-09-16T17:25:09.173895] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-09-16T17:25:09.174628] [FATAL] [VALIDATOR ] BDX: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:25:09.174732] [FATAL] [MAIN ] BDX: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:25:09.174770] [WARN ] [MAIN ] BDX: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:25:09.174819] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-09-16T17:25:09.174869] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-09-16T17:25:09.175013] [DEBUG] [LOCAL ] BDX: No primary data file found to delete. [2025-09-16T17:25:09.175839] [INFO ] [LOCAL ] BDX: Starting deletion of derivative data. [2025-09-16T17:25:09.176261] [DEBUG] [LOCAL ] BDX: Deleted derivative data file. [2025-09-16T17:25:09.176409] [INFO ] [MAIN ] Update Progress: 242/2369 symbols completed. BDX took 25.2s. Estimated remaining: 3h 40m 37s. Rate: 9.6 symbols/min [2025-09-16T17:25:09.360318] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:25:09.400238] [DEBUG] [LOCAL ] BEKE: Loaded 39242 existing records from primary storage. [2025-09-16T17:25:09.400387] [INFO ] [MAIN ] BEKE: Loaded 39242 existing records. [2025-09-16T17:25:09.589140] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:25:09.589420] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-09-16T17:25:09.589491] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-09-16T17:25:09.595868] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-09-16T17:25:09.601995] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-09-16T17:25:09.664286] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-16T17:25:09.718576] [INFO ] [REMOTE ] BDN: Full fetch complete (51397 records). [2025-09-16T17:25:09.718756] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-09-16T17:25:09.735255] [FATAL] [VALIDATOR ] BDN: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:25:09.797582] [FATAL] [MAIN ] BDN: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:25:09.849720] [WARN ] [MAIN ] BDN: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:25:09.883356] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-09-16T17:25:09.912993] [DEBUG] [LOCAL ] BDN: No primary data file found to delete. [2025-09-16T17:25:09.918737] [INFO ] [LOCAL ] BDN: Starting deletion of derivative data. [2025-09-16T17:25:09.929327] [DEBUG] [LOCAL ] BDN: Deleted derivative data file. [2025-09-16T17:25:09.954365] [INFO ] [MAIN ] Update Progress: 243/2369 symbols completed. BDN took 26.0s. Estimated remaining: 3h 39m 44s. Rate: 9.7 symbols/min [2025-09-16T17:25:09.986795] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-09-16T17:25:09.992035] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:25:10.187309] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:25:10.228738] [DEBUG] [LOCAL ] BEN: Loaded 39192 existing records from primary storage. [2025-09-16T17:25:10.228889] [INFO ] [MAIN ] BEN: Loaded 39192 existing records. [2025-09-16T17:25:10.337069] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-16T17:25:10.415611] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:25:10.415912] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-09-16T17:25:10.415963] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-09-16T17:25:10.417021] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-09-16T17:25:10.417078] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-09-16T17:25:10.780511] [INFO ] [REMOTE ] BEN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:25:10.777981] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-09-16T17:25:11.472274] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-16T17:25:11.574852] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-09-16T17:25:12.357541] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-16T17:25:12.374870] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-09-16T17:25:12.625861] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-09-16T17:25:13.174948] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-09-16T17:25:13.397504] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-09-16T17:25:13.839979] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-16T17:25:13.845813] [INFO ] [REMOTE ] BE: Full fetch complete (57934 records). [2025-09-16T17:25:13.845907] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-09-16T17:25:13.846579] [FATAL] [VALIDATOR ] BE: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:25:13.846675] [FATAL] [MAIN ] BE: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:25:13.846716] [WARN ] [MAIN ] BE: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:25:13.846753] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-09-16T17:25:13.846834] [DEBUG] [LOCAL ] BE: No primary data file found to delete. [2025-09-16T17:25:13.846871] [INFO ] [LOCAL ] BE: Starting deletion of derivative data. [2025-09-16T17:25:13.847148] [DEBUG] [LOCAL ] BE: Deleted derivative data file. [2025-09-16T17:25:13.847227] [INFO ] [MAIN ] Update Progress: 244/2369 symbols completed. BE took 29.9s. Estimated remaining: 3h 39m 17s. Rate: 9.7 symbols/min [2025-09-16T17:25:13.986847] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-09-16T17:25:14.016517] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:25:14.048306] [DEBUG] [LOCAL ] BEP: Loaded 27576 existing records from primary storage. [2025-09-16T17:25:14.048460] [INFO ] [MAIN ] BEP: Loaded 27576 existing records. [2025-09-16T17:25:14.222272] [WARN ] [MAIN ] BEP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:25:14.222517] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-09-16T17:25:14.222562] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-09-16T17:25:14.223405] [DEBUG] [LOCAL ] BEP: Deleted primary data file. [2025-09-16T17:25:14.223455] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-09-16T17:25:14.573731] [INFO ] [REMOTE ] BEP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:25:14.774939] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-09-16T17:25:15.340459] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-16T17:25:15.574967] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-09-16T17:25:15.962779] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-16T17:25:16.374958] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-09-16T17:25:16.920446] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-16T17:25:16.921238] [INFO ] [REMOTE ] BEDU: Full fetch complete (933 records). [2025-09-16T17:25:16.921308] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-09-16T17:25:17.110304] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 122 unique days, need 150 days [2025-09-16T17:25:17.110550] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:25:17.110626] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:25:17.110856] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-16T17:25:17.111010] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-16T17:25:17.111141] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-09-16T17:25:17.111299] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-09-16T17:25:17.111382] [INFO ] [MAIN ] Update Progress: 245/2369 symbols completed. BEDU took 14.9s. Estimated remaining: 3h 38m 46s. Rate: 9.7 symbols/min [2025-09-16T17:25:17.179948] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-09-16T17:25:17.294417] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:25:17.327784] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-16T17:25:17.370777] [DEBUG] [LOCAL ] BEPC: Loaded 33680 existing records from primary storage. [2025-09-16T17:25:17.370920] [INFO ] [MAIN ] BEPC: Loaded 33680 existing records. [2025-09-16T17:25:17.548585] [WARN ] [MAIN ] BEPC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:25:17.548847] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-09-16T17:25:17.548893] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-09-16T17:25:17.549797] [DEBUG] [LOCAL ] BEPC: Deleted primary data file. [2025-09-16T17:25:17.549847] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-09-16T17:25:17.904261] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:25:17.974854] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-09-16T17:25:18.775874] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-16T17:25:18.775979] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-09-16T17:25:19.574937] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-09-16T17:25:19.657437] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-16T17:25:20.334865] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-16T17:25:20.374926] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-09-16T17:25:20.760006] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-16T17:25:21.174915] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-09-16T17:25:21.802658] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-16T17:25:21.974954] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-09-16T17:25:22.481087] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-16T17:25:22.774908] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-09-16T17:25:23.574937] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-09-16T17:25:23.800428] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-16T17:25:24.115814] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-16T17:25:24.374914] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-09-16T17:25:24.838820] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-16T17:25:25.174964] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-09-16T17:25:25.979544] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-09-16T17:25:25.986672] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-16T17:25:26.353478] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-16T17:25:26.774906] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-09-16T17:25:27.574908] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-09-16T17:25:27.800701] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-16T17:25:28.004055] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-16T17:25:28.374921] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-09-16T17:25:29.157425] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-16T17:25:29.174855] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-09-16T17:25:29.790833] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-16T17:25:29.974909] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-09-16T17:25:30.780055] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-09-16T17:25:30.795258] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-16T17:25:31.459854] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-16T17:25:31.574887] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-09-16T17:25:32.374897] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-09-16T17:25:32.605662] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-16T17:25:32.915698] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-16T17:25:33.174924] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-09-16T17:25:33.632608] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-16T17:25:33.974917] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-09-16T17:25:34.484600] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-16T17:25:34.774950] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-09-16T17:25:35.574902] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-09-16T17:25:35.905627] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-16T17:25:36.375054] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-09-16T17:25:36.454029] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-16T17:25:36.461115] [INFO ] [REMOTE ] BEN: Full fetch complete (57719 records). [2025-09-16T17:25:36.461367] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-09-16T17:25:36.862606] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-09-16T17:25:36.862719] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-09-16T17:25:36.863367] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-09-16T17:25:36.863411] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-09-16T17:25:36.864740] [DEBUG] [LOCAL ] BEN: Trimmed 57719 records to 39572 (keeping 150 days of data) [2025-09-16T17:25:37.133373] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-16T17:25:37.169057] [DEBUG] [LOCAL ] BEN: Primary data saved (39572 records). [2025-09-16T17:25:37.169205] [INFO ] [MAIN ] BEN: Full history saved. [2025-09-16T17:25:37.169296] [INFO ] [MAIN ] Update Progress: 246/2369 symbols completed. BEN took 27.2s. Estimated remaining: 3h 40m 39s. Rate: 9.6 symbols/min [2025-09-16T17:25:37.180947] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-09-16T17:25:37.347074] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:25:37.352155] [DEBUG] [LOCAL ] BEPH: Loaded 3476 existing records from primary storage. [2025-09-16T17:25:37.352243] [INFO ] [MAIN ] BEPH: Loaded 3476 existing records. [2025-09-16T17:25:37.531200] [WARN ] [MAIN ] BEPH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:25:37.531482] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-09-16T17:25:37.531531] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-09-16T17:25:37.531955] [DEBUG] [LOCAL ] BEPH: Deleted primary data file. [2025-09-16T17:25:37.532005] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-09-16T17:25:37.892909] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:25:37.931780] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-16T17:25:37.974924] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-09-16T17:25:38.774895] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-09-16T17:25:39.158622] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-16T17:25:39.165043] [INFO ] [REMOTE ] BEKE: Full fetch complete (57946 records). [2025-09-16T17:25:39.165158] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-09-16T17:25:39.275634] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-16T17:25:39.492756] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-16T17:25:39.538279] [INFO ] [REMOTE ] BEP: Full fetch complete (42614 records). [2025-09-16T17:25:39.549371] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-09-16T17:25:39.580376] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-09-16T17:25:39.652004] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-09-16T17:25:39.666734] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-09-16T17:25:39.693977] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-09-16T17:25:39.705885] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-09-16T17:25:39.782267] [DEBUG] [LOCAL ] BEKE: Trimmed 57946 records to 39625 (keeping 150 days of data) [2025-09-16T17:25:40.085715] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-09-16T17:25:40.088550] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-09-16T17:25:40.092260] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-09-16T17:25:40.092823] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-09-16T17:25:40.107095] [DEBUG] [LOCAL ] BEP: Trimmed 42614 records to 27781 (keeping 150 days of data) [2025-09-16T17:25:40.351838] [DEBUG] [LOCAL ] BEKE: Primary data saved (39625 records). [2025-09-16T17:25:40.355234] [INFO ] [MAIN ] BEKE: Full history saved. [2025-09-16T17:25:40.356824] [INFO ] [MAIN ] Update Progress: 247/2369 symbols completed. BEKE took 31.2s. Estimated remaining: 3h 40m 7s. Rate: 9.6 symbols/min [2025-09-16T17:25:40.407019] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-09-16T17:25:40.589893] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:25:40.600922] [DEBUG] [LOCAL ] BEP: Primary data saved (27781 records). [2025-09-16T17:25:40.601035] [INFO ] [MAIN ] BEP: Full history saved. [2025-09-16T17:25:40.599694] [DEBUG] [LOCAL ] BEPI: Loaded 2662 existing records from primary storage. [2025-09-16T17:25:40.602805] [INFO ] [MAIN ] Update Progress: 248/2369 symbols completed. BEP took 26.8s. Estimated remaining: 3h 39m 9s. Rate: 9.7 symbols/min [2025-09-16T17:25:40.602886] [INFO ] [MAIN ] BEPI: Loaded 2662 existing records. [2025-09-16T17:25:40.945559] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:25:40.963213] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:25:40.964079] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-09-16T17:25:40.964150] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-09-16T17:25:40.964410] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-09-16T17:25:40.964471] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-09-16T17:25:41.066031] [DEBUG] [LOCAL ] BEPJ: Loaded 2575 existing records from primary storage. [2025-09-16T17:25:41.077719] [INFO ] [MAIN ] BEPJ: Loaded 2575 existing records. [2025-09-16T17:25:41.383149] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-16T17:25:41.496456] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-09-16T17:25:41.496147] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:25:41.523061] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-09-16T17:25:41.526514] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:25:41.526756] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-09-16T17:25:41.532910] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-09-16T17:25:41.541730] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-09-16T17:25:41.548064] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-16T17:25:41.623958] [INFO ] [REMOTE ] BEPC: Full fetch complete (50895 records). [2025-09-16T17:25:41.649027] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-09-16T17:25:41.977017] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-09-16T17:25:42.229851] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:25:42.295515] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-16T17:25:42.329568] [DEBUG] [VALIDATOR ] BEPC: All expected trading days are present. [2025-09-16T17:25:42.329685] [DEBUG] [VALIDATOR ] BEPC: Primary data validation passed. [2025-09-16T17:25:42.330335] [INFO ] [MAIN ] BEPC: Fetched primary data is valid. [2025-09-16T17:25:42.330379] [DEBUG] [LOCAL ] BEPC: Saving primary data. [2025-09-16T17:25:42.331499] [DEBUG] [LOCAL ] BEPC: Trimmed 50895 records to 34009 (keeping 150 days of data) [2025-09-16T17:25:42.557948] [DEBUG] [LOCAL ] BEPC: Primary data saved (34009 records). [2025-09-16T17:25:42.558235] [INFO ] [MAIN ] BEPC: Full history saved. [2025-09-16T17:25:42.558326] [INFO ] [MAIN ] Update Progress: 249/2369 symbols completed. BEPC took 25.4s. Estimated remaining: 3h 38m 27s. Rate: 9.7 symbols/min [2025-09-16T17:25:42.663332] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-16T17:25:42.739167] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:25:42.764631] [DEBUG] [LOCAL ] BFAM: Loaded 24414 existing records from primary storage. [2025-09-16T17:25:42.764844] [INFO ] [MAIN ] BFAM: Loaded 24414 existing records. [2025-09-16T17:25:42.780040] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-09-16T17:25:42.961044] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:25:42.961339] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-09-16T17:25:42.961386] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-09-16T17:25:42.962217] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-09-16T17:25:42.962281] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-09-16T17:25:43.353278] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:25:43.440403] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-16T17:25:43.574903] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-09-16T17:25:44.374894] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-09-16T17:25:44.956876] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-16T17:25:44.991077] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-16T17:25:45.174910] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-09-16T17:25:45.683315] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-16T17:25:45.974905] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-09-16T17:25:46.774907] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-09-16T17:25:47.177435] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-16T17:25:47.225773] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-16T17:25:47.574896] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-09-16T17:25:48.003003] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-16T17:25:48.374908] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-09-16T17:25:48.825267] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-16T17:25:49.174907] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-09-16T17:25:49.974900] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-09-16T17:25:50.270567] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-09-16T17:25:50.584410] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-16T17:25:50.774881] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-09-16T17:25:51.327592] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-16T17:25:51.574936] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-09-16T17:25:51.956727] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-16T17:25:52.374892] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-09-16T17:25:53.174908] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-09-16T17:25:53.510299] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-16T17:25:53.595894] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-16T17:25:53.974927] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-09-16T17:25:54.566756] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-16T17:25:54.774934] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-09-16T17:25:55.399849] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-16T17:25:55.400876] [INFO ] [REMOTE ] BEPH: Full fetch complete (5755 records). [2025-09-16T17:25:55.400944] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-09-16T17:25:55.580210] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-09-16T17:25:55.771840] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present. [2025-09-16T17:25:55.771921] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed. [2025-09-16T17:25:55.772097] [INFO ] [MAIN ] BEPH: Fetched primary data is valid. [2025-09-16T17:25:55.772145] [DEBUG] [LOCAL ] BEPH: Saving primary data. [2025-09-16T17:25:55.772533] [DEBUG] [LOCAL ] BEPH: Trimmed 5755 records to 3492 (keeping 150 days of data) [2025-09-16T17:25:55.794268] [DEBUG] [LOCAL ] BEPH: Primary data saved (3492 records). [2025-09-16T17:25:55.794358] [INFO ] [MAIN ] BEPH: Full history saved. [2025-09-16T17:25:55.794440] [INFO ] [MAIN ] Update Progress: 250/2369 symbols completed. BEPH took 18.6s. Estimated remaining: 3h 39m 21s. Rate: 9.7 symbols/min [2025-09-16T17:25:55.972566] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:25:56.006204] [DEBUG] [LOCAL ] BFH: Loaded 30069 existing records from primary storage. [2025-09-16T17:25:56.006399] [INFO ] [MAIN ] BFH: Loaded 30069 existing records. [2025-09-16T17:25:56.191090] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:25:56.191348] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-09-16T17:25:56.191396] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-09-16T17:25:56.192318] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-09-16T17:25:56.192370] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-09-16T17:25:56.381601] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-09-16T17:25:56.557362] [INFO ] [REMOTE ] BFH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:25:57.033140] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-16T17:25:57.174890] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-09-16T17:25:57.218082] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-16T17:25:57.974909] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-09-16T17:25:58.239873] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-16T17:25:58.774936] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-09-16T17:25:59.368751] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-16T17:25:59.574899] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-09-16T17:26:00.262707] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-16T17:26:00.358238] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-16T17:26:00.374850] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-09-16T17:26:01.080542] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-16T17:26:01.174963] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-09-16T17:26:01.711217] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-16T17:26:01.712142] [INFO ] [REMOTE ] BEPJ: Full fetch complete (3515 records). [2025-09-16T17:26:01.712224] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-09-16T17:26:01.712703] [FATAL] [VALIDATOR ] BEPJ: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:26:01.712782] [FATAL] [MAIN ] BEPJ: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:26:01.712821] [WARN ] [MAIN ] BEPJ: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:26:01.712863] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-09-16T17:26:01.712922] [DEBUG] [LOCAL ] BEPJ: No primary data file found to delete. [2025-09-16T17:26:01.712959] [INFO ] [LOCAL ] BEPJ: Starting deletion of derivative data. [2025-09-16T17:26:01.713279] [DEBUG] [LOCAL ] BEPJ: Deleted derivative data file. [2025-09-16T17:26:01.713366] [INFO ] [MAIN ] Update Progress: 251/2369 symbols completed. BEPJ took 21.1s. Estimated remaining: 3h 39m 12s. Rate: 9.7 symbols/min [2025-09-16T17:26:01.903286] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:26:01.914584] [DEBUG] [LOCAL ] BFK: Loaded 9574 existing records from primary storage. [2025-09-16T17:26:01.914764] [INFO ] [MAIN ] BFK: Loaded 9574 existing records. [2025-09-16T17:26:01.980035] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-09-16T17:26:02.095886] [WARN ] [MAIN ] BFK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:26:02.096158] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-09-16T17:26:02.096206] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-09-16T17:26:02.096528] [DEBUG] [LOCAL ] BFK: Deleted primary data file. [2025-09-16T17:26:02.096573] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-09-16T17:26:02.455591] [INFO ] [REMOTE ] BFK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:26:02.774902] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-09-16T17:26:03.244706] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-16T17:26:03.574910] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-09-16T17:26:03.603163] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-16T17:26:04.133212] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-16T17:26:04.374911] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-09-16T17:26:05.052838] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-16T17:26:05.174890] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-09-16T17:26:05.727000] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-16T17:26:05.974923] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-09-16T17:26:06.774958] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-09-16T17:26:07.290217] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-16T17:26:07.294427] [INFO ] [REMOTE ] BFAM: Full fetch complete (35656 records). [2025-09-16T17:26:07.294563] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-09-16T17:26:07.580794] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-09-16T17:26:07.671680] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-09-16T17:26:07.671772] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-09-16T17:26:07.672367] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-09-16T17:26:07.672424] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-09-16T17:26:07.673349] [DEBUG] [LOCAL ] BFAM: Trimmed 35656 records to 24751 (keeping 150 days of data) [2025-09-16T17:26:07.826128] [DEBUG] [LOCAL ] BFAM: Primary data saved (24751 records). [2025-09-16T17:26:07.826287] [INFO ] [MAIN ] BFAM: Full history saved. [2025-09-16T17:26:07.826396] [INFO ] [MAIN ] Update Progress: 252/2369 symbols completed. BFAM took 25.3s. Estimated remaining: 3h 39m 5s. Rate: 9.7 symbols/min [2025-09-16T17:26:07.995984] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:26:08.031266] [DEBUG] [LOCAL ] BFLY: Loaded 38151 existing records from primary storage. [2025-09-16T17:26:08.031429] [INFO ] [MAIN ] BFLY: Loaded 38151 existing records. [2025-09-16T17:26:08.207549] [WARN ] [MAIN ] BFLY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:26:08.207789] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-09-16T17:26:08.207835] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-09-16T17:26:08.208759] [DEBUG] [LOCAL ] BFLY: Deleted primary data file. [2025-09-16T17:26:08.208808] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-09-16T17:26:08.376592] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-09-16T17:26:08.575597] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:26:08.654691] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-16T17:26:08.936311] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-16T17:26:09.095798] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-16T17:26:09.174858] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-09-16T17:26:09.811933] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-16T17:26:09.812855] [INFO ] [REMOTE ] BEPI: Full fetch complete (3680 records). [2025-09-16T17:26:09.812935] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-09-16T17:26:09.984234] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-09-16T17:26:10.167390] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-09-16T17:26:10.167466] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-09-16T17:26:10.167580] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-09-16T17:26:10.167618] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-09-16T17:26:10.167974] [DEBUG] [LOCAL ] BEPI: Trimmed 3680 records to 2679 (keeping 150 days of data) [2025-09-16T17:26:10.184324] [DEBUG] [LOCAL ] BEPI: Primary data saved (2679 records). [2025-09-16T17:26:10.184388] [INFO ] [MAIN ] BEPI: Full history saved. [2025-09-16T17:26:10.184474] [INFO ] [MAIN ] Update Progress: 253/2369 symbols completed. BEPI took 29.8s. Estimated remaining: 3h 38m 27s. Rate: 9.7 symbols/min [2025-09-16T17:26:10.356985] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:26:10.365718] [DEBUG] [LOCAL ] BFS: Loaded 6716 existing records from primary storage. [2025-09-16T17:26:10.365838] [INFO ] [MAIN ] BFS: Loaded 6716 existing records. [2025-09-16T17:26:10.542313] [WARN ] [MAIN ] BFS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:26:10.542569] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-09-16T17:26:10.542615] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-09-16T17:26:10.542998] [DEBUG] [LOCAL ] BFS: Deleted primary data file. [2025-09-16T17:26:10.543044] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-09-16T17:26:10.781099] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-09-16T17:26:10.846983] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-16T17:26:10.912428] [INFO ] [REMOTE ] BFS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:26:11.574918] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-09-16T17:26:11.890859] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-16T17:26:12.374900] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-09-16T17:26:12.949983] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-16T17:26:13.159038] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-16T17:26:13.174841] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-09-16T17:26:13.974902] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-09-16T17:26:14.674560] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-16T17:26:14.721662] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-16T17:26:14.774879] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-09-16T17:26:15.524217] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-16T17:26:15.574859] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-09-16T17:26:16.100573] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-16T17:26:16.374886] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-09-16T17:26:17.021802] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-16T17:26:17.174884] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-09-16T17:26:17.974946] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-09-16T17:26:18.602772] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-16T17:26:18.774975] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-09-16T17:26:18.925859] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-16T17:26:19.239550] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-16T17:26:19.574957] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-09-16T17:26:20.374951] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-09-16T17:26:20.942461] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-16T17:26:21.174940] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-09-16T17:26:21.946667] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-16T17:26:21.974919] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-09-16T17:26:22.509907] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-16T17:26:22.774994] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-09-16T17:26:22.921909] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-16T17:26:23.574902] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-09-16T17:26:24.296701] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-16T17:26:24.299073] [INFO ] [REMOTE ] BFK: Full fetch complete (14613 records). [2025-09-16T17:26:24.299142] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-09-16T17:26:24.379882] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-09-16T17:26:24.674542] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present. [2025-09-16T17:26:24.674691] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed. [2025-09-16T17:26:24.674984] [INFO ] [MAIN ] BFK: Fetched primary data is valid. [2025-09-16T17:26:24.675126] [DEBUG] [LOCAL ] BFK: Saving primary data. [2025-09-16T17:26:24.675867] [DEBUG] [LOCAL ] BFK: Trimmed 14613 records to 9721 (keeping 150 days of data) [2025-09-16T17:26:24.761670] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-16T17:26:24.777430] [DEBUG] [LOCAL ] BFK: Primary data saved (9721 records). [2025-09-16T17:26:24.777604] [INFO ] [MAIN ] BFK: Full history saved. [2025-09-16T17:26:24.777704] [INFO ] [MAIN ] Update Progress: 254/2369 symbols completed. BFK took 23.1s. Estimated remaining: 3h 39m 30s. Rate: 9.6 symbols/min [2025-09-16T17:26:24.947028] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:26:24.956061] [DEBUG] [LOCAL ] BFZ: Loaded 8249 existing records from primary storage. [2025-09-16T17:26:24.956149] [INFO ] [MAIN ] BFZ: Loaded 8249 existing records. [2025-09-16T17:26:25.131096] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:26:25.131313] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-09-16T17:26:25.131361] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-09-16T17:26:25.131758] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-09-16T17:26:25.131813] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-09-16T17:26:25.187285] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-09-16T17:26:25.487547] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:26:25.638970] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-16T17:26:25.974915] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-09-16T17:26:26.595356] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-16T17:26:26.750006] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-16T17:26:26.774860] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-09-16T17:26:27.574883] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-09-16T17:26:28.088484] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-16T17:26:28.094446] [INFO ] [REMOTE ] BFLY: Full fetch complete (56085 records). [2025-09-16T17:26:28.094560] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-09-16T17:26:28.095286] [FATAL] [VALIDATOR ] BFLY: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:26:28.095367] [FATAL] [MAIN ] BFLY: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:26:28.095404] [WARN ] [MAIN ] BFLY: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:26:28.095451] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-09-16T17:26:28.095536] [DEBUG] [LOCAL ] BFLY: No primary data file found to delete. [2025-09-16T17:26:28.095597] [INFO ] [LOCAL ] BFLY: Starting deletion of derivative data. [2025-09-16T17:26:28.095977] [DEBUG] [LOCAL ] BFLY: Deleted derivative data file. [2025-09-16T17:26:28.096104] [INFO ] [MAIN ] Update Progress: 255/2369 symbols completed. BFLY took 20.3s. Estimated remaining: 3h 39m 0s. Rate: 9.7 symbols/min [2025-09-16T17:26:28.300873] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:26:28.335850] [DEBUG] [LOCAL ] BG: Loaded 37332 existing records from primary storage. [2025-09-16T17:26:28.335991] [INFO ] [MAIN ] BG: Loaded 37332 existing records. [2025-09-16T17:26:28.380080] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-09-16T17:26:28.513090] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:26:28.513377] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-09-16T17:26:28.513441] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-09-16T17:26:28.514386] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-09-16T17:26:28.514441] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-09-16T17:26:28.865103] [INFO ] [REMOTE ] BG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:26:28.885743] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-16T17:26:29.174914] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-09-16T17:26:29.238438] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-16T17:26:29.974915] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-09-16T17:26:30.658909] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-16T17:26:30.774887] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-09-16T17:26:31.067341] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-16T17:26:31.072380] [INFO ] [REMOTE ] BFH: Full fetch complete (45180 records). [2025-09-16T17:26:31.072506] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-09-16T17:26:31.073213] [FATAL] [VALIDATOR ] BFH: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:26:31.073324] [FATAL] [MAIN ] BFH: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:26:31.073709] [WARN ] [MAIN ] BFH: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:26:31.073955] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-09-16T17:26:31.074051] [DEBUG] [LOCAL ] BFH: No primary data file found to delete. [2025-09-16T17:26:31.074095] [INFO ] [LOCAL ] BFH: Starting deletion of derivative data. [2025-09-16T17:26:31.074377] [DEBUG] [LOCAL ] BFH: Deleted derivative data file. [2025-09-16T17:26:31.074541] [INFO ] [MAIN ] Update Progress: 256/2369 symbols completed. BFH took 35.3s. Estimated remaining: 3h 38m 27s. Rate: 9.7 symbols/min [2025-09-16T17:26:31.276337] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:26:31.292780] [DEBUG] [LOCAL ] BGB: Loaded 12257 existing records from primary storage. [2025-09-16T17:26:31.292963] [INFO ] [MAIN ] BGB: Loaded 12257 existing records. [2025-09-16T17:26:31.469325] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:26:31.469558] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-09-16T17:26:31.469604] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-09-16T17:26:31.470030] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-09-16T17:26:31.470076] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-09-16T17:26:31.580060] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-09-16T17:26:31.829759] [INFO ] [REMOTE ] BGB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:26:32.161274] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-16T17:26:32.374905] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-09-16T17:26:32.636394] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-16T17:26:32.905839] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-16T17:26:33.174913] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-09-16T17:26:33.925164] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-16T17:26:33.974849] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-09-16T17:26:34.774904] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-09-16T17:26:34.842416] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-16T17:26:35.522538] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-16T17:26:35.574873] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-09-16T17:26:36.374882] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-09-16T17:26:36.845513] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-16T17:26:37.174937] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-09-16T17:26:37.842110] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-16T17:26:37.974908] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-09-16T17:26:37.994613] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-16T17:26:38.724740] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-16T17:26:38.774872] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-09-16T17:26:39.574973] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-09-16T17:26:39.666847] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-16T17:26:40.326373] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-16T17:26:40.374892] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-09-16T17:26:41.174970] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-09-16T17:26:41.975010] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-09-16T17:26:42.159892] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-16T17:26:42.240361] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-16T17:26:42.776985] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-09-16T17:26:42.778041] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-16T17:26:43.574937] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-09-16T17:26:44.083918] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-16T17:26:44.369858] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-16T17:26:44.374835] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-09-16T17:26:45.174906] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-09-16T17:26:45.783559] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-16T17:26:45.785781] [INFO ] [REMOTE ] BFZ: Full fetch complete (12628 records). [2025-09-16T17:26:45.785856] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-09-16T17:26:45.982697] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-09-16T17:26:46.091272] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-16T17:26:46.117602] [INFO ] [REMOTE ] BGB: Full fetch complete (19454 records). [2025-09-16T17:26:46.139962] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-09-16T17:26:46.272175] [DEBUG] [VALIDATOR ] BFZ: All expected trading days are present. [2025-09-16T17:26:46.280263] [DEBUG] [VALIDATOR ] BFZ: Primary data validation passed. [2025-09-16T17:26:46.283088] [INFO ] [MAIN ] BFZ: Fetched primary data is valid. [2025-09-16T17:26:46.283204] [DEBUG] [LOCAL ] BFZ: Saving primary data. [2025-09-16T17:26:46.295034] [DEBUG] [LOCAL ] BFZ: Trimmed 12628 records to 8443 (keeping 150 days of data) [2025-09-16T17:26:46.550588] [DEBUG] [LOCAL ] BFZ: Primary data saved (8443 records). [2025-09-16T17:26:46.574677] [INFO ] [MAIN ] BFZ: Full history saved. [2025-09-16T17:26:46.582855] [INFO ] [MAIN ] Update Progress: 257/2369 symbols completed. BFZ took 21.8s. Estimated remaining: 3h 39m 37s. Rate: 9.6 symbols/min [2025-09-16T17:26:46.683480] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-09-16T17:26:46.699383] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-09-16T17:26:46.710045] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-09-16T17:26:46.710336] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-09-16T17:26:46.731559] [DEBUG] [LOCAL ] BGB: Trimmed 19454 records to 12351 (keeping 150 days of data) [2025-09-16T17:26:46.780377] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-09-16T17:26:46.783229] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:26:46.854891] [DEBUG] [LOCAL ] BGH: Loaded 12045 existing records from primary storage. [2025-09-16T17:26:46.856852] [INFO ] [MAIN ] BGH: Loaded 12045 existing records. [2025-09-16T17:26:47.043487] [WARN ] [MAIN ] BGH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:26:47.047616] [DEBUG] [LOCAL ] BGB: Primary data saved (12351 records). [2025-09-16T17:26:47.047796] [INFO ] [MAIN ] BGB: Full history saved. [2025-09-16T17:26:47.048080] [INFO ] [MAIN ] Update Progress: 258/2369 symbols completed. BGB took 16.0s. Estimated remaining: 3h 38m 44s. Rate: 9.7 symbols/min [2025-09-16T17:26:47.047998] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-09-16T17:26:47.091246] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-09-16T17:26:47.139015] [DEBUG] [LOCAL ] BGH: Deleted primary data file. [2025-09-16T17:26:47.149355] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-09-16T17:26:47.343663] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:26:47.523326] [DEBUG] [LOCAL ] BGR: Loaded 9621 existing records from primary storage. [2025-09-16T17:26:47.523929] [INFO ] [MAIN ] BGR: Loaded 9621 existing records. [2025-09-16T17:26:47.697402] [INFO ] [REMOTE ] BGH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:26:47.714838] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-09-16T17:26:47.811902] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:26:47.812769] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-09-16T17:26:47.813921] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-16T17:26:47.814007] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-09-16T17:26:47.817744] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-09-16T17:26:47.817855] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-09-16T17:26:48.221170] [INFO ] [REMOTE ] BGR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:26:48.226256] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-16T17:26:48.374853] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-09-16T17:26:48.732611] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-16T17:26:49.174910] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-09-16T17:26:49.920082] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-16T17:26:49.921868] [INFO ] [REMOTE ] BFS: Full fetch complete (9682 records). [2025-09-16T17:26:49.921940] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-09-16T17:26:49.984488] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-09-16T17:26:50.285851] [DEBUG] [VALIDATOR ] BFS: All expected trading days are present. [2025-09-16T17:26:50.286010] [DEBUG] [VALIDATOR ] BFS: Primary data validation passed. [2025-09-16T17:26:50.286289] [INFO ] [MAIN ] BFS: Fetched primary data is valid. [2025-09-16T17:26:50.286342] [DEBUG] [LOCAL ] BFS: Saving primary data. [2025-09-16T17:26:50.287168] [DEBUG] [LOCAL ] BFS: Trimmed 9682 records to 6786 (keeping 150 days of data) [2025-09-16T17:26:50.349691] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-16T17:26:50.371495] [DEBUG] [LOCAL ] BFS: Primary data saved (6786 records). [2025-09-16T17:26:50.371619] [INFO ] [MAIN ] BFS: Full history saved. [2025-09-16T17:26:50.371732] [INFO ] [MAIN ] Update Progress: 259/2369 symbols completed. BFS took 40.2s. Estimated remaining: 3h 38m 14s. Rate: 9.7 symbols/min [2025-09-16T17:26:50.541961] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:26:50.584228] [DEBUG] [LOCAL ] BGS: Loaded 37320 existing records from primary storage. [2025-09-16T17:26:50.584394] [INFO ] [MAIN ] BGS: Loaded 37320 existing records. [2025-09-16T17:26:50.760701] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:26:50.760952] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-09-16T17:26:50.761001] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-09-16T17:26:50.761897] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-09-16T17:26:50.761953] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-09-16T17:26:50.782461] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-09-16T17:26:51.111894] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-16T17:26:51.130668] [INFO ] [REMOTE ] BGS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:26:51.578342] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-09-16T17:26:51.579227] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-16T17:26:52.096820] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-16T17:26:52.374903] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-09-16T17:26:53.174902] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-09-16T17:26:53.232243] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-16T17:26:53.974903] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-09-16T17:26:54.526425] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-16T17:26:54.774900] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-09-16T17:26:54.984202] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-16T17:26:55.574896] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-09-16T17:26:56.374873] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-09-16T17:26:56.444297] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-16T17:26:56.812264] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-16T17:26:56.820328] [INFO ] [REMOTE ] BG: Full fetch complete (54772 records). [2025-09-16T17:26:56.820466] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-09-16T17:26:57.107439] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-16T17:26:57.189504] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-09-16T17:26:57.241178] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-09-16T17:26:57.241254] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-09-16T17:26:57.241890] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-09-16T17:26:57.241946] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-09-16T17:26:57.243395] [DEBUG] [LOCAL ] BG: Trimmed 54772 records to 37699 (keeping 150 days of data) [2025-09-16T17:26:57.482759] [DEBUG] [LOCAL ] BG: Primary data saved (37699 records). [2025-09-16T17:26:57.482909] [INFO ] [MAIN ] BG: Full history saved. [2025-09-16T17:26:57.482992] [INFO ] [MAIN ] Update Progress: 260/2369 symbols completed. BG took 29.4s. Estimated remaining: 3h 38m 15s. Rate: 9.7 symbols/min [2025-09-16T17:26:57.653774] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:26:57.660144] [DEBUG] [LOCAL ] BGSF: Loaded 4578 existing records from primary storage. [2025-09-16T17:26:57.660256] [INFO ] [MAIN ] BGSF: Loaded 4578 existing records. [2025-09-16T17:26:57.837784] [WARN ] [MAIN ] BGSF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:26:57.838038] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-09-16T17:26:57.838106] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-09-16T17:26:57.838340] [DEBUG] [LOCAL ] BGSF: Deleted primary data file. [2025-09-16T17:26:57.838383] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-09-16T17:26:57.981521] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-09-16T17:26:58.197708] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-16T17:26:58.207392] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:26:58.774915] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-09-16T17:26:59.254330] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-16T17:26:59.574867] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-09-16T17:26:59.681653] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-16T17:26:59.972450] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-16T17:27:00.374911] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-09-16T17:27:01.174897] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-09-16T17:27:01.974914] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-09-16T17:27:02.100050] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-16T17:27:02.263754] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-16T17:27:02.774888] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-09-16T17:27:03.062249] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-16T17:27:03.574894] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-09-16T17:27:03.638722] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-16T17:27:04.374916] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-09-16T17:27:05.174910] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-09-16T17:27:05.210367] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-16T17:27:05.332891] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-16T17:27:05.617391] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-16T17:27:05.974901] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-09-16T17:27:06.774944] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-09-16T17:27:07.558821] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-16T17:27:07.574853] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-09-16T17:27:07.786839] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-16T17:27:08.328097] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-16T17:27:08.374956] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-09-16T17:27:09.153046] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-16T17:27:09.155814] [INFO ] [REMOTE ] BGR: Full fetch complete (14905 records). [2025-09-16T17:27:09.156166] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-09-16T17:27:09.180086] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-09-16T17:27:09.518162] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present. [2025-09-16T17:27:09.518242] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed. [2025-09-16T17:27:09.518524] [INFO ] [MAIN ] BGR: Fetched primary data is valid. [2025-09-16T17:27:09.518565] [DEBUG] [LOCAL ] BGR: Saving primary data. [2025-09-16T17:27:09.519168] [DEBUG] [LOCAL ] BGR: Trimmed 14905 records to 9713 (keeping 150 days of data) [2025-09-16T17:27:09.582815] [DEBUG] [LOCAL ] BGR: Primary data saved (9713 records). [2025-09-16T17:27:09.582955] [INFO ] [MAIN ] BGR: Full history saved. [2025-09-16T17:27:09.583047] [INFO ] [MAIN ] Update Progress: 261/2369 symbols completed. BGR took 22.5s. Estimated remaining: 3h 38m 57s. Rate: 9.6 symbols/min [2025-09-16T17:27:09.753605] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:27:09.766749] [DEBUG] [LOCAL ] BGT: Loaded 12264 existing records from primary storage. [2025-09-16T17:27:09.766880] [INFO ] [MAIN ] BGT: Loaded 12264 existing records. [2025-09-16T17:27:09.941317] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:27:09.941545] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-09-16T17:27:09.942372] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-09-16T17:27:09.942818] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-09-16T17:27:09.942866] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-09-16T17:27:09.979960] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-09-16T17:27:10.315671] [INFO ] [REMOTE ] BGT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:27:10.774976] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-09-16T17:27:11.047155] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-16T17:27:11.083569] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-16T17:27:11.452088] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-16T17:27:11.574934] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-09-16T17:27:12.374931] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-09-16T17:27:12.626191] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-16T17:27:12.628165] [INFO ] [REMOTE ] BGSF: Full fetch complete (5911 records). [2025-09-16T17:27:12.628233] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-09-16T17:27:12.985505] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-09-16T17:27:12.985580] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-09-16T17:27:12.985757] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-09-16T17:27:12.985801] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-09-16T17:27:12.986183] [DEBUG] [LOCAL ] BGSF: Trimmed 5911 records to 4813 (keeping 150 days of data) [2025-09-16T17:27:13.013346] [DEBUG] [LOCAL ] BGSF: Primary data saved (4813 records). [2025-09-16T17:27:13.013428] [INFO ] [MAIN ] BGSF: Full history saved. [2025-09-16T17:27:13.013503] [INFO ] [MAIN ] Update Progress: 262/2369 symbols completed. BGSF took 15.5s. Estimated remaining: 3h 38m 28s. Rate: 9.6 symbols/min [2025-09-16T17:27:13.181519] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-09-16T17:27:13.183956] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:27:13.194583] [DEBUG] [LOCAL ] BGX: Loaded 7699 existing records from primary storage. [2025-09-16T17:27:13.194743] [INFO ] [MAIN ] BGX: Loaded 7699 existing records. [2025-09-16T17:27:13.378666] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:27:13.378931] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-09-16T17:27:13.378987] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-09-16T17:27:13.379403] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-09-16T17:27:13.379466] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-09-16T17:27:13.671881] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-16T17:27:13.692456] [INFO ] [REMOTE ] BGH: Full fetch complete (17396 records). [2025-09-16T17:27:13.726926] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-09-16T17:27:13.754983] [INFO ] [REMOTE ] BGX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:27:13.980020] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-09-16T17:27:14.130776] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present. [2025-09-16T17:27:14.130875] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed. [2025-09-16T17:27:14.131184] [INFO ] [MAIN ] BGH: Fetched primary data is valid. [2025-09-16T17:27:14.131223] [DEBUG] [LOCAL ] BGH: Saving primary data. [2025-09-16T17:27:14.131808] [DEBUG] [LOCAL ] BGH: Trimmed 17396 records to 12163 (keeping 150 days of data) [2025-09-16T17:27:14.207934] [DEBUG] [LOCAL ] BGH: Primary data saved (12163 records). [2025-09-16T17:27:14.208074] [INFO ] [MAIN ] BGH: Full history saved. [2025-09-16T17:27:14.208157] [INFO ] [MAIN ] Update Progress: 263/2369 symbols completed. BGH took 27.6s. Estimated remaining: 3h 37m 41s. Rate: 9.7 symbols/min [2025-09-16T17:27:14.379792] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:27:14.396455] [DEBUG] [LOCAL ] BGY: Loaded 16276 existing records from primary storage. [2025-09-16T17:27:14.396578] [INFO ] [MAIN ] BGY: Loaded 16276 existing records. [2025-09-16T17:27:14.584092] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:27:14.584543] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-09-16T17:27:14.584690] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-09-16T17:27:14.585304] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-09-16T17:27:14.585390] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-09-16T17:27:14.794850] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-09-16T17:27:14.875686] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-16T17:27:15.004627] [INFO ] [REMOTE ] BGY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:27:15.166567] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-16T17:27:15.497572] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-16T17:27:15.574909] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-09-16T17:27:16.374908] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-09-16T17:27:16.543456] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-16T17:27:17.174949] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-09-16T17:27:17.467293] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-16T17:27:17.776152] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-16T17:27:17.974913] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-09-16T17:27:18.774946] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-09-16T17:27:19.134248] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-16T17:27:19.455135] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-16T17:27:19.574914] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-09-16T17:27:20.374945] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-09-16T17:27:20.575378] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-16T17:27:21.148844] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-16T17:27:21.174952] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-09-16T17:27:21.759384] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-16T17:27:21.974940] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-09-16T17:27:22.757441] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-16T17:27:22.774897] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-09-16T17:27:23.420754] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-16T17:27:23.574924] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-09-16T17:27:24.374906] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-09-16T17:27:24.893581] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-16T17:27:25.108591] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-16T17:27:25.174892] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-09-16T17:27:25.974936] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-09-16T17:27:26.745611] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-16T17:27:26.772275] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-16T17:27:26.777863] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-09-16T17:27:26.779349] [INFO ] [REMOTE ] BGS: Full fetch complete (54816 records). [2025-09-16T17:27:26.779441] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-09-16T17:27:27.157161] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-09-16T17:27:27.157241] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-09-16T17:27:27.157842] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-09-16T17:27:27.157888] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-09-16T17:27:27.159033] [DEBUG] [LOCAL ] BGS: Trimmed 54816 records to 37704 (keeping 150 days of data) [2025-09-16T17:27:27.390230] [DEBUG] [LOCAL ] BGS: Primary data saved (37704 records). [2025-09-16T17:27:27.390397] [INFO ] [MAIN ] BGS: Full history saved. [2025-09-16T17:27:27.392095] [INFO ] [MAIN ] Update Progress: 264/2369 symbols completed. BGS took 37.0s. Estimated remaining: 3h 38m 31s. Rate: 9.6 symbols/min [2025-09-16T17:27:27.561436] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:27:27.561639] [DEBUG] [LOCAL ] BH: No existing data file found in primary storage. [2025-09-16T17:27:27.561696] [WARN ] [MAIN ] BH: No existing data found, performing full refresh instead. [2025-09-16T17:27:27.561816] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-09-16T17:27:27.561855] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-09-16T17:27:27.561895] [DEBUG] [LOCAL ] BH: No primary data file found to delete. [2025-09-16T17:27:27.561928] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-09-16T17:27:27.582196] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-09-16T17:27:27.926490] [INFO ] [REMOTE ] BH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:27:27.974031] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-16T17:27:28.374897] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-09-16T17:27:28.593787] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-16T17:27:29.132810] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-16T17:27:29.174938] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-09-16T17:27:29.974924] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-09-16T17:27:30.042533] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-16T17:27:30.656387] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-16T17:27:30.774871] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-09-16T17:27:31.449969] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-16T17:27:31.574884] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-09-16T17:27:32.374912] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-09-16T17:27:32.460519] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-16T17:27:32.462925] [INFO ] [REMOTE ] BGT: Full fetch complete (17989 records). [2025-09-16T17:27:32.462997] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-09-16T17:27:32.855977] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-09-16T17:27:32.856055] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-09-16T17:27:32.856381] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-09-16T17:27:32.856423] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-09-16T17:27:32.857007] [DEBUG] [LOCAL ] BGT: Trimmed 17989 records to 12384 (keeping 150 days of data) [2025-09-16T17:27:32.933664] [DEBUG] [LOCAL ] BGT: Primary data saved (12384 records). [2025-09-16T17:27:32.933838] [INFO ] [MAIN ] BGT: Full history saved. [2025-09-16T17:27:32.933925] [INFO ] [MAIN ] Update Progress: 265/2369 symbols completed. BGT took 23.4s. Estimated remaining: 3h 38m 19s. Rate: 9.6 symbols/min [2025-09-16T17:27:33.102054] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:27:33.137210] [DEBUG] [LOCAL ] BHC: Loaded 34175 existing records from primary storage. [2025-09-16T17:27:33.137342] [INFO ] [MAIN ] BHC: Loaded 34175 existing records. [2025-09-16T17:27:33.180020] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-09-16T17:27:33.313946] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:27:33.314190] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-09-16T17:27:33.314234] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-09-16T17:27:33.315024] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-09-16T17:27:33.315071] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-09-16T17:27:33.682453] [INFO ] [REMOTE ] BHC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:27:33.685380] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-16T17:27:33.974904] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-09-16T17:27:34.170163] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-16T17:27:34.774909] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-09-16T17:27:35.574922] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-09-16T17:27:35.651391] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-16T17:27:35.651101] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-16T17:27:36.374917] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-09-16T17:27:36.535760] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-16T17:27:37.135779] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-16T17:27:37.174915] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-09-16T17:27:37.974871] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-09-16T17:27:38.247788] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-16T17:27:38.752578] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-16T17:27:38.774853] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-09-16T17:27:39.574914] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-09-16T17:27:39.937244] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-16T17:27:40.328549] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-16T17:27:40.331234] [INFO ] [REMOTE ] BGY: Full fetch complete (25251 records). [2025-09-16T17:27:40.331355] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-09-16T17:27:40.379976] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-09-16T17:27:40.715949] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-09-16T17:27:40.716059] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-09-16T17:27:40.716460] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-09-16T17:27:40.716500] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-09-16T17:27:40.717194] [DEBUG] [LOCAL ] BGY: Trimmed 25251 records to 16395 (keeping 150 days of data) [2025-09-16T17:27:40.813857] [DEBUG] [LOCAL ] BGY: Primary data saved (16395 records). [2025-09-16T17:27:40.814007] [INFO ] [MAIN ] BGY: Full history saved. [2025-09-16T17:27:40.814091] [INFO ] [MAIN ] Update Progress: 266/2369 symbols completed. BGY took 26.6s. Estimated remaining: 3h 38m 26s. Rate: 9.6 symbols/min [2025-09-16T17:27:40.988397] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:27:41.005895] [DEBUG] [LOCAL ] BHE: Loaded 17441 existing records from primary storage. [2025-09-16T17:27:41.006048] [INFO ] [MAIN ] BHE: Loaded 17441 existing records. [2025-09-16T17:27:41.184743] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-09-16T17:27:41.190469] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:27:41.191383] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-09-16T17:27:41.191461] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-09-16T17:27:41.192153] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-09-16T17:27:41.192214] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-09-16T17:27:41.493957] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-16T17:27:41.540740] [INFO ] [REMOTE ] BGX: Full fetch complete (11921 records). [2025-09-16T17:27:41.569355] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-09-16T17:27:41.569257] [INFO ] [REMOTE ] BHE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:27:41.931870] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-09-16T17:27:41.931948] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-09-16T17:27:41.932241] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-09-16T17:27:41.932283] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-09-16T17:27:41.932777] [DEBUG] [LOCAL ] BGX: Trimmed 11921 records to 7749 (keeping 150 days of data) [2025-09-16T17:27:41.976955] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-09-16T17:27:41.982074] [DEBUG] [LOCAL ] BGX: Primary data saved (7749 records). [2025-09-16T17:27:41.982239] [INFO ] [MAIN ] BGX: Full history saved. [2025-09-16T17:27:41.982329] [INFO ] [MAIN ] Update Progress: 267/2369 symbols completed. BGX took 29.0s. Estimated remaining: 3h 37m 40s. Rate: 9.7 symbols/min [2025-09-16T17:27:42.155805] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:27:42.173536] [DEBUG] [LOCAL ] BHK: Loaded 18311 existing records from primary storage. [2025-09-16T17:27:42.173701] [INFO ] [MAIN ] BHK: Loaded 18311 existing records. [2025-09-16T17:27:42.360554] [WARN ] [MAIN ] BHK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:27:42.360840] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-09-16T17:27:42.360886] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-09-16T17:27:42.361396] [DEBUG] [LOCAL ] BHK: Deleted primary data file. [2025-09-16T17:27:42.361441] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-09-16T17:27:42.738596] [INFO ] [REMOTE ] BHK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:27:42.766427] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-16T17:27:42.776056] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-09-16T17:27:42.924676] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-16T17:27:42.927517] [INFO ] [REMOTE ] BH: Full fetch complete (15656 records). [2025-09-16T17:27:42.927610] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-09-16T17:27:43.300266] [DEBUG] [VALIDATOR ] BH: All expected trading days are present. [2025-09-16T17:27:43.300378] [DEBUG] [VALIDATOR ] BH: Primary data validation passed. [2025-09-16T17:27:43.300730] [INFO ] [MAIN ] BH: Fetched primary data is valid. [2025-09-16T17:27:43.300774] [DEBUG] [LOCAL ] BH: Saving primary data. [2025-09-16T17:27:43.301309] [DEBUG] [LOCAL ] BH: Trimmed 15656 records to 13261 (keeping 150 days of data) [2025-09-16T17:27:43.380369] [DEBUG] [LOCAL ] BH: Primary data saved (13261 records). [2025-09-16T17:27:43.380517] [INFO ] [MAIN ] BH: Full history saved. [2025-09-16T17:27:43.380595] [INFO ] [MAIN ] Update Progress: 268/2369 symbols completed. BH took 16.0s. Estimated remaining: 3h 36m 56s. Rate: 9.7 symbols/min [2025-09-16T17:27:43.558034] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:27:43.582551] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-09-16T17:27:43.600514] [DEBUG] [LOCAL ] BHP: Loaded 39376 existing records from primary storage. [2025-09-16T17:27:43.600687] [INFO ] [MAIN ] BHP: Loaded 39376 existing records. [2025-09-16T17:27:43.782144] [WARN ] [MAIN ] BHP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:27:43.782589] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-09-16T17:27:43.782742] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-09-16T17:27:43.790003] [DEBUG] [LOCAL ] BHP: Deleted primary data file. [2025-09-16T17:27:43.791554] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-09-16T17:27:43.825539] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-16T17:27:44.157751] [INFO ] [REMOTE ] BHP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:27:44.374912] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-09-16T17:27:44.942045] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-16T17:27:45.174929] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-09-16T17:27:45.424285] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-16T17:27:45.974913] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-09-16T17:27:46.225902] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-16T17:27:46.774908] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-09-16T17:27:47.574876] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-09-16T17:27:47.607321] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-16T17:27:47.827054] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-16T17:27:48.374899] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-09-16T17:27:48.862175] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-16T17:27:49.174915] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-09-16T17:27:49.974912] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-09-16T17:27:50.008678] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-16T17:27:50.033772] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-16T17:27:50.774906] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-09-16T17:27:51.574942] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-09-16T17:27:52.175368] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-16T17:27:52.374855] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-09-16T17:27:52.581194] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-16T17:27:52.755131] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-16T17:27:53.174870] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-09-16T17:27:53.928072] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-16T17:27:53.974855] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-09-16T17:27:54.774875] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-09-16T17:27:54.878564] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-16T17:27:55.504807] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-16T17:27:55.574858] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-09-16T17:27:55.903257] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-16T17:27:56.374932] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-09-16T17:27:57.158502] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-16T17:27:57.174851] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-09-16T17:27:57.974903] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-09-16T17:27:58.051113] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-16T17:27:58.774932] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-09-16T17:27:59.081205] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-16T17:27:59.085218] [INFO ] [REMOTE ] BHK: Full fetch complete (23529 records). [2025-09-16T17:27:59.085330] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-09-16T17:27:59.303401] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-16T17:27:59.502615] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-09-16T17:27:59.502708] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-09-16T17:27:59.502982] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-09-16T17:27:59.503023] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-09-16T17:27:59.503623] [DEBUG] [LOCAL ] BHK: Trimmed 23529 records to 18457 (keeping 150 days of data) [2025-09-16T17:27:59.586208] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-09-16T17:27:59.618724] [DEBUG] [LOCAL ] BHK: Primary data saved (18457 records). [2025-09-16T17:27:59.618852] [INFO ] [MAIN ] BHK: Full history saved. [2025-09-16T17:27:59.618936] [INFO ] [MAIN ] Update Progress: 269/2369 symbols completed. BHK took 17.6s. Estimated remaining: 3h 38m 8s. Rate: 9.6 symbols/min [2025-09-16T17:27:59.791036] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:27:59.806233] [DEBUG] [LOCAL ] BHR: Loaded 15154 existing records from primary storage. [2025-09-16T17:27:59.806356] [INFO ] [MAIN ] BHR: Loaded 15154 existing records. [2025-09-16T17:27:59.979518] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:27:59.979767] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-09-16T17:27:59.979821] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-09-16T17:27:59.980380] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-09-16T17:27:59.980442] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-09-16T17:28:00.330332] [INFO ] [REMOTE ] BHR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:28:00.346448] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-16T17:28:00.352091] [INFO ] [REMOTE ] BHC: Full fetch complete (50966 records). [2025-09-16T17:28:00.352203] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-09-16T17:28:00.383794] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-09-16T17:28:00.744464] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-09-16T17:28:00.744580] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-09-16T17:28:00.745371] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-09-16T17:28:00.745432] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-09-16T17:28:00.747001] [DEBUG] [LOCAL ] BHC: Trimmed 50966 records to 34553 (keeping 150 days of data) [2025-09-16T17:28:00.948528] [DEBUG] [LOCAL ] BHC: Primary data saved (34553 records). [2025-09-16T17:28:00.948700] [INFO ] [MAIN ] BHC: Full history saved. [2025-09-16T17:28:00.948809] [INFO ] [MAIN ] Update Progress: 270/2369 symbols completed. BHC took 28.0s. Estimated remaining: 3h 37m 24s. Rate: 9.7 symbols/min [2025-09-16T17:28:01.122257] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:28:01.122434] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-09-16T17:28:01.122473] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-09-16T17:28:01.122600] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-09-16T17:28:01.122658] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-16T17:28:01.122706] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-16T17:28:01.122740] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-09-16T17:28:01.187102] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-09-16T17:28:01.494556] [INFO ] [REMOTE ] BHV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:28:01.864111] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-09-16T17:28:01.901485] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-16T17:28:01.974898] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-09-16T17:28:02.774879] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-09-16T17:28:02.858542] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-16T17:28:03.125405] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-16T17:28:03.575003] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-09-16T17:28:04.032610] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-16T17:28:04.374958] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-09-16T17:28:04.634804] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-16T17:28:04.641135] [INFO ] [REMOTE ] BHP: Full fetch complete (58045 records). [2025-09-16T17:28:04.641277] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-09-16T17:28:05.029741] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-09-16T17:28:05.029837] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-09-16T17:28:05.030500] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-09-16T17:28:05.030551] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-09-16T17:28:05.031809] [DEBUG] [LOCAL ] BHP: Trimmed 58045 records to 39761 (keeping 150 days of data) [2025-09-16T17:28:05.212285] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-09-16T17:28:05.284408] [DEBUG] [LOCAL ] BHP: Primary data saved (39761 records). [2025-09-16T17:28:05.284595] [INFO ] [MAIN ] BHP: Full history saved. [2025-09-16T17:28:05.285407] [INFO ] [MAIN ] Update Progress: 271/2369 symbols completed. BHP took 21.9s. Estimated remaining: 3h 37m 3s. Rate: 9.7 symbols/min [2025-09-16T17:28:05.459506] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:28:05.498493] [DEBUG] [LOCAL ] BHVN: Loaded 37135 existing records from primary storage. [2025-09-16T17:28:05.498657] [INFO ] [MAIN ] BHVN: Loaded 37135 existing records. [2025-09-16T17:28:05.684168] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:28:05.684511] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-09-16T17:28:05.684665] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-09-16T17:28:05.685545] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-09-16T17:28:05.685602] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-09-16T17:28:05.875439] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-16T17:28:05.975229] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-09-16T17:28:06.086376] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:28:06.256571] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-16T17:28:06.774931] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-09-16T17:28:07.256088] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-16T17:28:07.276688] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-16T17:28:07.574901] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-09-16T17:28:07.905369] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-16T17:28:08.374905] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-09-16T17:28:08.803315] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-16T17:28:09.174928] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-09-16T17:28:09.510208] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-16T17:28:09.974926] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-09-16T17:28:10.346070] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-16T17:28:10.774906] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-09-16T17:28:11.574873] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-09-16T17:28:11.893838] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-16T17:28:11.985420] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-16T17:28:12.374950] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-09-16T17:28:13.174918] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-09-16T17:28:13.461696] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-16T17:28:13.974908] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-09-16T17:28:14.774896] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-09-16T17:28:14.813433] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-16T17:28:15.107961] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-16T17:28:15.460823] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-16T17:28:15.461710] [INFO ] [REMOTE ] BHV: Full fetch complete (1085 records). [2025-09-16T17:28:15.461840] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-09-16T17:28:15.579977] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-09-16T17:28:15.653830] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 147 unique days, need 150 days [2025-09-16T17:28:15.653996] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:28:15.654045] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:28:15.654091] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-16T17:28:15.654151] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-16T17:28:15.654201] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-09-16T17:28:15.654256] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-09-16T17:28:15.654336] [INFO ] [MAIN ] Update Progress: 272/2369 symbols completed. BHV took 14.7s. Estimated remaining: 3h 37m 29s. Rate: 9.6 symbols/min [2025-09-16T17:28:15.838209] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:28:15.874550] [DEBUG] [LOCAL ] BILL: Loaded 38625 existing records from primary storage. [2025-09-16T17:28:15.874727] [INFO ] [MAIN ] BILL: Loaded 38625 existing records. [2025-09-16T17:28:16.065396] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:28:16.065694] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-09-16T17:28:16.065752] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-09-16T17:28:16.066590] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-09-16T17:28:16.066638] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-09-16T17:28:16.379993] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-09-16T17:28:16.448718] [INFO ] [REMOTE ] BILL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:28:16.732860] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-16T17:28:17.148891] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-16T17:28:17.151793] [INFO ] [REMOTE ] BHE: Full fetch complete (27965 records). [2025-09-16T17:28:17.151869] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-09-16T17:28:17.181333] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-09-16T17:28:17.556454] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-09-16T17:28:17.556556] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-09-16T17:28:17.556955] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-09-16T17:28:17.556999] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-09-16T17:28:17.557707] [DEBUG] [LOCAL ] BHE: Trimmed 27965 records to 17617 (keeping 150 days of data) [2025-09-16T17:28:17.662898] [DEBUG] [LOCAL ] BHE: Primary data saved (17617 records). [2025-09-16T17:28:17.663040] [INFO ] [MAIN ] BHE: Full history saved. [2025-09-16T17:28:17.663125] [INFO ] [MAIN ] Update Progress: 273/2369 symbols completed. BHE took 36.8s. Estimated remaining: 3h 36m 50s. Rate: 9.7 symbols/min [2025-09-16T17:28:17.831405] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:28:17.849389] [DEBUG] [LOCAL ] BIO: Loaded 18273 existing records from primary storage. [2025-09-16T17:28:17.849509] [INFO ] [MAIN ] BIO: Loaded 18273 existing records. [2025-09-16T17:28:17.980022] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-09-16T17:28:18.033235] [WARN ] [MAIN ] BIO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:28:18.033502] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-09-16T17:28:18.033548] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-09-16T17:28:18.034128] [DEBUG] [LOCAL ] BIO: Deleted primary data file. [2025-09-16T17:28:18.034178] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-09-16T17:28:18.392011] [INFO ] [REMOTE ] BIO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:28:18.774882] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-09-16T17:28:19.017669] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-16T17:28:19.574927] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-09-16T17:28:19.779858] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-16T17:28:19.831142] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-16T17:28:20.374922] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-09-16T17:28:20.583914] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-16T17:28:21.133324] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-16T17:28:21.174853] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-09-16T17:28:21.974870] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-09-16T17:28:22.180595] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-16T17:28:22.774927] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-09-16T17:28:23.574879] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-09-16T17:28:23.696131] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-16T17:28:24.045947] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-16T17:28:24.049611] [INFO ] [REMOTE ] BHR: Full fetch complete (22674 records). [2025-09-16T17:28:24.049743] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-09-16T17:28:24.379468] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-09-16T17:28:24.419429] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-09-16T17:28:24.419515] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-09-16T17:28:24.419922] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-09-16T17:28:24.419968] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-09-16T17:28:24.420630] [DEBUG] [LOCAL ] BHR: Trimmed 22674 records to 15316 (keeping 150 days of data) [2025-09-16T17:28:24.508763] [DEBUG] [LOCAL ] BHR: Primary data saved (15316 records). [2025-09-16T17:28:24.508922] [INFO ] [MAIN ] BHR: Full history saved. [2025-09-16T17:28:24.509010] [INFO ] [MAIN ] Update Progress: 274/2369 symbols completed. BHR took 24.9s. Estimated remaining: 3h 36m 49s. Rate: 9.7 symbols/min [2025-09-16T17:28:24.683159] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:28:24.717078] [DEBUG] [LOCAL ] BIP: Loaded 27810 existing records from primary storage. [2025-09-16T17:28:24.717228] [INFO ] [MAIN ] BIP: Loaded 27810 existing records. [2025-09-16T17:28:24.897914] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:28:24.898208] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-09-16T17:28:24.898287] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-09-16T17:28:24.899089] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-09-16T17:28:24.899142] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-09-16T17:28:25.176765] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-09-16T17:28:25.275258] [INFO ] [REMOTE ] BIP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:28:25.377093] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-16T17:28:25.696847] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-16T17:28:25.974920] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-09-16T17:28:26.774928] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-09-16T17:28:26.988303] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-16T17:28:27.303129] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-16T17:28:27.574960] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-09-16T17:28:27.891600] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-16T17:28:28.374911] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-09-16T17:28:29.174921] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-09-16T17:28:29.238247] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-16T17:28:29.985934] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-09-16T17:28:30.009542] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-16T17:28:30.774912] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-09-16T17:28:30.826819] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-16T17:28:31.347628] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-16T17:28:31.575032] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-09-16T17:28:32.177092] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-16T17:28:32.374900] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-09-16T17:28:32.826539] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-16T17:28:33.174930] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-09-16T17:28:33.974916] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-09-16T17:28:34.177864] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-16T17:28:34.464067] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-16T17:28:34.774919] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-09-16T17:28:35.574919] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-09-16T17:28:35.635920] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-16T17:28:35.670992] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-16T17:28:36.374930] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-09-16T17:28:37.009322] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-16T17:28:37.174872] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-09-16T17:28:37.230374] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-16T17:28:37.974924] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-09-16T17:28:38.299814] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-16T17:28:38.774907] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-09-16T17:28:39.574940] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-09-16T17:28:39.754468] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-16T17:28:39.760391] [INFO ] [REMOTE ] BHVN: Full fetch complete (53279 records). [2025-09-16T17:28:39.760498] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-09-16T17:28:40.168308] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-09-16T17:28:40.168442] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-09-16T17:28:40.169862] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-09-16T17:28:40.169945] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-09-16T17:28:40.172860] [DEBUG] [LOCAL ] BHVN: Trimmed 53279 records to 37493 (keeping 150 days of data) [2025-09-16T17:28:40.376461] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-09-16T17:28:40.423448] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-16T17:28:40.449403] [DEBUG] [LOCAL ] BHVN: Primary data saved (37493 records). [2025-09-16T17:28:40.449533] [INFO ] [MAIN ] BHVN: Full history saved. [2025-09-16T17:28:40.450452] [INFO ] [MAIN ] Update Progress: 275/2369 symbols completed. BHVN took 35.2s. Estimated remaining: 3h 37m 57s. Rate: 9.6 symbols/min [2025-09-16T17:28:40.631268] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:28:40.664305] [DEBUG] [LOCAL ] BIPC: Loaded 29926 existing records from primary storage. [2025-09-16T17:28:40.664442] [INFO ] [MAIN ] BIPC: Loaded 29926 existing records. [2025-09-16T17:28:40.846222] [WARN ] [MAIN ] BIPC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:28:40.846465] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-09-16T17:28:40.846520] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-09-16T17:28:40.847375] [DEBUG] [LOCAL ] BIPC: Deleted primary data file. [2025-09-16T17:28:40.847431] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-09-16T17:28:41.177871] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-09-16T17:28:41.236658] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:28:41.264827] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-16T17:28:41.281556] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-16T17:28:41.284386] [INFO ] [REMOTE ] BIO: Full fetch complete (28282 records). [2025-09-16T17:28:41.284476] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-09-16T17:28:41.658850] [DEBUG] [VALIDATOR ] BIO: All expected trading days are present. [2025-09-16T17:28:41.658930] [DEBUG] [VALIDATOR ] BIO: Primary data validation passed. [2025-09-16T17:28:41.659379] [INFO ] [MAIN ] BIO: Fetched primary data is valid. [2025-09-16T17:28:41.659444] [DEBUG] [LOCAL ] BIO: Saving primary data. [2025-09-16T17:28:41.660236] [DEBUG] [LOCAL ] BIO: Trimmed 28282 records to 18405 (keeping 150 days of data) [2025-09-16T17:28:41.771820] [DEBUG] [LOCAL ] BIO: Primary data saved (18405 records). [2025-09-16T17:28:41.771964] [INFO ] [MAIN ] BIO: Full history saved. [2025-09-16T17:28:41.772059] [INFO ] [MAIN ] Update Progress: 276/2369 symbols completed. BIO took 24.1s. Estimated remaining: 3h 37m 13s. Rate: 9.6 symbols/min [2025-09-16T17:28:41.953618] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:28:41.956986] [DEBUG] [LOCAL ] BIPH: Loaded 1566 existing records from primary storage. [2025-09-16T17:28:41.957059] [INFO ] [MAIN ] BIPH: Loaded 1566 existing records. [2025-09-16T17:28:41.980045] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-09-16T17:28:42.144249] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:28:42.144525] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-09-16T17:28:42.144590] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-09-16T17:28:42.144860] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-09-16T17:28:42.144954] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-09-16T17:28:42.508709] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:28:42.774855] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-09-16T17:28:42.990663] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-16T17:28:43.389627] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-16T17:28:43.548929] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-16T17:28:43.574862] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-09-16T17:28:44.374924] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-09-16T17:28:44.829011] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-16T17:28:45.144506] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-16T17:28:45.149290] [INFO ] [REMOTE ] BIP: Full fetch complete (43456 records). [2025-09-16T17:28:45.149393] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-09-16T17:28:45.179998] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-09-16T17:28:45.542003] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-09-16T17:28:45.542116] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-09-16T17:28:45.542665] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-09-16T17:28:45.542712] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-09-16T17:28:45.544523] [DEBUG] [LOCAL ] BIP: Trimmed 43456 records to 28099 (keeping 150 days of data) [2025-09-16T17:28:45.722763] [DEBUG] [LOCAL ] BIP: Primary data saved (28099 records). [2025-09-16T17:28:45.722905] [INFO ] [MAIN ] BIP: Full history saved. [2025-09-16T17:28:45.725884] [INFO ] [MAIN ] Update Progress: 277/2369 symbols completed. BIP took 21.2s. Estimated remaining: 3h 36m 50s. Rate: 9.6 symbols/min [2025-09-16T17:28:45.828755] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-16T17:28:45.974863] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-09-16T17:28:46.352391] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-16T17:28:46.774904] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-09-16T17:28:47.574904] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-09-16T17:28:48.323269] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-16T17:28:48.374922] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-09-16T17:28:49.027685] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-16T17:28:49.174899] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-09-16T17:28:49.614746] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-16T17:28:49.743746] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-16T17:28:49.974912] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-09-16T17:28:50.774945] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-09-16T17:28:51.267390] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-16T17:28:51.574894] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-09-16T17:28:52.374962] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-09-16T17:28:52.728768] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-16T17:28:52.730208] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-16T17:28:52.739197] [INFO ] [REMOTE ] BILL: Full fetch complete (56980 records). [2025-09-16T17:28:52.739369] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-09-16T17:28:53.149019] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-09-16T17:28:53.149208] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-09-16T17:28:53.150054] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-09-16T17:28:53.150121] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-09-16T17:28:53.151656] [DEBUG] [LOCAL ] BILL: Trimmed 56980 records to 39007 (keeping 150 days of data) [2025-09-16T17:28:53.209878] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-09-16T17:28:53.282473] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-16T17:28:53.427602] [DEBUG] [LOCAL ] BILL: Primary data saved (39007 records). [2025-09-16T17:28:53.427766] [INFO ] [MAIN ] BILL: Full history saved. [2025-09-16T17:28:53.427859] [INFO ] [MAIN ] Update Progress: 278/2369 symbols completed. BILL took 37.8s. Estimated remaining: 3h 36m 55s. Rate: 9.6 symbols/min [2025-09-16T17:28:53.690849] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-16T17:28:53.974923] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-09-16T17:28:54.774916] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-09-16T17:28:55.072315] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-16T17:28:55.240884] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-16T17:28:55.241984] [INFO ] [REMOTE ] BIPH: Full fetch complete (2794 records). [2025-09-16T17:28:55.242058] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-09-16T17:28:55.580077] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-09-16T17:28:55.631009] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-09-16T17:28:55.631078] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-09-16T17:28:55.631191] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-09-16T17:28:55.631229] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-09-16T17:28:55.631566] [DEBUG] [LOCAL ] BIPH: Trimmed 2794 records to 1585 (keeping 150 days of data) [2025-09-16T17:28:55.642225] [DEBUG] [LOCAL ] BIPH: Primary data saved (1585 records). [2025-09-16T17:28:55.642292] [INFO ] [MAIN ] BIPH: Full history saved. [2025-09-16T17:28:55.642360] [INFO ] [MAIN ] Update Progress: 279/2369 symbols completed. BIPH took 13.9s. Estimated remaining: 3h 36m 19s. Rate: 9.7 symbols/min [2025-09-16T17:28:57.205341] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-16T17:28:57.214759] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-09-16T17:28:58.794521] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-16T17:28:58.803325] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-09-16T17:28:59.915906] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-16T17:28:59.920665] [INFO ] [REMOTE ] BIPC: Full fetch complete (45505 records). [2025-09-16T17:28:59.920779] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-09-16T17:29:00.303430] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present. [2025-09-16T17:29:00.303552] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed. [2025-09-16T17:29:00.304213] [INFO ] [MAIN ] BIPC: Fetched primary data is valid. [2025-09-16T17:29:00.304301] [DEBUG] [LOCAL ] BIPC: Saving primary data. [2025-09-16T17:29:00.307134] [DEBUG] [LOCAL ] BIPC: Trimmed 45505 records to 30211 (keeping 150 days of data) [2025-09-16T17:29:00.498257] [DEBUG] [LOCAL ] BIPC: Primary data saved (30211 records). [2025-09-16T17:29:00.498391] [INFO ] [MAIN ] BIPC: Full history saved. [2025-09-16T17:29:00.499287] [INFO ] [MAIN ] Update Progress: 280/2369 symbols completed. BIPC took 20.0s. Estimated remaining: 3h 36m 2s. Rate: 9.7 symbols/min [2025-09-16T17:29:01.085952] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:29:01.212570] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:29:01.222597] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:29:01.242425] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:29:01.250478] [DEBUG] [LOCAL ] BIPI: Loaded 2045 existing records from primary storage. [2025-09-16T17:29:01.248910] [DEBUG] [LOCAL ] BIPJ: Loaded 2114 existing records from primary storage. [2025-09-16T17:29:01.251002] [INFO ] [MAIN ] BIPI: Loaded 2045 existing records. [2025-09-16T17:29:01.261930] [INFO ] [MAIN ] BIPJ: Loaded 2114 existing records. [2025-09-16T17:29:01.480443] [DEBUG] [LOCAL ] BIT: Loaded 16393 existing records from primary storage. [2025-09-16T17:29:01.535853] [INFO ] [MAIN ] BIT: Loaded 16393 existing records. [2025-09-16T17:29:01.620564] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:29:01.657351] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-09-16T17:29:01.732668] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-09-16T17:29:01.732532] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:29:01.783197] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-09-16T17:29:01.783091] [DEBUG] [LOCAL ] BIRK: Loaded 37594 existing records from primary storage. [2025-09-16T17:29:01.799139] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-09-16T17:29:01.798994] [INFO ] [MAIN ] BIRK: Loaded 37594 existing records. [2025-09-16T17:29:01.788461] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-09-16T17:29:01.849660] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-09-16T17:29:01.866098] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-09-16T17:29:01.858951] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-09-16T17:29:01.911213] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:29:02.144675] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-09-16T17:29:02.216412] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-09-16T17:29:02.436067] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:29:02.394740] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-09-16T17:29:02.474556] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-09-16T17:29:02.508438] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-09-16T17:29:02.508504] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-09-16T17:29:02.593722] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-09-16T17:29:02.698449] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-09-16T17:29:03.029638] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:29:03.142681] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-09-16T17:29:03.173052] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:29:03.208516] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-09-16T17:29:03.472113] [INFO ] [REMOTE ] BIT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:29:03.482775] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-09-16T17:29:03.592595] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:29:03.592922] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-09-16T17:29:03.727438] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-16T17:29:03.728687] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-09-16T17:29:03.833717] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-16T17:29:03.834900] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-09-16T17:29:04.132807] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-09-16T17:29:04.134014] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-09-16T17:29:04.350489] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-16T17:29:04.352398] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-09-16T17:29:04.501323] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-16T17:29:04.503466] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-09-16T17:29:04.525803] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-16T17:29:04.799228] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-16T17:29:04.831522] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-16T17:29:05.180421] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-09-16T17:29:05.183415] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-16T17:29:05.727281] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-16T17:29:05.974916] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-09-16T17:29:06.273602] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-09-16T17:29:06.774946] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-09-16T17:29:07.248744] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-16T17:29:07.574949] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-09-16T17:29:08.374899] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-09-16T17:29:08.798199] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-16T17:29:09.174918] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-09-16T17:29:09.456730] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-16T17:29:09.974912] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-09-16T17:29:10.443730] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-16T17:29:10.509558] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-16T17:29:10.774906] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-09-16T17:29:11.574885] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-09-16T17:29:11.999326] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-16T17:29:12.029110] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-16T17:29:12.374901] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-09-16T17:29:13.174879] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-09-16T17:29:13.369037] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-16T17:29:13.544020] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-16T17:29:13.974904] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-09-16T17:29:14.774903] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-09-16T17:29:15.447748] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-16T17:29:15.574884] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-09-16T17:29:15.769240] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-16T17:29:16.144858] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-16T17:29:16.146008] [INFO ] [REMOTE ] BIPI: Full fetch complete (3619 records). [2025-09-16T17:29:16.146078] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-09-16T17:29:16.385178] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-09-16T17:29:16.512067] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-09-16T17:29:16.512141] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-09-16T17:29:16.512263] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-09-16T17:29:16.512301] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-09-16T17:29:16.512666] [DEBUG] [LOCAL ] BIPI: Trimmed 3619 records to 2076 (keeping 150 days of data) [2025-09-16T17:29:16.526032] [DEBUG] [LOCAL ] BIPI: Primary data saved (2076 records). [2025-09-16T17:29:16.526093] [INFO ] [MAIN ] BIPI: Full history saved. [2025-09-16T17:29:16.526164] [INFO ] [MAIN ] Update Progress: 281/2369 symbols completed. BIPI took 16.0s. Estimated remaining: 3h 37m 9s. Rate: 9.6 symbols/min [2025-09-16T17:29:16.693721] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:29:16.741389] [DEBUG] [LOCAL ] BJ: Loaded 37884 existing records from primary storage. [2025-09-16T17:29:16.741534] [INFO ] [MAIN ] BJ: Loaded 37884 existing records. [2025-09-16T17:29:16.929899] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:29:16.930250] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-09-16T17:29:16.930321] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-09-16T17:29:16.931726] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-09-16T17:29:16.931992] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-09-16T17:29:17.175552] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-09-16T17:29:17.244119] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-16T17:29:17.500672] [INFO ] [REMOTE ] BJ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:29:17.946614] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-16T17:29:17.948427] [INFO ] [REMOTE ] BIPJ: Full fetch complete (3106 records). [2025-09-16T17:29:17.948551] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-09-16T17:29:17.982208] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-09-16T17:29:18.333290] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-09-16T17:29:18.333374] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-09-16T17:29:18.333520] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-09-16T17:29:18.333563] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-09-16T17:29:18.333970] [DEBUG] [LOCAL ] BIPJ: Trimmed 3106 records to 2171 (keeping 150 days of data) [2025-09-16T17:29:18.348344] [DEBUG] [LOCAL ] BIPJ: Primary data saved (2171 records). [2025-09-16T17:29:18.348441] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-09-16T17:29:18.348531] [INFO ] [MAIN ] Update Progress: 282/2369 symbols completed. BIPJ took 17.8s. Estimated remaining: 3h 36m 30s. Rate: 9.6 symbols/min [2025-09-16T17:29:18.525549] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:29:18.566871] [DEBUG] [LOCAL ] BK: Loaded 39555 existing records from primary storage. [2025-09-16T17:29:18.567047] [INFO ] [MAIN ] BK: Loaded 39555 existing records. [2025-09-16T17:29:18.747000] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:29:18.747228] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-09-16T17:29:18.747273] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-09-16T17:29:18.748213] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-09-16T17:29:18.748262] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-09-16T17:29:18.780034] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-09-16T17:29:19.093835] [INFO ] [REMOTE ] BK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:29:19.561143] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-16T17:29:19.574861] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-09-16T17:29:20.374869] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-09-16T17:29:20.670079] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-16T17:29:21.021451] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-16T17:29:21.174903] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-09-16T17:29:21.974865] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-09-16T17:29:22.030510] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-16T17:29:22.599666] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-16T17:29:22.774912] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-09-16T17:29:23.317772] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-16T17:29:23.574906] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-09-16T17:29:24.351834] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-16T17:29:24.374850] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-09-16T17:29:24.669081] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-16T17:29:25.174902] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-09-16T17:29:25.927166] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-16T17:29:25.974844] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-09-16T17:29:26.774908] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-09-16T17:29:27.045007] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-16T17:29:27.320158] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-16T17:29:27.574879] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-09-16T17:29:28.370202] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-16T17:29:28.376198] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-09-16T17:29:28.378224] [INFO ] [REMOTE ] BIRK: Full fetch complete (55266 records). [2025-09-16T17:29:28.378327] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-09-16T17:29:28.770246] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-09-16T17:29:28.770328] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-09-16T17:29:28.771051] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-09-16T17:29:28.771097] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-09-16T17:29:28.772252] [DEBUG] [LOCAL ] BIRK: Trimmed 55266 records to 37975 (keeping 150 days of data) [2025-09-16T17:29:28.995914] [DEBUG] [LOCAL ] BIRK: Primary data saved (37975 records). [2025-09-16T17:29:28.996072] [INFO ] [MAIN ] BIRK: Full history saved. [2025-09-16T17:29:28.996162] [INFO ] [MAIN ] Update Progress: 283/2369 symbols completed. BIRK took 28.5s. Estimated remaining: 3h 36m 57s. Rate: 9.6 symbols/min [2025-09-16T17:29:29.167242] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:29:29.174874] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-09-16T17:29:29.202741] [DEBUG] [LOCAL ] BKD: Loaded 37053 existing records from primary storage. [2025-09-16T17:29:29.202966] [INFO ] [MAIN ] BKD: Loaded 37053 existing records. [2025-09-16T17:29:29.346748] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-16T17:29:29.423985] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:29:29.424220] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-09-16T17:29:29.424265] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-09-16T17:29:29.425123] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-09-16T17:29:29.425173] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-09-16T17:29:29.777892] [INFO ] [REMOTE ] BKD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:29:29.974968] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-09-16T17:29:30.088834] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-16T17:29:30.402222] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-16T17:29:30.774940] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-09-16T17:29:31.563546] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-16T17:29:31.574986] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-09-16T17:29:31.737274] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-16T17:29:31.741589] [INFO ] [REMOTE ] BIT: Full fetch complete (23240 records). [2025-09-16T17:29:31.741690] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-09-16T17:29:32.106069] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-09-16T17:29:32.106148] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-09-16T17:29:32.106518] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-09-16T17:29:32.106560] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-09-16T17:29:32.107194] [DEBUG] [LOCAL ] BIT: Trimmed 23240 records to 16575 (keeping 150 days of data) [2025-09-16T17:29:32.212905] [DEBUG] [LOCAL ] BIT: Primary data saved (16575 records). [2025-09-16T17:29:32.213052] [INFO ] [MAIN ] BIT: Full history saved. [2025-09-16T17:29:32.213133] [INFO ] [MAIN ] Update Progress: 284/2369 symbols completed. BIT took 31.7s. Estimated remaining: 3h 36m 28s. Rate: 9.6 symbols/min [2025-09-16T17:29:32.384686] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-09-16T17:29:32.387638] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:29:32.412074] [DEBUG] [LOCAL ] BKE: Loaded 24727 existing records from primary storage. [2025-09-16T17:29:32.412222] [INFO ] [MAIN ] BKE: Loaded 24727 existing records. [2025-09-16T17:29:32.589954] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:29:32.590241] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-09-16T17:29:32.590303] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-09-16T17:29:32.591033] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-09-16T17:29:32.591116] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-09-16T17:29:32.942010] [INFO ] [REMOTE ] BKE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:29:33.174895] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-09-16T17:29:33.445155] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-16T17:29:33.974896] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-09-16T17:29:34.176709] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-16T17:29:34.182839] [INFO ] [REMOTE ] BJ: Full fetch complete (55947 records). [2025-09-16T17:29:34.182945] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-09-16T17:29:34.561575] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-09-16T17:29:34.561698] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-09-16T17:29:34.562348] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-09-16T17:29:34.562403] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-09-16T17:29:34.563964] [DEBUG] [LOCAL ] BJ: Trimmed 55947 records to 38269 (keeping 150 days of data) [2025-09-16T17:29:34.689212] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-16T17:29:34.791793] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-09-16T17:29:34.824059] [DEBUG] [LOCAL ] BJ: Primary data saved (38269 records). [2025-09-16T17:29:34.824215] [INFO ] [MAIN ] BJ: Full history saved. [2025-09-16T17:29:34.824304] [INFO ] [MAIN ] Update Progress: 285/2369 symbols completed. BJ took 18.3s. Estimated remaining: 3h 35m 55s. Rate: 9.7 symbols/min [2025-09-16T17:29:34.991528] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:29:35.017378] [DEBUG] [LOCAL ] BKH: Loaded 27296 existing records from primary storage. [2025-09-16T17:29:35.017524] [INFO ] [MAIN ] BKH: Loaded 27296 existing records. [2025-09-16T17:29:35.192467] [WARN ] [MAIN ] BKH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:29:35.192736] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-09-16T17:29:35.192782] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-09-16T17:29:35.193518] [DEBUG] [LOCAL ] BKH: Deleted primary data file. [2025-09-16T17:29:35.193566] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-09-16T17:29:35.547610] [INFO ] [REMOTE ] BKH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:29:35.574853] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-09-16T17:29:35.640368] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-16T17:29:36.081565] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-16T17:29:36.374900] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-09-16T17:29:36.691138] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-16T17:29:37.174911] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-09-16T17:29:37.802175] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-16T17:29:37.974929] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-09-16T17:29:38.360883] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-16T17:29:38.774916] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-09-16T17:29:39.319977] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-16T17:29:39.574899] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-09-16T17:29:40.374889] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-09-16T17:29:40.442349] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-16T17:29:40.909353] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-16T17:29:41.174901] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-09-16T17:29:41.334001] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-16T17:29:41.974908] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-09-16T17:29:42.774907] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-09-16T17:29:42.990153] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-16T17:29:43.288792] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-16T17:29:43.574885] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-09-16T17:29:44.056908] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-16T17:29:44.374917] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-09-16T17:29:45.174893] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-09-16T17:29:45.323378] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-16T17:29:45.329265] [INFO ] [REMOTE ] BK: Full fetch complete (57858 records). [2025-09-16T17:29:45.329374] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-09-16T17:29:45.330083] [FATAL] [VALIDATOR ] BK: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:29:45.330169] [FATAL] [MAIN ] BK: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:29:45.330211] [WARN ] [MAIN ] BK: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:29:45.330271] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-09-16T17:29:45.330360] [DEBUG] [LOCAL ] BK: No primary data file found to delete. [2025-09-16T17:29:45.330415] [INFO ] [LOCAL ] BK: Starting deletion of derivative data. [2025-09-16T17:29:45.330870] [DEBUG] [LOCAL ] BK: Deleted derivative data file. [2025-09-16T17:29:45.330982] [INFO ] [MAIN ] Update Progress: 286/2369 symbols completed. BK took 27.0s. Estimated remaining: 3h 36m 20s. Rate: 9.6 symbols/min [2025-09-16T17:29:45.514335] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:29:45.542609] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-16T17:29:45.570916] [DEBUG] [LOCAL ] BKKT: Loaded 25845 existing records from primary storage. [2025-09-16T17:29:45.571041] [INFO ] [MAIN ] BKKT: Loaded 25845 existing records. [2025-09-16T17:29:45.753156] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:29:45.753454] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-09-16T17:29:45.753522] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-09-16T17:29:45.754355] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-09-16T17:29:45.754428] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-09-16T17:29:45.980008] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-09-16T17:29:46.114035] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:29:46.668132] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-16T17:29:46.774881] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-09-16T17:29:47.089587] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-16T17:29:47.574941] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-09-16T17:29:48.374909] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-09-16T17:29:48.432189] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-16T17:29:48.694470] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-16T17:29:49.174933] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-09-16T17:29:49.350483] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-16T17:29:49.354964] [INFO ] [REMOTE ] BKE: Full fetch complete (38047 records). [2025-09-16T17:29:49.355065] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-09-16T17:29:49.753098] [DEBUG] [VALIDATOR ] BKE: All expected trading days are present. [2025-09-16T17:29:49.753327] [DEBUG] [VALIDATOR ] BKE: Primary data validation passed. [2025-09-16T17:29:49.753901] [INFO ] [MAIN ] BKE: Fetched primary data is valid. [2025-09-16T17:29:49.753953] [DEBUG] [LOCAL ] BKE: Saving primary data. [2025-09-16T17:29:49.755787] [DEBUG] [LOCAL ] BKE: Trimmed 38047 records to 25000 (keeping 150 days of data) [2025-09-16T17:29:49.911559] [DEBUG] [LOCAL ] BKE: Primary data saved (25000 records). [2025-09-16T17:29:49.911726] [INFO ] [MAIN ] BKE: Full history saved. [2025-09-16T17:29:49.911860] [INFO ] [MAIN ] Update Progress: 287/2369 symbols completed. BKE took 17.7s. Estimated remaining: 3h 36m 2s. Rate: 9.6 symbols/min [2025-09-16T17:29:49.980021] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-09-16T17:29:50.087574] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:29:50.094327] [DEBUG] [LOCAL ] BKN: Loaded 5415 existing records from primary storage. [2025-09-16T17:29:50.094417] [INFO ] [MAIN ] BKN: Loaded 5415 existing records. [2025-09-16T17:29:50.270312] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:29:50.270552] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-09-16T17:29:50.270598] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-09-16T17:29:50.270893] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-09-16T17:29:50.270940] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-09-16T17:29:50.632436] [INFO ] [REMOTE ] BKN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:29:50.653471] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-16T17:29:50.774866] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-09-16T17:29:51.385283] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-16T17:29:51.470972] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-16T17:29:51.574910] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-09-16T17:29:52.253343] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-16T17:29:52.374903] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-09-16T17:29:53.174896] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-09-16T17:29:53.732936] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-16T17:29:53.974918] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-09-16T17:29:54.686499] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-16T17:29:54.774880] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-09-16T17:29:55.489758] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-16T17:29:55.574900] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-09-16T17:29:56.271595] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-16T17:29:56.277595] [INFO ] [REMOTE ] BKD: Full fetch complete (54361 records). [2025-09-16T17:29:56.277742] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-09-16T17:29:56.381259] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-09-16T17:29:56.658622] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-09-16T17:29:56.658724] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-09-16T17:29:56.659330] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-09-16T17:29:56.659372] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-09-16T17:29:56.660477] [DEBUG] [LOCAL ] BKD: Trimmed 54361 records to 37399 (keeping 150 days of data) [2025-09-16T17:29:56.874289] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-16T17:29:56.907585] [DEBUG] [LOCAL ] BKD: Primary data saved (37399 records). [2025-09-16T17:29:56.907725] [INFO ] [MAIN ] BKD: Full history saved. [2025-09-16T17:29:56.908737] [INFO ] [MAIN ] Update Progress: 288/2369 symbols completed. BKD took 27.9s. Estimated remaining: 3h 36m 2s. Rate: 9.6 symbols/min [2025-09-16T17:29:57.076468] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:29:57.114913] [DEBUG] [LOCAL ] BKSY: Loaded 35899 existing records from primary storage. [2025-09-16T17:29:57.115050] [INFO ] [MAIN ] BKSY: Loaded 35899 existing records. [2025-09-16T17:29:57.190765] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-09-16T17:29:57.259497] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-16T17:29:57.341980] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:29:57.342269] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-09-16T17:29:57.342315] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-09-16T17:29:57.343344] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-09-16T17:29:57.343392] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-09-16T17:29:57.692268] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:29:57.974892] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-09-16T17:29:58.552051] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-16T17:29:58.556561] [INFO ] [REMOTE ] BKH: Full fetch complete (39524 records). [2025-09-16T17:29:58.556717] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-09-16T17:29:58.783841] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-09-16T17:29:58.817012] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-16T17:29:58.956458] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-09-16T17:29:58.956536] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-09-16T17:29:58.957082] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-09-16T17:29:58.957127] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-09-16T17:29:58.958030] [DEBUG] [LOCAL ] BKH: Trimmed 39524 records to 27582 (keeping 150 days of data) [2025-09-16T17:29:59.124295] [DEBUG] [LOCAL ] BKH: Primary data saved (27582 records). [2025-09-16T17:29:59.124431] [INFO ] [MAIN ] BKH: Full history saved. [2025-09-16T17:29:59.124515] [INFO ] [MAIN ] Update Progress: 289/2369 symbols completed. BKH took 24.3s. Estimated remaining: 3h 35m 26s. Rate: 9.7 symbols/min [2025-09-16T17:29:59.306101] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:29:59.315390] [DEBUG] [LOCAL ] BKT: Loaded 7700 existing records from primary storage. [2025-09-16T17:29:59.315514] [INFO ] [MAIN ] BKT: Loaded 7700 existing records. [2025-09-16T17:29:59.496799] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:29:59.497047] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-09-16T17:29:59.497095] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-09-16T17:29:59.497413] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-09-16T17:29:59.497459] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-09-16T17:29:59.579964] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-09-16T17:29:59.870438] [INFO ] [REMOTE ] BKT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:29:59.893780] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-16T17:30:00.359728] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-16T17:30:00.374854] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-09-16T17:30:01.174907] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-09-16T17:30:01.974892] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-09-16T17:30:02.774955] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-09-16T17:30:02.880565] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-09-16T17:30:03.574889] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-09-16T17:30:03.862976] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (2.69 seconds). [2025-09-16T17:30:04.019477] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-16T17:30:04.166470] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-16T17:30:04.374908] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-09-16T17:30:04.547758] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (2.57 seconds). [2025-09-16T17:30:05.174893] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-09-16T17:30:05.704908] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-16T17:30:05.974901] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-09-16T17:30:06.142995] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-16T17:30:06.144487] [INFO ] [REMOTE ] BKN: Full fetch complete (8083 records). [2025-09-16T17:30:06.144566] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-09-16T17:30:06.145115] [FATAL] [VALIDATOR ] BKN: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:30:06.145212] [FATAL] [MAIN ] BKN: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:30:06.145271] [WARN ] [MAIN ] BKN: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:30:06.145340] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-09-16T17:30:06.145406] [DEBUG] [LOCAL ] BKN: No primary data file found to delete. [2025-09-16T17:30:06.145443] [INFO ] [LOCAL ] BKN: Starting deletion of derivative data. [2025-09-16T17:30:06.145796] [DEBUG] [LOCAL ] BKN: Deleted derivative data file. [2025-09-16T17:30:06.145888] [INFO ] [MAIN ] Update Progress: 290/2369 symbols completed. BKN took 16.2s. Estimated remaining: 3h 35m 26s. Rate: 9.7 symbols/min [2025-09-16T17:30:06.319337] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:30:06.353482] [DEBUG] [LOCAL ] BKU: Loaded 30685 existing records from primary storage. [2025-09-16T17:30:06.353619] [INFO ] [MAIN ] BKU: Loaded 30685 existing records. [2025-09-16T17:30:06.528506] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:30:06.528818] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-09-16T17:30:06.528865] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-09-16T17:30:06.529632] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-09-16T17:30:06.529712] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-09-16T17:30:06.774950] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-09-16T17:30:06.914267] [INFO ] [REMOTE ] BKU: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:30:07.363331] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-16T17:30:07.504686] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-16T17:30:07.574912] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-09-16T17:30:08.374932] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-09-16T17:30:08.639792] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-16T17:30:09.067904] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-16T17:30:09.174944] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-09-16T17:30:09.974958] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-09-16T17:30:10.616611] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-16T17:30:10.774980] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-09-16T17:30:10.905543] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-16T17:30:11.574904] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-09-16T17:30:12.374977] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-09-16T17:30:12.434787] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-16T17:30:13.061722] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-16T17:30:13.174949] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-09-16T17:30:13.794575] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-16T17:30:13.954700] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-16T17:30:13.974860] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-09-16T17:30:14.774899] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-09-16T17:30:15.574925] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-09-16T17:30:16.374936] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-09-16T17:30:16.570743] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-09-16T17:30:17.023662] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-16T17:30:17.174911] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-09-16T17:30:17.715533] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-16T17:30:17.980033] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-09-16T17:30:17.982983] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-16T17:30:18.197473] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-16T17:30:18.774903] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-09-16T17:30:19.574931] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-09-16T17:30:19.662991] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-16T17:30:19.875023] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-16T17:30:20.250461] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-16T17:30:20.253142] [INFO ] [REMOTE ] BKT: Full fetch complete (11286 records). [2025-09-16T17:30:20.253247] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-09-16T17:30:20.379980] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-09-16T17:30:20.638194] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-09-16T17:30:20.638473] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-09-16T17:30:20.638812] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-09-16T17:30:20.638879] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-09-16T17:30:20.639481] [DEBUG] [LOCAL ] BKT: Trimmed 11286 records to 8064 (keeping 150 days of data) [2025-09-16T17:30:20.692545] [DEBUG] [LOCAL ] BKT: Primary data saved (8064 records). [2025-09-16T17:30:20.692691] [INFO ] [MAIN ] BKT: Full history saved. [2025-09-16T17:30:20.692814] [INFO ] [MAIN ] Update Progress: 291/2369 symbols completed. BKT took 21.6s. Estimated remaining: 3h 36m 19s. Rate: 9.6 symbols/min [2025-09-16T17:30:20.870809] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:30:20.892535] [DEBUG] [LOCAL ] BKV: Loaded 20925 existing records from primary storage. [2025-09-16T17:30:20.892697] [INFO ] [MAIN ] BKV: Loaded 20925 existing records. [2025-09-16T17:30:21.086299] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:30:21.086557] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-09-16T17:30:21.086603] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-09-16T17:30:21.087153] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-09-16T17:30:21.087211] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-09-16T17:30:21.180724] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-09-16T17:30:21.457540] [INFO ] [REMOTE ] BKV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:30:21.974951] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-09-16T17:30:22.222279] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-16T17:30:22.227531] [INFO ] [REMOTE ] BKKT: Full fetch complete (36144 records). [2025-09-16T17:30:22.227626] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-09-16T17:30:22.606118] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-09-16T17:30:22.606205] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-09-16T17:30:22.606750] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-09-16T17:30:22.606798] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-09-16T17:30:22.607778] [DEBUG] [LOCAL ] BKKT: Trimmed 36144 records to 26158 (keeping 150 days of data) [2025-09-16T17:30:22.768314] [DEBUG] [LOCAL ] BKKT: Primary data saved (26158 records). [2025-09-16T17:30:22.768460] [INFO ] [MAIN ] BKKT: Full history saved. [2025-09-16T17:30:22.768557] [INFO ] [MAIN ] Update Progress: 292/2369 symbols completed. BKKT took 37.4s. Estimated remaining: 3h 35m 43s. Rate: 9.6 symbols/min [2025-09-16T17:30:22.802754] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-09-16T17:30:22.952800] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:30:22.953034] [DEBUG] [LOCAL ] BLCO: No existing data file found in primary storage. [2025-09-16T17:30:22.953074] [WARN ] [MAIN ] BLCO: No existing data found, performing full refresh instead. [2025-09-16T17:30:22.953196] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-09-16T17:30:22.953242] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-09-16T17:30:22.953291] [DEBUG] [LOCAL ] BLCO: No primary data file found to delete. [2025-09-16T17:30:22.953329] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-09-16T17:30:23.310881] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:30:23.329865] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-16T17:30:23.364507] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-16T17:30:23.574905] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-09-16T17:30:24.374901] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-09-16T17:30:24.529561] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-16T17:30:24.731535] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-16T17:30:25.174906] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-09-16T17:30:25.974906] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-09-16T17:30:26.373523] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-16T17:30:26.425747] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-16T17:30:26.774910] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-09-16T17:30:27.464896] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-16T17:30:27.574945] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-09-16T17:30:28.151686] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-16T17:30:28.374941] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-09-16T17:30:29.174978] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-09-16T17:30:29.550966] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-16T17:30:29.611378] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-16T17:30:29.974924] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-09-16T17:30:30.593442] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-16T17:30:30.774917] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-09-16T17:30:31.154716] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-16T17:30:31.159349] [INFO ] [REMOTE ] BKU: Full fetch complete (45293 records). [2025-09-16T17:30:31.159474] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-09-16T17:30:31.528346] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-09-16T17:30:31.528425] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-09-16T17:30:31.528955] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-09-16T17:30:31.528999] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-09-16T17:30:31.529954] [DEBUG] [LOCAL ] BKU: Trimmed 45293 records to 30997 (keeping 150 days of data) [2025-09-16T17:30:31.586005] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-09-16T17:30:31.722314] [DEBUG] [LOCAL ] BKU: Primary data saved (30997 records). [2025-09-16T17:30:31.722451] [INFO ] [MAIN ] BKU: Full history saved. [2025-09-16T17:30:31.722542] [INFO ] [MAIN ] Update Progress: 293/2369 symbols completed. BKU took 25.6s. Estimated remaining: 3h 35m 56s. Rate: 9.6 symbols/min [2025-09-16T17:30:31.891428] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:30:31.910338] [DEBUG] [LOCAL ] BLD: Loaded 20372 existing records from primary storage. [2025-09-16T17:30:31.910458] [INFO ] [MAIN ] BLD: Loaded 20372 existing records. [2025-09-16T17:30:32.083469] [WARN ] [MAIN ] BLD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:30:32.083761] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-09-16T17:30:32.083812] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-09-16T17:30:32.084382] [DEBUG] [LOCAL ] BLD: Deleted primary data file. [2025-09-16T17:30:32.084428] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-09-16T17:30:32.380045] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-09-16T17:30:32.447119] [INFO ] [REMOTE ] BLD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:30:32.469348] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-16T17:30:32.928463] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-16T17:30:33.174898] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-09-16T17:30:33.977081] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-09-16T17:30:33.978909] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-16T17:30:33.988201] [INFO ] [REMOTE ] BKSY: Full fetch complete (52754 records). [2025-09-16T17:30:33.988443] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-09-16T17:30:34.374051] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-09-16T17:30:34.374158] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-09-16T17:30:34.374804] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-09-16T17:30:34.374859] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-09-16T17:30:34.392244] [DEBUG] [LOCAL ] BKSY: Trimmed 52754 records to 36256 (keeping 150 days of data) [2025-09-16T17:30:34.396849] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-16T17:30:34.627967] [DEBUG] [LOCAL ] BKSY: Primary data saved (36256 records). [2025-09-16T17:30:34.628172] [INFO ] [MAIN ] BKSY: Full history saved. [2025-09-16T17:30:34.628848] [INFO ] [MAIN ] Update Progress: 294/2369 symbols completed. BKSY took 37.7s. Estimated remaining: 3h 35m 27s. Rate: 9.6 symbols/min [2025-09-16T17:30:34.779833] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-09-16T17:30:34.799010] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:30:34.799882] [DEBUG] [LOCAL ] BLDR: No existing data file found in primary storage. [2025-09-16T17:30:34.799921] [WARN ] [MAIN ] BLDR: No existing data found, performing full refresh instead. [2025-09-16T17:30:34.800055] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-09-16T17:30:34.800102] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-09-16T17:30:34.800146] [DEBUG] [LOCAL ] BLDR: No primary data file found to delete. [2025-09-16T17:30:34.800190] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-09-16T17:30:35.162772] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:30:35.186202] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-16T17:30:35.574888] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-09-16T17:30:36.374938] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-09-16T17:30:36.411037] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-16T17:30:36.493066] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-16T17:30:37.174927] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-09-16T17:30:37.974907] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-09-16T17:30:38.017364] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-16T17:30:38.387412] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-16T17:30:38.774944] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-09-16T17:30:39.029222] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-16T17:30:39.574896] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-09-16T17:30:40.275798] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-16T17:30:40.374919] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-09-16T17:30:40.441475] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-16T17:30:41.174902] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-09-16T17:30:41.561612] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-16T17:30:41.564966] [INFO ] [REMOTE ] BKV: Full fetch complete (33315 records). [2025-09-16T17:30:41.565086] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-09-16T17:30:41.953354] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-09-16T17:30:41.953441] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-09-16T17:30:41.953971] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-09-16T17:30:41.954042] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-09-16T17:30:41.954930] [DEBUG] [LOCAL ] BKV: Trimmed 33315 records to 21066 (keeping 150 days of data) [2025-09-16T17:30:42.009490] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-09-16T17:30:42.086353] [DEBUG] [LOCAL ] BKV: Primary data saved (21066 records). [2025-09-16T17:30:42.086486] [INFO ] [MAIN ] BKV: Full history saved. [2025-09-16T17:30:42.086589] [INFO ] [MAIN ] Update Progress: 295/2369 symbols completed. BKV took 21.4s. Estimated remaining: 3h 35m 29s. Rate: 9.6 symbols/min [2025-09-16T17:30:42.263356] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:30:42.274861] [DEBUG] [LOCAL ] BLE: Loaded 10139 existing records from primary storage. [2025-09-16T17:30:42.275017] [INFO ] [MAIN ] BLE: Loaded 10139 existing records. [2025-09-16T17:30:42.462423] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:30:42.462768] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-09-16T17:30:42.462828] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-09-16T17:30:42.463443] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-09-16T17:30:42.463507] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-09-16T17:30:42.778995] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-09-16T17:30:42.841863] [INFO ] [REMOTE ] BLE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:30:42.867689] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-16T17:30:42.898210] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-16T17:30:43.574898] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-09-16T17:30:44.177663] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-16T17:30:44.317361] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-16T17:30:44.374937] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-09-16T17:30:45.174903] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-09-16T17:30:45.268328] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-16T17:30:45.974948] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-09-16T17:30:46.774905] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-09-16T17:30:47.059506] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-16T17:30:47.428148] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-16T17:30:47.574894] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-09-16T17:30:47.841438] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-16T17:30:48.374917] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-09-16T17:30:49.175146] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-09-16T17:30:49.422941] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-16T17:30:49.482171] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-16T17:30:49.974922] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-09-16T17:30:50.159351] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-16T17:30:50.163186] [INFO ] [REMOTE ] BLCO: Full fetch complete (40073 records). [2025-09-16T17:30:50.163280] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-09-16T17:30:50.587214] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-09-16T17:30:50.587308] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-09-16T17:30:50.587873] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-09-16T17:30:50.587933] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-09-16T17:30:50.589163] [DEBUG] [LOCAL ] BLCO: Trimmed 40073 records to 26549 (keeping 150 days of data) [2025-09-16T17:30:50.776025] [DEBUG] [LOCAL ] BLCO: Primary data saved (26549 records). [2025-09-16T17:30:50.776160] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-09-16T17:30:50.776497] [INFO ] [MAIN ] BLCO: Full history saved. [2025-09-16T17:30:50.777530] [INFO ] [MAIN ] Update Progress: 296/2369 symbols completed. BLCO took 28.0s. Estimated remaining: 3h 35m 40s. Rate: 9.6 symbols/min [2025-09-16T17:30:50.961615] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:30:50.986617] [DEBUG] [LOCAL ] BLK: Loaded 24344 existing records from primary storage. [2025-09-16T17:30:50.986781] [INFO ] [MAIN ] BLK: Loaded 24344 existing records. [2025-09-16T17:30:51.184410] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:30:51.184677] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-09-16T17:30:51.184728] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-09-16T17:30:51.185452] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-09-16T17:30:51.185500] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-09-16T17:30:51.551404] [INFO ] [REMOTE ] BLK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:30:51.574897] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-09-16T17:30:51.680566] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-16T17:30:51.707319] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-16T17:30:52.374912] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-09-16T17:30:53.174998] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-09-16T17:30:53.358580] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-16T17:30:53.396699] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-16T17:30:53.974906] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-09-16T17:30:54.774927] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-09-16T17:30:54.824805] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-16T17:30:54.845704] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-16T17:30:55.574882] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-09-16T17:30:56.374937] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-09-16T17:30:56.602449] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-16T17:30:56.645976] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-16T17:30:57.174917] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-09-16T17:30:57.632936] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-16T17:30:57.636536] [INFO ] [REMOTE ] BLD: Full fetch complete (30878 records). [2025-09-16T17:30:57.636692] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-09-16T17:30:57.977490] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-09-16T17:30:58.013342] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present. [2025-09-16T17:30:58.013433] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed. [2025-09-16T17:30:58.013931] [INFO ] [MAIN ] BLD: Fetched primary data is valid. [2025-09-16T17:30:58.013981] [DEBUG] [LOCAL ] BLD: Saving primary data. [2025-09-16T17:30:58.015024] [DEBUG] [LOCAL ] BLD: Trimmed 30878 records to 20558 (keeping 150 days of data) [2025-09-16T17:30:58.160415] [DEBUG] [LOCAL ] BLD: Primary data saved (20558 records). [2025-09-16T17:30:58.160563] [INFO ] [MAIN ] BLD: Full history saved. [2025-09-16T17:30:58.160697] [INFO ] [MAIN ] Update Progress: 297/2369 symbols completed. BLD took 26.4s. Estimated remaining: 3h 35m 42s. Rate: 9.6 symbols/min [2025-09-16T17:30:58.333475] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:30:58.368758] [DEBUG] [LOCAL ] BLND: Loaded 36059 existing records from primary storage. [2025-09-16T17:30:58.368909] [INFO ] [MAIN ] BLND: Loaded 36059 existing records. [2025-09-16T17:30:58.553207] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:30:58.553512] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-09-16T17:30:58.553570] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-09-16T17:30:58.554357] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-09-16T17:30:58.554422] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-09-16T17:30:58.780636] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-09-16T17:30:58.925075] [INFO ] [REMOTE ] BLND: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:30:59.006560] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-16T17:30:59.574907] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-09-16T17:30:59.630737] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-16T17:31:00.015155] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-16T17:31:00.374920] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-09-16T17:31:01.174927] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-09-16T17:31:01.590708] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-16T17:31:01.974906] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-09-16T17:31:02.664398] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-16T17:31:02.774939] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-09-16T17:31:03.574992] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-09-16T17:31:03.683674] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (2.51 seconds). [2025-09-16T17:31:04.374952] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-09-16T17:31:04.462430] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-09-16T17:31:04.469711] [INFO ] [REMOTE ] BLDR: Full fetch complete (56103 records). [2025-09-16T17:31:04.469939] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-09-16T17:31:04.710546] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-16T17:31:04.955033] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-09-16T17:31:04.955145] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-09-16T17:31:04.955812] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-09-16T17:31:04.955861] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-09-16T17:31:04.957196] [DEBUG] [LOCAL ] BLDR: Trimmed 56103 records to 38691 (keeping 150 days of data) [2025-09-16T17:31:05.175221] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-09-16T17:31:05.213411] [DEBUG] [LOCAL ] BLDR: Primary data saved (38691 records). [2025-09-16T17:31:05.213581] [INFO ] [MAIN ] BLDR: Full history saved. [2025-09-16T17:31:05.213690] [INFO ] [MAIN ] Update Progress: 298/2369 symbols completed. BLDR took 30.6s. Estimated remaining: 3h 35m 41s. Rate: 9.6 symbols/min [2025-09-16T17:31:05.340346] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-16T17:31:05.398167] [INFO ] [REMOTE ] BLE: Full fetch complete (15618 records). [2025-09-16T17:31:05.408008] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:31:05.408279] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-09-16T17:31:05.408097] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-09-16T17:31:05.408387] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-09-16T17:31:05.429656] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-09-16T17:31:05.444960] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-16T17:31:05.451727] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-09-16T17:31:05.451928] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-09-16T17:31:05.622610] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-16T17:31:05.994200] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-09-16T17:31:06.140213] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:31:06.181841] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-09-16T17:31:06.181920] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-09-16T17:31:06.182333] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-09-16T17:31:06.182400] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-09-16T17:31:06.183057] [DEBUG] [LOCAL ] BLE: Trimmed 15618 records to 10217 (keeping 150 days of data) [2025-09-16T17:31:06.249383] [DEBUG] [LOCAL ] BLE: Primary data saved (10217 records). [2025-09-16T17:31:06.249532] [INFO ] [MAIN ] BLE: Full history saved. [2025-09-16T17:31:06.249629] [INFO ] [MAIN ] Update Progress: 299/2369 symbols completed. BLE took 24.2s. Estimated remaining: 3h 34m 59s. Rate: 9.6 symbols/min [2025-09-16T17:31:06.418981] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:31:06.429044] [DEBUG] [LOCAL ] BLW: Loaded 8953 existing records from primary storage. [2025-09-16T17:31:06.429166] [INFO ] [MAIN ] BLW: Loaded 8953 existing records. [2025-09-16T17:31:06.609723] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:31:06.610151] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-09-16T17:31:06.610276] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-09-16T17:31:06.610769] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-09-16T17:31:06.610837] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-09-16T17:31:06.803156] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-02. [2025-09-16T17:31:06.890081] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-16T17:31:07.029736] [INFO ] [REMOTE ] BLW: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:31:07.121792] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:31:07.122102] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-02 [2025-09-16T17:31:07.574858] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-03. [2025-09-16T17:31:07.798945] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:31:07.799313] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-03 [2025-09-16T17:31:08.006629] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-16T17:31:08.374922] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-09-16T17:31:09.174936] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-04. [2025-09-16T17:31:09.224395] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-16T17:31:09.381983] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:31:09.382438] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-04 [2025-09-16T17:31:09.974951] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-09-16T17:31:10.708269] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-16T17:31:10.774917] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-09-16T17:31:11.574916] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-05. [2025-09-16T17:31:11.763927] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:31:11.764265] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-05 [2025-09-16T17:31:12.338168] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-16T17:31:12.374903] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-09-16T17:31:13.174914] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-09-16T17:31:13.762150] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-16T17:31:13.765938] [INFO ] [REMOTE ] BLK: Full fetch complete (38881 records). [2025-09-16T17:31:13.766054] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-09-16T17:31:13.766616] [FATAL] [VALIDATOR ] BLK: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:31:13.766720] [FATAL] [MAIN ] BLK: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:31:13.766777] [WARN ] [MAIN ] BLK: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:31:13.766818] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-09-16T17:31:13.766884] [DEBUG] [LOCAL ] BLK: No primary data file found to delete. [2025-09-16T17:31:13.766938] [INFO ] [LOCAL ] BLK: Starting deletion of derivative data. [2025-09-16T17:31:13.767293] [DEBUG] [LOCAL ] BLK: Deleted derivative data file. [2025-09-16T17:31:13.767384] [INFO ] [MAIN ] Update Progress: 300/2369 symbols completed. BLK took 23.0s. Estimated remaining: 3h 35m 1s. Rate: 9.6 symbols/min [2025-09-16T17:31:13.940073] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:31:13.940244] [DEBUG] [LOCAL ] BLX: No existing data file found in primary storage. [2025-09-16T17:31:13.940282] [WARN ] [MAIN ] BLX: No existing data found, performing full refresh instead. [2025-09-16T17:31:13.940403] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-09-16T17:31:13.940441] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-09-16T17:31:13.940489] [DEBUG] [LOCAL ] BLX: No primary data file found to delete. [2025-09-16T17:31:13.940521] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-09-16T17:31:13.983244] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-09-16T17:31:14.299199] [INFO ] [REMOTE ] BLX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:31:14.772456] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-16T17:31:14.776281] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-09-16T17:31:15.574894] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-06. [2025-09-16T17:31:15.597264] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-16T17:31:15.818587] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:31:15.818938] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-06 [2025-09-16T17:31:16.186567] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (3.01 seconds). [2025-09-16T17:31:16.374914] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-07. [2025-09-16T17:31:16.575293] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:31:16.575595] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-07 [2025-09-16T17:31:17.174936] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-09-16T17:31:17.974910] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-09-16T17:31:18.009802] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-16T17:31:18.774915] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-09-16T17:31:19.519969] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-16T17:31:19.556486] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-16T17:31:19.574906] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-09-16T17:31:20.161496] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-16T17:31:20.374935] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-08. [2025-09-16T17:31:21.174940] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-09-16T17:31:21.903450] [INFO ] [REMOTE ] BLSH: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-16T17:31:21.974925] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-09. [2025-09-16T17:31:22.130981] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-16T17:31:22.774924] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-09-16T17:31:23.575048] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-09-16T17:31:24.039572] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-16T17:31:24.269925] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-16T17:31:24.374911] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-09-16T17:31:24.450456] [INFO ] [REMOTE ] BLSH: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-09-16T17:31:24.457920] [INFO ] [REMOTE ] BLSH: Full fetch complete (9102 records). [2025-09-16T17:31:24.458151] [DEBUG] [VALIDATOR ] BLSH: Validating primary data. [2025-09-16T17:31:24.649077] [WARN ] [VALIDATOR ] BLSH: Validation failed - insufficient historical data. Have 24 unique days, need 150 days [2025-09-16T17:31:24.649367] [FATAL] [MAIN ] BLSH: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:31:24.649421] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:31:24.649467] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-16T17:31:24.649555] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-09-16T17:31:24.649596] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-09-16T17:31:24.649638] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-09-16T17:31:24.649724] [INFO ] [MAIN ] Update Progress: 301/2369 symbols completed. BLSH took 19.4s. Estimated remaining: 3h 35m 27s. Rate: 9.6 symbols/min [2025-09-16T17:31:24.829271] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:31:24.854627] [DEBUG] [LOCAL ] BMA: Loaded 25268 existing records from primary storage. [2025-09-16T17:31:24.854793] [INFO ] [MAIN ] BMA: Loaded 25268 existing records. [2025-09-16T17:31:25.035554] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:31:25.035833] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-09-16T17:31:25.035879] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-09-16T17:31:25.036589] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-09-16T17:31:25.036638] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-09-16T17:31:25.195199] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-09-16T17:31:25.327865] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-16T17:31:25.419401] [INFO ] [REMOTE ] BMA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:31:25.974945] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-09-16T17:31:26.641558] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-16T17:31:26.774909] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-09-16T17:31:27.548896] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-16T17:31:27.574892] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-09-16T17:31:28.374923] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-09-16T17:31:28.451299] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-16T17:31:28.457402] [INFO ] [REMOTE ] BLND: Full fetch complete (53942 records). [2025-09-16T17:31:28.457500] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-09-16T17:31:28.839023] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-09-16T17:31:28.839152] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-09-16T17:31:28.839863] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-09-16T17:31:28.840004] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-09-16T17:31:28.841299] [DEBUG] [LOCAL ] BLND: Trimmed 53942 records to 36409 (keeping 150 days of data) [2025-09-16T17:31:28.954579] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-16T17:31:29.082942] [DEBUG] [LOCAL ] BLND: Primary data saved (36409 records). [2025-09-16T17:31:29.083093] [INFO ] [MAIN ] BLND: Full history saved. [2025-09-16T17:31:29.083188] [INFO ] [MAIN ] Update Progress: 302/2369 symbols completed. BLND took 30.9s. Estimated remaining: 3h 35m 8s. Rate: 9.6 symbols/min [2025-09-16T17:31:29.180066] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-09-16T17:31:29.256871] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:31:29.257069] [DEBUG] [LOCAL ] BME: No existing data file found in primary storage. [2025-09-16T17:31:29.257108] [WARN ] [MAIN ] BME: No existing data found, performing full refresh instead. [2025-09-16T17:31:29.257232] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-09-16T17:31:29.257272] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-09-16T17:31:29.257314] [DEBUG] [LOCAL ] BME: No primary data file found to delete. [2025-09-16T17:31:29.257346] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-09-16T17:31:29.603796] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-16T17:31:29.625577] [INFO ] [REMOTE ] BME: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:31:29.974904] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-09-16T17:31:30.616714] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-16T17:31:30.640685] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-16T17:31:30.774898] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-09-16T17:31:31.574923] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-09-16T17:31:31.631761] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-16T17:31:32.374950] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-09-16T17:31:32.508853] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-16T17:31:33.174918] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-09-16T17:31:33.539873] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-16T17:31:33.942254] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-16T17:31:33.944894] [INFO ] [REMOTE ] BLW: Full fetch complete (14098 records). [2025-09-16T17:31:33.944988] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-09-16T17:31:33.980948] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-09-16T17:31:34.348258] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-09-16T17:31:34.348340] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-09-16T17:31:34.348627] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-09-16T17:31:34.348686] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-09-16T17:31:34.349177] [DEBUG] [LOCAL ] BLW: Trimmed 14098 records to 9090 (keeping 150 days of data) [2025-09-16T17:31:34.406774] [DEBUG] [LOCAL ] BLW: Primary data saved (9090 records). [2025-09-16T17:31:34.406937] [INFO ] [MAIN ] BLW: Full history saved. [2025-09-16T17:31:34.407030] [INFO ] [MAIN ] Update Progress: 303/2369 symbols completed. BLW took 28.2s. Estimated remaining: 3h 34m 56s. Rate: 9.6 symbols/min [2025-09-16T17:31:34.575725] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:31:34.594327] [DEBUG] [LOCAL ] BMEZ: Loaded 17633 existing records from primary storage. [2025-09-16T17:31:34.594517] [INFO ] [MAIN ] BMEZ: Loaded 17633 existing records. [2025-09-16T17:31:34.769333] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:31:34.769573] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-09-16T17:31:34.769622] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-09-16T17:31:34.770174] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-09-16T17:31:34.770221] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-09-16T17:31:34.781436] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-09-16T17:31:35.167581] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:31:35.511573] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-16T17:31:35.574901] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-09-16T17:31:35.824209] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-16T17:31:35.826246] [INFO ] [REMOTE ] BLX: Full fetch complete (17012 records). [2025-09-16T17:31:35.826337] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-09-16T17:31:35.826769] [FATAL] [VALIDATOR ] BLX: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:31:35.826841] [FATAL] [MAIN ] BLX: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:31:35.826878] [WARN ] [MAIN ] BLX: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:31:35.826919] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-09-16T17:31:35.826975] [DEBUG] [LOCAL ] BLX: No primary data file found to delete. [2025-09-16T17:31:35.827010] [INFO ] [LOCAL ] BLX: Starting deletion of derivative data. [2025-09-16T17:31:35.827060] [DEBUG] [LOCAL ] BLX: No derivative data file found to delete. [2025-09-16T17:31:35.827115] [INFO ] [MAIN ] Update Progress: 304/2369 symbols completed. BLX took 22.1s. Estimated remaining: 3h 34m 17s. Rate: 9.6 symbols/min [2025-09-16T17:31:35.998099] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:31:36.016254] [DEBUG] [LOCAL ] BMI: Loaded 17207 existing records from primary storage. [2025-09-16T17:31:36.016391] [INFO ] [MAIN ] BMI: Loaded 17207 existing records. [2025-09-16T17:31:36.203821] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:31:36.204073] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-09-16T17:31:36.204120] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-09-16T17:31:36.204633] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-09-16T17:31:36.204712] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-09-16T17:31:36.383571] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-09-16T17:31:36.589603] [INFO ] [REMOTE ] BMI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:31:37.057463] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-16T17:31:37.174927] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-09-16T17:31:37.525675] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-16T17:31:37.974928] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-09-16T17:31:38.758482] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-16T17:31:38.774874] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-09-16T17:31:39.000038] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-16T17:31:39.574916] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-09-16T17:31:40.374911] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-09-16T17:31:40.417978] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-16T17:31:40.424634] [INFO ] [REMOTE ] BMA: Full fetch complete (37712 records). [2025-09-16T17:31:40.424814] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-09-16T17:31:40.876476] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-09-16T17:31:40.876581] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-09-16T17:31:40.877113] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-09-16T17:31:40.877161] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-09-16T17:31:40.878070] [DEBUG] [LOCAL ] BMA: Trimmed 37712 records to 25533 (keeping 150 days of data) [2025-09-16T17:31:41.060542] [DEBUG] [LOCAL ] BMA: Primary data saved (25533 records). [2025-09-16T17:31:41.060748] [INFO ] [MAIN ] BMA: Full history saved. [2025-09-16T17:31:41.060840] [INFO ] [MAIN ] Update Progress: 305/2369 symbols completed. BMA took 16.4s. Estimated remaining: 3h 34m 4s. Rate: 9.6 symbols/min [2025-09-16T17:31:41.179997] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-09-16T17:31:41.241184] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:31:41.241614] [DEBUG] [LOCAL ] BMN: No existing data file found in primary storage. [2025-09-16T17:31:41.241732] [WARN ] [MAIN ] BMN: No existing data found, performing full refresh instead. [2025-09-16T17:31:41.248989] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-16T17:31:41.248741] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-09-16T17:31:41.249176] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-09-16T17:31:41.251876] [DEBUG] [LOCAL ] BMN: No primary data file found to delete. [2025-09-16T17:31:41.251977] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-09-16T17:31:41.384793] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-16T17:31:41.637260] [INFO ] [REMOTE ] BMN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:31:41.974894] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-09-16T17:31:42.496897] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-16T17:31:42.774910] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-09-16T17:31:42.985887] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-16T17:31:43.574918] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-09-16T17:31:43.780901] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-16T17:31:44.148466] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-16T17:31:44.374901] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-09-16T17:31:45.174869] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-09-16T17:31:45.479878] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-16T17:31:45.494658] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-16T17:31:45.974897] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-09-16T17:31:46.774905] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-09-16T17:31:46.837462] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-16T17:31:47.574902] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-09-16T17:31:47.736275] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-16T17:31:48.375777] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-09-16T17:31:48.378372] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-16T17:31:49.131036] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-16T17:31:49.174899] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-09-16T17:31:49.760057] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-16T17:31:49.974893] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-09-16T17:31:50.774908] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-09-16T17:31:50.807785] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-16T17:31:51.574889] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-09-16T17:31:51.671937] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-16T17:31:52.374903] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-09-16T17:31:52.423920] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-16T17:31:53.174918] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-09-16T17:31:53.347030] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-16T17:31:53.951256] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-16T17:31:53.953071] [INFO ] [REMOTE ] BME: Full fetch complete (11453 records). [2025-09-16T17:31:53.953167] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-09-16T17:31:53.983894] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-09-16T17:31:54.342757] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-09-16T17:31:54.342889] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-09-16T17:31:54.343183] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-09-16T17:31:54.343225] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-09-16T17:31:54.343785] [DEBUG] [LOCAL ] BME: Trimmed 11453 records to 8162 (keeping 150 days of data) [2025-09-16T17:31:54.395483] [DEBUG] [LOCAL ] BME: Primary data saved (8162 records). [2025-09-16T17:31:54.395623] [INFO ] [MAIN ] BME: Full history saved. [2025-09-16T17:31:54.395740] [INFO ] [MAIN ] Update Progress: 306/2369 symbols completed. BME took 25.3s. Estimated remaining: 3h 34m 46s. Rate: 9.6 symbols/min [2025-09-16T17:31:54.582018] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:31:54.582242] [DEBUG] [LOCAL ] BMO: No existing data file found in primary storage. [2025-09-16T17:31:54.582312] [WARN ] [MAIN ] BMO: No existing data found, performing full refresh instead. [2025-09-16T17:31:54.582446] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-09-16T17:31:54.582488] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-09-16T17:31:54.582531] [DEBUG] [LOCAL ] BMO: No primary data file found to delete. [2025-09-16T17:31:54.582566] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-09-16T17:31:54.709003] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-16T17:31:54.790385] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-09-16T17:31:55.045390] [INFO ] [REMOTE ] BMO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:31:55.574967] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-09-16T17:31:56.313013] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-16T17:31:56.374870] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-09-16T17:31:57.174910] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-09-16T17:31:57.427896] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-16T17:31:57.537275] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-16T17:31:57.628530] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-16T17:31:57.974898] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-09-16T17:31:58.432393] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-16T17:31:58.774908] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-09-16T17:31:59.574884] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-09-16T17:31:59.789490] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-16T17:31:59.792526] [INFO ] [REMOTE ] BMEZ: Full fetch complete (28458 records). [2025-09-16T17:31:59.792601] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-09-16T17:32:00.161740] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-09-16T17:32:00.161947] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-09-16T17:32:00.162408] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-09-16T17:32:00.162455] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-09-16T17:32:00.163229] [DEBUG] [LOCAL ] BMEZ: Trimmed 28458 records to 17832 (keeping 150 days of data) [2025-09-16T17:32:00.274120] [DEBUG] [LOCAL ] BMEZ: Primary data saved (17832 records). [2025-09-16T17:32:00.274274] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-09-16T17:32:00.274360] [INFO ] [MAIN ] Update Progress: 307/2369 symbols completed. BMEZ took 25.9s. Estimated remaining: 3h 34m 37s. Rate: 9.6 symbols/min [2025-09-16T17:32:00.375206] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-09-16T17:32:00.449104] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:32:00.490414] [DEBUG] [LOCAL ] BMY: Loaded 39717 existing records from primary storage. [2025-09-16T17:32:00.490581] [INFO ] [MAIN ] BMY: Loaded 39717 existing records. [2025-09-16T17:32:00.670522] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:32:00.670842] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-09-16T17:32:00.670891] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-09-16T17:32:00.672080] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-09-16T17:32:00.672133] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-09-16T17:32:01.034609] [INFO ] [REMOTE ] BMY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:32:01.174890] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-09-16T17:32:01.299964] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-16T17:32:01.828701] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-09-16T17:32:01.974890] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-09-16T17:32:02.785514] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-09-16T17:32:02.795407] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-16T17:32:02.826802] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-16T17:32:02.828235] [INFO ] [REMOTE ] BMN: Full fetch complete (2749 records). [2025-09-16T17:32:02.828321] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-09-16T17:32:02.828887] [FATAL] [VALIDATOR ] BMN: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:32:02.828989] [FATAL] [MAIN ] BMN: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:32:02.829041] [WARN ] [MAIN ] BMN: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:32:02.829107] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-09-16T17:32:02.829194] [DEBUG] [LOCAL ] BMN: No primary data file found to delete. [2025-09-16T17:32:02.829250] [INFO ] [LOCAL ] BMN: Starting deletion of derivative data. [2025-09-16T17:32:02.829308] [DEBUG] [LOCAL ] BMN: No derivative data file found to delete. [2025-09-16T17:32:02.829916] [INFO ] [MAIN ] Update Progress: 308/2369 symbols completed. BMN took 21.8s. Estimated remaining: 3h 34m 6s. Rate: 9.6 symbols/min [2025-09-16T17:32:02.997863] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:32:03.037495] [DEBUG] [LOCAL ] BN: Loaded 39006 existing records from primary storage. [2025-09-16T17:32:03.037680] [INFO ] [MAIN ] BN: Loaded 39006 existing records. [2025-09-16T17:32:03.216823] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:32:03.217087] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-09-16T17:32:03.217133] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-09-16T17:32:03.218103] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-09-16T17:32:03.218153] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-09-16T17:32:03.572634] [INFO ] [REMOTE ] BN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:32:03.574853] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-09-16T17:32:04.011964] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-16T17:32:04.374964] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-09-16T17:32:05.174923] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-09-16T17:32:05.374616] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-16T17:32:05.503545] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-16T17:32:05.974904] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-09-16T17:32:06.774907] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-09-16T17:32:07.180552] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-16T17:32:07.406407] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-16T17:32:07.574863] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-09-16T17:32:08.374905] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-09-16T17:32:08.702507] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-16T17:32:08.772141] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-16T17:32:09.174902] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-09-16T17:32:09.974870] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-09-16T17:32:10.140486] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-16T17:32:10.742033] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-16T17:32:10.760329] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-16T17:32:10.774850] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-09-16T17:32:11.574905] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-09-16T17:32:12.207897] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-16T17:32:12.211248] [INFO ] [REMOTE ] BMI: Full fetch complete (25135 records). [2025-09-16T17:32:12.211335] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-09-16T17:32:12.211877] [FATAL] [VALIDATOR ] BMI: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:32:12.211953] [FATAL] [MAIN ] BMI: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:32:12.211989] [WARN ] [MAIN ] BMI: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:32:12.212028] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-09-16T17:32:12.212097] [DEBUG] [LOCAL ] BMI: No primary data file found to delete. [2025-09-16T17:32:12.212135] [INFO ] [LOCAL ] BMI: Starting deletion of derivative data. [2025-09-16T17:32:12.212482] [DEBUG] [LOCAL ] BMI: Deleted derivative data file. [2025-09-16T17:32:12.212565] [INFO ] [MAIN ] Update Progress: 309/2369 symbols completed. BMI took 36.4s. Estimated remaining: 3h 34m 21s. Rate: 9.6 symbols/min [2025-09-16T17:32:12.382614] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-09-16T17:32:12.385885] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:32:12.407573] [DEBUG] [LOCAL ] BNED: Loaded 21697 existing records from primary storage. [2025-09-16T17:32:12.407729] [INFO ] [MAIN ] BNED: Loaded 21697 existing records. [2025-09-16T17:32:12.591310] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:32:12.591559] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-09-16T17:32:12.591607] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-09-16T17:32:12.592180] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-09-16T17:32:12.592253] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-09-16T17:32:12.949476] [INFO ] [REMOTE ] BNED: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:32:13.174905] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-09-16T17:32:13.392149] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-16T17:32:13.974910] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-09-16T17:32:14.443147] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-16T17:32:14.478037] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-16T17:32:14.774890] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-09-16T17:32:15.558691] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-16T17:32:15.574853] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-09-16T17:32:16.031444] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-16T17:32:16.374901] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-09-16T17:32:16.978403] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-16T17:32:17.174897] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-09-16T17:32:17.907350] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-16T17:32:17.974926] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-09-16T17:32:18.780428] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-09-16T17:32:18.786132] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-16T17:32:19.574929] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-09-16T17:32:19.932887] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-16T17:32:20.223628] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-16T17:32:20.374905] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-09-16T17:32:21.174898] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-09-16T17:32:21.280258] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-16T17:32:21.286774] [INFO ] [REMOTE ] BN: Full fetch complete (57648 records). [2025-09-16T17:32:21.286900] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-09-16T17:32:21.681988] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-09-16T17:32:21.682133] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-09-16T17:32:21.683025] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-09-16T17:32:21.683130] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-09-16T17:32:21.685102] [DEBUG] [LOCAL ] BN: Trimmed 57648 records to 39392 (keeping 150 days of data) [2025-09-16T17:32:21.928027] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-16T17:32:21.934335] [INFO ] [REMOTE ] BMO: Full fetch complete (44685 records). [2025-09-16T17:32:21.934944] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-09-16T17:32:21.936421] [FATAL] [VALIDATOR ] BMO: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:32:21.937175] [FATAL] [MAIN ] BMO: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:32:21.937911] [WARN ] [MAIN ] BMO: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:32:21.938907] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-09-16T17:32:21.939456] [DEBUG] [LOCAL ] BMO: No primary data file found to delete. [2025-09-16T17:32:21.939967] [INFO ] [LOCAL ] BMO: Starting deletion of derivative data. [2025-09-16T17:32:21.940769] [DEBUG] [LOCAL ] BMO: No derivative data file found to delete. [2025-09-16T17:32:21.941781] [INFO ] [MAIN ] Update Progress: 310/2369 symbols completed. BMO took 27.5s. Estimated remaining: 3h 34m 38s. Rate: 9.6 symbols/min [2025-09-16T17:32:21.975014] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-09-16T17:32:22.133324] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:32:22.134315] [DEBUG] [LOCAL ] BNH: No existing data file found in primary storage. [2025-09-16T17:32:22.134812] [WARN ] [MAIN ] BNH: No existing data found, performing full refresh instead. [2025-09-16T17:32:22.135993] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-09-16T17:32:22.136557] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-09-16T17:32:22.137104] [DEBUG] [LOCAL ] BNH: No primary data file found to delete. [2025-09-16T17:32:22.137585] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-09-16T17:32:22.540124] [DEBUG] [LOCAL ] BN: Primary data saved (39392 records). [2025-09-16T17:32:22.540029] [INFO ] [REMOTE ] BNH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:32:22.541381] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-16T17:32:22.541502] [INFO ] [MAIN ] BN: Full history saved. [2025-09-16T17:32:22.549870] [INFO ] [MAIN ] Update Progress: 311/2369 symbols completed. BN took 19.7s. Estimated remaining: 3h 33m 54s. Rate: 9.6 symbols/min [2025-09-16T17:32:22.721584] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:32:22.725792] [DEBUG] [LOCAL ] BNJ: Loaded 1727 existing records from primary storage. [2025-09-16T17:32:22.725916] [INFO ] [MAIN ] BNJ: Loaded 1727 existing records. [2025-09-16T17:32:22.781287] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-09-16T17:32:22.906015] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:32:22.906242] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-09-16T17:32:22.906291] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-09-16T17:32:22.906530] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-09-16T17:32:22.906594] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-09-16T17:32:23.263242] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:32:23.383041] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-16T17:32:23.574911] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-09-16T17:32:24.031707] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-16T17:32:24.177714] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-16T17:32:24.374917] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-09-16T17:32:24.726837] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-16T17:32:25.174898] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-09-16T17:32:25.906761] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-16T17:32:25.974920] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-09-16T17:32:26.774899] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-09-16T17:32:27.252674] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-16T17:32:27.574856] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-09-16T17:32:27.615306] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-16T17:32:28.019771] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-16T17:32:28.374873] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-09-16T17:32:29.174935] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-09-16T17:32:29.193835] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-16T17:32:29.200193] [INFO ] [REMOTE ] BMY: Full fetch complete (58437 records). [2025-09-16T17:32:29.200335] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-09-16T17:32:29.589135] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-09-16T17:32:29.589221] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-09-16T17:32:29.589924] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-09-16T17:32:29.589971] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-09-16T17:32:29.591161] [DEBUG] [LOCAL ] BMY: Trimmed 58437 records to 40107 (keeping 150 days of data) [2025-09-16T17:32:29.837195] [DEBUG] [LOCAL ] BMY: Primary data saved (40107 records). [2025-09-16T17:32:29.837321] [INFO ] [MAIN ] BMY: Full history saved. [2025-09-16T17:32:29.837418] [INFO ] [MAIN ] Update Progress: 312/2369 symbols completed. BMY took 29.6s. Estimated remaining: 3h 33m 55s. Rate: 9.6 symbols/min [2025-09-16T17:32:29.981200] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-09-16T17:32:30.013964] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:32:30.048254] [DEBUG] [LOCAL ] BNL: Loaded 34424 existing records from primary storage. [2025-09-16T17:32:30.048392] [INFO ] [MAIN ] BNL: Loaded 34424 existing records. [2025-09-16T17:32:30.228271] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:32:30.228518] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-09-16T17:32:30.228565] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-09-16T17:32:30.229371] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-09-16T17:32:30.229427] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-09-16T17:32:30.611578] [INFO ] [REMOTE ] BNL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:32:30.612672] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-16T17:32:30.632208] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-16T17:32:30.774900] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-09-16T17:32:31.574907] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-09-16T17:32:32.120793] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-16T17:32:32.374901] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-09-16T17:32:32.930977] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-16T17:32:33.174873] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-09-16T17:32:33.587098] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-16T17:32:33.974907] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-09-16T17:32:34.447510] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-16T17:32:34.774876] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-09-16T17:32:34.844291] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-16T17:32:35.574908] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-09-16T17:32:35.856278] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-16T17:32:36.171265] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-16T17:32:36.374904] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-09-16T17:32:36.884540] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-16T17:32:37.174914] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-09-16T17:32:37.723481] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-16T17:32:37.974900] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-09-16T17:32:38.423330] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-16T17:32:38.774905] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-09-16T17:32:39.226181] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-16T17:32:39.227191] [INFO ] [REMOTE ] BNH: Full fetch complete (5145 records). [2025-09-16T17:32:39.227258] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-09-16T17:32:39.582947] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-09-16T17:32:39.582586] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-09-16T17:32:39.584279] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-09-16T17:32:39.584487] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-09-16T17:32:39.584531] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-09-16T17:32:39.584931] [DEBUG] [LOCAL ] BNH: Trimmed 5145 records to 3128 (keeping 150 days of data) [2025-09-16T17:32:39.606481] [DEBUG] [LOCAL ] BNH: Primary data saved (3128 records). [2025-09-16T17:32:39.606614] [INFO ] [MAIN ] BNH: Full history saved. [2025-09-16T17:32:39.606720] [INFO ] [MAIN ] Update Progress: 313/2369 symbols completed. BNH took 17.7s. Estimated remaining: 3h 34m 12s. Rate: 9.6 symbols/min [2025-09-16T17:32:39.816088] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:32:39.852923] [DEBUG] [LOCAL ] BNS: Loaded 37795 existing records from primary storage. [2025-09-16T17:32:39.853077] [INFO ] [MAIN ] BNS: Loaded 37795 existing records. [2025-09-16T17:32:40.036397] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:32:40.036670] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-09-16T17:32:40.036719] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-09-16T17:32:40.037564] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-09-16T17:32:40.037616] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-09-16T17:32:40.377090] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-09-16T17:32:40.397805] [INFO ] [REMOTE ] BNS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:32:40.814679] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-16T17:32:41.026370] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-16T17:32:41.174877] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-09-16T17:32:41.974912] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-09-16T17:32:42.171572] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-16T17:32:42.176175] [INFO ] [REMOTE ] BNED: Full fetch complete (32286 records). [2025-09-16T17:32:42.176339] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-09-16T17:32:42.177141] [FATAL] [VALIDATOR ] BNED: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:32:42.177288] [FATAL] [MAIN ] BNED: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:32:42.177355] [WARN ] [MAIN ] BNED: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:32:42.177414] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-09-16T17:32:42.177476] [DEBUG] [LOCAL ] BNED: No primary data file found to delete. [2025-09-16T17:32:42.177520] [INFO ] [LOCAL ] BNED: Starting deletion of derivative data. [2025-09-16T17:32:42.177923] [DEBUG] [LOCAL ] BNED: Deleted derivative data file. [2025-09-16T17:32:42.178049] [INFO ] [MAIN ] Update Progress: 314/2369 symbols completed. BNED took 30.0s. Estimated remaining: 3h 33m 41s. Rate: 9.6 symbols/min [2025-09-16T17:32:42.364097] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:32:42.368064] [DEBUG] [LOCAL ] BNT: Loaded 2060 existing records from primary storage. [2025-09-16T17:32:42.368150] [INFO ] [MAIN ] BNT: Loaded 2060 existing records. [2025-09-16T17:32:42.487276] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-16T17:32:42.566152] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:32:42.566410] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-09-16T17:32:42.566459] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-09-16T17:32:42.566709] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-09-16T17:32:42.566758] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-09-16T17:32:42.781197] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-09-16T17:32:42.941824] [INFO ] [REMOTE ] BNT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:32:43.574907] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-09-16T17:32:44.374904] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-09-16T17:32:44.578221] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-16T17:32:45.082740] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-16T17:32:45.083778] [INFO ] [REMOTE ] BNJ: Full fetch complete (2900 records). [2025-09-16T17:32:45.083854] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-09-16T17:32:45.177357] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-09-16T17:32:45.402283] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-16T17:32:45.482748] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-09-16T17:32:45.482820] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-09-16T17:32:45.482930] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-09-16T17:32:45.482969] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-09-16T17:32:45.483306] [DEBUG] [LOCAL ] BNJ: Trimmed 2900 records to 1747 (keeping 150 days of data) [2025-09-16T17:32:45.494969] [DEBUG] [LOCAL ] BNJ: Primary data saved (1747 records). [2025-09-16T17:32:45.495042] [INFO ] [MAIN ] BNJ: Full history saved. [2025-09-16T17:32:45.495130] [INFO ] [MAIN ] Update Progress: 315/2369 symbols completed. BNJ took 22.9s. Estimated remaining: 3h 33m 16s. Rate: 9.6 symbols/min [2025-09-16T17:32:45.668820] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:32:45.678971] [DEBUG] [LOCAL ] BNY: Loaded 5301 existing records from primary storage. [2025-09-16T17:32:45.679083] [INFO ] [MAIN ] BNY: Loaded 5301 existing records. [2025-09-16T17:32:45.854705] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:32:45.854949] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-09-16T17:32:45.855002] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-09-16T17:32:45.855324] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-09-16T17:32:45.855370] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-09-16T17:32:45.980057] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-09-16T17:32:46.229634] [INFO ] [REMOTE ] BNY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:32:46.774909] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-09-16T17:32:46.907520] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-16T17:32:46.910300] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-16T17:32:47.574922] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-09-16T17:32:48.374908] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-09-16T17:32:48.501116] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-16T17:32:48.630544] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-16T17:32:48.944149] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-16T17:32:49.174898] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-09-16T17:32:49.974901] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-09-16T17:32:50.447666] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-16T17:32:50.738296] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-16T17:32:50.774874] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-09-16T17:32:51.574906] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-09-16T17:32:52.079101] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-16T17:32:52.374894] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-09-16T17:32:52.434632] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-16T17:32:53.082264] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-16T17:32:53.174940] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-09-16T17:32:53.520010] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-16T17:32:53.974916] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-09-16T17:32:54.774919] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-09-16T17:32:55.224114] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-16T17:32:55.574927] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-09-16T17:32:55.714885] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-16T17:32:55.720524] [INFO ] [REMOTE ] BNL: Full fetch complete (50837 records). [2025-09-16T17:32:55.720683] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-09-16T17:32:56.105539] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-09-16T17:32:56.105633] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-09-16T17:32:56.106703] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-09-16T17:32:56.106769] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-09-16T17:32:56.108561] [DEBUG] [LOCAL ] BNL: Trimmed 50837 records to 34783 (keeping 150 days of data) [2025-09-16T17:32:56.321718] [DEBUG] [LOCAL ] BNL: Primary data saved (34783 records). [2025-09-16T17:32:56.321885] [INFO ] [MAIN ] BNL: Full history saved. [2025-09-16T17:32:56.321986] [INFO ] [MAIN ] Update Progress: 316/2369 symbols completed. BNL took 26.5s. Estimated remaining: 3h 33m 40s. Rate: 9.6 symbols/min [2025-09-16T17:32:56.380998] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-09-16T17:32:56.504447] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:32:56.504628] [DEBUG] [LOCAL ] BOC: No existing data file found in primary storage. [2025-09-16T17:32:56.504714] [WARN ] [MAIN ] BOC: No existing data found, performing full refresh instead. [2025-09-16T17:32:56.504865] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-09-16T17:32:56.504915] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-09-16T17:32:56.504961] [DEBUG] [LOCAL ] BOC: No primary data file found to delete. [2025-09-16T17:32:56.505002] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-09-16T17:32:56.871999] [INFO ] [REMOTE ] BOC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:32:57.119178] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-16T17:32:57.174857] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-09-16T17:32:57.581081] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-16T17:32:57.582544] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-16T17:32:57.974902] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-09-16T17:32:58.774906] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-09-16T17:32:59.574877] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-09-16T17:32:59.658277] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-16T17:32:59.705809] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-16T17:33:00.159610] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-16T17:33:00.160747] [INFO ] [REMOTE ] BNT: Full fetch complete (3501 records). [2025-09-16T17:33:00.160816] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-09-16T17:33:00.381026] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-09-16T17:33:00.524080] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-09-16T17:33:00.524159] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-09-16T17:33:00.524311] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-09-16T17:33:00.524368] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-09-16T17:33:00.524776] [DEBUG] [LOCAL ] BNT: Trimmed 3501 records to 2089 (keeping 150 days of data) [2025-09-16T17:33:00.537903] [DEBUG] [LOCAL ] BNT: Primary data saved (2089 records). [2025-09-16T17:33:00.537962] [INFO ] [MAIN ] BNT: Full history saved. [2025-09-16T17:33:00.538052] [INFO ] [MAIN ] Update Progress: 317/2369 symbols completed. BNT took 18.4s. Estimated remaining: 3h 33m 20s. Rate: 9.6 symbols/min [2025-09-16T17:33:01.174886] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-09-16T17:33:01.228825] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-16T17:33:01.974902] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-09-16T17:33:02.708472] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-16T17:33:02.774876] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-09-16T17:33:02.880302] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-16T17:33:03.559429] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-16T17:33:03.574866] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-09-16T17:33:04.320497] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-16T17:33:04.374896] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-09-16T17:33:04.959154] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-16T17:33:04.960578] [INFO ] [REMOTE ] BNY: Full fetch complete (7706 records). [2025-09-16T17:33:04.960692] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-09-16T17:33:05.184270] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-09-16T17:33:05.325583] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-09-16T17:33:05.325670] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-09-16T17:33:05.325868] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-09-16T17:33:05.325926] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-09-16T17:33:05.326319] [DEBUG] [LOCAL ] BNY: Trimmed 7706 records to 5332 (keeping 150 days of data) [2025-09-16T17:33:05.359111] [DEBUG] [LOCAL ] BNY: Primary data saved (5332 records). [2025-09-16T17:33:05.359198] [INFO ] [MAIN ] BNY: Full history saved. [2025-09-16T17:33:05.359279] [INFO ] [MAIN ] Update Progress: 318/2369 symbols completed. BNY took 19.9s. Estimated remaining: 3h 33m 5s. Rate: 9.6 symbols/min [2025-09-16T17:33:05.974937] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-09-16T17:33:06.784771] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-16T17:33:06.800591] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-09-16T17:33:06.953484] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-16T17:33:07.574964] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-09-16T17:33:08.314983] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-16T17:33:08.374929] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-09-16T17:33:08.549713] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-16T17:33:09.174902] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-09-16T17:33:09.781166] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-16T17:33:09.787794] [INFO ] [REMOTE ] BNS: Full fetch complete (55949 records). [2025-09-16T17:33:09.787917] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-09-16T17:33:10.175305] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-09-16T17:33:10.175414] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-09-16T17:33:10.176145] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-09-16T17:33:10.176196] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-09-16T17:33:10.177458] [DEBUG] [LOCAL ] BNS: Trimmed 55949 records to 38179 (keeping 150 days of data) [2025-09-16T17:33:10.292955] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-16T17:33:10.300665] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-09-16T17:33:10.436485] [DEBUG] [LOCAL ] BNS: Primary data saved (38179 records). [2025-09-16T17:33:10.436635] [INFO ] [MAIN ] BNS: Full history saved. [2025-09-16T17:33:10.436773] [INFO ] [MAIN ] Update Progress: 319/2369 symbols completed. BNS took 30.8s. Estimated remaining: 3h 32m 51s. Rate: 9.6 symbols/min [2025-09-16T17:33:11.277627] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-16T17:33:11.281539] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-09-16T17:33:12.065942] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-16T17:33:12.069813] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-09-16T17:33:13.070343] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-16T17:33:13.074919] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-09-16T17:33:14.134963] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-16T17:33:14.140539] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-09-16T17:33:15.140476] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-16T17:33:15.144246] [INFO ] [REMOTE ] BOC: Full fetch complete (19671 records). [2025-09-16T17:33:15.144393] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-09-16T17:33:15.506144] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-09-16T17:33:15.506225] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-09-16T17:33:15.506595] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-09-16T17:33:15.506635] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-09-16T17:33:15.507264] [DEBUG] [LOCAL ] BOC: Trimmed 19671 records to 13393 (keeping 150 days of data) [2025-09-16T17:33:15.593230] [DEBUG] [LOCAL ] BOC: Primary data saved (13393 records). [2025-09-16T17:33:15.593410] [INFO ] [MAIN ] BOC: Full history saved. [2025-09-16T17:33:15.593489] [INFO ] [MAIN ] Update Progress: 320/2369 symbols completed. BOC took 19.3s. Estimated remaining: 3h 32m 38s. Rate: 9.6 symbols/min [2025-09-16T17:33:16.210976] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:33:16.247931] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:33:16.296229] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:33:16.298696] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:33:16.321912] [DEBUG] [LOCAL ] BOE: Loaded 11861 existing records from primary storage. [2025-09-16T17:33:16.333028] [INFO ] [MAIN ] BOE: Loaded 11861 existing records. [2025-09-16T17:33:16.444582] [DEBUG] [LOCAL ] BOH: Loaded 21842 existing records from primary storage. [2025-09-16T17:33:16.467739] [INFO ] [MAIN ] BOH: Loaded 21842 existing records. [2025-09-16T17:33:16.489367] [DEBUG] [LOCAL ] BOOT: Loaded 29291 existing records from primary storage. [2025-09-16T17:33:16.561380] [DEBUG] [LOCAL ] BOND: Loaded 23537 existing records from primary storage. [2025-09-16T17:33:16.598734] [WARN ] [MAIN ] BOE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:33:16.618370] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-09-16T17:33:16.598839] [INFO ] [MAIN ] BOOT: Loaded 29291 existing records. [2025-09-16T17:33:16.644473] [INFO ] [MAIN ] BOND: Loaded 23537 existing records. [2025-09-16T17:33:16.634217] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-09-16T17:33:16.696842] [DEBUG] [LOCAL ] BOE: Deleted primary data file. [2025-09-16T17:33:16.712628] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-09-16T17:33:17.013749] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:33:17.108979] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:33:17.109092] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-09-16T17:33:17.140356] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-09-16T17:33:17.145741] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-09-16T17:33:17.161823] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-09-16T17:33:17.176244] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-09-16T17:33:17.204728] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-09-16T17:33:17.210118] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-09-16T17:33:17.209945] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:33:17.225573] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-09-16T17:33:17.360395] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-09-16T17:33:17.447024] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-09-16T17:33:17.580961] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-09-16T17:33:17.645707] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-09-16T17:33:17.926908] [INFO ] [REMOTE ] BOE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:33:17.992573] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-09-16T17:33:18.423692] [INFO ] [REMOTE ] BOH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:33:18.382118] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:33:18.451834] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-09-16T17:33:18.452847] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-09-16T17:33:18.568591] [INFO ] [REMOTE ] BOND: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:33:18.568917] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-09-16T17:33:19.125493] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-16T17:33:19.129745] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-09-16T17:33:19.627049] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-16T17:33:19.633253] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-09-16T17:33:19.761873] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-16T17:33:19.770394] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-09-16T17:33:19.923138] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-16T17:33:19.927482] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-09-16T17:33:20.118242] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-16T17:33:20.374942] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-09-16T17:33:20.654843] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-16T17:33:20.795759] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-16T17:33:21.075133] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-16T17:33:21.174880] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-09-16T17:33:21.625117] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-16T17:33:21.908636] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-16T17:33:21.974908] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-09-16T17:33:22.774903] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-09-16T17:33:23.574906] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-09-16T17:33:23.618974] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-16T17:33:24.157555] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-16T17:33:24.374899] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-09-16T17:33:24.801082] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-16T17:33:25.174905] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-09-16T17:33:25.959515] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-16T17:33:25.974842] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-09-16T17:33:26.423185] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-16T17:33:26.774955] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-09-16T17:33:27.431173] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-16T17:33:27.574910] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-09-16T17:33:28.089359] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-16T17:33:28.374914] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-09-16T17:33:28.534081] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-16T17:33:29.174908] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-09-16T17:33:29.635503] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-16T17:33:29.974898] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-09-16T17:33:30.774934] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-09-16T17:33:30.814622] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-16T17:33:31.048568] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-16T17:33:31.574909] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-09-16T17:33:32.025314] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-16T17:33:32.374906] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-09-16T17:33:33.061408] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-16T17:33:33.110078] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-16T17:33:33.174914] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-09-16T17:33:33.974912] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-09-16T17:33:34.711189] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-16T17:33:34.774911] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-09-16T17:33:35.374770] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-16T17:33:35.379846] [INFO ] [REMOTE ] BOOT: Full fetch complete (45417 records). [2025-09-16T17:33:35.379981] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-09-16T17:33:35.575284] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-09-16T17:33:35.649112] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-16T17:33:35.691620] [INFO ] [REMOTE ] BOE: Full fetch complete (18935 records). [2025-09-16T17:33:35.707207] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-09-16T17:33:35.855148] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-09-16T17:33:35.873604] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-09-16T17:33:35.876366] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-09-16T17:33:35.876424] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-09-16T17:33:35.934444] [DEBUG] [LOCAL ] BOOT: Trimmed 45417 records to 29529 (keeping 150 days of data) [2025-09-16T17:33:36.252020] [DEBUG] [VALIDATOR ] BOE: All expected trading days are present. [2025-09-16T17:33:36.252599] [DEBUG] [VALIDATOR ] BOE: Primary data validation passed. [2025-09-16T17:33:36.252992] [INFO ] [MAIN ] BOE: Fetched primary data is valid. [2025-09-16T17:33:36.253257] [DEBUG] [LOCAL ] BOE: Saving primary data. [2025-09-16T17:33:36.255592] [DEBUG] [LOCAL ] BOE: Trimmed 18935 records to 11979 (keeping 150 days of data) [2025-09-16T17:33:36.375668] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-09-16T17:33:36.377217] [DEBUG] [LOCAL ] BOE: Primary data saved (11979 records). [2025-09-16T17:33:36.382888] [INFO ] [MAIN ] BOE: Full history saved. [2025-09-16T17:33:36.396628] [INFO ] [MAIN ] Update Progress: 321/2369 symbols completed. BOE took 20.8s. Estimated remaining: 3h 34m 5s. Rate: 9.6 symbols/min [2025-09-16T17:33:36.588973] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:33:36.595673] [DEBUG] [LOCAL ] BOOT: Primary data saved (29529 records). [2025-09-16T17:33:36.595924] [INFO ] [MAIN ] BOOT: Full history saved. [2025-09-16T17:33:36.599790] [INFO ] [MAIN ] Update Progress: 322/2369 symbols completed. BOOT took 21.0s. Estimated remaining: 3h 33m 20s. Rate: 9.6 symbols/min [2025-09-16T17:33:36.780059] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:33:36.795919] [DEBUG] [LOCAL ] BORR: Loaded 37699 existing records from primary storage. [2025-09-16T17:33:36.796070] [INFO ] [MAIN ] BORR: Loaded 37699 existing records. [2025-09-16T17:33:36.986519] [DEBUG] [LOCAL ] BOW: Loaded 16164 existing records from primary storage. [2025-09-16T17:33:36.986100] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:33:36.986937] [INFO ] [MAIN ] BOW: Loaded 16164 existing records. [2025-09-16T17:33:37.018186] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-09-16T17:33:37.023467] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-09-16T17:33:37.068122] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-09-16T17:33:37.068390] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-09-16T17:33:37.275704] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:33:37.302230] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-09-16T17:33:37.331935] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-09-16T17:33:37.334884] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-09-16T17:33:37.335737] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-09-16T17:33:37.519735] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-16T17:33:37.649214] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-09-16T17:33:37.752633] [INFO ] [REMOTE ] BORR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:33:37.966826] [INFO ] [REMOTE ] BOW: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:33:37.980172] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-09-16T17:33:37.990009] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-16T17:33:38.774886] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-09-16T17:33:38.923495] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-16T17:33:39.100845] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-16T17:33:39.105021] [INFO ] [REMOTE ] BOND: Full fetch complete (34774 records). [2025-09-16T17:33:39.105130] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-09-16T17:33:39.481964] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-09-16T17:33:39.482046] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-09-16T17:33:39.482488] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-09-16T17:33:39.482528] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-09-16T17:33:39.483302] [DEBUG] [LOCAL ] BOND: Trimmed 34774 records to 23774 (keeping 150 days of data) [2025-09-16T17:33:39.580250] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-09-16T17:33:39.639745] [DEBUG] [LOCAL ] BOND: Primary data saved (23774 records). [2025-09-16T17:33:39.639874] [INFO ] [MAIN ] BOND: Full history saved. [2025-09-16T17:33:39.639961] [INFO ] [MAIN ] Update Progress: 323/2369 symbols completed. BOND took 24.0s. Estimated remaining: 3h 32m 54s. Rate: 9.6 symbols/min [2025-09-16T17:33:39.815885] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:33:39.851182] [DEBUG] [LOCAL ] BOX: Loaded 37029 existing records from primary storage. [2025-09-16T17:33:39.851319] [INFO ] [MAIN ] BOX: Loaded 37029 existing records. [2025-09-16T17:33:40.036978] [WARN ] [MAIN ] BOX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:33:40.037243] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-09-16T17:33:40.037303] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-09-16T17:33:40.038325] [DEBUG] [LOCAL ] BOX: Deleted primary data file. [2025-09-16T17:33:40.038386] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-09-16T17:33:40.383219] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-09-16T17:33:40.405491] [INFO ] [REMOTE ] BOX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:33:40.568341] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-16T17:33:40.689236] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-16T17:33:41.174875] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-09-16T17:33:41.479596] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-16T17:33:41.974907] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-09-16T17:33:42.755181] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-16T17:33:42.774892] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-09-16T17:33:43.052559] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-16T17:33:43.574909] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-09-16T17:33:43.849034] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-16T17:33:44.374934] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-09-16T17:33:44.677550] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-16T17:33:45.174946] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-09-16T17:33:45.340791] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-16T17:33:45.974912] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-09-16T17:33:46.646320] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-16T17:33:46.774903] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-09-16T17:33:46.937296] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-16T17:33:47.574899] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-09-16T17:33:48.003784] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-16T17:33:48.374913] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-09-16T17:33:49.135860] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-16T17:33:49.174854] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-09-16T17:33:49.804544] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-16T17:33:49.808277] [INFO ] [REMOTE ] BOH: Full fetch complete (33814 records). [2025-09-16T17:33:49.808355] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-09-16T17:33:49.980068] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-09-16T17:33:50.179350] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-09-16T17:33:50.179426] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-09-16T17:33:50.179878] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-09-16T17:33:50.179925] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-09-16T17:33:50.180705] [DEBUG] [LOCAL ] BOH: Trimmed 33814 records to 22048 (keeping 150 days of data) [2025-09-16T17:33:50.320238] [DEBUG] [LOCAL ] BOH: Primary data saved (22048 records). [2025-09-16T17:33:50.320369] [INFO ] [MAIN ] BOH: Full history saved. [2025-09-16T17:33:50.320451] [INFO ] [MAIN ] Update Progress: 324/2369 symbols completed. BOH took 34.7s. Estimated remaining: 3h 33m 15s. Rate: 9.6 symbols/min [2025-09-16T17:33:50.494381] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:33:50.532989] [DEBUG] [LOCAL ] BP: Loaded 39671 existing records from primary storage. [2025-09-16T17:33:50.533148] [INFO ] [MAIN ] BP: Loaded 39671 existing records. [2025-09-16T17:33:50.717793] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:33:50.718264] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-09-16T17:33:50.718422] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-09-16T17:33:50.719597] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-09-16T17:33:50.729063] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-09-16T17:33:50.777991] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-09-16T17:33:50.827650] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-16T17:33:51.120604] [INFO ] [REMOTE ] BP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:33:51.137771] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-16T17:33:51.574912] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-09-16T17:33:52.374891] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-09-16T17:33:52.791946] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-16T17:33:53.174926] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-09-16T17:33:53.847179] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-09-16T17:33:53.933886] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-16T17:33:53.974845] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-09-16T17:33:54.544030] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-16T17:33:54.774904] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-09-16T17:33:55.574922] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-09-16T17:33:55.743607] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-16T17:33:56.292825] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-16T17:33:56.374913] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-09-16T17:33:57.174901] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-09-16T17:33:57.665408] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-16T17:33:57.974866] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-09-16T17:33:58.124284] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-16T17:33:58.130813] [INFO ] [REMOTE ] BORR: Full fetch complete (55813 records). [2025-09-16T17:33:58.130940] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-09-16T17:33:58.451900] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-16T17:33:58.496364] [INFO ] [REMOTE ] BOW: Full fetch complete (25064 records). [2025-09-16T17:33:58.511513] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-09-16T17:33:58.573737] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present. [2025-09-16T17:33:58.594464] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed. [2025-09-16T17:33:58.606576] [INFO ] [MAIN ] BORR: Fetched primary data is valid. [2025-09-16T17:33:58.611773] [DEBUG] [LOCAL ] BORR: Saving primary data. [2025-09-16T17:33:58.674723] [DEBUG] [LOCAL ] BORR: Trimmed 55813 records to 38074 (keeping 150 days of data) [2025-09-16T17:33:58.795353] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-09-16T17:33:59.008737] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-09-16T17:33:59.009347] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-09-16T17:33:59.015336] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-09-16T17:33:59.015955] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-09-16T17:33:59.028258] [DEBUG] [LOCAL ] BOW: Trimmed 25064 records to 16305 (keeping 150 days of data) [2025-09-16T17:33:59.221435] [DEBUG] [LOCAL ] BOW: Primary data saved (16305 records). [2025-09-16T17:33:59.224555] [INFO ] [MAIN ] BOW: Full history saved. [2025-09-16T17:33:59.225573] [INFO ] [MAIN ] Update Progress: 325/2369 symbols completed. BOW took 22.6s. Estimated remaining: 3h 33m 26s. Rate: 9.6 symbols/min [2025-09-16T17:33:59.273939] [DEBUG] [LOCAL ] BORR: Primary data saved (38074 records). [2025-09-16T17:33:59.312514] [INFO ] [MAIN ] BORR: Full history saved. [2025-09-16T17:33:59.334345] [INFO ] [MAIN ] Update Progress: 326/2369 symbols completed. BORR took 22.9s. Estimated remaining: 3h 32m 41s. Rate: 9.6 symbols/min [2025-09-16T17:33:59.513342] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:33:59.586073] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:33:59.636821] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-16T17:33:59.648474] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-09-16T17:33:59.659117] [DEBUG] [LOCAL ] BR: Loaded 25002 existing records from primary storage. [2025-09-16T17:33:59.659272] [INFO ] [MAIN ] BR: Loaded 25002 existing records. [2025-09-16T17:33:59.841457] [DEBUG] [LOCAL ] BRBR: Loaded 38487 existing records from primary storage. [2025-09-16T17:33:59.871729] [INFO ] [MAIN ] BRBR: Loaded 38487 existing records. [2025-09-16T17:33:59.936722] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:34:00.043822] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-09-16T17:34:00.058780] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-09-16T17:34:00.066684] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-09-16T17:34:00.100479] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-09-16T17:34:00.289488] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:34:00.316298] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-09-16T17:34:00.340609] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-09-16T17:34:00.407456] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-09-16T17:34:00.407746] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-09-16T17:34:00.992752] [INFO ] [REMOTE ] BR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:34:01.045133] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-09-16T17:34:01.140515] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:34:01.183310] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-09-16T17:34:01.202210] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-16T17:34:01.404543] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-09-16T17:34:01.974903] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-09-16T17:34:02.774899] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-09-16T17:34:02.792519] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-16T17:34:03.255796] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-16T17:34:03.574892] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-09-16T17:34:04.270977] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-09-16T17:34:04.368909] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-16T17:34:04.374880] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-09-16T17:34:04.375147] [INFO ] [REMOTE ] BOX: Full fetch complete (54557 records). [2025-09-16T17:34:04.375257] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-09-16T17:34:04.764198] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-09-16T17:34:04.764278] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-09-16T17:34:04.764884] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-09-16T17:34:04.764929] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-09-16T17:34:04.766013] [DEBUG] [LOCAL ] BOX: Trimmed 54557 records to 37385 (keeping 150 days of data) [2025-09-16T17:34:04.982347] [DEBUG] [LOCAL ] BOX: Primary data saved (37385 records). [2025-09-16T17:34:04.982489] [INFO ] [MAIN ] BOX: Full history saved. [2025-09-16T17:34:04.983445] [INFO ] [MAIN ] Update Progress: 327/2369 symbols completed. BOX took 25.3s. Estimated remaining: 3h 32m 31s. Rate: 9.6 symbols/min [2025-09-16T17:34:05.154701] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:34:05.170274] [DEBUG] [LOCAL ] BRC: Loaded 13268 existing records from primary storage. [2025-09-16T17:34:05.170462] [INFO ] [MAIN ] BRC: Loaded 13268 existing records. [2025-09-16T17:34:05.181722] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-09-16T17:34:05.383494] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-16T17:34:05.387712] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:34:05.398762] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-09-16T17:34:05.399159] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-09-16T17:34:05.399726] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-09-16T17:34:05.399778] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-09-16T17:34:05.749675] [INFO ] [REMOTE ] BRC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:34:05.903928] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-16T17:34:05.974861] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-09-16T17:34:06.774931] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-09-16T17:34:07.107984] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-16T17:34:07.445755] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-16T17:34:07.574906] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-09-16T17:34:08.374935] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-09-16T17:34:08.458915] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-16T17:34:08.878294] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-16T17:34:09.174920] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-09-16T17:34:09.798117] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-16T17:34:09.974924] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-09-16T17:34:10.048622] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-16T17:34:10.774915] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-09-16T17:34:11.261364] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-16T17:34:11.574947] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-09-16T17:34:11.898950] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-16T17:34:12.374903] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-09-16T17:34:13.174919] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-09-16T17:34:13.384427] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-16T17:34:13.715237] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-16T17:34:13.974919] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-09-16T17:34:14.614819] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-16T17:34:14.774953] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-09-16T17:34:15.574906] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-09-16T17:34:15.828559] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-16T17:34:16.174665] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-16T17:34:16.374878] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-09-16T17:34:16.441616] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-16T17:34:17.174903] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-09-16T17:34:17.810016] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-16T17:34:17.833404] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-16T17:34:17.974909] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-09-16T17:34:18.774923] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-09-16T17:34:19.127407] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-16T17:34:19.575000] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-09-16T17:34:20.149589] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-16T17:34:20.374910] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-09-16T17:34:21.174886] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-09-16T17:34:21.288722] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-16T17:34:21.383231] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-16T17:34:21.974903] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-09-16T17:34:22.588167] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-16T17:34:22.594554] [INFO ] [REMOTE ] BRBR: Full fetch complete (55112 records). [2025-09-16T17:34:22.594709] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-09-16T17:34:22.780030] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-09-16T17:34:22.994128] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-09-16T17:34:22.994227] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-09-16T17:34:22.994897] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-09-16T17:34:22.994954] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-09-16T17:34:22.996125] [DEBUG] [LOCAL ] BRBR: Trimmed 55112 records to 38872 (keeping 150 days of data) [2025-09-16T17:34:23.218160] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-16T17:34:23.224585] [INFO ] [REMOTE ] BR: Full fetch complete (37263 records). [2025-09-16T17:34:23.225015] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-09-16T17:34:23.600932] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-09-16T17:34:23.633095] [DEBUG] [LOCAL ] BRBR: Primary data saved (38872 records). [2025-09-16T17:34:23.635369] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-09-16T17:34:23.636328] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-09-16T17:34:23.635236] [INFO ] [MAIN ] BRBR: Full history saved. [2025-09-16T17:34:23.636931] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-09-16T17:34:23.639273] [INFO ] [MAIN ] Update Progress: 328/2369 symbols completed. BRBR took 24.3s. Estimated remaining: 3h 33m 42s. Rate: 9.6 symbols/min [2025-09-16T17:34:23.639599] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-09-16T17:34:23.692666] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-16T17:34:23.744378] [INFO ] [REMOTE ] BRC: Full fetch complete (21890 records). [2025-09-16T17:34:23.755323] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-09-16T17:34:23.755227] [DEBUG] [LOCAL ] BR: Trimmed 37263 records to 25280 (keeping 150 days of data) [2025-09-16T17:34:23.882533] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:34:24.257081] [DEBUG] [LOCAL ] BRCC: Loaded 30061 existing records from primary storage. [2025-09-16T17:34:24.285749] [INFO ] [MAIN ] BRCC: Loaded 30061 existing records. [2025-09-16T17:34:24.384170] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-09-16T17:34:24.396168] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-09-16T17:34:24.425045] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-09-16T17:34:24.426152] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-09-16T17:34:24.484550] [DEBUG] [LOCAL ] BRC: Trimmed 21890 records to 13406 (keeping 150 days of data) [2025-09-16T17:34:24.504335] [WARN ] [MAIN ] BRCC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:34:24.507947] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-09-16T17:34:24.545436] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-09-16T17:34:24.570214] [DEBUG] [LOCAL ] BRCC: Deleted primary data file. [2025-09-16T17:34:24.570696] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-09-16T17:34:24.703595] [DEBUG] [LOCAL ] BR: Primary data saved (25280 records). [2025-09-16T17:34:24.711195] [INFO ] [MAIN ] BR: Full history saved. [2025-09-16T17:34:24.724231] [INFO ] [MAIN ] Update Progress: 329/2369 symbols completed. BR took 25.5s. Estimated remaining: 3h 33m 3s. Rate: 9.6 symbols/min [2025-09-16T17:34:25.099354] [INFO ] [MAIN ] BRFS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:34:25.115536] [DEBUG] [LOCAL ] BRFS: No existing data file found in primary storage. [2025-09-16T17:34:25.116141] [WARN ] [MAIN ] BRFS: No existing data found, performing full refresh instead. [2025-09-16T17:34:25.142474] [INFO ] [MAIN ] BRFS: Wiping existing primary data before full refresh. [2025-09-16T17:34:25.168837] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:34:25.168933] [INFO ] [LOCAL ] BRFS: Starting deletion of primary data. [2025-09-16T17:34:25.165049] [DEBUG] [LOCAL ] BRC: Primary data saved (13406 records). [2025-09-16T17:34:25.169312] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-09-16T17:34:25.169085] [INFO ] [MAIN ] BRC: Full history saved. [2025-09-16T17:34:25.169445] [INFO ] [MAIN ] Update Progress: 330/2369 symbols completed. BRC took 20.2s. Estimated remaining: 3h 32m 21s. Rate: 9.6 symbols/min [2025-09-16T17:34:25.169049] [DEBUG] [LOCAL ] BRFS: No primary data file found to delete. [2025-09-16T17:34:25.170298] [INFO ] [MAIN ] BRFS: Starting full primary refresh. [2025-09-16T17:34:25.481220] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:34:25.514162] [DEBUG] [LOCAL ] BRO: No existing data file found in primary storage. [2025-09-16T17:34:25.553215] [WARN ] [MAIN ] BRO: No existing data found, performing full refresh instead. [2025-09-16T17:34:25.620689] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-09-16T17:34:25.620916] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-09-16T17:34:25.621239] [DEBUG] [LOCAL ] BRO: No primary data file found to delete. [2025-09-16T17:34:25.631674] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-09-16T17:34:25.712946] [INFO ] [REMOTE ] BRFS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:34:25.751195] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-02. [2025-09-16T17:34:25.831592] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-16T17:34:25.891826] [INFO ] [REMOTE ] BP: Full fetch complete (58390 records). [2025-09-16T17:34:25.899727] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-09-16T17:34:26.280275] [INFO ] [REMOTE ] BRO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:34:26.297224] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-09-16T17:34:26.515446] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-09-16T17:34:26.515678] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-09-16T17:34:26.516452] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-09-16T17:34:26.533701] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-09-16T17:34:26.535370] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-16T17:34:26.542835] [DEBUG] [LOCAL ] BP: Trimmed 58390 records to 40061 (keeping 150 days of data) [2025-09-16T17:34:26.774904] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-09-16T17:34:26.790138] [DEBUG] [LOCAL ] BP: Primary data saved (40061 records). [2025-09-16T17:34:26.790263] [INFO ] [MAIN ] BP: Full history saved. [2025-09-16T17:34:26.791735] [INFO ] [MAIN ] Update Progress: 331/2369 symbols completed. BP took 36.5s. Estimated remaining: 3h 31m 46s. Rate: 9.6 symbols/min [2025-09-16T17:34:26.963013] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:34:26.963173] [DEBUG] [LOCAL ] BROS: No existing data file found in primary storage. [2025-09-16T17:34:26.963210] [WARN ] [MAIN ] BROS: No existing data found, performing full refresh instead. [2025-09-16T17:34:26.963328] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-09-16T17:34:26.963386] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-09-16T17:34:26.963429] [DEBUG] [LOCAL ] BROS: No primary data file found to delete. [2025-09-16T17:34:26.963462] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-09-16T17:34:27.324956] [INFO ] [REMOTE ] BROS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:34:27.348217] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-16T17:34:27.574933] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-03. [2025-09-16T17:34:27.702786] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-16T17:34:27.809927] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-16T17:34:28.374900] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-09-16T17:34:28.632675] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-16T17:34:29.174971] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-04. [2025-09-16T17:34:29.744107] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-16T17:34:29.974910] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-09-16T17:34:30.365961] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-16T17:34:30.774921] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-05. [2025-09-16T17:34:31.409590] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-16T17:34:31.574905] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-09-16T17:34:31.912272] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-16T17:34:32.374963] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-09-16T17:34:33.022888] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-16T17:34:33.174927] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-06. [2025-09-16T17:34:33.974895] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-09-16T17:34:34.041015] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-16T17:34:34.388339] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-16T17:34:34.774964] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-09-16T17:34:35.272685] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-16T17:34:35.574919] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-09-16T17:34:36.374900] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-09-16T17:34:36.502716] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-16T17:34:36.689986] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-16T17:34:37.174895] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-09-16T17:34:37.956282] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-16T17:34:37.974855] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-09-16T17:34:38.774928] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-09-16T17:34:39.166857] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-16T17:34:39.462392] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-16T17:34:39.574884] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-09-16T17:34:40.241438] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-16T17:34:40.374926] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-07. [2025-09-16T17:34:41.174916] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-09-16T17:34:41.201404] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-16T17:34:41.208135] [INFO ] [REMOTE ] BRO: Full fetch complete (56239 records). [2025-09-16T17:34:41.208271] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-09-16T17:34:41.598913] [DEBUG] [VALIDATOR ] BRO: All expected trading days are present. [2025-09-16T17:34:41.599071] [DEBUG] [VALIDATOR ] BRO: Primary data validation passed. [2025-09-16T17:34:41.599766] [INFO ] [MAIN ] BRO: Fetched primary data is valid. [2025-09-16T17:34:41.599911] [DEBUG] [LOCAL ] BRO: Saving primary data. [2025-09-16T17:34:41.601271] [DEBUG] [LOCAL ] BRO: Trimmed 56239 records to 38727 (keeping 150 days of data) [2025-09-16T17:34:41.716003] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-16T17:34:41.874610] [DEBUG] [LOCAL ] BRO: Primary data saved (38727 records). [2025-09-16T17:34:41.874784] [INFO ] [MAIN ] BRO: Full history saved. [2025-09-16T17:34:41.874875] [INFO ] [MAIN ] Update Progress: 332/2369 symbols completed. BRO took 16.7s. Estimated remaining: 3h 32m 34s. Rate: 9.6 symbols/min [2025-09-16T17:34:41.975603] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-08. [2025-09-16T17:34:42.045037] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:34:42.045190] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-09-16T17:34:42.045227] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-09-16T17:34:42.045343] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-09-16T17:34:42.045380] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-16T17:34:42.045421] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-09-16T17:34:42.045453] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-09-16T17:34:42.399433] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:34:42.774868] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-02. [2025-09-16T17:34:42.965714] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:34:42.967864] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-16T17:34:42.968326] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-02 [2025-09-16T17:34:43.094445] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-16T17:34:43.574911] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-09-16T17:34:44.374903] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-09. [2025-09-16T17:34:45.174919] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-09-16T17:34:45.569551] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-16T17:34:45.592016] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-16T17:34:45.596416] [INFO ] [REMOTE ] BRFS: Full fetch complete (44962 records). [2025-09-16T17:34:45.596538] [DEBUG] [VALIDATOR ] BRFS: Validating primary data. [2025-09-16T17:34:45.982154] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-09-16T17:34:45.994115] [DEBUG] [VALIDATOR ] BRFS: All expected trading days are present. [2025-09-16T17:34:45.994173] [DEBUG] [VALIDATOR ] BRFS: Primary data validation passed. [2025-09-16T17:34:45.994740] [INFO ] [MAIN ] BRFS: Fetched primary data is valid. [2025-09-16T17:34:45.994786] [DEBUG] [LOCAL ] BRFS: Saving primary data. [2025-09-16T17:34:45.995802] [DEBUG] [LOCAL ] BRFS: Trimmed 44962 records to 30222 (keeping 150 days of data) [2025-09-16T17:34:46.168910] [DEBUG] [LOCAL ] BRFS: Primary data saved (30222 records). [2025-09-16T17:34:46.169072] [INFO ] [MAIN ] BRFS: Full history saved. [2025-09-16T17:34:46.169153] [INFO ] [MAIN ] Update Progress: 333/2369 symbols completed. BRFS took 21.4s. Estimated remaining: 3h 32m 16s. Rate: 9.6 symbols/min [2025-09-16T17:34:46.351787] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:34:46.351947] [DEBUG] [LOCAL ] BRSP: No existing data file found in primary storage. [2025-09-16T17:34:46.351986] [WARN ] [MAIN ] BRSP: No existing data found, performing full refresh instead. [2025-09-16T17:34:46.352120] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-09-16T17:34:46.352159] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-09-16T17:34:46.352201] [DEBUG] [LOCAL ] BRSP: No primary data file found to delete. [2025-09-16T17:34:46.352234] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-09-16T17:34:46.719687] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:34:46.742539] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-16T17:34:46.774859] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-09-16T17:34:47.574903] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-09-16T17:34:48.078484] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-16T17:34:48.375004] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-03. [2025-09-16T17:34:48.374935] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-16T17:34:48.639156] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:34:48.639486] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-03 [2025-09-16T17:34:49.174963] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-04. [2025-09-16T17:34:49.295485] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-16T17:34:49.361966] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:34:49.362323] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-04 [2025-09-16T17:34:49.974931] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-09-16T17:34:50.774945] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-05. [2025-09-16T17:34:51.014333] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:34:51.014632] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-05 [2025-09-16T17:34:51.253622] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-16T17:34:51.574915] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-09-16T17:34:52.374961] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-09-16T17:34:53.175002] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-06. [2025-09-16T17:34:53.375989] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:34:53.376408] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-06 [2025-09-16T17:34:53.713816] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-16T17:34:53.852928] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-16T17:34:53.974896] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-09-16T17:34:54.774922] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-09-16T17:34:55.574933] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-09-16T17:34:56.298326] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-09-16T17:34:56.305060] [INFO ] [REMOTE ] BROS: Full fetch complete (57952 records). [2025-09-16T17:34:56.305178] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-09-16T17:34:56.376231] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-07. [2025-09-16T17:34:56.716432] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-16T17:34:56.746218] [DEBUG] [VALIDATOR ] BROS: All expected trading days are present. [2025-09-16T17:34:56.746623] [DEBUG] [VALIDATOR ] BROS: Primary data validation passed. [2025-09-16T17:34:56.747374] [INFO ] [MAIN ] BROS: Fetched primary data is valid. [2025-09-16T17:34:56.747422] [DEBUG] [LOCAL ] BROS: Saving primary data. [2025-09-16T17:34:56.748697] [DEBUG] [LOCAL ] BROS: Trimmed 57952 records to 39721 (keeping 150 days of data) [2025-09-16T17:34:56.861148] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-16T17:34:56.868302] [INFO ] [REMOTE ] BRCC: Full fetch complete (43073 records). [2025-09-16T17:34:56.868928] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-09-16T17:34:56.870156] [FATAL] [VALIDATOR ] BRCC: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:34:56.871062] [FATAL] [MAIN ] BRCC: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:34:56.871621] [WARN ] [MAIN ] BRCC: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:34:56.872465] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-09-16T17:34:56.873054] [DEBUG] [LOCAL ] BRCC: No primary data file found to delete. [2025-09-16T17:34:56.873586] [INFO ] [LOCAL ] BRCC: Starting deletion of derivative data. [2025-09-16T17:34:56.875001] [DEBUG] [LOCAL ] BRCC: Deleted derivative data file. [2025-09-16T17:34:56.875376] [INFO ] [MAIN ] Update Progress: 334/2369 symbols completed. BRCC took 33.2s. Estimated remaining: 3h 32m 37s. Rate: 9.6 symbols/min [2025-09-16T17:34:57.083031] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:34:57.083910] [DEBUG] [LOCAL ] BRT: No existing data file found in primary storage. [2025-09-16T17:34:57.084511] [WARN ] [MAIN ] BRT: No existing data found, performing full refresh instead. [2025-09-16T17:34:57.085894] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-09-16T17:34:57.086489] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-09-16T17:34:57.087553] [DEBUG] [LOCAL ] BRT: No primary data file found to delete. [2025-09-16T17:34:57.088934] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-09-16T17:34:57.228070] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-09-16T17:34:57.566755] [INFO ] [REMOTE ] BRT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:34:57.587840] [DEBUG] [LOCAL ] BROS: Primary data saved (39721 records). [2025-09-16T17:34:57.588010] [INFO ] [MAIN ] BROS: Full history saved. [2025-09-16T17:34:57.588094] [INFO ] [MAIN ] Update Progress: 335/2369 symbols completed. BROS took 30.8s. Estimated remaining: 3h 31m 57s. Rate: 9.6 symbols/min [2025-09-16T17:34:57.760795] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:34:57.775217] [DEBUG] [LOCAL ] BRW: Loaded 14142 existing records from primary storage. [2025-09-16T17:34:57.775334] [INFO ] [MAIN ] BRW: Loaded 14142 existing records. [2025-09-16T17:34:57.955162] [WARN ] [MAIN ] BRW: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:34:57.955444] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-09-16T17:34:57.955501] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-09-16T17:34:57.955927] [DEBUG] [LOCAL ] BRW: Deleted primary data file. [2025-09-16T17:34:57.955976] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-09-16T17:34:57.986973] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-09-16T17:34:58.310222] [INFO ] [REMOTE ] BRW: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:34:58.349555] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-16T17:34:58.386672] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-16T17:34:58.719437] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-16T17:34:58.774881] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-09-16T17:34:59.574900] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-09-16T17:34:59.846589] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-16T17:35:00.287876] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-16T17:35:00.374879] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-08. [2025-09-16T17:35:01.174928] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-09-16T17:35:01.974900] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-09-16T17:35:02.389886] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-16T17:35:02.496375] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-16T17:35:02.564084] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-16T17:35:02.774920] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-09. [2025-09-16T17:35:03.574898] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-09-16T17:35:04.299610] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-16T17:35:04.305441] [INFO ] [REMOTE ] BRSL: Full fetch complete (19399 records). [2025-09-16T17:35:04.305542] [DEBUG] [VALIDATOR ] BRSL: Validating primary data. [2025-09-16T17:35:04.384111] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-09-16T17:35:04.497964] [WARN ] [VALIDATOR ] BRSL: Validation failed - insufficient historical data. Have 53 unique days, need 150 days [2025-09-16T17:35:04.498302] [FATAL] [MAIN ] BRSL: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:35:04.498368] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:35:04.498424] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-16T17:35:04.498485] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-09-16T17:35:04.498520] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-09-16T17:35:04.498560] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-09-16T17:35:04.498630] [INFO ] [MAIN ] Update Progress: 336/2369 symbols completed. BRSL took 22.6s. Estimated remaining: 3h 31m 55s. Rate: 9.6 symbols/min [2025-09-16T17:35:04.683287] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:35:04.703482] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-16T17:35:04.752444] [DEBUG] [LOCAL ] BRX: Loaded 38344 existing records from primary storage. [2025-09-16T17:35:04.752598] [INFO ] [MAIN ] BRX: Loaded 38344 existing records. [2025-09-16T17:35:04.928497] [WARN ] [MAIN ] BRX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:35:04.928795] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-09-16T17:35:04.928843] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-09-16T17:35:04.929804] [DEBUG] [LOCAL ] BRX: Deleted primary data file. [2025-09-16T17:35:04.929855] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-09-16T17:35:05.180431] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-16T17:35:05.180535] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-09-16T17:35:05.300478] [INFO ] [REMOTE ] BRX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:35:05.974909] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-09-16T17:35:06.129101] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-16T17:35:06.359903] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-16T17:35:06.774894] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-09-16T17:35:07.479759] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-16T17:35:07.574919] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-09-16T17:35:08.374910] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-09-16T17:35:08.737032] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-16T17:35:09.174948] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-09-16T17:35:09.960702] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-16T17:35:09.974869] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-09-16T17:35:10.487083] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-16T17:35:10.774928] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-09-16T17:35:11.486210] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-16T17:35:11.574927] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-09-16T17:35:11.720308] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-16T17:35:11.723385] [INFO ] [REMOTE ] BRW: Full fetch complete (20416 records). [2025-09-16T17:35:11.723477] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-09-16T17:35:12.088630] [DEBUG] [VALIDATOR ] BRW: All expected trading days are present. [2025-09-16T17:35:12.088837] [DEBUG] [VALIDATOR ] BRW: Primary data validation passed. [2025-09-16T17:35:12.089164] [INFO ] [MAIN ] BRW: Fetched primary data is valid. [2025-09-16T17:35:12.089223] [DEBUG] [LOCAL ] BRW: Saving primary data. [2025-09-16T17:35:12.089887] [DEBUG] [LOCAL ] BRW: Trimmed 20416 records to 14443 (keeping 150 days of data) [2025-09-16T17:35:12.178750] [DEBUG] [LOCAL ] BRW: Primary data saved (14443 records). [2025-09-16T17:35:12.178885] [INFO ] [MAIN ] BRW: Full history saved. [2025-09-16T17:35:12.179057] [INFO ] [MAIN ] Update Progress: 337/2369 symbols completed. BRW took 14.6s. Estimated remaining: 3h 31m 57s. Rate: 9.6 symbols/min [2025-09-16T17:35:12.347084] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:35:12.352350] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-16T17:35:12.374193] [DEBUG] [LOCAL ] BSAC: Loaded 24120 existing records from primary storage. [2025-09-16T17:35:12.374313] [INFO ] [MAIN ] BSAC: Loaded 24120 existing records. [2025-09-16T17:35:12.385033] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-09-16T17:35:12.550410] [WARN ] [MAIN ] BSAC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:35:12.550664] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-09-16T17:35:12.550735] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-09-16T17:35:12.551423] [DEBUG] [LOCAL ] BSAC: Deleted primary data file. [2025-09-16T17:35:12.551483] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-09-16T17:35:12.904285] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:35:13.174884] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-09-16T17:35:13.707030] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-16T17:35:13.974892] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-09-16T17:35:14.141281] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-16T17:35:14.476113] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-16T17:35:14.477230] [INFO ] [REMOTE ] BRT: Full fetch complete (4986 records). [2025-09-16T17:35:14.477298] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-09-16T17:35:14.780001] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-09-16T17:35:14.851045] [DEBUG] [VALIDATOR ] BRT: All expected trading days are present. [2025-09-16T17:35:14.851120] [DEBUG] [VALIDATOR ] BRT: Primary data validation passed. [2025-09-16T17:35:14.851279] [INFO ] [MAIN ] BRT: Fetched primary data is valid. [2025-09-16T17:35:14.851319] [DEBUG] [LOCAL ] BRT: Saving primary data. [2025-09-16T17:35:14.851714] [DEBUG] [LOCAL ] BRT: Trimmed 4986 records to 3507 (keeping 150 days of data) [2025-09-16T17:35:14.873198] [DEBUG] [LOCAL ] BRT: Primary data saved (3507 records). [2025-09-16T17:35:14.873277] [INFO ] [MAIN ] BRT: Full history saved. [2025-09-16T17:35:14.873352] [INFO ] [MAIN ] Update Progress: 338/2369 symbols completed. BRT took 18.0s. Estimated remaining: 3h 31m 29s. Rate: 9.6 symbols/min [2025-09-16T17:35:15.044874] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:35:15.073978] [DEBUG] [LOCAL ] BSBR: Loaded 26500 existing records from primary storage. [2025-09-16T17:35:15.074135] [INFO ] [MAIN ] BSBR: Loaded 26500 existing records. [2025-09-16T17:35:15.249408] [WARN ] [MAIN ] BSBR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:35:15.249690] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-09-16T17:35:15.249754] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-09-16T17:35:15.250419] [DEBUG] [LOCAL ] BSBR: Deleted primary data file. [2025-09-16T17:35:15.250478] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-09-16T17:35:15.580208] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-09-16T17:35:15.608630] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:35:16.277409] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-16T17:35:16.374846] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-09-16T17:35:16.598930] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-16T17:35:17.174952] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-09-16T17:35:17.853862] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-16T17:35:17.974897] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-09-16T17:35:18.634157] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-16T17:35:18.774903] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-09-16T17:35:18.978725] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-16T17:35:19.574946] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-09-16T17:35:19.671453] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-16T17:35:20.374905] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-09-16T17:35:21.174954] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-09-16T17:35:21.330901] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-16T17:35:21.780974] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-16T17:35:21.786926] [INFO ] [REMOTE ] BRSP: Full fetch complete (40528 records). [2025-09-16T17:35:21.787123] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-09-16T17:35:21.981081] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-09-16T17:35:22.212968] [DEBUG] [VALIDATOR ] BRSP: All expected trading days are present. [2025-09-16T17:35:22.213184] [DEBUG] [VALIDATOR ] BRSP: Primary data validation passed. [2025-09-16T17:35:22.213869] [INFO ] [MAIN ] BRSP: Fetched primary data is valid. [2025-09-16T17:35:22.213928] [DEBUG] [LOCAL ] BRSP: Saving primary data. [2025-09-16T17:35:22.215594] [DEBUG] [LOCAL ] BRSP: Trimmed 40528 records to 26482 (keeping 150 days of data) [2025-09-16T17:35:22.355967] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-16T17:35:22.430027] [DEBUG] [LOCAL ] BRSP: Primary data saved (26482 records). [2025-09-16T17:35:22.430173] [INFO ] [MAIN ] BRSP: Full history saved. [2025-09-16T17:35:22.430262] [INFO ] [MAIN ] Update Progress: 339/2369 symbols completed. BRSP took 36.3s. Estimated remaining: 3h 31m 31s. Rate: 9.6 symbols/min [2025-09-16T17:35:22.614022] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:35:22.621082] [DEBUG] [LOCAL ] BSL: Loaded 5094 existing records from primary storage. [2025-09-16T17:35:22.621182] [INFO ] [MAIN ] BSL: Loaded 5094 existing records. [2025-09-16T17:35:22.778367] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-09-16T17:35:22.801536] [WARN ] [MAIN ] BSL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:35:22.801913] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-09-16T17:35:22.801972] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-09-16T17:35:22.802470] [DEBUG] [LOCAL ] BSL: Deleted primary data file. [2025-09-16T17:35:22.802517] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-09-16T17:35:23.152137] [INFO ] [REMOTE ] BSL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:35:23.574951] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-09-16T17:35:23.848399] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-16T17:35:24.374904] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-09-16T17:35:24.551541] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-16T17:35:24.981536] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (3.00 seconds). [2025-09-16T17:35:25.174917] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-09-16T17:35:25.974992] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-09-16T17:35:26.525693] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-16T17:35:26.602400] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-16T17:35:26.774943] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-09-16T17:35:27.580528] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-09-16T17:35:27.583036] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (3.21 seconds). [2025-09-16T17:35:28.286884] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-16T17:35:28.374928] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-09-16T17:35:28.922508] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-16T17:35:29.174922] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-09-16T17:35:29.340224] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-16T17:35:29.974944] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-09-16T17:35:30.616963] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-16T17:35:30.622636] [INFO ] [REMOTE ] BRX: Full fetch complete (56068 records). [2025-09-16T17:35:30.622769] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-09-16T17:35:30.624970] [FATAL] [VALIDATOR ] BRX: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:35:30.625054] [FATAL] [MAIN ] BRX: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:35:30.625094] [WARN ] [MAIN ] BRX: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:35:30.625134] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-09-16T17:35:30.625204] [DEBUG] [LOCAL ] BRX: No primary data file found to delete. [2025-09-16T17:35:30.625243] [INFO ] [LOCAL ] BRX: Starting deletion of derivative data. [2025-09-16T17:35:30.625502] [DEBUG] [LOCAL ] BRX: Deleted derivative data file. [2025-09-16T17:35:30.627927] [INFO ] [MAIN ] Update Progress: 340/2369 symbols completed. BRX took 26.1s. Estimated remaining: 3h 31m 36s. Rate: 9.6 symbols/min [2025-09-16T17:35:30.779963] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-09-16T17:35:30.803965] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:35:30.846209] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-16T17:35:30.861796] [DEBUG] [LOCAL ] BSM: Loaded 23991 existing records from primary storage. [2025-09-16T17:35:30.862257] [INFO ] [MAIN ] BSM: Loaded 23991 existing records. [2025-09-16T17:35:31.038148] [WARN ] [MAIN ] BSM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:35:31.038381] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-09-16T17:35:31.038427] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-09-16T17:35:31.039137] [DEBUG] [LOCAL ] BSM: Deleted primary data file. [2025-09-16T17:35:31.039187] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-09-16T17:35:31.387689] [INFO ] [REMOTE ] BSM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:35:31.574908] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-09-16T17:35:31.713777] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-16T17:35:32.374894] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-09-16T17:35:32.459484] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-16T17:35:33.174904] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-09-16T17:35:33.366153] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-16T17:35:33.974913] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-09-16T17:35:34.310377] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-16T17:35:34.315170] [INFO ] [REMOTE ] BSAC: Full fetch complete (35579 records). [2025-09-16T17:35:34.315309] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-09-16T17:35:34.709129] [DEBUG] [VALIDATOR ] BSAC: All expected trading days are present. [2025-09-16T17:35:34.709265] [DEBUG] [VALIDATOR ] BSAC: Primary data validation passed. [2025-09-16T17:35:34.709804] [INFO ] [MAIN ] BSAC: Fetched primary data is valid. [2025-09-16T17:35:34.709853] [DEBUG] [LOCAL ] BSAC: Saving primary data. [2025-09-16T17:35:34.710941] [DEBUG] [LOCAL ] BSAC: Trimmed 35579 records to 24383 (keeping 150 days of data) [2025-09-16T17:35:34.799431] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-09-16T17:35:34.858861] [DEBUG] [LOCAL ] BSAC: Primary data saved (24383 records). [2025-09-16T17:35:34.858979] [INFO ] [MAIN ] BSAC: Full history saved. [2025-09-16T17:35:34.859061] [INFO ] [MAIN ] Update Progress: 341/2369 symbols completed. BSAC took 22.7s. Estimated remaining: 3h 31m 18s. Rate: 9.6 symbols/min [2025-09-16T17:35:35.030982] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:35:35.031266] [DEBUG] [LOCAL ] BST: No existing data file found in primary storage. [2025-09-16T17:35:35.031364] [WARN ] [MAIN ] BST: No existing data found, performing full refresh instead. [2025-09-16T17:35:35.031763] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-09-16T17:35:35.031834] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-09-16T17:35:35.031905] [DEBUG] [LOCAL ] BST: No primary data file found to delete. [2025-09-16T17:35:35.032089] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-09-16T17:35:35.160606] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-16T17:35:35.417824] [INFO ] [REMOTE ] BST: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:35:35.574900] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-09-16T17:35:35.601679] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-16T17:35:36.374861] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-09-16T17:35:36.405015] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-16T17:35:37.174909] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-09-16T17:35:37.240013] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-16T17:35:37.974879] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-09-16T17:35:37.993826] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-16T17:35:38.386053] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-16T17:35:38.774906] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-09-16T17:35:39.169316] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-16T17:35:39.574923] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-09-16T17:35:40.141952] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-16T17:35:40.374914] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-09-16T17:35:40.856994] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-16T17:35:41.174934] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-09-16T17:35:41.974869] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-09-16T17:35:42.072194] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-16T17:35:42.774907] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-09-16T17:35:43.221345] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-16T17:35:43.491844] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-16T17:35:43.493256] [INFO ] [REMOTE ] BSL: Full fetch complete (9481 records). [2025-09-16T17:35:43.493324] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-09-16T17:35:43.580017] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-09-16T17:35:43.858858] [DEBUG] [VALIDATOR ] BSL: All expected trading days are present. [2025-09-16T17:35:43.858939] [DEBUG] [VALIDATOR ] BSL: Primary data validation passed. [2025-09-16T17:35:43.859185] [INFO ] [MAIN ] BSL: Fetched primary data is valid. [2025-09-16T17:35:43.859226] [DEBUG] [LOCAL ] BSL: Saving primary data. [2025-09-16T17:35:43.859683] [DEBUG] [LOCAL ] BSL: Trimmed 9481 records to 5178 (keeping 150 days of data) [2025-09-16T17:35:43.891655] [DEBUG] [LOCAL ] BSL: Primary data saved (5178 records). [2025-09-16T17:35:43.891781] [INFO ] [MAIN ] BSL: Full history saved. [2025-09-16T17:35:43.891891] [INFO ] [MAIN ] Update Progress: 342/2369 symbols completed. BSL took 21.5s. Estimated remaining: 3h 31m 28s. Rate: 9.6 symbols/min [2025-09-16T17:35:44.106920] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:35:44.124978] [DEBUG] [LOCAL ] BSTZ: Loaded 18005 existing records from primary storage. [2025-09-16T17:35:44.125103] [INFO ] [MAIN ] BSTZ: Loaded 18005 existing records. [2025-09-16T17:35:44.307018] [WARN ] [MAIN ] BSTZ: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:35:44.307286] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-09-16T17:35:44.307464] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-09-16T17:35:44.313106] [DEBUG] [LOCAL ] BSTZ: Deleted primary data file. [2025-09-16T17:35:44.317989] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-09-16T17:35:44.377084] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-09-16T17:35:44.392061] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-16T17:35:44.696380] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:35:45.174954] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-09-16T17:35:45.542551] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-16T17:35:45.974907] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-09-16T17:35:46.265789] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-16T17:35:46.774899] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-09-16T17:35:47.349130] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-16T17:35:47.574913] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-09-16T17:35:47.604609] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-16T17:35:48.374955] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-09-16T17:35:48.673999] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-16T17:35:48.679350] [INFO ] [REMOTE ] BSBR: Full fetch complete (38184 records). [2025-09-16T17:35:48.679482] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-09-16T17:35:49.056433] [DEBUG] [VALIDATOR ] BSBR: All expected trading days are present. [2025-09-16T17:35:49.056582] [DEBUG] [VALIDATOR ] BSBR: Primary data validation passed. [2025-09-16T17:35:49.057055] [INFO ] [MAIN ] BSBR: Fetched primary data is valid. [2025-09-16T17:35:49.057110] [DEBUG] [LOCAL ] BSBR: Saving primary data. [2025-09-16T17:35:49.058312] [DEBUG] [LOCAL ] BSBR: Trimmed 38184 records to 26737 (keeping 150 days of data) [2025-09-16T17:35:49.133389] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-16T17:35:49.175066] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-09-16T17:35:49.236602] [DEBUG] [LOCAL ] BSBR: Primary data saved (26737 records). [2025-09-16T17:35:49.236766] [INFO ] [MAIN ] BSBR: Full history saved. [2025-09-16T17:35:49.236886] [INFO ] [MAIN ] Update Progress: 343/2369 symbols completed. BSBR took 34.4s. Estimated remaining: 3h 31m 17s. Rate: 9.6 symbols/min [2025-09-16T17:35:49.409524] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:35:49.449400] [DEBUG] [LOCAL ] BSX: Loaded 39648 existing records from primary storage. [2025-09-16T17:35:49.449541] [INFO ] [MAIN ] BSX: Loaded 39648 existing records. [2025-09-16T17:35:49.625490] [WARN ] [MAIN ] BSX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:35:49.625747] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-09-16T17:35:49.625803] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-09-16T17:35:49.626930] [DEBUG] [LOCAL ] BSX: Deleted primary data file. [2025-09-16T17:35:49.626981] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-09-16T17:35:49.978886] [INFO ] [REMOTE ] BSX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:35:49.978987] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-09-16T17:35:50.069682] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-16T17:35:50.774909] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-09-16T17:35:50.899172] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-16T17:35:51.574900] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-09-16T17:35:52.374870] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-09-16T17:35:52.493624] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-16T17:35:52.916607] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-09-16T17:35:53.174915] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-09-16T17:35:53.262245] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-16T17:35:53.974912] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-09-16T17:35:54.039825] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-16T17:35:54.774915] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-09-16T17:35:55.143885] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-16T17:35:55.146910] [INFO ] [REMOTE ] BST: Full fetch complete (21237 records). [2025-09-16T17:35:55.146999] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-09-16T17:35:55.517735] [DEBUG] [VALIDATOR ] BST: All expected trading days are present. [2025-09-16T17:35:55.517834] [DEBUG] [VALIDATOR ] BST: Primary data validation passed. [2025-09-16T17:35:55.518341] [INFO ] [MAIN ] BST: Fetched primary data is valid. [2025-09-16T17:35:55.518417] [DEBUG] [LOCAL ] BST: Saving primary data. [2025-09-16T17:35:55.519445] [DEBUG] [LOCAL ] BST: Trimmed 21237 records to 13342 (keeping 150 days of data) [2025-09-16T17:35:55.580245] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-09-16T17:35:55.604880] [DEBUG] [LOCAL ] BST: Primary data saved (13342 records). [2025-09-16T17:35:55.605030] [INFO ] [MAIN ] BST: Full history saved. [2025-09-16T17:35:55.605115] [INFO ] [MAIN ] Update Progress: 344/2369 symbols completed. BST took 20.7s. Estimated remaining: 3h 31m 11s. Rate: 9.6 symbols/min [2025-09-16T17:35:55.775402] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:35:55.780662] [DEBUG] [LOCAL ] BTA: Loaded 4014 existing records from primary storage. [2025-09-16T17:35:55.780748] [INFO ] [MAIN ] BTA: Loaded 4014 existing records. [2025-09-16T17:35:55.957079] [WARN ] [MAIN ] BTA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:35:55.957363] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-09-16T17:35:55.957411] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-09-16T17:35:55.957613] [DEBUG] [LOCAL ] BTA: Deleted primary data file. [2025-09-16T17:35:55.957685] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-09-16T17:35:56.314855] [INFO ] [REMOTE ] BTA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:35:56.374851] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-09-16T17:35:56.468388] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-16T17:35:56.992692] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-16T17:35:57.174907] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-09-16T17:35:57.627713] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-16T17:35:57.974909] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-09-16T17:35:58.030764] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-16T17:35:58.774913] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-09-16T17:35:59.004451] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-16T17:35:59.371740] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-16T17:35:59.574930] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-09-16T17:35:59.981628] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-16T17:36:00.374895] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-09-16T17:36:01.174907] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-09-16T17:36:01.223704] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-16T17:36:01.974893] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-09-16T17:36:02.466291] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-16T17:36:02.491244] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-16T17:36:02.774897] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-09-16T17:36:03.297632] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-16T17:36:03.574900] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-09-16T17:36:04.374901] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-09-16T17:36:04.954272] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-16T17:36:05.174918] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-09-16T17:36:05.511009] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-16T17:36:05.974911] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-09-16T17:36:06.120361] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-16T17:36:06.123316] [INFO ] [REMOTE ] BSTZ: Full fetch complete (26915 records). [2025-09-16T17:36:06.123387] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-09-16T17:36:06.123924] [FATAL] [VALIDATOR ] BSTZ: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:36:06.124012] [FATAL] [MAIN ] BSTZ: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:36:06.124076] [WARN ] [MAIN ] BSTZ: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:36:06.124134] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-09-16T17:36:06.124206] [DEBUG] [LOCAL ] BSTZ: No primary data file found to delete. [2025-09-16T17:36:06.124310] [INFO ] [LOCAL ] BSTZ: Starting deletion of derivative data. [2025-09-16T17:36:06.124592] [DEBUG] [LOCAL ] BSTZ: Deleted derivative data file. [2025-09-16T17:36:06.124688] [INFO ] [MAIN ] Update Progress: 345/2369 symbols completed. BSTZ took 22.2s. Estimated remaining: 3h 31m 30s. Rate: 9.6 symbols/min [2025-09-16T17:36:06.299413] [INFO ] [MAIN ] BTCM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:36:06.312560] [DEBUG] [LOCAL ] BTCM: Loaded 12784 existing records from primary storage. [2025-09-16T17:36:06.312699] [INFO ] [MAIN ] BTCM: Loaded 12784 existing records. [2025-09-16T17:36:06.499378] [WARN ] [MAIN ] BTCM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:36:06.503486] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-16T17:36:06.505075] [INFO ] [MAIN ] BTCM: Wiping existing primary data before full refresh. [2025-09-16T17:36:06.505195] [INFO ] [REMOTE ] BTA: Full fetch complete (5875 records). [2025-09-16T17:36:06.505294] [INFO ] [LOCAL ] BTCM: Starting deletion of primary data. [2025-09-16T17:36:06.505362] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-09-16T17:36:06.505911] [FATAL] [VALIDATOR ] BTA: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:36:06.506020] [FATAL] [MAIN ] BTA: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:36:06.506083] [WARN ] [MAIN ] BTA: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:36:06.506143] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-09-16T17:36:06.506220] [DEBUG] [LOCAL ] BTA: No primary data file found to delete. [2025-09-16T17:36:06.506282] [INFO ] [LOCAL ] BTA: Starting deletion of derivative data. [2025-09-16T17:36:06.506438] [DEBUG] [LOCAL ] BTCM: Deleted primary data file. [2025-09-16T17:36:06.506507] [INFO ] [MAIN ] BTCM: Starting full primary refresh. [2025-09-16T17:36:06.506551] [DEBUG] [LOCAL ] BTA: Deleted derivative data file. [2025-09-16T17:36:06.576439] [INFO ] [MAIN ] Update Progress: 346/2369 symbols completed. BTA took 11.0s. Estimated remaining: 3h 30m 50s. Rate: 9.6 symbols/min [2025-09-16T17:36:06.778903] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-09-16T17:36:06.991534] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:36:07.098129] [INFO ] [REMOTE ] BTCM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:36:07.127044] [DEBUG] [LOCAL ] BTE: Loaded 38887 existing records from primary storage. [2025-09-16T17:36:07.127193] [INFO ] [MAIN ] BTE: Loaded 38887 existing records. [2025-09-16T17:36:07.320956] [WARN ] [MAIN ] BTE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:36:07.321351] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-09-16T17:36:07.321402] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-09-16T17:36:07.322304] [DEBUG] [LOCAL ] BTE: Deleted primary data file. [2025-09-16T17:36:07.322355] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-09-16T17:36:07.580197] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-02. [2025-09-16T17:36:07.685509] [INFO ] [REMOTE ] BTE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:36:08.374869] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-09-16T17:36:08.535659] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-16T17:36:08.749221] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-16T17:36:09.174914] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-09-16T17:36:09.974917] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-03. [2025-09-16T17:36:10.196669] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-16T17:36:10.630874] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-16T17:36:10.774922] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-09-16T17:36:10.815683] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-16T17:36:11.574948] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-09-16T17:36:12.171065] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-16T17:36:12.374911] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-04. [2025-09-16T17:36:12.974437] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-16T17:36:13.174906] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-09-16T17:36:13.427864] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-16T17:36:13.974918] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-05. [2025-09-16T17:36:14.556341] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-16T17:36:14.691099] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-16T17:36:14.774914] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-09-16T17:36:15.574920] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-06. [2025-09-16T17:36:15.979174] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-16T17:36:16.374923] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-09-16T17:36:16.687852] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-16T17:36:17.174921] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-09-16T17:36:17.974916] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-07. [2025-09-16T17:36:18.185254] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-16T17:36:18.382606] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-16T17:36:18.387150] [INFO ] [REMOTE ] BSM: Full fetch complete (35939 records). [2025-09-16T17:36:18.387232] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-09-16T17:36:18.767782] [DEBUG] [VALIDATOR ] BSM: All expected trading days are present. [2025-09-16T17:36:18.767868] [DEBUG] [VALIDATOR ] BSM: Primary data validation passed. [2025-09-16T17:36:18.768356] [INFO ] [MAIN ] BSM: Fetched primary data is valid. [2025-09-16T17:36:18.768399] [DEBUG] [LOCAL ] BSM: Saving primary data. [2025-09-16T17:36:18.769245] [DEBUG] [LOCAL ] BSM: Trimmed 35939 records to 24221 (keeping 150 days of data) [2025-09-16T17:36:18.825019] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-09-16T17:36:18.919822] [DEBUG] [LOCAL ] BSM: Primary data saved (24221 records). [2025-09-16T17:36:18.919975] [INFO ] [MAIN ] BSM: Full history saved. [2025-09-16T17:36:18.920064] [INFO ] [MAIN ] Update Progress: 347/2369 symbols completed. BSM took 48.3s. Estimated remaining: 3h 31m 19s. Rate: 9.6 symbols/min [2025-09-16T17:36:19.090385] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:36:19.131011] [DEBUG] [LOCAL ] BTI: Loaded 39570 existing records from primary storage. [2025-09-16T17:36:19.131152] [INFO ] [MAIN ] BTI: Loaded 39570 existing records. [2025-09-16T17:36:19.309309] [WARN ] [MAIN ] BTI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:36:19.309546] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-09-16T17:36:19.309613] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-09-16T17:36:19.310691] [DEBUG] [LOCAL ] BTI: Deleted primary data file. [2025-09-16T17:36:19.310743] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-09-16T17:36:19.589222] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-09-16T17:36:19.678604] [INFO ] [REMOTE ] BTI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:36:19.885592] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-16T17:36:20.374869] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-08. [2025-09-16T17:36:20.927071] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-16T17:36:21.174933] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-09-16T17:36:21.621135] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-16T17:36:21.784904] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-16T17:36:21.974903] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-09. [2025-09-16T17:36:22.774904] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-09-16T17:36:22.945240] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-16T17:36:23.273244] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-16T17:36:23.276343] [INFO ] [REMOTE ] BTCM: Full fetch complete (14683 records). [2025-09-16T17:36:23.276434] [DEBUG] [VALIDATOR ] BTCM: Validating primary data. [2025-09-16T17:36:23.580000] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-09-16T17:36:23.647042] [DEBUG] [VALIDATOR ] BTCM: All expected trading days are present. [2025-09-16T17:36:23.647120] [DEBUG] [VALIDATOR ] BTCM: Primary data validation passed. [2025-09-16T17:36:23.647422] [INFO ] [MAIN ] BTCM: Fetched primary data is valid. [2025-09-16T17:36:23.647462] [DEBUG] [LOCAL ] BTCM: Saving primary data. [2025-09-16T17:36:23.648046] [DEBUG] [LOCAL ] BTCM: Trimmed 14683 records to 12997 (keeping 150 days of data) [2025-09-16T17:36:23.721172] [DEBUG] [LOCAL ] BTCM: Primary data saved (12997 records). [2025-09-16T17:36:23.721313] [INFO ] [MAIN ] BTCM: Full history saved. [2025-09-16T17:36:23.721399] [INFO ] [MAIN ] Update Progress: 348/2369 symbols completed. BTCM took 17.6s. Estimated remaining: 3h 31m 4s. Rate: 9.6 symbols/min [2025-09-16T17:36:23.892161] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:36:23.899566] [DEBUG] [LOCAL ] BTO: Loaded 6142 existing records from primary storage. [2025-09-16T17:36:23.899680] [INFO ] [MAIN ] BTO: Loaded 6142 existing records. [2025-09-16T17:36:24.076796] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:36:24.077046] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-09-16T17:36:24.077090] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-09-16T17:36:24.077445] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-09-16T17:36:24.077495] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-09-16T17:36:24.380020] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-09-16T17:36:24.434024] [INFO ] [REMOTE ] BTO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:36:24.913597] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-16T17:36:24.921820] [INFO ] [REMOTE ] BSX: Full fetch complete (58365 records). [2025-09-16T17:36:24.922019] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-09-16T17:36:25.189835] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-09-16T17:36:25.337665] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present. [2025-09-16T17:36:25.337761] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed. [2025-09-16T17:36:25.338533] [INFO ] [MAIN ] BSX: Fetched primary data is valid. [2025-09-16T17:36:25.338591] [DEBUG] [LOCAL ] BSX: Saving primary data. [2025-09-16T17:36:25.339967] [DEBUG] [LOCAL ] BSX: Trimmed 58365 records to 40038 (keeping 150 days of data) [2025-09-16T17:36:25.604082] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-16T17:36:25.634448] [DEBUG] [LOCAL ] BSX: Primary data saved (40038 records). [2025-09-16T17:36:25.634579] [INFO ] [MAIN ] BSX: Full history saved. [2025-09-16T17:36:25.634689] [INFO ] [MAIN ] Update Progress: 349/2369 symbols completed. BSX took 36.4s. Estimated remaining: 3h 30m 33s. Rate: 9.6 symbols/min [2025-09-16T17:36:25.810904] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:36:25.811075] [DEBUG] [LOCAL ] BTT: No existing data file found in primary storage. [2025-09-16T17:36:25.811114] [WARN ] [MAIN ] BTT: No existing data found, performing full refresh instead. [2025-09-16T17:36:25.811249] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-09-16T17:36:25.811303] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-09-16T17:36:25.811359] [DEBUG] [LOCAL ] BTT: No primary data file found to delete. [2025-09-16T17:36:25.811405] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-09-16T17:36:25.986739] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-09-16T17:36:26.068736] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-16T17:36:26.184464] [INFO ] [REMOTE ] BTT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:36:26.218259] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-16T17:36:26.774907] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-09-16T17:36:27.574965] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-09-16T17:36:28.105265] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-16T17:36:28.156555] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-16T17:36:28.255850] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-16T17:36:28.374926] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-09-16T17:36:29.174929] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-09-16T17:36:29.974947] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-09-16T17:36:30.085252] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-16T17:36:30.131038] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-16T17:36:30.774911] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-09-16T17:36:31.574889] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-09-16T17:36:31.767917] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-16T17:36:32.121420] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-16T17:36:32.127209] [INFO ] [REMOTE ] BTE: Full fetch complete (56910 records). [2025-09-16T17:36:32.127320] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-09-16T17:36:32.127961] [FATAL] [VALIDATOR ] BTE: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:36:32.128041] [FATAL] [MAIN ] BTE: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:36:32.128080] [WARN ] [MAIN ] BTE: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:36:32.128156] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-09-16T17:36:32.128216] [DEBUG] [LOCAL ] BTE: No primary data file found to delete. [2025-09-16T17:36:32.128253] [INFO ] [LOCAL ] BTE: Starting deletion of derivative data. [2025-09-16T17:36:32.128616] [DEBUG] [LOCAL ] BTE: Deleted derivative data file. [2025-09-16T17:36:32.128723] [INFO ] [MAIN ] Update Progress: 350/2369 symbols completed. BTE took 25.5s. Estimated remaining: 3h 30m 28s. Rate: 9.6 symbols/min [2025-09-16T17:36:32.310002] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:36:32.311036] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-16T17:36:32.356324] [DEBUG] [LOCAL ] BTU: Loaded 39314 existing records from primary storage. [2025-09-16T17:36:32.356471] [INFO ] [MAIN ] BTU: Loaded 39314 existing records. [2025-09-16T17:36:32.380050] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-09-16T17:36:32.534416] [WARN ] [MAIN ] BTU: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:36:32.534670] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-09-16T17:36:32.534718] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-09-16T17:36:32.535614] [DEBUG] [LOCAL ] BTU: Deleted primary data file. [2025-09-16T17:36:32.535690] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-09-16T17:36:32.893024] [INFO ] [REMOTE ] BTU: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:36:33.174874] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-09-16T17:36:33.575187] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-16T17:36:33.974916] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-09-16T17:36:34.774921] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-09-16T17:36:34.905711] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-16T17:36:35.540993] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-16T17:36:35.574845] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-09-16T17:36:35.661829] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-16T17:36:36.374901] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-09-16T17:36:37.176936] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-09-16T17:36:37.180436] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-16T17:36:37.704306] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-16T17:36:37.974910] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-09-16T17:36:38.561352] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-16T17:36:38.774859] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-09-16T17:36:38.908843] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-16T17:36:39.509177] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-16T17:36:39.574909] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-09-16T17:36:40.374876] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-09-16T17:36:40.672221] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-16T17:36:41.174904] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-09-16T17:36:41.918417] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-16T17:36:41.942454] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-16T17:36:41.974918] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-09-16T17:36:42.774889] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-09-16T17:36:42.886253] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-16T17:36:43.574923] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-09-16T17:36:44.374971] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-09-16T17:36:44.933197] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-16T17:36:44.987169] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-16T17:36:45.174896] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-09-16T17:36:45.555190] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-16T17:36:45.562037] [INFO ] [REMOTE ] BTI: Full fetch complete (58222 records). [2025-09-16T17:36:45.562251] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-09-16T17:36:45.966626] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-09-16T17:36:45.966779] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-09-16T17:36:45.967772] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-09-16T17:36:45.967833] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-09-16T17:36:45.969807] [DEBUG] [LOCAL ] BTI: Trimmed 58222 records to 39958 (keeping 150 days of data) [2025-09-16T17:36:45.974939] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-09-16T17:36:46.235701] [DEBUG] [LOCAL ] BTI: Primary data saved (39958 records). [2025-09-16T17:36:46.235938] [INFO ] [MAIN ] BTI: Full history saved. [2025-09-16T17:36:46.237171] [INFO ] [MAIN ] Update Progress: 351/2369 symbols completed. BTI took 27.3s. Estimated remaining: 3h 31m 7s. Rate: 9.6 symbols/min [2025-09-16T17:36:46.416578] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:36:46.416819] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-09-16T17:36:46.416868] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-09-16T17:36:46.417000] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-09-16T17:36:46.417040] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-16T17:36:46.417081] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-09-16T17:36:46.417113] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-09-16T17:36:46.788673] [INFO ] [REMOTE ] BTX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:36:46.788736] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-09-16T17:36:46.791382] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-16T17:36:46.849737] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-16T17:36:47.574881] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-09-16T17:36:47.779087] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-16T17:36:47.780712] [INFO ] [REMOTE ] BTO: Full fetch complete (9820 records). [2025-09-16T17:36:47.780795] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-09-16T17:36:48.156187] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-09-16T17:36:48.156267] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-09-16T17:36:48.156511] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-09-16T17:36:48.156553] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-09-16T17:36:48.157034] [DEBUG] [LOCAL ] BTO: Trimmed 9820 records to 6236 (keeping 150 days of data) [2025-09-16T17:36:48.194297] [DEBUG] [LOCAL ] BTO: Primary data saved (6236 records). [2025-09-16T17:36:48.194382] [INFO ] [MAIN ] BTO: Full history saved. [2025-09-16T17:36:48.194477] [INFO ] [MAIN ] Update Progress: 352/2369 symbols completed. BTO took 24.5s. Estimated remaining: 3h 30m 36s. Rate: 9.6 symbols/min [2025-09-16T17:36:48.373952] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:36:48.374871] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-09-16T17:36:48.391766] [DEBUG] [LOCAL ] BTZ: Loaded 16047 existing records from primary storage. [2025-09-16T17:36:48.392265] [INFO ] [MAIN ] BTZ: Loaded 16047 existing records. [2025-09-16T17:36:48.572550] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:36:48.572833] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-09-16T17:36:48.572907] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-09-16T17:36:48.573471] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-09-16T17:36:48.573531] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-09-16T17:36:48.930972] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:36:49.174874] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-02. [2025-09-16T17:36:49.338965] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-16T17:36:49.373775] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-16T17:36:49.376249] [INFO ] [REMOTE ] BTT: Full fetch complete (17329 records). [2025-09-16T17:36:49.376319] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-09-16T17:36:49.733489] [DEBUG] [VALIDATOR ] BTT: All expected trading days are present. [2025-09-16T17:36:49.733561] [DEBUG] [VALIDATOR ] BTT: Primary data validation passed. [2025-09-16T17:36:49.733853] [INFO ] [MAIN ] BTT: Fetched primary data is valid. [2025-09-16T17:36:49.733897] [DEBUG] [LOCAL ] BTT: Saving primary data. [2025-09-16T17:36:49.734419] [DEBUG] [LOCAL ] BTT: Trimmed 17329 records to 11485 (keeping 150 days of data) [2025-09-16T17:36:49.808030] [DEBUG] [LOCAL ] BTT: Primary data saved (11485 records). [2025-09-16T17:36:49.808164] [INFO ] [MAIN ] BTT: Full history saved. [2025-09-16T17:36:49.808252] [INFO ] [MAIN ] Update Progress: 353/2369 symbols completed. BTT took 24.2s. Estimated remaining: 3h 30m 3s. Rate: 9.6 symbols/min [2025-09-16T17:36:49.976569] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:36:49.975337] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-09-16T17:36:50.013083] [DEBUG] [LOCAL ] BUD: Loaded 38809 existing records from primary storage. [2025-09-16T17:36:50.013225] [INFO ] [MAIN ] BUD: Loaded 38809 existing records. [2025-09-16T17:36:50.129370] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-16T17:36:50.200968] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:36:50.201154] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-09-16T17:36:50.201201] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-09-16T17:36:50.202013] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-09-16T17:36:50.202079] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-09-16T17:36:50.555243] [INFO ] [REMOTE ] BUD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:36:50.774846] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-09-16T17:36:51.056816] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-16T17:36:51.574861] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-09-16T17:36:52.374910] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-03. [2025-09-16T17:36:52.713603] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-16T17:36:53.174920] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-09-16T17:36:53.498152] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-16T17:36:53.859722] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-16T17:36:53.974888] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-04. [2025-09-16T17:36:54.774922] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-09-16T17:36:54.889861] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-16T17:36:54.921845] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-16T17:36:55.574903] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-05. [2025-09-16T17:36:56.374932] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-09-16T17:36:56.516841] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-16T17:36:56.674023] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-16T17:36:57.119240] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-16T17:36:57.174993] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-09-16T17:36:57.974905] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-09-16T17:36:58.354714] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-16T17:36:58.774902] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-09-16T17:36:59.447614] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-16T17:36:59.574903] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-09-16T17:36:59.803769] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-16T17:37:00.374886] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-09-16T17:37:01.174911] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-09-16T17:37:01.356758] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-16T17:37:01.363429] [INFO ] [REMOTE ] BTU: Full fetch complete (57932 records). [2025-09-16T17:37:01.363609] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-09-16T17:37:01.748015] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-16T17:37:01.766472] [DEBUG] [VALIDATOR ] BTU: All expected trading days are present. [2025-09-16T17:37:01.766598] [DEBUG] [VALIDATOR ] BTU: Primary data validation passed. [2025-09-16T17:37:01.771959] [INFO ] [MAIN ] BTU: Fetched primary data is valid. [2025-09-16T17:37:01.772137] [DEBUG] [LOCAL ] BTU: Saving primary data. [2025-09-16T17:37:01.773520] [DEBUG] [LOCAL ] BTU: Trimmed 57932 records to 39703 (keeping 150 days of data) [2025-09-16T17:37:01.991065] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-06. [2025-09-16T17:37:02.025509] [DEBUG] [LOCAL ] BTU: Primary data saved (39703 records). [2025-09-16T17:37:02.025679] [INFO ] [MAIN ] BTU: Full history saved. [2025-09-16T17:37:02.026880] [INFO ] [MAIN ] Update Progress: 354/2369 symbols completed. BTU took 29.9s. Estimated remaining: 3h 30m 30s. Rate: 9.6 symbols/min [2025-09-16T17:37:02.196739] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:37:02.208002] [DEBUG] [LOCAL ] BUI: Loaded 8539 existing records from primary storage. [2025-09-16T17:37:02.208132] [INFO ] [MAIN ] BUI: Loaded 8539 existing records. [2025-09-16T17:37:02.389589] [WARN ] [MAIN ] BUI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:37:02.389888] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-09-16T17:37:02.389975] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-09-16T17:37:02.390306] [DEBUG] [LOCAL ] BUI: Deleted primary data file. [2025-09-16T17:37:02.390356] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-09-16T17:37:02.759262] [INFO ] [REMOTE ] BUI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:37:02.774865] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-09-16T17:37:03.035782] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-16T17:37:03.189619] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-16T17:37:03.574919] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-07. [2025-09-16T17:37:03.664398] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-16T17:37:04.374893] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-09-16T17:37:04.700250] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-16T17:37:05.174894] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-08. [2025-09-16T17:37:05.974905] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-09-16T17:37:06.104579] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-16T17:37:06.165804] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-16T17:37:06.774925] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-09-16T17:37:06.797369] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-16T17:37:07.574909] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-09-16T17:37:08.374905] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-09. [2025-09-16T17:37:08.409536] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-16T17:37:08.531614] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-16T17:37:09.174900] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-09-16T17:37:09.737351] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-16T17:37:09.741052] [INFO ] [REMOTE ] BTX: Full fetch complete (34419 records). [2025-09-16T17:37:09.741159] [DEBUG] [VALIDATOR ] BTX: Validating primary data. [2025-09-16T17:37:09.932874] [WARN ] [VALIDATOR ] BTX: Validation failed - insufficient historical data. Have 144 unique days, need 150 days [2025-09-16T17:37:09.933363] [FATAL] [MAIN ] BTX: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:37:09.933416] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:37:09.933465] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-16T17:37:09.933533] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-09-16T17:37:09.933591] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-09-16T17:37:09.933632] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-09-16T17:37:09.933747] [INFO ] [MAIN ] Update Progress: 355/2369 symbols completed. BTX took 23.7s. Estimated remaining: 3h 30m 33s. Rate: 9.6 symbols/min [2025-09-16T17:37:09.979997] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-09-16T17:37:10.123128] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:37:10.131580] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-16T17:37:10.173268] [DEBUG] [LOCAL ] BUR: Loaded 33462 existing records from primary storage. [2025-09-16T17:37:10.173412] [INFO ] [MAIN ] BUR: Loaded 33462 existing records. [2025-09-16T17:37:10.360126] [WARN ] [MAIN ] BUR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:37:10.360413] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-09-16T17:37:10.360469] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-09-16T17:37:10.361222] [DEBUG] [LOCAL ] BUR: Deleted primary data file. [2025-09-16T17:37:10.361272] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-09-16T17:37:10.715089] [INFO ] [REMOTE ] BUR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:37:10.774930] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-09-16T17:37:11.532824] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-16T17:37:11.574867] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-09-16T17:37:11.835796] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-16T17:37:12.083626] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-16T17:37:12.374887] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-09-16T17:37:13.073906] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-16T17:37:13.174911] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-09-16T17:37:13.974938] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-09-16T17:37:14.576244] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-16T17:37:14.582775] [INFO ] [REMOTE ] BUD: Full fetch complete (56980 records). [2025-09-16T17:37:14.582881] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-09-16T17:37:14.583527] [FATAL] [VALIDATOR ] BUD: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:37:14.583603] [FATAL] [MAIN ] BUD: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:37:14.583666] [WARN ] [MAIN ] BUD: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:37:14.583709] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-09-16T17:37:14.583789] [DEBUG] [LOCAL ] BUD: No primary data file found to delete. [2025-09-16T17:37:14.583830] [INFO ] [LOCAL ] BUD: Starting deletion of derivative data. [2025-09-16T17:37:14.584129] [DEBUG] [LOCAL ] BUD: Deleted derivative data file. [2025-09-16T17:37:14.584216] [INFO ] [MAIN ] Update Progress: 356/2369 symbols completed. BUD took 24.8s. Estimated remaining: 3h 30m 18s. Rate: 9.6 symbols/min [2025-09-16T17:37:14.755711] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:37:14.775143] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-09-16T17:37:14.790316] [DEBUG] [LOCAL ] BURL: Loaded 33645 existing records from primary storage. [2025-09-16T17:37:14.790440] [INFO ] [MAIN ] BURL: Loaded 33645 existing records. [2025-09-16T17:37:14.972633] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:37:14.972953] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-09-16T17:37:14.973003] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-09-16T17:37:14.973845] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-09-16T17:37:14.973896] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-09-16T17:37:15.337753] [INFO ] [REMOTE ] BURL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:37:15.350842] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-16T17:37:15.561370] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-16T17:37:15.574848] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-09-16T17:37:16.330434] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-16T17:37:16.332578] [INFO ] [REMOTE ] BUI: Full fetch complete (12250 records). [2025-09-16T17:37:16.332674] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-09-16T17:37:16.380116] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-09-16T17:37:16.706629] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-09-16T17:37:16.706729] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-09-16T17:37:16.707019] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-09-16T17:37:16.707079] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-09-16T17:37:16.707706] [DEBUG] [LOCAL ] BUI: Trimmed 12250 records to 8640 (keeping 150 days of data) [2025-09-16T17:37:16.763148] [DEBUG] [LOCAL ] BUI: Primary data saved (8640 records). [2025-09-16T17:37:16.763271] [INFO ] [MAIN ] BUI: Full history saved. [2025-09-16T17:37:16.763376] [INFO ] [MAIN ] Update Progress: 357/2369 symbols completed. BUI took 14.7s. Estimated remaining: 3h 29m 49s. Rate: 9.6 symbols/min [2025-09-16T17:37:17.174930] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-09-16T17:37:17.640068] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-16T17:37:17.974901] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-09-16T17:37:18.143527] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-16T17:37:18.147219] [INFO ] [REMOTE ] BTZ: Full fetch complete (24972 records). [2025-09-16T17:37:18.147294] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-09-16T17:37:18.148491] [FATAL] [VALIDATOR ] BTZ: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:37:18.148567] [FATAL] [MAIN ] BTZ: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:37:18.148604] [WARN ] [MAIN ] BTZ: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:37:18.148659] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-09-16T17:37:18.148720] [DEBUG] [LOCAL ] BTZ: No primary data file found to delete. [2025-09-16T17:37:18.148768] [INFO ] [LOCAL ] BTZ: Starting deletion of derivative data. [2025-09-16T17:37:18.148970] [DEBUG] [LOCAL ] BTZ: Deleted derivative data file. [2025-09-16T17:37:18.149045] [INFO ] [MAIN ] Update Progress: 358/2369 symbols completed. BTZ took 30.0s. Estimated remaining: 3h 29m 15s. Rate: 9.6 symbols/min [2025-09-16T17:37:18.774889] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-09-16T17:37:19.238140] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-16T17:37:19.574919] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-09-16T17:37:21.005936] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-16T17:37:21.016523] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-09-16T17:37:21.525981] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (2.75 seconds). [2025-09-16T17:37:21.533879] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-09-16T17:37:22.334096] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-16T17:37:22.344378] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-09-16T17:37:22.674575] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-16T17:37:22.774913] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-09-16T17:37:22.882309] [DEBUG] [REMOTE ] BUR: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-09-16T17:37:22.882620] [WARN ] [REMOTE ] BUR: No data returned for month 2025-04 [2025-09-16T17:37:23.574967] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-09-16T17:37:23.721969] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-16T17:37:24.374964] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-09-16T17:37:24.714130] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-16T17:37:25.174906] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-09-16T17:37:25.616889] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-16T17:37:25.974976] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-09-16T17:37:26.312167] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-16T17:37:26.774921] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-09-16T17:37:27.210553] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-16T17:37:27.574913] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-09-16T17:37:27.942863] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-16T17:37:28.374952] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-09-16T17:37:28.988709] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-16T17:37:28.994061] [INFO ] [REMOTE ] BURL: Full fetch complete (50411 records). [2025-09-16T17:37:28.994201] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-09-16T17:37:29.376129] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-09-16T17:37:29.376228] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-09-16T17:37:29.376847] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-09-16T17:37:29.376904] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-09-16T17:37:29.378076] [DEBUG] [LOCAL ] BURL: Trimmed 50411 records to 33959 (keeping 150 days of data) [2025-09-16T17:37:29.587515] [DEBUG] [LOCAL ] BURL: Primary data saved (33959 records). [2025-09-16T17:37:29.587687] [INFO ] [MAIN ] BURL: Full history saved. [2025-09-16T17:37:29.587803] [INFO ] [MAIN ] Update Progress: 359/2369 symbols completed. BURL took 15.0s. Estimated remaining: 3h 29m 38s. Rate: 9.6 symbols/min [2025-09-16T17:37:29.642527] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-16T17:37:29.652459] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-09-16T17:37:30.940403] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-16T17:37:30.945578] [INFO ] [REMOTE ] BUR: Full fetch complete (41520 records). [2025-09-16T17:37:30.945753] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-09-16T17:37:30.946323] [FATAL] [VALIDATOR ] BUR: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:37:30.946427] [FATAL] [MAIN ] BUR: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:37:30.946473] [WARN ] [MAIN ] BUR: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:37:30.946536] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-09-16T17:37:30.946617] [DEBUG] [LOCAL ] BUR: No primary data file found to delete. [2025-09-16T17:37:30.946695] [INFO ] [LOCAL ] BUR: Starting deletion of derivative data. [2025-09-16T17:37:30.947020] [DEBUG] [LOCAL ] BUR: Deleted derivative data file. [2025-09-16T17:37:30.947722] [INFO ] [MAIN ] Update Progress: 360/2369 symbols completed. BUR took 21.0s. Estimated remaining: 3h 29m 4s. Rate: 9.6 symbols/min [2025-09-16T17:37:31.533982] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:37:31.687583] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:37:31.683448] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:37:31.695779] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:37:31.712961] [DEBUG] [LOCAL ] BUXX: Loaded 11375 existing records from primary storage. [2025-09-16T17:37:31.713381] [INFO ] [MAIN ] BUXX: Loaded 11375 existing records. [2025-09-16T17:37:31.865773] [DEBUG] [LOCAL ] BW: Loaded 28077 existing records from primary storage. [2025-09-16T17:37:31.922407] [INFO ] [MAIN ] BW: Loaded 28077 existing records. [2025-09-16T17:37:31.950262] [DEBUG] [LOCAL ] BVN: Loaded 31889 existing records from primary storage. [2025-09-16T17:37:31.967304] [INFO ] [MAIN ] BVN: Loaded 31889 existing records. [2025-09-16T17:37:31.967176] [WARN ] [MAIN ] BUXX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:37:31.999073] [DEBUG] [LOCAL ] BV: Loaded 28319 existing records from primary storage. [2025-09-16T17:37:32.055765] [INFO ] [MAIN ] BV: Loaded 28319 existing records. [2025-09-16T17:37:32.095108] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-09-16T17:37:32.146463] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-09-16T17:37:32.178754] [DEBUG] [LOCAL ] BUXX: Deleted primary data file. [2025-09-16T17:37:32.221249] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-09-16T17:37:32.574671] [WARN ] [MAIN ] BVN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:37:32.574771] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:37:32.618449] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-09-16T17:37:32.637989] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-09-16T17:37:32.638154] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-09-16T17:37:32.646757] [WARN ] [MAIN ] BV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:37:32.646845] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-09-16T17:37:32.715949] [DEBUG] [LOCAL ] BVN: Deleted primary data file. [2025-09-16T17:37:32.691280] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-09-16T17:37:32.724520] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-09-16T17:37:32.691213] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-09-16T17:37:32.731561] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-09-16T17:37:32.731467] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-09-16T17:37:32.801088] [DEBUG] [LOCAL ] BV: Deleted primary data file. [2025-09-16T17:37:32.855145] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-09-16T17:37:33.343788] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:37:33.412682] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-09-16T17:37:33.900429] [INFO ] [REMOTE ] BW: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:37:33.937732] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-09-16T17:37:34.088213] [INFO ] [REMOTE ] BV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:37:34.093908] [INFO ] [REMOTE ] BVN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:37:34.094330] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-09-16T17:37:34.094639] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-09-16T17:37:34.378788] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-16T17:37:34.381410] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-09-16T17:37:34.884893] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-16T17:37:34.888157] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-09-16T17:37:34.993027] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-16T17:37:35.000677] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-09-16T17:37:35.364136] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-16T17:37:35.527683] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-16T17:37:35.574843] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-09-16T17:37:35.680464] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-16T17:37:36.237476] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-16T17:37:36.374917] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-09-16T17:37:37.174952] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-09-16T17:37:37.246471] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-09-16T17:37:37.938089] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-16T17:37:37.974849] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-09-16T17:37:38.081440] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-16T17:37:38.774914] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-09-16T17:37:39.534568] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-16T17:37:39.574893] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-09-16T17:37:39.758087] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-16T17:37:40.374898] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-09-16T17:37:40.947471] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-16T17:37:41.174890] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-09-16T17:37:41.209691] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-16T17:37:41.974916] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-09-16T17:37:42.627521] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-16T17:37:42.774896] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-09-16T17:37:43.171500] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-16T17:37:43.574900] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-09-16T17:37:44.029042] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-16T17:37:44.374929] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-09-16T17:37:44.568047] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-16T17:37:44.570157] [INFO ] [REMOTE ] BUXX: Full fetch complete (16205 records). [2025-09-16T17:37:44.570232] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-09-16T17:37:44.936544] [DEBUG] [VALIDATOR ] BUXX: All expected trading days are present. [2025-09-16T17:37:44.936664] [DEBUG] [VALIDATOR ] BUXX: Primary data validation passed. [2025-09-16T17:37:44.937025] [INFO ] [MAIN ] BUXX: Fetched primary data is valid. [2025-09-16T17:37:44.937067] [DEBUG] [LOCAL ] BUXX: Saving primary data. [2025-09-16T17:37:44.937739] [DEBUG] [LOCAL ] BUXX: Trimmed 16205 records to 11499 (keeping 150 days of data) [2025-09-16T17:37:45.011490] [DEBUG] [LOCAL ] BUXX: Primary data saved (11499 records). [2025-09-16T17:37:45.011664] [INFO ] [MAIN ] BUXX: Full history saved. [2025-09-16T17:37:45.011756] [INFO ] [MAIN ] Update Progress: 361/2369 symbols completed. BUXX took 14.1s. Estimated remaining: 3h 29m 42s. Rate: 9.6 symbols/min [2025-09-16T17:37:45.180121] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:37:45.180242] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-09-16T17:37:45.226559] [DEBUG] [LOCAL ] BWA: Loaded 38415 existing records from primary storage. [2025-09-16T17:37:45.226717] [INFO ] [MAIN ] BWA: Loaded 38415 existing records. [2025-09-16T17:37:45.402182] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:37:45.402415] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-09-16T17:37:45.402460] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-09-16T17:37:45.403432] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-09-16T17:37:45.403481] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-09-16T17:37:45.752133] [INFO ] [REMOTE ] BWA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:37:45.899435] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-16T17:37:45.974908] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-09-16T17:37:46.587563] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-16T17:37:46.774916] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-09-16T17:37:47.524432] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-16T17:37:47.574910] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-09-16T17:37:48.193742] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-16T17:37:48.374893] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-09-16T17:37:49.072412] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-16T17:37:49.174907] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-09-16T17:37:49.543176] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-16T17:37:49.549314] [INFO ] [REMOTE ] BV: Full fetch complete (42137 records). [2025-09-16T17:37:49.549424] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-09-16T17:37:49.950279] [DEBUG] [VALIDATOR ] BV: All expected trading days are present. [2025-09-16T17:37:49.950379] [DEBUG] [VALIDATOR ] BV: Primary data validation passed. [2025-09-16T17:37:49.951040] [INFO ] [MAIN ] BV: Fetched primary data is valid. [2025-09-16T17:37:49.951088] [DEBUG] [LOCAL ] BV: Saving primary data. [2025-09-16T17:37:49.952267] [DEBUG] [LOCAL ] BV: Trimmed 42137 records to 28578 (keeping 150 days of data) [2025-09-16T17:37:50.012776] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-09-16T17:37:50.175584] [DEBUG] [LOCAL ] BV: Primary data saved (28578 records). [2025-09-16T17:37:50.175771] [INFO ] [MAIN ] BV: Full history saved. [2025-09-16T17:37:50.175865] [INFO ] [MAIN ] Update Progress: 362/2369 symbols completed. BV took 19.2s. Estimated remaining: 3h 29m 29s. Rate: 9.6 symbols/min [2025-09-16T17:37:50.409022] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:37:50.424848] [DEBUG] [LOCAL ] BWG: Loaded 9569 existing records from primary storage. [2025-09-16T17:37:50.425039] [INFO ] [MAIN ] BWG: Loaded 9569 existing records. [2025-09-16T17:37:50.700124] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:37:50.700592] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-09-16T17:37:50.700744] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-09-16T17:37:50.701284] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-09-16T17:37:50.701470] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-09-16T17:37:50.778589] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-09-16T17:37:51.078062] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-16T17:37:51.210803] [INFO ] [REMOTE ] BWG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:37:51.525834] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-16T17:37:51.574895] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-09-16T17:37:52.168244] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-16T17:37:52.180575] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-16T17:37:52.180794] [INFO ] [REMOTE ] BVN: Full fetch complete (47169 records). [2025-09-16T17:37:52.183604] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-09-16T17:37:52.380013] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-09-16T17:37:52.565276] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-09-16T17:37:52.565354] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-09-16T17:37:52.565940] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-09-16T17:37:52.565985] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-09-16T17:37:52.567053] [DEBUG] [LOCAL ] BVN: Trimmed 47169 records to 32229 (keeping 150 days of data) [2025-09-16T17:37:52.754019] [DEBUG] [LOCAL ] BVN: Primary data saved (32229 records). [2025-09-16T17:37:52.754163] [INFO ] [MAIN ] BVN: Full history saved. [2025-09-16T17:37:52.754247] [INFO ] [MAIN ] Update Progress: 363/2369 symbols completed. BVN took 21.8s. Estimated remaining: 3h 29m 3s. Rate: 9.6 symbols/min [2025-09-16T17:37:52.923040] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:37:52.947830] [DEBUG] [LOCAL ] BWLP: Loaded 23730 existing records from primary storage. [2025-09-16T17:37:52.948011] [INFO ] [MAIN ] BWLP: Loaded 23730 existing records. [2025-09-16T17:37:53.123712] [WARN ] [MAIN ] BWLP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:37:53.123961] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-09-16T17:37:53.124008] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-09-16T17:37:53.124673] [DEBUG] [LOCAL ] BWLP: Deleted primary data file. [2025-09-16T17:37:53.124727] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-09-16T17:37:53.180053] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-09-16T17:37:53.485285] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:37:53.959162] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-16T17:37:53.974843] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-09-16T17:37:54.262239] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-16T17:37:54.774920] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-09-16T17:37:55.290958] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-16T17:37:55.574920] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-09-16T17:37:56.374906] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-09-16T17:37:56.404460] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-16T17:37:56.550174] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-16T17:37:57.174942] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-09-16T17:37:57.740594] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-16T17:37:57.974915] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-09-16T17:37:58.093523] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-16T17:37:58.774912] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-09-16T17:37:59.183953] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-16T17:37:59.539988] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-16T17:37:59.574852] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-09-16T17:38:00.374893] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-09-16T17:38:00.538859] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-16T17:38:01.174908] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-09-16T17:38:01.974876] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-09-16T17:38:02.384965] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-16T17:38:02.676920] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-16T17:38:02.774904] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-09-16T17:38:02.903383] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-16T17:38:03.574936] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-09-16T17:38:04.220476] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-16T17:38:04.374899] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-09-16T17:38:04.536821] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-16T17:38:04.539091] [INFO ] [REMOTE ] BWG: Full fetch complete (13285 records). [2025-09-16T17:38:04.539160] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-09-16T17:38:04.896233] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-09-16T17:38:04.896314] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-09-16T17:38:04.896662] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-09-16T17:38:04.896707] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-09-16T17:38:04.897203] [DEBUG] [LOCAL ] BWG: Trimmed 13285 records to 9776 (keeping 150 days of data) [2025-09-16T17:38:04.954292] [DEBUG] [LOCAL ] BWG: Primary data saved (9776 records). [2025-09-16T17:38:04.954429] [INFO ] [MAIN ] BWG: Full history saved. [2025-09-16T17:38:04.954513] [INFO ] [MAIN ] Update Progress: 364/2369 symbols completed. BWG took 14.8s. Estimated remaining: 3h 29m 29s. Rate: 9.6 symbols/min [2025-09-16T17:38:05.124135] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:38:05.124273] [DEBUG] [LOCAL ] BWMX: No existing data file found in primary storage. [2025-09-16T17:38:05.124313] [WARN ] [MAIN ] BWMX: No existing data found, performing full refresh instead. [2025-09-16T17:38:05.124434] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-09-16T17:38:05.124475] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-09-16T17:38:05.124518] [DEBUG] [LOCAL ] BWMX: No primary data file found to delete. [2025-09-16T17:38:05.124552] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-09-16T17:38:05.180678] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-09-16T17:38:05.481065] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:38:05.737262] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-16T17:38:05.974888] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-09-16T17:38:06.331497] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-16T17:38:06.774913] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-09-16T17:38:07.327722] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-16T17:38:07.553188] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-16T17:38:07.574851] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-09-16T17:38:08.374935] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-09-16T17:38:08.875993] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-16T17:38:09.174900] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-09-16T17:38:09.950985] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-16T17:38:09.974856] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-09-16T17:38:10.762770] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-16T17:38:10.774861] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-09-16T17:38:11.311752] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-16T17:38:11.574937] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-09-16T17:38:12.147316] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-16T17:38:12.154068] [INFO ] [REMOTE ] BW: Full fetch complete (42990 records). [2025-09-16T17:38:12.154295] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-09-16T17:38:12.386407] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-09-16T17:38:12.566629] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-09-16T17:38:12.566776] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-09-16T17:38:12.567583] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-09-16T17:38:12.567668] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-09-16T17:38:12.576411] [DEBUG] [LOCAL ] BW: Trimmed 42990 records to 28462 (keeping 150 days of data) [2025-09-16T17:38:12.588164] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-16T17:38:12.770149] [DEBUG] [LOCAL ] BW: Primary data saved (28462 records). [2025-09-16T17:38:12.770322] [INFO ] [MAIN ] BW: Full history saved. [2025-09-16T17:38:12.770428] [INFO ] [MAIN ] Update Progress: 365/2369 symbols completed. BW took 41.8s. Estimated remaining: 3h 29m 31s. Rate: 9.6 symbols/min [2025-09-16T17:38:12.940319] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:38:12.945225] [DEBUG] [LOCAL ] BWNB: Loaded 3439 existing records from primary storage. [2025-09-16T17:38:12.945303] [INFO ] [MAIN ] BWNB: Loaded 3439 existing records. [2025-09-16T17:38:13.122556] [WARN ] [MAIN ] BWNB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:38:13.122838] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-09-16T17:38:13.122885] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-09-16T17:38:13.123172] [DEBUG] [LOCAL ] BWNB: Deleted primary data file. [2025-09-16T17:38:13.123219] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-09-16T17:38:13.186195] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-09-16T17:38:13.481498] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:38:13.793465] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-16T17:38:13.974917] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-09-16T17:38:14.282161] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-16T17:38:14.774896] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-09-16T17:38:14.973888] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-16T17:38:15.574913] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-09-16T17:38:16.301685] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-16T17:38:16.374862] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-09-16T17:38:16.416877] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-16T17:38:16.425898] [INFO ] [REMOTE ] BWA: Full fetch complete (56849 records). [2025-09-16T17:38:16.426013] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-09-16T17:38:16.805085] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-09-16T17:38:16.805169] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-09-16T17:38:16.805897] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-09-16T17:38:16.805943] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-09-16T17:38:16.807135] [DEBUG] [LOCAL ] BWA: Trimmed 56849 records to 38799 (keeping 150 days of data) [2025-09-16T17:38:17.049722] [DEBUG] [LOCAL ] BWA: Primary data saved (38799 records). [2025-09-16T17:38:17.049880] [INFO ] [MAIN ] BWA: Full history saved. [2025-09-16T17:38:17.050943] [INFO ] [MAIN ] Update Progress: 366/2369 symbols completed. BWA took 32.0s. Estimated remaining: 3h 29m 14s. Rate: 9.6 symbols/min [2025-09-16T17:38:17.178434] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-09-16T17:38:17.206239] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-16T17:38:17.233385] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:38:17.241882] [DEBUG] [LOCAL ] BWSN: Loaded 4084 existing records from primary storage. [2025-09-16T17:38:17.242015] [INFO ] [MAIN ] BWSN: Loaded 4084 existing records. [2025-09-16T17:38:17.419513] [WARN ] [MAIN ] BWSN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:38:17.419773] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-09-16T17:38:17.419821] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-09-16T17:38:17.420092] [DEBUG] [LOCAL ] BWSN: Deleted primary data file. [2025-09-16T17:38:17.420137] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-09-16T17:38:17.775028] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:38:17.974917] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-09-16T17:38:18.673114] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-16T17:38:18.679296] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-16T17:38:18.680905] [INFO ] [REMOTE ] BWLP: Full fetch complete (35658 records). [2025-09-16T17:38:18.680979] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-09-16T17:38:18.681498] [FATAL] [VALIDATOR ] BWLP: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:38:18.681575] [FATAL] [MAIN ] BWLP: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:38:18.681612] [WARN ] [MAIN ] BWLP: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:38:18.681672] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-09-16T17:38:18.681732] [DEBUG] [LOCAL ] BWLP: No primary data file found to delete. [2025-09-16T17:38:18.681773] [INFO ] [LOCAL ] BWLP: Starting deletion of derivative data. [2025-09-16T17:38:18.682094] [DEBUG] [LOCAL ] BWLP: Deleted derivative data file. [2025-09-16T17:38:18.682173] [INFO ] [MAIN ] Update Progress: 367/2369 symbols completed. BWLP took 25.9s. Estimated remaining: 3h 28m 43s. Rate: 9.6 symbols/min [2025-09-16T17:38:18.780014] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-09-16T17:38:18.851359] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:38:18.886157] [DEBUG] [LOCAL ] BWXT: Loaded 34580 existing records from primary storage. [2025-09-16T17:38:18.886301] [INFO ] [MAIN ] BWXT: Loaded 34580 existing records. [2025-09-16T17:38:19.061706] [WARN ] [MAIN ] BWXT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:38:19.061959] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-09-16T17:38:19.062013] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-09-16T17:38:19.062988] [DEBUG] [LOCAL ] BWXT: Deleted primary data file. [2025-09-16T17:38:19.063044] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-09-16T17:38:19.421090] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:38:19.566473] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-16T17:38:19.574836] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-09-16T17:38:20.374880] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-09-16T17:38:20.409225] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-16T17:38:21.174902] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-09-16T17:38:21.896108] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-16T17:38:21.974862] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-09-16T17:38:22.072504] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-16T17:38:22.695313] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-16T17:38:22.696574] [INFO ] [REMOTE ] BWMX: Full fetch complete (7846 records). [2025-09-16T17:38:22.696659] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-09-16T17:38:22.697020] [FATAL] [VALIDATOR ] BWMX: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:38:22.697134] [FATAL] [MAIN ] BWMX: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:38:22.697171] [WARN ] [MAIN ] BWMX: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:38:22.697208] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-09-16T17:38:22.697272] [DEBUG] [LOCAL ] BWMX: No primary data file found to delete. [2025-09-16T17:38:22.697309] [INFO ] [LOCAL ] BWMX: Starting deletion of derivative data. [2025-09-16T17:38:22.697351] [DEBUG] [LOCAL ] BWMX: No derivative data file found to delete. [2025-09-16T17:38:22.697408] [INFO ] [MAIN ] Update Progress: 368/2369 symbols completed. BWMX took 17.7s. Estimated remaining: 3h 28m 24s. Rate: 9.6 symbols/min [2025-09-16T17:38:22.780016] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-09-16T17:38:22.868501] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:38:22.908723] [DEBUG] [LOCAL ] BX: Loaded 39477 existing records from primary storage. [2025-09-16T17:38:22.908859] [INFO ] [MAIN ] BX: Loaded 39477 existing records. [2025-09-16T17:38:23.084666] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:38:23.084887] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-09-16T17:38:23.084974] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-09-16T17:38:23.085977] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-09-16T17:38:23.086028] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-09-16T17:38:23.448993] [INFO ] [REMOTE ] BX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:38:23.452170] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-16T17:38:23.574930] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-09-16T17:38:24.374945] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-09-16T17:38:25.177368] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-09-16T17:38:25.183108] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-16T17:38:25.596060] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-16T17:38:25.707534] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-16T17:38:25.974937] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-09-16T17:38:26.395684] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-16T17:38:26.774911] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-09-16T17:38:27.275923] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-16T17:38:27.574913] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-09-16T17:38:27.950159] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-16T17:38:28.374919] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-09-16T17:38:28.900985] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-16T17:38:29.174908] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-09-16T17:38:29.468459] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-09-16T17:38:29.974914] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-09-16T17:38:30.774931] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-09-16T17:38:31.108956] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-16T17:38:31.259279] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-16T17:38:31.574896] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-09-16T17:38:32.374928] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-09-16T17:38:33.174924] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-09-16T17:38:33.304448] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-16T17:38:33.635705] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-16T17:38:33.934277] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-16T17:38:33.974861] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-09-16T17:38:34.774920] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-09-16T17:38:35.574898] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-09-16T17:38:35.789173] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-16T17:38:35.964347] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-16T17:38:36.156677] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-16T17:38:36.374904] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-09-16T17:38:37.174902] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-09-16T17:38:37.944788] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-16T17:38:37.974874] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-09-16T17:38:38.720538] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-16T17:38:38.774918] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-09-16T17:38:39.574898] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-09-16T17:38:39.643693] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-16T17:38:40.094707] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-16T17:38:40.286920] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-16T17:38:40.374905] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-09-16T17:38:41.174943] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-09-16T17:38:41.619326] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-16T17:38:41.948851] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-16T17:38:41.974870] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-09-16T17:38:42.774982] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-09-16T17:38:43.248009] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-16T17:38:43.249307] [INFO ] [REMOTE ] BWSN: Full fetch complete (5350 records). [2025-09-16T17:38:43.249393] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-09-16T17:38:43.580278] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-09-16T17:38:43.901612] [DEBUG] [VALIDATOR ] BWSN: All expected trading days are present. [2025-09-16T17:38:43.901768] [DEBUG] [VALIDATOR ] BWSN: Primary data validation passed. [2025-09-16T17:38:43.902093] [INFO ] [MAIN ] BWSN: Fetched primary data is valid. [2025-09-16T17:38:43.902197] [DEBUG] [LOCAL ] BWSN: Saving primary data. [2025-09-16T17:38:43.903602] [DEBUG] [LOCAL ] BWSN: Trimmed 5350 records to 4093 (keeping 150 days of data) [2025-09-16T17:38:43.983177] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-16T17:38:44.004327] [DEBUG] [LOCAL ] BWSN: Primary data saved (4093 records). [2025-09-16T17:38:44.004501] [INFO ] [MAIN ] BWSN: Full history saved. [2025-09-16T17:38:44.004604] [INFO ] [MAIN ] Update Progress: 369/2369 symbols completed. BWSN took 27.0s. Estimated remaining: 3h 29m 39s. Rate: 9.5 symbols/min [2025-09-16T17:38:44.157770] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-16T17:38:44.233535] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:38:44.245371] [DEBUG] [LOCAL ] BXC: Loaded 10082 existing records from primary storage. [2025-09-16T17:38:44.245524] [INFO ] [MAIN ] BXC: Loaded 10082 existing records. [2025-09-16T17:38:44.380138] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-09-16T17:38:44.440522] [WARN ] [MAIN ] BXC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:38:44.440810] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-09-16T17:38:44.440863] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-09-16T17:38:44.441400] [DEBUG] [LOCAL ] BXC: Deleted primary data file. [2025-09-16T17:38:44.441453] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-09-16T17:38:44.788935] [INFO ] [REMOTE ] BXC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:38:45.174913] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-09-16T17:38:45.974926] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-09-16T17:38:46.054079] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-16T17:38:46.059597] [INFO ] [REMOTE ] BWXT: Full fetch complete (50857 records). [2025-09-16T17:38:46.059725] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-09-16T17:38:46.438864] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-09-16T17:38:46.438949] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-09-16T17:38:46.439541] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-09-16T17:38:46.439585] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-09-16T17:38:46.440614] [DEBUG] [LOCAL ] BWXT: Trimmed 50857 records to 34954 (keeping 150 days of data) [2025-09-16T17:38:46.661169] [DEBUG] [LOCAL ] BWXT: Primary data saved (34954 records). [2025-09-16T17:38:46.661306] [INFO ] [MAIN ] BWXT: Full history saved. [2025-09-16T17:38:46.661389] [INFO ] [MAIN ] Update Progress: 370/2369 symbols completed. BWXT took 28.0s. Estimated remaining: 3h 29m 14s. Rate: 9.6 symbols/min [2025-09-16T17:38:46.785318] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-09-16T17:38:46.844178] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:38:46.844746] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-16T17:38:46.867601] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-16T17:38:46.874258] [INFO ] [REMOTE ] BX: Full fetch complete (58175 records). [2025-09-16T17:38:46.874440] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-09-16T17:38:47.059623] [DEBUG] [LOCAL ] BXMT: Loaded 33962 existing records from primary storage. [2025-09-16T17:38:47.075182] [INFO ] [MAIN ] BXMT: Loaded 33962 existing records. [2025-09-16T17:38:47.475074] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-16T17:38:47.474890] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:38:47.479751] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-09-16T17:38:47.479957] [INFO ] [REMOTE ] BWNB: Full fetch complete (4808 records). [2025-09-16T17:38:47.480306] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-09-16T17:38:47.480181] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-09-16T17:38:47.480581] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-09-16T17:38:47.480248] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-09-16T17:38:47.502151] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-09-16T17:38:47.502116] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-09-16T17:38:47.512381] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-09-16T17:38:47.529572] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-09-16T17:38:47.592853] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-09-16T17:38:47.712042] [DEBUG] [LOCAL ] BX: Trimmed 58175 records to 39866 (keeping 150 days of data) [2025-09-16T17:38:48.311518] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:38:48.311964] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present. [2025-09-16T17:38:48.313835] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed. [2025-09-16T17:38:48.314699] [INFO ] [MAIN ] BWNB: Fetched primary data is valid. [2025-09-16T17:38:48.316677] [DEBUG] [LOCAL ] BWNB: Saving primary data. [2025-09-16T17:38:48.324447] [DEBUG] [LOCAL ] BWNB: Trimmed 4808 records to 3471 (keeping 150 days of data) [2025-09-16T17:38:48.421249] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-09-16T17:38:48.421159] [DEBUG] [LOCAL ] BWNB: Primary data saved (3471 records). [2025-09-16T17:38:48.431145] [INFO ] [MAIN ] BWNB: Full history saved. [2025-09-16T17:38:48.431606] [INFO ] [MAIN ] Update Progress: 371/2369 symbols completed. BWNB took 35.7s. Estimated remaining: 3h 28m 43s. Rate: 9.6 symbols/min [2025-09-16T17:38:48.649911] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:38:48.670357] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-16T17:38:48.682007] [DEBUG] [LOCAL ] BXMX: Loaded 13325 existing records from primary storage. [2025-09-16T17:38:48.683788] [INFO ] [MAIN ] BXMX: Loaded 13325 existing records. [2025-09-16T17:38:48.869951] [WARN ] [MAIN ] BXMX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:38:48.871207] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-09-16T17:38:48.873870] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-09-16T17:38:48.873926] [DEBUG] [LOCAL ] BX: Primary data saved (39866 records). [2025-09-16T17:38:48.874035] [INFO ] [MAIN ] BX: Full history saved. [2025-09-16T17:38:48.875435] [INFO ] [MAIN ] Update Progress: 372/2369 symbols completed. BX took 26.2s. Estimated remaining: 3h 28m 5s. Rate: 9.6 symbols/min [2025-09-16T17:38:48.881413] [DEBUG] [LOCAL ] BXMX: Deleted primary data file. [2025-09-16T17:38:48.918902] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-09-16T17:38:49.186872] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-09-16T17:38:49.191964] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:38:49.405329] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:38:49.428128] [DEBUG] [LOCAL ] BXP: Loaded 36565 existing records from primary storage. [2025-09-16T17:38:49.428229] [INFO ] [MAIN ] BXP: Loaded 36565 existing records. [2025-09-16T17:38:49.603335] [WARN ] [MAIN ] BXP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:38:49.603562] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-09-16T17:38:49.603617] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-09-16T17:38:49.604513] [DEBUG] [LOCAL ] BXP: Deleted primary data file. [2025-09-16T17:38:49.604561] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-09-16T17:38:49.971420] [INFO ] [REMOTE ] BXP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:38:49.982491] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-09-16T17:38:50.000568] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-16T17:38:50.070586] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-16T17:38:50.774943] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-09-16T17:38:51.165118] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-16T17:38:51.574906] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-09-16T17:38:52.380056] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-09-16T17:38:52.395353] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-16T17:38:53.146465] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-16T17:38:53.174840] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-09-16T17:38:53.508694] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-16T17:38:53.974910] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-09-16T17:38:54.703866] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-16T17:38:54.757282] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-16T17:38:54.774857] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-09-16T17:38:55.570468] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-16T17:38:55.574860] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-09-16T17:38:56.374900] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-09-16T17:38:57.108258] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-16T17:38:57.174868] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-09-16T17:38:57.395108] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-16T17:38:57.974903] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-09-16T17:38:58.744754] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-16T17:38:58.774843] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-09-16T17:38:59.506574] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-16T17:38:59.574869] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-09-16T17:39:00.374880] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-09-16T17:39:00.441052] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-16T17:39:01.174909] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-09-16T17:39:01.500849] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-16T17:39:01.974915] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-09-16T17:39:02.107765] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-16T17:39:02.639751] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-16T17:39:02.774875] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-09-16T17:39:03.574925] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-09-16T17:39:03.649794] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-16T17:39:04.185357] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-16T17:39:04.374898] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-09-16T17:39:04.499097] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-16T17:39:05.174903] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-09-16T17:39:05.922615] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-16T17:39:05.974894] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-09-16T17:39:06.084049] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-16T17:39:06.085921] [INFO ] [REMOTE ] BXC: Full fetch complete (14604 records). [2025-09-16T17:39:06.086024] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-09-16T17:39:06.455917] [DEBUG] [VALIDATOR ] BXC: All expected trading days are present. [2025-09-16T17:39:06.455999] [DEBUG] [VALIDATOR ] BXC: Primary data validation passed. [2025-09-16T17:39:06.456329] [INFO ] [MAIN ] BXC: Fetched primary data is valid. [2025-09-16T17:39:06.456382] [DEBUG] [LOCAL ] BXC: Saving primary data. [2025-09-16T17:39:06.456956] [DEBUG] [LOCAL ] BXC: Trimmed 14604 records to 10137 (keeping 150 days of data) [2025-09-16T17:39:06.517898] [DEBUG] [LOCAL ] BXC: Primary data saved (10137 records). [2025-09-16T17:39:06.518049] [INFO ] [MAIN ] BXC: Full history saved. [2025-09-16T17:39:06.518154] [INFO ] [MAIN ] Update Progress: 373/2369 symbols completed. BXC took 22.5s. Estimated remaining: 3h 29m 0s. Rate: 9.6 symbols/min [2025-09-16T17:39:06.728964] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:39:06.770868] [DEBUG] [LOCAL ] BXSL: Loaded 34368 existing records from primary storage. [2025-09-16T17:39:06.771138] [INFO ] [MAIN ] BXSL: Loaded 34368 existing records. [2025-09-16T17:39:06.782368] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-09-16T17:39:06.957190] [WARN ] [MAIN ] BXSL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:39:06.969957] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-09-16T17:39:06.970551] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-09-16T17:39:06.971039] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-16T17:39:06.976156] [DEBUG] [LOCAL ] BXSL: Deleted primary data file. [2025-09-16T17:39:06.976258] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-09-16T17:39:07.332434] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:39:07.574955] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-09-16T17:39:08.314959] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-16T17:39:08.320324] [INFO ] [REMOTE ] BXMT: Full fetch complete (51728 records). [2025-09-16T17:39:08.320438] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-09-16T17:39:08.384081] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-09-16T17:39:08.707449] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-09-16T17:39:08.707550] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-09-16T17:39:08.708239] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-09-16T17:39:08.708287] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-09-16T17:39:08.710057] [DEBUG] [LOCAL ] BXMT: Trimmed 51728 records to 34285 (keeping 150 days of data) [2025-09-16T17:39:08.916261] [DEBUG] [LOCAL ] BXMT: Primary data saved (34285 records). [2025-09-16T17:39:08.916414] [INFO ] [MAIN ] BXMT: Full history saved. [2025-09-16T17:39:08.916512] [INFO ] [MAIN ] Update Progress: 374/2369 symbols completed. BXMT took 22.3s. Estimated remaining: 3h 28m 33s. Rate: 9.6 symbols/min [2025-09-16T17:39:09.087453] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:39:09.103178] [DEBUG] [LOCAL ] BY: Loaded 15598 existing records from primary storage. [2025-09-16T17:39:09.103293] [INFO ] [MAIN ] BY: Loaded 15598 existing records. [2025-09-16T17:39:09.178546] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-09-16T17:39:09.282581] [WARN ] [MAIN ] BY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:39:09.283343] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-09-16T17:39:09.283484] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-09-16T17:39:09.284039] [DEBUG] [LOCAL ] BY: Deleted primary data file. [2025-09-16T17:39:09.284103] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-09-16T17:39:09.542765] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-16T17:39:09.691088] [INFO ] [REMOTE ] BY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:39:09.980109] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-09-16T17:39:09.998423] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-16T17:39:10.159366] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-16T17:39:10.774923] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-09-16T17:39:11.080330] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-16T17:39:11.574937] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-09-16T17:39:12.354599] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-16T17:39:12.361401] [INFO ] [REMOTE ] BXP: Full fetch complete (54166 records). [2025-09-16T17:39:12.361565] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-09-16T17:39:12.383595] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-09-16T17:39:12.756542] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-09-16T17:39:12.756630] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-09-16T17:39:12.757279] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-09-16T17:39:12.757322] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-09-16T17:39:12.758894] [DEBUG] [LOCAL ] BXP: Trimmed 54166 records to 36936 (keeping 150 days of data) [2025-09-16T17:39:12.836094] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-16T17:39:12.997584] [DEBUG] [LOCAL ] BXP: Primary data saved (36936 records). [2025-09-16T17:39:12.997740] [INFO ] [MAIN ] BXP: Full history saved. [2025-09-16T17:39:12.997825] [INFO ] [MAIN ] Update Progress: 375/2369 symbols completed. BXP took 24.1s. Estimated remaining: 3h 28m 15s. Rate: 9.6 symbols/min [2025-09-16T17:39:13.168681] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:39:13.174878] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-09-16T17:39:13.208225] [DEBUG] [LOCAL ] BYD: Loaded 33316 existing records from primary storage. [2025-09-16T17:39:13.208412] [INFO ] [MAIN ] BYD: Loaded 33316 existing records. [2025-09-16T17:39:13.393760] [WARN ] [MAIN ] BYD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:39:13.394171] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-09-16T17:39:13.394303] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-09-16T17:39:13.400571] [DEBUG] [LOCAL ] BYD: Deleted primary data file. [2025-09-16T17:39:13.405603] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-09-16T17:39:13.406027] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-16T17:39:13.761113] [INFO ] [REMOTE ] BYD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:39:13.974874] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-09-16T17:39:14.568630] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-16T17:39:14.774960] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-09-16T17:39:15.281252] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-16T17:39:15.574922] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-09-16T17:39:16.374874] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-09-16T17:39:16.445855] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-16T17:39:17.174867] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-09-16T17:39:17.271357] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-16T17:39:17.520296] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-16T17:39:17.974902] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-09-16T17:39:17.996935] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-16T17:39:18.774904] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-09-16T17:39:19.574929] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-09-16T17:39:19.813189] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-16T17:39:19.865150] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-16T17:39:20.374916] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-09-16T17:39:20.853555] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-16T17:39:21.174927] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-09-16T17:39:21.389406] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-16T17:39:21.391704] [INFO ] [REMOTE ] BXMX: Full fetch complete (21288 records). [2025-09-16T17:39:21.391778] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-09-16T17:39:21.760670] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present. [2025-09-16T17:39:21.760749] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed. [2025-09-16T17:39:21.761115] [INFO ] [MAIN ] BXMX: Fetched primary data is valid. [2025-09-16T17:39:21.761155] [DEBUG] [LOCAL ] BXMX: Saving primary data. [2025-09-16T17:39:21.761757] [DEBUG] [LOCAL ] BXMX: Trimmed 21288 records to 13505 (keeping 150 days of data) [2025-09-16T17:39:21.846548] [DEBUG] [LOCAL ] BXMX: Primary data saved (13505 records). [2025-09-16T17:39:21.846726] [INFO ] [MAIN ] BXMX: Full history saved. [2025-09-16T17:39:21.846815] [INFO ] [MAIN ] Update Progress: 376/2369 symbols completed. BXMX took 33.4s. Estimated remaining: 3h 28m 23s. Rate: 9.6 symbols/min [2025-09-16T17:39:21.980028] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-09-16T17:39:22.047137] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:39:22.056290] [DEBUG] [LOCAL ] BYM: Loaded 8410 existing records from primary storage. [2025-09-16T17:39:22.056373] [INFO ] [MAIN ] BYM: Loaded 8410 existing records. [2025-09-16T17:39:22.233461] [WARN ] [MAIN ] BYM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:39:22.233720] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-09-16T17:39:22.233796] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-09-16T17:39:22.234117] [DEBUG] [LOCAL ] BYM: Deleted primary data file. [2025-09-16T17:39:22.234160] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-09-16T17:39:22.603490] [INFO ] [REMOTE ] BYM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:39:22.619816] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-16T17:39:22.774859] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-09-16T17:39:23.325296] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-16T17:39:23.574867] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-09-16T17:39:23.663141] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-16T17:39:24.374936] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-09-16T17:39:25.176479] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-09-16T17:39:25.179592] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-16T17:39:25.530369] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-16T17:39:25.974913] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-09-16T17:39:26.154368] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-16T17:39:26.774895] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-09-16T17:39:27.020596] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-16T17:39:27.574933] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-09-16T17:39:28.227779] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-16T17:39:28.374909] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-09-16T17:39:28.544620] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-16T17:39:29.174959] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-09-16T17:39:29.974861] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-09-16T17:39:30.217061] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-16T17:39:30.226317] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-16T17:39:30.234620] [INFO ] [REMOTE ] BY: Full fetch complete (22442 records). [2025-09-16T17:39:30.234991] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-09-16T17:39:30.235489] [FATAL] [VALIDATOR ] BY: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:39:30.235585] [FATAL] [MAIN ] BY: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:39:30.235625] [WARN ] [MAIN ] BY: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:39:30.235688] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-09-16T17:39:30.235750] [DEBUG] [LOCAL ] BY: No primary data file found to delete. [2025-09-16T17:39:30.235787] [INFO ] [LOCAL ] BY: Starting deletion of derivative data. [2025-09-16T17:39:30.236033] [DEBUG] [LOCAL ] BY: Deleted derivative data file. [2025-09-16T17:39:30.236113] [INFO ] [MAIN ] Update Progress: 377/2369 symbols completed. BY took 21.3s. Estimated remaining: 3h 28m 28s. Rate: 9.6 symbols/min [2025-09-16T17:39:30.406899] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:39:30.430282] [DEBUG] [LOCAL ] BZH: Loaded 24078 existing records from primary storage. [2025-09-16T17:39:30.430431] [INFO ] [MAIN ] BZH: Loaded 24078 existing records. [2025-09-16T17:39:30.617559] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:39:30.617818] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-09-16T17:39:30.617885] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-09-16T17:39:30.618495] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-09-16T17:39:30.618552] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-09-16T17:39:30.790372] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-09-16T17:39:30.948617] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-16T17:39:30.987798] [INFO ] [REMOTE ] BZH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:39:31.574949] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-09-16T17:39:32.374903] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-09-16T17:39:32.606015] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-16T17:39:32.612250] [INFO ] [REMOTE ] BXSL: Full fetch complete (51506 records). [2025-09-16T17:39:32.612440] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-09-16T17:39:33.001825] [DEBUG] [VALIDATOR ] BXSL: All expected trading days are present. [2025-09-16T17:39:33.001907] [DEBUG] [VALIDATOR ] BXSL: Primary data validation passed. [2025-09-16T17:39:33.002504] [INFO ] [MAIN ] BXSL: Fetched primary data is valid. [2025-09-16T17:39:33.002547] [DEBUG] [LOCAL ] BXSL: Saving primary data. [2025-09-16T17:39:33.003668] [DEBUG] [LOCAL ] BXSL: Trimmed 51506 records to 34756 (keeping 150 days of data) [2025-09-16T17:39:33.190316] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-09-16T17:39:33.216560] [DEBUG] [LOCAL ] BXSL: Primary data saved (34756 records). [2025-09-16T17:39:33.216944] [INFO ] [MAIN ] BXSL: Full history saved. [2025-09-16T17:39:33.217604] [INFO ] [MAIN ] Update Progress: 378/2369 symbols completed. BXSL took 26.7s. Estimated remaining: 3h 28m 4s. Rate: 9.6 symbols/min [2025-09-16T17:39:33.395905] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:39:33.424051] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-16T17:39:33.472009] [DEBUG] [LOCAL ] C: Loaded 39702 existing records from primary storage. [2025-09-16T17:39:33.472161] [INFO ] [MAIN ] C: Loaded 39702 existing records. [2025-09-16T17:39:33.648708] [WARN ] [MAIN ] C: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:39:33.648929] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-09-16T17:39:33.648975] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-09-16T17:39:33.649833] [DEBUG] [LOCAL ] C: Deleted primary data file. [2025-09-16T17:39:33.649881] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-09-16T17:39:34.012752] [INFO ] [REMOTE ] C: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:39:33.975708] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-09-16T17:39:34.063307] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-16T17:39:34.088762] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-16T17:39:34.774916] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-09-16T17:39:35.406231] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-16T17:39:35.574934] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-09-16T17:39:36.374971] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-09-16T17:39:36.722482] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-16T17:39:36.830560] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-16T17:39:37.149096] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-16T17:39:37.174857] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-09-16T17:39:37.974905] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-09-16T17:39:38.607291] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-16T17:39:38.774910] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-09-16T17:39:39.574903] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-09-16T17:39:39.874820] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-16T17:39:40.179029] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-16T17:39:40.288396] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-16T17:39:40.374919] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-09-16T17:39:41.174908] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-09-16T17:39:41.673306] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-16T17:39:41.678798] [INFO ] [REMOTE ] BYD: Full fetch complete (49234 records). [2025-09-16T17:39:41.678895] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-09-16T17:39:41.979953] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-09-16T17:39:42.063627] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-09-16T17:39:42.063727] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-09-16T17:39:42.064381] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-09-16T17:39:42.064427] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-09-16T17:39:42.065532] [DEBUG] [LOCAL ] BYD: Trimmed 49234 records to 33670 (keeping 150 days of data) [2025-09-16T17:39:42.283249] [DEBUG] [LOCAL ] BYD: Primary data saved (33670 records). [2025-09-16T17:39:42.283414] [INFO ] [MAIN ] BYD: Full history saved. [2025-09-16T17:39:42.283522] [INFO ] [MAIN ] Update Progress: 379/2369 symbols completed. BYD took 29.3s. Estimated remaining: 3h 28m 12s. Rate: 9.6 symbols/min [2025-09-16T17:39:42.454111] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:39:42.468244] [DEBUG] [LOCAL ] CAAP: Loaded 13239 existing records from primary storage. [2025-09-16T17:39:42.468375] [INFO ] [MAIN ] CAAP: Loaded 13239 existing records. [2025-09-16T17:39:42.649493] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:39:42.649742] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-09-16T17:39:42.649819] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-09-16T17:39:42.650267] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-09-16T17:39:42.650337] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-09-16T17:39:42.780000] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-09-16T17:39:42.965897] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-16T17:39:43.000553] [INFO ] [REMOTE ] BYM: Full fetch complete (13107 records). [2025-09-16T17:39:43.021410] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-09-16T17:39:43.021339] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:39:43.378041] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-09-16T17:39:43.378144] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-09-16T17:39:43.378444] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-09-16T17:39:43.378539] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-09-16T17:39:43.379276] [DEBUG] [LOCAL ] BYM: Trimmed 13107 records to 8475 (keeping 150 days of data) [2025-09-16T17:39:43.454164] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-16T17:39:43.474800] [DEBUG] [LOCAL ] BYM: Primary data saved (8475 records). [2025-09-16T17:39:43.474903] [INFO ] [MAIN ] BYM: Full history saved. [2025-09-16T17:39:43.474987] [INFO ] [MAIN ] Update Progress: 380/2369 symbols completed. BYM took 21.6s. Estimated remaining: 3h 27m 39s. Rate: 9.6 symbols/min [2025-09-16T17:39:43.579942] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-09-16T17:39:43.643447] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:39:43.658106] [DEBUG] [LOCAL ] CABO: Loaded 13796 existing records from primary storage. [2025-09-16T17:39:43.658211] [INFO ] [MAIN ] CABO: Loaded 13796 existing records. [2025-09-16T17:39:43.831697] [WARN ] [MAIN ] CABO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:39:43.831944] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-09-16T17:39:43.832012] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-09-16T17:39:43.832394] [DEBUG] [LOCAL ] CABO: Deleted primary data file. [2025-09-16T17:39:43.832439] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-09-16T17:39:44.188069] [INFO ] [REMOTE ] CABO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:39:44.291138] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-16T17:39:44.374881] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-09-16T17:39:44.656606] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-16T17:39:45.174925] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-09-16T17:39:45.433272] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-16T17:39:45.974906] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-09-16T17:39:46.439079] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-16T17:39:46.774899] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-09-16T17:39:47.574880] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-09-16T17:39:47.762759] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-16T17:39:47.864560] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-16T17:39:48.374890] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-09-16T17:39:48.409517] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-16T17:39:49.174928] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-09-16T17:39:49.974911] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-09-16T17:39:50.362202] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-16T17:39:50.417005] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-16T17:39:50.774941] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-09-16T17:39:51.014627] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-16T17:39:51.574906] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-09-16T17:39:51.621804] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-16T17:39:52.374918] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-09-16T17:39:53.174932] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-09-16T17:39:53.504288] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-16T17:39:53.739175] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-16T17:39:53.974974] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-09-16T17:39:54.482664] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-16T17:39:54.774900] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-09-16T17:39:55.574898] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-09-16T17:39:55.997372] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-16T17:39:56.258420] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-16T17:39:56.262766] [INFO ] [REMOTE ] BZH: Full fetch complete (36335 records). [2025-09-16T17:39:56.262861] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-09-16T17:39:56.380000] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-09-16T17:39:56.645681] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-09-16T17:39:56.645761] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-09-16T17:39:56.646240] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-09-16T17:39:56.646280] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-09-16T17:39:56.647113] [DEBUG] [LOCAL ] BZH: Trimmed 36335 records to 24301 (keeping 150 days of data) [2025-09-16T17:39:56.786464] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-16T17:39:56.836363] [DEBUG] [LOCAL ] BZH: Primary data saved (24301 records). [2025-09-16T17:39:56.836547] [INFO ] [MAIN ] BZH: Full history saved. [2025-09-16T17:39:56.836687] [INFO ] [MAIN ] Update Progress: 381/2369 symbols completed. BZH took 26.6s. Estimated remaining: 3h 28m 10s. Rate: 9.5 symbols/min [2025-09-16T17:39:57.020221] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:39:57.038051] [DEBUG] [LOCAL ] CACI: Loaded 16695 existing records from primary storage. [2025-09-16T17:39:57.038260] [INFO ] [MAIN ] CACI: Loaded 16695 existing records. [2025-09-16T17:39:57.187829] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-09-16T17:39:57.226578] [WARN ] [MAIN ] CACI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:39:57.226829] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-09-16T17:39:57.226875] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-09-16T17:39:57.227364] [DEBUG] [LOCAL ] CACI: Deleted primary data file. [2025-09-16T17:39:57.227408] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-09-16T17:39:57.583431] [INFO ] [REMOTE ] CACI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:39:57.597763] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-16T17:39:57.974871] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-09-16T17:39:58.379156] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-16T17:39:58.774916] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-09-16T17:39:59.451526] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-16T17:39:59.538237] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-16T17:39:59.574861] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-09-16T17:40:00.374883] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-09-16T17:40:00.682862] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-16T17:40:01.175095] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-09-16T17:40:01.922022] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-16T17:40:01.974926] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-09-16T17:40:02.774911] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-09-16T17:40:02.955581] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-16T17:40:03.200949] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-16T17:40:03.206834] [INFO ] [REMOTE ] C: Full fetch complete (58031 records). [2025-09-16T17:40:03.206932] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-09-16T17:40:03.207582] [FATAL] [VALIDATOR ] C: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:40:03.207694] [FATAL] [MAIN ] C: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:40:03.207749] [WARN ] [MAIN ] C: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:40:03.207814] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-09-16T17:40:03.207879] [DEBUG] [LOCAL ] C: No primary data file found to delete. [2025-09-16T17:40:03.207917] [INFO ] [LOCAL ] C: Starting deletion of derivative data. [2025-09-16T17:40:03.208229] [DEBUG] [LOCAL ] C: Deleted derivative data file. [2025-09-16T17:40:03.209662] [INFO ] [MAIN ] Update Progress: 382/2369 symbols completed. C took 30.0s. Estimated remaining: 3h 28m 4s. Rate: 9.5 symbols/min [2025-09-16T17:40:03.378317] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:40:03.394853] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-16T17:40:03.432829] [DEBUG] [LOCAL ] CADE: Loaded 36349 existing records from primary storage. [2025-09-16T17:40:03.432965] [INFO ] [MAIN ] CADE: Loaded 36349 existing records. [2025-09-16T17:40:03.577588] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-09-16T17:40:03.610533] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:40:03.610765] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-09-16T17:40:03.610832] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-09-16T17:40:03.611716] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-09-16T17:40:03.611772] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-09-16T17:40:03.965310] [INFO ] [REMOTE ] CADE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:40:04.374891] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-09-16T17:40:05.157820] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-16T17:40:05.174858] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-09-16T17:40:05.211559] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-16T17:40:05.214696] [INFO ] [REMOTE ] CAAP: Full fetch complete (20187 records). [2025-09-16T17:40:05.214768] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-09-16T17:40:05.574741] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-09-16T17:40:05.574824] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-09-16T17:40:05.575179] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-09-16T17:40:05.575220] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-09-16T17:40:05.575801] [DEBUG] [LOCAL ] CAAP: Trimmed 20187 records to 13352 (keeping 150 days of data) [2025-09-16T17:40:05.658872] [DEBUG] [LOCAL ] CAAP: Primary data saved (13352 records). [2025-09-16T17:40:05.659012] [INFO ] [MAIN ] CAAP: Full history saved. [2025-09-16T17:40:05.659105] [INFO ] [MAIN ] Update Progress: 383/2369 symbols completed. CAAP took 23.4s. Estimated remaining: 3h 27m 38s. Rate: 9.6 symbols/min [2025-09-16T17:40:05.829966] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:40:05.858083] [DEBUG] [LOCAL ] CAE: Loaded 28270 existing records from primary storage. [2025-09-16T17:40:05.858272] [INFO ] [MAIN ] CAE: Loaded 28270 existing records. [2025-09-16T17:40:05.980018] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-09-16T17:40:06.040314] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:40:06.040515] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-09-16T17:40:06.040563] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-09-16T17:40:06.041216] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-09-16T17:40:06.041265] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-09-16T17:40:06.403082] [INFO ] [REMOTE ] CAE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:40:06.422613] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-16T17:40:06.774917] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-09-16T17:40:07.195887] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-16T17:40:07.197784] [INFO ] [REMOTE ] CABO: Full fetch complete (19010 records). [2025-09-16T17:40:07.197855] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-09-16T17:40:07.198293] [FATAL] [VALIDATOR ] CABO: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:40:07.198368] [FATAL] [MAIN ] CABO: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:40:07.198404] [WARN ] [MAIN ] CABO: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:40:07.198484] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-09-16T17:40:07.198559] [DEBUG] [LOCAL ] CABO: No primary data file found to delete. [2025-09-16T17:40:07.198597] [INFO ] [LOCAL ] CABO: Starting deletion of derivative data. [2025-09-16T17:40:07.198853] [DEBUG] [LOCAL ] CABO: Deleted derivative data file. [2025-09-16T17:40:07.198930] [INFO ] [MAIN ] Update Progress: 384/2369 symbols completed. CABO took 23.7s. Estimated remaining: 3h 27m 8s. Rate: 9.6 symbols/min [2025-09-16T17:40:07.384785] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:40:07.390525] [DEBUG] [LOCAL ] CAF: Loaded 2269 existing records from primary storage. [2025-09-16T17:40:07.390725] [INFO ] [MAIN ] CAF: Loaded 2269 existing records. [2025-09-16T17:40:07.575793] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-09-16T17:40:07.575616] [WARN ] [MAIN ] CAF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:40:07.577727] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-09-16T17:40:07.577860] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-09-16T17:40:07.578095] [DEBUG] [LOCAL ] CAF: Deleted primary data file. [2025-09-16T17:40:07.578144] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-09-16T17:40:07.944002] [INFO ] [REMOTE ] CAF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:40:08.162707] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-16T17:40:08.374939] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-09-16T17:40:08.756970] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-16T17:40:09.174942] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-09-16T17:40:09.557215] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-16T17:40:09.813260] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-16T17:40:09.974930] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-09-16T17:40:10.411150] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-16T17:40:10.774908] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-09-16T17:40:11.574916] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-09-16T17:40:11.648570] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-16T17:40:12.374928] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-09-16T17:40:13.174962] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-09-16T17:40:13.420758] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-16T17:40:13.445338] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-16T17:40:13.662281] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-16T17:40:13.974909] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-09-16T17:40:14.548439] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-16T17:40:14.774940] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-09-16T17:40:15.218016] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-16T17:40:15.574902] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-09-16T17:40:16.374928] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-09-16T17:40:17.174902] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-09-16T17:40:17.342433] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-16T17:40:17.362764] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-16T17:40:17.365181] [INFO ] [REMOTE ] CACI: Full fetch complete (29391 records). [2025-09-16T17:40:17.365270] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-09-16T17:40:17.365853] [FATAL] [VALIDATOR ] CACI: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:40:17.365945] [FATAL] [MAIN ] CACI: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:40:17.365998] [WARN ] [MAIN ] CACI: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:40:17.366066] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-09-16T17:40:17.366207] [DEBUG] [LOCAL ] CACI: No primary data file found to delete. [2025-09-16T17:40:17.366264] [INFO ] [LOCAL ] CACI: Starting deletion of derivative data. [2025-09-16T17:40:17.366589] [DEBUG] [LOCAL ] CACI: Deleted derivative data file. [2025-09-16T17:40:17.366714] [INFO ] [MAIN ] Update Progress: 385/2369 symbols completed. CACI took 20.5s. Estimated remaining: 3h 27m 21s. Rate: 9.6 symbols/min [2025-09-16T17:40:17.542159] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:40:17.581890] [DEBUG] [LOCAL ] CAG: Loaded 39628 existing records from primary storage. [2025-09-16T17:40:17.582035] [INFO ] [MAIN ] CAG: Loaded 39628 existing records. [2025-09-16T17:40:17.772540] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:40:17.775975] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-16T17:40:17.775815] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-09-16T17:40:17.777408] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-09-16T17:40:17.778386] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-09-16T17:40:17.778437] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-09-16T17:40:17.981529] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-09-16T17:40:18.144388] [INFO ] [REMOTE ] CAG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:40:18.774913] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-09-16T17:40:19.574899] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-09-16T17:40:19.607229] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-16T17:40:19.883032] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-16T17:40:20.374923] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-09-16T17:40:21.174924] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-09-16T17:40:21.486928] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-16T17:40:21.914412] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-16T17:40:21.973194] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-16T17:40:21.982242] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-09-16T17:40:22.482463] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-16T17:40:22.483569] [INFO ] [REMOTE ] CAF: Full fetch complete (3942 records). [2025-09-16T17:40:22.483638] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-09-16T17:40:22.780008] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-09-16T17:40:22.843315] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present. [2025-09-16T17:40:22.843418] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed. [2025-09-16T17:40:22.843611] [INFO ] [MAIN ] CAF: Fetched primary data is valid. [2025-09-16T17:40:22.843777] [DEBUG] [LOCAL ] CAF: Saving primary data. [2025-09-16T17:40:22.844240] [DEBUG] [LOCAL ] CAF: Trimmed 3942 records to 2322 (keeping 150 days of data) [2025-09-16T17:40:22.857948] [DEBUG] [LOCAL ] CAF: Primary data saved (2322 records). [2025-09-16T17:40:22.858014] [INFO ] [MAIN ] CAF: Full history saved. [2025-09-16T17:40:22.858094] [INFO ] [MAIN ] Update Progress: 386/2369 symbols completed. CAF took 15.7s. Estimated remaining: 3h 27m 11s. Rate: 9.6 symbols/min [2025-09-16T17:40:23.035865] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:40:23.081426] [DEBUG] [LOCAL ] CAH: Loaded 37932 existing records from primary storage. [2025-09-16T17:40:23.081596] [INFO ] [MAIN ] CAH: Loaded 37932 existing records. [2025-09-16T17:40:23.266243] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:40:23.266557] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-09-16T17:40:23.266621] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-09-16T17:40:23.267708] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-09-16T17:40:23.267774] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-09-16T17:40:23.580067] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-09-16T17:40:23.645287] [INFO ] [REMOTE ] CAH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:40:24.341326] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-16T17:40:24.374918] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-09-16T17:40:25.174925] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-09-16T17:40:25.294026] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-16T17:40:25.974915] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-09-16T17:40:26.126057] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-16T17:40:26.571988] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-16T17:40:26.774900] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-09-16T17:40:27.574902] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-09-16T17:40:27.714636] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-16T17:40:28.374931] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-09-16T17:40:28.397237] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-16T17:40:29.174926] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-09-16T17:40:29.428882] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-16T17:40:29.892050] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-16T17:40:29.974895] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-09-16T17:40:30.774947] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-09-16T17:40:30.896002] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-16T17:40:31.574934] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-09-16T17:40:31.867168] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-16T17:40:32.371487] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-16T17:40:32.380171] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-09-16T17:40:33.174925] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-09-16T17:40:33.286687] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-16T17:40:33.292832] [INFO ] [REMOTE ] CADE: Full fetch complete (52745 records). [2025-09-16T17:40:33.293024] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-09-16T17:40:33.682262] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-09-16T17:40:33.682343] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-09-16T17:40:33.682998] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-09-16T17:40:33.683052] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-09-16T17:40:33.684185] [DEBUG] [LOCAL ] CADE: Trimmed 52745 records to 36711 (keeping 150 days of data) [2025-09-16T17:40:33.910200] [DEBUG] [LOCAL ] CADE: Primary data saved (36711 records). [2025-09-16T17:40:33.910428] [INFO ] [MAIN ] CADE: Full history saved. [2025-09-16T17:40:33.911804] [INFO ] [MAIN ] Update Progress: 387/2369 symbols completed. CADE took 30.7s. Estimated remaining: 3h 27m 29s. Rate: 9.6 symbols/min [2025-09-16T17:40:33.986692] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-09-16T17:40:34.049702] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-16T17:40:34.131297] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:40:34.164618] [DEBUG] [LOCAL ] CAL: Loaded 31389 existing records from primary storage. [2025-09-16T17:40:34.164805] [INFO ] [MAIN ] CAL: Loaded 31389 existing records. [2025-09-16T17:40:34.392289] [WARN ] [MAIN ] CAL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:40:34.392565] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-09-16T17:40:34.392830] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-09-16T17:40:34.393573] [DEBUG] [LOCAL ] CAL: Deleted primary data file. [2025-09-16T17:40:34.393635] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-09-16T17:40:34.577989] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-16T17:40:34.780001] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-09-16T17:40:34.808184] [INFO ] [REMOTE ] CAL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:40:35.574925] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-09-16T17:40:36.137888] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-16T17:40:36.142344] [INFO ] [REMOTE ] CAE: Full fetch complete (42459 records). [2025-09-16T17:40:36.142454] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-09-16T17:40:36.379497] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-09-16T17:40:36.511576] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (2.52 seconds). [2025-09-16T17:40:36.589012] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-09-16T17:40:36.589106] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-09-16T17:40:36.589709] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-09-16T17:40:36.589759] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-09-16T17:40:36.590858] [DEBUG] [LOCAL ] CAE: Trimmed 42459 records to 28505 (keeping 150 days of data) [2025-09-16T17:40:36.760699] [DEBUG] [LOCAL ] CAE: Primary data saved (28505 records). [2025-09-16T17:40:36.760854] [INFO ] [MAIN ] CAE: Full history saved. [2025-09-16T17:40:36.760942] [INFO ] [MAIN ] Update Progress: 388/2369 symbols completed. CAE took 31.1s. Estimated remaining: 3h 27m 6s. Rate: 9.6 symbols/min [2025-09-16T17:40:36.933717] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:40:36.961831] [DEBUG] [LOCAL ] CALX: Loaded 28396 existing records from primary storage. [2025-09-16T17:40:36.962001] [INFO ] [MAIN ] CALX: Loaded 28396 existing records. [2025-09-16T17:40:37.144781] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:40:37.145170] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-09-16T17:40:37.145229] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-09-16T17:40:37.145940] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-09-16T17:40:37.145995] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-09-16T17:40:37.179309] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-09-16T17:40:37.559206] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-16T17:40:37.564039] [INFO ] [REMOTE ] CALX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:40:37.653343] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-16T17:40:37.974905] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-09-16T17:40:38.774950] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-09-16T17:40:39.337083] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-16T17:40:39.574889] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-09-16T17:40:39.788109] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-16T17:40:40.190062] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-16T17:40:40.374968] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-09-16T17:40:41.126891] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-16T17:40:41.174936] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-09-16T17:40:41.797888] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-16T17:40:41.974964] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-09-16T17:40:42.774933] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-09-16T17:40:42.987630] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-16T17:40:42.994683] [INFO ] [REMOTE ] CAG: Full fetch complete (58335 records). [2025-09-16T17:40:42.994852] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-09-16T17:40:43.396927] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-09-16T17:40:43.397029] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-09-16T17:40:43.397720] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-09-16T17:40:43.397767] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-09-16T17:40:43.399094] [DEBUG] [LOCAL ] CAG: Trimmed 58335 records to 40018 (keeping 150 days of data) [2025-09-16T17:40:43.592102] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-09-16T17:40:43.665254] [DEBUG] [LOCAL ] CAG: Primary data saved (40018 records). [2025-09-16T17:40:43.665392] [INFO ] [MAIN ] CAG: Full history saved. [2025-09-16T17:40:43.665476] [INFO ] [MAIN ] Update Progress: 389/2369 symbols completed. CAG took 26.3s. Estimated remaining: 3h 27m 2s. Rate: 9.6 symbols/min [2025-09-16T17:40:43.844072] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:40:43.864887] [DEBUG] [LOCAL ] CANG: Loaded 20242 existing records from primary storage. [2025-09-16T17:40:43.865039] [INFO ] [MAIN ] CANG: Loaded 20242 existing records. [2025-09-16T17:40:44.047192] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:40:44.047468] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-09-16T17:40:44.047516] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-09-16T17:40:44.048071] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-09-16T17:40:44.048154] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-09-16T17:40:44.413760] [INFO ] [REMOTE ] CANG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:40:44.414109] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-09-16T17:40:44.625160] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-16T17:40:44.667328] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-16T17:40:45.129277] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-16T17:40:45.174906] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-09-16T17:40:45.974936] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-09-16T17:40:46.453041] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-16T17:40:46.774882] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-09-16T17:40:46.827188] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (4.85 seconds). [2025-09-16T17:40:47.515145] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-16T17:40:47.574930] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-09-16T17:40:47.797148] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-16T17:40:48.374975] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-09-16T17:40:48.826584] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-16T17:40:49.174949] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-09-16T17:40:49.974877] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-09-16T17:40:50.012819] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-16T17:40:50.525513] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-16T17:40:50.774958] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-09-16T17:40:51.522834] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-16T17:40:51.574911] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-09-16T17:40:52.194557] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-16T17:40:52.200888] [INFO ] [REMOTE ] CAH: Full fetch complete (56136 records). [2025-09-16T17:40:52.201033] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-09-16T17:40:52.380038] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-09-16T17:40:52.601501] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-09-16T17:40:52.601763] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-09-16T17:40:52.602688] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-09-16T17:40:52.602739] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-09-16T17:40:52.604183] [DEBUG] [LOCAL ] CAH: Trimmed 56136 records to 38301 (keeping 150 days of data) [2025-09-16T17:40:52.853219] [DEBUG] [LOCAL ] CAH: Primary data saved (38301 records). [2025-09-16T17:40:52.853383] [INFO ] [MAIN ] CAH: Full history saved. [2025-09-16T17:40:52.855150] [INFO ] [MAIN ] Update Progress: 390/2369 symbols completed. CAH took 30.0s. Estimated remaining: 3h 27m 11s. Rate: 9.6 symbols/min [2025-09-16T17:40:53.032265] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:40:53.039252] [DEBUG] [LOCAL ] CAPL: Loaded 3877 existing records from primary storage. [2025-09-16T17:40:53.039386] [INFO ] [MAIN ] CAPL: Loaded 3877 existing records. [2025-09-16T17:40:53.185390] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-09-16T17:40:53.224461] [WARN ] [MAIN ] CAPL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:40:53.225975] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-09-16T17:40:53.226086] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-09-16T17:40:53.226615] [DEBUG] [LOCAL ] CAPL: Deleted primary data file. [2025-09-16T17:40:53.226851] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-09-16T17:40:53.441997] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-16T17:40:53.654198] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:40:53.844052] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-16T17:40:53.974928] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-09-16T17:40:54.569562] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-16T17:40:54.774959] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-09-16T17:40:54.950784] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-16T17:40:55.574922] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-09-16T17:40:55.660410] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-16T17:40:56.374916] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-09-16T17:40:56.703589] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-16T17:40:57.171987] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-16T17:40:57.174843] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-09-16T17:40:57.724989] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-16T17:40:57.974948] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-09-16T17:40:58.674081] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-16T17:40:58.774946] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-09-16T17:40:59.574918] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-09-16T17:41:00.242978] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-16T17:41:00.340692] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-16T17:41:00.374890] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-09-16T17:41:01.174902] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-09-16T17:41:01.955514] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-16T17:41:01.974846] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-09-16T17:41:02.533588] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-16T17:41:02.538282] [INFO ] [REMOTE ] CALX: Full fetch complete (41816 records). [2025-09-16T17:41:02.538403] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-09-16T17:41:02.780127] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-09-16T17:41:02.931264] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-09-16T17:41:02.931351] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-09-16T17:41:02.931993] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-09-16T17:41:02.932057] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-09-16T17:41:02.933085] [DEBUG] [LOCAL ] CALX: Trimmed 41816 records to 28624 (keeping 150 days of data) [2025-09-16T17:41:03.106692] [DEBUG] [LOCAL ] CALX: Primary data saved (28624 records). [2025-09-16T17:41:03.106836] [INFO ] [MAIN ] CALX: Full history saved. [2025-09-16T17:41:03.106931] [INFO ] [MAIN ] Update Progress: 391/2369 symbols completed. CALX took 26.3s. Estimated remaining: 3h 27m 25s. Rate: 9.5 symbols/min [2025-09-16T17:41:03.279027] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:41:03.317225] [DEBUG] [LOCAL ] CARR: Loaded 39576 existing records from primary storage. [2025-09-16T17:41:03.317387] [INFO ] [MAIN ] CARR: Loaded 39576 existing records. [2025-09-16T17:41:03.452115] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-16T17:41:03.511365] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:41:03.513880] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-09-16T17:41:03.514067] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-09-16T17:41:03.520147] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-09-16T17:41:03.529041] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-09-16T17:41:03.576693] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-09-16T17:41:03.535975] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-16T17:41:03.635865] [INFO ] [REMOTE ] CAL: Full fetch complete (46971 records). [2025-09-16T17:41:03.647782] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-09-16T17:41:04.164254] [INFO ] [REMOTE ] CARR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:41:04.320257] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-09-16T17:41:04.320487] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-09-16T17:41:04.325982] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-09-16T17:41:04.326611] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-09-16T17:41:04.326886] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-16T17:41:04.330244] [DEBUG] [LOCAL ] CAL: Trimmed 46971 records to 31697 (keeping 150 days of data) [2025-09-16T17:41:04.387465] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-09-16T17:41:04.537306] [DEBUG] [LOCAL ] CAL: Primary data saved (31697 records). [2025-09-16T17:41:04.537461] [INFO ] [MAIN ] CAL: Full history saved. [2025-09-16T17:41:04.537549] [INFO ] [MAIN ] Update Progress: 392/2369 symbols completed. CAL took 30.6s. Estimated remaining: 3h 26m 54s. Rate: 9.6 symbols/min [2025-09-16T17:41:04.712235] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:41:04.740090] [DEBUG] [LOCAL ] CARS: Loaded 28899 existing records from primary storage. [2025-09-16T17:41:04.740248] [INFO ] [MAIN ] CARS: Loaded 28899 existing records. [2025-09-16T17:41:04.917343] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:41:04.917610] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-09-16T17:41:04.917677] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-09-16T17:41:04.918359] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-09-16T17:41:04.918408] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-09-16T17:41:05.175423] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-09-16T17:41:05.189711] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-16T17:41:05.207852] [INFO ] [REMOTE ] CAPL: Full fetch complete (6482 records). [2025-09-16T17:41:05.208790] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-09-16T17:41:05.395487] [INFO ] [REMOTE ] CARS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:41:05.678412] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present. [2025-09-16T17:41:05.678493] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed. [2025-09-16T17:41:05.678740] [INFO ] [MAIN ] CAPL: Fetched primary data is valid. [2025-09-16T17:41:05.678786] [DEBUG] [LOCAL ] CAPL: Saving primary data. [2025-09-16T17:41:05.679209] [DEBUG] [LOCAL ] CAPL: Trimmed 6482 records to 3928 (keeping 150 days of data) [2025-09-16T17:41:05.705351] [DEBUG] [LOCAL ] CAPL: Primary data saved (3928 records). [2025-09-16T17:41:05.705455] [INFO ] [MAIN ] CAPL: Full history saved. [2025-09-16T17:41:05.705547] [INFO ] [MAIN ] Update Progress: 393/2369 symbols completed. CAPL took 12.9s. Estimated remaining: 3h 26m 22s. Rate: 9.6 symbols/min [2025-09-16T17:41:05.880846] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:41:05.921392] [DEBUG] [LOCAL ] CAT: Loaded 39023 existing records from primary storage. [2025-09-16T17:41:05.921536] [INFO ] [MAIN ] CAT: Loaded 39023 existing records. [2025-09-16T17:41:05.985895] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-09-16T17:41:06.104982] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:41:06.105233] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-09-16T17:41:06.105287] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-09-16T17:41:06.106198] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-09-16T17:41:06.106258] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-09-16T17:41:06.475173] [INFO ] [REMOTE ] CAT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:41:06.774851] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-09-16T17:41:07.071269] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-16T17:41:07.574906] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-09-16T17:41:07.607920] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-16T17:41:08.374901] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-09-16T17:41:08.738717] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-16T17:41:09.174909] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-09-16T17:41:09.335057] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-16T17:41:09.902216] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-16T17:41:09.974977] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-09-16T17:41:10.545869] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-16T17:41:10.774944] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-09-16T17:41:11.574921] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-09-16T17:41:12.000880] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-16T17:41:12.083903] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-16T17:41:12.374910] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-09-16T17:41:13.174921] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-09-16T17:41:13.591781] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-16T17:41:13.926103] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-09-16T17:41:13.974874] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-09-16T17:41:14.294867] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-16T17:41:14.774941] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-09-16T17:41:15.574903] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-09-16T17:41:16.315018] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-16T17:41:16.352510] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-16T17:41:16.374859] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-09-16T17:41:17.174875] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-09-16T17:41:17.288037] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-16T17:41:17.685325] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-16T17:41:17.974935] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-09-16T17:41:18.359815] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-16T17:41:18.364053] [INFO ] [REMOTE ] CANG: Full fetch complete (29124 records). [2025-09-16T17:41:18.364160] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-09-16T17:41:18.736997] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-09-16T17:41:18.737077] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-09-16T17:41:18.737520] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-09-16T17:41:18.737564] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-09-16T17:41:18.738331] [DEBUG] [LOCAL ] CANG: Trimmed 29124 records to 20458 (keeping 150 days of data) [2025-09-16T17:41:18.784334] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-09-16T17:41:18.856178] [DEBUG] [LOCAL ] CANG: Primary data saved (20458 records). [2025-09-16T17:41:18.856303] [INFO ] [MAIN ] CANG: Full history saved. [2025-09-16T17:41:18.856396] [INFO ] [MAIN ] Update Progress: 394/2369 symbols completed. CANG took 35.2s. Estimated remaining: 3h 26m 50s. Rate: 9.5 symbols/min [2025-09-16T17:41:19.046281] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:41:19.053300] [DEBUG] [LOCAL ] CATO: Loaded 5040 existing records from primary storage. [2025-09-16T17:41:19.053460] [INFO ] [MAIN ] CATO: Loaded 5040 existing records. [2025-09-16T17:41:19.251006] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:41:19.251236] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-09-16T17:41:19.251281] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-09-16T17:41:19.251593] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-09-16T17:41:19.251640] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-09-16T17:41:19.580145] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-09-16T17:41:19.640195] [INFO ] [REMOTE ] CATO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:41:20.235783] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-16T17:41:20.312331] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-16T17:41:20.374894] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-09-16T17:41:21.174940] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-09-16T17:41:21.409808] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-16T17:41:21.731443] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-16T17:41:21.736536] [INFO ] [REMOTE ] CARS: Full fetch complete (43611 records). [2025-09-16T17:41:21.736715] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-09-16T17:41:21.984473] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-09-16T17:41:22.119365] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-09-16T17:41:22.119476] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-09-16T17:41:22.120132] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-09-16T17:41:22.122957] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-09-16T17:41:22.126278] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-16T17:41:22.128926] [DEBUG] [LOCAL ] CARS: Trimmed 43611 records to 29216 (keeping 150 days of data) [2025-09-16T17:41:22.303948] [DEBUG] [LOCAL ] CARS: Primary data saved (29216 records). [2025-09-16T17:41:22.304096] [INFO ] [MAIN ] CARS: Full history saved. [2025-09-16T17:41:22.304200] [INFO ] [MAIN ] Update Progress: 395/2369 symbols completed. CARS took 17.8s. Estimated remaining: 3h 26m 30s. Rate: 9.6 symbols/min [2025-09-16T17:41:22.472602] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:41:22.472807] [DEBUG] [LOCAL ] CAVA: No existing data file found in primary storage. [2025-09-16T17:41:22.472844] [WARN ] [MAIN ] CAVA: No existing data found, performing full refresh instead. [2025-09-16T17:41:22.473013] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-09-16T17:41:22.473062] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-09-16T17:41:22.473106] [DEBUG] [LOCAL ] CAVA: No primary data file found to delete. [2025-09-16T17:41:22.473139] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-09-16T17:41:22.779963] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-09-16T17:41:22.830544] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:41:23.574886] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-09-16T17:41:23.703306] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-16T17:41:24.037130] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-16T17:41:24.374900] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-09-16T17:41:25.174921] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-09-16T17:41:25.702171] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-16T17:41:25.721606] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-16T17:41:25.974875] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-09-16T17:41:26.049399] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-16T17:41:26.616274] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-16T17:41:26.774885] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-09-16T17:41:27.574905] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-09-16T17:41:28.100732] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-16T17:41:28.374903] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-09-16T17:41:28.801440] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-16T17:41:29.174905] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-09-16T17:41:29.974898] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-09-16T17:41:30.495433] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-16T17:41:30.621876] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-16T17:41:30.774886] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-09-16T17:41:31.111669] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-16T17:41:31.574897] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-09-16T17:41:32.374873] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-09-16T17:41:32.549579] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-16T17:41:33.061545] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-16T17:41:33.069025] [INFO ] [REMOTE ] CARR: Full fetch complete (58278 records). [2025-09-16T17:41:33.069158] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-09-16T17:41:33.177150] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-09-16T17:41:33.236986] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-16T17:41:33.462867] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-09-16T17:41:33.462951] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-09-16T17:41:33.463682] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-09-16T17:41:33.463728] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-09-16T17:41:33.465240] [DEBUG] [LOCAL ] CARR: Trimmed 58278 records to 39965 (keeping 150 days of data) [2025-09-16T17:41:33.713014] [DEBUG] [LOCAL ] CARR: Primary data saved (39965 records). [2025-09-16T17:41:33.713172] [INFO ] [MAIN ] CARR: Full history saved. [2025-09-16T17:41:33.713285] [INFO ] [MAIN ] Update Progress: 396/2369 symbols completed. CARR took 30.6s. Estimated remaining: 3h 26m 49s. Rate: 9.5 symbols/min [2025-09-16T17:41:33.887531] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:41:33.887761] [DEBUG] [LOCAL ] CB: No existing data file found in primary storage. [2025-09-16T17:41:33.887801] [WARN ] [MAIN ] CB: No existing data found, performing full refresh instead. [2025-09-16T17:41:33.887992] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-09-16T17:41:33.888048] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-09-16T17:41:33.888092] [DEBUG] [LOCAL ] CB: No primary data file found to delete. [2025-09-16T17:41:33.888126] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-09-16T17:41:33.984213] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-09-16T17:41:34.253894] [INFO ] [REMOTE ] CB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:41:34.718092] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-16T17:41:34.719904] [INFO ] [REMOTE ] CATO: Full fetch complete (8206 records). [2025-09-16T17:41:34.719973] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-09-16T17:41:34.782616] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-09-16T17:41:35.086257] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-09-16T17:41:35.086378] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-09-16T17:41:35.086711] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-09-16T17:41:35.086974] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-09-16T17:41:35.087736] [DEBUG] [LOCAL ] CATO: Trimmed 8206 records to 5079 (keeping 150 days of data) [2025-09-16T17:41:35.118421] [DEBUG] [LOCAL ] CATO: Primary data saved (5079 records). [2025-09-16T17:41:35.118730] [INFO ] [MAIN ] CATO: Full history saved. [2025-09-16T17:41:35.118936] [INFO ] [MAIN ] Update Progress: 397/2369 symbols completed. CATO took 16.3s. Estimated remaining: 3h 26m 19s. Rate: 9.6 symbols/min [2025-09-16T17:41:35.188929] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-16T17:41:35.574933] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-09-16T17:41:36.374906] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-09-16T17:41:36.882181] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-16T17:41:36.889807] [INFO ] [REMOTE ] CAT: Full fetch complete (57567 records). [2025-09-16T17:41:36.889957] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-09-16T17:41:37.278927] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-09-16T17:41:37.279020] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-09-16T17:41:37.280293] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-09-16T17:41:37.280347] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-09-16T17:41:37.281764] [DEBUG] [LOCAL ] CAT: Trimmed 57567 records to 39407 (keeping 150 days of data) [2025-09-16T17:41:37.538704] [DEBUG] [LOCAL ] CAT: Primary data saved (39407 records). [2025-09-16T17:41:37.538860] [INFO ] [MAIN ] CAT: Full history saved. [2025-09-16T17:41:37.540020] [INFO ] [MAIN ] Update Progress: 398/2369 symbols completed. CAT took 31.8s. Estimated remaining: 3h 25m 53s. Rate: 9.6 symbols/min [2025-09-16T17:41:37.698527] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-16T17:41:37.709914] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-09-16T17:41:38.150749] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-16T17:41:38.160713] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-09-16T17:41:39.616952] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-16T17:41:39.628127] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-09-16T17:41:39.762842] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-16T17:41:39.773379] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-09-16T17:41:41.440063] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-16T17:41:41.451821] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-09-16T17:41:41.743943] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-16T17:41:41.756756] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-09-16T17:41:43.007521] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-16T17:41:43.018287] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-09-16T17:41:43.794851] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-16T17:41:43.806302] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-09-16T17:41:44.740365] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-16T17:41:44.750680] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-09-16T17:41:45.501612] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-16T17:41:45.507827] [INFO ] [REMOTE ] CAVA: Full fetch complete (57819 records). [2025-09-16T17:41:45.507950] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-09-16T17:41:45.508739] [FATAL] [VALIDATOR ] CAVA: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:41:45.508827] [FATAL] [MAIN ] CAVA: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:41:45.508879] [WARN ] [MAIN ] CAVA: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:41:45.508945] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-09-16T17:41:45.509029] [DEBUG] [LOCAL ] CAVA: No primary data file found to delete. [2025-09-16T17:41:45.509081] [INFO ] [LOCAL ] CAVA: Starting deletion of derivative data. [2025-09-16T17:41:45.509150] [DEBUG] [LOCAL ] CAVA: No derivative data file found to delete. [2025-09-16T17:41:45.509250] [INFO ] [MAIN ] Update Progress: 399/2369 symbols completed. CAVA took 23.2s. Estimated remaining: 3h 25m 55s. Rate: 9.6 symbols/min [2025-09-16T17:41:46.658812] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-16T17:41:46.670157] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-09-16T17:41:48.727131] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-16T17:41:48.738068] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-09-16T17:41:50.852798] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-16T17:41:50.858879] [INFO ] [REMOTE ] CB: Full fetch complete (54403 records). [2025-09-16T17:41:50.859021] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-09-16T17:41:51.233166] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-09-16T17:41:51.233249] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-09-16T17:41:51.233909] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-09-16T17:41:51.233957] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-09-16T17:41:51.235092] [DEBUG] [LOCAL ] CB: Trimmed 54403 records to 37022 (keeping 150 days of data) [2025-09-16T17:41:51.479624] [DEBUG] [LOCAL ] CB: Primary data saved (37022 records). [2025-09-16T17:41:51.479799] [INFO ] [MAIN ] CB: Full history saved. [2025-09-16T17:41:51.479896] [INFO ] [MAIN ] Update Progress: 400/2369 symbols completed. CB took 17.8s. Estimated remaining: 3h 25m 48s. Rate: 9.6 symbols/min [2025-09-16T17:41:52.092095] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:41:52.211187] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-09-16T17:41:52.212102] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:41:52.212940] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:41:52.208152] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:41:52.213898] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-09-16T17:41:52.215182] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-09-16T17:41:52.215231] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-16T17:41:52.215279] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-16T17:41:52.215326] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-09-16T17:41:52.308601] [DEBUG] [LOCAL ] CBNA: Loaded 2270 existing records from primary storage. [2025-09-16T17:41:52.317187] [INFO ] [MAIN ] CBNA: Loaded 2270 existing records. [2025-09-16T17:41:52.343853] [DEBUG] [LOCAL ] CBAN: Loaded 7399 existing records from primary storage. [2025-09-16T17:41:52.356541] [INFO ] [MAIN ] CBAN: Loaded 7399 existing records. [2025-09-16T17:41:52.380700] [DEBUG] [LOCAL ] CBL: Loaded 11888 existing records from primary storage. [2025-09-16T17:41:52.449432] [INFO ] [MAIN ] CBL: Loaded 11888 existing records. [2025-09-16T17:41:52.968610] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:41:53.069573] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-09-16T17:41:53.126930] [INFO ] [REMOTE ] CBO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:41:53.158684] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-02. [2025-09-16T17:41:53.151577] [WARN ] [MAIN ] CBAN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:41:53.151714] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-09-16T17:41:53.179175] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-09-16T17:41:53.180534] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-09-16T17:41:53.178925] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:41:53.180791] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-09-16T17:41:53.180975] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-09-16T17:41:53.180879] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-09-16T17:41:53.192043] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-09-16T17:41:53.192110] [DEBUG] [LOCAL ] CBAN: Deleted primary data file. [2025-09-16T17:41:53.210488] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-09-16T17:41:53.222208] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-09-16T17:41:53.222035] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-09-16T17:41:53.458250] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:41:53.495592] [WARN ] [REMOTE ] CBO: No data returned for month 2025-02 [2025-09-16T17:41:53.499987] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-03. [2025-09-16T17:41:54.146227] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-16T17:41:54.184399] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-04. [2025-09-16T17:41:54.214670] [INFO ] [REMOTE ] CBL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:41:54.248721] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:41:54.265190] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-09-16T17:41:54.284173] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-09-16T17:41:54.304083] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:41:54.305395] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-09-16T17:41:54.464325] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-09-16T17:41:54.465236] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-05. [2025-09-16T17:41:54.865359] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-16T17:41:54.866632] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-09-16T17:41:55.052881] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-16T17:41:55.055872] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-09-16T17:41:55.160481] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-09-16T17:41:55.161849] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-09-16T17:41:55.169017] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-16T17:41:55.171207] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-06. [2025-09-16T17:41:55.185132] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-16T17:41:55.189607] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-09-16T17:41:55.451387] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-16T17:41:55.574868] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-07. [2025-09-16T17:41:55.619038] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-16T17:41:56.023012] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-16T17:41:56.034333] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-16T17:41:56.062622] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-16T17:41:56.374921] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-09-16T17:41:56.910627] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-16T17:41:57.174912] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-09-16T17:41:57.974892] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-09-16T17:41:58.243133] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-16T17:41:58.529040] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-16T17:41:58.774904] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-09-16T17:41:59.208858] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-16T17:41:59.574906] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-09-16T17:42:00.374904] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-09-16T17:42:00.403619] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-16T17:42:01.031831] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-16T17:42:01.174898] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-09-16T17:42:01.767543] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-16T17:42:01.768687] [INFO ] [REMOTE ] CBNA: Full fetch complete (3176 records). [2025-09-16T17:42:01.768762] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-09-16T17:42:01.984739] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-08. [2025-09-16T17:42:02.166414] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-09-16T17:42:02.166502] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-09-16T17:42:02.166618] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-09-16T17:42:02.166674] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-09-16T17:42:02.167048] [DEBUG] [LOCAL ] CBNA: Trimmed 3176 records to 2286 (keeping 150 days of data) [2025-09-16T17:42:02.181463] [DEBUG] [LOCAL ] CBNA: Primary data saved (2286 records). [2025-09-16T17:42:02.181585] [INFO ] [MAIN ] CBNA: Full history saved. [2025-09-16T17:42:02.181703] [INFO ] [MAIN ] Update Progress: 401/2369 symbols completed. CBNA took 10.7s. Estimated remaining: 3h 26m 3s. Rate: 9.6 symbols/min [2025-09-16T17:42:02.291620] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:42:02.313043] [WARN ] [REMOTE ] CBO: No data returned for month 2025-08 [2025-09-16T17:42:02.367496] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:42:02.408804] [DEBUG] [LOCAL ] CBRE: Loaded 37044 existing records from primary storage. [2025-09-16T17:42:02.408953] [INFO ] [MAIN ] CBRE: Loaded 37044 existing records. [2025-09-16T17:42:02.590769] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:42:02.591025] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-09-16T17:42:02.591071] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-09-16T17:42:02.591974] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-09-16T17:42:02.592024] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-09-16T17:42:02.783144] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-09-16T17:42:02.954884] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:42:03.574946] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-09. [2025-09-16T17:42:03.697512] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-16T17:42:03.941223] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:42:03.941736] [WARN ] [REMOTE ] CBO: No data returned for month 2025-09 [2025-09-16T17:42:03.941839] [INFO ] [REMOTE ] CBO: Full fetch complete (1016 records). [2025-09-16T17:42:03.941959] [DEBUG] [VALIDATOR ] CBO: Validating primary data. [2025-09-16T17:42:03.942791] [FATAL] [VALIDATOR ] CBO: Data is stale - most recent date (2025-07-10) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:42:03.942866] [FATAL] [MAIN ] CBO: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:42:03.942903] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:42:03.942961] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-16T17:42:03.943042] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-16T17:42:03.943082] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-09-16T17:42:03.943132] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-09-16T17:42:03.943202] [INFO ] [MAIN ] Update Progress: 402/2369 symbols completed. CBO took 12.5s. Estimated remaining: 3h 25m 35s. Rate: 9.6 symbols/min [2025-09-16T17:42:04.127129] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:42:04.152943] [DEBUG] [LOCAL ] CBT: Loaded 22706 existing records from primary storage. [2025-09-16T17:42:04.153142] [INFO ] [MAIN ] CBT: Loaded 22706 existing records. [2025-09-16T17:42:04.347628] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:42:04.347963] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-09-16T17:42:04.348016] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-09-16T17:42:04.348725] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-09-16T17:42:04.348786] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-09-16T17:42:04.380568] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-09-16T17:42:04.736549] [INFO ] [REMOTE ] CBT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:42:05.174886] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-09-16T17:42:05.372634] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-16T17:42:05.974908] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-09-16T17:42:06.253155] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-16T17:42:06.486537] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-16T17:42:06.774892] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-09-16T17:42:07.574864] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-09-16T17:42:07.597764] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-16T17:42:08.374909] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-09-16T17:42:09.064242] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-16T17:42:09.174953] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-09-16T17:42:09.974914] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-09-16T17:42:10.125147] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-16T17:42:10.590273] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-16T17:42:10.749032] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-16T17:42:10.774852] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-09-16T17:42:11.574918] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-09-16T17:42:11.599027] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-16T17:42:11.600548] [INFO ] [REMOTE ] CBAN: Full fetch complete (12304 records). [2025-09-16T17:42:11.600658] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-09-16T17:42:11.972786] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-09-16T17:42:11.972945] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-09-16T17:42:11.973275] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-09-16T17:42:11.973323] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-09-16T17:42:11.974040] [DEBUG] [LOCAL ] CBAN: Trimmed 12304 records to 7457 (keeping 150 days of data) [2025-09-16T17:42:12.025025] [DEBUG] [LOCAL ] CBAN: Primary data saved (7457 records). [2025-09-16T17:42:12.025179] [INFO ] [MAIN ] CBAN: Full history saved. [2025-09-16T17:42:12.025281] [INFO ] [MAIN ] Update Progress: 403/2369 symbols completed. CBAN took 20.5s. Estimated remaining: 3h 25m 37s. Rate: 9.6 symbols/min [2025-09-16T17:42:12.199191] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:42:12.219303] [DEBUG] [LOCAL ] CBU: Loaded 16204 existing records from primary storage. [2025-09-16T17:42:12.219490] [INFO ] [MAIN ] CBU: Loaded 16204 existing records. [2025-09-16T17:42:12.375935] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-09-16T17:42:12.394403] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:42:12.395541] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-09-16T17:42:12.395590] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-09-16T17:42:12.396126] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-09-16T17:42:12.396242] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-09-16T17:42:12.746272] [INFO ] [REMOTE ] CBU: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:42:12.794908] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-16T17:42:13.174898] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-09-16T17:42:13.930766] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-16T17:42:13.953263] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-16T17:42:13.974855] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-09-16T17:42:14.774902] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-09-16T17:42:15.166281] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-16T17:42:15.574930] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-09-16T17:42:16.374883] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-09-16T17:42:16.627817] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-16T17:42:16.668031] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-16T17:42:17.174947] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-09-16T17:42:17.588882] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-16T17:42:17.783049] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-16T17:42:17.974899] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-09-16T17:42:18.774915] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-09-16T17:42:19.192856] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-16T17:42:19.574912] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-09-16T17:42:20.374873] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-09-16T17:42:20.766454] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-16T17:42:20.804356] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-16T17:42:21.174950] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-09-16T17:42:21.509041] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-16T17:42:21.974952] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-09-16T17:42:22.396379] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-16T17:42:22.774960] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-09-16T17:42:22.806743] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-16T17:42:22.809050] [INFO ] [REMOTE ] CBL: Full fetch complete (18646 records). [2025-09-16T17:42:22.809168] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-09-16T17:42:23.180164] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-09-16T17:42:23.180248] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-09-16T17:42:23.180605] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-09-16T17:42:23.180662] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-09-16T17:42:23.181268] [DEBUG] [LOCAL ] CBL: Trimmed 18646 records to 11971 (keeping 150 days of data) [2025-09-16T17:42:23.259340] [DEBUG] [LOCAL ] CBL: Primary data saved (11971 records). [2025-09-16T17:42:23.259518] [INFO ] [MAIN ] CBL: Full history saved. [2025-09-16T17:42:23.259618] [INFO ] [MAIN ] Update Progress: 404/2369 symbols completed. CBL took 31.8s. Estimated remaining: 3h 25m 55s. Rate: 9.5 symbols/min [2025-09-16T17:42:23.439899] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:42:23.440133] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-09-16T17:42:23.440186] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-09-16T17:42:23.440325] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-09-16T17:42:23.440370] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-16T17:42:23.440414] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-16T17:42:23.440447] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-09-16T17:42:23.588048] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-09-16T17:42:23.859780] [INFO ] [REMOTE ] CBX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:42:23.869675] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-16T17:42:24.374949] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-09-16T17:42:24.769743] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-16T17:42:25.174910] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-02. [2025-09-16T17:42:25.515576] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:42:25.515923] [WARN ] [REMOTE ] CBX: No data returned for month 2025-02 [2025-09-16T17:42:25.977560] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-09-16T17:42:25.983663] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-16T17:42:26.774883] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-09-16T17:42:26.840711] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-16T17:42:26.844483] [INFO ] [REMOTE ] CBT: Full fetch complete (34453 records). [2025-09-16T17:42:26.844582] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-09-16T17:42:27.211338] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-09-16T17:42:27.211416] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-09-16T17:42:27.211920] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-09-16T17:42:27.211999] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-09-16T17:42:27.212787] [DEBUG] [LOCAL ] CBT: Trimmed 34453 records to 22881 (keeping 150 days of data) [2025-09-16T17:42:27.356163] [DEBUG] [LOCAL ] CBT: Primary data saved (22881 records). [2025-09-16T17:42:27.356295] [INFO ] [MAIN ] CBT: Full history saved. [2025-09-16T17:42:27.356379] [INFO ] [MAIN ] Update Progress: 405/2369 symbols completed. CBT took 23.4s. Estimated remaining: 3h 25m 38s. Rate: 9.6 symbols/min [2025-09-16T17:42:27.527016] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:42:27.549676] [DEBUG] [LOCAL ] CBZ: Loaded 24586 existing records from primary storage. [2025-09-16T17:42:27.549801] [INFO ] [MAIN ] CBZ: Loaded 24586 existing records. [2025-09-16T17:42:27.580564] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-03. [2025-09-16T17:42:27.734821] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:42:27.735037] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-09-16T17:42:27.735092] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-09-16T17:42:27.735765] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-09-16T17:42:27.735821] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-09-16T17:42:27.896734] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:42:27.961930] [WARN ] [REMOTE ] CBX: No data returned for month 2025-03 [2025-09-16T17:42:28.102370] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:42:28.247286] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-16T17:42:28.374858] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-09-16T17:42:29.174906] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-09-16T17:42:29.618901] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-16T17:42:29.625039] [INFO ] [REMOTE ] CBRE: Full fetch complete (55221 records). [2025-09-16T17:42:29.625149] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-09-16T17:42:29.980051] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-09-16T17:42:30.021108] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-09-16T17:42:30.021194] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-09-16T17:42:30.021870] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-09-16T17:42:30.021915] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-09-16T17:42:30.023032] [DEBUG] [LOCAL ] CBRE: Trimmed 55221 records to 37405 (keeping 150 days of data) [2025-09-16T17:42:30.255259] [DEBUG] [LOCAL ] CBRE: Primary data saved (37405 records). [2025-09-16T17:42:30.255497] [INFO ] [MAIN ] CBRE: Full history saved. [2025-09-16T17:42:30.257564] [INFO ] [MAIN ] Update Progress: 406/2369 symbols completed. CBRE took 28.1s. Estimated remaining: 3h 25m 16s. Rate: 9.6 symbols/min [2025-09-16T17:42:30.364387] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-16T17:42:30.449314] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:42:30.492753] [DEBUG] [LOCAL ] CC: Loaded 39175 existing records from primary storage. [2025-09-16T17:42:30.492891] [INFO ] [MAIN ] CC: Loaded 39175 existing records. [2025-09-16T17:42:30.666714] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:42:30.666966] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-09-16T17:42:30.667031] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-09-16T17:42:30.667947] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-09-16T17:42:30.667996] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-09-16T17:42:30.780026] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-04. [2025-09-16T17:42:31.021994] [INFO ] [REMOTE ] CC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:42:31.033667] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-16T17:42:31.263699] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:42:31.264019] [WARN ] [REMOTE ] CBX: No data returned for month 2025-04 [2025-09-16T17:42:31.574905] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-09-16T17:42:32.374892] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-09-16T17:42:32.888997] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-16T17:42:33.175001] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-09-16T17:42:33.356821] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-16T17:42:33.960275] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-16T17:42:33.974877] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-09-16T17:42:34.774915] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-09-16T17:42:34.933606] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-16T17:42:35.574899] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-09-16T17:42:35.865260] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-16T17:42:36.374899] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-09-16T17:42:37.103467] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-16T17:42:37.174853] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-09-16T17:42:37.273487] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-16T17:42:37.974913] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-05. [2025-09-16T17:42:38.508349] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-16T17:42:38.669122] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-16T17:42:38.774888] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-09-16T17:42:39.574949] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-06. [2025-09-16T17:42:39.803770] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-09-16T17:42:40.106247] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-16T17:42:40.374903] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-09-16T17:42:41.175460] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-09-16T17:42:41.974963] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-07. [2025-09-16T17:42:42.135100] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-16T17:42:42.183131] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-07 (0.21 seconds). [2025-09-16T17:42:42.491134] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-16T17:42:42.495260] [INFO ] [REMOTE ] CBU: Full fetch complete (24372 records). [2025-09-16T17:42:42.495394] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-09-16T17:42:42.780120] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-09-16T17:42:42.934201] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-09-16T17:42:42.934390] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-09-16T17:42:42.935027] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-09-16T17:42:42.935082] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-09-16T17:42:42.936318] [DEBUG] [LOCAL ] CBU: Trimmed 24372 records to 16385 (keeping 150 days of data) [2025-09-16T17:42:43.041406] [DEBUG] [LOCAL ] CBU: Primary data saved (16385 records). [2025-09-16T17:42:43.041582] [INFO ] [MAIN ] CBU: Full history saved. [2025-09-16T17:42:43.041705] [INFO ] [MAIN ] Update Progress: 407/2369 symbols completed. CBU took 31.0s. Estimated remaining: 3h 25m 41s. Rate: 9.5 symbols/min [2025-09-16T17:42:43.219250] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:42:43.262724] [DEBUG] [LOCAL ] CCI: Loaded 39172 existing records from primary storage. [2025-09-16T17:42:43.262887] [INFO ] [MAIN ] CCI: Loaded 39172 existing records. [2025-09-16T17:42:43.450842] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:42:43.451080] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-09-16T17:42:43.451139] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-09-16T17:42:43.452120] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-09-16T17:42:43.452169] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-09-16T17:42:43.580057] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-08. [2025-09-16T17:42:43.818840] [INFO ] [REMOTE ] CCI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:42:43.888357] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:42:43.888725] [WARN ] [REMOTE ] CBX: No data returned for month 2025-08 [2025-09-16T17:42:44.374881] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-09-16T17:42:44.480470] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-16T17:42:45.174941] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-09. [2025-09-16T17:42:45.644694] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:42:45.645008] [WARN ] [REMOTE ] CBX: No data returned for month 2025-09 [2025-09-16T17:42:45.645091] [INFO ] [REMOTE ] CBX: Full fetch complete (1040 records). [2025-09-16T17:42:45.645156] [DEBUG] [VALIDATOR ] CBX: Validating primary data. [2025-09-16T17:42:45.645772] [FATAL] [VALIDATOR ] CBX: Data is stale - most recent date (2025-07-02) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:42:45.645843] [FATAL] [MAIN ] CBX: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:42:45.645880] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:42:45.645924] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-16T17:42:45.645980] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-16T17:42:45.646014] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-09-16T17:42:45.646054] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-09-16T17:42:45.646111] [INFO ] [MAIN ] Update Progress: 408/2369 symbols completed. CBX took 22.4s. Estimated remaining: 3h 25m 17s. Rate: 9.6 symbols/min [2025-09-16T17:42:45.821517] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:42:45.821775] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-09-16T17:42:45.821960] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-09-16T17:42:45.822157] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-09-16T17:42:45.822232] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-16T17:42:45.822285] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-09-16T17:42:45.822375] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-09-16T17:42:45.979345] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-09-16T17:42:46.218682] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:42:46.221094] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-16T17:42:46.774918] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-09-16T17:42:47.479933] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-16T17:42:47.574923] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-09-16T17:42:47.789187] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-16T17:42:47.913114] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-16T17:42:48.374923] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-09-16T17:42:48.685840] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-16T17:42:49.174919] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-09-16T17:42:49.974914] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-09-16T17:42:50.564529] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-16T17:42:50.774936] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-09-16T17:42:51.574915] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-09-16T17:42:51.622532] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-16T17:42:51.629104] [INFO ] [REMOTE ] CC: Full fetch complete (57587 records). [2025-09-16T17:42:51.629229] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-09-16T17:42:52.006365] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-09-16T17:42:52.006449] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-09-16T17:42:52.007177] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-09-16T17:42:52.007223] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-09-16T17:42:52.008420] [DEBUG] [LOCAL ] CC: Trimmed 57587 records to 39560 (keeping 150 days of data) [2025-09-16T17:42:52.266530] [DEBUG] [LOCAL ] CC: Primary data saved (39560 records). [2025-09-16T17:42:52.266811] [INFO ] [MAIN ] CC: Full history saved. [2025-09-16T17:42:52.266917] [INFO ] [MAIN ] Update Progress: 409/2369 symbols completed. CC took 22.0s. Estimated remaining: 3h 25m 12s. Rate: 9.6 symbols/min [2025-09-16T17:42:52.382603] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-09-16T17:42:52.478332] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-16T17:42:52.480783] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:42:52.503681] [DEBUG] [LOCAL ] CCIF: Loaded 11217 existing records from primary storage. [2025-09-16T17:42:52.503827] [INFO ] [MAIN ] CCIF: Loaded 11217 existing records. [2025-09-16T17:42:52.678603] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:42:52.678880] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-09-16T17:42:52.678927] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-09-16T17:42:52.679320] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-09-16T17:42:52.679379] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-09-16T17:42:52.767420] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-16T17:42:53.049512] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:42:53.072224] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-16T17:42:53.174903] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-09-16T17:42:53.974904] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-09-16T17:42:54.380755] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-16T17:42:54.774892] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-09-16T17:42:55.009202] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-16T17:42:55.574905] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-09-16T17:42:55.896381] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-16T17:42:55.901495] [INFO ] [REMOTE ] CBZ: Full fetch complete (35525 records). [2025-09-16T17:42:55.901595] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-09-16T17:42:56.198875] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-16T17:42:56.295976] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-09-16T17:42:56.296069] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-09-16T17:42:56.296548] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-09-16T17:42:56.296591] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-09-16T17:42:56.297580] [DEBUG] [LOCAL ] CBZ: Trimmed 35525 records to 24900 (keeping 150 days of data) [2025-09-16T17:42:56.384288] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-09-16T17:42:56.448505] [DEBUG] [LOCAL ] CBZ: Primary data saved (24900 records). [2025-09-16T17:42:56.448653] [INFO ] [MAIN ] CBZ: Full history saved. [2025-09-16T17:42:56.448741] [INFO ] [MAIN ] Update Progress: 410/2369 symbols completed. CBZ took 29.1s. Estimated remaining: 3h 24m 56s. Rate: 9.6 symbols/min [2025-09-16T17:42:56.618789] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:42:56.657413] [DEBUG] [LOCAL ] CCJ: Loaded 39663 existing records from primary storage. [2025-09-16T17:42:56.657560] [INFO ] [MAIN ] CCJ: Loaded 39663 existing records. [2025-09-16T17:42:56.763384] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-16T17:42:56.839417] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:42:56.839660] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-09-16T17:42:56.839708] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-09-16T17:42:56.840595] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-09-16T17:42:56.840667] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-09-16T17:42:57.178030] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-09-16T17:42:57.198633] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:42:57.967150] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-16T17:42:57.974856] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-09-16T17:42:58.774876] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-09-16T17:42:58.874291] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-16T17:42:59.574913] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-09-16T17:43:00.348730] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-16T17:43:00.374843] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-09-16T17:43:00.890685] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-16T17:43:01.174932] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-09-16T17:43:01.720688] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-16T17:43:01.916736] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-16T17:43:01.974909] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-09-16T17:43:02.774907] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-09-16T17:43:03.574904] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-09-16T17:43:03.799986] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-16T17:43:03.939064] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-16T17:43:04.374889] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-09-16T17:43:05.014380] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-09-16T17:43:05.174858] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-09-16T17:43:05.433979] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-16T17:43:05.974905] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-09-16T17:43:06.722874] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-16T17:43:06.774893] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-09-16T17:43:07.107500] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-16T17:43:07.574905] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-09-16T17:43:07.772159] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-16T17:43:08.374893] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-09-16T17:43:09.174881] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-09-16T17:43:09.226491] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-16T17:43:09.228759] [INFO ] [REMOTE ] CCIF: Full fetch complete (16495 records). [2025-09-16T17:43:09.228834] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-09-16T17:43:09.619617] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-09-16T17:43:09.634103] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-09-16T17:43:09.634561] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-09-16T17:43:09.634682] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-09-16T17:43:09.637144] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-16T17:43:09.637571] [DEBUG] [LOCAL ] CCIF: Trimmed 16495 records to 11293 (keeping 150 days of data) [2025-09-16T17:43:09.714811] [DEBUG] [LOCAL ] CCIF: Primary data saved (11293 records). [2025-09-16T17:43:09.714951] [INFO ] [MAIN ] CCIF: Full history saved. [2025-09-16T17:43:09.715035] [INFO ] [MAIN ] Update Progress: 411/2369 symbols completed. CCIF took 17.4s. Estimated remaining: 3h 25m 23s. Rate: 9.5 symbols/min [2025-09-16T17:43:09.892659] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:43:09.929335] [DEBUG] [LOCAL ] CCK: Loaded 34145 existing records from primary storage. [2025-09-16T17:43:09.929568] [INFO ] [MAIN ] CCK: Loaded 34145 existing records. [2025-09-16T17:43:09.984712] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-09-16T17:43:10.107279] [WARN ] [MAIN ] CCK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:43:10.107622] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-09-16T17:43:10.107687] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-09-16T17:43:10.108750] [DEBUG] [LOCAL ] CCK: Deleted primary data file. [2025-09-16T17:43:10.108800] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-09-16T17:43:10.486310] [INFO ] [REMOTE ] CCK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:43:10.493697] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-16T17:43:10.494546] [INFO ] [REMOTE ] CCIA: Full fetch complete (1556 records). [2025-09-16T17:43:10.494613] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-09-16T17:43:10.670365] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 148 unique days, need 150 days [2025-09-16T17:43:10.670562] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:43:10.670612] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:43:10.670671] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-16T17:43:10.670735] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-09-16T17:43:10.670773] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-09-16T17:43:10.670824] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-09-16T17:43:10.670883] [INFO ] [MAIN ] Update Progress: 412/2369 symbols completed. CCIA took 25.0s. Estimated remaining: 3h 24m 51s. Rate: 9.6 symbols/min [2025-09-16T17:43:10.775500] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-09-16T17:43:10.840313] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:43:10.893469] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-16T17:43:10.916867] [DEBUG] [LOCAL ] CCL: Loaded 39760 existing records from primary storage. [2025-09-16T17:43:10.916998] [INFO ] [MAIN ] CCL: Loaded 39760 existing records. [2025-09-16T17:43:11.104945] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:43:11.105222] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-09-16T17:43:11.105269] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-09-16T17:43:11.106137] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-09-16T17:43:11.106187] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-09-16T17:43:11.472439] [INFO ] [REMOTE ] CCL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:43:11.574899] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-09-16T17:43:12.374905] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-09-16T17:43:12.575289] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-16T17:43:13.174917] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-09-16T17:43:13.888884] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-16T17:43:13.895191] [INFO ] [REMOTE ] CCI: Full fetch complete (57804 records). [2025-09-16T17:43:13.895296] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-09-16T17:43:13.977572] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-09-16T17:43:14.290683] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (2.72 seconds). [2025-09-16T17:43:14.376443] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-09-16T17:43:14.376525] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-09-16T17:43:14.377186] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-09-16T17:43:14.377261] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-09-16T17:43:14.378902] [DEBUG] [LOCAL ] CCI: Trimmed 57804 records to 39559 (keeping 150 days of data) [2025-09-16T17:43:14.630944] [DEBUG] [LOCAL ] CCI: Primary data saved (39559 records). [2025-09-16T17:43:14.631117] [INFO ] [MAIN ] CCI: Full history saved. [2025-09-16T17:43:14.631214] [INFO ] [MAIN ] Update Progress: 413/2369 symbols completed. CCI took 31.6s. Estimated remaining: 3h 24m 34s. Rate: 9.6 symbols/min [2025-09-16T17:43:14.775281] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-09-16T17:43:14.808828] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:43:14.844331] [DEBUG] [LOCAL ] CCO: Loaded 35835 existing records from primary storage. [2025-09-16T17:43:14.844518] [INFO ] [MAIN ] CCO: Loaded 35835 existing records. [2025-09-16T17:43:15.043438] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:43:15.044032] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-09-16T17:43:15.044112] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-09-16T17:43:15.045015] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-09-16T17:43:15.045074] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-09-16T17:43:15.416960] [INFO ] [REMOTE ] CCO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:43:15.435133] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-16T17:43:15.574906] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-09-16T17:43:15.675797] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-16T17:43:16.374957] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-09-16T17:43:16.806544] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-16T17:43:16.964290] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-16T17:43:17.174902] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-09-16T17:43:17.974904] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-09-16T17:43:18.516065] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-16T17:43:18.614000] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-16T17:43:18.774853] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-09-16T17:43:19.574913] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-09-16T17:43:19.665148] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-16T17:43:19.968023] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-16T17:43:20.374898] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-09-16T17:43:21.174901] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-09-16T17:43:21.677617] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-16T17:43:21.974924] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-09-16T17:43:22.061458] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-16T17:43:22.774922] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-09-16T17:43:23.532462] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-16T17:43:23.574876] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-09-16T17:43:23.975353] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-16T17:43:24.294038] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-16T17:43:24.374893] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-09-16T17:43:25.174914] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-09-16T17:43:25.746206] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-16T17:43:25.849133] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-16T17:43:25.974907] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-09-16T17:43:26.666354] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-16T17:43:26.774904] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-09-16T17:43:27.574928] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-09-16T17:43:27.923974] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-16T17:43:28.374962] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-09-16T17:43:28.553164] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-16T17:43:28.559360] [INFO ] [REMOTE ] CCJ: Full fetch complete (58354 records). [2025-09-16T17:43:28.559467] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-09-16T17:43:28.949439] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-09-16T17:43:28.949519] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-09-16T17:43:28.950197] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-09-16T17:43:28.950251] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-09-16T17:43:28.951378] [DEBUG] [LOCAL ] CCJ: Trimmed 58354 records to 40053 (keeping 150 days of data) [2025-09-16T17:43:29.175145] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-09-16T17:43:29.189625] [DEBUG] [LOCAL ] CCJ: Primary data saved (40053 records). [2025-09-16T17:43:29.189777] [INFO ] [MAIN ] CCJ: Full history saved. [2025-09-16T17:43:29.189872] [INFO ] [MAIN ] Update Progress: 414/2369 symbols completed. CCJ took 32.7s. Estimated remaining: 3h 25m 7s. Rate: 9.5 symbols/min [2025-09-16T17:43:29.359237] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:43:29.368004] [DEBUG] [LOCAL ] CCRD: Loaded 7738 existing records from primary storage. [2025-09-16T17:43:29.368107] [INFO ] [MAIN ] CCRD: Loaded 7738 existing records. [2025-09-16T17:43:29.549670] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:43:29.550044] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-09-16T17:43:29.550142] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-09-16T17:43:29.550545] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-09-16T17:43:29.550622] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-09-16T17:43:29.683363] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-16T17:43:29.947456] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:43:29.975180] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-09-16T17:43:29.975119] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-16T17:43:30.774923] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-09-16T17:43:31.065481] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-16T17:43:31.266034] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-16T17:43:31.574951] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-09-16T17:43:31.807856] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-16T17:43:32.374915] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-09-16T17:43:32.747878] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-16T17:43:33.174899] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-09-16T17:43:33.974909] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-09-16T17:43:34.728775] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-09-16T17:43:34.774945] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-09-16T17:43:34.849323] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-16T17:43:34.855332] [INFO ] [REMOTE ] CCO: Full fetch complete (51133 records). [2025-09-16T17:43:34.855500] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-09-16T17:43:35.233900] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-09-16T17:43:35.234021] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-09-16T17:43:35.234818] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-09-16T17:43:35.234876] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-09-16T17:43:35.236318] [DEBUG] [LOCAL ] CCO: Trimmed 51133 records to 36204 (keeping 150 days of data) [2025-09-16T17:43:35.346755] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-16T17:43:35.354900] [INFO ] [REMOTE ] CCK: Full fetch complete (50784 records). [2025-09-16T17:43:35.358055] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-09-16T17:43:35.598638] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-09-16T17:43:35.850832] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-09-16T17:43:35.851673] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-09-16T17:43:35.855275] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-09-16T17:43:35.856876] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-09-16T17:43:35.860393] [DEBUG] [LOCAL ] CCO: Primary data saved (36204 records). [2025-09-16T17:43:35.860477] [INFO ] [MAIN ] CCO: Full history saved. [2025-09-16T17:43:35.860590] [INFO ] [MAIN ] Update Progress: 415/2369 symbols completed. CCO took 21.2s. Estimated remaining: 3h 25m 2s. Rate: 9.5 symbols/min [2025-09-16T17:43:35.961138] [DEBUG] [LOCAL ] CCK: Trimmed 50784 records to 34509 (keeping 150 days of data) [2025-09-16T17:43:36.099183] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:43:36.133854] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-16T17:43:36.169545] [DEBUG] [LOCAL ] CCS: Loaded 22400 existing records from primary storage. [2025-09-16T17:43:36.170860] [INFO ] [MAIN ] CCS: Loaded 22400 existing records. [2025-09-16T17:43:36.359043] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:43:36.362734] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-09-16T17:43:36.362823] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-09-16T17:43:36.363498] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-09-16T17:43:36.401855] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-09-16T17:43:36.428963] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-09-16T17:43:36.851557] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-16T17:43:36.849712] [INFO ] [REMOTE ] CCS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:43:36.860588] [INFO ] [REMOTE ] CCL: Full fetch complete (58480 records). [2025-09-16T17:43:36.863983] [DEBUG] [LOCAL ] CCK: Primary data saved (34509 records). [2025-09-16T17:43:36.864064] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-09-16T17:43:36.864186] [INFO ] [MAIN ] CCK: Full history saved. [2025-09-16T17:43:36.865110] [INFO ] [MAIN ] Update Progress: 416/2369 symbols completed. CCK took 27.1s. Estimated remaining: 3h 24m 31s. Rate: 9.5 symbols/min [2025-09-16T17:43:37.090340] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-16T17:43:37.199442] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-09-16T17:43:37.275487] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:43:37.477522] [DEBUG] [LOCAL ] CCU: Loaded 16315 existing records from primary storage. [2025-09-16T17:43:37.509731] [INFO ] [MAIN ] CCU: Loaded 16315 existing records. [2025-09-16T17:43:37.527172] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-09-16T17:43:37.585877] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-09-16T17:43:37.619470] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-09-16T17:43:37.619672] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-09-16T17:43:37.696882] [DEBUG] [LOCAL ] CCL: Trimmed 58480 records to 40150 (keeping 150 days of data) [2025-09-16T17:43:37.697025] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:43:37.697840] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-09-16T17:43:37.697910] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-09-16T17:43:37.698668] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-09-16T17:43:37.698728] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-09-16T17:43:37.902003] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-16T17:43:37.980994] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-09-16T17:43:38.175194] [INFO ] [REMOTE ] CCU: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:43:38.320149] [DEBUG] [LOCAL ] CCL: Primary data saved (40150 records). [2025-09-16T17:43:38.320293] [INFO ] [MAIN ] CCL: Full history saved. [2025-09-16T17:43:38.320390] [INFO ] [MAIN ] Update Progress: 417/2369 symbols completed. CCL took 27.6s. Estimated remaining: 3h 24m 2s. Rate: 9.6 symbols/min [2025-09-16T17:43:38.516249] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:43:38.516470] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-09-16T17:43:38.516513] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-09-16T17:43:38.516684] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-09-16T17:43:38.516742] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-16T17:43:38.516800] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-16T17:43:38.516847] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-09-16T17:43:38.780006] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-09-16T17:43:38.899987] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:43:39.109073] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-16T17:43:39.453470] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-16T17:43:39.574900] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-09-16T17:43:40.130604] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-16T17:43:40.374900] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-09-16T17:43:41.169413] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-16T17:43:41.176095] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-09-16T17:43:41.974898] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-09-16T17:43:42.025779] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-16T17:43:42.441960] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-16T17:43:42.774915] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-09-16T17:43:43.574925] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-09-16T17:43:44.250626] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-16T17:43:44.374903] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-09-16T17:43:44.534947] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-16T17:43:45.174926] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-09-16T17:43:45.284713] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-16T17:43:45.512243] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-16T17:43:45.974937] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-09-16T17:43:46.774902] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-09-16T17:43:46.981613] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-16T17:43:47.574976] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-09-16T17:43:47.719106] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-16T17:43:47.845673] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.27 seconds). [2025-09-16T17:43:48.374924] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-09-16T17:43:49.174903] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-09-16T17:43:49.545606] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-16T17:43:49.974863] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-09-16T17:43:50.037494] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-16T17:43:50.039171] [INFO ] [REMOTE ] CCRD: Full fetch complete (9307 records). [2025-09-16T17:43:50.039238] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-09-16T17:43:50.417403] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-09-16T17:43:50.417482] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-09-16T17:43:50.417736] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-09-16T17:43:50.417781] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-09-16T17:43:50.418331] [DEBUG] [LOCAL ] CCRD: Trimmed 9307 records to 7777 (keeping 150 days of data) [2025-09-16T17:43:50.464332] [DEBUG] [LOCAL ] CCRD: Primary data saved (7777 records). [2025-09-16T17:43:50.464444] [INFO ] [MAIN ] CCRD: Full history saved. [2025-09-16T17:43:50.464542] [INFO ] [MAIN ] Update Progress: 418/2369 symbols completed. CCRD took 21.3s. Estimated remaining: 3h 24m 23s. Rate: 9.5 symbols/min [2025-09-16T17:43:50.642668] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:43:50.682232] [DEBUG] [LOCAL ] CDE: Loaded 39604 existing records from primary storage. [2025-09-16T17:43:50.682372] [INFO ] [MAIN ] CDE: Loaded 39604 existing records. [2025-09-16T17:43:50.780097] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-09-16T17:43:50.879347] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:43:50.879588] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-09-16T17:43:50.879658] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-09-16T17:43:50.880401] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-09-16T17:43:50.880450] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-09-16T17:43:51.054003] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-09-16T17:43:51.258429] [INFO ] [REMOTE ] CDE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:43:51.274494] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-16T17:43:51.574890] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-09-16T17:43:52.374952] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-09-16T17:43:52.446059] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-16T17:43:52.449369] [INFO ] [REMOTE ] CCS: Full fetch complete (33239 records). [2025-09-16T17:43:52.449492] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-09-16T17:43:52.450048] [FATAL] [VALIDATOR ] CCS: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:43:52.450126] [FATAL] [MAIN ] CCS: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:43:52.450179] [WARN ] [MAIN ] CCS: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:43:52.450227] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-09-16T17:43:52.450288] [DEBUG] [LOCAL ] CCS: No primary data file found to delete. [2025-09-16T17:43:52.450333] [INFO ] [LOCAL ] CCS: Starting deletion of derivative data. [2025-09-16T17:43:52.450689] [DEBUG] [LOCAL ] CCS: Deleted derivative data file. [2025-09-16T17:43:52.450779] [INFO ] [MAIN ] Update Progress: 419/2369 symbols completed. CCS took 16.6s. Estimated remaining: 3h 23m 57s. Rate: 9.6 symbols/min [2025-09-16T17:43:52.634513] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:43:52.643214] [DEBUG] [LOCAL ] CDLR: Loaded 6990 existing records from primary storage. [2025-09-16T17:43:52.643319] [INFO ] [MAIN ] CDLR: Loaded 6990 existing records. [2025-09-16T17:43:52.819689] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:43:52.819944] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-09-16T17:43:52.819991] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-09-16T17:43:52.820248] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-09-16T17:43:52.820292] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-09-16T17:43:53.201028] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-09-16T17:43:53.208942] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:43:53.323157] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-16T17:43:53.554307] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:43:53.554665] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-09-16T17:43:53.974912] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-09-16T17:43:54.378748] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-16T17:43:54.774897] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-09-16T17:43:55.465827] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-16T17:43:55.574864] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-07. [2025-09-16T17:43:55.785966] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-07 (0.21 seconds). [2025-09-16T17:43:56.374900] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-08. [2025-09-16T17:43:56.631052] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-09-16T17:43:57.174898] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-09-16T17:43:57.882438] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-16T17:43:57.974912] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-09-16T17:43:58.774909] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-09. [2025-09-16T17:43:59.005414] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-16T17:43:59.067327] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-09-16T17:43:59.067951] [INFO ] [REMOTE ] CCZ: Full fetch complete (76 records). [2025-09-16T17:43:59.068047] [DEBUG] [VALIDATOR ] CCZ: Validating primary data. [2025-09-16T17:43:59.068399] [FATAL] [VALIDATOR ] CCZ: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:43:59.068479] [FATAL] [MAIN ] CCZ: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:43:59.068524] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:43:59.068595] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-16T17:43:59.068681] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-16T17:43:59.068737] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-09-16T17:43:59.068788] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-09-16T17:43:59.068869] [INFO ] [MAIN ] Update Progress: 420/2369 symbols completed. CCZ took 20.7s. Estimated remaining: 3h 23m 52s. Rate: 9.6 symbols/min [2025-09-16T17:43:59.242171] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:43:59.276530] [DEBUG] [LOCAL ] CDP: Loaded 31021 existing records from primary storage. [2025-09-16T17:43:59.276680] [INFO ] [MAIN ] CDP: Loaded 31021 existing records. [2025-09-16T17:43:59.451237] [WARN ] [MAIN ] CDP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:43:59.451458] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-09-16T17:43:59.451513] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-09-16T17:43:59.452267] [DEBUG] [LOCAL ] CDP: Deleted primary data file. [2025-09-16T17:43:59.452316] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-09-16T17:43:59.591263] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-09-16T17:43:59.805213] [INFO ] [REMOTE ] CDP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:44:00.374901] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-09-16T17:44:01.096480] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-16T17:44:01.174862] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-09-16T17:44:01.974889] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-09-16T17:44:02.112439] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-16T17:44:02.115255] [INFO ] [REMOTE ] CCU: Full fetch complete (26323 records). [2025-09-16T17:44:02.115338] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-09-16T17:44:02.485740] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-09-16T17:44:02.485819] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-09-16T17:44:02.486217] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-09-16T17:44:02.486262] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-09-16T17:44:02.486960] [DEBUG] [LOCAL ] CCU: Trimmed 26323 records to 16433 (keeping 150 days of data) [2025-09-16T17:44:02.589709] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-09-16T17:44:02.623621] [DEBUG] [LOCAL ] CCU: Primary data saved (16433 records). [2025-09-16T17:44:02.623789] [INFO ] [MAIN ] CCU: Full history saved. [2025-09-16T17:44:02.623881] [INFO ] [MAIN ] Update Progress: 421/2369 symbols completed. CCU took 25.8s. Estimated remaining: 3h 23m 33s. Rate: 9.6 symbols/min [2025-09-16T17:44:02.791794] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:44:02.781569] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-09-16T17:44:02.811788] [DEBUG] [LOCAL ] CDRE: Loaded 18482 existing records from primary storage. [2025-09-16T17:44:02.811962] [INFO ] [MAIN ] CDRE: Loaded 18482 existing records. [2025-09-16T17:44:02.992900] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:44:02.998507] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-09-16T17:44:03.002617] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-09-16T17:44:03.003466] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-16T17:44:03.004760] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-09-16T17:44:03.007103] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-09-16T17:44:03.358546] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:44:03.574893] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-09-16T17:44:04.338433] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-16T17:44:04.374861] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-09-16T17:44:04.689866] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-16T17:44:05.059378] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-16T17:44:05.174916] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-09-16T17:44:05.974914] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-09-16T17:44:06.032014] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-16T17:44:06.774893] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-09-16T17:44:07.177827] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-16T17:44:07.574901] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-09-16T17:44:07.619422] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-16T17:44:08.374900] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-09-16T17:44:09.174895] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-09-16T17:44:09.256174] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-16T17:44:09.499709] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-16T17:44:09.961740] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-16T17:44:09.974859] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-09-16T17:44:10.774913] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-09-16T17:44:10.884364] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-16T17:44:11.574911] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-09-16T17:44:12.374915] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-09-16T17:44:12.824692] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-16T17:44:12.871783] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-16T17:44:13.030405] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-16T17:44:13.174911] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-09-16T17:44:13.808786] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-16T17:44:13.810291] [INFO ] [REMOTE ] CDLR: Full fetch complete (10628 records). [2025-09-16T17:44:13.810358] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-09-16T17:44:13.981491] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-09-16T17:44:14.170443] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-09-16T17:44:14.170521] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-09-16T17:44:14.170816] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-09-16T17:44:14.170880] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-09-16T17:44:14.171551] [DEBUG] [LOCAL ] CDLR: Trimmed 10628 records to 7019 (keeping 150 days of data) [2025-09-16T17:44:14.212380] [DEBUG] [LOCAL ] CDLR: Primary data saved (7019 records). [2025-09-16T17:44:14.212488] [INFO ] [MAIN ] CDLR: Full history saved. [2025-09-16T17:44:14.212581] [INFO ] [MAIN ] Update Progress: 422/2369 symbols completed. CDLR took 21.8s. Estimated remaining: 3h 23m 52s. Rate: 9.6 symbols/min [2025-09-16T17:44:14.385485] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:44:14.428690] [DEBUG] [LOCAL ] CE: Loaded 37804 existing records from primary storage. [2025-09-16T17:44:14.428863] [INFO ] [MAIN ] CE: Loaded 37804 existing records. [2025-09-16T17:44:14.609672] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:44:14.609932] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-09-16T17:44:14.609990] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-09-16T17:44:14.610955] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-09-16T17:44:14.611008] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-09-16T17:44:14.775228] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-09-16T17:44:14.974708] [INFO ] [REMOTE ] CE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:44:15.574918] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-09-16T17:44:15.981320] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-16T17:44:16.374906] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-09-16T17:44:16.514995] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-16T17:44:17.134529] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-16T17:44:17.174852] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-09-16T17:44:17.463041] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-16T17:44:17.974908] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-09-16T17:44:18.774906] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-09-16T17:44:18.863927] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-16T17:44:19.558004] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-16T17:44:19.574843] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-09-16T17:44:20.374884] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-09-16T17:44:20.424425] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-16T17:44:21.041259] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-16T17:44:21.174911] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-09-16T17:44:21.981156] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-09-16T17:44:22.002033] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-16T17:44:22.774908] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-09-16T17:44:23.285616] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-16T17:44:23.490240] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-16T17:44:23.574860] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-09-16T17:44:24.374921] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-09-16T17:44:24.474971] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-16T17:44:24.884045] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-16T17:44:25.174908] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-09-16T17:44:25.974906] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-09-16T17:44:26.346666] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-16T17:44:26.774894] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-09-16T17:44:26.943948] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-16T17:44:27.015323] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-16T17:44:27.574962] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-09-16T17:44:28.374897] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-09-16T17:44:28.558758] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-16T17:44:28.561605] [INFO ] [REMOTE ] CDRE: Full fetch complete (26546 records). [2025-09-16T17:44:28.561702] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-09-16T17:44:28.946523] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-09-16T17:44:28.946663] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-09-16T17:44:28.947087] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-09-16T17:44:28.947222] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-09-16T17:44:28.948157] [DEBUG] [LOCAL ] CDRE: Trimmed 26546 records to 18653 (keeping 150 days of data) [2025-09-16T17:44:29.057273] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-16T17:44:29.065974] [INFO ] [REMOTE ] CDE: Full fetch complete (58320 records). [2025-09-16T17:44:29.068294] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-09-16T17:44:29.177434] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-09-16T17:44:29.481791] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-09-16T17:44:29.483593] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-09-16T17:44:29.485739] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-09-16T17:44:29.486396] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-09-16T17:44:29.493409] [DEBUG] [LOCAL ] CDRE: Primary data saved (18653 records). [2025-09-16T17:44:29.493730] [INFO ] [MAIN ] CDRE: Full history saved. [2025-09-16T17:44:29.494036] [INFO ] [MAIN ] Update Progress: 423/2369 symbols completed. CDRE took 26.9s. Estimated remaining: 3h 24m 27s. Rate: 9.5 symbols/min [2025-09-16T17:44:29.494339] [DEBUG] [LOCAL ] CDE: Trimmed 58320 records to 39994 (keeping 150 days of data) [2025-09-16T17:44:29.765189] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:44:29.780012] [DEBUG] [LOCAL ] CEE: Loaded 3994 existing records from primary storage. [2025-09-16T17:44:29.783297] [INFO ] [MAIN ] CEE: Loaded 3994 existing records. [2025-09-16T17:44:29.980843] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:44:29.984988] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-09-16T17:44:29.987762] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-09-16T17:44:29.988110] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-09-16T17:44:29.988162] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-09-16T17:44:30.472514] [INFO ] [REMOTE ] CEE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:44:30.473139] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-09-16T17:44:30.506962] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-16T17:44:30.530027] [DEBUG] [LOCAL ] CDE: Primary data saved (39994 records). [2025-09-16T17:44:30.530155] [INFO ] [MAIN ] CDE: Full history saved. [2025-09-16T17:44:30.530236] [INFO ] [MAIN ] Update Progress: 424/2369 symbols completed. CDE took 40.1s. Estimated remaining: 3h 23m 56s. Rate: 9.5 symbols/min [2025-09-16T17:44:30.702008] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:44:30.719369] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-16T17:44:30.725148] [INFO ] [REMOTE ] CDP: Full fetch complete (46630 records). [2025-09-16T17:44:30.725275] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-09-16T17:44:30.794149] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-09-16T17:44:30.866159] [DEBUG] [LOCAL ] CEPU: Loaded 18551 existing records from primary storage. [2025-09-16T17:44:30.889878] [INFO ] [MAIN ] CEPU: Loaded 18551 existing records. [2025-09-16T17:44:31.252942] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:44:31.290483] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-09-16T17:44:31.290344] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-09-16T17:44:31.290572] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-09-16T17:44:31.291253] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-09-16T17:44:31.291395] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-09-16T17:44:31.291331] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-09-16T17:44:31.299193] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-09-16T17:44:31.299532] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-09-16T17:44:31.300186] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-16T17:44:31.357469] [DEBUG] [LOCAL ] CDP: Trimmed 46630 records to 31306 (keeping 150 days of data) [2025-09-16T17:44:31.575751] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-09-16T17:44:31.772944] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:44:31.876661] [DEBUG] [LOCAL ] CDP: Primary data saved (31306 records). [2025-09-16T17:44:31.876817] [INFO ] [MAIN ] CDP: Full history saved. [2025-09-16T17:44:31.878888] [INFO ] [MAIN ] Update Progress: 425/2369 symbols completed. CDP took 32.8s. Estimated remaining: 3h 23m 27s. Rate: 9.6 symbols/min [2025-09-16T17:44:32.049078] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:44:32.091664] [DEBUG] [LOCAL ] CF: Loaded 38590 existing records from primary storage. [2025-09-16T17:44:32.091822] [INFO ] [MAIN ] CF: Loaded 38590 existing records. [2025-09-16T17:44:32.266534] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:44:32.266802] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-09-16T17:44:32.266852] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-09-16T17:44:32.267775] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-09-16T17:44:32.267826] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-09-16T17:44:32.379973] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-09-16T17:44:32.622050] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-16T17:44:32.640768] [INFO ] [REMOTE ] CF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:44:32.675997] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-16T17:44:33.174898] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-09-16T17:44:33.919965] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-16T17:44:33.979089] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-09-16T17:44:33.982635] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-16T17:44:34.658187] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-16T17:44:34.774892] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-09-16T17:44:35.387881] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-16T17:44:35.574900] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-09-16T17:44:36.039776] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-16T17:44:36.374900] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-09-16T17:44:36.874298] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-16T17:44:37.174926] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-09-16T17:44:37.974930] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-09-16T17:44:38.534546] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-16T17:44:38.535704] [INFO ] [REMOTE ] CEE: Full fetch complete (8728 records). [2025-09-16T17:44:38.535781] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-09-16T17:44:38.783582] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-09-16T17:44:38.988266] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-09-16T17:44:38.988470] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-09-16T17:44:38.989057] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-09-16T17:44:38.989261] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-09-16T17:44:38.990375] [DEBUG] [LOCAL ] CEE: Trimmed 8728 records to 4013 (keeping 150 days of data) [2025-09-16T17:44:39.026305] [DEBUG] [LOCAL ] CEE: Primary data saved (4013 records). [2025-09-16T17:44:39.026616] [INFO ] [MAIN ] CEE: Full history saved. [2025-09-16T17:44:39.026914] [INFO ] [MAIN ] Update Progress: 426/2369 symbols completed. CEE took 9.5s. Estimated remaining: 3h 23m 25s. Rate: 9.6 symbols/min [2025-09-16T17:44:39.225729] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-16T17:44:39.384073] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:44:39.442124] [DEBUG] [LOCAL ] CFG: Loaded 39585 existing records from primary storage. [2025-09-16T17:44:39.442331] [INFO ] [MAIN ] CFG: Loaded 39585 existing records. [2025-09-16T17:44:39.583307] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-09-16T17:44:39.686062] [WARN ] [MAIN ] CFG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:44:39.686378] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-09-16T17:44:39.686450] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-09-16T17:44:39.687515] [DEBUG] [LOCAL ] CFG: Deleted primary data file. [2025-09-16T17:44:39.687594] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-09-16T17:44:40.103697] [INFO ] [REMOTE ] CFG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:44:40.374884] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-09-16T17:44:40.449035] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-16T17:44:41.174900] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-09-16T17:44:41.446101] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-16T17:44:41.452113] [INFO ] [REMOTE ] CE: Full fetch complete (56252 records). [2025-09-16T17:44:41.452228] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-09-16T17:44:41.838431] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-09-16T17:44:41.838516] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-09-16T17:44:41.839162] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-09-16T17:44:41.839208] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-09-16T17:44:41.840400] [DEBUG] [LOCAL ] CE: Trimmed 56252 records to 38140 (keeping 150 days of data) [2025-09-16T17:44:41.973542] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-16T17:44:41.981022] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-09-16T17:44:42.098696] [DEBUG] [LOCAL ] CE: Primary data saved (38140 records). [2025-09-16T17:44:42.098834] [INFO ] [MAIN ] CE: Full history saved. [2025-09-16T17:44:42.098915] [INFO ] [MAIN ] Update Progress: 427/2369 symbols completed. CE took 27.9s. Estimated remaining: 3h 23m 4s. Rate: 9.6 symbols/min [2025-09-16T17:44:42.267344] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:44:42.267493] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-09-16T17:44:42.267530] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-09-16T17:44:42.267666] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-09-16T17:44:42.267707] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-16T17:44:42.267747] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-09-16T17:44:42.267779] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-09-16T17:44:42.622915] [INFO ] [REMOTE ] CFND: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:44:42.656864] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-16T17:44:42.774861] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-09-16T17:44:43.574882] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-02. [2025-09-16T17:44:43.666614] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-16T17:44:43.808458] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:44:43.808780] [WARN ] [REMOTE ] CFND: No data returned for month 2025-02 [2025-09-16T17:44:43.848401] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-16T17:44:44.374911] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-09-16T17:44:45.174909] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-09-16T17:44:45.916257] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-16T17:44:45.974876] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-09-16T17:44:46.656761] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-16T17:44:46.774961] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-03. [2025-09-16T17:44:47.008292] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:44:47.008730] [WARN ] [REMOTE ] CFND: No data returned for month 2025-03 [2025-09-16T17:44:47.574906] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-04. [2025-09-16T17:44:47.741417] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-16T17:44:47.842071] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:44:47.842373] [WARN ] [REMOTE ] CFND: No data returned for month 2025-04 [2025-09-16T17:44:48.374935] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-09-16T17:44:49.174914] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-09-16T17:44:49.771979] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-16T17:44:49.974917] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-09-16T17:44:50.163565] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-16T17:44:50.774919] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-09-16T17:44:51.364779] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-16T17:44:51.442151] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-16T17:44:51.574909] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-09-16T17:44:52.374902] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-09-16T17:44:53.007187] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-16T17:44:53.100235] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-16T17:44:53.174947] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-09-16T17:44:53.974910] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-09-16T17:44:54.666068] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-16T17:44:54.774962] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-05. [2025-09-16T17:44:54.920382] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-16T17:44:54.968347] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:44:54.968779] [WARN ] [REMOTE ] CFND: No data returned for month 2025-05 [2025-09-16T17:44:55.574922] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-09-16T17:44:56.374906] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-06. [2025-09-16T17:44:56.532728] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-16T17:44:56.536459] [INFO ] [REMOTE ] CEPU: Full fetch complete (27977 records). [2025-09-16T17:44:56.536528] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-09-16T17:44:56.606954] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:44:56.638462] [WARN ] [REMOTE ] CFND: No data returned for month 2025-06 [2025-09-16T17:44:56.905815] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-09-16T17:44:56.905892] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-09-16T17:44:56.906304] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-09-16T17:44:56.906344] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-09-16T17:44:56.907019] [DEBUG] [LOCAL ] CEPU: Trimmed 27977 records to 18809 (keeping 150 days of data) [2025-09-16T17:44:57.018613] [DEBUG] [LOCAL ] CEPU: Primary data saved (18809 records). [2025-09-16T17:44:57.018783] [INFO ] [MAIN ] CEPU: Full history saved. [2025-09-16T17:44:57.018880] [INFO ] [MAIN ] Update Progress: 428/2369 symbols completed. CEPU took 26.5s. Estimated remaining: 3h 23m 37s. Rate: 9.5 symbols/min [2025-09-16T17:44:57.176275] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-07. [2025-09-16T17:44:57.196288] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:44:57.196503] [DEBUG] [LOCAL ] CFR: No existing data file found in primary storage. [2025-09-16T17:44:57.196545] [WARN ] [MAIN ] CFR: No existing data found, performing full refresh instead. [2025-09-16T17:44:57.196694] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-09-16T17:44:57.196738] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-09-16T17:44:57.196780] [DEBUG] [LOCAL ] CFR: No primary data file found to delete. [2025-09-16T17:44:57.196813] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-09-16T17:44:57.470329] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:44:57.473215] [WARN ] [REMOTE ] CFND: No data returned for month 2025-07 [2025-09-16T17:44:57.548822] [INFO ] [REMOTE ] CFR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:44:57.974900] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-09-16T17:44:58.774982] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-08. [2025-09-16T17:44:59.250901] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-16T17:44:59.574965] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-09-16T17:44:59.742476] [INFO ] [REMOTE ] CFND: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-16T17:45:00.374952] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-09. [2025-09-16T17:45:01.036216] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-16T17:45:01.169665] [INFO ] [REMOTE ] CFND: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-16T17:45:01.171106] [INFO ] [REMOTE ] CFND: Full fetch complete (2261 records). [2025-09-16T17:45:01.171180] [DEBUG] [VALIDATOR ] CFND: Validating primary data. [2025-09-16T17:45:01.182680] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-09-16T17:45:01.373568] [WARN ] [VALIDATOR ] CFND: Validation failed - insufficient historical data. Have 28 unique days, need 150 days [2025-09-16T17:45:01.373982] [FATAL] [MAIN ] CFND: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:45:01.374074] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:45:01.374126] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-16T17:45:01.374201] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-09-16T17:45:01.374239] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-09-16T17:45:01.374299] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-09-16T17:45:01.374372] [INFO ] [MAIN ] Update Progress: 429/2369 symbols completed. CFND took 19.3s. Estimated remaining: 3h 23m 22s. Rate: 9.5 symbols/min [2025-09-16T17:45:01.562501] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:45:01.599385] [DEBUG] [LOCAL ] CGAU: Loaded 31020 existing records from primary storage. [2025-09-16T17:45:01.599679] [INFO ] [MAIN ] CGAU: Loaded 31020 existing records. [2025-09-16T17:45:01.789939] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:45:01.790199] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-09-16T17:45:01.790246] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-09-16T17:45:01.791170] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-09-16T17:45:01.791223] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-09-16T17:45:01.981550] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-09-16T17:45:02.192463] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:45:02.774929] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-09-16T17:45:03.415227] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-16T17:45:03.574919] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-09-16T17:45:03.684426] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-16T17:45:03.898763] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-16T17:45:04.374908] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-09-16T17:45:04.804805] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-16T17:45:05.174924] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-09-16T17:45:05.569391] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-16T17:45:05.974932] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-09-16T17:45:06.252388] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-16T17:45:06.774903] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-09-16T17:45:07.229688] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-16T17:45:07.235859] [INFO ] [REMOTE ] CF: Full fetch complete (56896 records). [2025-09-16T17:45:07.235955] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-09-16T17:45:07.595953] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-09-16T17:45:07.614403] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-09-16T17:45:07.614473] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-09-16T17:45:07.615277] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-09-16T17:45:07.615427] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-09-16T17:45:07.616731] [DEBUG] [LOCAL ] CF: Trimmed 56896 records to 38963 (keeping 150 days of data) [2025-09-16T17:45:07.860239] [DEBUG] [LOCAL ] CF: Primary data saved (38963 records). [2025-09-16T17:45:07.860388] [INFO ] [MAIN ] CF: Full history saved. [2025-09-16T17:45:07.861358] [INFO ] [MAIN ] Update Progress: 430/2369 symbols completed. CF took 36.0s. Estimated remaining: 3h 23m 17s. Rate: 9.5 symbols/min [2025-09-16T17:45:08.034952] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:45:08.038629] [DEBUG] [LOCAL ] CGV: Loaded 943 existing records from primary storage. [2025-09-16T17:45:08.038728] [INFO ] [MAIN ] CGV: Loaded 943 existing records. [2025-09-16T17:45:08.229810] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:45:08.230062] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-09-16T17:45:08.230108] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-09-16T17:45:08.230362] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-09-16T17:45:08.230414] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-09-16T17:45:08.380884] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-09-16T17:45:08.601373] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-16T17:45:08.605253] [INFO ] [REMOTE ] CGV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:45:08.612271] [INFO ] [REMOTE ] CFG: Full fetch complete (58292 records). [2025-09-16T17:45:08.612402] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-09-16T17:45:08.994678] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-09-16T17:45:08.994771] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-09-16T17:45:08.995485] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-09-16T17:45:08.995530] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-09-16T17:45:08.996812] [DEBUG] [LOCAL ] CFG: Trimmed 58292 records to 39975 (keeping 150 days of data) [2025-09-16T17:45:09.177798] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-09-16T17:45:09.246762] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-16T17:45:09.283023] [DEBUG] [LOCAL ] CFG: Primary data saved (39975 records). [2025-09-16T17:45:09.283206] [INFO ] [MAIN ] CFG: Full history saved. [2025-09-16T17:45:09.283319] [INFO ] [MAIN ] Update Progress: 431/2369 symbols completed. CFG took 30.3s. Estimated remaining: 3h 22m 48s. Rate: 9.6 symbols/min [2025-09-16T17:45:09.458050] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:45:09.488373] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-16T17:45:09.509289] [DEBUG] [LOCAL ] CHCT: Loaded 17753 existing records from primary storage. [2025-09-16T17:45:09.509438] [INFO ] [MAIN ] CHCT: Loaded 17753 existing records. [2025-09-16T17:45:09.664810] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-16T17:45:09.700803] [WARN ] [MAIN ] CHCT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:45:09.701051] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-09-16T17:45:09.701099] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-09-16T17:45:09.701670] [DEBUG] [LOCAL ] CHCT: Deleted primary data file. [2025-09-16T17:45:09.701729] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-09-16T17:45:09.980154] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-09-16T17:45:10.088252] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:45:10.458338] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-16T17:45:10.774898] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-09-16T17:45:11.574903] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-09-16T17:45:12.201409] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-16T17:45:12.374913] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-09-16T17:45:12.502341] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-16T17:45:12.791561] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-16T17:45:13.174902] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-09-16T17:45:13.584201] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-16T17:45:13.974929] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-09-16T17:45:14.774913] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-09-16T17:45:15.343515] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-16T17:45:15.574919] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-09-16T17:45:15.912583] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-16T17:45:15.973066] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-16T17:45:16.374929] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-09-16T17:45:16.884173] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-16T17:45:17.174901] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-09-16T17:45:17.974940] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-09-16T17:45:18.318253] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-16T17:45:18.774904] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-09-16T17:45:19.128313] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-16T17:45:19.200983] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-16T17:45:19.574902] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-09-16T17:45:20.085768] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-16T17:45:20.086502] [INFO ] [REMOTE ] CGV: Full fetch complete (1636 records). [2025-09-16T17:45:20.086569] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-09-16T17:45:20.379972] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-09-16T17:45:20.445976] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-09-16T17:45:20.446054] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-09-16T17:45:20.446144] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-09-16T17:45:20.446215] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-09-16T17:45:20.446570] [DEBUG] [LOCAL ] CGV: Trimmed 1636 records to 954 (keeping 150 days of data) [2025-09-16T17:45:20.453234] [DEBUG] [LOCAL ] CGV: Primary data saved (954 records). [2025-09-16T17:45:20.453301] [INFO ] [MAIN ] CGV: Full history saved. [2025-09-16T17:45:20.453375] [INFO ] [MAIN ] Update Progress: 432/2369 symbols completed. CGV took 12.6s. Estimated remaining: 3h 23m 4s. Rate: 9.5 symbols/min [2025-09-16T17:45:20.623198] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:45:20.667612] [DEBUG] [LOCAL ] CHD: Loaded 38809 existing records from primary storage. [2025-09-16T17:45:20.667807] [INFO ] [MAIN ] CHD: Loaded 38809 existing records. [2025-09-16T17:45:20.851596] [WARN ] [MAIN ] CHD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:45:20.851898] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-09-16T17:45:20.851945] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-09-16T17:45:20.852724] [DEBUG] [LOCAL ] CHD: Deleted primary data file. [2025-09-16T17:45:20.852774] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-09-16T17:45:21.181063] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-09-16T17:45:21.218379] [INFO ] [REMOTE ] CHD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:45:21.941857] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-16T17:45:21.974871] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-09-16T17:45:22.377525] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-16T17:45:22.774901] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-09-16T17:45:23.073340] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-16T17:45:23.574912] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-09-16T17:45:24.235501] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-16T17:45:24.374951] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-09-16T17:45:24.990594] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-16T17:45:25.174919] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-09-16T17:45:25.830415] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-16T17:45:25.974924] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-09-16T17:45:26.258462] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-16T17:45:26.774966] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-09-16T17:45:27.331141] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-16T17:45:27.335771] [INFO ] [REMOTE ] CFR: Full fetch complete (36706 records). [2025-09-16T17:45:27.335879] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-09-16T17:45:27.580155] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-09-16T17:45:27.754705] [DEBUG] [VALIDATOR ] CFR: All expected trading days are present. [2025-09-16T17:45:27.754795] [DEBUG] [VALIDATOR ] CFR: Primary data validation passed. [2025-09-16T17:45:27.755381] [INFO ] [MAIN ] CFR: Fetched primary data is valid. [2025-09-16T17:45:27.755428] [DEBUG] [LOCAL ] CFR: Saving primary data. [2025-09-16T17:45:27.756310] [DEBUG] [LOCAL ] CFR: Trimmed 36706 records to 24180 (keeping 150 days of data) [2025-09-16T17:45:27.907479] [DEBUG] [LOCAL ] CFR: Primary data saved (24180 records). [2025-09-16T17:45:27.907612] [INFO ] [MAIN ] CFR: Full history saved. [2025-09-16T17:45:27.907704] [INFO ] [MAIN ] Update Progress: 433/2369 symbols completed. CFR took 30.9s. Estimated remaining: 3h 23m 3s. Rate: 9.5 symbols/min [2025-09-16T17:45:28.076500] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:45:28.088394] [DEBUG] [LOCAL ] CHE: Loaded 11150 existing records from primary storage. [2025-09-16T17:45:28.088524] [INFO ] [MAIN ] CHE: Loaded 11150 existing records. [2025-09-16T17:45:28.267828] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:45:28.268129] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-09-16T17:45:28.268184] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-09-16T17:45:28.268574] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-09-16T17:45:28.268626] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-09-16T17:45:28.376287] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-09-16T17:45:28.632862] [INFO ] [REMOTE ] CHE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:45:28.663686] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-16T17:45:28.801417] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-16T17:45:29.174919] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-09-16T17:45:29.957022] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-16T17:45:29.974856] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-09-16T17:45:30.157569] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-16T17:45:30.163489] [INFO ] [REMOTE ] CGAU: Full fetch complete (45918 records). [2025-09-16T17:45:30.163626] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-09-16T17:45:30.582147] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-09-16T17:45:30.582232] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-09-16T17:45:30.582799] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-09-16T17:45:30.582843] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-09-16T17:45:30.583937] [DEBUG] [LOCAL ] CGAU: Trimmed 45918 records to 31389 (keeping 150 days of data) [2025-09-16T17:45:30.766356] [DEBUG] [LOCAL ] CGAU: Primary data saved (31389 records). [2025-09-16T17:45:30.766500] [INFO ] [MAIN ] CGAU: Full history saved. [2025-09-16T17:45:30.766634] [INFO ] [MAIN ] Update Progress: 434/2369 symbols completed. CGAU took 29.4s. Estimated remaining: 3h 22m 41s. Rate: 9.5 symbols/min [2025-09-16T17:45:30.780044] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-09-16T17:45:30.937772] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:45:30.952517] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-16T17:45:30.981255] [DEBUG] [LOCAL ] CHGG: Loaded 35278 existing records from primary storage. [2025-09-16T17:45:30.981408] [INFO ] [MAIN ] CHGG: Loaded 35278 existing records. [2025-09-16T17:45:31.158612] [WARN ] [MAIN ] CHGG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:45:31.158886] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-09-16T17:45:31.158933] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-09-16T17:45:31.159731] [DEBUG] [LOCAL ] CHGG: Deleted primary data file. [2025-09-16T17:45:31.159781] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-09-16T17:45:31.515294] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:45:31.574949] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-09-16T17:45:32.375357] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-09-16T17:45:32.562594] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-16T17:45:32.571586] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-16T17:45:33.175019] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-09-16T17:45:33.763807] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-16T17:45:33.974995] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-09-16T17:45:34.325934] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-16T17:45:34.774948] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-09-16T17:45:35.576215] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-09-16T17:45:35.584791] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-16T17:45:35.891891] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-16T17:45:36.374935] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-09-16T17:45:36.461664] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-16T17:45:37.174921] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-09-16T17:45:37.875693] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-16T17:45:37.981891] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-09-16T17:45:37.983541] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-16T17:45:38.774903] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-09-16T17:45:39.493562] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-16T17:45:39.574866] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-09-16T17:45:39.942336] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-16T17:45:39.945252] [INFO ] [REMOTE ] CHCT: Full fetch complete (26412 records). [2025-09-16T17:45:39.945348] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-09-16T17:45:40.319529] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present. [2025-09-16T17:45:40.319626] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed. [2025-09-16T17:45:40.320098] [INFO ] [MAIN ] CHCT: Fetched primary data is valid. [2025-09-16T17:45:40.320144] [DEBUG] [LOCAL ] CHCT: Saving primary data. [2025-09-16T17:45:40.321032] [DEBUG] [LOCAL ] CHCT: Trimmed 26412 records to 17905 (keeping 150 days of data) [2025-09-16T17:45:40.377259] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-09-16T17:45:40.433111] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-16T17:45:40.453214] [DEBUG] [LOCAL ] CHCT: Primary data saved (17905 records). [2025-09-16T17:45:40.453373] [INFO ] [MAIN ] CHCT: Full history saved. [2025-09-16T17:45:40.453465] [INFO ] [MAIN ] Update Progress: 435/2369 symbols completed. CHCT took 31.2s. Estimated remaining: 3h 22m 50s. Rate: 9.5 symbols/min [2025-09-16T17:45:40.624335] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:45:40.647318] [DEBUG] [LOCAL ] CHH: Loaded 23316 existing records from primary storage. [2025-09-16T17:45:40.647452] [INFO ] [MAIN ] CHH: Loaded 23316 existing records. [2025-09-16T17:45:40.830524] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:45:40.830868] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-09-16T17:45:40.830936] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-09-16T17:45:40.831591] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-09-16T17:45:40.831690] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-09-16T17:45:41.176092] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-09-16T17:45:41.198849] [INFO ] [REMOTE ] CHH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:45:41.928993] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-16T17:45:41.974871] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-09-16T17:45:42.221526] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-16T17:45:42.777376] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-09-16T17:45:42.779284] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-16T17:45:42.782297] [INFO ] [REMOTE ] CHE: Full fetch complete (15404 records). [2025-09-16T17:45:42.782420] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-09-16T17:45:43.156265] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-09-16T17:45:43.156346] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-09-16T17:45:43.156730] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-09-16T17:45:43.156797] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-09-16T17:45:43.157328] [DEBUG] [LOCAL ] CHE: Trimmed 15404 records to 11229 (keeping 150 days of data) [2025-09-16T17:45:43.227892] [DEBUG] [LOCAL ] CHE: Primary data saved (11229 records). [2025-09-16T17:45:43.228034] [INFO ] [MAIN ] CHE: Full history saved. [2025-09-16T17:45:43.228123] [INFO ] [MAIN ] Update Progress: 436/2369 symbols completed. CHE took 15.3s. Estimated remaining: 3h 22m 28s. Rate: 9.5 symbols/min [2025-09-16T17:45:43.400222] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:45:43.400382] [DEBUG] [LOCAL ] CHMI: No existing data file found in primary storage. [2025-09-16T17:45:43.400421] [WARN ] [MAIN ] CHMI: No existing data found, performing full refresh instead. [2025-09-16T17:45:43.400570] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-09-16T17:45:43.400612] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-09-16T17:45:43.400702] [DEBUG] [LOCAL ] CHMI: No primary data file found to delete. [2025-09-16T17:45:43.400795] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-09-16T17:45:43.582786] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-09-16T17:45:43.771006] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:45:44.374929] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-09-16T17:45:44.609538] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-16T17:45:45.181112] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-09-16T17:45:45.201455] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-16T17:45:45.278843] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-16T17:45:45.974914] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-09-16T17:45:46.452794] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-16T17:45:46.774892] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-09-16T17:45:47.143473] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-16T17:45:47.574913] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-09-16T17:45:48.374890] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-09-16T17:45:48.472694] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-16T17:45:48.883015] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-16T17:45:49.174954] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-09-16T17:45:49.974921] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-09-16T17:45:50.128979] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-16T17:45:50.783542] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-09-16T17:45:50.811543] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-16T17:45:50.836087] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-16T17:45:51.574924] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-09-16T17:45:51.777213] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-16T17:45:52.374923] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-09-16T17:45:52.721809] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-16T17:45:52.727685] [INFO ] [REMOTE ] CHD: Full fetch complete (55983 records). [2025-09-16T17:45:52.727820] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-09-16T17:45:52.728491] [FATAL] [VALIDATOR ] CHD: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:45:52.728576] [FATAL] [MAIN ] CHD: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:45:52.728635] [WARN ] [MAIN ] CHD: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:45:52.728849] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-09-16T17:45:52.728912] [DEBUG] [LOCAL ] CHD: No primary data file found to delete. [2025-09-16T17:45:52.728967] [INFO ] [LOCAL ] CHD: Starting deletion of derivative data. [2025-09-16T17:45:52.729333] [DEBUG] [LOCAL ] CHD: Deleted derivative data file. [2025-09-16T17:45:52.731839] [INFO ] [MAIN ] Update Progress: 437/2369 symbols completed. CHD took 32.3s. Estimated remaining: 3h 22m 36s. Rate: 9.5 symbols/min [2025-09-16T17:45:53.091753] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-16T17:45:53.174901] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-09-16T17:45:53.975000] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-09-16T17:45:54.662173] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-16T17:45:54.774892] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-09-16T17:45:54.820501] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-16T17:45:55.574908] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-09-16T17:45:56.107383] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-16T17:45:56.374909] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-09-16T17:45:56.906776] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-16T17:45:57.176856] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-09-16T17:45:57.181997] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-16T17:45:57.974910] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-09-16T17:45:58.625476] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-16T17:45:58.631704] [INFO ] [REMOTE ] CHGG: Full fetch complete (52209 records). [2025-09-16T17:45:58.631837] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-09-16T17:45:58.783064] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-09-16T17:45:59.020528] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present. [2025-09-16T17:45:59.020715] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed. [2025-09-16T17:45:59.021352] [INFO ] [MAIN ] CHGG: Fetched primary data is valid. [2025-09-16T17:45:59.021396] [DEBUG] [LOCAL ] CHGG: Saving primary data. [2025-09-16T17:45:59.022459] [DEBUG] [LOCAL ] CHGG: Trimmed 52209 records to 35600 (keeping 150 days of data) [2025-09-16T17:45:59.136006] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-16T17:45:59.263070] [DEBUG] [LOCAL ] CHGG: Primary data saved (35600 records). [2025-09-16T17:45:59.263247] [INFO ] [MAIN ] CHGG: Full history saved. [2025-09-16T17:45:59.263349] [INFO ] [MAIN ] Update Progress: 438/2369 symbols completed. CHGG took 28.5s. Estimated remaining: 3h 22m 31s. Rate: 9.5 symbols/min [2025-09-16T17:45:59.490738] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-16T17:45:59.574894] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-09-16T17:46:00.374937] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-09-16T17:46:00.599629] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-16T17:46:00.603372] [INFO ] [REMOTE ] CHMI: Full fetch complete (23757 records). [2025-09-16T17:46:00.603483] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-09-16T17:46:00.985184] [DEBUG] [VALIDATOR ] CHMI: All expected trading days are present. [2025-09-16T17:46:00.985277] [DEBUG] [VALIDATOR ] CHMI: Primary data validation passed. [2025-09-16T17:46:00.985724] [INFO ] [MAIN ] CHMI: Fetched primary data is valid. [2025-09-16T17:46:00.985770] [DEBUG] [LOCAL ] CHMI: Saving primary data. [2025-09-16T17:46:00.986538] [DEBUG] [LOCAL ] CHMI: Trimmed 23757 records to 15316 (keeping 150 days of data) [2025-09-16T17:46:01.081398] [DEBUG] [LOCAL ] CHMI: Primary data saved (15316 records). [2025-09-16T17:46:01.081555] [INFO ] [MAIN ] CHMI: Full history saved. [2025-09-16T17:46:01.081672] [INFO ] [MAIN ] Update Progress: 439/2369 symbols completed. CHMI took 17.9s. Estimated remaining: 3h 22m 5s. Rate: 9.6 symbols/min [2025-09-16T17:46:01.408025] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-16T17:46:01.415151] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-09-16T17:46:02.536469] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-16T17:46:02.540563] [INFO ] [REMOTE ] CHH: Full fetch complete (35560 records). [2025-09-16T17:46:02.540773] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-09-16T17:46:02.922448] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-09-16T17:46:02.922527] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-09-16T17:46:02.923060] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-09-16T17:46:02.923111] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-09-16T17:46:02.924019] [DEBUG] [LOCAL ] CHH: Trimmed 35560 records to 23518 (keeping 150 days of data) [2025-09-16T17:46:03.080069] [DEBUG] [LOCAL ] CHH: Primary data saved (23518 records). [2025-09-16T17:46:03.080221] [INFO ] [MAIN ] CHH: Full history saved. [2025-09-16T17:46:03.080314] [INFO ] [MAIN ] Update Progress: 440/2369 symbols completed. CHH took 22.6s. Estimated remaining: 3h 21m 40s. Rate: 9.6 symbols/min [2025-09-16T17:46:03.653706] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:46:03.744487] [DEBUG] [LOCAL ] CHN: No existing data file found in primary storage. [2025-09-16T17:46:03.826409] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:46:03.826602] [WARN ] [MAIN ] CHN: No existing data found, performing full refresh instead. [2025-09-16T17:46:03.880862] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-09-16T17:46:03.880782] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:46:03.879632] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:46:03.882077] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-09-16T17:46:03.882840] [DEBUG] [LOCAL ] CHN: No primary data file found to delete. [2025-09-16T17:46:03.882894] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-09-16T17:46:04.025604] [DEBUG] [LOCAL ] CHT: Loaded 14218 existing records from primary storage. [2025-09-16T17:46:04.066676] [INFO ] [MAIN ] CHT: Loaded 14218 existing records. [2025-09-16T17:46:04.291110] [DEBUG] [LOCAL ] CHWY: Loaded 39622 existing records from primary storage. [2025-09-16T17:46:04.338568] [INFO ] [MAIN ] CHWY: Loaded 39622 existing records. [2025-09-16T17:46:04.338790] [DEBUG] [LOCAL ] CHPT: Loaded 36128 existing records from primary storage. [2025-09-16T17:46:04.408594] [INFO ] [MAIN ] CHPT: Loaded 36128 existing records. [2025-09-16T17:46:04.672136] [INFO ] [REMOTE ] CHN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:46:04.742757] [WARN ] [MAIN ] CHT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:46:04.804328] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-09-16T17:46:04.804555] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-09-16T17:46:04.810293] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:46:04.810397] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-09-16T17:46:04.821971] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-09-16T17:46:04.837748] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-09-16T17:46:04.827201] [DEBUG] [LOCAL ] CHT: Deleted primary data file. [2025-09-16T17:46:04.888513] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-09-16T17:46:04.899288] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-09-16T17:46:04.905761] [WARN ] [MAIN ] CHPT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:46:04.932053] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-09-16T17:46:04.939172] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-09-16T17:46:04.956693] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-09-16T17:46:05.045468] [DEBUG] [LOCAL ] CHPT: Deleted primary data file. [2025-09-16T17:46:05.094113] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-09-16T17:46:05.586961] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-16T17:46:05.620681] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-09-16T17:46:05.883245] [INFO ] [REMOTE ] CHT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:46:05.904434] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-09-16T17:46:06.004542] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:46:06.025931] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-09-16T17:46:06.029618] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:46:06.030494] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-09-16T17:46:06.035173] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-16T17:46:06.036945] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-09-16T17:46:06.513412] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-16T17:46:06.774906] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-09-16T17:46:06.995476] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-16T17:46:07.199040] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-16T17:46:07.513195] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-16T17:46:07.574860] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-09-16T17:46:07.973039] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-16T17:46:08.374899] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-09-16T17:46:09.147729] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-16T17:46:09.184928] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-09-16T17:46:09.190897] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-16T17:46:09.604329] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-16T17:46:09.974920] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-09-16T17:46:10.652756] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-16T17:46:10.774909] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-09-16T17:46:11.574900] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-09-16T17:46:11.637675] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-16T17:46:12.374902] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-09-16T17:46:12.785238] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-16T17:46:13.187544] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-09-16T17:46:13.213156] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-16T17:46:13.974892] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-09-16T17:46:14.470045] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-16T17:46:14.471233] [INFO ] [REMOTE ] CHN: Full fetch complete (5463 records). [2025-09-16T17:46:14.471329] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-09-16T17:46:14.778101] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-09-16T17:46:14.863162] [DEBUG] [VALIDATOR ] CHN: All expected trading days are present. [2025-09-16T17:46:14.863344] [DEBUG] [VALIDATOR ] CHN: Primary data validation passed. [2025-09-16T17:46:14.863591] [INFO ] [MAIN ] CHN: Fetched primary data is valid. [2025-09-16T17:46:14.863808] [DEBUG] [LOCAL ] CHN: Saving primary data. [2025-09-16T17:46:14.864466] [DEBUG] [LOCAL ] CHN: Trimmed 5463 records to 3643 (keeping 150 days of data) [2025-09-16T17:46:14.919093] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-16T17:46:14.935739] [DEBUG] [LOCAL ] CHN: Primary data saved (3643 records). [2025-09-16T17:46:14.935836] [INFO ] [MAIN ] CHN: Full history saved. [2025-09-16T17:46:14.935917] [INFO ] [MAIN ] Update Progress: 441/2369 symbols completed. CHN took 11.9s. Estimated remaining: 3h 21m 58s. Rate: 9.5 symbols/min [2025-09-16T17:46:15.129845] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:46:15.178963] [DEBUG] [LOCAL ] CI: Loaded 36930 existing records from primary storage. [2025-09-16T17:46:15.179139] [INFO ] [MAIN ] CI: Loaded 36930 existing records. [2025-09-16T17:46:15.356307] [WARN ] [MAIN ] CI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:46:15.356527] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-09-16T17:46:15.356572] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-09-16T17:46:15.357459] [DEBUG] [LOCAL ] CI: Deleted primary data file. [2025-09-16T17:46:15.357518] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-09-16T17:46:15.580015] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-09-16T17:46:15.749604] [INFO ] [REMOTE ] CI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:46:15.776860] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-16T17:46:16.374897] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-09-16T17:46:17.174880] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-09-16T17:46:17.259062] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-16T17:46:17.974904] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-09-16T17:46:18.272274] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-16T17:46:18.699363] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-16T17:46:18.774907] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-09-16T17:46:18.977452] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-16T17:46:19.574902] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-09-16T17:46:20.374881] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-09-16T17:46:20.764176] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-16T17:46:21.176655] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-09-16T17:46:21.179449] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-16T17:46:21.338407] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-16T17:46:21.974915] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-09-16T17:46:22.774900] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-09-16T17:46:23.391479] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-16T17:46:23.579967] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-09-16T17:46:23.602006] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-09-16T17:46:24.302149] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-16T17:46:24.374970] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-09-16T17:46:25.008988] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-16T17:46:25.174980] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-09-16T17:46:25.285865] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-16T17:46:25.290225] [INFO ] [REMOTE ] CHT: Full fetch complete (21465 records). [2025-09-16T17:46:25.290409] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-09-16T17:46:25.684011] [DEBUG] [VALIDATOR ] CHT: All expected trading days are present. [2025-09-16T17:46:25.684093] [DEBUG] [VALIDATOR ] CHT: Primary data validation passed. [2025-09-16T17:46:25.684489] [INFO ] [MAIN ] CHT: Fetched primary data is valid. [2025-09-16T17:46:25.684530] [DEBUG] [LOCAL ] CHT: Saving primary data. [2025-09-16T17:46:25.685131] [DEBUG] [LOCAL ] CHT: Trimmed 21465 records to 14367 (keeping 150 days of data) [2025-09-16T17:46:25.775704] [DEBUG] [LOCAL ] CHT: Primary data saved (14367 records). [2025-09-16T17:46:25.775844] [INFO ] [MAIN ] CHT: Full history saved. [2025-09-16T17:46:25.775936] [INFO ] [MAIN ] Update Progress: 442/2369 symbols completed. CHT took 22.7s. Estimated remaining: 3h 22m 12s. Rate: 9.5 symbols/min [2025-09-16T17:46:25.948003] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:46:25.961248] [DEBUG] [LOCAL ] CIA: Loaded 12731 existing records from primary storage. [2025-09-16T17:46:25.961368] [INFO ] [MAIN ] CIA: Loaded 12731 existing records. [2025-09-16T17:46:25.982264] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-09-16T17:46:26.146084] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:46:26.146315] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-09-16T17:46:26.146360] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-09-16T17:46:26.146785] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-09-16T17:46:26.146834] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-09-16T17:46:26.502429] [INFO ] [REMOTE ] CIA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:46:26.774919] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-09-16T17:46:27.042256] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-16T17:46:27.574940] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-09-16T17:46:27.744920] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-16T17:46:27.819548] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-16T17:46:28.374901] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-09-16T17:46:29.174919] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-09-16T17:46:29.362866] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-16T17:46:29.557543] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-16T17:46:29.974900] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-09-16T17:46:30.773045] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-16T17:46:30.782430] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-09-16T17:46:31.574954] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-09-16T17:46:31.714505] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-16T17:46:31.825313] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-16T17:46:31.831838] [INFO ] [REMOTE ] CHWY: Full fetch complete (58297 records). [2025-09-16T17:46:31.831972] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-09-16T17:46:32.233377] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-09-16T17:46:32.233455] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-09-16T17:46:32.234160] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-09-16T17:46:32.234209] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-09-16T17:46:32.235356] [DEBUG] [LOCAL ] CHWY: Trimmed 58297 records to 40012 (keeping 150 days of data) [2025-09-16T17:46:32.413684] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-09-16T17:46:32.491139] [DEBUG] [LOCAL ] CHWY: Primary data saved (40012 records). [2025-09-16T17:46:32.491271] [INFO ] [MAIN ] CHWY: Full history saved. [2025-09-16T17:46:32.492627] [INFO ] [MAIN ] Update Progress: 443/2369 symbols completed. CHWY took 29.4s. Estimated remaining: 3h 22m 7s. Rate: 9.5 symbols/min [2025-09-16T17:46:32.669668] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:46:32.694245] [DEBUG] [LOCAL ] CIB: Loaded 21773 existing records from primary storage. [2025-09-16T17:46:32.694395] [INFO ] [MAIN ] CIB: Loaded 21773 existing records. [2025-09-16T17:46:32.883012] [WARN ] [MAIN ] CIB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:46:32.883238] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-09-16T17:46:32.883283] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-09-16T17:46:32.883900] [DEBUG] [LOCAL ] CIB: Deleted primary data file. [2025-09-16T17:46:32.883948] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-09-16T17:46:33.177664] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-09-16T17:46:33.239563] [INFO ] [REMOTE ] CIB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:46:33.354264] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-16T17:46:33.398859] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-16T17:46:33.974924] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-09-16T17:46:34.774931] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-09-16T17:46:35.366734] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-16T17:46:35.548305] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-16T17:46:35.574861] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-09-16T17:46:35.863898] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-16T17:46:36.374942] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-09-16T17:46:37.020918] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-16T17:46:37.027179] [INFO ] [REMOTE ] CI: Full fetch complete (54303 records). [2025-09-16T17:46:37.027341] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-09-16T17:46:37.180089] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-09-16T17:46:37.424341] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-09-16T17:46:37.424419] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-09-16T17:46:37.425051] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-09-16T17:46:37.425097] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-09-16T17:46:37.426130] [DEBUG] [LOCAL ] CI: Trimmed 54303 records to 37304 (keeping 150 days of data) [2025-09-16T17:46:37.663520] [DEBUG] [LOCAL ] CI: Primary data saved (37304 records). [2025-09-16T17:46:37.663672] [INFO ] [MAIN ] CI: Full history saved. [2025-09-16T17:46:37.665006] [INFO ] [MAIN ] Update Progress: 444/2369 symbols completed. CI took 22.7s. Estimated remaining: 3h 21m 56s. Rate: 9.5 symbols/min [2025-09-16T17:46:37.841422] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:46:37.841620] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-09-16T17:46:37.841713] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-09-16T17:46:37.841840] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-09-16T17:46:37.841880] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-16T17:46:37.841922] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-09-16T17:46:37.841964] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-09-16T17:46:37.987393] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-09-16T17:46:38.207834] [INFO ] [REMOTE ] CICB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:46:38.233706] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-16T17:46:38.376765] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-16T17:46:38.774957] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-09-16T17:46:39.127370] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-16T17:46:39.574981] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-09-16T17:46:40.176131] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-16T17:46:40.180854] [INFO ] [REMOTE ] CHPT: Full fetch complete (54587 records). [2025-09-16T17:46:40.180943] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-09-16T17:46:40.382710] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-09-16T17:46:40.563492] [DEBUG] [VALIDATOR ] CHPT: All expected trading days are present. [2025-09-16T17:46:40.563578] [DEBUG] [VALIDATOR ] CHPT: Primary data validation passed. [2025-09-16T17:46:40.564239] [INFO ] [MAIN ] CHPT: Fetched primary data is valid. [2025-09-16T17:46:40.564287] [DEBUG] [LOCAL ] CHPT: Saving primary data. [2025-09-16T17:46:40.565589] [DEBUG] [LOCAL ] CHPT: Trimmed 54587 records to 36364 (keeping 150 days of data) [2025-09-16T17:46:40.690128] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-16T17:46:40.799925] [DEBUG] [LOCAL ] CHPT: Primary data saved (36364 records). [2025-09-16T17:46:40.800072] [INFO ] [MAIN ] CHPT: Full history saved. [2025-09-16T17:46:40.801529] [INFO ] [MAIN ] Update Progress: 445/2369 symbols completed. CHPT took 37.7s. Estimated remaining: 3h 21m 36s. Rate: 9.5 symbols/min [2025-09-16T17:46:40.905639] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-16T17:46:40.975979] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:46:41.017674] [DEBUG] [LOCAL ] CIEN: Loaded 38272 existing records from primary storage. [2025-09-16T17:46:41.017819] [INFO ] [MAIN ] CIEN: Loaded 38272 existing records. [2025-09-16T17:46:41.178462] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-09-16T17:46:41.198705] [WARN ] [MAIN ] CIEN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:46:41.198856] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-09-16T17:46:41.198900] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-09-16T17:46:41.199710] [DEBUG] [LOCAL ] CIEN: Deleted primary data file. [2025-09-16T17:46:41.199762] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-09-16T17:46:41.547871] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:46:41.974856] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-09-16T17:46:42.280720] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-16T17:46:42.378964] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-16T17:46:42.774913] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-09-16T17:46:43.574939] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-09-16T17:46:44.027045] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-16T17:46:44.088167] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-16T17:46:44.374975] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-09-16T17:46:45.158739] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-16T17:46:45.160609] [INFO ] [REMOTE ] CIA: Full fetch complete (18158 records). [2025-09-16T17:46:45.160702] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-09-16T17:46:45.181489] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-09-16T17:46:45.529349] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-09-16T17:46:45.529427] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-09-16T17:46:45.529808] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-09-16T17:46:45.529855] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-09-16T17:46:45.530453] [DEBUG] [LOCAL ] CIA: Trimmed 18158 records to 12780 (keeping 150 days of data) [2025-09-16T17:46:45.583632] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-16T17:46:45.603198] [DEBUG] [LOCAL ] CIA: Primary data saved (12780 records). [2025-09-16T17:46:45.603282] [INFO ] [MAIN ] CIA: Full history saved. [2025-09-16T17:46:45.603356] [INFO ] [MAIN ] Update Progress: 446/2369 symbols completed. CIA took 19.8s. Estimated remaining: 3h 21m 23s. Rate: 9.5 symbols/min [2025-09-16T17:46:45.773244] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:46:45.778314] [DEBUG] [LOCAL ] CIF: Loaded 2943 existing records from primary storage. [2025-09-16T17:46:45.778413] [INFO ] [MAIN ] CIF: Loaded 2943 existing records. [2025-09-16T17:46:45.953974] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:46:45.954207] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-09-16T17:46:45.954251] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-09-16T17:46:45.954471] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-09-16T17:46:45.954514] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-09-16T17:46:45.983448] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-09-16T17:46:46.317313] [INFO ] [REMOTE ] CIF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:46:46.438805] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-16T17:46:46.774871] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-09-16T17:46:47.574958] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-09-16T17:46:48.331999] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-16T17:46:48.374903] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-09-16T17:46:48.491252] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-16T17:46:49.174898] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-09-16T17:46:49.974952] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-09-16T17:46:50.112963] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-16T17:46:50.461346] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-16T17:46:50.774894] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-09-16T17:46:51.007336] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-16T17:46:51.574944] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-09-16T17:46:51.759631] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-16T17:46:52.374914] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-09-16T17:46:52.952028] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-16T17:46:53.174929] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-09-16T17:46:53.380299] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-16T17:46:53.653504] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-16T17:46:53.974918] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-09-16T17:46:54.379670] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-16T17:46:54.774899] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-09-16T17:46:55.098994] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-16T17:46:55.574897] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-09-16T17:46:55.999319] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-16T17:46:56.000236] [INFO ] [REMOTE ] CICB: Full fetch complete (1438 records). [2025-09-16T17:46:56.000313] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-09-16T17:46:56.190966] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 147 unique days, need 150 days [2025-09-16T17:46:56.191184] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:46:56.191230] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:46:56.191270] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-16T17:46:56.191326] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-09-16T17:46:56.191364] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-09-16T17:46:56.191415] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-09-16T17:46:56.191476] [INFO ] [MAIN ] Update Progress: 447/2369 symbols completed. CICB took 18.5s. Estimated remaining: 3h 21m 36s. Rate: 9.5 symbols/min [2025-09-16T17:46:56.366096] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:46:56.374912] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-09-16T17:46:56.400453] [DEBUG] [LOCAL ] CIG: Loaded 32541 existing records from primary storage. [2025-09-16T17:46:56.400582] [INFO ] [MAIN ] CIG: Loaded 32541 existing records. [2025-09-16T17:46:56.575782] [WARN ] [MAIN ] CIG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:46:56.576059] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-09-16T17:46:56.576107] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-09-16T17:46:56.576884] [DEBUG] [LOCAL ] CIG: Deleted primary data file. [2025-09-16T17:46:56.576936] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-09-16T17:46:56.933386] [INFO ] [REMOTE ] CIG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:46:56.952897] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-16T17:46:57.174898] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-09-16T17:46:57.974902] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-09-16T17:46:58.613674] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-16T17:46:58.774915] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-09-16T17:46:59.227352] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-16T17:46:59.574899] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-09-16T17:47:00.374901] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-09-16T17:47:00.613378] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-16T17:47:01.174905] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-09-16T17:47:01.228128] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-16T17:47:01.833337] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-16T17:47:01.974898] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-09-16T17:47:02.116490] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-16T17:47:02.774894] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-09-16T17:47:02.823755] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-16T17:47:02.828097] [INFO ] [REMOTE ] CIB: Full fetch complete (34168 records). [2025-09-16T17:47:02.828202] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-09-16T17:47:03.214770] [DEBUG] [VALIDATOR ] CIB: All expected trading days are present. [2025-09-16T17:47:03.214994] [DEBUG] [VALIDATOR ] CIB: Primary data validation passed. [2025-09-16T17:47:03.215542] [INFO ] [MAIN ] CIB: Fetched primary data is valid. [2025-09-16T17:47:03.215586] [DEBUG] [LOCAL ] CIB: Saving primary data. [2025-09-16T17:47:03.216607] [DEBUG] [LOCAL ] CIB: Trimmed 34168 records to 21993 (keeping 150 days of data) [2025-09-16T17:47:03.346106] [DEBUG] [LOCAL ] CIB: Primary data saved (21993 records). [2025-09-16T17:47:03.346240] [INFO ] [MAIN ] CIB: Full history saved. [2025-09-16T17:47:03.346323] [INFO ] [MAIN ] Update Progress: 448/2369 symbols completed. CIB took 30.9s. Estimated remaining: 3h 21m 33s. Rate: 9.5 symbols/min [2025-09-16T17:47:03.519199] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:47:03.530404] [DEBUG] [LOCAL ] CII: Loaded 10090 existing records from primary storage. [2025-09-16T17:47:03.530518] [INFO ] [MAIN ] CII: Loaded 10090 existing records. [2025-09-16T17:47:03.586894] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-09-16T17:47:03.714279] [WARN ] [MAIN ] CII: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:47:03.714556] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-09-16T17:47:03.714603] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-09-16T17:47:03.715222] [DEBUG] [LOCAL ] CII: Deleted primary data file. [2025-09-16T17:47:03.715272] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-09-16T17:47:04.074940] [INFO ] [REMOTE ] CII: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:47:04.375047] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-09-16T17:47:04.377258] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-16T17:47:04.411085] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-16T17:47:05.109351] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-16T17:47:05.174853] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-09-16T17:47:05.960244] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-16T17:47:05.974840] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-09-16T17:47:06.774892] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-09-16T17:47:06.927529] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-16T17:47:07.574903] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-09-16T17:47:08.002395] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-16T17:47:08.374897] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-09-16T17:47:09.182967] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-09-16T17:47:09.209817] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-16T17:47:09.827476] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-16T17:47:09.974902] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-09-16T17:47:10.774894] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-09-16T17:47:10.946327] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (2.57 seconds). [2025-09-16T17:47:11.244880] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-16T17:47:11.245926] [INFO ] [REMOTE ] CIF: Full fetch complete (5117 records). [2025-09-16T17:47:11.246004] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-09-16T17:47:11.580002] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-09-16T17:47:11.623917] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-09-16T17:47:11.624015] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-09-16T17:47:11.624261] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-09-16T17:47:11.624310] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-09-16T17:47:11.624749] [DEBUG] [LOCAL ] CIF: Trimmed 5117 records to 2981 (keeping 150 days of data) [2025-09-16T17:47:11.644107] [DEBUG] [LOCAL ] CIF: Primary data saved (2981 records). [2025-09-16T17:47:11.644208] [INFO ] [MAIN ] CIF: Full history saved. [2025-09-16T17:47:11.644305] [INFO ] [MAIN ] Update Progress: 449/2369 symbols completed. CIF took 26.0s. Estimated remaining: 3h 21m 35s. Rate: 9.5 symbols/min [2025-09-16T17:47:11.825159] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:47:11.854196] [DEBUG] [LOCAL ] CIM: Loaded 26357 existing records from primary storage. [2025-09-16T17:47:11.854427] [INFO ] [MAIN ] CIM: Loaded 26357 existing records. [2025-09-16T17:47:12.054564] [WARN ] [MAIN ] CIM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:47:12.068485] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-09-16T17:47:12.068630] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-09-16T17:47:12.070364] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-16T17:47:12.070405] [DEBUG] [LOCAL ] CIM: Deleted primary data file. [2025-09-16T17:47:12.080892] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-09-16T17:47:12.380047] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-09-16T17:47:12.458736] [INFO ] [REMOTE ] CIM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:47:13.174905] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-09-16T17:47:13.377794] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-16T17:47:13.554028] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-16T17:47:13.974901] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-09-16T17:47:14.575931] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-16T17:47:14.774887] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-09-16T17:47:14.945106] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-16T17:47:15.574902] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-09-16T17:47:16.330244] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-16T17:47:16.377435] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-09-16T17:47:16.383521] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-16T17:47:17.174973] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-09-16T17:47:17.861437] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-16T17:47:17.974899] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-09-16T17:47:18.774900] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-09-16T17:47:18.935819] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-16T17:47:18.940986] [INFO ] [REMOTE ] CIG: Full fetch complete (46968 records). [2025-09-16T17:47:18.941094] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-09-16T17:47:19.315917] [DEBUG] [VALIDATOR ] CIG: All expected trading days are present. [2025-09-16T17:47:19.316015] [DEBUG] [VALIDATOR ] CIG: Primary data validation passed. [2025-09-16T17:47:19.316746] [INFO ] [MAIN ] CIG: Fetched primary data is valid. [2025-09-16T17:47:19.316821] [DEBUG] [LOCAL ] CIG: Saving primary data. [2025-09-16T17:47:19.317943] [DEBUG] [LOCAL ] CIG: Trimmed 46968 records to 32909 (keeping 150 days of data) [2025-09-16T17:47:19.515908] [DEBUG] [LOCAL ] CIG: Primary data saved (32909 records). [2025-09-16T17:47:19.516083] [INFO ] [MAIN ] CIG: Full history saved. [2025-09-16T17:47:19.517337] [INFO ] [MAIN ] Update Progress: 450/2369 symbols completed. CIG took 23.3s. Estimated remaining: 3h 21m 36s. Rate: 9.5 symbols/min [2025-09-16T17:47:19.583249] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-09-16T17:47:19.700546] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:47:19.708468] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-16T17:47:19.714302] [INFO ] [REMOTE ] CII: Full fetch complete (16884 records). [2025-09-16T17:47:19.714152] [DEBUG] [LOCAL ] CIMN: Loaded 1932 existing records from primary storage. [2025-09-16T17:47:19.714522] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-09-16T17:47:19.714609] [INFO ] [MAIN ] CIMN: Loaded 1932 existing records. [2025-09-16T17:47:19.942652] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-16T17:47:20.002857] [INFO ] [REMOTE ] CIEN: Full fetch complete (56666 records). [2025-09-16T17:47:20.115278] [WARN ] [MAIN ] CIMN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:47:20.050690] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-09-16T17:47:20.178730] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-09-16T17:47:20.219695] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-09-16T17:47:20.256443] [DEBUG] [LOCAL ] CIMN: Deleted primary data file. [2025-09-16T17:47:20.288129] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-09-16T17:47:20.652488] [DEBUG] [VALIDATOR ] CII: All expected trading days are present. [2025-09-16T17:47:20.728982] [DEBUG] [VALIDATOR ] CII: Primary data validation passed. [2025-09-16T17:47:20.831168] [INFO ] [MAIN ] CII: Fetched primary data is valid. [2025-09-16T17:47:20.852330] [DEBUG] [LOCAL ] CII: Saving primary data. [2025-09-16T17:47:20.951216] [DEBUG] [LOCAL ] CII: Trimmed 16884 records to 10219 (keeping 150 days of data) [2025-09-16T17:47:21.167017] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:47:21.170887] [DEBUG] [VALIDATOR ] CIEN: All expected trading days are present. [2025-09-16T17:47:21.171152] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-09-16T17:47:21.173813] [DEBUG] [VALIDATOR ] CIEN: Primary data validation passed. [2025-09-16T17:47:21.174745] [INFO ] [MAIN ] CIEN: Fetched primary data is valid. [2025-09-16T17:47:21.175446] [DEBUG] [LOCAL ] CIEN: Saving primary data. [2025-09-16T17:47:21.188609] [DEBUG] [LOCAL ] CIEN: Trimmed 56666 records to 38661 (keeping 150 days of data) [2025-09-16T17:47:21.305180] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-16T17:47:21.307389] [DEBUG] [LOCAL ] CII: Primary data saved (10219 records). [2025-09-16T17:47:21.307884] [INFO ] [MAIN ] CII: Full history saved. [2025-09-16T17:47:21.316209] [INFO ] [MAIN ] Update Progress: 451/2369 symbols completed. CII took 18.0s. Estimated remaining: 3h 21m 10s. Rate: 9.5 symbols/min [2025-09-16T17:47:21.317376] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-09-16T17:47:21.506252] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:47:21.514673] [DEBUG] [LOCAL ] CIMO: Loaded 2027 existing records from primary storage. [2025-09-16T17:47:21.517336] [INFO ] [MAIN ] CIMO: Loaded 2027 existing records. [2025-09-16T17:47:21.755081] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-16T17:47:21.808691] [WARN ] [MAIN ] CIMO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:47:21.814746] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-09-16T17:47:21.816761] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-09-16T17:47:21.819448] [DEBUG] [LOCAL ] CIMO: Deleted primary data file. [2025-09-16T17:47:21.820000] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-09-16T17:47:21.989782] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-09-16T17:47:22.121717] [DEBUG] [LOCAL ] CIEN: Primary data saved (38661 records). [2025-09-16T17:47:22.121868] [INFO ] [MAIN ] CIEN: Full history saved. [2025-09-16T17:47:22.121971] [INFO ] [MAIN ] Update Progress: 452/2369 symbols completed. CIEN took 41.3s. Estimated remaining: 3h 20m 41s. Rate: 9.6 symbols/min [2025-09-16T17:47:22.306128] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:47:22.380521] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:47:22.394137] [DEBUG] [LOCAL ] CINT: Loaded 13303 existing records from primary storage. [2025-09-16T17:47:22.394251] [INFO ] [MAIN ] CINT: Loaded 13303 existing records. [2025-09-16T17:47:22.559995] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-16T17:47:22.589471] [WARN ] [MAIN ] CINT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:47:22.590972] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-09-16T17:47:22.591051] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-09-16T17:47:22.591449] [DEBUG] [LOCAL ] CINT: Deleted primary data file. [2025-09-16T17:47:22.591497] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-09-16T17:47:22.781979] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-09-16T17:47:22.961961] [INFO ] [REMOTE ] CINT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:47:22.987440] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-16T17:47:23.296228] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-16T17:47:23.574897] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-09-16T17:47:24.374905] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-09-16T17:47:24.398868] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-16T17:47:24.951457] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-16T17:47:25.174920] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-09-16T17:47:25.877080] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-16T17:47:25.974934] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-09-16T17:47:26.420059] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-16T17:47:26.774896] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-09-16T17:47:27.574902] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-09-16T17:47:28.269210] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-16T17:47:28.293586] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-16T17:47:28.374855] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-09-16T17:47:29.174927] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-09-16T17:47:29.594062] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-16T17:47:29.625036] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-16T17:47:29.974942] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-09-16T17:47:30.372956] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-16T17:47:30.774917] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-09-16T17:47:31.308231] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-16T17:47:31.574941] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-09-16T17:47:32.065927] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-16T17:47:32.374902] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-09-16T17:47:32.930202] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-16T17:47:33.174951] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-09-16T17:47:33.670490] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-16T17:47:33.974959] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-09-16T17:47:34.774939] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-09-16T17:47:35.276355] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-16T17:47:35.560522] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-16T17:47:35.561711] [INFO ] [REMOTE ] CIMO: Full fetch complete (3167 records). [2025-09-16T17:47:35.561782] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-09-16T17:47:35.583901] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-09-16T17:47:35.939085] [DEBUG] [VALIDATOR ] CIMO: All expected trading days are present. [2025-09-16T17:47:35.939202] [DEBUG] [VALIDATOR ] CIMO: Primary data validation passed. [2025-09-16T17:47:35.939328] [INFO ] [MAIN ] CIMO: Fetched primary data is valid. [2025-09-16T17:47:35.939369] [DEBUG] [LOCAL ] CIMO: Saving primary data. [2025-09-16T17:47:35.939788] [DEBUG] [LOCAL ] CIMO: Trimmed 3167 records to 2059 (keeping 150 days of data) [2025-09-16T17:47:35.953179] [DEBUG] [LOCAL ] CIMO: Primary data saved (2059 records). [2025-09-16T17:47:35.953306] [INFO ] [MAIN ] CIMO: Full history saved. [2025-09-16T17:47:35.953395] [INFO ] [MAIN ] Update Progress: 453/2369 symbols completed. CIMO took 14.6s. Estimated remaining: 3h 21m 6s. Rate: 9.5 symbols/min [2025-09-16T17:47:36.125997] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:47:36.140568] [DEBUG] [LOCAL ] CIO: Loaded 14449 existing records from primary storage. [2025-09-16T17:47:36.140770] [INFO ] [MAIN ] CIO: Loaded 14449 existing records. [2025-09-16T17:47:36.322346] [WARN ] [MAIN ] CIO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:47:36.322593] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-09-16T17:47:36.322639] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-09-16T17:47:36.323115] [DEBUG] [LOCAL ] CIO: Deleted primary data file. [2025-09-16T17:47:36.323192] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-09-16T17:47:36.380585] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-09-16T17:47:36.693178] [INFO ] [REMOTE ] CIO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:47:37.041995] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-16T17:47:37.174858] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-09-16T17:47:37.300952] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-16T17:47:37.974870] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-09-16T17:47:38.236705] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-16T17:47:38.387092] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-16T17:47:38.774893] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-09-16T17:47:39.199412] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-16T17:47:39.574886] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-09-16T17:47:40.374907] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-09-16T17:47:40.866079] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-16T17:47:40.866899] [INFO ] [REMOTE ] CIMN: Full fetch complete (2854 records). [2025-09-16T17:47:40.866965] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-09-16T17:47:41.178030] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-09-16T17:47:41.231046] [DEBUG] [VALIDATOR ] CIMN: All expected trading days are present. [2025-09-16T17:47:41.231116] [DEBUG] [VALIDATOR ] CIMN: Primary data validation passed. [2025-09-16T17:47:41.231334] [INFO ] [MAIN ] CIMN: Fetched primary data is valid. [2025-09-16T17:47:41.231413] [DEBUG] [LOCAL ] CIMN: Saving primary data. [2025-09-16T17:47:41.231912] [DEBUG] [LOCAL ] CIMN: Trimmed 2854 records to 1937 (keeping 150 days of data) [2025-09-16T17:47:41.263756] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-16T17:47:41.273914] [DEBUG] [LOCAL ] CIMN: Primary data saved (1937 records). [2025-09-16T17:47:41.273997] [INFO ] [MAIN ] CIMN: Full history saved. [2025-09-16T17:47:41.274083] [INFO ] [MAIN ] Update Progress: 454/2369 symbols completed. CIMN took 21.8s. Estimated remaining: 3h 20m 56s. Rate: 9.5 symbols/min [2025-09-16T17:47:41.441972] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:47:41.463846] [DEBUG] [LOCAL ] CION: Loaded 20264 existing records from primary storage. [2025-09-16T17:47:41.463969] [INFO ] [MAIN ] CION: Loaded 20264 existing records. [2025-09-16T17:47:41.639470] [WARN ] [MAIN ] CION: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:47:41.639700] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-09-16T17:47:41.639777] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-09-16T17:47:41.640312] [DEBUG] [LOCAL ] CION: Deleted primary data file. [2025-09-16T17:47:41.640366] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-09-16T17:47:41.986474] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-09-16T17:47:41.990439] [INFO ] [REMOTE ] CION: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:47:42.160275] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-16T17:47:42.774900] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-09-16T17:47:42.918288] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-16T17:47:43.574903] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-09-16T17:47:43.974496] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-16T17:47:44.238952] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-16T17:47:44.374940] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-09-16T17:47:45.174951] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-09-16T17:47:45.429876] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-16T17:47:45.434308] [INFO ] [REMOTE ] CIM: Full fetch complete (40778 records). [2025-09-16T17:47:45.434396] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-09-16T17:47:45.837575] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present. [2025-09-16T17:47:45.837694] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed. [2025-09-16T17:47:45.838253] [INFO ] [MAIN ] CIM: Fetched primary data is valid. [2025-09-16T17:47:45.838300] [DEBUG] [LOCAL ] CIM: Saving primary data. [2025-09-16T17:47:45.839828] [DEBUG] [LOCAL ] CIM: Trimmed 40778 records to 26648 (keeping 150 days of data) [2025-09-16T17:47:45.984029] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-09-16T17:47:46.010679] [DEBUG] [LOCAL ] CIM: Primary data saved (26648 records). [2025-09-16T17:47:46.010834] [INFO ] [MAIN ] CIM: Full history saved. [2025-09-16T17:47:46.010929] [INFO ] [MAIN ] Update Progress: 455/2369 symbols completed. CIM took 34.4s. Estimated remaining: 3h 20m 43s. Rate: 9.5 symbols/min [2025-09-16T17:47:46.188728] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:47:46.201048] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-16T17:47:46.246902] [DEBUG] [LOCAL ] CIVI: Loaded 38791 existing records from primary storage. [2025-09-16T17:47:46.247097] [INFO ] [MAIN ] CIVI: Loaded 38791 existing records. [2025-09-16T17:47:46.426058] [WARN ] [MAIN ] CIVI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:47:46.426355] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-09-16T17:47:46.426411] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-09-16T17:47:46.427383] [DEBUG] [LOCAL ] CIVI: Deleted primary data file. [2025-09-16T17:47:46.427435] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-09-16T17:47:46.784012] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-09-16T17:47:46.788967] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:47:46.946803] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-16T17:47:47.575020] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-09-16T17:47:47.985073] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-16T17:47:48.374956] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-09-16T17:47:49.174947] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-09-16T17:47:49.194552] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-16T17:47:49.358607] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-16T17:47:49.974866] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-09-16T17:47:50.055420] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-16T17:47:50.774917] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-09-16T17:47:51.554667] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-16T17:47:51.574862] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-09-16T17:47:51.724966] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-16T17:47:52.374889] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-09-16T17:47:52.838882] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-16T17:47:53.072199] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-16T17:47:53.174856] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-09-16T17:47:53.974933] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-09-16T17:47:54.253501] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-16T17:47:54.256594] [INFO ] [REMOTE ] CIO: Full fetch complete (21245 records). [2025-09-16T17:47:54.256705] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-09-16T17:47:54.636023] [DEBUG] [VALIDATOR ] CIO: All expected trading days are present. [2025-09-16T17:47:54.636129] [DEBUG] [VALIDATOR ] CIO: Primary data validation passed. [2025-09-16T17:47:54.636556] [INFO ] [MAIN ] CIO: Fetched primary data is valid. [2025-09-16T17:47:54.636607] [DEBUG] [LOCAL ] CIO: Saving primary data. [2025-09-16T17:47:54.637792] [DEBUG] [LOCAL ] CIO: Trimmed 21245 records to 14659 (keeping 150 days of data) [2025-09-16T17:47:54.723088] [DEBUG] [LOCAL ] CIO: Primary data saved (14659 records). [2025-09-16T17:47:54.723248] [INFO ] [MAIN ] CIO: Full history saved. [2025-09-16T17:47:54.723364] [INFO ] [MAIN ] Update Progress: 456/2369 symbols completed. CIO took 18.8s. Estimated remaining: 3h 20m 47s. Rate: 9.5 symbols/min [2025-09-16T17:47:54.787224] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-09-16T17:47:54.900392] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:47:54.945446] [DEBUG] [LOCAL ] CL: Loaded 39609 existing records from primary storage. [2025-09-16T17:47:54.945695] [INFO ] [MAIN ] CL: Loaded 39609 existing records. [2025-09-16T17:47:55.123753] [WARN ] [MAIN ] CL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:47:55.124184] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-09-16T17:47:55.124270] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-09-16T17:47:55.132898] [DEBUG] [LOCAL ] CL: Deleted primary data file. [2025-09-16T17:47:55.144242] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-09-16T17:47:55.238539] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-16T17:47:55.514487] [INFO ] [REMOTE ] CL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:47:55.574877] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-09-16T17:47:55.779881] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-16T17:47:55.782831] [INFO ] [REMOTE ] CINT: Full fetch complete (19910 records). [2025-09-16T17:47:55.782909] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-09-16T17:47:56.150323] [DEBUG] [VALIDATOR ] CINT: All expected trading days are present. [2025-09-16T17:47:56.150400] [DEBUG] [VALIDATOR ] CINT: Primary data validation passed. [2025-09-16T17:47:56.150827] [INFO ] [MAIN ] CINT: Fetched primary data is valid. [2025-09-16T17:47:56.150899] [DEBUG] [LOCAL ] CINT: Saving primary data. [2025-09-16T17:47:56.151596] [DEBUG] [LOCAL ] CINT: Trimmed 19910 records to 13656 (keeping 150 days of data) [2025-09-16T17:47:56.232670] [DEBUG] [LOCAL ] CINT: Primary data saved (13656 records). [2025-09-16T17:47:56.232830] [INFO ] [MAIN ] CINT: Full history saved. [2025-09-16T17:47:56.232946] [INFO ] [MAIN ] Update Progress: 457/2369 symbols completed. CINT took 34.1s. Estimated remaining: 3h 20m 21s. Rate: 9.5 symbols/min [2025-09-16T17:47:56.380542] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-09-16T17:47:56.404776] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:47:56.429629] [DEBUG] [LOCAL ] CLB: Loaded 24105 existing records from primary storage. [2025-09-16T17:47:56.429793] [INFO ] [MAIN ] CLB: Loaded 24105 existing records. [2025-09-16T17:47:56.604828] [WARN ] [MAIN ] CLB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:47:56.605083] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-09-16T17:47:56.605128] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-09-16T17:47:56.605888] [DEBUG] [LOCAL ] CLB: Deleted primary data file. [2025-09-16T17:47:56.605947] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-09-16T17:47:56.972736] [INFO ] [REMOTE ] CLB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:47:57.062933] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-16T17:47:57.174898] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-09-16T17:47:57.974918] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-09-16T17:47:58.051557] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-16T17:47:58.774937] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-09-16T17:47:58.869897] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-16T17:47:59.223191] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-16T17:47:59.574878] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-09-16T17:47:59.945899] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-16T17:48:00.374901] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-09-16T17:48:01.013318] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-16T17:48:01.174902] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-09-16T17:48:01.918763] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-16T17:48:01.974946] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-09-16T17:48:02.637706] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-16T17:48:02.774915] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-09-16T17:48:03.574926] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-09-16T17:48:03.853950] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-16T17:48:03.925748] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-16T17:48:04.374942] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-09-16T17:48:05.174862] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-09-16T17:48:05.544948] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-16T17:48:05.660509] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-16T17:48:05.974903] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-09-16T17:48:06.774908] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-09-16T17:48:07.007740] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-16T17:48:07.392024] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-16T17:48:07.574945] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-09-16T17:48:08.052054] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-16T17:48:08.055911] [INFO ] [REMOTE ] CION: Full fetch complete (31485 records). [2025-09-16T17:48:08.056007] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-09-16T17:48:08.380141] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-09-16T17:48:08.441456] [DEBUG] [VALIDATOR ] CION: All expected trading days are present. [2025-09-16T17:48:08.441548] [DEBUG] [VALIDATOR ] CION: Primary data validation passed. [2025-09-16T17:48:08.442195] [INFO ] [MAIN ] CION: Fetched primary data is valid. [2025-09-16T17:48:08.442262] [DEBUG] [LOCAL ] CION: Saving primary data. [2025-09-16T17:48:08.443262] [DEBUG] [LOCAL ] CION: Trimmed 31485 records to 20480 (keeping 150 days of data) [2025-09-16T17:48:08.574873] [DEBUG] [LOCAL ] CION: Primary data saved (20480 records). [2025-09-16T17:48:08.575002] [INFO ] [MAIN ] CION: Full history saved. [2025-09-16T17:48:08.575112] [INFO ] [MAIN ] Update Progress: 458/2369 symbols completed. CION took 27.3s. Estimated remaining: 3h 20m 40s. Rate: 9.5 symbols/min [2025-09-16T17:48:08.745472] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:48:08.754094] [DEBUG] [LOCAL ] CLCO: Loaded 7925 existing records from primary storage. [2025-09-16T17:48:08.754193] [INFO ] [MAIN ] CLCO: Loaded 7925 existing records. [2025-09-16T17:48:08.931911] [WARN ] [MAIN ] CLCO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:48:08.932190] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-09-16T17:48:08.932237] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-09-16T17:48:08.932583] [DEBUG] [LOCAL ] CLCO: Deleted primary data file. [2025-09-16T17:48:08.932639] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-09-16T17:48:09.184958] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-09-16T17:48:09.330046] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:48:09.423192] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-16T17:48:09.974915] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-09-16T17:48:10.231416] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-16T17:48:10.597389] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-16T17:48:10.774893] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-09-16T17:48:11.200909] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-16T17:48:11.574950] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-09-16T17:48:12.116957] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-16T17:48:12.374901] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-09-16T17:48:13.174913] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-09-16T17:48:13.575607] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-16T17:48:13.974906] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-09-16T17:48:14.017287] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-16T17:48:14.317005] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-16T17:48:14.774887] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-09-16T17:48:15.574891] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-09-16T17:48:15.909932] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-16T17:48:15.934875] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-16T17:48:16.374970] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-09-16T17:48:17.071804] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-16T17:48:17.078162] [INFO ] [REMOTE ] CIVI: Full fetch complete (56727 records). [2025-09-16T17:48:17.078316] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-09-16T17:48:17.079121] [FATAL] [VALIDATOR ] CIVI: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:48:17.079207] [FATAL] [MAIN ] CIVI: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:48:17.079247] [WARN ] [MAIN ] CIVI: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:48:17.079299] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-09-16T17:48:17.079372] [DEBUG] [LOCAL ] CIVI: No primary data file found to delete. [2025-09-16T17:48:17.079413] [INFO ] [LOCAL ] CIVI: Starting deletion of derivative data. [2025-09-16T17:48:17.079762] [DEBUG] [LOCAL ] CIVI: Deleted derivative data file. [2025-09-16T17:48:17.079850] [INFO ] [MAIN ] Update Progress: 459/2369 symbols completed. CIVI took 31.1s. Estimated remaining: 3h 20m 43s. Rate: 9.5 symbols/min [2025-09-16T17:48:17.180158] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-09-16T17:48:17.265859] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:48:17.284516] [DEBUG] [LOCAL ] CLDT: Loaded 17486 existing records from primary storage. [2025-09-16T17:48:17.284704] [INFO ] [MAIN ] CLDT: Loaded 17486 existing records. [2025-09-16T17:48:17.473859] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:48:17.474095] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-09-16T17:48:17.474141] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-09-16T17:48:17.474618] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-09-16T17:48:17.474695] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-09-16T17:48:17.848688] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:48:17.861917] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-16T17:48:17.868061] [INFO ] [REMOTE ] CLB: Full fetch complete (35847 records). [2025-09-16T17:48:17.868255] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-09-16T17:48:17.982718] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-09-16T17:48:18.266412] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-09-16T17:48:18.266503] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-09-16T17:48:18.267110] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-09-16T17:48:18.267155] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-09-16T17:48:18.268081] [DEBUG] [LOCAL ] CLB: Trimmed 35847 records to 24336 (keeping 150 days of data) [2025-09-16T17:48:18.371192] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-16T17:48:18.435088] [DEBUG] [LOCAL ] CLB: Primary data saved (24336 records). [2025-09-16T17:48:18.435227] [INFO ] [MAIN ] CLB: Full history saved. [2025-09-16T17:48:18.435325] [INFO ] [MAIN ] Update Progress: 460/2369 symbols completed. CLB took 22.2s. Estimated remaining: 3h 20m 16s. Rate: 9.5 symbols/min [2025-09-16T17:48:18.606047] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:48:18.645179] [DEBUG] [LOCAL ] CLF: Loaded 39702 existing records from primary storage. [2025-09-16T17:48:18.645330] [INFO ] [MAIN ] CLF: Loaded 39702 existing records. [2025-09-16T17:48:18.788625] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-09-16T17:48:18.827731] [WARN ] [MAIN ] CLF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:48:18.827983] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-09-16T17:48:18.828030] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-09-16T17:48:18.829338] [DEBUG] [LOCAL ] CLF: Deleted primary data file. [2025-09-16T17:48:18.829387] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-09-16T17:48:19.184554] [INFO ] [REMOTE ] CLF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:48:19.256163] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-16T17:48:19.574934] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-09-16T17:48:20.374907] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-09-16T17:48:20.680419] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-16T17:48:20.902794] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-16T17:48:20.909162] [INFO ] [REMOTE ] CL: Full fetch complete (58319 records). [2025-09-16T17:48:20.909276] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-09-16T17:48:21.177564] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-09-16T17:48:21.234580] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-16T17:48:21.310028] [DEBUG] [VALIDATOR ] CL: All expected trading days are present. [2025-09-16T17:48:21.310120] [DEBUG] [VALIDATOR ] CL: Primary data validation passed. [2025-09-16T17:48:21.310916] [INFO ] [MAIN ] CL: Fetched primary data is valid. [2025-09-16T17:48:21.310995] [DEBUG] [LOCAL ] CL: Saving primary data. [2025-09-16T17:48:21.312287] [DEBUG] [LOCAL ] CL: Trimmed 58319 records to 39999 (keeping 150 days of data) [2025-09-16T17:48:21.561625] [DEBUG] [LOCAL ] CL: Primary data saved (39999 records). [2025-09-16T17:48:21.561799] [INFO ] [MAIN ] CL: Full history saved. [2025-09-16T17:48:21.563229] [INFO ] [MAIN ] Update Progress: 461/2369 symbols completed. CL took 26.8s. Estimated remaining: 3h 19m 56s. Rate: 9.5 symbols/min [2025-09-16T17:48:21.741766] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:48:21.764895] [DEBUG] [LOCAL ] CLH: Loaded 19570 existing records from primary storage. [2025-09-16T17:48:21.765046] [INFO ] [MAIN ] CLH: Loaded 19570 existing records. [2025-09-16T17:48:21.945553] [WARN ] [MAIN ] CLH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:48:21.945848] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-09-16T17:48:21.945895] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-09-16T17:48:21.946402] [DEBUG] [LOCAL ] CLH: Deleted primary data file. [2025-09-16T17:48:21.946447] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-09-16T17:48:21.979988] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-09-16T17:48:22.302472] [INFO ] [REMOTE ] CLH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:48:22.656580] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-16T17:48:22.774890] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-09-16T17:48:23.410137] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-16T17:48:23.574955] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-09-16T17:48:24.032107] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-16T17:48:24.374934] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-09-16T17:48:24.773510] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-16T17:48:25.174915] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-09-16T17:48:25.974948] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-09-16T17:48:26.105752] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-16T17:48:26.400516] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-16T17:48:26.774888] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-09-16T17:48:27.124679] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-16T17:48:27.574931] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-09-16T17:48:27.597067] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-16T17:48:28.374941] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-09-16T17:48:28.664156] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-16T17:48:29.174962] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-09-16T17:48:29.763285] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-16T17:48:29.974978] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-09-16T17:48:30.504271] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-16T17:48:30.774885] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-09-16T17:48:31.240627] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-16T17:48:31.574908] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-09-16T17:48:31.591825] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-16T17:48:31.593360] [INFO ] [REMOTE ] CLCO: Full fetch complete (15521 records). [2025-09-16T17:48:31.593440] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-09-16T17:48:31.964854] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-09-16T17:48:31.964945] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-09-16T17:48:31.965350] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-09-16T17:48:31.965401] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-09-16T17:48:31.966014] [DEBUG] [LOCAL ] CLCO: Trimmed 15521 records to 7998 (keeping 150 days of data) [2025-09-16T17:48:32.012924] [DEBUG] [LOCAL ] CLCO: Primary data saved (7998 records). [2025-09-16T17:48:32.013070] [INFO ] [MAIN ] CLCO: Full history saved. [2025-09-16T17:48:32.013163] [INFO ] [MAIN ] Update Progress: 462/2369 symbols completed. CLCO took 23.4s. Estimated remaining: 3h 20m 7s. Rate: 9.5 symbols/min [2025-09-16T17:48:32.191678] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:48:32.200626] [DEBUG] [LOCAL ] CLPR: Loaded 7760 existing records from primary storage. [2025-09-16T17:48:32.200750] [INFO ] [MAIN ] CLPR: Loaded 7760 existing records. [2025-09-16T17:48:32.380873] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-09-16T17:48:32.386577] [WARN ] [MAIN ] CLPR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:48:32.386928] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-09-16T17:48:32.387032] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-09-16T17:48:32.387371] [DEBUG] [LOCAL ] CLPR: Deleted primary data file. [2025-09-16T17:48:32.387592] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-09-16T17:48:32.573736] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-16T17:48:32.780106] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:48:33.174908] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-09-16T17:48:33.871454] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-16T17:48:33.974920] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-09-16T17:48:34.415308] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-16T17:48:34.774913] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-09-16T17:48:34.924755] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-16T17:48:35.486016] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-16T17:48:35.574988] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-09-16T17:48:36.374940] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-09-16T17:48:36.685150] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-16T17:48:37.174916] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-09-16T17:48:37.974911] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-09-16T17:48:38.204745] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-16T17:48:38.289202] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-16T17:48:38.566178] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-16T17:48:38.774893] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-09-16T17:48:39.574917] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-09-16T17:48:40.374881] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-09-16T17:48:40.827793] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-16T17:48:40.830883] [INFO ] [REMOTE ] CLDT: Full fetch complete (28602 records). [2025-09-16T17:48:40.830983] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-09-16T17:48:41.195445] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-09-16T17:48:41.265435] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-09-16T17:48:41.266212] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-09-16T17:48:41.269959] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-09-16T17:48:41.269315] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-09-16T17:48:41.270151] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-09-16T17:48:41.286075] [DEBUG] [LOCAL ] CLDT: Trimmed 28602 records to 17684 (keeping 150 days of data) [2025-09-16T17:48:41.391570] [DEBUG] [LOCAL ] CLDT: Primary data saved (17684 records). [2025-09-16T17:48:41.391755] [INFO ] [MAIN ] CLDT: Full history saved. [2025-09-16T17:48:41.391845] [INFO ] [MAIN ] Update Progress: 463/2369 symbols completed. CLDT took 24.3s. Estimated remaining: 3h 20m 14s. Rate: 9.5 symbols/min [2025-09-16T17:48:41.574261] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:48:41.615200] [DEBUG] [LOCAL ] CLS: Loaded 39616 existing records from primary storage. [2025-09-16T17:48:41.615419] [INFO ] [MAIN ] CLS: Loaded 39616 existing records. [2025-09-16T17:48:41.745165] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-16T17:48:41.832547] [WARN ] [MAIN ] CLS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:48:41.833012] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-09-16T17:48:41.833064] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-09-16T17:48:41.834014] [DEBUG] [LOCAL ] CLS: Deleted primary data file. [2025-09-16T17:48:41.834069] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-09-16T17:48:41.977458] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-09-16T17:48:42.179358] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-16T17:48:42.201945] [INFO ] [REMOTE ] CLS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:48:42.774881] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-09-16T17:48:43.328696] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-16T17:48:43.359881] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-16T17:48:43.574917] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-09-16T17:48:44.374941] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-09-16T17:48:45.174922] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-09-16T17:48:45.510977] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-16T17:48:45.514802] [INFO ] [REMOTE ] CLH: Full fetch complete (31781 records). [2025-09-16T17:48:45.514959] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-09-16T17:48:45.650726] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-16T17:48:45.929089] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present. [2025-09-16T17:48:45.929180] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed. [2025-09-16T17:48:45.929678] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-09-16T17:48:45.929724] [DEBUG] [LOCAL ] CLH: Saving primary data. [2025-09-16T17:48:45.930614] [DEBUG] [LOCAL ] CLH: Trimmed 31781 records to 19781 (keeping 150 days of data) [2025-09-16T17:48:45.983977] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-09-16T17:48:46.056370] [DEBUG] [LOCAL ] CLH: Primary data saved (19781 records). [2025-09-16T17:48:46.056521] [INFO ] [MAIN ] CLH: Full history saved. [2025-09-16T17:48:46.056610] [INFO ] [MAIN ] Update Progress: 464/2369 symbols completed. CLH took 24.5s. Estimated remaining: 3h 20m 1s. Rate: 9.5 symbols/min [2025-09-16T17:48:46.228065] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:48:46.269400] [DEBUG] [LOCAL ] CLVT: Loaded 38400 existing records from primary storage. [2025-09-16T17:48:46.269565] [INFO ] [MAIN ] CLVT: Loaded 38400 existing records. [2025-09-16T17:48:46.446829] [WARN ] [MAIN ] CLVT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:48:46.447059] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-09-16T17:48:46.447105] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-09-16T17:48:46.447952] [DEBUG] [LOCAL ] CLVT: Deleted primary data file. [2025-09-16T17:48:46.448003] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-09-16T17:48:46.787270] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-09-16T17:48:46.791557] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:48:47.436389] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-09-16T17:48:47.574861] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-09-16T17:48:47.744024] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-16T17:48:48.050157] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-16T17:48:48.056473] [INFO ] [REMOTE ] CLF: Full fetch complete (58422 records). [2025-09-16T17:48:48.056571] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-09-16T17:48:48.387775] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-09-16T17:48:48.437860] [DEBUG] [VALIDATOR ] CLF: All expected trading days are present. [2025-09-16T17:48:48.437935] [DEBUG] [VALIDATOR ] CLF: Primary data validation passed. [2025-09-16T17:48:48.438603] [INFO ] [MAIN ] CLF: Fetched primary data is valid. [2025-09-16T17:48:48.438662] [DEBUG] [LOCAL ] CLF: Saving primary data. [2025-09-16T17:48:48.439818] [DEBUG] [LOCAL ] CLF: Trimmed 58422 records to 40092 (keeping 150 days of data) [2025-09-16T17:48:48.678110] [DEBUG] [LOCAL ] CLF: Primary data saved (40092 records). [2025-09-16T17:48:48.678240] [INFO ] [MAIN ] CLF: Full history saved. [2025-09-16T17:48:48.678321] [INFO ] [MAIN ] Update Progress: 465/2369 symbols completed. CLF took 30.2s. Estimated remaining: 3h 19m 39s. Rate: 9.5 symbols/min [2025-09-16T17:48:48.849549] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:48:48.865165] [DEBUG] [LOCAL ] CLW: Loaded 15618 existing records from primary storage. [2025-09-16T17:48:48.865302] [INFO ] [MAIN ] CLW: Loaded 15618 existing records. [2025-09-16T17:48:49.042780] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:48:49.043005] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-09-16T17:48:49.043050] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-09-16T17:48:49.043454] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-09-16T17:48:49.043499] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-09-16T17:48:49.191486] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-09-16T17:48:49.402533] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-16T17:48:49.422087] [INFO ] [REMOTE ] CLW: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:48:49.507671] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-16T17:48:49.974896] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-09-16T17:48:50.664618] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-16T17:48:50.774863] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-09-16T17:48:51.169383] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-16T17:48:51.574885] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-09-16T17:48:52.374937] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-09-16T17:48:52.603732] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-16T17:48:52.836340] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-16T17:48:53.091565] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-16T17:48:53.092963] [INFO ] [REMOTE ] CLPR: Full fetch complete (12528 records). [2025-09-16T17:48:53.093033] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-09-16T17:48:53.093443] [FATAL] [VALIDATOR ] CLPR: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:48:53.093518] [FATAL] [MAIN ] CLPR: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:48:53.093556] [WARN ] [MAIN ] CLPR: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:48:53.093596] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-09-16T17:48:53.093715] [DEBUG] [LOCAL ] CLPR: No primary data file found to delete. [2025-09-16T17:48:53.093769] [INFO ] [LOCAL ] CLPR: Starting deletion of derivative data. [2025-09-16T17:48:53.094087] [DEBUG] [LOCAL ] CLPR: Deleted derivative data file. [2025-09-16T17:48:53.094167] [INFO ] [MAIN ] Update Progress: 466/2369 symbols completed. CLPR took 21.1s. Estimated remaining: 3h 19m 25s. Rate: 9.5 symbols/min [2025-09-16T17:48:53.180017] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-09-16T17:48:53.269270] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:48:53.311057] [DEBUG] [LOCAL ] CLX: Loaded 38387 existing records from primary storage. [2025-09-16T17:48:53.311196] [INFO ] [MAIN ] CLX: Loaded 38387 existing records. [2025-09-16T17:48:53.492320] [WARN ] [MAIN ] CLX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:48:53.492671] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-09-16T17:48:53.492720] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-09-16T17:48:53.493616] [DEBUG] [LOCAL ] CLX: Deleted primary data file. [2025-09-16T17:48:53.493695] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-09-16T17:48:53.864159] [INFO ] [REMOTE ] CLX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:48:53.974843] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-09-16T17:48:54.774881] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-09-16T17:48:55.113412] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-16T17:48:55.367263] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-16T17:48:55.574861] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-09-16T17:48:56.374918] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-09-16T17:48:57.046804] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-16T17:48:57.174864] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-09-16T17:48:57.217196] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-16T17:48:57.520170] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-16T17:48:57.974957] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-09-16T17:48:58.774908] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-09-16T17:48:59.540425] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-09-16T17:48:59.574895] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-09-16T17:48:59.699761] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-16T17:49:00.374929] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-09-16T17:49:00.568723] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-16T17:49:01.174916] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-09-16T17:49:01.802508] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-16T17:49:01.974920] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-09-16T17:49:02.128523] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-16T17:49:02.360890] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-16T17:49:02.774881] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-09-16T17:49:03.574920] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-09-16T17:49:03.977602] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-16T17:49:04.374954] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-09-16T17:49:04.778812] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-16T17:49:05.076085] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-16T17:49:05.174901] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-09-16T17:49:05.266358] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-16T17:49:05.974913] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-09-16T17:49:06.774891] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-09-16T17:49:07.563362] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-09-16T17:49:07.575129] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-09-16T17:49:07.828056] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-16T17:49:08.374899] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-09-16T17:49:08.461620] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-16T17:49:09.174905] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-09-16T17:49:09.368814] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-16T17:49:09.486287] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-16T17:49:09.492694] [INFO ] [REMOTE ] CLS: Full fetch complete (58322 records). [2025-09-16T17:49:09.492810] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-09-16T17:49:09.889688] [DEBUG] [VALIDATOR ] CLS: All expected trading days are present. [2025-09-16T17:49:09.889790] [DEBUG] [VALIDATOR ] CLS: Primary data validation passed. [2025-09-16T17:49:09.890596] [INFO ] [MAIN ] CLS: Fetched primary data is valid. [2025-09-16T17:49:09.890667] [DEBUG] [LOCAL ] CLS: Saving primary data. [2025-09-16T17:49:09.891982] [DEBUG] [LOCAL ] CLS: Trimmed 58322 records to 40005 (keeping 150 days of data) [2025-09-16T17:49:09.982281] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-09-16T17:49:10.143840] [DEBUG] [LOCAL ] CLS: Primary data saved (40005 records). [2025-09-16T17:49:10.143987] [INFO ] [MAIN ] CLS: Full history saved. [2025-09-16T17:49:10.144146] [INFO ] [MAIN ] Update Progress: 467/2369 symbols completed. CLS took 28.8s. Estimated remaining: 3h 20m 3s. Rate: 9.5 symbols/min [2025-09-16T17:49:10.319284] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:49:10.319455] [DEBUG] [LOCAL ] CM: No existing data file found in primary storage. [2025-09-16T17:49:10.319496] [WARN ] [MAIN ] CM: No existing data found, performing full refresh instead. [2025-09-16T17:49:10.319620] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-09-16T17:49:10.319681] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-09-16T17:49:10.319727] [DEBUG] [LOCAL ] CM: No primary data file found to delete. [2025-09-16T17:49:10.319761] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-09-16T17:49:10.677198] [INFO ] [REMOTE ] CM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:49:10.774857] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-09-16T17:49:10.898282] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-16T17:49:11.005950] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-16T17:49:11.574896] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-09-16T17:49:12.374870] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-09-16T17:49:12.462337] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-16T17:49:12.690506] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-16T17:49:12.693538] [INFO ] [REMOTE ] CLW: Full fetch complete (24645 records). [2025-09-16T17:49:12.693627] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-09-16T17:49:13.063823] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-09-16T17:49:13.063900] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-09-16T17:49:13.064349] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-09-16T17:49:13.064392] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-09-16T17:49:13.065095] [DEBUG] [LOCAL ] CLW: Trimmed 24645 records to 15781 (keeping 150 days of data) [2025-09-16T17:49:13.156829] [DEBUG] [LOCAL ] CLW: Primary data saved (15781 records). [2025-09-16T17:49:13.156978] [INFO ] [MAIN ] CLW: Full history saved. [2025-09-16T17:49:13.157064] [INFO ] [MAIN ] Update Progress: 468/2369 symbols completed. CLW took 24.5s. Estimated remaining: 3h 19m 43s. Rate: 9.5 symbols/min [2025-09-16T17:49:13.180008] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-09-16T17:49:13.339814] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:49:13.376780] [DEBUG] [LOCAL ] CMA: Loaded 36840 existing records from primary storage. [2025-09-16T17:49:13.376938] [INFO ] [MAIN ] CMA: Loaded 36840 existing records. [2025-09-16T17:49:13.559203] [WARN ] [MAIN ] CMA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:49:13.559415] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-09-16T17:49:13.559461] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-09-16T17:49:13.560298] [DEBUG] [LOCAL ] CMA: Deleted primary data file. [2025-09-16T17:49:13.560360] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-09-16T17:49:13.918383] [INFO ] [REMOTE ] CMA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:49:13.974861] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-09-16T17:49:14.245931] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-16T17:49:14.770531] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-16T17:49:14.776429] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-09-16T17:49:14.778273] [INFO ] [REMOTE ] CLX: Full fetch complete (55705 records). [2025-09-16T17:49:14.778446] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-09-16T17:49:15.174424] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present. [2025-09-16T17:49:15.174525] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed. [2025-09-16T17:49:15.175271] [INFO ] [MAIN ] CLX: Fetched primary data is valid. [2025-09-16T17:49:15.175345] [DEBUG] [LOCAL ] CLX: Saving primary data. [2025-09-16T17:49:15.176633] [DEBUG] [LOCAL ] CLX: Trimmed 55705 records to 38771 (keeping 150 days of data) [2025-09-16T17:49:15.424531] [DEBUG] [LOCAL ] CLX: Primary data saved (38771 records). [2025-09-16T17:49:15.424744] [INFO ] [MAIN ] CLX: Full history saved. [2025-09-16T17:49:15.426997] [INFO ] [MAIN ] Update Progress: 469/2369 symbols completed. CLX took 22.3s. Estimated remaining: 3h 19m 20s. Rate: 9.5 symbols/min [2025-09-16T17:49:15.582574] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-09-16T17:49:15.607860] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:49:15.626438] [DEBUG] [LOCAL ] CMBT: Loaded 16946 existing records from primary storage. [2025-09-16T17:49:15.626588] [INFO ] [MAIN ] CMBT: Loaded 16946 existing records. [2025-09-16T17:49:15.813597] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:49:15.813980] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-09-16T17:49:15.814110] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-09-16T17:49:15.814578] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-09-16T17:49:15.814627] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-09-16T17:49:16.082052] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-16T17:49:16.241603] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:49:16.258814] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-16T17:49:16.265044] [INFO ] [REMOTE ] CLVT: Full fetch complete (56663 records). [2025-09-16T17:49:16.265180] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-09-16T17:49:16.379964] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-09-16T17:49:16.642664] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present. [2025-09-16T17:49:16.642744] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed. [2025-09-16T17:49:16.643407] [INFO ] [MAIN ] CLVT: Fetched primary data is valid. [2025-09-16T17:49:16.643450] [DEBUG] [LOCAL ] CLVT: Saving primary data. [2025-09-16T17:49:16.644599] [DEBUG] [LOCAL ] CLVT: Trimmed 56663 records to 38762 (keeping 150 days of data) [2025-09-16T17:49:16.861926] [DEBUG] [LOCAL ] CLVT: Primary data saved (38762 records). [2025-09-16T17:49:16.862089] [INFO ] [MAIN ] CLVT: Full history saved. [2025-09-16T17:49:16.863145] [INFO ] [MAIN ] Update Progress: 470/2369 symbols completed. CLVT took 30.8s. Estimated remaining: 3h 18m 55s. Rate: 9.5 symbols/min [2025-09-16T17:49:17.036814] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:49:17.072102] [DEBUG] [LOCAL ] CMC: Loaded 32872 existing records from primary storage. [2025-09-16T17:49:17.072281] [INFO ] [MAIN ] CMC: Loaded 32872 existing records. [2025-09-16T17:49:17.175096] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-09-16T17:49:17.256342] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:49:17.256811] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-09-16T17:49:17.257030] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-09-16T17:49:17.257853] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-09-16T17:49:17.257949] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-09-16T17:49:17.412375] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-16T17:49:17.689522] [INFO ] [REMOTE ] CMC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:49:17.690845] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-16T17:49:17.974926] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-09-16T17:49:18.774865] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-09-16T17:49:18.941162] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-16T17:49:19.437285] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-16T17:49:19.574909] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-09-16T17:49:19.729791] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-16T17:49:20.374900] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-09-16T17:49:20.614364] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-16T17:49:21.174914] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-09-16T17:49:21.671035] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-16T17:49:21.974987] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-09-16T17:49:22.786415] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-09-16T17:49:22.796068] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-16T17:49:23.043112] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-16T17:49:23.574951] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-09-16T17:49:24.289015] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-16T17:49:24.352274] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-16T17:49:24.374896] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-09-16T17:49:25.134850] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-16T17:49:25.174950] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-09-16T17:49:25.974957] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-09-16T17:49:26.771515] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-16T17:49:26.781200] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-09-16T17:49:27.574943] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-09-16T17:49:27.809719] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-16T17:49:28.374922] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-09-16T17:49:28.421387] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-16T17:49:29.150024] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-16T17:49:29.174853] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-09-16T17:49:29.974879] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-09-16T17:49:30.022292] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-16T17:49:30.697964] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-16T17:49:30.704103] [INFO ] [REMOTE ] CMBT: Full fetch complete (22064 records). [2025-09-16T17:49:30.704214] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-09-16T17:49:30.784170] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-09-16T17:49:31.082781] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-09-16T17:49:31.082903] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-09-16T17:49:31.083496] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-09-16T17:49:31.083541] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-09-16T17:49:31.084280] [DEBUG] [LOCAL ] CMBT: Trimmed 22064 records to 17313 (keeping 150 days of data) [2025-09-16T17:49:31.187500] [DEBUG] [LOCAL ] CMBT: Primary data saved (17313 records). [2025-09-16T17:49:31.187705] [INFO ] [MAIN ] CMBT: Full history saved. [2025-09-16T17:49:31.187829] [INFO ] [MAIN ] Update Progress: 471/2369 symbols completed. CMBT took 15.8s. Estimated remaining: 3h 19m 21s. Rate: 9.5 symbols/min [2025-09-16T17:49:31.366567] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:49:31.371554] [DEBUG] [LOCAL ] CMCM: Loaded 3391 existing records from primary storage. [2025-09-16T17:49:31.371632] [INFO ] [MAIN ] CMCM: Loaded 3391 existing records. [2025-09-16T17:49:31.561522] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:49:31.575836] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-09-16T17:49:31.580528] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-09-16T17:49:31.584309] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-16T17:49:31.581152] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-09-16T17:49:31.596580] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-09-16T17:49:31.596852] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-09-16T17:49:31.977967] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:49:32.374929] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-09-16T17:49:32.585208] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-16T17:49:32.912909] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-16T17:49:32.958136] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-16T17:49:33.174923] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-09-16T17:49:33.975002] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-09-16T17:49:34.674377] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-16T17:49:34.774909] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-09-16T17:49:35.351546] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-16T17:49:35.574902] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-09-16T17:49:36.169446] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-16T17:49:36.374910] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-09-16T17:49:36.993370] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-16T17:49:37.174880] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-09-16T17:49:37.974903] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-09-16T17:49:38.161934] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-16T17:49:38.576992] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-16T17:49:38.582981] [INFO ] [REMOTE ] CMA: Full fetch complete (54773 records). [2025-09-16T17:49:38.583103] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-09-16T17:49:38.783884] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-09-16T17:49:38.982028] [DEBUG] [VALIDATOR ] CMA: All expected trading days are present. [2025-09-16T17:49:38.982150] [DEBUG] [VALIDATOR ] CMA: Primary data validation passed. [2025-09-16T17:49:38.982845] [INFO ] [MAIN ] CMA: Fetched primary data is valid. [2025-09-16T17:49:38.982898] [DEBUG] [LOCAL ] CMA: Saving primary data. [2025-09-16T17:49:38.984270] [DEBUG] [LOCAL ] CMA: Trimmed 54773 records to 37171 (keeping 150 days of data) [2025-09-16T17:49:39.178937] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-16T17:49:39.215591] [INFO ] [REMOTE ] CMC: Full fetch complete (49757 records). [2025-09-16T17:49:39.219879] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-09-16T17:49:39.444817] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-16T17:49:39.580167] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-09-16T17:49:39.609383] [DEBUG] [LOCAL ] CMA: Primary data saved (37171 records). [2025-09-16T17:49:39.622080] [INFO ] [MAIN ] CMA: Full history saved. [2025-09-16T17:49:39.622165] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-09-16T17:49:39.622289] [INFO ] [MAIN ] Update Progress: 472/2369 symbols completed. CMA took 26.5s. Estimated remaining: 3h 19m 23s. Rate: 9.5 symbols/min [2025-09-16T17:49:39.622347] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-09-16T17:49:39.623186] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-09-16T17:49:39.653696] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-09-16T17:49:39.734866] [DEBUG] [LOCAL ] CMC: Trimmed 49757 records to 33219 (keeping 150 days of data) [2025-09-16T17:49:39.798456] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:49:39.798665] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-09-16T17:49:39.798706] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-09-16T17:49:39.851683] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-09-16T17:49:39.860981] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-16T17:49:39.861415] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-09-16T17:49:39.887591] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-09-16T17:49:40.254160] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:49:40.350416] [DEBUG] [LOCAL ] CMC: Primary data saved (33219 records). [2025-09-16T17:49:40.350565] [INFO ] [MAIN ] CMC: Full history saved. [2025-09-16T17:49:40.351302] [INFO ] [MAIN ] Update Progress: 473/2369 symbols completed. CMC took 23.5s. Estimated remaining: 3h 18m 54s. Rate: 9.5 symbols/min [2025-09-16T17:49:40.382264] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-02. [2025-09-16T17:49:40.521284] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:49:40.561263] [DEBUG] [LOCAL ] CMG: Loaded 39687 existing records from primary storage. [2025-09-16T17:49:40.561424] [INFO ] [MAIN ] CMG: Loaded 39687 existing records. [2025-09-16T17:49:40.662231] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:49:40.662749] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-02 [2025-09-16T17:49:40.738012] [WARN ] [MAIN ] CMG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:49:40.738201] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-09-16T17:49:40.738256] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-09-16T17:49:40.739183] [DEBUG] [LOCAL ] CMG: Deleted primary data file. [2025-09-16T17:49:40.739233] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-09-16T17:49:41.124142] [INFO ] [REMOTE ] CMG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:49:41.174843] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-09-16T17:49:41.229244] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-16T17:49:41.974885] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-03. [2025-09-16T17:49:42.167162] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:49:42.167409] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-03 [2025-09-16T17:49:42.774915] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-09-16T17:49:43.227140] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-16T17:49:43.377866] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-16T17:49:43.574928] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-09-16T17:49:44.374945] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-09-16T17:49:44.801002] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-16T17:49:45.134870] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-16T17:49:45.140549] [INFO ] [REMOTE ] CM: Full fetch complete (52654 records). [2025-09-16T17:49:45.140699] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-09-16T17:49:45.180015] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-09-16T17:49:45.516316] [DEBUG] [VALIDATOR ] CM: All expected trading days are present. [2025-09-16T17:49:45.516401] [DEBUG] [VALIDATOR ] CM: Primary data validation passed. [2025-09-16T17:49:45.517044] [INFO ] [MAIN ] CM: Fetched primary data is valid. [2025-09-16T17:49:45.517088] [DEBUG] [LOCAL ] CM: Saving primary data. [2025-09-16T17:49:45.518161] [DEBUG] [LOCAL ] CM: Trimmed 52654 records to 36130 (keeping 150 days of data) [2025-09-16T17:49:45.743097] [DEBUG] [LOCAL ] CM: Primary data saved (36130 records). [2025-09-16T17:49:45.743301] [INFO ] [MAIN ] CM: Full history saved. [2025-09-16T17:49:45.743404] [INFO ] [MAIN ] Update Progress: 474/2369 symbols completed. CM took 35.6s. Estimated remaining: 3h 18m 44s. Rate: 9.5 symbols/min [2025-09-16T17:49:45.912842] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:49:45.944904] [DEBUG] [LOCAL ] CMI: Loaded 30182 existing records from primary storage. [2025-09-16T17:49:45.945040] [INFO ] [MAIN ] CMI: Loaded 30182 existing records. [2025-09-16T17:49:45.980022] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-04. [2025-09-16T17:49:46.124944] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:49:46.125177] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-09-16T17:49:46.125232] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-09-16T17:49:46.125883] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-09-16T17:49:46.125933] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-09-16T17:49:46.275061] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:49:46.347181] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-04 [2025-09-16T17:49:46.485790] [INFO ] [REMOTE ] CMI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:49:46.774876] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-05. [2025-09-16T17:49:47.239967] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-16T17:49:47.574908] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-09-16T17:49:47.868246] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-16T17:49:48.374941] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-09-16T17:49:49.174918] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-09-16T17:49:49.450113] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-16T17:49:49.540147] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-16T17:49:49.974870] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-09-16T17:49:50.059398] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-16T17:49:50.774918] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-09-16T17:49:51.400457] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-16T17:49:51.574863] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-09-16T17:49:51.998248] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-16T17:49:52.374909] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-09-16T17:49:52.997874] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-16T17:49:53.174891] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-09-16T17:49:53.231735] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-16T17:49:53.974896] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-09-16T17:49:54.774910] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-09-16T17:49:55.432366] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-09-16T17:49:55.514634] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-16T17:49:55.516491] [INFO ] [REMOTE ] CMCM: Full fetch complete (5307 records). [2025-09-16T17:49:55.516561] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-09-16T17:49:55.580110] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-06. [2025-09-16T17:49:55.894341] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-09-16T17:49:55.894470] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-09-16T17:49:55.894729] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-09-16T17:49:55.895004] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-09-16T17:49:55.895626] [DEBUG] [LOCAL ] CMCM: Trimmed 5307 records to 3467 (keeping 150 days of data) [2025-09-16T17:49:55.941278] [DEBUG] [LOCAL ] CMCM: Primary data saved (3467 records). [2025-09-16T17:49:55.942234] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-16T17:49:55.942463] [INFO ] [MAIN ] CMCM: Full history saved. [2025-09-16T17:49:55.951456] [INFO ] [MAIN ] Update Progress: 475/2369 symbols completed. CMCM took 24.8s. Estimated remaining: 3h 18m 54s. Rate: 9.5 symbols/min [2025-09-16T17:49:56.124329] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:49:56.153179] [DEBUG] [LOCAL ] CMP: Loaded 27389 existing records from primary storage. [2025-09-16T17:49:56.153342] [INFO ] [MAIN ] CMP: Loaded 27389 existing records. [2025-09-16T17:49:56.329218] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:49:56.329460] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-09-16T17:49:56.329512] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-09-16T17:49:56.330072] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-09-16T17:49:56.330131] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-09-16T17:49:56.378534] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-09-16T17:49:56.538879] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-16T17:49:56.720760] [INFO ] [REMOTE ] CMP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:49:57.174906] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-09-16T17:49:57.658148] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-16T17:49:57.974872] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-09-16T17:49:58.736797] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-16T17:49:58.774845] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-09-16T17:49:59.476857] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-16T17:49:59.574930] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-09-16T17:50:00.168421] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-16T17:50:00.374909] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-09-16T17:50:01.151310] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-16T17:50:01.174870] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-09-16T17:50:01.974957] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-09-16T17:50:02.169525] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-16T17:50:02.774926] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-09-16T17:50:03.273383] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-16T17:50:03.574983] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-07. [2025-09-16T17:50:03.920772] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-16T17:50:04.341994] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-16T17:50:04.369890] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-16T17:50:04.378384] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-09-16T17:50:05.174902] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-08. [2025-09-16T17:50:05.785304] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-16T17:50:05.974887] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-09-16T17:50:06.774885] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-09. [2025-09-16T17:50:06.868177] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-09-16T17:50:07.404795] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-16T17:50:07.459941] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-16T17:50:07.462577] [INFO ] [REMOTE ] CMDB: Full fetch complete (10335 records). [2025-09-16T17:50:07.462723] [DEBUG] [VALIDATOR ] CMDB: Validating primary data. [2025-09-16T17:50:07.580105] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-09-16T17:50:07.667573] [WARN ] [VALIDATOR ] CMDB: Validation failed - insufficient historical data. Have 91 unique days, need 150 days [2025-09-16T17:50:07.667936] [FATAL] [MAIN ] CMDB: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:50:07.668032] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:50:07.668105] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-16T17:50:07.668190] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-09-16T17:50:07.668230] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-09-16T17:50:07.668286] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-09-16T17:50:07.668371] [INFO ] [MAIN ] Update Progress: 476/2369 symbols completed. CMDB took 28.0s. Estimated remaining: 3h 19m 9s. Rate: 9.5 symbols/min [2025-09-16T17:50:07.849666] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:50:07.881409] [DEBUG] [LOCAL ] CMRE: Loaded 26054 existing records from primary storage. [2025-09-16T17:50:07.881617] [INFO ] [MAIN ] CMRE: Loaded 26054 existing records. [2025-09-16T17:50:08.070979] [WARN ] [MAIN ] CMRE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:50:08.071341] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-09-16T17:50:08.071393] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-09-16T17:50:08.072044] [DEBUG] [LOCAL ] CMRE: Deleted primary data file. [2025-09-16T17:50:08.072099] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-09-16T17:50:08.380058] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-09-16T17:50:08.441853] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:50:09.174904] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-09-16T17:50:09.955382] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-16T17:50:09.974840] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-09-16T17:50:10.038494] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-09-16T17:50:10.045350] [INFO ] [REMOTE ] CMG: Full fetch complete (58398 records). [2025-09-16T17:50:10.045462] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-09-16T17:50:10.443550] [DEBUG] [VALIDATOR ] CMG: All expected trading days are present. [2025-09-16T17:50:10.443674] [DEBUG] [VALIDATOR ] CMG: Primary data validation passed. [2025-09-16T17:50:10.444389] [INFO ] [MAIN ] CMG: Fetched primary data is valid. [2025-09-16T17:50:10.444446] [DEBUG] [LOCAL ] CMG: Saving primary data. [2025-09-16T17:50:10.463749] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-16T17:50:10.463885] [DEBUG] [LOCAL ] CMG: Trimmed 58398 records to 40077 (keeping 150 days of data) [2025-09-16T17:50:10.721783] [DEBUG] [LOCAL ] CMG: Primary data saved (40077 records). [2025-09-16T17:50:10.721931] [INFO ] [MAIN ] CMG: Full history saved. [2025-09-16T17:50:10.722546] [INFO ] [MAIN ] Update Progress: 477/2369 symbols completed. CMG took 30.4s. Estimated remaining: 3h 18m 50s. Rate: 9.5 symbols/min [2025-09-16T17:50:10.774936] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-09-16T17:50:11.104269] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-16T17:50:11.574966] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-09-16T17:50:12.246376] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-16T17:50:12.374902] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-09-16T17:50:13.174915] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-09-16T17:50:13.713052] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-16T17:50:13.974895] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-09-16T17:50:14.523870] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-16T17:50:14.529728] [INFO ] [REMOTE ] CMP: Full fetch complete (40315 records). [2025-09-16T17:50:14.529931] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-09-16T17:50:15.138356] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-09-16T17:50:15.138625] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-09-16T17:50:15.139993] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-09-16T17:50:15.140107] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-09-16T17:50:15.177206] [DEBUG] [LOCAL ] CMP: Trimmed 40315 records to 27600 (keeping 150 days of data) [2025-09-16T17:50:15.179715] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-16T17:50:15.191692] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-09-16T17:50:15.375465] [DEBUG] [LOCAL ] CMP: Primary data saved (27600 records). [2025-09-16T17:50:15.375660] [INFO ] [MAIN ] CMP: Full history saved. [2025-09-16T17:50:15.375753] [INFO ] [MAIN ] Update Progress: 478/2369 symbols completed. CMP took 19.4s. Estimated remaining: 3h 18m 37s. Rate: 9.5 symbols/min [2025-09-16T17:50:16.260627] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (4.69 seconds). [2025-09-16T17:50:16.268244] [INFO ] [REMOTE ] CMI: Full fetch complete (45444 records). [2025-09-16T17:50:16.268360] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-09-16T17:50:16.628108] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-16T17:50:16.686296] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-09-16T17:50:16.686897] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-09-16T17:50:16.687495] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-09-16T17:50:16.687550] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-09-16T17:50:16.686817] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-09-16T17:50:16.689471] [DEBUG] [LOCAL ] CMI: Trimmed 45444 records to 30499 (keeping 150 days of data) [2025-09-16T17:50:16.889279] [DEBUG] [LOCAL ] CMI: Primary data saved (30499 records). [2025-09-16T17:50:16.889429] [INFO ] [MAIN ] CMI: Full history saved. [2025-09-16T17:50:16.889514] [INFO ] [MAIN ] Update Progress: 479/2369 symbols completed. CMI took 31.1s. Estimated remaining: 3h 18m 12s. Rate: 9.5 symbols/min [2025-09-16T17:50:18.049600] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-16T17:50:18.058201] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-09-16T17:50:19.760519] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-16T17:50:19.769179] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-09-16T17:50:21.148618] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-16T17:50:21.153356] [INFO ] [REMOTE ] CMRE: Full fetch complete (38782 records). [2025-09-16T17:50:21.153479] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-09-16T17:50:21.549838] [DEBUG] [VALIDATOR ] CMRE: All expected trading days are present. [2025-09-16T17:50:21.549940] [DEBUG] [VALIDATOR ] CMRE: Primary data validation passed. [2025-09-16T17:50:21.550496] [INFO ] [MAIN ] CMRE: Fetched primary data is valid. [2025-09-16T17:50:21.550544] [DEBUG] [LOCAL ] CMRE: Saving primary data. [2025-09-16T17:50:21.551708] [DEBUG] [LOCAL ] CMRE: Trimmed 38782 records to 26276 (keeping 150 days of data) [2025-09-16T17:50:21.712118] [DEBUG] [LOCAL ] CMRE: Primary data saved (26276 records). [2025-09-16T17:50:21.712300] [INFO ] [MAIN ] CMRE: Full history saved. [2025-09-16T17:50:21.712387] [INFO ] [MAIN ] Update Progress: 480/2369 symbols completed. CMRE took 14.0s. Estimated remaining: 3h 17m 60s. Rate: 9.5 symbols/min [2025-09-16T17:50:22.346812] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:50:22.360066] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:50:22.407187] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:50:22.408758] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:50:22.413086] [DEBUG] [LOCAL ] CMSA: Loaded 2500 existing records from primary storage. [2025-09-16T17:50:22.415569] [INFO ] [MAIN ] CMSA: Loaded 2500 existing records. [2025-09-16T17:50:22.453457] [DEBUG] [LOCAL ] CMSC: Loaded 3425 existing records from primary storage. [2025-09-16T17:50:22.470149] [DEBUG] [LOCAL ] CMSD: Loaded 5630 existing records from primary storage. [2025-09-16T17:50:22.478188] [INFO ] [MAIN ] CMSC: Loaded 3425 existing records. [2025-09-16T17:50:22.492626] [INFO ] [MAIN ] CMSD: Loaded 5630 existing records. [2025-09-16T17:50:22.850011] [WARN ] [MAIN ] CMSA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:50:22.890387] [DEBUG] [LOCAL ] CMS: Loaded 38924 existing records from primary storage. [2025-09-16T17:50:22.906446] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-09-16T17:50:22.911583] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:50:22.932390] [INFO ] [MAIN ] CMS: Loaded 38924 existing records. [2025-09-16T17:50:22.922043] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-09-16T17:50:22.962709] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-09-16T17:50:22.989661] [DEBUG] [LOCAL ] CMSA: Deleted primary data file. [2025-09-16T17:50:23.017683] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-09-16T17:50:23.019149] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-09-16T17:50:23.028065] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:50:23.088883] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-09-16T17:50:23.121186] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-09-16T17:50:23.145354] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-09-16T17:50:23.173135] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-09-16T17:50:23.237847] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-09-16T17:50:23.272531] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-09-16T17:50:23.463053] [WARN ] [MAIN ] CMS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:50:23.602670] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-09-16T17:50:23.637346] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-09-16T17:50:23.688061] [DEBUG] [LOCAL ] CMS: Deleted primary data file. [2025-09-16T17:50:23.811602] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-09-16T17:50:24.122289] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:50:24.189406] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-09-16T17:50:24.279106] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:50:24.306776] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-09-16T17:50:24.367164] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:50:24.383783] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-09-16T17:50:24.611339] [INFO ] [REMOTE ] CMS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:50:24.611632] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-09-16T17:50:24.773201] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-16T17:50:24.774459] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-09-16T17:50:25.070905] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-16T17:50:25.072460] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-09-16T17:50:25.080393] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-16T17:50:25.082185] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-09-16T17:50:25.131853] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-16T17:50:25.133661] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-09-16T17:50:25.598929] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-16T17:50:25.600473] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-09-16T17:50:25.606294] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-16T17:50:25.608396] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-09-16T17:50:25.648380] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-16T17:50:25.930942] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-16T17:50:25.974860] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-09-16T17:50:26.033928] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-16T17:50:26.033713] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-16T17:50:26.306548] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-16T17:50:26.774908] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-09-16T17:50:27.478620] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-16T17:50:27.574920] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-09-16T17:50:28.374883] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-09-16T17:50:28.777408] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-16T17:50:29.128834] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-16T17:50:29.174877] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-09-16T17:50:29.974928] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-09-16T17:50:30.472966] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-16T17:50:30.774862] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-09-16T17:50:30.869200] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-16T17:50:31.574890] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-09-16T17:50:32.019325] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-16T17:50:32.374917] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-09-16T17:50:32.916549] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-16T17:50:33.174902] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-09-16T17:50:33.826999] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (3.05 seconds). [2025-09-16T17:50:33.974934] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-09-16T17:50:34.340149] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-16T17:50:34.433210] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-16T17:50:34.774911] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-09-16T17:50:35.472559] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-16T17:50:35.473852] [INFO ] [REMOTE ] CMSA: Full fetch complete (3539 records). [2025-09-16T17:50:35.473939] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-09-16T17:50:35.580067] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-09-16T17:50:35.863820] [DEBUG] [VALIDATOR ] CMSA: All expected trading days are present. [2025-09-16T17:50:35.863909] [DEBUG] [VALIDATOR ] CMSA: Primary data validation passed. [2025-09-16T17:50:35.864077] [INFO ] [MAIN ] CMSA: Fetched primary data is valid. [2025-09-16T17:50:35.864118] [DEBUG] [LOCAL ] CMSA: Saving primary data. [2025-09-16T17:50:35.864489] [DEBUG] [LOCAL ] CMSA: Trimmed 3539 records to 2523 (keeping 150 days of data) [2025-09-16T17:50:35.880352] [DEBUG] [LOCAL ] CMSA: Primary data saved (2523 records). [2025-09-16T17:50:35.880424] [INFO ] [MAIN ] CMSA: Full history saved. [2025-09-16T17:50:35.880496] [INFO ] [MAIN ] Update Progress: 481/2369 symbols completed. CMSA took 14.2s. Estimated remaining: 3h 18m 24s. Rate: 9.5 symbols/min [2025-09-16T17:50:36.058704] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:50:36.083529] [DEBUG] [LOCAL ] CMTG: Loaded 26381 existing records from primary storage. [2025-09-16T17:50:36.083687] [INFO ] [MAIN ] CMTG: Loaded 26381 existing records. [2025-09-16T17:50:36.304200] [WARN ] [MAIN ] CMTG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:50:36.304437] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-09-16T17:50:36.304485] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-09-16T17:50:36.305074] [DEBUG] [LOCAL ] CMTG: Deleted primary data file. [2025-09-16T17:50:36.305137] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-09-16T17:50:36.382379] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-09-16T17:50:36.678054] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:50:36.994698] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-16T17:50:37.174905] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-09-16T17:50:37.231010] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-16T17:50:37.662518] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-16T17:50:37.974902] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-09-16T17:50:38.774929] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-09-16T17:50:39.314250] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-16T17:50:39.315584] [INFO ] [REMOTE ] CMSD: Full fetch complete (8724 records). [2025-09-16T17:50:39.315679] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-09-16T17:50:39.576879] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-09-16T17:50:39.710316] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-09-16T17:50:39.710492] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-09-16T17:50:39.710829] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-09-16T17:50:39.712687] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-16T17:50:39.711092] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-09-16T17:50:39.724015] [DEBUG] [LOCAL ] CMSD: Trimmed 8724 records to 5674 (keeping 150 days of data) [2025-09-16T17:50:39.758486] [DEBUG] [LOCAL ] CMSD: Primary data saved (5674 records). [2025-09-16T17:50:39.758573] [INFO ] [MAIN ] CMSD: Full history saved. [2025-09-16T17:50:39.758666] [INFO ] [MAIN ] Update Progress: 482/2369 symbols completed. CMSD took 18.0s. Estimated remaining: 3h 18m 8s. Rate: 9.5 symbols/min [2025-09-16T17:50:39.933104] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:50:39.938543] [DEBUG] [LOCAL ] CMU: Loaded 4387 existing records from primary storage. [2025-09-16T17:50:39.938664] [INFO ] [MAIN ] CMU: Loaded 4387 existing records. [2025-09-16T17:50:40.113749] [WARN ] [MAIN ] CMU: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:50:40.114006] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-09-16T17:50:40.114051] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-09-16T17:50:40.114299] [DEBUG] [LOCAL ] CMU: Deleted primary data file. [2025-09-16T17:50:40.114343] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-09-16T17:50:40.380231] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-09-16T17:50:40.467095] [INFO ] [REMOTE ] CMU: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:50:40.870573] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-16T17:50:41.174897] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-09-16T17:50:41.676280] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-16T17:50:41.678289] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-16T17:50:41.974944] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-09-16T17:50:42.774921] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-09-16T17:50:43.241118] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-16T17:50:43.247503] [INFO ] [REMOTE ] CMS: Full fetch complete (57265 records). [2025-09-16T17:50:43.247618] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-09-16T17:50:43.360341] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-16T17:50:43.588192] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-09-16T17:50:43.638748] [DEBUG] [VALIDATOR ] CMS: All expected trading days are present. [2025-09-16T17:50:43.638824] [DEBUG] [VALIDATOR ] CMS: Primary data validation passed. [2025-09-16T17:50:43.639540] [INFO ] [MAIN ] CMS: Fetched primary data is valid. [2025-09-16T17:50:43.639584] [DEBUG] [LOCAL ] CMS: Saving primary data. [2025-09-16T17:50:43.640811] [DEBUG] [LOCAL ] CMS: Trimmed 57265 records to 39283 (keeping 150 days of data) [2025-09-16T17:50:43.884717] [DEBUG] [LOCAL ] CMS: Primary data saved (39283 records). [2025-09-16T17:50:43.884864] [INFO ] [MAIN ] CMS: Full history saved. [2025-09-16T17:50:43.884951] [INFO ] [MAIN ] Update Progress: 483/2369 symbols completed. CMS took 22.2s. Estimated remaining: 3h 17m 54s. Rate: 9.5 symbols/min [2025-09-16T17:50:44.056997] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:50:44.079877] [DEBUG] [LOCAL ] CNA: Loaded 24485 existing records from primary storage. [2025-09-16T17:50:44.080027] [INFO ] [MAIN ] CNA: Loaded 24485 existing records. [2025-09-16T17:50:44.259910] [WARN ] [MAIN ] CNA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:50:44.260209] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-09-16T17:50:44.260274] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-09-16T17:50:44.260892] [DEBUG] [LOCAL ] CNA: Deleted primary data file. [2025-09-16T17:50:44.260941] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-09-16T17:50:44.379961] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-09-16T17:50:44.617768] [INFO ] [REMOTE ] CNA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:50:44.792944] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-16T17:50:44.939366] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-16T17:50:45.174928] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-09-16T17:50:45.974903] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-09-16T17:50:46.359909] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-16T17:50:46.774916] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-09-16T17:50:46.850150] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-16T17:50:47.574902] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-09-16T17:50:47.740902] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-16T17:50:48.121051] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-16T17:50:48.374970] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-09-16T17:50:49.174953] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-09-16T17:50:49.733629] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-16T17:50:49.776894] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-16T17:50:49.974927] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-09-16T17:50:50.774926] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-09-16T17:50:51.422813] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-16T17:50:51.423992] [INFO ] [REMOTE ] CMSC: Full fetch complete (5380 records). [2025-09-16T17:50:51.424142] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-09-16T17:50:51.579722] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-09-16T17:50:51.824523] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-09-16T17:50:51.825368] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-09-16T17:50:51.825595] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-09-16T17:50:51.825670] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-09-16T17:50:51.827240] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-16T17:50:51.836310] [DEBUG] [LOCAL ] CMSC: Trimmed 5380 records to 3464 (keeping 150 days of data) [2025-09-16T17:50:51.858184] [DEBUG] [LOCAL ] CMSC: Primary data saved (3464 records). [2025-09-16T17:50:51.858272] [INFO ] [MAIN ] CMSC: Full history saved. [2025-09-16T17:50:51.858353] [INFO ] [MAIN ] Update Progress: 484/2369 symbols completed. CMSC took 30.1s. Estimated remaining: 3h 17m 54s. Rate: 9.5 symbols/min [2025-09-16T17:50:52.027132] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:50:52.070669] [DEBUG] [LOCAL ] CNC: Loaded 39748 existing records from primary storage. [2025-09-16T17:50:52.070816] [INFO ] [MAIN ] CNC: Loaded 39748 existing records. [2025-09-16T17:50:52.260303] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:50:52.260731] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-09-16T17:50:52.260797] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-09-16T17:50:52.261795] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-09-16T17:50:52.261852] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-09-16T17:50:52.370819] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-16T17:50:52.378166] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-09-16T17:50:52.640296] [INFO ] [REMOTE ] CNC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:50:53.174949] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-09-16T17:50:53.533239] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-16T17:50:53.742572] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-16T17:50:53.974972] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-09-16T17:50:54.774945] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-09-16T17:50:55.574970] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-09-16T17:50:56.084387] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-16T17:50:56.250169] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-16T17:50:56.374915] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-09-16T17:50:56.376423] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (2.40 seconds). [2025-09-16T17:50:57.174904] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-09-16T17:50:57.456834] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-16T17:50:57.974930] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-09-16T17:50:58.636373] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-16T17:50:58.774901] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-09-16T17:50:59.063666] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-16T17:50:59.067978] [INFO ] [REMOTE ] CMTG: Full fetch complete (41440 records). [2025-09-16T17:50:59.068138] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-09-16T17:50:59.446713] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-09-16T17:50:59.446801] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-09-16T17:50:59.447348] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-09-16T17:50:59.447389] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-09-16T17:50:59.448271] [DEBUG] [LOCAL ] CMTG: Trimmed 41440 records to 26595 (keeping 150 days of data) [2025-09-16T17:50:59.575528] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-09-16T17:50:59.601965] [DEBUG] [LOCAL ] CMTG: Primary data saved (26595 records). [2025-09-16T17:50:59.602115] [INFO ] [MAIN ] CMTG: Full history saved. [2025-09-16T17:50:59.602206] [INFO ] [MAIN ] Update Progress: 485/2369 symbols completed. CMTG took 23.7s. Estimated remaining: 3h 17m 53s. Rate: 9.5 symbols/min [2025-09-16T17:50:59.787242] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:50:59.796534] [DEBUG] [LOCAL ] CNF: Loaded 8697 existing records from primary storage. [2025-09-16T17:50:59.796632] [INFO ] [MAIN ] CNF: Loaded 8697 existing records. [2025-09-16T17:51:00.002888] [WARN ] [MAIN ] CNF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:51:00.003621] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-09-16T17:51:00.003706] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-09-16T17:51:00.004302] [DEBUG] [LOCAL ] CNF: Deleted primary data file. [2025-09-16T17:51:00.004348] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-09-16T17:51:00.352596] [INFO ] [REMOTE ] CNF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:51:00.374850] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-09-16T17:51:00.686132] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-16T17:51:01.175918] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-09-16T17:51:01.181259] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-16T17:51:01.217013] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-16T17:51:01.974922] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-09-16T17:51:02.632903] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-16T17:51:02.634110] [INFO ] [REMOTE ] CMU: Full fetch complete (7577 records). [2025-09-16T17:51:02.634181] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-09-16T17:51:02.782705] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-09-16T17:51:03.011061] [DEBUG] [VALIDATOR ] CMU: All expected trading days are present. [2025-09-16T17:51:03.011179] [DEBUG] [VALIDATOR ] CMU: Primary data validation passed. [2025-09-16T17:51:03.011379] [INFO ] [MAIN ] CMU: Fetched primary data is valid. [2025-09-16T17:51:03.011428] [DEBUG] [LOCAL ] CMU: Saving primary data. [2025-09-16T17:51:03.012072] [DEBUG] [LOCAL ] CMU: Trimmed 7577 records to 4419 (keeping 150 days of data) [2025-09-16T17:51:03.038279] [DEBUG] [LOCAL ] CMU: Primary data saved (4419 records). [2025-09-16T17:51:03.038379] [INFO ] [MAIN ] CMU: Full history saved. [2025-09-16T17:51:03.038458] [INFO ] [MAIN ] Update Progress: 486/2369 symbols completed. CMU took 23.3s. Estimated remaining: 3h 17m 36s. Rate: 9.5 symbols/min [2025-09-16T17:51:03.210013] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:51:03.247331] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-16T17:51:03.293509] [DEBUG] [LOCAL ] CNH: Loaded 39528 existing records from primary storage. [2025-09-16T17:51:03.293680] [INFO ] [MAIN ] CNH: Loaded 39528 existing records. [2025-09-16T17:51:03.474587] [WARN ] [MAIN ] CNH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:51:03.474879] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-09-16T17:51:03.474933] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-09-16T17:51:03.475964] [DEBUG] [LOCAL ] CNH: Deleted primary data file. [2025-09-16T17:51:03.476014] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-09-16T17:51:03.577174] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-09-16T17:51:03.829091] [INFO ] [REMOTE ] CNH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:51:04.082797] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-16T17:51:04.374903] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-09-16T17:51:04.425514] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-16T17:51:05.174897] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-09-16T17:51:05.975003] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-09-16T17:51:06.487799] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-16T17:51:06.595602] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-16T17:51:06.774927] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-09-16T17:51:07.144453] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-16T17:51:07.574979] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-09-16T17:51:08.374916] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-09-16T17:51:08.509150] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-16T17:51:09.062547] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-16T17:51:09.174891] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-09-16T17:51:09.437802] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-16T17:51:09.974900] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-09-16T17:51:10.692819] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-16T17:51:10.712890] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-16T17:51:10.774895] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-09-16T17:51:11.574886] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-09-16T17:51:11.657717] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-16T17:51:12.374906] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-09-16T17:51:13.174904] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-09-16T17:51:13.207537] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-16T17:51:13.974871] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-09-16T17:51:14.151720] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-16T17:51:14.614020] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-16T17:51:14.774885] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-09-16T17:51:15.518607] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-16T17:51:15.574858] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-09-16T17:51:15.663491] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-16T17:51:15.665724] [INFO ] [REMOTE ] CNF: Full fetch complete (10864 records). [2025-09-16T17:51:15.665797] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-09-16T17:51:16.046202] [DEBUG] [VALIDATOR ] CNF: All expected trading days are present. [2025-09-16T17:51:16.046284] [DEBUG] [VALIDATOR ] CNF: Primary data validation passed. [2025-09-16T17:51:16.046553] [INFO ] [MAIN ] CNF: Fetched primary data is valid. [2025-09-16T17:51:16.046599] [DEBUG] [LOCAL ] CNF: Saving primary data. [2025-09-16T17:51:16.047117] [DEBUG] [LOCAL ] CNF: Trimmed 10864 records to 8738 (keeping 150 days of data) [2025-09-16T17:51:16.094996] [DEBUG] [LOCAL ] CNF: Primary data saved (8738 records). [2025-09-16T17:51:16.095126] [INFO ] [MAIN ] CNF: Full history saved. [2025-09-16T17:51:16.095217] [INFO ] [MAIN ] Update Progress: 487/2369 symbols completed. CNF took 16.5s. Estimated remaining: 3h 17m 56s. Rate: 9.5 symbols/min [2025-09-16T17:51:16.265901] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:51:16.305636] [DEBUG] [LOCAL ] CNI: Loaded 38141 existing records from primary storage. [2025-09-16T17:51:16.305810] [INFO ] [MAIN ] CNI: Loaded 38141 existing records. [2025-09-16T17:51:16.380182] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-09-16T17:51:16.483704] [WARN ] [MAIN ] CNI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:51:16.483978] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-09-16T17:51:16.484024] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-09-16T17:51:16.484926] [DEBUG] [LOCAL ] CNI: Deleted primary data file. [2025-09-16T17:51:16.484976] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-09-16T17:51:16.871668] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-16T17:51:16.875707] [INFO ] [REMOTE ] CNI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:51:16.880381] [INFO ] [REMOTE ] CNA: Full fetch complete (35934 records). [2025-09-16T17:51:16.880499] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-09-16T17:51:17.180040] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-09-16T17:51:17.256432] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present. [2025-09-16T17:51:17.256511] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed. [2025-09-16T17:51:17.257020] [INFO ] [MAIN ] CNA: Fetched primary data is valid. [2025-09-16T17:51:17.257073] [DEBUG] [LOCAL ] CNA: Saving primary data. [2025-09-16T17:51:17.257962] [DEBUG] [LOCAL ] CNA: Trimmed 35934 records to 24774 (keeping 150 days of data) [2025-09-16T17:51:17.411827] [DEBUG] [LOCAL ] CNA: Primary data saved (24774 records). [2025-09-16T17:51:17.411977] [INFO ] [MAIN ] CNA: Full history saved. [2025-09-16T17:51:17.412071] [INFO ] [MAIN ] Update Progress: 488/2369 symbols completed. CNA took 33.5s. Estimated remaining: 3h 17m 30s. Rate: 9.5 symbols/min [2025-09-16T17:51:17.584165] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:51:17.621976] [DEBUG] [LOCAL ] CNK: Loaded 38995 existing records from primary storage. [2025-09-16T17:51:17.622137] [INFO ] [MAIN ] CNK: Loaded 38995 existing records. [2025-09-16T17:51:17.800777] [WARN ] [MAIN ] CNK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:51:17.801041] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-09-16T17:51:17.801100] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-09-16T17:51:17.802084] [DEBUG] [LOCAL ] CNK: Deleted primary data file. [2025-09-16T17:51:17.802147] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-09-16T17:51:18.008543] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-09-16T17:51:18.162354] [INFO ] [REMOTE ] CNK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:51:18.301744] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-16T17:51:18.780041] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-09-16T17:51:18.792924] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-16T17:51:19.574921] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-09-16T17:51:20.374916] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-09-16T17:51:20.518104] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-16T17:51:20.618017] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (2.61 seconds). [2025-09-16T17:51:21.174900] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-09-16T17:51:21.350234] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-16T17:51:21.851136] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-16T17:51:21.974924] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-09-16T17:51:22.774936] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-09-16T17:51:22.994887] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-16T17:51:23.003867] [INFO ] [REMOTE ] CNC: Full fetch complete (58396 records). [2025-09-16T17:51:23.004021] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-09-16T17:51:23.393856] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-09-16T17:51:23.393954] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-09-16T17:51:23.394747] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-09-16T17:51:23.394802] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-09-16T17:51:23.396094] [DEBUG] [LOCAL ] CNC: Trimmed 58396 records to 40138 (keeping 150 days of data) [2025-09-16T17:51:23.581587] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-09-16T17:51:23.647729] [DEBUG] [LOCAL ] CNC: Primary data saved (40138 records). [2025-09-16T17:51:23.647869] [INFO ] [MAIN ] CNC: Full history saved. [2025-09-16T17:51:23.647983] [INFO ] [MAIN ] Update Progress: 489/2369 symbols completed. CNC took 31.8s. Estimated remaining: 3h 17m 23s. Rate: 9.5 symbols/min [2025-09-16T17:51:23.820821] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:51:23.856732] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-16T17:51:23.894150] [DEBUG] [LOCAL ] CNM: Loaded 37287 existing records from primary storage. [2025-09-16T17:51:23.894296] [INFO ] [MAIN ] CNM: Loaded 37287 existing records. [2025-09-16T17:51:24.098010] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:51:24.098258] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-09-16T17:51:24.098306] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-09-16T17:51:24.099148] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-09-16T17:51:24.099199] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-09-16T17:51:24.380752] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-09-16T17:51:24.459003] [INFO ] [REMOTE ] CNM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:51:24.532873] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-16T17:51:25.174891] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-09-16T17:51:25.241464] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-16T17:51:25.974878] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-09-16T17:51:26.043328] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-16T17:51:26.685460] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-16T17:51:26.774917] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-09-16T17:51:27.574886] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-09-16T17:51:27.789631] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-16T17:51:28.374916] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-09-16T17:51:29.064564] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-09-16T17:51:29.071076] [INFO ] [REMOTE ] CNH: Full fetch complete (58240 records). [2025-09-16T17:51:29.071221] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-09-16T17:51:29.180014] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-09-16T17:51:29.453006] [DEBUG] [VALIDATOR ] CNH: All expected trading days are present. [2025-09-16T17:51:29.453081] [DEBUG] [VALIDATOR ] CNH: Primary data validation passed. [2025-09-16T17:51:29.453759] [INFO ] [MAIN ] CNH: Fetched primary data is valid. [2025-09-16T17:51:29.453831] [DEBUG] [LOCAL ] CNH: Saving primary data. [2025-09-16T17:51:29.455030] [DEBUG] [LOCAL ] CNH: Trimmed 58240 records to 39916 (keeping 150 days of data) [2025-09-16T17:51:29.696654] [DEBUG] [LOCAL ] CNH: Primary data saved (39916 records). [2025-09-16T17:51:29.696804] [INFO ] [MAIN ] CNH: Full history saved. [2025-09-16T17:51:29.696901] [INFO ] [MAIN ] Update Progress: 490/2369 symbols completed. CNH took 26.7s. Estimated remaining: 3h 17m 16s. Rate: 9.5 symbols/min [2025-09-16T17:51:29.871603] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:51:29.904569] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-09-16T17:51:29.929675] [DEBUG] [LOCAL ] CNMD: Loaded 23436 existing records from primary storage. [2025-09-16T17:51:29.929815] [INFO ] [MAIN ] CNMD: Loaded 23436 existing records. [2025-09-16T17:51:29.985791] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-09-16T17:51:30.113758] [WARN ] [MAIN ] CNMD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:51:30.114123] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-09-16T17:51:30.114196] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-09-16T17:51:30.114964] [DEBUG] [LOCAL ] CNMD: Deleted primary data file. [2025-09-16T17:51:30.115028] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-09-16T17:51:30.302693] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-16T17:51:30.516693] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:51:30.568529] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-16T17:51:30.774920] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-09-16T17:51:31.574924] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-09-16T17:51:31.680051] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-16T17:51:32.374960] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-09-16T17:51:32.443737] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-16T17:51:33.136460] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-16T17:51:33.174926] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-09-16T17:51:33.432006] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-16T17:51:33.974903] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-09-16T17:51:34.774912] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-09-16T17:51:34.907503] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-16T17:51:35.341982] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-16T17:51:35.574898] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-09-16T17:51:36.374880] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-09-16T17:51:36.461193] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-16T17:51:36.935988] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-16T17:51:37.174948] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-09-16T17:51:37.715662] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-16T17:51:37.974902] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-09-16T17:51:38.535418] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-16T17:51:38.774918] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-09-16T17:51:39.356494] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-16T17:51:39.574922] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-09-16T17:51:40.080294] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-16T17:51:40.086471] [INFO ] [REMOTE ] CNI: Full fetch complete (56115 records). [2025-09-16T17:51:40.086566] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-09-16T17:51:40.379369] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-09-16T17:51:40.468337] [DEBUG] [VALIDATOR ] CNI: All expected trading days are present. [2025-09-16T17:51:40.468413] [DEBUG] [VALIDATOR ] CNI: Primary data validation passed. [2025-09-16T17:51:40.469081] [INFO ] [MAIN ] CNI: Fetched primary data is valid. [2025-09-16T17:51:40.469127] [DEBUG] [LOCAL ] CNI: Saving primary data. [2025-09-16T17:51:40.470253] [DEBUG] [LOCAL ] CNI: Trimmed 56115 records to 38509 (keeping 150 days of data) [2025-09-16T17:51:40.711624] [DEBUG] [LOCAL ] CNI: Primary data saved (38509 records). [2025-09-16T17:51:40.711771] [INFO ] [MAIN ] CNI: Full history saved. [2025-09-16T17:51:40.713502] [INFO ] [MAIN ] Update Progress: 491/2369 symbols completed. CNI took 24.6s. Estimated remaining: 3h 17m 28s. Rate: 9.5 symbols/min [2025-09-16T17:51:40.854462] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-16T17:51:40.909954] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:51:40.937719] [DEBUG] [LOCAL ] CNNE: Loaded 26310 existing records from primary storage. [2025-09-16T17:51:40.937850] [INFO ] [MAIN ] CNNE: Loaded 26310 existing records. [2025-09-16T17:51:41.118300] [WARN ] [MAIN ] CNNE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:51:41.118587] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-09-16T17:51:41.118637] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-09-16T17:51:41.119341] [DEBUG] [LOCAL ] CNNE: Deleted primary data file. [2025-09-16T17:51:41.119400] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-09-16T17:51:41.183591] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-09-16T17:51:41.476717] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:51:41.974917] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-09-16T17:51:41.994916] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-16T17:51:42.001790] [INFO ] [REMOTE ] CNK: Full fetch complete (57472 records). [2025-09-16T17:51:42.001991] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-09-16T17:51:42.401484] [DEBUG] [VALIDATOR ] CNK: All expected trading days are present. [2025-09-16T17:51:42.401665] [DEBUG] [VALIDATOR ] CNK: Primary data validation passed. [2025-09-16T17:51:42.402412] [INFO ] [MAIN ] CNK: Fetched primary data is valid. [2025-09-16T17:51:42.402501] [DEBUG] [LOCAL ] CNK: Saving primary data. [2025-09-16T17:51:42.405303] [DEBUG] [LOCAL ] CNK: Trimmed 57472 records to 39385 (keeping 150 days of data) [2025-09-16T17:51:42.517837] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-16T17:51:42.676840] [DEBUG] [LOCAL ] CNK: Primary data saved (39385 records). [2025-09-16T17:51:42.676991] [INFO ] [MAIN ] CNK: Full history saved. [2025-09-16T17:51:42.677713] [INFO ] [MAIN ] Update Progress: 492/2369 symbols completed. CNK took 25.3s. Estimated remaining: 3h 17m 5s. Rate: 9.5 symbols/min [2025-09-16T17:51:42.779026] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-09-16T17:51:42.849478] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:51:42.881742] [DEBUG] [LOCAL ] CNO: Loaded 29693 existing records from primary storage. [2025-09-16T17:51:42.881877] [INFO ] [MAIN ] CNO: Loaded 29693 existing records. [2025-09-16T17:51:43.061058] [WARN ] [MAIN ] CNO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:51:43.061419] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-09-16T17:51:43.061512] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-09-16T17:51:43.067911] [DEBUG] [LOCAL ] CNO: Deleted primary data file. [2025-09-16T17:51:43.077489] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-09-16T17:51:43.078027] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-16T17:51:43.441035] [INFO ] [REMOTE ] CNO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:51:43.574884] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-09-16T17:51:44.088365] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-16T17:51:44.374946] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-09-16T17:51:44.806252] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-16T17:51:45.174933] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-09-16T17:51:45.447795] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-16T17:51:45.974925] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-09-16T17:51:46.572487] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-16T17:51:46.774917] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-09-16T17:51:47.241275] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-16T17:51:47.574929] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-09-16T17:51:47.747610] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-16T17:51:48.374906] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-09-16T17:51:48.670138] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-16T17:51:49.174935] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-09-16T17:51:49.780315] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-16T17:51:49.974898] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-09-16T17:51:50.574553] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-16T17:51:50.578279] [INFO ] [REMOTE ] CNMD: Full fetch complete (35745 records). [2025-09-16T17:51:50.578431] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-09-16T17:51:50.784084] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-09-16T17:51:50.981796] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-09-16T17:51:50.981939] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-09-16T17:51:50.982703] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-09-16T17:51:50.982770] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-09-16T17:51:50.984169] [DEBUG] [LOCAL ] CNMD: Trimmed 35745 records to 23618 (keeping 150 days of data) [2025-09-16T17:51:51.142528] [DEBUG] [LOCAL ] CNMD: Primary data saved (23618 records). [2025-09-16T17:51:51.142679] [INFO ] [MAIN ] CNMD: Full history saved. [2025-09-16T17:51:51.142790] [INFO ] [MAIN ] Update Progress: 493/2369 symbols completed. CNMD took 21.4s. Estimated remaining: 3h 17m 7s. Rate: 9.5 symbols/min [2025-09-16T17:51:51.313852] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:51:51.350414] [DEBUG] [LOCAL ] CNP: Loaded 39456 existing records from primary storage. [2025-09-16T17:51:51.350570] [INFO ] [MAIN ] CNP: Loaded 39456 existing records. [2025-09-16T17:51:51.481166] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-16T17:51:51.568776] [WARN ] [MAIN ] CNP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:51:51.569028] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-09-16T17:51:51.569085] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-09-16T17:51:51.569953] [DEBUG] [LOCAL ] CNP: Deleted primary data file. [2025-09-16T17:51:51.570002] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-09-16T17:51:51.581016] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-09-16T17:51:51.933012] [INFO ] [REMOTE ] CNP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:51:51.956764] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-16T17:51:52.374921] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-09-16T17:51:53.039570] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-16T17:51:53.174884] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-09-16T17:51:53.686151] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-16T17:51:53.974917] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-09-16T17:51:54.234061] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-16T17:51:54.774907] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-09-16T17:51:55.398428] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-16T17:51:55.574934] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-09-16T17:51:55.878571] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-16T17:51:56.374903] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-09-16T17:51:56.712134] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-16T17:51:57.174901] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-09-16T17:51:57.491440] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-16T17:51:57.974904] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-09-16T17:51:58.758505] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-16T17:51:58.774853] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-09-16T17:51:59.574861] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-09-16T17:51:59.678061] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-16T17:52:00.245413] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-16T17:52:00.251694] [INFO ] [REMOTE ] CNM: Full fetch complete (55118 records). [2025-09-16T17:52:00.251841] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-09-16T17:52:00.379983] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-09-16T17:52:00.653937] [DEBUG] [VALIDATOR ] CNM: All expected trading days are present. [2025-09-16T17:52:00.654022] [DEBUG] [VALIDATOR ] CNM: Primary data validation passed. [2025-09-16T17:52:00.654692] [INFO ] [MAIN ] CNM: Fetched primary data is valid. [2025-09-16T17:52:00.654763] [DEBUG] [LOCAL ] CNM: Saving primary data. [2025-09-16T17:52:00.655950] [DEBUG] [LOCAL ] CNM: Trimmed 55118 records to 37677 (keeping 150 days of data) [2025-09-16T17:52:00.881527] [DEBUG] [LOCAL ] CNM: Primary data saved (37677 records). [2025-09-16T17:52:00.881685] [INFO ] [MAIN ] CNM: Full history saved. [2025-09-16T17:52:00.881797] [INFO ] [MAIN ] Update Progress: 494/2369 symbols completed. CNM took 37.2s. Estimated remaining: 3h 17m 14s. Rate: 9.5 symbols/min [2025-09-16T17:52:01.055289] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:52:01.095134] [DEBUG] [LOCAL ] CNQ: Loaded 39551 existing records from primary storage. [2025-09-16T17:52:01.095303] [INFO ] [MAIN ] CNQ: Loaded 39551 existing records. [2025-09-16T17:52:01.186039] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-09-16T17:52:01.274166] [WARN ] [MAIN ] CNQ: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:52:01.274380] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-09-16T17:52:01.274426] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-09-16T17:52:01.275212] [DEBUG] [LOCAL ] CNQ: Deleted primary data file. [2025-09-16T17:52:01.275271] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-09-16T17:52:01.632165] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:52:01.690364] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-16T17:52:01.974909] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-09-16T17:52:02.422516] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-16T17:52:02.658412] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-16T17:52:02.774889] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-09-16T17:52:03.574870] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-09-16T17:52:03.612461] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-16T17:52:04.339784] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-16T17:52:04.374856] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-09-16T17:52:04.944087] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-16T17:52:04.948908] [INFO ] [REMOTE ] CNNE: Full fetch complete (39808 records). [2025-09-16T17:52:04.949011] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-09-16T17:52:05.180086] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-09-16T17:52:05.322179] [DEBUG] [VALIDATOR ] CNNE: All expected trading days are present. [2025-09-16T17:52:05.322275] [DEBUG] [VALIDATOR ] CNNE: Primary data validation passed. [2025-09-16T17:52:05.322962] [INFO ] [MAIN ] CNNE: Fetched primary data is valid. [2025-09-16T17:52:05.323019] [DEBUG] [LOCAL ] CNNE: Saving primary data. [2025-09-16T17:52:05.324118] [DEBUG] [LOCAL ] CNNE: Trimmed 39808 records to 26562 (keeping 150 days of data) [2025-09-16T17:52:05.493515] [DEBUG] [LOCAL ] CNNE: Primary data saved (26562 records). [2025-09-16T17:52:05.493707] [INFO ] [MAIN ] CNNE: Full history saved. [2025-09-16T17:52:05.493849] [INFO ] [MAIN ] Update Progress: 495/2369 symbols completed. CNNE took 24.8s. Estimated remaining: 3h 17m 1s. Rate: 9.5 symbols/min [2025-09-16T17:52:05.673711] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:52:05.707504] [DEBUG] [LOCAL ] CNR: Loaded 32097 existing records from primary storage. [2025-09-16T17:52:05.707669] [INFO ] [MAIN ] CNR: Loaded 32097 existing records. [2025-09-16T17:52:05.896818] [WARN ] [MAIN ] CNR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:52:05.897056] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-09-16T17:52:05.897116] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-09-16T17:52:05.897835] [DEBUG] [LOCAL ] CNR: Deleted primary data file. [2025-09-16T17:52:05.897889] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-09-16T17:52:05.984262] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-09-16T17:52:06.261802] [INFO ] [REMOTE ] CNR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:52:06.296463] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-16T17:52:06.534908] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-16T17:52:06.541000] [INFO ] [REMOTE ] CNO: Full fetch complete (45738 records). [2025-09-16T17:52:06.541096] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-09-16T17:52:06.782396] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-02. [2025-09-16T17:52:06.922161] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present. [2025-09-16T17:52:06.922265] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed. [2025-09-16T17:52:06.923024] [INFO ] [MAIN ] CNO: Fetched primary data is valid. [2025-09-16T17:52:06.923073] [DEBUG] [LOCAL ] CNO: Saving primary data. [2025-09-16T17:52:06.924304] [DEBUG] [LOCAL ] CNO: Trimmed 45738 records to 29999 (keeping 150 days of data) [2025-09-16T17:52:07.126495] [DEBUG] [LOCAL ] CNO: Primary data saved (29999 records). [2025-09-16T17:52:07.126671] [INFO ] [MAIN ] CNO: Full history saved. [2025-09-16T17:52:07.127357] [INFO ] [MAIN ] Update Progress: 496/2369 symbols completed. CNO took 24.4s. Estimated remaining: 3h 16m 37s. Rate: 9.5 symbols/min [2025-09-16T17:52:07.304716] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:52:07.324550] [DEBUG] [LOCAL ] CNS: Loaded 14550 existing records from primary storage. [2025-09-16T17:52:07.324715] [INFO ] [MAIN ] CNS: Loaded 14550 existing records. [2025-09-16T17:52:07.510170] [WARN ] [MAIN ] CNS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:52:07.510501] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-09-16T17:52:07.510553] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-09-16T17:52:07.510993] [DEBUG] [LOCAL ] CNS: Deleted primary data file. [2025-09-16T17:52:07.511040] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-09-16T17:52:07.581719] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-09-16T17:52:07.879975] [INFO ] [REMOTE ] CNS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:52:07.926549] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-16T17:52:08.374909] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-09-16T17:52:08.410304] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-16T17:52:09.174873] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-03. [2025-09-16T17:52:09.428593] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-16T17:52:09.533080] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-16T17:52:09.974906] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-09-16T17:52:10.665509] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-16T17:52:10.774881] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-04. [2025-09-16T17:52:11.574938] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-09-16T17:52:11.839308] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-16T17:52:12.227886] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-16T17:52:12.374897] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-09-16T17:52:13.161419] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-16T17:52:13.167793] [INFO ] [REMOTE ] CNP: Full fetch complete (58127 records). [2025-09-16T17:52:13.167912] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-09-16T17:52:13.179983] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-09-16T17:52:13.546733] [DEBUG] [VALIDATOR ] CNP: All expected trading days are present. [2025-09-16T17:52:13.546813] [DEBUG] [VALIDATOR ] CNP: Primary data validation passed. [2025-09-16T17:52:13.547471] [INFO ] [MAIN ] CNP: Fetched primary data is valid. [2025-09-16T17:52:13.547513] [DEBUG] [LOCAL ] CNP: Saving primary data. [2025-09-16T17:52:13.548704] [DEBUG] [LOCAL ] CNP: Trimmed 58127 records to 39844 (keeping 150 days of data) [2025-09-16T17:52:13.798537] [DEBUG] [LOCAL ] CNP: Primary data saved (39844 records). [2025-09-16T17:52:13.798716] [INFO ] [MAIN ] CNP: Full history saved. [2025-09-16T17:52:13.798804] [INFO ] [MAIN ] Update Progress: 497/2369 symbols completed. CNP took 22.7s. Estimated remaining: 3h 16m 32s. Rate: 9.5 symbols/min [2025-09-16T17:52:13.968743] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:52:13.974911] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-05. [2025-09-16T17:52:14.006362] [DEBUG] [LOCAL ] CNX: Loaded 37796 existing records from primary storage. [2025-09-16T17:52:14.006511] [INFO ] [MAIN ] CNX: Loaded 37796 existing records. [2025-09-16T17:52:14.186559] [WARN ] [MAIN ] CNX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:52:14.187196] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-09-16T17:52:14.187313] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-09-16T17:52:14.188205] [DEBUG] [LOCAL ] CNX: Deleted primary data file. [2025-09-16T17:52:14.188267] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-09-16T17:52:14.405561] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-16T17:52:14.614475] [INFO ] [REMOTE ] CNX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:52:14.630625] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-16T17:52:14.774903] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-09-16T17:52:15.383837] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-16T17:52:15.574898] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-06. [2025-09-16T17:52:16.374893] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-09-16T17:52:16.494312] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-16T17:52:16.918620] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-16T17:52:17.174901] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-09-16T17:52:17.522667] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-16T17:52:17.974881] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-09-16T17:52:18.766019] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-16T17:52:18.779521] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-07. [2025-09-16T17:52:18.947690] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-16T17:52:19.574978] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-09-16T17:52:20.343978] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-16T17:52:20.374890] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-08. [2025-09-16T17:52:20.769204] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-16T17:52:21.174915] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-09-16T17:52:21.605849] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-16T17:52:21.949692] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-16T17:52:21.974869] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-09-16T17:52:22.774930] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-09-16T17:52:22.903192] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-16T17:52:23.574932] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-09-16T17:52:24.103937] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-16T17:52:24.374915] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-09-16T17:52:24.615046] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-16T17:52:25.174925] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-09-16T17:52:25.974910] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-09. [2025-09-16T17:52:26.077103] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-16T17:52:26.774912] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-09-16T17:52:27.004186] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-16T17:52:27.440834] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-16T17:52:27.446345] [INFO ] [REMOTE ] CNR: Full fetch complete (48399 records). [2025-09-16T17:52:27.446517] [DEBUG] [VALIDATOR ] CNR: Validating primary data. [2025-09-16T17:52:27.588500] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-09-16T17:52:27.830974] [DEBUG] [VALIDATOR ] CNR: All expected trading days are present. [2025-09-16T17:52:27.831054] [DEBUG] [VALIDATOR ] CNR: Primary data validation passed. [2025-09-16T17:52:27.831657] [INFO ] [MAIN ] CNR: Fetched primary data is valid. [2025-09-16T17:52:27.831703] [DEBUG] [LOCAL ] CNR: Saving primary data. [2025-09-16T17:52:27.832679] [DEBUG] [LOCAL ] CNR: Trimmed 48399 records to 32395 (keeping 150 days of data) [2025-09-16T17:52:28.057986] [DEBUG] [LOCAL ] CNR: Primary data saved (32395 records). [2025-09-16T17:52:28.058146] [INFO ] [MAIN ] CNR: Full history saved. [2025-09-16T17:52:28.060259] [INFO ] [MAIN ] Update Progress: 498/2369 symbols completed. CNR took 22.6s. Estimated remaining: 3h 16m 56s. Rate: 9.5 symbols/min [2025-09-16T17:52:28.234679] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:52:28.266071] [DEBUG] [LOCAL ] CODI: Loaded 31124 existing records from primary storage. [2025-09-16T17:52:28.266268] [INFO ] [MAIN ] CODI: Loaded 31124 existing records. [2025-09-16T17:52:28.378381] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-09-16T17:52:28.446901] [WARN ] [MAIN ] CODI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:52:28.447264] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-09-16T17:52:28.447370] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-09-16T17:52:28.448039] [DEBUG] [LOCAL ] CODI: Deleted primary data file. [2025-09-16T17:52:28.448090] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-09-16T17:52:28.771178] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-16T17:52:28.847379] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-16T17:52:28.867906] [INFO ] [REMOTE ] CNS: Full fetch complete (22783 records). [2025-09-16T17:52:28.870760] [INFO ] [REMOTE ] CODI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:52:28.870960] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-09-16T17:52:29.180038] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-09-16T17:52:29.240906] [DEBUG] [VALIDATOR ] CNS: All expected trading days are present. [2025-09-16T17:52:29.240988] [DEBUG] [VALIDATOR ] CNS: Primary data validation passed. [2025-09-16T17:52:29.241438] [INFO ] [MAIN ] CNS: Fetched primary data is valid. [2025-09-16T17:52:29.241480] [DEBUG] [LOCAL ] CNS: Saving primary data. [2025-09-16T17:52:29.242169] [DEBUG] [LOCAL ] CNS: Trimmed 22783 records to 14689 (keeping 150 days of data) [2025-09-16T17:52:29.332299] [DEBUG] [LOCAL ] CNS: Primary data saved (14689 records). [2025-09-16T17:52:29.332452] [INFO ] [MAIN ] CNS: Full history saved. [2025-09-16T17:52:29.332542] [INFO ] [MAIN ] Update Progress: 499/2369 symbols completed. CNS took 22.2s. Estimated remaining: 3h 16m 31s. Rate: 9.5 symbols/min [2025-09-16T17:52:29.507903] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:52:29.546446] [DEBUG] [LOCAL ] COF: Loaded 39597 existing records from primary storage. [2025-09-16T17:52:29.546586] [INFO ] [MAIN ] COF: Loaded 39597 existing records. [2025-09-16T17:52:29.726307] [WARN ] [MAIN ] COF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:52:29.726806] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-09-16T17:52:29.726855] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-09-16T17:52:29.728057] [DEBUG] [LOCAL ] COF: Deleted primary data file. [2025-09-16T17:52:29.728108] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-09-16T17:52:29.977143] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-09-16T17:52:30.081487] [INFO ] [REMOTE ] COF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:52:30.140927] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-16T17:52:30.729905] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-16T17:52:30.774921] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-09-16T17:52:30.839853] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-16T17:52:31.574907] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-09-16T17:52:32.374896] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-09-16T17:52:32.504371] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-16T17:52:32.978093] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-16T17:52:32.984357] [INFO ] [REMOTE ] CNX: Full fetch complete (55955 records). [2025-09-16T17:52:32.984521] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-09-16T17:52:33.180413] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-09-16T17:52:33.380994] [DEBUG] [VALIDATOR ] CNX: All expected trading days are present. [2025-09-16T17:52:33.381085] [DEBUG] [VALIDATOR ] CNX: Primary data validation passed. [2025-09-16T17:52:33.381953] [INFO ] [MAIN ] CNX: Fetched primary data is valid. [2025-09-16T17:52:33.382017] [DEBUG] [LOCAL ] CNX: Saving primary data. [2025-09-16T17:52:33.383274] [DEBUG] [LOCAL ] CNX: Trimmed 55955 records to 38164 (keeping 150 days of data) [2025-09-16T17:52:33.614113] [DEBUG] [LOCAL ] CNX: Primary data saved (38164 records). [2025-09-16T17:52:33.614285] [INFO ] [MAIN ] CNX: Full history saved. [2025-09-16T17:52:33.614380] [INFO ] [MAIN ] Update Progress: 500/2369 symbols completed. CNX took 19.8s. Estimated remaining: 3h 16m 17s. Rate: 9.5 symbols/min [2025-09-16T17:52:33.792707] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:52:33.811078] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-16T17:52:33.853318] [DEBUG] [LOCAL ] COHR: Loaded 39393 existing records from primary storage. [2025-09-16T17:52:33.853498] [INFO ] [MAIN ] COHR: Loaded 39393 existing records. [2025-09-16T17:52:33.979974] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-09-16T17:52:34.037303] [WARN ] [MAIN ] COHR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:52:34.037578] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-09-16T17:52:34.037629] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-09-16T17:52:34.038537] [DEBUG] [LOCAL ] COHR: Deleted primary data file. [2025-09-16T17:52:34.038608] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-09-16T17:52:34.395961] [INFO ] [REMOTE ] COHR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:52:34.774906] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-09-16T17:52:35.053446] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-16T17:52:35.195900] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-16T17:52:35.574914] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-09-16T17:52:36.329929] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-16T17:52:36.336454] [INFO ] [REMOTE ] CNQ: Full fetch complete (58257 records). [2025-09-16T17:52:36.336559] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-09-16T17:52:36.380283] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-09-16T17:52:36.717137] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present. [2025-09-16T17:52:36.717221] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed. [2025-09-16T17:52:36.717907] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-09-16T17:52:36.717951] [DEBUG] [LOCAL ] CNQ: Saving primary data. [2025-09-16T17:52:36.719080] [DEBUG] [LOCAL ] CNQ: Trimmed 58257 records to 39941 (keeping 150 days of data) [2025-09-16T17:52:36.964450] [DEBUG] [LOCAL ] CNQ: Primary data saved (39941 records). [2025-09-16T17:52:36.964603] [INFO ] [MAIN ] CNQ: Full history saved. [2025-09-16T17:52:36.964708] [INFO ] [MAIN ] Update Progress: 501/2369 symbols completed. CNQ took 36.1s. Estimated remaining: 3h 15m 59s. Rate: 9.5 symbols/min [2025-09-16T17:52:37.145027] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:52:37.175148] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-16T17:52:37.175279] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-09-16T17:52:37.214627] [DEBUG] [LOCAL ] COLD: Loaded 38617 existing records from primary storage. [2025-09-16T17:52:37.214785] [INFO ] [MAIN ] COLD: Loaded 38617 existing records. [2025-09-16T17:52:37.388268] [WARN ] [MAIN ] COLD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:52:37.388514] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-09-16T17:52:37.388560] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-09-16T17:52:37.389345] [DEBUG] [LOCAL ] COLD: Deleted primary data file. [2025-09-16T17:52:37.389395] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-09-16T17:52:37.739478] [INFO ] [REMOTE ] COLD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:52:37.935677] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-16T17:52:37.974848] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-09-16T17:52:38.774906] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-09-16T17:52:39.241152] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-16T17:52:39.574932] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-09-16T17:52:39.778584] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-16T17:52:40.186061] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-16T17:52:40.374916] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-09-16T17:52:41.180044] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-09-16T17:52:41.196690] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-16T17:52:41.974958] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-09-16T17:52:41.983123] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-16T17:52:42.774893] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-09-16T17:52:42.907411] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-16T17:52:43.522569] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-16T17:52:43.574939] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-09-16T17:52:43.857788] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-16T17:52:44.374913] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-09-16T17:52:45.174932] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-09-16T17:52:45.368023] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-16T17:52:45.458765] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-16T17:52:45.463118] [INFO ] [REMOTE ] CODI: Full fetch complete (41530 records). [2025-09-16T17:52:45.463220] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-09-16T17:52:45.845483] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-09-16T17:52:45.845598] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-09-16T17:52:45.846178] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-09-16T17:52:45.846222] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-09-16T17:52:45.847262] [DEBUG] [LOCAL ] CODI: Trimmed 41530 records to 31403 (keeping 150 days of data) [2025-09-16T17:52:45.990447] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-09-16T17:52:46.030092] [DEBUG] [LOCAL ] CODI: Primary data saved (31403 records). [2025-09-16T17:52:46.030195] [INFO ] [MAIN ] CODI: Full history saved. [2025-09-16T17:52:46.030273] [INFO ] [MAIN ] Update Progress: 502/2369 symbols completed. CODI took 18.0s. Estimated remaining: 3h 16m 3s. Rate: 9.5 symbols/min [2025-09-16T17:52:46.200064] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:52:46.235551] [DEBUG] [LOCAL ] COMP: Loaded 39382 existing records from primary storage. [2025-09-16T17:52:46.235720] [INFO ] [MAIN ] COMP: Loaded 39382 existing records. [2025-09-16T17:52:46.418833] [WARN ] [MAIN ] COMP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:52:46.419265] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-09-16T17:52:46.419313] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-09-16T17:52:46.420063] [DEBUG] [LOCAL ] COMP: Deleted primary data file. [2025-09-16T17:52:46.420111] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-09-16T17:52:46.769631] [INFO ] [REMOTE ] COMP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:52:46.774847] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-09-16T17:52:47.009113] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-16T17:52:47.475306] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-16T17:52:47.574910] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-09-16T17:52:48.062938] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-16T17:52:48.374899] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-09-16T17:52:49.103788] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-16T17:52:49.174841] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-09-16T17:52:49.974914] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-09-16T17:52:50.201256] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-16T17:52:50.774851] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-09-16T17:52:51.040318] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-16T17:52:51.574917] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-09-16T17:52:51.913516] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-16T17:52:52.180480] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-16T17:52:52.374930] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-09-16T17:52:53.136696] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-16T17:52:53.143224] [INFO ] [REMOTE ] COF: Full fetch complete (58263 records). [2025-09-16T17:52:53.143371] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-09-16T17:52:53.180056] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-09-16T17:52:53.538010] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-09-16T17:52:53.538099] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-09-16T17:52:53.538792] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-09-16T17:52:53.538838] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-09-16T17:52:53.540081] [DEBUG] [LOCAL ] COF: Trimmed 58263 records to 39987 (keeping 150 days of data) [2025-09-16T17:52:53.792385] [DEBUG] [LOCAL ] COF: Primary data saved (39987 records). [2025-09-16T17:52:53.792533] [INFO ] [MAIN ] COF: Full history saved. [2025-09-16T17:52:53.793871] [INFO ] [MAIN ] Update Progress: 503/2369 symbols completed. COF took 24.5s. Estimated remaining: 3h 16m 3s. Rate: 9.5 symbols/min [2025-09-16T17:52:53.969793] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:52:53.974932] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-09-16T17:52:54.004673] [DEBUG] [LOCAL ] CON: Loaded 28443 existing records from primary storage. [2025-09-16T17:52:54.004943] [INFO ] [MAIN ] CON: Loaded 28443 existing records. [2025-09-16T17:52:54.206310] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-16T17:52:54.238729] [WARN ] [MAIN ] CON: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:52:54.239672] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-09-16T17:52:54.239729] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-09-16T17:52:54.240519] [DEBUG] [LOCAL ] CON: Deleted primary data file. [2025-09-16T17:52:54.240574] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-09-16T17:52:54.621979] [INFO ] [REMOTE ] CON: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:52:54.774875] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-09-16T17:52:54.841246] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-16T17:52:55.574901] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-09-16T17:52:55.898387] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-16T17:52:56.261202] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-16T17:52:56.374888] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-09-16T17:52:56.850931] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-16T17:52:57.174923] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-09-16T17:52:57.974916] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-09-16T17:52:58.055932] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-16T17:52:58.469894] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-16T17:52:58.774922] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-09-16T17:52:59.574898] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-09-16T17:52:59.663277] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-16T17:52:59.972217] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-16T17:53:00.374906] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-09-16T17:53:01.174987] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-09-16T17:53:01.757700] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-16T17:53:01.848851] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-16T17:53:01.974912] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-09-16T17:53:02.774912] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-09-16T17:53:02.878459] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-16T17:53:03.303031] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-16T17:53:03.574913] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-09-16T17:53:04.374913] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-09-16T17:53:04.425241] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-16T17:53:05.174906] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-09-16T17:53:05.352265] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-16T17:53:05.358688] [INFO ] [REMOTE ] COMP: Full fetch complete (58017 records). [2025-09-16T17:53:05.358825] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-09-16T17:53:05.743717] [DEBUG] [VALIDATOR ] COMP: All expected trading days are present. [2025-09-16T17:53:05.743823] [DEBUG] [VALIDATOR ] COMP: Primary data validation passed. [2025-09-16T17:53:05.744544] [INFO ] [MAIN ] COMP: Fetched primary data is valid. [2025-09-16T17:53:05.744604] [DEBUG] [LOCAL ] COMP: Saving primary data. [2025-09-16T17:53:05.745912] [DEBUG] [LOCAL ] COMP: Trimmed 58017 records to 39767 (keeping 150 days of data) [2025-09-16T17:53:05.973129] [DEBUG] [LOCAL ] COMP: Primary data saved (39767 records). [2025-09-16T17:53:05.973284] [INFO ] [MAIN ] COMP: Full history saved. [2025-09-16T17:53:05.974395] [INFO ] [MAIN ] Update Progress: 504/2369 symbols completed. COMP took 19.9s. Estimated remaining: 3h 16m 18s. Rate: 9.5 symbols/min [2025-09-16T17:53:06.006558] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-09-16T17:53:06.151173] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:53:06.171992] [DEBUG] [LOCAL ] COOK: Loaded 18462 existing records from primary storage. [2025-09-16T17:53:06.172172] [INFO ] [MAIN ] COOK: Loaded 18462 existing records. [2025-09-16T17:53:06.348612] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:53:06.349243] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-09-16T17:53:06.349398] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-09-16T17:53:06.349949] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-09-16T17:53:06.350092] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-09-16T17:53:06.491610] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-16T17:53:06.740790] [INFO ] [REMOTE ] COOK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:53:06.771109] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-09-16T17:53:06.781280] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-09-16T17:53:07.574901] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-09-16T17:53:07.670594] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-16T17:53:07.698469] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-16T17:53:08.374906] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-09-16T17:53:08.833447] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-16T17:53:09.174916] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-09-16T17:53:09.980033] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-09-16T17:53:09.996117] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-16T17:53:10.006356] [INFO ] [REMOTE ] COLD: Full fetch complete (56352 records). [2025-09-16T17:53:10.006625] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-09-16T17:53:10.285102] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-16T17:53:10.444965] [DEBUG] [VALIDATOR ] COLD: All expected trading days are present. [2025-09-16T17:53:10.445082] [DEBUG] [VALIDATOR ] COLD: Primary data validation passed. [2025-09-16T17:53:10.446022] [INFO ] [MAIN ] COLD: Fetched primary data is valid. [2025-09-16T17:53:10.446085] [DEBUG] [LOCAL ] COLD: Saving primary data. [2025-09-16T17:53:10.447573] [DEBUG] [LOCAL ] COLD: Trimmed 56352 records to 39001 (keeping 150 days of data) [2025-09-16T17:53:10.689663] [DEBUG] [LOCAL ] COLD: Primary data saved (39001 records). [2025-09-16T17:53:10.689834] [INFO ] [MAIN ] COLD: Full history saved. [2025-09-16T17:53:10.689924] [INFO ] [MAIN ] Update Progress: 505/2369 symbols completed. COLD took 33.7s. Estimated remaining: 3h 16m 6s. Rate: 9.5 symbols/min [2025-09-16T17:53:10.780101] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-09-16T17:53:10.871007] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:53:10.906923] [DEBUG] [LOCAL ] COP: Loaded 39687 existing records from primary storage. [2025-09-16T17:53:10.907069] [INFO ] [MAIN ] COP: Loaded 39687 existing records. [2025-09-16T17:53:11.090567] [WARN ] [MAIN ] COP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:53:11.090853] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-09-16T17:53:11.090910] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-09-16T17:53:11.091798] [DEBUG] [LOCAL ] COP: Deleted primary data file. [2025-09-16T17:53:11.091862] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-09-16T17:53:11.466107] [INFO ] [REMOTE ] COP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:53:11.574929] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-09-16T17:53:12.156968] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-16T17:53:12.167730] [INFO ] [REMOTE ] COHR: Full fetch complete (58035 records). [2025-09-16T17:53:12.167960] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-09-16T17:53:12.363298] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-16T17:53:12.378943] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-09-16T17:53:12.705611] [DEBUG] [VALIDATOR ] COHR: All expected trading days are present. [2025-09-16T17:53:12.705745] [DEBUG] [VALIDATOR ] COHR: Primary data validation passed. [2025-09-16T17:53:12.706695] [INFO ] [MAIN ] COHR: Fetched primary data is valid. [2025-09-16T17:53:12.706746] [DEBUG] [LOCAL ] COHR: Saving primary data. [2025-09-16T17:53:12.708234] [DEBUG] [LOCAL ] COHR: Trimmed 58035 records to 39783 (keeping 150 days of data) [2025-09-16T17:53:12.948094] [DEBUG] [LOCAL ] COHR: Primary data saved (39783 records). [2025-09-16T17:53:12.948245] [INFO ] [MAIN ] COHR: Full history saved. [2025-09-16T17:53:12.948341] [INFO ] [MAIN ] Update Progress: 506/2369 symbols completed. COHR took 39.3s. Estimated remaining: 3h 15m 44s. Rate: 9.5 symbols/min [2025-09-16T17:53:13.121226] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:53:13.121384] [DEBUG] [LOCAL ] COR: No existing data file found in primary storage. [2025-09-16T17:53:13.121422] [WARN ] [MAIN ] COR: No existing data found, performing full refresh instead. [2025-09-16T17:53:13.121595] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-09-16T17:53:13.121670] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-09-16T17:53:13.121729] [DEBUG] [LOCAL ] COR: No primary data file found to delete. [2025-09-16T17:53:13.121765] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-09-16T17:53:13.185693] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-09-16T17:53:13.448156] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-16T17:53:13.515824] [INFO ] [REMOTE ] COR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:53:13.546090] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-16T17:53:13.974914] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-09-16T17:53:14.774900] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-09-16T17:53:14.842012] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-16T17:53:15.574905] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-09-16T17:53:15.716592] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-09-16T17:53:15.721871] [INFO ] [REMOTE ] CON: Full fetch complete (41829 records). [2025-09-16T17:53:15.722006] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-09-16T17:53:15.722726] [FATAL] [VALIDATOR ] CON: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:53:15.722807] [FATAL] [MAIN ] CON: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:53:15.722846] [WARN ] [MAIN ] CON: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:53:15.722886] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-09-16T17:53:15.722946] [DEBUG] [LOCAL ] CON: No primary data file found to delete. [2025-09-16T17:53:15.722994] [INFO ] [LOCAL ] CON: Starting deletion of derivative data. [2025-09-16T17:53:15.723425] [DEBUG] [LOCAL ] CON: Deleted derivative data file. [2025-09-16T17:53:15.724125] [INFO ] [MAIN ] Update Progress: 507/2369 symbols completed. CON took 21.9s. Estimated remaining: 3h 15m 25s. Rate: 9.5 symbols/min [2025-09-16T17:53:15.922582] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:53:15.971569] [DEBUG] [LOCAL ] COTY: Loaded 39335 existing records from primary storage. [2025-09-16T17:53:15.971809] [INFO ] [MAIN ] COTY: Loaded 39335 existing records. [2025-09-16T17:53:16.174058] [WARN ] [MAIN ] COTY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:53:16.174321] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-09-16T17:53:16.174368] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-09-16T17:53:16.175207] [DEBUG] [LOCAL ] COTY: Deleted primary data file. [2025-09-16T17:53:16.175260] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-09-16T17:53:16.386024] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-09-16T17:53:16.537422] [INFO ] [REMOTE ] COTY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:53:16.654771] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-16T17:53:16.722083] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-16T17:53:17.174907] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-09-16T17:53:17.795200] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-16T17:53:17.974896] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-09-16T17:53:18.384301] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-16T17:53:18.774901] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-09-16T17:53:19.583520] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-09-16T17:53:19.603285] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-16T17:53:20.273694] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-16T17:53:20.374901] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-09-16T17:53:21.174897] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-09-16T17:53:21.527785] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-16T17:53:21.592580] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-16T17:53:21.982447] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-09-16T17:53:21.984682] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-16T17:53:22.774905] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-09-16T17:53:23.543724] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-16T17:53:23.574840] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-09-16T17:53:24.120940] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-16T17:53:24.374945] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-09-16T17:53:25.052232] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-16T17:53:25.178894] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-09-16T17:53:25.180507] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-16T17:53:25.184237] [INFO ] [REMOTE ] COOK: Full fetch complete (25207 records). [2025-09-16T17:53:25.184319] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-09-16T17:53:25.542464] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-09-16T17:53:25.542540] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-09-16T17:53:25.542958] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-09-16T17:53:25.543001] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-09-16T17:53:25.543624] [DEBUG] [LOCAL ] COOK: Trimmed 25207 records to 18606 (keeping 150 days of data) [2025-09-16T17:53:25.651613] [DEBUG] [LOCAL ] COOK: Primary data saved (18606 records). [2025-09-16T17:53:25.651769] [INFO ] [MAIN ] COOK: Full history saved. [2025-09-16T17:53:25.651862] [INFO ] [MAIN ] Update Progress: 508/2369 symbols completed. COOK took 19.7s. Estimated remaining: 3h 15m 32s. Rate: 9.5 symbols/min [2025-09-16T17:53:25.820529] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:53:25.858258] [DEBUG] [LOCAL ] COUR: Loaded 36333 existing records from primary storage. [2025-09-16T17:53:25.858400] [INFO ] [MAIN ] COUR: Loaded 36333 existing records. [2025-09-16T17:53:25.979974] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-09-16T17:53:26.037324] [WARN ] [MAIN ] COUR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:53:26.037560] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-09-16T17:53:26.037624] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-09-16T17:53:26.038459] [DEBUG] [LOCAL ] COUR: Deleted primary data file. [2025-09-16T17:53:26.038527] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-09-16T17:53:26.394925] [INFO ] [REMOTE ] COUR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:53:26.586501] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-16T17:53:26.774902] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-09-16T17:53:27.574918] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-09-16T17:53:27.627891] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-16T17:53:28.061401] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-16T17:53:28.374905] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-09-16T17:53:28.819291] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-16T17:53:29.174901] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-09-16T17:53:29.982770] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-09-16T17:53:30.004056] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-16T17:53:30.774908] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-09-16T17:53:31.246517] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-16T17:53:31.574943] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-09-16T17:53:31.876935] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (2.70 seconds). [2025-09-16T17:53:32.179835] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-16T17:53:32.374888] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-09-16T17:53:33.066858] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-16T17:53:33.174933] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-09-16T17:53:33.555699] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-16T17:53:33.974898] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-09-16T17:53:34.489063] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-16T17:53:34.774907] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-09-16T17:53:35.533033] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-16T17:53:35.539560] [INFO ] [REMOTE ] COP: Full fetch complete (58407 records). [2025-09-16T17:53:35.539708] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-09-16T17:53:35.580058] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-09-16T17:53:35.932468] [DEBUG] [VALIDATOR ] COP: All expected trading days are present. [2025-09-16T17:53:35.932551] [DEBUG] [VALIDATOR ] COP: Primary data validation passed. [2025-09-16T17:53:35.933237] [INFO ] [MAIN ] COP: Fetched primary data is valid. [2025-09-16T17:53:35.933285] [DEBUG] [LOCAL ] COP: Saving primary data. [2025-09-16T17:53:35.934511] [DEBUG] [LOCAL ] COP: Trimmed 58407 records to 40077 (keeping 150 days of data) [2025-09-16T17:53:36.220398] [DEBUG] [LOCAL ] COP: Primary data saved (40077 records). [2025-09-16T17:53:36.223283] [INFO ] [MAIN ] COP: Full history saved. [2025-09-16T17:53:36.223396] [INFO ] [MAIN ] Update Progress: 509/2369 symbols completed. COP took 25.5s. Estimated remaining: 3h 15m 42s. Rate: 9.5 symbols/min [2025-09-16T17:53:36.224963] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-16T17:53:36.381607] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-09-16T17:53:36.414523] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:53:36.453732] [DEBUG] [LOCAL ] CP: Loaded 39276 existing records from primary storage. [2025-09-16T17:53:36.453909] [INFO ] [MAIN ] CP: Loaded 39276 existing records. [2025-09-16T17:53:36.630771] [WARN ] [MAIN ] CP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:53:36.631069] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-09-16T17:53:36.631130] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-09-16T17:53:36.631898] [DEBUG] [LOCAL ] CP: Deleted primary data file. [2025-09-16T17:53:36.631949] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-09-16T17:53:36.986314] [INFO ] [REMOTE ] CP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:53:37.035974] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-16T17:53:37.174873] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-09-16T17:53:37.750691] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-16T17:53:37.757003] [INFO ] [REMOTE ] COTY: Full fetch complete (57936 records). [2025-09-16T17:53:37.757113] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-09-16T17:53:37.980081] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-09-16T17:53:38.154098] [DEBUG] [VALIDATOR ] COTY: All expected trading days are present. [2025-09-16T17:53:38.154179] [DEBUG] [VALIDATOR ] COTY: Primary data validation passed. [2025-09-16T17:53:38.154893] [INFO ] [MAIN ] COTY: Fetched primary data is valid. [2025-09-16T17:53:38.154940] [DEBUG] [LOCAL ] COTY: Saving primary data. [2025-09-16T17:53:38.156160] [DEBUG] [LOCAL ] COTY: Trimmed 57936 records to 39719 (keeping 150 days of data) [2025-09-16T17:53:38.396793] [DEBUG] [LOCAL ] COTY: Primary data saved (39719 records). [2025-09-16T17:53:38.397213] [INFO ] [MAIN ] COTY: Full history saved. [2025-09-16T17:53:38.397920] [INFO ] [MAIN ] Update Progress: 510/2369 symbols completed. COTY took 22.7s. Estimated remaining: 3h 15m 20s. Rate: 9.5 symbols/min [2025-09-16T17:53:38.581204] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:53:38.615238] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-16T17:53:38.639807] [DEBUG] [LOCAL ] CPA: Loaded 21144 existing records from primary storage. [2025-09-16T17:53:38.639934] [INFO ] [MAIN ] CPA: Loaded 21144 existing records. [2025-09-16T17:53:38.788141] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-09-16T17:53:38.826455] [WARN ] [MAIN ] CPA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:53:38.826698] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-09-16T17:53:38.826747] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-09-16T17:53:38.827270] [DEBUG] [LOCAL ] CPA: Deleted primary data file. [2025-09-16T17:53:38.827324] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-09-16T17:53:39.198068] [INFO ] [REMOTE ] CPA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:53:39.313694] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-16T17:53:39.574933] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-09-16T17:53:40.307660] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-16T17:53:40.374864] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-09-16T17:53:41.174897] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-09-16T17:53:41.513969] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-16T17:53:41.974890] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-09-16T17:53:42.099237] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-16T17:53:42.121282] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-16T17:53:42.774938] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-09-16T17:53:43.318926] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-16T17:53:43.324841] [INFO ] [REMOTE ] COR: Full fetch complete (51611 records). [2025-09-16T17:53:43.324969] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-09-16T17:53:43.580804] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-09-16T17:53:43.717828] [DEBUG] [VALIDATOR ] COR: All expected trading days are present. [2025-09-16T17:53:43.717920] [DEBUG] [VALIDATOR ] COR: Primary data validation passed. [2025-09-16T17:53:43.718674] [INFO ] [MAIN ] COR: Fetched primary data is valid. [2025-09-16T17:53:43.718741] [DEBUG] [LOCAL ] COR: Saving primary data. [2025-09-16T17:53:43.719930] [DEBUG] [LOCAL ] COR: Trimmed 51611 records to 34601 (keeping 150 days of data) [2025-09-16T17:53:43.953399] [DEBUG] [LOCAL ] COR: Primary data saved (34601 records). [2025-09-16T17:53:43.953557] [INFO ] [MAIN ] COR: Full history saved. [2025-09-16T17:53:43.953660] [INFO ] [MAIN ] Update Progress: 511/2369 symbols completed. COR took 31.0s. Estimated remaining: 3h 15m 11s. Rate: 9.5 symbols/min [2025-09-16T17:53:44.133152] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:53:44.133372] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-09-16T17:53:44.133417] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-09-16T17:53:44.133565] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-09-16T17:53:44.133613] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-16T17:53:44.133675] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-09-16T17:53:44.133719] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-09-16T17:53:44.381575] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-09-16T17:53:44.495418] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:53:44.623904] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-16T17:53:45.126571] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-16T17:53:45.174885] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-09-16T17:53:45.965900] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-16T17:53:45.975403] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-09-16T17:53:46.477726] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-16T17:53:46.774920] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-09-16T17:53:47.210160] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-16T17:53:47.574930] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-09-16T17:53:47.864472] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-16T17:53:47.889027] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-16T17:53:48.374975] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-09-16T17:53:49.174923] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-09-16T17:53:49.834497] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-16T17:53:49.974870] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-09-16T17:53:50.774945] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-09-16T17:53:51.022309] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-16T17:53:51.085134] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-16T17:53:51.574950] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-09-16T17:53:51.924732] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-16T17:53:52.374906] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-09-16T17:53:52.638194] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-16T17:53:53.174900] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-09-16T17:53:53.496935] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-16T17:53:53.748904] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-16T17:53:53.974898] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-09-16T17:53:54.257829] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-16T17:53:54.774930] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-09-16T17:53:55.574904] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-09-16T17:53:55.973350] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-16T17:53:56.374909] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-09-16T17:53:56.485544] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-16T17:53:56.492169] [INFO ] [REMOTE ] CP: Full fetch complete (57914 records). [2025-09-16T17:53:56.492300] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-09-16T17:53:56.890328] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-09-16T17:53:56.890467] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-09-16T17:53:56.891189] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-09-16T17:53:56.891239] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-09-16T17:53:56.892583] [DEBUG] [LOCAL ] CP: Trimmed 57914 records to 39666 (keeping 150 days of data) [2025-09-16T17:53:57.134966] [DEBUG] [LOCAL ] CP: Primary data saved (39666 records). [2025-09-16T17:53:57.135128] [INFO ] [MAIN ] CP: Full history saved. [2025-09-16T17:53:57.135227] [INFO ] [MAIN ] Update Progress: 512/2369 symbols completed. CP took 20.9s. Estimated remaining: 3h 15m 30s. Rate: 9.5 symbols/min [2025-09-16T17:53:57.180005] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-09-16T17:53:57.305752] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:53:57.332991] [DEBUG] [LOCAL ] CPAY: Loaded 22320 existing records from primary storage. [2025-09-16T17:53:57.333156] [INFO ] [MAIN ] CPAY: Loaded 22320 existing records. [2025-09-16T17:53:57.559018] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:53:57.559268] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-09-16T17:53:57.559330] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-09-16T17:53:57.560029] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-09-16T17:53:57.560083] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-09-16T17:53:57.927852] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:53:57.962688] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-16T17:53:57.974863] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-09-16T17:53:58.702015] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-16T17:53:58.774908] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-09-16T17:53:59.140287] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-16T17:53:59.237336] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-16T17:53:59.574892] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-09-16T17:54:00.374909] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-09-16T17:54:00.890964] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-16T17:54:00.891758] [INFO ] [REMOTE ] CPAC: Full fetch complete (1259 records). [2025-09-16T17:54:00.891826] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-09-16T17:54:01.068316] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-16T17:54:01.068490] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:54:01.068539] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:54:01.068583] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-16T17:54:01.068639] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-09-16T17:54:01.068695] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-09-16T17:54:01.068737] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-09-16T17:54:01.068794] [INFO ] [MAIN ] Update Progress: 513/2369 symbols completed. CPAC took 17.1s. Estimated remaining: 3h 15m 15s. Rate: 9.5 symbols/min [2025-09-16T17:54:01.180035] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-09-16T17:54:01.242345] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:54:01.259707] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-16T17:54:01.268149] [INFO ] [REMOTE ] COUR: Full fetch complete (53068 records). [2025-09-16T17:54:01.268298] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-09-16T17:54:01.310429] [DEBUG] [LOCAL ] CPF: Loaded 10798 existing records from primary storage. [2025-09-16T17:54:01.344254] [INFO ] [MAIN ] CPF: Loaded 10798 existing records. [2025-09-16T17:54:01.710762] [WARN ] [MAIN ] CPF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:54:01.747703] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-09-16T17:54:01.750389] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-09-16T17:54:01.756289] [DEBUG] [LOCAL ] CPF: Deleted primary data file. [2025-09-16T17:54:01.766625] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-09-16T17:54:01.943082] [DEBUG] [VALIDATOR ] COUR: All expected trading days are present. [2025-09-16T17:54:01.943221] [DEBUG] [VALIDATOR ] COUR: Primary data validation passed. [2025-09-16T17:54:01.943900] [INFO ] [MAIN ] COUR: Fetched primary data is valid. [2025-09-16T17:54:01.944000] [DEBUG] [LOCAL ] COUR: Saving primary data. [2025-09-16T17:54:01.984284] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-09-16T17:54:02.033535] [DEBUG] [LOCAL ] COUR: Trimmed 53068 records to 36689 (keeping 150 days of data) [2025-09-16T17:54:02.290840] [INFO ] [REMOTE ] CPF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:54:02.422826] [DEBUG] [LOCAL ] COUR: Primary data saved (36689 records). [2025-09-16T17:54:02.422979] [INFO ] [MAIN ] COUR: Full history saved. [2025-09-16T17:54:02.425178] [INFO ] [MAIN ] Update Progress: 514/2369 symbols completed. COUR took 36.8s. Estimated remaining: 3h 14m 51s. Rate: 9.5 symbols/min [2025-09-16T17:54:02.597085] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:54:02.606317] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-16T17:54:02.610221] [INFO ] [REMOTE ] CPA: Full fetch complete (31858 records). [2025-09-16T17:54:02.610363] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-09-16T17:54:02.717154] [DEBUG] [LOCAL ] CPK: Loaded 9139 existing records from primary storage. [2025-09-16T17:54:02.722759] [INFO ] [MAIN ] CPK: Loaded 9139 existing records. [2025-09-16T17:54:02.794314] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-09-16T17:54:03.108324] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:54:03.194659] [DEBUG] [VALIDATOR ] CPA: All expected trading days are present. [2025-09-16T17:54:03.194832] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-09-16T17:54:03.194966] [DEBUG] [VALIDATOR ] CPA: Primary data validation passed. [2025-09-16T17:54:03.195728] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-09-16T17:54:03.195550] [INFO ] [MAIN ] CPA: Fetched primary data is valid. [2025-09-16T17:54:03.195978] [DEBUG] [LOCAL ] CPA: Saving primary data. [2025-09-16T17:54:03.196367] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-09-16T17:54:03.196897] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-09-16T17:54:03.248037] [DEBUG] [LOCAL ] CPA: Trimmed 31858 records to 21298 (keeping 150 days of data) [2025-09-16T17:54:03.512404] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-16T17:54:03.580257] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-09-16T17:54:03.744033] [INFO ] [REMOTE ] CPK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:54:03.762581] [DEBUG] [LOCAL ] CPA: Primary data saved (21298 records). [2025-09-16T17:54:03.762731] [INFO ] [MAIN ] CPA: Full history saved. [2025-09-16T17:54:03.762822] [INFO ] [MAIN ] Update Progress: 515/2369 symbols completed. CPA took 25.4s. Estimated remaining: 3h 14m 26s. Rate: 9.5 symbols/min [2025-09-16T17:54:03.930925] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:54:03.970893] [DEBUG] [LOCAL ] CPNG: Loaded 39648 existing records from primary storage. [2025-09-16T17:54:03.971047] [INFO ] [MAIN ] CPNG: Loaded 39648 existing records. [2025-09-16T17:54:04.151246] [WARN ] [MAIN ] CPNG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:54:04.151595] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-09-16T17:54:04.151674] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-09-16T17:54:04.157879] [DEBUG] [LOCAL ] CPNG: Deleted primary data file. [2025-09-16T17:54:04.163387] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-09-16T17:54:04.185678] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-16T17:54:04.380127] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-09-16T17:54:04.735858] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:54:04.983341] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-16T17:54:05.097799] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-16T17:54:05.174959] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-09-16T17:54:05.974922] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-09-16T17:54:06.774903] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-09-16T17:54:06.839440] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-16T17:54:07.074092] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-16T17:54:07.574909] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-09-16T17:54:08.102695] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-16T17:54:08.374904] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-09-16T17:54:08.558203] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-16T17:54:09.174930] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-09-16T17:54:09.277919] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-16T17:54:09.974904] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-09-16T17:54:10.091564] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-16T17:54:10.774898] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-09-16T17:54:11.574941] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-09-16T17:54:11.651533] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-16T17:54:11.910843] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-16T17:54:12.374900] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-09-16T17:54:12.902286] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-16T17:54:13.174885] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-09-16T17:54:13.319373] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-16T17:54:13.974903] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-09-16T17:54:14.497851] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-16T17:54:14.774897] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-09-16T17:54:15.054384] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-16T17:54:15.574911] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-09-16T17:54:15.827708] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-16T17:54:16.374899] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-09-16T17:54:16.536337] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-16T17:54:17.174913] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-09-16T17:54:17.381864] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-16T17:54:17.974910] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-09-16T17:54:18.774914] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-09-16T17:54:19.207945] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-16T17:54:19.377728] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-16T17:54:19.574905] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-09-16T17:54:19.823129] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-16T17:54:20.374889] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-09-16T17:54:21.174951] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-09-16T17:54:21.297977] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-16T17:54:21.298335] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-16T17:54:21.312704] [INFO ] [REMOTE ] CPF: Full fetch complete (16947 records). [2025-09-16T17:54:21.313253] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-09-16T17:54:21.675632] [DEBUG] [VALIDATOR ] CPF: All expected trading days are present. [2025-09-16T17:54:21.675734] [DEBUG] [VALIDATOR ] CPF: Primary data validation passed. [2025-09-16T17:54:21.676133] [INFO ] [MAIN ] CPF: Fetched primary data is valid. [2025-09-16T17:54:21.676173] [DEBUG] [LOCAL ] CPF: Saving primary data. [2025-09-16T17:54:21.676772] [DEBUG] [LOCAL ] CPF: Trimmed 16947 records to 10949 (keeping 150 days of data) [2025-09-16T17:54:21.743259] [DEBUG] [LOCAL ] CPF: Primary data saved (10949 records). [2025-09-16T17:54:21.743401] [INFO ] [MAIN ] CPF: Full history saved. [2025-09-16T17:54:21.743486] [INFO ] [MAIN ] Update Progress: 516/2369 symbols completed. CPF took 20.7s. Estimated remaining: 3h 15m 2s. Rate: 9.5 symbols/min [2025-09-16T17:54:21.913610] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:54:21.953259] [DEBUG] [LOCAL ] CPRI: Loaded 38730 existing records from primary storage. [2025-09-16T17:54:21.953399] [INFO ] [MAIN ] CPRI: Loaded 38730 existing records. [2025-09-16T17:54:21.984096] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-09-16T17:54:22.137628] [WARN ] [MAIN ] CPRI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:54:22.137896] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-09-16T17:54:22.137943] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-09-16T17:54:22.138727] [DEBUG] [LOCAL ] CPRI: Deleted primary data file. [2025-09-16T17:54:22.138778] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-09-16T17:54:22.496531] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:54:22.505721] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-16T17:54:22.509238] [INFO ] [REMOTE ] CPAY: Full fetch complete (33905 records). [2025-09-16T17:54:22.509345] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-09-16T17:54:22.779995] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-09-16T17:54:22.882289] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-09-16T17:54:22.882376] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-09-16T17:54:22.882896] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-09-16T17:54:22.882941] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-09-16T17:54:22.883921] [DEBUG] [LOCAL ] CPAY: Trimmed 33905 records to 22534 (keeping 150 days of data) [2025-09-16T17:54:23.017696] [DEBUG] [LOCAL ] CPAY: Primary data saved (22534 records). [2025-09-16T17:54:23.017833] [INFO ] [MAIN ] CPAY: Full history saved. [2025-09-16T17:54:23.017918] [INFO ] [MAIN ] Update Progress: 517/2369 symbols completed. CPAY took 25.9s. Estimated remaining: 3h 14m 38s. Rate: 9.5 symbols/min [2025-09-16T17:54:23.574916] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-09-16T17:54:24.010447] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-16T17:54:24.374918] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-09-16T17:54:24.482990] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-16T17:54:24.546326] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-16T17:54:25.174909] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-09-16T17:54:25.974936] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-09-16T17:54:26.257410] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-16T17:54:26.408607] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-16T17:54:26.524677] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-16T17:54:26.774925] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-09-16T17:54:27.574942] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-09-16T17:54:28.374930] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-09-16T17:54:28.449883] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-16T17:54:28.948871] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-16T17:54:28.951026] [INFO ] [REMOTE ] CPK: Full fetch complete (14061 records). [2025-09-16T17:54:28.951102] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-09-16T17:54:29.181267] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-09-16T17:54:29.342490] [DEBUG] [VALIDATOR ] CPK: All expected trading days are present. [2025-09-16T17:54:29.342610] [DEBUG] [VALIDATOR ] CPK: Primary data validation passed. [2025-09-16T17:54:29.342996] [INFO ] [MAIN ] CPK: Fetched primary data is valid. [2025-09-16T17:54:29.343101] [DEBUG] [LOCAL ] CPK: Saving primary data. [2025-09-16T17:54:29.359303] [DEBUG] [LOCAL ] CPK: Trimmed 14061 records to 9239 (keeping 150 days of data) [2025-09-16T17:54:29.407864] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-16T17:54:29.454282] [DEBUG] [LOCAL ] CPK: Primary data saved (9239 records). [2025-09-16T17:54:29.454453] [INFO ] [MAIN ] CPK: Full history saved. [2025-09-16T17:54:29.454545] [INFO ] [MAIN ] Update Progress: 518/2369 symbols completed. CPK took 27.0s. Estimated remaining: 3h 14m 32s. Rate: 9.5 symbols/min [2025-09-16T17:54:29.974962] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-09-16T17:54:31.072758] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-16T17:54:31.079127] [INFO ] [REMOTE ] CPNG: Full fetch complete (58349 records). [2025-09-16T17:54:31.079244] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-09-16T17:54:31.458010] [DEBUG] [VALIDATOR ] CPNG: All expected trading days are present. [2025-09-16T17:54:31.458154] [DEBUG] [VALIDATOR ] CPNG: Primary data validation passed. [2025-09-16T17:54:31.458864] [INFO ] [MAIN ] CPNG: Fetched primary data is valid. [2025-09-16T17:54:31.458940] [DEBUG] [LOCAL ] CPNG: Saving primary data. [2025-09-16T17:54:31.471131] [DEBUG] [LOCAL ] CPNG: Trimmed 58349 records to 40038 (keeping 150 days of data) [2025-09-16T17:54:31.492820] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-16T17:54:31.590900] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-09-16T17:54:31.742104] [DEBUG] [LOCAL ] CPNG: Primary data saved (40038 records). [2025-09-16T17:54:31.742235] [INFO ] [MAIN ] CPNG: Full history saved. [2025-09-16T17:54:31.743321] [INFO ] [MAIN ] Update Progress: 519/2369 symbols completed. CPNG took 28.0s. Estimated remaining: 3h 14m 11s. Rate: 9.5 symbols/min [2025-09-16T17:54:32.934863] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-16T17:54:32.945404] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-09-16T17:54:34.093736] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-16T17:54:34.105412] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-09-16T17:54:35.387190] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-16T17:54:35.407944] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-09-16T17:54:36.692171] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-16T17:54:36.701624] [INFO ] [REMOTE ] CPRI: Full fetch complete (57175 records). [2025-09-16T17:54:36.701842] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-09-16T17:54:37.227303] [DEBUG] [VALIDATOR ] CPRI: All expected trading days are present. [2025-09-16T17:54:37.227449] [DEBUG] [VALIDATOR ] CPRI: Primary data validation passed. [2025-09-16T17:54:37.228453] [INFO ] [MAIN ] CPRI: Fetched primary data is valid. [2025-09-16T17:54:37.228517] [DEBUG] [LOCAL ] CPRI: Saving primary data. [2025-09-16T17:54:37.230477] [DEBUG] [LOCAL ] CPRI: Trimmed 57175 records to 39119 (keeping 150 days of data) [2025-09-16T17:54:37.480580] [DEBUG] [LOCAL ] CPRI: Primary data saved (39119 records). [2025-09-16T17:54:37.480843] [INFO ] [MAIN ] CPRI: Full history saved. [2025-09-16T17:54:37.480957] [INFO ] [MAIN ] Update Progress: 520/2369 symbols completed. CPRI took 15.7s. Estimated remaining: 3h 14m 3s. Rate: 9.5 symbols/min [2025-09-16T17:54:38.100480] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:54:38.211347] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:54:38.234472] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:54:38.230024] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:54:38.279057] [DEBUG] [LOCAL ] CPS: Loaded 18514 existing records from primary storage. [2025-09-16T17:54:38.279497] [DEBUG] [LOCAL ] CR: Loaded 17772 existing records from primary storage. [2025-09-16T17:54:38.279741] [INFO ] [MAIN ] CR: Loaded 17772 existing records. [2025-09-16T17:54:38.279626] [INFO ] [MAIN ] CPS: Loaded 18514 existing records. [2025-09-16T17:54:38.280136] [DEBUG] [LOCAL ] CQP: Loaded 14914 existing records from primary storage. [2025-09-16T17:54:38.355713] [INFO ] [MAIN ] CQP: Loaded 14914 existing records. [2025-09-16T17:54:38.597947] [DEBUG] [LOCAL ] CPT: Loaded 32473 existing records from primary storage. [2025-09-16T17:54:38.634630] [INFO ] [MAIN ] CPT: Loaded 32473 existing records. [2025-09-16T17:54:38.891917] [WARN ] [MAIN ] CPS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:54:38.921011] [WARN ] [MAIN ] CR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:54:38.942492] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-09-16T17:54:38.947685] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-09-16T17:54:38.979782] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-09-16T17:54:38.986665] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-09-16T17:54:39.020622] [DEBUG] [LOCAL ] CPS: Deleted primary data file. [2025-09-16T17:54:39.020828] [WARN ] [MAIN ] CQP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:54:39.031276] [DEBUG] [LOCAL ] CR: Deleted primary data file. [2025-09-16T17:54:39.048302] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-09-16T17:54:39.031453] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-09-16T17:54:39.082213] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-09-16T17:54:39.089201] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-09-16T17:54:39.115043] [DEBUG] [LOCAL ] CQP: Deleted primary data file. [2025-09-16T17:54:39.150546] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-09-16T17:54:39.169082] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:54:39.211785] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-09-16T17:54:39.238800] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-09-16T17:54:39.349295] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-09-16T17:54:39.354820] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-09-16T17:54:40.269921] [INFO ] [REMOTE ] CR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:54:40.363668] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-09-16T17:54:40.363406] [INFO ] [REMOTE ] CQP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:54:40.410725] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-09-16T17:54:40.484602] [INFO ] [REMOTE ] CPS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:54:40.488579] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-09-16T17:54:40.567446] [INFO ] [REMOTE ] CPT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:54:40.567780] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-09-16T17:54:41.514581] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-16T17:54:41.519953] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-09-16T17:54:41.679808] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-16T17:54:41.684291] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-09-16T17:54:41.846685] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-16T17:54:41.851859] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-09-16T17:54:42.300409] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-16T17:54:42.305262] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-09-16T17:54:42.468531] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-16T17:54:42.477440] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-09-16T17:54:42.560867] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-16T17:54:42.566562] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-09-16T17:54:42.981315] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-16T17:54:42.999624] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-09-16T17:54:43.001399] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-16T17:54:43.007746] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-09-16T17:54:43.602275] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-16T17:54:43.614720] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-09-16T17:54:43.889368] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-16T17:54:43.939028] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-16T17:54:44.072251] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-16T17:54:44.374879] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-09-16T17:54:44.433615] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-16T17:54:45.174921] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-09-16T17:54:45.679702] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-16T17:54:45.974945] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-09-16T17:54:46.089273] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-16T17:54:46.774857] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-09-16T17:54:46.818924] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-16T17:54:47.574908] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-09-16T17:54:48.130219] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-16T17:54:48.373309] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-16T17:54:48.378631] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-09-16T17:54:49.178196] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-09-16T17:54:49.180246] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-16T17:54:49.946962] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-16T17:54:49.974881] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-09-16T17:54:50.571857] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-16T17:54:50.774926] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-09-16T17:54:51.574939] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-09-16T17:54:52.068202] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-16T17:54:52.374883] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-09-16T17:54:52.414962] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-16T17:54:52.416943] [INFO ] [REMOTE ] CQP: Full fetch complete (22076 records). [2025-09-16T17:54:52.417014] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-09-16T17:54:52.785209] [DEBUG] [VALIDATOR ] CQP: All expected trading days are present. [2025-09-16T17:54:52.785300] [DEBUG] [VALIDATOR ] CQP: Primary data validation passed. [2025-09-16T17:54:52.785719] [INFO ] [MAIN ] CQP: Fetched primary data is valid. [2025-09-16T17:54:52.785771] [DEBUG] [LOCAL ] CQP: Saving primary data. [2025-09-16T17:54:52.786492] [DEBUG] [LOCAL ] CQP: Trimmed 22076 records to 15075 (keeping 150 days of data) [2025-09-16T17:54:52.877920] [DEBUG] [LOCAL ] CQP: Primary data saved (15075 records). [2025-09-16T17:54:52.878051] [INFO ] [MAIN ] CQP: Full history saved. [2025-09-16T17:54:52.878152] [INFO ] [MAIN ] Update Progress: 521/2369 symbols completed. CQP took 15.4s. Estimated remaining: 3h 14m 29s. Rate: 9.5 symbols/min [2025-09-16T17:54:53.046669] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:54:53.054781] [DEBUG] [LOCAL ] CRBD: Loaded 6872 existing records from primary storage. [2025-09-16T17:54:53.054878] [INFO ] [MAIN ] CRBD: Loaded 6872 existing records. [2025-09-16T17:54:53.179989] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-09-16T17:54:53.230081] [WARN ] [MAIN ] CRBD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:54:53.230369] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-09-16T17:54:53.230414] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-09-16T17:54:53.230735] [DEBUG] [LOCAL ] CRBD: Deleted primary data file. [2025-09-16T17:54:53.230787] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-09-16T17:54:53.592606] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:54:53.607393] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-16T17:54:53.974933] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-09-16T17:54:54.726547] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-16T17:54:54.774856] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-09-16T17:54:55.221991] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-16T17:54:55.574897] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-09-16T17:54:55.892130] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-16T17:54:56.374871] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-09-16T17:54:56.405002] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-16T17:54:57.174919] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-09-16T17:54:57.256364] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-16T17:54:57.974978] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-09-16T17:54:58.074803] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-16T17:54:58.080399] [INFO ] [REMOTE ] CR: Full fetch complete (26595 records). [2025-09-16T17:54:58.080608] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-09-16T17:54:58.671069] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-09-16T17:54:58.671165] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-09-16T17:54:58.671679] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-09-16T17:54:58.671728] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-09-16T17:54:58.672573] [DEBUG] [LOCAL ] CR: Trimmed 26595 records to 17929 (keeping 150 days of data) [2025-09-16T17:54:58.779701] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-09-16T17:54:58.810258] [DEBUG] [LOCAL ] CR: Primary data saved (17929 records). [2025-09-16T17:54:58.810435] [INFO ] [MAIN ] CR: Full history saved. [2025-09-16T17:54:58.810536] [INFO ] [MAIN ] Update Progress: 522/2369 symbols completed. CR took 21.3s. Estimated remaining: 3h 14m 21s. Rate: 9.5 symbols/min [2025-09-16T17:54:58.983435] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:54:58.992209] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-16T17:54:58.995438] [INFO ] [REMOTE ] CPS: Full fetch complete (28935 records). [2025-09-16T17:54:58.995522] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-09-16T17:54:59.306940] [DEBUG] [LOCAL ] CRBG: Loaded 38714 existing records from primary storage. [2025-09-16T17:54:59.312744] [INFO ] [MAIN ] CRBG: Loaded 38714 existing records. [2025-09-16T17:54:59.503951] [DEBUG] [VALIDATOR ] CPS: All expected trading days are present. [2025-09-16T17:54:59.504123] [DEBUG] [VALIDATOR ] CPS: Primary data validation passed. [2025-09-16T17:54:59.504833] [INFO ] [MAIN ] CPS: Fetched primary data is valid. [2025-09-16T17:54:59.504919] [DEBUG] [LOCAL ] CPS: Saving primary data. [2025-09-16T17:54:59.537048] [DEBUG] [LOCAL ] CPS: Trimmed 28935 records to 18635 (keeping 150 days of data) [2025-09-16T17:54:59.628376] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-09-16T17:54:59.642991] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:54:59.644306] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-09-16T17:54:59.672677] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-09-16T17:54:59.674430] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-09-16T17:54:59.678217] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-09-16T17:55:00.075401] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:55:00.078331] [DEBUG] [LOCAL ] CPS: Primary data saved (18635 records). [2025-09-16T17:55:00.079019] [INFO ] [MAIN ] CPS: Full history saved. [2025-09-16T17:55:00.079135] [INFO ] [MAIN ] Update Progress: 523/2369 symbols completed. CPS took 22.6s. Estimated remaining: 3h 13m 57s. Rate: 9.5 symbols/min [2025-09-16T17:55:00.250309] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:55:00.283002] [DEBUG] [LOCAL ] CRC: Loaded 32513 existing records from primary storage. [2025-09-16T17:55:00.283141] [INFO ] [MAIN ] CRC: Loaded 32513 existing records. [2025-09-16T17:55:00.380507] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-09-16T17:55:00.463879] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:55:00.470506] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-09-16T17:55:00.470381] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-16T17:55:00.470777] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-09-16T17:55:00.474169] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-09-16T17:55:00.474228] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-09-16T17:55:00.631962] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-16T17:55:00.879571] [INFO ] [REMOTE ] CRC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:55:01.174948] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-09-16T17:55:01.797490] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-16T17:55:01.975014] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-09-16T17:55:02.455062] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-16T17:55:02.624639] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-09-16T17:55:02.774941] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-09-16T17:55:03.574898] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-09-16T17:55:04.379973] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-09-16T17:55:04.385627] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-16T17:55:05.174901] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-09-16T17:55:05.263828] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-16T17:55:05.376576] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-16T17:55:05.974909] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-09-16T17:55:06.732825] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-16T17:55:06.737993] [INFO ] [REMOTE ] CPT: Full fetch complete (48329 records). [2025-09-16T17:55:06.738081] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-09-16T17:55:06.780965] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-09-16T17:55:07.119590] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-09-16T17:55:07.119685] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-09-16T17:55:07.120352] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-09-16T17:55:07.120403] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-09-16T17:55:07.121413] [DEBUG] [LOCAL ] CPT: Trimmed 48329 records to 32824 (keeping 150 days of data) [2025-09-16T17:55:07.344486] [DEBUG] [LOCAL ] CPT: Primary data saved (32824 records). [2025-09-16T17:55:07.344680] [INFO ] [MAIN ] CPT: Full history saved. [2025-09-16T17:55:07.344811] [INFO ] [MAIN ] Update Progress: 524/2369 symbols completed. CPT took 29.9s. Estimated remaining: 3h 13m 54s. Rate: 9.5 symbols/min [2025-09-16T17:55:07.521324] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:55:07.521638] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-09-16T17:55:07.521719] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-09-16T17:55:07.521929] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-09-16T17:55:07.521973] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-16T17:55:07.522050] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-09-16T17:55:07.522096] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-09-16T17:55:07.585944] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-09-16T17:55:07.936675] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:55:07.939387] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-16T17:55:08.360861] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-16T17:55:08.374867] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-09-16T17:55:08.468535] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-16T17:55:09.174906] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-09-16T17:55:09.184076] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-16T17:55:09.974939] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-09-16T17:55:10.709217] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-16T17:55:10.711091] [INFO ] [REMOTE ] CRBD: Full fetch complete (9932 records). [2025-09-16T17:55:10.711165] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-09-16T17:55:10.780044] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-02. [2025-09-16T17:55:11.078273] [DEBUG] [VALIDATOR ] CRBD: All expected trading days are present. [2025-09-16T17:55:11.078498] [DEBUG] [VALIDATOR ] CRBD: Primary data validation passed. [2025-09-16T17:55:11.078992] [INFO ] [MAIN ] CRBD: Fetched primary data is valid. [2025-09-16T17:55:11.079090] [DEBUG] [LOCAL ] CRBD: Saving primary data. [2025-09-16T17:55:11.079805] [DEBUG] [LOCAL ] CRBD: Trimmed 9932 records to 6926 (keeping 150 days of data) [2025-09-16T17:55:11.112484] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:55:11.122780] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-02 [2025-09-16T17:55:11.128037] [DEBUG] [LOCAL ] CRBD: Primary data saved (6926 records). [2025-09-16T17:55:11.128189] [INFO ] [MAIN ] CRBD: Full history saved. [2025-09-16T17:55:11.128297] [INFO ] [MAIN ] Update Progress: 525/2369 symbols completed. CRBD took 18.3s. Estimated remaining: 3h 13m 39s. Rate: 9.5 symbols/min [2025-09-16T17:55:11.338369] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:55:11.340693] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-16T17:55:11.396571] [DEBUG] [LOCAL ] CRGY: Loaded 38598 existing records from primary storage. [2025-09-16T17:55:11.396795] [INFO ] [MAIN ] CRGY: Loaded 38598 existing records. [2025-09-16T17:55:11.577200] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-03. [2025-09-16T17:55:11.577551] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:55:11.578744] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-09-16T17:55:11.578794] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-09-16T17:55:11.579553] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-09-16T17:55:11.579684] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-09-16T17:55:11.884413] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:55:11.890471] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-03 [2025-09-16T17:55:11.962085] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:55:12.374917] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-09-16T17:55:13.174906] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-09-16T17:55:13.876609] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-16T17:55:13.974852] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-09-16T17:55:14.774888] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-04. [2025-09-16T17:55:14.986332] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:55:14.986704] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-04 [2025-09-16T17:55:15.142245] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-16T17:55:15.338598] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-16T17:55:15.574890] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-05. [2025-09-16T17:55:15.805084] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:55:15.805378] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-05 [2025-09-16T17:55:16.374897] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-09-16T17:55:17.174891] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-06. [2025-09-16T17:55:17.961917] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-16T17:55:17.974851] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-09-16T17:55:18.774937] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-09-16T17:55:19.276191] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-16T17:55:19.574947] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-09-16T17:55:19.658506] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-09-16T17:55:20.374872] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-09-16T17:55:20.430212] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-16T17:55:20.803975] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-16T17:55:21.174892] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-07. [2025-09-16T17:55:21.974889] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-09-16T17:55:22.132315] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-16T17:55:22.774907] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-09-16T17:55:23.574881] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-09-16T17:55:23.696674] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-16T17:55:24.011206] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-07 (2.84 seconds). [2025-09-16T17:55:24.374914] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-08. [2025-09-16T17:55:24.429125] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-16T17:55:24.435883] [INFO ] [REMOTE ] CRBG: Full fetch complete (56922 records). [2025-09-16T17:55:24.436040] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-09-16T17:55:24.822538] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-09-16T17:55:24.822618] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-09-16T17:55:24.823368] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-09-16T17:55:24.823423] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-09-16T17:55:24.824594] [DEBUG] [LOCAL ] CRBG: Trimmed 56922 records to 39103 (keeping 150 days of data) [2025-09-16T17:55:25.060177] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-16T17:55:25.100418] [DEBUG] [LOCAL ] CRBG: Primary data saved (39103 records). [2025-09-16T17:55:25.100565] [INFO ] [MAIN ] CRBG: Full history saved. [2025-09-16T17:55:25.100686] [INFO ] [MAIN ] Update Progress: 526/2369 symbols completed. CRBG took 26.3s. Estimated remaining: 3h 13m 60s. Rate: 9.5 symbols/min [2025-09-16T17:55:25.179962] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-09-16T17:55:25.276120] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:55:25.313048] [DEBUG] [LOCAL ] CRH: Loaded 39445 existing records from primary storage. [2025-09-16T17:55:25.313213] [INFO ] [MAIN ] CRH: Loaded 39445 existing records. [2025-09-16T17:55:25.489627] [WARN ] [MAIN ] CRH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:55:25.489915] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-09-16T17:55:25.489963] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-09-16T17:55:25.490846] [DEBUG] [LOCAL ] CRH: Deleted primary data file. [2025-09-16T17:55:25.490897] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-09-16T17:55:25.843513] [INFO ] [REMOTE ] CRH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:55:25.974926] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-09-16T17:55:26.774932] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-09-16T17:55:26.825436] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-09-16T17:55:27.040110] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-16T17:55:27.451761] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-16T17:55:27.574902] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-09-16T17:55:28.374881] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-09. [2025-09-16T17:55:28.895101] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-16T17:55:28.919519] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-16T17:55:28.925075] [INFO ] [REMOTE ] CRC: Full fetch complete (47864 records). [2025-09-16T17:55:28.925178] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-09-16T17:55:29.180742] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-09-16T17:55:29.305346] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-09-16T17:55:29.305426] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-09-16T17:55:29.306025] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-09-16T17:55:29.306069] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-09-16T17:55:29.307024] [DEBUG] [LOCAL ] CRC: Trimmed 47864 records to 32855 (keeping 150 days of data) [2025-09-16T17:55:29.507522] [DEBUG] [LOCAL ] CRC: Primary data saved (32855 records). [2025-09-16T17:55:29.507676] [INFO ] [MAIN ] CRC: Full history saved. [2025-09-16T17:55:29.507762] [INFO ] [MAIN ] Update Progress: 527/2369 symbols completed. CRC took 29.4s. Estimated remaining: 3h 13m 47s. Rate: 9.5 symbols/min [2025-09-16T17:55:29.680450] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:55:29.714308] [DEBUG] [LOCAL ] CRI: Loaded 36947 existing records from primary storage. [2025-09-16T17:55:29.714447] [INFO ] [MAIN ] CRI: Loaded 36947 existing records. [2025-09-16T17:55:29.889403] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:55:29.889662] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-09-16T17:55:29.889712] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-09-16T17:55:29.890522] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-09-16T17:55:29.890570] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-09-16T17:55:29.981201] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-09-16T17:55:30.247381] [INFO ] [REMOTE ] CRI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:55:30.774924] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-09-16T17:55:31.018920] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-16T17:55:31.140856] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-09 (2.77 seconds). [2025-09-16T17:55:31.147276] [INFO ] [REMOTE ] CRCL: Full fetch complete (27489 records). [2025-09-16T17:55:31.147383] [DEBUG] [VALIDATOR ] CRCL: Validating primary data. [2025-09-16T17:55:31.335943] [WARN ] [VALIDATOR ] CRCL: Validation failed - insufficient historical data. Have 71 unique days, need 150 days [2025-09-16T17:55:31.336374] [FATAL] [MAIN ] CRCL: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:55:31.336432] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:55:31.336483] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-16T17:55:31.336546] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-09-16T17:55:31.336596] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-09-16T17:55:31.336667] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-09-16T17:55:31.336740] [INFO ] [MAIN ] Update Progress: 528/2369 symbols completed. CRCL took 24.0s. Estimated remaining: 3h 13m 25s. Rate: 9.5 symbols/min [2025-09-16T17:55:31.514185] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:55:31.553846] [DEBUG] [LOCAL ] CRK: Loaded 38364 existing records from primary storage. [2025-09-16T17:55:31.554020] [INFO ] [MAIN ] CRK: Loaded 38364 existing records. [2025-09-16T17:55:31.587040] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-09-16T17:55:31.781201] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:55:31.781613] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-09-16T17:55:31.781746] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-09-16T17:55:31.782559] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-09-16T17:55:31.782609] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-09-16T17:55:32.174222] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-16T17:55:32.178170] [INFO ] [REMOTE ] CRK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:55:32.374186] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-16T17:55:32.382656] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-09-16T17:55:33.174910] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-09-16T17:55:33.397316] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-16T17:55:33.854340] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-16T17:55:33.974901] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-09-16T17:55:34.710631] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-16T17:55:34.774865] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-09-16T17:55:35.452476] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-16T17:55:35.574908] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-09-16T17:55:36.111388] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-16T17:55:36.374899] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-09-16T17:55:37.184068] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-09-16T17:55:37.207260] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-16T17:55:37.695953] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-16T17:55:37.974959] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-09-16T17:55:38.774939] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-09-16T17:55:39.464592] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-16T17:55:39.470985] [INFO ] [REMOTE ] CRGY: Full fetch complete (57050 records). [2025-09-16T17:55:39.471196] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-09-16T17:55:39.576111] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-09-16T17:55:39.605981] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-09-16T17:55:39.898988] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-09-16T17:55:39.899071] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-09-16T17:55:39.899836] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-09-16T17:55:39.899882] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-09-16T17:55:39.901047] [DEBUG] [LOCAL ] CRGY: Trimmed 57050 records to 38979 (keeping 150 days of data) [2025-09-16T17:55:40.144477] [DEBUG] [LOCAL ] CRGY: Primary data saved (38979 records). [2025-09-16T17:55:40.144665] [INFO ] [MAIN ] CRGY: Full history saved. [2025-09-16T17:55:40.146108] [INFO ] [MAIN ] Update Progress: 529/2369 symbols completed. CRGY took 29.0s. Estimated remaining: 3h 13m 27s. Rate: 9.5 symbols/min [2025-09-16T17:55:40.321604] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:55:40.321906] [DEBUG] [LOCAL ] CRL: No existing data file found in primary storage. [2025-09-16T17:55:40.321963] [WARN ] [MAIN ] CRL: No existing data found, performing full refresh instead. [2025-09-16T17:55:40.322244] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-09-16T17:55:40.322354] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-09-16T17:55:40.322532] [DEBUG] [LOCAL ] CRL: No primary data file found to delete. [2025-09-16T17:55:40.322587] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-09-16T17:55:40.385135] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-09-16T17:55:40.464591] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-16T17:55:40.727531] [INFO ] [REMOTE ] CRL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:55:40.868535] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-16T17:55:41.174905] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-09-16T17:55:41.974915] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-09-16T17:55:42.124225] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-16T17:55:42.442661] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-16T17:55:42.774932] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-09-16T17:55:43.343171] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-16T17:55:43.574944] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-09-16T17:55:44.224027] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-16T17:55:44.374886] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-09-16T17:55:45.174958] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-09-16T17:55:45.437848] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-16T17:55:45.570041] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-16T17:55:45.974948] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-09-16T17:55:46.478545] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-16T17:55:46.774929] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-09-16T17:55:47.324725] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-16T17:55:47.574898] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-09-16T17:55:48.346440] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-16T17:55:48.374845] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-09-16T17:55:49.124630] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-16T17:55:49.131348] [INFO ] [REMOTE ] CRH: Full fetch complete (58153 records). [2025-09-16T17:55:49.131492] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-09-16T17:55:49.186851] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-09-16T17:55:49.535783] [DEBUG] [VALIDATOR ] CRH: All expected trading days are present. [2025-09-16T17:55:49.535882] [DEBUG] [VALIDATOR ] CRH: Primary data validation passed. [2025-09-16T17:55:49.537065] [INFO ] [MAIN ] CRH: Fetched primary data is valid. [2025-09-16T17:55:49.537130] [DEBUG] [LOCAL ] CRH: Saving primary data. [2025-09-16T17:55:49.538449] [DEBUG] [LOCAL ] CRH: Trimmed 58153 records to 39829 (keeping 150 days of data) [2025-09-16T17:55:49.792490] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-16T17:55:49.835187] [DEBUG] [LOCAL ] CRH: Primary data saved (39829 records). [2025-09-16T17:55:49.835332] [INFO ] [MAIN ] CRH: Full history saved. [2025-09-16T17:55:49.835418] [INFO ] [MAIN ] Update Progress: 530/2369 symbols completed. CRH took 24.7s. Estimated remaining: 3h 13m 33s. Rate: 9.5 symbols/min [2025-09-16T17:55:49.982626] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-09-16T17:55:50.012935] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:55:50.050072] [DEBUG] [LOCAL ] CRM: Loaded 39730 existing records from primary storage. [2025-09-16T17:55:50.050206] [INFO ] [MAIN ] CRM: Loaded 39730 existing records. [2025-09-16T17:55:50.227834] [WARN ] [MAIN ] CRM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:55:50.228086] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-09-16T17:55:50.228139] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-09-16T17:55:50.229044] [DEBUG] [LOCAL ] CRM: Deleted primary data file. [2025-09-16T17:55:50.229092] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-09-16T17:55:50.599129] [INFO ] [REMOTE ] CRM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:55:50.631156] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-16T17:55:50.774951] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-09-16T17:55:51.152669] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-16T17:55:51.158081] [INFO ] [REMOTE ] CRI: Full fetch complete (53813 records). [2025-09-16T17:55:51.158183] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-09-16T17:55:51.158780] [FATAL] [VALIDATOR ] CRI: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:55:51.158857] [FATAL] [MAIN ] CRI: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:55:51.158913] [WARN ] [MAIN ] CRI: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:55:51.158987] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-09-16T17:55:51.159065] [DEBUG] [LOCAL ] CRI: No primary data file found to delete. [2025-09-16T17:55:51.159119] [INFO ] [LOCAL ] CRI: Starting deletion of derivative data. [2025-09-16T17:55:51.159531] [DEBUG] [LOCAL ] CRI: Deleted derivative data file. [2025-09-16T17:55:51.159657] [INFO ] [MAIN ] Update Progress: 531/2369 symbols completed. CRI took 21.7s. Estimated remaining: 3h 13m 9s. Rate: 9.5 symbols/min [2025-09-16T17:55:51.336138] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:55:51.370863] [DEBUG] [LOCAL ] CRS: Loaded 32032 existing records from primary storage. [2025-09-16T17:55:51.370999] [INFO ] [MAIN ] CRS: Loaded 32032 existing records. [2025-09-16T17:55:51.551389] [WARN ] [MAIN ] CRS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:55:51.551635] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-09-16T17:55:51.551700] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-09-16T17:55:51.552341] [DEBUG] [LOCAL ] CRS: Deleted primary data file. [2025-09-16T17:55:51.552387] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-09-16T17:55:51.580018] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-09-16T17:55:51.919094] [INFO ] [REMOTE ] CRS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:55:52.374893] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-09-16T17:55:52.874674] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-16T17:55:53.017440] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-16T17:55:53.024775] [INFO ] [REMOTE ] CRK: Full fetch complete (56638 records). [2025-09-16T17:55:53.024899] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-09-16T17:55:53.179982] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-09-16T17:55:53.412319] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-09-16T17:55:53.412412] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-09-16T17:55:53.413114] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-09-16T17:55:53.413185] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-09-16T17:55:53.414728] [DEBUG] [LOCAL ] CRK: Trimmed 56638 records to 38747 (keeping 150 days of data) [2025-09-16T17:55:53.644750] [DEBUG] [LOCAL ] CRK: Primary data saved (38747 records). [2025-09-16T17:55:53.644912] [INFO ] [MAIN ] CRK: Full history saved. [2025-09-16T17:55:53.645893] [INFO ] [MAIN ] Update Progress: 532/2369 symbols completed. CRK took 22.3s. Estimated remaining: 3h 12m 50s. Rate: 9.5 symbols/min [2025-09-16T17:55:53.818983] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:55:53.826086] [DEBUG] [LOCAL ] CRT: Loaded 3442 existing records from primary storage. [2025-09-16T17:55:53.826212] [INFO ] [MAIN ] CRT: Loaded 3442 existing records. [2025-09-16T17:55:53.951019] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-16T17:55:53.984477] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-09-16T17:55:54.037630] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:55:54.037880] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-09-16T17:55:54.037928] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-09-16T17:55:54.038140] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-09-16T17:55:54.038197] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-09-16T17:55:54.390841] [INFO ] [REMOTE ] CRT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:55:54.774894] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-09-16T17:55:54.821885] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-16T17:55:55.574917] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-09-16T17:55:55.889032] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-16T17:55:56.102311] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-16T17:55:56.374913] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-09-16T17:55:57.022035] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-16T17:55:57.174909] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-09-16T17:55:57.974917] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-09-16T17:55:58.420992] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-16T17:55:58.670428] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-16T17:55:58.774848] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-09-16T17:55:59.485292] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-16T17:55:59.574953] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-09-16T17:56:00.302725] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-16T17:56:00.374951] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-09-16T17:56:01.178691] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-09-16T17:56:01.179478] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-16T17:56:01.597439] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (2.82 seconds). [2025-09-16T17:56:01.974924] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-09-16T17:56:02.775226] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-16T17:56:02.775292] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-09-16T17:56:03.574907] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-09-16T17:56:04.385102] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-09-16T17:56:04.390237] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-09-16T17:56:04.523767] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-16T17:56:04.564111] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-16T17:56:05.174913] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-09-16T17:56:05.974900] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-09-16T17:56:06.285848] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-16T17:56:06.774899] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-09-16T17:56:07.459612] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-16T17:56:07.574947] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-09-16T17:56:07.860607] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-16T17:56:08.157042] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-16T17:56:08.374882] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-09-16T17:56:08.462628] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-16T17:56:08.979214] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-16T17:56:09.174956] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-09-16T17:56:09.974922] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-09-16T17:56:10.748280] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-16T17:56:10.774947] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-09-16T17:56:11.542620] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-16T17:56:11.574905] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-09-16T17:56:11.996290] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-16T17:56:12.221315] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-16T17:56:12.374907] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-09-16T17:56:13.174886] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-09-16T17:56:13.326714] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-16T17:56:13.328037] [INFO ] [REMOTE ] CRT: Full fetch complete (5425 records). [2025-09-16T17:56:13.328106] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-09-16T17:56:13.710408] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-09-16T17:56:13.710521] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-09-16T17:56:13.710714] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-09-16T17:56:13.710760] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-09-16T17:56:13.711157] [DEBUG] [LOCAL ] CRT: Trimmed 5425 records to 3500 (keeping 150 days of data) [2025-09-16T17:56:13.733186] [DEBUG] [LOCAL ] CRT: Primary data saved (3500 records). [2025-09-16T17:56:13.733293] [INFO ] [MAIN ] CRT: Full history saved. [2025-09-16T17:56:13.733385] [INFO ] [MAIN ] Update Progress: 533/2369 symbols completed. CRT took 20.1s. Estimated remaining: 3h 13m 31s. Rate: 9.5 symbols/min [2025-09-16T17:56:13.914727] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:56:13.949003] [DEBUG] [LOCAL ] CSAN: Loaded 31174 existing records from primary storage. [2025-09-16T17:56:13.949145] [INFO ] [MAIN ] CSAN: Loaded 31174 existing records. [2025-09-16T17:56:13.982724] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-09-16T17:56:14.139359] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:56:14.139603] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-09-16T17:56:14.139675] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-09-16T17:56:14.140394] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-09-16T17:56:14.140445] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-09-16T17:56:14.526049] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:56:14.629163] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-16T17:56:14.774858] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-09-16T17:56:15.574934] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-09-16T17:56:16.068502] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-16T17:56:16.078735] [INFO ] [REMOTE ] CRM: Full fetch complete (58058 records). [2025-09-16T17:56:16.078955] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-09-16T17:56:16.082009] [FATAL] [VALIDATOR ] CRM: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:56:16.082150] [FATAL] [MAIN ] CRM: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:56:16.082203] [WARN ] [MAIN ] CRM: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:56:16.082276] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-09-16T17:56:16.082379] [DEBUG] [LOCAL ] CRM: No primary data file found to delete. [2025-09-16T17:56:16.082434] [INFO ] [LOCAL ] CRM: Starting deletion of derivative data. [2025-09-16T17:56:16.082792] [DEBUG] [LOCAL ] CRM: Deleted derivative data file. [2025-09-16T17:56:16.082952] [INFO ] [MAIN ] Update Progress: 534/2369 symbols completed. CRM took 26.2s. Estimated remaining: 3h 13m 11s. Rate: 9.5 symbols/min [2025-09-16T17:56:16.274432] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:56:16.298117] [DEBUG] [LOCAL ] CSL: Loaded 22192 existing records from primary storage. [2025-09-16T17:56:16.298283] [INFO ] [MAIN ] CSL: Loaded 22192 existing records. [2025-09-16T17:56:16.379960] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-09-16T17:56:16.486820] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:56:16.487192] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-09-16T17:56:16.487305] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-09-16T17:56:16.493013] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-09-16T17:56:16.499301] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-09-16T17:56:16.560344] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-16T17:56:16.614129] [INFO ] [REMOTE ] CRS: Full fetch complete (47441 records). [2025-09-16T17:56:16.634992] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-09-16T17:56:17.123448] [INFO ] [REMOTE ] CSL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:56:17.184444] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-09-16T17:56:17.287504] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-09-16T17:56:17.287667] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-09-16T17:56:17.288320] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-09-16T17:56:17.288421] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-09-16T17:56:17.303083] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-16T17:56:17.308288] [DEBUG] [LOCAL ] CRS: Trimmed 47441 records to 32329 (keeping 150 days of data) [2025-09-16T17:56:17.309620] [INFO ] [REMOTE ] CRL: Full fetch complete (48230 records). [2025-09-16T17:56:17.309735] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-09-16T17:56:17.807362] [DEBUG] [VALIDATOR ] CRL: All expected trading days are present. [2025-09-16T17:56:17.807900] [DEBUG] [VALIDATOR ] CRL: Primary data validation passed. [2025-09-16T17:56:17.809269] [INFO ] [MAIN ] CRL: Fetched primary data is valid. [2025-09-16T17:56:17.809626] [DEBUG] [LOCAL ] CRL: Saving primary data. [2025-09-16T17:56:17.813047] [DEBUG] [LOCAL ] CRL: Trimmed 48230 records to 31389 (keeping 150 days of data) [2025-09-16T17:56:18.122417] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-16T17:56:18.135091] [DEBUG] [LOCAL ] CRS: Primary data saved (32329 records). [2025-09-16T17:56:18.134758] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-09-16T17:56:18.137539] [INFO ] [MAIN ] CRS: Full history saved. [2025-09-16T17:56:18.138371] [INFO ] [MAIN ] Update Progress: 535/2369 symbols completed. CRS took 27.0s. Estimated remaining: 3h 12m 50s. Rate: 9.5 symbols/min [2025-09-16T17:56:18.187450] [DEBUG] [LOCAL ] CRL: Primary data saved (31389 records). [2025-09-16T17:56:18.212370] [INFO ] [MAIN ] CRL: Full history saved. [2025-09-16T17:56:18.241286] [INFO ] [MAIN ] Update Progress: 536/2369 symbols completed. CRL took 38.1s. Estimated remaining: 3h 12m 22s. Rate: 9.5 symbols/min [2025-09-16T17:56:18.408232] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:56:18.513443] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:56:18.517789] [DEBUG] [LOCAL ] CSR: Loaded 9476 existing records from primary storage. [2025-09-16T17:56:18.517960] [INFO ] [MAIN ] CSR: Loaded 9476 existing records. [2025-09-16T17:56:18.661191] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-16T17:56:18.742682] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:56:18.752991] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-09-16T17:56:18.753062] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-09-16T17:56:18.753542] [DEBUG] [LOCAL ] CSTM: Loaded 34900 existing records from primary storage. [2025-09-16T17:56:18.753664] [INFO ] [MAIN ] CSTM: Loaded 34900 existing records. [2025-09-16T17:56:18.783977] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-09-16T17:56:18.789545] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-09-16T17:56:18.816919] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-09-16T17:56:19.106393] [WARN ] [MAIN ] CSTM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:56:19.204988] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-09-16T17:56:19.216922] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-09-16T17:56:19.243110] [DEBUG] [LOCAL ] CSTM: Deleted primary data file. [2025-09-16T17:56:19.243206] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-09-16T17:56:19.441149] [INFO ] [REMOTE ] CSR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:56:19.579098] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-09-16T17:56:19.682827] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:56:19.707111] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-16T17:56:20.184498] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-16T17:56:20.257028] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-16T17:56:20.374905] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-09-16T17:56:21.174905] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-09-16T17:56:21.285979] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-16T17:56:21.974899] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-09-16T17:56:22.774903] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-09-16T17:56:22.968945] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-16T17:56:23.352317] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-16T17:56:23.574920] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-09-16T17:56:23.718133] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-16T17:56:24.374947] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-09-16T17:56:25.113681] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-16T17:56:25.174890] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-09-16T17:56:25.693414] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-16T17:56:25.974901] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-09-16T17:56:26.774883] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-09-16T17:56:26.834572] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-16T17:56:26.853051] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-16T17:56:27.574925] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-09-16T17:56:28.208490] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-16T17:56:28.241301] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-16T17:56:28.374905] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-09-16T17:56:29.174907] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-09-16T17:56:29.785022] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-16T17:56:29.974921] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-09-16T17:56:30.699602] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-16T17:56:30.774878] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-09-16T17:56:31.441182] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-16T17:56:31.574896] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-09-16T17:56:32.374929] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-09-16T17:56:32.414166] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-16T17:56:32.970327] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-16T17:56:33.167868] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-16T17:56:33.174834] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-09-16T17:56:33.974887] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-09-16T17:56:34.051499] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-16T17:56:34.774914] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-09-16T17:56:35.318306] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-16T17:56:35.322583] [INFO ] [REMOTE ] CSL: Full fetch complete (34290 records). [2025-09-16T17:56:35.322687] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-09-16T17:56:35.587766] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-09-16T17:56:35.721812] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-09-16T17:56:35.722096] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-16T17:56:35.722283] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-09-16T17:56:35.724617] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-09-16T17:56:35.725102] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-09-16T17:56:35.725194] [INFO ] [REMOTE ] CSR: Full fetch complete (13233 records). [2025-09-16T17:56:35.725420] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-09-16T17:56:35.824754] [DEBUG] [LOCAL ] CSL: Trimmed 34290 records to 22516 (keeping 150 days of data) [2025-09-16T17:56:36.194885] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-09-16T17:56:36.196575] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-09-16T17:56:36.198114] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-09-16T17:56:36.198173] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-09-16T17:56:36.203987] [DEBUG] [LOCAL ] CSR: Trimmed 13233 records to 9535 (keeping 150 days of data) [2025-09-16T17:56:36.279137] [DEBUG] [LOCAL ] CSR: Primary data saved (9535 records). [2025-09-16T17:56:36.279317] [INFO ] [MAIN ] CSR: Full history saved. [2025-09-16T17:56:36.286082] [INFO ] [MAIN ] Update Progress: 537/2369 symbols completed. CSR took 18.1s. Estimated remaining: 3h 12m 56s. Rate: 9.5 symbols/min [2025-09-16T17:56:36.381214] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-09-16T17:56:36.375967] [DEBUG] [LOCAL ] CSL: Primary data saved (22516 records). [2025-09-16T17:56:36.386805] [INFO ] [MAIN ] CSL: Full history saved. [2025-09-16T17:56:36.386946] [INFO ] [MAIN ] Update Progress: 538/2369 symbols completed. CSL took 20.3s. Estimated remaining: 3h 12m 29s. Rate: 9.5 symbols/min [2025-09-16T17:56:36.590043] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:56:36.650012] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:56:36.652522] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-09-16T17:56:36.652611] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-09-16T17:56:36.652764] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-09-16T17:56:36.652846] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-16T17:56:36.652896] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-09-16T17:56:36.652932] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-09-16T17:56:36.758831] [DEBUG] [LOCAL ] CSV: Loaded 8876 existing records from primary storage. [2025-09-16T17:56:36.758989] [INFO ] [MAIN ] CSV: Loaded 8876 existing records. [2025-09-16T17:56:37.120436] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:56:37.124089] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-09-16T17:56:37.124169] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-09-16T17:56:37.140085] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-09-16T17:56:37.164373] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-09-16T17:56:37.222548] [INFO ] [REMOTE ] CSW: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:56:37.258529] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-02. [2025-09-16T17:56:37.537255] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:56:37.587591] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-16T17:56:37.590973] [WARN ] [REMOTE ] CSW: No data returned for month 2025-02 [2025-09-16T17:56:37.590851] [INFO ] [REMOTE ] CSV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:56:37.974902] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-09-16T17:56:38.231295] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-16T17:56:38.774885] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-03. [2025-09-16T17:56:38.969370] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:56:38.969697] [WARN ] [REMOTE ] CSW: No data returned for month 2025-03 [2025-09-16T17:56:39.034359] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-16T17:56:39.574919] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-09-16T17:56:40.374934] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-09-16T17:56:41.176674] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-04. [2025-09-16T17:56:41.182963] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-16T17:56:41.384241] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:56:41.384553] [WARN ] [REMOTE ] CSW: No data returned for month 2025-04 [2025-09-16T17:56:41.961526] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-16T17:56:41.974848] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-09-16T17:56:42.774933] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-09-16T17:56:43.420006] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-16T17:56:43.574895] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-05. [2025-09-16T17:56:43.791255] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:56:43.791554] [WARN ] [REMOTE ] CSW: No data returned for month 2025-05 [2025-09-16T17:56:44.374933] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-06. [2025-09-16T17:56:44.473267] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-16T17:56:44.481404] [INFO ] [REMOTE ] CSTM: Full fetch complete (52206 records). [2025-09-16T17:56:44.481572] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-09-16T17:56:44.878544] [DEBUG] [VALIDATOR ] CSTM: All expected trading days are present. [2025-09-16T17:56:44.878625] [DEBUG] [VALIDATOR ] CSTM: Primary data validation passed. [2025-09-16T17:56:44.879282] [INFO ] [MAIN ] CSTM: Fetched primary data is valid. [2025-09-16T17:56:44.879327] [DEBUG] [LOCAL ] CSTM: Saving primary data. [2025-09-16T17:56:44.880385] [DEBUG] [LOCAL ] CSTM: Trimmed 52206 records to 35217 (keeping 150 days of data) [2025-09-16T17:56:44.977625] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-16T17:56:45.096681] [DEBUG] [LOCAL ] CSTM: Primary data saved (35217 records). [2025-09-16T17:56:45.096830] [INFO ] [MAIN ] CSTM: Full history saved. [2025-09-16T17:56:45.097713] [INFO ] [MAIN ] Update Progress: 539/2369 symbols completed. CSTM took 26.8s. Estimated remaining: 3h 12m 30s. Rate: 9.5 symbols/min [2025-09-16T17:56:45.180008] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-09-16T17:56:45.287727] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:56:45.297020] [DEBUG] [LOCAL ] CTBB: Loaded 4787 existing records from primary storage. [2025-09-16T17:56:45.297178] [INFO ] [MAIN ] CTBB: Loaded 4787 existing records. [2025-09-16T17:56:45.469999] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:56:45.470232] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-09-16T17:56:45.470278] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-09-16T17:56:45.470517] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-09-16T17:56:45.470560] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-09-16T17:56:45.817802] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:56:45.974900] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-07. [2025-09-16T17:56:46.774940] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-09-16T17:56:46.891825] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-16T17:56:46.938146] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-16T17:56:47.574924] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-09-16T17:56:47.588300] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-16T17:56:48.265083] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-16T17:56:48.374874] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-08. [2025-09-16T17:56:49.174895] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-09-16T17:56:49.314836] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-16T17:56:49.974875] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-09. [2025-09-16T17:56:50.051661] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-16T17:56:50.707633] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-16T17:56:50.709967] [INFO ] [REMOTE ] CSW: Full fetch complete (7329 records). [2025-09-16T17:56:50.710036] [DEBUG] [VALIDATOR ] CSW: Validating primary data. [2025-09-16T17:56:50.780014] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-09-16T17:56:50.893005] [WARN ] [VALIDATOR ] CSW: Validation failed - insufficient historical data. Have 69 unique days, need 150 days [2025-09-16T17:56:50.893213] [FATAL] [MAIN ] CSW: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:56:50.893265] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:56:50.893314] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-16T17:56:50.893371] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-09-16T17:56:50.893408] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-09-16T17:56:50.893450] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-09-16T17:56:50.893508] [INFO ] [MAIN ] Update Progress: 540/2369 symbols completed. CSW took 14.5s. Estimated remaining: 3h 12m 22s. Rate: 9.5 symbols/min [2025-09-16T17:56:51.063871] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:56:51.069089] [DEBUG] [LOCAL ] CTDD: Loaded 3783 existing records from primary storage. [2025-09-16T17:56:51.069198] [INFO ] [MAIN ] CTDD: Loaded 3783 existing records. [2025-09-16T17:56:51.246369] [WARN ] [MAIN ] CTDD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:56:51.246621] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-09-16T17:56:51.246696] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-09-16T17:56:51.246972] [DEBUG] [LOCAL ] CTDD: Deleted primary data file. [2025-09-16T17:56:51.247021] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-09-16T17:56:51.597658] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-09-16T17:56:51.602255] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:56:51.645017] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-16T17:56:52.374905] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-09-16T17:56:53.174869] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-09-16T17:56:53.204210] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-16T17:56:53.220970] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-16T17:56:53.226082] [INFO ] [REMOTE ] CSAN: Full fetch complete (45489 records). [2025-09-16T17:56:53.226167] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-09-16T17:56:53.603483] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-09-16T17:56:53.603601] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-09-16T17:56:53.604203] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-09-16T17:56:53.604250] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-09-16T17:56:53.605159] [DEBUG] [LOCAL ] CSAN: Trimmed 45489 records to 31504 (keeping 150 days of data) [2025-09-16T17:56:53.788547] [DEBUG] [LOCAL ] CSAN: Primary data saved (31504 records). [2025-09-16T17:56:53.788702] [INFO ] [MAIN ] CSAN: Full history saved. [2025-09-16T17:56:53.788806] [INFO ] [MAIN ] Update Progress: 541/2369 symbols completed. CSAN took 40.1s. Estimated remaining: 3h 12m 5s. Rate: 9.5 symbols/min [2025-09-16T17:56:53.959504] [INFO ] [MAIN ] CTEST: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:56:53.959813] [DEBUG] [LOCAL ] CTEST: No existing data file found in primary storage. [2025-09-16T17:56:53.964130] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-16T17:56:53.963306] [WARN ] [MAIN ] CTEST: No existing data found, performing full refresh instead. [2025-09-16T17:56:53.966094] [INFO ] [MAIN ] CTEST: Wiping existing primary data before full refresh. [2025-09-16T17:56:53.966171] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-16T17:56:53.966218] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-16T17:56:53.966251] [INFO ] [MAIN ] CTEST: Starting full primary refresh. [2025-09-16T17:56:53.979936] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-09-16T17:56:54.331404] [INFO ] [REMOTE ] CTEST: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:56:54.774895] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-09-16T17:56:54.890698] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-16T17:56:55.326963] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-16T17:56:55.574895] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-02. [2025-09-16T17:56:55.891120] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:56:55.891455] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-02 [2025-09-16T17:56:56.374896] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-03. [2025-09-16T17:56:56.575740] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:56:56.575984] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-03 [2025-09-16T17:56:57.174936] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-09-16T17:56:57.792212] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-16T17:56:57.974947] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-04. [2025-09-16T17:56:58.197356] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:56:58.197685] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-04 [2025-09-16T17:56:58.774908] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-09-16T17:56:59.390544] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-16T17:56:59.574914] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-09-16T17:57:00.374857] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-05. [2025-09-16T17:57:00.435312] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-16T17:57:01.174923] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-09-16T17:57:01.182755] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-16T17:57:01.803363] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-16T17:57:01.974930] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-09-16T17:57:02.536174] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-16T17:57:02.774914] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-09-16T17:57:03.395017] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-16T17:57:03.575113] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-09-16T17:57:04.205166] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-16T17:57:04.374990] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-09-16T17:57:05.174837] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-16T17:57:05.174954] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-09-16T17:57:05.177907] [INFO ] [REMOTE ] CTBB: Full fetch complete (7893 records). [2025-09-16T17:57:05.178013] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-09-16T17:57:05.556605] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-09-16T17:57:05.556709] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-09-16T17:57:05.556911] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-09-16T17:57:05.556952] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-09-16T17:57:05.557390] [DEBUG] [LOCAL ] CTBB: Trimmed 7893 records to 4822 (keeping 150 days of data) [2025-09-16T17:57:05.590332] [DEBUG] [LOCAL ] CTBB: Primary data saved (4822 records). [2025-09-16T17:57:05.590499] [INFO ] [MAIN ] CTBB: Full history saved. [2025-09-16T17:57:05.590592] [INFO ] [MAIN ] Update Progress: 542/2369 symbols completed. CTBB took 20.5s. Estimated remaining: 3h 12m 17s. Rate: 9.5 symbols/min [2025-09-16T17:57:05.761872] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:57:05.762059] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-09-16T17:57:05.762130] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-09-16T17:57:05.762276] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-09-16T17:57:05.762316] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-16T17:57:05.762356] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-09-16T17:57:05.762389] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-09-16T17:57:05.980141] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-06. [2025-09-16T17:57:06.062073] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-16T17:57:06.125717] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:57:06.453783] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-16T17:57:06.774890] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-07. [2025-09-16T17:57:07.003770] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-09-16T17:57:07.575094] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-08. [2025-09-16T17:57:07.768310] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:57:07.768605] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-08 [2025-09-16T17:57:08.374903] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-09. [2025-09-16T17:57:08.683058] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T17:57:08.683367] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-09 [2025-09-16T17:57:08.683451] [INFO ] [REMOTE ] CTEST: Full fetch complete (1020 records). [2025-09-16T17:57:08.683512] [DEBUG] [VALIDATOR ] CTEST: Validating primary data. [2025-09-16T17:57:08.684156] [FATAL] [VALIDATOR ] CTEST: Data is stale - most recent date (2025-07-02) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:57:08.684228] [FATAL] [MAIN ] CTEST: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:57:08.684271] [WARN ] [MAIN ] CTEST: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:57:08.684315] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-16T17:57:08.684371] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-16T17:57:08.684407] [INFO ] [LOCAL ] CTEST: Starting deletion of derivative data. [2025-09-16T17:57:08.684462] [DEBUG] [LOCAL ] CTEST: No derivative data file found to delete. [2025-09-16T17:57:08.684521] [INFO ] [MAIN ] Update Progress: 543/2369 symbols completed. CTEST took 14.9s. Estimated remaining: 3h 11m 60s. Rate: 9.5 symbols/min [2025-09-16T17:57:08.894930] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:57:08.914310] [DEBUG] [LOCAL ] CTO: Loaded 19381 existing records from primary storage. [2025-09-16T17:57:08.914468] [INFO ] [MAIN ] CTO: Loaded 19381 existing records. [2025-09-16T17:57:09.090293] [WARN ] [MAIN ] CTO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:57:09.090533] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-09-16T17:57:09.090579] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-09-16T17:57:09.091170] [DEBUG] [LOCAL ] CTO: Deleted primary data file. [2025-09-16T17:57:09.091219] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-09-16T17:57:09.180119] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-09-16T17:57:09.449380] [INFO ] [REMOTE ] CTO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:57:09.756421] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-16T17:57:09.974914] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-09-16T17:57:10.582492] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-16T17:57:10.774913] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-09-16T17:57:11.529639] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-16T17:57:11.530878] [INFO ] [REMOTE ] CTDD: Full fetch complete (6241 records). [2025-09-16T17:57:11.530946] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-09-16T17:57:11.583855] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-09-16T17:57:11.887156] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-09-16T17:57:11.887236] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-09-16T17:57:11.887423] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-09-16T17:57:11.887462] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-09-16T17:57:11.887865] [DEBUG] [LOCAL ] CTDD: Trimmed 6241 records to 3822 (keeping 150 days of data) [2025-09-16T17:57:11.911806] [DEBUG] [LOCAL ] CTDD: Primary data saved (3822 records). [2025-09-16T17:57:11.911903] [INFO ] [MAIN ] CTDD: Full history saved. [2025-09-16T17:57:11.911991] [INFO ] [MAIN ] Update Progress: 544/2369 symbols completed. CTDD took 21.0s. Estimated remaining: 3h 11m 43s. Rate: 9.5 symbols/min [2025-09-16T17:57:12.086313] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:57:12.111588] [DEBUG] [LOCAL ] CTOS: Loaded 26642 existing records from primary storage. [2025-09-16T17:57:12.111752] [INFO ] [MAIN ] CTOS: Loaded 26642 existing records. [2025-09-16T17:57:12.294858] [WARN ] [MAIN ] CTOS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:57:12.295117] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-09-16T17:57:12.295171] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-09-16T17:57:12.295810] [DEBUG] [LOCAL ] CTOS: Deleted primary data file. [2025-09-16T17:57:12.295872] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-09-16T17:57:12.380062] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-02. [2025-09-16T17:57:12.675091] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:57:13.090104] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-16T17:57:13.090981] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-16T17:57:13.174865] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-03. [2025-09-16T17:57:13.899462] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-16T17:57:13.974871] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-04. [2025-09-16T17:57:14.749033] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-16T17:57:14.774850] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-05. [2025-09-16T17:57:15.537962] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-16T17:57:15.574850] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-06. [2025-09-16T17:57:16.374902] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-09-16T17:57:16.465823] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-16T17:57:17.012790] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-16T17:57:17.174898] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-09-16T17:57:17.974895] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-09-16T17:57:18.532938] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-16T17:57:18.774906] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-09-16T17:57:19.517962] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-16T17:57:19.574855] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-09-16T17:57:20.280397] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-16T17:57:20.374883] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-09-16T17:57:20.974117] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-16T17:57:21.174915] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-07. [2025-09-16T17:57:21.669144] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-16T17:57:21.770958] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-16T17:57:21.974898] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-08. [2025-09-16T17:57:22.774898] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-09-16T17:57:22.848973] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-16T17:57:23.574916] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-09-16T17:57:24.151915] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-16T17:57:24.374910] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-09. [2025-09-16T17:57:25.156725] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-16T17:57:25.174843] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-09-16T17:57:25.375526] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-16T17:57:25.377516] [INFO ] [REMOTE ] CTEV: Full fetch complete (13025 records). [2025-09-16T17:57:25.377598] [DEBUG] [VALIDATOR ] CTEV: Validating primary data. [2025-09-16T17:57:25.596397] [WARN ] [VALIDATOR ] CTEV: Validation failed - insufficient historical data. Have 138 unique days, need 150 days [2025-09-16T17:57:25.596680] [FATAL] [MAIN ] CTEV: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:57:25.596729] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:57:25.596773] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-16T17:57:25.596830] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-09-16T17:57:25.596865] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-09-16T17:57:25.596904] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-09-16T17:57:25.596966] [INFO ] [MAIN ] Update Progress: 545/2369 symbols completed. CTEV took 20.0s. Estimated remaining: 3h 12m 1s. Rate: 9.5 symbols/min [2025-09-16T17:57:25.778833] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:57:25.819674] [DEBUG] [LOCAL ] CTRA: Loaded 39612 existing records from primary storage. [2025-09-16T17:57:25.819838] [INFO ] [MAIN ] CTRA: Loaded 39612 existing records. [2025-09-16T17:57:25.978138] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-09-16T17:57:25.999858] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:57:26.000117] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-09-16T17:57:26.000167] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-09-16T17:57:26.001096] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-09-16T17:57:26.001156] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-09-16T17:57:26.356670] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:57:26.426741] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-16T17:57:26.653890] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-16T17:57:26.774952] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-09-16T17:57:27.574884] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-09-16T17:57:27.890614] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-16T17:57:28.374937] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-09-16T17:57:29.174934] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-09-16T17:57:29.395943] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-16T17:57:29.504600] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-16T17:57:29.506730] [INFO ] [REMOTE ] CSV: Full fetch complete (14401 records). [2025-09-16T17:57:29.506808] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-09-16T17:57:29.886723] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-09-16T17:57:29.886807] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-09-16T17:57:29.887174] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-09-16T17:57:29.887238] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-09-16T17:57:29.887769] [DEBUG] [LOCAL ] CSV: Trimmed 14401 records to 8953 (keeping 150 days of data) [2025-09-16T17:57:29.942591] [DEBUG] [LOCAL ] CSV: Primary data saved (8953 records). [2025-09-16T17:57:29.942746] [INFO ] [MAIN ] CSV: Full history saved. [2025-09-16T17:57:29.942834] [INFO ] [MAIN ] Update Progress: 546/2369 symbols completed. CSV took 53.7s. Estimated remaining: 3h 11m 48s. Rate: 9.5 symbols/min [2025-09-16T17:57:29.979968] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-09-16T17:57:30.130429] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:57:30.169132] [DEBUG] [LOCAL ] CTRE: Loaded 36257 existing records from primary storage. [2025-09-16T17:57:30.169276] [INFO ] [MAIN ] CTRE: Loaded 36257 existing records. [2025-09-16T17:57:30.357307] [WARN ] [MAIN ] CTRE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:57:30.357569] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-09-16T17:57:30.357617] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-09-16T17:57:30.358454] [DEBUG] [LOCAL ] CTRE: Deleted primary data file. [2025-09-16T17:57:30.358503] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-09-16T17:57:30.728397] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:57:30.745368] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-16T17:57:30.774846] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-09-16T17:57:31.574866] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-09-16T17:57:31.757829] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-16T17:57:31.975397] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-16T17:57:32.374925] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-09-16T17:57:33.103587] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-16T17:57:33.174878] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-09-16T17:57:33.974908] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-09-16T17:57:34.203299] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-16T17:57:34.774930] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-09-16T17:57:34.921570] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-16T17:57:35.330244] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-16T17:57:35.333807] [INFO ] [REMOTE ] CTO: Full fetch complete (31266 records). [2025-09-16T17:57:35.333910] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-09-16T17:57:35.581772] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-09-16T17:57:35.718349] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present. [2025-09-16T17:57:35.718427] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed. [2025-09-16T17:57:35.718979] [INFO ] [MAIN ] CTO: Fetched primary data is valid. [2025-09-16T17:57:35.719045] [DEBUG] [LOCAL ] CTO: Saving primary data. [2025-09-16T17:57:35.719808] [DEBUG] [LOCAL ] CTO: Trimmed 31266 records to 19613 (keeping 150 days of data) [2025-09-16T17:57:35.839151] [DEBUG] [LOCAL ] CTO: Primary data saved (19613 records). [2025-09-16T17:57:35.839293] [INFO ] [MAIN ] CTO: Full history saved. [2025-09-16T17:57:35.839395] [INFO ] [MAIN ] Update Progress: 547/2369 symbols completed. CTO took 27.2s. Estimated remaining: 3h 11m 41s. Rate: 9.5 symbols/min [2025-09-16T17:57:36.020865] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:57:36.047896] [DEBUG] [LOCAL ] CTRI: Loaded 29026 existing records from primary storage. [2025-09-16T17:57:36.048058] [INFO ] [MAIN ] CTRI: Loaded 29026 existing records. [2025-09-16T17:57:36.235275] [WARN ] [MAIN ] CTRI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:57:36.235513] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-09-16T17:57:36.235563] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-09-16T17:57:36.236249] [DEBUG] [LOCAL ] CTRI: Deleted primary data file. [2025-09-16T17:57:36.236306] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-09-16T17:57:36.385202] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-09-16T17:57:36.607913] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:57:36.733140] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-16T17:57:37.088596] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-16T17:57:37.174887] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-09-16T17:57:37.974916] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-09-16T17:57:38.041457] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-16T17:57:38.555240] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-16T17:57:38.774906] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-09-16T17:57:39.560916] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-16T17:57:39.574846] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-09-16T17:57:40.374900] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-09-16T17:57:40.446419] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-16T17:57:41.174916] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-09-16T17:57:41.392391] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-16T17:57:41.852716] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-16T17:57:41.974897] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-09-16T17:57:42.780077] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-09-16T17:57:42.799263] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-16T17:57:42.835530] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-16T17:57:42.839669] [INFO ] [REMOTE ] CTOS: Full fetch complete (39810 records). [2025-09-16T17:57:42.839751] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-09-16T17:57:43.207453] [DEBUG] [VALIDATOR ] CTOS: All expected trading days are present. [2025-09-16T17:57:43.207530] [DEBUG] [VALIDATOR ] CTOS: Primary data validation passed. [2025-09-16T17:57:43.208088] [INFO ] [MAIN ] CTOS: Fetched primary data is valid. [2025-09-16T17:57:43.208132] [DEBUG] [LOCAL ] CTOS: Saving primary data. [2025-09-16T17:57:43.209040] [DEBUG] [LOCAL ] CTOS: Trimmed 39810 records to 26856 (keeping 150 days of data) [2025-09-16T17:57:43.361074] [DEBUG] [LOCAL ] CTOS: Primary data saved (26856 records). [2025-09-16T17:57:43.361220] [INFO ] [MAIN ] CTOS: Full history saved. [2025-09-16T17:57:43.361314] [INFO ] [MAIN ] Update Progress: 548/2369 symbols completed. CTOS took 31.4s. Estimated remaining: 3h 11m 38s. Rate: 9.5 symbols/min [2025-09-16T17:57:43.527892] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:57:43.542112] [DEBUG] [LOCAL ] CTS: Loaded 13778 existing records from primary storage. [2025-09-16T17:57:43.542250] [INFO ] [MAIN ] CTS: Loaded 13778 existing records. [2025-09-16T17:57:43.584435] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-09-16T17:57:43.718812] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:57:43.719058] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-09-16T17:57:43.719112] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-09-16T17:57:43.719588] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-09-16T17:57:43.719635] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-09-16T17:57:44.065679] [INFO ] [REMOTE ] CTS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:57:44.106831] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-16T17:57:44.374896] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-09-16T17:57:45.174905] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-09-16T17:57:45.317903] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-16T17:57:45.658075] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-16T17:57:45.974905] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-09-16T17:57:46.774930] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-09-16T17:57:46.963248] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-16T17:57:47.170747] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-16T17:57:47.176796] [INFO ] [REMOTE ] CTRE: Full fetch complete (53472 records). [2025-09-16T17:57:47.176940] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-09-16T17:57:47.574973] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-09-16T17:57:47.589832] [DEBUG] [VALIDATOR ] CTRE: All expected trading days are present. [2025-09-16T17:57:47.589896] [DEBUG] [VALIDATOR ] CTRE: Primary data validation passed. [2025-09-16T17:57:47.590606] [INFO ] [MAIN ] CTRE: Fetched primary data is valid. [2025-09-16T17:57:47.590669] [DEBUG] [LOCAL ] CTRE: Saving primary data. [2025-09-16T17:57:47.592729] [DEBUG] [LOCAL ] CTRE: Trimmed 53472 records to 36634 (keeping 150 days of data) [2025-09-16T17:57:47.806542] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-16T17:57:47.840254] [DEBUG] [LOCAL ] CTRE: Primary data saved (36634 records). [2025-09-16T17:57:47.840391] [INFO ] [MAIN ] CTRE: Full history saved. [2025-09-16T17:57:47.840478] [INFO ] [MAIN ] Update Progress: 549/2369 symbols completed. CTRE took 17.9s. Estimated remaining: 3h 11m 26s. Rate: 9.5 symbols/min [2025-09-16T17:57:48.021196] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:57:48.061818] [DEBUG] [LOCAL ] CTVA: Loaded 39324 existing records from primary storage. [2025-09-16T17:57:48.061970] [INFO ] [MAIN ] CTVA: Loaded 39324 existing records. [2025-09-16T17:57:48.252018] [WARN ] [MAIN ] CTVA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:57:48.252266] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-09-16T17:57:48.252321] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-09-16T17:57:48.253279] [DEBUG] [LOCAL ] CTVA: Deleted primary data file. [2025-09-16T17:57:48.253329] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-09-16T17:57:48.380044] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-09-16T17:57:48.631630] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:57:49.174904] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-09-16T17:57:49.475046] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-16T17:57:49.481544] [INFO ] [REMOTE ] CTRA: Full fetch complete (58329 records). [2025-09-16T17:57:49.481633] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-09-16T17:57:49.864065] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-09-16T17:57:49.864163] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-09-16T17:57:49.864905] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-09-16T17:57:49.864962] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-09-16T17:57:49.875551] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-16T17:57:49.880107] [DEBUG] [LOCAL ] CTRA: Trimmed 58329 records to 40002 (keeping 150 days of data) [2025-09-16T17:57:49.977868] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-09-16T17:57:50.135169] [DEBUG] [LOCAL ] CTRA: Primary data saved (40002 records). [2025-09-16T17:57:50.135298] [INFO ] [MAIN ] CTRA: Full history saved. [2025-09-16T17:57:50.135999] [INFO ] [MAIN ] Update Progress: 550/2369 symbols completed. CTRA took 24.5s. Estimated remaining: 3h 11m 6s. Rate: 9.5 symbols/min [2025-09-16T17:57:50.307584] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:57:50.307848] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-09-16T17:57:50.307954] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-09-16T17:57:50.308240] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-09-16T17:57:50.308377] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-16T17:57:50.308453] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-16T17:57:50.308493] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-09-16T17:57:50.554219] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-16T17:57:50.710236] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:57:50.774887] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-09-16T17:57:51.148859] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-16T17:57:51.222000] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-16T17:57:51.574942] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-09-16T17:57:52.374936] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-09-16T17:57:52.498163] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-16T17:57:53.174922] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-09-16T17:57:53.822689] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-16T17:57:53.974877] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-09-16T17:57:54.227073] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-16T17:57:54.774909] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-09-16T17:57:55.470431] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-16T17:57:55.574881] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-09-16T17:57:55.873578] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-16T17:57:55.994330] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-16T17:57:56.374914] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-09-16T17:57:57.174905] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-09-16T17:57:57.516059] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-16T17:57:57.974961] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-09-16T17:57:58.315604] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-16T17:57:58.516492] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-16T17:57:58.774953] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-09-16T17:57:59.574925] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-09-16T17:58:00.258317] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-16T17:58:00.266284] [INFO ] [REMOTE ] CTRI: Full fetch complete (39890 records). [2025-09-16T17:58:00.266455] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-09-16T17:58:00.380027] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-09-16T17:58:00.636555] [DEBUG] [VALIDATOR ] CTRI: All expected trading days are present. [2025-09-16T17:58:00.636632] [DEBUG] [VALIDATOR ] CTRI: Primary data validation passed. [2025-09-16T17:58:00.637208] [INFO ] [MAIN ] CTRI: Fetched primary data is valid. [2025-09-16T17:58:00.637257] [DEBUG] [LOCAL ] CTRI: Saving primary data. [2025-09-16T17:58:00.638100] [DEBUG] [LOCAL ] CTRI: Trimmed 39890 records to 29346 (keeping 150 days of data) [2025-09-16T17:58:00.815542] [DEBUG] [LOCAL ] CTRI: Primary data saved (29346 records). [2025-09-16T17:58:00.815761] [INFO ] [MAIN ] CTRI: Full history saved. [2025-09-16T17:58:00.815914] [INFO ] [MAIN ] Update Progress: 551/2369 symbols completed. CTRI took 25.0s. Estimated remaining: 3h 11m 15s. Rate: 9.5 symbols/min [2025-09-16T17:58:00.984619] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:58:01.022564] [DEBUG] [LOCAL ] CUBE: Loaded 37556 existing records from primary storage. [2025-09-16T17:58:01.022759] [INFO ] [MAIN ] CUBE: Loaded 37556 existing records. [2025-09-16T17:58:01.177695] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-09-16T17:58:01.200303] [WARN ] [MAIN ] CUBE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:58:01.200491] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-09-16T17:58:01.200547] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-09-16T17:58:01.201388] [DEBUG] [LOCAL ] CUBE: Deleted primary data file. [2025-09-16T17:58:01.201457] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-09-16T17:58:01.576723] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:58:01.629010] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-16T17:58:01.707368] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-16T17:58:01.723139] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-16T17:58:01.974942] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-09-16T17:58:02.774918] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-09-16T17:58:03.469881] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-16T17:58:03.487349] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-16T17:58:03.490105] [INFO ] [REMOTE ] CTS: Full fetch complete (20625 records). [2025-09-16T17:58:03.490215] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-09-16T17:58:03.580049] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-09-16T17:58:03.860958] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-09-16T17:58:03.861042] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-09-16T17:58:03.861433] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-09-16T17:58:03.861486] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-09-16T17:58:03.862116] [DEBUG] [LOCAL ] CTS: Trimmed 20625 records to 13918 (keeping 150 days of data) [2025-09-16T17:58:03.950789] [DEBUG] [LOCAL ] CTS: Primary data saved (13918 records). [2025-09-16T17:58:03.950939] [INFO ] [MAIN ] CTS: Full history saved. [2025-09-16T17:58:03.951063] [INFO ] [MAIN ] Update Progress: 552/2369 symbols completed. CTS took 20.6s. Estimated remaining: 3h 10m 58s. Rate: 9.5 symbols/min [2025-09-16T17:58:04.126700] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:58:04.148278] [DEBUG] [LOCAL ] CUBI: Loaded 19575 existing records from primary storage. [2025-09-16T17:58:04.148400] [INFO ] [MAIN ] CUBI: Loaded 19575 existing records. [2025-09-16T17:58:04.336202] [WARN ] [MAIN ] CUBI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:58:04.336467] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-09-16T17:58:04.336515] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-09-16T17:58:04.337025] [DEBUG] [LOCAL ] CUBI: Deleted primary data file. [2025-09-16T17:58:04.337085] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-09-16T17:58:04.380059] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-09-16T17:58:04.696711] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:58:04.776789] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-16T17:58:05.174880] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-09-16T17:58:05.423079] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-16T17:58:05.974918] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-09-16T17:58:06.070848] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-16T17:58:06.774918] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-09-16T17:58:07.102714] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-16T17:58:07.574899] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-09-16T17:58:07.852749] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-16T17:58:07.901935] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-16T17:58:08.374913] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-09-16T17:58:09.174865] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-09-16T17:58:09.496676] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-16T17:58:09.974934] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-09-16T17:58:10.774876] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-09-16T17:58:10.830359] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-16T17:58:11.574955] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-09-16T17:58:11.919878] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-16T17:58:12.040121] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-16T17:58:12.042979] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-16T17:58:12.044583] [INFO ] [REMOTE ] CUBB: Full fetch complete (749 records). [2025-09-16T17:58:12.044893] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-09-16T17:58:12.236835] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 138 unique days, need 150 days [2025-09-16T17:58:12.237049] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:58:12.237102] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:58:12.237151] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-16T17:58:12.237209] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-16T17:58:12.237255] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-09-16T17:58:12.237312] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-09-16T17:58:12.237375] [INFO ] [MAIN ] Update Progress: 553/2369 symbols completed. CUBB took 22.1s. Estimated remaining: 3h 10m 58s. Rate: 9.5 symbols/min [2025-09-16T17:58:12.384445] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-09-16T17:58:12.409152] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:58:12.465920] [DEBUG] [LOCAL ] CUK: Loaded 37358 existing records from primary storage. [2025-09-16T17:58:12.466102] [INFO ] [MAIN ] CUK: Loaded 37358 existing records. [2025-09-16T17:58:12.680559] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:58:12.680840] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-09-16T17:58:12.680887] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-09-16T17:58:12.681622] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-09-16T17:58:12.681702] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-09-16T17:58:13.031496] [INFO ] [REMOTE ] CUK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:58:13.174919] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-09-16T17:58:13.979984] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-09-16T17:58:13.995027] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-16T17:58:14.774918] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-09-16T17:58:14.902006] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-16T17:58:14.939038] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-16T17:58:15.574931] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-09-16T17:58:16.097525] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-16T17:58:16.374863] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-09-16T17:58:16.572793] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-16T17:58:17.174900] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-09-16T17:58:17.747590] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-16T17:58:17.974885] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-09-16T17:58:18.464923] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-16T17:58:18.774903] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-09-16T17:58:19.510939] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-16T17:58:19.574855] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-09-16T17:58:19.949116] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-16T17:58:20.374899] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-09-16T17:58:21.174888] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-09-16T17:58:21.255270] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-16T17:58:21.801231] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-16T17:58:21.974885] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-09-16T17:58:22.774870] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-09-16T17:58:22.853438] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-16T17:58:23.574870] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-09-16T17:58:23.629993] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-16T17:58:23.653696] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-16T17:58:23.657954] [INFO ] [REMOTE ] CUBI: Full fetch complete (29219 records). [2025-09-16T17:58:23.658049] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-09-16T17:58:24.025185] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present. [2025-09-16T17:58:24.025260] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed. [2025-09-16T17:58:24.025725] [INFO ] [MAIN ] CUBI: Fetched primary data is valid. [2025-09-16T17:58:24.025769] [DEBUG] [LOCAL ] CUBI: Saving primary data. [2025-09-16T17:58:24.026480] [DEBUG] [LOCAL ] CUBI: Trimmed 29219 records to 19849 (keeping 150 days of data) [2025-09-16T17:58:24.144737] [DEBUG] [LOCAL ] CUBI: Primary data saved (19849 records). [2025-09-16T17:58:24.144880] [INFO ] [MAIN ] CUBI: Full history saved. [2025-09-16T17:58:24.144968] [INFO ] [MAIN ] Update Progress: 554/2369 symbols completed. CUBI took 20.2s. Estimated remaining: 3h 11m 10s. Rate: 9.5 symbols/min [2025-09-16T17:58:24.317259] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:58:24.320852] [DEBUG] [LOCAL ] CULP: Loaded 1982 existing records from primary storage. [2025-09-16T17:58:24.320926] [INFO ] [MAIN ] CULP: Loaded 1982 existing records. [2025-09-16T17:58:24.384168] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-09-16T17:58:24.499245] [WARN ] [MAIN ] CULP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:58:24.499469] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-09-16T17:58:24.499514] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-09-16T17:58:24.499832] [DEBUG] [LOCAL ] CULP: Deleted primary data file. [2025-09-16T17:58:24.499879] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-09-16T17:58:24.853969] [INFO ] [REMOTE ] CULP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:58:25.174901] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-09-16T17:58:25.299466] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-16T17:58:25.866513] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-16T17:58:25.974890] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-09-16T17:58:26.015591] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-16T17:58:26.021593] [INFO ] [REMOTE ] CUBE: Full fetch complete (55020 records). [2025-09-16T17:58:26.021711] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-09-16T17:58:26.422994] [DEBUG] [VALIDATOR ] CUBE: All expected trading days are present. [2025-09-16T17:58:26.423072] [DEBUG] [VALIDATOR ] CUBE: Primary data validation passed. [2025-09-16T17:58:26.423739] [INFO ] [MAIN ] CUBE: Fetched primary data is valid. [2025-09-16T17:58:26.423783] [DEBUG] [LOCAL ] CUBE: Saving primary data. [2025-09-16T17:58:26.424907] [DEBUG] [LOCAL ] CUBE: Trimmed 55020 records to 37936 (keeping 150 days of data) [2025-09-16T17:58:26.657908] [DEBUG] [LOCAL ] CUBE: Primary data saved (37936 records). [2025-09-16T17:58:26.658064] [INFO ] [MAIN ] CUBE: Full history saved. [2025-09-16T17:58:26.659598] [INFO ] [MAIN ] Update Progress: 555/2369 symbols completed. CUBE took 25.8s. Estimated remaining: 3h 10m 51s. Rate: 9.5 symbols/min [2025-09-16T17:58:26.780048] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-09-16T17:58:26.829426] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:58:26.852960] [DEBUG] [LOCAL ] CURB: Loaded 23402 existing records from primary storage. [2025-09-16T17:58:26.853093] [INFO ] [MAIN ] CURB: Loaded 23402 existing records. [2025-09-16T17:58:27.027734] [WARN ] [MAIN ] CURB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:58:27.027982] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-09-16T17:58:27.028027] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-09-16T17:58:27.028615] [DEBUG] [LOCAL ] CURB: Deleted primary data file. [2025-09-16T17:58:27.028689] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-09-16T17:58:27.382999] [INFO ] [REMOTE ] CURB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:58:27.574899] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-09-16T17:58:27.629055] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-16T17:58:28.175537] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-16T17:58:28.374940] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-09-16T17:58:28.620774] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-16T17:58:28.627589] [INFO ] [REMOTE ] CTVA: Full fetch complete (57840 records). [2025-09-16T17:58:28.627742] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-09-16T17:58:29.027907] [DEBUG] [VALIDATOR ] CTVA: All expected trading days are present. [2025-09-16T17:58:29.031624] [DEBUG] [VALIDATOR ] CTVA: Primary data validation passed. [2025-09-16T17:58:29.031791] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-16T17:58:29.032498] [INFO ] [MAIN ] CTVA: Fetched primary data is valid. [2025-09-16T17:58:29.033579] [DEBUG] [LOCAL ] CTVA: Saving primary data. [2025-09-16T17:58:29.035565] [DEBUG] [LOCAL ] CTVA: Trimmed 57840 records to 39714 (keeping 150 days of data) [2025-09-16T17:58:29.223511] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-09-16T17:58:29.295607] [DEBUG] [LOCAL ] CTVA: Primary data saved (39714 records). [2025-09-16T17:58:29.295781] [INFO ] [MAIN ] CTVA: Full history saved. [2025-09-16T17:58:29.295869] [INFO ] [MAIN ] Update Progress: 556/2369 symbols completed. CTVA took 41.5s. Estimated remaining: 3h 10m 33s. Rate: 9.5 symbols/min [2025-09-16T17:58:29.468491] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:58:29.489387] [DEBUG] [LOCAL ] CURV: Loaded 19728 existing records from primary storage. [2025-09-16T17:58:29.489528] [INFO ] [MAIN ] CURV: Loaded 19728 existing records. [2025-09-16T17:58:29.668061] [WARN ] [MAIN ] CURV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:58:29.668298] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-09-16T17:58:29.668344] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-09-16T17:58:29.668790] [DEBUG] [LOCAL ] CURV: Deleted primary data file. [2025-09-16T17:58:29.668838] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-09-16T17:58:29.980049] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-09-16T17:58:30.046584] [INFO ] [REMOTE ] CURV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:58:30.604947] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-16T17:58:30.606352] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-16T17:58:30.774939] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-09-16T17:58:31.308777] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-16T17:58:31.574890] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-09-16T17:58:32.374914] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-09-16T17:58:33.002346] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-16T17:58:33.174901] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-09-16T17:58:33.208974] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-16T17:58:33.974897] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-09-16T17:58:34.742615] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-16T17:58:34.774845] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-09-16T17:58:35.070685] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-16T17:58:35.574934] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-09-16T17:58:36.035536] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-16T17:58:36.374896] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-09-16T17:58:36.505110] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-16T17:58:37.174891] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-09-16T17:58:37.211310] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-16T17:58:37.974900] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-09-16T17:58:38.455260] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-16T17:58:38.774905] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-09-16T17:58:39.574906] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-09-16T17:58:39.771827] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-16T17:58:39.843397] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-16T17:58:40.000446] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-16T17:58:40.374917] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-09-16T17:58:41.174917] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-09-16T17:58:41.758572] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-16T17:58:41.974915] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-09-16T17:58:42.456700] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-16T17:58:42.458327] [INFO ] [REMOTE ] CULP: Full fetch complete (3313 records). [2025-09-16T17:58:42.459478] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-16T17:58:42.459693] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-09-16T17:58:42.780909] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-09-16T17:58:42.817081] [DEBUG] [VALIDATOR ] CULP: All expected trading days are present. [2025-09-16T17:58:42.817136] [DEBUG] [VALIDATOR ] CULP: Primary data validation passed. [2025-09-16T17:58:42.817245] [INFO ] [MAIN ] CULP: Fetched primary data is valid. [2025-09-16T17:58:42.817283] [DEBUG] [LOCAL ] CULP: Saving primary data. [2025-09-16T17:58:42.817630] [DEBUG] [LOCAL ] CULP: Trimmed 3313 records to 2000 (keeping 150 days of data) [2025-09-16T17:58:42.829329] [DEBUG] [LOCAL ] CULP: Primary data saved (2000 records). [2025-09-16T17:58:42.829626] [INFO ] [MAIN ] CULP: Full history saved. [2025-09-16T17:58:42.829791] [INFO ] [MAIN ] Update Progress: 557/2369 symbols completed. CULP took 18.7s. Estimated remaining: 3h 10m 50s. Rate: 9.5 symbols/min [2025-09-16T17:58:43.574927] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-09-16T17:58:44.119153] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-16T17:58:44.374898] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-09-16T17:58:45.174924] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-09-16T17:58:45.493795] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-16T17:58:45.582392] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-16T17:58:45.591175] [INFO ] [REMOTE ] CUK: Full fetch complete (55544 records). [2025-09-16T17:58:45.591350] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-09-16T17:58:45.980143] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-09-16T17:58:45.984202] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-09-16T17:58:45.984324] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-09-16T17:58:45.985228] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-09-16T17:58:45.985368] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-09-16T17:58:45.986631] [DEBUG] [LOCAL ] CUK: Trimmed 55544 records to 37737 (keeping 150 days of data) [2025-09-16T17:58:46.218456] [DEBUG] [LOCAL ] CUK: Primary data saved (37737 records). [2025-09-16T17:58:46.218618] [INFO ] [MAIN ] CUK: Full history saved. [2025-09-16T17:58:46.219881] [INFO ] [MAIN ] Update Progress: 558/2369 symbols completed. CUK took 34.0s. Estimated remaining: 3h 10m 34s. Rate: 9.5 symbols/min [2025-09-16T17:58:46.472838] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-16T17:58:46.774950] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-09-16T17:58:47.329840] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-16T17:58:47.574958] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-09-16T17:58:47.970586] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-16T17:58:48.374907] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-09-16T17:58:48.951755] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-16T17:58:48.956700] [INFO ] [REMOTE ] CURV: Full fetch complete (28683 records). [2025-09-16T17:58:48.956784] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-09-16T17:58:49.339429] [DEBUG] [VALIDATOR ] CURV: All expected trading days are present. [2025-09-16T17:58:49.339511] [DEBUG] [VALIDATOR ] CURV: Primary data validation passed. [2025-09-16T17:58:49.339977] [INFO ] [MAIN ] CURV: Fetched primary data is valid. [2025-09-16T17:58:49.340020] [DEBUG] [LOCAL ] CURV: Saving primary data. [2025-09-16T17:58:49.340756] [DEBUG] [LOCAL ] CURV: Trimmed 28683 records to 20011 (keeping 150 days of data) [2025-09-16T17:58:49.450492] [DEBUG] [LOCAL ] CURV: Primary data saved (20011 records). [2025-09-16T17:58:49.450698] [INFO ] [MAIN ] CURV: Full history saved. [2025-09-16T17:58:49.450810] [INFO ] [MAIN ] Update Progress: 559/2369 symbols completed. CURV took 20.2s. Estimated remaining: 3h 10m 18s. Rate: 9.5 symbols/min [2025-09-16T17:58:49.525566] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-16T17:58:49.533040] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-09-16T17:58:50.856379] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-16T17:58:50.864003] [INFO ] [REMOTE ] CURB: Full fetch complete (35496 records). [2025-09-16T17:58:50.864274] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-09-16T17:58:51.438845] [DEBUG] [VALIDATOR ] CURB: All expected trading days are present. [2025-09-16T17:58:51.438948] [DEBUG] [VALIDATOR ] CURB: Primary data validation passed. [2025-09-16T17:58:51.439600] [INFO ] [MAIN ] CURB: Fetched primary data is valid. [2025-09-16T17:58:51.439667] [DEBUG] [LOCAL ] CURB: Saving primary data. [2025-09-16T17:58:51.440784] [DEBUG] [LOCAL ] CURB: Trimmed 35496 records to 23660 (keeping 150 days of data) [2025-09-16T17:58:51.601592] [DEBUG] [LOCAL ] CURB: Primary data saved (23660 records). [2025-09-16T17:58:51.601772] [INFO ] [MAIN ] CURB: Full history saved. [2025-09-16T17:58:51.601865] [INFO ] [MAIN ] Update Progress: 560/2369 symbols completed. CURB took 24.9s. Estimated remaining: 3h 9m 58s. Rate: 9.5 symbols/min [2025-09-16T17:58:52.252050] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:58:52.317051] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:58:52.316032] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:58:52.338085] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:58:52.353567] [DEBUG] [LOCAL ] CVEO: Loaded 11679 existing records from primary storage. [2025-09-16T17:58:52.353895] [INFO ] [MAIN ] CVEO: Loaded 11679 existing records. [2025-09-16T17:58:52.588162] [WARN ] [MAIN ] CVEO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:58:52.587976] [DEBUG] [LOCAL ] CVI: Loaded 33984 existing records from primary storage. [2025-09-16T17:58:52.599733] [DEBUG] [LOCAL ] CUZ: Loaded 36592 existing records from primary storage. [2025-09-16T17:58:52.599112] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-09-16T17:58:52.599903] [INFO ] [MAIN ] CVI: Loaded 33984 existing records. [2025-09-16T17:58:52.600022] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-09-16T17:58:52.631730] [INFO ] [MAIN ] CUZ: Loaded 36592 existing records. [2025-09-16T17:58:52.646240] [DEBUG] [LOCAL ] CVEO: Deleted primary data file. [2025-09-16T17:58:52.651512] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-09-16T17:58:52.806308] [DEBUG] [LOCAL ] CVE: Loaded 39534 existing records from primary storage. [2025-09-16T17:58:52.885688] [INFO ] [MAIN ] CVE: Loaded 39534 existing records. [2025-09-16T17:58:53.093196] [WARN ] [MAIN ] CVI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:58:53.249373] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:58:53.302848] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-09-16T17:58:53.306085] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-09-16T17:58:53.311638] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-09-16T17:58:53.306232] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-09-16T17:58:53.352274] [DEBUG] [LOCAL ] CVI: Deleted primary data file. [2025-09-16T17:58:53.387472] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-09-16T17:58:53.419410] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-09-16T17:58:53.387680] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-09-16T17:58:53.477526] [WARN ] [MAIN ] CVE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:58:53.507714] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-09-16T17:58:53.650115] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-09-16T17:58:53.729507] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:58:53.739745] [DEBUG] [LOCAL ] CVE: Deleted primary data file. [2025-09-16T17:58:53.743329] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-09-16T17:58:53.743453] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-09-16T17:58:54.503462] [INFO ] [REMOTE ] CVI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:58:54.572730] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-09-16T17:58:54.577411] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:58:54.577712] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-09-16T17:58:54.656890] [INFO ] [REMOTE ] CVE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:58:54.657346] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-09-16T17:58:54.766333] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-16T17:58:54.769406] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-09-16T17:58:55.321484] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-16T17:58:55.327385] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-09-16T17:58:55.906563] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-16T17:58:55.910401] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-09-16T17:58:56.194109] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-16T17:58:56.202984] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-09-16T17:58:56.231673] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-16T17:58:56.374953] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-09-16T17:58:56.503489] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-16T17:58:56.620555] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-16T17:58:57.174923] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-09-16T17:58:57.453128] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-16T17:58:57.825166] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-16T17:58:57.974924] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-09-16T17:58:58.198399] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-16T17:58:58.774906] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-09-16T17:58:59.574921] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-09-16T17:58:59.620861] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-16T17:59:00.374940] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-09-16T17:59:00.732374] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-16T17:59:01.174918] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-09-16T17:59:01.313927] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-16T17:59:01.417892] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-16T17:59:01.974889] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-09-16T17:59:02.583763] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-16T17:59:02.774861] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-09-16T17:59:03.574944] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-09-16T17:59:03.755315] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-16T17:59:04.374937] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-09-16T17:59:04.515189] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-16T17:59:05.182687] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-09-16T17:59:05.189145] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-16T17:59:05.723265] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-16T17:59:05.974898] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-09-16T17:59:06.712863] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-16T17:59:06.774891] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-09-16T17:59:07.574891] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-09-16T17:59:07.961624] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-16T17:59:08.044505] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-16T17:59:08.322665] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-16T17:59:08.374929] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-09-16T17:59:09.174900] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-09-16T17:59:09.897417] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-16T17:59:09.899707] [INFO ] [REMOTE ] CVEO: Full fetch complete (16901 records). [2025-09-16T17:59:09.899806] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-09-16T17:59:09.976591] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-09-16T17:59:10.074058] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-16T17:59:10.337711] [DEBUG] [VALIDATOR ] CVEO: All expected trading days are present. [2025-09-16T17:59:10.337819] [DEBUG] [VALIDATOR ] CVEO: Primary data validation passed. [2025-09-16T17:59:10.338175] [INFO ] [MAIN ] CVEO: Fetched primary data is valid. [2025-09-16T17:59:10.338216] [DEBUG] [LOCAL ] CVEO: Saving primary data. [2025-09-16T17:59:10.338757] [DEBUG] [LOCAL ] CVEO: Trimmed 16901 records to 11755 (keeping 150 days of data) [2025-09-16T17:59:10.406942] [DEBUG] [LOCAL ] CVEO: Primary data saved (11755 records). [2025-09-16T17:59:10.407090] [INFO ] [MAIN ] CVEO: Full history saved. [2025-09-16T17:59:10.407197] [INFO ] [MAIN ] Update Progress: 561/2369 symbols completed. CVEO took 18.8s. Estimated remaining: 3h 10m 32s. Rate: 9.5 symbols/min [2025-09-16T17:59:10.587075] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:59:10.598805] [DEBUG] [LOCAL ] CVLG: Loaded 11290 existing records from primary storage. [2025-09-16T17:59:10.598938] [INFO ] [MAIN ] CVLG: Loaded 11290 existing records. [2025-09-16T17:59:10.781469] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-09-16T17:59:10.786007] [WARN ] [MAIN ] CVLG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:59:10.786987] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-09-16T17:59:10.787058] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-09-16T17:59:10.787480] [DEBUG] [LOCAL ] CVLG: Deleted primary data file. [2025-09-16T17:59:10.787525] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-09-16T17:59:11.147141] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:59:11.574921] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-09-16T17:59:11.712335] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-16T17:59:12.355884] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-16T17:59:12.380007] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-09-16T17:59:12.403219] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-16T17:59:13.174906] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-09-16T17:59:13.784425] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-16T17:59:13.790729] [INFO ] [REMOTE ] CUZ: Full fetch complete (53412 records). [2025-09-16T17:59:13.790881] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-09-16T17:59:13.975380] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-09-16T17:59:14.163927] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-16T17:59:14.198577] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-09-16T17:59:14.199021] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-09-16T17:59:14.199730] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-09-16T17:59:14.199775] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-09-16T17:59:14.200847] [DEBUG] [LOCAL ] CUZ: Trimmed 53412 records to 36954 (keeping 150 days of data) [2025-09-16T17:59:14.421386] [DEBUG] [LOCAL ] CUZ: Primary data saved (36954 records). [2025-09-16T17:59:14.421524] [INFO ] [MAIN ] CUZ: Full history saved. [2025-09-16T17:59:14.421608] [INFO ] [MAIN ] Update Progress: 562/2369 symbols completed. CUZ took 22.8s. Estimated remaining: 3h 10m 19s. Rate: 9.5 symbols/min [2025-09-16T17:59:14.595813] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:59:14.632603] [DEBUG] [LOCAL ] CVNA: Loaded 39119 existing records from primary storage. [2025-09-16T17:59:14.632807] [INFO ] [MAIN ] CVNA: Loaded 39119 existing records. [2025-09-16T17:59:14.776983] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-09-16T17:59:14.809905] [WARN ] [MAIN ] CVNA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:59:14.810133] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-09-16T17:59:14.810183] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-09-16T17:59:14.811028] [DEBUG] [LOCAL ] CVNA: Deleted primary data file. [2025-09-16T17:59:14.811078] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-09-16T17:59:15.176148] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:59:15.460692] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-16T17:59:15.574936] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-09-16T17:59:16.374900] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-09-16T17:59:16.595361] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-16T17:59:16.600813] [INFO ] [REMOTE ] CVI: Full fetch complete (49970 records). [2025-09-16T17:59:16.600923] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-09-16T17:59:16.601573] [FATAL] [VALIDATOR ] CVI: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T17:59:16.601705] [FATAL] [MAIN ] CVI: Fetched primary data is invalid. Refusing to save it. [2025-09-16T17:59:16.601745] [WARN ] [MAIN ] CVI: Deleting existing primary and derivative data due to validation failure. [2025-09-16T17:59:16.601790] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-09-16T17:59:16.601856] [DEBUG] [LOCAL ] CVI: No primary data file found to delete. [2025-09-16T17:59:16.601893] [INFO ] [LOCAL ] CVI: Starting deletion of derivative data. [2025-09-16T17:59:16.602498] [DEBUG] [LOCAL ] CVI: Deleted derivative data file. [2025-09-16T17:59:16.604537] [INFO ] [MAIN ] Update Progress: 563/2369 symbols completed. CVI took 25.0s. Estimated remaining: 3h 9m 59s. Rate: 9.5 symbols/min [2025-09-16T17:59:16.780539] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:59:16.822532] [DEBUG] [LOCAL ] CVS: Loaded 39658 existing records from primary storage. [2025-09-16T17:59:16.822716] [INFO ] [MAIN ] CVS: Loaded 39658 existing records. [2025-09-16T17:59:17.003743] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:59:17.004009] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-09-16T17:59:17.004068] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-09-16T17:59:17.005100] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-09-16T17:59:17.005152] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-09-16T17:59:17.178368] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-09-16T17:59:17.383680] [INFO ] [REMOTE ] CVS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:59:17.398199] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-16T17:59:17.462943] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-16T17:59:17.974898] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-09-16T17:59:18.774881] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-09-16T17:59:19.251286] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-16T17:59:19.574906] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-09-16T17:59:19.747859] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-16T17:59:20.328167] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-16T17:59:20.374863] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-09-16T17:59:21.174887] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-09-16T17:59:21.415629] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-16T17:59:21.421822] [INFO ] [REMOTE ] CVE: Full fetch complete (58231 records). [2025-09-16T17:59:21.421917] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-09-16T17:59:21.804486] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present. [2025-09-16T17:59:21.804569] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed. [2025-09-16T17:59:21.805283] [INFO ] [MAIN ] CVE: Fetched primary data is valid. [2025-09-16T17:59:21.805331] [DEBUG] [LOCAL ] CVE: Saving primary data. [2025-09-16T17:59:21.806770] [DEBUG] [LOCAL ] CVE: Trimmed 58231 records to 39924 (keeping 150 days of data) [2025-09-16T17:59:21.993421] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-09-16T17:59:22.063776] [DEBUG] [LOCAL ] CVE: Primary data saved (39924 records). [2025-09-16T17:59:22.063952] [INFO ] [MAIN ] CVE: Full history saved. [2025-09-16T17:59:22.064059] [INFO ] [MAIN ] Update Progress: 564/2369 symbols completed. CVE took 30.5s. Estimated remaining: 3h 9m 50s. Rate: 9.5 symbols/min [2025-09-16T17:59:22.237205] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:59:22.250548] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-16T17:59:22.293777] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-16T17:59:22.333143] [DEBUG] [LOCAL ] CVX: Loaded 39720 existing records from primary storage. [2025-09-16T17:59:22.333311] [INFO ] [MAIN ] CVX: Loaded 39720 existing records. [2025-09-16T17:59:22.547251] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:59:22.547505] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-09-16T17:59:22.547552] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-09-16T17:59:22.548515] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-09-16T17:59:22.548567] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-09-16T17:59:22.780138] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-09-16T17:59:22.918726] [INFO ] [REMOTE ] CVX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:59:23.574925] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-09-16T17:59:24.375939] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-16T17:59:24.376048] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-09-16T17:59:24.459383] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-16T17:59:25.174974] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-09-16T17:59:25.512007] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-16T17:59:25.657409] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-16T17:59:25.974878] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-09-16T17:59:26.774969] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-09-16T17:59:27.293777] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-16T17:59:27.541295] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-16T17:59:27.574853] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-09-16T17:59:28.186391] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-16T17:59:28.206489] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-16T17:59:28.374927] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-09-16T17:59:29.174961] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-09-16T17:59:29.974936] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-09-16T17:59:30.208389] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-16T17:59:30.774952] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-09-16T17:59:31.514085] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-09-16T17:59:31.574952] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-09-16T17:59:32.295216] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-16T17:59:32.383745] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-09-16T17:59:32.389311] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-09-16T17:59:33.097500] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-16T17:59:33.099355] [INFO ] [REMOTE ] CVLG: Full fetch complete (16227 records). [2025-09-16T17:59:33.099442] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-09-16T17:59:33.182657] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-09-16T17:59:33.473217] [DEBUG] [VALIDATOR ] CVLG: All expected trading days are present. [2025-09-16T17:59:33.473297] [DEBUG] [VALIDATOR ] CVLG: Primary data validation passed. [2025-09-16T17:59:33.473704] [INFO ] [MAIN ] CVLG: Fetched primary data is valid. [2025-09-16T17:59:33.473764] [DEBUG] [LOCAL ] CVLG: Saving primary data. [2025-09-16T17:59:33.474338] [DEBUG] [LOCAL ] CVLG: Trimmed 16227 records to 11374 (keeping 150 days of data) [2025-09-16T17:59:33.544026] [DEBUG] [LOCAL ] CVLG: Primary data saved (11374 records). [2025-09-16T17:59:33.544165] [INFO ] [MAIN ] CVLG: Full history saved. [2025-09-16T17:59:33.544250] [INFO ] [MAIN ] Update Progress: 565/2369 symbols completed. CVLG took 23.1s. Estimated remaining: 3h 10m 0s. Rate: 9.5 symbols/min [2025-09-16T17:59:33.720735] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:59:33.769051] [DEBUG] [LOCAL ] CW: Loaded 16766 existing records from primary storage. [2025-09-16T17:59:33.769786] [INFO ] [MAIN ] CW: Loaded 16766 existing records. [2025-09-16T17:59:33.771226] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-16T17:59:33.960247] [WARN ] [MAIN ] CW: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:59:33.960500] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-09-16T17:59:33.960567] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-09-16T17:59:33.961124] [DEBUG] [LOCAL ] CW: Deleted primary data file. [2025-09-16T17:59:33.961171] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-09-16T17:59:33.981338] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-09-16T17:59:34.316548] [INFO ] [REMOTE ] CW: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:59:34.774950] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-09-16T17:59:35.301130] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-16T17:59:35.574927] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-09-16T17:59:36.198154] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-16T17:59:36.374907] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-09-16T17:59:36.445868] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-09-16T17:59:37.174867] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-09-16T17:59:37.426510] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-16T17:59:37.535910] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-16T17:59:37.974923] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-09-16T17:59:38.774947] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-09-16T17:59:39.393049] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-09-16T17:59:39.574933] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-09-16T17:59:40.154461] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-16T17:59:40.160875] [INFO ] [REMOTE ] CVS: Full fetch complete (58378 records). [2025-09-16T17:59:40.160988] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-09-16T17:59:40.385234] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-09-16T17:59:40.544756] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-09-16T17:59:40.544835] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-09-16T17:59:40.545503] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-09-16T17:59:40.545546] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-09-16T17:59:40.546734] [DEBUG] [LOCAL ] CVS: Trimmed 58378 records to 40048 (keeping 150 days of data) [2025-09-16T17:59:40.791573] [DEBUG] [LOCAL ] CVS: Primary data saved (40048 records). [2025-09-16T17:59:40.791764] [INFO ] [MAIN ] CVS: Full history saved. [2025-09-16T17:59:40.792667] [INFO ] [MAIN ] Update Progress: 566/2369 symbols completed. CVS took 24.2s. Estimated remaining: 3h 9m 57s. Rate: 9.5 symbols/min [2025-09-16T17:59:40.968481] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:59:41.000270] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-16T17:59:41.042885] [DEBUG] [LOCAL ] CWAN: Loaded 38857 existing records from primary storage. [2025-09-16T17:59:41.043022] [INFO ] [MAIN ] CWAN: Loaded 38857 existing records. [2025-09-16T17:59:41.183689] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-09-16T17:59:41.220947] [WARN ] [MAIN ] CWAN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:59:41.221156] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-09-16T17:59:41.221207] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-09-16T17:59:41.222079] [DEBUG] [LOCAL ] CWAN: Deleted primary data file. [2025-09-16T17:59:41.222135] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-09-16T17:59:41.576532] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:59:41.591822] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-16T17:59:41.815059] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-16T17:59:41.974871] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-09-16T17:59:42.774927] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-09-16T17:59:43.075473] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-16T17:59:43.082444] [INFO ] [REMOTE ] CVNA: Full fetch complete (57693 records). [2025-09-16T17:59:43.082564] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-09-16T17:59:43.460099] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-09-16T17:59:43.460178] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-09-16T17:59:43.460853] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-09-16T17:59:43.460899] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-09-16T17:59:43.462054] [DEBUG] [LOCAL ] CVNA: Trimmed 57693 records to 39474 (keeping 150 days of data) [2025-09-16T17:59:43.578107] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-09-16T17:59:43.707163] [DEBUG] [LOCAL ] CVNA: Primary data saved (39474 records). [2025-09-16T17:59:43.707317] [INFO ] [MAIN ] CVNA: Full history saved. [2025-09-16T17:59:43.707404] [INFO ] [MAIN ] Update Progress: 567/2369 symbols completed. CVNA took 29.3s. Estimated remaining: 3h 9m 40s. Rate: 9.5 symbols/min [2025-09-16T17:59:43.880270] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:59:43.912229] [DEBUG] [LOCAL ] CWEN: Loaded 32791 existing records from primary storage. [2025-09-16T17:59:43.912370] [INFO ] [MAIN ] CWEN: Loaded 32791 existing records. [2025-09-16T17:59:44.094605] [WARN ] [MAIN ] CWEN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:59:44.094982] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-09-16T17:59:44.095246] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-09-16T17:59:44.096283] [DEBUG] [LOCAL ] CWEN: Deleted primary data file. [2025-09-16T17:59:44.096400] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-09-16T17:59:44.403330] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-09-16T17:59:44.481942] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-09-16T17:59:44.510243] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:59:44.584590] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-16T17:59:44.882713] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-16T17:59:45.174927] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-09-16T17:59:45.974920] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-09-16T17:59:46.774910] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-09-16T17:59:46.924767] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-16T17:59:46.981172] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-09-16T17:59:46.987575] [INFO ] [REMOTE ] CVX: Full fetch complete (58440 records). [2025-09-16T17:59:46.987727] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-09-16T17:59:47.367355] [DEBUG] [VALIDATOR ] CVX: All expected trading days are present. [2025-09-16T17:59:47.367445] [DEBUG] [VALIDATOR ] CVX: Primary data validation passed. [2025-09-16T17:59:47.368153] [INFO ] [MAIN ] CVX: Fetched primary data is valid. [2025-09-16T17:59:47.368233] [DEBUG] [LOCAL ] CVX: Saving primary data. [2025-09-16T17:59:47.369812] [DEBUG] [LOCAL ] CVX: Trimmed 58440 records to 40110 (keeping 150 days of data) [2025-09-16T17:59:47.522695] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-16T17:59:47.594493] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-09-16T17:59:47.665075] [DEBUG] [LOCAL ] CVX: Primary data saved (40110 records). [2025-09-16T17:59:47.665194] [INFO ] [MAIN ] CVX: Full history saved. [2025-09-16T17:59:47.666090] [INFO ] [MAIN ] Update Progress: 568/2369 symbols completed. CVX took 25.6s. Estimated remaining: 3h 9m 26s. Rate: 9.5 symbols/min [2025-09-16T17:59:47.833441] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T17:59:47.873707] [DEBUG] [LOCAL ] CWH: Loaded 38060 existing records from primary storage. [2025-09-16T17:59:47.873864] [INFO ] [MAIN ] CWH: Loaded 38060 existing records. [2025-09-16T17:59:48.047146] [WARN ] [MAIN ] CWH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T17:59:48.047367] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-09-16T17:59:48.047431] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-09-16T17:59:48.048301] [DEBUG] [LOCAL ] CWH: Deleted primary data file. [2025-09-16T17:59:48.048357] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-09-16T17:59:48.383245] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-09-16T17:59:48.402747] [INFO ] [REMOTE ] CWH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T17:59:48.703467] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-16T17:59:49.049092] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-16T17:59:49.174895] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-09-16T17:59:49.974936] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-09-16T17:59:50.140450] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-16T17:59:50.355385] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-16T17:59:50.774869] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-09-16T17:59:51.175160] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-16T17:59:51.574921] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-09-16T17:59:52.352446] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-16T17:59:52.374919] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-09-16T17:59:53.066266] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-16T17:59:53.174904] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-09-16T17:59:53.978769] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-09-16T17:59:53.983695] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-16T17:59:54.590026] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-16T17:59:54.774874] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-09-16T17:59:55.395558] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-16T17:59:55.574887] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-09-16T17:59:56.155131] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-16T17:59:56.374908] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-09-16T17:59:56.931237] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-16T17:59:57.174903] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-09-16T17:59:57.974931] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-09-16T17:59:58.262298] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-16T17:59:58.292888] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-16T17:59:58.774909] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-09-16T17:59:59.556242] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-16T17:59:59.574849] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-09-16T18:00:00.374949] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-09-16T18:00:00.430232] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-16T18:00:01.174910] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-09-16T18:00:01.566983] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-16T18:00:01.975170] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-09-16T18:00:02.095112] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-16T18:00:02.098475] [INFO ] [REMOTE ] CW: Full fetch complete (25596 records). [2025-09-16T18:00:02.098684] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-09-16T18:00:02.526876] [DEBUG] [VALIDATOR ] CW: All expected trading days are present. [2025-09-16T18:00:02.526996] [DEBUG] [VALIDATOR ] CW: Primary data validation passed. [2025-09-16T18:00:02.527549] [INFO ] [MAIN ] CW: Fetched primary data is valid. [2025-09-16T18:00:02.527626] [DEBUG] [LOCAL ] CW: Saving primary data. [2025-09-16T18:00:02.530041] [DEBUG] [LOCAL ] CW: Trimmed 25596 records to 16921 (keeping 150 days of data) [2025-09-16T18:00:02.676595] [DEBUG] [LOCAL ] CW: Primary data saved (16921 records). [2025-09-16T18:00:02.676839] [INFO ] [MAIN ] CW: Full history saved. [2025-09-16T18:00:02.676998] [INFO ] [MAIN ] Update Progress: 569/2369 symbols completed. CW took 29.1s. Estimated remaining: 3h 9m 47s. Rate: 9.5 symbols/min [2025-09-16T18:00:02.776694] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-09-16T18:00:02.951195] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:00:02.951441] [DEBUG] [LOCAL ] CWK: No existing data file found in primary storage. [2025-09-16T18:00:02.951495] [WARN ] [MAIN ] CWK: No existing data found, performing full refresh instead. [2025-09-16T18:00:02.951719] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-09-16T18:00:02.951786] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-09-16T18:00:02.951848] [DEBUG] [LOCAL ] CWK: No primary data file found to delete. [2025-09-16T18:00:02.951896] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-09-16T18:00:03.505379] [INFO ] [REMOTE ] CWK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:00:03.563922] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-09-16T18:00:03.578029] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-09-16T18:00:03.629950] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-16T18:00:04.374938] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-09-16T18:00:04.800133] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-16T18:00:04.806846] [INFO ] [REMOTE ] CWAN: Full fetch complete (56492 records). [2025-09-16T18:00:04.807057] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-09-16T18:00:04.809272] [FATAL] [VALIDATOR ] CWAN: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:00:04.809370] [FATAL] [MAIN ] CWAN: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:00:04.809447] [WARN ] [MAIN ] CWAN: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:00:04.809534] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-09-16T18:00:04.809623] [DEBUG] [LOCAL ] CWAN: No primary data file found to delete. [2025-09-16T18:00:04.809732] [INFO ] [LOCAL ] CWAN: Starting deletion of derivative data. [2025-09-16T18:00:04.810032] [DEBUG] [LOCAL ] CWAN: Deleted derivative data file. [2025-09-16T18:00:04.811136] [INFO ] [MAIN ] Update Progress: 570/2369 symbols completed. CWAN took 24.0s. Estimated remaining: 3h 9m 28s. Rate: 9.5 symbols/min [2025-09-16T18:00:04.983140] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:00:05.009152] [DEBUG] [LOCAL ] CWT: Loaded 20038 existing records from primary storage. [2025-09-16T18:00:05.009285] [INFO ] [MAIN ] CWT: Loaded 20038 existing records. [2025-09-16T18:00:05.174954] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-09-16T18:00:05.196533] [WARN ] [MAIN ] CWT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:00:05.198136] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-09-16T18:00:05.198255] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-09-16T18:00:05.198855] [DEBUG] [LOCAL ] CWT: Deleted primary data file. [2025-09-16T18:00:05.198917] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-09-16T18:00:05.388683] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-16T18:00:05.594379] [INFO ] [REMOTE ] CWT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:00:05.722371] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-16T18:00:05.728389] [INFO ] [REMOTE ] CWEN: Full fetch complete (48966 records). [2025-09-16T18:00:05.728483] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-09-16T18:00:05.980447] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-09-16T18:00:06.112566] [DEBUG] [VALIDATOR ] CWEN: All expected trading days are present. [2025-09-16T18:00:06.112685] [DEBUG] [VALIDATOR ] CWEN: Primary data validation passed. [2025-09-16T18:00:06.113658] [INFO ] [MAIN ] CWEN: Fetched primary data is valid. [2025-09-16T18:00:06.113730] [DEBUG] [LOCAL ] CWEN: Saving primary data. [2025-09-16T18:00:06.115025] [DEBUG] [LOCAL ] CWEN: Trimmed 48966 records to 33122 (keeping 150 days of data) [2025-09-16T18:00:06.321587] [DEBUG] [LOCAL ] CWEN: Primary data saved (33122 records). [2025-09-16T18:00:06.321738] [INFO ] [MAIN ] CWEN: Full history saved. [2025-09-16T18:00:06.321862] [INFO ] [MAIN ] Update Progress: 571/2369 symbols completed. CWEN took 22.6s. Estimated remaining: 3h 9m 6s. Rate: 9.5 symbols/min [2025-09-16T18:00:06.495101] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:00:06.533474] [DEBUG] [LOCAL ] CX: Loaded 38965 existing records from primary storage. [2025-09-16T18:00:06.533593] [INFO ] [MAIN ] CX: Loaded 38965 existing records. [2025-09-16T18:00:06.710265] [WARN ] [MAIN ] CX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:00:06.710505] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-09-16T18:00:06.710555] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-09-16T18:00:06.711401] [DEBUG] [LOCAL ] CX: Deleted primary data file. [2025-09-16T18:00:06.711452] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-09-16T18:00:06.785472] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-09-16T18:00:07.072321] [INFO ] [REMOTE ] CX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:00:07.376460] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-16T18:00:07.574914] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-09-16T18:00:07.671544] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-16T18:00:08.374941] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-09-16T18:00:08.878907] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-16T18:00:09.174908] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-09-16T18:00:09.617617] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (4.44 seconds). [2025-09-16T18:00:09.880996] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-16T18:00:09.974904] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-09-16T18:00:10.390287] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-16T18:00:10.774910] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-09-16T18:00:11.192517] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-16T18:00:11.574905] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-09-16T18:00:11.975530] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-16T18:00:12.374910] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-09-16T18:00:13.174920] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-09-16T18:00:13.625966] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-16T18:00:13.974954] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-09-16T18:00:14.539768] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-16T18:00:14.773521] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (3.20 seconds). [2025-09-16T18:00:14.778527] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-09-16T18:00:14.780291] [INFO ] [REMOTE ] CWH: Full fetch complete (55080 records). [2025-09-16T18:00:14.780490] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-09-16T18:00:14.781326] [FATAL] [VALIDATOR ] CWH: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:00:14.781429] [FATAL] [MAIN ] CWH: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:00:14.781494] [WARN ] [MAIN ] CWH: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:00:14.781545] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-09-16T18:00:14.781621] [DEBUG] [LOCAL ] CWH: No primary data file found to delete. [2025-09-16T18:00:14.781682] [INFO ] [LOCAL ] CWH: Starting deletion of derivative data. [2025-09-16T18:00:14.781921] [DEBUG] [LOCAL ] CWH: Deleted derivative data file. [2025-09-16T18:00:14.782795] [INFO ] [MAIN ] Update Progress: 572/2369 symbols completed. CWH took 27.1s. Estimated remaining: 3h 9m 7s. Rate: 9.5 symbols/min [2025-09-16T18:00:14.957516] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:00:14.969934] [DEBUG] [LOCAL ] CXE: Loaded 4647 existing records from primary storage. [2025-09-16T18:00:14.970068] [INFO ] [MAIN ] CXE: Loaded 4647 existing records. [2025-09-16T18:00:15.155973] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:00:15.156220] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-09-16T18:00:15.156276] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-09-16T18:00:15.156539] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-09-16T18:00:15.156584] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-09-16T18:00:15.505595] [INFO ] [REMOTE ] CXE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:00:15.574880] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-09-16T18:00:15.749749] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-16T18:00:16.210206] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-16T18:00:16.374911] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-09-16T18:00:16.777268] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-16T18:00:17.174902] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-09-16T18:00:17.585572] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-16T18:00:17.592341] [INFO ] [REMOTE ] CWK: Full fetch complete (53613 records). [2025-09-16T18:00:17.592497] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-09-16T18:00:17.981189] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-09-16T18:00:18.037994] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-09-16T18:00:18.038090] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-09-16T18:00:18.038831] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-09-16T18:00:18.038891] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-09-16T18:00:18.040720] [DEBUG] [LOCAL ] CWK: Trimmed 53613 records to 36655 (keeping 150 days of data) [2025-09-16T18:00:18.261902] [DEBUG] [LOCAL ] CWK: Primary data saved (36655 records). [2025-09-16T18:00:18.262053] [INFO ] [MAIN ] CWK: Full history saved. [2025-09-16T18:00:18.262131] [INFO ] [MAIN ] Update Progress: 573/2369 symbols completed. CWK took 15.6s. Estimated remaining: 3h 8m 51s. Rate: 9.5 symbols/min [2025-09-16T18:00:18.432119] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:00:18.437768] [DEBUG] [LOCAL ] CXH: Loaded 3905 existing records from primary storage. [2025-09-16T18:00:18.437880] [INFO ] [MAIN ] CXH: Loaded 3905 existing records. [2025-09-16T18:00:18.616222] [WARN ] [MAIN ] CXH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:00:18.616532] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-09-16T18:00:18.616579] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-09-16T18:00:18.616880] [DEBUG] [LOCAL ] CXH: Deleted primary data file. [2025-09-16T18:00:18.616927] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-09-16T18:00:18.776200] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-09-16T18:00:18.972021] [INFO ] [REMOTE ] CXH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:00:19.307349] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-16T18:00:19.574905] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-09-16T18:00:19.626254] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-09-16T18:00:19.856172] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-16T18:00:20.374908] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-09-16T18:00:20.802914] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-16T18:00:21.158487] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-16T18:00:21.174840] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-09-16T18:00:21.974908] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-09-16T18:00:22.635294] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-16T18:00:22.774910] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-09-16T18:00:22.889528] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-16T18:00:23.057569] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-09-16T18:00:23.574908] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-09-16T18:00:23.927789] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-16T18:00:24.374897] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-09-16T18:00:25.174897] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-09-16T18:00:25.412578] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-16T18:00:25.883229] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-16T18:00:25.974920] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-09-16T18:00:26.547168] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-16T18:00:26.774902] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-09-16T18:00:27.301532] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-16T18:00:27.574887] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-09-16T18:00:28.374914] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-09-16T18:00:29.174911] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-09-16T18:00:29.256636] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-16T18:00:29.676575] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-16T18:00:29.974861] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-09-16T18:00:30.730048] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-16T18:00:30.774851] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-09-16T18:00:31.574904] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-09-16T18:00:31.847834] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-16T18:00:31.909805] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-16T18:00:32.308269] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-09-16T18:00:32.374859] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-09-16T18:00:33.174922] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-09-16T18:00:33.797286] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-16T18:00:33.803519] [INFO ] [REMOTE ] CX: Full fetch complete (57441 records). [2025-09-16T18:00:33.803634] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-09-16T18:00:33.984651] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-09-16T18:00:34.201817] [DEBUG] [VALIDATOR ] CX: All expected trading days are present. [2025-09-16T18:00:34.201937] [DEBUG] [VALIDATOR ] CX: Primary data validation passed. [2025-09-16T18:00:34.202679] [INFO ] [MAIN ] CX: Fetched primary data is valid. [2025-09-16T18:00:34.202734] [DEBUG] [LOCAL ] CX: Saving primary data. [2025-09-16T18:00:34.220804] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-16T18:00:34.219624] [DEBUG] [LOCAL ] CX: Trimmed 57441 records to 39346 (keeping 150 days of data) [2025-09-16T18:00:34.458160] [DEBUG] [LOCAL ] CX: Primary data saved (39346 records). [2025-09-16T18:00:34.458303] [INFO ] [MAIN ] CX: Full history saved. [2025-09-16T18:00:34.458389] [INFO ] [MAIN ] Update Progress: 574/2369 symbols completed. CX took 28.1s. Estimated remaining: 3h 9m 16s. Rate: 9.5 symbols/min [2025-09-16T18:00:34.628189] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:00:34.664499] [DEBUG] [LOCAL ] CXM: Loaded 35117 existing records from primary storage. [2025-09-16T18:00:34.664636] [INFO ] [MAIN ] CXM: Loaded 35117 existing records. [2025-09-16T18:00:34.780041] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-09-16T18:00:34.843021] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:00:34.843232] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-09-16T18:00:34.843280] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-09-16T18:00:34.844112] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-09-16T18:00:34.844165] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-09-16T18:00:34.947894] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-16T18:00:34.957358] [INFO ] [REMOTE ] CXH: Full fetch complete (4619 records). [2025-09-16T18:00:34.967625] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-09-16T18:00:35.465153] [INFO ] [REMOTE ] CXM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:00:35.569808] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-09-16T18:00:35.569887] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-09-16T18:00:35.570030] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-09-16T18:00:35.570068] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-09-16T18:00:35.570450] [DEBUG] [LOCAL ] CXH: Trimmed 4619 records to 3921 (keeping 150 days of data) [2025-09-16T18:00:35.579838] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-09-16T18:00:35.594986] [DEBUG] [LOCAL ] CXH: Primary data saved (3921 records). [2025-09-16T18:00:35.595069] [INFO ] [MAIN ] CXH: Full history saved. [2025-09-16T18:00:35.595148] [INFO ] [MAIN ] Update Progress: 575/2369 symbols completed. CXH took 17.3s. Estimated remaining: 3h 8m 53s. Rate: 9.5 symbols/min [2025-09-16T18:00:35.774779] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:00:35.775387] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-16T18:00:35.798139] [DEBUG] [LOCAL ] CXT: Loaded 22071 existing records from primary storage. [2025-09-16T18:00:35.798268] [INFO ] [MAIN ] CXT: Loaded 22071 existing records. [2025-09-16T18:00:35.982563] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:00:35.982837] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-09-16T18:00:35.982885] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-09-16T18:00:35.983600] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-09-16T18:00:35.983676] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-09-16T18:00:36.357310] [INFO ] [REMOTE ] CXT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:00:36.374911] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-09-16T18:00:36.419607] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-16T18:00:37.174964] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-09-16T18:00:37.424353] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-16T18:00:37.974946] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-09-16T18:00:38.258186] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-16T18:00:38.774896] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-09-16T18:00:38.910497] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-16T18:00:39.574905] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-09-16T18:00:40.013143] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-16T18:00:40.374875] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-09-16T18:00:40.455137] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-16T18:00:41.174909] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-09-16T18:00:41.804069] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-16T18:00:41.974890] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-09-16T18:00:42.674064] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-16T18:00:42.677459] [INFO ] [REMOTE ] CWT: Full fetch complete (30655 records). [2025-09-16T18:00:42.677544] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-09-16T18:00:42.779440] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-09-16T18:00:43.049904] [DEBUG] [VALIDATOR ] CWT: All expected trading days are present. [2025-09-16T18:00:43.049981] [DEBUG] [VALIDATOR ] CWT: Primary data validation passed. [2025-09-16T18:00:43.050446] [INFO ] [MAIN ] CWT: Fetched primary data is valid. [2025-09-16T18:00:43.050487] [DEBUG] [LOCAL ] CWT: Saving primary data. [2025-09-16T18:00:43.051214] [DEBUG] [LOCAL ] CWT: Trimmed 30655 records to 20240 (keeping 150 days of data) [2025-09-16T18:00:43.208730] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-16T18:00:43.224098] [DEBUG] [LOCAL ] CWT: Primary data saved (20240 records). [2025-09-16T18:00:43.224209] [INFO ] [MAIN ] CWT: Full history saved. [2025-09-16T18:00:43.224288] [INFO ] [MAIN ] Update Progress: 576/2369 symbols completed. CWT took 38.4s. Estimated remaining: 3h 8m 51s. Rate: 9.5 symbols/min [2025-09-16T18:00:43.437189] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:00:43.474501] [DEBUG] [LOCAL ] CXW: Loaded 32561 existing records from primary storage. [2025-09-16T18:00:43.474659] [INFO ] [MAIN ] CXW: Loaded 32561 existing records. [2025-09-16T18:00:43.576534] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-09-16T18:00:43.653562] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:00:43.653810] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-09-16T18:00:43.653885] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-09-16T18:00:43.654554] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-09-16T18:00:43.654620] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-09-16T18:00:43.773369] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-16T18:00:43.814553] [INFO ] [REMOTE ] CXE: Full fetch complete (7914 records). [2025-09-16T18:00:43.838988] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-09-16T18:00:44.232409] [INFO ] [REMOTE ] CXW: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:00:44.379844] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-09-16T18:00:44.386384] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-09-16T18:00:44.386449] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-09-16T18:00:44.386619] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-09-16T18:00:44.386683] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-09-16T18:00:44.387301] [DEBUG] [LOCAL ] CXE: Trimmed 7914 records to 4683 (keeping 150 days of data) [2025-09-16T18:00:44.421118] [DEBUG] [LOCAL ] CXE: Primary data saved (4683 records). [2025-09-16T18:00:44.421314] [INFO ] [MAIN ] CXE: Full history saved. [2025-09-16T18:00:44.421409] [INFO ] [MAIN ] Update Progress: 577/2369 symbols completed. CXE took 29.6s. Estimated remaining: 3h 8m 29s. Rate: 9.5 symbols/min [2025-09-16T18:00:44.597808] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:00:44.618016] [DEBUG] [LOCAL ] CYD: Loaded 18953 existing records from primary storage. [2025-09-16T18:00:44.618155] [INFO ] [MAIN ] CYD: Loaded 18953 existing records. [2025-09-16T18:00:44.794977] [WARN ] [MAIN ] CYD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:00:44.795222] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-09-16T18:00:44.795270] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-09-16T18:00:44.795774] [DEBUG] [LOCAL ] CYD: Deleted primary data file. [2025-09-16T18:00:44.795830] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-09-16T18:00:45.147078] [INFO ] [REMOTE ] CYD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:00:45.174859] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-09-16T18:00:45.217683] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-16T18:00:45.974939] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-09-16T18:00:46.283760] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-16T18:00:46.603363] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-16T18:00:46.774905] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-09-16T18:00:47.574896] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-09-16T18:00:47.608881] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-16T18:00:48.196028] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-16T18:00:48.374918] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-09-16T18:00:48.950925] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-16T18:00:49.174938] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-09-16T18:00:49.413962] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-16T18:00:49.974963] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-09-16T18:00:50.774961] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-09-16T18:00:50.901725] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-16T18:00:51.356566] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-16T18:00:51.574840] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-09-16T18:00:52.374899] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-09-16T18:00:52.504326] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-16T18:00:52.959923] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-16T18:00:53.174925] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-09-16T18:00:53.298597] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-16T18:00:53.974891] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-09-16T18:00:54.782454] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-09-16T18:00:54.799076] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-16T18:00:55.436380] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-16T18:00:55.574936] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-09-16T18:00:56.152471] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-16T18:00:56.374970] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-09-16T18:00:57.174889] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-09-16T18:00:57.466871] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-16T18:00:57.497420] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-16T18:00:57.503199] [INFO ] [REMOTE ] CXM: Full fetch complete (52008 records). [2025-09-16T18:00:57.503295] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-09-16T18:00:57.882079] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-09-16T18:00:57.882156] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-09-16T18:00:57.882789] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-09-16T18:00:57.882834] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-09-16T18:00:57.883925] [DEBUG] [LOCAL ] CXM: Trimmed 52008 records to 35428 (keeping 150 days of data) [2025-09-16T18:00:57.978513] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-09-16T18:00:58.086714] [DEBUG] [LOCAL ] CXM: Primary data saved (35428 records). [2025-09-16T18:00:58.086852] [INFO ] [MAIN ] CXM: Full history saved. [2025-09-16T18:00:58.086935] [INFO ] [MAIN ] Update Progress: 578/2369 symbols completed. CXM took 23.6s. Estimated remaining: 3h 8m 45s. Rate: 9.5 symbols/min [2025-09-16T18:00:58.260540] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:00:58.293347] [DEBUG] [LOCAL ] CYH: Loaded 35531 existing records from primary storage. [2025-09-16T18:00:58.293533] [INFO ] [MAIN ] CYH: Loaded 35531 existing records. [2025-09-16T18:00:58.477605] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:00:58.477856] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-09-16T18:00:58.477902] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-09-16T18:00:58.478633] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-09-16T18:00:58.478714] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-09-16T18:00:58.777364] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-09-16T18:00:58.840955] [INFO ] [REMOTE ] CYH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:00:58.870025] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-16T18:00:59.574952] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-09-16T18:00:59.591318] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-16T18:00:59.595240] [INFO ] [REMOTE ] CXT: Full fetch complete (34045 records). [2025-09-16T18:00:59.595319] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-09-16T18:00:59.966119] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-09-16T18:00:59.966197] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-09-16T18:00:59.966708] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-09-16T18:00:59.966753] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-09-16T18:00:59.967545] [DEBUG] [LOCAL ] CXT: Trimmed 34045 records to 22307 (keeping 150 days of data) [2025-09-16T18:01:00.104635] [DEBUG] [LOCAL ] CXT: Primary data saved (22307 records). [2025-09-16T18:01:00.104794] [INFO ] [MAIN ] CXT: Full history saved. [2025-09-16T18:01:00.104881] [INFO ] [MAIN ] Update Progress: 579/2369 symbols completed. CXT took 24.5s. Estimated remaining: 3h 8m 26s. Rate: 9.5 symbols/min [2025-09-16T18:01:00.278241] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:01:00.278430] [DEBUG] [LOCAL ] D: No existing data file found in primary storage. [2025-09-16T18:01:00.278501] [WARN ] [MAIN ] D: No existing data found, performing full refresh instead. [2025-09-16T18:01:00.278835] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-09-16T18:01:00.278895] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-09-16T18:01:00.279024] [DEBUG] [LOCAL ] D: No primary data file found to delete. [2025-09-16T18:01:00.279128] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-09-16T18:01:00.377848] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-09-16T18:01:00.591880] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-16T18:01:00.687381] [INFO ] [REMOTE ] D: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:01:01.100228] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-16T18:01:01.174926] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-09-16T18:01:01.974925] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-09-16T18:01:02.353843] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-16T18:01:02.737371] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-16T18:01:02.742753] [INFO ] [REMOTE ] CXW: Full fetch complete (48694 records). [2025-09-16T18:01:02.742920] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-09-16T18:01:02.743875] [FATAL] [VALIDATOR ] CXW: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:01:02.743988] [FATAL] [MAIN ] CXW: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:01:02.744044] [WARN ] [MAIN ] CXW: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:01:02.744092] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-09-16T18:01:02.744164] [DEBUG] [LOCAL ] CXW: No primary data file found to delete. [2025-09-16T18:01:02.744205] [INFO ] [LOCAL ] CXW: Starting deletion of derivative data. [2025-09-16T18:01:02.744571] [DEBUG] [LOCAL ] CXW: Deleted derivative data file. [2025-09-16T18:01:02.745910] [INFO ] [MAIN ] Update Progress: 580/2369 symbols completed. CXW took 19.5s. Estimated remaining: 3h 8m 8s. Rate: 9.5 symbols/min [2025-09-16T18:01:02.779988] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-09-16T18:01:02.934726] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:01:02.934919] [DEBUG] [LOCAL ] DAC: No existing data file found in primary storage. [2025-09-16T18:01:02.934959] [WARN ] [MAIN ] DAC: No existing data found, performing full refresh instead. [2025-09-16T18:01:02.935096] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-09-16T18:01:02.935151] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-09-16T18:01:02.935208] [DEBUG] [LOCAL ] DAC: No primary data file found to delete. [2025-09-16T18:01:02.935255] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-09-16T18:01:03.302670] [INFO ] [REMOTE ] DAC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:01:03.574897] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-09-16T18:01:04.065240] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-16T18:01:04.374874] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-09-16T18:01:04.748594] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-16T18:01:05.174917] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-09-16T18:01:05.309992] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-09-16T18:01:05.538895] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-16T18:01:05.974884] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-09-16T18:01:06.099308] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-16T18:01:06.774943] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-09-16T18:01:07.232490] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-16T18:01:07.554698] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-16T18:01:07.574853] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-09-16T18:01:08.374925] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-09-16T18:01:08.464342] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-16T18:01:09.174905] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-09-16T18:01:09.558595] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-16T18:01:09.974892] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-09-16T18:01:10.310584] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-16T18:01:10.774912] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-09-16T18:01:11.303912] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-16T18:01:11.307615] [INFO ] [REMOTE ] CYD: Full fetch complete (29178 records). [2025-09-16T18:01:11.307719] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-09-16T18:01:11.580026] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-09-16T18:01:11.689730] [DEBUG] [VALIDATOR ] CYD: All expected trading days are present. [2025-09-16T18:01:11.689818] [DEBUG] [VALIDATOR ] CYD: Primary data validation passed. [2025-09-16T18:01:11.690343] [INFO ] [MAIN ] CYD: Fetched primary data is valid. [2025-09-16T18:01:11.690387] [DEBUG] [LOCAL ] CYD: Saving primary data. [2025-09-16T18:01:11.691197] [DEBUG] [LOCAL ] CYD: Trimmed 29178 records to 19154 (keeping 150 days of data) [2025-09-16T18:01:11.805697] [DEBUG] [LOCAL ] CYD: Primary data saved (19154 records). [2025-09-16T18:01:11.805847] [INFO ] [MAIN ] CYD: Full history saved. [2025-09-16T18:01:11.805931] [INFO ] [MAIN ] Update Progress: 581/2369 symbols completed. CYD took 27.4s. Estimated remaining: 3h 8m 10s. Rate: 9.5 symbols/min [2025-09-16T18:01:11.977821] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:01:11.978035] [DEBUG] [LOCAL ] DAL: No existing data file found in primary storage. [2025-09-16T18:01:11.978075] [WARN ] [MAIN ] DAL: No existing data found, performing full refresh instead. [2025-09-16T18:01:11.978228] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-09-16T18:01:11.978268] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-09-16T18:01:11.978312] [DEBUG] [LOCAL ] DAL: No primary data file found to delete. [2025-09-16T18:01:11.978351] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-09-16T18:01:12.332003] [INFO ] [REMOTE ] DAL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:01:12.374915] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-09-16T18:01:12.962777] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-16T18:01:13.095308] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-16T18:01:13.174902] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-09-16T18:01:13.974898] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-09-16T18:01:14.629031] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-16T18:01:14.730327] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-09-16T18:01:14.774846] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-09-16T18:01:15.574897] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-09-16T18:01:16.111461] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-16T18:01:16.374899] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-09-16T18:01:16.445092] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-16T18:01:17.179994] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-09-16T18:01:17.195401] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-09-16T18:01:17.974894] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-09-16T18:01:18.218918] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-16T18:01:18.238789] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-16T18:01:18.774897] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-09-16T18:01:19.579968] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-09-16T18:01:19.593590] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-16T18:01:20.374900] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-09-16T18:01:20.562038] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-16T18:01:21.174894] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-09-16T18:01:21.720753] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-16T18:01:21.968593] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-16T18:01:21.979185] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-09-16T18:01:22.774876] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-09-16T18:01:22.899588] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-16T18:01:23.336180] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-16T18:01:23.337838] [INFO ] [REMOTE ] DAC: Full fetch complete (14211 records). [2025-09-16T18:01:23.337905] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-09-16T18:01:23.579975] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-09-16T18:01:23.696297] [DEBUG] [VALIDATOR ] DAC: All expected trading days are present. [2025-09-16T18:01:23.696370] [DEBUG] [VALIDATOR ] DAC: Primary data validation passed. [2025-09-16T18:01:23.696714] [INFO ] [MAIN ] DAC: Fetched primary data is valid. [2025-09-16T18:01:23.696784] [DEBUG] [LOCAL ] DAC: Saving primary data. [2025-09-16T18:01:23.697251] [DEBUG] [LOCAL ] DAC: Trimmed 14211 records to 9052 (keeping 150 days of data) [2025-09-16T18:01:23.754221] [DEBUG] [LOCAL ] DAC: Primary data saved (9052 records). [2025-09-16T18:01:23.754346] [INFO ] [MAIN ] DAC: Full history saved. [2025-09-16T18:01:23.754420] [INFO ] [MAIN ] Update Progress: 582/2369 symbols completed. DAC took 21.0s. Estimated remaining: 3h 8m 21s. Rate: 9.5 symbols/min [2025-09-16T18:01:23.928884] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:01:23.966896] [DEBUG] [LOCAL ] DAN: Loaded 36208 existing records from primary storage. [2025-09-16T18:01:23.967042] [INFO ] [MAIN ] DAN: Loaded 36208 existing records. [2025-09-16T18:01:24.141208] [WARN ] [MAIN ] DAN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:01:24.141458] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-09-16T18:01:24.141520] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-09-16T18:01:24.142301] [DEBUG] [LOCAL ] DAN: Deleted primary data file. [2025-09-16T18:01:24.142355] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-09-16T18:01:24.381778] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-09-16T18:01:24.520972] [INFO ] [REMOTE ] DAN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:01:24.547851] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-16T18:01:25.174902] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-09-16T18:01:25.974882] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-09-16T18:01:26.340509] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (2.76 seconds). [2025-09-16T18:01:26.380089] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-16T18:01:26.600428] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-16T18:01:26.605984] [INFO ] [REMOTE ] CYH: Full fetch complete (52653 records). [2025-09-16T18:01:26.606083] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-09-16T18:01:26.782730] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-09-16T18:01:26.996831] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-09-16T18:01:26.996929] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-09-16T18:01:26.997637] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-09-16T18:01:26.997717] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-09-16T18:01:26.999038] [DEBUG] [LOCAL ] CYH: Trimmed 52653 records to 35832 (keeping 150 days of data) [2025-09-16T18:01:27.202248] [DEBUG] [LOCAL ] CYH: Primary data saved (35832 records). [2025-09-16T18:01:27.202408] [INFO ] [MAIN ] CYH: Full history saved. [2025-09-16T18:01:27.202495] [INFO ] [MAIN ] Update Progress: 583/2369 symbols completed. CYH took 29.1s. Estimated remaining: 3h 8m 6s. Rate: 9.5 symbols/min [2025-09-16T18:01:27.385370] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:01:27.399156] [DEBUG] [LOCAL ] DAO: Loaded 13357 existing records from primary storage. [2025-09-16T18:01:27.399276] [INFO ] [MAIN ] DAO: Loaded 13357 existing records. [2025-09-16T18:01:27.580702] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-09-16T18:01:27.580890] [WARN ] [MAIN ] DAO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:01:27.582231] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-09-16T18:01:27.582289] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-09-16T18:01:27.582682] [DEBUG] [LOCAL ] DAO: Deleted primary data file. [2025-09-16T18:01:27.582740] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-09-16T18:01:27.951450] [INFO ] [REMOTE ] DAO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:01:27.978094] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-16T18:01:28.374899] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-09-16T18:01:28.932304] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-16T18:01:28.939070] [INFO ] [REMOTE ] D: Full fetch complete (58325 records). [2025-09-16T18:01:28.939218] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-09-16T18:01:29.181976] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-09-16T18:01:29.342889] [DEBUG] [VALIDATOR ] D: All expected trading days are present. [2025-09-16T18:01:29.343139] [DEBUG] [VALIDATOR ] D: Primary data validation passed. [2025-09-16T18:01:29.344148] [INFO ] [MAIN ] D: Fetched primary data is valid. [2025-09-16T18:01:29.344307] [DEBUG] [LOCAL ] D: Saving primary data. [2025-09-16T18:01:29.346145] [DEBUG] [LOCAL ] D: Trimmed 58325 records to 40007 (keeping 150 days of data) [2025-09-16T18:01:29.469440] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-16T18:01:29.641524] [DEBUG] [LOCAL ] D: Primary data saved (40007 records). [2025-09-16T18:01:29.641674] [INFO ] [MAIN ] D: Full history saved. [2025-09-16T18:01:29.641752] [INFO ] [MAIN ] Update Progress: 584/2369 symbols completed. D took 29.5s. Estimated remaining: 3h 7m 48s. Rate: 9.5 symbols/min [2025-09-16T18:01:29.812632] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:01:29.812826] [DEBUG] [LOCAL ] DAR: No existing data file found in primary storage. [2025-09-16T18:01:29.812865] [WARN ] [MAIN ] DAR: No existing data found, performing full refresh instead. [2025-09-16T18:01:29.812981] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-09-16T18:01:29.813021] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-09-16T18:01:29.813062] [DEBUG] [LOCAL ] DAR: No primary data file found to delete. [2025-09-16T18:01:29.813094] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-09-16T18:01:29.980203] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-09-16T18:01:30.190282] [INFO ] [REMOTE ] DAR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:01:30.249357] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-16T18:01:30.483349] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-16T18:01:30.774924] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-09-16T18:01:31.574920] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-09-16T18:01:32.310533] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-16T18:01:32.374855] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-09-16T18:01:32.872084] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (2.89 seconds). [2025-09-16T18:01:32.919145] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-16T18:01:33.174928] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-09-16T18:01:33.640120] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-16T18:01:33.974944] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-09-16T18:01:34.014081] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-16T18:01:34.774915] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-09-16T18:01:35.327849] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-16T18:01:35.574913] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-09-16T18:01:36.073118] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-16T18:01:36.374925] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-09-16T18:01:36.885144] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-16T18:01:37.174930] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-09-16T18:01:37.971239] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-16T18:01:37.975544] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-09-16T18:01:38.321554] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-16T18:01:38.774974] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-09-16T18:01:39.589348] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-09-16T18:01:39.592101] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-16T18:01:40.277990] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-16T18:01:40.374851] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-09-16T18:01:40.815273] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-16T18:01:41.174893] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-09-16T18:01:41.979957] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-09-16T18:01:41.995997] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-16T18:01:42.774928] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-09-16T18:01:43.314471] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-16T18:01:43.320699] [INFO ] [REMOTE ] DAL: Full fetch complete (58433 records). [2025-09-16T18:01:43.320817] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-09-16T18:01:43.589958] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-09-16T18:01:43.718311] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-09-16T18:01:43.718424] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-09-16T18:01:43.719187] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-09-16T18:01:43.719240] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-09-16T18:01:43.720520] [DEBUG] [LOCAL ] DAL: Trimmed 58433 records to 40103 (keeping 150 days of data) [2025-09-16T18:01:43.988089] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-16T18:01:44.016627] [DEBUG] [LOCAL ] DAL: Primary data saved (40103 records). [2025-09-16T18:01:44.016772] [INFO ] [MAIN ] DAL: Full history saved. [2025-09-16T18:01:44.016871] [INFO ] [MAIN ] Update Progress: 585/2369 symbols completed. DAL took 32.2s. Estimated remaining: 3h 8m 6s. Rate: 9.5 symbols/min [2025-09-16T18:01:44.187222] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:01:44.218369] [DEBUG] [LOCAL ] DAVA: Loaded 30318 existing records from primary storage. [2025-09-16T18:01:44.218499] [INFO ] [MAIN ] DAVA: Loaded 30318 existing records. [2025-09-16T18:01:44.378140] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-09-16T18:01:44.402134] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:01:44.403373] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-09-16T18:01:44.403476] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-09-16T18:01:44.404288] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-09-16T18:01:44.404345] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-09-16T18:01:44.665695] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-16T18:01:44.757564] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-16T18:01:44.842317] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:01:45.174904] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-09-16T18:01:45.535033] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-16T18:01:45.974904] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-09-16T18:01:46.458161] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-16T18:01:46.774946] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-09-16T18:01:47.049102] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-16T18:01:47.574946] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-09-16T18:01:48.154526] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-16T18:01:48.160534] [INFO ] [REMOTE ] DAR: Full fetch complete (55935 records). [2025-09-16T18:01:48.160711] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-09-16T18:01:48.161445] [FATAL] [VALIDATOR ] DAR: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:01:48.161532] [FATAL] [MAIN ] DAR: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:01:48.161569] [WARN ] [MAIN ] DAR: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:01:48.161616] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-09-16T18:01:48.161705] [DEBUG] [LOCAL ] DAR: No primary data file found to delete. [2025-09-16T18:01:48.161788] [INFO ] [LOCAL ] DAR: Starting deletion of derivative data. [2025-09-16T18:01:48.161843] [DEBUG] [LOCAL ] DAR: No derivative data file found to delete. [2025-09-16T18:01:48.161909] [INFO ] [MAIN ] Update Progress: 586/2369 symbols completed. DAR took 18.5s. Estimated remaining: 3h 7m 53s. Rate: 9.5 symbols/min [2025-09-16T18:01:48.334367] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:01:48.368479] [DEBUG] [LOCAL ] DAY: Loaded 36701 existing records from primary storage. [2025-09-16T18:01:48.368673] [INFO ] [MAIN ] DAY: Loaded 36701 existing records. [2025-09-16T18:01:48.380076] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-09-16T18:01:48.550090] [WARN ] [MAIN ] DAY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:01:48.550307] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-09-16T18:01:48.550355] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-09-16T18:01:48.551353] [DEBUG] [LOCAL ] DAY: Deleted primary data file. [2025-09-16T18:01:48.551405] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-09-16T18:01:48.910127] [INFO ] [REMOTE ] DAY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:01:48.968888] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-16T18:01:48.975123] [INFO ] [REMOTE ] DAN: Full fetch complete (53293 records). [2025-09-16T18:01:48.975306] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-09-16T18:01:49.175271] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-09-16T18:01:49.385625] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-16T18:01:49.503228] [DEBUG] [VALIDATOR ] DAN: All expected trading days are present. [2025-09-16T18:01:49.503334] [DEBUG] [VALIDATOR ] DAN: Primary data validation passed. [2025-09-16T18:01:49.504353] [INFO ] [MAIN ] DAN: Fetched primary data is valid. [2025-09-16T18:01:49.504450] [DEBUG] [LOCAL ] DAN: Saving primary data. [2025-09-16T18:01:49.506004] [DEBUG] [LOCAL ] DAN: Trimmed 53293 records to 36555 (keeping 150 days of data) [2025-09-16T18:01:49.871000] [DEBUG] [LOCAL ] DAN: Primary data saved (36555 records). [2025-09-16T18:01:49.871253] [INFO ] [MAIN ] DAN: Full history saved. [2025-09-16T18:01:49.871395] [INFO ] [MAIN ] Update Progress: 587/2369 symbols completed. DAN took 26.1s. Estimated remaining: 3h 7m 33s. Rate: 9.5 symbols/min [2025-09-16T18:01:49.980104] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-09-16T18:01:50.119259] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:01:50.173769] [DEBUG] [LOCAL ] DB: Loaded 38694 existing records from primary storage. [2025-09-16T18:01:50.174127] [INFO ] [MAIN ] DB: Loaded 38694 existing records. [2025-09-16T18:01:50.375366] [WARN ] [MAIN ] DB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:01:50.375613] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-09-16T18:01:50.375682] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-09-16T18:01:50.376553] [DEBUG] [LOCAL ] DB: Deleted primary data file. [2025-09-16T18:01:50.376623] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-09-16T18:01:50.759155] [INFO ] [REMOTE ] DB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:01:50.780240] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-09-16T18:01:50.793556] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-16T18:01:50.970070] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-16T18:01:50.972627] [INFO ] [REMOTE ] DAO: Full fetch complete (24373 records). [2025-09-16T18:01:50.972726] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-09-16T18:01:51.332753] [DEBUG] [VALIDATOR ] DAO: All expected trading days are present. [2025-09-16T18:01:51.332828] [DEBUG] [VALIDATOR ] DAO: Primary data validation passed. [2025-09-16T18:01:51.333248] [INFO ] [MAIN ] DAO: Fetched primary data is valid. [2025-09-16T18:01:51.333288] [DEBUG] [LOCAL ] DAO: Saving primary data. [2025-09-16T18:01:51.333940] [DEBUG] [LOCAL ] DAO: Trimmed 24373 records to 13384 (keeping 150 days of data) [2025-09-16T18:01:51.409966] [DEBUG] [LOCAL ] DAO: Primary data saved (13384 records). [2025-09-16T18:01:51.410115] [INFO ] [MAIN ] DAO: Full history saved. [2025-09-16T18:01:51.410201] [INFO ] [MAIN ] Update Progress: 588/2369 symbols completed. DAO took 24.2s. Estimated remaining: 3h 7m 12s. Rate: 9.5 symbols/min [2025-09-16T18:01:51.577766] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:01:51.577866] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-09-16T18:01:51.579169] [DEBUG] [LOCAL ] DBD: No existing data file found in primary storage. [2025-09-16T18:01:51.579232] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-09-16T18:01:51.579364] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-09-16T18:01:51.579403] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-09-16T18:01:51.579444] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-09-16T18:01:51.579477] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-09-16T18:01:51.971055] [INFO ] [REMOTE ] DBD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:01:52.374914] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-09-16T18:01:53.128890] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-09-16T18:01:53.174446] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-16T18:01:53.184622] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-09-16T18:01:53.195812] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-16T18:01:53.974898] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-09-16T18:01:54.759264] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-16T18:01:54.774866] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-09-16T18:01:55.263801] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-16T18:01:55.574912] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-09-16T18:01:56.374895] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-09-16T18:01:56.804016] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-16T18:01:56.900582] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-16T18:01:57.174902] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-09-16T18:01:57.543053] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-16T18:01:57.974904] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-09-16T18:01:58.312541] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-16T18:01:58.774919] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-09-16T18:01:59.574908] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-09-16T18:01:59.661856] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-16T18:02:00.257336] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-16T18:02:00.374903] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-09-16T18:02:01.174899] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-09-16T18:02:01.344222] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-16T18:02:01.974911] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-09-16T18:02:02.081732] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-16T18:02:02.454403] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-16T18:02:02.774927] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-09-16T18:02:03.574917] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-09-16T18:02:03.847986] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-16T18:02:04.374933] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-09-16T18:02:04.411201] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-16T18:02:04.882037] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-16T18:02:05.175044] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-09-16T18:02:05.497559] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-16T18:02:05.974917] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-09-16T18:02:06.774908] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-09-16T18:02:06.810058] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-16T18:02:06.869224] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-16T18:02:07.574928] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-09-16T18:02:07.972701] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-16T18:02:08.374900] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-09-16T18:02:08.831888] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-16T18:02:09.174912] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-09-16T18:02:09.974910] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-09-16T18:02:10.199462] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-16T18:02:10.363222] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-16T18:02:10.774913] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-09-16T18:02:11.512796] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-16T18:02:11.518260] [INFO ] [REMOTE ] DAY: Full fetch complete (54138 records). [2025-09-16T18:02:11.518419] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-09-16T18:02:11.519225] [FATAL] [VALIDATOR ] DAY: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:02:11.519315] [FATAL] [MAIN ] DAY: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:02:11.519353] [WARN ] [MAIN ] DAY: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:02:11.519407] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-09-16T18:02:11.519470] [DEBUG] [LOCAL ] DAY: No primary data file found to delete. [2025-09-16T18:02:11.519506] [INFO ] [LOCAL ] DAY: Starting deletion of derivative data. [2025-09-16T18:02:11.519892] [DEBUG] [LOCAL ] DAY: Deleted derivative data file. [2025-09-16T18:02:11.519987] [INFO ] [MAIN ] Update Progress: 589/2369 symbols completed. DAY took 23.4s. Estimated remaining: 3h 7m 48s. Rate: 9.5 symbols/min [2025-09-16T18:02:11.584589] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-09-16T18:02:11.696398] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:02:11.726455] [DEBUG] [LOCAL ] DBI: Loaded 32715 existing records from primary storage. [2025-09-16T18:02:11.726596] [INFO ] [MAIN ] DBI: Loaded 32715 existing records. [2025-09-16T18:02:11.918412] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-16T18:02:11.917866] [WARN ] [MAIN ] DBI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:02:11.921611] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-09-16T18:02:11.921703] [INFO ] [REMOTE ] DBD: Full fetch complete (24936 records). [2025-09-16T18:02:11.921862] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-09-16T18:02:11.921821] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-09-16T18:02:11.922466] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:02:11.922572] [FATAL] [MAIN ] DBD: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:02:11.922672] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:02:11.922741] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-09-16T18:02:11.922794] [DEBUG] [LOCAL ] DBI: Deleted primary data file. [2025-09-16T18:02:11.922843] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-09-16T18:02:11.922928] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-09-16T18:02:11.922964] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-09-16T18:02:11.928792] [DEBUG] [LOCAL ] DBD: No derivative data file found to delete. [2025-09-16T18:02:11.993453] [INFO ] [MAIN ] Update Progress: 590/2369 symbols completed. DBD took 20.6s. Estimated remaining: 3h 7m 24s. Rate: 9.5 symbols/min [2025-09-16T18:02:12.385997] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:02:12.380187] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-09-16T18:02:12.469419] [DEBUG] [LOCAL ] DBL: Loaded 7034 existing records from primary storage. [2025-09-16T18:02:12.469215] [INFO ] [REMOTE ] DBI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:02:12.469776] [INFO ] [MAIN ] DBL: Loaded 7034 existing records. [2025-09-16T18:02:12.650170] [WARN ] [MAIN ] DBL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:02:12.650405] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-09-16T18:02:12.650451] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-09-16T18:02:12.650843] [DEBUG] [LOCAL ] DBL: Deleted primary data file. [2025-09-16T18:02:12.650904] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-09-16T18:02:13.015634] [INFO ] [REMOTE ] DBL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:02:13.046366] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-16T18:02:13.174912] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-09-16T18:02:13.865915] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-16T18:02:13.974916] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-09-16T18:02:14.017775] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-16T18:02:14.774918] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-09-16T18:02:15.574913] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-09-16T18:02:15.702801] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-16T18:02:16.374917] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-09-16T18:02:16.560223] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-16T18:02:16.566395] [INFO ] [REMOTE ] DAVA: Full fetch complete (43462 records). [2025-09-16T18:02:16.566564] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-09-16T18:02:16.969166] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-09-16T18:02:16.969268] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-09-16T18:02:16.969990] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-09-16T18:02:16.970059] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-09-16T18:02:16.972195] [DEBUG] [LOCAL ] DAVA: Trimmed 43462 records to 30657 (keeping 150 days of data) [2025-09-16T18:02:17.167507] [DEBUG] [LOCAL ] DAVA: Primary data saved (30657 records). [2025-09-16T18:02:17.167688] [INFO ] [MAIN ] DAVA: Full history saved. [2025-09-16T18:02:17.168456] [INFO ] [MAIN ] Update Progress: 591/2369 symbols completed. DAVA took 33.2s. Estimated remaining: 3h 7m 14s. Rate: 9.5 symbols/min [2025-09-16T18:02:17.201092] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-09-16T18:02:17.346070] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:02:17.387668] [DEBUG] [LOCAL ] DBRG: Loaded 36678 existing records from primary storage. [2025-09-16T18:02:17.387828] [INFO ] [MAIN ] DBRG: Loaded 36678 existing records. [2025-09-16T18:02:17.571944] [WARN ] [MAIN ] DBRG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:02:17.572216] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-09-16T18:02:17.572263] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-09-16T18:02:17.573097] [DEBUG] [LOCAL ] DBRG: Deleted primary data file. [2025-09-16T18:02:17.573157] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-09-16T18:02:17.860968] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-16T18:02:17.958706] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:02:17.976625] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-09-16T18:02:17.980027] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-09-16T18:02:17.988658] [INFO ] [REMOTE ] DB: Full fetch complete (57116 records). [2025-09-16T18:02:17.988842] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-09-16T18:02:18.122765] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-16T18:02:18.410455] [DEBUG] [VALIDATOR ] DB: All expected trading days are present. [2025-09-16T18:02:18.410535] [DEBUG] [VALIDATOR ] DB: Primary data validation passed. [2025-09-16T18:02:18.411229] [INFO ] [MAIN ] DB: Fetched primary data is valid. [2025-09-16T18:02:18.411293] [DEBUG] [LOCAL ] DB: Saving primary data. [2025-09-16T18:02:18.412754] [DEBUG] [LOCAL ] DB: Trimmed 57116 records to 39078 (keeping 150 days of data) [2025-09-16T18:02:18.650387] [DEBUG] [LOCAL ] DB: Primary data saved (39078 records). [2025-09-16T18:02:18.650514] [INFO ] [MAIN ] DB: Full history saved. [2025-09-16T18:02:18.650623] [INFO ] [MAIN ] Update Progress: 592/2369 symbols completed. DB took 28.8s. Estimated remaining: 3h 6m 53s. Rate: 9.5 symbols/min [2025-09-16T18:02:18.780047] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-09-16T18:02:18.838408] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:02:18.864726] [DEBUG] [LOCAL ] DCI: Loaded 27192 existing records from primary storage. [2025-09-16T18:02:18.864864] [INFO ] [MAIN ] DCI: Loaded 27192 existing records. [2025-09-16T18:02:19.032496] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-16T18:02:19.056751] [WARN ] [MAIN ] DCI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:02:19.057196] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-09-16T18:02:19.057260] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-09-16T18:02:19.057989] [DEBUG] [LOCAL ] DCI: Deleted primary data file. [2025-09-16T18:02:19.058053] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-09-16T18:02:19.405900] [INFO ] [REMOTE ] DCI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:02:19.574899] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-09-16T18:02:20.374904] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-09-16T18:02:20.727498] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-16T18:02:21.064251] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-16T18:02:21.174915] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-09-16T18:02:21.755748] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-16T18:02:21.974940] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-09-16T18:02:22.742006] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-16T18:02:22.774925] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-09-16T18:02:23.259560] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-16T18:02:23.574901] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-09-16T18:02:23.966002] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-16T18:02:24.374907] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-09-16T18:02:24.482066] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-16T18:02:25.174910] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-09-16T18:02:25.721123] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-16T18:02:25.974929] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-09-16T18:02:26.284031] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-16T18:02:26.774932] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-09-16T18:02:27.574921] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-09-16T18:02:27.754080] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-16T18:02:28.374909] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-09-16T18:02:28.615942] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-16T18:02:28.990038] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-16T18:02:29.081132] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-16T18:02:29.174894] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-09-16T18:02:29.974898] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-09-16T18:02:30.592075] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-16T18:02:30.774939] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-09-16T18:02:31.141293] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-16T18:02:31.574934] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-09-16T18:02:32.223734] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-16T18:02:32.374941] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-09-16T18:02:32.853505] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-16T18:02:33.174905] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-09-16T18:02:33.974905] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-09-16T18:02:34.257162] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-16T18:02:34.783619] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-09-16T18:02:34.789545] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-16T18:02:34.851120] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-16T18:02:35.574899] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-09-16T18:02:36.374894] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-09-16T18:02:36.509304] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-16T18:02:36.515047] [INFO ] [REMOTE ] DBI: Full fetch complete (49335 records). [2025-09-16T18:02:36.515284] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-09-16T18:02:36.629719] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-16T18:02:36.657230] [INFO ] [REMOTE ] DBL: Full fetch complete (9808 records). [2025-09-16T18:02:36.681260] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-09-16T18:02:36.723619] [FATAL] [VALIDATOR ] DBL: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:02:36.788828] [FATAL] [MAIN ] DBL: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:02:36.820628] [WARN ] [MAIN ] DBL: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:02:36.820761] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-09-16T18:02:36.821073] [DEBUG] [LOCAL ] DBL: No primary data file found to delete. [2025-09-16T18:02:36.836618] [INFO ] [LOCAL ] DBL: Starting deletion of derivative data. [2025-09-16T18:02:36.877941] [DEBUG] [LOCAL ] DBL: Deleted derivative data file. [2025-09-16T18:02:36.897010] [INFO ] [MAIN ] Update Progress: 593/2369 symbols completed. DBL took 24.9s. Estimated remaining: 3h 7m 22s. Rate: 9.5 symbols/min [2025-09-16T18:02:36.908964] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-09-16T18:02:36.909141] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-09-16T18:02:36.941981] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-09-16T18:02:36.974247] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-09-16T18:02:37.012521] [DEBUG] [LOCAL ] DBI: Trimmed 49335 records to 33046 (keeping 150 days of data) [2025-09-16T18:02:37.139325] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:02:37.176776] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-09-16T18:02:37.194027] [DEBUG] [LOCAL ] DCO: Loaded 10699 existing records from primary storage. [2025-09-16T18:02:37.197209] [INFO ] [MAIN ] DCO: Loaded 10699 existing records. [2025-09-16T18:02:37.456968] [WARN ] [MAIN ] DCO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:02:37.463583] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-09-16T18:02:37.464225] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-09-16T18:02:37.465790] [DEBUG] [LOCAL ] DCO: Deleted primary data file. [2025-09-16T18:02:37.466402] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-09-16T18:02:37.632727] [DEBUG] [LOCAL ] DBI: Primary data saved (33046 records). [2025-09-16T18:02:37.649012] [INFO ] [MAIN ] DBI: Full history saved. [2025-09-16T18:02:37.665820] [INFO ] [MAIN ] Update Progress: 594/2369 symbols completed. DBI took 26.1s. Estimated remaining: 3h 6m 59s. Rate: 9.5 symbols/min [2025-09-16T18:02:38.004958] [INFO ] [REMOTE ] DCO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:02:38.033899] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-16T18:02:38.016063] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-09-16T18:02:38.074175] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:02:38.114021] [DEBUG] [LOCAL ] DD: Loaded 38986 existing records from primary storage. [2025-09-16T18:02:38.114178] [INFO ] [MAIN ] DD: Loaded 38986 existing records. [2025-09-16T18:02:38.291201] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:02:38.291465] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-09-16T18:02:38.291511] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-09-16T18:02:38.292485] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-09-16T18:02:38.292535] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-09-16T18:02:38.640279] [INFO ] [REMOTE ] DD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:02:38.774854] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-09-16T18:02:38.950983] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-16T18:02:38.968784] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-16T18:02:39.574914] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-09-16T18:02:40.374907] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-09-16T18:02:40.558538] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-16T18:02:41.174949] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-09-16T18:02:41.196097] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-16T18:02:41.325682] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-16T18:02:41.331549] [INFO ] [REMOTE ] DBRG: Full fetch complete (54306 records). [2025-09-16T18:02:41.331683] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-09-16T18:02:41.719440] [DEBUG] [VALIDATOR ] DBRG: All expected trading days are present. [2025-09-16T18:02:41.719538] [DEBUG] [VALIDATOR ] DBRG: Primary data validation passed. [2025-09-16T18:02:41.720291] [INFO ] [MAIN ] DBRG: Fetched primary data is valid. [2025-09-16T18:02:41.720389] [DEBUG] [LOCAL ] DBRG: Saving primary data. [2025-09-16T18:02:41.721593] [DEBUG] [LOCAL ] DBRG: Trimmed 54306 records to 36985 (keeping 150 days of data) [2025-09-16T18:02:41.949442] [DEBUG] [LOCAL ] DBRG: Primary data saved (36985 records). [2025-09-16T18:02:41.949590] [INFO ] [MAIN ] DBRG: Full history saved. [2025-09-16T18:02:41.951155] [INFO ] [MAIN ] Update Progress: 595/2369 symbols completed. DBRG took 24.8s. Estimated remaining: 3h 6m 47s. Rate: 9.5 symbols/min [2025-09-16T18:02:41.981943] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-09-16T18:02:42.125353] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:02:42.164546] [DEBUG] [LOCAL ] DDD: Loaded 37346 existing records from primary storage. [2025-09-16T18:02:42.164709] [INFO ] [MAIN ] DDD: Loaded 37346 existing records. [2025-09-16T18:02:42.347171] [WARN ] [MAIN ] DDD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:02:42.347469] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-09-16T18:02:42.347517] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-09-16T18:02:42.348330] [DEBUG] [LOCAL ] DDD: Deleted primary data file. [2025-09-16T18:02:42.348386] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-09-16T18:02:42.734546] [INFO ] [REMOTE ] DDD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:02:42.774955] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-09-16T18:02:43.574973] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-09-16T18:02:43.778443] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-16T18:02:44.048010] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-16T18:02:44.374884] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-09-16T18:02:44.499468] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (3.32 seconds). [2025-09-16T18:02:45.174847] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-09-16T18:02:45.190992] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-16T18:02:45.271132] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-16T18:02:45.974897] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-09-16T18:02:46.536200] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-16T18:02:46.774900] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-09-16T18:02:47.307525] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-16T18:02:47.574916] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-09-16T18:02:47.897064] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-16T18:02:47.902113] [INFO ] [REMOTE ] DCI: Full fetch complete (40928 records). [2025-09-16T18:02:47.902245] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-09-16T18:02:48.289512] [DEBUG] [VALIDATOR ] DCI: All expected trading days are present. [2025-09-16T18:02:48.289590] [DEBUG] [VALIDATOR ] DCI: Primary data validation passed. [2025-09-16T18:02:48.290143] [INFO ] [MAIN ] DCI: Fetched primary data is valid. [2025-09-16T18:02:48.290188] [DEBUG] [LOCAL ] DCI: Saving primary data. [2025-09-16T18:02:48.291092] [DEBUG] [LOCAL ] DCI: Trimmed 40928 records to 27450 (keeping 150 days of data) [2025-09-16T18:02:48.383224] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-09-16T18:02:48.462967] [DEBUG] [LOCAL ] DCI: Primary data saved (27450 records). [2025-09-16T18:02:48.463106] [INFO ] [MAIN ] DCI: Full history saved. [2025-09-16T18:02:48.463194] [INFO ] [MAIN ] Update Progress: 596/2369 symbols completed. DCI took 29.8s. Estimated remaining: 3h 6m 41s. Rate: 9.5 symbols/min [2025-09-16T18:02:48.632576] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:02:48.656830] [DEBUG] [LOCAL ] DDL: Loaded 25348 existing records from primary storage. [2025-09-16T18:02:48.656961] [INFO ] [MAIN ] DDL: Loaded 25348 existing records. [2025-09-16T18:02:48.836959] [WARN ] [MAIN ] DDL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:02:48.837380] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-09-16T18:02:48.837488] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-09-16T18:02:48.838123] [DEBUG] [LOCAL ] DDL: Deleted primary data file. [2025-09-16T18:02:48.838176] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-09-16T18:02:49.196579] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-09-16T18:02:49.223160] [INFO ] [REMOTE ] DDL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:02:49.228040] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-16T18:02:49.887282] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-16T18:02:49.909478] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-16T18:02:49.974864] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-09-16T18:02:50.774904] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-09-16T18:02:51.552778] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-16T18:02:51.574860] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-09-16T18:02:52.003778] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-16T18:02:52.374942] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-09-16T18:02:52.714695] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-16T18:02:53.174921] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-09-16T18:02:53.491604] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-16T18:02:53.974922] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-09-16T18:02:54.413347] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-16T18:02:54.774932] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-09-16T18:02:55.133334] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-16T18:02:55.574896] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-09-16T18:02:56.375006] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-09-16T18:02:56.533009] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-16T18:02:56.856461] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-16T18:02:57.174919] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-09-16T18:02:57.974893] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-09-16T18:02:58.028549] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-16T18:02:58.065267] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-16T18:02:58.719960] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-16T18:02:58.774866] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-09-16T18:02:59.574899] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-09-16T18:02:59.716546] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-16T18:03:00.374906] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-09-16T18:03:01.174918] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-09-16T18:03:01.384933] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-16T18:03:01.974921] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-09-16T18:03:02.774908] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-09-16T18:03:03.513663] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-16T18:03:03.574848] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-09-16T18:03:04.006452] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (3.63 seconds). [2025-09-16T18:03:04.374913] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-09-16T18:03:04.673143] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-16T18:03:05.174895] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-09-16T18:03:05.347788] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (3.37 seconds). [2025-09-16T18:03:05.353888] [INFO ] [REMOTE ] DDD: Full fetch complete (55233 records). [2025-09-16T18:03:05.354028] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-09-16T18:03:05.739928] [DEBUG] [VALIDATOR ] DDD: All expected trading days are present. [2025-09-16T18:03:05.740041] [DEBUG] [VALIDATOR ] DDD: Primary data validation passed. [2025-09-16T18:03:05.740834] [INFO ] [MAIN ] DDD: Fetched primary data is valid. [2025-09-16T18:03:05.740885] [DEBUG] [LOCAL ] DDD: Saving primary data. [2025-09-16T18:03:05.742301] [DEBUG] [LOCAL ] DDD: Trimmed 55233 records to 37715 (keeping 150 days of data) [2025-09-16T18:03:05.954549] [DEBUG] [LOCAL ] DDD: Primary data saved (37715 records). [2025-09-16T18:03:05.954693] [INFO ] [MAIN ] DDD: Full history saved. [2025-09-16T18:03:05.955707] [INFO ] [MAIN ] Update Progress: 597/2369 symbols completed. DDD took 24.0s. Estimated remaining: 3h 7m 8s. Rate: 9.5 symbols/min [2025-09-16T18:03:06.125449] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-16T18:03:06.128101] [INFO ] [REMOTE ] DCO: Full fetch complete (14502 records). [2025-09-16T18:03:06.128178] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-09-16T18:03:06.128839] [FATAL] [VALIDATOR ] DCO: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:03:06.128916] [FATAL] [MAIN ] DCO: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:03:06.128953] [WARN ] [MAIN ] DCO: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:03:06.128994] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-09-16T18:03:06.129051] [DEBUG] [LOCAL ] DCO: No primary data file found to delete. [2025-09-16T18:03:06.129086] [INFO ] [LOCAL ] DCO: Starting deletion of derivative data. [2025-09-16T18:03:06.129610] [DEBUG] [LOCAL ] DCO: Deleted derivative data file. [2025-09-16T18:03:06.129708] [INFO ] [MAIN ] Update Progress: 598/2369 symbols completed. DCO took 29.2s. Estimated remaining: 3h 6m 44s. Rate: 9.5 symbols/min [2025-09-16T18:03:06.461608] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (2.89 seconds). [2025-09-16T18:03:06.473577] [INFO ] [REMOTE ] DD: Full fetch complete (57376 records). [2025-09-16T18:03:06.479111] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-09-16T18:03:06.479988] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-16T18:03:06.554264] [INFO ] [REMOTE ] DDL: Full fetch complete (39202 records). [2025-09-16T18:03:06.585790] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-09-16T18:03:06.589159] [FATAL] [VALIDATOR ] DDL: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:03:06.610318] [FATAL] [MAIN ] DDL: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:03:06.647948] [WARN ] [MAIN ] DDL: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:03:06.667835] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-09-16T18:03:06.679439] [DEBUG] [LOCAL ] DDL: No primary data file found to delete. [2025-09-16T18:03:06.730103] [INFO ] [LOCAL ] DDL: Starting deletion of derivative data. [2025-09-16T18:03:06.768171] [DEBUG] [LOCAL ] DDL: Deleted derivative data file. [2025-09-16T18:03:06.787571] [INFO ] [MAIN ] Update Progress: 599/2369 symbols completed. DDL took 18.3s. Estimated remaining: 3h 6m 21s. Rate: 9.5 symbols/min [2025-09-16T18:03:06.878214] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-09-16T18:03:06.878286] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-09-16T18:03:06.879064] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-09-16T18:03:06.879111] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-09-16T18:03:06.880256] [DEBUG] [LOCAL ] DD: Trimmed 57376 records to 39373 (keeping 150 days of data) [2025-09-16T18:03:07.127751] [DEBUG] [LOCAL ] DD: Primary data saved (39373 records). [2025-09-16T18:03:07.127893] [INFO ] [MAIN ] DD: Full history saved. [2025-09-16T18:03:07.127977] [INFO ] [MAIN ] Update Progress: 600/2369 symbols completed. DD took 29.5s. Estimated remaining: 3h 5m 57s. Rate: 9.5 symbols/min [2025-09-16T18:03:07.737679] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:03:07.700366] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:03:07.775552] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:03:07.848365] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:03:07.848730] [DEBUG] [LOCAL ] DE: No existing data file found in primary storage. [2025-09-16T18:03:07.848921] [WARN ] [MAIN ] DE: No existing data found, performing full refresh instead. [2025-09-16T18:03:07.849523] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-09-16T18:03:07.851465] [DEBUG] [LOCAL ] DDT: Loaded 1355 existing records from primary storage. [2025-09-16T18:03:07.857549] [INFO ] [MAIN ] DDT: Loaded 1355 existing records. [2025-09-16T18:03:07.849736] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-09-16T18:03:07.874796] [DEBUG] [LOCAL ] DE: No primary data file found to delete. [2025-09-16T18:03:07.863690] [DEBUG] [LOCAL ] DDS: Loaded 9514 existing records from primary storage. [2025-09-16T18:03:07.880201] [INFO ] [MAIN ] DDS: Loaded 9514 existing records. [2025-09-16T18:03:07.888929] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-09-16T18:03:08.281654] [DEBUG] [LOCAL ] DEA: Loaded 29061 existing records from primary storage. [2025-09-16T18:03:08.312320] [WARN ] [MAIN ] DDT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:03:08.321328] [INFO ] [MAIN ] DEA: Loaded 29061 existing records. [2025-09-16T18:03:08.401201] [WARN ] [MAIN ] DDS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:03:08.412671] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-09-16T18:03:08.444616] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-09-16T18:03:08.507272] [DEBUG] [LOCAL ] DDT: Deleted primary data file. [2025-09-16T18:03:08.521708] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-09-16T18:03:08.493603] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-09-16T18:03:08.569730] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-09-16T18:03:08.631070] [DEBUG] [LOCAL ] DDS: Deleted primary data file. [2025-09-16T18:03:08.647124] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-09-16T18:03:09.002435] [INFO ] [REMOTE ] DE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:03:09.035555] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-09-16T18:03:09.035283] [WARN ] [MAIN ] DEA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:03:09.059714] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-09-16T18:03:09.084679] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-09-16T18:03:09.203050] [DEBUG] [LOCAL ] DEA: Deleted primary data file. [2025-09-16T18:03:09.252685] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-09-16T18:03:09.574802] [INFO ] [REMOTE ] DDT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:03:09.585439] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-09-16T18:03:09.661132] [INFO ] [REMOTE ] DDS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:03:09.684873] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-09-16T18:03:09.868800] [INFO ] [REMOTE ] DEA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:03:09.869102] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-09-16T18:03:10.248588] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-16T18:03:10.249637] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-09-16T18:03:10.549294] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-09-16T18:03:10.550831] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-09-16T18:03:10.559458] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-16T18:03:10.774939] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-09-16T18:03:11.044993] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-16T18:03:11.235255] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-16T18:03:11.385568] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-16T18:03:11.574905] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-09-16T18:03:11.958220] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-16T18:03:12.375150] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-09-16T18:03:12.380594] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (2.51 seconds). [2025-09-16T18:03:12.744540] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-16T18:03:13.174906] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-09-16T18:03:13.974914] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-09-16T18:03:14.482155] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-16T18:03:14.532940] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-16T18:03:14.774907] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-09-16T18:03:15.166515] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-16T18:03:15.574908] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-09-16T18:03:16.066373] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-16T18:03:16.067179] [INFO ] [REMOTE ] DDT: Full fetch complete (2198 records). [2025-09-16T18:03:16.067246] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-09-16T18:03:16.383764] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-09-16T18:03:16.420867] [DEBUG] [VALIDATOR ] DDT: All expected trading days are present. [2025-09-16T18:03:16.420949] [DEBUG] [VALIDATOR ] DDT: Primary data validation passed. [2025-09-16T18:03:16.421073] [INFO ] [MAIN ] DDT: Fetched primary data is valid. [2025-09-16T18:03:16.421113] [DEBUG] [LOCAL ] DDT: Saving primary data. [2025-09-16T18:03:16.421458] [DEBUG] [LOCAL ] DDT: Trimmed 2198 records to 1367 (keeping 150 days of data) [2025-09-16T18:03:16.430429] [DEBUG] [LOCAL ] DDT: Primary data saved (1367 records). [2025-09-16T18:03:16.430491] [INFO ] [MAIN ] DDT: Full history saved. [2025-09-16T18:03:16.430561] [INFO ] [MAIN ] Update Progress: 601/2369 symbols completed. DDT took 9.3s. Estimated remaining: 3h 5m 59s. Rate: 9.5 symbols/min [2025-09-16T18:03:16.599229] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:03:16.620778] [DEBUG] [LOCAL ] DEC: Loaded 21123 existing records from primary storage. [2025-09-16T18:03:16.620912] [INFO ] [MAIN ] DEC: Loaded 21123 existing records. [2025-09-16T18:03:16.796626] [WARN ] [MAIN ] DEC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:03:16.796926] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-09-16T18:03:16.796971] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-09-16T18:03:16.797628] [DEBUG] [LOCAL ] DEC: Deleted primary data file. [2025-09-16T18:03:16.797697] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-09-16T18:03:17.143958] [INFO ] [REMOTE ] DEC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:03:17.174846] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-09-16T18:03:17.573285] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-16T18:03:17.974889] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-09-16T18:03:18.440230] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-16T18:03:18.774907] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-09-16T18:03:18.918006] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-16T18:03:19.574900] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-09-16T18:03:20.198958] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-16T18:03:20.374863] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-09-16T18:03:21.174874] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-09-16T18:03:21.451769] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-16T18:03:21.562411] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-16T18:03:21.974903] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-09-16T18:03:22.546894] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-16T18:03:22.774883] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-09-16T18:03:23.574897] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-09-16T18:03:23.727788] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-16T18:03:23.793868] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-16T18:03:24.374903] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-09-16T18:03:25.174862] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-09-16T18:03:25.401959] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-16T18:03:25.618087] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-16T18:03:25.835566] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-16T18:03:25.974922] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-09-16T18:03:26.774899] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-09-16T18:03:27.520056] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-16T18:03:27.537780] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-16T18:03:27.574842] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-09-16T18:03:28.374948] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-09-16T18:03:28.502980] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-16T18:03:28.505368] [INFO ] [REMOTE ] DDS: Full fetch complete (14723 records). [2025-09-16T18:03:28.505504] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-09-16T18:03:28.506158] [FATAL] [VALIDATOR ] DDS: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:03:28.506238] [FATAL] [MAIN ] DDS: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:03:28.506282] [WARN ] [MAIN ] DDS: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:03:28.506329] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-09-16T18:03:28.506397] [DEBUG] [LOCAL ] DDS: No primary data file found to delete. [2025-09-16T18:03:28.506435] [INFO ] [LOCAL ] DDS: Starting deletion of derivative data. [2025-09-16T18:03:28.506993] [DEBUG] [LOCAL ] DDS: Deleted derivative data file. [2025-09-16T18:03:28.507314] [INFO ] [MAIN ] Update Progress: 602/2369 symbols completed. DDS took 21.4s. Estimated remaining: 3h 6m 10s. Rate: 9.5 symbols/min [2025-09-16T18:03:28.678400] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:03:28.720740] [DEBUG] [LOCAL ] DECK: Loaded 39340 existing records from primary storage. [2025-09-16T18:03:28.720948] [INFO ] [MAIN ] DECK: Loaded 39340 existing records. [2025-09-16T18:03:28.902951] [WARN ] [MAIN ] DECK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:03:28.903249] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-09-16T18:03:28.903296] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-09-16T18:03:28.904361] [DEBUG] [LOCAL ] DECK: Deleted primary data file. [2025-09-16T18:03:28.904413] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-09-16T18:03:29.179714] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-09-16T18:03:29.265695] [INFO ] [REMOTE ] DECK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:03:29.949830] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-16T18:03:29.974840] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-09-16T18:03:30.233338] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-16T18:03:30.774902] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-09-16T18:03:31.568692] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-16T18:03:31.578133] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-09-16T18:03:31.986309] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-16T18:03:32.374917] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-09-16T18:03:33.174909] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-09-16T18:03:33.564057] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-16T18:03:33.974897] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-09-16T18:03:34.149435] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-16T18:03:34.155923] [INFO ] [REMOTE ] DE: Full fetch complete (52306 records). [2025-09-16T18:03:34.156070] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-09-16T18:03:34.552319] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-09-16T18:03:34.552445] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-09-16T18:03:34.553187] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-09-16T18:03:34.553242] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-09-16T18:03:34.554539] [DEBUG] [LOCAL ] DE: Trimmed 52306 records to 35191 (keeping 150 days of data) [2025-09-16T18:03:34.776299] [DEBUG] [LOCAL ] DE: Primary data saved (35191 records). [2025-09-16T18:03:34.776417] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-09-16T18:03:34.776615] [INFO ] [MAIN ] DE: Full history saved. [2025-09-16T18:03:34.777844] [INFO ] [MAIN ] Update Progress: 603/2369 symbols completed. DE took 27.6s. Estimated remaining: 3h 6m 3s. Rate: 9.5 symbols/min [2025-09-16T18:03:34.951354] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:03:34.986573] [DEBUG] [LOCAL ] DEI: Loaded 35546 existing records from primary storage. [2025-09-16T18:03:34.986743] [INFO ] [MAIN ] DEI: Loaded 35546 existing records. [2025-09-16T18:03:35.169032] [WARN ] [MAIN ] DEI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:03:35.169361] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-09-16T18:03:35.169413] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-09-16T18:03:35.170301] [DEBUG] [LOCAL ] DEI: Deleted primary data file. [2025-09-16T18:03:35.170351] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-09-16T18:03:35.534600] [INFO ] [REMOTE ] DEI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:03:35.564842] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-09-16T18:03:35.575356] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-09-16T18:03:35.599803] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-16T18:03:35.837786] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-16T18:03:35.841042] [INFO ] [REMOTE ] DEC: Full fetch complete (34004 records). [2025-09-16T18:03:35.841139] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-09-16T18:03:36.239605] [DEBUG] [VALIDATOR ] DEC: All expected trading days are present. [2025-09-16T18:03:36.239708] [DEBUG] [VALIDATOR ] DEC: Primary data validation passed. [2025-09-16T18:03:36.240215] [INFO ] [MAIN ] DEC: Fetched primary data is valid. [2025-09-16T18:03:36.240257] [DEBUG] [LOCAL ] DEC: Saving primary data. [2025-09-16T18:03:36.241083] [DEBUG] [LOCAL ] DEC: Trimmed 34004 records to 21218 (keeping 150 days of data) [2025-09-16T18:03:36.373814] [DEBUG] [LOCAL ] DEC: Primary data saved (21218 records). [2025-09-16T18:03:36.373969] [INFO ] [MAIN ] DEC: Full history saved. [2025-09-16T18:03:36.374052] [INFO ] [MAIN ] Update Progress: 604/2369 symbols completed. DEC took 19.9s. Estimated remaining: 3h 5m 43s. Rate: 9.5 symbols/min [2025-09-16T18:03:36.385598] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-09-16T18:03:36.551599] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:03:36.552279] [DEBUG] [LOCAL ] DELL: No existing data file found in primary storage. [2025-09-16T18:03:36.552322] [WARN ] [MAIN ] DELL: No existing data found, performing full refresh instead. [2025-09-16T18:03:36.552499] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-09-16T18:03:36.552543] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-09-16T18:03:36.552586] [DEBUG] [LOCAL ] DELL: No primary data file found to delete. [2025-09-16T18:03:36.552619] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-09-16T18:03:36.906256] [INFO ] [REMOTE ] DELL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:03:36.960737] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-16T18:03:37.174924] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-09-16T18:03:37.974905] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-09-16T18:03:38.141961] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-16T18:03:38.774925] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-09-16T18:03:39.432941] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-09-16T18:03:39.574892] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-09-16T18:03:39.625747] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-16T18:03:39.690445] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-16T18:03:40.374943] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-09-16T18:03:41.174930] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-09-16T18:03:41.960723] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-09-16T18:03:41.974844] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-09-16T18:03:42.181979] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-16T18:03:42.564083] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-16T18:03:42.774915] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-09-16T18:03:43.574918] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-09-16T18:03:43.953703] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-16T18:03:44.374941] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-09-16T18:03:44.511295] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-16T18:03:45.174961] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-09-16T18:03:45.646719] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-16T18:03:45.974927] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-09-16T18:03:46.605149] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-16T18:03:46.666892] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-16T18:03:46.774877] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-09-16T18:03:47.521288] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-16T18:03:47.526867] [INFO ] [REMOTE ] DEA: Full fetch complete (46144 records). [2025-09-16T18:03:47.526987] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-09-16T18:03:47.580049] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-09-16T18:03:47.915675] [DEBUG] [VALIDATOR ] DEA: All expected trading days are present. [2025-09-16T18:03:47.915757] [DEBUG] [VALIDATOR ] DEA: Primary data validation passed. [2025-09-16T18:03:47.916397] [INFO ] [MAIN ] DEA: Fetched primary data is valid. [2025-09-16T18:03:47.916440] [DEBUG] [LOCAL ] DEA: Saving primary data. [2025-09-16T18:03:47.917434] [DEBUG] [LOCAL ] DEA: Trimmed 46144 records to 29272 (keeping 150 days of data) [2025-09-16T18:03:48.092836] [DEBUG] [LOCAL ] DEA: Primary data saved (29272 records). [2025-09-16T18:03:48.092982] [INFO ] [MAIN ] DEA: Full history saved. [2025-09-16T18:03:48.093082] [INFO ] [MAIN ] Update Progress: 605/2369 symbols completed. DEA took 41.0s. Estimated remaining: 3h 5m 53s. Rate: 9.5 symbols/min [2025-09-16T18:03:48.270365] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:03:48.299773] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-16T18:03:48.340111] [DEBUG] [LOCAL ] DEO: Loaded 35760 existing records from primary storage. [2025-09-16T18:03:48.340249] [INFO ] [MAIN ] DEO: Loaded 35760 existing records. [2025-09-16T18:03:48.382324] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-09-16T18:03:48.518996] [WARN ] [MAIN ] DEO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:03:48.519233] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-09-16T18:03:48.519282] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-09-16T18:03:48.520168] [DEBUG] [LOCAL ] DEO: Deleted primary data file. [2025-09-16T18:03:48.520219] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-09-16T18:03:48.872948] [INFO ] [REMOTE ] DEO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:03:49.174901] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-09-16T18:03:49.562345] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-16T18:03:49.974957] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-09-16T18:03:50.259964] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-16T18:03:50.774938] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-09-16T18:03:50.974170] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (2.59 seconds). [2025-09-16T18:03:51.574954] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-09-16T18:03:51.930907] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-16T18:03:52.374972] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-09-16T18:03:52.532532] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-16T18:03:53.174867] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-09-16T18:03:53.851552] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-16T18:03:53.859008] [INFO ] [REMOTE ] DEI: Full fetch complete (52134 records). [2025-09-16T18:03:53.859254] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-09-16T18:03:53.870979] [FATAL] [VALIDATOR ] DEI: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:03:53.889572] [FATAL] [MAIN ] DEI: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:03:53.889931] [WARN ] [MAIN ] DEI: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:03:53.891809] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-16T18:03:53.890459] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-09-16T18:03:53.901989] [DEBUG] [LOCAL ] DEI: No primary data file found to delete. [2025-09-16T18:03:53.902434] [INFO ] [LOCAL ] DEI: Starting deletion of derivative data. [2025-09-16T18:03:53.903042] [DEBUG] [LOCAL ] DEI: Deleted derivative data file. [2025-09-16T18:03:53.904973] [INFO ] [MAIN ] Update Progress: 606/2369 symbols completed. DEI took 19.1s. Estimated remaining: 3h 5m 45s. Rate: 9.5 symbols/min [2025-09-16T18:03:53.983622] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-09-16T18:03:54.084110] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:03:54.110477] [DEBUG] [LOCAL ] DFH: Loaded 23634 existing records from primary storage. [2025-09-16T18:03:54.110626] [INFO ] [MAIN ] DFH: Loaded 23634 existing records. [2025-09-16T18:03:54.291094] [WARN ] [MAIN ] DFH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:03:54.291372] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-09-16T18:03:54.291613] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-09-16T18:03:54.292220] [DEBUG] [LOCAL ] DFH: Deleted primary data file. [2025-09-16T18:03:54.292269] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-09-16T18:03:54.652562] [INFO ] [REMOTE ] DFH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:03:54.695723] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-16T18:03:54.774862] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-09-16T18:03:55.574938] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-09-16T18:03:55.792993] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-16T18:03:56.318250] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-16T18:03:56.374970] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-09-16T18:03:57.174945] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-09-16T18:03:57.494528] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-16T18:03:57.688842] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-16T18:03:57.974902] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-09-16T18:03:58.268510] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-16T18:03:58.774910] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-09-16T18:03:59.457874] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-16T18:03:59.574904] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-09-16T18:03:59.826123] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-16T18:04:00.374905] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-09-16T18:04:01.174926] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-09-16T18:04:01.610743] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-16T18:04:01.974944] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-09-16T18:04:02.226670] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-16T18:04:02.774908] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-09-16T18:04:03.520505] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-09-16T18:04:03.574862] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-09-16T18:04:03.677686] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-16T18:04:03.719777] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-16T18:04:04.374930] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-09-16T18:04:05.119377] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-16T18:04:05.125675] [INFO ] [REMOTE ] DECK: Full fetch complete (57994 records). [2025-09-16T18:04:05.125823] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-09-16T18:04:05.185579] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-09-16T18:04:05.535241] [DEBUG] [VALIDATOR ] DECK: All expected trading days are present. [2025-09-16T18:04:05.535352] [DEBUG] [VALIDATOR ] DECK: Primary data validation passed. [2025-09-16T18:04:05.536186] [INFO ] [MAIN ] DECK: Fetched primary data is valid. [2025-09-16T18:04:05.536262] [DEBUG] [LOCAL ] DECK: Saving primary data. [2025-09-16T18:04:05.537770] [DEBUG] [LOCAL ] DECK: Trimmed 57994 records to 39727 (keeping 150 days of data) [2025-09-16T18:04:05.779865] [DEBUG] [LOCAL ] DECK: Primary data saved (39727 records). [2025-09-16T18:04:05.780018] [INFO ] [MAIN ] DECK: Full history saved. [2025-09-16T18:04:05.781024] [INFO ] [MAIN ] Update Progress: 607/2369 symbols completed. DECK took 37.3s. Estimated remaining: 3h 5m 55s. Rate: 9.5 symbols/min [2025-09-16T18:04:05.962528] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:04:05.974900] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-09-16T18:04:05.982383] [DEBUG] [LOCAL ] DFIN: Loaded 15977 existing records from primary storage. [2025-09-16T18:04:05.982522] [INFO ] [MAIN ] DFIN: Loaded 15977 existing records. [2025-09-16T18:04:06.165327] [WARN ] [MAIN ] DFIN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:04:06.165595] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-09-16T18:04:06.165663] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-09-16T18:04:06.166102] [DEBUG] [LOCAL ] DFIN: Deleted primary data file. [2025-09-16T18:04:06.166149] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-09-16T18:04:06.528061] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:04:06.545246] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-16T18:04:06.551375] [INFO ] [REMOTE ] DEO: Full fetch complete (53252 records). [2025-09-16T18:04:06.551621] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-09-16T18:04:06.690668] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-16T18:04:06.790399] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-09-16T18:04:06.980405] [DEBUG] [VALIDATOR ] DEO: All expected trading days are present. [2025-09-16T18:04:06.980493] [DEBUG] [VALIDATOR ] DEO: Primary data validation passed. [2025-09-16T18:04:06.981199] [INFO ] [MAIN ] DEO: Fetched primary data is valid. [2025-09-16T18:04:06.981248] [DEBUG] [LOCAL ] DEO: Saving primary data. [2025-09-16T18:04:06.982440] [DEBUG] [LOCAL ] DEO: Trimmed 53252 records to 36147 (keeping 150 days of data) [2025-09-16T18:04:07.209401] [DEBUG] [LOCAL ] DEO: Primary data saved (36147 records). [2025-09-16T18:04:07.209543] [INFO ] [MAIN ] DEO: Full history saved. [2025-09-16T18:04:07.209654] [INFO ] [MAIN ] Update Progress: 608/2369 symbols completed. DEO took 19.1s. Estimated remaining: 3h 5m 34s. Rate: 9.5 symbols/min [2025-09-16T18:04:07.389907] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-16T18:04:07.415101] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:04:07.415818] [DEBUG] [LOCAL ] DFP: No existing data file found in primary storage. [2025-09-16T18:04:07.415863] [WARN ] [MAIN ] DFP: No existing data found, performing full refresh instead. [2025-09-16T18:04:07.416413] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-09-16T18:04:07.416500] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-09-16T18:04:07.416550] [DEBUG] [LOCAL ] DFP: No primary data file found to delete. [2025-09-16T18:04:07.416583] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-09-16T18:04:07.590440] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-09-16T18:04:07.780819] [INFO ] [REMOTE ] DFP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:04:07.796325] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-16T18:04:08.374947] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-09-16T18:04:09.174889] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-09-16T18:04:09.499984] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-16T18:04:09.505980] [INFO ] [REMOTE ] DELL: Full fetch complete (58026 records). [2025-09-16T18:04:09.506134] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-09-16T18:04:09.506948] [FATAL] [VALIDATOR ] DELL: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:04:09.507036] [FATAL] [MAIN ] DELL: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:04:09.507075] [WARN ] [MAIN ] DELL: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:04:09.507121] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-09-16T18:04:09.507180] [DEBUG] [LOCAL ] DELL: No primary data file found to delete. [2025-09-16T18:04:09.507230] [INFO ] [LOCAL ] DELL: Starting deletion of derivative data. [2025-09-16T18:04:09.507283] [DEBUG] [LOCAL ] DELL: No derivative data file found to delete. [2025-09-16T18:04:09.507348] [INFO ] [MAIN ] Update Progress: 609/2369 symbols completed. DELL took 33.1s. Estimated remaining: 3h 5m 16s. Rate: 9.5 symbols/min [2025-09-16T18:04:09.689407] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:04:09.707199] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-16T18:04:09.748671] [DEBUG] [LOCAL ] DG: Loaded 39311 existing records from primary storage. [2025-09-16T18:04:09.748821] [INFO ] [MAIN ] DG: Loaded 39311 existing records. [2025-09-16T18:04:09.936498] [WARN ] [MAIN ] DG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:04:09.936787] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-09-16T18:04:09.936833] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-09-16T18:04:09.937740] [DEBUG] [LOCAL ] DG: Deleted primary data file. [2025-09-16T18:04:09.937828] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-09-16T18:04:09.982517] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-09-16T18:04:10.310194] [INFO ] [REMOTE ] DG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:04:10.774892] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-09-16T18:04:10.835804] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-16T18:04:10.895815] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-16T18:04:11.574909] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-09-16T18:04:11.969035] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-16T18:04:12.374910] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-09-16T18:04:12.450837] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-16T18:04:13.174907] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-09-16T18:04:13.674193] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-16T18:04:13.974916] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-09-16T18:04:14.319940] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-16T18:04:14.774941] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-09-16T18:04:14.993293] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-16T18:04:14.997069] [INFO ] [REMOTE ] DFH: Full fetch complete (36003 records). [2025-09-16T18:04:14.997176] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-09-16T18:04:14.997787] [FATAL] [VALIDATOR ] DFH: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:04:14.997867] [FATAL] [MAIN ] DFH: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:04:14.997907] [WARN ] [MAIN ] DFH: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:04:14.997948] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-09-16T18:04:14.998009] [DEBUG] [LOCAL ] DFH: No primary data file found to delete. [2025-09-16T18:04:14.998047] [INFO ] [LOCAL ] DFH: Starting deletion of derivative data. [2025-09-16T18:04:14.998284] [DEBUG] [LOCAL ] DFH: Deleted derivative data file. [2025-09-16T18:04:14.998367] [INFO ] [MAIN ] Update Progress: 610/2369 symbols completed. DFH took 21.1s. Estimated remaining: 3h 5m 7s. Rate: 9.5 symbols/min [2025-09-16T18:04:15.179239] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:04:15.214917] [DEBUG] [LOCAL ] DGX: Loaded 32994 existing records from primary storage. [2025-09-16T18:04:15.215089] [INFO ] [MAIN ] DGX: Loaded 32994 existing records. [2025-09-16T18:04:15.405442] [WARN ] [MAIN ] DGX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:04:15.406375] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-16T18:04:15.406711] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-09-16T18:04:15.409503] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-09-16T18:04:15.410986] [DEBUG] [LOCAL ] DGX: Deleted primary data file. [2025-09-16T18:04:15.411057] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-09-16T18:04:15.595106] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-09-16T18:04:15.776694] [INFO ] [REMOTE ] DGX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:04:16.374874] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-09-16T18:04:16.484786] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-16T18:04:17.174906] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-09-16T18:04:17.203131] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-16T18:04:17.974902] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-09-16T18:04:18.740377] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-16T18:04:18.774869] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-09-16T18:04:18.873301] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-16T18:04:19.574915] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-09-16T18:04:20.374906] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-09-16T18:04:20.505076] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-16T18:04:20.548256] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-16T18:04:21.174910] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-09-16T18:04:21.974888] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-09-16T18:04:22.217035] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-16T18:04:22.774904] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-09-16T18:04:22.941219] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-16T18:04:22.944180] [INFO ] [REMOTE ] DFIN: Full fetch complete (25898 records). [2025-09-16T18:04:22.944295] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-09-16T18:04:22.944910] [FATAL] [VALIDATOR ] DFIN: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:04:22.944993] [FATAL] [MAIN ] DFIN: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:04:22.945031] [WARN ] [MAIN ] DFIN: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:04:22.945084] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-09-16T18:04:22.945159] [DEBUG] [LOCAL ] DFIN: No primary data file found to delete. [2025-09-16T18:04:22.945208] [INFO ] [LOCAL ] DFIN: Starting deletion of derivative data. [2025-09-16T18:04:22.945518] [DEBUG] [LOCAL ] DFIN: Deleted derivative data file. [2025-09-16T18:04:22.945672] [INFO ] [MAIN ] Update Progress: 611/2369 symbols completed. DFIN took 17.2s. Estimated remaining: 3h 5m 6s. Rate: 9.5 symbols/min [2025-09-16T18:04:23.132719] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:04:23.170482] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-16T18:04:23.186559] [DEBUG] [LOCAL ] DHF: Loaded 15803 existing records from primary storage. [2025-09-16T18:04:23.186951] [INFO ] [MAIN ] DHF: Loaded 15803 existing records. [2025-09-16T18:04:23.371580] [WARN ] [MAIN ] DHF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:04:23.371858] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-09-16T18:04:23.371932] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-09-16T18:04:23.372381] [DEBUG] [LOCAL ] DHF: Deleted primary data file. [2025-09-16T18:04:23.372431] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-09-16T18:04:23.586020] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-09-16T18:04:23.738769] [INFO ] [REMOTE ] DHF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:04:24.374861] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-09-16T18:04:24.493783] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-16T18:04:25.185603] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-09-16T18:04:25.190750] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-16T18:04:25.449174] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-16T18:04:25.974886] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-09-16T18:04:26.774945] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-09-16T18:04:27.004540] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-16T18:04:27.091636] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-16T18:04:27.574910] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-09-16T18:04:27.817881] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-16T18:04:28.374931] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-09-16T18:04:29.174920] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-09-16T18:04:29.512597] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-16T18:04:29.974864] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-09-16T18:04:30.279830] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-16T18:04:30.537446] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-16T18:04:30.774959] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-09-16T18:04:31.353068] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-16T18:04:31.574935] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-09-16T18:04:32.290246] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-16T18:04:32.374869] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-09-16T18:04:32.912727] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-16T18:04:32.917381] [INFO ] [REMOTE ] DGX: Full fetch complete (49577 records). [2025-09-16T18:04:32.917494] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-09-16T18:04:32.918199] [FATAL] [VALIDATOR ] DGX: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:04:32.918287] [FATAL] [MAIN ] DGX: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:04:32.918332] [WARN ] [MAIN ] DGX: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:04:32.918385] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-09-16T18:04:32.918444] [DEBUG] [LOCAL ] DGX: No primary data file found to delete. [2025-09-16T18:04:32.918483] [INFO ] [LOCAL ] DGX: Starting deletion of derivative data. [2025-09-16T18:04:32.918727] [DEBUG] [LOCAL ] DGX: Deleted derivative data file. [2025-09-16T18:04:32.918810] [INFO ] [MAIN ] Update Progress: 612/2369 symbols completed. DGX took 17.9s. Estimated remaining: 3h 5m 10s. Rate: 9.5 symbols/min [2025-09-16T18:04:33.088025] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:04:33.130888] [DEBUG] [LOCAL ] DHI: Loaded 39418 existing records from primary storage. [2025-09-16T18:04:33.131028] [INFO ] [MAIN ] DHI: Loaded 39418 existing records. [2025-09-16T18:04:33.186161] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-09-16T18:04:33.318684] [WARN ] [MAIN ] DHI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:04:33.318965] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-09-16T18:04:33.319014] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-09-16T18:04:33.320022] [DEBUG] [LOCAL ] DHI: Deleted primary data file. [2025-09-16T18:04:33.320079] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-09-16T18:04:33.673328] [INFO ] [REMOTE ] DHI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:04:33.974881] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-09-16T18:04:34.196599] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-16T18:04:34.232291] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-16T18:04:34.774908] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-09-16T18:04:35.007205] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-16T18:04:35.574912] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-09-16T18:04:36.366474] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-16T18:04:36.376926] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-09-16T18:04:36.445711] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-16T18:04:37.174933] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-09-16T18:04:37.974872] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-09-16T18:04:38.092614] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-16T18:04:38.302507] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-16T18:04:38.774896] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-09-16T18:04:38.810356] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-16T18:04:39.574906] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-09-16T18:04:40.374894] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-09-16T18:04:40.554353] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-16T18:04:40.556564] [INFO ] [REMOTE ] DFP: Full fetch complete (12830 records). [2025-09-16T18:04:40.556632] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-09-16T18:04:40.965326] [DEBUG] [VALIDATOR ] DFP: All expected trading days are present. [2025-09-16T18:04:40.965423] [DEBUG] [VALIDATOR ] DFP: Primary data validation passed. [2025-09-16T18:04:40.965854] [INFO ] [MAIN ] DFP: Fetched primary data is valid. [2025-09-16T18:04:40.965966] [DEBUG] [LOCAL ] DFP: Saving primary data. [2025-09-16T18:04:40.966622] [DEBUG] [LOCAL ] DFP: Trimmed 12830 records to 8662 (keeping 150 days of data) [2025-09-16T18:04:41.039271] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-16T18:04:41.064454] [DEBUG] [LOCAL ] DFP: Primary data saved (8662 records). [2025-09-16T18:04:41.064572] [INFO ] [MAIN ] DFP: Full history saved. [2025-09-16T18:04:41.064663] [INFO ] [MAIN ] Update Progress: 613/2369 symbols completed. DFP took 33.9s. Estimated remaining: 3h 5m 9s. Rate: 9.5 symbols/min [2025-09-16T18:04:41.176635] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-09-16T18:04:41.283622] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:04:41.284773] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-16T18:04:41.334342] [DEBUG] [LOCAL ] DHR: Loaded 39395 existing records from primary storage. [2025-09-16T18:04:41.334492] [INFO ] [MAIN ] DHR: Loaded 39395 existing records. [2025-09-16T18:04:41.516755] [WARN ] [MAIN ] DHR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:04:41.517021] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-09-16T18:04:41.517069] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-09-16T18:04:41.517928] [DEBUG] [LOCAL ] DHR: Deleted primary data file. [2025-09-16T18:04:41.518027] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-09-16T18:04:41.884863] [INFO ] [REMOTE ] DHR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:04:41.974869] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-09-16T18:04:42.774895] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-09-16T18:04:42.909846] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-16T18:04:43.166332] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-16T18:04:43.574924] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-09-16T18:04:44.374917] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-09-16T18:04:44.426082] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-16T18:04:44.661831] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-16T18:04:44.669662] [INFO ] [REMOTE ] DG: Full fetch complete (57958 records). [2025-09-16T18:04:44.669810] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-09-16T18:04:45.055497] [DEBUG] [VALIDATOR ] DG: All expected trading days are present. [2025-09-16T18:04:45.055581] [DEBUG] [VALIDATOR ] DG: Primary data validation passed. [2025-09-16T18:04:45.056402] [INFO ] [MAIN ] DG: Fetched primary data is valid. [2025-09-16T18:04:45.056462] [DEBUG] [LOCAL ] DG: Saving primary data. [2025-09-16T18:04:45.058786] [DEBUG] [LOCAL ] DG: Trimmed 57958 records to 39688 (keeping 150 days of data) [2025-09-16T18:04:45.177743] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-09-16T18:04:45.312492] [DEBUG] [LOCAL ] DG: Primary data saved (39688 records). [2025-09-16T18:04:45.312655] [INFO ] [MAIN ] DG: Full history saved. [2025-09-16T18:04:45.312767] [INFO ] [MAIN ] Update Progress: 614/2369 symbols completed. DG took 35.8s. Estimated remaining: 3h 4m 57s. Rate: 9.5 symbols/min [2025-09-16T18:04:45.483848] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:04:45.484036] [DEBUG] [LOCAL ] DHT: No existing data file found in primary storage. [2025-09-16T18:04:45.484075] [WARN ] [MAIN ] DHT: No existing data found, performing full refresh instead. [2025-09-16T18:04:45.484206] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-09-16T18:04:45.484246] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-09-16T18:04:45.484288] [DEBUG] [LOCAL ] DHT: No primary data file found to delete. [2025-09-16T18:04:45.484321] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-09-16T18:04:45.845169] [INFO ] [REMOTE ] DHT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:04:45.974866] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-09-16T18:04:46.088421] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-16T18:04:46.774914] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-09-16T18:04:46.985581] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-16T18:04:47.574893] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-09-16T18:04:47.608531] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-16T18:04:48.374954] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-09-16T18:04:48.607700] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-16T18:04:48.773250] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-16T18:04:48.777309] [INFO ] [REMOTE ] DHF: Full fetch complete (22577 records). [2025-09-16T18:04:48.777492] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-09-16T18:04:49.180084] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-09-16T18:04:49.359420] [DEBUG] [VALIDATOR ] DHF: All expected trading days are present. [2025-09-16T18:04:49.359509] [DEBUG] [VALIDATOR ] DHF: Primary data validation passed. [2025-09-16T18:04:49.360022] [INFO ] [MAIN ] DHF: Fetched primary data is valid. [2025-09-16T18:04:49.360068] [DEBUG] [LOCAL ] DHF: Saving primary data. [2025-09-16T18:04:49.361003] [DEBUG] [LOCAL ] DHF: Trimmed 22577 records to 15920 (keeping 150 days of data) [2025-09-16T18:04:49.464678] [DEBUG] [LOCAL ] DHF: Primary data saved (15920 records). [2025-09-16T18:04:49.464843] [INFO ] [MAIN ] DHF: Full history saved. [2025-09-16T18:04:49.464957] [INFO ] [MAIN ] Update Progress: 615/2369 symbols completed. DHF took 26.5s. Estimated remaining: 3h 4m 44s. Rate: 9.5 symbols/min [2025-09-16T18:04:49.638032] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:04:49.647610] [DEBUG] [LOCAL ] DHX: Loaded 9039 existing records from primary storage. [2025-09-16T18:04:49.647726] [INFO ] [MAIN ] DHX: Loaded 9039 existing records. [2025-09-16T18:04:49.823708] [WARN ] [MAIN ] DHX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:04:49.824229] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-09-16T18:04:49.824337] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-09-16T18:04:49.824776] [DEBUG] [LOCAL ] DHX: Deleted primary data file. [2025-09-16T18:04:49.824876] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-09-16T18:04:49.982603] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-09-16T18:04:50.218610] [INFO ] [REMOTE ] DHX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:04:50.224594] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-16T18:04:50.774934] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-09-16T18:04:50.904778] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-16T18:04:51.574871] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-09-16T18:04:51.939219] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-16T18:04:52.049930] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-16T18:04:52.374889] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-09-16T18:04:53.179982] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-09-16T18:04:53.198068] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-16T18:04:53.242299] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-16T18:04:53.974887] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-09-16T18:04:54.774916] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-09-16T18:04:54.919035] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-16T18:04:55.014128] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-16T18:04:55.574898] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-09-16T18:04:56.374914] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-09-16T18:04:56.591679] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-16T18:04:57.104731] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-16T18:04:57.174881] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-09-16T18:04:57.974928] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-09-16T18:04:58.097312] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-16T18:04:58.774910] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-09-16T18:04:59.081886] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-16T18:04:59.574945] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-09-16T18:05:00.194223] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-16T18:05:00.226988] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-16T18:05:00.375073] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-09-16T18:05:00.382270] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-16T18:05:01.174900] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-09-16T18:05:01.974962] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-09-16T18:05:02.774911] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-09-16T18:05:03.541196] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-16T18:05:03.574868] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-09-16T18:05:04.646282] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (4.27 seconds). [2025-09-16T18:05:04.649369] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-09-16T18:05:04.899083] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-16T18:05:05.066492] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-09-16T18:05:05.073714] [INFO ] [REMOTE ] DHI: Full fetch complete (58039 records). [2025-09-16T18:05:05.073971] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-09-16T18:05:05.176523] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-09-16T18:05:05.480181] [DEBUG] [VALIDATOR ] DHI: All expected trading days are present. [2025-09-16T18:05:05.480428] [DEBUG] [VALIDATOR ] DHI: Primary data validation passed. [2025-09-16T18:05:05.481462] [INFO ] [MAIN ] DHI: Fetched primary data is valid. [2025-09-16T18:05:05.481765] [DEBUG] [LOCAL ] DHI: Saving primary data. [2025-09-16T18:05:05.483492] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-16T18:05:05.488518] [DEBUG] [LOCAL ] DHI: Trimmed 58039 records to 39803 (keeping 150 days of data) [2025-09-16T18:05:05.577310] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (4.40 seconds). [2025-09-16T18:05:05.623112] [INFO ] [REMOTE ] DHR: Full fetch complete (57653 records). [2025-09-16T18:05:05.627180] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-09-16T18:05:05.629379] [FATAL] [VALIDATOR ] DHR: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:05:05.630905] [FATAL] [MAIN ] DHR: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:05:05.631800] [WARN ] [MAIN ] DHR: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:05:05.632630] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-09-16T18:05:05.634951] [DEBUG] [LOCAL ] DHR: No primary data file found to delete. [2025-09-16T18:05:05.636028] [INFO ] [LOCAL ] DHR: Starting deletion of derivative data. [2025-09-16T18:05:05.637326] [DEBUG] [LOCAL ] DHR: Deleted derivative data file. [2025-09-16T18:05:05.637920] [INFO ] [MAIN ] Update Progress: 616/2369 symbols completed. DHR took 24.6s. Estimated remaining: 3h 5m 6s. Rate: 9.5 symbols/min [2025-09-16T18:05:05.832033] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:05:05.833729] [DEBUG] [LOCAL ] DIAX: No existing data file found in primary storage. [2025-09-16T18:05:05.834045] [WARN ] [MAIN ] DIAX: No existing data found, performing full refresh instead. [2025-09-16T18:05:05.834737] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-09-16T18:05:05.835742] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-09-16T18:05:05.836972] [DEBUG] [LOCAL ] DIAX: No primary data file found to delete. [2025-09-16T18:05:05.837302] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-09-16T18:05:05.979950] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-09-16T18:05:06.316676] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:05:06.347866] [DEBUG] [LOCAL ] DHI: Primary data saved (39803 records). [2025-09-16T18:05:06.348029] [INFO ] [MAIN ] DHI: Full history saved. [2025-09-16T18:05:06.350380] [INFO ] [MAIN ] Update Progress: 617/2369 symbols completed. DHI took 33.4s. Estimated remaining: 3h 4m 43s. Rate: 9.5 symbols/min [2025-09-16T18:05:06.526384] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:05:06.556742] [DEBUG] [LOCAL ] DIN: Loaded 26800 existing records from primary storage. [2025-09-16T18:05:06.556885] [INFO ] [MAIN ] DIN: Loaded 26800 existing records. [2025-09-16T18:05:06.738260] [WARN ] [MAIN ] DIN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:05:06.738504] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-09-16T18:05:06.738551] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-09-16T18:05:06.739368] [DEBUG] [LOCAL ] DIN: Deleted primary data file. [2025-09-16T18:05:06.739429] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-09-16T18:05:06.783404] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-09-16T18:05:07.055287] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-16T18:05:07.113291] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-16T18:05:07.153263] [INFO ] [REMOTE ] DHT: Full fetch complete (51967 records). [2025-09-16T18:05:07.153171] [INFO ] [REMOTE ] DIN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:05:07.153668] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-09-16T18:05:07.154334] [FATAL] [VALIDATOR ] DHT: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:05:07.154417] [FATAL] [MAIN ] DHT: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:05:07.154456] [WARN ] [MAIN ] DHT: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:05:07.154502] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-09-16T18:05:07.154561] [DEBUG] [LOCAL ] DHT: No primary data file found to delete. [2025-09-16T18:05:07.154598] [INFO ] [LOCAL ] DHT: Starting deletion of derivative data. [2025-09-16T18:05:07.154669] [DEBUG] [LOCAL ] DHT: No derivative data file found to delete. [2025-09-16T18:05:07.154746] [INFO ] [MAIN ] Update Progress: 618/2369 symbols completed. DHT took 21.8s. Estimated remaining: 3h 4m 22s. Rate: 9.5 symbols/min [2025-09-16T18:05:07.327903] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:05:07.366381] [DEBUG] [LOCAL ] DINO: Loaded 39092 existing records from primary storage. [2025-09-16T18:05:07.366531] [INFO ] [MAIN ] DINO: Loaded 39092 existing records. [2025-09-16T18:05:07.550012] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-16T18:05:07.553318] [WARN ] [MAIN ] DINO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:05:07.556031] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-09-16T18:05:07.556118] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-09-16T18:05:07.557099] [DEBUG] [LOCAL ] DINO: Deleted primary data file. [2025-09-16T18:05:07.557150] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-09-16T18:05:07.579946] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-09-16T18:05:07.907082] [INFO ] [REMOTE ] DINO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:05:08.374913] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-09-16T18:05:09.021435] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-16T18:05:09.174893] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-09-16T18:05:09.408564] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-16T18:05:09.974891] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-09-16T18:05:10.141421] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-16T18:05:10.774942] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-09-16T18:05:10.965927] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-16T18:05:10.968426] [INFO ] [REMOTE ] DHX: Full fetch complete (15104 records). [2025-09-16T18:05:10.968507] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-09-16T18:05:10.969003] [FATAL] [VALIDATOR ] DHX: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:05:10.969084] [FATAL] [MAIN ] DHX: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:05:10.969123] [WARN ] [MAIN ] DHX: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:05:10.969165] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-09-16T18:05:10.969223] [DEBUG] [LOCAL ] DHX: No primary data file found to delete. [2025-09-16T18:05:10.969260] [INFO ] [LOCAL ] DHX: Starting deletion of derivative data. [2025-09-16T18:05:10.969519] [DEBUG] [LOCAL ] DHX: Deleted derivative data file. [2025-09-16T18:05:10.969600] [INFO ] [MAIN ] Update Progress: 619/2369 symbols completed. DHX took 21.5s. Estimated remaining: 3h 4m 8s. Rate: 9.5 symbols/min [2025-09-16T18:05:11.140659] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:05:11.180873] [DEBUG] [LOCAL ] DIS: Loaded 39748 existing records from primary storage. [2025-09-16T18:05:11.181053] [INFO ] [MAIN ] DIS: Loaded 39748 existing records. [2025-09-16T18:05:11.358144] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:05:11.358383] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-09-16T18:05:11.358430] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-09-16T18:05:11.359396] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-09-16T18:05:11.359446] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-09-16T18:05:11.580073] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-09-16T18:05:11.725469] [INFO ] [REMOTE ] DIS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:05:12.374908] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-09-16T18:05:12.514154] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-16T18:05:13.123909] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-16T18:05:13.174914] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-09-16T18:05:13.289566] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-16T18:05:13.974953] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-09-16T18:05:14.774949] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-09-16T18:05:14.805622] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-16T18:05:15.364014] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-16T18:05:15.574905] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-09-16T18:05:16.372321] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-16T18:05:16.380475] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-09-16T18:05:17.096148] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-16T18:05:17.174924] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-09-16T18:05:17.943672] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-09-16T18:05:17.974852] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-09-16T18:05:18.578942] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-16T18:05:18.774905] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-09-16T18:05:19.473700] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-16T18:05:19.574894] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-09-16T18:05:20.374919] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-09-16T18:05:20.531803] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-16T18:05:20.533862] [INFO ] [REMOTE ] DIAX: Full fetch complete (12998 records). [2025-09-16T18:05:20.534009] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-09-16T18:05:20.534488] [FATAL] [VALIDATOR ] DIAX: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:05:20.534622] [FATAL] [MAIN ] DIAX: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:05:20.534687] [WARN ] [MAIN ] DIAX: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:05:20.534737] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-09-16T18:05:20.534857] [DEBUG] [LOCAL ] DIAX: No primary data file found to delete. [2025-09-16T18:05:20.534902] [INFO ] [LOCAL ] DIAX: Starting deletion of derivative data. [2025-09-16T18:05:20.534985] [DEBUG] [LOCAL ] DIAX: No derivative data file found to delete. [2025-09-16T18:05:20.535111] [INFO ] [MAIN ] Update Progress: 620/2369 symbols completed. DIAX took 14.9s. Estimated remaining: 3h 4m 11s. Rate: 9.5 symbols/min [2025-09-16T18:05:20.678776] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.70 seconds). [2025-09-16T18:05:20.761525] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:05:20.761786] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-09-16T18:05:20.761855] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-09-16T18:05:20.761987] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-09-16T18:05:20.762028] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-16T18:05:20.762072] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-09-16T18:05:20.762105] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-09-16T18:05:21.115582] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:05:21.174919] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-09-16T18:05:21.705727] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-16T18:05:21.974880] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-09-16T18:05:22.774904] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-09-16T18:05:22.983497] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-16T18:05:23.254308] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-16T18:05:23.574898] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-09-16T18:05:24.374901] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-09-16T18:05:24.879334] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-16T18:05:25.053581] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-16T18:05:25.174858] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-09-16T18:05:25.253766] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-09-16T18:05:25.974876] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-09-16T18:05:26.668861] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-16T18:05:26.673317] [INFO ] [REMOTE ] DIN: Full fetch complete (40362 records). [2025-09-16T18:05:26.673415] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-09-16T18:05:26.674038] [FATAL] [VALIDATOR ] DIN: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:05:26.674118] [FATAL] [MAIN ] DIN: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:05:26.674161] [WARN ] [MAIN ] DIN: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:05:26.674222] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-09-16T18:05:26.674294] [DEBUG] [LOCAL ] DIN: No primary data file found to delete. [2025-09-16T18:05:26.674344] [INFO ] [LOCAL ] DIN: Starting deletion of derivative data. [2025-09-16T18:05:26.674603] [DEBUG] [LOCAL ] DIN: Deleted derivative data file. [2025-09-16T18:05:26.674714] [INFO ] [MAIN ] Update Progress: 621/2369 symbols completed. DIN took 20.3s. Estimated remaining: 3h 4m 4s. Rate: 9.5 symbols/min [2025-09-16T18:05:26.779954] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-09-16T18:05:26.854730] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:05:26.898371] [DEBUG] [LOCAL ] DK: Loaded 36616 existing records from primary storage. [2025-09-16T18:05:26.898522] [INFO ] [MAIN ] DK: Loaded 36616 existing records. [2025-09-16T18:05:27.081188] [WARN ] [MAIN ] DK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:05:27.081439] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-09-16T18:05:27.081485] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-09-16T18:05:27.082393] [DEBUG] [LOCAL ] DK: Deleted primary data file. [2025-09-16T18:05:27.082444] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-09-16T18:05:27.342332] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-16T18:05:27.462694] [INFO ] [REMOTE ] DK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:05:27.574857] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-09-16T18:05:27.660628] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-16T18:05:27.924547] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-16T18:05:28.374911] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-09-16T18:05:28.705236] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-16T18:05:29.174912] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-09-16T18:05:29.974884] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-09-16T18:05:30.301265] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-16T18:05:30.530688] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-16T18:05:30.774942] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-09-16T18:05:31.574934] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-09-16T18:05:31.999911] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-16T18:05:32.374937] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-09-16T18:05:32.533921] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-16T18:05:33.174938] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-09-16T18:05:33.974888] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-09-16T18:05:34.528605] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-16T18:05:34.663309] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-16T18:05:34.774887] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-09-16T18:05:35.188252] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-16T18:05:35.574909] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-09-16T18:05:35.662700] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-16T18:05:35.976488] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-16T18:05:35.977222] [INFO ] [REMOTE ] DIVY: Full fetch complete (1274 records). [2025-09-16T18:05:35.977289] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-09-16T18:05:36.159013] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 148 unique days, need 150 days [2025-09-16T18:05:36.159205] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:05:36.159254] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:05:36.159295] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-16T18:05:36.159361] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-09-16T18:05:36.159398] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-09-16T18:05:36.159439] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-09-16T18:05:36.159496] [INFO ] [MAIN ] Update Progress: 622/2369 symbols completed. DIVY took 15.6s. Estimated remaining: 3h 4m 7s. Rate: 9.5 symbols/min [2025-09-16T18:05:36.368908] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:05:36.375867] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-09-16T18:05:36.383105] [DEBUG] [LOCAL ] DKL: Loaded 12610 existing records from primary storage. [2025-09-16T18:05:36.383272] [INFO ] [MAIN ] DKL: Loaded 12610 existing records. [2025-09-16T18:05:36.564980] [WARN ] [MAIN ] DKL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:05:36.565226] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-09-16T18:05:36.565272] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-09-16T18:05:36.565735] [DEBUG] [LOCAL ] DKL: Deleted primary data file. [2025-09-16T18:05:36.565787] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-09-16T18:05:36.939610] [INFO ] [REMOTE ] DKL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:05:37.174900] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-09-16T18:05:37.974943] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-09-16T18:05:38.111739] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-16T18:05:38.774919] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-09-16T18:05:38.802193] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-16T18:05:39.574955] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-09-16T18:05:40.188900] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-16T18:05:40.374900] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-09-16T18:05:40.739445] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-16T18:05:40.899280] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-16T18:05:41.174973] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-09-16T18:05:41.974936] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-09-16T18:05:42.086558] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-16T18:05:42.774912] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-09-16T18:05:43.574951] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-09-16T18:05:43.574893] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-09-16T18:05:43.765608] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-16T18:05:43.795550] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-16T18:05:44.374913] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-09-16T18:05:45.174915] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-09-16T18:05:45.262811] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-16T18:05:45.269092] [INFO ] [REMOTE ] DINO: Full fetch complete (57632 records). [2025-09-16T18:05:45.269196] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-09-16T18:05:45.654478] [DEBUG] [VALIDATOR ] DINO: All expected trading days are present. [2025-09-16T18:05:45.654575] [DEBUG] [VALIDATOR ] DINO: Primary data validation passed. [2025-09-16T18:05:45.655326] [INFO ] [MAIN ] DINO: Fetched primary data is valid. [2025-09-16T18:05:45.655379] [DEBUG] [LOCAL ] DINO: Saving primary data. [2025-09-16T18:05:45.656712] [DEBUG] [LOCAL ] DINO: Trimmed 57632 records to 39480 (keeping 150 days of data) [2025-09-16T18:05:45.908242] [DEBUG] [LOCAL ] DINO: Primary data saved (39480 records). [2025-09-16T18:05:45.908392] [INFO ] [MAIN ] DINO: Full history saved. [2025-09-16T18:05:45.908482] [INFO ] [MAIN ] Update Progress: 623/2369 symbols completed. DINO took 38.8s. Estimated remaining: 3h 4m 10s. Rate: 9.5 symbols/min [2025-09-16T18:05:45.982663] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-09-16T18:05:46.085554] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:05:46.101565] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-16T18:05:46.151256] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-16T18:05:46.161271] [INFO ] [REMOTE ] DIS: Full fetch complete (58468 records). [2025-09-16T18:05:46.162350] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-09-16T18:05:46.173677] [DEBUG] [LOCAL ] DKS: Loaded 36782 existing records from primary storage. [2025-09-16T18:05:46.173967] [INFO ] [MAIN ] DKS: Loaded 36782 existing records. [2025-09-16T18:05:46.597140] [WARN ] [MAIN ] DKS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:05:46.637593] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-09-16T18:05:46.650292] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-09-16T18:05:46.670575] [DEBUG] [LOCAL ] DKS: Deleted primary data file. [2025-09-16T18:05:46.694775] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-09-16T18:05:46.781019] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-09-16T18:05:46.904880] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-09-16T18:05:46.926031] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-09-16T18:05:46.967033] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-09-16T18:05:47.025424] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-09-16T18:05:47.098133] [DEBUG] [LOCAL ] DIS: Trimmed 58468 records to 40138 (keeping 150 days of data) [2025-09-16T18:05:47.269885] [INFO ] [REMOTE ] DKS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:05:47.457898] [DEBUG] [LOCAL ] DIS: Primary data saved (40138 records). [2025-09-16T18:05:47.458118] [INFO ] [MAIN ] DIS: Full history saved. [2025-09-16T18:05:47.459587] [INFO ] [MAIN ] Update Progress: 624/2369 symbols completed. DIS took 36.5s. Estimated remaining: 3h 3m 50s. Rate: 9.5 symbols/min [2025-09-16T18:05:47.462358] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-16T18:05:47.576409] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-09-16T18:05:47.648538] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:05:47.673555] [DEBUG] [LOCAL ] DLB: Loaded 23670 existing records from primary storage. [2025-09-16T18:05:47.673709] [INFO ] [MAIN ] DLB: Loaded 23670 existing records. [2025-09-16T18:05:47.852876] [WARN ] [MAIN ] DLB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:05:47.853137] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-09-16T18:05:47.853184] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-09-16T18:05:47.853846] [DEBUG] [LOCAL ] DLB: Deleted primary data file. [2025-09-16T18:05:47.853900] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-09-16T18:05:48.157411] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-16T18:05:48.240087] [INFO ] [REMOTE ] DLB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:05:48.374917] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-09-16T18:05:49.174952] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-09-16T18:05:49.328985] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-16T18:05:49.807415] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-16T18:05:49.903154] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-16T18:05:49.974895] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-09-16T18:05:50.774908] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-09-16T18:05:51.574877] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-09-16T18:05:51.668745] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-16T18:05:52.121722] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-16T18:05:52.374913] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-09-16T18:05:53.174955] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-09-16T18:05:53.341021] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-16T18:05:53.409015] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-16T18:05:53.974948] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-09-16T18:05:54.774903] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-09-16T18:05:55.138985] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-16T18:05:55.148381] [INFO ] [REMOTE ] DK: Full fetch complete (53801 records). [2025-09-16T18:05:55.148580] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-09-16T18:05:55.432660] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-16T18:05:55.576429] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-09-16T18:05:55.576714] [DEBUG] [VALIDATOR ] DK: All expected trading days are present. [2025-09-16T18:05:55.577468] [DEBUG] [VALIDATOR ] DK: Primary data validation passed. [2025-09-16T18:05:55.578205] [INFO ] [MAIN ] DK: Fetched primary data is valid. [2025-09-16T18:05:55.578252] [DEBUG] [LOCAL ] DK: Saving primary data. [2025-09-16T18:05:55.579523] [DEBUG] [LOCAL ] DK: Trimmed 53801 records to 36998 (keeping 150 days of data) [2025-09-16T18:05:55.811161] [DEBUG] [LOCAL ] DK: Primary data saved (36998 records). [2025-09-16T18:05:55.811309] [INFO ] [MAIN ] DK: Full history saved. [2025-09-16T18:05:55.811398] [INFO ] [MAIN ] Update Progress: 625/2369 symbols completed. DK took 29.1s. Estimated remaining: 3h 3m 50s. Rate: 9.5 symbols/min [2025-09-16T18:05:55.991960] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:05:55.998013] [DEBUG] [LOCAL ] DLNG: Loaded 4259 existing records from primary storage. [2025-09-16T18:05:55.998123] [INFO ] [MAIN ] DLNG: Loaded 4259 existing records. [2025-09-16T18:05:56.180901] [WARN ] [MAIN ] DLNG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:05:56.181176] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-09-16T18:05:56.181227] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-09-16T18:05:56.181518] [DEBUG] [LOCAL ] DLNG: Deleted primary data file. [2025-09-16T18:05:56.181567] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-09-16T18:05:56.396763] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-09-16T18:05:56.558393] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:05:56.590026] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-16T18:05:56.987092] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-16T18:05:57.174937] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-09-16T18:05:57.368182] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-16T18:05:57.974922] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-09-16T18:05:58.186668] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-16T18:05:58.774900] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-09-16T18:05:58.903400] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-16T18:05:58.905735] [INFO ] [REMOTE ] DKL: Full fetch complete (22002 records). [2025-09-16T18:05:58.905819] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-09-16T18:05:59.275799] [DEBUG] [VALIDATOR ] DKL: All expected trading days are present. [2025-09-16T18:05:59.275874] [DEBUG] [VALIDATOR ] DKL: Primary data validation passed. [2025-09-16T18:05:59.276282] [INFO ] [MAIN ] DKL: Fetched primary data is valid. [2025-09-16T18:05:59.276323] [DEBUG] [LOCAL ] DKL: Saving primary data. [2025-09-16T18:05:59.276896] [DEBUG] [LOCAL ] DKL: Trimmed 22002 records to 12673 (keeping 150 days of data) [2025-09-16T18:05:59.353247] [DEBUG] [LOCAL ] DKL: Primary data saved (12673 records). [2025-09-16T18:05:59.353389] [INFO ] [MAIN ] DKL: Full history saved. [2025-09-16T18:05:59.353477] [INFO ] [MAIN ] Update Progress: 626/2369 symbols completed. DKL took 23.2s. Estimated remaining: 3h 3m 36s. Rate: 9.5 symbols/min [2025-09-16T18:05:59.525435] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:05:59.566954] [DEBUG] [LOCAL ] DLR: Loaded 37449 existing records from primary storage. [2025-09-16T18:05:59.567103] [INFO ] [MAIN ] DLR: Loaded 37449 existing records. [2025-09-16T18:05:59.580094] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-09-16T18:05:59.755017] [WARN ] [MAIN ] DLR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:05:59.755296] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-09-16T18:05:59.755344] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-09-16T18:05:59.756175] [DEBUG] [LOCAL ] DLR: Deleted primary data file. [2025-09-16T18:05:59.756229] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-09-16T18:06:00.124704] [INFO ] [REMOTE ] DLR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:06:00.251566] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-16T18:06:00.374887] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-09-16T18:06:01.174945] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-09-16T18:06:01.974932] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-09-16T18:06:02.169007] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-09-16T18:06:02.255048] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-16T18:06:02.774955] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-09-16T18:06:02.810615] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-16T18:06:02.814931] [INFO ] [REMOTE ] DLB: Full fetch complete (35159 records). [2025-09-16T18:06:02.815065] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-09-16T18:06:03.149713] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-16T18:06:03.214363] [DEBUG] [VALIDATOR ] DLB: All expected trading days are present. [2025-09-16T18:06:03.214439] [DEBUG] [VALIDATOR ] DLB: Primary data validation passed. [2025-09-16T18:06:03.214961] [INFO ] [MAIN ] DLB: Fetched primary data is valid. [2025-09-16T18:06:03.215004] [DEBUG] [LOCAL ] DLB: Saving primary data. [2025-09-16T18:06:03.215762] [DEBUG] [LOCAL ] DLB: Trimmed 35159 records to 23929 (keeping 150 days of data) [2025-09-16T18:06:03.361702] [DEBUG] [LOCAL ] DLB: Primary data saved (23929 records). [2025-09-16T18:06:03.361828] [INFO ] [MAIN ] DLB: Full history saved. [2025-09-16T18:06:03.361910] [INFO ] [MAIN ] Update Progress: 627/2369 symbols completed. DLB took 15.9s. Estimated remaining: 3h 3m 23s. Rate: 9.5 symbols/min [2025-09-16T18:06:03.529978] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:06:03.550870] [DEBUG] [LOCAL ] DLX: Loaded 21432 existing records from primary storage. [2025-09-16T18:06:03.551006] [INFO ] [MAIN ] DLX: Loaded 21432 existing records. [2025-09-16T18:06:03.581327] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-09-16T18:06:03.735300] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:06:03.735633] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-09-16T18:06:03.735699] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-09-16T18:06:03.736288] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-09-16T18:06:03.736334] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-09-16T18:06:04.093422] [INFO ] [REMOTE ] DLX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:06:04.374904] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-09-16T18:06:04.473120] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-16T18:06:04.474928] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-16T18:06:05.174912] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-09-16T18:06:05.862058] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-16T18:06:05.974901] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-09-16T18:06:06.774895] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-09-16T18:06:06.803152] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-16T18:06:06.883178] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-16T18:06:07.574902] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-09-16T18:06:07.734794] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-16T18:06:08.374901] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-09-16T18:06:08.615069] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-16T18:06:09.174904] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-09-16T18:06:09.948635] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-16T18:06:09.974846] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-09-16T18:06:10.206119] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-16T18:06:10.692063] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-16T18:06:10.774872] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-09-16T18:06:11.574909] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-09-16T18:06:12.374899] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-09-16T18:06:12.615446] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-16T18:06:12.659251] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-16T18:06:13.174895] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-09-16T18:06:13.974878] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-09-16T18:06:14.074109] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-16T18:06:14.538251] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-16T18:06:14.774901] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-09-16T18:06:15.574880] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-09-16T18:06:15.638431] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-16T18:06:16.093898] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-16T18:06:16.181604] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-16T18:06:16.374902] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-09-16T18:06:17.174900] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-09-16T18:06:17.831206] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-16T18:06:17.974884] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-09-16T18:06:18.207864] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-16T18:06:18.214015] [INFO ] [REMOTE ] DKS: Full fetch complete (54251 records). [2025-09-16T18:06:18.214127] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-09-16T18:06:18.605030] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-09-16T18:06:18.605267] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-09-16T18:06:18.606149] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-09-16T18:06:18.606227] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-09-16T18:06:18.607672] [DEBUG] [LOCAL ] DKS: Trimmed 54251 records to 37152 (keeping 150 days of data) [2025-09-16T18:06:18.794710] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-09-16T18:06:18.857107] [DEBUG] [LOCAL ] DKS: Primary data saved (37152 records). [2025-09-16T18:06:18.857270] [INFO ] [MAIN ] DKS: Full history saved. [2025-09-16T18:06:18.857360] [INFO ] [MAIN ] Update Progress: 628/2369 symbols completed. DKS took 32.9s. Estimated remaining: 3h 3m 42s. Rate: 9.5 symbols/min [2025-09-16T18:06:19.028592] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:06:19.028805] [DEBUG] [LOCAL ] DLY: No existing data file found in primary storage. [2025-09-16T18:06:19.028844] [WARN ] [MAIN ] DLY: No existing data found, performing full refresh instead. [2025-09-16T18:06:19.029008] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-09-16T18:06:19.029048] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-09-16T18:06:19.029102] [DEBUG] [LOCAL ] DLY: No primary data file found to delete. [2025-09-16T18:06:19.029165] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-09-16T18:06:19.398287] [INFO ] [REMOTE ] DLY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:06:19.410161] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-16T18:06:19.411423] [INFO ] [REMOTE ] DLNG: Full fetch complete (7273 records). [2025-09-16T18:06:19.411501] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-09-16T18:06:19.583015] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-09-16T18:06:19.789493] [DEBUG] [VALIDATOR ] DLNG: All expected trading days are present. [2025-09-16T18:06:19.789712] [DEBUG] [VALIDATOR ] DLNG: Primary data validation passed. [2025-09-16T18:06:19.789966] [INFO ] [MAIN ] DLNG: Fetched primary data is valid. [2025-09-16T18:06:19.790040] [DEBUG] [LOCAL ] DLNG: Saving primary data. [2025-09-16T18:06:19.790916] [DEBUG] [LOCAL ] DLNG: Trimmed 7273 records to 4310 (keeping 150 days of data) [2025-09-16T18:06:19.817868] [DEBUG] [LOCAL ] DLNG: Primary data saved (4310 records). [2025-09-16T18:06:19.818126] [INFO ] [MAIN ] DLNG: Full history saved. [2025-09-16T18:06:19.818273] [INFO ] [MAIN ] Update Progress: 629/2369 symbols completed. DLNG took 24.0s. Estimated remaining: 3h 3m 21s. Rate: 9.5 symbols/min [2025-09-16T18:06:19.949729] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-16T18:06:20.030729] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:06:20.035979] [DEBUG] [LOCAL ] DMA: Loaded 3612 existing records from primary storage. [2025-09-16T18:06:20.036056] [INFO ] [MAIN ] DMA: Loaded 3612 existing records. [2025-09-16T18:06:20.211406] [WARN ] [MAIN ] DMA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:06:20.211693] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-09-16T18:06:20.211754] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-09-16T18:06:20.212156] [DEBUG] [LOCAL ] DMA: Deleted primary data file. [2025-09-16T18:06:20.212223] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-09-16T18:06:20.389180] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-09-16T18:06:20.591008] [INFO ] [REMOTE ] DMA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:06:20.854824] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-16T18:06:21.174887] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-09-16T18:06:21.911212] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-16T18:06:21.974857] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-09-16T18:06:22.538112] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-16T18:06:22.570004] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-16T18:06:22.774893] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-09-16T18:06:23.271706] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-16T18:06:23.574910] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-09-16T18:06:24.374903] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-09-16T18:06:24.797029] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-16T18:06:25.174899] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-09-16T18:06:25.400304] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-16T18:06:25.974888] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-09-16T18:06:26.412894] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-16T18:06:26.774897] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-09-16T18:06:27.574860] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-09-16T18:06:27.733163] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-16T18:06:27.757179] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-16T18:06:27.968277] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-16T18:06:28.374882] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-09-16T18:06:28.771214] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-16T18:06:29.174946] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-09-16T18:06:29.974876] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-09-16T18:06:30.464371] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-16T18:06:30.468267] [INFO ] [REMOTE ] DLX: Full fetch complete (32338 records). [2025-09-16T18:06:30.468403] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-09-16T18:06:30.780093] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-09-16T18:06:30.844400] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-09-16T18:06:30.844484] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-09-16T18:06:30.845062] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-09-16T18:06:30.845364] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-09-16T18:06:30.846473] [DEBUG] [LOCAL ] DLX: Trimmed 32338 records to 21590 (keeping 150 days of data) [2025-09-16T18:06:30.980084] [DEBUG] [LOCAL ] DLX: Primary data saved (21590 records). [2025-09-16T18:06:30.980210] [INFO ] [MAIN ] DLX: Full history saved. [2025-09-16T18:06:30.980296] [INFO ] [MAIN ] Update Progress: 630/2369 symbols completed. DLX took 27.6s. Estimated remaining: 3h 3m 28s. Rate: 9.5 symbols/min [2025-09-16T18:06:31.160534] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:06:31.169909] [DEBUG] [LOCAL ] DMB: Loaded 7871 existing records from primary storage. [2025-09-16T18:06:31.170005] [INFO ] [MAIN ] DMB: Loaded 7871 existing records. [2025-09-16T18:06:31.347664] [WARN ] [MAIN ] DMB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:06:31.347932] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-09-16T18:06:31.348000] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-09-16T18:06:31.348336] [DEBUG] [LOCAL ] DMB: Deleted primary data file. [2025-09-16T18:06:31.348383] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-09-16T18:06:31.577213] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-09-16T18:06:31.747171] [INFO ] [REMOTE ] DMB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:06:31.748274] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-16T18:06:31.749836] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-16T18:06:31.760473] [INFO ] [REMOTE ] DLR: Full fetch complete (55863 records). [2025-09-16T18:06:31.760579] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-09-16T18:06:32.144492] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-09-16T18:06:32.144570] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-09-16T18:06:32.145289] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-09-16T18:06:32.145352] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-09-16T18:06:32.146430] [DEBUG] [LOCAL ] DLR: Trimmed 55863 records to 37822 (keeping 150 days of data) [2025-09-16T18:06:32.364756] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-16T18:06:32.374954] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-09-16T18:06:32.400964] [DEBUG] [LOCAL ] DLR: Primary data saved (37822 records). [2025-09-16T18:06:32.401092] [INFO ] [MAIN ] DLR: Full history saved. [2025-09-16T18:06:32.401174] [INFO ] [MAIN ] Update Progress: 631/2369 symbols completed. DLR took 33.0s. Estimated remaining: 3h 3m 8s. Rate: 9.5 symbols/min [2025-09-16T18:06:32.570565] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:06:32.578791] [DEBUG] [LOCAL ] DMO: Loaded 6850 existing records from primary storage. [2025-09-16T18:06:32.578905] [INFO ] [MAIN ] DMO: Loaded 6850 existing records. [2025-09-16T18:06:32.757954] [WARN ] [MAIN ] DMO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:06:32.758202] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-09-16T18:06:32.758251] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-09-16T18:06:32.758563] [DEBUG] [LOCAL ] DMO: Deleted primary data file. [2025-09-16T18:06:32.758609] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-09-16T18:06:33.126295] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-16T18:06:33.129593] [INFO ] [REMOTE ] DMO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:06:33.174852] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-09-16T18:06:33.883291] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-16T18:06:33.884802] [INFO ] [REMOTE ] DMA: Full fetch complete (5032 records). [2025-09-16T18:06:33.884904] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-09-16T18:06:33.980209] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-09-16T18:06:34.378783] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present. [2025-09-16T18:06:34.378902] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed. [2025-09-16T18:06:34.379187] [INFO ] [MAIN ] DMA: Fetched primary data is valid. [2025-09-16T18:06:34.379244] [DEBUG] [LOCAL ] DMA: Saving primary data. [2025-09-16T18:06:34.379865] [DEBUG] [LOCAL ] DMA: Trimmed 5032 records to 3636 (keeping 150 days of data) [2025-09-16T18:06:34.414873] [DEBUG] [LOCAL ] DMA: Primary data saved (3636 records). [2025-09-16T18:06:34.415069] [INFO ] [MAIN ] DMA: Full history saved. [2025-09-16T18:06:34.415233] [INFO ] [MAIN ] Update Progress: 632/2369 symbols completed. DMA took 14.6s. Estimated remaining: 3h 2m 50s. Rate: 9.5 symbols/min [2025-09-16T18:06:34.705393] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:06:34.745800] [DEBUG] [LOCAL ] DNA: Loaded 35541 existing records from primary storage. [2025-09-16T18:06:34.745980] [INFO ] [MAIN ] DNA: Loaded 35541 existing records. [2025-09-16T18:06:34.780159] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-09-16T18:06:34.946274] [WARN ] [MAIN ] DNA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:06:34.946591] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-09-16T18:06:34.946776] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-09-16T18:06:34.952736] [DEBUG] [LOCAL ] DNA: Deleted primary data file. [2025-09-16T18:06:34.958675] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-09-16T18:06:34.994363] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-16T18:06:35.355190] [INFO ] [REMOTE ] DNA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:06:35.550206] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-16T18:06:35.574851] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-09-16T18:06:36.340859] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-16T18:06:36.374847] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-09-16T18:06:37.099157] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-16T18:06:37.174875] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-09-16T18:06:37.935936] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-16T18:06:37.974862] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-09-16T18:06:38.743313] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-16T18:06:38.774887] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-09-16T18:06:39.544873] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-16T18:06:39.574857] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-09-16T18:06:40.272676] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-16T18:06:40.374877] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-09-16T18:06:41.174913] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-09-16T18:06:41.194539] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-16T18:06:41.196036] [INFO ] [REMOTE ] DMO: Full fetch complete (10437 records). [2025-09-16T18:06:41.196104] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-09-16T18:06:41.554898] [DEBUG] [VALIDATOR ] DMO: All expected trading days are present. [2025-09-16T18:06:41.554980] [DEBUG] [VALIDATOR ] DMO: Primary data validation passed. [2025-09-16T18:06:41.555313] [INFO ] [MAIN ] DMO: Fetched primary data is valid. [2025-09-16T18:06:41.555372] [DEBUG] [LOCAL ] DMO: Saving primary data. [2025-09-16T18:06:41.555856] [DEBUG] [LOCAL ] DMO: Trimmed 10437 records to 6948 (keeping 150 days of data) [2025-09-16T18:06:41.603580] [DEBUG] [LOCAL ] DMO: Primary data saved (6948 records). [2025-09-16T18:06:41.603772] [INFO ] [MAIN ] DMO: Full history saved. [2025-09-16T18:06:41.603899] [INFO ] [MAIN ] Update Progress: 633/2369 symbols completed. DMO took 9.2s. Estimated remaining: 3h 2m 46s. Rate: 9.5 symbols/min [2025-09-16T18:06:41.777493] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:06:41.777690] [DEBUG] [LOCAL ] DNOW: No existing data file found in primary storage. [2025-09-16T18:06:41.777768] [WARN ] [MAIN ] DNOW: No existing data found, performing full refresh instead. [2025-09-16T18:06:41.777894] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-09-16T18:06:41.777934] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-09-16T18:06:41.777977] [DEBUG] [LOCAL ] DNOW: No primary data file found to delete. [2025-09-16T18:06:41.778011] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-09-16T18:06:41.980289] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-09-16T18:06:42.077834] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-16T18:06:42.152620] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:06:42.774921] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-09-16T18:06:43.574911] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-09-16T18:06:44.056847] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-16T18:06:44.083430] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-16T18:06:44.175839] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-16T18:06:44.374952] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-09-16T18:06:45.174930] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-09-16T18:06:45.908127] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-16T18:06:45.974857] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-09-16T18:06:45.997320] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-16T18:06:46.774991] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-09-16T18:06:47.533392] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-16T18:06:47.583246] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-09-16T18:06:47.588095] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-16T18:06:48.374939] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-09-16T18:06:49.174913] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-09-16T18:06:49.512227] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-16T18:06:49.736554] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-16T18:06:49.974888] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-09-16T18:06:50.331130] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-16T18:06:50.771779] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-16T18:06:50.774845] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-09-16T18:06:51.383302] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-16T18:06:51.574905] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-09-16T18:06:52.374901] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-09-16T18:06:53.076730] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-16T18:06:53.174915] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-09-16T18:06:53.974919] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-09-16T18:06:54.240090] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-16T18:06:54.774928] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-09-16T18:06:54.893105] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-16T18:06:55.052288] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-16T18:06:55.574915] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-09-16T18:06:56.356608] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-16T18:06:56.374844] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-09-16T18:06:56.421509] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-16T18:06:56.423537] [INFO ] [REMOTE ] DMB: Full fetch complete (10829 records). [2025-09-16T18:06:56.423611] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-09-16T18:06:56.783120] [DEBUG] [VALIDATOR ] DMB: All expected trading days are present. [2025-09-16T18:06:56.783196] [DEBUG] [VALIDATOR ] DMB: Primary data validation passed. [2025-09-16T18:06:56.783435] [INFO ] [MAIN ] DMB: Fetched primary data is valid. [2025-09-16T18:06:56.783474] [DEBUG] [LOCAL ] DMB: Saving primary data. [2025-09-16T18:06:56.783935] [DEBUG] [LOCAL ] DMB: Trimmed 10829 records to 7953 (keeping 150 days of data) [2025-09-16T18:06:56.831974] [DEBUG] [LOCAL ] DMB: Primary data saved (7953 records). [2025-09-16T18:06:56.832090] [INFO ] [MAIN ] DMB: Full history saved. [2025-09-16T18:06:56.832179] [INFO ] [MAIN ] Update Progress: 634/2369 symbols completed. DMB took 25.9s. Estimated remaining: 3h 3m 4s. Rate: 9.5 symbols/min [2025-09-16T18:06:57.006351] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:06:57.028790] [DEBUG] [LOCAL ] DNP: Loaded 24357 existing records from primary storage. [2025-09-16T18:06:57.028931] [INFO ] [MAIN ] DNP: Loaded 24357 existing records. [2025-09-16T18:06:57.179974] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-09-16T18:06:57.207026] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:06:57.207228] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-09-16T18:06:57.207296] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-09-16T18:06:57.207991] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-09-16T18:06:57.208049] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-09-16T18:06:57.555470] [INFO ] [REMOTE ] DNP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:06:57.974891] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-09-16T18:06:58.143808] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-16T18:06:58.190484] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-16T18:06:58.774890] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-09-16T18:06:59.259005] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-16T18:06:59.574914] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-09-16T18:07:00.374868] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-09-16T18:07:00.885283] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-16T18:07:01.049124] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-16T18:07:01.174861] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-09-16T18:07:01.563019] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-16T18:07:01.570079] [INFO ] [REMOTE ] DLY: Full fetch complete (20513 records). [2025-09-16T18:07:01.570217] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-09-16T18:07:01.933981] [DEBUG] [VALIDATOR ] DLY: All expected trading days are present. [2025-09-16T18:07:01.934061] [DEBUG] [VALIDATOR ] DLY: Primary data validation passed. [2025-09-16T18:07:01.934467] [INFO ] [MAIN ] DLY: Fetched primary data is valid. [2025-09-16T18:07:01.934544] [DEBUG] [LOCAL ] DLY: Saving primary data. [2025-09-16T18:07:01.935214] [DEBUG] [LOCAL ] DLY: Trimmed 20513 records to 13860 (keeping 150 days of data) [2025-09-16T18:07:01.979306] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-09-16T18:07:02.021253] [DEBUG] [LOCAL ] DLY: Primary data saved (13860 records). [2025-09-16T18:07:02.021355] [INFO ] [MAIN ] DLY: Full history saved. [2025-09-16T18:07:02.021444] [INFO ] [MAIN ] Update Progress: 635/2369 symbols completed. DLY took 43.2s. Estimated remaining: 3h 2m 55s. Rate: 9.5 symbols/min [2025-09-16T18:07:02.194442] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:07:02.232494] [DEBUG] [LOCAL ] DOC: Loaded 39535 existing records from primary storage. [2025-09-16T18:07:02.232627] [INFO ] [MAIN ] DOC: Loaded 39535 existing records. [2025-09-16T18:07:02.412407] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:07:02.412656] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-09-16T18:07:02.412714] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-09-16T18:07:02.413531] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-09-16T18:07:02.413580] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-09-16T18:07:02.761554] [INFO ] [REMOTE ] DOC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:07:02.774843] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-09-16T18:07:02.840502] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-16T18:07:03.176093] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-16T18:07:03.182008] [INFO ] [REMOTE ] DNOW: Full fetch complete (47551 records). [2025-09-16T18:07:03.182101] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-09-16T18:07:03.557430] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-09-16T18:07:03.557510] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-09-16T18:07:03.558165] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-09-16T18:07:03.558213] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-09-16T18:07:03.559838] [DEBUG] [LOCAL ] DNOW: Trimmed 47551 records to 31921 (keeping 150 days of data) [2025-09-16T18:07:03.611058] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-09-16T18:07:03.748927] [DEBUG] [LOCAL ] DNOW: Primary data saved (31921 records). [2025-09-16T18:07:03.749057] [INFO ] [MAIN ] DNOW: Full history saved. [2025-09-16T18:07:03.749140] [INFO ] [MAIN ] Update Progress: 636/2369 symbols completed. DNOW took 22.1s. Estimated remaining: 3h 2m 36s. Rate: 9.5 symbols/min [2025-09-16T18:07:03.925068] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:07:03.960408] [DEBUG] [LOCAL ] DOCN: Loaded 37526 existing records from primary storage. [2025-09-16T18:07:03.960549] [INFO ] [MAIN ] DOCN: Loaded 37526 existing records. [2025-09-16T18:07:04.137338] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:07:04.137584] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-09-16T18:07:04.137679] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-09-16T18:07:04.138448] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-09-16T18:07:04.138520] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-09-16T18:07:04.383732] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-09-16T18:07:04.493786] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:07:04.988672] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-09-16T18:07:05.174857] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-09-16T18:07:05.228893] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-16T18:07:05.236795] [INFO ] [REMOTE ] DNA: Full fetch complete (53102 records). [2025-09-16T18:07:05.237018] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-09-16T18:07:05.628904] [DEBUG] [VALIDATOR ] DNA: All expected trading days are present. [2025-09-16T18:07:05.629021] [DEBUG] [VALIDATOR ] DNA: Primary data validation passed. [2025-09-16T18:07:05.629796] [INFO ] [MAIN ] DNA: Fetched primary data is valid. [2025-09-16T18:07:05.629859] [DEBUG] [LOCAL ] DNA: Saving primary data. [2025-09-16T18:07:05.632629] [DEBUG] [LOCAL ] DNA: Trimmed 53102 records to 35867 (keeping 150 days of data) [2025-09-16T18:07:05.844697] [DEBUG] [LOCAL ] DNA: Primary data saved (35867 records). [2025-09-16T18:07:05.844834] [INFO ] [MAIN ] DNA: Full history saved. [2025-09-16T18:07:05.844937] [INFO ] [MAIN ] Update Progress: 637/2369 symbols completed. DNA took 31.4s. Estimated remaining: 3h 2m 18s. Rate: 9.5 symbols/min [2025-09-16T18:07:05.893775] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-16T18:07:05.974842] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-09-16T18:07:06.785047] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-09-16T18:07:06.790492] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-16T18:07:07.303942] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-16T18:07:07.574876] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-09-16T18:07:08.374888] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-09-16T18:07:08.840546] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-16T18:07:08.927571] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-16T18:07:09.174955] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-09-16T18:07:09.387360] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-16T18:07:09.974893] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-09-16T18:07:10.774939] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-09-16T18:07:11.156601] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-16T18:07:11.464253] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-16T18:07:11.574865] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-09-16T18:07:12.374966] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-09-16T18:07:12.721589] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-16T18:07:12.953515] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-16T18:07:13.174908] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-09-16T18:07:13.974934] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-09-16T18:07:14.179847] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-16T18:07:14.780220] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-09-16T18:07:14.783088] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-16T18:07:15.342297] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-16T18:07:15.574987] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-09-16T18:07:16.374944] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-09-16T18:07:16.880507] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-16T18:07:17.174898] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-09-16T18:07:17.306172] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-16T18:07:17.310217] [INFO ] [REMOTE ] DNP: Full fetch complete (36420 records). [2025-09-16T18:07:17.310334] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-09-16T18:07:17.646941] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-16T18:07:17.726238] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present. [2025-09-16T18:07:17.726330] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed. [2025-09-16T18:07:17.727013] [INFO ] [MAIN ] DNP: Fetched primary data is valid. [2025-09-16T18:07:17.727102] [DEBUG] [LOCAL ] DNP: Saving primary data. [2025-09-16T18:07:17.728183] [DEBUG] [LOCAL ] DNP: Trimmed 36420 records to 24576 (keeping 150 days of data) [2025-09-16T18:07:17.879546] [DEBUG] [LOCAL ] DNP: Primary data saved (24576 records). [2025-09-16T18:07:17.879693] [INFO ] [MAIN ] DNP: Full history saved. [2025-09-16T18:07:17.879793] [INFO ] [MAIN ] Update Progress: 638/2369 symbols completed. DNP took 21.0s. Estimated remaining: 3h 2m 27s. Rate: 9.5 symbols/min [2025-09-16T18:07:17.974891] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-09-16T18:07:19.369773] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-16T18:07:19.381550] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-09-16T18:07:19.478995] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-16T18:07:19.574897] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-09-16T18:07:21.327233] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-16T18:07:21.338860] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-09-16T18:07:21.557468] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-16T18:07:21.568821] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-09-16T18:07:23.088916] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-16T18:07:23.095304] [INFO ] [REMOTE ] DOC: Full fetch complete (58181 records). [2025-09-16T18:07:23.095424] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-09-16T18:07:23.502612] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-09-16T18:07:23.503917] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-16T18:07:23.503256] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-09-16T18:07:23.510478] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-09-16T18:07:23.510680] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-09-16T18:07:23.511082] [INFO ] [REMOTE ] DOCN: Full fetch complete (54717 records). [2025-09-16T18:07:23.511356] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-09-16T18:07:23.595338] [DEBUG] [LOCAL ] DOC: Trimmed 58181 records to 39924 (keeping 150 days of data) [2025-09-16T18:07:24.012163] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-09-16T18:07:24.013229] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-09-16T18:07:24.014300] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-09-16T18:07:24.014920] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-09-16T18:07:24.027917] [DEBUG] [LOCAL ] DOCN: Trimmed 54717 records to 37915 (keeping 150 days of data) [2025-09-16T18:07:24.256256] [DEBUG] [LOCAL ] DOC: Primary data saved (39924 records). [2025-09-16T18:07:24.257887] [INFO ] [MAIN ] DOC: Full history saved. [2025-09-16T18:07:24.258864] [INFO ] [MAIN ] Update Progress: 639/2369 symbols completed. DOC took 22.2s. Estimated remaining: 3h 2m 21s. Rate: 9.5 symbols/min [2025-09-16T18:07:24.381772] [DEBUG] [LOCAL ] DOCN: Primary data saved (37915 records). [2025-09-16T18:07:24.381938] [INFO ] [MAIN ] DOCN: Full history saved. [2025-09-16T18:07:24.382046] [INFO ] [MAIN ] Update Progress: 640/2369 symbols completed. DOCN took 20.6s. Estimated remaining: 3h 1m 58s. Rate: 9.5 symbols/min [2025-09-16T18:07:24.982394] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:07:25.108318] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:07:25.112097] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:07:25.127772] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:07:25.128085] [DEBUG] [LOCAL ] DOV: No existing data file found in primary storage. [2025-09-16T18:07:25.128704] [WARN ] [MAIN ] DOV: No existing data found, performing full refresh instead. [2025-09-16T18:07:25.129211] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-09-16T18:07:25.129256] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-09-16T18:07:25.131052] [DEBUG] [LOCAL ] DOV: No primary data file found to delete. [2025-09-16T18:07:25.131119] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-09-16T18:07:25.331319] [DEBUG] [LOCAL ] DOUG: Loaded 25700 existing records from primary storage. [2025-09-16T18:07:25.379594] [INFO ] [MAIN ] DOUG: Loaded 25700 existing records. [2025-09-16T18:07:25.403184] [DEBUG] [LOCAL ] DOLE: Loaded 28240 existing records from primary storage. [2025-09-16T18:07:25.422537] [INFO ] [MAIN ] DOLE: Loaded 28240 existing records. [2025-09-16T18:07:25.422361] [DEBUG] [LOCAL ] DOCS: Loaded 37582 existing records from primary storage. [2025-09-16T18:07:25.493205] [INFO ] [MAIN ] DOCS: Loaded 37582 existing records. [2025-09-16T18:07:26.023964] [INFO ] [REMOTE ] DOV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:07:26.068243] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:07:26.106922] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-09-16T18:07:26.068873] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-09-16T18:07:26.110105] [WARN ] [MAIN ] DOLE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:07:26.110200] [WARN ] [MAIN ] DOCS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:07:26.111369] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-09-16T18:07:26.111467] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-09-16T18:07:26.111523] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-09-16T18:07:26.112189] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-09-16T18:07:26.112264] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-09-16T18:07:26.112458] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-09-16T18:07:26.112420] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-09-16T18:07:26.117913] [DEBUG] [LOCAL ] DOLE: Deleted primary data file. [2025-09-16T18:07:26.133367] [DEBUG] [LOCAL ] DOCS: Deleted primary data file. [2025-09-16T18:07:26.133461] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-09-16T18:07:26.166341] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-09-16T18:07:27.028989] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:07:27.034479] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-09-16T18:07:27.184000] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:07:27.194869] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-09-16T18:07:27.249753] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:07:27.250073] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-09-16T18:07:27.804562] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-16T18:07:27.812958] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-09-16T18:07:28.140769] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-16T18:07:28.147872] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-09-16T18:07:28.240010] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-16T18:07:28.246273] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-09-16T18:07:29.028484] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-16T18:07:29.038425] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-09-16T18:07:29.122340] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-16T18:07:29.132213] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-09-16T18:07:29.251287] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-16T18:07:29.258788] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-09-16T18:07:29.546067] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-16T18:07:29.974939] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-09-16T18:07:30.831469] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-16T18:07:30.843297] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-09-16T18:07:30.908912] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-16T18:07:31.006537] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-16T18:07:31.366110] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-16T18:07:31.574866] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-09-16T18:07:32.374889] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-09-16T18:07:32.521880] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-16T18:07:33.090388] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-16T18:07:33.174924] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-09-16T18:07:33.414980] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-16T18:07:33.974914] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-09-16T18:07:34.319422] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-16T18:07:34.774901] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-09-16T18:07:35.574883] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-09-16T18:07:35.615875] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-16T18:07:36.277172] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-16T18:07:36.374921] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-09-16T18:07:37.122561] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-16T18:07:37.174854] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-09-16T18:07:37.969093] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-16T18:07:37.977442] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-09-16T18:07:38.742399] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-16T18:07:38.774876] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-09-16T18:07:39.173032] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-16T18:07:39.574910] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-09-16T18:07:40.374978] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-09-16T18:07:40.657613] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-16T18:07:40.740272] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-16T18:07:41.174950] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-09-16T18:07:41.512211] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-16T18:07:41.974915] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-09-16T18:07:42.774920] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-09-16T18:07:43.074679] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-16T18:07:43.480249] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-16T18:07:43.574870] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-09-16T18:07:44.374966] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-09-16T18:07:44.717198] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-16T18:07:44.722607] [INFO ] [REMOTE ] DOLE: Full fetch complete (40595 records). [2025-09-16T18:07:44.722719] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-09-16T18:07:45.092191] [DEBUG] [VALIDATOR ] DOLE: All expected trading days are present. [2025-09-16T18:07:45.092272] [DEBUG] [VALIDATOR ] DOLE: Primary data validation passed. [2025-09-16T18:07:45.092860] [INFO ] [MAIN ] DOLE: Fetched primary data is valid. [2025-09-16T18:07:45.092904] [DEBUG] [LOCAL ] DOLE: Saving primary data. [2025-09-16T18:07:45.093827] [DEBUG] [LOCAL ] DOLE: Trimmed 40595 records to 28584 (keeping 150 days of data) [2025-09-16T18:07:45.187337] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-09-16T18:07:45.276502] [DEBUG] [LOCAL ] DOLE: Primary data saved (28584 records). [2025-09-16T18:07:45.276665] [INFO ] [MAIN ] DOLE: Full history saved. [2025-09-16T18:07:45.276754] [INFO ] [MAIN ] Update Progress: 641/2369 symbols completed. DOLE took 20.9s. Estimated remaining: 3h 2m 31s. Rate: 9.5 symbols/min [2025-09-16T18:07:45.447032] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:07:45.489400] [DEBUG] [LOCAL ] DOW: Loaded 39693 existing records from primary storage. [2025-09-16T18:07:45.489586] [INFO ] [MAIN ] DOW: Loaded 39693 existing records. [2025-09-16T18:07:45.670034] [WARN ] [MAIN ] DOW: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:07:45.670831] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-09-16T18:07:45.671108] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-09-16T18:07:45.676557] [DEBUG] [LOCAL ] DOW: Deleted primary data file. [2025-09-16T18:07:45.679508] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-09-16T18:07:45.726828] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-16T18:07:45.787516] [INFO ] [REMOTE ] DOUG: Full fetch complete (37743 records). [2025-09-16T18:07:45.790722] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-09-16T18:07:45.817936] [FATAL] [VALIDATOR ] DOUG: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:07:45.842161] [FATAL] [MAIN ] DOUG: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:07:45.849657] [WARN ] [MAIN ] DOUG: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:07:45.867083] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-09-16T18:07:45.880946] [DEBUG] [LOCAL ] DOUG: No primary data file found to delete. [2025-09-16T18:07:45.890444] [INFO ] [LOCAL ] DOUG: Starting deletion of derivative data. [2025-09-16T18:07:45.938978] [DEBUG] [LOCAL ] DOUG: Deleted derivative data file. [2025-09-16T18:07:45.971607] [INFO ] [MAIN ] Update Progress: 642/2369 symbols completed. DOUG took 21.6s. Estimated remaining: 3h 2m 9s. Rate: 9.5 symbols/min [2025-09-16T18:07:46.093683] [INFO ] [REMOTE ] DOW: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:07:46.130445] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (2.56 seconds). [2025-09-16T18:07:46.129174] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-09-16T18:07:46.259067] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:07:46.270522] [DEBUG] [LOCAL ] DPG: Loaded 9724 existing records from primary storage. [2025-09-16T18:07:46.270666] [INFO ] [MAIN ] DPG: Loaded 9724 existing records. [2025-09-16T18:07:46.453220] [WARN ] [MAIN ] DPG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:07:46.453520] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-09-16T18:07:46.453566] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-09-16T18:07:46.453997] [DEBUG] [LOCAL ] DPG: Deleted primary data file. [2025-09-16T18:07:46.454047] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-09-16T18:07:46.781434] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-09-16T18:07:46.818482] [INFO ] [REMOTE ] DPG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:07:46.851496] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-16T18:07:47.574937] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-09-16T18:07:48.382244] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-09-16T18:07:48.389760] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-16T18:07:48.397381] [INFO ] [REMOTE ] DOV: Full fetch complete (49658 records). [2025-09-16T18:07:48.397628] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-09-16T18:07:48.696270] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (2.57 seconds). [2025-09-16T18:07:49.044429] [DEBUG] [VALIDATOR ] DOV: All expected trading days are present. [2025-09-16T18:07:49.044554] [DEBUG] [VALIDATOR ] DOV: Primary data validation passed. [2025-09-16T18:07:49.045577] [INFO ] [MAIN ] DOV: Fetched primary data is valid. [2025-09-16T18:07:49.045680] [DEBUG] [LOCAL ] DOV: Saving primary data. [2025-09-16T18:07:49.047068] [DEBUG] [LOCAL ] DOV: Trimmed 49658 records to 33591 (keeping 150 days of data) [2025-09-16T18:07:49.185857] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-09-16T18:07:49.252491] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-16T18:07:49.294990] [INFO ] [REMOTE ] DOCS: Full fetch complete (56085 records). [2025-09-16T18:07:49.297271] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-09-16T18:07:49.298073] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-16T18:07:49.748171] [DEBUG] [VALIDATOR ] DOCS: All expected trading days are present. [2025-09-16T18:07:49.749880] [DEBUG] [VALIDATOR ] DOCS: Primary data validation passed. [2025-09-16T18:07:49.751446] [INFO ] [MAIN ] DOCS: Fetched primary data is valid. [2025-09-16T18:07:49.751815] [DEBUG] [LOCAL ] DOCS: Saving primary data. [2025-09-16T18:07:49.757176] [DEBUG] [LOCAL ] DOV: Primary data saved (33591 records). [2025-09-16T18:07:49.757372] [INFO ] [MAIN ] DOV: Full history saved. [2025-09-16T18:07:49.757607] [INFO ] [MAIN ] Update Progress: 643/2369 symbols completed. DOV took 25.4s. Estimated remaining: 3h 1m 56s. Rate: 9.5 symbols/min [2025-09-16T18:07:49.757831] [DEBUG] [LOCAL ] DOCS: Trimmed 56085 records to 37942 (keeping 150 days of data) [2025-09-16T18:07:49.975548] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-09-16T18:07:50.027942] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:07:50.077483] [DEBUG] [LOCAL ] DQ: Loaded 31306 existing records from primary storage. [2025-09-16T18:07:50.077739] [INFO ] [MAIN ] DQ: Loaded 31306 existing records. [2025-09-16T18:07:50.340810] [WARN ] [MAIN ] DQ: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:07:50.343874] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-09-16T18:07:50.345185] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-09-16T18:07:50.347441] [DEBUG] [LOCAL ] DQ: Deleted primary data file. [2025-09-16T18:07:50.347766] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-09-16T18:07:50.722575] [INFO ] [REMOTE ] DQ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:07:50.727524] [DEBUG] [LOCAL ] DOCS: Primary data saved (37942 records). [2025-09-16T18:07:50.727677] [INFO ] [MAIN ] DOCS: Full history saved. [2025-09-16T18:07:50.727797] [INFO ] [MAIN ] Update Progress: 644/2369 symbols completed. DOCS took 26.3s. Estimated remaining: 3h 1m 35s. Rate: 9.5 symbols/min [2025-09-16T18:07:50.786131] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-09-16T18:07:50.902280] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:07:50.928524] [DEBUG] [LOCAL ] DRD: Loaded 26240 existing records from primary storage. [2025-09-16T18:07:50.928693] [INFO ] [MAIN ] DRD: Loaded 26240 existing records. [2025-09-16T18:07:51.123712] [WARN ] [MAIN ] DRD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:07:51.125022] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-16T18:07:51.128892] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-09-16T18:07:51.129026] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-09-16T18:07:51.140356] [DEBUG] [LOCAL ] DRD: Deleted primary data file. [2025-09-16T18:07:51.159909] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-09-16T18:07:51.227133] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-16T18:07:51.526747] [INFO ] [REMOTE ] DRD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:07:51.574860] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-09-16T18:07:52.374958] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-09-16T18:07:52.607968] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-16T18:07:52.770078] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-16T18:07:53.174998] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-09-16T18:07:53.331773] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-16T18:07:53.974953] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-09-16T18:07:54.720585] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-16T18:07:54.774859] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-09-16T18:07:55.532953] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-16T18:07:55.574860] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-09-16T18:07:56.224799] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-16T18:07:56.374906] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-09-16T18:07:57.148762] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-16T18:07:57.174858] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-09-16T18:07:57.865602] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-16T18:07:57.974874] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-09-16T18:07:58.774910] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-09-16T18:07:59.574881] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-09-16T18:07:59.626095] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-16T18:07:59.713404] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (2.54 seconds). [2025-09-16T18:07:59.824818] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-16T18:08:00.374918] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-09-16T18:08:00.705685] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-16T18:08:01.174899] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-09-16T18:08:01.980229] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-09-16T18:08:01.981967] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-16T18:08:02.774903] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-09-16T18:08:03.575029] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-09-16T18:08:03.775167] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-16T18:08:03.916022] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-16T18:08:04.374952] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-09-16T18:08:05.174955] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-09-16T18:08:06.055146] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-16T18:08:06.064745] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-09-16T18:08:06.125866] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-16T18:08:06.774934] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-09-16T18:08:07.728564] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-16T18:08:07.730493] [INFO ] [REMOTE ] DPG: Full fetch complete (14285 records). [2025-09-16T18:08:07.730563] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-09-16T18:08:08.110951] [DEBUG] [VALIDATOR ] DPG: All expected trading days are present. [2025-09-16T18:08:08.111147] [DEBUG] [VALIDATOR ] DPG: Primary data validation passed. [2025-09-16T18:08:08.125407] [INFO ] [MAIN ] DPG: Fetched primary data is valid. [2025-09-16T18:08:08.125992] [DEBUG] [LOCAL ] DPG: Saving primary data. [2025-09-16T18:08:08.126495] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-16T18:08:08.132735] [INFO ] [REMOTE ] DQ: Full fetch complete (47230 records). [2025-09-16T18:08:08.132849] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-09-16T18:08:08.132618] [DEBUG] [LOCAL ] DPG: Trimmed 14285 records to 9792 (keeping 150 days of data) [2025-09-16T18:08:08.398442] [DEBUG] [LOCAL ] DPG: Primary data saved (9792 records). [2025-09-16T18:08:08.412707] [INFO ] [MAIN ] DPG: Full history saved. [2025-09-16T18:08:08.458505] [INFO ] [MAIN ] Update Progress: 645/2369 symbols completed. DPG took 22.5s. Estimated remaining: 3h 1m 60s. Rate: 9.5 symbols/min [2025-09-16T18:08:08.778750] [DEBUG] [VALIDATOR ] DQ: All expected trading days are present. [2025-09-16T18:08:08.791222] [DEBUG] [VALIDATOR ] DQ: Primary data validation passed. [2025-09-16T18:08:08.810899] [INFO ] [MAIN ] DQ: Fetched primary data is valid. [2025-09-16T18:08:08.809881] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:08:08.811128] [DEBUG] [LOCAL ] DQ: Saving primary data. [2025-09-16T18:08:08.813024] [DEBUG] [LOCAL ] DQ: Trimmed 47230 records to 31641 (keeping 150 days of data) [2025-09-16T18:08:08.956781] [DEBUG] [LOCAL ] DRH: Loaded 37030 existing records from primary storage. [2025-09-16T18:08:08.958118] [INFO ] [MAIN ] DRH: Loaded 37030 existing records. [2025-09-16T18:08:09.209271] [WARN ] [MAIN ] DRH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:08:09.213701] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-09-16T18:08:09.214461] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-09-16T18:08:09.216966] [DEBUG] [LOCAL ] DRH: Deleted primary data file. [2025-09-16T18:08:09.217834] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-09-16T18:08:09.545960] [DEBUG] [LOCAL ] DQ: Primary data saved (31641 records). [2025-09-16T18:08:09.561498] [INFO ] [MAIN ] DQ: Full history saved. [2025-09-16T18:08:09.566753] [INFO ] [MAIN ] Update Progress: 646/2369 symbols completed. DQ took 19.8s. Estimated remaining: 3h 1m 39s. Rate: 9.5 symbols/min [2025-09-16T18:08:09.703310] [INFO ] [REMOTE ] DRH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:08:09.728417] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-09-16T18:08:09.806121] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:08:09.840692] [DEBUG] [LOCAL ] DRI: Loaded 34727 existing records from primary storage. [2025-09-16T18:08:09.840869] [INFO ] [MAIN ] DRI: Loaded 34727 existing records. [2025-09-16T18:08:10.023822] [WARN ] [MAIN ] DRI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:08:10.024080] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-09-16T18:08:10.024127] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-09-16T18:08:10.025086] [DEBUG] [LOCAL ] DRI: Deleted primary data file. [2025-09-16T18:08:10.025138] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-09-16T18:08:10.383277] [INFO ] [REMOTE ] DRI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:08:10.383660] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-09-16T18:08:11.396031] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-16T18:08:11.404857] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-09-16T18:08:13.061823] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (2.68 seconds). [2025-09-16T18:08:13.071331] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-09-16T18:08:13.690495] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-09-16T18:08:13.703208] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-09-16T18:08:14.432827] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-16T18:08:14.443351] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-09-16T18:08:15.120326] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-16T18:08:15.131182] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-09-16T18:08:15.785803] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-16T18:08:15.796573] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-09-16T18:08:16.161991] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (12.59 seconds). [2025-09-16T18:08:16.170294] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-09-16T18:08:16.453912] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-16T18:08:16.464418] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-09-16T18:08:16.784563] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (16.41 seconds). [2025-09-16T18:08:16.796049] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-09-16T18:08:17.144150] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-16T18:08:17.157915] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-09-16T18:08:17.358263] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-16T18:08:17.366067] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-09-16T18:08:17.725234] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-16T18:08:17.974960] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-09-16T18:08:18.449300] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-16T18:08:18.493245] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-16T18:08:18.594968] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-16T18:08:18.774898] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-09-16T18:08:19.270295] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-16T18:08:19.574953] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-09-16T18:08:19.952094] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-16T18:08:19.957120] [INFO ] [REMOTE ] DRD: Full fetch complete (38415 records). [2025-09-16T18:08:19.957207] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-09-16T18:08:19.957774] [FATAL] [VALIDATOR ] DRD: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:08:19.957864] [FATAL] [MAIN ] DRD: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:08:19.957919] [WARN ] [MAIN ] DRD: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:08:19.957986] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-09-16T18:08:19.958054] [DEBUG] [LOCAL ] DRD: No primary data file found to delete. [2025-09-16T18:08:19.958093] [INFO ] [LOCAL ] DRD: Starting deletion of derivative data. [2025-09-16T18:08:19.958354] [DEBUG] [LOCAL ] DRD: Deleted derivative data file. [2025-09-16T18:08:19.958437] [INFO ] [MAIN ] Update Progress: 647/2369 symbols completed. DRD took 29.2s. Estimated remaining: 3h 1m 44s. Rate: 9.5 symbols/min [2025-09-16T18:08:20.128019] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:08:20.135839] [DEBUG] [LOCAL ] DRLL: Loaded 6438 existing records from primary storage. [2025-09-16T18:08:20.135961] [INFO ] [MAIN ] DRLL: Loaded 6438 existing records. [2025-09-16T18:08:20.310266] [WARN ] [MAIN ] DRLL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:08:20.310538] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-09-16T18:08:20.310590] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-09-16T18:08:20.310865] [DEBUG] [LOCAL ] DRLL: Deleted primary data file. [2025-09-16T18:08:20.310960] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-09-16T18:08:20.384457] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-09-16T18:08:20.663006] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:08:21.174907] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-09-16T18:08:21.449345] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-16T18:08:21.974909] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-09-16T18:08:22.057376] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-16T18:08:22.128042] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-16T18:08:22.774898] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-09-16T18:08:23.291181] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-16T18:08:23.547531] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-16T18:08:23.574840] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-09-16T18:08:24.069368] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-16T18:08:24.374905] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-09-16T18:08:25.174891] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-09-16T18:08:25.704311] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-16T18:08:25.974900] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-09-16T18:08:26.774905] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-09-16T18:08:27.517575] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-16T18:08:27.523595] [INFO ] [REMOTE ] DRH: Full fetch complete (54535 records). [2025-09-16T18:08:27.523719] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-09-16T18:08:27.588339] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-09-16T18:08:27.910804] [DEBUG] [VALIDATOR ] DRH: All expected trading days are present. [2025-09-16T18:08:27.910966] [DEBUG] [VALIDATOR ] DRH: Primary data validation passed. [2025-09-16T18:08:27.911733] [INFO ] [MAIN ] DRH: Fetched primary data is valid. [2025-09-16T18:08:27.911844] [DEBUG] [LOCAL ] DRH: Saving primary data. [2025-09-16T18:08:27.913221] [DEBUG] [LOCAL ] DRH: Trimmed 54535 records to 37403 (keeping 150 days of data) [2025-09-16T18:08:28.034518] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (2.86 seconds). [2025-09-16T18:08:28.184322] [DEBUG] [LOCAL ] DRH: Primary data saved (37403 records). [2025-09-16T18:08:28.184606] [INFO ] [MAIN ] DRH: Full history saved. [2025-09-16T18:08:28.184737] [INFO ] [MAIN ] Update Progress: 648/2369 symbols completed. DRH took 19.7s. Estimated remaining: 3h 1m 43s. Rate: 9.5 symbols/min [2025-09-16T18:08:28.323331] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-16T18:08:28.374494] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:08:28.375142] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-09-16T18:08:28.393295] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-16T18:08:28.399506] [INFO ] [REMOTE ] DRI: Full fetch complete (52061 records). [2025-09-16T18:08:28.399678] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-09-16T18:08:28.516245] [DEBUG] [LOCAL ] DSL: Loaded 19964 existing records from primary storage. [2025-09-16T18:08:28.521994] [INFO ] [MAIN ] DSL: Loaded 19964 existing records. [2025-09-16T18:08:28.902867] [WARN ] [MAIN ] DSL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:08:28.967723] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-09-16T18:08:28.980672] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-09-16T18:08:28.990085] [DEBUG] [LOCAL ] DSL: Deleted primary data file. [2025-09-16T18:08:28.990201] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-09-16T18:08:29.003709] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-16T18:08:29.003818] [DEBUG] [VALIDATOR ] DRI: All expected trading days are present. [2025-09-16T18:08:29.040171] [DEBUG] [VALIDATOR ] DRI: Primary data validation passed. [2025-09-16T18:08:29.053301] [INFO ] [MAIN ] DRI: Fetched primary data is valid. [2025-09-16T18:08:29.073804] [DEBUG] [LOCAL ] DRI: Saving primary data. [2025-09-16T18:08:29.143451] [DEBUG] [LOCAL ] DRI: Trimmed 52061 records to 35099 (keeping 150 days of data) [2025-09-16T18:08:29.178067] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-09-16T18:08:29.535701] [INFO ] [REMOTE ] DSL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:08:29.587927] [DEBUG] [LOCAL ] DRI: Primary data saved (35099 records). [2025-09-16T18:08:29.588080] [INFO ] [MAIN ] DRI: Full history saved. [2025-09-16T18:08:29.588169] [INFO ] [MAIN ] Update Progress: 649/2369 symbols completed. DRI took 20.0s. Estimated remaining: 3h 1m 23s. Rate: 9.5 symbols/min [2025-09-16T18:08:29.773405] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:08:29.783770] [DEBUG] [LOCAL ] DSM: Loaded 10060 existing records from primary storage. [2025-09-16T18:08:29.783885] [INFO ] [MAIN ] DSM: Loaded 10060 existing records. [2025-09-16T18:08:29.968637] [WARN ] [MAIN ] DSM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:08:29.969017] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-09-16T18:08:29.969066] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-09-16T18:08:29.969487] [DEBUG] [LOCAL ] DSM: Deleted primary data file. [2025-09-16T18:08:29.969536] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-09-16T18:08:29.980622] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-09-16T18:08:30.329363] [INFO ] [REMOTE ] DSM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:08:30.337401] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-16T18:08:30.774902] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-09-16T18:08:31.362733] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-16T18:08:31.574868] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-09-16T18:08:32.136835] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-16T18:08:32.143184] [INFO ] [REMOTE ] DOW: Full fetch complete (58411 records). [2025-09-16T18:08:32.143300] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-09-16T18:08:32.380011] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-09-16T18:08:32.548906] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present. [2025-09-16T18:08:32.549175] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed. [2025-09-16T18:08:32.550041] [INFO ] [MAIN ] DOW: Fetched primary data is valid. [2025-09-16T18:08:32.550111] [DEBUG] [LOCAL ] DOW: Saving primary data. [2025-09-16T18:08:32.557970] [DEBUG] [LOCAL ] DOW: Trimmed 58411 records to 40083 (keeping 150 days of data) [2025-09-16T18:08:32.570487] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-16T18:08:32.829453] [DEBUG] [LOCAL ] DOW: Primary data saved (40083 records). [2025-09-16T18:08:32.829624] [INFO ] [MAIN ] DOW: Full history saved. [2025-09-16T18:08:32.830983] [INFO ] [MAIN ] Update Progress: 650/2369 symbols completed. DOW took 47.6s. Estimated remaining: 3h 1m 9s. Rate: 9.5 symbols/min [2025-09-16T18:08:33.000955] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:08:33.004634] [DEBUG] [LOCAL ] DSMC: Loaded 1215 existing records from primary storage. [2025-09-16T18:08:33.004743] [INFO ] [MAIN ] DSMC: Loaded 1215 existing records. [2025-09-16T18:08:33.175106] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-09-16T18:08:33.178351] [WARN ] [MAIN ] DSMC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:08:33.179491] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-09-16T18:08:33.179537] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-09-16T18:08:33.179808] [DEBUG] [LOCAL ] DSMC: Deleted primary data file. [2025-09-16T18:08:33.179856] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-09-16T18:08:33.312905] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-16T18:08:33.342525] [INFO ] [REMOTE ] DRLL: Full fetch complete (11134 records). [2025-09-16T18:08:33.372248] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-09-16T18:08:33.786998] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:08:33.928886] [DEBUG] [VALIDATOR ] DRLL: All expected trading days are present. [2025-09-16T18:08:33.928966] [DEBUG] [VALIDATOR ] DRLL: Primary data validation passed. [2025-09-16T18:08:33.929200] [INFO ] [MAIN ] DRLL: Fetched primary data is valid. [2025-09-16T18:08:33.929241] [DEBUG] [LOCAL ] DRLL: Saving primary data. [2025-09-16T18:08:33.929755] [DEBUG] [LOCAL ] DRLL: Trimmed 11134 records to 6504 (keeping 150 days of data) [2025-09-16T18:08:33.970677] [DEBUG] [LOCAL ] DRLL: Primary data saved (6504 records). [2025-09-16T18:08:33.970818] [INFO ] [MAIN ] DRLL: Full history saved. [2025-09-16T18:08:33.970907] [INFO ] [MAIN ] Update Progress: 651/2369 symbols completed. DRLL took 14.0s. Estimated remaining: 3h 0m 49s. Rate: 9.5 symbols/min [2025-09-16T18:08:33.982135] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-09-16T18:08:34.150299] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:08:34.150517] [DEBUG] [LOCAL ] DSU: No existing data file found in primary storage. [2025-09-16T18:08:34.150564] [WARN ] [MAIN ] DSU: No existing data found, performing full refresh instead. [2025-09-16T18:08:34.150911] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-09-16T18:08:34.150988] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-09-16T18:08:34.151071] [DEBUG] [LOCAL ] DSU: No primary data file found to delete. [2025-09-16T18:08:34.151135] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-09-16T18:08:34.283710] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-16T18:08:34.537024] [INFO ] [REMOTE ] DSU: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:08:34.774900] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-09-16T18:08:35.192329] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-16T18:08:35.237118] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-16T18:08:35.574900] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-09-16T18:08:36.327232] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-16T18:08:36.374868] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-09-16T18:08:37.053078] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-16T18:08:37.174893] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-09-16T18:08:37.974918] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-09-16T18:08:38.537876] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-16T18:08:38.774888] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-09-16T18:08:39.117941] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-16T18:08:39.303399] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-16T18:08:39.574911] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-09-16T18:08:40.374892] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-09-16T18:08:40.531128] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-16T18:08:41.174970] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-09-16T18:08:41.427387] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-16T18:08:41.971624] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-16T18:08:41.976009] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-09-16T18:08:42.774949] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-09-16T18:08:43.013059] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-16T18:08:43.574955] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-09-16T18:08:43.806159] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-16T18:08:44.374924] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-09-16T18:08:44.474127] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-16T18:08:45.174943] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-09-16T18:08:45.724247] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-16T18:08:45.974910] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-09-16T18:08:46.416302] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-16T18:08:46.418420] [INFO ] [REMOTE ] DSM: Full fetch complete (17923 records). [2025-09-16T18:08:46.418493] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-09-16T18:08:46.782684] [DEBUG] [VALIDATOR ] DSM: All expected trading days are present. [2025-09-16T18:08:46.782442] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-09-16T18:08:46.783132] [DEBUG] [VALIDATOR ] DSM: Primary data validation passed. [2025-09-16T18:08:46.784376] [INFO ] [MAIN ] DSM: Fetched primary data is valid. [2025-09-16T18:08:46.784453] [DEBUG] [LOCAL ] DSM: Saving primary data. [2025-09-16T18:08:46.785230] [DEBUG] [LOCAL ] DSM: Trimmed 17923 records to 10175 (keeping 150 days of data) [2025-09-16T18:08:46.845049] [DEBUG] [LOCAL ] DSM: Primary data saved (10175 records). [2025-09-16T18:08:46.845198] [INFO ] [MAIN ] DSM: Full history saved. [2025-09-16T18:08:46.845281] [INFO ] [MAIN ] Update Progress: 652/2369 symbols completed. DSM took 17.3s. Estimated remaining: 3h 0m 60s. Rate: 9.5 symbols/min [2025-09-16T18:08:47.022145] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:08:47.040772] [DEBUG] [LOCAL ] DSX: Loaded 17629 existing records from primary storage. [2025-09-16T18:08:47.040918] [INFO ] [MAIN ] DSX: Loaded 17629 existing records. [2025-09-16T18:08:47.225622] [WARN ] [MAIN ] DSX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:08:47.240800] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-09-16T18:08:47.240932] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-09-16T18:08:47.242204] [DEBUG] [LOCAL ] DSX: Deleted primary data file. [2025-09-16T18:08:47.242144] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-16T18:08:47.242365] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-09-16T18:08:47.580061] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-09-16T18:08:47.624563] [INFO ] [REMOTE ] DSX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:08:47.685543] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-16T18:08:48.374909] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-09-16T18:08:48.902167] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-16T18:08:48.905772] [INFO ] [REMOTE ] DSL: Full fetch complete (30785 records). [2025-09-16T18:08:48.905858] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-09-16T18:08:49.180059] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-09-16T18:08:49.291181] [DEBUG] [VALIDATOR ] DSL: All expected trading days are present. [2025-09-16T18:08:49.291259] [DEBUG] [VALIDATOR ] DSL: Primary data validation passed. [2025-09-16T18:08:49.291765] [INFO ] [MAIN ] DSL: Fetched primary data is valid. [2025-09-16T18:08:49.291821] [DEBUG] [LOCAL ] DSL: Saving primary data. [2025-09-16T18:08:49.292548] [DEBUG] [LOCAL ] DSL: Trimmed 30785 records to 20214 (keeping 150 days of data) [2025-09-16T18:08:49.430180] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-16T18:08:49.441492] [DEBUG] [LOCAL ] DSL: Primary data saved (20214 records). [2025-09-16T18:08:49.441601] [INFO ] [MAIN ] DSL: Full history saved. [2025-09-16T18:08:49.441703] [INFO ] [MAIN ] Update Progress: 653/2369 symbols completed. DSL took 21.3s. Estimated remaining: 3h 0m 44s. Rate: 9.5 symbols/min [2025-09-16T18:08:49.619439] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:08:49.656664] [DEBUG] [LOCAL ] DT: Loaded 39040 existing records from primary storage. [2025-09-16T18:08:49.656837] [INFO ] [MAIN ] DT: Loaded 39040 existing records. [2025-09-16T18:08:49.832458] [WARN ] [MAIN ] DT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:08:49.832729] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-09-16T18:08:49.832777] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-09-16T18:08:49.833593] [DEBUG] [LOCAL ] DT: Deleted primary data file. [2025-09-16T18:08:49.833664] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-09-16T18:08:49.936538] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-16T18:08:49.980018] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-09-16T18:08:50.226304] [INFO ] [REMOTE ] DT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:08:50.774923] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-09-16T18:08:51.286158] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-16T18:08:51.358552] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-16T18:08:51.574908] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-09-16T18:08:52.026551] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-16T18:08:52.374911] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-09-16T18:08:52.710437] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-16T18:08:53.174913] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-09-16T18:08:53.974901] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-09-16T18:08:54.396300] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-16T18:08:54.774979] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-09-16T18:08:54.943709] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-16T18:08:55.467060] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-16T18:08:55.574914] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-09-16T18:08:56.374908] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-09-16T18:08:57.174864] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-09-16T18:08:57.321574] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-16T18:08:57.604680] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-16T18:08:57.843486] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-16T18:08:57.974889] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-09-16T18:08:58.774943] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-09-16T18:08:59.151505] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-16T18:08:59.574927] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-09-16T18:09:00.244297] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-16T18:09:00.374868] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-09-16T18:09:00.404806] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-16T18:09:01.174920] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-09-16T18:09:01.772819] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-16T18:09:01.974938] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-09-16T18:09:02.054144] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-16T18:09:02.360112] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-16T18:09:02.361024] [INFO ] [REMOTE ] DSMC: Full fetch complete (2222 records). [2025-09-16T18:09:02.361114] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-09-16T18:09:02.361576] [FATAL] [VALIDATOR ] DSMC: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:09:02.361681] [FATAL] [MAIN ] DSMC: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:09:02.361728] [WARN ] [MAIN ] DSMC: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:09:02.361787] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-09-16T18:09:02.361846] [DEBUG] [LOCAL ] DSMC: No primary data file found to delete. [2025-09-16T18:09:02.361883] [INFO ] [LOCAL ] DSMC: Starting deletion of derivative data. [2025-09-16T18:09:02.362190] [DEBUG] [LOCAL ] DSMC: Deleted derivative data file. [2025-09-16T18:09:02.362284] [INFO ] [MAIN ] Update Progress: 654/2369 symbols completed. DSMC took 29.5s. Estimated remaining: 3h 0m 55s. Rate: 9.5 symbols/min [2025-09-16T18:09:02.540244] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:09:02.549716] [DEBUG] [LOCAL ] DTB: Loaded 3739 existing records from primary storage. [2025-09-16T18:09:02.549877] [INFO ] [MAIN ] DTB: Loaded 3739 existing records. [2025-09-16T18:09:02.727956] [WARN ] [MAIN ] DTB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:09:02.728198] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-09-16T18:09:02.728243] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-09-16T18:09:02.728478] [DEBUG] [LOCAL ] DTB: Deleted primary data file. [2025-09-16T18:09:02.728535] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-09-16T18:09:02.782071] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-09-16T18:09:03.082892] [INFO ] [REMOTE ] DTB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:09:03.574907] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-09-16T18:09:04.374925] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-09-16T18:09:04.436771] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-16T18:09:04.529697] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-16T18:09:05.027853] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-16T18:09:05.174867] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-09-16T18:09:05.520877] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-16T18:09:05.974907] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-09-16T18:09:06.774921] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-09-16T18:09:06.975033] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-16T18:09:07.574877] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-09-16T18:09:07.976535] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-16T18:09:08.184621] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-16T18:09:08.374892] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-09-16T18:09:09.174901] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-09-16T18:09:09.596517] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-16T18:09:09.974926] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-09-16T18:09:10.293789] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-16T18:09:10.782030] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-09-16T18:09:10.783962] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-16T18:09:11.574897] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-09-16T18:09:12.122400] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-16T18:09:12.374901] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-09-16T18:09:12.584592] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-16T18:09:13.174907] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-09-16T18:09:13.211555] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-16T18:09:13.214744] [INFO ] [REMOTE ] DSU: Full fetch complete (23266 records). [2025-09-16T18:09:13.214819] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-09-16T18:09:13.577678] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-09-16T18:09:13.577763] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-09-16T18:09:13.578248] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-09-16T18:09:13.578289] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-09-16T18:09:13.578904] [DEBUG] [LOCAL ] DSU: Trimmed 23266 records to 15673 (keeping 150 days of data) [2025-09-16T18:09:13.677511] [DEBUG] [LOCAL ] DSU: Primary data saved (15673 records). [2025-09-16T18:09:13.677704] [INFO ] [MAIN ] DSU: Full history saved. [2025-09-16T18:09:13.677807] [INFO ] [MAIN ] Update Progress: 655/2369 symbols completed. DSU took 39.7s. Estimated remaining: 3h 1m 1s. Rate: 9.5 symbols/min [2025-09-16T18:09:13.846683] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:09:13.882193] [DEBUG] [LOCAL ] DTE: Loaded 35164 existing records from primary storage. [2025-09-16T18:09:13.882359] [INFO ] [MAIN ] DTE: Loaded 35164 existing records. [2025-09-16T18:09:13.980236] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-09-16T18:09:14.062971] [WARN ] [MAIN ] DTE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:09:14.063200] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-09-16T18:09:14.063247] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-09-16T18:09:14.064160] [DEBUG] [LOCAL ] DTE: Deleted primary data file. [2025-09-16T18:09:14.064213] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-09-16T18:09:14.420942] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-16T18:09:14.442929] [INFO ] [REMOTE ] DSX: Full fetch complete (27399 records). [2025-09-16T18:09:14.446208] [INFO ] [REMOTE ] DTE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:09:14.446350] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-09-16T18:09:14.735954] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-16T18:09:14.780012] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-09-16T18:09:14.821347] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present. [2025-09-16T18:09:14.821423] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed. [2025-09-16T18:09:14.821974] [INFO ] [MAIN ] DSX: Fetched primary data is valid. [2025-09-16T18:09:14.822019] [DEBUG] [LOCAL ] DSX: Saving primary data. [2025-09-16T18:09:14.822760] [DEBUG] [LOCAL ] DSX: Trimmed 27399 records to 17834 (keeping 150 days of data) [2025-09-16T18:09:14.925850] [DEBUG] [LOCAL ] DSX: Primary data saved (17834 records). [2025-09-16T18:09:14.925999] [INFO ] [MAIN ] DSX: Full history saved. [2025-09-16T18:09:14.926085] [INFO ] [MAIN ] Update Progress: 656/2369 symbols completed. DSX took 28.1s. Estimated remaining: 3h 0m 42s. Rate: 9.5 symbols/min [2025-09-16T18:09:15.095160] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:09:15.095339] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-09-16T18:09:15.095378] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-09-16T18:09:15.095493] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-09-16T18:09:15.095531] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-16T18:09:15.095571] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-16T18:09:15.095603] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-09-16T18:09:15.445918] [INFO ] [REMOTE ] DTF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:09:15.574861] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-09-16T18:09:16.085950] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-16T18:09:16.374888] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-09-16T18:09:16.699993] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-16T18:09:16.706299] [INFO ] [REMOTE ] DT: Full fetch complete (57586 records). [2025-09-16T18:09:16.706402] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-09-16T18:09:17.105806] [DEBUG] [VALIDATOR ] DT: All expected trading days are present. [2025-09-16T18:09:17.105906] [DEBUG] [VALIDATOR ] DT: Primary data validation passed. [2025-09-16T18:09:17.106719] [INFO ] [MAIN ] DT: Fetched primary data is valid. [2025-09-16T18:09:17.106770] [DEBUG] [LOCAL ] DT: Saving primary data. [2025-09-16T18:09:17.108036] [DEBUG] [LOCAL ] DT: Trimmed 57586 records to 39430 (keeping 150 days of data) [2025-09-16T18:09:17.199870] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-09-16T18:09:17.203722] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-16T18:09:17.352393] [DEBUG] [LOCAL ] DT: Primary data saved (39430 records). [2025-09-16T18:09:17.352554] [INFO ] [MAIN ] DT: Full history saved. [2025-09-16T18:09:17.352776] [INFO ] [MAIN ] Update Progress: 657/2369 symbols completed. DT took 27.9s. Estimated remaining: 3h 0m 25s. Rate: 9.5 symbols/min [2025-09-16T18:09:17.523782] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:09:17.524025] [DEBUG] [LOCAL ] DTG: No existing data file found in primary storage. [2025-09-16T18:09:17.524065] [WARN ] [MAIN ] DTG: No existing data found, performing full refresh instead. [2025-09-16T18:09:17.524226] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-09-16T18:09:17.524279] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-09-16T18:09:17.524323] [DEBUG] [LOCAL ] DTG: No primary data file found to delete. [2025-09-16T18:09:17.524356] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-09-16T18:09:17.772958] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-16T18:09:17.883437] [INFO ] [REMOTE ] DTG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:09:17.974905] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-09-16T18:09:18.774920] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-09-16T18:09:18.801112] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-16T18:09:18.802445] [INFO ] [REMOTE ] DTB: Full fetch complete (4990 records). [2025-09-16T18:09:18.802512] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-09-16T18:09:19.163776] [DEBUG] [VALIDATOR ] DTB: All expected trading days are present. [2025-09-16T18:09:19.163873] [DEBUG] [VALIDATOR ] DTB: Primary data validation passed. [2025-09-16T18:09:19.164038] [INFO ] [MAIN ] DTB: Fetched primary data is valid. [2025-09-16T18:09:19.164080] [DEBUG] [LOCAL ] DTB: Saving primary data. [2025-09-16T18:09:19.164484] [DEBUG] [LOCAL ] DTB: Trimmed 4990 records to 3766 (keeping 150 days of data) [2025-09-16T18:09:19.187890] [DEBUG] [LOCAL ] DTB: Primary data saved (3766 records). [2025-09-16T18:09:19.187974] [INFO ] [MAIN ] DTB: Full history saved. [2025-09-16T18:09:19.188076] [INFO ] [MAIN ] Update Progress: 658/2369 symbols completed. DTB took 16.8s. Estimated remaining: 3h 0m 7s. Rate: 9.5 symbols/min [2025-09-16T18:09:19.356074] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:09:19.389721] [DEBUG] [LOCAL ] DTM: Loaded 31775 existing records from primary storage. [2025-09-16T18:09:19.389859] [INFO ] [MAIN ] DTM: Loaded 31775 existing records. [2025-09-16T18:09:19.566837] [WARN ] [MAIN ] DTM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:09:19.567083] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-09-16T18:09:19.567128] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-09-16T18:09:19.568001] [DEBUG] [LOCAL ] DTM: Deleted primary data file. [2025-09-16T18:09:19.568052] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-09-16T18:09:19.580844] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-09-16T18:09:19.930227] [INFO ] [REMOTE ] DTM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:09:20.110353] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-16T18:09:20.387128] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-09-16T18:09:20.407007] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-16T18:09:21.170252] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-16T18:09:21.174834] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-09-16T18:09:21.974937] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-09-16T18:09:22.095090] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-16T18:09:22.774956] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-09-16T18:09:23.132707] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-16T18:09:23.574918] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-09-16T18:09:24.374909] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-09-16T18:09:24.405821] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-16T18:09:24.749029] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-16T18:09:25.118050] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (3.14 seconds). [2025-09-16T18:09:25.174873] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-09-16T18:09:25.546953] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-16T18:09:25.974906] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-09-16T18:09:26.351767] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-16T18:09:26.774904] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-09-16T18:09:27.574903] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-09-16T18:09:28.087337] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-16T18:09:28.374908] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-09-16T18:09:28.942130] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-16T18:09:29.174938] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-09-16T18:09:29.624882] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-16T18:09:29.675036] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-16T18:09:29.974895] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-09-16T18:09:30.774894] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-09-16T18:09:31.282381] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-16T18:09:31.574899] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-09-16T18:09:32.084611] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-16T18:09:32.098305] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-16T18:09:32.374890] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-09-16T18:09:33.174924] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-09-16T18:09:33.790442] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-16T18:09:33.974966] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-09-16T18:09:34.503905] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-16T18:09:34.774984] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-09-16T18:09:35.327974] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-16T18:09:35.574898] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-09-16T18:09:36.070557] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-16T18:09:36.374940] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-09-16T18:09:36.654688] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-09-16T18:09:36.880272] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-16T18:09:37.174918] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-09-16T18:09:37.553074] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-16T18:09:37.974932] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-09-16T18:09:38.774934] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-09-16T18:09:38.810635] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-16T18:09:38.811827] [INFO ] [REMOTE ] DTG: Full fetch complete (6398 records). [2025-09-16T18:09:38.811895] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-09-16T18:09:38.812321] [FATAL] [VALIDATOR ] DTG: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:09:38.812401] [FATAL] [MAIN ] DTG: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:09:38.812451] [WARN ] [MAIN ] DTG: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:09:38.812510] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-09-16T18:09:38.812567] [DEBUG] [LOCAL ] DTG: No primary data file found to delete. [2025-09-16T18:09:38.812603] [INFO ] [LOCAL ] DTG: Starting deletion of derivative data. [2025-09-16T18:09:38.812678] [DEBUG] [LOCAL ] DTG: No derivative data file found to delete. [2025-09-16T18:09:38.812748] [INFO ] [MAIN ] Update Progress: 659/2369 symbols completed. DTG took 21.5s. Estimated remaining: 3h 0m 35s. Rate: 9.5 symbols/min [2025-09-16T18:09:38.983515] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:09:38.989118] [DEBUG] [LOCAL ] DTW: Loaded 3503 existing records from primary storage. [2025-09-16T18:09:38.989222] [INFO ] [MAIN ] DTW: Loaded 3503 existing records. [2025-09-16T18:09:39.168690] [WARN ] [MAIN ] DTW: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:09:39.168930] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-09-16T18:09:39.169001] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-09-16T18:09:39.169289] [DEBUG] [LOCAL ] DTW: Deleted primary data file. [2025-09-16T18:09:39.169342] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-09-16T18:09:39.528429] [INFO ] [REMOTE ] DTW: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:09:39.574929] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-09-16T18:09:40.084466] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-16T18:09:40.268216] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-16T18:09:40.277122] [INFO ] [REMOTE ] DTE: Full fetch complete (52179 records). [2025-09-16T18:09:40.277307] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-09-16T18:09:40.377734] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-09-16T18:09:40.655852] [DEBUG] [VALIDATOR ] DTE: All expected trading days are present. [2025-09-16T18:09:40.655933] [DEBUG] [VALIDATOR ] DTE: Primary data validation passed. [2025-09-16T18:09:40.656606] [INFO ] [MAIN ] DTE: Fetched primary data is valid. [2025-09-16T18:09:40.656677] [DEBUG] [LOCAL ] DTE: Saving primary data. [2025-09-16T18:09:40.658200] [DEBUG] [LOCAL ] DTE: Trimmed 52179 records to 35490 (keeping 150 days of data) [2025-09-16T18:09:40.878499] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-16T18:09:40.907193] [DEBUG] [LOCAL ] DTE: Primary data saved (35490 records). [2025-09-16T18:09:40.907377] [INFO ] [MAIN ] DTE: Full history saved. [2025-09-16T18:09:40.907518] [INFO ] [MAIN ] Update Progress: 660/2369 symbols completed. DTE took 27.2s. Estimated remaining: 3h 0m 18s. Rate: 9.5 symbols/min [2025-09-16T18:09:41.080921] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:09:41.125077] [DEBUG] [LOCAL ] DUK: Loaded 39449 existing records from primary storage. [2025-09-16T18:09:41.125230] [INFO ] [MAIN ] DUK: Loaded 39449 existing records. [2025-09-16T18:09:41.180140] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-09-16T18:09:41.317839] [WARN ] [MAIN ] DUK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:09:41.318239] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-09-16T18:09:41.318294] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-09-16T18:09:41.319362] [DEBUG] [LOCAL ] DUK: Deleted primary data file. [2025-09-16T18:09:41.319429] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-09-16T18:09:41.685158] [INFO ] [REMOTE ] DUK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:09:41.974916] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-09-16T18:09:42.617789] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-16T18:09:42.619056] [INFO ] [REMOTE ] DTF: Full fetch complete (1331 records). [2025-09-16T18:09:42.619154] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-09-16T18:09:42.619659] [FATAL] [VALIDATOR ] DTF: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:09:42.619754] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:09:42.619804] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:09:42.619856] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-16T18:09:42.619942] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-16T18:09:42.619991] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-09-16T18:09:42.620056] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-09-16T18:09:42.620131] [INFO ] [MAIN ] Update Progress: 661/2369 symbols completed. DTF took 27.7s. Estimated remaining: 2h 59m 60s. Rate: 9.5 symbols/min [2025-09-16T18:09:42.784841] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-09-16T18:09:42.816715] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:09:42.825504] [DEBUG] [LOCAL ] DUKB: Loaded 4653 existing records from primary storage. [2025-09-16T18:09:42.825692] [INFO ] [MAIN ] DUKB: Loaded 4653 existing records. [2025-09-16T18:09:43.007333] [WARN ] [MAIN ] DUKB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:09:43.007749] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-09-16T18:09:43.007852] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-09-16T18:09:43.008120] [DEBUG] [LOCAL ] DUKB: Deleted primary data file. [2025-09-16T18:09:43.008166] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-09-16T18:09:43.347236] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-16T18:09:43.349580] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-16T18:09:43.426113] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:09:43.574899] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-09-16T18:09:43.975300] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-16T18:09:44.374898] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-09-16T18:09:44.786536] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-16T18:09:45.174900] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-09-16T18:09:45.974933] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-09-16T18:09:46.438802] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-16T18:09:46.539974] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-16T18:09:46.774908] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-09-16T18:09:47.133206] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-16T18:09:47.574926] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-09-16T18:09:48.374900] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-09-16T18:09:49.174896] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-09-16T18:09:49.329192] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-16T18:09:49.710375] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-16T18:09:49.974907] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-09-16T18:09:50.587372] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-16T18:09:50.774907] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-09-16T18:09:51.292555] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-16T18:09:51.574872] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-09-16T18:09:52.044510] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-16T18:09:52.062777] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-16T18:09:52.374905] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-09-16T18:09:53.174921] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-09-16T18:09:53.974908] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-09-16T18:09:54.316401] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-16T18:09:54.350197] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-16T18:09:54.357951] [INFO ] [REMOTE ] DTM: Full fetch complete (48820 records). [2025-09-16T18:09:54.358094] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-09-16T18:09:54.673966] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-16T18:09:54.700015] [INFO ] [REMOTE ] DTW: Full fetch complete (5242 records). [2025-09-16T18:09:54.700177] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-09-16T18:09:54.783790] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-09-16T18:09:54.905836] [DEBUG] [VALIDATOR ] DTM: All expected trading days are present. [2025-09-16T18:09:54.940892] [DEBUG] [VALIDATOR ] DTM: Primary data validation passed. [2025-09-16T18:09:54.959243] [INFO ] [MAIN ] DTM: Fetched primary data is valid. [2025-09-16T18:09:54.959591] [DEBUG] [LOCAL ] DTM: Saving primary data. [2025-09-16T18:09:55.060241] [DEBUG] [LOCAL ] DTM: Trimmed 48820 records to 32101 (keeping 150 days of data) [2025-09-16T18:09:55.262248] [DEBUG] [VALIDATOR ] DTW: All expected trading days are present. [2025-09-16T18:09:55.262630] [DEBUG] [VALIDATOR ] DTW: Primary data validation passed. [2025-09-16T18:09:55.263378] [INFO ] [MAIN ] DTW: Fetched primary data is valid. [2025-09-16T18:09:55.264028] [DEBUG] [LOCAL ] DTW: Saving primary data. [2025-09-16T18:09:55.265873] [DEBUG] [LOCAL ] DTW: Trimmed 5242 records to 3569 (keeping 150 days of data) [2025-09-16T18:09:55.294727] [DEBUG] [LOCAL ] DTW: Primary data saved (3569 records). [2025-09-16T18:09:55.295403] [INFO ] [MAIN ] DTW: Full history saved. [2025-09-16T18:09:55.295874] [INFO ] [MAIN ] Update Progress: 662/2369 symbols completed. DTW took 16.5s. Estimated remaining: 3h 0m 10s. Rate: 9.5 symbols/min [2025-09-16T18:09:55.540663] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:09:55.581581] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-09-16T18:09:55.646573] [DEBUG] [LOCAL ] DV: Loaded 37587 existing records from primary storage. [2025-09-16T18:09:55.647941] [INFO ] [MAIN ] DV: Loaded 37587 existing records. [2025-09-16T18:09:55.752622] [DEBUG] [LOCAL ] DTM: Primary data saved (32101 records). [2025-09-16T18:09:55.752786] [INFO ] [MAIN ] DTM: Full history saved. [2025-09-16T18:09:55.753825] [INFO ] [MAIN ] Update Progress: 663/2369 symbols completed. DTM took 36.6s. Estimated remaining: 2h 59m 48s. Rate: 9.5 symbols/min [2025-09-16T18:09:55.929890] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:09:55.930377] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-09-16T18:09:55.940805] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-09-16T18:09:55.976682] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-09-16T18:09:55.999225] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-09-16T18:09:55.999179] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:09:56.188124] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-16T18:09:56.322080] [DEBUG] [LOCAL ] DVA: Loaded 30220 existing records from primary storage. [2025-09-16T18:09:56.378264] [INFO ] [MAIN ] DVA: Loaded 30220 existing records. [2025-09-16T18:09:56.387182] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-09-16T18:09:56.387130] [INFO ] [REMOTE ] DV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:09:56.566098] [WARN ] [MAIN ] DVA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:09:56.566409] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-09-16T18:09:56.566533] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-09-16T18:09:56.567269] [DEBUG] [LOCAL ] DVA: Deleted primary data file. [2025-09-16T18:09:56.583709] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-09-16T18:09:56.696679] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-16T18:09:56.957125] [INFO ] [REMOTE ] DVA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:09:57.177086] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-09-16T18:09:57.181159] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-16T18:09:57.974924] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-09-16T18:09:58.774876] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-09-16T18:09:58.865897] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-16T18:09:59.589286] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-09-16T18:09:59.598303] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-16T18:09:59.617115] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-16T18:10:00.374926] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-09-16T18:10:00.970174] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-16T18:10:01.174902] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-09-16T18:10:01.455538] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-16T18:10:01.974899] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-09-16T18:10:02.774921] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-09-16T18:10:03.056324] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-16T18:10:03.322863] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-16T18:10:03.324114] [INFO ] [REMOTE ] DUKB: Full fetch complete (6886 records). [2025-09-16T18:10:03.324188] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-09-16T18:10:03.587827] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-09-16T18:10:03.712900] [DEBUG] [VALIDATOR ] DUKB: All expected trading days are present. [2025-09-16T18:10:03.713179] [DEBUG] [VALIDATOR ] DUKB: Primary data validation passed. [2025-09-16T18:10:03.713373] [INFO ] [MAIN ] DUKB: Fetched primary data is valid. [2025-09-16T18:10:03.713416] [DEBUG] [LOCAL ] DUKB: Saving primary data. [2025-09-16T18:10:03.713851] [DEBUG] [LOCAL ] DUKB: Trimmed 6886 records to 4679 (keeping 150 days of data) [2025-09-16T18:10:03.747262] [DEBUG] [LOCAL ] DUKB: Primary data saved (4679 records). [2025-09-16T18:10:03.747425] [INFO ] [MAIN ] DUKB: Full history saved. [2025-09-16T18:10:03.747560] [INFO ] [MAIN ] Update Progress: 664/2369 symbols completed. DUKB took 21.1s. Estimated remaining: 2h 59m 46s. Rate: 9.5 symbols/min [2025-09-16T18:10:03.937515] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:10:03.973132] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-16T18:10:04.023372] [DEBUG] [LOCAL ] DVN: Loaded 39659 existing records from primary storage. [2025-09-16T18:10:04.023557] [INFO ] [MAIN ] DVN: Loaded 39659 existing records. [2025-09-16T18:10:04.206006] [WARN ] [MAIN ] DVN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:10:04.206272] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-09-16T18:10:04.206325] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-09-16T18:10:04.207238] [DEBUG] [LOCAL ] DVN: Deleted primary data file. [2025-09-16T18:10:04.207301] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-09-16T18:10:04.379990] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-09-16T18:10:04.598500] [INFO ] [REMOTE ] DVN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:10:05.174917] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-09-16T18:10:05.454652] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-16T18:10:05.974957] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-09-16T18:10:06.044292] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-16T18:10:06.771329] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-16T18:10:06.780580] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-09-16T18:10:07.574941] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-09-16T18:10:07.661026] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-16T18:10:08.314282] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-16T18:10:08.374950] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-09-16T18:10:09.174916] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-09-16T18:10:09.677777] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-16T18:10:09.752854] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-16T18:10:09.974945] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-09-16T18:10:10.311717] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-16T18:10:10.774912] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-09-16T18:10:11.574957] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-09-16T18:10:12.374944] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-09-16T18:10:12.722014] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (2.75 seconds). [2025-09-16T18:10:12.748824] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-16T18:10:12.755722] [INFO ] [REMOTE ] DUK: Full fetch complete (58155 records). [2025-09-16T18:10:12.755896] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-09-16T18:10:13.139463] [DEBUG] [VALIDATOR ] DUK: All expected trading days are present. [2025-09-16T18:10:13.139542] [DEBUG] [VALIDATOR ] DUK: Primary data validation passed. [2025-09-16T18:10:13.140271] [INFO ] [MAIN ] DUK: Fetched primary data is valid. [2025-09-16T18:10:13.140317] [DEBUG] [LOCAL ] DUK: Saving primary data. [2025-09-16T18:10:13.141469] [DEBUG] [LOCAL ] DUK: Trimmed 58155 records to 39839 (keeping 150 days of data) [2025-09-16T18:10:13.201296] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-09-16T18:10:13.428301] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-16T18:10:13.444956] [DEBUG] [LOCAL ] DUK: Primary data saved (39839 records). [2025-09-16T18:10:13.445125] [INFO ] [MAIN ] DUK: Full history saved. [2025-09-16T18:10:13.447248] [INFO ] [MAIN ] Update Progress: 665/2369 symbols completed. DUK took 32.5s. Estimated remaining: 2h 59m 49s. Rate: 9.5 symbols/min [2025-09-16T18:10:13.623015] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:10:13.675992] [DEBUG] [LOCAL ] DX: Loaded 38676 existing records from primary storage. [2025-09-16T18:10:13.676260] [INFO ] [MAIN ] DX: Loaded 38676 existing records. [2025-09-16T18:10:13.868737] [WARN ] [MAIN ] DX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:10:13.868984] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-09-16T18:10:13.869142] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-09-16T18:10:13.878391] [DEBUG] [LOCAL ] DX: Deleted primary data file. [2025-09-16T18:10:13.892614] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-09-16T18:10:13.969186] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-16T18:10:13.985905] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-09-16T18:10:14.259235] [INFO ] [REMOTE ] DX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:10:14.774887] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-09-16T18:10:14.960833] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-16T18:10:15.574987] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-09-16T18:10:16.074907] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-16T18:10:16.374902] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-09-16T18:10:16.591244] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-16T18:10:16.731579] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-16T18:10:17.174910] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-09-16T18:10:17.974939] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-09-16T18:10:18.436856] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-16T18:10:18.597206] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-16T18:10:18.774888] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-09-16T18:10:19.364718] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-16T18:10:19.370609] [INFO ] [REMOTE ] DVA: Full fetch complete (45950 records). [2025-09-16T18:10:19.370794] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-09-16T18:10:19.584207] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-09-16T18:10:19.761047] [DEBUG] [VALIDATOR ] DVA: All expected trading days are present. [2025-09-16T18:10:19.761122] [DEBUG] [VALIDATOR ] DVA: Primary data validation passed. [2025-09-16T18:10:19.761755] [INFO ] [MAIN ] DVA: Fetched primary data is valid. [2025-09-16T18:10:19.761800] [DEBUG] [LOCAL ] DVA: Saving primary data. [2025-09-16T18:10:19.762758] [DEBUG] [LOCAL ] DVA: Trimmed 45950 records to 30522 (keeping 150 days of data) [2025-09-16T18:10:19.944620] [DEBUG] [LOCAL ] DVA: Primary data saved (30522 records). [2025-09-16T18:10:19.944773] [INFO ] [MAIN ] DVA: Full history saved. [2025-09-16T18:10:19.946701] [INFO ] [MAIN ] Update Progress: 666/2369 symbols completed. DVA took 24.2s. Estimated remaining: 2h 59m 43s. Rate: 9.5 symbols/min [2025-09-16T18:10:20.116780] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:10:20.155470] [DEBUG] [LOCAL ] DXC: Loaded 36743 existing records from primary storage. [2025-09-16T18:10:20.155632] [INFO ] [MAIN ] DXC: Loaded 36743 existing records. [2025-09-16T18:10:20.335758] [WARN ] [MAIN ] DXC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:10:20.336048] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-09-16T18:10:20.336094] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-09-16T18:10:20.336868] [DEBUG] [LOCAL ] DXC: Deleted primary data file. [2025-09-16T18:10:20.336922] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-09-16T18:10:20.383005] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-09-16T18:10:20.696439] [INFO ] [REMOTE ] DXC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:10:21.042355] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-16T18:10:21.174905] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-09-16T18:10:21.539689] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-16T18:10:21.605029] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-16T18:10:21.611538] [INFO ] [REMOTE ] DV: Full fetch complete (55583 records). [2025-09-16T18:10:21.611752] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-09-16T18:10:21.975966] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-09-16T18:10:22.011521] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-09-16T18:10:22.011614] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-09-16T18:10:22.012353] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-09-16T18:10:22.012402] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-09-16T18:10:22.014583] [DEBUG] [LOCAL ] DV: Trimmed 55583 records to 37966 (keeping 150 days of data) [2025-09-16T18:10:22.245378] [DEBUG] [LOCAL ] DV: Primary data saved (37966 records). [2025-09-16T18:10:22.245536] [INFO ] [MAIN ] DV: Full history saved. [2025-09-16T18:10:22.245625] [INFO ] [MAIN ] Update Progress: 667/2369 symbols completed. DV took 26.9s. Estimated remaining: 2h 59m 26s. Rate: 9.5 symbols/min [2025-09-16T18:10:22.428317] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:10:22.455997] [DEBUG] [LOCAL ] DXYZ: Loaded 26469 existing records from primary storage. [2025-09-16T18:10:22.456181] [INFO ] [MAIN ] DXYZ: Loaded 26469 existing records. [2025-09-16T18:10:22.598137] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-16T18:10:22.685111] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:10:22.685338] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-09-16T18:10:22.685385] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-09-16T18:10:22.685982] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-09-16T18:10:22.686029] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-09-16T18:10:22.783019] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-09-16T18:10:23.037696] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:10:23.574902] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-09-16T18:10:23.952156] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-16T18:10:24.374921] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-09-16T18:10:24.840717] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-16T18:10:25.018190] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-16T18:10:25.174840] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-09-16T18:10:25.825119] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-16T18:10:25.974841] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-09-16T18:10:26.254940] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-16T18:10:26.774977] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-09-16T18:10:27.574923] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-09-16T18:10:27.877013] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-16T18:10:28.248034] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-16T18:10:28.374872] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-09-16T18:10:29.174901] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-09-16T18:10:29.523261] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-16T18:10:29.530112] [INFO ] [REMOTE ] DVN: Full fetch complete (58379 records). [2025-09-16T18:10:29.530264] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-09-16T18:10:29.925814] [DEBUG] [VALIDATOR ] DVN: All expected trading days are present. [2025-09-16T18:10:29.925990] [DEBUG] [VALIDATOR ] DVN: Primary data validation passed. [2025-09-16T18:10:29.926820] [INFO ] [MAIN ] DVN: Fetched primary data is valid. [2025-09-16T18:10:29.926959] [DEBUG] [LOCAL ] DVN: Saving primary data. [2025-09-16T18:10:29.928453] [DEBUG] [LOCAL ] DVN: Trimmed 58379 records to 40049 (keeping 150 days of data) [2025-09-16T18:10:30.008878] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-09-16T18:10:30.051240] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-16T18:10:30.226132] [DEBUG] [LOCAL ] DVN: Primary data saved (40049 records). [2025-09-16T18:10:30.226265] [INFO ] [MAIN ] DVN: Full history saved. [2025-09-16T18:10:30.226348] [INFO ] [MAIN ] Update Progress: 668/2369 symbols completed. DVN took 26.5s. Estimated remaining: 2h 59m 24s. Rate: 9.5 symbols/min [2025-09-16T18:10:30.401615] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:10:30.423739] [DEBUG] [LOCAL ] DY: Loaded 20943 existing records from primary storage. [2025-09-16T18:10:30.423966] [INFO ] [MAIN ] DY: Loaded 20943 existing records. [2025-09-16T18:10:30.611715] [WARN ] [MAIN ] DY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:10:30.611949] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-09-16T18:10:30.611995] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-09-16T18:10:30.612557] [DEBUG] [LOCAL ] DY: Deleted primary data file. [2025-09-16T18:10:30.612602] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-09-16T18:10:30.784928] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-09-16T18:10:30.968074] [INFO ] [REMOTE ] DY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:10:31.017802] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-16T18:10:31.574902] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-09-16T18:10:31.984771] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-16T18:10:32.374927] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-09-16T18:10:32.430289] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-16T18:10:32.731968] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-16T18:10:33.174901] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-09-16T18:10:33.974920] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-09-16T18:10:34.062279] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-16T18:10:34.503630] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-16T18:10:34.774953] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-09-16T18:10:35.574903] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-09-16T18:10:35.741573] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-16T18:10:36.152322] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-16T18:10:36.374935] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-09-16T18:10:37.174893] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-09-16T18:10:37.244910] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-16T18:10:37.974917] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-09-16T18:10:38.133833] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-16T18:10:38.674852] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-16T18:10:38.683046] [INFO ] [REMOTE ] DXC: Full fetch complete (53294 records). [2025-09-16T18:10:38.683234] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-09-16T18:10:38.779993] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-09-16T18:10:39.092067] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present. [2025-09-16T18:10:39.092150] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed. [2025-09-16T18:10:39.092897] [INFO ] [MAIN ] DXC: Fetched primary data is valid. [2025-09-16T18:10:39.092944] [DEBUG] [LOCAL ] DXC: Saving primary data. [2025-09-16T18:10:39.094115] [DEBUG] [LOCAL ] DXC: Trimmed 53294 records to 37119 (keeping 150 days of data) [2025-09-16T18:10:39.316709] [DEBUG] [LOCAL ] DXC: Primary data saved (37119 records). [2025-09-16T18:10:39.316870] [INFO ] [MAIN ] DXC: Full history saved. [2025-09-16T18:10:39.317506] [INFO ] [MAIN ] Update Progress: 669/2369 symbols completed. DXC took 19.4s. Estimated remaining: 2h 59m 25s. Rate: 9.5 symbols/min [2025-09-16T18:10:39.487877] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:10:39.512426] [DEBUG] [LOCAL ] E: Loaded 24276 existing records from primary storage. [2025-09-16T18:10:39.512577] [INFO ] [MAIN ] E: Loaded 24276 existing records. [2025-09-16T18:10:39.581234] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-09-16T18:10:39.715732] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:10:39.715979] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-09-16T18:10:39.716032] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-09-16T18:10:39.716611] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-09-16T18:10:39.716688] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-09-16T18:10:40.071219] [INFO ] [REMOTE ] E: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:10:40.087232] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-16T18:10:40.093339] [INFO ] [REMOTE ] DX: Full fetch complete (57002 records). [2025-09-16T18:10:40.093444] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-09-16T18:10:40.380085] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-09-16T18:10:40.483055] [DEBUG] [VALIDATOR ] DX: All expected trading days are present. [2025-09-16T18:10:40.483154] [DEBUG] [VALIDATOR ] DX: Primary data validation passed. [2025-09-16T18:10:40.483977] [INFO ] [MAIN ] DX: Fetched primary data is valid. [2025-09-16T18:10:40.484027] [DEBUG] [LOCAL ] DX: Saving primary data. [2025-09-16T18:10:40.485296] [DEBUG] [LOCAL ] DX: Trimmed 57002 records to 39065 (keeping 150 days of data) [2025-09-16T18:10:40.632151] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-16T18:10:40.771245] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-16T18:10:40.791736] [DEBUG] [LOCAL ] DX: Primary data saved (39065 records). [2025-09-16T18:10:40.791866] [INFO ] [MAIN ] DX: Full history saved. [2025-09-16T18:10:40.791951] [INFO ] [MAIN ] Update Progress: 670/2369 symbols completed. DX took 27.3s. Estimated remaining: 2h 59m 6s. Rate: 9.5 symbols/min [2025-09-16T18:10:40.966458] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:10:40.997519] [DEBUG] [LOCAL ] EAF: Loaded 32555 existing records from primary storage. [2025-09-16T18:10:40.997690] [INFO ] [MAIN ] EAF: Loaded 32555 existing records. [2025-09-16T18:10:41.176462] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-09-16T18:10:41.179918] [WARN ] [MAIN ] EAF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:10:41.180814] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-09-16T18:10:41.180865] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-09-16T18:10:41.181594] [DEBUG] [LOCAL ] EAF: Deleted primary data file. [2025-09-16T18:10:41.181671] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-09-16T18:10:41.544093] [INFO ] [REMOTE ] EAF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:10:41.599608] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-16T18:10:41.974917] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-09-16T18:10:42.774904] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-09-16T18:10:43.204844] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-16T18:10:43.365278] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-16T18:10:43.575199] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-09-16T18:10:44.374917] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-09-16T18:10:44.410677] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-16T18:10:45.174944] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-09-16T18:10:45.681476] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-16T18:10:45.708137] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-16T18:10:45.974914] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-09-16T18:10:46.347221] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-16T18:10:46.774904] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-09-16T18:10:47.505707] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-16T18:10:47.574881] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-09-16T18:10:47.978827] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-16T18:10:48.374914] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-09-16T18:10:48.990193] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-16T18:10:49.174919] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-09-16T18:10:49.670477] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-16T18:10:49.974950] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-09-16T18:10:50.774901] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-09-16T18:10:50.960967] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-16T18:10:51.535193] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-16T18:10:51.574863] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-09-16T18:10:52.217175] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-16T18:10:52.374909] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-09-16T18:10:52.805326] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-16T18:10:53.174932] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-09-16T18:10:53.398787] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-16T18:10:53.404318] [INFO ] [REMOTE ] DY: Full fetch complete (33429 records). [2025-09-16T18:10:53.404448] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-09-16T18:10:53.779854] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-09-16T18:10:53.779939] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-09-16T18:10:53.780464] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-09-16T18:10:53.780507] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-09-16T18:10:53.781301] [DEBUG] [LOCAL ] DY: Trimmed 33429 records to 21107 (keeping 150 days of data) [2025-09-16T18:10:53.907980] [DEBUG] [LOCAL ] DY: Primary data saved (21107 records). [2025-09-16T18:10:53.908110] [INFO ] [MAIN ] DY: Full history saved. [2025-09-16T18:10:53.908191] [INFO ] [MAIN ] Update Progress: 671/2369 symbols completed. DY took 23.7s. Estimated remaining: 2h 59m 17s. Rate: 9.5 symbols/min [2025-09-16T18:10:53.980061] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-09-16T18:10:54.086477] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:10:54.090984] [DEBUG] [LOCAL ] EAI: Loaded 2827 existing records from primary storage. [2025-09-16T18:10:54.091063] [INFO ] [MAIN ] EAI: Loaded 2827 existing records. [2025-09-16T18:10:54.266114] [WARN ] [MAIN ] EAI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:10:54.266323] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-09-16T18:10:54.266389] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-09-16T18:10:54.266614] [DEBUG] [LOCAL ] EAI: Deleted primary data file. [2025-09-16T18:10:54.266680] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-09-16T18:10:54.615514] [INFO ] [REMOTE ] EAI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:10:54.652409] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-16T18:10:54.774849] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-09-16T18:10:55.197183] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-16T18:10:55.327052] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-16T18:10:55.331368] [INFO ] [REMOTE ] DXYZ: Full fetch complete (40513 records). [2025-09-16T18:10:55.331447] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-09-16T18:10:55.580063] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-09-16T18:10:55.707680] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-09-16T18:10:55.707879] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-09-16T18:10:55.708513] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-09-16T18:10:55.708557] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-09-16T18:10:55.709466] [DEBUG] [LOCAL ] DXYZ: Trimmed 40513 records to 26694 (keeping 150 days of data) [2025-09-16T18:10:55.864707] [DEBUG] [LOCAL ] DXYZ: Primary data saved (26694 records). [2025-09-16T18:10:55.864842] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-09-16T18:10:55.864926] [INFO ] [MAIN ] Update Progress: 672/2369 symbols completed. DXYZ took 33.6s. Estimated remaining: 2h 58m 60s. Rate: 9.5 symbols/min [2025-09-16T18:10:56.034224] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:10:56.052962] [DEBUG] [LOCAL ] EARN: Loaded 20059 existing records from primary storage. [2025-09-16T18:10:56.053111] [INFO ] [MAIN ] EARN: Loaded 20059 existing records. [2025-09-16T18:10:56.229535] [WARN ] [MAIN ] EARN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:10:56.233825] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-09-16T18:10:56.234360] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-09-16T18:10:56.234599] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-16T18:10:56.235832] [DEBUG] [LOCAL ] EARN: Deleted primary data file. [2025-09-16T18:10:56.235947] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-09-16T18:10:56.379157] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-09-16T18:10:56.589411] [INFO ] [REMOTE ] EARN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:10:57.174961] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-09-16T18:10:57.830371] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-16T18:10:57.974888] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-09-16T18:10:58.370540] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-16T18:10:58.598978] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-16T18:10:58.774891] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-09-16T18:10:59.402104] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-16T18:10:59.574944] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-09-16T18:11:00.374914] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-09-16T18:11:00.775133] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-16T18:11:01.174902] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-09-16T18:11:01.974999] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-09-16T18:11:02.284265] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-16T18:11:02.328111] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-16T18:11:02.774956] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-09-16T18:11:02.822512] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-09-16T18:11:03.575011] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-09-16T18:11:04.049332] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-16T18:11:04.098408] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-16T18:11:04.101879] [INFO ] [REMOTE ] E: Full fetch complete (36179 records). [2025-09-16T18:11:04.101959] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-09-16T18:11:04.102523] [FATAL] [VALIDATOR ] E: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:11:04.102612] [FATAL] [MAIN ] E: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:11:04.102702] [WARN ] [MAIN ] E: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:11:04.102767] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-09-16T18:11:04.102853] [DEBUG] [LOCAL ] E: No primary data file found to delete. [2025-09-16T18:11:04.102892] [INFO ] [LOCAL ] E: Starting deletion of derivative data. [2025-09-16T18:11:04.103224] [DEBUG] [LOCAL ] E: Deleted derivative data file. [2025-09-16T18:11:04.103319] [INFO ] [MAIN ] Update Progress: 673/2369 symbols completed. E took 24.8s. Estimated remaining: 2h 58m 58s. Rate: 9.5 symbols/min [2025-09-16T18:11:04.271706] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:11:04.312037] [DEBUG] [LOCAL ] EAT: Loaded 36616 existing records from primary storage. [2025-09-16T18:11:04.312177] [INFO ] [MAIN ] EAT: Loaded 36616 existing records. [2025-09-16T18:11:04.380104] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-09-16T18:11:04.491123] [WARN ] [MAIN ] EAT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:11:04.491356] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-09-16T18:11:04.491400] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-09-16T18:11:04.492203] [DEBUG] [LOCAL ] EAT: Deleted primary data file. [2025-09-16T18:11:04.492252] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-09-16T18:11:04.844021] [INFO ] [REMOTE ] EAT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:11:05.174912] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-09-16T18:11:05.857529] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-16T18:11:05.974880] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-09-16T18:11:06.774863] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-09-16T18:11:06.845034] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-16T18:11:07.402244] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-16T18:11:07.574980] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-09-16T18:11:07.948661] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-16T18:11:08.374956] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-09-16T18:11:08.490636] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-16T18:11:09.174914] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-09-16T18:11:09.641245] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-16T18:11:09.776171] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-16T18:11:09.974873] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-09-16T18:11:10.539620] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-16T18:11:10.540755] [INFO ] [REMOTE ] EAI: Full fetch complete (4340 records). [2025-09-16T18:11:10.540822] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-09-16T18:11:10.780049] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-09-16T18:11:10.906673] [DEBUG] [VALIDATOR ] EAI: All expected trading days are present. [2025-09-16T18:11:10.906754] [DEBUG] [VALIDATOR ] EAI: Primary data validation passed. [2025-09-16T18:11:10.906903] [INFO ] [MAIN ] EAI: Fetched primary data is valid. [2025-09-16T18:11:10.906958] [DEBUG] [LOCAL ] EAI: Saving primary data. [2025-09-16T18:11:10.907357] [DEBUG] [LOCAL ] EAI: Trimmed 4340 records to 2911 (keeping 150 days of data) [2025-09-16T18:11:10.926995] [DEBUG] [LOCAL ] EAI: Primary data saved (2911 records). [2025-09-16T18:11:10.927073] [INFO ] [MAIN ] EAI: Full history saved. [2025-09-16T18:11:10.927150] [INFO ] [MAIN ] Update Progress: 674/2369 symbols completed. EAI took 17.0s. Estimated remaining: 2h 58m 53s. Rate: 9.5 symbols/min [2025-09-16T18:11:11.098333] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:11:11.122916] [DEBUG] [LOCAL ] EB: Loaded 26972 existing records from primary storage. [2025-09-16T18:11:11.123056] [INFO ] [MAIN ] EB: Loaded 26972 existing records. [2025-09-16T18:11:11.301095] [WARN ] [MAIN ] EB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:11:11.301337] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-09-16T18:11:11.301382] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-09-16T18:11:11.301950] [DEBUG] [LOCAL ] EB: Deleted primary data file. [2025-09-16T18:11:11.302009] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-09-16T18:11:11.584466] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-09-16T18:11:11.665491] [INFO ] [REMOTE ] EB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:11:12.266390] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-16T18:11:12.374888] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-09-16T18:11:12.570045] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-16T18:11:13.174897] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-09-16T18:11:13.835506] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-16T18:11:13.974907] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-09-16T18:11:14.523239] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-16T18:11:14.526582] [INFO ] [REMOTE ] EAF: Full fetch complete (48473 records). [2025-09-16T18:11:14.526721] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-09-16T18:11:14.527356] [FATAL] [VALIDATOR ] EAF: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:11:14.527434] [FATAL] [MAIN ] EAF: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:11:14.527472] [WARN ] [MAIN ] EAF: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:11:14.527520] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-09-16T18:11:14.527600] [DEBUG] [LOCAL ] EAF: No primary data file found to delete. [2025-09-16T18:11:14.527660] [INFO ] [LOCAL ] EAF: Starting deletion of derivative data. [2025-09-16T18:11:14.527935] [DEBUG] [LOCAL ] EAF: Deleted derivative data file. [2025-09-16T18:11:14.528031] [INFO ] [MAIN ] Update Progress: 675/2369 symbols completed. EAF took 33.7s. Estimated remaining: 2h 58m 40s. Rate: 9.5 symbols/min [2025-09-16T18:11:14.697808] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:11:14.712347] [DEBUG] [LOCAL ] EBF: Loaded 13862 existing records from primary storage. [2025-09-16T18:11:14.712457] [INFO ] [MAIN ] EBF: Loaded 13862 existing records. [2025-09-16T18:11:14.776836] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-09-16T18:11:14.903988] [WARN ] [MAIN ] EBF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:11:14.919415] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-09-16T18:11:14.919677] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-09-16T18:11:14.920841] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-16T18:11:14.920881] [DEBUG] [LOCAL ] EBF: Deleted primary data file. [2025-09-16T18:11:14.926388] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-09-16T18:11:15.278929] [INFO ] [REMOTE ] EBF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:11:15.574908] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-09-16T18:11:16.228333] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-16T18:11:16.374847] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-09-16T18:11:16.418721] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-16T18:11:16.421547] [INFO ] [REMOTE ] EARN: Full fetch complete (34252 records). [2025-09-16T18:11:16.421623] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-09-16T18:11:16.422210] [FATAL] [VALIDATOR ] EARN: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:11:16.422304] [FATAL] [MAIN ] EARN: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:11:16.422361] [WARN ] [MAIN ] EARN: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:11:16.422426] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-09-16T18:11:16.422491] [DEBUG] [LOCAL ] EARN: No primary data file found to delete. [2025-09-16T18:11:16.422530] [INFO ] [LOCAL ] EARN: Starting deletion of derivative data. [2025-09-16T18:11:16.422830] [DEBUG] [LOCAL ] EARN: Deleted derivative data file. [2025-09-16T18:11:16.422927] [INFO ] [MAIN ] Update Progress: 676/2369 symbols completed. EARN took 20.6s. Estimated remaining: 2h 58m 22s. Rate: 9.5 symbols/min [2025-09-16T18:11:16.593484] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:11:16.624754] [DEBUG] [LOCAL ] EBR: Loaded 31335 existing records from primary storage. [2025-09-16T18:11:16.624925] [INFO ] [MAIN ] EBR: Loaded 31335 existing records. [2025-09-16T18:11:16.801555] [WARN ] [MAIN ] EBR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:11:16.801819] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-09-16T18:11:16.801866] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-09-16T18:11:16.802561] [DEBUG] [LOCAL ] EBR: Deleted primary data file. [2025-09-16T18:11:16.802610] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-09-16T18:11:17.188389] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-09-16T18:11:17.193755] [INFO ] [REMOTE ] EBR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:11:17.974940] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-09-16T18:11:18.157683] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-16T18:11:18.328376] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-16T18:11:18.774912] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-09-16T18:11:18.841379] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-16T18:11:19.574907] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-09-16T18:11:20.094767] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-16T18:11:20.374911] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-09-16T18:11:20.705374] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-16T18:11:21.174899] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-09-16T18:11:21.481842] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-16T18:11:21.974915] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-09-16T18:11:22.298378] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-16T18:11:22.774899] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-09-16T18:11:23.411295] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-16T18:11:23.416828] [INFO ] [REMOTE ] EAT: Full fetch complete (53943 records). [2025-09-16T18:11:23.416928] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-09-16T18:11:23.417585] [FATAL] [VALIDATOR ] EAT: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:11:23.417689] [FATAL] [MAIN ] EAT: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:11:23.417731] [WARN ] [MAIN ] EAT: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:11:23.417772] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-09-16T18:11:23.417832] [DEBUG] [LOCAL ] EAT: No primary data file found to delete. [2025-09-16T18:11:23.417871] [INFO ] [LOCAL ] EAT: Starting deletion of derivative data. [2025-09-16T18:11:23.418157] [DEBUG] [LOCAL ] EAT: Deleted derivative data file. [2025-09-16T18:11:23.418819] [INFO ] [MAIN ] Update Progress: 677/2369 symbols completed. EAT took 19.3s. Estimated remaining: 2h 58m 18s. Rate: 9.5 symbols/min [2025-09-16T18:11:23.574906] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-09-16T18:11:23.830311] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-16T18:11:24.349624] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-16T18:11:24.374874] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-09-16T18:11:25.119353] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-16T18:11:25.174888] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-09-16T18:11:25.860158] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-16T18:11:25.974904] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-09-16T18:11:26.774907] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-09-16T18:11:27.156990] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-16T18:11:27.574898] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-09-16T18:11:28.376933] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-09-16T18:11:28.380085] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-16T18:11:29.095216] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-16T18:11:29.174870] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-09-16T18:11:29.236481] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-16T18:11:29.974905] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-09-16T18:11:30.539516] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-16T18:11:30.774890] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-09-16T18:11:31.247242] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-16T18:11:31.574895] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-09-16T18:11:32.173743] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-16T18:11:32.374905] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-09-16T18:11:32.618583] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-16T18:11:33.174957] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-09-16T18:11:33.619446] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-16T18:11:33.623323] [INFO ] [REMOTE ] EB: Full fetch complete (41476 records). [2025-09-16T18:11:33.623418] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-09-16T18:11:33.987097] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-09-16T18:11:34.002063] [DEBUG] [VALIDATOR ] EB: All expected trading days are present. [2025-09-16T18:11:34.002137] [DEBUG] [VALIDATOR ] EB: Primary data validation passed. [2025-09-16T18:11:34.002763] [INFO ] [MAIN ] EB: Fetched primary data is valid. [2025-09-16T18:11:34.002886] [DEBUG] [LOCAL ] EB: Saving primary data. [2025-09-16T18:11:34.003988] [DEBUG] [LOCAL ] EB: Trimmed 41476 records to 27190 (keeping 150 days of data) [2025-09-16T18:11:34.164510] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-16T18:11:34.168318] [DEBUG] [LOCAL ] EB: Primary data saved (27190 records). [2025-09-16T18:11:34.168614] [INFO ] [MAIN ] EB: Full history saved. [2025-09-16T18:11:34.168713] [INFO ] [MAIN ] Update Progress: 678/2369 symbols completed. EB took 23.2s. Estimated remaining: 2h 58m 22s. Rate: 9.5 symbols/min [2025-09-16T18:11:34.168794] [INFO ] [REMOTE ] EBF: Full fetch complete (21435 records). [2025-09-16T18:11:34.168963] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-09-16T18:11:34.550565] [DEBUG] [VALIDATOR ] EBF: All expected trading days are present. [2025-09-16T18:11:34.550664] [DEBUG] [VALIDATOR ] EBF: Primary data validation passed. [2025-09-16T18:11:34.551099] [INFO ] [MAIN ] EBF: Fetched primary data is valid. [2025-09-16T18:11:34.551141] [DEBUG] [LOCAL ] EBF: Saving primary data. [2025-09-16T18:11:34.551858] [DEBUG] [LOCAL ] EBF: Trimmed 21435 records to 13951 (keeping 150 days of data) [2025-09-16T18:11:34.635876] [DEBUG] [LOCAL ] EBF: Primary data saved (13951 records). [2025-09-16T18:11:34.636023] [INFO ] [MAIN ] EBF: Full history saved. [2025-09-16T18:11:34.636110] [INFO ] [MAIN ] Update Progress: 679/2369 symbols completed. EBF took 20.1s. Estimated remaining: 2h 58m 1s. Rate: 9.5 symbols/min [2025-09-16T18:11:35.512929] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-16T18:11:35.522369] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-09-16T18:11:37.045884] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-16T18:11:37.054315] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-09-16T18:11:38.677510] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-16T18:11:38.690294] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-09-16T18:11:40.322448] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-16T18:11:40.332067] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-09-16T18:11:41.873397] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-16T18:11:41.878576] [INFO ] [REMOTE ] EBR: Full fetch complete (46456 records). [2025-09-16T18:11:41.878686] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-09-16T18:11:42.268205] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-09-16T18:11:42.268282] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-09-16T18:11:42.268914] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-09-16T18:11:42.268959] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-09-16T18:11:42.269932] [DEBUG] [LOCAL ] EBR: Trimmed 46456 records to 31640 (keeping 150 days of data) [2025-09-16T18:11:42.450492] [DEBUG] [LOCAL ] EBR: Primary data saved (31640 records). [2025-09-16T18:11:42.450634] [INFO ] [MAIN ] EBR: Full history saved. [2025-09-16T18:11:42.450737] [INFO ] [MAIN ] Update Progress: 680/2369 symbols completed. EBR took 26.0s. Estimated remaining: 2h 57m 59s. Rate: 9.5 symbols/min [2025-09-16T18:11:43.147598] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:11:43.207763] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:11:43.180219] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:11:43.241874] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:11:43.301617] [DEBUG] [LOCAL ] ECAT: Loaded 21685 existing records from primary storage. [2025-09-16T18:11:43.302319] [INFO ] [MAIN ] ECAT: Loaded 21685 existing records. [2025-09-16T18:11:43.369951] [DEBUG] [LOCAL ] ECC: Loaded 31558 existing records from primary storage. [2025-09-16T18:11:43.395934] [INFO ] [MAIN ] ECC: Loaded 31558 existing records. [2025-09-16T18:11:43.443969] [DEBUG] [LOCAL ] EC: Loaded 36092 existing records from primary storage. [2025-09-16T18:11:43.460349] [DEBUG] [LOCAL ] EBS: Loaded 34806 existing records from primary storage. [2025-09-16T18:11:43.500102] [INFO ] [MAIN ] EC: Loaded 36092 existing records. [2025-09-16T18:11:43.519823] [INFO ] [MAIN ] EBS: Loaded 34806 existing records. [2025-09-16T18:11:43.778454] [WARN ] [MAIN ] ECAT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:11:43.926290] [WARN ] [MAIN ] ECC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:11:43.957485] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-09-16T18:11:43.977195] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-09-16T18:11:43.993233] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-09-16T18:11:44.014104] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-09-16T18:11:44.023349] [WARN ] [MAIN ] EBS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:11:44.055227] [DEBUG] [LOCAL ] ECAT: Deleted primary data file. [2025-09-16T18:11:44.054188] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-09-16T18:11:44.055435] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-09-16T18:11:44.047270] [DEBUG] [LOCAL ] ECC: Deleted primary data file. [2025-09-16T18:11:44.055382] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-09-16T18:11:44.074231] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-09-16T18:11:44.085692] [DEBUG] [LOCAL ] EBS: Deleted primary data file. [2025-09-16T18:11:44.085631] [WARN ] [MAIN ] EC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:11:44.125336] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-09-16T18:11:44.154076] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-09-16T18:11:44.162901] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-09-16T18:11:44.256437] [DEBUG] [LOCAL ] EC: Deleted primary data file. [2025-09-16T18:11:44.256554] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-09-16T18:11:45.323842] [INFO ] [REMOTE ] EBS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:11:45.338121] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:11:45.343605] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-09-16T18:11:45.372033] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-09-16T18:11:45.446953] [INFO ] [REMOTE ] ECC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:11:45.477250] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-09-16T18:11:45.508501] [INFO ] [REMOTE ] EC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:11:45.509124] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-09-16T18:11:46.907587] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-16T18:11:46.916296] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-09-16T18:11:47.036500] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-16T18:11:47.043287] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-09-16T18:11:47.164149] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-16T18:11:47.171622] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-09-16T18:11:47.289900] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-16T18:11:47.299415] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-09-16T18:11:48.112541] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-16T18:11:48.122787] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-09-16T18:11:48.408858] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-16T18:11:48.415759] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-09-16T18:11:48.799788] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-16T18:11:48.809261] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-09-16T18:11:48.929003] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-16T18:11:48.939496] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-09-16T18:11:49.796137] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-16T18:11:49.805850] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-09-16T18:11:49.829309] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-16T18:11:49.835385] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-09-16T18:11:50.158884] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-16T18:11:50.168625] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-09-16T18:11:50.440423] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-16T18:11:50.451276] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-09-16T18:11:50.985306] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-16T18:11:50.991422] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-09-16T18:11:51.151853] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-16T18:11:51.574912] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-09-16T18:11:51.759746] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-16T18:11:52.258850] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-16T18:11:52.374901] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-09-16T18:11:52.459094] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-16T18:11:53.097282] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-16T18:11:53.174927] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-09-16T18:11:53.683330] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-16T18:11:53.974910] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-09-16T18:11:54.549584] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-16T18:11:54.774872] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-09-16T18:11:55.574868] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-09-16T18:11:55.576128] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-16T18:11:56.231010] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-16T18:11:56.374849] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-09-16T18:11:56.481947] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-16T18:11:57.174919] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-09-16T18:11:57.974920] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-09-16T18:11:58.054721] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-16T18:11:58.060103] [INFO ] [REMOTE ] EBS: Full fetch complete (51089 records). [2025-09-16T18:11:58.060243] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-09-16T18:11:58.435668] [DEBUG] [VALIDATOR ] EBS: All expected trading days are present. [2025-09-16T18:11:58.435746] [DEBUG] [VALIDATOR ] EBS: Primary data validation passed. [2025-09-16T18:11:58.436355] [INFO ] [MAIN ] EBS: Fetched primary data is valid. [2025-09-16T18:11:58.436419] [DEBUG] [LOCAL ] EBS: Saving primary data. [2025-09-16T18:11:58.437424] [DEBUG] [LOCAL ] EBS: Trimmed 51089 records to 35107 (keeping 150 days of data) [2025-09-16T18:11:58.644366] [DEBUG] [LOCAL ] EBS: Primary data saved (35107 records). [2025-09-16T18:11:58.644564] [INFO ] [MAIN ] EBS: Full history saved. [2025-09-16T18:11:58.646124] [INFO ] [MAIN ] Update Progress: 681/2369 symbols completed. EBS took 16.2s. Estimated remaining: 2h 58m 17s. Rate: 9.5 symbols/min [2025-09-16T18:11:58.776394] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-09-16T18:11:58.824713] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:11:58.840064] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-09-16T18:11:58.850754] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-09-16T18:11:58.851184] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-09-16T18:11:58.851757] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-16T18:11:58.853154] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-16T18:11:58.863210] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-09-16T18:11:58.863613] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-09-16T18:11:59.214534] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:11:59.400819] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-16T18:11:59.405038] [INFO ] [REMOTE ] ECAT: Full fetch complete (32389 records). [2025-09-16T18:11:59.405115] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-09-16T18:11:59.581799] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-09-16T18:11:59.773105] [DEBUG] [VALIDATOR ] ECAT: All expected trading days are present. [2025-09-16T18:11:59.773178] [DEBUG] [VALIDATOR ] ECAT: Primary data validation passed. [2025-09-16T18:11:59.773684] [INFO ] [MAIN ] ECAT: Fetched primary data is valid. [2025-09-16T18:11:59.773727] [DEBUG] [LOCAL ] ECAT: Saving primary data. [2025-09-16T18:11:59.774435] [DEBUG] [LOCAL ] ECAT: Trimmed 32389 records to 21933 (keeping 150 days of data) [2025-09-16T18:11:59.914252] [DEBUG] [LOCAL ] ECAT: Primary data saved (21933 records). [2025-09-16T18:11:59.914391] [INFO ] [MAIN ] ECAT: Full history saved. [2025-09-16T18:11:59.914500] [INFO ] [MAIN ] Update Progress: 682/2369 symbols completed. ECAT took 17.5s. Estimated remaining: 2h 57m 58s. Rate: 9.5 symbols/min [2025-09-16T18:12:00.085191] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:12:00.089443] [DEBUG] [LOCAL ] ECCU: Loaded 1672 existing records from primary storage. [2025-09-16T18:12:00.089527] [INFO ] [MAIN ] ECCU: Loaded 1672 existing records. [2025-09-16T18:12:00.139407] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-16T18:12:00.268038] [WARN ] [MAIN ] ECCU: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:12:00.268251] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-09-16T18:12:00.268318] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-09-16T18:12:00.268546] [DEBUG] [LOCAL ] ECCU: Deleted primary data file. [2025-09-16T18:12:00.268610] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-09-16T18:12:00.379975] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-09-16T18:12:00.628845] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:12:00.657291] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-16T18:12:01.174941] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-09-16T18:12:01.833321] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-16T18:12:01.974879] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-09-16T18:12:02.227948] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-16T18:12:02.314683] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-16T18:12:02.774906] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-09-16T18:12:03.338007] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-16T18:12:03.574939] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-09-16T18:12:04.021777] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-16T18:12:04.374897] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-09-16T18:12:05.174896] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-09-16T18:12:05.694400] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-16T18:12:05.974881] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-09-16T18:12:06.042508] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-16T18:12:06.447161] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-16T18:12:06.774901] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-09-16T18:12:07.574906] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-09-16T18:12:08.374908] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-09-16T18:12:08.518909] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-16T18:12:08.524183] [INFO ] [REMOTE ] ECC: Full fetch complete (46703 records). [2025-09-16T18:12:08.524273] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-09-16T18:12:08.689038] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-09-16T18:12:08.914955] [DEBUG] [VALIDATOR ] ECC: All expected trading days are present. [2025-09-16T18:12:08.915050] [DEBUG] [VALIDATOR ] ECC: Primary data validation passed. [2025-09-16T18:12:08.915771] [INFO ] [MAIN ] ECC: Fetched primary data is valid. [2025-09-16T18:12:08.915821] [DEBUG] [LOCAL ] ECC: Saving primary data. [2025-09-16T18:12:08.917038] [DEBUG] [LOCAL ] ECC: Trimmed 46703 records to 31843 (keeping 150 days of data) [2025-09-16T18:12:09.111039] [DEBUG] [LOCAL ] ECC: Primary data saved (31843 records). [2025-09-16T18:12:09.111172] [INFO ] [MAIN ] ECC: Full history saved. [2025-09-16T18:12:09.111298] [INFO ] [MAIN ] Update Progress: 683/2369 symbols completed. ECC took 26.7s. Estimated remaining: 2h 57m 59s. Rate: 9.5 symbols/min [2025-09-16T18:12:09.180125] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-09-16T18:12:09.287071] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:12:09.287268] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-09-16T18:12:09.287310] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-09-16T18:12:09.287609] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-09-16T18:12:09.287680] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-16T18:12:09.287967] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-09-16T18:12:09.288040] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-09-16T18:12:09.681891] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:12:09.685158] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-16T18:12:09.686473] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-16T18:12:09.974916] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-09-16T18:12:10.774915] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-09-16T18:12:11.574940] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-09-16T18:12:11.678986] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-16T18:12:11.994159] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-16T18:12:12.098703] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-16T18:12:12.105016] [INFO ] [REMOTE ] EC: Full fetch complete (53962 records). [2025-09-16T18:12:12.105171] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-09-16T18:12:12.380021] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-09-16T18:12:12.497938] [DEBUG] [VALIDATOR ] EC: All expected trading days are present. [2025-09-16T18:12:12.498072] [DEBUG] [VALIDATOR ] EC: Primary data validation passed. [2025-09-16T18:12:12.499318] [INFO ] [MAIN ] EC: Fetched primary data is valid. [2025-09-16T18:12:12.499423] [DEBUG] [LOCAL ] EC: Saving primary data. [2025-09-16T18:12:12.501216] [DEBUG] [LOCAL ] EC: Trimmed 53962 records to 36426 (keeping 150 days of data) [2025-09-16T18:12:12.763814] [DEBUG] [LOCAL ] EC: Primary data saved (36426 records). [2025-09-16T18:12:12.763996] [INFO ] [MAIN ] EC: Full history saved. [2025-09-16T18:12:12.764102] [INFO ] [MAIN ] Update Progress: 684/2369 symbols completed. EC took 30.3s. Estimated remaining: 2h 57m 46s. Rate: 9.5 symbols/min [2025-09-16T18:12:12.935524] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:12:12.935704] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-09-16T18:12:12.935743] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-09-16T18:12:12.935915] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-09-16T18:12:12.935969] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-16T18:12:12.936015] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-09-16T18:12:12.936050] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-09-16T18:12:13.115517] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-16T18:12:13.164087] [INFO ] [REMOTE ] ECCU: Full fetch complete (3176 records). [2025-09-16T18:12:13.193812] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-09-16T18:12:13.194142] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-09-16T18:12:13.394814] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:12:13.674196] [DEBUG] [VALIDATOR ] ECCU: All expected trading days are present. [2025-09-16T18:12:13.676622] [DEBUG] [VALIDATOR ] ECCU: Primary data validation passed. [2025-09-16T18:12:13.676775] [INFO ] [MAIN ] ECCU: Fetched primary data is valid. [2025-09-16T18:12:13.676916] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-16T18:12:13.676823] [DEBUG] [LOCAL ] ECCU: Saving primary data. [2025-09-16T18:12:13.678404] [DEBUG] [LOCAL ] ECCU: Trimmed 3176 records to 1691 (keeping 150 days of data) [2025-09-16T18:12:13.690182] [DEBUG] [LOCAL ] ECCU: Primary data saved (1691 records). [2025-09-16T18:12:13.690320] [INFO ] [MAIN ] ECCU: Full history saved. [2025-09-16T18:12:13.690404] [INFO ] [MAIN ] Update Progress: 685/2369 symbols completed. ECCU took 13.8s. Estimated remaining: 2h 57m 26s. Rate: 9.5 symbols/min [2025-09-16T18:12:13.885484] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:12:13.908887] [DEBUG] [LOCAL ] ECG: Loaded 24130 existing records from primary storage. [2025-09-16T18:12:13.909088] [INFO ] [MAIN ] ECG: Loaded 24130 existing records. [2025-09-16T18:12:13.980040] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-09-16T18:12:14.087733] [WARN ] [MAIN ] ECG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:12:14.088047] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-09-16T18:12:14.088094] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-09-16T18:12:14.088785] [DEBUG] [LOCAL ] ECG: Deleted primary data file. [2025-09-16T18:12:14.088836] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-09-16T18:12:14.362798] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-16T18:12:14.441289] [INFO ] [REMOTE ] ECG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:12:14.774947] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-09-16T18:12:15.164066] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-16T18:12:15.574909] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-09-16T18:12:15.869143] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-09-16T18:12:16.374960] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-09-16T18:12:16.701292] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-16T18:12:17.174943] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-09-16T18:12:17.444882] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-09-16T18:12:17.974915] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-09-16T18:12:18.235228] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-09-16T18:12:18.774911] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-09-16T18:12:19.030460] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-09-16T18:12:19.574911] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-09-16T18:12:20.028086] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-16T18:12:20.374910] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-09-16T18:12:20.819420] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-16T18:12:21.174895] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-09-16T18:12:21.458845] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-09-16T18:12:21.974906] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-09-16T18:12:22.282832] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-16T18:12:22.774903] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-09-16T18:12:23.072241] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-09-16T18:12:23.574911] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-09-16T18:12:24.003420] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-16T18:12:24.374921] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-09-16T18:12:24.771854] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-16T18:12:24.772675] [INFO ] [REMOTE ] ECCX: Full fetch complete (1160 records). [2025-09-16T18:12:24.772743] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-09-16T18:12:24.970609] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 146 unique days, need 150 days [2025-09-16T18:12:24.970795] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:12:24.970846] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:12:24.970895] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-16T18:12:24.970973] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-09-16T18:12:24.971013] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-09-16T18:12:24.971067] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-09-16T18:12:24.971128] [INFO ] [MAIN ] Update Progress: 686/2369 symbols completed. ECCX took 12.2s. Estimated remaining: 2h 57m 32s. Rate: 9.5 symbols/min [2025-09-16T18:12:25.144004] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:12:25.180449] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-09-16T18:12:25.183036] [DEBUG] [LOCAL ] ECL: Loaded 33964 existing records from primary storage. [2025-09-16T18:12:25.183247] [INFO ] [MAIN ] ECL: Loaded 33964 existing records. [2025-09-16T18:12:25.368532] [WARN ] [MAIN ] ECL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:12:25.368776] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-09-16T18:12:25.368834] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-09-16T18:12:25.369755] [DEBUG] [LOCAL ] ECL: Deleted primary data file. [2025-09-16T18:12:25.369811] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-09-16T18:12:25.729390] [INFO ] [REMOTE ] ECL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:12:25.974889] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-09-16T18:12:26.514084] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-16T18:12:26.774900] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-09-16T18:12:27.451248] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-16T18:12:27.526081] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-16T18:12:27.574860] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-09-16T18:12:28.176933] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-16T18:12:28.374900] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-09-16T18:12:29.174894] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-09-16T18:12:29.974932] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-09-16T18:12:30.152088] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-16T18:12:30.272496] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-16T18:12:30.273221] [INFO ] [REMOTE ] ECCC: Full fetch complete (970 records). [2025-09-16T18:12:30.273292] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-09-16T18:12:30.453690] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 146 unique days, need 150 days [2025-09-16T18:12:30.453909] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:12:30.453964] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:12:30.454008] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-16T18:12:30.454095] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-09-16T18:12:30.454132] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-09-16T18:12:30.454173] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-09-16T18:12:30.454229] [INFO ] [MAIN ] Update Progress: 687/2369 symbols completed. ECCC took 31.8s. Estimated remaining: 2h 57m 24s. Rate: 9.5 symbols/min [2025-09-16T18:12:30.626255] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:12:30.649573] [DEBUG] [LOCAL ] ECO: Loaded 13055 existing records from primary storage. [2025-09-16T18:12:30.649761] [INFO ] [MAIN ] ECO: Loaded 13055 existing records. [2025-09-16T18:12:30.780063] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-09-16T18:12:30.832839] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:12:30.833089] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-09-16T18:12:30.833139] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-09-16T18:12:30.833556] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-09-16T18:12:30.833604] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-09-16T18:12:31.207831] [INFO ] [REMOTE ] ECO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:12:31.211365] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-16T18:12:31.240736] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-16T18:12:31.574923] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-09-16T18:12:32.374954] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-09-16T18:12:32.666996] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-16T18:12:33.174932] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-09-16T18:12:33.238514] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-16T18:12:33.974917] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-09-16T18:12:34.703137] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-16T18:12:34.774870] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-09-16T18:12:35.436406] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-16T18:12:35.574895] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-09-16T18:12:36.248075] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-16T18:12:36.374903] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-09-16T18:12:36.483511] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-16T18:12:37.174935] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-09-16T18:12:37.627337] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-16T18:12:37.974905] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-09-16T18:12:38.492747] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-16T18:12:38.774906] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-09-16T18:12:39.401184] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-16T18:12:39.574906] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-09-16T18:12:39.787612] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-16T18:12:40.137002] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-16T18:12:40.137891] [INFO ] [REMOTE ] ECCW: Full fetch complete (1187 records). [2025-09-16T18:12:40.137967] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-09-16T18:12:40.313443] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 144 unique days, need 150 days [2025-09-16T18:12:40.313659] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:12:40.313709] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:12:40.313759] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-16T18:12:40.313833] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-09-16T18:12:40.313910] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-09-16T18:12:40.313958] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-09-16T18:12:40.314016] [INFO ] [MAIN ] Update Progress: 688/2369 symbols completed. ECCW took 31.2s. Estimated remaining: 2h 57m 26s. Rate: 9.5 symbols/min [2025-09-16T18:12:40.379981] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-09-16T18:12:40.484598] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:12:40.514617] [DEBUG] [LOCAL ] ECVT: Loaded 31664 existing records from primary storage. [2025-09-16T18:12:40.514777] [INFO ] [MAIN ] ECVT: Loaded 31664 existing records. [2025-09-16T18:12:40.688716] [WARN ] [MAIN ] ECVT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:12:40.688953] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-09-16T18:12:40.688997] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-09-16T18:12:40.689726] [DEBUG] [LOCAL ] ECVT: Deleted primary data file. [2025-09-16T18:12:40.689778] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-09-16T18:12:41.038692] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:12:41.174864] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-09-16T18:12:41.494690] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-16T18:12:41.974930] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-09-16T18:12:42.774911] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-09-16T18:12:42.860765] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-16T18:12:43.112532] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-16T18:12:43.574920] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-09-16T18:12:43.934631] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-16T18:12:44.374920] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-09-16T18:12:44.864510] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-16T18:12:44.870250] [INFO ] [REMOTE ] ECL: Full fetch complete (50904 records). [2025-09-16T18:12:44.870379] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-09-16T18:12:45.179986] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-09-16T18:12:45.258921] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-09-16T18:12:45.258993] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-09-16T18:12:45.259662] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-09-16T18:12:45.259712] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-09-16T18:12:45.260773] [DEBUG] [LOCAL ] ECL: Trimmed 50904 records to 34316 (keeping 150 days of data) [2025-09-16T18:12:45.474789] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-16T18:12:45.487986] [DEBUG] [LOCAL ] ECL: Primary data saved (34316 records). [2025-09-16T18:12:45.488097] [INFO ] [MAIN ] ECL: Full history saved. [2025-09-16T18:12:45.488170] [INFO ] [MAIN ] Update Progress: 689/2369 symbols completed. ECL took 20.5s. Estimated remaining: 2h 57m 17s. Rate: 9.5 symbols/min [2025-09-16T18:12:45.660118] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:12:45.698948] [DEBUG] [LOCAL ] ED: Loaded 38957 existing records from primary storage. [2025-09-16T18:12:45.699082] [INFO ] [MAIN ] ED: Loaded 38957 existing records. [2025-09-16T18:12:45.875511] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:12:45.875782] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-09-16T18:12:45.875828] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-09-16T18:12:45.876770] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-09-16T18:12:45.876819] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-09-16T18:12:45.976546] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-09-16T18:12:46.227981] [INFO ] [REMOTE ] ED: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:12:46.654343] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-16T18:12:46.774853] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-09-16T18:12:46.926703] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-16T18:12:47.574968] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-09-16T18:12:48.110113] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-16T18:12:48.374877] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-09-16T18:12:48.438082] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-16T18:12:48.440636] [INFO ] [REMOTE ] ECO: Full fetch complete (20789 records). [2025-09-16T18:12:48.440742] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-09-16T18:12:48.805056] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-09-16T18:12:48.805135] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-09-16T18:12:48.805550] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-09-16T18:12:48.805591] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-09-16T18:12:48.806179] [DEBUG] [LOCAL ] ECO: Trimmed 20789 records to 13314 (keeping 150 days of data) [2025-09-16T18:12:48.886596] [DEBUG] [LOCAL ] ECO: Primary data saved (13314 records). [2025-09-16T18:12:48.886753] [INFO ] [MAIN ] ECO: Full history saved. [2025-09-16T18:12:48.886837] [INFO ] [MAIN ] Update Progress: 690/2369 symbols completed. ECO took 18.4s. Estimated remaining: 2h 57m 3s. Rate: 9.5 symbols/min [2025-09-16T18:12:49.057713] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:12:49.077990] [DEBUG] [LOCAL ] EDD: Loaded 19939 existing records from primary storage. [2025-09-16T18:12:49.078123] [INFO ] [MAIN ] EDD: Loaded 19939 existing records. [2025-09-16T18:12:49.177988] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-09-16T18:12:49.259516] [WARN ] [MAIN ] EDD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:12:49.259791] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-09-16T18:12:49.259844] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-09-16T18:12:49.260318] [DEBUG] [LOCAL ] EDD: Deleted primary data file. [2025-09-16T18:12:49.260380] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-09-16T18:12:49.626781] [INFO ] [REMOTE ] EDD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:12:49.836235] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-16T18:12:49.974926] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-09-16T18:12:50.652490] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-16T18:12:50.774915] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-09-16T18:12:50.870033] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-16T18:12:51.574908] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-09-16T18:12:52.203251] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-16T18:12:52.374930] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-09-16T18:12:53.026840] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-16T18:12:53.174872] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-09-16T18:12:53.531666] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-16T18:12:53.974908] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-09-16T18:12:54.136593] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-16T18:12:54.140382] [INFO ] [REMOTE ] ECG: Full fetch complete (38853 records). [2025-09-16T18:12:54.140485] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-09-16T18:12:54.516919] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-09-16T18:12:54.517073] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-09-16T18:12:54.517724] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-09-16T18:12:54.517776] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-09-16T18:12:54.518915] [DEBUG] [LOCAL ] ECG: Trimmed 38853 records to 24286 (keeping 150 days of data) [2025-09-16T18:12:54.663218] [DEBUG] [LOCAL ] ECG: Primary data saved (24286 records). [2025-09-16T18:12:54.663348] [INFO ] [MAIN ] ECG: Full history saved. [2025-09-16T18:12:54.663460] [INFO ] [MAIN ] Update Progress: 691/2369 symbols completed. ECG took 41.0s. Estimated remaining: 2h 56m 56s. Rate: 9.5 symbols/min [2025-09-16T18:12:54.785070] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-09-16T18:12:54.839045] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:12:54.850318] [DEBUG] [LOCAL ] EDF: Loaded 9497 existing records from primary storage. [2025-09-16T18:12:54.850554] [INFO ] [MAIN ] EDF: Loaded 9497 existing records. [2025-09-16T18:12:55.026108] [WARN ] [MAIN ] EDF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:12:55.026356] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-09-16T18:12:55.026401] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-09-16T18:12:55.026767] [DEBUG] [LOCAL ] EDF: Deleted primary data file. [2025-09-16T18:12:55.026820] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-09-16T18:12:55.391847] [INFO ] [REMOTE ] EDF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:12:55.415524] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-16T18:12:55.574853] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-09-16T18:12:56.045230] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-16T18:12:56.374948] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-09-16T18:12:57.053562] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-16T18:12:57.174868] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-09-16T18:12:57.492128] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-16T18:12:57.974953] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-09-16T18:12:58.411070] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-16T18:12:58.698606] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-16T18:12:58.774924] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-09-16T18:12:59.574902] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-09-16T18:12:59.601570] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-16T18:13:00.374902] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-09-16T18:13:01.174927] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-09-16T18:13:01.646459] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-16T18:13:01.788798] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-16T18:13:01.974903] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-09-16T18:13:02.197030] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-16T18:13:02.774903] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-09-16T18:13:03.574911] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-09-16T18:13:03.651894] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-16T18:13:03.657352] [INFO ] [REMOTE ] ECVT: Full fetch complete (46333 records). [2025-09-16T18:13:03.657473] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-09-16T18:13:03.859848] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-16T18:13:04.077223] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present. [2025-09-16T18:13:04.077317] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed. [2025-09-16T18:13:04.078023] [INFO ] [MAIN ] ECVT: Fetched primary data is valid. [2025-09-16T18:13:04.078075] [DEBUG] [LOCAL ] ECVT: Saving primary data. [2025-09-16T18:13:04.079580] [DEBUG] [LOCAL ] ECVT: Trimmed 46333 records to 32031 (keeping 150 days of data) [2025-09-16T18:13:04.269673] [DEBUG] [LOCAL ] ECVT: Primary data saved (32031 records). [2025-09-16T18:13:04.269839] [INFO ] [MAIN ] ECVT: Full history saved. [2025-09-16T18:13:04.269953] [INFO ] [MAIN ] Update Progress: 692/2369 symbols completed. ECVT took 24.0s. Estimated remaining: 2h 56m 57s. Rate: 9.5 symbols/min [2025-09-16T18:13:04.379084] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-09-16T18:13:04.455866] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:13:04.470210] [DEBUG] [LOCAL ] EDN: Loaded 12886 existing records from primary storage. [2025-09-16T18:13:04.470343] [INFO ] [MAIN ] EDN: Loaded 12886 existing records. [2025-09-16T18:13:04.648027] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:13:04.648304] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-09-16T18:13:04.648349] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-09-16T18:13:04.648890] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-09-16T18:13:04.648940] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-09-16T18:13:05.003166] [INFO ] [REMOTE ] EDN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:13:05.174921] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-09-16T18:13:05.290883] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-16T18:13:05.292675] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-16T18:13:05.974918] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-09-16T18:13:06.399360] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-16T18:13:06.774956] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-09-16T18:13:07.327957] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-16T18:13:07.574871] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-09-16T18:13:07.894745] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-16T18:13:08.374915] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-09-16T18:13:08.766357] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-16T18:13:09.174945] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-09-16T18:13:09.382730] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-16T18:13:09.974927] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-09-16T18:13:10.563003] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-16T18:13:10.774907] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-09-16T18:13:11.036010] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-16T18:13:11.574940] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-09-16T18:13:12.380016] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-09-16T18:13:12.393111] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-16T18:13:12.754241] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-16T18:13:13.174917] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-09-16T18:13:13.642299] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-16T18:13:13.646180] [INFO ] [REMOTE ] EDD: Full fetch complete (29787 records). [2025-09-16T18:13:13.646262] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-09-16T18:13:13.980551] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-09-16T18:13:14.024540] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-09-16T18:13:14.024690] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-09-16T18:13:14.025190] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-09-16T18:13:14.025244] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-09-16T18:13:14.026205] [DEBUG] [LOCAL ] EDD: Trimmed 29787 records to 20209 (keeping 150 days of data) [2025-09-16T18:13:14.141465] [DEBUG] [LOCAL ] EDD: Primary data saved (20209 records). [2025-09-16T18:13:14.141592] [INFO ] [MAIN ] EDD: Full history saved. [2025-09-16T18:13:14.141692] [INFO ] [MAIN ] Update Progress: 693/2369 symbols completed. EDD took 25.3s. Estimated remaining: 2h 56m 60s. Rate: 9.5 symbols/min [2025-09-16T18:13:14.326055] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:13:14.361836] [DEBUG] [LOCAL ] EDU: Loaded 32550 existing records from primary storage. [2025-09-16T18:13:14.362018] [INFO ] [MAIN ] EDU: Loaded 32550 existing records. [2025-09-16T18:13:14.540138] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:13:14.540424] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-09-16T18:13:14.540473] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-09-16T18:13:14.541255] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-09-16T18:13:14.541311] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-09-16T18:13:14.783414] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-09-16T18:13:14.899930] [INFO ] [REMOTE ] EDU: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:13:14.907871] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-16T18:13:15.101590] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-16T18:13:15.574894] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-09-16T18:13:15.793829] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-16T18:13:16.374897] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-09-16T18:13:16.407304] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-16T18:13:16.409201] [INFO ] [REMOTE ] EDF: Full fetch complete (15175 records). [2025-09-16T18:13:16.409288] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-09-16T18:13:16.770019] [DEBUG] [VALIDATOR ] EDF: All expected trading days are present. [2025-09-16T18:13:16.770097] [DEBUG] [VALIDATOR ] EDF: Primary data validation passed. [2025-09-16T18:13:16.770442] [INFO ] [MAIN ] EDF: Fetched primary data is valid. [2025-09-16T18:13:16.770491] [DEBUG] [LOCAL ] EDF: Saving primary data. [2025-09-16T18:13:16.771016] [DEBUG] [LOCAL ] EDF: Trimmed 15175 records to 9544 (keeping 150 days of data) [2025-09-16T18:13:16.827538] [DEBUG] [LOCAL ] EDF: Primary data saved (9544 records). [2025-09-16T18:13:16.827696] [INFO ] [MAIN ] EDF: Full history saved. [2025-09-16T18:13:16.827785] [INFO ] [MAIN ] Update Progress: 694/2369 symbols completed. EDF took 22.2s. Estimated remaining: 2h 56m 44s. Rate: 9.5 symbols/min [2025-09-16T18:13:16.996339] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:13:17.018690] [DEBUG] [LOCAL ] EE: Loaded 23948 existing records from primary storage. [2025-09-16T18:13:17.018830] [INFO ] [MAIN ] EE: Loaded 23948 existing records. [2025-09-16T18:13:17.177860] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-09-16T18:13:17.196618] [WARN ] [MAIN ] EE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:13:17.197760] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-09-16T18:13:17.197818] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-09-16T18:13:17.198342] [DEBUG] [LOCAL ] EE: Deleted primary data file. [2025-09-16T18:13:17.198430] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-09-16T18:13:17.573540] [INFO ] [REMOTE ] EE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:13:17.974909] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-09-16T18:13:18.117312] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-16T18:13:18.358435] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-16T18:13:18.774909] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-09-16T18:13:19.574899] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-09-16T18:13:19.763257] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-16T18:13:20.374882] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-09-16T18:13:20.643999] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-16T18:13:20.677931] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-16T18:13:21.174929] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-09-16T18:13:21.975270] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-09-16T18:13:21.979540] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-16T18:13:21.986516] [INFO ] [REMOTE ] ED: Full fetch complete (57427 records). [2025-09-16T18:13:21.986630] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-09-16T18:13:22.371852] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-09-16T18:13:22.371947] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-09-16T18:13:22.372842] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-09-16T18:13:22.372891] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-09-16T18:13:22.374276] [DEBUG] [LOCAL ] ED: Trimmed 57427 records to 39343 (keeping 150 days of data) [2025-09-16T18:13:22.617581] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-16T18:13:22.647324] [DEBUG] [LOCAL ] ED: Primary data saved (39343 records). [2025-09-16T18:13:22.647448] [INFO ] [MAIN ] ED: Full history saved. [2025-09-16T18:13:22.647545] [INFO ] [MAIN ] Update Progress: 695/2369 symbols completed. ED took 37.2s. Estimated remaining: 2h 56m 37s. Rate: 9.5 symbols/min [2025-09-16T18:13:22.779984] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-09-16T18:13:22.832952] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:13:22.836897] [DEBUG] [LOCAL ] EEA: Loaded 1980 existing records from primary storage. [2025-09-16T18:13:22.837053] [INFO ] [MAIN ] EEA: Loaded 1980 existing records. [2025-09-16T18:13:23.026503] [WARN ] [MAIN ] EEA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:13:23.026778] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-09-16T18:13:23.026827] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-09-16T18:13:23.027077] [DEBUG] [LOCAL ] EEA: Deleted primary data file. [2025-09-16T18:13:23.027123] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-09-16T18:13:23.401483] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-16T18:13:23.406683] [INFO ] [REMOTE ] EEA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:13:23.410713] [INFO ] [REMOTE ] EDN: Full fetch complete (19673 records). [2025-09-16T18:13:23.410807] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-09-16T18:13:23.584509] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-09-16T18:13:23.793595] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-09-16T18:13:23.793700] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-09-16T18:13:23.794182] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-09-16T18:13:23.794228] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-09-16T18:13:23.794942] [DEBUG] [LOCAL ] EDN: Trimmed 19673 records to 13047 (keeping 150 days of data) [2025-09-16T18:13:23.871137] [DEBUG] [LOCAL ] EDN: Primary data saved (13047 records). [2025-09-16T18:13:23.871294] [INFO ] [MAIN ] EDN: Full history saved. [2025-09-16T18:13:23.871387] [INFO ] [MAIN ] Update Progress: 696/2369 symbols completed. EDN took 19.6s. Estimated remaining: 2h 56m 18s. Rate: 9.5 symbols/min [2025-09-16T18:13:24.039946] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:13:24.049158] [DEBUG] [LOCAL ] EEX: Loaded 7231 existing records from primary storage. [2025-09-16T18:13:24.049277] [INFO ] [MAIN ] EEX: Loaded 7231 existing records. [2025-09-16T18:13:24.238460] [WARN ] [MAIN ] EEX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:13:24.241834] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-16T18:13:24.242147] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-09-16T18:13:24.243535] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-09-16T18:13:24.248010] [DEBUG] [LOCAL ] EEX: Deleted primary data file. [2025-09-16T18:13:24.248226] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-09-16T18:13:24.380073] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-09-16T18:13:24.705024] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-16T18:13:24.866900] [INFO ] [REMOTE ] EEX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:13:25.006067] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-16T18:13:25.174934] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-09-16T18:13:25.974904] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-09-16T18:13:26.718344] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-16T18:13:26.770663] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-16T18:13:26.774831] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-09-16T18:13:27.502357] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-16T18:13:27.574857] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-09-16T18:13:28.374940] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-09-16T18:13:28.598140] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-16T18:13:29.174903] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-09-16T18:13:29.494281] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-16T18:13:29.974859] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-09-16T18:13:30.030017] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-16T18:13:30.774897] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-09-16T18:13:31.508463] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-16T18:13:31.574909] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-09-16T18:13:31.669746] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-16T18:13:32.374906] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-09-16T18:13:33.013761] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-16T18:13:33.126162] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-16T18:13:33.174862] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-09-16T18:13:33.974928] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-09-16T18:13:34.478116] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-16T18:13:34.498954] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-16T18:13:34.774940] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-09-16T18:13:35.191358] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-16T18:13:35.574905] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-09-16T18:13:36.374924] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-09-16T18:13:36.424003] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-16T18:13:36.425550] [INFO ] [REMOTE ] EEX: Full fetch complete (13652 records). [2025-09-16T18:13:36.425631] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-09-16T18:13:36.795633] [DEBUG] [VALIDATOR ] EEX: All expected trading days are present. [2025-09-16T18:13:36.795741] [DEBUG] [VALIDATOR ] EEX: Primary data validation passed. [2025-09-16T18:13:36.796062] [INFO ] [MAIN ] EEX: Fetched primary data is valid. [2025-09-16T18:13:36.796106] [DEBUG] [LOCAL ] EEX: Saving primary data. [2025-09-16T18:13:36.796696] [DEBUG] [LOCAL ] EEX: Trimmed 13652 records to 7285 (keeping 150 days of data) [2025-09-16T18:13:36.838746] [DEBUG] [LOCAL ] EEX: Primary data saved (7285 records). [2025-09-16T18:13:36.838878] [INFO ] [MAIN ] EEX: Full history saved. [2025-09-16T18:13:36.838962] [INFO ] [MAIN ] Update Progress: 697/2369 symbols completed. EEX took 13.0s. Estimated remaining: 2h 56m 28s. Rate: 9.5 symbols/min [2025-09-16T18:13:36.947268] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-16T18:13:37.018875] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:13:37.054975] [DEBUG] [LOCAL ] EFC: Loaded 33691 existing records from primary storage. [2025-09-16T18:13:37.055150] [INFO ] [MAIN ] EFC: Loaded 33691 existing records. [2025-09-16T18:13:37.179989] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-09-16T18:13:37.237143] [WARN ] [MAIN ] EFC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:13:37.237383] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-09-16T18:13:37.237431] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-09-16T18:13:37.238215] [DEBUG] [LOCAL ] EFC: Deleted primary data file. [2025-09-16T18:13:37.238266] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-09-16T18:13:37.599622] [INFO ] [REMOTE ] EFC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:13:37.974904] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-09-16T18:13:38.774869] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-09-16T18:13:38.810480] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-16T18:13:39.574971] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-09-16T18:13:39.617405] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-16T18:13:40.095125] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-16T18:13:40.289106] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-16T18:13:40.374950] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-09-16T18:13:41.174905] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-09-16T18:13:41.658852] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-16T18:13:41.974900] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-09-16T18:13:42.103338] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-16T18:13:42.429478] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-16T18:13:42.774916] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-09-16T18:13:43.574904] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-09-16T18:13:44.374942] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-09-16T18:13:44.448118] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-16T18:13:45.159484] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-16T18:13:45.174841] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-09-16T18:13:45.672956] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-16T18:13:45.974906] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-09-16T18:13:46.613228] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-16T18:13:46.618694] [INFO ] [REMOTE ] EDU: Full fetch complete (49863 records). [2025-09-16T18:13:46.618787] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-09-16T18:13:46.796580] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-09-16T18:13:47.003779] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-09-16T18:13:47.003855] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-09-16T18:13:47.004509] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-09-16T18:13:47.004551] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-09-16T18:13:47.005743] [DEBUG] [LOCAL ] EDU: Trimmed 49863 records to 32909 (keeping 150 days of data) [2025-09-16T18:13:47.196333] [DEBUG] [LOCAL ] EDU: Primary data saved (32909 records). [2025-09-16T18:13:47.196474] [INFO ] [MAIN ] EDU: Full history saved. [2025-09-16T18:13:47.197188] [INFO ] [MAIN ] Update Progress: 698/2369 symbols completed. EDU took 33.1s. Estimated remaining: 2h 56m 31s. Rate: 9.5 symbols/min [2025-09-16T18:13:47.367532] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:13:47.375879] [DEBUG] [LOCAL ] EFR: No existing data file found in primary storage. [2025-09-16T18:13:47.376719] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-16T18:13:47.376383] [WARN ] [MAIN ] EFR: No existing data found, performing full refresh instead. [2025-09-16T18:13:47.380085] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-09-16T18:13:47.380416] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-09-16T18:13:47.380540] [DEBUG] [LOCAL ] EFR: No primary data file found to delete. [2025-09-16T18:13:47.380576] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-09-16T18:13:47.424507] [INFO ] [REMOTE ] EE: Full fetch complete (34474 records). [2025-09-16T18:13:47.456626] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-09-16T18:13:47.578820] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-09-16T18:13:48.039456] [INFO ] [REMOTE ] EFR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:13:48.121975] [DEBUG] [VALIDATOR ] EE: All expected trading days are present. [2025-09-16T18:13:48.122079] [DEBUG] [VALIDATOR ] EE: Primary data validation passed. [2025-09-16T18:13:48.122603] [INFO ] [MAIN ] EE: Fetched primary data is valid. [2025-09-16T18:13:48.122660] [DEBUG] [LOCAL ] EE: Saving primary data. [2025-09-16T18:13:48.123518] [DEBUG] [LOCAL ] EE: Trimmed 34474 records to 24150 (keeping 150 days of data) [2025-09-16T18:13:48.289407] [DEBUG] [LOCAL ] EE: Primary data saved (24150 records). [2025-09-16T18:13:48.289540] [INFO ] [MAIN ] EE: Full history saved. [2025-09-16T18:13:48.289666] [INFO ] [MAIN ] Update Progress: 699/2369 symbols completed. EE took 31.5s. Estimated remaining: 2h 56m 12s. Rate: 9.5 symbols/min [2025-09-16T18:13:48.382949] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-09-16T18:13:48.372335] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-16T18:13:48.391731] [INFO ] [REMOTE ] EEA: Full fetch complete (3047 records). [2025-09-16T18:13:48.395910] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-09-16T18:13:48.576220] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:13:48.718560] [DEBUG] [LOCAL ] EFT: Loaded 9090 existing records from primary storage. [2025-09-16T18:13:48.718819] [INFO ] [MAIN ] EFT: Loaded 9090 existing records. [2025-09-16T18:13:49.015739] [DEBUG] [VALIDATOR ] EEA: All expected trading days are present. [2025-09-16T18:13:49.049860] [WARN ] [MAIN ] EFT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:13:49.050193] [DEBUG] [VALIDATOR ] EEA: Primary data validation passed. [2025-09-16T18:13:49.050511] [INFO ] [MAIN ] EEA: Fetched primary data is valid. [2025-09-16T18:13:49.050743] [DEBUG] [LOCAL ] EEA: Saving primary data. [2025-09-16T18:13:49.051101] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-09-16T18:13:49.051239] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-09-16T18:13:49.051744] [DEBUG] [LOCAL ] EEA: Trimmed 3047 records to 1988 (keeping 150 days of data) [2025-09-16T18:13:49.052139] [DEBUG] [LOCAL ] EFT: Deleted primary data file. [2025-09-16T18:13:49.052271] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-09-16T18:13:49.108441] [DEBUG] [LOCAL ] EEA: Primary data saved (1988 records). [2025-09-16T18:13:49.159119] [INFO ] [MAIN ] EEA: Full history saved. [2025-09-16T18:13:49.193635] [INFO ] [MAIN ] Update Progress: 700/2369 symbols completed. EEA took 26.5s. Estimated remaining: 2h 55m 53s. Rate: 9.5 symbols/min [2025-09-16T18:13:49.199814] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-09-16T18:13:49.313166] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-09-16T18:13:49.579571] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-16T18:13:49.644009] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:13:49.723040] [INFO ] [REMOTE ] EFT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:13:49.752778] [DEBUG] [LOCAL ] EFX: Loaded 32620 existing records from primary storage. [2025-09-16T18:13:49.752935] [INFO ] [MAIN ] EFX: Loaded 32620 existing records. [2025-09-16T18:13:49.940315] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:13:49.940594] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-09-16T18:13:49.940663] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-09-16T18:13:49.941540] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-09-16T18:13:49.941609] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-09-16T18:13:49.984596] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-09-16T18:13:50.305337] [INFO ] [REMOTE ] EFX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:13:50.774933] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-09-16T18:13:50.880743] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-16T18:13:51.131813] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-16T18:13:51.574903] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-09-16T18:13:52.230425] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-16T18:13:52.374951] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-09-16T18:13:52.604377] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-16T18:13:52.905076] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-16T18:13:53.174902] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-09-16T18:13:53.932265] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-16T18:13:53.974931] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-09-16T18:13:54.774899] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-09-16T18:13:54.810051] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-16T18:13:55.574936] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-09-16T18:13:56.374874] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-09-16T18:13:56.439089] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-16T18:13:56.517141] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-16T18:13:57.009810] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-16T18:13:57.174873] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-09-16T18:13:57.974881] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-09-16T18:13:58.161152] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-16T18:13:58.774905] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-09-16T18:13:58.940211] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-16T18:13:59.574911] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-09-16T18:14:00.374939] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-09-16T18:14:01.037531] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-16T18:14:01.174941] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-09-16T18:14:01.555033] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-16T18:14:01.602961] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-16T18:14:01.974899] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-09-16T18:14:02.774867] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-09-16T18:14:02.968133] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-16T18:14:02.970490] [INFO ] [REMOTE ] EFR: Full fetch complete (14752 records). [2025-09-16T18:14:02.970569] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-09-16T18:14:03.343776] [DEBUG] [VALIDATOR ] EFR: All expected trading days are present. [2025-09-16T18:14:03.343993] [DEBUG] [VALIDATOR ] EFR: Primary data validation passed. [2025-09-16T18:14:03.344400] [INFO ] [MAIN ] EFR: Fetched primary data is valid. [2025-09-16T18:14:03.344466] [DEBUG] [LOCAL ] EFR: Saving primary data. [2025-09-16T18:14:03.345299] [DEBUG] [LOCAL ] EFR: Trimmed 14752 records to 10364 (keeping 150 days of data) [2025-09-16T18:14:03.422689] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-09-16T18:14:03.448087] [DEBUG] [LOCAL ] EFR: Primary data saved (10364 records). [2025-09-16T18:14:03.448206] [INFO ] [MAIN ] EFR: Full history saved. [2025-09-16T18:14:03.448293] [INFO ] [MAIN ] Update Progress: 701/2369 symbols completed. EFR took 16.3s. Estimated remaining: 2h 56m 6s. Rate: 9.5 symbols/min [2025-09-16T18:14:03.590001] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-09-16T18:14:03.620549] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:14:03.645411] [DEBUG] [LOCAL ] EFXT: Loaded 20982 existing records from primary storage. [2025-09-16T18:14:03.645543] [INFO ] [MAIN ] EFXT: Loaded 20982 existing records. [2025-09-16T18:14:03.822382] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:14:03.822636] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-09-16T18:14:03.822704] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-09-16T18:14:03.823287] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-09-16T18:14:03.823344] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-09-16T18:14:04.179411] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:14:04.374957] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-09-16T18:14:04.540156] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-16T18:14:05.147304] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-16T18:14:05.174883] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-09-16T18:14:05.337284] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-16T18:14:05.974923] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-09-16T18:14:06.774906] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-09-16T18:14:06.909102] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-16T18:14:07.316925] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-16T18:14:07.574915] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-09-16T18:14:08.283790] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-16T18:14:08.374850] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-09-16T18:14:08.472951] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-16T18:14:09.174916] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-09-16T18:14:09.843510] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-16T18:14:09.974889] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-09-16T18:14:10.256635] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-16T18:14:10.263517] [INFO ] [REMOTE ] EFC: Full fetch complete (50177 records). [2025-09-16T18:14:10.263722] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-09-16T18:14:10.655009] [DEBUG] [VALIDATOR ] EFC: All expected trading days are present. [2025-09-16T18:14:10.655107] [DEBUG] [VALIDATOR ] EFC: Primary data validation passed. [2025-09-16T18:14:10.655824] [INFO ] [MAIN ] EFC: Fetched primary data is valid. [2025-09-16T18:14:10.655876] [DEBUG] [LOCAL ] EFC: Saving primary data. [2025-09-16T18:14:10.657138] [DEBUG] [LOCAL ] EFC: Trimmed 50177 records to 34040 (keeping 150 days of data) [2025-09-16T18:14:10.775916] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-09-16T18:14:10.867618] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-16T18:14:10.870467] [INFO ] [REMOTE ] EFT: Full fetch complete (13155 records). [2025-09-16T18:14:10.871371] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-09-16T18:14:11.257988] [DEBUG] [VALIDATOR ] EFT: All expected trading days are present. [2025-09-16T18:14:11.258618] [DEBUG] [VALIDATOR ] EFT: Primary data validation passed. [2025-09-16T18:14:11.260128] [INFO ] [MAIN ] EFT: Fetched primary data is valid. [2025-09-16T18:14:11.260741] [DEBUG] [LOCAL ] EFT: Saving primary data. [2025-09-16T18:14:11.263612] [DEBUG] [LOCAL ] EFC: Primary data saved (34040 records). [2025-09-16T18:14:11.264115] [INFO ] [MAIN ] EFC: Full history saved. [2025-09-16T18:14:11.264391] [INFO ] [MAIN ] Update Progress: 702/2369 symbols completed. EFC took 34.4s. Estimated remaining: 2h 56m 3s. Rate: 9.5 symbols/min [2025-09-16T18:14:11.264498] [DEBUG] [LOCAL ] EFT: Trimmed 13155 records to 9155 (keeping 150 days of data) [2025-09-16T18:14:11.481729] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:14:11.508197] [DEBUG] [LOCAL ] EFT: Primary data saved (9155 records). [2025-09-16T18:14:11.509221] [INFO ] [MAIN ] EFT: Full history saved. [2025-09-16T18:14:11.509543] [DEBUG] [LOCAL ] EG: Loaded 20850 existing records from primary storage. [2025-09-16T18:14:11.509690] [INFO ] [MAIN ] Update Progress: 703/2369 symbols completed. EFT took 23.2s. Estimated remaining: 2h 55m 42s. Rate: 9.5 symbols/min [2025-09-16T18:14:11.509750] [INFO ] [MAIN ] EG: Loaded 20850 existing records. [2025-09-16T18:14:11.594262] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-09-16T18:14:11.839716] [WARN ] [MAIN ] EG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:14:11.864183] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:14:11.864385] [DEBUG] [LOCAL ] EGO: No existing data file found in primary storage. [2025-09-16T18:14:11.864503] [WARN ] [MAIN ] EGO: No existing data found, performing full refresh instead. [2025-09-16T18:14:11.864440] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-09-16T18:14:11.864606] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-09-16T18:14:11.864950] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-09-16T18:14:11.865132] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-09-16T18:14:11.865192] [DEBUG] [LOCAL ] EGO: No primary data file found to delete. [2025-09-16T18:14:11.865229] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-09-16T18:14:11.878579] [DEBUG] [LOCAL ] EG: Deleted primary data file. [2025-09-16T18:14:11.932060] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-09-16T18:14:12.541952] [INFO ] [REMOTE ] EG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:14:12.592783] [INFO ] [REMOTE ] EGO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:14:12.593008] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-09-16T18:14:12.622678] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-16T18:14:13.152250] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-16T18:14:13.174849] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-09-16T18:14:13.748526] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-16T18:14:13.974902] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-09-16T18:14:14.101363] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-16T18:14:14.774906] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-09-16T18:14:15.400463] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-16T18:14:15.574897] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-09-16T18:14:16.374887] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-09-16T18:14:16.660618] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-16T18:14:16.746985] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-16T18:14:16.752494] [INFO ] [REMOTE ] EFX: Full fetch complete (48998 records). [2025-09-16T18:14:16.752603] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-09-16T18:14:17.125088] [DEBUG] [VALIDATOR ] EFX: All expected trading days are present. [2025-09-16T18:14:17.125169] [DEBUG] [VALIDATOR ] EFX: Primary data validation passed. [2025-09-16T18:14:17.125892] [INFO ] [MAIN ] EFX: Fetched primary data is valid. [2025-09-16T18:14:17.125955] [DEBUG] [LOCAL ] EFX: Saving primary data. [2025-09-16T18:14:17.127103] [DEBUG] [LOCAL ] EFX: Trimmed 48998 records to 32959 (keeping 150 days of data) [2025-09-16T18:14:17.190362] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-09-16T18:14:17.344907] [DEBUG] [LOCAL ] EFX: Primary data saved (32959 records). [2025-09-16T18:14:17.345054] [INFO ] [MAIN ] EFX: Full history saved. [2025-09-16T18:14:17.345155] [INFO ] [MAIN ] Update Progress: 704/2369 symbols completed. EFX took 28.1s. Estimated remaining: 2h 55m 35s. Rate: 9.5 symbols/min [2025-09-16T18:14:17.521258] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:14:17.544834] [DEBUG] [LOCAL ] EGP: Loaded 22063 existing records from primary storage. [2025-09-16T18:14:17.545004] [INFO ] [MAIN ] EGP: Loaded 22063 existing records. [2025-09-16T18:14:17.741510] [WARN ] [MAIN ] EGP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:14:17.741833] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-09-16T18:14:17.742074] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-09-16T18:14:17.742871] [DEBUG] [LOCAL ] EGP: Deleted primary data file. [2025-09-16T18:14:17.743128] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-09-16T18:14:17.979386] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-09-16T18:14:18.316917] [INFO ] [REMOTE ] EGP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:14:18.354287] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-16T18:14:18.410318] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-16T18:14:18.774941] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-09-16T18:14:18.973338] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-16T18:14:19.574930] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-09-16T18:14:20.354978] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-16T18:14:20.374868] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-09-16T18:14:20.734196] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-16T18:14:21.174927] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-09-16T18:14:21.974972] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-09-16T18:14:22.148576] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-16T18:14:22.210954] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-16T18:14:22.774914] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-09-16T18:14:23.311945] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-16T18:14:23.574881] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-09-16T18:14:23.719168] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-16T18:14:24.374896] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-09-16T18:14:24.995354] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-16T18:14:25.174914] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-09-16T18:14:25.915268] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-16T18:14:25.974885] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-09-16T18:14:26.097671] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-16T18:14:26.774913] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-09-16T18:14:27.263001] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-16T18:14:27.574902] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-09-16T18:14:28.374935] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-09-16T18:14:28.514498] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-16T18:14:28.920581] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-16T18:14:29.174908] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-09-16T18:14:29.364927] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-16T18:14:29.974937] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-09-16T18:14:30.752061] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-16T18:14:30.774841] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-09-16T18:14:31.429447] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-16T18:14:31.433356] [INFO ] [REMOTE ] EFXT: Full fetch complete (32416 records). [2025-09-16T18:14:31.433435] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-09-16T18:14:31.582140] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-09-16T18:14:31.814350] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-09-16T18:14:31.814431] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-09-16T18:14:31.814965] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-09-16T18:14:31.815010] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-09-16T18:14:31.815824] [DEBUG] [LOCAL ] EFXT: Trimmed 32416 records to 21228 (keeping 150 days of data) [2025-09-16T18:14:31.945520] [DEBUG] [LOCAL ] EFXT: Primary data saved (21228 records). [2025-09-16T18:14:31.945660] [INFO ] [MAIN ] EFXT: Full history saved. [2025-09-16T18:14:31.945758] [INFO ] [MAIN ] Update Progress: 705/2369 symbols completed. EFXT took 28.5s. Estimated remaining: 2h 55m 48s. Rate: 9.5 symbols/min [2025-09-16T18:14:32.119683] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:14:32.153370] [DEBUG] [LOCAL ] EGY: Loaded 30410 existing records from primary storage. [2025-09-16T18:14:32.153588] [INFO ] [MAIN ] EGY: Loaded 30410 existing records. [2025-09-16T18:14:32.362463] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-16T18:14:32.375992] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-09-16T18:14:32.376255] [WARN ] [MAIN ] EGY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:14:32.377396] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-09-16T18:14:32.377541] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-09-16T18:14:32.378234] [DEBUG] [LOCAL ] EGY: Deleted primary data file. [2025-09-16T18:14:32.378290] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-09-16T18:14:32.732876] [INFO ] [REMOTE ] EGY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:14:32.982083] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-16T18:14:33.174921] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-09-16T18:14:33.523937] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-16T18:14:33.974904] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-09-16T18:14:34.714357] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-16T18:14:34.774871] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-09-16T18:14:35.350980] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-16T18:14:35.357267] [INFO ] [REMOTE ] EGO: Full fetch complete (55836 records). [2025-09-16T18:14:35.357392] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-09-16T18:14:35.575959] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-09-16T18:14:35.772773] [DEBUG] [VALIDATOR ] EGO: All expected trading days are present. [2025-09-16T18:14:35.772856] [DEBUG] [VALIDATOR ] EGO: Primary data validation passed. [2025-09-16T18:14:35.773538] [INFO ] [MAIN ] EGO: Fetched primary data is valid. [2025-09-16T18:14:35.773582] [DEBUG] [LOCAL ] EGO: Saving primary data. [2025-09-16T18:14:35.774818] [DEBUG] [LOCAL ] EGO: Trimmed 55836 records to 38230 (keeping 150 days of data) [2025-09-16T18:14:35.995150] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-16T18:14:35.999460] [INFO ] [REMOTE ] EG: Full fetch complete (32025 records). [2025-09-16T18:14:36.000086] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-09-16T18:14:36.376227] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-09-16T18:14:36.390742] [DEBUG] [VALIDATOR ] EG: All expected trading days are present. [2025-09-16T18:14:36.391949] [DEBUG] [VALIDATOR ] EG: Primary data validation passed. [2025-09-16T18:14:36.393216] [INFO ] [MAIN ] EG: Fetched primary data is valid. [2025-09-16T18:14:36.394044] [DEBUG] [LOCAL ] EG: Saving primary data. [2025-09-16T18:14:36.398063] [DEBUG] [LOCAL ] EGO: Primary data saved (38230 records). [2025-09-16T18:14:36.398237] [INFO ] [MAIN ] EGO: Full history saved. [2025-09-16T18:14:36.398369] [INFO ] [MAIN ] Update Progress: 706/2369 symbols completed. EGO took 24.9s. Estimated remaining: 2h 55m 37s. Rate: 9.5 symbols/min [2025-09-16T18:14:36.430167] [DEBUG] [LOCAL ] EG: Trimmed 32025 records to 21087 (keeping 150 days of data) [2025-09-16T18:14:36.662885] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:14:36.699081] [DEBUG] [LOCAL ] EHAB: Loaded 22563 existing records from primary storage. [2025-09-16T18:14:36.702709] [INFO ] [MAIN ] EHAB: Loaded 22563 existing records. [2025-09-16T18:14:36.863383] [DEBUG] [LOCAL ] EG: Primary data saved (21087 records). [2025-09-16T18:14:36.897118] [INFO ] [MAIN ] EG: Full history saved. [2025-09-16T18:14:36.901530] [WARN ] [MAIN ] EHAB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:14:36.901719] [INFO ] [MAIN ] Update Progress: 707/2369 symbols completed. EG took 25.6s. Estimated remaining: 2h 55m 17s. Rate: 9.5 symbols/min [2025-09-16T18:14:36.902085] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-09-16T18:14:36.944064] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-09-16T18:14:36.991458] [DEBUG] [LOCAL ] EHAB: Deleted primary data file. [2025-09-16T18:14:37.001555] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-09-16T18:14:37.192038] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:14:37.453922] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:14:37.463343] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-09-16T18:14:37.464891] [DEBUG] [LOCAL ] EHC: Loaded 30763 existing records from primary storage. [2025-09-16T18:14:37.465152] [INFO ] [MAIN ] EHC: Loaded 30763 existing records. [2025-09-16T18:14:37.656242] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:14:37.656610] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-09-16T18:14:37.656740] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-09-16T18:14:37.664395] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-09-16T18:14:37.676669] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-09-16T18:14:37.740596] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-16T18:14:37.976950] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-09-16T18:14:38.069418] [INFO ] [REMOTE ] EHC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:14:38.097037] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-16T18:14:38.379201] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-16T18:14:38.774938] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-09-16T18:14:39.308039] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-16T18:14:39.554063] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-16T18:14:39.574867] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-09-16T18:14:40.374908] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-09-16T18:14:40.822334] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-16T18:14:41.174912] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-09-16T18:14:41.932099] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-16T18:14:41.974935] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-09-16T18:14:42.174364] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-16T18:14:42.774947] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-09-16T18:14:42.942150] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-16T18:14:42.946302] [INFO ] [REMOTE ] EGP: Full fetch complete (34484 records). [2025-09-16T18:14:42.946380] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-09-16T18:14:43.309689] [DEBUG] [VALIDATOR ] EGP: All expected trading days are present. [2025-09-16T18:14:43.309770] [DEBUG] [VALIDATOR ] EGP: Primary data validation passed. [2025-09-16T18:14:43.310291] [INFO ] [MAIN ] EGP: Fetched primary data is valid. [2025-09-16T18:14:43.310331] [DEBUG] [LOCAL ] EGP: Saving primary data. [2025-09-16T18:14:43.311123] [DEBUG] [LOCAL ] EGP: Trimmed 34484 records to 22312 (keeping 150 days of data) [2025-09-16T18:14:43.448454] [DEBUG] [LOCAL ] EGP: Primary data saved (22312 records). [2025-09-16T18:14:43.448593] [INFO ] [MAIN ] EGP: Full history saved. [2025-09-16T18:14:43.448697] [INFO ] [MAIN ] Update Progress: 708/2369 symbols completed. EGP took 26.1s. Estimated remaining: 2h 55m 11s. Rate: 9.5 symbols/min [2025-09-16T18:14:43.588049] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-09-16T18:14:43.619817] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:14:43.629263] [DEBUG] [LOCAL ] EHI: Loaded 7828 existing records from primary storage. [2025-09-16T18:14:43.629456] [INFO ] [MAIN ] EHI: Loaded 7828 existing records. [2025-09-16T18:14:43.805746] [WARN ] [MAIN ] EHI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:14:43.806001] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-09-16T18:14:43.806048] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-09-16T18:14:43.806390] [DEBUG] [LOCAL ] EHI: Deleted primary data file. [2025-09-16T18:14:43.806437] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-09-16T18:14:44.158107] [INFO ] [REMOTE ] EHI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:14:44.374899] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-09-16T18:14:44.469232] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-16T18:14:44.534880] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-16T18:14:45.174916] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-09-16T18:14:45.958163] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-16T18:14:45.974837] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-09-16T18:14:46.774900] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-09-16T18:14:46.982084] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-16T18:14:47.306867] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-16T18:14:47.514323] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-16T18:14:47.574912] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-09-16T18:14:48.374897] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-09-16T18:14:49.174908] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-09-16T18:14:49.267046] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-16T18:14:49.875420] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-16T18:14:49.925634] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-16T18:14:49.974955] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-09-16T18:14:50.774900] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-09-16T18:14:51.253360] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-16T18:14:51.574900] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-09-16T18:14:51.606578] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-16T18:14:52.374910] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-09-16T18:14:53.022757] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-16T18:14:53.174868] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-09-16T18:14:53.277710] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-16T18:14:53.974913] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-09-16T18:14:54.403389] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-16T18:14:54.774914] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-09-16T18:14:55.444469] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-16T18:14:55.574898] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-09-16T18:14:55.642866] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-16T18:14:56.374905] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-09-16T18:14:56.793063] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-16T18:14:56.798254] [INFO ] [REMOTE ] EHC: Full fetch complete (45086 records). [2025-09-16T18:14:56.798835] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-09-16T18:14:57.152071] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-16T18:14:57.176395] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-09-16T18:14:57.188482] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-09-16T18:14:57.188568] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-09-16T18:14:57.189261] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-09-16T18:14:57.189389] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-09-16T18:14:57.190447] [DEBUG] [LOCAL ] EHC: Trimmed 45086 records to 30997 (keeping 150 days of data) [2025-09-16T18:14:57.388736] [DEBUG] [LOCAL ] EHC: Primary data saved (30997 records). [2025-09-16T18:14:57.388966] [INFO ] [MAIN ] EHC: Full history saved. [2025-09-16T18:14:57.389059] [INFO ] [MAIN ] Update Progress: 709/2369 symbols completed. EHC took 20.5s. Estimated remaining: 2h 55m 23s. Rate: 9.5 symbols/min [2025-09-16T18:14:57.558703] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:14:57.576129] [DEBUG] [LOCAL ] EIC: Loaded 17683 existing records from primary storage. [2025-09-16T18:14:57.576258] [INFO ] [MAIN ] EIC: Loaded 17683 existing records. [2025-09-16T18:14:57.752533] [WARN ] [MAIN ] EIC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:14:57.752854] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-09-16T18:14:57.752899] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-09-16T18:14:57.753459] [DEBUG] [LOCAL ] EIC: Deleted primary data file. [2025-09-16T18:14:57.753507] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-09-16T18:14:57.986269] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-09-16T18:14:58.111234] [INFO ] [REMOTE ] EIC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:14:58.674105] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-16T18:14:58.691541] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-16T18:14:58.774864] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-09-16T18:14:59.574909] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-09-16T18:14:59.664518] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-16T18:14:59.666350] [INFO ] [REMOTE ] EHI: Full fetch complete (11362 records). [2025-09-16T18:14:59.666424] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-09-16T18:15:00.040746] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-09-16T18:15:00.040827] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-09-16T18:15:00.041082] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-09-16T18:15:00.041121] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-09-16T18:15:00.041584] [DEBUG] [LOCAL ] EHI: Trimmed 11362 records to 7902 (keeping 150 days of data) [2025-09-16T18:15:00.087399] [DEBUG] [LOCAL ] EHI: Primary data saved (7902 records). [2025-09-16T18:15:00.087523] [INFO ] [MAIN ] EHI: Full history saved. [2025-09-16T18:15:00.087605] [INFO ] [MAIN ] Update Progress: 710/2369 symbols completed. EHI took 16.6s. Estimated remaining: 2h 55m 8s. Rate: 9.5 symbols/min [2025-09-16T18:15:00.267232] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:15:00.267583] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-09-16T18:15:00.267626] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-09-16T18:15:00.267795] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-09-16T18:15:00.267878] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-16T18:15:00.267925] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-09-16T18:15:00.267961] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-09-16T18:15:00.380011] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-09-16T18:15:00.630052] [INFO ] [REMOTE ] EICA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:15:00.791622] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-16T18:15:01.174950] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-09-16T18:15:01.641180] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-16T18:15:01.974914] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-09-16T18:15:02.732012] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-09-16T18:15:02.774843] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-09-16T18:15:03.480777] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-16T18:15:03.485623] [INFO ] [REMOTE ] EGY: Full fetch complete (45923 records). [2025-09-16T18:15:03.485733] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-09-16T18:15:03.583275] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-09-16T18:15:03.860530] [DEBUG] [VALIDATOR ] EGY: All expected trading days are present. [2025-09-16T18:15:03.860682] [DEBUG] [VALIDATOR ] EGY: Primary data validation passed. [2025-09-16T18:15:03.861330] [INFO ] [MAIN ] EGY: Fetched primary data is valid. [2025-09-16T18:15:03.861456] [DEBUG] [LOCAL ] EGY: Saving primary data. [2025-09-16T18:15:03.862681] [DEBUG] [LOCAL ] EGY: Trimmed 45923 records to 30724 (keeping 150 days of data) [2025-09-16T18:15:03.881295] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-16T18:15:03.979115] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-16T18:15:04.072440] [DEBUG] [LOCAL ] EGY: Primary data saved (30724 records). [2025-09-16T18:15:04.072570] [INFO ] [MAIN ] EGY: Full history saved. [2025-09-16T18:15:04.073443] [INFO ] [MAIN ] Update Progress: 711/2369 symbols completed. EGY took 32.1s. Estimated remaining: 2h 54m 56s. Rate: 9.5 symbols/min [2025-09-16T18:15:04.242278] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:15:04.242427] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-09-16T18:15:04.242465] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-09-16T18:15:04.242578] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-09-16T18:15:04.242617] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-16T18:15:04.242680] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-09-16T18:15:04.242716] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-09-16T18:15:04.382612] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-09-16T18:15:04.595382] [INFO ] [REMOTE ] EICB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:15:05.174906] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-09-16T18:15:05.863549] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-16T18:15:05.946878] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-16T18:15:05.950067] [INFO ] [REMOTE ] EHAB: Full fetch complete (32217 records). [2025-09-16T18:15:05.950142] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-09-16T18:15:05.979972] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-09-16T18:15:06.324803] [DEBUG] [VALIDATOR ] EHAB: All expected trading days are present. [2025-09-16T18:15:06.325011] [DEBUG] [VALIDATOR ] EHAB: Primary data validation passed. [2025-09-16T18:15:06.325552] [INFO ] [MAIN ] EHAB: Fetched primary data is valid. [2025-09-16T18:15:06.325595] [DEBUG] [LOCAL ] EHAB: Saving primary data. [2025-09-16T18:15:06.326359] [DEBUG] [LOCAL ] EHAB: Trimmed 32217 records to 22697 (keeping 150 days of data) [2025-09-16T18:15:06.457297] [DEBUG] [LOCAL ] EHAB: Primary data saved (22697 records). [2025-09-16T18:15:06.457464] [INFO ] [MAIN ] EHAB: Full history saved. [2025-09-16T18:15:06.457585] [INFO ] [MAIN ] Update Progress: 712/2369 symbols completed. EHAB took 30.1s. Estimated remaining: 2h 54m 40s. Rate: 9.5 symbols/min [2025-09-16T18:15:06.650186] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:15:06.650412] [DEBUG] [LOCAL ] EICC: No existing data file found in primary storage. [2025-09-16T18:15:06.650453] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-09-16T18:15:06.650606] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-09-16T18:15:06.650665] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-09-16T18:15:06.650711] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-09-16T18:15:06.650746] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-09-16T18:15:06.780002] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-09-16T18:15:07.018587] [INFO ] [REMOTE ] EICC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:15:07.181624] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-16T18:15:07.309871] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-16T18:15:07.574917] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-09-16T18:15:08.139021] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-16T18:15:08.374914] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-09-16T18:15:09.174857] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-09-16T18:15:09.576830] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-16T18:15:09.667286] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-16T18:15:09.974908] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-09-16T18:15:10.652395] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-16T18:15:10.774912] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-09-16T18:15:11.574928] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-09-16T18:15:11.767896] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-16T18:15:11.944756] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-16T18:15:12.374913] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-09-16T18:15:13.097877] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-16T18:15:13.174893] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-09-16T18:15:13.605470] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-16T18:15:13.974920] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-09-16T18:15:14.254547] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-16T18:15:14.774911] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-09-16T18:15:15.121013] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-16T18:15:15.574898] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-09-16T18:15:16.044613] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-16T18:15:16.374904] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-09-16T18:15:16.790404] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-16T18:15:17.174895] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-09-16T18:15:17.508976] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-16T18:15:17.974919] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-09-16T18:15:18.573538] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-16T18:15:18.774901] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-09-16T18:15:19.351659] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-16T18:15:19.574904] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-09-16T18:15:19.982714] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-16T18:15:19.983432] [INFO ] [REMOTE ] EICA: Full fetch complete (872 records). [2025-09-16T18:15:19.983526] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-09-16T18:15:19.983928] [FATAL] [VALIDATOR ] EICA: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:15:19.984002] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:15:19.984047] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:15:19.984092] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-16T18:15:19.984162] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-09-16T18:15:19.984201] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-09-16T18:15:19.984259] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-09-16T18:15:19.984315] [INFO ] [MAIN ] Update Progress: 713/2369 symbols completed. EICA took 19.9s. Estimated remaining: 2h 54m 51s. Rate: 9.5 symbols/min [2025-09-16T18:15:20.157035] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:15:20.172788] [DEBUG] [LOCAL ] EIG: Loaded 15429 existing records from primary storage. [2025-09-16T18:15:20.172934] [INFO ] [MAIN ] EIG: Loaded 15429 existing records. [2025-09-16T18:15:20.359958] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:15:20.360247] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-09-16T18:15:20.360308] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-09-16T18:15:20.360898] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-09-16T18:15:20.360953] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-09-16T18:15:20.381759] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-09-16T18:15:20.724726] [INFO ] [REMOTE ] EIG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:15:20.974293] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-16T18:15:21.174913] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-09-16T18:15:21.974942] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-09-16T18:15:22.306400] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-16T18:15:22.569790] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-16T18:15:22.774960] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-09-16T18:15:23.574877] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-09-16T18:15:23.957177] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-16T18:15:24.374940] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-09-16T18:15:24.399160] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-16T18:15:25.148831] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-16T18:15:25.174876] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-09-16T18:15:25.767403] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-16T18:15:25.974947] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-09-16T18:15:26.587210] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-16T18:15:26.588623] [INFO ] [REMOTE ] EICC: Full fetch complete (6244 records). [2025-09-16T18:15:26.588725] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-09-16T18:15:26.589130] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:15:26.589207] [FATAL] [MAIN ] EICC: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:15:26.589252] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:15:26.589313] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-09-16T18:15:26.589384] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-09-16T18:15:26.589435] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-09-16T18:15:26.589517] [DEBUG] [LOCAL ] EICC: No derivative data file found to delete. [2025-09-16T18:15:26.589601] [INFO ] [MAIN ] Update Progress: 714/2369 symbols completed. EICC took 20.1s. Estimated remaining: 2h 54m 45s. Rate: 9.5 symbols/min [2025-09-16T18:15:26.761371] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:15:26.761560] [DEBUG] [LOCAL ] EIX: No existing data file found in primary storage. [2025-09-16T18:15:26.761613] [WARN ] [MAIN ] EIX: No existing data found, performing full refresh instead. [2025-09-16T18:15:26.761793] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-09-16T18:15:26.761856] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-09-16T18:15:26.761915] [DEBUG] [LOCAL ] EIX: No primary data file found to delete. [2025-09-16T18:15:26.761962] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-09-16T18:15:26.782207] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-09-16T18:15:27.115000] [INFO ] [REMOTE ] EIX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:15:27.574921] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-09-16T18:15:27.915857] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-16T18:15:28.374900] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-09-16T18:15:29.174883] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-09-16T18:15:29.244472] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-16T18:15:29.468001] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-16T18:15:29.974947] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-09-16T18:15:30.274550] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-16T18:15:30.282605] [INFO ] [REMOTE ] EIC: Full fetch complete (26909 records). [2025-09-16T18:15:30.282845] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-09-16T18:15:30.783439] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-09-16T18:15:30.923210] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-09-16T18:15:30.923334] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-09-16T18:15:30.924199] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-09-16T18:15:30.924290] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-09-16T18:15:30.925411] [DEBUG] [LOCAL ] EIC: Trimmed 26909 records to 17796 (keeping 150 days of data) [2025-09-16T18:15:31.042516] [DEBUG] [LOCAL ] EIC: Primary data saved (17796 records). [2025-09-16T18:15:31.042732] [INFO ] [MAIN ] EIC: Full history saved. [2025-09-16T18:15:31.042880] [INFO ] [MAIN ] Update Progress: 715/2369 symbols completed. EIC took 33.7s. Estimated remaining: 2h 54m 34s. Rate: 9.5 symbols/min [2025-09-16T18:15:31.243467] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:15:31.282774] [DEBUG] [LOCAL ] EL: Loaded 39517 existing records from primary storage. [2025-09-16T18:15:31.282924] [INFO ] [MAIN ] EL: Loaded 39517 existing records. [2025-09-16T18:15:31.386219] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-16T18:15:31.481576] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:15:31.481925] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-09-16T18:15:31.481996] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-09-16T18:15:31.483212] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-09-16T18:15:31.483287] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-09-16T18:15:31.580018] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-09-16T18:15:31.840980] [INFO ] [REMOTE ] EL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:15:32.009629] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-16T18:15:32.073716] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-16T18:15:32.074554] [INFO ] [REMOTE ] EICB: Full fetch complete (1970 records). [2025-09-16T18:15:32.074623] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-09-16T18:15:32.075006] [FATAL] [VALIDATOR ] EICB: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:15:32.075080] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:15:32.075116] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:15:32.075156] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-16T18:15:32.075215] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-09-16T18:15:32.075250] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-09-16T18:15:32.075289] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-09-16T18:15:32.075343] [INFO ] [MAIN ] Update Progress: 716/2369 symbols completed. EICB took 28.0s. Estimated remaining: 2h 54m 16s. Rate: 9.5 symbols/min [2025-09-16T18:15:32.247087] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:15:32.286781] [DEBUG] [LOCAL ] ELAN: Loaded 39316 existing records from primary storage. [2025-09-16T18:15:32.286922] [INFO ] [MAIN ] ELAN: Loaded 39316 existing records. [2025-09-16T18:15:32.380052] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-09-16T18:15:32.471603] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:15:32.471830] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-09-16T18:15:32.471877] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-09-16T18:15:32.472782] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-09-16T18:15:32.472853] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-09-16T18:15:32.847701] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:15:33.174912] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-09-16T18:15:33.974947] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-09-16T18:15:34.340710] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-16T18:15:34.774893] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-09-16T18:15:34.857205] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-16T18:15:35.491665] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-16T18:15:35.574912] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-09-16T18:15:36.374898] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-09-16T18:15:36.789014] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-16T18:15:37.077396] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-16T18:15:37.174867] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-09-16T18:15:37.974865] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-09-16T18:15:38.075979] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-16T18:15:38.096985] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-16T18:15:38.774909] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-09-16T18:15:39.574923] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-09-16T18:15:39.865003] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-16T18:15:40.086576] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-16T18:15:40.374905] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-09-16T18:15:41.174937] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-09-16T18:15:41.382229] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-16T18:15:41.974875] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-09-16T18:15:42.204337] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-16T18:15:42.367465] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-16T18:15:42.774929] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-09-16T18:15:43.574932] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-09-16T18:15:43.993179] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-16T18:15:44.374940] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-09-16T18:15:44.480692] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-16T18:15:45.174904] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-09-16T18:15:45.591895] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-16T18:15:45.974904] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-09-16T18:15:46.395838] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-16T18:15:46.774923] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-09-16T18:15:46.825335] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-16T18:15:46.828401] [INFO ] [REMOTE ] EIG: Full fetch complete (21708 records). [2025-09-16T18:15:46.828534] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-09-16T18:15:47.237171] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-09-16T18:15:47.237296] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-09-16T18:15:47.237911] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-09-16T18:15:47.238006] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-09-16T18:15:47.239140] [DEBUG] [LOCAL ] EIG: Trimmed 21708 records to 15610 (keeping 150 days of data) [2025-09-16T18:15:47.351445] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-16T18:15:47.377260] [DEBUG] [LOCAL ] EIG: Primary data saved (15610 records). [2025-09-16T18:15:47.377394] [INFO ] [MAIN ] EIG: Full history saved. [2025-09-16T18:15:47.377495] [INFO ] [MAIN ] Update Progress: 717/2369 symbols completed. EIG took 27.4s. Estimated remaining: 2h 54m 30s. Rate: 9.5 symbols/min [2025-09-16T18:15:47.574917] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-09-16T18:15:48.374936] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-09-16T18:15:48.569038] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-16T18:15:48.575540] [INFO ] [REMOTE ] EIX: Full fetch complete (58036 records). [2025-09-16T18:15:48.575725] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-09-16T18:15:48.966771] [DEBUG] [VALIDATOR ] EIX: All expected trading days are present. [2025-09-16T18:15:48.966873] [DEBUG] [VALIDATOR ] EIX: Primary data validation passed. [2025-09-16T18:15:48.967585] [INFO ] [MAIN ] EIX: Fetched primary data is valid. [2025-09-16T18:15:48.967628] [DEBUG] [LOCAL ] EIX: Saving primary data. [2025-09-16T18:15:48.968947] [DEBUG] [LOCAL ] EIX: Trimmed 58036 records to 39795 (keeping 150 days of data) [2025-09-16T18:15:49.210397] [DEBUG] [LOCAL ] EIX: Primary data saved (39795 records). [2025-09-16T18:15:49.210576] [INFO ] [MAIN ] EIX: Full history saved. [2025-09-16T18:15:49.210747] [INFO ] [MAIN ] Update Progress: 718/2369 symbols completed. EIX took 22.6s. Estimated remaining: 2h 54m 14s. Rate: 9.5 symbols/min [2025-09-16T18:15:49.719038] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-16T18:15:49.731007] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-09-16T18:15:49.889872] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-16T18:15:49.974948] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-09-16T18:15:51.233156] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-16T18:15:51.244590] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-09-16T18:15:51.843140] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-16T18:15:51.854693] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-09-16T18:15:52.804828] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-16T18:15:52.816788] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-09-16T18:15:53.857240] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-16T18:15:53.864924] [INFO ] [REMOTE ] EL: Full fetch complete (58143 records). [2025-09-16T18:15:53.865158] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-09-16T18:15:54.331615] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-09-16T18:15:54.331751] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-09-16T18:15:54.332467] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-09-16T18:15:54.332512] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-09-16T18:15:54.333879] [DEBUG] [LOCAL ] EL: Trimmed 58143 records to 39892 (keeping 150 days of data) [2025-09-16T18:15:54.583479] [DEBUG] [LOCAL ] EL: Primary data saved (39892 records). [2025-09-16T18:15:54.583654] [INFO ] [MAIN ] EL: Full history saved. [2025-09-16T18:15:54.583746] [INFO ] [MAIN ] Update Progress: 719/2369 symbols completed. EL took 23.5s. Estimated remaining: 2h 54m 5s. Rate: 9.5 symbols/min [2025-09-16T18:15:54.633340] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-16T18:15:54.644776] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-09-16T18:15:56.411679] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-16T18:15:56.418294] [INFO ] [REMOTE ] ELAN: Full fetch complete (57769 records). [2025-09-16T18:15:56.418445] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-09-16T18:15:56.804069] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-09-16T18:15:56.804170] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-09-16T18:15:56.805105] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-09-16T18:15:56.805174] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-09-16T18:15:56.806594] [DEBUG] [LOCAL ] ELAN: Trimmed 57769 records to 39704 (keeping 150 days of data) [2025-09-16T18:15:57.068274] [DEBUG] [LOCAL ] ELAN: Primary data saved (39704 records). [2025-09-16T18:15:57.068438] [INFO ] [MAIN ] ELAN: Full history saved. [2025-09-16T18:15:57.068564] [INFO ] [MAIN ] Update Progress: 720/2369 symbols completed. ELAN took 25.0s. Estimated remaining: 2h 53m 50s. Rate: 9.5 symbols/min [2025-09-16T18:15:57.699165] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:15:57.809787] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:15:57.812731] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:15:57.813566] [DEBUG] [LOCAL ] ELC: No existing data file found in primary storage. [2025-09-16T18:15:57.814407] [DEBUG] [LOCAL ] ELME: No existing data file found in primary storage. [2025-09-16T18:15:57.832716] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:15:57.814831] [WARN ] [MAIN ] ELC: No existing data found, performing full refresh instead. [2025-09-16T18:15:57.815345] [WARN ] [MAIN ] ELME: No existing data found, performing full refresh instead. [2025-09-16T18:15:57.833152] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-09-16T18:15:57.833683] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-09-16T18:15:57.833967] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-09-16T18:15:57.833785] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-09-16T18:15:57.838117] [DEBUG] [LOCAL ] ELC: No primary data file found to delete. [2025-09-16T18:15:57.838433] [DEBUG] [LOCAL ] ELME: No primary data file found to delete. [2025-09-16T18:15:57.838362] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-09-16T18:15:57.838999] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-09-16T18:15:58.119139] [DEBUG] [LOCAL ] ELP: Loaded 19225 existing records from primary storage. [2025-09-16T18:15:58.140582] [INFO ] [MAIN ] ELP: Loaded 19225 existing records. [2025-09-16T18:15:58.381106] [DEBUG] [LOCAL ] ELF: Loaded 38501 existing records from primary storage. [2025-09-16T18:15:58.531241] [INFO ] [MAIN ] ELF: Loaded 38501 existing records. [2025-09-16T18:15:58.854724] [WARN ] [MAIN ] ELP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:15:58.984512] [INFO ] [REMOTE ] ELME: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:15:59.024253] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-09-16T18:15:59.061479] [INFO ] [REMOTE ] ELC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:15:59.081927] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-09-16T18:15:59.066738] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-09-16T18:15:59.091508] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-09-16T18:15:59.104000] [DEBUG] [LOCAL ] ELP: Deleted primary data file. [2025-09-16T18:15:59.104247] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-09-16T18:15:59.130944] [WARN ] [MAIN ] ELF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:15:59.200601] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-09-16T18:15:59.232074] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-09-16T18:15:59.240712] [DEBUG] [LOCAL ] ELF: Deleted primary data file. [2025-09-16T18:15:59.261412] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-09-16T18:15:59.681886] [INFO ] [REMOTE ] ELP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:15:59.695234] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-09-16T18:15:59.806548] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-16T18:15:59.807987] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-09-16T18:15:59.889671] [INFO ] [REMOTE ] ELF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:15:59.890055] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-09-16T18:16:00.564060] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-16T18:16:00.565589] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-09-16T18:16:00.699330] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-16T18:16:00.707262] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-09-16T18:16:01.143039] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-16T18:16:01.144731] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-09-16T18:16:01.229875] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-16T18:16:01.235476] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-09-16T18:16:01.902832] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-16T18:16:01.904707] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-09-16T18:16:01.949670] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-16T18:16:01.974913] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-09-16T18:16:02.090584] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-09-16T18:16:02.459506] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-16T18:16:02.501473] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-16T18:16:02.774906] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-09-16T18:16:03.152705] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-16T18:16:03.574909] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-09-16T18:16:04.257990] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-16T18:16:04.374922] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-09-16T18:16:05.174902] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-09-16T18:16:05.672897] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-16T18:16:05.872693] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-16T18:16:05.915059] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-09-16T18:16:05.974942] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-09-16T18:16:06.774906] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-09-16T18:16:07.193239] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-16T18:16:07.574961] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-09-16T18:16:08.256819] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-16T18:16:08.374897] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-09-16T18:16:08.734558] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-16T18:16:08.997167] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-16T18:16:08.998336] [INFO ] [REMOTE ] ELC: Full fetch complete (3778 records). [2025-09-16T18:16:08.998431] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-09-16T18:16:09.176689] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-09-16T18:16:09.363722] [DEBUG] [VALIDATOR ] ELC: All expected trading days are present. [2025-09-16T18:16:09.363803] [DEBUG] [VALIDATOR ] ELC: Primary data validation passed. [2025-09-16T18:16:09.363971] [INFO ] [MAIN ] ELC: Fetched primary data is valid. [2025-09-16T18:16:09.364037] [DEBUG] [LOCAL ] ELC: Saving primary data. [2025-09-16T18:16:09.364413] [DEBUG] [LOCAL ] ELC: Trimmed 3778 records to 2672 (keeping 150 days of data) [2025-09-16T18:16:09.382445] [DEBUG] [LOCAL ] ELC: Primary data saved (2672 records). [2025-09-16T18:16:09.382519] [INFO ] [MAIN ] ELC: Full history saved. [2025-09-16T18:16:09.382608] [INFO ] [MAIN ] Update Progress: 721/2369 symbols completed. ELC took 12.3s. Estimated remaining: 2h 53m 57s. Rate: 9.5 symbols/min [2025-09-16T18:16:09.562016] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:16:09.562194] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-09-16T18:16:09.562235] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-09-16T18:16:09.562358] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-09-16T18:16:09.562401] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-16T18:16:09.562445] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-09-16T18:16:09.562493] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-09-16T18:16:09.914452] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:16:09.974864] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-09-16T18:16:10.774907] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-09-16T18:16:11.167023] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-16T18:16:11.229545] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-16T18:16:11.230843] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-16T18:16:11.574905] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-09-16T18:16:12.374903] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-09-16T18:16:13.174944] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-09-16T18:16:13.246042] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-16T18:16:13.974904] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-09-16T18:16:14.343490] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-16T18:16:14.605636] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-16T18:16:14.774981] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-09-16T18:16:15.430452] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-16T18:16:15.436339] [INFO ] [REMOTE ] ELME: Full fetch complete (42849 records). [2025-09-16T18:16:15.436497] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-09-16T18:16:15.592142] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-09-16T18:16:15.850875] [DEBUG] [VALIDATOR ] ELME: All expected trading days are present. [2025-09-16T18:16:15.850990] [DEBUG] [VALIDATOR ] ELME: Primary data validation passed. [2025-09-16T18:16:15.851665] [INFO ] [MAIN ] ELME: Fetched primary data is valid. [2025-09-16T18:16:15.851735] [DEBUG] [LOCAL ] ELME: Saving primary data. [2025-09-16T18:16:15.853242] [DEBUG] [LOCAL ] ELME: Trimmed 42849 records to 29238 (keeping 150 days of data) [2025-09-16T18:16:16.042489] [DEBUG] [LOCAL ] ELME: Primary data saved (29238 records). [2025-09-16T18:16:16.042657] [INFO ] [MAIN ] ELME: Full history saved. [2025-09-16T18:16:16.042754] [INFO ] [MAIN ] Update Progress: 722/2369 symbols completed. ELME took 19.0s. Estimated remaining: 2h 53m 52s. Rate: 9.5 symbols/min [2025-09-16T18:16:16.210318] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:16:16.210483] [DEBUG] [LOCAL ] ELS: No existing data file found in primary storage. [2025-09-16T18:16:16.210542] [WARN ] [MAIN ] ELS: No existing data found, performing full refresh instead. [2025-09-16T18:16:16.210685] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-09-16T18:16:16.210768] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-09-16T18:16:16.210812] [DEBUG] [LOCAL ] ELS: No primary data file found to delete. [2025-09-16T18:16:16.210845] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-09-16T18:16:16.387292] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-09-16T18:16:16.592787] [INFO ] [REMOTE ] ELS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:16:16.681576] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-16T18:16:16.820747] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-16T18:16:16.952275] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-16T18:16:17.174910] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-09-16T18:16:17.974909] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-09-16T18:16:18.774885] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-09-16T18:16:19.072223] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-09-16T18:16:19.175190] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-16T18:16:19.303096] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-16T18:16:19.574863] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-09-16T18:16:20.374910] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-09-16T18:16:21.174867] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-09-16T18:16:21.210064] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-16T18:16:21.974908] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-09-16T18:16:22.389681] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-16T18:16:22.442787] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-16T18:16:22.774911] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-09-16T18:16:23.574963] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-09-16T18:16:23.695662] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-16T18:16:24.374908] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-09-16T18:16:24.517558] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-16T18:16:24.523595] [INFO ] [REMOTE ] ELF: Full fetch complete (56999 records). [2025-09-16T18:16:24.523711] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-09-16T18:16:24.904234] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-09-16T18:16:24.904312] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-09-16T18:16:24.905070] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-09-16T18:16:24.905117] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-09-16T18:16:24.906256] [DEBUG] [LOCAL ] ELF: Trimmed 56999 records to 38878 (keeping 150 days of data) [2025-09-16T18:16:24.979899] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-16T18:16:25.009243] [INFO ] [REMOTE ] ELP: Full fetch complete (28043 records). [2025-09-16T18:16:25.010133] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-09-16T18:16:25.015802] [FATAL] [VALIDATOR ] ELP: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:16:25.016602] [FATAL] [MAIN ] ELP: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:16:25.017726] [WARN ] [MAIN ] ELP: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:16:25.018092] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-09-16T18:16:25.018704] [DEBUG] [LOCAL ] ELP: No primary data file found to delete. [2025-09-16T18:16:25.019302] [INFO ] [LOCAL ] ELP: Starting deletion of derivative data. [2025-09-16T18:16:25.020627] [DEBUG] [LOCAL ] ELP: Deleted derivative data file. [2025-09-16T18:16:25.021330] [INFO ] [MAIN ] Update Progress: 723/2369 symbols completed. ELP took 28.0s. Estimated remaining: 2h 53m 51s. Rate: 9.5 symbols/min [2025-09-16T18:16:25.177596] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-09-16T18:16:25.201714] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:16:25.203199] [DEBUG] [LOCAL ] ELV: No existing data file found in primary storage. [2025-09-16T18:16:25.203950] [WARN ] [MAIN ] ELV: No existing data found, performing full refresh instead. [2025-09-16T18:16:25.204567] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-09-16T18:16:25.205211] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-09-16T18:16:25.205829] [DEBUG] [LOCAL ] ELV: No primary data file found to delete. [2025-09-16T18:16:25.206605] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-09-16T18:16:25.645686] [INFO ] [REMOTE ] ELV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:16:25.707699] [DEBUG] [LOCAL ] ELF: Primary data saved (38878 records). [2025-09-16T18:16:25.707871] [INFO ] [MAIN ] ELF: Full history saved. [2025-09-16T18:16:25.707973] [INFO ] [MAIN ] Update Progress: 724/2369 symbols completed. ELF took 28.6s. Estimated remaining: 2h 53m 32s. Rate: 9.5 symbols/min [2025-09-16T18:16:25.879972] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:16:25.880168] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-09-16T18:16:25.880207] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-09-16T18:16:25.880335] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-09-16T18:16:25.880374] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-16T18:16:25.880414] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-09-16T18:16:25.880446] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-09-16T18:16:25.963462] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-16T18:16:25.975185] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-09-16T18:16:26.242498] [INFO ] [REMOTE ] EMA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:16:26.269497] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-16T18:16:26.774897] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-09-16T18:16:27.142751] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-16T18:16:27.574896] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-09-16T18:16:27.866945] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-16T18:16:27.991898] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-16T18:16:28.374902] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-09-16T18:16:29.174906] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-09-16T18:16:29.974914] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-02. [2025-09-16T18:16:30.135835] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-16T18:16:30.160130] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T18:16:30.160478] [WARN ] [REMOTE ] EMA: No data returned for month 2025-02 [2025-09-16T18:16:30.774918] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-03. [2025-09-16T18:16:30.966117] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T18:16:30.966418] [WARN ] [REMOTE ] EMA: No data returned for month 2025-03 [2025-09-16T18:16:31.310102] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-16T18:16:31.574916] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-04. [2025-09-16T18:16:31.792995] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T18:16:31.793300] [WARN ] [REMOTE ] EMA: No data returned for month 2025-04 [2025-09-16T18:16:32.374898] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-09-16T18:16:33.174919] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-09-16T18:16:33.974949] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-09-16T18:16:34.245290] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-16T18:16:34.289658] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-16T18:16:34.774877] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-09-16T18:16:34.900195] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-16T18:16:35.574924] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-09-16T18:16:35.932790] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-16T18:16:35.933477] [INFO ] [REMOTE ] ELPC: Full fetch complete (963 records). [2025-09-16T18:16:35.933546] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-09-16T18:16:35.934001] [FATAL] [VALIDATOR ] ELPC: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:16:35.934096] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:16:35.934153] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:16:35.934221] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-16T18:16:35.934285] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-09-16T18:16:35.934321] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-09-16T18:16:35.934499] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-09-16T18:16:35.934576] [INFO ] [MAIN ] Update Progress: 725/2369 symbols completed. ELPC took 26.6s. Estimated remaining: 2h 53m 35s. Rate: 9.5 symbols/min [2025-09-16T18:16:36.110003] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:16:36.128782] [DEBUG] [LOCAL ] EMD: Loaded 14899 existing records from primary storage. [2025-09-16T18:16:36.128917] [INFO ] [MAIN ] EMD: Loaded 14899 existing records. [2025-09-16T18:16:36.307382] [WARN ] [MAIN ] EMD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:16:36.307699] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-09-16T18:16:36.307762] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-09-16T18:16:36.308287] [DEBUG] [LOCAL ] EMD: Deleted primary data file. [2025-09-16T18:16:36.308335] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-09-16T18:16:36.383007] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-09-16T18:16:36.672295] [INFO ] [REMOTE ] EMD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:16:36.707082] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-16T18:16:37.174914] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-09-16T18:16:37.974909] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-05. [2025-09-16T18:16:38.387087] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-16T18:16:38.774911] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-06. [2025-09-16T18:16:38.818604] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-09-16T18:16:38.849304] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-16T18:16:38.855854] [INFO ] [REMOTE ] ELS: Full fetch complete (53312 records). [2025-09-16T18:16:38.855986] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-09-16T18:16:39.244475] [DEBUG] [VALIDATOR ] ELS: All expected trading days are present. [2025-09-16T18:16:39.244557] [DEBUG] [VALIDATOR ] ELS: Primary data validation passed. [2025-09-16T18:16:39.245272] [INFO ] [MAIN ] ELS: Fetched primary data is valid. [2025-09-16T18:16:39.245319] [DEBUG] [LOCAL ] ELS: Saving primary data. [2025-09-16T18:16:39.246452] [DEBUG] [LOCAL ] ELS: Trimmed 53312 records to 36880 (keeping 150 days of data) [2025-09-16T18:16:39.469981] [DEBUG] [LOCAL ] ELS: Primary data saved (36880 records). [2025-09-16T18:16:39.470137] [INFO ] [MAIN ] ELS: Full history saved. [2025-09-16T18:16:39.470215] [INFO ] [MAIN ] Update Progress: 726/2369 symbols completed. ELS took 23.4s. Estimated remaining: 2h 53m 22s. Rate: 9.5 symbols/min [2025-09-16T18:16:39.580132] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-09-16T18:16:39.645899] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:16:39.656691] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-16T18:16:39.678736] [DEBUG] [LOCAL ] EME: Loaded 22200 existing records from primary storage. [2025-09-16T18:16:39.678874] [INFO ] [MAIN ] EME: Loaded 22200 existing records. [2025-09-16T18:16:39.856381] [WARN ] [MAIN ] EME: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:16:39.856703] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-09-16T18:16:39.856755] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-09-16T18:16:39.857410] [DEBUG] [LOCAL ] EME: Deleted primary data file. [2025-09-16T18:16:39.857473] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-09-16T18:16:40.208484] [INFO ] [REMOTE ] EME: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:16:40.374916] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-07. [2025-09-16T18:16:41.174910] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-09-16T18:16:41.199763] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-16T18:16:41.366055] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-16T18:16:41.974915] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-09-16T18:16:42.157999] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-16T18:16:42.774906] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-09-16T18:16:43.574878] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-09-16T18:16:44.029377] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-16T18:16:44.115361] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-16T18:16:44.374908] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-08. [2025-09-16T18:16:45.166451] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-16T18:16:45.174840] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-09-16T18:16:45.375792] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-16T18:16:45.974940] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-09-16T18:16:46.568132] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-16T18:16:46.774967] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-09-16T18:16:47.574875] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-09. [2025-09-16T18:16:47.683369] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-16T18:16:47.925505] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-16T18:16:48.374919] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-09-16T18:16:48.499659] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-16T18:16:48.501927] [INFO ] [REMOTE ] EMA: Full fetch complete (7287 records). [2025-09-16T18:16:48.502005] [DEBUG] [VALIDATOR ] EMA: Validating primary data. [2025-09-16T18:16:48.696157] [WARN ] [VALIDATOR ] EMA: Validation failed - insufficient historical data. Have 77 unique days, need 150 days [2025-09-16T18:16:48.696438] [FATAL] [MAIN ] EMA: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:16:48.696517] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:16:48.696584] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-16T18:16:48.696686] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-09-16T18:16:48.696744] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-09-16T18:16:48.696804] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-09-16T18:16:48.696886] [INFO ] [MAIN ] Update Progress: 727/2369 symbols completed. EMA took 23.0s. Estimated remaining: 2h 53m 22s. Rate: 9.5 symbols/min [2025-09-16T18:16:48.865917] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:16:48.869615] [DEBUG] [LOCAL ] EMF: Loaded 2155 existing records from primary storage. [2025-09-16T18:16:48.869722] [INFO ] [MAIN ] EMF: Loaded 2155 existing records. [2025-09-16T18:16:49.046800] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:16:49.047094] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-09-16T18:16:49.047196] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-09-16T18:16:49.047482] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-09-16T18:16:49.047543] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-09-16T18:16:49.190207] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-09-16T18:16:49.406250] [INFO ] [REMOTE ] EMF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:16:49.974916] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-09-16T18:16:50.317402] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-16T18:16:50.323958] [INFO ] [REMOTE ] ELV: Full fetch complete (54870 records). [2025-09-16T18:16:50.324077] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-09-16T18:16:50.735565] [DEBUG] [VALIDATOR ] ELV: All expected trading days are present. [2025-09-16T18:16:50.735673] [DEBUG] [VALIDATOR ] ELV: Primary data validation passed. [2025-09-16T18:16:50.736495] [INFO ] [MAIN ] ELV: Fetched primary data is valid. [2025-09-16T18:16:50.736565] [DEBUG] [LOCAL ] ELV: Saving primary data. [2025-09-16T18:16:50.737858] [DEBUG] [LOCAL ] ELV: Trimmed 54870 records to 37831 (keeping 150 days of data) [2025-09-16T18:16:50.806203] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-09-16T18:16:50.997565] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-16T18:16:51.035378] [DEBUG] [LOCAL ] ELV: Primary data saved (37831 records). [2025-09-16T18:16:51.035543] [INFO ] [MAIN ] ELV: Full history saved. [2025-09-16T18:16:51.035622] [INFO ] [MAIN ] Update Progress: 728/2369 symbols completed. ELV took 26.0s. Estimated remaining: 2h 53m 7s. Rate: 9.5 symbols/min [2025-09-16T18:16:51.221707] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-16T18:16:51.223464] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:16:51.267052] [DEBUG] [LOCAL ] EMN: Loaded 37455 existing records from primary storage. [2025-09-16T18:16:51.267212] [INFO ] [MAIN ] EMN: Loaded 37455 existing records. [2025-09-16T18:16:51.452922] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:16:51.453151] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-09-16T18:16:51.453197] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-09-16T18:16:51.454222] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-09-16T18:16:51.454280] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-09-16T18:16:51.580056] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-09-16T18:16:51.828954] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-16T18:16:51.834105] [INFO ] [REMOTE ] EMN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:16:52.374924] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-09-16T18:16:52.790801] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-16T18:16:53.174946] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-09-16T18:16:53.974872] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-09-16T18:16:54.079388] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-16T18:16:54.664207] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-16T18:16:54.774923] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-09-16T18:16:55.156927] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-16T18:16:55.574899] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-09-16T18:16:56.374897] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-09-16T18:16:56.599619] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-16T18:16:56.627241] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-16T18:16:57.037753] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-16T18:16:57.174891] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-09-16T18:16:57.779255] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-16T18:16:57.974939] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-09-16T18:16:58.774898] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-09-16T18:16:58.951569] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-16T18:16:58.954785] [INFO ] [REMOTE ] EMD: Full fetch complete (23945 records). [2025-09-16T18:16:58.954888] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-09-16T18:16:59.198720] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-16T18:16:59.336808] [DEBUG] [VALIDATOR ] EMD: All expected trading days are present. [2025-09-16T18:16:59.336892] [DEBUG] [VALIDATOR ] EMD: Primary data validation passed. [2025-09-16T18:16:59.337349] [INFO ] [MAIN ] EMD: Fetched primary data is valid. [2025-09-16T18:16:59.337390] [DEBUG] [LOCAL ] EMD: Saving primary data. [2025-09-16T18:16:59.338118] [DEBUG] [LOCAL ] EMD: Trimmed 23945 records to 15174 (keeping 150 days of data) [2025-09-16T18:16:59.437826] [DEBUG] [LOCAL ] EMD: Primary data saved (15174 records). [2025-09-16T18:16:59.437976] [INFO ] [MAIN ] EMD: Full history saved. [2025-09-16T18:16:59.438065] [INFO ] [MAIN ] Update Progress: 729/2369 symbols completed. EMD took 23.5s. Estimated remaining: 2h 53m 5s. Rate: 9.5 symbols/min [2025-09-16T18:16:59.586865] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-09-16T18:16:59.619085] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:16:59.629972] [DEBUG] [LOCAL ] EMO: Loaded 9432 existing records from primary storage. [2025-09-16T18:16:59.630182] [INFO ] [MAIN ] EMO: Loaded 9432 existing records. [2025-09-16T18:16:59.808291] [WARN ] [MAIN ] EMO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:16:59.808551] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-09-16T18:16:59.808599] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-09-16T18:16:59.809081] [DEBUG] [LOCAL ] EMO: Deleted primary data file. [2025-09-16T18:16:59.809142] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-09-16T18:17:00.166878] [INFO ] [REMOTE ] EMO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:17:00.374910] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-09-16T18:17:00.911844] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-16T18:17:01.174909] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-09-16T18:17:01.346383] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-16T18:17:01.974960] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-09-16T18:17:02.082933] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-16T18:17:02.364619] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-16T18:17:02.774914] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-09-16T18:17:03.241793] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-16T18:17:03.574920] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-09-16T18:17:04.374921] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-09-16T18:17:04.440507] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-16T18:17:05.174881] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-09-16T18:17:05.249704] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-16T18:17:05.774145] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-16T18:17:05.775013] [INFO ] [REMOTE ] EMF: Full fetch complete (4164 records). [2025-09-16T18:17:05.775084] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-09-16T18:17:05.775456] [FATAL] [VALIDATOR ] EMF: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:17:05.775573] [FATAL] [MAIN ] EMF: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:17:05.775612] [WARN ] [MAIN ] EMF: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:17:05.775671] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-09-16T18:17:05.775733] [DEBUG] [LOCAL ] EMF: No primary data file found to delete. [2025-09-16T18:17:05.775771] [INFO ] [LOCAL ] EMF: Starting deletion of derivative data. [2025-09-16T18:17:05.776049] [DEBUG] [LOCAL ] EMF: Deleted derivative data file. [2025-09-16T18:17:05.776128] [INFO ] [MAIN ] Update Progress: 730/2369 symbols completed. EMF took 17.1s. Estimated remaining: 2h 52m 59s. Rate: 9.5 symbols/min [2025-09-16T18:17:05.952818] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:17:05.953034] [DEBUG] [LOCAL ] EMP: No existing data file found in primary storage. [2025-09-16T18:17:05.953074] [WARN ] [MAIN ] EMP: No existing data found, performing full refresh instead. [2025-09-16T18:17:05.953203] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-09-16T18:17:05.953245] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-09-16T18:17:05.953289] [DEBUG] [LOCAL ] EMP: No primary data file found to delete. [2025-09-16T18:17:05.953323] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-09-16T18:17:05.983679] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-09-16T18:17:06.322246] [INFO ] [REMOTE ] EMP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:17:06.774913] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-09-16T18:17:07.385853] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-16T18:17:07.574890] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-09-16T18:17:07.969513] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-16T18:17:08.374904] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-09-16T18:17:08.882336] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-16T18:17:08.886381] [INFO ] [REMOTE ] EME: Full fetch complete (35205 records). [2025-09-16T18:17:08.886468] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-09-16T18:17:09.180033] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-09-16T18:17:09.261723] [DEBUG] [VALIDATOR ] EME: All expected trading days are present. [2025-09-16T18:17:09.261819] [DEBUG] [VALIDATOR ] EME: Primary data validation passed. [2025-09-16T18:17:09.262436] [INFO ] [MAIN ] EME: Fetched primary data is valid. [2025-09-16T18:17:09.262481] [DEBUG] [LOCAL ] EME: Saving primary data. [2025-09-16T18:17:09.263464] [DEBUG] [LOCAL ] EME: Trimmed 35205 records to 22441 (keeping 150 days of data) [2025-09-16T18:17:09.409907] [DEBUG] [LOCAL ] EME: Primary data saved (22441 records). [2025-09-16T18:17:09.410234] [INFO ] [MAIN ] EME: Full history saved. [2025-09-16T18:17:09.410397] [INFO ] [MAIN ] Update Progress: 731/2369 symbols completed. EME took 29.9s. Estimated remaining: 2h 52m 47s. Rate: 9.5 symbols/min [2025-09-16T18:17:09.578422] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:17:09.617523] [DEBUG] [LOCAL ] EMR: Loaded 39273 existing records from primary storage. [2025-09-16T18:17:09.617686] [INFO ] [MAIN ] EMR: Loaded 39273 existing records. [2025-09-16T18:17:09.797066] [WARN ] [MAIN ] EMR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:17:09.797426] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-09-16T18:17:09.797511] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-09-16T18:17:09.798528] [DEBUG] [LOCAL ] EMR: Deleted primary data file. [2025-09-16T18:17:09.798582] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-09-16T18:17:09.981594] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-09-16T18:17:10.191843] [INFO ] [REMOTE ] EMR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:17:10.194187] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-16T18:17:10.212430] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-16T18:17:10.474310] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-16T18:17:10.774926] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-09-16T18:17:11.574900] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-09-16T18:17:12.127699] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-16T18:17:12.374938] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-09-16T18:17:12.540371] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-16T18:17:13.174948] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-09-16T18:17:13.974909] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-09-16T18:17:14.102524] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-16T18:17:14.145104] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-16T18:17:14.774907] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-09-16T18:17:15.355810] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-16T18:17:15.574947] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-09-16T18:17:15.793840] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-16T18:17:15.920773] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-16T18:17:16.374968] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-09-16T18:17:16.969205] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-16T18:17:17.174908] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-09-16T18:17:17.974929] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-09-16T18:17:18.645337] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-16T18:17:18.774938] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-09-16T18:17:19.018476] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-16T18:17:19.574906] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-09-16T18:17:19.786782] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-16T18:17:20.010588] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-16T18:17:20.374916] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-09-16T18:17:21.174917] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-09-16T18:17:21.300450] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-16T18:17:21.736976] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-16T18:17:21.738038] [INFO ] [REMOTE ] EMP: Full fetch complete (3181 records). [2025-09-16T18:17:21.738111] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-09-16T18:17:21.980132] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-09-16T18:17:22.143230] [DEBUG] [VALIDATOR ] EMP: All expected trading days are present. [2025-09-16T18:17:22.143322] [DEBUG] [VALIDATOR ] EMP: Primary data validation passed. [2025-09-16T18:17:22.143452] [INFO ] [MAIN ] EMP: Fetched primary data is valid. [2025-09-16T18:17:22.143499] [DEBUG] [LOCAL ] EMP: Saving primary data. [2025-09-16T18:17:22.143965] [DEBUG] [LOCAL ] EMP: Trimmed 3181 records to 2224 (keeping 150 days of data) [2025-09-16T18:17:22.158100] [DEBUG] [LOCAL ] EMP: Primary data saved (2224 records). [2025-09-16T18:17:22.158194] [INFO ] [MAIN ] EMP: Full history saved. [2025-09-16T18:17:22.158265] [INFO ] [MAIN ] Update Progress: 732/2369 symbols completed. EMP took 16.4s. Estimated remaining: 2h 52m 55s. Rate: 9.5 symbols/min [2025-09-16T18:17:22.332411] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:17:22.372579] [DEBUG] [LOCAL ] ENB: Loaded 39511 existing records from primary storage. [2025-09-16T18:17:22.372766] [INFO ] [MAIN ] ENB: Loaded 39511 existing records. [2025-09-16T18:17:22.547744] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:17:22.548004] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-09-16T18:17:22.548049] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-09-16T18:17:22.549002] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-09-16T18:17:22.549054] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-09-16T18:17:22.784209] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-09-16T18:17:22.903608] [INFO ] [REMOTE ] ENB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:17:23.495782] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-16T18:17:23.574907] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-09-16T18:17:24.374902] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-09-16T18:17:24.657909] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-16T18:17:25.174896] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-09-16T18:17:25.515486] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-16T18:17:25.518297] [INFO ] [REMOTE ] EMO: Full fetch complete (12961 records). [2025-09-16T18:17:25.518372] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-09-16T18:17:25.936405] [DEBUG] [VALIDATOR ] EMO: All expected trading days are present. [2025-09-16T18:17:25.936526] [DEBUG] [VALIDATOR ] EMO: Primary data validation passed. [2025-09-16T18:17:25.937088] [INFO ] [MAIN ] EMO: Fetched primary data is valid. [2025-09-16T18:17:25.937596] [DEBUG] [LOCAL ] EMO: Saving primary data. [2025-09-16T18:17:25.939188] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-16T18:17:25.951115] [DEBUG] [LOCAL ] EMO: Trimmed 12961 records to 9509 (keeping 150 days of data) [2025-09-16T18:17:25.978911] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-09-16T18:17:26.016365] [DEBUG] [LOCAL ] EMO: Primary data saved (9509 records). [2025-09-16T18:17:26.016501] [INFO ] [MAIN ] EMO: Full history saved. [2025-09-16T18:17:26.016596] [INFO ] [MAIN ] Update Progress: 733/2369 symbols completed. EMO took 26.6s. Estimated remaining: 2h 52m 43s. Rate: 9.5 symbols/min [2025-09-16T18:17:26.206010] [INFO ] [MAIN ] ENFY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:17:26.206182] [DEBUG] [LOCAL ] ENFY: No existing data file found in primary storage. [2025-09-16T18:17:26.206219] [WARN ] [MAIN ] ENFY: No existing data found, performing full refresh instead. [2025-09-16T18:17:26.206378] [INFO ] [MAIN ] ENFY: Wiping existing primary data before full refresh. [2025-09-16T18:17:26.206417] [INFO ] [LOCAL ] ENFY: Starting deletion of primary data. [2025-09-16T18:17:26.206459] [DEBUG] [LOCAL ] ENFY: No primary data file found to delete. [2025-09-16T18:17:26.206494] [INFO ] [MAIN ] ENFY: Starting full primary refresh. [2025-09-16T18:17:26.572929] [INFO ] [REMOTE ] ENFY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:17:26.658297] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-16T18:17:26.774857] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-09-16T18:17:27.574942] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-02. [2025-09-16T18:17:27.880427] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-16T18:17:28.309607] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-16T18:17:28.374914] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-09-16T18:17:28.428325] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-16T18:17:28.434687] [INFO ] [REMOTE ] EMN: Full fetch complete (54282 records). [2025-09-16T18:17:28.434793] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-09-16T18:17:28.817240] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-09-16T18:17:28.817328] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-09-16T18:17:28.818008] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-09-16T18:17:28.818067] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-09-16T18:17:28.819142] [DEBUG] [LOCAL ] EMN: Trimmed 54282 records to 37814 (keeping 150 days of data) [2025-09-16T18:17:29.055931] [DEBUG] [LOCAL ] EMN: Primary data saved (37814 records). [2025-09-16T18:17:29.056082] [INFO ] [MAIN ] EMN: Full history saved. [2025-09-16T18:17:29.057079] [INFO ] [MAIN ] Update Progress: 734/2369 symbols completed. EMN took 38.0s. Estimated remaining: 2h 52m 29s. Rate: 9.5 symbols/min [2025-09-16T18:17:29.180036] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-09-16T18:17:29.231267] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:17:29.258595] [DEBUG] [LOCAL ] ENIC: Loaded 27637 existing records from primary storage. [2025-09-16T18:17:29.258758] [INFO ] [MAIN ] ENIC: Loaded 27637 existing records. [2025-09-16T18:17:29.432275] [WARN ] [MAIN ] ENIC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:17:29.432549] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-09-16T18:17:29.432596] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-09-16T18:17:29.433292] [DEBUG] [LOCAL ] ENIC: Deleted primary data file. [2025-09-16T18:17:29.433341] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-09-16T18:17:29.792766] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:17:29.981205] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-03. [2025-09-16T18:17:30.002158] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-16T18:17:30.451841] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-16T18:17:30.774890] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-09-16T18:17:31.005636] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-16T18:17:31.574903] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-04. [2025-09-16T18:17:31.911520] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-16T18:17:32.374898] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-09-16T18:17:32.433760] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-16T18:17:33.174892] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-09-16T18:17:33.972115] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-16T18:17:33.982671] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-05. [2025-09-16T18:17:34.332169] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-16T18:17:34.774967] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-09-16T18:17:35.182673] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-16T18:17:35.574908] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-09-16T18:17:35.960143] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-16T18:17:36.374912] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-09-16T18:17:37.174901] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-06. [2025-09-16T18:17:37.400721] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-16T18:17:37.506689] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-16T18:17:37.535487] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-16T18:17:37.974909] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-09-16T18:17:38.774937] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-09-16T18:17:38.876779] [DEBUG] [REMOTE ] ENIC: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-09-16T18:17:38.877113] [WARN ] [REMOTE ] ENIC: No data returned for month 2025-04 [2025-09-16T18:17:39.574859] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-09-16T18:17:40.135522] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-16T18:17:40.374909] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-07. [2025-09-16T18:17:41.174922] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-09-16T18:17:41.368006] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-16T18:17:41.539525] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-16T18:17:41.974906] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-08. [2025-09-16T18:17:42.353327] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-16T18:17:42.749206] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-16T18:17:42.774881] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-09-16T18:17:43.574905] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-09-16T18:17:44.374907] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-09-16T18:17:44.607973] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-16T18:17:44.614520] [INFO ] [REMOTE ] ENB: Full fetch complete (58208 records). [2025-09-16T18:17:44.614724] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-09-16T18:17:45.005032] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-09-16T18:17:45.005228] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-09-16T18:17:45.006101] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-09-16T18:17:45.006227] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-09-16T18:17:45.035295] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-16T18:17:45.033865] [DEBUG] [LOCAL ] ENB: Trimmed 58208 records to 39899 (keeping 150 days of data) [2025-09-16T18:17:45.177308] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-09-16T18:17:45.312267] [DEBUG] [LOCAL ] ENB: Primary data saved (39899 records). [2025-09-16T18:17:45.312443] [INFO ] [MAIN ] ENB: Full history saved. [2025-09-16T18:17:45.312571] [INFO ] [MAIN ] Update Progress: 735/2369 symbols completed. ENB took 23.2s. Estimated remaining: 2h 52m 45s. Rate: 9.5 symbols/min [2025-09-16T18:17:45.497563] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:17:45.500664] [DEBUG] [LOCAL ] ENO: Loaded 1228 existing records from primary storage. [2025-09-16T18:17:45.500743] [INFO ] [MAIN ] ENO: Loaded 1228 existing records. [2025-09-16T18:17:45.688262] [WARN ] [MAIN ] ENO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:17:45.688535] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-09-16T18:17:45.688598] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-09-16T18:17:45.688817] [DEBUG] [LOCAL ] ENO: Deleted primary data file. [2025-09-16T18:17:45.688876] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-09-16T18:17:45.974968] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-09. [2025-09-16T18:17:46.067662] [INFO ] [REMOTE ] ENO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:17:46.088047] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-16T18:17:46.094545] [INFO ] [REMOTE ] EMR: Full fetch complete (57500 records). [2025-09-16T18:17:46.094661] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-09-16T18:17:46.095345] [FATAL] [VALIDATOR ] EMR: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:17:46.095427] [FATAL] [MAIN ] EMR: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:17:46.095465] [WARN ] [MAIN ] EMR: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:17:46.095504] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-09-16T18:17:46.095561] [DEBUG] [LOCAL ] EMR: No primary data file found to delete. [2025-09-16T18:17:46.095606] [INFO ] [LOCAL ] EMR: Starting deletion of derivative data. [2025-09-16T18:17:46.095937] [DEBUG] [LOCAL ] EMR: Deleted derivative data file. [2025-09-16T18:17:46.096031] [INFO ] [MAIN ] Update Progress: 736/2369 symbols completed. EMR took 36.7s. Estimated remaining: 2h 52m 26s. Rate: 9.5 symbols/min [2025-09-16T18:17:46.264393] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:17:46.264591] [DEBUG] [LOCAL ] ENOV: No existing data file found in primary storage. [2025-09-16T18:17:46.264633] [WARN ] [MAIN ] ENOV: No existing data found, performing full refresh instead. [2025-09-16T18:17:46.264771] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-09-16T18:17:46.264811] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-09-16T18:17:46.264851] [DEBUG] [LOCAL ] ENOV: No primary data file found to delete. [2025-09-16T18:17:46.264884] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-09-16T18:17:46.619962] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:17:46.642276] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-16T18:17:46.653347] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-16T18:17:46.654790] [INFO ] [REMOTE ] ENFY: Full fetch complete (3539 records). [2025-09-16T18:17:46.654860] [DEBUG] [VALIDATOR ] ENFY: Validating primary data. [2025-09-16T18:17:46.655261] [FATAL] [VALIDATOR ] ENFY: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:17:46.655340] [FATAL] [MAIN ] ENFY: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:17:46.655377] [WARN ] [MAIN ] ENFY: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:17:46.655421] [INFO ] [LOCAL ] ENFY: Starting deletion of primary data. [2025-09-16T18:17:46.655479] [DEBUG] [LOCAL ] ENFY: No primary data file found to delete. [2025-09-16T18:17:46.655513] [INFO ] [LOCAL ] ENFY: Starting deletion of derivative data. [2025-09-16T18:17:46.655565] [DEBUG] [LOCAL ] ENFY: No derivative data file found to delete. [2025-09-16T18:17:46.655635] [INFO ] [MAIN ] Update Progress: 737/2369 symbols completed. ENFY took 20.6s. Estimated remaining: 2h 52m 7s. Rate: 9.5 symbols/min [2025-09-16T18:17:46.780022] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-09-16T18:17:46.826139] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:17:46.864365] [DEBUG] [LOCAL ] ENR: Loaded 32871 existing records from primary storage. [2025-09-16T18:17:46.864508] [INFO ] [MAIN ] ENR: Loaded 32871 existing records. [2025-09-16T18:17:47.041438] [WARN ] [MAIN ] ENR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:17:47.041715] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-09-16T18:17:47.041954] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-09-16T18:17:47.042774] [DEBUG] [LOCAL ] ENR: Deleted primary data file. [2025-09-16T18:17:47.042824] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-09-16T18:17:47.400334] [INFO ] [REMOTE ] ENR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:17:47.574888] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-09-16T18:17:48.047186] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-16T18:17:48.374908] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-09-16T18:17:49.094029] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-16T18:17:49.174948] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-09-16T18:17:49.784117] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-16T18:17:49.974972] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-09-16T18:17:50.573978] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-16T18:17:50.774931] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-09-16T18:17:51.328493] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-16T18:17:51.585007] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-09-16T18:17:51.589804] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-16T18:17:52.374918] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-09-16T18:17:53.015635] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-16T18:17:53.174886] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-09-16T18:17:53.550895] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-16T18:17:53.974911] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-09-16T18:17:54.135894] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-16T18:17:54.140040] [INFO ] [REMOTE ] ENIC: Full fetch complete (33472 records). [2025-09-16T18:17:54.140115] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-09-16T18:17:54.331974] [WARN ] [VALIDATOR ] ENIC: Validation failed - insufficient historical data. Have 129 unique days, need 150 days [2025-09-16T18:17:54.332435] [FATAL] [MAIN ] ENIC: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:17:54.332490] [WARN ] [MAIN ] ENIC: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:17:54.332537] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-09-16T18:17:54.332605] [DEBUG] [LOCAL ] ENIC: No primary data file found to delete. [2025-09-16T18:17:54.332660] [INFO ] [LOCAL ] ENIC: Starting deletion of derivative data. [2025-09-16T18:17:54.332922] [DEBUG] [LOCAL ] ENIC: Deleted derivative data file. [2025-09-16T18:17:54.333003] [INFO ] [MAIN ] Update Progress: 738/2369 symbols completed. ENIC took 25.3s. Estimated remaining: 2h 52m 4s. Rate: 9.5 symbols/min [2025-09-16T18:17:54.524090] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:17:54.544364] [DEBUG] [LOCAL ] ENS: Loaded 21455 existing records from primary storage. [2025-09-16T18:17:54.544488] [INFO ] [MAIN ] ENS: Loaded 21455 existing records. [2025-09-16T18:17:54.718227] [WARN ] [MAIN ] ENS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:17:54.718470] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-09-16T18:17:54.718517] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-09-16T18:17:54.719077] [DEBUG] [LOCAL ] ENS: Deleted primary data file. [2025-09-16T18:17:54.719136] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-09-16T18:17:54.780856] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-09-16T18:17:55.103606] [INFO ] [REMOTE ] ENS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:17:55.248834] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-16T18:17:55.556433] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-16T18:17:55.574855] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-09-16T18:17:56.374889] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-09-16T18:17:57.140564] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-16T18:17:57.174848] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-09-16T18:17:57.790616] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-16T18:17:57.974922] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-09-16T18:17:58.774915] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-09-16T18:17:58.813161] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-16T18:17:59.286581] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-16T18:17:59.289579] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-16T18:17:59.574905] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-09-16T18:18:00.374917] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-09-16T18:18:00.935195] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-16T18:18:00.988405] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-16T18:18:01.174899] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-09-16T18:18:01.974957] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-09-16T18:18:02.606775] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-16T18:18:02.774935] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-09-16T18:18:03.023414] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-16T18:18:03.574937] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-09-16T18:18:04.316002] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-16T18:18:04.374860] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-09-16T18:18:05.076878] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-16T18:18:05.174960] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-09-16T18:18:05.687064] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-16T18:18:05.974988] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-09-16T18:18:06.781744] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-09-16T18:18:06.787508] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-16T18:18:07.574914] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-09-16T18:18:07.769293] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-16T18:18:08.120360] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-16T18:18:08.374900] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-09-16T18:18:08.909542] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-16T18:18:09.174944] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-09-16T18:18:09.750312] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-16T18:18:09.868040] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-16T18:18:09.875738] [INFO ] [REMOTE ] ENR: Full fetch complete (45284 records). [2025-09-16T18:18:09.875963] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-09-16T18:18:09.876976] [FATAL] [VALIDATOR ] ENR: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:18:09.877103] [FATAL] [MAIN ] ENR: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:18:09.877173] [WARN ] [MAIN ] ENR: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:18:09.877252] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-09-16T18:18:09.877344] [DEBUG] [LOCAL ] ENR: No primary data file found to delete. [2025-09-16T18:18:09.877401] [INFO ] [LOCAL ] ENR: Starting deletion of derivative data. [2025-09-16T18:18:09.877771] [DEBUG] [LOCAL ] ENR: Deleted derivative data file. [2025-09-16T18:18:09.877912] [INFO ] [MAIN ] Update Progress: 739/2369 symbols completed. ENR took 23.2s. Estimated remaining: 2h 52m 18s. Rate: 9.5 symbols/min [2025-09-16T18:18:09.983711] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-09-16T18:18:10.173617] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:18:10.206759] [DEBUG] [LOCAL ] ENVA: Loaded 18662 existing records from primary storage. [2025-09-16T18:18:10.206952] [INFO ] [MAIN ] ENVA: Loaded 18662 existing records. [2025-09-16T18:18:10.439740] [WARN ] [MAIN ] ENVA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:18:10.440098] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-09-16T18:18:10.440167] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-09-16T18:18:10.440916] [DEBUG] [LOCAL ] ENVA: Deleted primary data file. [2025-09-16T18:18:10.441004] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-09-16T18:18:10.788071] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-09-16T18:18:10.827863] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:18:11.222272] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-16T18:18:11.575227] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-09-16T18:18:11.581197] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-16T18:18:12.374937] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-09-16T18:18:13.166158] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-16T18:18:13.167179] [INFO ] [REMOTE ] ENO: Full fetch complete (2221 records). [2025-09-16T18:18:13.167352] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-09-16T18:18:13.182568] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-09-16T18:18:13.174182] [FATAL] [VALIDATOR ] ENO: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:18:13.187620] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-16T18:18:13.186397] [FATAL] [MAIN ] ENO: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:18:13.194366] [WARN ] [MAIN ] ENO: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:18:13.194524] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-09-16T18:18:13.194613] [DEBUG] [LOCAL ] ENO: No primary data file found to delete. [2025-09-16T18:18:13.194710] [INFO ] [LOCAL ] ENO: Starting deletion of derivative data. [2025-09-16T18:18:13.195030] [DEBUG] [LOCAL ] ENO: Deleted derivative data file. [2025-09-16T18:18:13.195167] [INFO ] [MAIN ] Update Progress: 740/2369 symbols completed. ENO took 27.9s. Estimated remaining: 2h 52m 5s. Rate: 9.5 symbols/min [2025-09-16T18:18:13.388546] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:18:13.401270] [DEBUG] [LOCAL ] EOD: Loaded 10829 existing records from primary storage. [2025-09-16T18:18:13.401413] [INFO ] [MAIN ] EOD: Loaded 10829 existing records. [2025-09-16T18:18:13.582601] [WARN ] [MAIN ] EOD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:18:13.582870] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-09-16T18:18:13.582940] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-09-16T18:18:13.583315] [DEBUG] [LOCAL ] EOD: Deleted primary data file. [2025-09-16T18:18:13.583373] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-09-16T18:18:13.927459] [INFO ] [REMOTE ] EOD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:18:13.974862] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-09-16T18:18:14.568526] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-16T18:18:14.774935] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-09-16T18:18:14.843810] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-16T18:18:15.574941] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-09-16T18:18:15.942497] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-16T18:18:15.946050] [INFO ] [REMOTE ] ENS: Full fetch complete (31744 records). [2025-09-16T18:18:15.946162] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-09-16T18:18:15.946681] [FATAL] [VALIDATOR ] ENS: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:18:15.946775] [FATAL] [MAIN ] ENS: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:18:15.946818] [WARN ] [MAIN ] ENS: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:18:15.946861] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-09-16T18:18:15.946916] [DEBUG] [LOCAL ] ENS: No primary data file found to delete. [2025-09-16T18:18:15.946952] [INFO ] [LOCAL ] ENS: Starting deletion of derivative data. [2025-09-16T18:18:15.947164] [DEBUG] [LOCAL ] ENS: Deleted derivative data file. [2025-09-16T18:18:15.947269] [INFO ] [MAIN ] Update Progress: 741/2369 symbols completed. ENS took 21.6s. Estimated remaining: 2h 51m 50s. Rate: 9.5 symbols/min [2025-09-16T18:18:16.119504] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:18:16.128898] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-16T18:18:16.173139] [DEBUG] [LOCAL ] EOG: Loaded 39357 existing records from primary storage. [2025-09-16T18:18:16.173307] [INFO ] [MAIN ] EOG: Loaded 39357 existing records. [2025-09-16T18:18:16.350899] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:18:16.351148] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-09-16T18:18:16.351195] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-09-16T18:18:16.352089] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-09-16T18:18:16.352139] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-09-16T18:18:16.381167] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-09-16T18:18:16.705558] [INFO ] [REMOTE ] EOG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:18:17.174874] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-09-16T18:18:17.974917] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-09-16T18:18:18.001593] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-16T18:18:18.007100] [INFO ] [REMOTE ] ENOV: Full fetch complete (48344 records). [2025-09-16T18:18:18.007193] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-09-16T18:18:18.009211] [FATAL] [VALIDATOR ] ENOV: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:18:18.009287] [FATAL] [MAIN ] ENOV: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:18:18.009325] [WARN ] [MAIN ] ENOV: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:18:18.009370] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-09-16T18:18:18.009439] [DEBUG] [LOCAL ] ENOV: No primary data file found to delete. [2025-09-16T18:18:18.009476] [INFO ] [LOCAL ] ENOV: Starting deletion of derivative data. [2025-09-16T18:18:18.009517] [DEBUG] [LOCAL ] ENOV: No derivative data file found to delete. [2025-09-16T18:18:18.009585] [INFO ] [MAIN ] Update Progress: 742/2369 symbols completed. ENOV took 31.9s. Estimated remaining: 2h 51m 35s. Rate: 9.5 symbols/min [2025-09-16T18:18:18.177692] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:18:18.187399] [DEBUG] [LOCAL ] EOI: Loaded 6869 existing records from primary storage. [2025-09-16T18:18:18.187499] [INFO ] [MAIN ] EOI: Loaded 6869 existing records. [2025-09-16T18:18:18.362764] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:18:18.363030] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-09-16T18:18:18.363227] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-09-16T18:18:18.363583] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-09-16T18:18:18.363761] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-09-16T18:18:18.503423] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-16T18:18:18.741055] [INFO ] [REMOTE ] EOI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:18:18.774872] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-09-16T18:18:19.574896] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-09-16T18:18:19.614943] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-16T18:18:19.807220] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-16T18:18:20.374946] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-09-16T18:18:20.961698] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-16T18:18:21.174895] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-09-16T18:18:21.910592] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-16T18:18:21.974869] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-09-16T18:18:22.140330] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-16T18:18:22.774917] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-09-16T18:18:23.574914] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-09-16T18:18:23.598569] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-16T18:18:23.996090] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-16T18:18:24.374904] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-09-16T18:18:24.389659] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-16T18:18:25.174896] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-09-16T18:18:25.271628] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-16T18:18:25.974870] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-09-16T18:18:26.344410] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-16T18:18:26.774911] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-09-16T18:18:27.574910] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-09-16T18:18:27.771705] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-16T18:18:27.849797] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-16T18:18:28.374871] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-09-16T18:18:28.743779] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-16T18:18:29.174897] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-09-16T18:18:29.974893] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-09-16T18:18:30.169678] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-16T18:18:30.581683] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-09-16T18:18:30.774895] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-09-16T18:18:30.927914] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-16T18:18:31.574898] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-09-16T18:18:31.835123] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-16T18:18:32.374893] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-09-16T18:18:33.174894] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-09-16T18:18:33.217053] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-16T18:18:33.348512] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-16T18:18:33.941316] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-16T18:18:33.974852] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-09-16T18:18:34.729794] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-16T18:18:34.774856] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-09-16T18:18:35.530345] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-16T18:18:35.574855] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-09-16T18:18:36.374953] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-09-16T18:18:36.422302] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-16T18:18:36.423943] [INFO ] [REMOTE ] EOI: Full fetch complete (11526 records). [2025-09-16T18:18:36.424021] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-09-16T18:18:36.786529] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-09-16T18:18:36.786624] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-09-16T18:18:36.786926] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-09-16T18:18:36.786969] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-09-16T18:18:36.787448] [DEBUG] [LOCAL ] EOI: Trimmed 11526 records to 6949 (keeping 150 days of data) [2025-09-16T18:18:36.831471] [DEBUG] [LOCAL ] EOI: Primary data saved (6949 records). [2025-09-16T18:18:36.831615] [INFO ] [MAIN ] EOI: Full history saved. [2025-09-16T18:18:36.831719] [INFO ] [MAIN ] Update Progress: 743/2369 symbols completed. EOI took 18.8s. Estimated remaining: 2h 51m 56s. Rate: 9.5 symbols/min [2025-09-16T18:18:37.002522] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:18:37.013836] [DEBUG] [LOCAL ] EOS: Loaded 10119 existing records from primary storage. [2025-09-16T18:18:37.014009] [INFO ] [MAIN ] EOS: Loaded 10119 existing records. [2025-09-16T18:18:37.191927] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-09-16T18:18:37.196246] [WARN ] [MAIN ] EOS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:18:37.197351] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-09-16T18:18:37.197400] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-09-16T18:18:37.197757] [DEBUG] [LOCAL ] EOS: Deleted primary data file. [2025-09-16T18:18:37.197805] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-09-16T18:18:37.457903] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-16T18:18:37.493475] [INFO ] [REMOTE ] EOD: Full fetch complete (15414 records). [2025-09-16T18:18:37.493739] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-09-16T18:18:37.687156] [INFO ] [REMOTE ] EOS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:18:37.957612] [DEBUG] [VALIDATOR ] EOD: All expected trading days are present. [2025-09-16T18:18:37.957720] [DEBUG] [VALIDATOR ] EOD: Primary data validation passed. [2025-09-16T18:18:37.958131] [INFO ] [MAIN ] EOD: Fetched primary data is valid. [2025-09-16T18:18:37.958174] [DEBUG] [LOCAL ] EOD: Saving primary data. [2025-09-16T18:18:37.958943] [DEBUG] [LOCAL ] EOD: Trimmed 15414 records to 10922 (keeping 150 days of data) [2025-09-16T18:18:37.989182] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-09-16T18:18:38.029070] [DEBUG] [LOCAL ] EOD: Primary data saved (10922 records). [2025-09-16T18:18:38.029260] [INFO ] [MAIN ] EOD: Full history saved. [2025-09-16T18:18:38.029441] [INFO ] [MAIN ] Update Progress: 744/2369 symbols completed. EOD took 24.8s. Estimated remaining: 2h 51m 38s. Rate: 9.5 symbols/min [2025-09-16T18:18:38.214433] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:18:38.221665] [DEBUG] [LOCAL ] EOT: Loaded 4995 existing records from primary storage. [2025-09-16T18:18:38.221795] [INFO ] [MAIN ] EOT: Loaded 4995 existing records. [2025-09-16T18:18:38.401592] [WARN ] [MAIN ] EOT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:18:38.401871] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-09-16T18:18:38.401940] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-09-16T18:18:38.402216] [DEBUG] [LOCAL ] EOT: Deleted primary data file. [2025-09-16T18:18:38.402263] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-09-16T18:18:38.765789] [INFO ] [REMOTE ] EOT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:18:38.774866] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-09-16T18:18:38.820936] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-16T18:18:39.121952] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-16T18:18:39.369801] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-16T18:18:39.574926] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-09-16T18:18:40.374885] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-09-16T18:18:40.694597] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-16T18:18:40.697798] [INFO ] [REMOTE ] ENVA: Full fetch complete (27733 records). [2025-09-16T18:18:40.697885] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-09-16T18:18:40.698408] [FATAL] [VALIDATOR ] ENVA: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:18:40.698491] [FATAL] [MAIN ] ENVA: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:18:40.698529] [WARN ] [MAIN ] ENVA: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:18:40.698568] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-09-16T18:18:40.698624] [DEBUG] [LOCAL ] ENVA: No primary data file found to delete. [2025-09-16T18:18:40.698698] [INFO ] [LOCAL ] ENVA: Starting deletion of derivative data. [2025-09-16T18:18:40.698924] [DEBUG] [LOCAL ] ENVA: Deleted derivative data file. [2025-09-16T18:18:40.699004] [INFO ] [MAIN ] Update Progress: 745/2369 symbols completed. ENVA took 30.8s. Estimated remaining: 2h 51m 24s. Rate: 9.5 symbols/min [2025-09-16T18:18:40.868703] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:18:40.888273] [DEBUG] [LOCAL ] EPAC: Loaded 18981 existing records from primary storage. [2025-09-16T18:18:40.888403] [INFO ] [MAIN ] EPAC: Loaded 18981 existing records. [2025-09-16T18:18:41.061957] [WARN ] [MAIN ] EPAC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:18:41.062175] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-09-16T18:18:41.062220] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-09-16T18:18:41.062794] [DEBUG] [LOCAL ] EPAC: Deleted primary data file. [2025-09-16T18:18:41.062844] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-09-16T18:18:41.180025] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-09-16T18:18:41.412628] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:18:41.425996] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-16T18:18:41.974903] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-09-16T18:18:42.774874] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-09-16T18:18:43.108971] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-16T18:18:43.153411] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-16T18:18:43.574909] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-09-16T18:18:43.813037] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-16T18:18:44.280239] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-16T18:18:44.374928] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-09-16T18:18:45.174902] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-09-16T18:18:45.205558] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-16T18:18:45.974925] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-09-16T18:18:46.663118] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-16T18:18:46.774960] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-09-16T18:18:46.931660] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-16T18:18:46.940852] [INFO ] [REMOTE ] EOG: Full fetch complete (58010 records). [2025-09-16T18:18:46.941120] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-09-16T18:18:47.339598] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-09-16T18:18:47.339735] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-09-16T18:18:47.340728] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-09-16T18:18:47.340823] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-09-16T18:18:47.343844] [DEBUG] [LOCAL ] EOG: Trimmed 58010 records to 39747 (keeping 150 days of data) [2025-09-16T18:18:47.581772] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-09-16T18:18:47.597861] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-16T18:18:47.630923] [DEBUG] [LOCAL ] EOG: Primary data saved (39747 records). [2025-09-16T18:18:47.631099] [INFO ] [MAIN ] EOG: Full history saved. [2025-09-16T18:18:47.632384] [INFO ] [MAIN ] Update Progress: 746/2369 symbols completed. EOG took 31.7s. Estimated remaining: 2h 51m 19s. Rate: 9.5 symbols/min [2025-09-16T18:18:47.806758] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:18:47.842959] [DEBUG] [LOCAL ] EPAM: Loaded 28631 existing records from primary storage. [2025-09-16T18:18:47.843104] [INFO ] [MAIN ] EPAM: Loaded 28631 existing records. [2025-09-16T18:18:48.019871] [WARN ] [MAIN ] EPAM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:18:48.020152] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-09-16T18:18:48.020199] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-09-16T18:18:48.020949] [DEBUG] [LOCAL ] EPAM: Deleted primary data file. [2025-09-16T18:18:48.021000] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-09-16T18:18:48.375917] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:18:48.376052] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-09-16T18:18:48.891857] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-16T18:18:49.174926] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-09-16T18:18:49.490106] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-16T18:18:49.974915] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-09-16T18:18:50.630692] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-16T18:18:50.774893] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-09-16T18:18:51.270768] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-16T18:18:51.574924] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-09-16T18:18:52.386975] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-09-16T18:18:52.390207] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-16T18:18:52.723412] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-16T18:18:53.104708] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-16T18:18:53.174863] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-09-16T18:18:53.810843] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-16T18:18:53.974920] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-09-16T18:18:54.772506] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-16T18:18:54.774838] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-09-16T18:18:55.558083] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-16T18:18:55.574855] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-09-16T18:18:56.334036] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-16T18:18:56.335580] [INFO ] [REMOTE ] EOT: Full fetch complete (7484 records). [2025-09-16T18:18:56.335667] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-09-16T18:18:56.379961] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-09-16T18:18:56.691517] [DEBUG] [VALIDATOR ] EOT: All expected trading days are present. [2025-09-16T18:18:56.691598] [DEBUG] [VALIDATOR ] EOT: Primary data validation passed. [2025-09-16T18:18:56.691872] [INFO ] [MAIN ] EOT: Fetched primary data is valid. [2025-09-16T18:18:56.691916] [DEBUG] [LOCAL ] EOT: Saving primary data. [2025-09-16T18:18:56.692321] [DEBUG] [LOCAL ] EOT: Trimmed 7484 records to 5065 (keeping 150 days of data) [2025-09-16T18:18:56.724032] [DEBUG] [LOCAL ] EOT: Primary data saved (5065 records). [2025-09-16T18:18:56.724144] [INFO ] [MAIN ] EOT: Full history saved. [2025-09-16T18:18:56.724227] [INFO ] [MAIN ] Update Progress: 747/2369 symbols completed. EOT took 18.7s. Estimated remaining: 2h 51m 18s. Rate: 9.5 symbols/min [2025-09-16T18:18:56.902008] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:18:56.936862] [DEBUG] [LOCAL ] EPC: Loaded 29617 existing records from primary storage. [2025-09-16T18:18:56.937035] [INFO ] [MAIN ] EPC: Loaded 29617 existing records. [2025-09-16T18:18:57.122217] [WARN ] [MAIN ] EPC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:18:57.122463] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-09-16T18:18:57.122510] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-09-16T18:18:57.123278] [DEBUG] [LOCAL ] EPC: Deleted primary data file. [2025-09-16T18:18:57.123329] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-09-16T18:18:57.179972] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-09-16T18:18:57.500696] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-16T18:18:57.504223] [INFO ] [REMOTE ] EPC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:18:57.974932] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-09-16T18:18:58.774924] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-09-16T18:18:58.999661] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-16T18:18:59.301483] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-16T18:18:59.574963] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-09-16T18:18:59.969438] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-16T18:19:00.374953] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-09-16T18:19:01.174918] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-09-16T18:19:01.232375] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-16T18:19:01.864809] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-16T18:19:01.974873] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-09-16T18:19:01.985478] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-16T18:19:01.987673] [INFO ] [REMOTE ] EOS: Full fetch complete (16870 records). [2025-09-16T18:19:01.987847] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-09-16T18:19:01.988301] [FATAL] [VALIDATOR ] EOS: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:19:01.988383] [FATAL] [MAIN ] EOS: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:19:01.988420] [WARN ] [MAIN ] EOS: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:19:01.988463] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-09-16T18:19:01.988519] [DEBUG] [LOCAL ] EOS: No primary data file found to delete. [2025-09-16T18:19:01.988554] [INFO ] [LOCAL ] EOS: Starting deletion of derivative data. [2025-09-16T18:19:01.988852] [DEBUG] [LOCAL ] EOS: Deleted derivative data file. [2025-09-16T18:19:01.988936] [INFO ] [MAIN ] Update Progress: 748/2369 symbols completed. EOS took 25.2s. Estimated remaining: 2h 51m 10s. Rate: 9.5 symbols/min [2025-09-16T18:19:02.165084] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:19:02.211057] [DEBUG] [LOCAL ] EPD: Loaded 39582 existing records from primary storage. [2025-09-16T18:19:02.211241] [INFO ] [MAIN ] EPD: Loaded 39582 existing records. [2025-09-16T18:19:02.399568] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:19:02.399825] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-09-16T18:19:02.399871] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-09-16T18:19:02.400969] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-09-16T18:19:02.401026] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-09-16T18:19:02.761693] [INFO ] [REMOTE ] EPD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:19:02.774857] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-09-16T18:19:03.580184] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-16T18:19:03.578871] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-09-16T18:19:04.374863] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-09-16T18:19:04.512885] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-16T18:19:04.843059] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-16T18:19:05.174917] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-09-16T18:19:05.908434] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-16T18:19:05.974876] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-09-16T18:19:06.267831] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-16T18:19:06.271205] [INFO ] [REMOTE ] EPAC: Full fetch complete (29093 records). [2025-09-16T18:19:06.271285] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-09-16T18:19:06.637851] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present. [2025-09-16T18:19:06.637928] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed. [2025-09-16T18:19:06.638458] [INFO ] [MAIN ] EPAC: Fetched primary data is valid. [2025-09-16T18:19:06.638498] [DEBUG] [LOCAL ] EPAC: Saving primary data. [2025-09-16T18:19:06.639228] [DEBUG] [LOCAL ] EPAC: Trimmed 29093 records to 19167 (keeping 150 days of data) [2025-09-16T18:19:06.759195] [DEBUG] [LOCAL ] EPAC: Primary data saved (19167 records). [2025-09-16T18:19:06.759344] [INFO ] [MAIN ] EPAC: Full history saved. [2025-09-16T18:19:06.759431] [INFO ] [MAIN ] Update Progress: 749/2369 symbols completed. EPAC took 26.1s. Estimated remaining: 2h 51m 0s. Rate: 9.5 symbols/min [2025-09-16T18:19:06.780073] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-09-16T18:19:06.933452] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:19:06.933683] [DEBUG] [LOCAL ] EPR: No existing data file found in primary storage. [2025-09-16T18:19:06.933727] [WARN ] [MAIN ] EPR: No existing data found, performing full refresh instead. [2025-09-16T18:19:06.933880] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-09-16T18:19:06.933970] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-09-16T18:19:06.934030] [DEBUG] [LOCAL ] EPR: No primary data file found to delete. [2025-09-16T18:19:06.934077] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-09-16T18:19:07.300062] [INFO ] [REMOTE ] EPR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:19:07.574932] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-09-16T18:19:07.691567] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-16T18:19:08.374883] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-09-16T18:19:08.794480] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-16T18:19:09.088076] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-16T18:19:09.174973] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-09-16T18:19:09.719287] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-16T18:19:09.974965] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-09-16T18:19:10.774915] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-09-16T18:19:11.365360] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-16T18:19:11.474576] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-16T18:19:11.574866] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-09-16T18:19:12.122442] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-16T18:19:12.374907] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-09-16T18:19:13.002515] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-16T18:19:13.174914] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-09-16T18:19:13.974916] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-09-16T18:19:14.234366] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-16T18:19:14.774910] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-09-16T18:19:14.828338] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-16T18:19:15.574908] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-09-16T18:19:16.119749] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-16T18:19:16.183306] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-16T18:19:16.374917] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-09-16T18:19:16.944115] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-16T18:19:17.174924] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-09-16T18:19:17.932457] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-16T18:19:17.974904] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-09-16T18:19:18.774934] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-09-16T18:19:18.905722] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-16T18:19:19.517468] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-16T18:19:19.522225] [INFO ] [REMOTE ] EPAM: Full fetch complete (43054 records). [2025-09-16T18:19:19.522326] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-09-16T18:19:19.522964] [FATAL] [VALIDATOR ] EPAM: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:19:19.523044] [FATAL] [MAIN ] EPAM: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:19:19.523081] [WARN ] [MAIN ] EPAM: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:19:19.523126] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-09-16T18:19:19.523184] [DEBUG] [LOCAL ] EPAM: No primary data file found to delete. [2025-09-16T18:19:19.523220] [INFO ] [LOCAL ] EPAM: Starting deletion of derivative data. [2025-09-16T18:19:19.523473] [DEBUG] [LOCAL ] EPAM: Deleted derivative data file. [2025-09-16T18:19:19.524533] [INFO ] [MAIN ] Update Progress: 750/2369 symbols completed. EPAM took 31.9s. Estimated remaining: 2h 51m 8s. Rate: 9.5 symbols/min [2025-09-16T18:19:19.579984] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-09-16T18:19:19.699538] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:19:19.740891] [DEBUG] [LOCAL ] EPRT: Loaded 35533 existing records from primary storage. [2025-09-16T18:19:19.741052] [INFO ] [MAIN ] EPRT: Loaded 35533 existing records. [2025-09-16T18:19:19.917456] [WARN ] [MAIN ] EPRT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:19:19.917723] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-09-16T18:19:19.917771] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-09-16T18:19:19.918530] [DEBUG] [LOCAL ] EPRT: Deleted primary data file. [2025-09-16T18:19:19.918575] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-09-16T18:19:20.275228] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:19:20.324474] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-16T18:19:20.374893] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-09-16T18:19:21.174945] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-09-16T18:19:21.323729] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-16T18:19:21.682556] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-16T18:19:21.689088] [INFO ] [REMOTE ] EPC: Full fetch complete (43364 records). [2025-09-16T18:19:21.689285] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-09-16T18:19:21.690136] [FATAL] [VALIDATOR ] EPC: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:19:21.690237] [FATAL] [MAIN ] EPC: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:19:21.690283] [WARN ] [MAIN ] EPC: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:19:21.690342] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-09-16T18:19:21.690412] [DEBUG] [LOCAL ] EPC: No primary data file found to delete. [2025-09-16T18:19:21.690460] [INFO ] [LOCAL ] EPC: Starting deletion of derivative data. [2025-09-16T18:19:21.690832] [DEBUG] [LOCAL ] EPC: Deleted derivative data file. [2025-09-16T18:19:21.690944] [INFO ] [MAIN ] Update Progress: 751/2369 symbols completed. EPC took 25.0s. Estimated remaining: 2h 50m 52s. Rate: 9.5 symbols/min [2025-09-16T18:19:21.889871] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:19:21.900736] [DEBUG] [LOCAL ] EQBK: Loaded 7957 existing records from primary storage. [2025-09-16T18:19:21.900887] [INFO ] [MAIN ] EQBK: Loaded 7957 existing records. [2025-09-16T18:19:21.980160] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-09-16T18:19:22.143975] [WARN ] [MAIN ] EQBK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:19:22.144295] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-09-16T18:19:22.144367] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-09-16T18:19:22.144853] [DEBUG] [LOCAL ] EQBK: Deleted primary data file. [2025-09-16T18:19:22.144929] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-09-16T18:19:22.692344] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:19:22.775007] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-09-16T18:19:22.874383] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-16T18:19:23.389033] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-16T18:19:23.394213] [INFO ] [REMOTE ] EPR: Full fetch complete (47927 records). [2025-09-16T18:19:23.394301] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-09-16T18:19:23.394856] [FATAL] [VALIDATOR ] EPR: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:19:23.394975] [FATAL] [MAIN ] EPR: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:19:23.395014] [WARN ] [MAIN ] EPR: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:19:23.395053] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-09-16T18:19:23.395109] [DEBUG] [LOCAL ] EPR: No primary data file found to delete. [2025-09-16T18:19:23.395145] [INFO ] [LOCAL ] EPR: Starting deletion of derivative data. [2025-09-16T18:19:23.395183] [DEBUG] [LOCAL ] EPR: No derivative data file found to delete. [2025-09-16T18:19:23.395248] [INFO ] [MAIN ] Update Progress: 752/2369 symbols completed. EPR took 16.6s. Estimated remaining: 2h 50m 36s. Rate: 9.5 symbols/min [2025-09-16T18:19:23.564465] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:19:23.574919] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-09-16T18:19:23.602987] [DEBUG] [LOCAL ] EQH: Loaded 38767 existing records from primary storage. [2025-09-16T18:19:23.603120] [INFO ] [MAIN ] EQH: Loaded 38767 existing records. [2025-09-16T18:19:23.777496] [WARN ] [MAIN ] EQH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:19:23.777808] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-09-16T18:19:23.777855] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-09-16T18:19:23.778639] [DEBUG] [LOCAL ] EQH: Deleted primary data file. [2025-09-16T18:19:23.778714] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-09-16T18:19:24.126022] [INFO ] [REMOTE ] EQH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:19:24.315756] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-16T18:19:24.374897] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-09-16T18:19:25.053361] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-16T18:19:25.174878] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-09-16T18:19:25.974893] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-09-16T18:19:26.329256] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-16T18:19:26.774933] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-09-16T18:19:26.879423] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-16T18:19:27.144399] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-16T18:19:27.574907] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-09-16T18:19:28.256722] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-16T18:19:28.374896] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-09-16T18:19:28.993493] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-16T18:19:28.999900] [INFO ] [REMOTE ] EPD: Full fetch complete (58293 records). [2025-09-16T18:19:29.000006] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-09-16T18:19:29.178907] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-09-16T18:19:29.310579] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-16T18:19:29.403426] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-09-16T18:19:29.403521] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-09-16T18:19:29.404373] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-09-16T18:19:29.404431] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-09-16T18:19:29.406795] [DEBUG] [LOCAL ] EPD: Trimmed 58293 records to 39972 (keeping 150 days of data) [2025-09-16T18:19:29.660448] [DEBUG] [LOCAL ] EPD: Primary data saved (39972 records). [2025-09-16T18:19:29.660813] [INFO ] [MAIN ] EPD: Full history saved. [2025-09-16T18:19:29.660972] [INFO ] [MAIN ] Update Progress: 753/2369 symbols completed. EPD took 27.7s. Estimated remaining: 2h 50m 29s. Rate: 9.5 symbols/min [2025-09-16T18:19:29.837320] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:19:29.837513] [DEBUG] [LOCAL ] EQNR: No existing data file found in primary storage. [2025-09-16T18:19:29.837551] [WARN ] [MAIN ] EQNR: No existing data found, performing full refresh instead. [2025-09-16T18:19:29.837706] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-09-16T18:19:29.837752] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-09-16T18:19:29.837795] [DEBUG] [LOCAL ] EQNR: No primary data file found to delete. [2025-09-16T18:19:29.837829] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-09-16T18:19:29.987072] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-09-16T18:19:30.215509] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:19:30.774881] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-09-16T18:19:30.985773] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-16T18:19:31.075479] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-16T18:19:31.574901] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-09-16T18:19:32.374862] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-09-16T18:19:32.861301] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-16T18:19:32.892013] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-16T18:19:33.174931] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-09-16T18:19:33.289752] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-16T18:19:33.974936] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-09-16T18:19:34.774935] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-09-16T18:19:35.079301] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-16T18:19:35.185401] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-16T18:19:35.553196] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-16T18:19:35.574913] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-09-16T18:19:36.269812] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-16T18:19:36.374881] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-09-16T18:19:37.174901] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-09-16T18:19:37.357771] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-16T18:19:37.974942] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-09-16T18:19:38.774911] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-09-16T18:19:39.057669] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-16T18:19:39.081120] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-16T18:19:39.083048] [INFO ] [REMOTE ] EQBK: Full fetch complete (11459 records). [2025-09-16T18:19:39.083117] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-09-16T18:19:39.455028] [DEBUG] [VALIDATOR ] EQBK: All expected trading days are present. [2025-09-16T18:19:39.455109] [DEBUG] [VALIDATOR ] EQBK: Primary data validation passed. [2025-09-16T18:19:39.455387] [INFO ] [MAIN ] EQBK: Fetched primary data is valid. [2025-09-16T18:19:39.455437] [DEBUG] [LOCAL ] EQBK: Saving primary data. [2025-09-16T18:19:39.455961] [DEBUG] [LOCAL ] EQBK: Trimmed 11459 records to 8045 (keeping 150 days of data) [2025-09-16T18:19:39.508041] [DEBUG] [LOCAL ] EQBK: Primary data saved (8045 records). [2025-09-16T18:19:39.508206] [INFO ] [MAIN ] EQBK: Full history saved. [2025-09-16T18:19:39.508329] [INFO ] [MAIN ] Update Progress: 754/2369 symbols completed. EQBK took 17.8s. Estimated remaining: 2h 50m 31s. Rate: 9.5 symbols/min [2025-09-16T18:19:39.580065] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-09-16T18:19:39.692075] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:19:39.731118] [DEBUG] [LOCAL ] EQR: Loaded 37964 existing records from primary storage. [2025-09-16T18:19:39.731282] [INFO ] [MAIN ] EQR: Loaded 37964 existing records. [2025-09-16T18:19:39.921296] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:19:39.921600] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-09-16T18:19:39.921683] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-09-16T18:19:39.923274] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-09-16T18:19:39.923368] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-09-16T18:19:40.303222] [INFO ] [REMOTE ] EQR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:19:40.374915] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-09-16T18:19:40.481855] [DEBUG] [REMOTE ] EQR: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-09-16T18:19:40.482271] [WARN ] [REMOTE ] EQR: No data returned for month 2025-02 [2025-09-16T18:19:40.595844] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-16T18:19:41.174909] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-09-16T18:19:41.509738] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-16T18:19:41.974916] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-09-16T18:19:42.774905] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-09-16T18:19:43.024477] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-16T18:19:43.336314] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-16T18:19:43.574937] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-09-16T18:19:44.369041] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-16T18:19:44.379175] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-09-16T18:19:45.174900] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-09-16T18:19:45.211453] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-16T18:19:45.974917] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-09-16T18:19:46.147977] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-16T18:19:46.774989] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-09-16T18:19:46.808176] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-16T18:19:47.574883] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-09-16T18:19:47.606369] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-16T18:19:48.374938] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-09-16T18:19:48.532717] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-16T18:19:49.174942] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-09-16T18:19:49.388043] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-16T18:19:49.974925] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-09-16T18:19:50.337944] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-16T18:19:50.774929] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-09-16T18:19:50.808334] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-16T18:19:51.156688] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-16T18:19:51.163000] [INFO ] [REMOTE ] EQH: Full fetch complete (57287 records). [2025-09-16T18:19:51.163151] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-09-16T18:19:51.543464] [DEBUG] [VALIDATOR ] EQH: All expected trading days are present. [2025-09-16T18:19:51.543549] [DEBUG] [VALIDATOR ] EQH: Primary data validation passed. [2025-09-16T18:19:51.544310] [INFO ] [MAIN ] EQH: Fetched primary data is valid. [2025-09-16T18:19:51.544379] [DEBUG] [LOCAL ] EQH: Saving primary data. [2025-09-16T18:19:51.545735] [DEBUG] [LOCAL ] EQH: Trimmed 57287 records to 39156 (keeping 150 days of data) [2025-09-16T18:19:51.603488] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-09-16T18:19:51.793054] [DEBUG] [LOCAL ] EQH: Primary data saved (39156 records). [2025-09-16T18:19:51.793251] [INFO ] [MAIN ] EQH: Full history saved. [2025-09-16T18:19:51.793347] [INFO ] [MAIN ] Update Progress: 755/2369 symbols completed. EQH took 28.4s. Estimated remaining: 2h 50m 37s. Rate: 9.5 symbols/min [2025-09-16T18:19:51.968215] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:19:51.968380] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-09-16T18:19:51.968418] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-09-16T18:19:51.968552] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-09-16T18:19:51.968600] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-16T18:19:51.968671] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-09-16T18:19:51.968708] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-09-16T18:19:52.326252] [INFO ] [REMOTE ] EQS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:19:52.374917] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-09-16T18:19:52.637536] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-16T18:19:53.174910] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-09-16T18:19:53.264713] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-16T18:19:53.565524] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-16T18:19:53.974879] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-09-16T18:19:54.131499] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-16T18:19:54.309447] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-16T18:19:54.774913] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-09-16T18:19:55.017831] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.24 seconds). [2025-09-16T18:19:55.574904] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-09-16T18:19:56.374895] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-09-16T18:19:57.181009] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-09-16T18:19:57.182767] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-16T18:19:57.188875] [INFO ] [REMOTE ] EPRT: Full fetch complete (52903 records). [2025-09-16T18:19:57.188965] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-09-16T18:19:57.574510] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present. [2025-09-16T18:19:57.574598] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed. [2025-09-16T18:19:57.575534] [INFO ] [MAIN ] EPRT: Fetched primary data is valid. [2025-09-16T18:19:57.575595] [DEBUG] [LOCAL ] EPRT: Saving primary data. [2025-09-16T18:19:57.576857] [DEBUG] [LOCAL ] EPRT: Trimmed 52903 records to 35910 (keeping 150 days of data) [2025-09-16T18:19:57.644384] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-16T18:19:57.796939] [DEBUG] [LOCAL ] EPRT: Primary data saved (35910 records). [2025-09-16T18:19:57.797079] [INFO ] [MAIN ] EPRT: Full history saved. [2025-09-16T18:19:57.797711] [INFO ] [MAIN ] Update Progress: 756/2369 symbols completed. EPRT took 38.3s. Estimated remaining: 2h 50m 30s. Rate: 9.5 symbols/min [2025-09-16T18:19:57.965751] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:19:57.974923] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-09-16T18:19:58.005619] [DEBUG] [LOCAL ] EQT: Loaded 39645 existing records from primary storage. [2025-09-16T18:19:58.005794] [INFO ] [MAIN ] EQT: Loaded 39645 existing records. [2025-09-16T18:19:58.188082] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:19:58.188547] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-09-16T18:19:58.188601] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-09-16T18:19:58.189429] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-09-16T18:19:58.189476] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-09-16T18:19:58.503781] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-16T18:19:58.511277] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-16T18:19:58.595740] [INFO ] [REMOTE ] EQT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:19:58.774922] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-09-16T18:19:59.574947] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-09-16T18:20:00.374972] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-09-16T18:20:00.728498] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-16T18:20:00.873226] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-16T18:20:01.174887] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-09-16T18:20:01.559308] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-16T18:20:01.566733] [INFO ] [REMOTE ] EQNR: Full fetch complete (57717 records). [2025-09-16T18:20:01.566932] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-09-16T18:20:01.967083] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-09-16T18:20:01.967178] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-09-16T18:20:01.967930] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-09-16T18:20:01.967978] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-09-16T18:20:01.969241] [DEBUG] [LOCAL ] EQNR: Trimmed 57717 records to 39521 (keeping 150 days of data) [2025-09-16T18:20:02.026541] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-09-16T18:20:02.223288] [DEBUG] [LOCAL ] EQNR: Primary data saved (39521 records). [2025-09-16T18:20:02.223453] [INFO ] [MAIN ] EQNR: Full history saved. [2025-09-16T18:20:02.223553] [INFO ] [MAIN ] Update Progress: 757/2369 symbols completed. EQNR took 32.6s. Estimated remaining: 2h 50m 20s. Rate: 9.5 symbols/min [2025-09-16T18:20:02.732753] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-16T18:20:02.774860] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-09-16T18:20:03.170758] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-16T18:20:03.501868] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-16T18:20:03.503147] [INFO ] [REMOTE ] EQS: Full fetch complete (1856 records). [2025-09-16T18:20:03.503216] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-09-16T18:20:03.580122] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-09-16T18:20:03.686871] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 139 unique days, need 150 days [2025-09-16T18:20:03.687107] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:20:03.687178] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:20:03.687245] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-16T18:20:03.687315] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-09-16T18:20:03.687363] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-09-16T18:20:03.687406] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-09-16T18:20:03.687467] [INFO ] [MAIN ] Update Progress: 758/2369 symbols completed. EQS took 11.9s. Estimated remaining: 2h 50m 3s. Rate: 9.5 symbols/min [2025-09-16T18:20:04.374928] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-09-16T18:20:05.700108] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-16T18:20:05.711553] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-09-16T18:20:06.262484] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-16T18:20:06.273463] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-09-16T18:20:07.694087] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-16T18:20:07.705450] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-09-16T18:20:07.853447] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-16T18:20:07.859622] [INFO ] [REMOTE ] EQR: Full fetch complete (50978 records). [2025-09-16T18:20:07.859744] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-09-16T18:20:08.053530] [WARN ] [VALIDATOR ] EQR: Validation failed - insufficient historical data. Have 137 unique days, need 150 days [2025-09-16T18:20:08.054189] [FATAL] [MAIN ] EQR: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:20:08.054247] [WARN ] [MAIN ] EQR: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:20:08.054295] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-09-16T18:20:08.054354] [DEBUG] [LOCAL ] EQR: No primary data file found to delete. [2025-09-16T18:20:08.054390] [INFO ] [LOCAL ] EQR: Starting deletion of derivative data. [2025-09-16T18:20:08.054698] [DEBUG] [LOCAL ] EQR: Deleted derivative data file. [2025-09-16T18:20:08.054784] [INFO ] [MAIN ] Update Progress: 759/2369 symbols completed. EQR took 28.5s. Estimated remaining: 2h 49m 52s. Rate: 9.5 symbols/min [2025-09-16T18:20:09.688485] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-16T18:20:09.699281] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-09-16T18:20:11.823341] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-16T18:20:11.835072] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-09-16T18:20:13.856149] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-16T18:20:13.867713] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-09-16T18:20:15.624020] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-16T18:20:15.634391] [INFO ] [REMOTE ] EQT: Full fetch complete (58361 records). [2025-09-16T18:20:15.634694] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-09-16T18:20:16.231682] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-09-16T18:20:16.231796] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-09-16T18:20:16.232553] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-09-16T18:20:16.232599] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-09-16T18:20:16.234043] [DEBUG] [LOCAL ] EQT: Trimmed 58361 records to 40035 (keeping 150 days of data) [2025-09-16T18:20:16.509594] [DEBUG] [LOCAL ] EQT: Primary data saved (40035 records). [2025-09-16T18:20:16.509780] [INFO ] [MAIN ] EQT: Full history saved. [2025-09-16T18:20:16.510862] [INFO ] [MAIN ] Update Progress: 760/2369 symbols completed. EQT took 18.7s. Estimated remaining: 2h 49m 51s. Rate: 9.5 symbols/min [2025-09-16T18:20:17.137188] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:20:17.116088] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:20:17.208877] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:20:17.213525] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:20:17.217113] [DEBUG] [LOCAL ] EQV: Loaded 2157 existing records from primary storage. [2025-09-16T18:20:17.218799] [INFO ] [MAIN ] EQV: Loaded 2157 existing records. [2025-09-16T18:20:17.447564] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:20:17.448466] [DEBUG] [LOCAL ] ERO: Loaded 29843 existing records from primary storage. [2025-09-16T18:20:17.459118] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-09-16T18:20:17.459354] [INFO ] [MAIN ] ERO: Loaded 29843 existing records. [2025-09-16T18:20:17.459294] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-09-16T18:20:17.518971] [DEBUG] [LOCAL ] ES: Loaded 38782 existing records from primary storage. [2025-09-16T18:20:17.501903] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-09-16T18:20:17.513222] [DEBUG] [LOCAL ] ERJ: Loaded 37326 existing records from primary storage. [2025-09-16T18:20:17.519318] [INFO ] [MAIN ] ERJ: Loaded 37326 existing records. [2025-09-16T18:20:17.519386] [INFO ] [MAIN ] ES: Loaded 38782 existing records. [2025-09-16T18:20:17.600113] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-09-16T18:20:18.174077] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:20:18.174185] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:20:18.245479] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-09-16T18:20:18.253281] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:20:18.255539] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-09-16T18:20:18.253604] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-09-16T18:20:18.279254] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-09-16T18:20:18.305220] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-09-16T18:20:18.305443] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-09-16T18:20:18.344735] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-09-16T18:20:18.339432] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-09-16T18:20:18.344817] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-09-16T18:20:18.366578] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-09-16T18:20:18.360486] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-09-16T18:20:18.443764] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-09-16T18:20:18.707264] [INFO ] [REMOTE ] EQV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:20:18.734575] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-09-16T18:20:19.495167] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-16T18:20:19.518954] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-09-16T18:20:19.527576] [INFO ] [REMOTE ] ES: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:20:19.589797] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-09-16T18:20:19.638081] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:20:19.659708] [INFO ] [REMOTE ] ERO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:20:19.660268] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-09-16T18:20:19.660068] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-09-16T18:20:19.961118] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-16T18:20:19.962537] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-09-16T18:20:20.287958] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-16T18:20:20.289275] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-09-16T18:20:20.628606] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-16T18:20:20.630046] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-09-16T18:20:20.929803] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-16T18:20:20.939150] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-09-16T18:20:20.989937] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-16T18:20:20.991387] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-09-16T18:20:21.317744] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-16T18:20:21.318964] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-09-16T18:20:21.547069] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-16T18:20:21.555089] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-09-16T18:20:21.634475] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-16T18:20:21.636034] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-09-16T18:20:22.141199] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-16T18:20:22.142094] [INFO ] [REMOTE ] EQV: Full fetch complete (3340 records). [2025-09-16T18:20:22.142164] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-09-16T18:20:22.142540] [FATAL] [VALIDATOR ] EQV: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:20:22.142628] [FATAL] [MAIN ] EQV: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:20:22.142713] [WARN ] [MAIN ] EQV: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:20:22.142767] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-09-16T18:20:22.142825] [DEBUG] [LOCAL ] EQV: No primary data file found to delete. [2025-09-16T18:20:22.142862] [INFO ] [LOCAL ] EQV: Starting deletion of derivative data. [2025-09-16T18:20:22.143185] [DEBUG] [LOCAL ] EQV: Deleted derivative data file. [2025-09-16T18:20:22.143269] [INFO ] [MAIN ] Update Progress: 761/2369 symbols completed. EQV took 5.6s. Estimated remaining: 2h 49m 43s. Rate: 9.5 symbols/min [2025-09-16T18:20:22.369212] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:20:22.389075] [DEBUG] [LOCAL ] ESAB: Loaded 18188 existing records from primary storage. [2025-09-16T18:20:22.389331] [INFO ] [MAIN ] ESAB: Loaded 18188 existing records. [2025-09-16T18:20:22.539655] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (2.95 seconds). [2025-09-16T18:20:22.584239] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-09-16T18:20:22.619213] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:20:22.619447] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-09-16T18:20:22.619502] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-09-16T18:20:22.620013] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-09-16T18:20:22.620063] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-09-16T18:20:22.996980] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:20:22.997433] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-09-16T18:20:23.033107] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-16T18:20:23.044441] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-09-16T18:20:23.321039] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-16T18:20:23.330194] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-09-16T18:20:24.335841] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-16T18:20:24.340878] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-09-16T18:20:24.370977] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-16T18:20:24.382431] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-09-16T18:20:24.475673] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-16T18:20:24.514004] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-16T18:20:25.174899] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-09-16T18:20:25.301008] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-16T18:20:25.976183] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-09-16T18:20:25.982230] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-16T18:20:26.315501] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-16T18:20:26.774893] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-09-16T18:20:27.378160] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-16T18:20:27.574895] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-09-16T18:20:27.751125] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-16T18:20:28.374899] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-09-16T18:20:29.021732] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-16T18:20:29.174902] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-09-16T18:20:29.614974] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-16T18:20:29.974901] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-09-16T18:20:30.436114] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-16T18:20:30.774905] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-09-16T18:20:31.574896] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-09-16T18:20:31.626877] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-16T18:20:32.062611] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-16T18:20:32.374878] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-09-16T18:20:32.469572] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-16T18:20:33.174902] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-09-16T18:20:33.506134] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-16T18:20:33.511619] [INFO ] [REMOTE ] ERO: Full fetch complete (44885 records). [2025-09-16T18:20:33.511770] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-09-16T18:20:33.900750] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-09-16T18:20:33.900858] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-09-16T18:20:33.901555] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-09-16T18:20:33.901608] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-09-16T18:20:33.902703] [DEBUG] [LOCAL ] ERO: Trimmed 44885 records to 30125 (keeping 150 days of data) [2025-09-16T18:20:33.990525] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-09-16T18:20:34.097385] [DEBUG] [LOCAL ] ERO: Primary data saved (30125 records). [2025-09-16T18:20:34.097575] [INFO ] [MAIN ] ERO: Full history saved. [2025-09-16T18:20:34.097715] [INFO ] [MAIN ] Update Progress: 762/2369 symbols completed. ERO took 17.6s. Estimated remaining: 2h 49m 48s. Rate: 9.5 symbols/min [2025-09-16T18:20:34.283723] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:20:34.303140] [DEBUG] [LOCAL ] ESE: Loaded 12123 existing records from primary storage. [2025-09-16T18:20:34.303298] [INFO ] [MAIN ] ESE: Loaded 12123 existing records. [2025-09-16T18:20:34.486592] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:20:34.486961] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-09-16T18:20:34.487034] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-09-16T18:20:34.487598] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-09-16T18:20:34.487774] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-09-16T18:20:34.776143] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-09-16T18:20:34.826699] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-16T18:20:34.894244] [INFO ] [REMOTE ] ESE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:20:35.276341] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-16T18:20:35.574881] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-09-16T18:20:35.775008] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-16T18:20:36.374953] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-09-16T18:20:37.174894] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-09-16T18:20:37.464102] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-16T18:20:37.484491] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-16T18:20:37.974916] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-09-16T18:20:38.467560] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-16T18:20:38.473578] [INFO ] [REMOTE ] ERJ: Full fetch complete (55378 records). [2025-09-16T18:20:38.473756] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-09-16T18:20:38.780155] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-09-16T18:20:38.864672] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-09-16T18:20:38.864784] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-09-16T18:20:38.865851] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-09-16T18:20:38.865922] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-09-16T18:20:38.867580] [DEBUG] [LOCAL ] ERJ: Trimmed 55378 records to 37655 (keeping 150 days of data) [2025-09-16T18:20:39.100991] [DEBUG] [LOCAL ] ERJ: Primary data saved (37655 records). [2025-09-16T18:20:39.101152] [INFO ] [MAIN ] ERJ: Full history saved. [2025-09-16T18:20:39.101282] [INFO ] [MAIN ] Update Progress: 763/2369 symbols completed. ERJ took 22.6s. Estimated remaining: 2h 49m 39s. Rate: 9.5 symbols/min [2025-09-16T18:20:39.274266] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:20:39.314329] [DEBUG] [LOCAL ] ESI: Loaded 37061 existing records from primary storage. [2025-09-16T18:20:39.314504] [INFO ] [MAIN ] ESI: Loaded 37061 existing records. [2025-09-16T18:20:39.501029] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:20:39.501451] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-09-16T18:20:39.501511] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-09-16T18:20:39.502362] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-09-16T18:20:39.502412] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-09-16T18:20:39.582422] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-09-16T18:20:39.772409] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-16T18:20:39.912057] [INFO ] [REMOTE ] ESI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:20:39.920402] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-16T18:20:40.374949] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-09-16T18:20:40.491982] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-16T18:20:41.175068] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-09-16T18:20:41.175863] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-16T18:20:41.974915] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-09-16T18:20:42.658412] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-16T18:20:42.774967] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-09-16T18:20:42.984061] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-16T18:20:43.574926] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-09-16T18:20:44.374966] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-09-16T18:20:44.531592] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-16T18:20:44.540619] [INFO ] [REMOTE ] ES: Full fetch complete (57162 records). [2025-09-16T18:20:44.540820] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-09-16T18:20:44.932386] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-09-16T18:20:44.932483] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-09-16T18:20:44.933310] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-09-16T18:20:44.933364] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-09-16T18:20:44.934802] [DEBUG] [LOCAL ] ES: Trimmed 57162 records to 39171 (keeping 150 days of data) [2025-09-16T18:20:45.175398] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-09-16T18:20:45.185590] [DEBUG] [LOCAL ] ES: Primary data saved (39171 records). [2025-09-16T18:20:45.185776] [INFO ] [MAIN ] ES: Full history saved. [2025-09-16T18:20:45.185885] [INFO ] [MAIN ] Update Progress: 764/2369 symbols completed. ES took 28.7s. Estimated remaining: 2h 49m 32s. Rate: 9.5 symbols/min [2025-09-16T18:20:45.416734] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-16T18:20:45.418193] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:20:45.429494] [DEBUG] [LOCAL ] ESNT: No existing data file found in primary storage. [2025-09-16T18:20:45.429558] [WARN ] [MAIN ] ESNT: No existing data found, performing full refresh instead. [2025-09-16T18:20:45.430048] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-09-16T18:20:45.430090] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-09-16T18:20:45.430131] [DEBUG] [LOCAL ] ESNT: No primary data file found to delete. [2025-09-16T18:20:45.430165] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-09-16T18:20:45.818299] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-16T18:20:45.823844] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:20:45.974956] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-09-16T18:20:46.642914] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-16T18:20:46.774898] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-09-16T18:20:47.050132] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-16T18:20:47.574922] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-09-16T18:20:47.935173] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-16T18:20:47.938250] [INFO ] [REMOTE ] ESAB: Full fetch complete (27359 records). [2025-09-16T18:20:47.938338] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-09-16T18:20:47.938845] [FATAL] [VALIDATOR ] ESAB: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:20:47.938932] [FATAL] [MAIN ] ESAB: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:20:47.938999] [WARN ] [MAIN ] ESAB: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:20:47.939068] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-09-16T18:20:47.939137] [DEBUG] [LOCAL ] ESAB: No primary data file found to delete. [2025-09-16T18:20:47.939172] [INFO ] [LOCAL ] ESAB: Starting deletion of derivative data. [2025-09-16T18:20:47.939411] [DEBUG] [LOCAL ] ESAB: Deleted derivative data file. [2025-09-16T18:20:47.939500] [INFO ] [MAIN ] Update Progress: 765/2369 symbols completed. ESAB took 25.8s. Estimated remaining: 2h 49m 18s. Rate: 9.5 symbols/min [2025-09-16T18:20:48.118933] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:20:48.155779] [DEBUG] [LOCAL ] ESRT: Loaded 34095 existing records from primary storage. [2025-09-16T18:20:48.155925] [INFO ] [MAIN ] ESRT: Loaded 34095 existing records. [2025-09-16T18:20:48.332068] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:20:48.332322] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-09-16T18:20:48.332371] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-09-16T18:20:48.333022] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-09-16T18:20:48.333075] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-09-16T18:20:48.387105] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-09-16T18:20:48.695308] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:20:49.171950] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-16T18:20:49.186819] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-09-16T18:20:49.300301] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-16T18:20:49.974927] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-09-16T18:20:50.774949] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-09-16T18:20:50.841900] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-16T18:20:51.009590] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-16T18:20:51.574946] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-09-16T18:20:52.322098] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-16T18:20:52.374860] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-09-16T18:20:52.727748] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-16T18:20:52.730721] [INFO ] [REMOTE ] ESE: Full fetch complete (17819 records). [2025-09-16T18:20:52.730930] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-09-16T18:20:53.097340] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-09-16T18:20:53.097441] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-09-16T18:20:53.097888] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-09-16T18:20:53.097933] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-09-16T18:20:53.098549] [DEBUG] [LOCAL ] ESE: Trimmed 17819 records to 12263 (keeping 150 days of data) [2025-09-16T18:20:53.176878] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-09-16T18:20:53.182723] [DEBUG] [LOCAL ] ESE: Primary data saved (12263 records). [2025-09-16T18:20:53.183009] [INFO ] [MAIN ] ESE: Full history saved. [2025-09-16T18:20:53.183117] [INFO ] [MAIN ] Update Progress: 766/2369 symbols completed. ESE took 19.1s. Estimated remaining: 2h 49m 10s. Rate: 9.5 symbols/min [2025-09-16T18:20:53.352738] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:20:53.375209] [DEBUG] [LOCAL ] ESS: Loaded 21846 existing records from primary storage. [2025-09-16T18:20:53.375351] [INFO ] [MAIN ] ESS: Loaded 21846 existing records. [2025-09-16T18:20:53.556703] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:20:53.556945] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-09-16T18:20:53.557014] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-09-16T18:20:53.557824] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-09-16T18:20:53.557874] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-09-16T18:20:53.926450] [INFO ] [REMOTE ] ESS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:20:53.951539] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-16T18:20:53.974863] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-09-16T18:20:54.756508] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-16T18:20:54.774841] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-09-16T18:20:55.486893] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-16T18:20:55.574897] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-09-16T18:20:56.374948] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-09-16T18:20:56.598351] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-16T18:20:56.949770] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-16T18:20:57.174946] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-09-16T18:20:57.974944] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-09-16T18:20:58.031948] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-16T18:20:58.576334] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-16T18:20:58.774955] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-09-16T18:20:59.063495] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-16T18:20:59.574945] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-09-16T18:21:00.333677] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-16T18:21:00.374854] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-09-16T18:21:01.062634] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-16T18:21:01.174847] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-09-16T18:21:01.974912] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-09-16T18:21:02.135371] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-16T18:21:02.362670] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-16T18:21:02.774927] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-09-16T18:21:03.192337] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-16T18:21:03.574937] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-09-16T18:21:04.220536] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-16T18:21:04.374868] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-09-16T18:21:05.174859] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-09-16T18:21:05.272882] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-16T18:21:05.480310] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-16T18:21:05.974892] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-09-16T18:21:06.750042] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-16T18:21:06.774853] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-09-16T18:21:07.386751] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-16T18:21:07.574970] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-09-16T18:21:08.374923] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-09-16T18:21:08.497034] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-16T18:21:08.955497] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-16T18:21:09.174985] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-09-16T18:21:09.714876] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-16T18:21:09.724104] [INFO ] [REMOTE ] ESRT: Full fetch complete (50176 records). [2025-09-16T18:21:09.724428] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-09-16T18:21:09.983611] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-09-16T18:21:10.154263] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-09-16T18:21:10.154353] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-09-16T18:21:10.155141] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-09-16T18:21:10.155190] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-09-16T18:21:10.156297] [DEBUG] [LOCAL ] ESRT: Trimmed 50176 records to 34466 (keeping 150 days of data) [2025-09-16T18:21:10.363843] [DEBUG] [LOCAL ] ESRT: Primary data saved (34466 records). [2025-09-16T18:21:10.364018] [INFO ] [MAIN ] ESRT: Full history saved. [2025-09-16T18:21:10.364110] [INFO ] [MAIN ] Update Progress: 767/2369 symbols completed. ESRT took 22.4s. Estimated remaining: 2h 49m 26s. Rate: 9.5 symbols/min [2025-09-16T18:21:10.544514] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:21:10.580723] [DEBUG] [LOCAL ] ESTC: Loaded 37222 existing records from primary storage. [2025-09-16T18:21:10.580876] [INFO ] [MAIN ] ESTC: Loaded 37222 existing records. [2025-09-16T18:21:10.772241] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:21:10.778728] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-09-16T18:21:10.787541] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-09-16T18:21:10.788767] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-09-16T18:21:10.789866] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-16T18:21:10.793970] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-09-16T18:21:10.794544] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-09-16T18:21:10.799928] [INFO ] [REMOTE ] ESNT: Full fetch complete (42800 records). [2025-09-16T18:21:10.866453] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-09-16T18:21:11.444632] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:21:11.584760] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-09-16T18:21:11.585101] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-09-16T18:21:11.586472] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-09-16T18:21:11.588019] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-16T18:21:11.588967] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-09-16T18:21:11.598186] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-09-16T18:21:11.598530] [INFO ] [REMOTE ] ESI: Full fetch complete (55218 records). [2025-09-16T18:21:11.599062] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-09-16T18:21:11.600020] [DEBUG] [LOCAL ] ESNT: Trimmed 42800 records to 28016 (keeping 150 days of data) [2025-09-16T18:21:12.132159] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-09-16T18:21:12.132868] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-09-16T18:21:12.134540] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-09-16T18:21:12.134964] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-09-16T18:21:12.156604] [DEBUG] [LOCAL ] ESI: Trimmed 55218 records to 37431 (keeping 150 days of data) [2025-09-16T18:21:12.307859] [DEBUG] [LOCAL ] ESNT: Primary data saved (28016 records). [2025-09-16T18:21:12.315526] [INFO ] [MAIN ] ESNT: Full history saved. [2025-09-16T18:21:12.326212] [INFO ] [MAIN ] Update Progress: 768/2369 symbols completed. ESNT took 27.1s. Estimated remaining: 2h 49m 11s. Rate: 9.5 symbols/min [2025-09-16T18:21:12.350237] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-16T18:21:12.414278] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-09-16T18:21:12.550961] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:21:12.679156] [DEBUG] [LOCAL ] ET: Loaded 39750 existing records from primary storage. [2025-09-16T18:21:12.679802] [INFO ] [MAIN ] ET: Loaded 39750 existing records. [2025-09-16T18:21:12.874903] [WARN ] [MAIN ] ET: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:21:12.876399] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-09-16T18:21:12.877023] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-09-16T18:21:12.878107] [DEBUG] [LOCAL ] ET: Deleted primary data file. [2025-09-16T18:21:12.878684] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-09-16T18:21:13.219395] [DEBUG] [LOCAL ] ESI: Primary data saved (37431 records). [2025-09-16T18:21:13.240902] [INFO ] [MAIN ] ESI: Full history saved. [2025-09-16T18:21:13.273605] [INFO ] [MAIN ] Update Progress: 769/2369 symbols completed. ESI took 34.2s. Estimated remaining: 2h 48m 53s. Rate: 9.5 symbols/min [2025-09-16T18:21:13.278124] [INFO ] [REMOTE ] ET: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:21:13.342788] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-09-16T18:21:13.476336] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:21:13.476560] [DEBUG] [LOCAL ] ETB: No existing data file found in primary storage. [2025-09-16T18:21:13.476665] [WARN ] [MAIN ] ETB: No existing data found, performing full refresh instead. [2025-09-16T18:21:13.476926] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-09-16T18:21:13.477072] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-09-16T18:21:13.477146] [DEBUG] [LOCAL ] ETB: No primary data file found to delete. [2025-09-16T18:21:13.477258] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-09-16T18:21:13.698973] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-16T18:21:13.898061] [INFO ] [REMOTE ] ETB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:21:13.920003] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-16T18:21:13.974869] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-09-16T18:21:14.774923] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-09-16T18:21:15.174516] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-16T18:21:15.574911] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-09-16T18:21:15.750162] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (2.41 seconds). [2025-09-16T18:21:16.379969] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-09-16T18:21:16.397810] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-16T18:21:16.994969] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-16T18:21:17.174904] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-09-16T18:21:17.484403] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-16T18:21:17.974907] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-09-16T18:21:18.774896] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-09-16T18:21:19.448252] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-16T18:21:19.574913] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-09-16T18:21:19.592163] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-16T18:21:19.595881] [INFO ] [REMOTE ] ESS: Full fetch complete (32748 records). [2025-09-16T18:21:19.595963] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-09-16T18:21:19.812302] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-16T18:21:20.005055] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-09-16T18:21:20.005138] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-09-16T18:21:20.005703] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-09-16T18:21:20.005748] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-09-16T18:21:20.006500] [DEBUG] [LOCAL ] ESS: Trimmed 32748 records to 22109 (keeping 150 days of data) [2025-09-16T18:21:20.149487] [DEBUG] [LOCAL ] ESS: Primary data saved (22109 records). [2025-09-16T18:21:20.149630] [INFO ] [MAIN ] ESS: Full history saved. [2025-09-16T18:21:20.149752] [INFO ] [MAIN ] Update Progress: 770/2369 symbols completed. ESS took 27.0s. Estimated remaining: 2h 48m 48s. Rate: 9.5 symbols/min [2025-09-16T18:21:20.320095] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:21:20.339203] [DEBUG] [LOCAL ] ETD: Loaded 20372 existing records from primary storage. [2025-09-16T18:21:20.339353] [INFO ] [MAIN ] ETD: Loaded 20372 existing records. [2025-09-16T18:21:20.382270] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-09-16T18:21:20.518355] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:21:20.518599] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-09-16T18:21:20.518662] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-09-16T18:21:20.519238] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-09-16T18:21:20.519313] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-09-16T18:21:20.873720] [INFO ] [REMOTE ] ETD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:21:21.174902] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-09-16T18:21:21.271063] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-16T18:21:21.974878] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-09-16T18:21:22.065263] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-09-16T18:21:22.477627] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-16T18:21:22.774904] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-09-16T18:21:22.923533] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-16T18:21:23.574906] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-09-16T18:21:23.607868] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-16T18:21:24.374893] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-09-16T18:21:24.935374] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-16T18:21:25.174890] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-09-16T18:21:25.974898] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-09-16T18:21:26.446425] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-16T18:21:26.511680] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-16T18:21:26.774966] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-09-16T18:21:27.165537] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-16T18:21:27.574909] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-09-16T18:21:28.374922] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-09-16T18:21:28.419224] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-16T18:21:29.062012] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-16T18:21:29.063469] [INFO ] [REMOTE ] ETB: Full fetch complete (13729 records). [2025-09-16T18:21:29.063538] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-09-16T18:21:29.180084] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-09-16T18:21:29.425211] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-09-16T18:21:29.425293] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-09-16T18:21:29.425585] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-09-16T18:21:29.425627] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-09-16T18:21:29.426176] [DEBUG] [LOCAL ] ETB: Trimmed 13729 records to 8126 (keeping 150 days of data) [2025-09-16T18:21:29.479211] [DEBUG] [LOCAL ] ETB: Primary data saved (8126 records). [2025-09-16T18:21:29.479371] [INFO ] [MAIN ] ETB: Full history saved. [2025-09-16T18:21:29.479454] [INFO ] [MAIN ] Update Progress: 771/2369 symbols completed. ETB took 16.2s. Estimated remaining: 2h 48m 48s. Rate: 9.5 symbols/min [2025-09-16T18:21:29.664286] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:21:29.676989] [DEBUG] [LOCAL ] ETG: Loaded 12094 existing records from primary storage. [2025-09-16T18:21:29.677112] [INFO ] [MAIN ] ETG: Loaded 12094 existing records. [2025-09-16T18:21:29.851225] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:21:29.851504] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-09-16T18:21:29.851579] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-09-16T18:21:29.852076] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-09-16T18:21:29.852125] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-09-16T18:21:29.980077] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-09-16T18:21:30.208364] [INFO ] [REMOTE ] ETG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:21:30.747075] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (3.17 seconds). [2025-09-16T18:21:30.774846] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-09-16T18:21:31.141150] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-16T18:21:31.574894] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-09-16T18:21:31.881526] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-16T18:21:32.374902] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-09-16T18:21:32.515341] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-16T18:21:33.132810] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-16T18:21:33.174894] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-09-16T18:21:33.454418] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-16T18:21:33.974905] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-09-16T18:21:34.398605] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-16T18:21:34.774943] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-09-16T18:21:35.574912] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-09-16T18:21:35.995289] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-16T18:21:36.238115] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-16T18:21:36.374906] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-09-16T18:21:36.715827] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-16T18:21:37.174907] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-09-16T18:21:37.974863] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-09-16T18:21:38.105735] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-16T18:21:38.174314] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-16T18:21:38.588852] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-16T18:21:38.774909] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-09-16T18:21:39.574908] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-09-16T18:21:39.816229] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-16T18:21:40.374941] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-09-16T18:21:41.154697] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-16T18:21:41.160817] [INFO ] [REMOTE ] ESTC: Full fetch complete (54518 records). [2025-09-16T18:21:41.160917] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-09-16T18:21:41.182165] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-09-16T18:21:41.563713] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-09-16T18:21:41.563803] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-09-16T18:21:41.564681] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-09-16T18:21:41.564753] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-09-16T18:21:41.566032] [DEBUG] [LOCAL ] ESTC: Trimmed 54518 records to 37574 (keeping 150 days of data) [2025-09-16T18:21:41.789339] [DEBUG] [LOCAL ] ESTC: Primary data saved (37574 records). [2025-09-16T18:21:41.789518] [INFO ] [MAIN ] ESTC: Full history saved. [2025-09-16T18:21:41.789610] [INFO ] [MAIN ] Update Progress: 772/2369 symbols completed. ESTC took 31.4s. Estimated remaining: 2h 48m 54s. Rate: 9.5 symbols/min [2025-09-16T18:21:41.962431] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:21:41.973966] [DEBUG] [LOCAL ] ETJ: Loaded 10939 existing records from primary storage. [2025-09-16T18:21:41.974088] [INFO ] [MAIN ] ETJ: Loaded 10939 existing records. [2025-09-16T18:21:42.005786] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-09-16T18:21:42.160974] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:21:42.161915] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-09-16T18:21:42.161970] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-09-16T18:21:42.167776] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-09-16T18:21:42.177357] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-09-16T18:21:42.223479] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-16T18:21:42.555992] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-16T18:21:42.588022] [INFO ] [REMOTE ] ET: Full fetch complete (58080 records). [2025-09-16T18:21:42.592057] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:21:42.592274] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-09-16T18:21:42.593390] [FATAL] [VALIDATOR ] ET: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:21:42.593470] [FATAL] [MAIN ] ET: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:21:42.593507] [WARN ] [MAIN ] ET: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:21:42.593547] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-09-16T18:21:42.593604] [DEBUG] [LOCAL ] ET: No primary data file found to delete. [2025-09-16T18:21:42.593658] [INFO ] [LOCAL ] ET: Starting deletion of derivative data. [2025-09-16T18:21:42.593976] [DEBUG] [LOCAL ] ET: Deleted derivative data file. [2025-09-16T18:21:42.595248] [INFO ] [MAIN ] Update Progress: 773/2369 symbols completed. ET took 30.3s. Estimated remaining: 2h 48m 36s. Rate: 9.5 symbols/min [2025-09-16T18:21:42.762499] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:21:42.774941] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-09-16T18:21:42.802087] [DEBUG] [LOCAL ] ETN: Loaded 38883 existing records from primary storage. [2025-09-16T18:21:42.802226] [INFO ] [MAIN ] ETN: Loaded 38883 existing records. [2025-09-16T18:21:42.980287] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:21:42.992253] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-09-16T18:21:42.992332] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-09-16T18:21:42.992807] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-16T18:21:42.996829] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-09-16T18:21:42.996930] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-09-16T18:21:43.343712] [INFO ] [REMOTE ] ETN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:21:43.574848] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-09-16T18:21:43.619949] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-16T18:21:43.623799] [INFO ] [REMOTE ] ETD: Full fetch complete (29560 records). [2025-09-16T18:21:43.623885] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-09-16T18:21:43.998032] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-09-16T18:21:43.998117] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-09-16T18:21:43.998627] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-09-16T18:21:43.998689] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-09-16T18:21:43.999556] [DEBUG] [LOCAL ] ETD: Trimmed 29560 records to 20572 (keeping 150 days of data) [2025-09-16T18:21:44.125063] [DEBUG] [LOCAL ] ETD: Primary data saved (20572 records). [2025-09-16T18:21:44.125192] [INFO ] [MAIN ] ETD: Full history saved. [2025-09-16T18:21:44.125273] [INFO ] [MAIN ] Update Progress: 774/2369 symbols completed. ETD took 24.0s. Estimated remaining: 2h 48m 20s. Rate: 9.5 symbols/min [2025-09-16T18:21:44.301669] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:21:44.308673] [DEBUG] [LOCAL ] ETO: Loaded 4841 existing records from primary storage. [2025-09-16T18:21:44.308772] [INFO ] [MAIN ] ETO: Loaded 4841 existing records. [2025-09-16T18:21:44.384273] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-09-16T18:21:44.494046] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:21:44.494300] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-09-16T18:21:44.494354] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-09-16T18:21:44.494614] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-09-16T18:21:44.494691] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-09-16T18:21:44.854178] [INFO ] [REMOTE ] ETO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:21:45.174954] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-09-16T18:21:45.588462] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-16T18:21:45.608966] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-16T18:21:45.974953] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-09-16T18:21:46.030259] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-16T18:21:46.774920] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-09-16T18:21:47.001451] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-16T18:21:47.574942] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-09-16T18:21:47.673831] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-16T18:21:48.359823] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-16T18:21:48.374854] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-09-16T18:21:49.156319] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-16T18:21:49.174860] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-09-16T18:21:49.876771] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-16T18:21:49.974920] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-09-16T18:21:50.774868] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-09-16T18:21:50.783993] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-16T18:21:51.574922] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-09-16T18:21:52.374911] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-09-16T18:21:52.643252] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-16T18:21:52.910521] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-16T18:21:53.174937] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-09-16T18:21:53.699005] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-16T18:21:53.974945] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-09-16T18:21:54.774904] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-09-16T18:21:54.893060] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-16T18:21:54.895090] [INFO ] [REMOTE ] ETG: Full fetch complete (18297 records). [2025-09-16T18:21:54.895166] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-09-16T18:21:54.895736] [FATAL] [VALIDATOR ] ETG: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:21:54.895822] [FATAL] [MAIN ] ETG: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:21:54.895876] [WARN ] [MAIN ] ETG: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:21:54.895940] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-09-16T18:21:54.896006] [DEBUG] [LOCAL ] ETG: No primary data file found to delete. [2025-09-16T18:21:54.896043] [INFO ] [LOCAL ] ETG: Starting deletion of derivative data. [2025-09-16T18:21:54.896326] [DEBUG] [LOCAL ] ETG: Deleted derivative data file. [2025-09-16T18:21:54.896411] [INFO ] [MAIN ] Update Progress: 775/2369 symbols completed. ETG took 25.4s. Estimated remaining: 2h 48m 22s. Rate: 9.5 symbols/min [2025-09-16T18:21:55.075841] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:21:55.111961] [DEBUG] [LOCAL ] ETR: Loaded 39268 existing records from primary storage. [2025-09-16T18:21:55.112095] [INFO ] [MAIN ] ETR: Loaded 39268 existing records. [2025-09-16T18:21:55.286795] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:21:55.287008] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-09-16T18:21:55.287054] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-09-16T18:21:55.287894] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-09-16T18:21:55.287943] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-09-16T18:21:55.577700] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-09-16T18:21:55.646203] [INFO ] [REMOTE ] ETR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:21:55.657401] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-16T18:21:55.669827] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-16T18:21:56.374919] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-09-16T18:21:57.174907] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-09-16T18:21:57.974903] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-09-16T18:21:58.549678] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (2.97 seconds). [2025-09-16T18:21:58.588510] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-16T18:21:58.744073] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-09-16T18:21:58.745074] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-16T18:21:58.774852] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-09-16T18:21:59.240552] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-16T18:21:59.574904] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-09-16T18:22:00.367598] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-16T18:22:00.371194] [INFO ] [REMOTE ] ETJ: Full fetch complete (18385 records). [2025-09-16T18:22:00.371329] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-09-16T18:22:00.372064] [FATAL] [VALIDATOR ] ETJ: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:22:00.372167] [FATAL] [MAIN ] ETJ: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:22:00.372223] [WARN ] [MAIN ] ETJ: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:22:00.372281] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-09-16T18:22:00.372362] [DEBUG] [LOCAL ] ETJ: No primary data file found to delete. [2025-09-16T18:22:00.372417] [INFO ] [LOCAL ] ETJ: Starting deletion of derivative data. [2025-09-16T18:22:00.372713] [DEBUG] [LOCAL ] ETJ: Deleted derivative data file. [2025-09-16T18:22:00.372837] [INFO ] [MAIN ] Update Progress: 776/2369 symbols completed. ETJ took 18.6s. Estimated remaining: 2h 48m 14s. Rate: 9.5 symbols/min [2025-09-16T18:22:00.379962] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-09-16T18:22:00.558095] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:22:00.578035] [DEBUG] [LOCAL ] ETV: Loaded 14880 existing records from primary storage. [2025-09-16T18:22:00.578226] [INFO ] [MAIN ] ETV: Loaded 14880 existing records. [2025-09-16T18:22:00.759599] [WARN ] [MAIN ] ETV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:22:00.759907] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-09-16T18:22:00.759958] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-09-16T18:22:00.760464] [DEBUG] [LOCAL ] ETV: Deleted primary data file. [2025-09-16T18:22:00.760511] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-09-16T18:22:01.116061] [INFO ] [REMOTE ] ETV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:22:01.174862] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-09-16T18:22:01.974960] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-09-16T18:22:02.324188] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-16T18:22:02.541518] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-16T18:22:02.774974] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-09-16T18:22:03.574908] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-09-16T18:22:04.037279] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-16T18:22:04.258570] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-16T18:22:04.374918] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-09-16T18:22:04.651543] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-16T18:22:05.174886] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-09-16T18:22:05.974912] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-09-16T18:22:06.161975] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-16T18:22:06.605109] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-16T18:22:06.774886] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-09-16T18:22:06.858174] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-16T18:22:07.509397] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-16T18:22:07.510599] [INFO ] [REMOTE ] ETO: Full fetch complete (7153 records). [2025-09-16T18:22:07.510686] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-09-16T18:22:07.580022] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-09-16T18:22:07.875295] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-09-16T18:22:07.875371] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-09-16T18:22:07.875569] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-09-16T18:22:07.875623] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-09-16T18:22:07.876027] [DEBUG] [LOCAL ] ETO: Trimmed 7153 records to 4864 (keeping 150 days of data) [2025-09-16T18:22:07.906133] [DEBUG] [LOCAL ] ETO: Primary data saved (4864 records). [2025-09-16T18:22:07.906232] [INFO ] [MAIN ] ETO: Full history saved. [2025-09-16T18:22:07.906326] [INFO ] [MAIN ] Update Progress: 777/2369 symbols completed. ETO took 23.8s. Estimated remaining: 2h 48m 10s. Rate: 9.5 symbols/min [2025-09-16T18:22:08.105436] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:22:08.122568] [DEBUG] [LOCAL ] ETW: Loaded 17970 existing records from primary storage. [2025-09-16T18:22:08.122715] [INFO ] [MAIN ] ETW: Loaded 17970 existing records. [2025-09-16T18:22:08.303506] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:22:08.303808] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-09-16T18:22:08.303878] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-09-16T18:22:08.304371] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-09-16T18:22:08.304418] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-09-16T18:22:08.380094] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-09-16T18:22:08.662488] [INFO ] [REMOTE ] ETW: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:22:08.916135] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-16T18:22:09.174897] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-09-16T18:22:09.974916] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-09-16T18:22:10.179130] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-16T18:22:10.733510] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-09-16T18:22:10.774851] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-09-16T18:22:11.398189] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-16T18:22:11.574917] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-09-16T18:22:12.374921] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-09-16T18:22:12.740769] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-16T18:22:12.773518] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-16T18:22:13.174883] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-09-16T18:22:13.563299] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-16T18:22:13.974917] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-09-16T18:22:14.774973] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-09-16T18:22:15.366320] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-16T18:22:15.398578] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-16T18:22:15.404980] [INFO ] [REMOTE ] ETN: Full fetch complete (57547 records). [2025-09-16T18:22:15.405122] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-09-16T18:22:15.585273] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-09-16T18:22:15.799454] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-09-16T18:22:15.799578] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-09-16T18:22:15.800369] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-09-16T18:22:15.800425] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-09-16T18:22:15.801825] [DEBUG] [LOCAL ] ETN: Trimmed 57547 records to 39261 (keeping 150 days of data) [2025-09-16T18:22:15.918625] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-16T18:22:16.083985] [DEBUG] [LOCAL ] ETN: Primary data saved (39261 records). [2025-09-16T18:22:16.084146] [INFO ] [MAIN ] ETN: Full history saved. [2025-09-16T18:22:16.085047] [INFO ] [MAIN ] Update Progress: 778/2369 symbols completed. ETN took 33.5s. Estimated remaining: 2h 48m 8s. Rate: 9.5 symbols/min [2025-09-16T18:22:16.263354] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:22:16.263590] [DEBUG] [LOCAL ] ETX: No existing data file found in primary storage. [2025-09-16T18:22:16.263631] [WARN ] [MAIN ] ETX: No existing data found, performing full refresh instead. [2025-09-16T18:22:16.263805] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-09-16T18:22:16.263869] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-09-16T18:22:16.263948] [DEBUG] [LOCAL ] ETX: No primary data file found to delete. [2025-09-16T18:22:16.263999] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-09-16T18:22:16.380138] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-09-16T18:22:16.627725] [INFO ] [REMOTE ] ETX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:22:16.641349] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-16T18:22:17.174932] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-09-16T18:22:17.662709] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-16T18:22:17.974939] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-09-16T18:22:18.154273] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-16T18:22:18.156988] [INFO ] [REMOTE ] ETV: Full fetch complete (23277 records). [2025-09-16T18:22:18.157184] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-09-16T18:22:18.545934] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present. [2025-09-16T18:22:18.546013] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed. [2025-09-16T18:22:18.546463] [INFO ] [MAIN ] ETV: Fetched primary data is valid. [2025-09-16T18:22:18.546503] [DEBUG] [LOCAL ] ETV: Saving primary data. [2025-09-16T18:22:18.547119] [DEBUG] [LOCAL ] ETV: Trimmed 23277 records to 15040 (keeping 150 days of data) [2025-09-16T18:22:18.639259] [DEBUG] [LOCAL ] ETV: Primary data saved (15040 records). [2025-09-16T18:22:18.639390] [INFO ] [MAIN ] ETV: Full history saved. [2025-09-16T18:22:18.639473] [INFO ] [MAIN ] Update Progress: 779/2369 symbols completed. ETV took 18.3s. Estimated remaining: 2h 47m 54s. Rate: 9.5 symbols/min [2025-09-16T18:22:18.781003] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-09-16T18:22:18.812445] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:22:18.813571] [DEBUG] [LOCAL ] ETY: No existing data file found in primary storage. [2025-09-16T18:22:18.818391] [WARN ] [MAIN ] ETY: No existing data found, performing full refresh instead. [2025-09-16T18:22:18.819330] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-16T18:22:18.819446] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-09-16T18:22:18.821874] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-09-16T18:22:18.822142] [DEBUG] [LOCAL ] ETY: No primary data file found to delete. [2025-09-16T18:22:18.822241] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-09-16T18:22:19.181680] [INFO ] [REMOTE ] ETY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:22:19.575073] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-09-16T18:22:20.029661] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-16T18:22:20.374952] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-09-16T18:22:20.427390] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-16T18:22:21.174921] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-09-16T18:22:21.420055] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-16T18:22:21.703016] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-16T18:22:21.974897] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-09-16T18:22:22.347860] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-16T18:22:22.774940] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-09-16T18:22:23.574908] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-09-16T18:22:24.144337] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-16T18:22:24.374907] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-09-16T18:22:24.862101] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-16T18:22:25.174898] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-09-16T18:22:25.452933] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-16T18:22:25.974907] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-09-16T18:22:26.241326] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-16T18:22:26.600173] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-16T18:22:26.774900] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-09-16T18:22:27.574894] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-09-16T18:22:28.067434] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-16T18:22:28.070366] [INFO ] [REMOTE ] ETW: Full fetch complete (27081 records). [2025-09-16T18:22:28.070439] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-09-16T18:22:28.380033] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-09-16T18:22:28.457280] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-09-16T18:22:28.457380] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-09-16T18:22:28.458005] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-09-16T18:22:28.458066] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-09-16T18:22:28.459015] [DEBUG] [LOCAL ] ETW: Trimmed 27081 records to 18084 (keeping 150 days of data) [2025-09-16T18:22:28.569274] [DEBUG] [LOCAL ] ETW: Primary data saved (18084 records). [2025-09-16T18:22:28.569433] [INFO ] [MAIN ] ETW: Full history saved. [2025-09-16T18:22:28.569525] [INFO ] [MAIN ] Update Progress: 780/2369 symbols completed. ETW took 20.7s. Estimated remaining: 2h 47m 55s. Rate: 9.5 symbols/min [2025-09-16T18:22:28.750450] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:22:28.764780] [DEBUG] [LOCAL ] EVC: Loaded 13742 existing records from primary storage. [2025-09-16T18:22:28.764928] [INFO ] [MAIN ] EVC: Loaded 13742 existing records. [2025-09-16T18:22:28.951944] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:22:28.952241] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-09-16T18:22:28.952298] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-09-16T18:22:28.952744] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-09-16T18:22:28.952793] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-09-16T18:22:29.183740] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-09-16T18:22:29.328192] [INFO ] [REMOTE ] EVC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:22:29.392444] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-16T18:22:29.460497] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-16T18:22:29.974910] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-09-16T18:22:29.984954] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-16T18:22:30.774902] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-09-16T18:22:31.249017] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-16T18:22:31.528659] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-16T18:22:31.574855] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-09-16T18:22:32.271784] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-16T18:22:32.273131] [INFO ] [REMOTE ] ETX: Full fetch complete (5332 records). [2025-09-16T18:22:32.273203] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-09-16T18:22:32.379946] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-09-16T18:22:32.648745] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-09-16T18:22:32.648822] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-09-16T18:22:32.648978] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-09-16T18:22:32.649018] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-09-16T18:22:32.649409] [DEBUG] [LOCAL ] ETX: Trimmed 5332 records to 4122 (keeping 150 days of data) [2025-09-16T18:22:32.677552] [DEBUG] [LOCAL ] ETX: Primary data saved (4122 records). [2025-09-16T18:22:32.677656] [INFO ] [MAIN ] ETX: Full history saved. [2025-09-16T18:22:32.677726] [INFO ] [MAIN ] Update Progress: 781/2369 symbols completed. ETX took 16.6s. Estimated remaining: 2h 47m 44s. Rate: 9.5 symbols/min [2025-09-16T18:22:32.846845] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:22:32.871369] [DEBUG] [LOCAL ] EVEX: Loaded 22449 existing records from primary storage. [2025-09-16T18:22:32.871497] [INFO ] [MAIN ] EVEX: Loaded 22449 existing records. [2025-09-16T18:22:33.051247] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:22:33.051461] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-09-16T18:22:33.051534] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-09-16T18:22:33.052066] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-09-16T18:22:33.052127] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-09-16T18:22:33.179262] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-09-16T18:22:33.413155] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:22:33.639018] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-16T18:22:33.974908] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-09-16T18:22:34.297383] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-16T18:22:34.661946] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-16T18:22:34.774868] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-09-16T18:22:35.574870] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-09-16T18:22:35.789283] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-16T18:22:36.374867] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-09-16T18:22:36.727792] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-16T18:22:37.174890] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-09-16T18:22:37.621006] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-16T18:22:37.942040] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-16T18:22:37.974861] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-09-16T18:22:38.682194] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-16T18:22:38.774902] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-09-16T18:22:39.574903] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-09-16T18:22:40.202534] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-16T18:22:40.374893] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-09-16T18:22:41.098466] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-16T18:22:41.174904] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-09-16T18:22:41.952616] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-09-16T18:22:41.974876] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-09-16T18:22:42.115827] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-16T18:22:42.774896] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-09-16T18:22:43.286696] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-16T18:22:43.294466] [INFO ] [REMOTE ] ETR: Full fetch complete (57924 records). [2025-09-16T18:22:43.294603] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-09-16T18:22:43.580023] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-09-16T18:22:43.682170] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-09-16T18:22:43.682246] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-09-16T18:22:43.683009] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-09-16T18:22:43.683072] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-09-16T18:22:43.684228] [DEBUG] [LOCAL ] ETR: Trimmed 57924 records to 39652 (keeping 150 days of data) [2025-09-16T18:22:43.939577] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-16T18:22:43.956803] [DEBUG] [LOCAL ] ETR: Primary data saved (39652 records). [2025-09-16T18:22:43.956928] [INFO ] [MAIN ] ETR: Full history saved. [2025-09-16T18:22:43.957056] [INFO ] [MAIN ] Update Progress: 782/2369 symbols completed. ETR took 49.1s. Estimated remaining: 2h 47m 48s. Rate: 9.5 symbols/min [2025-09-16T18:22:44.134507] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:22:44.143152] [DEBUG] [LOCAL ] EVF: Loaded 6398 existing records from primary storage. [2025-09-16T18:22:44.143255] [INFO ] [MAIN ] EVF: Loaded 6398 existing records. [2025-09-16T18:22:44.329247] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:22:44.329541] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-09-16T18:22:44.329605] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-09-16T18:22:44.329914] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-09-16T18:22:44.329985] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-09-16T18:22:44.386162] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-09-16T18:22:44.633388] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-16T18:22:44.687184] [INFO ] [REMOTE ] ETY: Full fetch complete (25317 records). [2025-09-16T18:22:44.710768] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-09-16T18:22:44.715242] [INFO ] [REMOTE ] EVF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:22:45.094417] [DEBUG] [VALIDATOR ] ETY: All expected trading days are present. [2025-09-16T18:22:45.094522] [DEBUG] [VALIDATOR ] ETY: Primary data validation passed. [2025-09-16T18:22:45.095136] [INFO ] [MAIN ] ETY: Fetched primary data is valid. [2025-09-16T18:22:45.095184] [DEBUG] [LOCAL ] ETY: Saving primary data. [2025-09-16T18:22:45.096827] [DEBUG] [LOCAL ] ETY: Trimmed 25317 records to 16334 (keeping 150 days of data) [2025-09-16T18:22:45.175713] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-09-16T18:22:45.205625] [DEBUG] [LOCAL ] ETY: Primary data saved (16334 records). [2025-09-16T18:22:45.205803] [INFO ] [MAIN ] ETY: Full history saved. [2025-09-16T18:22:45.205895] [INFO ] [MAIN ] Update Progress: 783/2369 symbols completed. ETY took 26.6s. Estimated remaining: 2h 47m 31s. Rate: 9.5 symbols/min [2025-09-16T18:22:45.376670] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:22:45.392756] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-16T18:22:45.400683] [DEBUG] [LOCAL ] EVG: Loaded 4289 existing records from primary storage. [2025-09-16T18:22:45.401127] [INFO ] [MAIN ] EVG: Loaded 4289 existing records. [2025-09-16T18:22:45.574284] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:22:45.574528] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-09-16T18:22:45.574575] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-09-16T18:22:45.574963] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-09-16T18:22:45.575012] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-09-16T18:22:45.925617] [INFO ] [REMOTE ] EVG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:22:45.969324] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-16T18:22:45.974833] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-09-16T18:22:46.455069] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-16T18:22:46.774902] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-09-16T18:22:47.560780] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-16T18:22:47.574845] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-09-16T18:22:48.158253] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-16T18:22:48.374895] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-09-16T18:22:48.874597] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-16T18:22:49.174920] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-09-16T18:22:49.577602] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-16T18:22:49.974902] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-09-16T18:22:50.516152] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-16T18:22:50.774934] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-09-16T18:22:51.207452] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-16T18:22:51.574925] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-09-16T18:22:52.109534] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-16T18:22:52.374903] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-09-16T18:22:52.956308] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-16T18:22:53.174880] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-09-16T18:22:53.974923] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-09-16T18:22:54.032154] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-16T18:22:54.033669] [INFO ] [REMOTE ] EVF: Full fetch complete (9510 records). [2025-09-16T18:22:54.033740] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-09-16T18:22:54.399317] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-09-16T18:22:54.399395] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-09-16T18:22:54.399658] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-09-16T18:22:54.399703] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-09-16T18:22:54.400170] [DEBUG] [LOCAL ] EVF: Trimmed 9510 records to 6450 (keeping 150 days of data) [2025-09-16T18:22:54.437935] [DEBUG] [LOCAL ] EVF: Primary data saved (6450 records). [2025-09-16T18:22:54.438045] [INFO ] [MAIN ] EVF: Full history saved. [2025-09-16T18:22:54.438151] [INFO ] [MAIN ] Update Progress: 784/2369 symbols completed. EVF took 10.5s. Estimated remaining: 2h 47m 30s. Rate: 9.5 symbols/min [2025-09-16T18:22:54.609528] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:22:54.646242] [DEBUG] [LOCAL ] EVH: Loaded 36311 existing records from primary storage. [2025-09-16T18:22:54.646389] [INFO ] [MAIN ] EVH: Loaded 36311 existing records. [2025-09-16T18:22:54.780287] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-09-16T18:22:54.842472] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:22:54.842819] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-09-16T18:22:54.842889] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-09-16T18:22:54.843757] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-09-16T18:22:54.843810] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-09-16T18:22:55.204167] [INFO ] [REMOTE ] EVH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:22:55.395762] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-16T18:22:55.574999] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-09-16T18:22:55.951878] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-16T18:22:55.954504] [INFO ] [REMOTE ] EVC: Full fetch complete (21967 records). [2025-09-16T18:22:55.954602] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-09-16T18:22:55.955200] [FATAL] [VALIDATOR ] EVC: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:22:55.955305] [FATAL] [MAIN ] EVC: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:22:55.955376] [WARN ] [MAIN ] EVC: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:22:55.955452] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-09-16T18:22:55.955526] [DEBUG] [LOCAL ] EVC: No primary data file found to delete. [2025-09-16T18:22:55.955577] [INFO ] [LOCAL ] EVC: Starting deletion of derivative data. [2025-09-16T18:22:55.955942] [DEBUG] [LOCAL ] EVC: Deleted derivative data file. [2025-09-16T18:22:55.956069] [INFO ] [MAIN ] Update Progress: 785/2369 symbols completed. EVC took 27.4s. Estimated remaining: 2h 47m 14s. Rate: 9.5 symbols/min [2025-09-16T18:22:56.092225] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-16T18:22:56.148364] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:22:56.148675] [DEBUG] [LOCAL ] EVN: No existing data file found in primary storage. [2025-09-16T18:22:56.148720] [WARN ] [MAIN ] EVN: No existing data found, performing full refresh instead. [2025-09-16T18:22:56.148885] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-09-16T18:22:56.148930] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-09-16T18:22:56.148973] [DEBUG] [LOCAL ] EVN: No primary data file found to delete. [2025-09-16T18:22:56.149009] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-09-16T18:22:56.380111] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-09-16T18:22:56.568988] [INFO ] [REMOTE ] EVN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:22:57.174937] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-09-16T18:22:57.773470] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-16T18:22:57.794482] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-16T18:22:57.974990] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-09-16T18:22:58.422508] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-16T18:22:58.774954] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-09-16T18:22:59.574950] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-09-16T18:22:59.600880] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-16T18:23:00.374907] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-09-16T18:23:00.505057] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-16T18:23:00.782699] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-16T18:23:01.174931] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-09-16T18:23:01.974944] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-09-16T18:23:02.774913] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-09-16T18:23:03.574955] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-09-16T18:23:04.766383] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (2.79 seconds). [2025-09-16T18:23:04.768234] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-09-16T18:23:04.862616] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-16T18:23:05.174890] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-09-16T18:23:05.401584] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-16T18:23:05.565397] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-16T18:23:05.832721] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-16T18:23:05.965136] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (4.79 seconds). [2025-09-16T18:23:05.970355] [INFO ] [REMOTE ] EVEX: Full fetch complete (30554 records). [2025-09-16T18:23:05.970441] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-09-16T18:23:05.970975] [FATAL] [VALIDATOR ] EVEX: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:23:05.971056] [FATAL] [MAIN ] EVEX: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:23:05.971094] [WARN ] [MAIN ] EVEX: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:23:05.971191] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-09-16T18:23:05.971253] [DEBUG] [LOCAL ] EVEX: No primary data file found to delete. [2025-09-16T18:23:05.971288] [INFO ] [LOCAL ] EVEX: Starting deletion of derivative data. [2025-09-16T18:23:05.971576] [DEBUG] [LOCAL ] EVEX: Deleted derivative data file. [2025-09-16T18:23:05.971677] [INFO ] [MAIN ] Update Progress: 786/2369 symbols completed. EVEX took 33.3s. Estimated remaining: 2h 47m 16s. Rate: 9.5 symbols/min [2025-09-16T18:23:05.982586] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-09-16T18:23:06.150540] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:23:06.150745] [DEBUG] [LOCAL ] EVR: No existing data file found in primary storage. [2025-09-16T18:23:06.150786] [WARN ] [MAIN ] EVR: No existing data found, performing full refresh instead. [2025-09-16T18:23:06.150901] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-09-16T18:23:06.150939] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-09-16T18:23:06.150980] [DEBUG] [LOCAL ] EVR: No primary data file found to delete. [2025-09-16T18:23:06.151012] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-09-16T18:23:06.538864] [INFO ] [REMOTE ] EVR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:23:06.774895] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-09-16T18:23:07.284167] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-16T18:23:07.574947] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-09-16T18:23:08.234375] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-16T18:23:08.384085] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-09-16T18:23:08.386391] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-16T18:23:09.043610] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-16T18:23:09.174919] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-09-16T18:23:09.974916] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-09-16T18:23:10.728769] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-16T18:23:10.774914] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-09-16T18:23:10.821723] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-16T18:23:11.574901] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-09-16T18:23:12.375913] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-09-16T18:23:12.378224] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-16T18:23:13.174867] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-09-16T18:23:13.280934] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-16T18:23:13.303608] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-16T18:23:13.961871] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-16T18:23:13.963174] [INFO ] [REMOTE ] EVG: Full fetch complete (6205 records). [2025-09-16T18:23:13.963242] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-09-16T18:23:13.984341] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-09-16T18:23:14.332185] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-09-16T18:23:14.332264] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-09-16T18:23:14.332450] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-09-16T18:23:14.332492] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-09-16T18:23:14.332901] [DEBUG] [LOCAL ] EVG: Trimmed 6205 records to 4332 (keeping 150 days of data) [2025-09-16T18:23:14.360633] [DEBUG] [LOCAL ] EVG: Primary data saved (4332 records). [2025-09-16T18:23:14.360734] [INFO ] [MAIN ] EVG: Full history saved. [2025-09-16T18:23:14.360815] [INFO ] [MAIN ] Update Progress: 787/2369 symbols completed. EVG took 29.2s. Estimated remaining: 2h 47m 13s. Rate: 9.5 symbols/min [2025-09-16T18:23:14.532987] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:23:14.547388] [DEBUG] [LOCAL ] EVT: Loaded 12619 existing records from primary storage. [2025-09-16T18:23:14.547505] [INFO ] [MAIN ] EVT: Loaded 12619 existing records. [2025-09-16T18:23:14.745185] [WARN ] [MAIN ] EVT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:23:14.745485] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-09-16T18:23:14.745551] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-09-16T18:23:14.746135] [DEBUG] [LOCAL ] EVT: Deleted primary data file. [2025-09-16T18:23:14.746207] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-09-16T18:23:14.781335] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-09-16T18:23:14.996496] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-16T18:23:15.066746] [INFO ] [REMOTE ] EVN: Full fetch complete (12037 records). [2025-09-16T18:23:15.066955] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-09-16T18:23:15.520929] [INFO ] [REMOTE ] EVT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:23:15.578940] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-09-16T18:23:15.770430] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-09-16T18:23:15.770526] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-09-16T18:23:15.770948] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-09-16T18:23:15.770996] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-09-16T18:23:15.771537] [DEBUG] [LOCAL ] EVN: Trimmed 12037 records to 7786 (keeping 150 days of data) [2025-09-16T18:23:15.824046] [DEBUG] [LOCAL ] EVN: Primary data saved (7786 records). [2025-09-16T18:23:15.824213] [INFO ] [MAIN ] EVN: Full history saved. [2025-09-16T18:23:15.824298] [INFO ] [MAIN ] Update Progress: 788/2369 symbols completed. EVN took 19.9s. Estimated remaining: 2h 46m 57s. Rate: 9.5 symbols/min [2025-09-16T18:23:16.003065] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:23:16.023813] [DEBUG] [LOCAL ] EVTC: Loaded 19286 existing records from primary storage. [2025-09-16T18:23:16.023991] [INFO ] [MAIN ] EVTC: Loaded 19286 existing records. [2025-09-16T18:23:16.206568] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:23:16.206966] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-09-16T18:23:16.207089] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-09-16T18:23:16.207692] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-09-16T18:23:16.207821] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-09-16T18:23:16.359590] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-16T18:23:16.389573] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-09-16T18:23:16.624291] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:23:16.799724] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-16T18:23:17.174909] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-09-16T18:23:17.678252] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-16T18:23:17.974910] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-09-16T18:23:18.006622] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-16T18:23:18.774906] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-09-16T18:23:19.431398] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-16T18:23:19.574883] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-09-16T18:23:19.669483] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-16T18:23:20.374877] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-09-16T18:23:20.786180] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-16T18:23:21.174885] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-09-16T18:23:21.214588] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-16T18:23:21.974899] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-09-16T18:23:22.652088] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-16T18:23:22.774880] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-09-16T18:23:23.143759] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-16T18:23:23.574906] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-09-16T18:23:24.374861] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-09-16T18:23:24.445780] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-16T18:23:24.991348] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-16T18:23:25.174893] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-09-16T18:23:25.208128] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-16T18:23:25.974878] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-09-16T18:23:26.080506] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-16T18:23:26.774906] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-09-16T18:23:27.353891] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-16T18:23:27.574877] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-09-16T18:23:27.779570] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-16T18:23:27.784983] [INFO ] [REMOTE ] EVH: Full fetch complete (53367 records). [2025-09-16T18:23:27.785094] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-09-16T18:23:27.785784] [FATAL] [VALIDATOR ] EVH: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:23:27.785863] [FATAL] [MAIN ] EVH: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:23:27.785901] [WARN ] [MAIN ] EVH: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:23:27.785951] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-09-16T18:23:27.786014] [DEBUG] [LOCAL ] EVH: No primary data file found to delete. [2025-09-16T18:23:27.786052] [INFO ] [LOCAL ] EVH: Starting deletion of derivative data. [2025-09-16T18:23:27.786335] [DEBUG] [LOCAL ] EVH: Deleted derivative data file. [2025-09-16T18:23:27.786416] [INFO ] [MAIN ] Update Progress: 789/2369 symbols completed. EVH took 33.3s. Estimated remaining: 2h 47m 2s. Rate: 9.5 symbols/min [2025-09-16T18:23:27.964370] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:23:27.992398] [DEBUG] [LOCAL ] EVTL: Loaded 29727 existing records from primary storage. [2025-09-16T18:23:27.992559] [INFO ] [MAIN ] EVTL: Loaded 29727 existing records. [2025-09-16T18:23:28.174585] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:23:28.174850] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-09-16T18:23:28.174897] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-09-16T18:23:28.175675] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-09-16T18:23:28.175727] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-09-16T18:23:28.383496] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-09-16T18:23:28.546993] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:23:29.174882] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-09-16T18:23:29.205393] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-16T18:23:29.642225] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-16T18:23:29.974894] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-09-16T18:23:30.774874] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-09-16T18:23:30.814919] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-16T18:23:30.982275] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-16T18:23:31.574868] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-09-16T18:23:31.835307] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-16T18:23:32.374870] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-09-16T18:23:32.707735] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-16T18:23:33.174880] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-09-16T18:23:33.625938] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-16T18:23:33.974884] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-09-16T18:23:34.253686] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-16T18:23:34.774883] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-09-16T18:23:34.982874] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-16T18:23:34.985291] [INFO ] [REMOTE ] EVT: Full fetch complete (19236 records). [2025-09-16T18:23:34.985365] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-09-16T18:23:35.363174] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present. [2025-09-16T18:23:35.363264] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed. [2025-09-16T18:23:35.363745] [INFO ] [MAIN ] EVT: Fetched primary data is valid. [2025-09-16T18:23:35.363794] [DEBUG] [LOCAL ] EVT: Saving primary data. [2025-09-16T18:23:35.364383] [DEBUG] [LOCAL ] EVT: Trimmed 19236 records to 12703 (keeping 150 days of data) [2025-09-16T18:23:35.441834] [DEBUG] [LOCAL ] EVT: Primary data saved (12703 records). [2025-09-16T18:23:35.441979] [INFO ] [MAIN ] EVT: Full history saved. [2025-09-16T18:23:35.442064] [INFO ] [MAIN ] Update Progress: 790/2369 symbols completed. EVT took 21.1s. Estimated remaining: 2h 46m 58s. Rate: 9.5 symbols/min [2025-09-16T18:23:35.588022] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-09-16T18:23:35.621440] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:23:35.639086] [DEBUG] [LOCAL ] EVTR: Loaded 17176 existing records from primary storage. [2025-09-16T18:23:35.639230] [INFO ] [MAIN ] EVTR: Loaded 17176 existing records. [2025-09-16T18:23:35.822000] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:23:35.822307] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-09-16T18:23:35.822357] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-09-16T18:23:35.822896] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-09-16T18:23:35.822947] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-09-16T18:23:36.196459] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:23:36.287346] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-16T18:23:36.291275] [INFO ] [REMOTE ] EVR: Full fetch complete (39342 records). [2025-09-16T18:23:36.291373] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-09-16T18:23:36.379968] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-09-16T18:23:36.683911] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-09-16T18:23:36.684023] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-09-16T18:23:36.684860] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-09-16T18:23:36.684928] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-09-16T18:23:36.686048] [DEBUG] [LOCAL ] EVR: Trimmed 39342 records to 25174 (keeping 150 days of data) [2025-09-16T18:23:36.865027] [DEBUG] [LOCAL ] EVR: Primary data saved (25174 records). [2025-09-16T18:23:36.865466] [INFO ] [MAIN ] EVR: Full history saved. [2025-09-16T18:23:36.866013] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-16T18:23:36.866122] [INFO ] [MAIN ] Update Progress: 791/2369 symbols completed. EVR took 30.9s. Estimated remaining: 2h 46m 42s. Rate: 9.5 symbols/min [2025-09-16T18:23:37.046963] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:23:37.087609] [DEBUG] [LOCAL ] EW: Loaded 39389 existing records from primary storage. [2025-09-16T18:23:37.087807] [INFO ] [MAIN ] EW: Loaded 39389 existing records. [2025-09-16T18:23:37.180051] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-09-16T18:23:37.266346] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:23:37.266579] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-09-16T18:23:37.266624] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-09-16T18:23:37.267483] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-09-16T18:23:37.267535] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-09-16T18:23:37.630287] [INFO ] [REMOTE ] EW: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:23:37.671341] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-16T18:23:37.974877] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-09-16T18:23:38.122048] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-16T18:23:38.774932] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-09-16T18:23:39.574881] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-09-16T18:23:39.724503] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-16T18:23:39.879504] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-16T18:23:40.374948] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-09-16T18:23:41.174871] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-09-16T18:23:41.258791] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-16T18:23:41.582282] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-16T18:23:41.586075] [INFO ] [REMOTE ] EVTC: Full fetch complete (28984 records). [2025-09-16T18:23:41.586173] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-09-16T18:23:41.966450] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-09-16T18:23:41.966544] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-09-16T18:23:41.967096] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-09-16T18:23:41.967213] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-09-16T18:23:41.980403] [DEBUG] [LOCAL ] EVTC: Trimmed 28984 records to 19478 (keeping 150 days of data) [2025-09-16T18:23:41.980204] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-09-16T18:23:41.981695] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-16T18:23:42.109850] [DEBUG] [LOCAL ] EVTC: Primary data saved (19478 records). [2025-09-16T18:23:42.110011] [INFO ] [MAIN ] EVTC: Full history saved. [2025-09-16T18:23:42.110098] [INFO ] [MAIN ] Update Progress: 792/2369 symbols completed. EVTC took 26.3s. Estimated remaining: 2h 46m 34s. Rate: 9.5 symbols/min [2025-09-16T18:23:42.284094] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:23:42.284285] [DEBUG] [LOCAL ] EXG: No existing data file found in primary storage. [2025-09-16T18:23:42.284322] [WARN ] [MAIN ] EXG: No existing data found, performing full refresh instead. [2025-09-16T18:23:42.284485] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-09-16T18:23:42.284526] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-09-16T18:23:42.284568] [DEBUG] [LOCAL ] EXG: No primary data file found to delete. [2025-09-16T18:23:42.284602] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-09-16T18:23:42.655035] [INFO ] [REMOTE ] EXG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:23:42.774903] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-09-16T18:23:43.529228] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-16T18:23:43.574906] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-09-16T18:23:44.146451] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-16T18:23:44.374906] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-09-16T18:23:44.537727] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-16T18:23:45.174896] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-09-16T18:23:45.974903] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-09-16T18:23:46.241580] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-16T18:23:46.542836] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-16T18:23:46.774927] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-09-16T18:23:47.492926] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-16T18:23:47.519232] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-16T18:23:47.574908] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-09-16T18:23:48.374912] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-09-16T18:23:48.940890] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-16T18:23:49.174914] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-09-16T18:23:49.701862] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-16T18:23:49.974934] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-09-16T18:23:50.062482] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-16T18:23:50.067122] [INFO ] [REMOTE ] EVTR: Full fetch complete (24548 records). [2025-09-16T18:23:50.067230] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-09-16T18:23:50.438291] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-09-16T18:23:50.438390] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-09-16T18:23:50.439016] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-09-16T18:23:50.439064] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-09-16T18:23:50.440350] [DEBUG] [LOCAL ] EVTR: Trimmed 24548 records to 17483 (keeping 150 days of data) [2025-09-16T18:23:50.545997] [DEBUG] [LOCAL ] EVTR: Primary data saved (17483 records). [2025-09-16T18:23:50.546133] [INFO ] [MAIN ] EVTR: Full history saved. [2025-09-16T18:23:50.546226] [INFO ] [MAIN ] Update Progress: 793/2369 symbols completed. EVTR took 15.1s. Estimated remaining: 2h 46m 32s. Rate: 9.5 symbols/min [2025-09-16T18:23:50.718967] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:23:50.719162] [DEBUG] [LOCAL ] EXK: No existing data file found in primary storage. [2025-09-16T18:23:50.719199] [WARN ] [MAIN ] EXK: No existing data found, performing full refresh instead. [2025-09-16T18:23:50.719321] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-09-16T18:23:50.719359] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-09-16T18:23:50.719400] [DEBUG] [LOCAL ] EXK: No primary data file found to delete. [2025-09-16T18:23:50.719433] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-09-16T18:23:50.781902] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-09-16T18:23:51.092021] [INFO ] [REMOTE ] EXK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:23:51.112090] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-16T18:23:51.574904] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-09-16T18:23:52.374929] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-09-16T18:23:52.588708] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-16T18:23:52.988300] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-16T18:23:53.174952] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-09-16T18:23:53.305323] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-16T18:23:53.974904] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-09-16T18:23:54.547323] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-16T18:23:54.774923] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-09-16T18:23:55.574946] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-09-16T18:23:56.257493] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-16T18:23:56.374900] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-09-16T18:23:57.174934] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-09-16T18:23:57.738246] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-16T18:23:57.974946] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-09-16T18:24:03.648359] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (8.07 seconds). [2025-09-16T18:24:03.654066] [INFO ] [REMOTE ] EVTL: Full fetch complete (39307 records). [2025-09-16T18:24:03.654189] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-09-16T18:24:04.055994] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-09-16T18:24:04.056072] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-09-16T18:24:04.056810] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-09-16T18:24:04.056864] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-09-16T18:24:04.057812] [DEBUG] [LOCAL ] EVTL: Trimmed 39307 records to 30107 (keeping 150 days of data) [2025-09-16T18:24:04.225392] [DEBUG] [LOCAL ] EVTL: Primary data saved (30107 records). [2025-09-16T18:24:04.225538] [INFO ] [MAIN ] EVTL: Full history saved. [2025-09-16T18:24:04.225624] [INFO ] [MAIN ] Update Progress: 794/2369 symbols completed. EVTL took 36.4s. Estimated remaining: 2h 46m 40s. Rate: 9.5 symbols/min [2025-09-16T18:24:04.394397] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:24:04.414941] [DEBUG] [LOCAL ] EXP: Loaded 21794 existing records from primary storage. [2025-09-16T18:24:04.415076] [INFO ] [MAIN ] EXP: Loaded 21794 existing records. [2025-09-16T18:24:04.594902] [WARN ] [MAIN ] EXP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:24:04.595200] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-09-16T18:24:04.595260] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-09-16T18:24:04.595986] [DEBUG] [LOCAL ] EXP: Deleted primary data file. [2025-09-16T18:24:04.596037] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-09-16T18:24:04.945700] [INFO ] [REMOTE ] EXP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:24:04.945994] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-09-16T18:24:05.983258] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-16T18:24:05.989210] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-09-16T18:24:06.798990] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (9.62 seconds). [2025-09-16T18:24:06.808456] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-09-16T18:24:06.971260] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (13.00 seconds). [2025-09-16T18:24:06.982400] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-09-16T18:24:07.828179] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-16T18:24:07.838109] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-09-16T18:24:08.677360] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-16T18:24:08.689489] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-09-16T18:24:10.129636] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-16T18:24:10.140333] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-09-16T18:24:10.721564] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (2.88 seconds). [2025-09-16T18:24:10.727295] [INFO ] [REMOTE ] EXG: Full fetch complete (37741 records). [2025-09-16T18:24:10.727405] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-09-16T18:24:11.123470] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-09-16T18:24:11.125874] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-09-16T18:24:11.126871] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-09-16T18:24:11.127120] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-09-16T18:24:11.128832] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (5.14 seconds). [2025-09-16T18:24:11.136773] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-09-16T18:24:11.137132] [DEBUG] [LOCAL ] EXG: Trimmed 37741 records to 25052 (keeping 150 days of data) [2025-09-16T18:24:11.286494] [DEBUG] [LOCAL ] EXG: Primary data saved (25052 records). [2025-09-16T18:24:11.286652] [INFO ] [MAIN ] EXG: Full history saved. [2025-09-16T18:24:11.286733] [INFO ] [MAIN ] Update Progress: 795/2369 symbols completed. EXG took 29.2s. Estimated remaining: 2h 46m 35s. Rate: 9.4 symbols/min [2025-09-16T18:24:11.454569] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:24:11.494044] [DEBUG] [LOCAL ] EXPD: Loaded 35289 existing records from primary storage. [2025-09-16T18:24:11.494193] [INFO ] [MAIN ] EXPD: Loaded 35289 existing records. [2025-09-16T18:24:11.674845] [WARN ] [MAIN ] EXPD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:24:11.675142] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-09-16T18:24:11.675192] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-09-16T18:24:11.675999] [DEBUG] [LOCAL ] EXPD: Deleted primary data file. [2025-09-16T18:24:11.676058] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-09-16T18:24:12.009327] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (14.03 seconds). [2025-09-16T18:24:12.080867] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:24:12.082118] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-09-16T18:24:12.082545] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-09-16T18:24:12.119569] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-16T18:24:12.132071] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-09-16T18:24:12.400931] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-16T18:24:12.408010] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-09-16T18:24:13.247633] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-16T18:24:13.259437] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-09-16T18:24:13.388717] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-16T18:24:13.398379] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-09-16T18:24:13.498131] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-16T18:24:13.507456] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-09-16T18:24:13.810326] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-16T18:24:13.821870] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-09-16T18:24:14.396862] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-16T18:24:14.403760] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-09-16T18:24:14.513330] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-16T18:24:14.519879] [INFO ] [REMOTE ] EW: Full fetch complete (58063 records). [2025-09-16T18:24:14.520005] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-09-16T18:24:14.935626] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-09-16T18:24:14.935867] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-09-16T18:24:14.936827] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-09-16T18:24:14.937016] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-09-16T18:24:14.938664] [DEBUG] [LOCAL ] EW: Trimmed 58063 records to 39779 (keeping 150 days of data) [2025-09-16T18:24:15.061661] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-16T18:24:15.075943] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-09-16T18:24:15.223506] [DEBUG] [LOCAL ] EW: Primary data saved (39779 records). [2025-09-16T18:24:15.223692] [INFO ] [MAIN ] EW: Full history saved. [2025-09-16T18:24:15.224774] [INFO ] [MAIN ] Update Progress: 796/2369 symbols completed. EW took 38.4s. Estimated remaining: 2h 46m 24s. Rate: 9.5 symbols/min [2025-09-16T18:24:15.401872] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:24:15.439476] [DEBUG] [LOCAL ] EXR: Loaded 33469 existing records from primary storage. [2025-09-16T18:24:15.439818] [INFO ] [MAIN ] EXR: Loaded 33469 existing records. [2025-09-16T18:24:15.575904] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-16T18:24:15.613788] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-09-16T18:24:15.664894] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:24:15.665123] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-09-16T18:24:15.665187] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-09-16T18:24:15.665990] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-09-16T18:24:15.666049] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-09-16T18:24:16.019207] [INFO ] [REMOTE ] EXR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:24:16.019532] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-09-16T18:24:16.497319] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-16T18:24:16.505138] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-09-16T18:24:17.019670] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-16T18:24:17.025500] [INFO ] [REMOTE ] EXK: Full fetch complete (57224 records). [2025-09-16T18:24:17.025600] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-09-16T18:24:17.026306] [FATAL] [VALIDATOR ] EXK: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:24:17.026383] [FATAL] [MAIN ] EXK: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:24:17.026420] [WARN ] [MAIN ] EXK: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:24:17.026458] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-09-16T18:24:17.026515] [DEBUG] [LOCAL ] EXK: No primary data file found to delete. [2025-09-16T18:24:17.026551] [INFO ] [LOCAL ] EXK: Starting deletion of derivative data. [2025-09-16T18:24:17.026590] [DEBUG] [LOCAL ] EXK: No derivative data file found to delete. [2025-09-16T18:24:17.026688] [INFO ] [MAIN ] Update Progress: 797/2369 symbols completed. EXK took 26.5s. Estimated remaining: 2h 46m 8s. Rate: 9.5 symbols/min [2025-09-16T18:24:17.094465] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-16T18:24:17.104923] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-09-16T18:24:17.455336] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-16T18:24:17.465398] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-09-16T18:24:17.584389] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-16T18:24:17.591045] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-09-16T18:24:18.826226] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-16T18:24:18.837210] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-09-16T18:24:18.846747] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-16T18:24:18.850481] [INFO ] [REMOTE ] EXP: Full fetch complete (32680 records). [2025-09-16T18:24:18.850630] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-09-16T18:24:18.851228] [FATAL] [VALIDATOR ] EXP: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:24:18.851359] [FATAL] [MAIN ] EXP: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:24:18.851406] [WARN ] [MAIN ] EXP: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:24:18.860986] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-09-16T18:24:18.877215] [DEBUG] [LOCAL ] EXP: No primary data file found to delete. [2025-09-16T18:24:18.877307] [INFO ] [LOCAL ] EXP: Starting deletion of derivative data. [2025-09-16T18:24:18.879031] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-16T18:24:18.879074] [DEBUG] [LOCAL ] EXP: Deleted derivative data file. [2025-09-16T18:24:18.888391] [INFO ] [MAIN ] Update Progress: 798/2369 symbols completed. EXP took 14.7s. Estimated remaining: 2h 45m 53s. Rate: 9.5 symbols/min [2025-09-16T18:24:18.889284] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-09-16T18:24:20.418066] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-16T18:24:20.428087] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-09-16T18:24:20.474412] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-16T18:24:20.484798] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-09-16T18:24:22.113887] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-16T18:24:22.123562] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-09-16T18:24:22.203894] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-16T18:24:22.214724] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-09-16T18:24:23.193010] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-16T18:24:23.202401] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-09-16T18:24:23.941169] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-16T18:24:23.951510] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-09-16T18:24:24.907762] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-16T18:24:24.917808] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-09-16T18:24:25.387718] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-16T18:24:25.393701] [INFO ] [REMOTE ] EXPD: Full fetch complete (52515 records). [2025-09-16T18:24:25.393880] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-09-16T18:24:25.788966] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-09-16T18:24:25.789119] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-09-16T18:24:25.789864] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-09-16T18:24:25.789912] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-09-16T18:24:25.791147] [DEBUG] [LOCAL ] EXPD: Trimmed 52515 records to 35628 (keeping 150 days of data) [2025-09-16T18:24:26.013657] [DEBUG] [LOCAL ] EXPD: Primary data saved (35628 records). [2025-09-16T18:24:26.013813] [INFO ] [MAIN ] EXPD: Full history saved. [2025-09-16T18:24:26.013919] [INFO ] [MAIN ] Update Progress: 799/2369 symbols completed. EXPD took 14.7s. Estimated remaining: 2h 45m 48s. Rate: 9.5 symbols/min [2025-09-16T18:24:26.500320] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-16T18:24:26.510626] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-09-16T18:24:28.046022] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-16T18:24:28.052007] [INFO ] [REMOTE ] EXR: Full fetch complete (49591 records). [2025-09-16T18:24:28.052187] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-09-16T18:24:28.428086] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-09-16T18:24:28.428164] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-09-16T18:24:28.428934] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-09-16T18:24:28.428981] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-09-16T18:24:28.430025] [DEBUG] [LOCAL ] EXR: Trimmed 49591 records to 33814 (keeping 150 days of data) [2025-09-16T18:24:28.642986] [DEBUG] [LOCAL ] EXR: Primary data saved (33814 records). [2025-09-16T18:24:28.643136] [INFO ] [MAIN ] EXR: Full history saved. [2025-09-16T18:24:28.647097] [INFO ] [MAIN ] Update Progress: 800/2369 symbols completed. EXR took 13.4s. Estimated remaining: 2h 45m 35s. Rate: 9.5 symbols/min [2025-09-16T18:24:29.244148] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:24:29.274124] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:24:29.327390] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:24:29.325350] [DEBUG] [LOCAL ] FBK: No existing data file found in primary storage. [2025-09-16T18:24:29.335706] [WARN ] [MAIN ] FBK: No existing data found, performing full refresh instead. [2025-09-16T18:24:29.354261] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:24:29.354873] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-09-16T18:24:29.355213] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-09-16T18:24:29.355269] [DEBUG] [LOCAL ] FBK: No primary data file found to delete. [2025-09-16T18:24:29.355304] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-09-16T18:24:29.677663] [DEBUG] [LOCAL ] F: Loaded 39780 existing records from primary storage. [2025-09-16T18:24:29.676681] [DEBUG] [LOCAL ] FAF: Loaded 31072 existing records from primary storage. [2025-09-16T18:24:29.698721] [INFO ] [MAIN ] F: Loaded 39780 existing records. [2025-09-16T18:24:29.698666] [INFO ] [MAIN ] FAF: Loaded 31072 existing records. [2025-09-16T18:24:29.709667] [DEBUG] [LOCAL ] FBIN: Loaded 37347 existing records from primary storage. [2025-09-16T18:24:29.806567] [INFO ] [MAIN ] FBIN: Loaded 37347 existing records. [2025-09-16T18:24:30.072481] [INFO ] [REMOTE ] FBK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:24:30.117427] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-09-16T18:24:30.225607] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:24:30.360340] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-09-16T18:24:30.365993] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:24:30.369884] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-09-16T18:24:30.375323] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-09-16T18:24:30.375238] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:24:30.375458] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-09-16T18:24:30.375828] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-09-16T18:24:30.376082] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-09-16T18:24:30.376873] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-09-16T18:24:30.376950] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-09-16T18:24:30.388599] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-09-16T18:24:30.388802] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-09-16T18:24:30.441368] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-09-16T18:24:30.446867] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-09-16T18:24:31.332892] [INFO ] [REMOTE ] FAF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:24:31.350288] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-09-16T18:24:31.507966] [INFO ] [REMOTE ] F: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:24:31.530128] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-09-16T18:24:31.568029] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:24:31.575566] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-09-16T18:24:31.584407] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-16T18:24:31.588806] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-09-16T18:24:32.573896] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-16T18:24:32.578432] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-09-16T18:24:32.914811] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-16T18:24:32.921563] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-09-16T18:24:33.307806] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-16T18:24:33.317696] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-09-16T18:24:33.666531] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-09-16T18:24:33.676659] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-09-16T18:24:33.980535] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-16T18:24:33.987180] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-09-16T18:24:34.098609] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-16T18:24:34.107279] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-09-16T18:24:35.081709] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-16T18:24:35.092210] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-09-16T18:24:35.105530] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-16T18:24:35.580000] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-09-16T18:24:35.594507] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-16T18:24:35.707658] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-16T18:24:36.374864] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-09-16T18:24:36.549487] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-16T18:24:36.777132] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-16T18:24:37.174898] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-09-16T18:24:37.974909] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-09-16T18:24:38.697469] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-16T18:24:38.746851] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-16T18:24:38.774863] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-09-16T18:24:39.574923] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-09-16T18:24:39.691990] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-16T18:24:39.885934] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-16T18:24:40.374915] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-09-16T18:24:41.057635] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-16T18:24:41.174881] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-09-16T18:24:41.587020] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-16T18:24:41.974930] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-09-16T18:24:42.229802] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-16T18:24:42.774915] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-09-16T18:24:43.574905] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-09-16T18:24:44.312904] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-09-16T18:24:44.374903] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-09-16T18:24:44.450626] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-16T18:24:44.594135] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-16T18:24:44.597423] [INFO ] [REMOTE ] FBK: Full fetch complete (26441 records). [2025-09-16T18:24:44.597556] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-09-16T18:24:44.967698] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-09-16T18:24:44.967813] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-09-16T18:24:44.968455] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-09-16T18:24:44.968531] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-09-16T18:24:44.970109] [DEBUG] [LOCAL ] FBK: Trimmed 26441 records to 19358 (keeping 150 days of data) [2025-09-16T18:24:45.092486] [DEBUG] [LOCAL ] FBK: Primary data saved (19358 records). [2025-09-16T18:24:45.092630] [INFO ] [MAIN ] FBK: Full history saved. [2025-09-16T18:24:45.092728] [INFO ] [MAIN ] Update Progress: 801/2369 symbols completed. FBK took 16.4s. Estimated remaining: 2h 45m 48s. Rate: 9.5 symbols/min [2025-09-16T18:24:45.184066] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-09-16T18:24:45.271602] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:24:45.309124] [DEBUG] [LOCAL ] FBP: Loaded 33317 existing records from primary storage. [2025-09-16T18:24:45.309313] [INFO ] [MAIN ] FBP: Loaded 33317 existing records. [2025-09-16T18:24:45.486919] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:24:45.487177] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-09-16T18:24:45.487224] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-09-16T18:24:45.488036] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-09-16T18:24:45.488121] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-09-16T18:24:45.840069] [INFO ] [REMOTE ] FBP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:24:45.974926] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-09-16T18:24:46.566387] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-16T18:24:46.603349] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-16T18:24:46.774904] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-09-16T18:24:47.495935] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-16T18:24:47.574922] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-09-16T18:24:48.046057] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-16T18:24:48.051715] [INFO ] [REMOTE ] FAF: Full fetch complete (44947 records). [2025-09-16T18:24:48.051838] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-09-16T18:24:48.052482] [FATAL] [VALIDATOR ] FAF: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:24:48.052558] [FATAL] [MAIN ] FAF: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:24:48.052610] [WARN ] [MAIN ] FAF: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:24:48.052677] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-09-16T18:24:48.052737] [DEBUG] [LOCAL ] FAF: No primary data file found to delete. [2025-09-16T18:24:48.052772] [INFO ] [LOCAL ] FAF: Starting deletion of derivative data. [2025-09-16T18:24:48.053082] [DEBUG] [LOCAL ] FAF: Deleted derivative data file. [2025-09-16T18:24:48.053178] [INFO ] [MAIN ] Update Progress: 802/2369 symbols completed. FAF took 19.4s. Estimated remaining: 2h 45m 35s. Rate: 9.5 symbols/min [2025-09-16T18:24:48.227262] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:24:48.257303] [DEBUG] [LOCAL ] FBRT: Loaded 24991 existing records from primary storage. [2025-09-16T18:24:48.257442] [INFO ] [MAIN ] FBRT: Loaded 24991 existing records. [2025-09-16T18:24:48.380061] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-09-16T18:24:48.434231] [WARN ] [MAIN ] FBRT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:24:48.434494] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-09-16T18:24:48.434538] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-09-16T18:24:48.435180] [DEBUG] [LOCAL ] FBRT: Deleted primary data file. [2025-09-16T18:24:48.435229] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-09-16T18:24:48.793881] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:24:49.174889] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-09-16T18:24:49.972780] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-16T18:24:49.983335] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-09-16T18:24:50.278372] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.70 seconds). [2025-09-16T18:24:50.774922] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-09-16T18:24:50.957413] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-16T18:24:51.025293] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-16T18:24:51.574926] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-09-16T18:24:52.374948] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-09-16T18:24:52.642238] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-16T18:24:53.174890] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-09-16T18:24:53.509503] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-16T18:24:53.974952] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-09-16T18:24:54.064311] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-09-16T18:24:54.774918] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-09-16T18:24:54.865934] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-16T18:24:54.873134] [INFO ] [REMOTE ] FBIN: Full fetch complete (54879 records). [2025-09-16T18:24:54.873433] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-09-16T18:24:55.295664] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-09-16T18:24:55.295775] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-09-16T18:24:55.296764] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-09-16T18:24:55.296821] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-09-16T18:24:55.298407] [DEBUG] [LOCAL ] FBIN: Trimmed 54879 records to 37713 (keeping 150 days of data) [2025-09-16T18:24:55.559812] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-16T18:24:55.577669] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-09-16T18:24:55.593563] [DEBUG] [LOCAL ] FBIN: Primary data saved (37713 records). [2025-09-16T18:24:55.593830] [INFO ] [MAIN ] FBIN: Full history saved. [2025-09-16T18:24:55.593989] [INFO ] [MAIN ] Update Progress: 803/2369 symbols completed. FBIN took 26.9s. Estimated remaining: 2h 45m 31s. Rate: 9.5 symbols/min [2025-09-16T18:24:55.798846] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:24:55.814222] [DEBUG] [LOCAL ] FC: Loaded 10433 existing records from primary storage. [2025-09-16T18:24:55.814460] [INFO ] [MAIN ] FC: Loaded 10433 existing records. [2025-09-16T18:24:56.021856] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:24:56.022252] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-09-16T18:24:56.022305] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-09-16T18:24:56.022806] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-09-16T18:24:56.022858] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-09-16T18:24:56.380142] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-09-16T18:24:56.416625] [INFO ] [REMOTE ] FC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:24:56.761054] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-16T18:24:56.959106] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-16T18:24:56.968621] [INFO ] [REMOTE ] F: Full fetch complete (58500 records). [2025-09-16T18:24:56.968807] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-09-16T18:24:57.181069] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-09-16T18:24:57.362627] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-09-16T18:24:57.362730] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-09-16T18:24:57.363522] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-09-16T18:24:57.363566] [DEBUG] [LOCAL ] F: Saving primary data. [2025-09-16T18:24:57.365149] [DEBUG] [LOCAL ] F: Trimmed 58500 records to 40170 (keeping 150 days of data) [2025-09-16T18:24:57.620465] [DEBUG] [LOCAL ] F: Primary data saved (40170 records). [2025-09-16T18:24:57.620594] [INFO ] [MAIN ] F: Full history saved. [2025-09-16T18:24:57.620723] [INFO ] [MAIN ] Update Progress: 804/2369 symbols completed. F took 29.0s. Estimated remaining: 2h 45m 17s. Rate: 9.5 symbols/min [2025-09-16T18:24:57.794621] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:24:57.827938] [DEBUG] [LOCAL ] FCF: Loaded 28033 existing records from primary storage. [2025-09-16T18:24:57.828158] [INFO ] [MAIN ] FCF: Loaded 28033 existing records. [2025-09-16T18:24:57.980072] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-09-16T18:24:58.006987] [WARN ] [MAIN ] FCF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:24:58.007209] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-09-16T18:24:58.007265] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-09-16T18:24:58.007907] [DEBUG] [LOCAL ] FCF: Deleted primary data file. [2025-09-16T18:24:58.007955] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-09-16T18:24:58.359524] [INFO ] [REMOTE ] FCF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:24:58.381055] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-16T18:24:58.416521] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-16T18:24:58.774900] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-09-16T18:24:59.107946] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-16T18:24:59.574924] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-09-16T18:25:00.374980] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-09-16T18:25:00.583490] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-16T18:25:00.966665] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-16T18:25:01.174978] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-09-16T18:25:01.524669] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-16T18:25:01.974991] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-09-16T18:25:02.592172] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-16T18:25:02.774947] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-09-16T18:25:03.128803] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-16T18:25:03.497558] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-16T18:25:03.574914] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-09-16T18:25:04.374912] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-09-16T18:25:05.174862] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-09-16T18:25:05.252262] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-16T18:25:05.591784] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-16T18:25:05.974921] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-09-16T18:25:06.000310] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-16T18:25:06.004238] [INFO ] [REMOTE ] FBRT: Full fetch complete (37205 records). [2025-09-16T18:25:06.004341] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-09-16T18:25:06.378382] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-09-16T18:25:06.378459] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-09-16T18:25:06.379093] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-09-16T18:25:06.379139] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-09-16T18:25:06.379944] [DEBUG] [LOCAL ] FBRT: Trimmed 37205 records to 25233 (keeping 150 days of data) [2025-09-16T18:25:06.541264] [DEBUG] [LOCAL ] FBRT: Primary data saved (25233 records). [2025-09-16T18:25:06.541397] [INFO ] [MAIN ] FBRT: Full history saved. [2025-09-16T18:25:06.541481] [INFO ] [MAIN ] Update Progress: 805/2369 symbols completed. FBRT took 18.5s. Estimated remaining: 2h 45m 15s. Rate: 9.5 symbols/min [2025-09-16T18:25:06.712175] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:25:06.712355] [DEBUG] [LOCAL ] FCN: No existing data file found in primary storage. [2025-09-16T18:25:06.712395] [WARN ] [MAIN ] FCN: No existing data found, performing full refresh instead. [2025-09-16T18:25:06.712516] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-09-16T18:25:06.712556] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-09-16T18:25:06.712598] [DEBUG] [LOCAL ] FCN: No primary data file found to delete. [2025-09-16T18:25:06.712631] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-09-16T18:25:06.780016] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-09-16T18:25:07.071392] [INFO ] [REMOTE ] FCN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:25:07.094719] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-16T18:25:07.537321] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-16T18:25:07.574878] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-09-16T18:25:08.264191] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-16T18:25:08.374920] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-09-16T18:25:08.986194] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-16T18:25:09.174862] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-09-16T18:25:09.974905] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-09-16T18:25:10.125900] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-16T18:25:10.774910] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-09-16T18:25:11.012519] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-16T18:25:11.371501] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-16T18:25:11.574903] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-09-16T18:25:12.374925] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-09-16T18:25:12.500076] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-16T18:25:13.174931] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-09-16T18:25:13.685558] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-16T18:25:13.816892] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-16T18:25:13.819221] [INFO ] [REMOTE ] FC: Full fetch complete (16654 records). [2025-09-16T18:25:13.819308] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-09-16T18:25:13.819861] [FATAL] [VALIDATOR ] FC: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:25:13.819948] [FATAL] [MAIN ] FC: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:25:13.819990] [WARN ] [MAIN ] FC: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:25:13.820034] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-09-16T18:25:13.820103] [DEBUG] [LOCAL ] FC: No primary data file found to delete. [2025-09-16T18:25:13.820150] [INFO ] [LOCAL ] FC: Starting deletion of derivative data. [2025-09-16T18:25:13.820632] [DEBUG] [LOCAL ] FC: Deleted derivative data file. [2025-09-16T18:25:13.820994] [INFO ] [MAIN ] Update Progress: 806/2369 symbols completed. FC took 18.2s. Estimated remaining: 2h 45m 11s. Rate: 9.5 symbols/min [2025-09-16T18:25:13.975113] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-09-16T18:25:13.993890] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:25:14.020404] [DEBUG] [LOCAL ] FCPT: Loaded 26579 existing records from primary storage. [2025-09-16T18:25:14.020572] [INFO ] [MAIN ] FCPT: Loaded 26579 existing records. [2025-09-16T18:25:14.206828] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:25:14.207125] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-09-16T18:25:14.207190] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-09-16T18:25:14.208070] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-09-16T18:25:14.208148] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-09-16T18:25:14.601215] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:25:14.774927] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-09-16T18:25:15.274542] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-16T18:25:15.574940] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-09-16T18:25:15.940978] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-16T18:25:16.374895] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-09-16T18:25:16.694881] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-16T18:25:17.174881] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-09-16T18:25:17.404375] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-16T18:25:17.409156] [INFO ] [REMOTE ] FBP: Full fetch complete (49924 records). [2025-09-16T18:25:17.409255] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-09-16T18:25:17.409925] [FATAL] [VALIDATOR ] FBP: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:25:17.410004] [FATAL] [MAIN ] FBP: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:25:17.410053] [WARN ] [MAIN ] FBP: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:25:17.410099] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-09-16T18:25:17.410179] [DEBUG] [LOCAL ] FBP: No primary data file found to delete. [2025-09-16T18:25:17.410217] [INFO ] [LOCAL ] FBP: Starting deletion of derivative data. [2025-09-16T18:25:17.410448] [DEBUG] [LOCAL ] FBP: Deleted derivative data file. [2025-09-16T18:25:17.411748] [INFO ] [MAIN ] Update Progress: 807/2369 symbols completed. FBP took 32.3s. Estimated remaining: 2h 44m 59s. Rate: 9.5 symbols/min [2025-09-16T18:25:17.580926] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:25:17.581104] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-09-16T18:25:17.581143] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-09-16T18:25:17.581264] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-09-16T18:25:17.581302] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-16T18:25:17.581346] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-09-16T18:25:17.581407] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-09-16T18:25:17.935313] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:25:17.974860] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-09-16T18:25:18.338716] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-16T18:25:18.434249] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-16T18:25:18.774901] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-09-16T18:25:19.574899] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-09-16T18:25:20.148908] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-16T18:25:20.170787] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-16T18:25:20.374893] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-09-16T18:25:21.174924] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-09-16T18:25:21.226211] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-16T18:25:21.448919] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.27 seconds). [2025-09-16T18:25:21.974970] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-09-16T18:25:22.774856] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-09-16T18:25:23.257374] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-16T18:25:23.574919] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-09-16T18:25:23.923513] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-16T18:25:24.368887] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-16T18:25:24.374901] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-09-16T18:25:24.729620] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-16T18:25:25.174895] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-09-16T18:25:25.436967] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-09-16T18:25:25.974906] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-09-16T18:25:26.774866] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-09-16T18:25:26.808419] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-16T18:25:27.574896] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-09-16T18:25:27.918036] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-16T18:25:28.374905] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-09-16T18:25:28.837715] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-16T18:25:28.890895] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-16T18:25:29.174915] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-09-16T18:25:29.930048] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-16T18:25:29.932764] [INFO ] [REMOTE ] FCN: Full fetch complete (28426 records). [2025-09-16T18:25:29.932841] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-09-16T18:25:29.933342] [FATAL] [VALIDATOR ] FCN: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:25:29.933420] [FATAL] [MAIN ] FCN: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:25:29.933457] [WARN ] [MAIN ] FCN: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:25:29.933495] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-09-16T18:25:29.933585] [DEBUG] [LOCAL ] FCN: No primary data file found to delete. [2025-09-16T18:25:29.933625] [INFO ] [LOCAL ] FCN: Starting deletion of derivative data. [2025-09-16T18:25:29.933691] [DEBUG] [LOCAL ] FCN: No derivative data file found to delete. [2025-09-16T18:25:29.933748] [INFO ] [MAIN ] Update Progress: 808/2369 symbols completed. FCN took 23.4s. Estimated remaining: 2h 45m 5s. Rate: 9.5 symbols/min [2025-09-16T18:25:29.979991] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-09-16T18:25:30.114766] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:25:30.125316] [DEBUG] [LOCAL ] FCT: Loaded 10373 existing records from primary storage. [2025-09-16T18:25:30.125433] [INFO ] [MAIN ] FCT: Loaded 10373 existing records. [2025-09-16T18:25:30.306403] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:25:30.306682] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-09-16T18:25:30.306730] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-09-16T18:25:30.307090] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-09-16T18:25:30.307135] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-09-16T18:25:30.415294] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-16T18:25:30.668749] [INFO ] [REMOTE ] FCT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:25:30.774874] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-09-16T18:25:31.574916] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-09-16T18:25:31.649514] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-16T18:25:32.374903] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-09-16T18:25:32.679087] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-16T18:25:33.174899] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-09-16T18:25:33.363611] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-16T18:25:33.368210] [INFO ] [REMOTE ] FCF: Full fetch complete (43355 records). [2025-09-16T18:25:33.368309] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-09-16T18:25:33.682705] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-16T18:25:33.699475] [INFO ] [REMOTE ] FCRX: Full fetch complete (1250 records). [2025-09-16T18:25:33.704806] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-09-16T18:25:33.737666] [FATAL] [VALIDATOR ] FCRX: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:25:33.755562] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:25:33.767045] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:25:33.769378] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present. [2025-09-16T18:25:33.769502] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed. [2025-09-16T18:25:33.769465] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-16T18:25:33.770270] [INFO ] [MAIN ] FCF: Fetched primary data is valid. [2025-09-16T18:25:33.770331] [DEBUG] [LOCAL ] FCF: Saving primary data. [2025-09-16T18:25:33.770413] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-09-16T18:25:33.770573] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-09-16T18:25:33.770625] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-09-16T18:25:33.770715] [INFO ] [MAIN ] Update Progress: 809/2369 symbols completed. FCRX took 16.4s. Estimated remaining: 2h 44m 54s. Rate: 9.5 symbols/min [2025-09-16T18:25:33.870885] [DEBUG] [LOCAL ] FCF: Trimmed 43355 records to 28310 (keeping 150 days of data) [2025-09-16T18:25:33.975897] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-09-16T18:25:34.031938] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:25:34.033696] [DEBUG] [LOCAL ] FCX: No existing data file found in primary storage. [2025-09-16T18:25:34.048095] [WARN ] [MAIN ] FCX: No existing data found, performing full refresh instead. [2025-09-16T18:25:34.052302] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-09-16T18:25:34.053499] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-09-16T18:25:34.053988] [DEBUG] [LOCAL ] FCX: No primary data file found to delete. [2025-09-16T18:25:34.055778] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-09-16T18:25:34.523305] [INFO ] [REMOTE ] FCX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:25:34.535920] [DEBUG] [LOCAL ] FCF: Primary data saved (28310 records). [2025-09-16T18:25:34.536008] [INFO ] [MAIN ] FCF: Full history saved. [2025-09-16T18:25:34.536091] [INFO ] [MAIN ] Update Progress: 810/2369 symbols completed. FCF took 36.9s. Estimated remaining: 2h 44m 36s. Rate: 9.5 symbols/min [2025-09-16T18:25:34.706627] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:25:34.706829] [DEBUG] [LOCAL ] FDP: No existing data file found in primary storage. [2025-09-16T18:25:34.706889] [WARN ] [MAIN ] FDP: No existing data found, performing full refresh instead. [2025-09-16T18:25:34.707011] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-09-16T18:25:34.707051] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-09-16T18:25:34.707094] [DEBUG] [LOCAL ] FDP: No primary data file found to delete. [2025-09-16T18:25:34.707129] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-09-16T18:25:34.783435] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-09-16T18:25:35.076247] [INFO ] [REMOTE ] FDP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:25:35.361972] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-16T18:25:35.574896] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-09-16T18:25:36.374948] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-09-16T18:25:36.559833] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-16T18:25:36.901613] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-16T18:25:36.961833] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-16T18:25:37.174884] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-09-16T18:25:37.974919] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-09-16T18:25:38.146301] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-16T18:25:38.774934] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-09-16T18:25:39.444035] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-16T18:25:39.574945] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-09-16T18:25:40.374867] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-09-16T18:25:40.763474] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-16T18:25:40.925597] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-16T18:25:41.174928] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-09-16T18:25:41.361759] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-16T18:25:41.974924] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-09-16T18:25:42.403730] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-16T18:25:42.408186] [INFO ] [REMOTE ] FCPT: Full fetch complete (40630 records). [2025-09-16T18:25:42.408314] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-09-16T18:25:42.408972] [FATAL] [VALIDATOR ] FCPT: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:25:42.409077] [FATAL] [MAIN ] FCPT: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:25:42.409120] [WARN ] [MAIN ] FCPT: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:25:42.409168] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-09-16T18:25:42.409226] [DEBUG] [LOCAL ] FCPT: No primary data file found to delete. [2025-09-16T18:25:42.409264] [INFO ] [LOCAL ] FCPT: Starting deletion of derivative data. [2025-09-16T18:25:42.409511] [DEBUG] [LOCAL ] FCPT: Deleted derivative data file. [2025-09-16T18:25:42.409593] [INFO ] [MAIN ] Update Progress: 811/2369 symbols completed. FCPT took 28.6s. Estimated remaining: 2h 44m 33s. Rate: 9.5 symbols/min [2025-09-16T18:25:42.585954] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:25:42.604328] [DEBUG] [LOCAL ] FDS: Loaded 18187 existing records from primary storage. [2025-09-16T18:25:42.604472] [INFO ] [MAIN ] FDS: Loaded 18187 existing records. [2025-09-16T18:25:42.780069] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-09-16T18:25:42.784400] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:25:42.785389] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-09-16T18:25:42.785438] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-09-16T18:25:42.786005] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-09-16T18:25:42.786055] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-09-16T18:25:43.155414] [INFO ] [REMOTE ] FDS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:25:43.574897] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-09-16T18:25:43.690574] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-16T18:25:44.327732] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-09-16T18:25:44.374879] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-09-16T18:25:44.592278] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-16T18:25:45.174905] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-09-16T18:25:45.974901] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-09-16T18:25:46.413575] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-16T18:25:46.446831] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-16T18:25:46.774916] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-09-16T18:25:47.299973] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-16T18:25:47.574947] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-09-16T18:25:48.374918] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-09-16T18:25:48.691664] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-16T18:25:48.937354] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-16T18:25:49.174908] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-09-16T18:25:49.355134] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-16T18:25:49.974942] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-09-16T18:25:50.394800] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-16T18:25:50.774909] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-09-16T18:25:51.574888] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-09-16T18:25:51.611766] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-16T18:25:52.225635] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-16T18:25:52.374941] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-09-16T18:25:52.492915] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-16T18:25:53.174968] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-09-16T18:25:53.974941] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-09-16T18:25:54.210337] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-16T18:25:54.471658] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-16T18:25:54.774922] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-09-16T18:25:55.365918] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-16T18:25:55.574930] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-09-16T18:25:56.374934] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-09-16T18:25:56.614386] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-16T18:25:56.620834] [INFO ] [REMOTE ] FCX: Full fetch complete (58379 records). [2025-09-16T18:25:56.620962] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-09-16T18:25:57.003274] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-09-16T18:25:57.019588] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-09-16T18:25:57.020698] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-09-16T18:25:57.020882] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-09-16T18:25:57.022572] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-16T18:25:57.029793] [DEBUG] [LOCAL ] FCX: Trimmed 58379 records to 40052 (keeping 150 days of data) [2025-09-16T18:25:57.217157] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-09-16T18:25:57.278058] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-16T18:25:57.282792] [INFO ] [REMOTE ] FCT: Full fetch complete (15503 records). [2025-09-16T18:25:57.283911] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-09-16T18:25:57.653692] [DEBUG] [LOCAL ] FCX: Primary data saved (40052 records). [2025-09-16T18:25:57.677434] [INFO ] [MAIN ] FCX: Full history saved. [2025-09-16T18:25:57.677607] [INFO ] [MAIN ] Update Progress: 812/2369 symbols completed. FCX took 23.9s. Estimated remaining: 2h 44m 44s. Rate: 9.5 symbols/min [2025-09-16T18:25:57.678094] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-09-16T18:25:57.710327] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-09-16T18:25:57.743098] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-09-16T18:25:57.754498] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-09-16T18:25:57.781556] [DEBUG] [LOCAL ] FCT: Trimmed 15503 records to 10467 (keeping 150 days of data) [2025-09-16T18:25:57.898561] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:25:57.918284] [DEBUG] [LOCAL ] FCT: Primary data saved (10467 records). [2025-09-16T18:25:57.918510] [INFO ] [MAIN ] FCT: Full history saved. [2025-09-16T18:25:57.918609] [INFO ] [MAIN ] Update Progress: 813/2369 symbols completed. FCT took 28.0s. Estimated remaining: 2h 44m 26s. Rate: 9.5 symbols/min [2025-09-16T18:25:57.976369] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-09-16T18:25:58.114665] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:25:58.128098] [DEBUG] [LOCAL ] FDX: Loaded 37922 existing records from primary storage. [2025-09-16T18:25:58.128246] [INFO ] [MAIN ] FDX: Loaded 37922 existing records. [2025-09-16T18:25:58.315149] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:25:58.315385] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-09-16T18:25:58.315430] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-09-16T18:25:58.316459] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-09-16T18:25:58.316512] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-09-16T18:25:58.446375] [DEBUG] [LOCAL ] FE: Loaded 39450 existing records from primary storage. [2025-09-16T18:25:58.479748] [INFO ] [MAIN ] FE: Loaded 39450 existing records. [2025-09-16T18:25:58.594619] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-16T18:25:58.703721] [INFO ] [REMOTE ] FDP: Full fetch complete (33185 records). [2025-09-16T18:25:58.724699] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-09-16T18:25:58.915147] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:25:58.959283] [INFO ] [REMOTE ] FDX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:25:58.980611] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-09-16T18:25:58.995921] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-09-16T18:25:58.999744] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-09-16T18:25:59.007020] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-09-16T18:25:59.007161] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-09-16T18:25:59.503128] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-09-16T18:25:59.515170] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-09-16T18:25:59.541874] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-09-16T18:25:59.552696] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-09-16T18:25:59.564971] [DEBUG] [LOCAL ] FDP: Trimmed 33185 records to 22537 (keeping 150 days of data) [2025-09-16T18:25:59.704806] [INFO ] [REMOTE ] FE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:25:59.731373] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-09-16T18:25:59.750988] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-16T18:25:59.802560] [DEBUG] [LOCAL ] FDP: Primary data saved (22537 records). [2025-09-16T18:25:59.802744] [INFO ] [MAIN ] FDP: Full history saved. [2025-09-16T18:25:59.802833] [INFO ] [MAIN ] Update Progress: 814/2369 symbols completed. FDP took 25.3s. Estimated remaining: 2h 44m 11s. Rate: 9.5 symbols/min [2025-09-16T18:25:59.975717] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:25:59.975908] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-09-16T18:25:59.975948] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-09-16T18:25:59.976071] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-09-16T18:25:59.976115] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-16T18:25:59.976159] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-09-16T18:25:59.976193] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-09-16T18:26:00.337825] [INFO ] [REMOTE ] FENG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:26:00.374860] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-09-16T18:26:00.487151] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-16T18:26:01.005761] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-16T18:26:01.174901] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-09-16T18:26:01.366927] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-16T18:26:01.828562] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-16T18:26:01.974948] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-09-16T18:26:02.451931] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-16T18:26:02.774942] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-09-16T18:26:03.574953] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-09-16T18:26:04.114061] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-16T18:26:04.374914] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-09-16T18:26:05.174934] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-09-16T18:26:05.550689] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-16T18:26:05.974933] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-09-16T18:26:06.206824] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-16T18:26:06.323441] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-16T18:26:06.342228] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-16T18:26:06.774901] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-09-16T18:26:07.574898] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-09-16T18:26:08.374906] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-09-16T18:26:08.975490] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-16T18:26:09.174893] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-09-16T18:26:09.338618] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-16T18:26:09.447102] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-16T18:26:09.974901] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-09-16T18:26:10.774914] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-09-16T18:26:11.251426] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-16T18:26:11.542158] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-16T18:26:11.574847] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-09-16T18:26:11.696565] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-09-16T18:26:12.374903] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-09-16T18:26:13.174935] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-09-16T18:26:13.553701] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-16T18:26:13.984076] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-09-16T18:26:14.010414] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-16T18:26:14.774893] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-09-16T18:26:14.809992] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-16T18:26:14.813899] [INFO ] [REMOTE ] FDS: Full fetch complete (27170 records). [2025-09-16T18:26:14.814010] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-09-16T18:26:15.197093] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-09-16T18:26:15.197174] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-09-16T18:26:15.197762] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-09-16T18:26:15.197811] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-09-16T18:26:15.198504] [DEBUG] [LOCAL ] FDS: Trimmed 27170 records to 18492 (keeping 150 days of data) [2025-09-16T18:26:15.321461] [DEBUG] [LOCAL ] FDS: Primary data saved (18492 records). [2025-09-16T18:26:15.321620] [INFO ] [MAIN ] FDS: Full history saved. [2025-09-16T18:26:15.321731] [INFO ] [MAIN ] Update Progress: 815/2369 symbols completed. FDS took 32.9s. Estimated remaining: 2h 44m 22s. Rate: 9.5 symbols/min [2025-09-16T18:26:15.509869] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:26:15.510094] [DEBUG] [LOCAL ] FERG: No existing data file found in primary storage. [2025-09-16T18:26:15.510133] [WARN ] [MAIN ] FERG: No existing data found, performing full refresh instead. [2025-09-16T18:26:15.510262] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-09-16T18:26:15.510304] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-09-16T18:26:15.510347] [DEBUG] [LOCAL ] FERG: No primary data file found to delete. [2025-09-16T18:26:15.510404] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-09-16T18:26:15.578169] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-09-16T18:26:15.897072] [INFO ] [REMOTE ] FERG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:26:15.900433] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-16T18:26:15.931622] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-16T18:26:16.348215] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-16T18:26:16.374873] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-09-16T18:26:17.174909] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-09-16T18:26:17.459628] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-09-16T18:26:17.717131] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-16T18:26:17.974906] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-09-16T18:26:18.774913] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-09-16T18:26:19.240765] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-16T18:26:19.246982] [INFO ] [REMOTE ] FE: Full fetch complete (58096 records). [2025-09-16T18:26:19.247084] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-09-16T18:26:19.581253] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-09-16T18:26:19.686170] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-09-16T18:26:19.686267] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-09-16T18:26:19.687106] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-09-16T18:26:19.687195] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-09-16T18:26:19.688658] [DEBUG] [LOCAL ] FE: Trimmed 58096 records to 39837 (keeping 150 days of data) [2025-09-16T18:26:19.938743] [DEBUG] [LOCAL ] FE: Primary data saved (39837 records). [2025-09-16T18:26:19.938903] [INFO ] [MAIN ] FE: Full history saved. [2025-09-16T18:26:19.938992] [INFO ] [MAIN ] Update Progress: 816/2369 symbols completed. FE took 22.0s. Estimated remaining: 2h 44m 13s. Rate: 9.5 symbols/min [2025-09-16T18:26:20.125317] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:26:20.135890] [DEBUG] [LOCAL ] FET: Loaded 8868 existing records from primary storage. [2025-09-16T18:26:20.136067] [INFO ] [MAIN ] FET: Loaded 8868 existing records. [2025-09-16T18:26:20.252970] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-16T18:26:20.332056] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:26:20.326986] [INFO ] [REMOTE ] FENG: Full fetch complete (1671 records). [2025-09-16T18:26:20.332419] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-09-16T18:26:20.376694] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-09-16T18:26:20.376593] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-09-16T18:26:20.420681] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-09-16T18:26:20.443575] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-09-16T18:26:20.469446] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-09-16T18:26:20.534697] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-16T18:26:20.569122] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:26:20.595897] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:26:20.621440] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-16T18:26:20.640209] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-09-16T18:26:20.655733] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-09-16T18:26:20.692847] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-09-16T18:26:20.727329] [INFO ] [MAIN ] Update Progress: 817/2369 symbols completed. FENG took 20.9s. Estimated remaining: 2h 43m 56s. Rate: 9.5 symbols/min [2025-09-16T18:26:20.963575] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-16T18:26:21.111707] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:26:21.131249] [INFO ] [REMOTE ] FET: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:26:21.149024] [DEBUG] [LOCAL ] FF: Loaded 17610 existing records from primary storage. [2025-09-16T18:26:21.149176] [INFO ] [MAIN ] FF: Loaded 17610 existing records. [2025-09-16T18:26:21.180252] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-09-16T18:26:21.333572] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:26:21.333854] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-09-16T18:26:21.333904] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-09-16T18:26:21.334504] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-09-16T18:26:21.334567] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-09-16T18:26:21.690330] [INFO ] [REMOTE ] FF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:26:21.974862] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-09-16T18:26:22.022665] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-16T18:26:22.774882] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-09-16T18:26:22.975012] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-16T18:26:23.109246] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-16T18:26:23.574918] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-09-16T18:26:24.314350] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-16T18:26:24.321055] [INFO ] [REMOTE ] FDX: Full fetch complete (55865 records). [2025-09-16T18:26:24.321377] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-09-16T18:26:24.386957] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-09-16T18:26:24.713567] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-09-16T18:26:24.713681] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-09-16T18:26:24.714624] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-09-16T18:26:24.714718] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-09-16T18:26:24.716078] [DEBUG] [LOCAL ] FDX: Trimmed 55865 records to 38297 (keeping 150 days of data) [2025-09-16T18:26:24.960571] [DEBUG] [LOCAL ] FDX: Primary data saved (38297 records). [2025-09-16T18:26:24.960732] [INFO ] [MAIN ] FDX: Full history saved. [2025-09-16T18:26:24.961478] [INFO ] [MAIN ] Update Progress: 818/2369 symbols completed. FDX took 27.3s. Estimated remaining: 2h 43m 45s. Rate: 9.5 symbols/min [2025-09-16T18:26:25.132988] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:26:25.139414] [DEBUG] [LOCAL ] FFA: Loaded 3377 existing records from primary storage. [2025-09-16T18:26:25.139545] [INFO ] [MAIN ] FFA: Loaded 3377 existing records. [2025-09-16T18:26:25.182943] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-09-16T18:26:25.322661] [WARN ] [MAIN ] FFA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:26:25.322961] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-09-16T18:26:25.323118] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-09-16T18:26:25.328533] [DEBUG] [LOCAL ] FFA: Deleted primary data file. [2025-09-16T18:26:25.336326] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-09-16T18:26:25.406938] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-16T18:26:25.696129] [INFO ] [REMOTE ] FFA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:26:25.974910] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-09-16T18:26:26.598304] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-16T18:26:26.614897] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (3.04 seconds). [2025-09-16T18:26:26.774925] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-09-16T18:26:27.574909] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-09-16T18:26:28.197014] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-16T18:26:28.374901] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-09-16T18:26:29.174913] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-09-16T18:26:30.055131] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-16T18:26:30.061938] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-09-16T18:26:30.270171] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (3.50 seconds). [2025-09-16T18:26:30.606055] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-16T18:26:30.774915] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-09-16T18:26:31.348982] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-16T18:26:31.372206] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-16T18:26:31.574898] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-09-16T18:26:32.374921] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-09-16T18:26:32.832794] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-16T18:26:33.174904] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-09-16T18:26:33.974906] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-09-16T18:26:34.096201] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-16T18:26:34.587549] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-16T18:26:34.774897] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-09-16T18:26:35.527351] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-16T18:26:35.559138] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (3.18 seconds). [2025-09-16T18:26:35.574838] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-09-16T18:26:35.993332] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-16T18:26:36.374858] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-09-16T18:26:37.174925] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-09-16T18:26:37.295155] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-16T18:26:37.974958] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-09-16T18:26:38.092148] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (12.91 seconds). [2025-09-16T18:26:38.169233] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-16T18:26:38.766920] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-16T18:26:38.774841] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-09-16T18:26:39.574935] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-09-16T18:26:39.782484] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-16T18:26:39.785339] [INFO ] [REMOTE ] FF: Full fetch complete (27944 records). [2025-09-16T18:26:39.785416] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-09-16T18:26:39.785948] [FATAL] [VALIDATOR ] FF: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:26:39.786026] [FATAL] [MAIN ] FF: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:26:39.786066] [WARN ] [MAIN ] FF: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:26:39.786115] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-09-16T18:26:39.786180] [DEBUG] [LOCAL ] FF: No primary data file found to delete. [2025-09-16T18:26:39.786228] [INFO ] [LOCAL ] FF: Starting deletion of derivative data. [2025-09-16T18:26:39.786471] [DEBUG] [LOCAL ] FF: Deleted derivative data file. [2025-09-16T18:26:39.786560] [INFO ] [MAIN ] Update Progress: 819/2369 symbols completed. FF took 19.1s. Estimated remaining: 2h 43m 55s. Rate: 9.5 symbols/min [2025-09-16T18:26:39.957334] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:26:39.970750] [DEBUG] [LOCAL ] FFC: Loaded 11958 existing records from primary storage. [2025-09-16T18:26:39.970873] [INFO ] [MAIN ] FFC: Loaded 11958 existing records. [2025-09-16T18:26:40.178720] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:26:40.179004] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-09-16T18:26:40.179051] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-09-16T18:26:40.179446] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-09-16T18:26:40.179491] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-09-16T18:26:40.387015] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-09-16T18:26:40.536563] [INFO ] [REMOTE ] FFC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:26:40.638785] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-16T18:26:40.641099] [INFO ] [REMOTE ] FET: Full fetch complete (13641 records). [2025-09-16T18:26:40.641171] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-09-16T18:26:40.999671] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-09-16T18:26:40.999754] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-09-16T18:26:41.000063] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-09-16T18:26:41.000111] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-09-16T18:26:41.000636] [DEBUG] [LOCAL ] FET: Trimmed 13641 records to 9003 (keeping 150 days of data) [2025-09-16T18:26:41.056129] [DEBUG] [LOCAL ] FET: Primary data saved (9003 records). [2025-09-16T18:26:41.056299] [INFO ] [MAIN ] FET: Full history saved. [2025-09-16T18:26:41.056390] [INFO ] [MAIN ] Update Progress: 820/2369 symbols completed. FET took 21.1s. Estimated remaining: 2h 43m 39s. Rate: 9.5 symbols/min [2025-09-16T18:26:41.180018] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-09-16T18:26:41.228108] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:26:41.252335] [DEBUG] [LOCAL ] FFWM: Loaded 26071 existing records from primary storage. [2025-09-16T18:26:41.252465] [INFO ] [MAIN ] FFWM: Loaded 26071 existing records. [2025-09-16T18:26:41.430883] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:26:41.431228] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-09-16T18:26:41.431279] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-09-16T18:26:41.431874] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-09-16T18:26:41.431928] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-09-16T18:26:41.785570] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:26:41.887492] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-16T18:26:41.974931] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-09-16T18:26:42.230551] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-16T18:26:42.727746] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-16T18:26:42.774846] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-09-16T18:26:43.574893] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-09-16T18:26:43.765128] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-16T18:26:44.374906] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-09-16T18:26:44.939526] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-16T18:26:45.174925] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-09-16T18:26:45.207132] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-16T18:26:45.974919] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-09-16T18:26:46.393581] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-16T18:26:46.774967] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-09-16T18:26:47.574897] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-09-16T18:26:47.735025] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-16T18:26:48.194314] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-16T18:26:48.207444] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-16T18:26:48.374913] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-09-16T18:26:49.174911] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-09-16T18:26:49.440940] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-16T18:26:49.974939] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-09-16T18:26:50.555133] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-16T18:26:50.556257] [INFO ] [REMOTE ] FFA: Full fetch complete (5970 records). [2025-09-16T18:26:50.556354] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-09-16T18:26:50.556740] [FATAL] [VALIDATOR ] FFA: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:26:50.556807] [FATAL] [MAIN ] FFA: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:26:50.556851] [WARN ] [MAIN ] FFA: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:26:50.556892] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-09-16T18:26:50.556948] [DEBUG] [LOCAL ] FFA: No primary data file found to delete. [2025-09-16T18:26:50.556982] [INFO ] [LOCAL ] FFA: Starting deletion of derivative data. [2025-09-16T18:26:50.557224] [DEBUG] [LOCAL ] FFA: Deleted derivative data file. [2025-09-16T18:26:50.557301] [INFO ] [MAIN ] Update Progress: 821/2369 symbols completed. FFA took 25.6s. Estimated remaining: 2h 43m 39s. Rate: 9.5 symbols/min [2025-09-16T18:26:50.729879] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:26:50.758834] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-16T18:26:50.779138] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-09-16T18:26:50.779497] [DEBUG] [LOCAL ] FG: Loaded 15163 existing records from primary storage. [2025-09-16T18:26:50.780344] [INFO ] [MAIN ] FG: Loaded 15163 existing records. [2025-09-16T18:26:50.966022] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:26:50.966301] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-09-16T18:26:50.966351] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-09-16T18:26:50.966774] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-09-16T18:26:50.966824] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-09-16T18:26:51.331947] [INFO ] [REMOTE ] FG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:26:51.574904] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-09-16T18:26:52.301466] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-16T18:26:52.374866] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-09-16T18:26:53.174904] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-09-16T18:26:53.334081] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-16T18:26:53.441614] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-16T18:26:53.980588] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-09-16T18:26:53.983675] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-16T18:26:54.774871] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-09-16T18:26:55.081147] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-16T18:26:55.574881] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-09-16T18:26:55.874911] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-16T18:26:56.374904] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-09-16T18:26:57.176382] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-09-16T18:26:57.178695] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-16T18:26:57.683467] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-16T18:26:57.945144] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-16T18:26:57.974851] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-09-16T18:26:58.774894] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-09-16T18:26:59.574929] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-09-16T18:26:59.605438] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-16T18:26:59.611762] [INFO ] [REMOTE ] FERG: Full fetch complete (52858 records). [2025-09-16T18:26:59.611906] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-09-16T18:26:59.612602] [FATAL] [VALIDATOR ] FERG: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:26:59.612705] [FATAL] [MAIN ] FERG: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:26:59.612750] [WARN ] [MAIN ] FERG: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:26:59.612827] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-09-16T18:26:59.612895] [DEBUG] [LOCAL ] FERG: No primary data file found to delete. [2025-09-16T18:26:59.612932] [INFO ] [LOCAL ] FERG: Starting deletion of derivative data. [2025-09-16T18:26:59.613017] [DEBUG] [LOCAL ] FERG: No derivative data file found to delete. [2025-09-16T18:26:59.613080] [INFO ] [MAIN ] Update Progress: 822/2369 symbols completed. FERG took 44.3s. Estimated remaining: 2h 43m 37s. Rate: 9.5 symbols/min [2025-09-16T18:26:59.792550] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:26:59.815935] [DEBUG] [LOCAL ] FGN: Loaded 2723 existing records from primary storage. [2025-09-16T18:26:59.816437] [INFO ] [MAIN ] FGN: Loaded 2723 existing records. [2025-09-16T18:26:59.851104] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-16T18:27:00.013163] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:27:00.013430] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-09-16T18:27:00.013479] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-09-16T18:27:00.013698] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-09-16T18:27:00.013746] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-09-16T18:27:00.381783] [INFO ] [REMOTE ] FGN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:27:00.381867] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-09-16T18:27:00.800867] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-16T18:27:01.005007] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-16T18:27:01.174914] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-09-16T18:27:01.974901] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-09-16T18:27:02.614537] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-16T18:27:02.618832] [INFO ] [REMOTE ] FFWM: Full fetch complete (39173 records). [2025-09-16T18:27:02.618943] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-09-16T18:27:02.620621] [FATAL] [VALIDATOR ] FFWM: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:27:02.620736] [FATAL] [MAIN ] FFWM: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:27:02.620810] [WARN ] [MAIN ] FFWM: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:27:02.620913] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-09-16T18:27:02.620975] [DEBUG] [LOCAL ] FFWM: No primary data file found to delete. [2025-09-16T18:27:02.621012] [INFO ] [LOCAL ] FFWM: Starting deletion of derivative data. [2025-09-16T18:27:02.621287] [DEBUG] [LOCAL ] FFWM: Deleted derivative data file. [2025-09-16T18:27:02.621386] [INFO ] [MAIN ] Update Progress: 823/2369 symbols completed. FFWM took 21.6s. Estimated remaining: 2h 43m 25s. Rate: 9.5 symbols/min [2025-09-16T18:27:02.802765] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:27:02.798503] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-09-16T18:27:02.809009] [DEBUG] [LOCAL ] FGSN: Loaded 3496 existing records from primary storage. [2025-09-16T18:27:02.809109] [INFO ] [MAIN ] FGSN: Loaded 3496 existing records. [2025-09-16T18:27:02.959796] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-16T18:27:02.980376] [INFO ] [REMOTE ] FFC: Full fetch complete (17923 records). [2025-09-16T18:27:02.996589] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-09-16T18:27:03.000230] [WARN ] [MAIN ] FGSN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:27:03.000714] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-09-16T18:27:03.001163] [FATAL] [VALIDATOR ] FFC: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:27:03.001227] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-09-16T18:27:03.001412] [FATAL] [MAIN ] FFC: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:27:03.001528] [WARN ] [MAIN ] FFC: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:27:03.001575] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-09-16T18:27:03.001657] [DEBUG] [LOCAL ] FFC: No primary data file found to delete. [2025-09-16T18:27:03.001699] [INFO ] [LOCAL ] FFC: Starting deletion of derivative data. [2025-09-16T18:27:03.001753] [DEBUG] [LOCAL ] FGSN: Deleted primary data file. [2025-09-16T18:27:03.001847] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-09-16T18:27:03.033484] [DEBUG] [LOCAL ] FFC: Deleted derivative data file. [2025-09-16T18:27:03.072133] [INFO ] [MAIN ] Update Progress: 824/2369 symbols completed. FFC took 23.3s. Estimated remaining: 2h 43m 7s. Rate: 9.5 symbols/min [2025-09-16T18:27:03.417203] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:27:03.433598] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-16T18:27:03.576821] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:27:03.577004] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-09-16T18:27:03.589710] [DEBUG] [LOCAL ] FHI: Loaded 29782 existing records from primary storage. [2025-09-16T18:27:03.589835] [INFO ] [MAIN ] FHI: Loaded 29782 existing records. [2025-09-16T18:27:03.766406] [WARN ] [MAIN ] FHI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:27:03.766698] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-09-16T18:27:03.766747] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-09-16T18:27:03.767460] [DEBUG] [LOCAL ] FHI: Deleted primary data file. [2025-09-16T18:27:03.767508] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-09-16T18:27:04.121697] [INFO ] [REMOTE ] FHI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:27:04.374873] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-09-16T18:27:04.768402] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-16T18:27:04.953839] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-16T18:27:05.174958] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-02. [2025-09-16T18:27:05.899747] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-16T18:27:05.975123] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-09-16T18:27:06.775037] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-03. [2025-09-16T18:27:06.840331] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-16T18:27:07.316663] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-16T18:27:07.574929] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-04. [2025-09-16T18:27:08.061947] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-16T18:27:08.374932] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-05. [2025-09-16T18:27:08.925288] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-16T18:27:09.174943] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-09-16T18:27:09.974920] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-06. [2025-09-16T18:27:10.563296] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-16T18:27:10.749272] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-16T18:27:10.774851] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-09-16T18:27:11.574915] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-09-16T18:27:12.041632] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-16T18:27:12.247753] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-16T18:27:12.374898] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-09-16T18:27:13.174938] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-09-16T18:27:13.952590] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-16T18:27:13.954138] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-16T18:27:13.974870] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-09-16T18:27:14.620657] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-16T18:27:14.774896] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-07. [2025-09-16T18:27:15.355144] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-16T18:27:15.574908] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-09-16T18:27:16.374940] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-08. [2025-09-16T18:27:17.051627] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-16T18:27:17.174871] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-09-16T18:27:17.205250] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-16T18:27:17.732599] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-16T18:27:17.974965] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-09-16T18:27:18.774909] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-09-16T18:27:19.354878] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-16T18:27:19.456717] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-16T18:27:19.574884] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-09-16T18:27:20.374908] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-09. [2025-09-16T18:27:20.797883] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-16T18:27:20.956994] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-16T18:27:20.958833] [INFO ] [REMOTE ] FGSN: Full fetch complete (5529 records). [2025-09-16T18:27:20.959049] [DEBUG] [VALIDATOR ] FGSN: Validating primary data. [2025-09-16T18:27:21.180169] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-09-16T18:27:21.358005] [DEBUG] [VALIDATOR ] FGSN: All expected trading days are present. [2025-09-16T18:27:21.358120] [DEBUG] [VALIDATOR ] FGSN: Primary data validation passed. [2025-09-16T18:27:21.358361] [INFO ] [MAIN ] FGSN: Fetched primary data is valid. [2025-09-16T18:27:21.358411] [DEBUG] [LOCAL ] FGSN: Saving primary data. [2025-09-16T18:27:21.359375] [DEBUG] [LOCAL ] FGSN: Trimmed 5529 records to 3526 (keeping 150 days of data) [2025-09-16T18:27:21.382294] [DEBUG] [LOCAL ] FGSN: Primary data saved (3526 records). [2025-09-16T18:27:21.382389] [INFO ] [MAIN ] FGSN: Full history saved. [2025-09-16T18:27:21.382482] [INFO ] [MAIN ] Update Progress: 825/2369 symbols completed. FGSN took 18.8s. Estimated remaining: 2h 43m 24s. Rate: 9.4 symbols/min [2025-09-16T18:27:21.560684] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:27:21.608807] [DEBUG] [LOCAL ] FHN: Loaded 39364 existing records from primary storage. [2025-09-16T18:27:21.609012] [INFO ] [MAIN ] FHN: Loaded 39364 existing records. [2025-09-16T18:27:21.801555] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:27:21.801864] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-09-16T18:27:21.801920] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-09-16T18:27:21.803266] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-09-16T18:27:21.803331] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-09-16T18:27:21.979950] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-09-16T18:27:22.161091] [INFO ] [REMOTE ] FHN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:27:22.658984] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-16T18:27:22.660248] [INFO ] [REMOTE ] FGN: Full fetch complete (4341 records). [2025-09-16T18:27:22.660327] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-09-16T18:27:22.779991] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-09-16T18:27:23.019730] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present. [2025-09-16T18:27:23.019811] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed. [2025-09-16T18:27:23.019955] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-09-16T18:27:23.019994] [DEBUG] [LOCAL ] FGN: Saving primary data. [2025-09-16T18:27:23.020344] [DEBUG] [LOCAL ] FGN: Trimmed 4341 records to 2748 (keeping 150 days of data) [2025-09-16T18:27:23.037411] [DEBUG] [LOCAL ] FGN: Primary data saved (2748 records). [2025-09-16T18:27:23.037470] [INFO ] [MAIN ] FGN: Full history saved. [2025-09-16T18:27:23.037564] [INFO ] [MAIN ] Update Progress: 826/2369 symbols completed. FGN took 23.4s. Estimated remaining: 2h 43m 8s. Rate: 9.5 symbols/min [2025-09-16T18:27:23.213842] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:27:23.260212] [DEBUG] [LOCAL ] FI: Loaded 39603 existing records from primary storage. [2025-09-16T18:27:23.260351] [INFO ] [MAIN ] FI: Loaded 39603 existing records. [2025-09-16T18:27:23.433917] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:27:23.434233] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-09-16T18:27:23.434281] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-09-16T18:27:23.435138] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-09-16T18:27:23.435188] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-09-16T18:27:23.577764] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-09-16T18:27:23.851427] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-16T18:27:23.855206] [INFO ] [REMOTE ] FI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:27:24.374902] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-09-16T18:27:25.156889] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-16T18:27:25.159556] [INFO ] [REMOTE ] FG: Full fetch complete (23260 records). [2025-09-16T18:27:25.159633] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-09-16T18:27:25.193140] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-09-16T18:27:25.531190] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-09-16T18:27:25.531547] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-09-16T18:27:25.532047] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-09-16T18:27:25.532181] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-09-16T18:27:25.533289] [DEBUG] [LOCAL ] FG: Trimmed 23260 records to 15335 (keeping 150 days of data) [2025-09-16T18:27:25.634964] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-16T18:27:25.667871] [DEBUG] [LOCAL ] FG: Primary data saved (15335 records). [2025-09-16T18:27:25.667983] [INFO ] [MAIN ] FG: Full history saved. [2025-09-16T18:27:25.668091] [INFO ] [MAIN ] Update Progress: 827/2369 symbols completed. FG took 35.1s. Estimated remaining: 2h 42m 55s. Rate: 9.5 symbols/min [2025-09-16T18:27:25.839952] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:27:25.857431] [DEBUG] [LOCAL ] FICO: Loaded 16098 existing records from primary storage. [2025-09-16T18:27:25.857577] [INFO ] [MAIN ] FICO: Loaded 16098 existing records. [2025-09-16T18:27:25.979965] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-09-16T18:27:26.038192] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:27:26.038419] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-09-16T18:27:26.038466] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-09-16T18:27:26.039052] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-09-16T18:27:26.039108] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-09-16T18:27:26.413123] [INFO ] [REMOTE ] FICO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:27:26.433841] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (5.25 seconds). [2025-09-16T18:27:26.709834] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-16T18:27:26.774851] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-09-16T18:27:27.529040] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-16T18:27:27.574871] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-09-16T18:27:28.256899] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-16T18:27:28.374909] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-09-16T18:27:29.047154] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-16T18:27:29.051868] [INFO ] [REMOTE ] FHI: Full fetch complete (43948 records). [2025-09-16T18:27:29.051954] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-09-16T18:27:29.180076] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-09-16T18:27:29.434896] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-09-16T18:27:29.434985] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-09-16T18:27:29.435660] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-09-16T18:27:29.435707] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-09-16T18:27:29.436868] [DEBUG] [LOCAL ] FHI: Trimmed 43948 records to 30062 (keeping 150 days of data) [2025-09-16T18:27:29.635377] [DEBUG] [LOCAL ] FHI: Primary data saved (30062 records). [2025-09-16T18:27:29.635525] [INFO ] [MAIN ] FHI: Full history saved. [2025-09-16T18:27:29.635632] [INFO ] [MAIN ] Update Progress: 828/2369 symbols completed. FHI took 26.6s. Estimated remaining: 2h 42m 44s. Rate: 9.5 symbols/min [2025-09-16T18:27:29.810629] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:27:29.810812] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-09-16T18:27:29.810850] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-09-16T18:27:29.810971] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-09-16T18:27:29.811033] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-16T18:27:29.811134] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-09-16T18:27:29.811180] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-09-16T18:27:29.975373] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-09-16T18:27:30.174986] [INFO ] [REMOTE ] FIG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:27:30.374503] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-16T18:27:30.484089] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-16T18:27:30.774924] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-09-16T18:27:31.176702] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-16T18:27:31.574933] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-09-16T18:27:31.698722] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-16T18:27:32.374898] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-09-16T18:27:33.174914] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-09-16T18:27:33.386527] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-16T18:27:33.482759] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-16T18:27:33.974899] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-09-16T18:27:34.026387] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-16T18:27:34.774904] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-09-16T18:27:35.574891] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-09-16T18:27:35.878882] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-16T18:27:35.909555] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-16T18:27:36.360620] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-16T18:27:36.374846] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-09-16T18:27:37.174960] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-09-16T18:27:37.458307] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-09-16T18:27:37.812391] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-16T18:27:37.974940] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-09-16T18:27:38.174121] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T18:27:38.174487] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-09-16T18:27:38.774937] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-09-16T18:27:39.574936] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-09-16T18:27:40.374892] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-09-16T18:27:40.606801] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-16T18:27:40.944016] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-16T18:27:41.174923] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-09-16T18:27:41.868496] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-16T18:27:41.974911] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-09-16T18:27:42.286610] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-16T18:27:42.774935] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-09-16T18:27:43.574882] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-07. [2025-09-16T18:27:43.653234] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-16T18:27:43.659822] [INFO ] [REMOTE ] FHN: Full fetch complete (58023 records). [2025-09-16T18:27:43.659959] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-09-16T18:27:43.962249] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-16T18:27:44.051386] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-09-16T18:27:44.051473] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-09-16T18:27:44.052235] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-09-16T18:27:44.052280] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-09-16T18:27:44.053380] [DEBUG] [LOCAL ] FHN: Trimmed 58023 records to 39754 (keeping 150 days of data) [2025-09-16T18:27:44.303287] [DEBUG] [LOCAL ] FHN: Primary data saved (39754 records). [2025-09-16T18:27:44.303431] [INFO ] [MAIN ] FHN: Full history saved. [2025-09-16T18:27:44.303517] [INFO ] [MAIN ] Update Progress: 829/2369 symbols completed. FHN took 22.9s. Estimated remaining: 2h 42m 54s. Rate: 9.5 symbols/min [2025-09-16T18:27:44.384072] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-08. [2025-09-16T18:27:44.477441] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:27:44.511741] [DEBUG] [LOCAL ] FIGS: Loaded 36014 existing records from primary storage. [2025-09-16T18:27:44.511964] [INFO ] [MAIN ] FIGS: Loaded 36014 existing records. [2025-09-16T18:27:44.702129] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-16T18:27:44.732661] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:27:44.733268] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-09-16T18:27:44.733319] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-09-16T18:27:44.734141] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-09-16T18:27:44.734197] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-09-16T18:27:45.097582] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:27:45.174881] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-09-16T18:27:45.974900] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-09-16T18:27:46.774939] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-09-16T18:27:46.841347] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-16T18:27:47.068380] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-08 (2.68 seconds). [2025-09-16T18:27:47.197196] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-16T18:27:47.574893] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-09-16T18:27:48.374889] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-09. [2025-09-16T18:27:48.511231] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-16T18:27:48.517435] [INFO ] [REMOTE ] FI: Full fetch complete (58122 records). [2025-09-16T18:27:48.517524] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-09-16T18:27:48.899871] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-09-16T18:27:48.899953] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-09-16T18:27:48.900721] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-09-16T18:27:48.900766] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-09-16T18:27:48.901935] [DEBUG] [LOCAL ] FI: Trimmed 58122 records to 39987 (keeping 150 days of data) [2025-09-16T18:27:49.147111] [DEBUG] [LOCAL ] FI: Primary data saved (39987 records). [2025-09-16T18:27:49.147280] [INFO ] [MAIN ] FI: Full history saved. [2025-09-16T18:27:49.147364] [INFO ] [MAIN ] Update Progress: 830/2369 symbols completed. FI took 26.1s. Estimated remaining: 2h 42m 44s. Rate: 9.5 symbols/min [2025-09-16T18:27:49.180039] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-09-16T18:27:49.325844] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:27:49.358724] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-16T18:27:49.390026] [DEBUG] [LOCAL ] FIHL: Loaded 28558 existing records from primary storage. [2025-09-16T18:27:49.390156] [INFO ] [MAIN ] FIHL: Loaded 28558 existing records. [2025-09-16T18:27:49.606684] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:27:49.606967] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-09-16T18:27:49.607015] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-09-16T18:27:49.607715] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-09-16T18:27:49.607772] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-09-16T18:27:49.969064] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:27:49.974855] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-09-16T18:27:50.480958] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-16T18:27:50.774913] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-09-16T18:27:50.983478] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-09-16T18:27:50.989741] [INFO ] [REMOTE ] FIG: Full fetch complete (12943 records). [2025-09-16T18:27:50.989832] [DEBUG] [VALIDATOR ] FIG: Validating primary data. [2025-09-16T18:27:51.167715] [WARN ] [VALIDATOR ] FIG: Validation failed - insufficient historical data. Have 102 unique days, need 150 days [2025-09-16T18:27:51.168021] [FATAL] [MAIN ] FIG: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:27:51.168074] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:27:51.168118] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-16T18:27:51.168178] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-09-16T18:27:51.168215] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-09-16T18:27:51.168266] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-09-16T18:27:51.168328] [INFO ] [MAIN ] Update Progress: 831/2369 symbols completed. FIG took 21.5s. Estimated remaining: 2h 42m 30s. Rate: 9.5 symbols/min [2025-09-16T18:27:51.341865] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:27:51.350246] [DEBUG] [LOCAL ] FINS: Loaded 6401 existing records from primary storage. [2025-09-16T18:27:51.350403] [INFO ] [MAIN ] FINS: Loaded 6401 existing records. [2025-09-16T18:27:51.474118] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-16T18:27:51.550457] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:27:51.550688] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-09-16T18:27:51.550737] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-09-16T18:27:51.551034] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-09-16T18:27:51.551078] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-09-16T18:27:51.581443] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-09-16T18:27:51.910419] [INFO ] [REMOTE ] FINS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:27:52.338945] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-16T18:27:52.374923] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-09-16T18:27:53.099385] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-16T18:27:53.174943] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-09-16T18:27:53.716007] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-16T18:27:53.974908] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-09-16T18:27:54.787721] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-09-16T18:27:54.790268] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-16T18:27:55.156539] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-16T18:27:55.159491] [INFO ] [REMOTE ] FICO: Full fetch complete (21700 records). [2025-09-16T18:27:55.159584] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-09-16T18:27:55.539118] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-09-16T18:27:55.539199] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-09-16T18:27:55.539715] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-09-16T18:27:55.539761] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-09-16T18:27:55.540378] [DEBUG] [LOCAL ] FICO: Trimmed 21700 records to 16209 (keeping 150 days of data) [2025-09-16T18:27:55.589583] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-09-16T18:27:55.637789] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-16T18:27:55.661016] [DEBUG] [LOCAL ] FICO: Primary data saved (16209 records). [2025-09-16T18:27:55.661207] [INFO ] [MAIN ] FICO: Full history saved. [2025-09-16T18:27:55.661311] [INFO ] [MAIN ] Update Progress: 832/2369 symbols completed. FICO took 30.0s. Estimated remaining: 2h 42m 20s. Rate: 9.5 symbols/min [2025-09-16T18:27:55.833707] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:27:55.875442] [DEBUG] [LOCAL ] FINV: Loaded 32958 existing records from primary storage. [2025-09-16T18:27:55.875606] [INFO ] [MAIN ] FINV: Loaded 32958 existing records. [2025-09-16T18:27:56.058202] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:27:56.058463] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-09-16T18:27:56.058519] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-09-16T18:27:56.059267] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-09-16T18:27:56.059319] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-09-16T18:27:56.382133] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-09-16T18:27:56.421454] [INFO ] [REMOTE ] FINV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:27:57.174920] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-09-16T18:27:57.280969] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-16T18:27:57.316538] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-16T18:27:57.974916] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-09-16T18:27:58.775007] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-09-16T18:27:58.917826] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-16T18:27:59.559781] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-16T18:27:59.574852] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-09-16T18:28:00.374900] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-09-16T18:28:00.483027] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-16T18:28:01.103298] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-16T18:28:01.174858] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-09-16T18:28:01.788255] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-16T18:28:01.974940] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-09-16T18:28:02.774937] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-09-16T18:28:02.794830] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-16T18:28:03.070678] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-16T18:28:03.574946] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-09-16T18:28:04.361373] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-16T18:28:04.374840] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-09-16T18:28:04.548074] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-16T18:28:05.158424] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-16T18:28:05.174857] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-09-16T18:28:05.974938] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-09-16T18:28:05.991685] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-16T18:28:06.774920] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-09-16T18:28:07.574915] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-09-16T18:28:07.670864] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-16T18:28:07.676622] [INFO ] [REMOTE ] FIGS: Full fetch complete (53284 records). [2025-09-16T18:28:07.676741] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-09-16T18:28:08.047815] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-16T18:28:08.065611] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-09-16T18:28:08.065813] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-09-16T18:28:08.066888] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-09-16T18:28:08.066947] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-09-16T18:28:08.068305] [DEBUG] [LOCAL ] FIGS: Trimmed 53284 records to 36336 (keeping 150 days of data) [2025-09-16T18:28:08.213288] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-16T18:28:08.314835] [DEBUG] [LOCAL ] FIGS: Primary data saved (36336 records). [2025-09-16T18:28:08.314995] [INFO ] [MAIN ] FIGS: Full history saved. [2025-09-16T18:28:08.315090] [INFO ] [MAIN ] Update Progress: 833/2369 symbols completed. FIGS took 24.0s. Estimated remaining: 2h 42m 26s. Rate: 9.5 symbols/min [2025-09-16T18:28:08.380168] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-09-16T18:28:08.489177] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:28:08.525179] [DEBUG] [LOCAL ] FIS: Loaded 39350 existing records from primary storage. [2025-09-16T18:28:08.525338] [INFO ] [MAIN ] FIS: Loaded 39350 existing records. [2025-09-16T18:28:08.705512] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:28:08.705777] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-09-16T18:28:08.705823] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-09-16T18:28:08.706747] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-09-16T18:28:08.706799] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-09-16T18:28:09.068844] [INFO ] [REMOTE ] FIS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:28:09.174923] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-09-16T18:28:09.769267] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-16T18:28:09.770736] [INFO ] [REMOTE ] FINS: Full fetch complete (8767 records). [2025-09-16T18:28:09.770819] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-09-16T18:28:09.983229] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-09-16T18:28:10.136773] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-09-16T18:28:10.136890] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-09-16T18:28:10.137151] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-09-16T18:28:10.137202] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-09-16T18:28:10.137633] [DEBUG] [LOCAL ] FINS: Trimmed 8767 records to 6435 (keeping 150 days of data) [2025-09-16T18:28:10.189520] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-16T18:28:10.206865] [DEBUG] [LOCAL ] FINS: Primary data saved (6435 records). [2025-09-16T18:28:10.206951] [INFO ] [MAIN ] FINS: Full history saved. [2025-09-16T18:28:10.207028] [INFO ] [MAIN ] Update Progress: 834/2369 symbols completed. FINS took 19.0s. Estimated remaining: 2h 42m 11s. Rate: 9.5 symbols/min [2025-09-16T18:28:10.380933] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:28:10.400710] [DEBUG] [LOCAL ] FIX: Loaded 21071 existing records from primary storage. [2025-09-16T18:28:10.400873] [INFO ] [MAIN ] FIX: Loaded 21071 existing records. [2025-09-16T18:28:10.574946] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:28:10.575234] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-09-16T18:28:10.575288] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-09-16T18:28:10.575930] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-09-16T18:28:10.575981] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-09-16T18:28:10.780625] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-09-16T18:28:10.929099] [INFO ] [REMOTE ] FIX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:28:11.574869] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-09-16T18:28:11.839368] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-16T18:28:12.324937] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-16T18:28:12.374878] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-09-16T18:28:12.821554] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-16T18:28:13.175001] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-09-16T18:28:13.615082] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-16T18:28:13.620034] [INFO ] [REMOTE ] FIHL: Full fetch complete (43922 records). [2025-09-16T18:28:13.620116] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-09-16T18:28:13.981759] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-09-16T18:28:13.996825] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-09-16T18:28:13.997821] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-09-16T18:28:13.998428] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-09-16T18:28:13.998470] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-09-16T18:28:13.999443] [DEBUG] [LOCAL ] FIHL: Trimmed 43922 records to 28860 (keeping 150 days of data) [2025-09-16T18:28:14.171088] [DEBUG] [LOCAL ] FIHL: Primary data saved (28860 records). [2025-09-16T18:28:14.171242] [INFO ] [MAIN ] FIHL: Full history saved. [2025-09-16T18:28:14.171358] [INFO ] [MAIN ] Update Progress: 835/2369 symbols completed. FIHL took 25.0s. Estimated remaining: 2h 42m 0s. Rate: 9.5 symbols/min [2025-09-16T18:28:14.342726] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:28:14.342865] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-09-16T18:28:14.342901] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-09-16T18:28:14.343015] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-09-16T18:28:14.343052] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-16T18:28:14.343093] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-09-16T18:28:14.343124] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-09-16T18:28:14.692251] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:28:14.747788] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-16T18:28:14.774836] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-09-16T18:28:15.528513] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-16T18:28:15.574891] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-09-16T18:28:15.766493] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-16T18:28:16.374941] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-02. [2025-09-16T18:28:16.641324] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T18:28:16.641689] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-02 [2025-09-16T18:28:17.174913] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-09-16T18:28:17.335224] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-16T18:28:17.974916] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-09-16T18:28:18.314573] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-16T18:28:18.774904] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-09-16T18:28:19.483544] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-16T18:28:19.574860] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-09-16T18:28:20.013997] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-16T18:28:20.374943] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-09-16T18:28:21.174944] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-03. [2025-09-16T18:28:21.547895] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T18:28:21.551249] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-03 [2025-09-16T18:28:21.553839] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-16T18:28:21.746939] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-16T18:28:21.974908] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-09-16T18:28:22.774899] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-04. [2025-09-16T18:28:22.979754] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T18:28:22.980254] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-04 [2025-09-16T18:28:23.574899] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-05. [2025-09-16T18:28:23.808522] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T18:28:23.808854] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-05 [2025-09-16T18:28:24.374906] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-06. [2025-09-16T18:28:25.017034] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (3.04 seconds). [2025-09-16T18:28:25.100871] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-16T18:28:25.174926] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-09-16T18:28:25.974916] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-09-16T18:28:26.774907] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-09-16T18:28:26.894358] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-16T18:28:27.574917] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-07. [2025-09-16T18:28:27.597240] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-16T18:28:28.041264] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-16T18:28:28.222926] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-16T18:28:28.374870] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-09-16T18:28:29.174890] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-08. [2025-09-16T18:28:29.638187] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-16T18:28:29.974895] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-09-16T18:28:30.159369] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-16T18:28:30.774904] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-09. [2025-09-16T18:28:31.357143] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-16T18:28:31.358082] [INFO ] [REMOTE ] FIXT: Full fetch complete (1654 records). [2025-09-16T18:28:31.358152] [DEBUG] [VALIDATOR ] FIXT: Validating primary data. [2025-09-16T18:28:31.536258] [WARN ] [VALIDATOR ] FIXT: Validation failed - insufficient historical data. Have 64 unique days, need 150 days [2025-09-16T18:28:31.536548] [FATAL] [MAIN ] FIXT: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:28:31.536693] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:28:31.536854] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-16T18:28:31.545305] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-09-16T18:28:31.545411] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-09-16T18:28:31.546234] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-16T18:28:31.545938] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-09-16T18:28:31.549495] [INFO ] [MAIN ] Update Progress: 836/2369 symbols completed. FIXT took 17.4s. Estimated remaining: 2h 42m 14s. Rate: 9.4 symbols/min [2025-09-16T18:28:31.549968] [INFO ] [REMOTE ] FIX: Full fetch complete (34784 records). [2025-09-16T18:28:31.590355] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-09-16T18:28:31.585139] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-09-16T18:28:31.852552] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:28:32.012216] [DEBUG] [LOCAL ] FLC: Loaded 3882 existing records from primary storage. [2025-09-16T18:28:32.014529] [INFO ] [MAIN ] FLC: Loaded 3882 existing records. [2025-09-16T18:28:32.244344] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-09-16T18:28:32.278315] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-09-16T18:28:32.282526] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:28:32.283405] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-09-16T18:28:32.283728] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-09-16T18:28:32.283626] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-09-16T18:28:32.284009] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-09-16T18:28:32.284449] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-09-16T18:28:32.284572] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-09-16T18:28:32.290096] [DEBUG] [LOCAL ] FIX: Trimmed 34784 records to 21252 (keeping 150 days of data) [2025-09-16T18:28:32.381614] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-09-16T18:28:32.790215] [INFO ] [REMOTE ] FLC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:28:32.815099] [DEBUG] [LOCAL ] FIX: Primary data saved (21252 records). [2025-09-16T18:28:32.815257] [INFO ] [MAIN ] FIX: Full history saved. [2025-09-16T18:28:32.815357] [INFO ] [MAIN ] Update Progress: 837/2369 symbols completed. FIX took 22.6s. Estimated remaining: 2h 41m 59s. Rate: 9.5 symbols/min [2025-09-16T18:28:33.174906] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-09-16T18:28:33.468911] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-16T18:28:33.841658] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-16T18:28:33.977975] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-09-16T18:28:33.983839] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-16T18:28:34.681521] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-16T18:28:34.774899] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-09-16T18:28:35.532815] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-16T18:28:35.574866] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-09-16T18:28:36.374894] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-09-16T18:28:36.858075] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-16T18:28:37.174915] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-09-16T18:28:37.213536] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-16T18:28:37.219725] [INFO ] [REMOTE ] FINV: Full fetch complete (48867 records). [2025-09-16T18:28:37.219834] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-09-16T18:28:37.597739] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-09-16T18:28:37.597828] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-09-16T18:28:37.598519] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-09-16T18:28:37.598563] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-09-16T18:28:37.599633] [DEBUG] [LOCAL ] FINV: Trimmed 48867 records to 33313 (keeping 150 days of data) [2025-09-16T18:28:37.788982] [DEBUG] [LOCAL ] FINV: Primary data saved (33313 records). [2025-09-16T18:28:37.789125] [INFO ] [MAIN ] FINV: Full history saved. [2025-09-16T18:28:37.790522] [INFO ] [MAIN ] Update Progress: 838/2369 symbols completed. FINV took 42.1s. Estimated remaining: 2h 41m 50s. Rate: 9.5 symbols/min [2025-09-16T18:28:37.974929] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-09-16T18:28:38.563357] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-16T18:28:38.774951] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-09-16T18:28:39.083714] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-16T18:28:39.391739] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-16T18:28:39.574960] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-09-16T18:28:40.342869] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-16T18:28:40.374850] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-09-16T18:28:41.047599] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-16T18:28:41.049062] [INFO ] [REMOTE ] FLC: Full fetch complete (6118 records). [2025-09-16T18:28:41.049148] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-09-16T18:28:41.179974] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-09-16T18:28:41.419210] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-09-16T18:28:41.419291] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-09-16T18:28:41.419468] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-09-16T18:28:41.419510] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-09-16T18:28:41.419929] [DEBUG] [LOCAL ] FLC: Trimmed 6118 records to 3942 (keeping 150 days of data) [2025-09-16T18:28:41.446410] [DEBUG] [LOCAL ] FLC: Primary data saved (3942 records). [2025-09-16T18:28:41.446571] [INFO ] [MAIN ] FLC: Full history saved. [2025-09-16T18:28:41.446704] [INFO ] [MAIN ] Update Progress: 839/2369 symbols completed. FLC took 9.9s. Estimated remaining: 2h 41m 39s. Rate: 9.5 symbols/min [2025-09-16T18:28:43.089718] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-16T18:28:43.096147] [INFO ] [REMOTE ] FIS: Full fetch complete (58049 records). [2025-09-16T18:28:43.096286] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-09-16T18:28:43.498146] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-09-16T18:28:43.498233] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-09-16T18:28:43.499100] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-09-16T18:28:43.499155] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-09-16T18:28:43.500410] [DEBUG] [LOCAL ] FIS: Trimmed 58049 records to 39736 (keeping 150 days of data) [2025-09-16T18:28:43.754895] [DEBUG] [LOCAL ] FIS: Primary data saved (39736 records). [2025-09-16T18:28:43.755084] [INFO ] [MAIN ] FIS: Full history saved. [2025-09-16T18:28:43.755184] [INFO ] [MAIN ] Update Progress: 840/2369 symbols completed. FIS took 35.4s. Estimated remaining: 2h 41m 25s. Rate: 9.5 symbols/min [2025-09-16T18:28:44.294287] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:28:44.469314] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:28:44.471280] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:28:44.496312] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:28:44.531234] [DEBUG] [LOCAL ] FLOC: Loaded 20511 existing records from primary storage. [2025-09-16T18:28:44.532271] [DEBUG] [LOCAL ] FLNG: Loaded 24804 existing records from primary storage. [2025-09-16T18:28:44.541994] [INFO ] [MAIN ] FLNG: Loaded 24804 existing records. [2025-09-16T18:28:44.541878] [INFO ] [MAIN ] FLOC: Loaded 20511 existing records. [2025-09-16T18:28:44.780423] [DEBUG] [LOCAL ] FLG: Loaded 39349 existing records from primary storage. [2025-09-16T18:28:44.791541] [INFO ] [MAIN ] FLG: Loaded 39349 existing records. [2025-09-16T18:28:44.926902] [DEBUG] [LOCAL ] FLO: Loaded 38409 existing records from primary storage. [2025-09-16T18:28:44.995859] [INFO ] [MAIN ] FLO: Loaded 38409 existing records. [2025-09-16T18:28:45.014710] [WARN ] [MAIN ] FLOC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:28:44.995990] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:28:45.070202] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-09-16T18:28:45.085670] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-09-16T18:28:45.095836] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-09-16T18:28:45.092210] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-09-16T18:28:45.101772] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-09-16T18:28:45.110369] [DEBUG] [LOCAL ] FLOC: Deleted primary data file. [2025-09-16T18:28:45.135111] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-09-16T18:28:45.129480] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-09-16T18:28:45.430479] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:28:45.518157] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:28:45.533740] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-09-16T18:28:45.550355] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-09-16T18:28:45.606679] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-09-16T18:28:45.574393] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-09-16T18:28:45.617127] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-09-16T18:28:45.617220] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-09-16T18:28:45.712870] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-09-16T18:28:45.782357] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-09-16T18:28:46.283368] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:28:46.309024] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-09-16T18:28:46.506248] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:28:46.524857] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-02. [2025-09-16T18:28:46.677432] [INFO ] [REMOTE ] FLG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:28:46.688182] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-09-16T18:28:46.765052] [INFO ] [REMOTE ] FLO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:28:46.765345] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-09-16T18:28:48.090005] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-16T18:28:48.095930] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-03. [2025-09-16T18:28:48.212866] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-16T18:28:48.220475] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-09-16T18:28:48.325950] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-16T18:28:48.335932] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-09-16T18:28:48.496837] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-16T18:28:48.506616] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-09-16T18:28:49.250072] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-16T18:28:49.257449] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-04. [2025-09-16T18:28:49.429895] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-16T18:28:49.437717] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-09-16T18:28:50.159397] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-16T18:28:50.199513] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-09-16T18:28:50.202525] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-16T18:28:50.510502] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-16T18:28:50.554304] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-16T18:28:50.774915] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-05. [2025-09-16T18:28:51.574960] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-09-16T18:28:51.632062] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-16T18:28:52.161883] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-16T18:28:52.374967] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-06. [2025-09-16T18:28:52.752245] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-16T18:28:53.174901] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-09-16T18:28:53.522797] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-16T18:28:53.974959] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-09-16T18:28:54.774900] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-07. [2025-09-16T18:28:54.995342] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-16T18:28:55.463382] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-16T18:28:55.574868] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-09-16T18:28:55.752407] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-16T18:28:56.374901] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-09-16T18:28:57.174891] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-08. [2025-09-16T18:28:57.211446] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-16T18:28:57.753308] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-16T18:28:57.974916] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-09-16T18:28:58.163605] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-16T18:28:58.774913] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-09-16T18:28:59.574939] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-09. [2025-09-16T18:28:59.790451] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-16T18:29:00.102948] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-16T18:29:00.374925] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-09-16T18:29:01.051264] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-16T18:29:01.054722] [INFO ] [REMOTE ] FLOC: Full fetch complete (31627 records). [2025-09-16T18:29:01.054835] [DEBUG] [VALIDATOR ] FLOC: Validating primary data. [2025-09-16T18:29:01.179969] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-09-16T18:29:01.432275] [DEBUG] [VALIDATOR ] FLOC: All expected trading days are present. [2025-09-16T18:29:01.432356] [DEBUG] [VALIDATOR ] FLOC: Primary data validation passed. [2025-09-16T18:29:01.432931] [INFO ] [MAIN ] FLOC: Fetched primary data is valid. [2025-09-16T18:29:01.433014] [DEBUG] [LOCAL ] FLOC: Saving primary data. [2025-09-16T18:29:01.433826] [DEBUG] [LOCAL ] FLOC: Trimmed 31627 records to 20716 (keeping 150 days of data) [2025-09-16T18:29:01.582967] [DEBUG] [LOCAL ] FLOC: Primary data saved (20716 records). [2025-09-16T18:29:01.583106] [INFO ] [MAIN ] FLOC: Full history saved. [2025-09-16T18:29:01.583296] [INFO ] [MAIN ] Update Progress: 841/2369 symbols completed. FLOC took 17.8s. Estimated remaining: 2h 41m 39s. Rate: 9.5 symbols/min [2025-09-16T18:29:01.796353] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-16T18:29:01.798595] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:29:01.809054] [DEBUG] [LOCAL ] FLR: No existing data file found in primary storage. [2025-09-16T18:29:01.809278] [WARN ] [MAIN ] FLR: No existing data found, performing full refresh instead. [2025-09-16T18:29:01.809839] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-09-16T18:29:01.809882] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-09-16T18:29:01.809937] [DEBUG] [LOCAL ] FLR: No primary data file found to delete. [2025-09-16T18:29:01.810347] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-09-16T18:29:01.983431] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-09-16T18:29:02.168444] [INFO ] [REMOTE ] FLR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:29:02.748878] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-16T18:29:02.774849] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-09-16T18:29:03.379678] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-16T18:29:03.574877] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-09-16T18:29:03.816189] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-16T18:29:04.374902] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-09-16T18:29:05.174885] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-09-16T18:29:05.477387] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-16T18:29:05.974888] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-09-16T18:29:06.112122] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-16T18:29:06.558504] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-16T18:29:06.774878] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-09-16T18:29:07.574899] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-09-16T18:29:07.688349] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-16T18:29:07.694742] [INFO ] [REMOTE ] FLG: Full fetch complete (58009 records). [2025-09-16T18:29:07.694858] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-09-16T18:29:08.097358] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-09-16T18:29:08.097476] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-09-16T18:29:08.098347] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-09-16T18:29:08.098408] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-09-16T18:29:08.099846] [DEBUG] [LOCAL ] FLG: Trimmed 58009 records to 39734 (keeping 150 days of data) [2025-09-16T18:29:08.242891] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-16T18:29:08.251422] [INFO ] [REMOTE ] FLO: Full fetch complete (56357 records). [2025-09-16T18:29:08.252008] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-09-16T18:29:08.425988] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-09-16T18:29:08.760274] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-09-16T18:29:08.761395] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-09-16T18:29:08.764243] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-09-16T18:29:08.764936] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-09-16T18:29:08.775880] [DEBUG] [LOCAL ] FLO: Trimmed 56357 records to 38799 (keeping 150 days of data) [2025-09-16T18:29:08.784675] [DEBUG] [LOCAL ] FLG: Primary data saved (39734 records). [2025-09-16T18:29:08.784821] [INFO ] [MAIN ] FLG: Full history saved. [2025-09-16T18:29:08.784925] [INFO ] [MAIN ] Update Progress: 842/2369 symbols completed. FLG took 25.0s. Estimated remaining: 2h 41m 35s. Rate: 9.5 symbols/min [2025-09-16T18:29:09.055203] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:29:09.110634] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-16T18:29:09.136486] [DEBUG] [LOCAL ] FLS: Loaded 36835 existing records from primary storage. [2025-09-16T18:29:09.137106] [INFO ] [MAIN ] FLS: Loaded 36835 existing records. [2025-09-16T18:29:09.181114] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-09-16T18:29:09.326874] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:29:09.327137] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-09-16T18:29:09.327185] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-09-16T18:29:09.377866] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-09-16T18:29:09.386075] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-09-16T18:29:09.782767] [INFO ] [REMOTE ] FLS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:29:09.805555] [DEBUG] [LOCAL ] FLO: Primary data saved (38799 records). [2025-09-16T18:29:09.805683] [INFO ] [MAIN ] FLO: Full history saved. [2025-09-16T18:29:09.807223] [INFO ] [MAIN ] Update Progress: 843/2369 symbols completed. FLO took 26.0s. Estimated remaining: 2h 41m 19s. Rate: 9.5 symbols/min [2025-09-16T18:29:09.976430] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:29:09.975119] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-09-16T18:29:10.016676] [DEBUG] [LOCAL ] FLUT: Loaded 37330 existing records from primary storage. [2025-09-16T18:29:10.016846] [INFO ] [MAIN ] FLUT: Loaded 37330 existing records. [2025-09-16T18:29:10.201666] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:29:10.202163] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-09-16T18:29:10.202221] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-09-16T18:29:10.214900] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-16T18:29:10.214941] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-09-16T18:29:10.219427] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-09-16T18:29:10.286503] [INFO ] [REMOTE ] FLNG: Full fetch complete (37755 records). [2025-09-16T18:29:10.303708] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-09-16T18:29:10.892912] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:29:10.893289] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-09-16T18:29:10.980180] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-09-16T18:29:10.980386] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-09-16T18:29:10.981558] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-09-16T18:29:10.981803] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-09-16T18:29:10.983408] [DEBUG] [LOCAL ] FLNG: Trimmed 37755 records to 25121 (keeping 150 days of data) [2025-09-16T18:29:11.115087] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-16T18:29:11.170214] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-16T18:29:11.225142] [DEBUG] [LOCAL ] FLNG: Primary data saved (25121 records). [2025-09-16T18:29:11.225283] [INFO ] [MAIN ] FLNG: Full history saved. [2025-09-16T18:29:11.225374] [INFO ] [MAIN ] Update Progress: 844/2369 symbols completed. FLNG took 27.5s. Estimated remaining: 2h 41m 3s. Rate: 9.5 symbols/min [2025-09-16T18:29:11.393347] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:29:11.408730] [DEBUG] [LOCAL ] FLXR: Loaded 15177 existing records from primary storage. [2025-09-16T18:29:11.408859] [INFO ] [MAIN ] FLXR: Loaded 15177 existing records. [2025-09-16T18:29:11.581925] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-09-16T18:29:11.586257] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:29:11.587192] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-09-16T18:29:11.587257] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-09-16T18:29:11.587841] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-09-16T18:29:11.588011] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-09-16T18:29:11.956350] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:29:12.374871] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-09-16T18:29:12.802436] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-16T18:29:12.959069] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-16T18:29:12.997496] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-16T18:29:13.174909] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-09-16T18:29:13.974920] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-09-16T18:29:14.774905] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-09-16T18:29:14.991487] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-16T18:29:15.574908] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-09-16T18:29:15.774658] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-16T18:29:15.913203] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-16T18:29:16.374907] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-09-16T18:29:17.174901] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-09-16T18:29:17.425791] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-16T18:29:17.974940] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-09-16T18:29:18.048597] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-16T18:29:18.226421] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-16T18:29:18.774981] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-09-16T18:29:19.574922] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-09-16T18:29:19.750709] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-16T18:29:19.772292] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-16T18:29:20.374893] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-09-16T18:29:21.066968] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-16T18:29:21.174876] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-09-16T18:29:21.974887] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-09-16T18:29:22.131514] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-16T18:29:22.153280] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-16T18:29:22.774901] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-09-16T18:29:23.409919] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-16T18:29:23.574892] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-09-16T18:29:24.374865] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-09-16T18:29:24.862922] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-16T18:29:25.174906] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-09-16T18:29:25.393659] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-16T18:29:25.974883] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-09-16T18:29:26.014115] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-16T18:29:26.774939] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-09-16T18:29:26.942944] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-16T18:29:27.489677] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-16T18:29:27.574920] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-09-16T18:29:28.374878] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-09-16T18:29:28.534827] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-16T18:29:29.053853] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-16T18:29:29.060223] [INFO ] [REMOTE ] FLR: Full fetch complete (57773 records). [2025-09-16T18:29:29.060463] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-09-16T18:29:29.177738] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-09-16T18:29:29.384177] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-16T18:29:29.472798] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-09-16T18:29:29.472878] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-09-16T18:29:29.473617] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-09-16T18:29:29.473678] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-09-16T18:29:29.474868] [DEBUG] [LOCAL ] FLR: Trimmed 57773 records to 39691 (keeping 150 days of data) [2025-09-16T18:29:29.708042] [DEBUG] [LOCAL ] FLR: Primary data saved (39691 records). [2025-09-16T18:29:29.708195] [INFO ] [MAIN ] FLR: Full history saved. [2025-09-16T18:29:29.708274] [INFO ] [MAIN ] Update Progress: 845/2369 symbols completed. FLR took 28.1s. Estimated remaining: 2h 41m 19s. Rate: 9.4 symbols/min [2025-09-16T18:29:29.875718] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:29:29.912853] [DEBUG] [LOCAL ] FMC: Loaded 38090 existing records from primary storage. [2025-09-16T18:29:29.912998] [INFO ] [MAIN ] FMC: Loaded 38090 existing records. [2025-09-16T18:29:29.980004] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-09-16T18:29:30.096637] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:29:30.096923] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-09-16T18:29:30.096978] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-09-16T18:29:30.097799] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-09-16T18:29:30.097851] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-09-16T18:29:30.445048] [INFO ] [REMOTE ] FMC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:29:30.774895] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-09-16T18:29:30.998975] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-16T18:29:31.005432] [INFO ] [REMOTE ] FLUT: Full fetch complete (55499 records). [2025-09-16T18:29:31.005556] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-09-16T18:29:31.390755] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-09-16T18:29:31.390846] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-09-16T18:29:31.391621] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-09-16T18:29:31.391688] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-09-16T18:29:31.393544] [DEBUG] [LOCAL ] FLUT: Trimmed 55499 records to 37703 (keeping 150 days of data) [2025-09-16T18:29:31.594840] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-09-16T18:29:31.634981] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-16T18:29:31.647492] [DEBUG] [LOCAL ] FLUT: Primary data saved (37703 records). [2025-09-16T18:29:31.647616] [INFO ] [MAIN ] FLUT: Full history saved. [2025-09-16T18:29:31.647731] [INFO ] [MAIN ] Update Progress: 846/2369 symbols completed. FLUT took 21.8s. Estimated remaining: 2h 41m 5s. Rate: 9.5 symbols/min [2025-09-16T18:29:31.815985] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:29:31.821605] [DEBUG] [LOCAL ] FMN: Loaded 3809 existing records from primary storage. [2025-09-16T18:29:31.821720] [INFO ] [MAIN ] FMN: Loaded 3809 existing records. [2025-09-16T18:29:31.998261] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:29:31.998602] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-09-16T18:29:31.998672] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-09-16T18:29:31.998912] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-09-16T18:29:31.998998] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-09-16T18:29:32.334390] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-09-16T18:29:32.378488] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-09-16T18:29:32.400487] [INFO ] [REMOTE ] FMN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:29:33.174921] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-09-16T18:29:33.445838] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-16T18:29:33.482620] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-16T18:29:33.486233] [INFO ] [REMOTE ] FLXR: Full fetch complete (20562 records). [2025-09-16T18:29:33.486329] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-09-16T18:29:33.867929] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-09-16T18:29:33.868034] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-09-16T18:29:33.868566] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-09-16T18:29:33.868627] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-09-16T18:29:33.869356] [DEBUG] [LOCAL ] FLXR: Trimmed 20562 records to 15343 (keeping 150 days of data) [2025-09-16T18:29:33.971935] [DEBUG] [LOCAL ] FLXR: Primary data saved (15343 records). [2025-09-16T18:29:33.972090] [INFO ] [MAIN ] FLXR: Full history saved. [2025-09-16T18:29:33.972210] [INFO ] [MAIN ] Update Progress: 847/2369 symbols completed. FLXR took 22.7s. Estimated remaining: 2h 40m 51s. Rate: 9.5 symbols/min [2025-09-16T18:29:33.984284] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-09-16T18:29:34.084818] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-16T18:29:34.158262] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:29:34.180001] [DEBUG] [LOCAL ] FMS: Loaded 22098 existing records from primary storage. [2025-09-16T18:29:34.180134] [INFO ] [MAIN ] FMS: Loaded 22098 existing records. [2025-09-16T18:29:34.354329] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:29:34.354590] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-09-16T18:29:34.354636] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-09-16T18:29:34.355221] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-09-16T18:29:34.355279] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-09-16T18:29:34.746661] [INFO ] [REMOTE ] FMS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:29:34.774843] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-09-16T18:29:35.574936] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-09-16T18:29:35.822073] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-16T18:29:35.828796] [INFO ] [REMOTE ] FLS: Full fetch complete (54352 records). [2025-09-16T18:29:35.828891] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-09-16T18:29:36.224546] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-09-16T18:29:36.229478] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-09-16T18:29:36.230732] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-09-16T18:29:36.231195] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-16T18:29:36.236052] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-09-16T18:29:36.238122] [DEBUG] [LOCAL ] FLS: Trimmed 54352 records to 37213 (keeping 150 days of data) [2025-09-16T18:29:36.413787] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-09-16T18:29:36.473975] [DEBUG] [LOCAL ] FLS: Primary data saved (37213 records). [2025-09-16T18:29:36.474102] [INFO ] [MAIN ] FLS: Full history saved. [2025-09-16T18:29:36.474204] [INFO ] [MAIN ] Update Progress: 848/2369 symbols completed. FLS took 27.7s. Estimated remaining: 2h 40m 38s. Rate: 9.5 symbols/min [2025-09-16T18:29:36.647808] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:29:36.648014] [DEBUG] [LOCAL ] FMX: No existing data file found in primary storage. [2025-09-16T18:29:36.648054] [WARN ] [MAIN ] FMX: No existing data found, performing full refresh instead. [2025-09-16T18:29:36.648173] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-09-16T18:29:36.648210] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-09-16T18:29:36.648250] [DEBUG] [LOCAL ] FMX: No primary data file found to delete. [2025-09-16T18:29:36.648283] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-09-16T18:29:37.006576] [INFO ] [REMOTE ] FMX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:29:37.174891] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-09-16T18:29:37.524132] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-16T18:29:37.552550] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-16T18:29:37.974891] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-09-16T18:29:38.738363] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-16T18:29:38.779953] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-09-16T18:29:38.792206] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-16T18:29:39.307165] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-16T18:29:39.574934] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-09-16T18:29:40.374938] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-09-16T18:29:41.174958] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-09-16T18:29:41.359967] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-16T18:29:41.778189] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-16T18:29:41.974899] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-09-16T18:29:42.493444] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-16T18:29:42.774916] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-09-16T18:29:43.055224] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-16T18:29:43.324462] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-16T18:29:43.574915] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-09-16T18:29:44.374961] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-09-16T18:29:45.068412] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-16T18:29:45.174980] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-09-16T18:29:45.533766] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-16T18:29:45.791616] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-16T18:29:45.974939] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-09-16T18:29:46.774968] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-09-16T18:29:47.574958] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-09-16T18:29:47.706492] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-16T18:29:48.020040] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-16T18:29:48.374901] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-09-16T18:29:48.437988] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-16T18:29:49.174912] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-09-16T18:29:49.974762] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-16T18:29:49.975084] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-09-16T18:29:49.976164] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-16T18:29:49.978226] [INFO ] [REMOTE ] FMN: Full fetch complete (6787 records). [2025-09-16T18:29:49.985965] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-09-16T18:29:50.347763] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-09-16T18:29:50.347842] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-09-16T18:29:50.348027] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-09-16T18:29:50.348065] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-09-16T18:29:50.348445] [DEBUG] [LOCAL ] FMN: Trimmed 6787 records to 3836 (keeping 150 days of data) [2025-09-16T18:29:50.372320] [DEBUG] [LOCAL ] FMN: Primary data saved (3836 records). [2025-09-16T18:29:50.372408] [INFO ] [MAIN ] FMN: Full history saved. [2025-09-16T18:29:50.372484] [INFO ] [MAIN ] Update Progress: 849/2369 symbols completed. FMN took 18.7s. Estimated remaining: 2h 40m 45s. Rate: 9.5 symbols/min [2025-09-16T18:29:50.552635] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:29:50.555599] [DEBUG] [LOCAL ] FMY: Loaded 1018 existing records from primary storage. [2025-09-16T18:29:50.555699] [INFO ] [MAIN ] FMY: Loaded 1018 existing records. [2025-09-16T18:29:50.730432] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:29:50.730755] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-09-16T18:29:50.730829] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-09-16T18:29:50.731048] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-09-16T18:29:50.731102] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-09-16T18:29:50.786288] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-09-16T18:29:51.097798] [INFO ] [REMOTE ] FMY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:29:51.574948] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-09-16T18:29:51.769260] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-16T18:29:51.861305] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-16T18:29:51.979616] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-16T18:29:52.374897] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-09-16T18:29:53.174913] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-09-16T18:29:53.528088] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-16T18:29:53.614347] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-16T18:29:53.974937] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-09-16T18:29:54.774913] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-09-16T18:29:55.470546] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-16T18:29:55.574956] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-09-16T18:29:56.019992] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-16T18:29:56.374927] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-09-16T18:29:56.974032] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-16T18:29:57.020097] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-16T18:29:57.174924] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-09-16T18:29:57.974929] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-09-16T18:29:58.774914] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-09-16T18:29:59.104982] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-16T18:29:59.577267] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-09-16T18:29:59.579135] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-16T18:29:59.583689] [INFO ] [REMOTE ] FMS: Full fetch complete (32959 records). [2025-09-16T18:29:59.583791] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-09-16T18:29:59.960378] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-09-16T18:29:59.960468] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-09-16T18:29:59.961138] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-09-16T18:29:59.961193] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-09-16T18:29:59.962189] [DEBUG] [LOCAL ] FMS: Trimmed 32959 records to 22350 (keeping 150 days of data) [2025-09-16T18:30:00.127243] [DEBUG] [LOCAL ] FMS: Primary data saved (22350 records). [2025-09-16T18:30:00.127378] [INFO ] [MAIN ] FMS: Full history saved. [2025-09-16T18:30:00.127481] [INFO ] [MAIN ] Update Progress: 850/2369 symbols completed. FMS took 26.2s. Estimated remaining: 2h 40m 45s. Rate: 9.4 symbols/min [2025-09-16T18:30:00.297473] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:30:00.297731] [DEBUG] [LOCAL ] FN: No existing data file found in primary storage. [2025-09-16T18:30:00.297772] [WARN ] [MAIN ] FN: No existing data found, performing full refresh instead. [2025-09-16T18:30:00.297903] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-09-16T18:30:00.297981] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-09-16T18:30:00.298044] [DEBUG] [LOCAL ] FN: No primary data file found to delete. [2025-09-16T18:30:00.298091] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-09-16T18:30:00.377724] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-09-16T18:30:00.659355] [INFO ] [REMOTE ] FN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:30:00.686240] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-16T18:30:00.895674] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-16T18:30:01.174892] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-09-16T18:30:01.209908] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-16T18:30:01.215968] [INFO ] [REMOTE ] FMC: Full fetch complete (56113 records). [2025-09-16T18:30:01.216081] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-09-16T18:30:01.216779] [FATAL] [VALIDATOR ] FMC: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:30:01.216858] [FATAL] [MAIN ] FMC: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:30:01.216904] [WARN ] [MAIN ] FMC: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:30:01.216965] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-09-16T18:30:01.217056] [DEBUG] [LOCAL ] FMC: No primary data file found to delete. [2025-09-16T18:30:01.217115] [INFO ] [LOCAL ] FMC: Starting deletion of derivative data. [2025-09-16T18:30:01.217513] [DEBUG] [LOCAL ] FMC: Deleted derivative data file. [2025-09-16T18:30:01.217674] [INFO ] [MAIN ] Update Progress: 851/2369 symbols completed. FMC took 31.5s. Estimated remaining: 2h 40m 29s. Rate: 9.5 symbols/min [2025-09-16T18:30:01.395118] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:30:01.445086] [DEBUG] [LOCAL ] FNB: Loaded 38602 existing records from primary storage. [2025-09-16T18:30:01.445249] [INFO ] [MAIN ] FNB: Loaded 38602 existing records. [2025-09-16T18:30:01.640444] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:30:01.640712] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-09-16T18:30:01.640762] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-09-16T18:30:01.641799] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-09-16T18:30:01.641858] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-09-16T18:30:01.983161] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-09-16T18:30:02.023750] [INFO ] [REMOTE ] FNB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:30:02.490972] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-16T18:30:02.774922] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-09-16T18:30:02.789675] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-16T18:30:02.794614] [INFO ] [REMOTE ] FMX: Full fetch complete (43684 records). [2025-09-16T18:30:02.794714] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-09-16T18:30:02.795349] [FATAL] [VALIDATOR ] FMX: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:30:02.795447] [FATAL] [MAIN ] FMX: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:30:02.795486] [WARN ] [MAIN ] FMX: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:30:02.795546] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-09-16T18:30:02.795613] [DEBUG] [LOCAL ] FMX: No primary data file found to delete. [2025-09-16T18:30:02.795680] [INFO ] [LOCAL ] FMX: Starting deletion of derivative data. [2025-09-16T18:30:02.795735] [DEBUG] [LOCAL ] FMX: No derivative data file found to delete. [2025-09-16T18:30:02.795794] [INFO ] [MAIN ] Update Progress: 852/2369 symbols completed. FMX took 26.3s. Estimated remaining: 2h 40m 14s. Rate: 9.5 symbols/min [2025-09-16T18:30:02.972345] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:30:03.010245] [DEBUG] [LOCAL ] FND: Loaded 38434 existing records from primary storage. [2025-09-16T18:30:03.010390] [INFO ] [MAIN ] FND: Loaded 38434 existing records. [2025-09-16T18:30:03.190027] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:30:03.190283] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-09-16T18:30:03.190330] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-09-16T18:30:03.191236] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-09-16T18:30:03.191293] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-09-16T18:30:03.548154] [INFO ] [REMOTE ] FND: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:30:03.574898] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-09-16T18:30:04.182078] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-16T18:30:04.374923] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-09-16T18:30:05.092397] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-16T18:30:05.174947] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-09-16T18:30:05.496533] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-16T18:30:05.974915] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-09-16T18:30:06.208240] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-16T18:30:06.774941] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-09-16T18:30:07.243496] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-16T18:30:07.507765] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-16T18:30:07.574929] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-09-16T18:30:08.374922] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-09-16T18:30:08.825202] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-16T18:30:08.826057] [INFO ] [REMOTE ] FMY: Full fetch complete (1511 records). [2025-09-16T18:30:08.826128] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-09-16T18:30:09.183511] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-09-16T18:30:09.189378] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-09-16T18:30:09.189515] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-09-16T18:30:09.189676] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-09-16T18:30:09.189750] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-09-16T18:30:09.190129] [DEBUG] [LOCAL ] FMY: Trimmed 1511 records to 1027 (keeping 150 days of data) [2025-09-16T18:30:09.197171] [DEBUG] [LOCAL ] FMY: Primary data saved (1027 records). [2025-09-16T18:30:09.197243] [INFO ] [MAIN ] FMY: Full history saved. [2025-09-16T18:30:09.197316] [INFO ] [MAIN ] Update Progress: 853/2369 symbols completed. FMY took 18.8s. Estimated remaining: 2h 40m 8s. Rate: 9.5 symbols/min [2025-09-16T18:30:09.373477] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:30:09.403062] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-16T18:30:09.449151] [DEBUG] [LOCAL ] FNF: Loaded 36151 existing records from primary storage. [2025-09-16T18:30:09.449294] [INFO ] [MAIN ] FNF: Loaded 36151 existing records. [2025-09-16T18:30:09.622814] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:30:09.623025] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-09-16T18:30:09.623069] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-09-16T18:30:09.623867] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-09-16T18:30:09.623915] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-09-16T18:30:09.970450] [INFO ] [REMOTE ] FNF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:30:09.974853] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-09-16T18:30:10.774909] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-09-16T18:30:11.134947] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-16T18:30:11.574907] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-09-16T18:30:11.794139] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-16T18:30:12.374881] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-09-16T18:30:12.448269] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-16T18:30:13.174987] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-09-16T18:30:13.235373] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-16T18:30:13.974976] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-09-16T18:30:14.205287] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-16T18:30:14.653574] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-16T18:30:14.774919] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-09-16T18:30:15.402891] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-16T18:30:15.574901] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-09-16T18:30:16.374900] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-09-16T18:30:16.928023] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-16T18:30:17.174941] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-09-16T18:30:17.974951] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-09-16T18:30:18.013474] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-16T18:30:18.095707] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (3.32 seconds). [2025-09-16T18:30:18.329558] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-16T18:30:18.774917] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-09-16T18:30:19.574915] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-09-16T18:30:19.628745] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-16T18:30:19.779527] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-16T18:30:20.374947] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-09-16T18:30:21.111816] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-16T18:30:21.174927] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-09-16T18:30:21.866214] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-16T18:30:21.974948] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-09-16T18:30:22.567575] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-16T18:30:22.774923] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-09-16T18:30:23.525709] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-16T18:30:23.574850] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-09-16T18:30:24.374906] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-09-16T18:30:25.049833] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-09-16T18:30:25.174962] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-09-16T18:30:25.240011] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-16T18:30:25.979974] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-09-16T18:30:25.994275] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-16T18:30:26.001531] [INFO ] [REMOTE ] FNB: Full fetch complete (56937 records). [2025-09-16T18:30:26.001739] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-09-16T18:30:26.385135] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-09-16T18:30:26.385226] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-09-16T18:30:26.386000] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-09-16T18:30:26.386048] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-09-16T18:30:26.387329] [DEBUG] [LOCAL ] FNB: Trimmed 56937 records to 38986 (keeping 150 days of data) [2025-09-16T18:30:26.633410] [DEBUG] [LOCAL ] FNB: Primary data saved (38986 records). [2025-09-16T18:30:26.633570] [INFO ] [MAIN ] FNB: Full history saved. [2025-09-16T18:30:26.633677] [INFO ] [MAIN ] Update Progress: 854/2369 symbols completed. FNB took 25.4s. Estimated remaining: 2h 40m 21s. Rate: 9.4 symbols/min [2025-09-16T18:30:26.784162] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-09-16T18:30:26.814732] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:30:26.849661] [DEBUG] [LOCAL ] FNV: Loaded 33565 existing records from primary storage. [2025-09-16T18:30:26.849825] [INFO ] [MAIN ] FNV: Loaded 33565 existing records. [2025-09-16T18:30:27.041478] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:30:27.042020] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-09-16T18:30:27.042119] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-09-16T18:30:27.043036] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-09-16T18:30:27.043173] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-09-16T18:30:27.208456] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-16T18:30:27.456129] [INFO ] [REMOTE ] FNV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:30:27.574889] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-09-16T18:30:27.718094] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-16T18:30:27.724671] [INFO ] [REMOTE ] FND: Full fetch complete (56675 records). [2025-09-16T18:30:27.724800] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-09-16T18:30:28.123290] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-09-16T18:30:28.123440] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-09-16T18:30:28.124431] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-09-16T18:30:28.124594] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-09-16T18:30:28.125986] [DEBUG] [LOCAL ] FND: Trimmed 56675 records to 38807 (keeping 150 days of data) [2025-09-16T18:30:28.245660] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-16T18:30:28.380135] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-09-16T18:30:28.403738] [DEBUG] [LOCAL ] FND: Primary data saved (38807 records). [2025-09-16T18:30:28.404293] [INFO ] [MAIN ] FND: Full history saved. [2025-09-16T18:30:28.404426] [INFO ] [MAIN ] Update Progress: 855/2369 symbols completed. FND took 25.6s. Estimated remaining: 2h 40m 7s. Rate: 9.5 symbols/min [2025-09-16T18:30:28.575047] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:30:28.585180] [DEBUG] [LOCAL ] FOA: Loaded 9145 existing records from primary storage. [2025-09-16T18:30:28.585299] [INFO ] [MAIN ] FOA: Loaded 9145 existing records. [2025-09-16T18:30:28.764236] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:30:28.764707] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-09-16T18:30:28.764776] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-09-16T18:30:28.765227] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-09-16T18:30:28.765279] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-09-16T18:30:29.083480] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-16T18:30:29.159617] [INFO ] [REMOTE ] FOA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:30:29.174851] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-09-16T18:30:29.974945] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-09-16T18:30:30.070099] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-16T18:30:30.100116] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-16T18:30:30.774909] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-09-16T18:30:31.574879] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-09-16T18:30:31.664153] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-16T18:30:32.374924] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-09-16T18:30:32.474930] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-16T18:30:32.480436] [INFO ] [REMOTE ] FN: Full fetch complete (43431 records). [2025-09-16T18:30:32.480632] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-09-16T18:30:32.926623] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-09-16T18:30:32.926760] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-09-16T18:30:32.927563] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-09-16T18:30:32.927620] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-09-16T18:30:32.929106] [DEBUG] [LOCAL ] FN: Trimmed 43431 records to 28485 (keeping 150 days of data) [2025-09-16T18:30:33.063777] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-16T18:30:33.091742] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-16T18:30:33.178909] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-09-16T18:30:33.191060] [DEBUG] [LOCAL ] FN: Primary data saved (28485 records). [2025-09-16T18:30:33.191228] [INFO ] [MAIN ] FN: Full history saved. [2025-09-16T18:30:33.191334] [INFO ] [MAIN ] Update Progress: 856/2369 symbols completed. FN took 33.1s. Estimated remaining: 2h 39m 58s. Rate: 9.5 symbols/min [2025-09-16T18:30:33.376859] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:30:33.383870] [DEBUG] [LOCAL ] FOF: Loaded 5732 existing records from primary storage. [2025-09-16T18:30:33.383997] [INFO ] [MAIN ] FOF: Loaded 5732 existing records. [2025-09-16T18:30:33.559275] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:30:33.559522] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-09-16T18:30:33.559567] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-09-16T18:30:33.559900] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-09-16T18:30:33.559948] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-09-16T18:30:33.915596] [INFO ] [REMOTE ] FOF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:30:33.974884] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-09-16T18:30:34.683808] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-16T18:30:34.689837] [INFO ] [REMOTE ] FNF: Full fetch complete (53558 records). [2025-09-16T18:30:34.689993] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-09-16T18:30:34.782831] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-09-16T18:30:35.023564] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-16T18:30:35.087456] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-09-16T18:30:35.087537] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-09-16T18:30:35.088331] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-09-16T18:30:35.088391] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-09-16T18:30:35.089514] [DEBUG] [LOCAL ] FNF: Trimmed 53558 records to 36510 (keeping 150 days of data) [2025-09-16T18:30:35.314144] [DEBUG] [LOCAL ] FNF: Primary data saved (36510 records). [2025-09-16T18:30:35.314433] [INFO ] [MAIN ] FNF: Full history saved. [2025-09-16T18:30:35.314528] [INFO ] [MAIN ] Update Progress: 857/2369 symbols completed. FNF took 26.1s. Estimated remaining: 2h 39m 44s. Rate: 9.5 symbols/min [2025-09-16T18:30:35.492017] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:30:35.507162] [DEBUG] [LOCAL ] FOR: Loaded 14480 existing records from primary storage. [2025-09-16T18:30:35.507291] [INFO ] [MAIN ] FOR: Loaded 14480 existing records. [2025-09-16T18:30:35.583932] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-09-16T18:30:35.689162] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:30:35.689442] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-09-16T18:30:35.689488] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-09-16T18:30:35.690128] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-09-16T18:30:35.690179] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-09-16T18:30:36.047121] [INFO ] [REMOTE ] FOR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:30:36.374920] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-09-16T18:30:36.671465] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-16T18:30:36.782360] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-16T18:30:37.174919] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-09-16T18:30:37.220363] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-16T18:30:37.974911] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-09-16T18:30:38.774944] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-09-16T18:30:38.966350] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-16T18:30:38.988939] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-16T18:30:39.358087] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-16T18:30:39.574903] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-09-16T18:30:40.374901] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-09-16T18:30:40.601381] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-16T18:30:41.174906] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-09-16T18:30:41.272332] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-16T18:30:41.888187] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-16T18:30:41.974915] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-09-16T18:30:42.774925] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-09-16T18:30:43.574940] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-09-16T18:30:43.643092] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-16T18:30:43.677039] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-16T18:30:44.119023] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-16T18:30:44.374944] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-09-16T18:30:45.174901] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-09-16T18:30:45.252052] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-16T18:30:45.974931] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-09-16T18:30:46.065465] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-16T18:30:46.560266] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-16T18:30:46.774920] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-09-16T18:30:47.325983] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-16T18:30:47.574948] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-09-16T18:30:48.130971] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-16T18:30:48.374951] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-09-16T18:30:49.174925] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-09-16T18:30:49.235387] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-16T18:30:49.974919] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-09-16T18:30:50.428867] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-16T18:30:50.774930] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-09-16T18:30:50.958884] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-16T18:30:50.961198] [INFO ] [REMOTE ] FOA: Full fetch complete (14596 records). [2025-09-16T18:30:50.961363] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-09-16T18:30:50.961970] [FATAL] [VALIDATOR ] FOA: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:30:50.962046] [FATAL] [MAIN ] FOA: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:30:50.962082] [WARN ] [MAIN ] FOA: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:30:50.962119] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-09-16T18:30:50.962188] [DEBUG] [LOCAL ] FOA: No primary data file found to delete. [2025-09-16T18:30:50.962247] [INFO ] [LOCAL ] FOA: Starting deletion of derivative data. [2025-09-16T18:30:50.962559] [DEBUG] [LOCAL ] FOA: Deleted derivative data file. [2025-09-16T18:30:50.962636] [INFO ] [MAIN ] Update Progress: 858/2369 symbols completed. FOA took 22.6s. Estimated remaining: 2h 39m 54s. Rate: 9.4 symbols/min [2025-09-16T18:30:51.135497] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:30:51.168560] [DEBUG] [LOCAL ] FOUR: Loaded 36302 existing records from primary storage. [2025-09-16T18:30:51.168723] [INFO ] [MAIN ] FOUR: Loaded 36302 existing records. [2025-09-16T18:30:51.351200] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:30:51.351444] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-09-16T18:30:51.351492] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-09-16T18:30:51.352243] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-09-16T18:30:51.352292] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-09-16T18:30:51.577282] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-09-16T18:30:51.660368] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-16T18:30:51.665543] [INFO ] [REMOTE ] FOF: Full fetch complete (8703 records). [2025-09-16T18:30:51.671149] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-09-16T18:30:51.832142] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:30:52.126375] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-09-16T18:30:52.126455] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-09-16T18:30:52.126709] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-09-16T18:30:52.126753] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-09-16T18:30:52.127182] [DEBUG] [LOCAL ] FOF: Trimmed 8703 records to 5797 (keeping 150 days of data) [2025-09-16T18:30:52.163990] [DEBUG] [LOCAL ] FOF: Primary data saved (5797 records). [2025-09-16T18:30:52.164133] [INFO ] [MAIN ] FOF: Full history saved. [2025-09-16T18:30:52.164221] [INFO ] [MAIN ] Update Progress: 859/2369 symbols completed. FOF took 19.0s. Estimated remaining: 2h 39m 39s. Rate: 9.5 symbols/min [2025-09-16T18:30:52.352505] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:30:52.367364] [DEBUG] [LOCAL ] FPF: Loaded 12774 existing records from primary storage. [2025-09-16T18:30:52.367486] [INFO ] [MAIN ] FPF: Loaded 12774 existing records. [2025-09-16T18:30:52.380109] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-09-16T18:30:52.550102] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:30:52.550462] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-09-16T18:30:52.550517] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-09-16T18:30:52.556230] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-09-16T18:30:52.562984] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-09-16T18:30:52.569401] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-16T18:30:52.926402] [INFO ] [REMOTE ] FPF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:30:53.174909] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-09-16T18:30:53.974964] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-09-16T18:30:54.162749] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-16T18:30:54.224758] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-16T18:30:54.774899] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-09-16T18:30:54.908852] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-16T18:30:55.574905] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-09-16T18:30:56.374962] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-09-16T18:30:56.537345] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-16T18:30:56.664158] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-16T18:30:57.174960] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-09-16T18:30:57.345604] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-16T18:30:57.349326] [INFO ] [REMOTE ] FOR: Full fetch complete (22350 records). [2025-09-16T18:30:57.349464] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-09-16T18:30:57.754792] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-09-16T18:30:57.754899] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-09-16T18:30:57.755411] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-09-16T18:30:57.755466] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-09-16T18:30:57.756369] [DEBUG] [LOCAL ] FOR: Trimmed 22350 records to 14590 (keeping 150 days of data) [2025-09-16T18:30:57.853875] [DEBUG] [LOCAL ] FOR: Primary data saved (14590 records). [2025-09-16T18:30:57.854107] [INFO ] [MAIN ] FOR: Full history saved. [2025-09-16T18:30:57.854238] [INFO ] [MAIN ] Update Progress: 860/2369 symbols completed. FOR took 22.5s. Estimated remaining: 2h 39m 31s. Rate: 9.5 symbols/min [2025-09-16T18:30:57.980889] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-09-16T18:30:58.121706] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:30:58.140137] [DEBUG] [LOCAL ] FPH: Loaded 14437 existing records from primary storage. [2025-09-16T18:30:58.140325] [INFO ] [MAIN ] FPH: Loaded 14437 existing records. [2025-09-16T18:30:58.433549] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:30:58.433918] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-09-16T18:30:58.434013] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-09-16T18:30:58.434491] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-09-16T18:30:58.434556] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-09-16T18:30:58.788933] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-09-16T18:30:58.918914] [INFO ] [REMOTE ] FPH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:30:59.210549] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-16T18:30:59.258320] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-16T18:30:59.574904] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-09-16T18:31:00.374914] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-09-16T18:31:00.585898] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-16T18:31:00.590901] [INFO ] [REMOTE ] FNV: Full fetch complete (49997 records). [2025-09-16T18:31:00.591020] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-09-16T18:31:00.592292] [FATAL] [VALIDATOR ] FNV: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:31:00.592558] [FATAL] [MAIN ] FNV: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:31:00.592596] [WARN ] [MAIN ] FNV: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:31:00.592687] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-09-16T18:31:00.592749] [DEBUG] [LOCAL ] FNV: No primary data file found to delete. [2025-09-16T18:31:00.592786] [INFO ] [LOCAL ] FNV: Starting deletion of derivative data. [2025-09-16T18:31:00.593007] [DEBUG] [LOCAL ] FNV: Deleted derivative data file. [2025-09-16T18:31:00.593086] [INFO ] [MAIN ] Update Progress: 861/2369 symbols completed. FNV took 34.0s. Estimated remaining: 2h 39m 19s. Rate: 9.5 symbols/min [2025-09-16T18:31:00.769782] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:31:00.769985] [DEBUG] [LOCAL ] FPI: No existing data file found in primary storage. [2025-09-16T18:31:00.770025] [WARN ] [MAIN ] FPI: No existing data found, performing full refresh instead. [2025-09-16T18:31:00.770161] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-09-16T18:31:00.770200] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-09-16T18:31:00.770251] [DEBUG] [LOCAL ] FPI: No primary data file found to delete. [2025-09-16T18:31:00.770284] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-09-16T18:31:01.127264] [INFO ] [REMOTE ] FPI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:31:01.174884] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-09-16T18:31:01.708055] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-16T18:31:01.974953] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-09-16T18:31:02.249715] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-16T18:31:02.329224] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-16T18:31:02.774900] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-09-16T18:31:03.490496] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-16T18:31:03.574905] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-09-16T18:31:04.124252] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-16T18:31:04.374873] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-09-16T18:31:04.710036] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-16T18:31:05.174903] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-09-16T18:31:05.974912] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-09-16T18:31:06.153198] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-16T18:31:06.327813] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-16T18:31:06.774946] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-09-16T18:31:07.143164] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-16T18:31:07.574921] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-09-16T18:31:08.374881] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-09-16T18:31:08.451183] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-16T18:31:08.777704] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-16T18:31:09.174944] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-09-16T18:31:09.827244] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-16T18:31:09.974905] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-09-16T18:31:10.168808] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-16T18:31:10.774944] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-09-16T18:31:11.501440] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-16T18:31:11.574974] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-09-16T18:31:11.649494] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-16T18:31:12.374970] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-09-16T18:31:12.684118] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-16T18:31:13.174937] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-09-16T18:31:13.429425] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-16T18:31:13.903742] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-16T18:31:13.974970] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-09-16T18:31:14.774942] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-09-16T18:31:14.909605] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-16T18:31:15.518685] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-16T18:31:15.520944] [INFO ] [REMOTE ] FPF: Full fetch complete (19012 records). [2025-09-16T18:31:15.521048] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-09-16T18:31:15.584409] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-09-16T18:31:15.895423] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-09-16T18:31:15.895515] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-09-16T18:31:15.896110] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-09-16T18:31:15.896154] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-09-16T18:31:15.896907] [DEBUG] [LOCAL ] FPF: Trimmed 19012 records to 12881 (keeping 150 days of data) [2025-09-16T18:31:15.980025] [DEBUG] [LOCAL ] FPF: Primary data saved (12881 records). [2025-09-16T18:31:15.980155] [INFO ] [MAIN ] FPF: Full history saved. [2025-09-16T18:31:15.980251] [INFO ] [MAIN ] Update Progress: 862/2369 symbols completed. FPF took 23.8s. Estimated remaining: 2h 39m 28s. Rate: 9.5 symbols/min [2025-09-16T18:31:16.158585] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:31:16.194728] [DEBUG] [LOCAL ] FR: Loaded 34195 existing records from primary storage. [2025-09-16T18:31:16.194866] [INFO ] [MAIN ] FR: Loaded 34195 existing records. [2025-09-16T18:31:16.383142] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:31:16.383206] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-09-16T18:31:16.390631] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-09-16T18:31:16.392581] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-09-16T18:31:16.393765] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-16T18:31:16.398504] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-09-16T18:31:16.398561] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-09-16T18:31:16.751027] [INFO ] [REMOTE ] FR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:31:17.174922] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-09-16T18:31:17.974935] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-09-16T18:31:18.456241] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-16T18:31:18.713910] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-16T18:31:18.774913] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-09-16T18:31:19.231770] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-16T18:31:19.559282] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-16T18:31:19.562147] [INFO ] [REMOTE ] FPH: Full fetch complete (22086 records). [2025-09-16T18:31:19.562218] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-09-16T18:31:19.580024] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-09-16T18:31:19.949209] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-09-16T18:31:19.949289] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-09-16T18:31:19.949797] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-09-16T18:31:19.949844] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-09-16T18:31:19.950413] [DEBUG] [LOCAL ] FPH: Trimmed 22086 records to 14629 (keeping 150 days of data) [2025-09-16T18:31:20.037284] [DEBUG] [LOCAL ] FPH: Primary data saved (14629 records). [2025-09-16T18:31:20.037469] [INFO ] [MAIN ] FPH: Full history saved. [2025-09-16T18:31:20.037569] [INFO ] [MAIN ] Update Progress: 863/2369 symbols completed. FPH took 22.2s. Estimated remaining: 2h 39m 18s. Rate: 9.5 symbols/min [2025-09-16T18:31:20.215694] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:31:20.227494] [DEBUG] [LOCAL ] FRA: Loaded 9987 existing records from primary storage. [2025-09-16T18:31:20.227617] [INFO ] [MAIN ] FRA: Loaded 9987 existing records. [2025-09-16T18:31:20.380301] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-09-16T18:31:20.420928] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:31:20.421165] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-09-16T18:31:20.421224] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-09-16T18:31:20.421634] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-09-16T18:31:20.421707] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-09-16T18:31:20.796746] [INFO ] [REMOTE ] FRA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:31:20.808088] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-16T18:31:21.174914] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-09-16T18:31:21.975077] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-09-16T18:31:21.994708] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-16T18:31:22.774916] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-09-16T18:31:23.574882] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-09-16T18:31:23.766594] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (3.39 seconds). [2025-09-16T18:31:23.980209] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-16T18:31:24.374915] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-09-16T18:31:24.650040] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-16T18:31:25.174919] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-09-16T18:31:25.892805] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-09-16T18:31:25.897453] [INFO ] [REMOTE ] FPI: Full fetch complete (33901 records). [2025-09-16T18:31:25.897605] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-09-16T18:31:25.991072] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-09-16T18:31:26.293318] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-16T18:31:26.312467] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-09-16T18:31:26.312552] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-09-16T18:31:26.313211] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-09-16T18:31:26.313429] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-09-16T18:31:26.313356] [INFO ] [REMOTE ] FOUR: Full fetch complete (54071 records). [2025-09-16T18:31:26.313712] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-09-16T18:31:26.349548] [DEBUG] [LOCAL ] FPI: Trimmed 33901 records to 23420 (keeping 150 days of data) [2025-09-16T18:31:26.828226] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-09-16T18:31:26.828619] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-09-16T18:31:26.831832] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-09-16T18:31:26.832265] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-09-16T18:31:26.836866] [DEBUG] [LOCAL ] FOUR: Trimmed 54071 records to 36659 (keeping 150 days of data) [2025-09-16T18:31:26.967299] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-16T18:31:26.987795] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-09-16T18:31:27.037690] [DEBUG] [LOCAL ] FPI: Primary data saved (23420 records). [2025-09-16T18:31:27.038882] [INFO ] [MAIN ] FPI: Full history saved. [2025-09-16T18:31:27.039023] [INFO ] [MAIN ] Update Progress: 864/2369 symbols completed. FPI took 26.4s. Estimated remaining: 2h 39m 12s. Rate: 9.5 symbols/min [2025-09-16T18:31:27.337519] [DEBUG] [LOCAL ] FOUR: Primary data saved (36659 records). [2025-09-16T18:31:27.341835] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:31:27.342339] [DEBUG] [LOCAL ] FRGE: No existing data file found in primary storage. [2025-09-16T18:31:27.342247] [INFO ] [MAIN ] FOUR: Full history saved. [2025-09-16T18:31:27.342431] [WARN ] [MAIN ] FRGE: No existing data found, performing full refresh instead. [2025-09-16T18:31:27.342626] [INFO ] [MAIN ] Update Progress: 865/2369 symbols completed. FOUR took 36.4s. Estimated remaining: 2h 38m 56s. Rate: 9.5 symbols/min [2025-09-16T18:31:27.343193] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-09-16T18:31:27.348520] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-09-16T18:31:27.376227] [DEBUG] [LOCAL ] FRGE: No primary data file found to delete. [2025-09-16T18:31:27.389445] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-09-16T18:31:27.594405] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-16T18:31:27.649215] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:31:27.649867] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-09-16T18:31:27.931308] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:31:27.943251] [DEBUG] [LOCAL ] FRO: Loaded 38124 existing records from primary storage. [2025-09-16T18:31:27.943362] [INFO ] [MAIN ] FRO: Loaded 38124 existing records. [2025-09-16T18:31:28.118305] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:31:28.118559] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-09-16T18:31:28.118610] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-09-16T18:31:28.119579] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-09-16T18:31:28.119627] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-09-16T18:31:28.380014] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-09-16T18:31:28.496976] [INFO ] [REMOTE ] FRO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:31:28.505768] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-16T18:31:28.631550] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-16T18:31:29.174909] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-09-16T18:31:29.365237] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-16T18:31:29.852361] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-16T18:31:29.974915] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-09-16T18:31:30.774912] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-09-16T18:31:31.006314] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-16T18:31:31.574918] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-09-16T18:31:32.374903] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-09-16T18:31:32.459169] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-16T18:31:32.727691] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-16T18:31:33.174907] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-09-16T18:31:33.974908] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-09-16T18:31:34.137888] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-16T18:31:34.303799] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-16T18:31:34.774904] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-09-16T18:31:35.419837] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-16T18:31:35.422296] [INFO ] [REMOTE ] FRA: Full fetch complete (16457 records). [2025-09-16T18:31:35.422390] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-09-16T18:31:35.580627] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-09-16T18:31:35.827390] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-09-16T18:31:35.827522] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-09-16T18:31:35.827982] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-09-16T18:31:35.828082] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-09-16T18:31:35.829574] [DEBUG] [LOCAL ] FRA: Trimmed 16457 records to 10140 (keeping 150 days of data) [2025-09-16T18:31:35.896397] [DEBUG] [LOCAL ] FRA: Primary data saved (10140 records). [2025-09-16T18:31:35.896557] [INFO ] [MAIN ] FRA: Full history saved. [2025-09-16T18:31:35.896715] [INFO ] [MAIN ] Update Progress: 866/2369 symbols completed. FRA took 15.9s. Estimated remaining: 2h 38m 53s. Rate: 9.5 symbols/min [2025-09-16T18:31:36.074238] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:31:36.074413] [DEBUG] [LOCAL ] FRT: No existing data file found in primary storage. [2025-09-16T18:31:36.074531] [WARN ] [MAIN ] FRT: No existing data found, performing full refresh instead. [2025-09-16T18:31:36.074872] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-09-16T18:31:36.074934] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-09-16T18:31:36.075221] [DEBUG] [LOCAL ] FRT: No primary data file found to delete. [2025-09-16T18:31:36.075300] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-09-16T18:31:36.230770] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-16T18:31:36.379955] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-09-16T18:31:36.485421] [INFO ] [REMOTE ] FRT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:31:36.886199] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-16T18:31:37.174961] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-09-16T18:31:37.965461] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-16T18:31:37.975823] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-09-16T18:31:38.439889] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-16T18:31:38.774904] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-09-16T18:31:39.004999] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-16T18:31:39.574921] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-09-16T18:31:40.374907] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-09-16T18:31:40.387530] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-16T18:31:40.424003] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-16T18:31:41.174956] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-09-16T18:31:41.901810] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-16T18:31:41.974847] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-09-16T18:31:42.774949] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-09-16T18:31:42.951256] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-16T18:31:43.574980] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-09-16T18:31:43.860394] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-16T18:31:44.375021] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-09-16T18:31:44.411872] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-16T18:31:44.417723] [INFO ] [REMOTE ] FR: Full fetch complete (50673 records). [2025-09-16T18:31:44.417875] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-09-16T18:31:44.801576] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-09-16T18:31:44.801673] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-09-16T18:31:44.802450] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-09-16T18:31:44.802493] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-09-16T18:31:44.803513] [DEBUG] [LOCAL ] FR: Trimmed 50673 records to 34514 (keeping 150 days of data) [2025-09-16T18:31:45.013557] [DEBUG] [LOCAL ] FR: Primary data saved (34514 records). [2025-09-16T18:31:45.013693] [INFO ] [MAIN ] FR: Full history saved. [2025-09-16T18:31:45.018533] [INFO ] [MAIN ] Update Progress: 867/2369 symbols completed. FR took 29.0s. Estimated remaining: 2h 38m 52s. Rate: 9.5 symbols/min [2025-09-16T18:31:45.188724] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:31:45.186512] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-09-16T18:31:45.188886] [DEBUG] [LOCAL ] FSCO: No existing data file found in primary storage. [2025-09-16T18:31:45.189604] [WARN ] [MAIN ] FSCO: No existing data found, performing full refresh instead. [2025-09-16T18:31:45.189764] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-09-16T18:31:45.189819] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-09-16T18:31:45.189880] [DEBUG] [LOCAL ] FSCO: No primary data file found to delete. [2025-09-16T18:31:45.189926] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-09-16T18:31:45.565077] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:31:45.560693] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-16T18:31:45.599919] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-16T18:31:45.974915] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-09-16T18:31:46.774875] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-09-16T18:31:46.989665] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-16T18:31:47.438059] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-16T18:31:47.574911] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-09-16T18:31:47.598682] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-16T18:31:48.374976] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-09-16T18:31:49.174949] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-09-16T18:31:49.269631] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-16T18:31:49.744813] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-16T18:31:49.974939] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-09-16T18:31:50.758592] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-16T18:31:50.774914] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-09-16T18:31:51.574892] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-09-16T18:31:51.648502] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-16T18:31:52.149429] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-16T18:31:52.374899] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-09-16T18:31:52.450106] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-16T18:31:52.451954] [INFO ] [REMOTE ] FRGE: Full fetch complete (22065 records). [2025-09-16T18:31:52.452023] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-09-16T18:31:52.820683] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-09-16T18:31:52.820770] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-09-16T18:31:52.821313] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-09-16T18:31:52.821361] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-09-16T18:31:52.822023] [DEBUG] [LOCAL ] FRGE: Trimmed 22065 records to 11551 (keeping 150 days of data) [2025-09-16T18:31:52.892382] [DEBUG] [LOCAL ] FRGE: Primary data saved (11551 records). [2025-09-16T18:31:52.892520] [INFO ] [MAIN ] FRGE: Full history saved. [2025-09-16T18:31:52.892597] [INFO ] [MAIN ] Update Progress: 868/2369 symbols completed. FRGE took 25.9s. Estimated remaining: 2h 38m 48s. Rate: 9.5 symbols/min [2025-09-16T18:31:53.062085] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:31:53.100938] [DEBUG] [LOCAL ] FSK: Loaded 35641 existing records from primary storage. [2025-09-16T18:31:53.101078] [INFO ] [MAIN ] FSK: Loaded 35641 existing records. [2025-09-16T18:31:53.179970] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-09-16T18:31:53.289837] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:31:53.290101] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-09-16T18:31:53.290170] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-09-16T18:31:53.291007] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-09-16T18:31:53.291059] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-09-16T18:31:53.691397] [INFO ] [REMOTE ] FSK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:31:53.974952] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-09-16T18:31:54.013037] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-16T18:31:54.020225] [INFO ] [REMOTE ] FRO: Full fetch complete (56522 records). [2025-09-16T18:31:54.020392] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-09-16T18:31:54.436968] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-09-16T18:31:54.437092] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-09-16T18:31:54.438139] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-09-16T18:31:54.438207] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-09-16T18:31:54.440027] [DEBUG] [LOCAL ] FRO: Trimmed 56522 records to 38509 (keeping 150 days of data) [2025-09-16T18:31:54.695634] [DEBUG] [LOCAL ] FRO: Primary data saved (38509 records). [2025-09-16T18:31:54.695798] [INFO ] [MAIN ] FRO: Full history saved. [2025-09-16T18:31:54.695901] [INFO ] [MAIN ] Update Progress: 869/2369 symbols completed. FRO took 27.4s. Estimated remaining: 2h 38m 34s. Rate: 9.5 symbols/min [2025-09-16T18:31:54.777232] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-09-16T18:31:54.871425] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:31:54.896364] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-16T18:31:54.937550] [DEBUG] [LOCAL ] FSLY: Loaded 37625 existing records from primary storage. [2025-09-16T18:31:54.937780] [INFO ] [MAIN ] FSLY: Loaded 37625 existing records. [2025-09-16T18:31:55.118869] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:31:55.119218] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-09-16T18:31:55.119272] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-09-16T18:31:55.120330] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-09-16T18:31:55.120382] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-09-16T18:31:55.495338] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:31:55.574907] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-09-16T18:31:55.698727] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-16T18:31:56.374916] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-09-16T18:31:56.561096] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-16T18:31:56.761669] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-16T18:31:57.174940] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-09-16T18:31:57.974905] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-09-16T18:31:58.249832] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-16T18:31:58.311386] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-16T18:31:58.774913] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-09-16T18:31:59.507615] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-16T18:31:59.574860] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-09-16T18:32:00.374908] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-09-16T18:32:00.693844] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-16T18:32:01.160915] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-16T18:32:01.166718] [INFO ] [REMOTE ] FRT: Full fetch complete (45998 records). [2025-09-16T18:32:01.166866] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-09-16T18:32:01.180187] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-09-16T18:32:01.558072] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present. [2025-09-16T18:32:01.558157] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed. [2025-09-16T18:32:01.558943] [INFO ] [MAIN ] FRT: Fetched primary data is valid. [2025-09-16T18:32:01.558999] [DEBUG] [LOCAL ] FRT: Saving primary data. [2025-09-16T18:32:01.560028] [DEBUG] [LOCAL ] FRT: Trimmed 45998 records to 31128 (keeping 150 days of data) [2025-09-16T18:32:01.759803] [DEBUG] [LOCAL ] FRT: Primary data saved (31128 records). [2025-09-16T18:32:01.759954] [INFO ] [MAIN ] FRT: Full history saved. [2025-09-16T18:32:01.760065] [INFO ] [MAIN ] Update Progress: 870/2369 symbols completed. FRT took 25.9s. Estimated remaining: 2h 38m 29s. Rate: 9.5 symbols/min [2025-09-16T18:32:01.938239] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:32:01.980070] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-09-16T18:32:01.987942] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-16T18:32:02.024874] [DEBUG] [LOCAL ] FSM: Loaded 39280 existing records from primary storage. [2025-09-16T18:32:02.025029] [INFO ] [MAIN ] FSM: Loaded 39280 existing records. [2025-09-16T18:32:02.212889] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:32:02.213158] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-09-16T18:32:02.213204] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-09-16T18:32:02.213966] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-09-16T18:32:02.214014] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-09-16T18:32:02.576871] [INFO ] [REMOTE ] FSM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:32:02.618251] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-16T18:32:02.774935] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-09-16T18:32:03.575071] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-09-16T18:32:03.682507] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-16T18:32:04.374915] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-09-16T18:32:04.471702] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-16T18:32:05.174919] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-09-16T18:32:05.876663] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-16T18:32:05.917546] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-09-16T18:32:05.974903] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-09-16T18:32:06.614102] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-16T18:32:06.774900] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-09-16T18:32:07.574906] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-09-16T18:32:07.730339] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-16T18:32:08.151269] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-16T18:32:08.158355] [INFO ] [REMOTE ] FSCO: Full fetch complete (39927 records). [2025-09-16T18:32:08.158460] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-09-16T18:32:08.380023] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-09-16T18:32:08.531992] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-09-16T18:32:08.532069] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-09-16T18:32:08.532719] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-09-16T18:32:08.532765] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-09-16T18:32:08.533631] [DEBUG] [LOCAL ] FSCO: Trimmed 39927 records to 27172 (keeping 150 days of data) [2025-09-16T18:32:08.699031] [DEBUG] [LOCAL ] FSCO: Primary data saved (27172 records). [2025-09-16T18:32:08.699169] [INFO ] [MAIN ] FSCO: Full history saved. [2025-09-16T18:32:08.699257] [INFO ] [MAIN ] Update Progress: 871/2369 symbols completed. FSCO took 23.7s. Estimated remaining: 2h 38m 23s. Rate: 9.5 symbols/min [2025-09-16T18:32:08.870278] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:32:08.894205] [DEBUG] [LOCAL ] FSS: Loaded 24725 existing records from primary storage. [2025-09-16T18:32:08.894361] [INFO ] [MAIN ] FSS: Loaded 24725 existing records. [2025-09-16T18:32:09.069381] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:32:09.069624] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-09-16T18:32:09.069688] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-09-16T18:32:09.070387] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-09-16T18:32:09.070436] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-09-16T18:32:09.183984] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-09-16T18:32:09.431379] [INFO ] [REMOTE ] FSS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:32:09.464098] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-16T18:32:09.974899] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-09-16T18:32:10.287424] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-16T18:32:10.774938] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-09-16T18:32:11.079529] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-16T18:32:11.462172] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-16T18:32:11.574908] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-09-16T18:32:12.183750] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-16T18:32:12.374922] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-09-16T18:32:13.174902] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-09-16T18:32:13.553859] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-16T18:32:13.960367] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-16T18:32:13.974851] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-09-16T18:32:14.774926] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-09-16T18:32:15.198658] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-16T18:32:15.262143] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-16T18:32:15.574897] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-09-16T18:32:16.374900] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-09-16T18:32:16.700771] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-16T18:32:17.174967] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-09-16T18:32:17.520399] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-16T18:32:17.722115] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-16T18:32:17.974907] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-09-16T18:32:18.597832] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-16T18:32:18.604129] [INFO ] [REMOTE ] FSK: Full fetch complete (53655 records). [2025-09-16T18:32:18.604248] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-09-16T18:32:18.777955] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-09-16T18:32:18.984218] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-09-16T18:32:18.984299] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-09-16T18:32:18.985147] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-09-16T18:32:18.985236] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-09-16T18:32:18.986472] [DEBUG] [LOCAL ] FSK: Trimmed 53655 records to 36028 (keeping 150 days of data) [2025-09-16T18:32:19.210609] [DEBUG] [LOCAL ] FSK: Primary data saved (36028 records). [2025-09-16T18:32:19.210773] [INFO ] [MAIN ] FSK: Full history saved. [2025-09-16T18:32:19.210861] [INFO ] [MAIN ] Update Progress: 872/2369 symbols completed. FSK took 26.3s. Estimated remaining: 2h 38m 24s. Rate: 9.5 symbols/min [2025-09-16T18:32:19.416662] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:32:19.437263] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-16T18:32:19.446213] [DEBUG] [LOCAL ] FT: Loaded 4670 existing records from primary storage. [2025-09-16T18:32:19.446558] [INFO ] [MAIN ] FT: Loaded 4670 existing records. [2025-09-16T18:32:19.587371] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-09-16T18:32:19.624548] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:32:19.624770] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-09-16T18:32:19.624820] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-09-16T18:32:19.625035] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-09-16T18:32:19.625081] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-09-16T18:32:19.979630] [INFO ] [REMOTE ] FT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:32:20.374882] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-09-16T18:32:20.740533] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-16T18:32:20.822597] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-16T18:32:21.174873] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-09-16T18:32:21.277059] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-16T18:32:21.974967] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-09-16T18:32:22.384923] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-16T18:32:22.774918] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-09-16T18:32:23.574933] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-09-16T18:32:23.684984] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-16T18:32:23.948631] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-16T18:32:24.374895] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-09-16T18:32:25.130919] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-16T18:32:25.174892] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-09-16T18:32:25.974879] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-09-16T18:32:26.022938] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-16T18:32:26.026090] [INFO ] [REMOTE ] FSS: Full fetch complete (37938 records). [2025-09-16T18:32:26.026179] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-09-16T18:32:26.026740] [FATAL] [VALIDATOR ] FSS: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:32:26.026815] [FATAL] [MAIN ] FSS: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:32:26.026852] [WARN ] [MAIN ] FSS: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:32:26.026889] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-09-16T18:32:26.027000] [DEBUG] [LOCAL ] FSS: No primary data file found to delete. [2025-09-16T18:32:26.027038] [INFO ] [LOCAL ] FSS: Starting deletion of derivative data. [2025-09-16T18:32:26.027386] [DEBUG] [LOCAL ] FSS: Deleted derivative data file. [2025-09-16T18:32:26.027465] [INFO ] [MAIN ] Update Progress: 873/2369 symbols completed. FSS took 17.3s. Estimated remaining: 2h 38m 19s. Rate: 9.4 symbols/min [2025-09-16T18:32:26.196069] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:32:26.205331] [DEBUG] [LOCAL ] FTHY: Loaded 8497 existing records from primary storage. [2025-09-16T18:32:26.205431] [INFO ] [MAIN ] FTHY: Loaded 8497 existing records. [2025-09-16T18:32:26.392712] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:32:26.392966] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-09-16T18:32:26.393017] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-09-16T18:32:26.393323] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-09-16T18:32:26.393369] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-09-16T18:32:26.680947] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-16T18:32:26.760115] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:32:26.774867] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-09-16T18:32:27.367698] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-16T18:32:27.374306] [INFO ] [REMOTE ] FSLY: Full fetch complete (55900 records). [2025-09-16T18:32:27.374479] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-09-16T18:32:27.580945] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-09-16T18:32:27.757553] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-09-16T18:32:27.757633] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-09-16T18:32:27.758449] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-09-16T18:32:27.758494] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-09-16T18:32:27.759664] [DEBUG] [LOCAL ] FSLY: Trimmed 55900 records to 38013 (keeping 150 days of data) [2025-09-16T18:32:27.978872] [DEBUG] [LOCAL ] FSLY: Primary data saved (38013 records). [2025-09-16T18:32:27.979097] [INFO ] [MAIN ] FSLY: Full history saved. [2025-09-16T18:32:27.979197] [INFO ] [MAIN ] Update Progress: 874/2369 symbols completed. FSLY took 33.3s. Estimated remaining: 2h 38m 5s. Rate: 9.5 symbols/min [2025-09-16T18:32:28.153994] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:32:28.154162] [DEBUG] [LOCAL ] FTI: No existing data file found in primary storage. [2025-09-16T18:32:28.154204] [WARN ] [MAIN ] FTI: No existing data found, performing full refresh instead. [2025-09-16T18:32:28.154364] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-09-16T18:32:28.154406] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-09-16T18:32:28.154448] [DEBUG] [LOCAL ] FTI: No primary data file found to delete. [2025-09-16T18:32:28.154483] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-09-16T18:32:28.307755] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-16T18:32:28.383309] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-09-16T18:32:28.531765] [INFO ] [REMOTE ] FTI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:32:28.564164] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-16T18:32:28.906166] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-16T18:32:29.174964] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-09-16T18:32:29.641966] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-16T18:32:29.974910] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-09-16T18:32:30.526855] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-16T18:32:30.774920] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-09-16T18:32:31.574910] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-09-16T18:32:31.587475] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-16T18:32:32.374900] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-09-16T18:32:32.978321] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-16T18:32:32.992766] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-16T18:32:33.000991] [INFO ] [REMOTE ] FSM: Full fetch complete (57910 records). [2025-09-16T18:32:33.001162] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-09-16T18:32:33.186227] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-09-16T18:32:33.411557] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-09-16T18:32:33.411692] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-09-16T18:32:33.412706] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-09-16T18:32:33.412782] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-09-16T18:32:33.414231] [DEBUG] [LOCAL ] FSM: Trimmed 57910 records to 39669 (keeping 150 days of data) [2025-09-16T18:32:33.654592] [DEBUG] [LOCAL ] FSM: Primary data saved (39669 records). [2025-09-16T18:32:33.654970] [INFO ] [MAIN ] FSM: Full history saved. [2025-09-16T18:32:33.655118] [INFO ] [MAIN ] Update Progress: 875/2369 symbols completed. FSM took 31.9s. Estimated remaining: 2h 37m 57s. Rate: 9.5 symbols/min [2025-09-16T18:32:33.837691] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:32:33.841703] [DEBUG] [LOCAL ] FTK: No existing data file found in primary storage. [2025-09-16T18:32:33.841611] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-16T18:32:33.841830] [WARN ] [MAIN ] FTK: No existing data found, performing full refresh instead. [2025-09-16T18:32:33.843168] [INFO ] [REMOTE ] FT: Full fetch complete (6714 records). [2025-09-16T18:32:33.843300] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-09-16T18:32:33.843448] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-09-16T18:32:33.888833] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-09-16T18:32:33.916335] [DEBUG] [LOCAL ] FTK: No primary data file found to delete. [2025-09-16T18:32:33.922747] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-09-16T18:32:33.979981] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-09-16T18:32:34.550147] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-09-16T18:32:34.567506] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-09-16T18:32:34.568883] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-09-16T18:32:34.584130] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-09-16T18:32:34.588617] [INFO ] [REMOTE ] FTK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:32:34.590062] [DEBUG] [LOCAL ] FT: Trimmed 6714 records to 4736 (keeping 150 days of data) [2025-09-16T18:32:34.618802] [DEBUG] [LOCAL ] FT: Primary data saved (4736 records). [2025-09-16T18:32:34.618966] [INFO ] [MAIN ] FT: Full history saved. [2025-09-16T18:32:34.619067] [INFO ] [MAIN ] Update Progress: 876/2369 symbols completed. FT took 15.4s. Estimated remaining: 2h 37m 42s. Rate: 9.5 symbols/min [2025-09-16T18:32:34.783934] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-09-16T18:32:34.802813] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:32:34.816383] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-16T18:32:34.848241] [DEBUG] [LOCAL ] FTS: Loaded 31167 existing records from primary storage. [2025-09-16T18:32:34.848385] [INFO ] [MAIN ] FTS: Loaded 31167 existing records. [2025-09-16T18:32:35.032262] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:32:35.032530] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-09-16T18:32:35.032576] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-09-16T18:32:35.033402] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-09-16T18:32:35.033451] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-09-16T18:32:35.392389] [INFO ] [REMOTE ] FTS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:32:35.574873] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-09-16T18:32:36.271183] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-16T18:32:36.374920] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-09-16T18:32:36.614891] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-16T18:32:37.129845] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-16T18:32:37.174873] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-09-16T18:32:37.974924] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-09-16T18:32:38.186748] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-16T18:32:38.656990] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-16T18:32:38.774922] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-09-16T18:32:39.574939] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-09-16T18:32:39.913839] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-16T18:32:40.347344] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-16T18:32:40.374865] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-09-16T18:32:40.879451] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-16T18:32:41.174905] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-09-16T18:32:41.975017] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-09-16T18:32:41.975716] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-16T18:32:42.774957] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-09-16T18:32:43.323587] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-16T18:32:43.574983] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-09-16T18:32:43.683750] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-16T18:32:44.374928] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-09-16T18:32:44.426971] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-16T18:32:45.174917] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-09-16T18:32:45.594243] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-16T18:32:45.974910] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-09-16T18:32:46.380269] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-16T18:32:46.774902] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-09-16T18:32:47.574925] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-09-16T18:32:48.013375] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-16T18:32:48.374944] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-09-16T18:32:48.422424] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-16T18:32:48.506170] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-16T18:32:48.508132] [INFO ] [REMOTE ] FTHY: Full fetch complete (12682 records). [2025-09-16T18:32:48.508202] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-09-16T18:32:48.871156] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-09-16T18:32:48.871244] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-09-16T18:32:48.871569] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-09-16T18:32:48.871617] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-09-16T18:32:48.872212] [DEBUG] [LOCAL ] FTHY: Trimmed 12682 records to 8557 (keeping 150 days of data) [2025-09-16T18:32:48.925749] [DEBUG] [LOCAL ] FTHY: Primary data saved (8557 records). [2025-09-16T18:32:48.925897] [INFO ] [MAIN ] FTHY: Full history saved. [2025-09-16T18:32:48.926005] [INFO ] [MAIN ] Update Progress: 877/2369 symbols completed. FTHY took 22.9s. Estimated remaining: 2h 37m 49s. Rate: 9.5 symbols/min [2025-09-16T18:32:49.174941] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-09-16T18:32:49.664898] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-16T18:32:49.974935] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-09-16T18:32:50.579034] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-16T18:32:50.774940] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-09-16T18:32:51.574928] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-09-16T18:32:52.130822] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-16T18:32:52.374963] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-09-16T18:32:52.578199] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-16T18:32:53.174920] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-09-16T18:32:53.757856] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-16T18:32:53.974901] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-09-16T18:32:54.019888] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-16T18:32:54.774914] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-09-16T18:32:54.900890] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (4.93 seconds). [2025-09-16T18:32:55.560101] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-16T18:32:55.574845] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-09-16T18:32:55.915776] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-16T18:32:55.919409] [INFO ] [REMOTE ] FTK: Full fetch complete (33369 records). [2025-09-16T18:32:55.919482] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-09-16T18:32:55.920055] [FATAL] [VALIDATOR ] FTK: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:32:55.920128] [FATAL] [MAIN ] FTK: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:32:55.920165] [WARN ] [MAIN ] FTK: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:32:55.920209] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-09-16T18:32:55.920265] [DEBUG] [LOCAL ] FTK: No primary data file found to delete. [2025-09-16T18:32:55.920319] [INFO ] [LOCAL ] FTK: Starting deletion of derivative data. [2025-09-16T18:32:55.920375] [DEBUG] [LOCAL ] FTK: No derivative data file found to delete. [2025-09-16T18:32:55.920434] [INFO ] [MAIN ] Update Progress: 878/2369 symbols completed. FTK took 22.3s. Estimated remaining: 2h 37m 44s. Rate: 9.5 symbols/min [2025-09-16T18:32:56.374914] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-09-16T18:32:57.280930] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-16T18:32:57.287425] [INFO ] [REMOTE ] FTI: Full fetch complete (57956 records). [2025-09-16T18:32:57.287531] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-09-16T18:32:57.688612] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-09-16T18:32:57.688737] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-09-16T18:32:57.689674] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-09-16T18:32:57.689727] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-09-16T18:32:57.691076] [DEBUG] [LOCAL ] FTI: Trimmed 57956 records to 39696 (keeping 150 days of data) [2025-09-16T18:32:57.957181] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-16T18:32:57.969442] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-09-16T18:32:57.980727] [DEBUG] [LOCAL ] FTI: Primary data saved (39696 records). [2025-09-16T18:32:57.980958] [INFO ] [MAIN ] FTI: Full history saved. [2025-09-16T18:32:57.981047] [INFO ] [MAIN ] Update Progress: 879/2369 symbols completed. FTI took 30.0s. Estimated remaining: 2h 37m 30s. Rate: 9.5 symbols/min [2025-09-16T18:32:59.466776] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-16T18:32:59.471691] [INFO ] [REMOTE ] FTS: Full fetch complete (45964 records). [2025-09-16T18:32:59.471824] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-09-16T18:32:59.845200] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-09-16T18:32:59.845283] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-09-16T18:32:59.845968] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-09-16T18:32:59.846015] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-09-16T18:32:59.847053] [DEBUG] [LOCAL ] FTS: Trimmed 45964 records to 31471 (keeping 150 days of data) [2025-09-16T18:33:00.045827] [DEBUG] [LOCAL ] FTS: Primary data saved (31471 records). [2025-09-16T18:33:00.046019] [INFO ] [MAIN ] FTS: Full history saved. [2025-09-16T18:33:00.046146] [INFO ] [MAIN ] Update Progress: 880/2369 symbols completed. FTS took 25.4s. Estimated remaining: 2h 37m 16s. Rate: 9.5 symbols/min [2025-09-16T18:33:00.624778] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:33:00.755353] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:33:00.775764] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:33:00.778364] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:33:00.778755] [DEBUG] [LOCAL ] FUL: No existing data file found in primary storage. [2025-09-16T18:33:00.779132] [WARN ] [MAIN ] FUL: No existing data found, performing full refresh instead. [2025-09-16T18:33:00.780059] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-09-16T18:33:00.780181] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-09-16T18:33:00.780752] [DEBUG] [LOCAL ] FUL: No primary data file found to delete. [2025-09-16T18:33:00.780802] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-09-16T18:33:00.813118] [DEBUG] [LOCAL ] FTWO: Loaded 1273 existing records from primary storage. [2025-09-16T18:33:00.828822] [INFO ] [MAIN ] FTWO: Loaded 1273 existing records. [2025-09-16T18:33:01.225908] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:33:01.281217] [DEBUG] [LOCAL ] FUBO: Loaded 39688 existing records from primary storage. [2025-09-16T18:33:01.280285] [DEBUG] [LOCAL ] FTV: Loaded 39181 existing records from primary storage. [2025-09-16T18:33:01.281669] [INFO ] [MAIN ] FUBO: Loaded 39688 existing records. [2025-09-16T18:33:01.281599] [INFO ] [MAIN ] FTV: Loaded 39181 existing records. [2025-09-16T18:33:01.307102] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-09-16T18:33:01.326190] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-09-16T18:33:01.437769] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-09-16T18:33:01.496457] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-09-16T18:33:01.539316] [INFO ] [REMOTE ] FUL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:33:01.643574] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-09-16T18:33:01.861318] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:33:01.861500] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:33:01.902545] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-09-16T18:33:01.904702] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-09-16T18:33:01.910961] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-09-16T18:33:01.911123] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-09-16T18:33:01.912237] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-09-16T18:33:01.941900] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-09-16T18:33:01.962938] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-09-16T18:33:01.991005] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-09-16T18:33:02.330973] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:33:02.376439] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-09-16T18:33:02.830967] [INFO ] [REMOTE ] FTV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:33:02.826224] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:33:02.831292] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-09-16T18:33:02.831521] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-09-16T18:33:03.172626] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-16T18:33:03.174016] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-09-16T18:33:03.374086] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-16T18:33:03.380420] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-09-16T18:33:03.454182] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-09-16T18:33:03.455374] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-09-16T18:33:03.899830] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-16T18:33:03.901190] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-09-16T18:33:04.240032] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-16T18:33:04.374866] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-09-16T18:33:04.470376] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-16T18:33:04.686296] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-16T18:33:04.828414] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-16T18:33:04.929141] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-16T18:33:05.174916] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-09-16T18:33:05.541367] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-16T18:33:05.974919] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-09-16T18:33:06.774899] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-09-16T18:33:07.574911] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-09-16T18:33:07.927067] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-16T18:33:08.374897] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-09-16T18:33:08.641082] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-16T18:33:09.180842] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-09-16T18:33:09.194883] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-09-16T18:33:09.642380] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-16T18:33:09.974938] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-09-16T18:33:10.065977] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-16T18:33:10.774911] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-09-16T18:33:11.574931] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-09-16T18:33:12.112290] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-16T18:33:12.178032] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-16T18:33:12.374922] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-09-16T18:33:12.922511] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-16T18:33:13.174933] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-09-16T18:33:13.761727] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-16T18:33:13.974933] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-09-16T18:33:14.517240] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-16T18:33:14.530438] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-16T18:33:14.531597] [INFO ] [REMOTE ] FTWO: Full fetch complete (2006 records). [2025-09-16T18:33:14.531685] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-09-16T18:33:14.532130] [FATAL] [VALIDATOR ] FTWO: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:33:14.532210] [FATAL] [MAIN ] FTWO: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:33:14.532247] [WARN ] [MAIN ] FTWO: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:33:14.532287] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-09-16T18:33:14.532344] [DEBUG] [LOCAL ] FTWO: No primary data file found to delete. [2025-09-16T18:33:14.532380] [INFO ] [LOCAL ] FTWO: Starting deletion of derivative data. [2025-09-16T18:33:14.532656] [DEBUG] [LOCAL ] FTWO: Deleted derivative data file. [2025-09-16T18:33:14.532743] [INFO ] [MAIN ] Update Progress: 881/2369 symbols completed. FTWO took 14.5s. Estimated remaining: 2h 37m 24s. Rate: 9.5 symbols/min [2025-09-16T18:33:14.707679] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:33:14.743826] [DEBUG] [LOCAL ] FUN: Loaded 38428 existing records from primary storage. [2025-09-16T18:33:14.744031] [INFO ] [MAIN ] FUN: Loaded 38428 existing records. [2025-09-16T18:33:14.780066] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-09-16T18:33:14.927023] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:33:14.927312] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-09-16T18:33:14.927370] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-09-16T18:33:14.928214] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-09-16T18:33:14.928264] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-09-16T18:33:15.277885] [INFO ] [REMOTE ] FUN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:33:15.574908] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-09-16T18:33:16.374895] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-09-16T18:33:16.762548] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-16T18:33:17.174906] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-09-16T18:33:17.236226] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-16T18:33:17.974917] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-09-16T18:33:18.601843] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-16T18:33:18.700161] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-16T18:33:18.774867] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-09-16T18:33:19.350219] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-16T18:33:19.574908] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-09-16T18:33:20.374863] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-09-16T18:33:20.393139] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-16T18:33:20.399516] [INFO ] [REMOTE ] FTV: Full fetch complete (57504 records). [2025-09-16T18:33:20.399611] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-09-16T18:33:20.785915] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-09-16T18:33:20.785993] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-09-16T18:33:20.786762] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-09-16T18:33:20.786835] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-09-16T18:33:20.788065] [DEBUG] [LOCAL ] FTV: Trimmed 57504 records to 39565 (keeping 150 days of data) [2025-09-16T18:33:21.034566] [DEBUG] [LOCAL ] FTV: Primary data saved (39565 records). [2025-09-16T18:33:21.034722] [INFO ] [MAIN ] FTV: Full history saved. [2025-09-16T18:33:21.034807] [INFO ] [MAIN ] Update Progress: 882/2369 symbols completed. FTV took 21.0s. Estimated remaining: 2h 37m 18s. Rate: 9.5 symbols/min [2025-09-16T18:33:21.178841] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-09-16T18:33:21.210451] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:33:21.227309] [DEBUG] [LOCAL ] FVR: Loaded 16121 existing records from primary storage. [2025-09-16T18:33:21.227455] [INFO ] [MAIN ] FVR: Loaded 16121 existing records. [2025-09-16T18:33:21.405220] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:33:21.405679] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-09-16T18:33:21.405734] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-09-16T18:33:21.415999] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-09-16T18:33:21.429879] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-09-16T18:33:21.534606] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-16T18:33:21.805329] [INFO ] [REMOTE ] FVR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:33:21.974883] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-09-16T18:33:22.154996] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-16T18:33:22.336586] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-16T18:33:22.774909] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-09-16T18:33:23.016456] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-16T18:33:23.574928] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-09-16T18:33:24.374871] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-09-16T18:33:24.699205] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-16T18:33:24.877929] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-16T18:33:25.174917] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-09-16T18:33:25.974903] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-09-16T18:33:26.038497] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-16T18:33:26.042986] [INFO ] [REMOTE ] FUL: Full fetch complete (35686 records). [2025-09-16T18:33:26.043078] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-09-16T18:33:26.423581] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-09-16T18:33:26.423682] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-09-16T18:33:26.424381] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-09-16T18:33:26.424437] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-09-16T18:33:26.426547] [DEBUG] [LOCAL ] FUL: Trimmed 35686 records to 22955 (keeping 150 days of data) [2025-09-16T18:33:26.533876] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-16T18:33:26.594854] [DEBUG] [LOCAL ] FUL: Primary data saved (22955 records). [2025-09-16T18:33:26.595015] [INFO ] [MAIN ] FUL: Full history saved. [2025-09-16T18:33:26.595115] [INFO ] [MAIN ] Update Progress: 883/2369 symbols completed. FUL took 26.5s. Estimated remaining: 2h 37m 10s. Rate: 9.5 symbols/min [2025-09-16T18:33:26.779479] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:33:26.778045] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-09-16T18:33:26.808823] [DEBUG] [LOCAL ] FVRR: Loaded 29697 existing records from primary storage. [2025-09-16T18:33:26.808963] [INFO ] [MAIN ] FVRR: Loaded 29697 existing records. [2025-09-16T18:33:26.997550] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:33:26.997855] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-09-16T18:33:26.997909] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-09-16T18:33:26.998636] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-09-16T18:33:26.998721] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-09-16T18:33:27.356284] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:33:27.574891] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-09-16T18:33:27.757288] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-16T18:33:28.102415] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-16T18:33:28.374898] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-09-16T18:33:29.174900] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-09-16T18:33:29.916362] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-09-16T18:33:29.974852] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-09-16T18:33:30.139201] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-16T18:33:30.539946] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-16T18:33:30.546363] [INFO ] [REMOTE ] FUBO: Full fetch complete (58379 records). [2025-09-16T18:33:30.546467] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-09-16T18:33:30.780074] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-09-16T18:33:30.933812] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-09-16T18:33:30.933892] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-09-16T18:33:30.935143] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-09-16T18:33:30.935193] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-09-16T18:33:30.936435] [DEBUG] [LOCAL ] FUBO: Trimmed 58379 records to 40078 (keeping 150 days of data) [2025-09-16T18:33:31.180133] [DEBUG] [LOCAL ] FUBO: Primary data saved (40078 records). [2025-09-16T18:33:31.180279] [INFO ] [MAIN ] FUBO: Full history saved. [2025-09-16T18:33:31.182259] [INFO ] [MAIN ] Update Progress: 884/2369 symbols completed. FUBO took 31.1s. Estimated remaining: 2h 37m 1s. Rate: 9.5 symbols/min [2025-09-16T18:33:31.367488] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:33:31.370457] [DEBUG] [LOCAL ] FXED: Loaded 868 existing records from primary storage. [2025-09-16T18:33:31.370629] [INFO ] [MAIN ] FXED: Loaded 868 existing records. [2025-09-16T18:33:31.581762] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:33:31.576273] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-09-16T18:33:31.589393] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-16T18:33:31.589725] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-09-16T18:33:31.598868] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-09-16T18:33:31.599509] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-09-16T18:33:31.599599] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-09-16T18:33:31.975136] [INFO ] [REMOTE ] FXED: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:33:32.010603] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-16T18:33:32.374900] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-09-16T18:33:33.174910] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-09-16T18:33:33.305162] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-16T18:33:33.426953] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-16T18:33:33.979975] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-09-16T18:33:33.987962] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-16T18:33:34.774890] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-09-16T18:33:35.067565] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-16T18:33:35.574875] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-09-16T18:33:35.677913] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-16T18:33:35.680329] [INFO ] [REMOTE ] FVR: Full fetch complete (23269 records). [2025-09-16T18:33:35.680407] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-09-16T18:33:35.680976] [FATAL] [VALIDATOR ] FVR: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:33:35.681074] [FATAL] [MAIN ] FVR: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:33:35.681235] [WARN ] [MAIN ] FVR: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:33:35.681294] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-09-16T18:33:35.681353] [DEBUG] [LOCAL ] FVR: No primary data file found to delete. [2025-09-16T18:33:35.681390] [INFO ] [LOCAL ] FVR: Starting deletion of derivative data. [2025-09-16T18:33:35.681624] [DEBUG] [LOCAL ] FVR: Deleted derivative data file. [2025-09-16T18:33:35.681737] [INFO ] [MAIN ] Update Progress: 885/2369 symbols completed. FVR took 14.6s. Estimated remaining: 2h 36m 51s. Rate: 9.5 symbols/min [2025-09-16T18:33:35.858275] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:33:35.894668] [DEBUG] [LOCAL ] G: Loaded 36743 existing records from primary storage. [2025-09-16T18:33:35.894811] [INFO ] [MAIN ] G: Loaded 36743 existing records. [2025-09-16T18:33:36.076179] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:33:36.076402] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-09-16T18:33:36.076446] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-09-16T18:33:36.077219] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-09-16T18:33:36.077268] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-09-16T18:33:36.380040] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-09-16T18:33:36.443816] [INFO ] [REMOTE ] G: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:33:36.639943] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-16T18:33:37.174953] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-09-16T18:33:37.776852] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-16T18:33:37.974956] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-09-16T18:33:38.395632] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-16T18:33:38.468659] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-16T18:33:38.774917] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-09-16T18:33:39.574907] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-09-16T18:33:40.073958] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-16T18:33:40.374927] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-09-16T18:33:40.974994] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-16T18:33:41.174912] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-09-16T18:33:41.743287] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-16T18:33:41.974905] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-09-16T18:33:42.382178] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-16T18:33:42.774945] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-09-16T18:33:43.055445] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-09-16T18:33:43.574919] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-09-16T18:33:43.659581] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-16T18:33:43.959907] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-16T18:33:44.374920] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-09-16T18:33:45.174945] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-09-16T18:33:45.974896] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-09-16T18:33:46.034802] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-16T18:33:46.774937] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-09-16T18:33:46.956957] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-16T18:33:47.574903] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-09-16T18:33:47.794851] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-16T18:33:48.338414] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-16T18:33:48.343562] [INFO ] [REMOTE ] FVRR: Full fetch complete (44023 records). [2025-09-16T18:33:48.343753] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-09-16T18:33:48.380115] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-09-16T18:33:48.726848] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-09-16T18:33:48.726931] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-09-16T18:33:48.727585] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-09-16T18:33:48.727671] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-09-16T18:33:48.728625] [DEBUG] [LOCAL ] FVRR: Trimmed 44023 records to 29987 (keeping 150 days of data) [2025-09-16T18:33:48.907792] [DEBUG] [LOCAL ] FVRR: Primary data saved (29987 records). [2025-09-16T18:33:48.908034] [INFO ] [MAIN ] FVRR: Full history saved. [2025-09-16T18:33:48.908161] [INFO ] [MAIN ] Update Progress: 886/2369 symbols completed. FVRR took 22.3s. Estimated remaining: 2h 36m 57s. Rate: 9.4 symbols/min [2025-09-16T18:33:49.077335] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-16T18:33:49.105982] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:33:49.108978] [INFO ] [REMOTE ] FUN: Full fetch complete (55665 records). [2025-09-16T18:33:49.109181] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-09-16T18:33:49.180430] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-09-16T18:33:49.360011] [DEBUG] [LOCAL ] GAB: Loaded 19323 existing records from primary storage. [2025-09-16T18:33:49.392697] [INFO ] [MAIN ] GAB: Loaded 19323 existing records. [2025-09-16T18:33:49.686345] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-09-16T18:33:49.686457] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:33:49.686679] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-09-16T18:33:49.687527] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-09-16T18:33:49.686714] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-09-16T18:33:49.687613] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-09-16T18:33:49.687763] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-09-16T18:33:49.688250] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-09-16T18:33:49.688333] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-09-16T18:33:49.732962] [DEBUG] [LOCAL ] FUN: Trimmed 55665 records to 38812 (keeping 150 days of data) [2025-09-16T18:33:49.901416] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-16T18:33:49.977151] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-09-16T18:33:50.151511] [INFO ] [REMOTE ] GAB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:33:50.185963] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-16T18:33:50.322582] [DEBUG] [LOCAL ] FUN: Primary data saved (38812 records). [2025-09-16T18:33:50.322757] [INFO ] [MAIN ] FUN: Full history saved. [2025-09-16T18:33:50.322879] [INFO ] [MAIN ] Update Progress: 887/2369 symbols completed. FUN took 35.8s. Estimated remaining: 2h 36m 42s. Rate: 9.5 symbols/min [2025-09-16T18:33:50.406043] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-16T18:33:50.495385] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:33:50.499306] [DEBUG] [LOCAL ] GAM: Loaded 2775 existing records from primary storage. [2025-09-16T18:33:50.499377] [INFO ] [MAIN ] GAM: Loaded 2775 existing records. [2025-09-16T18:33:50.685292] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:33:50.685518] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-09-16T18:33:50.685576] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-09-16T18:33:50.685812] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-09-16T18:33:50.685860] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-09-16T18:33:50.782857] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-09-16T18:33:51.037862] [INFO ] [REMOTE ] GAM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:33:51.084696] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-09-16T18:33:51.574944] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-09-16T18:33:52.374933] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-09-16T18:33:52.499759] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-16T18:33:53.174921] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-09-16T18:33:53.582154] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-16T18:33:53.842218] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-16T18:33:53.974934] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-09-16T18:33:54.774896] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-09-16T18:33:55.234578] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-16T18:33:55.235316] [INFO ] [REMOTE ] FXED: Full fetch complete (1274 records). [2025-09-16T18:33:55.235390] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-09-16T18:33:55.235761] [FATAL] [VALIDATOR ] FXED: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:33:55.235838] [FATAL] [MAIN ] FXED: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:33:55.235876] [WARN ] [MAIN ] FXED: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:33:55.235920] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-09-16T18:33:55.235988] [DEBUG] [LOCAL ] FXED: No primary data file found to delete. [2025-09-16T18:33:55.236027] [INFO ] [LOCAL ] FXED: Starting deletion of derivative data. [2025-09-16T18:33:55.236376] [DEBUG] [LOCAL ] FXED: Deleted derivative data file. [2025-09-16T18:33:55.236493] [INFO ] [MAIN ] Update Progress: 888/2369 symbols completed. FXED took 24.1s. Estimated remaining: 2h 36m 33s. Rate: 9.5 symbols/min [2025-09-16T18:33:55.419004] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:33:55.455253] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-16T18:33:55.507716] [DEBUG] [LOCAL ] GAP: Loaded 39617 existing records from primary storage. [2025-09-16T18:33:55.507941] [INFO ] [MAIN ] GAP: Loaded 39617 existing records. [2025-09-16T18:33:55.580007] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-09-16T18:33:55.691475] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:33:55.691799] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-09-16T18:33:55.691865] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-09-16T18:33:55.692931] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-09-16T18:33:55.692983] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-09-16T18:33:56.055218] [INFO ] [REMOTE ] GAP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:33:56.374899] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-09-16T18:33:56.681006] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-16T18:33:57.174900] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-09-16T18:33:57.643484] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-16T18:33:57.974910] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-09-16T18:33:58.068017] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-16T18:33:58.774936] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-09-16T18:33:59.574935] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-09-16T18:34:00.046823] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-16T18:34:00.148983] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-16T18:34:00.155615] [INFO ] [REMOTE ] G: Full fetch complete (54192 records). [2025-09-16T18:34:00.155750] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-09-16T18:34:00.380071] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-09-16T18:34:00.451675] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-16T18:34:00.553426] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-09-16T18:34:00.553502] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-09-16T18:34:00.554272] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-09-16T18:34:00.554320] [DEBUG] [LOCAL ] G: Saving primary data. [2025-09-16T18:34:00.555432] [DEBUG] [LOCAL ] G: Trimmed 54192 records to 37121 (keeping 150 days of data) [2025-09-16T18:34:00.789529] [DEBUG] [LOCAL ] G: Primary data saved (37121 records). [2025-09-16T18:34:00.789695] [INFO ] [MAIN ] G: Full history saved. [2025-09-16T18:34:00.791066] [INFO ] [MAIN ] Update Progress: 889/2369 symbols completed. G took 25.1s. Estimated remaining: 2h 36m 26s. Rate: 9.5 symbols/min [2025-09-16T18:34:00.965805] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:34:00.966021] [DEBUG] [LOCAL ] GATX: No existing data file found in primary storage. [2025-09-16T18:34:00.966062] [WARN ] [MAIN ] GATX: No existing data found, performing full refresh instead. [2025-09-16T18:34:00.966192] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-09-16T18:34:00.966253] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-09-16T18:34:00.966317] [DEBUG] [LOCAL ] GATX: No primary data file found to delete. [2025-09-16T18:34:00.966366] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-09-16T18:34:01.180004] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-09-16T18:34:01.334486] [INFO ] [REMOTE ] GATX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:34:01.974938] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-09-16T18:34:02.144864] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-16T18:34:02.774946] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-09-16T18:34:03.350383] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-16T18:34:03.574889] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-09-16T18:34:03.946417] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (2.77 seconds). [2025-09-16T18:34:03.972927] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-16T18:34:03.999085] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-16T18:34:04.374918] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-09-16T18:34:05.174911] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-09-16T18:34:05.241785] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-16T18:34:05.974913] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-09-16T18:34:06.774924] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-09-16T18:34:06.800849] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-16T18:34:07.059271] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-16T18:34:07.574931] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-09-16T18:34:07.786078] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-16T18:34:08.374905] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-09-16T18:34:09.174901] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-09-16T18:34:09.667250] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-16T18:34:09.754538] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-16T18:34:09.974899] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-09-16T18:34:10.146287] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-16T18:34:10.774905] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-09-16T18:34:11.574904] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-09-16T18:34:11.909823] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-16T18:34:12.310334] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-16T18:34:12.310551] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-16T18:34:12.374907] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-09-16T18:34:13.174938] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-09-16T18:34:13.974923] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-09-16T18:34:14.199866] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-16T18:34:14.226823] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-16T18:34:14.517265] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-16T18:34:14.518428] [INFO ] [REMOTE ] GAM: Full fetch complete (4947 records). [2025-09-16T18:34:14.518501] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-09-16T18:34:14.780000] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-09-16T18:34:14.880003] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-09-16T18:34:14.880086] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-09-16T18:34:14.880242] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-09-16T18:34:14.880285] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-09-16T18:34:14.880681] [DEBUG] [LOCAL ] GAM: Trimmed 4947 records to 2806 (keeping 150 days of data) [2025-09-16T18:34:14.897928] [DEBUG] [LOCAL ] GAM: Primary data saved (2806 records). [2025-09-16T18:34:14.898051] [INFO ] [MAIN ] GAM: Full history saved. [2025-09-16T18:34:14.898141] [INFO ] [MAIN ] Update Progress: 890/2369 symbols completed. GAM took 24.6s. Estimated remaining: 2h 36m 32s. Rate: 9.4 symbols/min [2025-09-16T18:34:15.069968] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:34:15.080275] [DEBUG] [LOCAL ] GBAB: Loaded 9535 existing records from primary storage. [2025-09-16T18:34:15.080383] [INFO ] [MAIN ] GBAB: Loaded 9535 existing records. [2025-09-16T18:34:15.254668] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:34:15.254926] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-09-16T18:34:15.254973] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-09-16T18:34:15.255310] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-09-16T18:34:15.255354] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-09-16T18:34:15.582434] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-09-16T18:34:15.624953] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:34:16.374937] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-09-16T18:34:16.567054] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-16T18:34:16.573758] [INFO ] [REMOTE ] GAP: Full fetch complete (58330 records). [2025-09-16T18:34:16.573921] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-09-16T18:34:16.859193] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-16T18:34:16.897927] [INFO ] [REMOTE ] GAB: Full fetch complete (29499 records). [2025-09-16T18:34:16.898500] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-09-16T18:34:17.143395] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-09-16T18:34:17.148628] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-09-16T18:34:17.154744] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-09-16T18:34:17.180435] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-09-16T18:34:17.170808] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-09-16T18:34:17.321434] [DEBUG] [LOCAL ] GAP: Trimmed 58330 records to 40007 (keeping 150 days of data) [2025-09-16T18:34:17.506043] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-09-16T18:34:17.506748] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-09-16T18:34:17.507921] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-09-16T18:34:17.508227] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-09-16T18:34:17.511475] [DEBUG] [LOCAL ] GAB: Trimmed 29499 records to 19527 (keeping 150 days of data) [2025-09-16T18:34:17.641307] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-16T18:34:17.763022] [DEBUG] [LOCAL ] GAB: Primary data saved (19527 records). [2025-09-16T18:34:17.764887] [INFO ] [MAIN ] GAB: Full history saved. [2025-09-16T18:34:17.765019] [INFO ] [MAIN ] Update Progress: 891/2369 symbols completed. GAB took 28.9s. Estimated remaining: 2h 36m 20s. Rate: 9.5 symbols/min [2025-09-16T18:34:17.960691] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:34:17.962239] [DEBUG] [LOCAL ] GBCI: No existing data file found in primary storage. [2025-09-16T18:34:17.962531] [WARN ] [MAIN ] GBCI: No existing data found, performing full refresh instead. [2025-09-16T18:34:17.963769] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-09-16T18:34:17.964867] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-09-16T18:34:17.965443] [DEBUG] [LOCAL ] GBCI: No primary data file found to delete. [2025-09-16T18:34:17.965807] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-09-16T18:34:17.980017] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-09-16T18:34:18.405685] [DEBUG] [LOCAL ] GAP: Primary data saved (40007 records). [2025-09-16T18:34:18.421095] [INFO ] [MAIN ] GAP: Full history saved. [2025-09-16T18:34:18.424465] [INFO ] [MAIN ] Update Progress: 892/2369 symbols completed. GAP took 23.2s. Estimated remaining: 2h 36m 4s. Rate: 9.5 symbols/min [2025-09-16T18:34:18.424346] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:34:18.599462] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:34:18.599855] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-09-16T18:34:18.600003] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-09-16T18:34:18.608837] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-16T18:34:18.612247] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-09-16T18:34:18.612408] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-16T18:34:18.612489] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-09-16T18:34:18.612527] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-09-16T18:34:18.729005] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-16T18:34:18.782962] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-09-16T18:34:18.986163] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:34:19.574910] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-09-16T18:34:19.923199] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-16T18:34:20.374929] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-09-16T18:34:21.154911] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-16T18:34:21.174843] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-09-16T18:34:21.312097] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-16T18:34:21.974901] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-09-16T18:34:22.666194] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-16T18:34:22.774863] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-09-16T18:34:22.842277] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-16T18:34:23.574917] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-09-16T18:34:23.798548] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-16T18:34:24.231025] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-16T18:34:24.374892] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-09-16T18:34:25.174897] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-09-16T18:34:25.541388] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-16T18:34:25.974907] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-09-16T18:34:26.001199] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-16T18:34:26.774916] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-09-16T18:34:26.829918] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-16T18:34:27.125451] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-16T18:34:27.574909] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-09-16T18:34:28.374906] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-09-16T18:34:28.644780] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-16T18:34:29.174931] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-09-16T18:34:29.451796] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-16T18:34:29.974899] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-09-16T18:34:30.412925] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-16T18:34:30.774907] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-09-16T18:34:30.824701] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-16T18:34:31.574882] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-09-16T18:34:31.819556] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-16T18:34:31.822414] [INFO ] [REMOTE ] GATX: Full fetch complete (19052 records). [2025-09-16T18:34:31.822491] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-09-16T18:34:32.211209] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-09-16T18:34:32.211292] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-09-16T18:34:32.211767] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-09-16T18:34:32.211813] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-09-16T18:34:32.212385] [DEBUG] [LOCAL ] GATX: Trimmed 19052 records to 13206 (keeping 150 days of data) [2025-09-16T18:34:32.303108] [DEBUG] [LOCAL ] GATX: Primary data saved (13206 records). [2025-09-16T18:34:32.303260] [INFO ] [MAIN ] GATX: Full history saved. [2025-09-16T18:34:32.303337] [INFO ] [MAIN ] Update Progress: 893/2369 symbols completed. GATX took 31.5s. Estimated remaining: 2h 36m 10s. Rate: 9.5 symbols/min [2025-09-16T18:34:32.384830] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-09-16T18:34:32.486685] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:34:32.517034] [DEBUG] [LOCAL ] GBTG: Loaded 29741 existing records from primary storage. [2025-09-16T18:34:32.517244] [INFO ] [MAIN ] GBTG: Loaded 29741 existing records. [2025-09-16T18:34:32.693135] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:34:32.693429] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-09-16T18:34:32.693616] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-09-16T18:34:32.694337] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-09-16T18:34:32.694389] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-09-16T18:34:32.869781] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-16T18:34:33.083602] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:34:33.174919] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-09-16T18:34:33.223997] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-16T18:34:33.974891] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-09-16T18:34:34.661936] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-16T18:34:34.774873] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-09-16T18:34:34.873441] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-16T18:34:34.875475] [INFO ] [REMOTE ] GBAB: Full fetch complete (14440 records). [2025-09-16T18:34:34.875545] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-09-16T18:34:35.246081] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-09-16T18:34:35.246216] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-09-16T18:34:35.246576] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-09-16T18:34:35.246618] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-09-16T18:34:35.247136] [DEBUG] [LOCAL ] GBAB: Trimmed 14440 records to 9666 (keeping 150 days of data) [2025-09-16T18:34:35.306220] [DEBUG] [LOCAL ] GBAB: Primary data saved (9666 records). [2025-09-16T18:34:35.306351] [INFO ] [MAIN ] GBAB: Full history saved. [2025-09-16T18:34:35.306438] [INFO ] [MAIN ] Update Progress: 894/2369 symbols completed. GBAB took 20.4s. Estimated remaining: 2h 35m 59s. Rate: 9.5 symbols/min [2025-09-16T18:34:35.481631] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:34:35.501174] [DEBUG] [LOCAL ] GBX: Loaded 20311 existing records from primary storage. [2025-09-16T18:34:35.501317] [INFO ] [MAIN ] GBX: Loaded 20311 existing records. [2025-09-16T18:34:35.580017] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-09-16T18:34:35.681251] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:34:35.681480] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-09-16T18:34:35.681533] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-09-16T18:34:35.682125] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-09-16T18:34:35.682178] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-09-16T18:34:36.034296] [INFO ] [REMOTE ] GBX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:34:36.197426] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-16T18:34:36.374896] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-09-16T18:34:36.942426] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-16T18:34:37.174911] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-09-16T18:34:37.898600] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-16T18:34:37.910992] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-16T18:34:37.915535] [INFO ] [REMOTE ] GBCI: Full fetch complete (43482 records). [2025-09-16T18:34:37.915619] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-09-16T18:34:37.980052] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-09-16T18:34:38.296244] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-16T18:34:38.296436] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-09-16T18:34:38.297350] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-09-16T18:34:38.298079] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-09-16T18:34:38.298135] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-09-16T18:34:38.298989] [DEBUG] [LOCAL ] GBCI: Trimmed 43482 records to 29687 (keeping 150 days of data) [2025-09-16T18:34:38.476970] [DEBUG] [LOCAL ] GBCI: Primary data saved (29687 records). [2025-09-16T18:34:38.477109] [INFO ] [MAIN ] GBCI: Full history saved. [2025-09-16T18:34:38.477185] [INFO ] [MAIN ] Update Progress: 895/2369 symbols completed. GBCI took 20.7s. Estimated remaining: 2h 35m 47s. Rate: 9.5 symbols/min [2025-09-16T18:34:38.650413] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:34:38.681955] [DEBUG] [LOCAL ] GCI: Loaded 32264 existing records from primary storage. [2025-09-16T18:34:38.682092] [INFO ] [MAIN ] GCI: Loaded 32264 existing records. [2025-09-16T18:34:38.780578] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-09-16T18:34:38.861268] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:34:38.861513] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-09-16T18:34:38.861560] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-09-16T18:34:38.862166] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-09-16T18:34:38.862215] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-09-16T18:34:39.117996] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-16T18:34:39.222298] [INFO ] [REMOTE ] GCI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:34:39.574901] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-09-16T18:34:40.374903] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-09-16T18:34:41.038127] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-16T18:34:41.174857] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-09-16T18:34:41.974911] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-09-16T18:34:42.053264] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-16T18:34:42.774883] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-09-16T18:34:43.559620] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-16T18:34:43.574841] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-09-16T18:34:43.850883] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-16T18:34:44.165312] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-16T18:34:44.374921] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-09-16T18:34:44.845350] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-16T18:34:44.967244] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-16T18:34:45.174913] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-09-16T18:34:45.974924] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-09-16T18:34:46.304031] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-16T18:34:46.774908] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-09-16T18:34:46.852122] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-16T18:34:47.574917] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-09-16T18:34:47.999472] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-16T18:34:48.374970] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-09-16T18:34:48.824003] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-16T18:34:48.846626] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-16T18:34:48.847513] [INFO ] [REMOTE ] GBLI: Full fetch complete (1050 records). [2025-09-16T18:34:48.847588] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-09-16T18:34:48.848032] [FATAL] [VALIDATOR ] GBLI: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:34:48.848140] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:34:48.848181] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:34:48.848222] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-16T18:34:48.848283] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-09-16T18:34:48.848325] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-09-16T18:34:48.848403] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-09-16T18:34:48.848522] [INFO ] [MAIN ] Update Progress: 896/2369 symbols completed. GBLI took 30.4s. Estimated remaining: 2h 35m 47s. Rate: 9.5 symbols/min [2025-09-16T18:34:49.064228] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:34:49.083335] [DEBUG] [LOCAL ] GCO: Loaded 17261 existing records from primary storage. [2025-09-16T18:34:49.083487] [INFO ] [MAIN ] GCO: Loaded 17261 existing records. [2025-09-16T18:34:49.180132] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-09-16T18:34:49.275191] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:34:49.275438] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-09-16T18:34:49.275486] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-09-16T18:34:49.275951] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-09-16T18:34:49.276001] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-09-16T18:34:49.633588] [INFO ] [REMOTE ] GCO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:34:49.974897] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-09-16T18:34:50.357147] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-16T18:34:50.774910] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-09-16T18:34:51.066336] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-16T18:34:51.574926] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-09-16T18:34:52.006812] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-16T18:34:52.374919] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-09-16T18:34:52.422274] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-16T18:34:53.174921] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-09-16T18:34:53.935921] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-16T18:34:53.974858] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-09-16T18:34:54.557856] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-16T18:34:54.774906] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-09-16T18:34:55.174924] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-16T18:34:55.574897] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-09-16T18:34:55.691676] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-16T18:34:56.374899] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-09-16T18:34:56.586096] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-16T18:34:57.174919] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-09-16T18:34:57.246301] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-16T18:34:57.974947] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-09-16T18:34:58.677075] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-16T18:34:58.710268] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-16T18:34:58.774879] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-09-16T18:34:59.574909] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-09-16T18:34:59.962552] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-16T18:35:00.374931] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-09-16T18:35:00.968473] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-16T18:35:00.973726] [INFO ] [REMOTE ] GBTG: Full fetch complete (43561 records). [2025-09-16T18:35:00.973853] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-09-16T18:35:01.181475] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-09-16T18:35:01.364566] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-09-16T18:35:01.364678] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-09-16T18:35:01.365334] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-09-16T18:35:01.365378] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-09-16T18:35:01.366574] [DEBUG] [LOCAL ] GBTG: Trimmed 43561 records to 30025 (keeping 150 days of data) [2025-09-16T18:35:01.539722] [DEBUG] [LOCAL ] GBTG: Primary data saved (30025 records). [2025-09-16T18:35:01.539850] [INFO ] [MAIN ] GBTG: Full history saved. [2025-09-16T18:35:01.539933] [INFO ] [MAIN ] Update Progress: 897/2369 symbols completed. GBTG took 29.2s. Estimated remaining: 2h 35m 51s. Rate: 9.4 symbols/min [2025-09-16T18:35:01.718705] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:35:01.718975] [DEBUG] [LOCAL ] GCTS: No existing data file found in primary storage. [2025-09-16T18:35:01.719056] [WARN ] [MAIN ] GCTS: No existing data found, performing full refresh instead. [2025-09-16T18:35:01.719337] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-09-16T18:35:01.719415] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-09-16T18:35:01.719462] [DEBUG] [LOCAL ] GCTS: No primary data file found to delete. [2025-09-16T18:35:01.719535] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-09-16T18:35:01.828586] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-16T18:35:01.976455] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-09-16T18:35:02.187070] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:35:02.779977] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-09-16T18:35:02.789163] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-16T18:35:02.794920] [INFO ] [REMOTE ] GCI: Full fetch complete (47995 records). [2025-09-16T18:35:02.795053] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-09-16T18:35:03.182220] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-09-16T18:35:03.182311] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-09-16T18:35:03.183047] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-09-16T18:35:03.183102] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-09-16T18:35:03.198728] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-16T18:35:03.204313] [DEBUG] [LOCAL ] GCI: Trimmed 47995 records to 32576 (keeping 150 days of data) [2025-09-16T18:35:03.392794] [DEBUG] [LOCAL ] GCI: Primary data saved (32576 records). [2025-09-16T18:35:03.392961] [INFO ] [MAIN ] GCI: Full history saved. [2025-09-16T18:35:03.393082] [INFO ] [MAIN ] Update Progress: 898/2369 symbols completed. GCI took 24.9s. Estimated remaining: 2h 35m 38s. Rate: 9.5 symbols/min [2025-09-16T18:35:03.564942] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:35:03.572464] [DEBUG] [LOCAL ] GCV: Loaded 5377 existing records from primary storage. [2025-09-16T18:35:03.572555] [INFO ] [MAIN ] GCV: Loaded 5377 existing records. [2025-09-16T18:35:03.583606] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-09-16T18:35:03.757886] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:35:03.769850] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-16T18:35:03.770051] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-09-16T18:35:03.774219] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-09-16T18:35:03.774982] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-09-16T18:35:03.775038] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-09-16T18:35:04.132439] [INFO ] [REMOTE ] GCV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:35:04.374936] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-09-16T18:35:04.495236] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-16T18:35:05.125321] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-16T18:35:05.174907] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-09-16T18:35:05.974926] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-09-16T18:35:06.017411] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-16T18:35:06.020802] [INFO ] [REMOTE ] GCO: Full fetch complete (27925 records). [2025-09-16T18:35:06.020894] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-09-16T18:35:06.384537] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-09-16T18:35:06.384614] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-09-16T18:35:06.385171] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-09-16T18:35:06.385216] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-09-16T18:35:06.385914] [DEBUG] [LOCAL ] GCO: Trimmed 27925 records to 17442 (keeping 150 days of data) [2025-09-16T18:35:06.492896] [DEBUG] [LOCAL ] GCO: Primary data saved (17442 records). [2025-09-16T18:35:06.493050] [INFO ] [MAIN ] GCO: Full history saved. [2025-09-16T18:35:06.493140] [INFO ] [MAIN ] Update Progress: 899/2369 symbols completed. GCO took 17.6s. Estimated remaining: 2h 35m 26s. Rate: 9.5 symbols/min [2025-09-16T18:35:06.677932] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:35:06.714541] [DEBUG] [LOCAL ] GD: Loaded 34238 existing records from primary storage. [2025-09-16T18:35:06.714735] [INFO ] [MAIN ] GD: Loaded 34238 existing records. [2025-09-16T18:35:06.780710] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-09-16T18:35:06.903785] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:35:06.904076] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-09-16T18:35:06.904126] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-09-16T18:35:06.905002] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-09-16T18:35:06.905064] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-09-16T18:35:07.103249] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-16T18:35:07.286347] [INFO ] [REMOTE ] GD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:35:07.513239] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-16T18:35:07.574877] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-09-16T18:35:08.374879] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-09-16T18:35:09.174912] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-09-16T18:35:09.202567] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-16T18:35:09.265314] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-16T18:35:09.269597] [INFO ] [REMOTE ] GBX: Full fetch complete (32583 records). [2025-09-16T18:35:09.269732] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-09-16T18:35:09.607209] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-16T18:35:09.649912] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-09-16T18:35:09.650000] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-09-16T18:35:09.650700] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-09-16T18:35:09.650759] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-09-16T18:35:09.651608] [DEBUG] [LOCAL ] GBX: Trimmed 32583 records to 20479 (keeping 150 days of data) [2025-09-16T18:35:09.777532] [DEBUG] [LOCAL ] GBX: Primary data saved (20479 records). [2025-09-16T18:35:09.777675] [INFO ] [MAIN ] GBX: Full history saved. [2025-09-16T18:35:09.777756] [INFO ] [MAIN ] Update Progress: 900/2369 symbols completed. GBX took 34.5s. Estimated remaining: 2h 35m 15s. Rate: 9.5 symbols/min [2025-09-16T18:35:09.950903] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:35:09.974918] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-09-16T18:35:09.987998] [DEBUG] [LOCAL ] GDDY: Loaded 36534 existing records from primary storage. [2025-09-16T18:35:09.988154] [INFO ] [MAIN ] GDDY: Loaded 36534 existing records. [2025-09-16T18:35:10.172381] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:35:10.172685] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-09-16T18:35:10.172735] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-09-16T18:35:10.173623] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-09-16T18:35:10.173700] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-09-16T18:35:10.565692] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:35:10.774899] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-09-16T18:35:11.574902] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-09-16T18:35:11.826564] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-16T18:35:12.214288] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-16T18:35:12.374869] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-09-16T18:35:12.863093] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-16T18:35:13.003833] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-16T18:35:13.174897] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-09-16T18:35:13.974933] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-09-16T18:35:14.429031] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-16T18:35:14.774895] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-09-16T18:35:15.191819] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-16T18:35:15.526118] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-16T18:35:15.574920] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-09-16T18:35:16.374895] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-09-16T18:35:17.118934] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-16T18:35:17.174928] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-09-16T18:35:17.478623] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-16T18:35:17.974912] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-09-16T18:35:18.545123] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-16T18:35:18.774869] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-09-16T18:35:19.574903] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-09-16T18:35:20.123460] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-16T18:35:20.198826] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-16T18:35:20.374906] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-09-16T18:35:21.174889] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-09-16T18:35:21.283910] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-16T18:35:21.624918] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-16T18:35:21.852156] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-16T18:35:21.974913] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-09-16T18:35:22.587527] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-16T18:35:22.774894] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-09-16T18:35:23.574968] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-09-16T18:35:23.784062] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-16T18:35:24.374907] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-09-16T18:35:25.174902] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-09-16T18:35:25.478207] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-16T18:35:25.496105] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-16T18:35:25.499424] [INFO ] [REMOTE ] GCTS: Full fetch complete (20479 records). [2025-09-16T18:35:25.499535] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-09-16T18:35:25.905366] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-09-16T18:35:25.905467] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-09-16T18:35:25.906003] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-09-16T18:35:25.906062] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-09-16T18:35:25.906768] [DEBUG] [LOCAL ] GCTS: Trimmed 20479 records to 15587 (keeping 150 days of data) [2025-09-16T18:35:25.975180] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-09-16T18:35:26.001148] [DEBUG] [LOCAL ] GCTS: Primary data saved (15587 records). [2025-09-16T18:35:26.001300] [INFO ] [MAIN ] GCTS: Full history saved. [2025-09-16T18:35:26.001395] [INFO ] [MAIN ] Update Progress: 901/2369 symbols completed. GCTS took 24.5s. Estimated remaining: 2h 35m 24s. Rate: 9.4 symbols/min [2025-09-16T18:35:26.171041] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:35:26.175536] [DEBUG] [LOCAL ] GDIV: Loaded 2590 existing records from primary storage. [2025-09-16T18:35:26.175633] [INFO ] [MAIN ] GDIV: Loaded 2590 existing records. [2025-09-16T18:35:26.354822] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:35:26.355102] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-09-16T18:35:26.355158] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-09-16T18:35:26.355410] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-09-16T18:35:26.355464] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-09-16T18:35:26.726507] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:35:26.757608] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-16T18:35:26.774858] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-09-16T18:35:27.574927] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-09-16T18:35:27.874479] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-16T18:35:28.353909] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-16T18:35:28.374926] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-09-16T18:35:28.474388] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-16T18:35:29.174904] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-09-16T18:35:29.689153] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-16T18:35:29.803559] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-16T18:35:29.974904] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-09-16T18:35:30.774905] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-09-16T18:35:31.233613] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-16T18:35:31.580084] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-09-16T18:35:31.588407] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-16T18:35:31.594010] [INFO ] [REMOTE ] GD: Full fetch complete (52162 records). [2025-09-16T18:35:31.594119] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-09-16T18:35:31.980514] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-09-16T18:35:31.980593] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-09-16T18:35:31.981304] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-09-16T18:35:31.981352] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-09-16T18:35:31.982408] [DEBUG] [LOCAL ] GD: Trimmed 52162 records to 34593 (keeping 150 days of data) [2025-09-16T18:35:32.205036] [DEBUG] [LOCAL ] GD: Primary data saved (34593 records). [2025-09-16T18:35:32.205197] [INFO ] [MAIN ] GD: Full history saved. [2025-09-16T18:35:32.205296] [INFO ] [MAIN ] Update Progress: 902/2369 symbols completed. GD took 25.7s. Estimated remaining: 2h 35m 18s. Rate: 9.4 symbols/min [2025-09-16T18:35:32.381717] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:35:32.380021] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-09-16T18:35:32.386577] [DEBUG] [LOCAL ] GDL: Loaded 1737 existing records from primary storage. [2025-09-16T18:35:32.386708] [INFO ] [MAIN ] GDL: Loaded 1737 existing records. [2025-09-16T18:35:32.510403] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-16T18:35:32.546359] [INFO ] [REMOTE ] GCV: Full fetch complete (7464 records). [2025-09-16T18:35:32.555388] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-09-16T18:35:32.569856] [FATAL] [VALIDATOR ] GCV: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:35:32.574331] [FATAL] [MAIN ] GCV: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:35:32.574200] [WARN ] [MAIN ] GDL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:35:32.574638] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-09-16T18:35:32.574481] [WARN ] [MAIN ] GCV: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:35:32.574813] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-09-16T18:35:32.574763] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-09-16T18:35:32.574911] [DEBUG] [LOCAL ] GCV: No primary data file found to delete. [2025-09-16T18:35:32.575004] [INFO ] [LOCAL ] GCV: Starting deletion of derivative data. [2025-09-16T18:35:32.575259] [DEBUG] [LOCAL ] GDL: Deleted primary data file. [2025-09-16T18:35:32.575337] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-09-16T18:35:32.606254] [DEBUG] [LOCAL ] GCV: Deleted derivative data file. [2025-09-16T18:35:32.640073] [INFO ] [MAIN ] Update Progress: 903/2369 symbols completed. GCV took 29.2s. Estimated remaining: 2h 35m 2s. Rate: 9.5 symbols/min [2025-09-16T18:35:33.000402] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-16T18:35:33.001857] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:35:33.113261] [DEBUG] [LOCAL ] GDO: Loaded 4329 existing records from primary storage. [2025-09-16T18:35:33.122606] [INFO ] [MAIN ] GDO: Loaded 4329 existing records. [2025-09-16T18:35:33.180596] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-09-16T18:35:33.141664] [INFO ] [REMOTE ] GDL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:35:33.324866] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:35:33.325105] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-09-16T18:35:33.325153] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-09-16T18:35:33.325404] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-09-16T18:35:33.325449] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-09-16T18:35:33.678609] [INFO ] [REMOTE ] GDO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:35:33.679214] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-16T18:35:33.974903] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-09-16T18:35:34.764457] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-16T18:35:34.774852] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-09-16T18:35:35.198463] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-16T18:35:35.574897] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-09-16T18:35:36.117049] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-16T18:35:36.374909] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-09-16T18:35:36.707124] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-16T18:35:37.174911] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-09-16T18:35:37.974939] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-09-16T18:35:38.396134] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-16T18:35:38.775033] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-09-16T18:35:39.081278] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-16T18:35:39.348417] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-16T18:35:39.574924] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-09-16T18:35:40.070954] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-16T18:35:40.071918] [INFO ] [REMOTE ] GDIV: Full fetch complete (4132 records). [2025-09-16T18:35:40.071999] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-09-16T18:35:40.391110] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-09-16T18:35:40.429916] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-09-16T18:35:40.429995] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-09-16T18:35:40.430121] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-09-16T18:35:40.430159] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-09-16T18:35:40.430564] [DEBUG] [LOCAL ] GDIV: Trimmed 4132 records to 2606 (keeping 150 days of data) [2025-09-16T18:35:40.447967] [DEBUG] [LOCAL ] GDIV: Primary data saved (2606 records). [2025-09-16T18:35:40.448097] [INFO ] [MAIN ] GDIV: Full history saved. [2025-09-16T18:35:40.448199] [INFO ] [MAIN ] Update Progress: 904/2369 symbols completed. GDIV took 14.4s. Estimated remaining: 2h 34m 58s. Rate: 9.5 symbols/min [2025-09-16T18:35:40.630884] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:35:40.658123] [DEBUG] [LOCAL ] GDOT: Loaded 27340 existing records from primary storage. [2025-09-16T18:35:40.658276] [INFO ] [MAIN ] GDOT: Loaded 27340 existing records. [2025-09-16T18:35:40.839434] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:35:40.839727] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-09-16T18:35:40.839784] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-09-16T18:35:40.840408] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-09-16T18:35:40.840457] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-09-16T18:35:40.945435] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-16T18:35:41.180033] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-09-16T18:35:41.244283] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:35:41.974964] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-09-16T18:35:42.135358] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-16T18:35:42.774910] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-09-16T18:35:43.101847] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-16T18:35:43.574927] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-09-16T18:35:44.374914] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-09-16T18:35:44.577261] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-16T18:35:44.583558] [INFO ] [REMOTE ] GDDY: Full fetch complete (54419 records). [2025-09-16T18:35:44.583721] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-09-16T18:35:44.892228] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-16T18:35:44.988818] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-09-16T18:35:44.988927] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-09-16T18:35:44.989725] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-09-16T18:35:44.989778] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-09-16T18:35:44.991112] [DEBUG] [LOCAL ] GDDY: Trimmed 54419 records to 36908 (keeping 150 days of data) [2025-09-16T18:35:45.191818] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-09-16T18:35:45.223412] [DEBUG] [LOCAL ] GDDY: Primary data saved (36908 records). [2025-09-16T18:35:45.223576] [INFO ] [MAIN ] GDDY: Full history saved. [2025-09-16T18:35:45.223692] [INFO ] [MAIN ] Update Progress: 905/2369 symbols completed. GDDY took 35.4s. Estimated remaining: 2h 34m 49s. Rate: 9.5 symbols/min [2025-09-16T18:35:45.397703] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:35:45.429608] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-16T18:35:45.449989] [DEBUG] [LOCAL ] GDV: Loaded 14265 existing records from primary storage. [2025-09-16T18:35:45.450167] [INFO ] [MAIN ] GDV: Loaded 14265 existing records. [2025-09-16T18:35:45.631776] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:35:45.632064] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-09-16T18:35:45.632119] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-09-16T18:35:45.632568] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-09-16T18:35:45.632614] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-09-16T18:35:45.736152] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-16T18:35:45.992991] [INFO ] [REMOTE ] GDV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:35:45.988854] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-09-16T18:35:46.484588] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-16T18:35:46.774929] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-09-16T18:35:47.574909] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-09-16T18:35:48.224238] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-16T18:35:48.380019] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-09-16T18:35:48.390284] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-16T18:35:49.174949] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-09-16T18:35:49.714021] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-16T18:35:49.767901] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-16T18:35:49.974958] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-09-16T18:35:50.774921] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-09-16T18:35:50.783481] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-16T18:35:50.784443] [INFO ] [REMOTE ] GDL: Full fetch complete (2543 records). [2025-09-16T18:35:50.784510] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-09-16T18:35:50.784878] [FATAL] [VALIDATOR ] GDL: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:35:50.784956] [FATAL] [MAIN ] GDL: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:35:50.785010] [WARN ] [MAIN ] GDL: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:35:50.785056] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-09-16T18:35:50.785109] [DEBUG] [LOCAL ] GDL: No primary data file found to delete. [2025-09-16T18:35:50.785145] [INFO ] [LOCAL ] GDL: Starting deletion of derivative data. [2025-09-16T18:35:50.785395] [DEBUG] [LOCAL ] GDL: Deleted derivative data file. [2025-09-16T18:35:50.785476] [INFO ] [MAIN ] Update Progress: 906/2369 symbols completed. GDL took 18.6s. Estimated remaining: 2h 34m 41s. Rate: 9.5 symbols/min [2025-09-16T18:35:50.961371] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:35:51.010925] [DEBUG] [LOCAL ] GE: Loaded 39678 existing records from primary storage. [2025-09-16T18:35:51.011150] [INFO ] [MAIN ] GE: Loaded 39678 existing records. [2025-09-16T18:35:51.209047] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:35:51.209336] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-09-16T18:35:51.209402] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-09-16T18:35:51.210490] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-09-16T18:35:51.210556] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-09-16T18:35:51.580121] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-09-16T18:35:51.583778] [INFO ] [REMOTE ] GE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:35:52.305304] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-16T18:35:52.374869] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-09-16T18:35:52.788296] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-16T18:35:53.174945] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-09-16T18:35:53.652962] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-16T18:35:53.974913] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-09-16T18:35:54.378693] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-16T18:35:54.774905] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-09-16T18:35:55.574909] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-09-16T18:35:55.970327] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-16T18:35:56.059814] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-16T18:35:56.374866] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-09-16T18:35:56.436636] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-16T18:35:57.174911] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-09-16T18:35:57.511024] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-16T18:35:57.679605] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-16T18:35:57.974931] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-09-16T18:35:58.774905] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-09-16T18:35:59.228877] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-16T18:35:59.358483] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-16T18:35:59.359984] [INFO ] [REMOTE ] GDO: Full fetch complete (6513 records). [2025-09-16T18:35:59.360077] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-09-16T18:35:59.580013] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-09-16T18:35:59.749161] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-09-16T18:35:59.749242] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-09-16T18:35:59.749426] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-09-16T18:35:59.749478] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-09-16T18:35:59.749896] [DEBUG] [LOCAL ] GDO: Trimmed 6513 records to 4393 (keeping 150 days of data) [2025-09-16T18:35:59.777966] [DEBUG] [LOCAL ] GDO: Primary data saved (4393 records). [2025-09-16T18:35:59.778067] [INFO ] [MAIN ] GDO: Full history saved. [2025-09-16T18:35:59.778181] [INFO ] [MAIN ] Update Progress: 907/2369 symbols completed. GDO took 27.1s. Estimated remaining: 2h 34m 39s. Rate: 9.5 symbols/min [2025-09-16T18:35:59.953684] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:35:59.971925] [DEBUG] [LOCAL ] GEF: Loaded 15263 existing records from primary storage. [2025-09-16T18:35:59.972085] [INFO ] [MAIN ] GEF: Loaded 15263 existing records. [2025-09-16T18:36:00.168278] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:36:00.168585] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-09-16T18:36:00.168990] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-09-16T18:36:00.169494] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-09-16T18:36:00.169559] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-09-16T18:36:00.380024] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-09-16T18:36:00.548698] [INFO ] [REMOTE ] GEF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:36:01.174902] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-09-16T18:36:01.622530] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-16T18:36:01.812807] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-16T18:36:01.974908] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-09-16T18:36:02.474434] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-16T18:36:02.481803] [INFO ] [REMOTE ] GDOT: Full fetch complete (40983 records). [2025-09-16T18:36:02.482017] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-09-16T18:36:02.483134] [FATAL] [VALIDATOR ] GDOT: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:36:02.483292] [FATAL] [MAIN ] GDOT: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:36:02.483365] [WARN ] [MAIN ] GDOT: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:36:02.483438] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-09-16T18:36:02.483527] [DEBUG] [LOCAL ] GDOT: No primary data file found to delete. [2025-09-16T18:36:02.483589] [INFO ] [LOCAL ] GDOT: Starting deletion of derivative data. [2025-09-16T18:36:02.483929] [DEBUG] [LOCAL ] GDOT: Deleted derivative data file. [2025-09-16T18:36:02.484134] [INFO ] [MAIN ] Update Progress: 908/2369 symbols completed. GDOT took 22.0s. Estimated remaining: 2h 34m 27s. Rate: 9.5 symbols/min [2025-09-16T18:36:02.689109] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:36:02.714551] [DEBUG] [LOCAL ] GEL: Loaded 24836 existing records from primary storage. [2025-09-16T18:36:02.714720] [INFO ] [MAIN ] GEL: Loaded 24836 existing records. [2025-09-16T18:36:02.780356] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-09-16T18:36:02.894928] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:36:02.895161] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-09-16T18:36:02.895207] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-09-16T18:36:02.895853] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-09-16T18:36:02.895909] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-09-16T18:36:03.246789] [INFO ] [REMOTE ] GEL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:36:03.445721] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-16T18:36:03.574945] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-09-16T18:36:04.374890] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-09-16T18:36:04.951705] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-16T18:36:05.135328] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (3.16 seconds). [2025-09-16T18:36:05.174864] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-09-16T18:36:05.219139] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-16T18:36:05.974945] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-09-16T18:36:06.774904] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-09-16T18:36:07.105057] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-16T18:36:07.147854] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-16T18:36:07.574937] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-09-16T18:36:07.819940] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-16T18:36:08.374905] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-09-16T18:36:09.174940] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-09-16T18:36:09.268028] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-16T18:36:09.441815] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-16T18:36:09.974902] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-09-16T18:36:10.091000] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-16T18:36:10.093399] [INFO ] [REMOTE ] GDV: Full fetch complete (21730 records). [2025-09-16T18:36:10.093487] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-09-16T18:36:10.485796] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-09-16T18:36:10.485875] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-09-16T18:36:10.486318] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-09-16T18:36:10.486358] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-09-16T18:36:10.486958] [DEBUG] [LOCAL ] GDV: Trimmed 21730 records to 14371 (keeping 150 days of data) [2025-09-16T18:36:10.578599] [DEBUG] [LOCAL ] GDV: Primary data saved (14371 records). [2025-09-16T18:36:10.578764] [INFO ] [MAIN ] GDV: Full history saved. [2025-09-16T18:36:10.578869] [INFO ] [MAIN ] Update Progress: 909/2369 symbols completed. GDV took 25.4s. Estimated remaining: 2h 34m 24s. Rate: 9.5 symbols/min [2025-09-16T18:36:10.751491] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:36:10.774918] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-09-16T18:36:10.792722] [DEBUG] [LOCAL ] GENI: Loaded 38999 existing records from primary storage. [2025-09-16T18:36:10.792854] [INFO ] [MAIN ] GENI: Loaded 38999 existing records. [2025-09-16T18:36:10.970182] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:36:10.970457] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-09-16T18:36:10.970503] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-09-16T18:36:10.971301] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-09-16T18:36:10.971350] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-09-16T18:36:11.326968] [INFO ] [REMOTE ] GENI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:36:11.574900] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-09-16T18:36:11.744736] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-16T18:36:12.046939] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-16T18:36:12.374892] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-09-16T18:36:13.174878] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-09-16T18:36:13.209465] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-16T18:36:13.974917] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-09-16T18:36:14.065538] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-16T18:36:14.319594] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-16T18:36:14.774905] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-09-16T18:36:15.424242] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-16T18:36:15.574899] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-09-16T18:36:15.937948] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-16T18:36:16.374906] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-09-16T18:36:16.948613] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-16T18:36:17.174904] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-09-16T18:36:17.974899] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-09-16T18:36:18.184771] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-16T18:36:18.190559] [INFO ] [REMOTE ] GE: Full fetch complete (58001 records). [2025-09-16T18:36:18.190681] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-09-16T18:36:18.191269] [FATAL] [VALIDATOR ] GE: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:36:18.191345] [FATAL] [MAIN ] GE: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:36:18.191382] [WARN ] [MAIN ] GE: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:36:18.191433] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-09-16T18:36:18.191490] [DEBUG] [LOCAL ] GE: No primary data file found to delete. [2025-09-16T18:36:18.191527] [INFO ] [LOCAL ] GE: Starting deletion of derivative data. [2025-09-16T18:36:18.191865] [DEBUG] [LOCAL ] GE: Deleted derivative data file. [2025-09-16T18:36:18.191959] [INFO ] [MAIN ] Update Progress: 910/2369 symbols completed. GE took 27.4s. Estimated remaining: 2h 34m 19s. Rate: 9.5 symbols/min [2025-09-16T18:36:18.369771] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:36:18.408558] [DEBUG] [LOCAL ] GEO: Loaded 38450 existing records from primary storage. [2025-09-16T18:36:18.408716] [INFO ] [MAIN ] GEO: Loaded 38450 existing records. [2025-09-16T18:36:18.607226] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:36:18.607603] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-09-16T18:36:18.607762] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-09-16T18:36:18.608533] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-09-16T18:36:18.608585] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-09-16T18:36:18.778874] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-09-16T18:36:18.914104] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-16T18:36:19.022771] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-16T18:36:19.041036] [INFO ] [REMOTE ] GEO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:36:19.574912] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-09-16T18:36:19.869011] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-16T18:36:20.374901] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-09-16T18:36:21.174919] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-09-16T18:36:21.573201] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-16T18:36:21.668325] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-16T18:36:21.974902] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-09-16T18:36:22.202140] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-16T18:36:22.774926] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-09-16T18:36:23.377433] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-16T18:36:23.574910] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-09-16T18:36:23.858533] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-16T18:36:23.862151] [INFO ] [REMOTE ] GEL: Full fetch complete (37619 records). [2025-09-16T18:36:23.862238] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-09-16T18:36:24.242769] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-09-16T18:36:24.242850] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-09-16T18:36:24.243438] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-09-16T18:36:24.243479] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-09-16T18:36:24.244346] [DEBUG] [LOCAL ] GEL: Trimmed 37619 records to 24970 (keeping 150 days of data) [2025-09-16T18:36:24.375084] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-09-16T18:36:24.413360] [DEBUG] [LOCAL ] GEL: Primary data saved (24970 records). [2025-09-16T18:36:24.413491] [INFO ] [MAIN ] GEL: Full history saved. [2025-09-16T18:36:24.413582] [INFO ] [MAIN ] Update Progress: 911/2369 symbols completed. GEL took 21.9s. Estimated remaining: 2h 34m 13s. Rate: 9.5 symbols/min [2025-09-16T18:36:24.586929] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:36:24.596835] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-16T18:36:24.628233] [DEBUG] [LOCAL ] GES: Loaded 28051 existing records from primary storage. [2025-09-16T18:36:24.628403] [INFO ] [MAIN ] GES: Loaded 28051 existing records. [2025-09-16T18:36:24.813041] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:36:24.813315] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-09-16T18:36:24.813364] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-09-16T18:36:24.814024] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-09-16T18:36:24.814075] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-09-16T18:36:25.176079] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-09-16T18:36:25.179133] [INFO ] [REMOTE ] GES: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:36:25.974897] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-09-16T18:36:26.298816] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-16T18:36:26.503364] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-16T18:36:26.774912] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-09-16T18:36:27.574921] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-09-16T18:36:27.822570] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-16T18:36:28.253524] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-16T18:36:28.374892] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-09-16T18:36:29.094161] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-16T18:36:29.174851] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-09-16T18:36:29.568705] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-16T18:36:29.974896] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-09-16T18:36:30.782766] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-09-16T18:36:30.784836] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-16T18:36:30.791329] [INFO ] [REMOTE ] GENI: Full fetch complete (57262 records). [2025-09-16T18:36:30.791415] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-09-16T18:36:31.181722] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-09-16T18:36:31.181819] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-09-16T18:36:31.182576] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-09-16T18:36:31.182617] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-09-16T18:36:31.183685] [DEBUG] [LOCAL ] GENI: Trimmed 57262 records to 39386 (keeping 150 days of data) [2025-09-16T18:36:31.421935] [DEBUG] [LOCAL ] GENI: Primary data saved (39386 records). [2025-09-16T18:36:31.422094] [INFO ] [MAIN ] GENI: Full history saved. [2025-09-16T18:36:31.422183] [INFO ] [MAIN ] Update Progress: 912/2369 symbols completed. GENI took 20.8s. Estimated remaining: 2h 34m 7s. Rate: 9.5 symbols/min [2025-09-16T18:36:31.577327] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-09-16T18:36:31.596224] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:36:31.622430] [DEBUG] [LOCAL ] GETY: Loaded 25721 existing records from primary storage. [2025-09-16T18:36:31.622550] [INFO ] [MAIN ] GETY: Loaded 25721 existing records. [2025-09-16T18:36:31.806981] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:36:31.807587] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-09-16T18:36:31.807837] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-09-16T18:36:31.808405] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-09-16T18:36:31.808452] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-09-16T18:36:32.135108] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-16T18:36:32.218316] [INFO ] [REMOTE ] GETY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:36:32.230914] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-16T18:36:32.374881] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-09-16T18:36:32.968362] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-16T18:36:33.174913] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-09-16T18:36:33.452889] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-16T18:36:33.457813] [INFO ] [REMOTE ] GEF: Full fetch complete (22288 records). [2025-09-16T18:36:33.457910] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-09-16T18:36:33.826779] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-09-16T18:36:33.826858] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-09-16T18:36:33.827303] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-09-16T18:36:33.827345] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-09-16T18:36:33.827983] [DEBUG] [LOCAL ] GEF: Trimmed 22288 records to 15462 (keeping 150 days of data) [2025-09-16T18:36:33.928366] [DEBUG] [LOCAL ] GEF: Primary data saved (15462 records). [2025-09-16T18:36:33.928523] [INFO ] [MAIN ] GEF: Full history saved. [2025-09-16T18:36:33.928635] [INFO ] [MAIN ] Update Progress: 913/2369 symbols completed. GEF took 34.2s. Estimated remaining: 2h 33m 55s. Rate: 9.5 symbols/min [2025-09-16T18:36:33.986140] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-09-16T18:36:34.123566] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:36:34.172890] [DEBUG] [LOCAL ] GEV: Loaded 39188 existing records from primary storage. [2025-09-16T18:36:34.173052] [INFO ] [MAIN ] GEV: Loaded 39188 existing records. [2025-09-16T18:36:34.379408] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:36:34.379759] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-09-16T18:36:34.379887] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-09-16T18:36:34.381185] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-09-16T18:36:34.381268] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-09-16T18:36:34.782534] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-09-16T18:36:34.903220] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-16T18:36:35.022213] [INFO ] [REMOTE ] GEV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:36:35.408926] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-16T18:36:35.574894] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-09-16T18:36:36.374904] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-09-16T18:36:36.752801] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-16T18:36:37.174926] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-09-16T18:36:37.954416] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-16T18:36:37.974853] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-09-16T18:36:38.208735] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (2.63 seconds). [2025-09-16T18:36:38.566082] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-16T18:36:38.774892] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-09-16T18:36:39.574982] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-09-16T18:36:39.673050] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-16T18:36:40.374934] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-09-16T18:36:40.982278] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-16T18:36:41.080792] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-16T18:36:41.174853] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-09-16T18:36:41.868207] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-16T18:36:41.974917] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-09-16T18:36:42.181190] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-16T18:36:42.774918] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-09-16T18:36:43.574922] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-09-16T18:36:44.093779] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-16T18:36:44.374908] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-09-16T18:36:44.424360] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-16T18:36:45.093572] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-16T18:36:45.174867] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-09-16T18:36:45.974059] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-16T18:36:45.979464] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-09-16T18:36:45.980891] [INFO ] [REMOTE ] GEO: Full fetch complete (56844 records). [2025-09-16T18:36:45.980987] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-09-16T18:36:46.368431] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-09-16T18:36:46.368528] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-09-16T18:36:46.369387] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-09-16T18:36:46.369468] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-09-16T18:36:46.371148] [DEBUG] [LOCAL ] GEO: Trimmed 56844 records to 38814 (keeping 150 days of data) [2025-09-16T18:36:46.508695] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-16T18:36:46.635315] [DEBUG] [LOCAL ] GEO: Primary data saved (38814 records). [2025-09-16T18:36:46.635469] [INFO ] [MAIN ] GEO: Full history saved. [2025-09-16T18:36:46.635569] [INFO ] [MAIN ] Update Progress: 914/2369 symbols completed. GEO took 28.4s. Estimated remaining: 2h 33m 59s. Rate: 9.4 symbols/min [2025-09-16T18:36:46.779174] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-09-16T18:36:46.809202] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:36:46.813120] [DEBUG] [LOCAL ] GF: Loaded 2108 existing records from primary storage. [2025-09-16T18:36:46.813196] [INFO ] [MAIN ] GF: Loaded 2108 existing records. [2025-09-16T18:36:46.991982] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:36:46.992224] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-09-16T18:36:46.992271] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-09-16T18:36:46.992449] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-09-16T18:36:46.992491] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-09-16T18:36:47.350597] [INFO ] [REMOTE ] GF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:36:47.574892] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-09-16T18:36:48.298435] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-16T18:36:48.374920] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-09-16T18:36:48.436903] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-16T18:36:48.518930] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-09-16T18:36:49.174907] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-09-16T18:36:49.814506] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-16T18:36:49.974998] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-09-16T18:36:50.774949] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-09-16T18:36:51.390101] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-16T18:36:51.433345] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-09-16T18:36:51.569574] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-16T18:36:51.574834] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-09-16T18:36:52.130983] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-16T18:36:52.374908] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-09-16T18:36:53.022240] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-16T18:36:53.174883] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-09-16T18:36:53.661288] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-16T18:36:53.974910] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-09-16T18:36:54.774903] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-09-16T18:36:55.272149] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-16T18:36:55.284454] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-16T18:36:55.288725] [INFO ] [REMOTE ] GETY: Full fetch complete (40402 records). [2025-09-16T18:36:55.288830] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-09-16T18:36:55.574865] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-09-16T18:36:55.660545] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-09-16T18:36:55.660658] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-09-16T18:36:55.661294] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-09-16T18:36:55.661336] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-09-16T18:36:55.662196] [DEBUG] [LOCAL ] GETY: Trimmed 40402 records to 25881 (keeping 150 days of data) [2025-09-16T18:36:55.807542] [DEBUG] [LOCAL ] GETY: Primary data saved (25881 records). [2025-09-16T18:36:55.807693] [INFO ] [MAIN ] GETY: Full history saved. [2025-09-16T18:36:55.807780] [INFO ] [MAIN ] Update Progress: 915/2369 symbols completed. GETY took 24.4s. Estimated remaining: 2h 33m 57s. Rate: 9.4 symbols/min [2025-09-16T18:36:55.986147] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:36:56.007414] [DEBUG] [LOCAL ] GFF: Loaded 22267 existing records from primary storage. [2025-09-16T18:36:56.007553] [INFO ] [MAIN ] GFF: Loaded 22267 existing records. [2025-09-16T18:36:56.164524] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-16T18:36:56.190834] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:36:56.191082] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-09-16T18:36:56.191143] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-09-16T18:36:56.191758] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-09-16T18:36:56.191817] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-09-16T18:36:56.380198] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-09-16T18:36:56.549752] [INFO ] [REMOTE ] GFF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:36:57.052840] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-16T18:36:57.053671] [INFO ] [REMOTE ] GF: Full fetch complete (4010 records). [2025-09-16T18:36:57.053742] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-09-16T18:36:57.179965] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-09-16T18:36:57.430688] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-09-16T18:36:57.430821] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-09-16T18:36:57.430993] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-09-16T18:36:57.431037] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-09-16T18:36:57.431451] [DEBUG] [LOCAL ] GF: Trimmed 4010 records to 2114 (keeping 150 days of data) [2025-09-16T18:36:57.444591] [DEBUG] [LOCAL ] GF: Primary data saved (2114 records). [2025-09-16T18:36:57.444680] [INFO ] [MAIN ] GF: Full history saved. [2025-09-16T18:36:57.444783] [INFO ] [MAIN ] Update Progress: 916/2369 symbols completed. GF took 10.8s. Estimated remaining: 2h 33m 43s. Rate: 9.5 symbols/min [2025-09-16T18:36:57.613018] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:36:57.651125] [DEBUG] [LOCAL ] GFI: Loaded 39110 existing records from primary storage. [2025-09-16T18:36:57.651299] [INFO ] [MAIN ] GFI: Loaded 39110 existing records. [2025-09-16T18:36:57.832340] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:36:57.832568] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-09-16T18:36:57.832615] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-09-16T18:36:57.833449] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-09-16T18:36:57.833525] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-09-16T18:36:57.979960] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-09-16T18:36:58.198685] [INFO ] [REMOTE ] GFI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:36:58.774903] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-09-16T18:36:59.450491] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-16T18:36:59.574891] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-09-16T18:36:59.954188] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-16T18:37:00.203816] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-16T18:37:00.374901] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-09-16T18:37:01.174914] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-09-16T18:37:01.980061] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-09-16T18:37:02.002156] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-09-16T18:37:02.156973] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-16T18:37:02.774943] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-09-16T18:37:02.929470] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-16T18:37:02.934187] [INFO ] [REMOTE ] GES: Full fetch complete (44510 records). [2025-09-16T18:37:02.934313] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-09-16T18:37:03.328820] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-09-16T18:37:03.329041] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-09-16T18:37:03.329816] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-09-16T18:37:03.329886] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-09-16T18:37:03.346700] [DEBUG] [LOCAL ] GES: Trimmed 44510 records to 28333 (keeping 150 days of data) [2025-09-16T18:37:03.351140] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-16T18:37:03.531210] [DEBUG] [LOCAL ] GES: Primary data saved (28333 records). [2025-09-16T18:37:03.531353] [INFO ] [MAIN ] GES: Full history saved. [2025-09-16T18:37:03.532670] [INFO ] [MAIN ] Update Progress: 917/2369 symbols completed. GES took 39.1s. Estimated remaining: 2h 33m 36s. Rate: 9.5 symbols/min [2025-09-16T18:37:03.574871] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-09-16T18:37:04.290911] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-16T18:37:04.374895] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-09-16T18:37:04.802266] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-16T18:37:05.174906] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-09-16T18:37:05.974937] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-09-16T18:37:06.112476] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-16T18:37:06.209208] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-16T18:37:06.774905] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-09-16T18:37:07.574914] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-09-16T18:37:07.663024] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-16T18:37:07.872838] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-16T18:37:07.878679] [INFO ] [REMOTE ] GEV: Full fetch complete (57439 records). [2025-09-16T18:37:07.878807] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-09-16T18:37:07.879582] [FATAL] [VALIDATOR ] GEV: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:37:07.879706] [FATAL] [MAIN ] GEV: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:37:07.879743] [WARN ] [MAIN ] GEV: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:37:07.879809] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-09-16T18:37:07.879883] [DEBUG] [LOCAL ] GEV: No primary data file found to delete. [2025-09-16T18:37:07.879923] [INFO ] [LOCAL ] GEV: Starting deletion of derivative data. [2025-09-16T18:37:07.880234] [DEBUG] [LOCAL ] GEV: Deleted derivative data file. [2025-09-16T18:37:07.881604] [INFO ] [MAIN ] Update Progress: 918/2369 symbols completed. GEV took 34.0s. Estimated remaining: 2h 33m 27s. Rate: 9.5 symbols/min [2025-09-16T18:37:08.374894] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-09-16T18:37:09.278823] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-16T18:37:09.284971] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-09-16T18:37:09.570459] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-16T18:37:09.974956] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-09-16T18:37:10.531561] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-16T18:37:10.774916] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-09-16T18:37:11.540167] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-16T18:37:11.574852] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-09-16T18:37:11.864322] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-16T18:37:11.867862] [INFO ] [REMOTE ] GFF: Full fetch complete (33758 records). [2025-09-16T18:37:11.867955] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-09-16T18:37:11.868423] [FATAL] [VALIDATOR ] GFF: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:37:11.868499] [FATAL] [MAIN ] GFF: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:37:11.868535] [WARN ] [MAIN ] GFF: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:37:11.868572] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-09-16T18:37:11.868628] [DEBUG] [LOCAL ] GFF: No primary data file found to delete. [2025-09-16T18:37:11.868689] [INFO ] [LOCAL ] GFF: Starting deletion of derivative data. [2025-09-16T18:37:11.868951] [DEBUG] [LOCAL ] GFF: Deleted derivative data file. [2025-09-16T18:37:11.869028] [INFO ] [MAIN ] Update Progress: 919/2369 symbols completed. GFF took 16.1s. Estimated remaining: 2h 33m 17s. Rate: 9.5 symbols/min [2025-09-16T18:37:13.363454] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-16T18:37:13.375117] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-09-16T18:37:15.066862] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-16T18:37:15.078220] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-09-16T18:37:16.601191] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-16T18:37:16.607700] [INFO ] [REMOTE ] GFI: Full fetch complete (57730 records). [2025-09-16T18:37:16.607806] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-09-16T18:37:16.994782] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-09-16T18:37:16.994881] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-09-16T18:37:16.995828] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-09-16T18:37:16.995881] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-09-16T18:37:16.998023] [DEBUG] [LOCAL ] GFI: Trimmed 57730 records to 39500 (keeping 150 days of data) [2025-09-16T18:37:17.241231] [DEBUG] [LOCAL ] GFI: Primary data saved (39500 records). [2025-09-16T18:37:17.241388] [INFO ] [MAIN ] GFI: Full history saved. [2025-09-16T18:37:17.241488] [INFO ] [MAIN ] Update Progress: 920/2369 symbols completed. GFI took 19.8s. Estimated remaining: 2h 33m 9s. Rate: 9.5 symbols/min [2025-09-16T18:37:17.834965] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:37:17.950550] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:37:17.953158] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:37:17.994391] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:37:18.009136] [DEBUG] [LOCAL ] GFR: Loaded 5085 existing records from primary storage. [2025-09-16T18:37:18.009449] [INFO ] [MAIN ] GFR: Loaded 5085 existing records. [2025-09-16T18:37:18.237554] [DEBUG] [LOCAL ] GGG: Loaded 29577 existing records from primary storage. [2025-09-16T18:37:18.255330] [INFO ] [MAIN ] GGG: Loaded 29577 existing records. [2025-09-16T18:37:18.260269] [DEBUG] [LOCAL ] GFL: Loaded 34741 existing records from primary storage. [2025-09-16T18:37:18.254328] [DEBUG] [LOCAL ] GGB: Loaded 37887 existing records from primary storage. [2025-09-16T18:37:18.259602] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:37:18.290299] [INFO ] [MAIN ] GFL: Loaded 34741 existing records. [2025-09-16T18:37:18.301021] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-09-16T18:37:18.326682] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-09-16T18:37:18.326756] [INFO ] [MAIN ] GGB: Loaded 37887 existing records. [2025-09-16T18:37:18.359376] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-09-16T18:37:18.423263] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-09-16T18:37:18.808177] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:37:18.850255] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-09-16T18:37:18.882019] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:37:18.916097] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-09-16T18:37:18.927175] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-09-16T18:37:18.927240] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-09-16T18:37:18.921285] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:37:18.937746] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-09-16T18:37:18.943009] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-09-16T18:37:18.988579] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-09-16T18:37:19.034820] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-09-16T18:37:19.016473] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-09-16T18:37:19.135850] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-09-16T18:37:19.249454] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-09-16T18:37:19.311100] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-09-16T18:37:19.625828] [INFO ] [REMOTE ] GFR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:37:19.669338] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-09-16T18:37:20.101982] [INFO ] [REMOTE ] GGG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:37:20.130086] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-09-16T18:37:20.188873] [INFO ] [REMOTE ] GFL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:37:20.189387] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-09-16T18:37:20.266531] [INFO ] [REMOTE ] GGB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:37:20.266847] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-09-16T18:37:20.475768] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-16T18:37:20.478064] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-09-16T18:37:21.463603] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-16T18:37:21.481224] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-16T18:37:21.481805] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-09-16T18:37:21.487845] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-09-16T18:37:21.691175] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-16T18:37:21.701009] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-09-16T18:37:21.998426] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-16T18:37:22.003906] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-09-16T18:37:22.078708] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-16T18:37:22.086722] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-09-16T18:37:22.583655] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-16T18:37:22.586530] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-09-16T18:37:23.033683] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-16T18:37:23.044261] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-09-16T18:37:23.124753] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-16T18:37:23.282532] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-16T18:37:23.574945] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-09-16T18:37:23.697959] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-16T18:37:24.374868] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-09-16T18:37:24.504543] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-16T18:37:24.982817] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-16T18:37:25.174912] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-09-16T18:37:25.857103] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-16T18:37:25.974908] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-09-16T18:37:26.320023] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-16T18:37:26.774912] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-09-16T18:37:27.199096] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-16T18:37:27.244782] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-16T18:37:27.574921] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-09-16T18:37:28.374974] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-09-16T18:37:28.819814] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-16T18:37:29.174961] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-09-16T18:37:29.729267] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-16T18:37:29.974901] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-09-16T18:37:30.369220] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-16T18:37:30.452207] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-16T18:37:30.774953] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-09-16T18:37:31.574900] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-09-16T18:37:32.118340] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-16T18:37:32.374886] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-09-16T18:37:33.029160] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-16T18:37:33.174911] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-09-16T18:37:33.974860] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-09-16T18:37:34.032458] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-16T18:37:34.033592] [INFO ] [REMOTE ] GFR: Full fetch complete (9141 records). [2025-09-16T18:37:34.033703] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-09-16T18:37:34.356838] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-16T18:37:34.446989] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-09-16T18:37:34.447069] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-09-16T18:37:34.447311] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-09-16T18:37:34.447366] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-09-16T18:37:34.447808] [DEBUG] [LOCAL ] GFR: Trimmed 9141 records to 5148 (keeping 150 days of data) [2025-09-16T18:37:34.475501] [DEBUG] [LOCAL ] GFR: Primary data saved (5148 records). [2025-09-16T18:37:34.475577] [INFO ] [MAIN ] GFR: Full history saved. [2025-09-16T18:37:34.475684] [INFO ] [MAIN ] Update Progress: 921/2369 symbols completed. GFR took 17.2s. Estimated remaining: 2h 33m 20s. Rate: 9.4 symbols/min [2025-09-16T18:37:34.651172] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:37:34.663343] [DEBUG] [LOCAL ] GGT: Loaded 11031 existing records from primary storage. [2025-09-16T18:37:34.663461] [INFO ] [MAIN ] GGT: Loaded 11031 existing records. [2025-09-16T18:37:34.779965] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-09-16T18:37:34.842243] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:37:34.842448] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-09-16T18:37:34.842494] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-09-16T18:37:34.842858] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-09-16T18:37:34.842907] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-09-16T18:37:35.191135] [INFO ] [REMOTE ] GGT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:37:35.574897] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-09-16T18:37:35.682976] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-16T18:37:36.334379] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-16T18:37:36.374867] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-09-16T18:37:36.795481] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-16T18:37:37.174897] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-09-16T18:37:37.226351] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-16T18:37:37.974899] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-09-16T18:37:38.143743] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-16T18:37:38.148408] [INFO ] [REMOTE ] GGG: Full fetch complete (44559 records). [2025-09-16T18:37:38.148500] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-09-16T18:37:38.554785] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-09-16T18:37:38.554874] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-09-16T18:37:38.555606] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-09-16T18:37:38.555669] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-09-16T18:37:38.556768] [DEBUG] [LOCAL ] GGG: Trimmed 44559 records to 29913 (keeping 150 days of data) [2025-09-16T18:37:38.770801] [DEBUG] [LOCAL ] GGG: Primary data saved (29913 records). [2025-09-16T18:37:38.771062] [INFO ] [MAIN ] GGG: Full history saved. [2025-09-16T18:37:38.771235] [INFO ] [MAIN ] Update Progress: 922/2369 symbols completed. GGG took 21.5s. Estimated remaining: 2h 33m 10s. Rate: 9.4 symbols/min [2025-09-16T18:37:38.782919] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-09-16T18:37:38.860328] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-16T18:37:38.962422] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:37:38.965919] [DEBUG] [LOCAL ] GGZ: Loaded 1696 existing records from primary storage. [2025-09-16T18:37:38.965994] [INFO ] [MAIN ] GGZ: Loaded 1696 existing records. [2025-09-16T18:37:39.139529] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:37:39.139781] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-09-16T18:37:39.139827] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-09-16T18:37:39.140004] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-09-16T18:37:39.140047] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-09-16T18:37:39.489885] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:37:39.574886] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-09-16T18:37:40.334138] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-16T18:37:40.340032] [INFO ] [REMOTE ] GFL: Full fetch complete (52371 records). [2025-09-16T18:37:40.340178] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-09-16T18:37:40.383977] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-09-16T18:37:40.515762] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-16T18:37:40.738084] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-09-16T18:37:40.738169] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-09-16T18:37:40.738941] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-09-16T18:37:40.738989] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-09-16T18:37:40.740187] [DEBUG] [LOCAL ] GFL: Trimmed 52371 records to 35126 (keeping 150 days of data) [2025-09-16T18:37:40.958962] [DEBUG] [LOCAL ] GFL: Primary data saved (35126 records). [2025-09-16T18:37:40.959149] [INFO ] [MAIN ] GFL: Full history saved. [2025-09-16T18:37:40.960082] [INFO ] [MAIN ] Update Progress: 923/2369 symbols completed. GFL took 23.7s. Estimated remaining: 2h 32m 57s. Rate: 9.5 symbols/min [2025-09-16T18:37:41.143781] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:37:41.148598] [DEBUG] [LOCAL ] GHC: Loaded 2054 existing records from primary storage. [2025-09-16T18:37:41.148729] [INFO ] [MAIN ] GHC: Loaded 2054 existing records. [2025-09-16T18:37:41.180034] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-09-16T18:37:41.239781] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-16T18:37:41.332402] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:37:41.332626] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-09-16T18:37:41.332693] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-09-16T18:37:41.332903] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-09-16T18:37:41.332957] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-09-16T18:37:41.696240] [INFO ] [REMOTE ] GHC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:37:41.974903] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-09-16T18:37:42.240077] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-16T18:37:42.442724] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-16T18:37:42.774935] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-09-16T18:37:43.574910] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-09-16T18:37:43.700105] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-16T18:37:44.374925] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-09-16T18:37:44.851081] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-16T18:37:45.174861] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-09-16T18:37:45.221289] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-16T18:37:45.711260] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-16T18:37:45.974944] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-09-16T18:37:46.503729] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-16T18:37:46.774911] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-09-16T18:37:47.394057] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-16T18:37:47.574900] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-09-16T18:37:48.374884] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-09-16T18:37:48.626793] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-16T18:37:49.174917] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-09-16T18:37:49.662807] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-16T18:37:49.894112] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-16T18:37:49.900094] [INFO ] [REMOTE ] GGB: Full fetch complete (55453 records). [2025-09-16T18:37:49.900198] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-09-16T18:37:49.980029] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-09-16T18:37:50.300557] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-09-16T18:37:50.300658] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-09-16T18:37:50.301394] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-09-16T18:37:50.301437] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-09-16T18:37:50.302540] [DEBUG] [LOCAL ] GGB: Trimmed 55453 records to 38267 (keeping 150 days of data) [2025-09-16T18:37:50.524935] [DEBUG] [LOCAL ] GGB: Primary data saved (38267 records). [2025-09-16T18:37:50.525071] [INFO ] [MAIN ] GGB: Full history saved. [2025-09-16T18:37:50.525165] [INFO ] [MAIN ] Update Progress: 924/2369 symbols completed. GGB took 33.3s. Estimated remaining: 2h 32m 56s. Rate: 9.4 symbols/min [2025-09-16T18:37:50.704458] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:37:50.704843] [DEBUG] [LOCAL ] GHG: No existing data file found in primary storage. [2025-09-16T18:37:50.708505] [WARN ] [MAIN ] GHG: No existing data found, performing full refresh instead. [2025-09-16T18:37:50.709389] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-16T18:37:50.709546] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-09-16T18:37:50.711057] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-09-16T18:37:50.711338] [DEBUG] [LOCAL ] GHG: No primary data file found to delete. [2025-09-16T18:37:50.711374] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-09-16T18:37:50.780003] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-09-16T18:37:51.076744] [INFO ] [REMOTE ] GHG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:37:51.412901] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-16T18:37:51.574866] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-09-16T18:37:52.069619] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-16T18:37:52.374925] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-09-16T18:37:52.883462] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-16T18:37:53.174913] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-09-16T18:37:53.745951] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-16T18:37:53.746851] [INFO ] [REMOTE ] GHC: Full fetch complete (2700 records). [2025-09-16T18:37:53.746918] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-09-16T18:37:53.983773] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-09-16T18:37:54.100668] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-09-16T18:37:54.100754] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-09-16T18:37:54.100860] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-09-16T18:37:54.100899] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-09-16T18:37:54.101231] [DEBUG] [LOCAL ] GHC: Trimmed 2700 records to 2082 (keeping 150 days of data) [2025-09-16T18:37:54.114879] [DEBUG] [LOCAL ] GHC: Primary data saved (2082 records). [2025-09-16T18:37:54.114943] [INFO ] [MAIN ] GHC: Full history saved. [2025-09-16T18:37:54.115051] [INFO ] [MAIN ] Update Progress: 925/2369 symbols completed. GHC took 13.2s. Estimated remaining: 2h 32m 45s. Rate: 9.5 symbols/min [2025-09-16T18:37:54.286531] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:37:54.294479] [DEBUG] [LOCAL ] GHI: Loaded 5230 existing records from primary storage. [2025-09-16T18:37:54.294620] [INFO ] [MAIN ] GHI: Loaded 5230 existing records. [2025-09-16T18:37:54.475693] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:37:54.478675] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-16T18:37:54.478552] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-09-16T18:37:54.478806] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-09-16T18:37:54.480202] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-09-16T18:37:54.480253] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-09-16T18:37:54.780035] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-09-16T18:37:54.831147] [INFO ] [REMOTE ] GHI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:37:55.331010] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-16T18:37:55.574920] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-09-16T18:37:56.374892] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-09-16T18:37:56.467343] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-16T18:37:56.804973] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-16T18:37:56.805855] [INFO ] [REMOTE ] GGZ: Full fetch complete (2720 records). [2025-09-16T18:37:56.805941] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-09-16T18:37:57.175381] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-09-16T18:37:57.176560] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-09-16T18:37:57.176675] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-09-16T18:37:57.176785] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-09-16T18:37:57.176825] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-09-16T18:37:57.177171] [DEBUG] [LOCAL ] GGZ: Trimmed 2720 records to 1704 (keeping 150 days of data) [2025-09-16T18:37:57.188561] [DEBUG] [LOCAL ] GGZ: Primary data saved (1704 records). [2025-09-16T18:37:57.188620] [INFO ] [MAIN ] GGZ: Full history saved. [2025-09-16T18:37:57.188731] [INFO ] [MAIN ] Update Progress: 926/2369 symbols completed. GGZ took 18.4s. Estimated remaining: 2h 32m 34s. Rate: 9.5 symbols/min [2025-09-16T18:37:57.361421] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:37:57.366229] [DEBUG] [LOCAL ] GHLD: Loaded 3305 existing records from primary storage. [2025-09-16T18:37:57.366303] [INFO ] [MAIN ] GHLD: Loaded 3305 existing records. [2025-09-16T18:37:57.540402] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:37:57.540635] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-09-16T18:37:57.540708] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-09-16T18:37:57.540947] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-09-16T18:37:57.540991] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-09-16T18:37:57.887554] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:37:57.974854] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-09-16T18:37:58.146351] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-16T18:37:58.429541] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-16T18:37:58.774918] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-09-16T18:37:59.305764] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-16T18:37:59.574946] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-09-16T18:38:00.066546] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-16T18:38:00.374889] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-09-16T18:38:01.174951] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-09-16T18:38:01.503962] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-16T18:38:01.506361] [INFO ] [REMOTE ] GGT: Full fetch complete (14989 records). [2025-09-16T18:38:01.506553] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-09-16T18:38:01.884607] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-09-16T18:38:01.884773] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-09-16T18:38:01.885404] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-09-16T18:38:01.885511] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-09-16T18:38:01.886620] [DEBUG] [LOCAL ] GGT: Trimmed 14989 records to 11129 (keeping 150 days of data) [2025-09-16T18:38:01.960619] [DEBUG] [LOCAL ] GGT: Primary data saved (11129 records). [2025-09-16T18:38:01.960811] [INFO ] [MAIN ] GGT: Full history saved. [2025-09-16T18:38:01.961074] [INFO ] [MAIN ] Update Progress: 927/2369 symbols completed. GGT took 27.5s. Estimated remaining: 2h 32m 25s. Rate: 9.5 symbols/min [2025-09-16T18:38:01.982479] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-09-16T18:38:02.213586] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:38:02.225517] [DEBUG] [LOCAL ] GHM: Loaded 10420 existing records from primary storage. [2025-09-16T18:38:02.225634] [INFO ] [MAIN ] GHM: Loaded 10420 existing records. [2025-09-16T18:38:02.408493] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:38:02.408808] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-09-16T18:38:02.408856] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-09-16T18:38:02.409274] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-09-16T18:38:02.409321] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-09-16T18:38:02.542634] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-16T18:38:02.700256] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-16T18:38:02.775069] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-09-16T18:38:02.778226] [INFO ] [REMOTE ] GHM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:38:03.357490] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-16T18:38:03.574884] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-09-16T18:38:04.314750] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-16T18:38:04.374906] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-09-16T18:38:04.835831] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-16T18:38:05.174913] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-09-16T18:38:05.712443] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-16T18:38:05.974953] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-09-16T18:38:06.582483] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-16T18:38:06.774916] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-09-16T18:38:07.574906] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-09-16T18:38:08.037582] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-16T18:38:08.320934] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-16T18:38:08.374849] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-09-16T18:38:09.174891] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-09-16T18:38:09.428156] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-16T18:38:09.728675] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-16T18:38:09.974928] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-09-16T18:38:10.774898] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-09-16T18:38:10.868220] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-16T18:38:11.441533] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-16T18:38:11.574931] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-09-16T18:38:11.975499] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-16T18:38:12.374924] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-09-16T18:38:13.174919] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-09-16T18:38:13.273740] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-16T18:38:13.274831] [INFO ] [REMOTE ] GHG: Full fetch complete (3333 records). [2025-09-16T18:38:13.274904] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-09-16T18:38:13.275276] [FATAL] [VALIDATOR ] GHG: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:38:13.275359] [FATAL] [MAIN ] GHG: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:38:13.275397] [WARN ] [MAIN ] GHG: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:38:13.275437] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-09-16T18:38:13.275494] [DEBUG] [LOCAL ] GHG: No primary data file found to delete. [2025-09-16T18:38:13.275532] [INFO ] [LOCAL ] GHG: Starting deletion of derivative data. [2025-09-16T18:38:13.275604] [DEBUG] [LOCAL ] GHG: No derivative data file found to delete. [2025-09-16T18:38:13.275716] [INFO ] [MAIN ] Update Progress: 928/2369 symbols completed. GHG took 22.8s. Estimated remaining: 2h 32m 26s. Rate: 9.5 symbols/min [2025-09-16T18:38:13.447231] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:38:13.466091] [DEBUG] [LOCAL ] GHY: Loaded 14869 existing records from primary storage. [2025-09-16T18:38:13.466224] [INFO ] [MAIN ] GHY: Loaded 14869 existing records. [2025-09-16T18:38:13.647071] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:38:13.647325] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-09-16T18:38:13.647376] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-09-16T18:38:13.647863] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-09-16T18:38:13.647912] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-09-16T18:38:13.784162] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-16T18:38:13.979991] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-09-16T18:38:14.019505] [INFO ] [REMOTE ] GHY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:38:14.598487] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-16T18:38:14.774905] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-09-16T18:38:15.263023] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-16T18:38:15.574903] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-09-16T18:38:16.374927] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-09-16T18:38:16.427036] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-16T18:38:16.825823] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-16T18:38:17.174934] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-09-16T18:38:17.974904] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-09-16T18:38:18.053539] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-16T18:38:18.774910] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-09-16T18:38:19.203816] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-16T18:38:19.574893] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-09-16T18:38:19.865331] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-16T18:38:20.321833] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-16T18:38:20.323125] [INFO ] [REMOTE ] GHI: Full fetch complete (7572 records). [2025-09-16T18:38:20.323222] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-09-16T18:38:20.380270] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-09-16T18:38:20.699486] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-09-16T18:38:20.699567] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-09-16T18:38:20.699776] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-09-16T18:38:20.699819] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-09-16T18:38:20.700229] [DEBUG] [LOCAL ] GHI: Trimmed 7572 records to 5260 (keeping 150 days of data) [2025-09-16T18:38:20.733446] [DEBUG] [LOCAL ] GHI: Primary data saved (5260 records). [2025-09-16T18:38:20.733582] [INFO ] [MAIN ] GHI: Full history saved. [2025-09-16T18:38:20.733713] [INFO ] [MAIN ] Update Progress: 929/2369 symbols completed. GHI took 26.6s. Estimated remaining: 2h 32m 22s. Rate: 9.5 symbols/min [2025-09-16T18:38:20.904485] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:38:20.928028] [DEBUG] [LOCAL ] GIB: Loaded 22652 existing records from primary storage. [2025-09-16T18:38:20.928174] [INFO ] [MAIN ] GIB: Loaded 22652 existing records. [2025-09-16T18:38:21.107676] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:38:21.107903] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-09-16T18:38:21.107969] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-09-16T18:38:21.108574] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-09-16T18:38:21.108619] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-09-16T18:38:21.181922] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-09-16T18:38:21.461978] [INFO ] [REMOTE ] GIB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:38:21.485257] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-16T18:38:21.974901] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-09-16T18:38:22.121278] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-16T18:38:22.682342] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-16T18:38:22.774890] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-09-16T18:38:23.251467] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-16T18:38:23.574944] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-09-16T18:38:24.374931] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-09-16T18:38:25.138818] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-16T18:38:25.174876] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-09-16T18:38:25.557210] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-16T18:38:25.974915] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-09-16T18:38:26.133249] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-16T18:38:26.774914] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-09-16T18:38:26.898019] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-16T18:38:26.899196] [INFO ] [REMOTE ] GHLD: Full fetch complete (4082 records). [2025-09-16T18:38:26.899264] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-09-16T18:38:27.265840] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-09-16T18:38:27.265917] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-09-16T18:38:27.266050] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-09-16T18:38:27.266089] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-09-16T18:38:27.266463] [DEBUG] [LOCAL ] GHLD: Trimmed 4082 records to 3340 (keeping 150 days of data) [2025-09-16T18:38:27.287828] [DEBUG] [LOCAL ] GHLD: Primary data saved (3340 records). [2025-09-16T18:38:27.287902] [INFO ] [MAIN ] GHLD: Full history saved. [2025-09-16T18:38:27.287990] [INFO ] [MAIN ] Update Progress: 930/2369 symbols completed. GHLD took 30.1s. Estimated remaining: 2h 32m 16s. Rate: 9.5 symbols/min [2025-09-16T18:38:27.458707] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:38:27.458927] [DEBUG] [LOCAL ] GIC: No existing data file found in primary storage. [2025-09-16T18:38:27.458965] [WARN ] [MAIN ] GIC: No existing data found, performing full refresh instead. [2025-09-16T18:38:27.459082] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-09-16T18:38:27.459121] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-09-16T18:38:27.459161] [DEBUG] [LOCAL ] GIC: No primary data file found to delete. [2025-09-16T18:38:27.459194] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-09-16T18:38:27.580053] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-09-16T18:38:27.816519] [INFO ] [REMOTE ] GIC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:38:27.823202] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-16T18:38:27.825497] [INFO ] [REMOTE ] GHM: Full fetch complete (16146 records). [2025-09-16T18:38:27.825573] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-09-16T18:38:28.189751] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-09-16T18:38:28.189838] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-09-16T18:38:28.190266] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-09-16T18:38:28.190308] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-09-16T18:38:28.190931] [DEBUG] [LOCAL ] GHM: Trimmed 16146 records to 10550 (keeping 150 days of data) [2025-09-16T18:38:28.256198] [DEBUG] [LOCAL ] GHM: Primary data saved (10550 records). [2025-09-16T18:38:28.256350] [INFO ] [MAIN ] GHM: Full history saved. [2025-09-16T18:38:28.256441] [INFO ] [MAIN ] Update Progress: 931/2369 symbols completed. GHM took 26.3s. Estimated remaining: 2h 32m 1s. Rate: 9.5 symbols/min [2025-09-16T18:38:28.379975] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-09-16T18:38:28.434030] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:38:28.475711] [DEBUG] [LOCAL ] GIL: Loaded 31665 existing records from primary storage. [2025-09-16T18:38:28.475919] [INFO ] [MAIN ] GIL: Loaded 31665 existing records. [2025-09-16T18:38:28.659031] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:38:28.659279] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-09-16T18:38:28.659327] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-09-16T18:38:28.660264] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-09-16T18:38:28.660317] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-09-16T18:38:29.012230] [INFO ] [REMOTE ] GIL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:38:29.110106] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-16T18:38:29.174864] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-09-16T18:38:29.541149] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-16T18:38:29.974899] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-09-16T18:38:30.662764] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-16T18:38:30.774898] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-09-16T18:38:31.175352] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-16T18:38:31.574911] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-09-16T18:38:31.762730] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-16T18:38:32.374890] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-09-16T18:38:32.508416] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-16T18:38:33.174889] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-09-16T18:38:33.623676] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-16T18:38:33.974885] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-09-16T18:38:34.133929] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-16T18:38:34.614255] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-16T18:38:34.774897] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-09-16T18:38:35.574906] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-09-16T18:38:36.161622] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-16T18:38:36.374892] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-09-16T18:38:36.410881] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-16T18:38:37.174874] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-09-16T18:38:37.436165] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-16T18:38:37.922136] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-16T18:38:37.974861] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-09-16T18:38:38.774928] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-09-16T18:38:38.832097] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-16T18:38:39.574893] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-09-16T18:38:39.835108] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-16T18:38:40.374866] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-09-16T18:38:40.736557] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-16T18:38:41.174865] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-09-16T18:38:41.616190] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-16T18:38:41.974891] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-09-16T18:38:42.703199] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-16T18:38:42.774970] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-09-16T18:38:43.099963] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-16T18:38:43.104198] [INFO ] [REMOTE ] GIB: Full fetch complete (35479 records). [2025-09-16T18:38:43.104369] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-09-16T18:38:43.486807] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-09-16T18:38:43.486902] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-09-16T18:38:43.487565] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-09-16T18:38:43.487611] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-09-16T18:38:43.488685] [DEBUG] [LOCAL ] GIB: Trimmed 35479 records to 22835 (keeping 150 days of data) [2025-09-16T18:38:43.584389] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-09-16T18:38:43.638935] [DEBUG] [LOCAL ] GIB: Primary data saved (22835 records). [2025-09-16T18:38:43.639084] [INFO ] [MAIN ] GIB: Full history saved. [2025-09-16T18:38:43.639179] [INFO ] [MAIN ] Update Progress: 932/2369 symbols completed. GIB took 22.9s. Estimated remaining: 2h 32m 9s. Rate: 9.4 symbols/min [2025-09-16T18:38:43.809367] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:38:43.855957] [DEBUG] [LOCAL ] GIS: Loaded 39641 existing records from primary storage. [2025-09-16T18:38:43.856105] [INFO ] [MAIN ] GIS: Loaded 39641 existing records. [2025-09-16T18:38:44.034315] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:38:44.034565] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-09-16T18:38:44.034613] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-09-16T18:38:44.035781] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-09-16T18:38:44.035841] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-09-16T18:38:44.300136] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-16T18:38:44.334115] [INFO ] [REMOTE ] GHY: Full fetch complete (22990 records). [2025-09-16T18:38:44.336731] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-09-16T18:38:44.383676] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-09-16T18:38:44.503190] [INFO ] [REMOTE ] GIS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:38:44.797228] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-09-16T18:38:44.806844] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-09-16T18:38:44.807337] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-09-16T18:38:44.807388] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-09-16T18:38:44.808238] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-16T18:38:44.812795] [DEBUG] [LOCAL ] GHY: Trimmed 22990 records to 14955 (keeping 150 days of data) [2025-09-16T18:38:44.909898] [DEBUG] [LOCAL ] GHY: Primary data saved (14955 records). [2025-09-16T18:38:44.910049] [INFO ] [MAIN ] GHY: Full history saved. [2025-09-16T18:38:44.910134] [INFO ] [MAIN ] Update Progress: 933/2369 symbols completed. GHY took 31.6s. Estimated remaining: 2h 31m 54s. Rate: 9.5 symbols/min [2025-09-16T18:38:45.079491] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:38:45.112050] [DEBUG] [LOCAL ] GKOS: Loaded 31298 existing records from primary storage. [2025-09-16T18:38:45.112183] [INFO ] [MAIN ] GKOS: Loaded 31298 existing records. [2025-09-16T18:38:45.180083] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-09-16T18:38:45.294789] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:38:45.295026] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-09-16T18:38:45.295075] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-09-16T18:38:45.295906] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-09-16T18:38:45.295955] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-09-16T18:38:45.644875] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:38:45.974870] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-09-16T18:38:46.186032] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-16T18:38:46.188488] [INFO ] [REMOTE ] GIC: Full fetch complete (15090 records). [2025-09-16T18:38:46.188583] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-09-16T18:38:46.555011] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-09-16T18:38:46.555227] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-09-16T18:38:46.555598] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-09-16T18:38:46.555675] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-09-16T18:38:46.580477] [DEBUG] [LOCAL ] GIC: Trimmed 15090 records to 9935 (keeping 150 days of data) [2025-09-16T18:38:46.582587] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-16T18:38:46.654173] [DEBUG] [LOCAL ] GIC: Primary data saved (9935 records). [2025-09-16T18:38:46.654308] [INFO ] [MAIN ] GIC: Full history saved. [2025-09-16T18:38:46.654404] [INFO ] [MAIN ] Update Progress: 934/2369 symbols completed. GIC took 19.4s. Estimated remaining: 2h 31m 41s. Rate: 9.5 symbols/min [2025-09-16T18:38:46.780071] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-09-16T18:38:46.824954] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:38:46.862055] [DEBUG] [LOCAL ] GL: Loaded 27677 existing records from primary storage. [2025-09-16T18:38:46.862200] [INFO ] [MAIN ] GL: Loaded 27677 existing records. [2025-09-16T18:38:47.037177] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:38:47.037383] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-09-16T18:38:47.037428] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-09-16T18:38:47.038189] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-09-16T18:38:47.038238] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-09-16T18:38:47.389903] [INFO ] [REMOTE ] GL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:38:47.415744] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-16T18:38:47.574856] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-09-16T18:38:48.374914] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-09-16T18:38:48.440708] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-16T18:38:49.125105] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-16T18:38:49.174879] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-09-16T18:38:49.588263] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-16T18:38:49.974942] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-09-16T18:38:50.775335] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-09-16T18:38:50.777696] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-16T18:38:51.574955] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-09-16T18:38:51.613957] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-16T18:38:52.363107] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-16T18:38:52.374836] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-09-16T18:38:53.059426] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-16T18:38:53.174890] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-09-16T18:38:53.845700] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-16T18:38:53.974870] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-09-16T18:38:54.710266] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-16T18:38:54.774953] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-09-16T18:38:55.427328] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-16T18:38:55.574878] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-09-16T18:38:56.374898] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-09-16T18:38:56.750973] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-16T18:38:57.174934] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-09-16T18:38:57.292551] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-16T18:38:57.834561] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-16T18:38:57.974909] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-09-16T18:38:58.375970] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-16T18:38:58.774943] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-09-16T18:38:59.560080] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-16T18:38:59.574847] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-09-16T18:38:59.969745] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-16T18:38:59.975291] [INFO ] [REMOTE ] GIL: Full fetch complete (46636 records). [2025-09-16T18:38:59.975392] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-09-16T18:39:00.381366] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-09-16T18:39:00.393805] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-09-16T18:39:00.393866] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-09-16T18:39:00.394631] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-09-16T18:39:00.394789] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-09-16T18:39:00.395896] [DEBUG] [LOCAL ] GIL: Trimmed 46636 records to 31974 (keeping 150 days of data) [2025-09-16T18:39:00.601266] [DEBUG] [LOCAL ] GIL: Primary data saved (31974 records). [2025-09-16T18:39:00.601402] [INFO ] [MAIN ] GIL: Full history saved. [2025-09-16T18:39:00.601485] [INFO ] [MAIN ] Update Progress: 935/2369 symbols completed. GIL took 32.3s. Estimated remaining: 2h 31m 46s. Rate: 9.4 symbols/min [2025-09-16T18:39:00.780607] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:39:00.806883] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-16T18:39:00.844935] [DEBUG] [LOCAL ] GLOB: Loaded 35383 existing records from primary storage. [2025-09-16T18:39:00.845100] [INFO ] [MAIN ] GLOB: Loaded 35383 existing records. [2025-09-16T18:39:01.019182] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:39:01.019408] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-09-16T18:39:01.019456] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-09-16T18:39:01.020271] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-09-16T18:39:01.020329] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-09-16T18:39:01.177337] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-09-16T18:39:01.378539] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:39:01.668692] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-16T18:39:01.974947] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-09-16T18:39:02.706881] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-16T18:39:02.774948] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-09-16T18:39:03.408377] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-16T18:39:03.574914] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-09-16T18:39:04.374876] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-09-16T18:39:04.748761] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-16T18:39:05.149573] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-16T18:39:05.174851] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-09-16T18:39:05.857605] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-16T18:39:05.974908] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-09-16T18:39:06.785772] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-09-16T18:39:06.791159] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-16T18:39:07.301461] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-16T18:39:07.305591] [INFO ] [REMOTE ] GL: Full fetch complete (41673 records). [2025-09-16T18:39:07.305705] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-09-16T18:39:07.584113] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-09-16T18:39:07.699388] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-09-16T18:39:07.699463] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-09-16T18:39:07.700108] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-09-16T18:39:07.700153] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-09-16T18:39:07.701045] [DEBUG] [LOCAL ] GL: Trimmed 41673 records to 27947 (keeping 150 days of data) [2025-09-16T18:39:07.880141] [DEBUG] [LOCAL ] GL: Primary data saved (27947 records). [2025-09-16T18:39:07.880279] [INFO ] [MAIN ] GL: Full history saved. [2025-09-16T18:39:07.880362] [INFO ] [MAIN ] Update Progress: 936/2369 symbols completed. GL took 21.2s. Estimated remaining: 2h 31m 41s. Rate: 9.4 symbols/min [2025-09-16T18:39:08.048750] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:39:08.048933] [DEBUG] [LOCAL ] GLP: No existing data file found in primary storage. [2025-09-16T18:39:08.048971] [WARN ] [MAIN ] GLP: No existing data found, performing full refresh instead. [2025-09-16T18:39:08.049089] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-09-16T18:39:08.049127] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-09-16T18:39:08.049168] [DEBUG] [LOCAL ] GLP: No primary data file found to delete. [2025-09-16T18:39:08.049208] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-09-16T18:39:08.385087] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-09-16T18:39:08.423335] [INFO ] [REMOTE ] GLP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:39:08.680264] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-16T18:39:09.109419] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-16T18:39:09.174866] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-09-16T18:39:09.974917] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-09-16T18:39:10.054096] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-16T18:39:10.774890] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-09-16T18:39:11.097616] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-16T18:39:11.574895] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-09-16T18:39:11.742422] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-16T18:39:11.963394] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-16T18:39:12.374916] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-09-16T18:39:13.174899] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-09-16T18:39:13.185112] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-16T18:39:13.214076] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-16T18:39:13.974967] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-09-16T18:39:14.670964] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-16T18:39:14.676589] [INFO ] [REMOTE ] GKOS: Full fetch complete (46698 records). [2025-09-16T18:39:14.676794] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-09-16T18:39:14.780881] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-09-16T18:39:14.823633] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-16T18:39:15.088183] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-09-16T18:39:15.088308] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-09-16T18:39:15.089262] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-09-16T18:39:15.089313] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-09-16T18:39:15.090453] [DEBUG] [LOCAL ] GKOS: Trimmed 46698 records to 31616 (keeping 150 days of data) [2025-09-16T18:39:15.282599] [DEBUG] [LOCAL ] GKOS: Primary data saved (31616 records). [2025-09-16T18:39:15.282782] [INFO ] [MAIN ] GKOS: Full history saved. [2025-09-16T18:39:15.282877] [INFO ] [MAIN ] Update Progress: 937/2369 symbols completed. GKOS took 30.4s. Estimated remaining: 2h 31m 37s. Rate: 9.4 symbols/min [2025-09-16T18:39:15.453236] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:39:15.491121] [DEBUG] [LOCAL ] GLW: Loaded 39598 existing records from primary storage. [2025-09-16T18:39:15.491296] [INFO ] [MAIN ] GLW: Loaded 39598 existing records. [2025-09-16T18:39:15.580802] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-09-16T18:39:15.667493] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:39:15.667783] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-09-16T18:39:15.667831] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-09-16T18:39:15.668780] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-09-16T18:39:15.668828] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-09-16T18:39:16.024764] [INFO ] [REMOTE ] GLW: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:39:16.374933] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-09-16T18:39:16.789195] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-16T18:39:16.795628] [INFO ] [REMOTE ] GIS: Full fetch complete (58353 records). [2025-09-16T18:39:16.795773] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-09-16T18:39:17.184916] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-09-16T18:39:17.187904] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-09-16T18:39:17.188145] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-09-16T18:39:17.189986] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-09-16T18:39:17.190076] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-09-16T18:39:17.198435] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-16T18:39:17.201979] [DEBUG] [LOCAL ] GIS: Trimmed 58353 records to 40031 (keeping 150 days of data) [2025-09-16T18:39:17.446025] [DEBUG] [LOCAL ] GIS: Primary data saved (40031 records). [2025-09-16T18:39:17.446313] [INFO ] [MAIN ] GIS: Full history saved. [2025-09-16T18:39:17.447086] [INFO ] [MAIN ] Update Progress: 938/2369 symbols completed. GIS took 33.8s. Estimated remaining: 2h 31m 24s. Rate: 9.5 symbols/min [2025-09-16T18:39:17.581233] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-16T18:39:17.660848] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:39:17.698490] [DEBUG] [LOCAL ] GM: Loaded 39689 existing records from primary storage. [2025-09-16T18:39:17.698677] [INFO ] [MAIN ] GM: Loaded 39689 existing records. [2025-09-16T18:39:17.873316] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:39:17.873561] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-09-16T18:39:17.873608] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-09-16T18:39:17.874524] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-09-16T18:39:17.874575] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-09-16T18:39:17.978779] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-09-16T18:39:18.231754] [INFO ] [REMOTE ] GM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:39:18.774865] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-09-16T18:39:19.170603] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-16T18:39:19.574879] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-09-16T18:39:19.626249] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-16T18:39:20.374931] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-09-16T18:39:21.010621] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-09-16T18:39:21.147102] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-16T18:39:21.184824] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-09-16T18:39:21.190717] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-16T18:39:21.974913] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-09-16T18:39:22.774931] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-09-16T18:39:23.522596] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-09-16T18:39:23.574856] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-09-16T18:39:23.766486] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-16T18:39:23.772502] [INFO ] [REMOTE ] GLOB: Full fetch complete (50977 records). [2025-09-16T18:39:23.772612] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-09-16T18:39:24.166837] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-09-16T18:39:24.166930] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-09-16T18:39:24.167665] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-09-16T18:39:24.167713] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-09-16T18:39:24.168912] [DEBUG] [LOCAL ] GLOB: Trimmed 50977 records to 35748 (keeping 150 days of data) [2025-09-16T18:39:24.375207] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-09-16T18:39:24.397366] [DEBUG] [LOCAL ] GLOB: Primary data saved (35748 records). [2025-09-16T18:39:24.397492] [INFO ] [MAIN ] GLOB: Full history saved. [2025-09-16T18:39:24.397594] [INFO ] [MAIN ] Update Progress: 939/2369 symbols completed. GLOB took 23.8s. Estimated remaining: 2h 31m 18s. Rate: 9.5 symbols/min [2025-09-16T18:39:24.570919] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:39:24.609420] [DEBUG] [LOCAL ] GME: Loaded 39747 existing records from primary storage. [2025-09-16T18:39:24.609573] [INFO ] [MAIN ] GME: Loaded 39747 existing records. [2025-09-16T18:39:24.795067] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:39:24.795540] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-09-16T18:39:24.795692] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-09-16T18:39:24.796726] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-09-16T18:39:24.796780] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-09-16T18:39:25.189786] [INFO ] [REMOTE ] GME: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:39:25.190225] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-09-16T18:39:25.193285] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-09-16T18:39:25.209411] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-16T18:39:25.822498] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-16T18:39:25.974942] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-09-16T18:39:26.777165] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-09-16T18:39:26.778638] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-16T18:39:27.496559] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-09-16T18:39:27.574918] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-09-16T18:39:28.374935] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-09-16T18:39:28.510167] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-16T18:39:28.528443] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-16T18:39:28.530765] [INFO ] [REMOTE ] GLP: Full fetch complete (10314 records). [2025-09-16T18:39:28.530842] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-09-16T18:39:28.531280] [FATAL] [VALIDATOR ] GLP: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:39:28.531358] [FATAL] [MAIN ] GLP: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:39:28.531397] [WARN ] [MAIN ] GLP: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:39:28.531445] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-09-16T18:39:28.531518] [DEBUG] [LOCAL ] GLP: No primary data file found to delete. [2025-09-16T18:39:28.531558] [INFO ] [LOCAL ] GLP: Starting deletion of derivative data. [2025-09-16T18:39:28.531615] [DEBUG] [LOCAL ] GLP: No derivative data file found to delete. [2025-09-16T18:39:28.531705] [INFO ] [MAIN ] Update Progress: 940/2369 symbols completed. GLP took 20.7s. Estimated remaining: 2h 31m 9s. Rate: 9.5 symbols/min [2025-09-16T18:39:28.717365] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:39:28.752066] [DEBUG] [LOCAL ] GMED: Loaded 35554 existing records from primary storage. [2025-09-16T18:39:28.752224] [INFO ] [MAIN ] GMED: Loaded 35554 existing records. [2025-09-16T18:39:28.936440] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:39:28.936750] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-09-16T18:39:28.936805] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-09-16T18:39:28.937618] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-09-16T18:39:28.937696] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-09-16T18:39:29.180039] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-09-16T18:39:29.291416] [INFO ] [REMOTE ] GMED: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:39:29.974917] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-09-16T18:39:30.774875] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-09-16T18:39:31.249145] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (2.87 seconds). [2025-09-16T18:39:31.496406] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-16T18:39:31.556305] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-09-16T18:39:31.574856] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-09-16T18:39:32.374916] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-09-16T18:39:32.728454] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-16T18:39:33.174927] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-09-16T18:39:33.467391] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-16T18:39:33.920865] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-16T18:39:33.974881] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-09-16T18:39:34.774897] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-09-16T18:39:35.053443] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-16T18:39:35.575052] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-09-16T18:39:35.894094] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-16T18:39:36.383769] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-09-16T18:39:36.391762] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-16T18:39:37.174942] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-09-16T18:39:37.316226] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-16T18:39:37.974910] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-09-16T18:39:38.652085] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-16T18:39:38.774899] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-09-16T18:39:39.196524] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.81 seconds). [2025-09-16T18:39:39.574911] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-09-16T18:39:39.981667] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-16T18:39:39.987996] [INFO ] [REMOTE ] GLW: Full fetch complete (58307 records). [2025-09-16T18:39:39.988099] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-09-16T18:39:40.377848] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-09-16T18:39:40.392972] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-09-16T18:39:40.393047] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-09-16T18:39:40.393976] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-09-16T18:39:40.394053] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-09-16T18:39:40.395470] [DEBUG] [LOCAL ] GLW: Trimmed 58307 records to 39988 (keeping 150 days of data) [2025-09-16T18:39:40.676127] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-16T18:39:40.700952] [DEBUG] [LOCAL ] GLW: Primary data saved (39988 records). [2025-09-16T18:39:40.701130] [INFO ] [MAIN ] GLW: Full history saved. [2025-09-16T18:39:40.701230] [INFO ] [MAIN ] Update Progress: 941/2369 symbols completed. GLW took 25.4s. Estimated remaining: 2h 31m 11s. Rate: 9.4 symbols/min [2025-09-16T18:39:40.884324] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:39:40.884549] [DEBUG] [LOCAL ] GMRE: No existing data file found in primary storage. [2025-09-16T18:39:40.884591] [WARN ] [MAIN ] GMRE: No existing data found, performing full refresh instead. [2025-09-16T18:39:40.884764] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-09-16T18:39:40.884837] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-09-16T18:39:40.884884] [DEBUG] [LOCAL ] GMRE: No primary data file found to delete. [2025-09-16T18:39:40.884918] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-09-16T18:39:41.177445] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-09-16T18:39:41.254027] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:39:41.283809] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-16T18:39:41.974937] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-09-16T18:39:42.774927] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-09-16T18:39:43.026435] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.65 seconds). [2025-09-16T18:39:43.294870] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-16T18:39:43.301329] [INFO ] [REMOTE ] GM: Full fetch complete (58408 records). [2025-09-16T18:39:43.301470] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-09-16T18:39:43.580006] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-09-16T18:39:43.707514] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-09-16T18:39:43.707687] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-09-16T18:39:43.708510] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-09-16T18:39:43.708576] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-09-16T18:39:43.736737] [DEBUG] [LOCAL ] GM: Trimmed 58408 records to 40079 (keeping 150 days of data) [2025-09-16T18:39:43.738390] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-16T18:39:43.870952] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-16T18:39:44.029481] [DEBUG] [LOCAL ] GM: Primary data saved (40079 records). [2025-09-16T18:39:44.029611] [INFO ] [MAIN ] GM: Full history saved. [2025-09-16T18:39:44.029713] [INFO ] [MAIN ] Update Progress: 942/2369 symbols completed. GM took 26.6s. Estimated remaining: 2h 31m 0s. Rate: 9.5 symbols/min [2025-09-16T18:39:44.208476] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:39:44.224455] [DEBUG] [LOCAL ] GNE: Loaded 14550 existing records from primary storage. [2025-09-16T18:39:44.224594] [INFO ] [MAIN ] GNE: Loaded 14550 existing records. [2025-09-16T18:39:44.384889] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-09-16T18:39:44.414204] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:39:44.414484] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-09-16T18:39:44.414534] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-09-16T18:39:44.415023] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-09-16T18:39:44.415076] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-09-16T18:39:44.793257] [INFO ] [REMOTE ] GNE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:39:45.174901] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-09-16T18:39:45.862385] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-16T18:39:45.974877] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-09-16T18:39:46.122066] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.54 seconds). [2025-09-16T18:39:46.146108] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-16T18:39:46.774905] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-09-16T18:39:47.476718] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-16T18:39:47.575737] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-09-16T18:39:47.577466] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-16T18:39:48.374983] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-09-16T18:39:49.067080] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-16T18:39:49.091408] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-16T18:39:49.174924] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-09-16T18:39:49.974902] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-09-16T18:39:50.113554] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-16T18:39:50.774912] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-09-16T18:39:51.574893] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-09-16T18:39:52.283396] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-16T18:39:52.374866] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-09-16T18:39:52.647032] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.67 seconds). [2025-09-16T18:39:52.735508] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-16T18:39:53.174897] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-09-16T18:39:53.427270] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-16T18:39:53.974928] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-09-16T18:39:54.491405] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-16T18:39:54.497074] [INFO ] [REMOTE ] GMED: Full fetch complete (52540 records). [2025-09-16T18:39:54.497222] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-09-16T18:39:54.783811] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-09-16T18:39:54.875487] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-09-16T18:39:54.875566] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-09-16T18:39:54.876300] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-09-16T18:39:54.876347] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-09-16T18:39:54.877453] [DEBUG] [LOCAL ] GMED: Trimmed 52540 records to 35875 (keeping 150 days of data) [2025-09-16T18:39:55.090046] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-16T18:39:55.105426] [DEBUG] [LOCAL ] GMED: Primary data saved (35875 records). [2025-09-16T18:39:55.105525] [INFO ] [MAIN ] GMED: Full history saved. [2025-09-16T18:39:55.105611] [INFO ] [MAIN ] Update Progress: 943/2369 symbols completed. GMED took 26.6s. Estimated remaining: 2h 31m 1s. Rate: 9.4 symbols/min [2025-09-16T18:39:55.277477] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:39:55.306489] [DEBUG] [LOCAL ] GNK: Loaded 29366 existing records from primary storage. [2025-09-16T18:39:55.306624] [INFO ] [MAIN ] GNK: Loaded 29366 existing records. [2025-09-16T18:39:55.481396] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:39:55.481631] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-09-16T18:39:55.481699] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-09-16T18:39:55.482381] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-09-16T18:39:55.482426] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-09-16T18:39:55.580328] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-09-16T18:39:55.836053] [INFO ] [REMOTE ] GNK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:39:56.374952] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-09-16T18:39:56.932045] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-16T18:39:57.174890] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-09-16T18:39:57.338352] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (2.55 seconds). [2025-09-16T18:39:57.445322] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-16T18:39:57.974886] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-09-16T18:39:58.215281] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-16T18:39:58.774911] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-09-16T18:39:59.398814] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-16T18:39:59.403670] [INFO ] [REMOTE ] GMRE: Full fetch complete (40378 records). [2025-09-16T18:39:59.403829] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-09-16T18:39:59.581459] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-09-16T18:39:59.815475] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-09-16T18:39:59.815557] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-09-16T18:39:59.816187] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-09-16T18:39:59.816229] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-09-16T18:39:59.817220] [DEBUG] [LOCAL ] GMRE: Trimmed 40378 records to 28154 (keeping 150 days of data) [2025-09-16T18:39:59.977468] [DEBUG] [LOCAL ] GMRE: Primary data saved (28154 records). [2025-09-16T18:39:59.977612] [INFO ] [MAIN ] GMRE: Full history saved. [2025-09-16T18:39:59.977706] [INFO ] [MAIN ] Update Progress: 944/2369 symbols completed. GMRE took 19.3s. Estimated remaining: 2h 30m 53s. Rate: 9.4 symbols/min [2025-09-16T18:40:00.144612] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:40:00.175837] [DEBUG] [LOCAL ] GNL: Loaded 34319 existing records from primary storage. [2025-09-16T18:40:00.175994] [INFO ] [MAIN ] GNL: Loaded 34319 existing records. [2025-09-16T18:40:00.356327] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:40:00.356624] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-09-16T18:40:00.356779] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-09-16T18:40:00.357540] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-09-16T18:40:00.357586] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-09-16T18:40:00.380069] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-09-16T18:40:00.494485] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-16T18:40:00.765358] [INFO ] [REMOTE ] GNL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:40:01.174912] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-09-16T18:40:01.356271] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-16T18:40:01.358889] [INFO ] [REMOTE ] GNE: Full fetch complete (18158 records). [2025-09-16T18:40:01.358970] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-09-16T18:40:01.737868] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-09-16T18:40:01.737952] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-09-16T18:40:01.738383] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-09-16T18:40:01.738433] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-09-16T18:40:01.739032] [DEBUG] [LOCAL ] GNE: Trimmed 18158 records to 14670 (keeping 150 days of data) [2025-09-16T18:40:01.831824] [DEBUG] [LOCAL ] GNE: Primary data saved (14670 records). [2025-09-16T18:40:01.831985] [INFO ] [MAIN ] GNE: Full history saved. [2025-09-16T18:40:01.832075] [INFO ] [MAIN ] Update Progress: 945/2369 symbols completed. GNE took 17.8s. Estimated remaining: 2h 30m 39s. Rate: 9.5 symbols/min [2025-09-16T18:40:01.980519] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-09-16T18:40:02.008216] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:40:02.045290] [DEBUG] [LOCAL ] GNRC: Loaded 33188 existing records from primary storage. [2025-09-16T18:40:02.045459] [INFO ] [MAIN ] GNRC: Loaded 33188 existing records. [2025-09-16T18:40:02.241613] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:40:02.242100] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-09-16T18:40:02.242172] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-09-16T18:40:02.243177] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-09-16T18:40:02.243274] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-09-16T18:40:02.396293] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (2.81 seconds). [2025-09-16T18:40:02.496523] [INFO ] [REMOTE ] GME: Full fetch complete (58436 records). [2025-09-16T18:40:02.526379] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-09-16T18:40:02.751132] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:40:02.781200] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-09-16T18:40:03.039574] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-16T18:40:03.093268] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-09-16T18:40:03.093736] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-09-16T18:40:03.094832] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-09-16T18:40:03.094906] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-09-16T18:40:03.096178] [DEBUG] [LOCAL ] GME: Trimmed 58436 records to 40137 (keeping 150 days of data) [2025-09-16T18:40:03.356935] [DEBUG] [LOCAL ] GME: Primary data saved (40137 records). [2025-09-16T18:40:03.357100] [INFO ] [MAIN ] GME: Full history saved. [2025-09-16T18:40:03.357222] [INFO ] [MAIN ] Update Progress: 946/2369 symbols completed. GME took 39.0s. Estimated remaining: 2h 30m 26s. Rate: 9.5 symbols/min [2025-09-16T18:40:03.527208] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:40:03.533986] [DEBUG] [LOCAL ] GNT: Loaded 5815 existing records from primary storage. [2025-09-16T18:40:03.534100] [INFO ] [MAIN ] GNT: Loaded 5815 existing records. [2025-09-16T18:40:03.597148] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-09-16T18:40:03.711519] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:40:03.711983] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-09-16T18:40:03.712057] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-09-16T18:40:03.712449] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-09-16T18:40:03.712502] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-09-16T18:40:04.028515] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-16T18:40:04.108468] [INFO ] [REMOTE ] GNT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:40:04.374936] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-09-16T18:40:04.542122] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-16T18:40:05.174876] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-09-16T18:40:05.217363] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-16T18:40:05.244047] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-16T18:40:05.974904] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-09-16T18:40:06.774928] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-09-16T18:40:06.891450] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-16T18:40:07.479520] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-16T18:40:07.574856] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-09-16T18:40:08.374907] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-09-16T18:40:08.443719] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-16T18:40:09.002979] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-16T18:40:09.174888] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-09-16T18:40:09.779760] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-16T18:40:09.974896] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-09-16T18:40:10.522543] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-16T18:40:10.655398] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-16T18:40:10.774923] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-09-16T18:40:11.574879] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-09-16T18:40:11.714782] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-16T18:40:12.374887] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-09-16T18:40:13.174978] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-09-16T18:40:13.327493] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-16T18:40:13.737611] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-16T18:40:13.974901] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-09-16T18:40:14.774950] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-09-16T18:40:15.144717] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-16T18:40:15.403074] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-16T18:40:15.574919] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-09-16T18:40:16.374931] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-09-16T18:40:16.956571] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-16T18:40:16.961573] [INFO ] [REMOTE ] GNK: Full fetch complete (44551 records). [2025-09-16T18:40:16.961690] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-09-16T18:40:17.181966] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-09-16T18:40:17.350913] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-09-16T18:40:17.350989] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-09-16T18:40:17.351671] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-09-16T18:40:17.351724] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-09-16T18:40:17.352683] [DEBUG] [LOCAL ] GNK: Trimmed 44551 records to 29717 (keeping 150 days of data) [2025-09-16T18:40:17.471013] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (2.70 seconds). [2025-09-16T18:40:17.547299] [DEBUG] [LOCAL ] GNK: Primary data saved (29717 records). [2025-09-16T18:40:17.547445] [INFO ] [MAIN ] GNK: Full history saved. [2025-09-16T18:40:17.547548] [INFO ] [MAIN ] Update Progress: 947/2369 symbols completed. GNK took 22.4s. Estimated remaining: 2h 30m 31s. Rate: 9.4 symbols/min [2025-09-16T18:40:17.726802] [INFO ] [MAIN ] GNTY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:40:17.727056] [DEBUG] [LOCAL ] GNTY: No existing data file found in primary storage. [2025-09-16T18:40:17.727136] [WARN ] [MAIN ] GNTY: No existing data found, performing full refresh instead. [2025-09-16T18:40:17.727779] [INFO ] [MAIN ] GNTY: Wiping existing primary data before full refresh. [2025-09-16T18:40:17.727862] [INFO ] [LOCAL ] GNTY: Starting deletion of primary data. [2025-09-16T18:40:17.728274] [DEBUG] [LOCAL ] GNTY: No primary data file found to delete. [2025-09-16T18:40:17.728408] [INFO ] [MAIN ] GNTY: Starting full primary refresh. [2025-09-16T18:40:17.922238] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-16T18:40:17.983086] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-09-16T18:40:18.143797] [INFO ] [REMOTE ] GNTY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:40:18.725295] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-16T18:40:18.774858] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-09-16T18:40:19.181333] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-16T18:40:19.574951] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-09-16T18:40:20.314131] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-16T18:40:20.374900] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-09-16T18:40:21.174881] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-02. [2025-09-16T18:40:21.239190] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-09-16T18:40:21.253588] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-16T18:40:21.255431] [INFO ] [REMOTE ] GNT: Full fetch complete (8293 records). [2025-09-16T18:40:21.255521] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-09-16T18:40:21.614883] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-09-16T18:40:21.614965] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-09-16T18:40:21.615169] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-09-16T18:40:21.615218] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-09-16T18:40:21.615707] [DEBUG] [LOCAL ] GNT: Trimmed 8293 records to 5867 (keeping 150 days of data) [2025-09-16T18:40:21.651407] [DEBUG] [LOCAL ] GNT: Primary data saved (5867 records). [2025-09-16T18:40:21.651517] [INFO ] [MAIN ] GNT: Full history saved. [2025-09-16T18:40:21.651626] [INFO ] [MAIN ] Update Progress: 948/2369 symbols completed. GNT took 18.3s. Estimated remaining: 2h 30m 21s. Rate: 9.5 symbols/min [2025-09-16T18:40:21.841305] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:40:21.846371] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-16T18:40:21.885323] [DEBUG] [LOCAL ] GNW: Loaded 37886 existing records from primary storage. [2025-09-16T18:40:21.885465] [INFO ] [MAIN ] GNW: Loaded 37886 existing records. [2025-09-16T18:40:21.980004] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-09-16T18:40:22.073020] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:40:22.073275] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-09-16T18:40:22.073322] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-09-16T18:40:22.074064] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-09-16T18:40:22.074118] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-09-16T18:40:22.426910] [INFO ] [REMOTE ] GNW: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:40:22.774933] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-03. [2025-09-16T18:40:23.371724] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-16T18:40:23.574883] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-09-16T18:40:23.715448] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-16T18:40:24.374899] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-09-16T18:40:25.174901] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-04. [2025-09-16T18:40:25.259201] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-16T18:40:25.769021] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-16T18:40:25.974882] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-05. [2025-09-16T18:40:26.070110] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-16T18:40:26.375161] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-16T18:40:26.774933] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-09-16T18:40:27.574928] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-09-16T18:40:28.375054] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-06. [2025-09-16T18:40:28.532872] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-16T18:40:28.791221] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-16T18:40:29.174962] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-09-16T18:40:29.249497] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-16T18:40:29.974985] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-09-16T18:40:30.432268] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-16T18:40:30.438699] [INFO ] [REMOTE ] GNL: Full fetch complete (51568 records). [2025-09-16T18:40:30.438885] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-09-16T18:40:30.785172] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-07. [2025-09-16T18:40:30.834588] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-09-16T18:40:30.834690] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-09-16T18:40:30.835413] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-09-16T18:40:30.835461] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-09-16T18:40:30.837079] [DEBUG] [LOCAL ] GNL: Trimmed 51568 records to 34634 (keeping 150 days of data) [2025-09-16T18:40:31.045923] [DEBUG] [LOCAL ] GNL: Primary data saved (34634 records). [2025-09-16T18:40:31.046094] [INFO ] [MAIN ] GNL: Full history saved. [2025-09-16T18:40:31.046185] [INFO ] [MAIN ] Update Progress: 949/2369 symbols completed. GNL took 31.1s. Estimated remaining: 2h 30m 20s. Rate: 9.4 symbols/min [2025-09-16T18:40:31.222233] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:40:31.254469] [DEBUG] [LOCAL ] GOF: Loaded 30983 existing records from primary storage. [2025-09-16T18:40:31.254615] [INFO ] [MAIN ] GOF: Loaded 30983 existing records. [2025-09-16T18:40:31.437096] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:40:31.437336] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-09-16T18:40:31.437396] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-09-16T18:40:31.438130] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-09-16T18:40:31.438184] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-09-16T18:40:31.590269] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-09-16T18:40:31.747142] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-16T18:40:31.809861] [INFO ] [REMOTE ] GOF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:40:31.844846] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-16T18:40:32.374899] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-09-16T18:40:33.174874] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-09-16T18:40:33.537345] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-16T18:40:33.950421] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-16T18:40:33.974855] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-09-16T18:40:34.774906] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-09-16T18:40:34.825344] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-16T18:40:35.575048] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-09-16T18:40:35.750315] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-16T18:40:35.936011] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-16T18:40:35.941446] [INFO ] [REMOTE ] GNRC: Full fetch complete (49251 records). [2025-09-16T18:40:35.941597] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-09-16T18:40:36.343174] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-09-16T18:40:36.343285] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-09-16T18:40:36.344057] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-09-16T18:40:36.344104] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-09-16T18:40:36.345244] [DEBUG] [LOCAL ] GNRC: Trimmed 49251 records to 33506 (keeping 150 days of data) [2025-09-16T18:40:36.400175] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-09-16T18:40:36.552855] [DEBUG] [LOCAL ] GNRC: Primary data saved (33506 records). [2025-09-16T18:40:36.553007] [INFO ] [MAIN ] GNRC: Full history saved. [2025-09-16T18:40:36.553600] [INFO ] [MAIN ] Update Progress: 950/2369 symbols completed. GNRC took 34.7s. Estimated remaining: 2h 30m 12s. Rate: 9.4 symbols/min [2025-09-16T18:40:36.722624] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:40:36.749172] [DEBUG] [LOCAL ] GOLF: Loaded 22665 existing records from primary storage. [2025-09-16T18:40:36.749337] [INFO ] [MAIN ] GOLF: Loaded 22665 existing records. [2025-09-16T18:40:36.926806] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:40:36.927081] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-09-16T18:40:36.927128] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-09-16T18:40:36.927787] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-09-16T18:40:36.927839] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-09-16T18:40:37.180023] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-08. [2025-09-16T18:40:37.289023] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:40:37.319255] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-16T18:40:37.794607] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-16T18:40:37.974909] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-09-16T18:40:38.317596] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-16T18:40:38.774900] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-09-16T18:40:39.514029] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-16T18:40:39.574901] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-09. [2025-09-16T18:40:40.327535] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-16T18:40:40.329198] [INFO ] [REMOTE ] GNTY: Full fetch complete (7308 records). [2025-09-16T18:40:40.329275] [DEBUG] [VALIDATOR ] GNTY: Validating primary data. [2025-09-16T18:40:40.387208] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-09-16T18:40:40.701936] [DEBUG] [VALIDATOR ] GNTY: All expected trading days are present. [2025-09-16T18:40:40.702066] [DEBUG] [VALIDATOR ] GNTY: Primary data validation passed. [2025-09-16T18:40:40.702258] [INFO ] [MAIN ] GNTY: Fetched primary data is valid. [2025-09-16T18:40:40.702405] [DEBUG] [LOCAL ] GNTY: Saving primary data. [2025-09-16T18:40:40.702978] [DEBUG] [LOCAL ] GNTY: Trimmed 7308 records to 5679 (keeping 150 days of data) [2025-09-16T18:40:40.762620] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-16T18:40:40.779515] [DEBUG] [LOCAL ] GNTY: Primary data saved (5679 records). [2025-09-16T18:40:40.779732] [INFO ] [MAIN ] GNTY: Full history saved. [2025-09-16T18:40:40.779854] [INFO ] [MAIN ] Update Progress: 951/2369 symbols completed. GNTY took 23.2s. Estimated remaining: 2h 30m 3s. Rate: 9.5 symbols/min [2025-09-16T18:40:40.952874] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:40:40.993056] [DEBUG] [LOCAL ] GOOS: Loaded 33701 existing records from primary storage. [2025-09-16T18:40:40.993239] [INFO ] [MAIN ] GOOS: Loaded 33701 existing records. [2025-09-16T18:40:41.170816] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:40:41.171085] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-09-16T18:40:41.171131] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-09-16T18:40:41.171834] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-09-16T18:40:41.171882] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-09-16T18:40:41.182937] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-09-16T18:40:41.578244] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:40:41.974938] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-09-16T18:40:42.122911] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-16T18:40:42.774907] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-09-16T18:40:43.040199] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-16T18:40:43.413291] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-16T18:40:43.574932] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-09-16T18:40:43.982906] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-16T18:40:44.374895] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-09-16T18:40:45.007406] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-16T18:40:45.174906] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-09-16T18:40:45.688579] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-16T18:40:45.694119] [INFO ] [REMOTE ] GNW: Full fetch complete (55383 records). [2025-09-16T18:40:45.694239] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-09-16T18:40:45.694973] [FATAL] [VALIDATOR ] GNW: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:40:45.695139] [FATAL] [MAIN ] GNW: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:40:45.695211] [WARN ] [MAIN ] GNW: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:40:45.695280] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-09-16T18:40:45.695350] [DEBUG] [LOCAL ] GNW: No primary data file found to delete. [2025-09-16T18:40:45.695388] [INFO ] [LOCAL ] GNW: Starting deletion of derivative data. [2025-09-16T18:40:45.695795] [DEBUG] [LOCAL ] GNW: Deleted derivative data file. [2025-09-16T18:40:45.695886] [INFO ] [MAIN ] Update Progress: 952/2369 symbols completed. GNW took 24.0s. Estimated remaining: 2h 29m 54s. Rate: 9.5 symbols/min [2025-09-16T18:40:45.876941] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:40:45.904397] [DEBUG] [LOCAL ] GOTU: Loaded 27638 existing records from primary storage. [2025-09-16T18:40:45.904535] [INFO ] [MAIN ] GOTU: Loaded 27638 existing records. [2025-09-16T18:40:45.980024] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-09-16T18:40:46.082243] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:40:46.082494] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-09-16T18:40:46.082540] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-09-16T18:40:46.083118] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-09-16T18:40:46.083165] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-09-16T18:40:46.433636] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:40:46.633258] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-16T18:40:46.774922] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-09-16T18:40:47.419628] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-16T18:40:47.574908] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-09-16T18:40:48.129972] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-16T18:40:48.374896] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-09-16T18:40:48.843698] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-16T18:40:49.174932] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-09-16T18:40:49.679463] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-16T18:40:49.974909] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-09-16T18:40:50.695078] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-16T18:40:50.774875] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-09-16T18:40:51.579974] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-09-16T18:40:51.592222] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-16T18:40:51.888451] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-16T18:40:52.374923] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-09-16T18:40:52.775636] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-16T18:40:53.174851] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-09-16T18:40:53.324631] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-16T18:40:53.974951] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-09-16T18:40:54.774907] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-09-16T18:40:55.253157] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-16T18:40:55.283893] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-16T18:40:55.574904] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-09-16T18:40:56.031405] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-16T18:40:56.374862] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-09-16T18:40:56.842371] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-16T18:40:57.174916] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-09-16T18:40:57.974941] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-09-16T18:40:58.074559] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-16T18:40:58.660482] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-16T18:40:58.774893] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-09-16T18:40:58.794755] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-16T18:40:58.798097] [INFO ] [REMOTE ] GOLF: Full fetch complete (35584 records). [2025-09-16T18:40:58.798204] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-09-16T18:40:58.798820] [FATAL] [VALIDATOR ] GOLF: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:40:58.798900] [FATAL] [MAIN ] GOLF: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:40:58.798937] [WARN ] [MAIN ] GOLF: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:40:58.798984] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-09-16T18:40:58.799041] [DEBUG] [LOCAL ] GOLF: No primary data file found to delete. [2025-09-16T18:40:58.799076] [INFO ] [LOCAL ] GOLF: Starting deletion of derivative data. [2025-09-16T18:40:58.799391] [DEBUG] [LOCAL ] GOLF: Deleted derivative data file. [2025-09-16T18:40:58.799480] [INFO ] [MAIN ] Update Progress: 953/2369 symbols completed. GOLF took 22.2s. Estimated remaining: 2h 29m 58s. Rate: 9.4 symbols/min [2025-09-16T18:40:58.972337] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:40:59.010749] [DEBUG] [LOCAL ] GPC: Loaded 33780 existing records from primary storage. [2025-09-16T18:40:59.010889] [INFO ] [MAIN ] GPC: Loaded 33780 existing records. [2025-09-16T18:40:59.206268] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:40:59.206525] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-09-16T18:40:59.206573] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-09-16T18:40:59.207567] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-09-16T18:40:59.207618] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-09-16T18:40:59.557542] [INFO ] [REMOTE ] GPC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:40:59.574862] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-09-16T18:41:00.374868] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-09-16T18:41:00.443813] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-16T18:41:01.174936] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-09-16T18:41:01.832067] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-09-16T18:41:01.883914] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-16T18:41:01.974863] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-09-16T18:41:02.581625] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-16T18:41:02.588013] [INFO ] [REMOTE ] GOOS: Full fetch complete (49741 records). [2025-09-16T18:41:02.588357] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-09-16T18:41:02.589506] [FATAL] [VALIDATOR ] GOOS: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:41:02.589610] [FATAL] [MAIN ] GOOS: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:41:02.589676] [WARN ] [MAIN ] GOOS: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:41:02.589736] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-09-16T18:41:02.590056] [DEBUG] [LOCAL ] GOOS: No primary data file found to delete. [2025-09-16T18:41:02.590312] [INFO ] [LOCAL ] GOOS: Starting deletion of derivative data. [2025-09-16T18:41:02.590607] [DEBUG] [LOCAL ] GOOS: Deleted derivative data file. [2025-09-16T18:41:02.590837] [INFO ] [MAIN ] Update Progress: 954/2369 symbols completed. GOOS took 21.8s. Estimated remaining: 2h 29m 48s. Rate: 9.4 symbols/min [2025-09-16T18:41:02.768502] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:41:02.774912] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-09-16T18:41:02.781290] [DEBUG] [LOCAL ] GPI: Loaded 10095 existing records from primary storage. [2025-09-16T18:41:02.781450] [INFO ] [MAIN ] GPI: Loaded 10095 existing records. [2025-09-16T18:41:02.957379] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:41:02.957614] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-09-16T18:41:02.957690] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-09-16T18:41:02.958054] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-09-16T18:41:02.958098] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-09-16T18:41:03.304048] [INFO ] [REMOTE ] GPI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:41:03.574938] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-09-16T18:41:03.901439] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-16T18:41:03.906552] [INFO ] [REMOTE ] GOF: Full fetch complete (46828 records). [2025-09-16T18:41:03.906633] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-09-16T18:41:04.302501] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-09-16T18:41:04.302674] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-09-16T18:41:04.303616] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-09-16T18:41:04.304041] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-09-16T18:41:04.304768] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-16T18:41:04.313210] [DEBUG] [LOCAL ] GOF: Trimmed 46828 records to 31297 (keeping 150 days of data) [2025-09-16T18:41:04.377121] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-09-16T18:41:04.505120] [DEBUG] [LOCAL ] GOF: Primary data saved (31297 records). [2025-09-16T18:41:04.505246] [INFO ] [MAIN ] GOF: Full history saved. [2025-09-16T18:41:04.505330] [INFO ] [MAIN ] Update Progress: 955/2369 symbols completed. GOF took 33.5s. Estimated remaining: 2h 29m 35s. Rate: 9.5 symbols/min [2025-09-16T18:41:04.673211] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:41:04.677510] [DEBUG] [LOCAL ] GPJA: Loaded 3082 existing records from primary storage. [2025-09-16T18:41:04.677587] [INFO ] [MAIN ] GPJA: Loaded 3082 existing records. [2025-09-16T18:41:04.854277] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:41:04.854601] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-09-16T18:41:04.854688] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-09-16T18:41:04.854889] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-09-16T18:41:04.854933] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-09-16T18:41:05.181819] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-09-16T18:41:05.210077] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:41:05.334841] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-16T18:41:05.710790] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-16T18:41:05.970196] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-16T18:41:05.974834] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-09-16T18:41:06.774954] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-09-16T18:41:06.938815] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-16T18:41:07.567606] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-16T18:41:07.574835] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-09-16T18:41:07.965781] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-16T18:41:08.374901] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-09-16T18:41:08.828383] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-16T18:41:09.174922] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-09-16T18:41:09.974907] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-09-16T18:41:10.659532] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-16T18:41:10.673592] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-16T18:41:10.678516] [INFO ] [REMOTE ] GOTU: Full fetch complete (44002 records). [2025-09-16T18:41:10.678696] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-09-16T18:41:10.780924] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-09-16T18:41:11.067492] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-09-16T18:41:11.067593] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-09-16T18:41:11.068318] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-09-16T18:41:11.068366] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-09-16T18:41:11.069506] [DEBUG] [LOCAL ] GOTU: Trimmed 44002 records to 27891 (keeping 150 days of data) [2025-09-16T18:41:11.241796] [DEBUG] [LOCAL ] GOTU: Primary data saved (27891 records). [2025-09-16T18:41:11.241951] [INFO ] [MAIN ] GOTU: Full history saved. [2025-09-16T18:41:11.242045] [INFO ] [MAIN ] Update Progress: 956/2369 symbols completed. GOTU took 25.5s. Estimated remaining: 2h 29m 29s. Rate: 9.5 symbols/min [2025-09-16T18:41:11.426902] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:41:11.466199] [DEBUG] [LOCAL ] GPK: Loaded 39013 existing records from primary storage. [2025-09-16T18:41:11.466365] [INFO ] [MAIN ] GPK: Loaded 39013 existing records. [2025-09-16T18:41:11.577726] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-09-16T18:41:11.579854] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-16T18:41:11.662212] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:41:11.662506] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-09-16T18:41:11.662555] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-09-16T18:41:11.663371] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-09-16T18:41:11.663428] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-09-16T18:41:12.029077] [INFO ] [REMOTE ] GPK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:41:12.374904] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-09-16T18:41:13.174950] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-09-16T18:41:13.681160] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-16T18:41:13.974908] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-09-16T18:41:14.100985] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-16T18:41:14.311906] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-16T18:41:14.774901] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-09-16T18:41:15.404938] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-16T18:41:15.530395] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-16T18:41:15.574872] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-09-16T18:41:16.374900] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-09-16T18:41:17.171886] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-16T18:41:17.180535] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-09-16T18:41:17.926035] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-16T18:41:17.974903] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-09-16T18:41:18.097457] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-16T18:41:18.774912] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-09-16T18:41:19.574909] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-09-16T18:41:19.625541] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-16T18:41:20.146466] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-16T18:41:20.147634] [INFO ] [REMOTE ] GPJA: Full fetch complete (4355 records). [2025-09-16T18:41:20.147730] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-09-16T18:41:20.379290] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-09-16T18:41:20.508785] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-09-16T18:41:20.508945] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-09-16T18:41:20.509167] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-09-16T18:41:20.509231] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-09-16T18:41:20.509736] [DEBUG] [LOCAL ] GPJA: Trimmed 4355 records to 3120 (keeping 150 days of data) [2025-09-16T18:41:20.529303] [DEBUG] [LOCAL ] GPJA: Primary data saved (3120 records). [2025-09-16T18:41:20.529395] [INFO ] [MAIN ] GPJA: Full history saved. [2025-09-16T18:41:20.529576] [INFO ] [MAIN ] Update Progress: 957/2369 symbols completed. GPJA took 16.0s. Estimated remaining: 2h 29m 27s. Rate: 9.4 symbols/min [2025-09-16T18:41:20.558653] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-16T18:41:21.175033] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-09-16T18:41:21.497928] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-16T18:41:21.974990] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-09-16T18:41:22.719255] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-16T18:41:22.774849] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-09-16T18:41:23.111832] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-16T18:41:23.574869] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-09-16T18:41:24.180431] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-16T18:41:24.185718] [INFO ] [REMOTE ] GPC: Full fetch complete (50903 records). [2025-09-16T18:41:24.185855] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-09-16T18:41:24.186531] [FATAL] [VALIDATOR ] GPC: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:41:24.186610] [FATAL] [MAIN ] GPC: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:41:24.186665] [WARN ] [MAIN ] GPC: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:41:24.186712] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-09-16T18:41:24.186793] [DEBUG] [LOCAL ] GPC: No primary data file found to delete. [2025-09-16T18:41:24.186832] [INFO ] [LOCAL ] GPC: Starting deletion of derivative data. [2025-09-16T18:41:24.187146] [DEBUG] [LOCAL ] GPC: Deleted derivative data file. [2025-09-16T18:41:24.188200] [INFO ] [MAIN ] Update Progress: 958/2369 symbols completed. GPC took 25.4s. Estimated remaining: 2h 29m 17s. Rate: 9.5 symbols/min [2025-09-16T18:41:24.374869] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-09-16T18:41:24.734409] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-16T18:41:25.174908] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-09-16T18:41:25.889859] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-16T18:41:25.974904] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-09-16T18:41:26.249881] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-16T18:41:26.774931] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-09-16T18:41:26.914801] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-16T18:41:26.917598] [INFO ] [REMOTE ] GPI: Full fetch complete (16146 records). [2025-09-16T18:41:26.917722] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-09-16T18:41:27.289257] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-09-16T18:41:27.289343] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-09-16T18:41:27.289759] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-09-16T18:41:27.289807] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-09-16T18:41:27.290403] [DEBUG] [LOCAL ] GPI: Trimmed 16146 records to 10230 (keeping 150 days of data) [2025-09-16T18:41:27.357834] [DEBUG] [LOCAL ] GPI: Primary data saved (10230 records). [2025-09-16T18:41:27.357988] [INFO ] [MAIN ] GPI: Full history saved. [2025-09-16T18:41:27.358077] [INFO ] [MAIN ] Update Progress: 959/2369 symbols completed. GPI took 24.8s. Estimated remaining: 2h 29m 6s. Rate: 9.5 symbols/min [2025-09-16T18:41:28.465958] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-16T18:41:28.476795] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-09-16T18:41:30.352357] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-16T18:41:30.364035] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-09-16T18:41:32.185705] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-16T18:41:32.198667] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-09-16T18:41:33.899359] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-16T18:41:33.907428] [INFO ] [REMOTE ] GPK: Full fetch complete (57080 records). [2025-09-16T18:41:33.907822] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-09-16T18:41:34.358816] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-09-16T18:41:34.358944] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-09-16T18:41:34.360172] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-09-16T18:41:34.360247] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-09-16T18:41:34.362302] [DEBUG] [LOCAL ] GPK: Trimmed 57080 records to 39401 (keeping 150 days of data) [2025-09-16T18:41:34.637397] [DEBUG] [LOCAL ] GPK: Primary data saved (39401 records). [2025-09-16T18:41:34.637573] [INFO ] [MAIN ] GPK: Full history saved. [2025-09-16T18:41:34.637727] [INFO ] [MAIN ] Update Progress: 960/2369 symbols completed. GPK took 23.4s. Estimated remaining: 2h 29m 1s. Rate: 9.5 symbols/min [2025-09-16T18:41:35.425816] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:41:35.443121] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:41:35.421515] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:41:35.469905] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:41:35.507828] [DEBUG] [LOCAL ] GPRK: Loaded 28378 existing records from primary storage. [2025-09-16T18:41:35.508151] [INFO ] [MAIN ] GPRK: Loaded 28378 existing records. [2025-09-16T18:41:35.620092] [DEBUG] [LOCAL ] GPOR: Loaded 16284 existing records from primary storage. [2025-09-16T18:41:35.619962] [DEBUG] [LOCAL ] GPMT: Loaded 20224 existing records from primary storage. [2025-09-16T18:41:35.648400] [INFO ] [MAIN ] GPOR: Loaded 16284 existing records. [2025-09-16T18:41:35.663306] [INFO ] [MAIN ] GPMT: Loaded 20224 existing records. [2025-09-16T18:41:35.777598] [DEBUG] [LOCAL ] GPN: Loaded 38444 existing records from primary storage. [2025-09-16T18:41:35.853332] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:41:35.847670] [INFO ] [MAIN ] GPN: Loaded 38444 existing records. [2025-09-16T18:41:35.952842] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-09-16T18:41:35.997455] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-09-16T18:41:36.016629] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-09-16T18:41:36.022214] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-09-16T18:41:36.315296] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:41:36.438725] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:41:36.460225] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-09-16T18:41:36.460521] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-09-16T18:41:36.460404] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:41:36.465950] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-09-16T18:41:36.502056] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-09-16T18:41:36.501938] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-09-16T18:41:36.519425] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-09-16T18:41:36.520860] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-09-16T18:41:36.550776] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-09-16T18:41:36.569225] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-09-16T18:41:36.590306] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-09-16T18:41:36.605588] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-09-16T18:41:36.736134] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-09-16T18:41:36.974327] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:41:37.008090] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-09-16T18:41:37.698368] [INFO ] [REMOTE ] GPN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:41:37.731606] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-09-16T18:41:37.772733] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:41:37.777210] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-09-16T18:41:37.858391] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:41:37.858778] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-09-16T18:41:38.958369] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-16T18:41:38.963291] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-09-16T18:41:39.113600] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-16T18:41:39.118612] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-09-16T18:41:39.144610] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-09-16T18:41:39.152398] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-09-16T18:41:39.762095] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-16T18:41:39.772033] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-09-16T18:41:39.815766] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-16T18:41:39.821362] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-09-16T18:41:40.274614] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-16T18:41:40.289898] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-09-16T18:41:40.305683] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-16T18:41:40.314781] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-09-16T18:41:41.002188] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-16T18:41:41.007579] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-09-16T18:41:41.627547] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-16T18:41:41.639029] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-09-16T18:41:41.781915] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-16T18:41:41.789940] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-09-16T18:41:41.874053] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-16T18:41:41.883548] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-09-16T18:41:42.019754] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-16T18:41:42.025057] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-09-16T18:41:42.848621] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-16T18:41:42.855422] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-09-16T18:41:43.074495] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-16T18:41:43.247129] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-16T18:41:43.341293] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-16T18:41:43.574936] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-09-16T18:41:43.779830] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-16T18:41:44.374931] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-09-16T18:41:44.648067] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-16T18:41:45.174942] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-09-16T18:41:45.974903] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-09-16T18:41:46.187010] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-16T18:41:46.378903] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-16T18:41:46.774902] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-09-16T18:41:47.086197] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-16T18:41:47.574934] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-09-16T18:41:48.380000] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-09-16T18:41:48.396568] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-16T18:41:49.009897] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-16T18:41:49.174911] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-09-16T18:41:49.548127] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-16T18:41:49.974940] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-09-16T18:41:50.417051] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-16T18:41:50.420699] [INFO ] [REMOTE ] GPOR: Full fetch complete (24992 records). [2025-09-16T18:41:50.420842] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-09-16T18:41:50.787251] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-09-16T18:41:50.800181] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-09-16T18:41:50.800262] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-09-16T18:41:50.800857] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-09-16T18:41:50.800928] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-09-16T18:41:50.801941] [DEBUG] [LOCAL ] GPOR: Trimmed 24992 records to 16532 (keeping 150 days of data) [2025-09-16T18:41:50.910513] [DEBUG] [LOCAL ] GPOR: Primary data saved (16532 records). [2025-09-16T18:41:50.910700] [INFO ] [MAIN ] GPOR: Full history saved. [2025-09-16T18:41:50.910793] [INFO ] [MAIN ] Update Progress: 961/2369 symbols completed. GPOR took 16.3s. Estimated remaining: 2h 29m 9s. Rate: 9.4 symbols/min [2025-09-16T18:41:51.046085] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-16T18:41:51.110361] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:41:51.110460] [INFO ] [REMOTE ] GPMT: Full fetch complete (29124 records). [2025-09-16T18:41:51.110679] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-09-16T18:41:51.315447] [DEBUG] [LOCAL ] GRBK: Loaded 19511 existing records from primary storage. [2025-09-16T18:41:51.375475] [INFO ] [MAIN ] GRBK: Loaded 19511 existing records. [2025-09-16T18:41:51.597283] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-09-16T18:41:51.630534] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-09-16T18:41:51.666576] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-09-16T18:41:51.687563] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-09-16T18:41:51.686972] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:41:51.687689] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-09-16T18:41:51.687812] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-09-16T18:41:51.687965] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-09-16T18:41:51.688533] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-09-16T18:41:51.688495] [DEBUG] [LOCAL ] GPMT: Trimmed 29124 records to 20304 (keeping 150 days of data) [2025-09-16T18:41:51.688610] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-09-16T18:41:52.169513] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:41:52.170084] [DEBUG] [LOCAL ] GPMT: Primary data saved (20304 records). [2025-09-16T18:41:52.170538] [INFO ] [MAIN ] GPMT: Full history saved. [2025-09-16T18:41:52.170630] [INFO ] [MAIN ] Update Progress: 962/2369 symbols completed. GPMT took 17.5s. Estimated remaining: 2h 28m 55s. Rate: 9.4 symbols/min [2025-09-16T18:41:52.349733] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:41:52.376789] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-09-16T18:41:52.380060] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-16T18:41:52.383604] [DEBUG] [LOCAL ] GRC: Loaded 6266 existing records from primary storage. [2025-09-16T18:41:52.391691] [INFO ] [MAIN ] GRC: Loaded 6266 existing records. [2025-09-16T18:41:52.575687] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:41:52.575972] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-09-16T18:41:52.576021] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-09-16T18:41:52.576547] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-09-16T18:41:52.576594] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-09-16T18:41:52.964172] [INFO ] [REMOTE ] GRC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:41:53.174959] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-09-16T18:41:53.472739] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-16T18:41:53.960127] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-16T18:41:53.974842] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-09-16T18:41:54.265822] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-16T18:41:54.774879] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-09-16T18:41:55.243558] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-16T18:41:55.574905] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-09-16T18:41:56.061845] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-16T18:41:56.066246] [INFO ] [REMOTE ] GPRK: Full fetch complete (42571 records). [2025-09-16T18:41:56.066340] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-09-16T18:41:56.380038] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-09-16T18:41:56.461971] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-09-16T18:41:56.462062] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-09-16T18:41:56.462765] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-09-16T18:41:56.462818] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-09-16T18:41:56.463807] [DEBUG] [LOCAL ] GPRK: Trimmed 42571 records to 28709 (keeping 150 days of data) [2025-09-16T18:41:56.632142] [DEBUG] [LOCAL ] GPRK: Primary data saved (28709 records). [2025-09-16T18:41:56.632285] [INFO ] [MAIN ] GPRK: Full history saved. [2025-09-16T18:41:56.632385] [INFO ] [MAIN ] Update Progress: 963/2369 symbols completed. GPRK took 22.0s. Estimated remaining: 2h 28m 46s. Rate: 9.5 symbols/min [2025-09-16T18:41:56.801374] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:41:56.801554] [DEBUG] [LOCAL ] GRDN: No existing data file found in primary storage. [2025-09-16T18:41:56.801597] [WARN ] [MAIN ] GRDN: No existing data found, performing full refresh instead. [2025-09-16T18:41:56.801745] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-09-16T18:41:56.801788] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-09-16T18:41:56.801829] [DEBUG] [LOCAL ] GRDN: No primary data file found to delete. [2025-09-16T18:41:56.801862] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-09-16T18:41:57.164089] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:41:57.174877] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-09-16T18:41:57.308259] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-16T18:41:57.325329] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-16T18:41:57.974898] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-09-16T18:41:58.112039] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-16T18:41:58.774914] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-09-16T18:41:59.291912] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-16T18:41:59.441212] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-16T18:41:59.574946] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-09-16T18:42:00.374916] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-09-16T18:42:00.688342] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-16T18:42:01.174933] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-09-16T18:42:01.974949] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-09-16T18:42:02.001501] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-16T18:42:02.661323] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-09-16T18:42:02.666871] [INFO ] [REMOTE ] GPN: Full fetch complete (56262 records). [2025-09-16T18:42:02.666967] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-09-16T18:42:02.667681] [FATAL] [VALIDATOR ] GPN: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:42:02.667761] [FATAL] [MAIN ] GPN: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:42:02.667798] [WARN ] [MAIN ] GPN: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:42:02.667841] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-09-16T18:42:02.667899] [DEBUG] [LOCAL ] GPN: No primary data file found to delete. [2025-09-16T18:42:02.667934] [INFO ] [LOCAL ] GPN: Starting deletion of derivative data. [2025-09-16T18:42:02.668199] [DEBUG] [LOCAL ] GPN: Deleted derivative data file. [2025-09-16T18:42:02.669163] [INFO ] [MAIN ] Update Progress: 964/2369 symbols completed. GPN took 28.0s. Estimated remaining: 2h 28m 39s. Rate: 9.5 symbols/min [2025-09-16T18:42:02.780035] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-09-16T18:42:02.847452] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:42:02.881634] [DEBUG] [LOCAL ] GRMN: Loaded 29826 existing records from primary storage. [2025-09-16T18:42:02.881838] [INFO ] [MAIN ] GRMN: Loaded 29826 existing records. [2025-09-16T18:42:03.059716] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:42:03.060025] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-09-16T18:42:03.065442] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-09-16T18:42:03.070102] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-16T18:42:03.073299] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-09-16T18:42:03.073738] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-09-16T18:42:03.423691] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:42:03.574920] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-09-16T18:42:04.187732] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-16T18:42:04.374896] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-09-16T18:42:05.031458] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-16T18:42:05.174921] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-09-16T18:42:05.299801] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-16T18:42:05.974904] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-09-16T18:42:06.092771] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-16T18:42:06.774922] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-09-16T18:42:07.039092] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-16T18:42:07.575115] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-09-16T18:42:07.684844] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-16T18:42:08.374938] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-09-16T18:42:08.748430] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-16T18:42:09.174914] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-09-16T18:42:09.281225] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-16T18:42:09.917908] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-16T18:42:09.974917] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-09-16T18:42:10.774902] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-09-16T18:42:10.786114] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-16T18:42:11.574938] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-09-16T18:42:12.374914] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-09-16T18:42:12.418503] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-16T18:42:12.446029] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-16T18:42:13.174863] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-09-16T18:42:13.421489] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-16T18:42:13.424744] [INFO ] [REMOTE ] GRBK: Full fetch complete (30101 records). [2025-09-16T18:42:13.424855] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-09-16T18:42:13.789903] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-09-16T18:42:13.789987] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-09-16T18:42:13.790577] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-09-16T18:42:13.790658] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-09-16T18:42:13.791443] [DEBUG] [LOCAL ] GRBK: Trimmed 30101 records to 19673 (keeping 150 days of data) [2025-09-16T18:42:13.904849] [DEBUG] [LOCAL ] GRBK: Primary data saved (19673 records). [2025-09-16T18:42:13.904997] [INFO ] [MAIN ] GRBK: Full history saved. [2025-09-16T18:42:13.905086] [INFO ] [MAIN ] Update Progress: 965/2369 symbols completed. GRBK took 23.0s. Estimated remaining: 2h 28m 40s. Rate: 9.4 symbols/min [2025-09-16T18:42:13.980145] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-09-16T18:42:14.079779] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:42:14.114728] [DEBUG] [LOCAL ] GRND: Loaded 36943 existing records from primary storage. [2025-09-16T18:42:14.114878] [INFO ] [MAIN ] GRND: Loaded 36943 existing records. [2025-09-16T18:42:14.290024] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:42:14.290285] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-09-16T18:42:14.290331] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-09-16T18:42:14.291402] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-09-16T18:42:14.291454] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-09-16T18:42:14.642980] [INFO ] [REMOTE ] GRND: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:42:14.678141] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-16T18:42:14.718503] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-16T18:42:14.774911] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-09-16T18:42:15.574904] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-09-16T18:42:15.845832] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-16T18:42:16.374916] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-09-16T18:42:17.107176] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-16T18:42:17.174914] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-09-16T18:42:17.469821] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-16T18:42:17.473751] [INFO ] [REMOTE ] GRDN: Full fetch complete (19681 records). [2025-09-16T18:42:17.473825] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-09-16T18:42:17.837451] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-09-16T18:42:17.837531] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-09-16T18:42:17.837973] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-09-16T18:42:17.838019] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-09-16T18:42:17.838677] [DEBUG] [LOCAL ] GRDN: Trimmed 19681 records to 15220 (keeping 150 days of data) [2025-09-16T18:42:17.929106] [DEBUG] [LOCAL ] GRDN: Primary data saved (15220 records). [2025-09-16T18:42:17.929250] [INFO ] [MAIN ] GRDN: Full history saved. [2025-09-16T18:42:17.929345] [INFO ] [MAIN ] Update Progress: 966/2369 symbols completed. GRDN took 21.3s. Estimated remaining: 2h 28m 30s. Rate: 9.4 symbols/min [2025-09-16T18:42:17.982157] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-09-16T18:42:18.112945] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:42:18.135919] [DEBUG] [LOCAL ] GRNT: Loaded 24663 existing records from primary storage. [2025-09-16T18:42:18.136068] [INFO ] [MAIN ] GRNT: Loaded 24663 existing records. [2025-09-16T18:42:18.313594] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:42:18.313863] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-09-16T18:42:18.313972] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-09-16T18:42:18.314849] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-09-16T18:42:18.314900] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-09-16T18:42:18.672244] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:42:18.774904] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-09-16T18:42:18.868793] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-16T18:42:18.870887] [INFO ] [REMOTE ] GRC: Full fetch complete (9653 records). [2025-09-16T18:42:18.871062] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-09-16T18:42:19.073596] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-16T18:42:19.284206] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-09-16T18:42:19.284285] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-09-16T18:42:19.284526] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-09-16T18:42:19.284565] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-09-16T18:42:19.285014] [DEBUG] [LOCAL ] GRC: Trimmed 9653 records to 6338 (keeping 150 days of data) [2025-09-16T18:42:19.323689] [DEBUG] [LOCAL ] GRC: Primary data saved (6338 records). [2025-09-16T18:42:19.323794] [INFO ] [MAIN ] GRC: Full history saved. [2025-09-16T18:42:19.323880] [INFO ] [MAIN ] Update Progress: 967/2369 symbols completed. GRC took 27.2s. Estimated remaining: 2h 28m 17s. Rate: 9.5 symbols/min [2025-09-16T18:42:19.491536] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:42:19.500032] [DEBUG] [LOCAL ] GROV: Loaded 6809 existing records from primary storage. [2025-09-16T18:42:19.500139] [INFO ] [MAIN ] GROV: Loaded 6809 existing records. [2025-09-16T18:42:19.580125] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-09-16T18:42:19.682036] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:42:19.682514] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-09-16T18:42:19.682565] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-09-16T18:42:19.682831] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-09-16T18:42:19.682874] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-09-16T18:42:20.037984] [INFO ] [REMOTE ] GROV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:42:20.096507] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-16T18:42:20.374925] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-09-16T18:42:21.083854] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-16T18:42:21.168345] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-16T18:42:21.174849] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-09-16T18:42:21.964261] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-16T18:42:21.974846] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-09-16T18:42:22.634718] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-16T18:42:22.774926] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-09-16T18:42:23.574919] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-09-16T18:42:23.994932] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-16T18:42:24.374924] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-09-16T18:42:24.979288] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-16T18:42:25.174903] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-09-16T18:42:25.527212] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-16T18:42:25.974908] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-09-16T18:42:26.000774] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-16T18:42:26.774903] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-09-16T18:42:27.263423] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-16T18:42:27.522871] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-16T18:42:27.574856] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-09-16T18:42:28.257706] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-16T18:42:28.374861] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-09-16T18:42:29.174932] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-09-16T18:42:29.194949] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-16T18:42:29.974915] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-09-16T18:42:30.769817] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-16T18:42:30.776907] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-09-16T18:42:31.493278] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-16T18:42:31.494532] [INFO ] [REMOTE ] GROV: Full fetch complete (10067 records). [2025-09-16T18:42:31.494604] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-09-16T18:42:31.575476] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-09-16T18:42:31.863079] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-09-16T18:42:31.863241] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-09-16T18:42:31.863548] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-09-16T18:42:31.863591] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-09-16T18:42:31.864169] [DEBUG] [LOCAL ] GROV: Trimmed 10067 records to 6863 (keeping 150 days of data) [2025-09-16T18:42:31.923418] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-16T18:42:31.945706] [DEBUG] [LOCAL ] GROV: Primary data saved (6863 records). [2025-09-16T18:42:31.945857] [INFO ] [MAIN ] GROV: Full history saved. [2025-09-16T18:42:31.945975] [INFO ] [MAIN ] Update Progress: 968/2369 symbols completed. GROV took 12.6s. Estimated remaining: 2h 28m 19s. Rate: 9.4 symbols/min [2025-09-16T18:42:32.121572] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:42:32.126475] [DEBUG] [LOCAL ] GRX: Loaded 3278 existing records from primary storage. [2025-09-16T18:42:32.126575] [INFO ] [MAIN ] GRX: Loaded 3278 existing records. [2025-09-16T18:42:32.307382] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:42:32.307623] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-09-16T18:42:32.307701] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-09-16T18:42:32.308003] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-09-16T18:42:32.308050] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-09-16T18:42:32.383570] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-09-16T18:42:32.678694] [INFO ] [REMOTE ] GRX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:42:33.174916] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-09-16T18:42:33.439997] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-16T18:42:33.976487] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-09-16T18:42:33.983965] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-16T18:42:34.370295] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-16T18:42:34.605542] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-16T18:42:34.774964] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-09-16T18:42:35.574904] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-09-16T18:42:36.137157] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-16T18:42:36.374880] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-09-16T18:42:36.413003] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-16T18:42:37.174898] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-09-16T18:42:37.811440] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-16T18:42:37.974897] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-09-16T18:42:38.774907] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-09-16T18:42:38.922634] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-16T18:42:39.115424] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-16T18:42:39.249998] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-16T18:42:39.254278] [INFO ] [REMOTE ] GRNT: Full fetch complete (36547 records). [2025-09-16T18:42:39.254374] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-09-16T18:42:39.579980] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-09-16T18:42:39.637509] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-09-16T18:42:39.637586] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-09-16T18:42:39.638313] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-09-16T18:42:39.638364] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-09-16T18:42:39.639471] [DEBUG] [LOCAL ] GRNT: Trimmed 36547 records to 24876 (keeping 150 days of data) [2025-09-16T18:42:39.789930] [DEBUG] [LOCAL ] GRNT: Primary data saved (24876 records). [2025-09-16T18:42:39.790115] [INFO ] [MAIN ] GRNT: Full history saved. [2025-09-16T18:42:39.790225] [INFO ] [MAIN ] Update Progress: 969/2369 symbols completed. GRNT took 21.9s. Estimated remaining: 2h 28m 15s. Rate: 9.4 symbols/min [2025-09-16T18:42:39.967704] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:42:40.010081] [DEBUG] [LOCAL ] GS: Loaded 38263 existing records from primary storage. [2025-09-16T18:42:40.010245] [INFO ] [MAIN ] GS: Loaded 38263 existing records. [2025-09-16T18:42:40.190500] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:42:40.190780] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-09-16T18:42:40.190905] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-09-16T18:42:40.194471] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-16T18:42:40.195610] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-09-16T18:42:40.196076] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-09-16T18:42:40.379997] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-09-16T18:42:40.554351] [INFO ] [REMOTE ] GS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:42:41.174900] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-09-16T18:42:41.974913] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-09-16T18:42:42.146075] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-16T18:42:42.774957] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-09-16T18:42:43.202976] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-16T18:42:43.251365] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-16T18:42:43.432249] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-16T18:42:43.574950] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-09-16T18:42:44.374877] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-09-16T18:42:45.183731] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-09-16T18:42:45.185709] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-16T18:42:45.190850] [INFO ] [REMOTE ] GRMN: Full fetch complete (45739 records). [2025-09-16T18:42:45.190939] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-09-16T18:42:45.586710] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-09-16T18:42:45.586811] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-09-16T18:42:45.587582] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-09-16T18:42:45.587682] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-09-16T18:42:45.588817] [DEBUG] [LOCAL ] GRMN: Trimmed 45739 records to 30105 (keeping 150 days of data) [2025-09-16T18:42:45.788663] [DEBUG] [LOCAL ] GRMN: Primary data saved (30105 records). [2025-09-16T18:42:45.788805] [INFO ] [MAIN ] GRMN: Full history saved. [2025-09-16T18:42:45.789505] [INFO ] [MAIN ] Update Progress: 970/2369 symbols completed. GRMN took 43.1s. Estimated remaining: 2h 28m 8s. Rate: 9.4 symbols/min [2025-09-16T18:42:45.963332] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:42:45.963951] [DEBUG] [LOCAL ] GSBD: No existing data file found in primary storage. [2025-09-16T18:42:45.964123] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-16T18:42:45.964229] [WARN ] [MAIN ] GSBD: No existing data found, performing full refresh instead. [2025-09-16T18:42:45.966123] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-09-16T18:42:45.966486] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-09-16T18:42:45.966535] [DEBUG] [LOCAL ] GSBD: No primary data file found to delete. [2025-09-16T18:42:45.966578] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-09-16T18:42:45.979954] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-09-16T18:42:46.349904] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:42:46.365957] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-16T18:42:46.372922] [INFO ] [REMOTE ] GRND: Full fetch complete (54214 records). [2025-09-16T18:42:46.373034] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-09-16T18:42:46.725774] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-16T18:42:46.788236] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-09-16T18:42:46.806480] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-09-16T18:42:46.806546] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-09-16T18:42:46.807344] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-09-16T18:42:46.807391] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-09-16T18:42:46.808755] [DEBUG] [LOCAL ] GRND: Trimmed 54214 records to 37247 (keeping 150 days of data) [2025-09-16T18:42:47.031160] [DEBUG] [LOCAL ] GRND: Primary data saved (37247 records). [2025-09-16T18:42:47.031306] [INFO ] [MAIN ] GRND: Full history saved. [2025-09-16T18:42:47.031418] [INFO ] [MAIN ] Update Progress: 971/2369 symbols completed. GRND took 33.1s. Estimated remaining: 2h 27m 55s. Rate: 9.5 symbols/min [2025-09-16T18:42:47.200176] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:42:47.238232] [DEBUG] [LOCAL ] GSK: Loaded 39497 existing records from primary storage. [2025-09-16T18:42:47.238391] [INFO ] [MAIN ] GSK: Loaded 39497 existing records. [2025-09-16T18:42:47.418113] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:42:47.418385] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-09-16T18:42:47.418434] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-09-16T18:42:47.419355] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-09-16T18:42:47.419407] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-09-16T18:42:47.524970] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-16T18:42:47.552094] [INFO ] [REMOTE ] GRX: Full fetch complete (4544 records). [2025-09-16T18:42:47.585400] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-09-16T18:42:47.575681] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-09-16T18:42:47.967259] [INFO ] [REMOTE ] GSK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:42:48.147317] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-09-16T18:42:48.147396] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-09-16T18:42:48.147533] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-09-16T18:42:48.147572] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-09-16T18:42:48.147955] [DEBUG] [LOCAL ] GRX: Trimmed 4544 records to 3340 (keeping 150 days of data) [2025-09-16T18:42:48.168203] [DEBUG] [LOCAL ] GRX: Primary data saved (3340 records). [2025-09-16T18:42:48.168266] [INFO ] [MAIN ] GRX: Full history saved. [2025-09-16T18:42:48.168353] [INFO ] [MAIN ] Update Progress: 972/2369 symbols completed. GRX took 16.2s. Estimated remaining: 2h 27m 41s. Rate: 9.5 symbols/min [2025-09-16T18:42:48.338151] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:42:48.362566] [DEBUG] [LOCAL ] GSL: Loaded 24348 existing records from primary storage. [2025-09-16T18:42:48.362714] [INFO ] [MAIN ] GSL: Loaded 24348 existing records. [2025-09-16T18:42:48.383107] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-09-16T18:42:48.539375] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:42:48.539629] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-09-16T18:42:48.539711] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-09-16T18:42:48.540403] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-09-16T18:42:48.540464] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-09-16T18:42:48.902872] [INFO ] [REMOTE ] GSL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:42:49.116962] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-16T18:42:49.174874] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-09-16T18:42:49.974914] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-09-16T18:42:50.281388] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-16T18:42:50.774907] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-09-16T18:42:50.817311] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-16T18:42:51.394581] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-16T18:42:51.574901] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-09-16T18:42:52.374906] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-09-16T18:42:52.538776] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-16T18:42:53.168265] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-16T18:42:53.177150] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-09-16T18:42:53.974904] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-09-16T18:42:54.511900] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-16T18:42:54.635634] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-16T18:42:54.774901] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-09-16T18:42:55.574896] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-09-16T18:42:55.911902] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-16T18:42:56.374897] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-09-16T18:42:56.995281] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-16T18:42:57.031437] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-16T18:42:57.174942] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-09-16T18:42:57.940340] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-16T18:42:57.974856] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-09-16T18:42:58.597033] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-16T18:42:58.774911] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-09-16T18:42:59.574936] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-09-16T18:42:59.755730] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-16T18:43:00.374878] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-09-16T18:43:00.616328] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-16T18:43:01.065443] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-16T18:43:01.174863] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-09-16T18:43:01.974925] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-09-16T18:43:02.019173] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-16T18:43:02.774935] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-09-16T18:43:02.956191] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-16T18:43:03.390601] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-16T18:43:03.574961] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-09-16T18:43:04.374936] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-09-16T18:43:04.842464] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-16T18:43:05.090180] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-16T18:43:05.174868] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-09-16T18:43:05.974864] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-09-16T18:43:06.076959] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-16T18:43:06.775009] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-09-16T18:43:07.005670] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-16T18:43:07.356263] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-16T18:43:07.574941] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-09-16T18:43:08.294926] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-16T18:43:08.303351] [INFO ] [REMOTE ] GSK: Full fetch complete (58180 records). [2025-09-16T18:43:08.303542] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-09-16T18:43:08.379990] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-09-16T18:43:08.689911] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-09-16T18:43:08.690000] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-09-16T18:43:08.690888] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-09-16T18:43:08.690934] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-09-16T18:43:08.692309] [DEBUG] [LOCAL ] GSK: Trimmed 58180 records to 39887 (keeping 150 days of data) [2025-09-16T18:43:08.936732] [DEBUG] [LOCAL ] GSK: Primary data saved (39887 records). [2025-09-16T18:43:08.936974] [INFO ] [MAIN ] GSK: Full history saved. [2025-09-16T18:43:08.937104] [INFO ] [MAIN ] Update Progress: 973/2369 symbols completed. GSK took 21.9s. Estimated remaining: 2h 27m 55s. Rate: 9.4 symbols/min [2025-09-16T18:43:09.052308] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-16T18:43:09.104085] [INFO ] [REMOTE ] GSBD: Full fetch complete (42570 records). [2025-09-16T18:43:09.127570] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:43:09.127740] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-09-16T18:43:09.177565] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-09-16T18:43:09.419032] [DEBUG] [LOCAL ] GTES: Loaded 37017 existing records from primary storage. [2025-09-16T18:43:09.458226] [INFO ] [MAIN ] GTES: Loaded 37017 existing records. [2025-09-16T18:43:09.721588] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-09-16T18:43:09.746328] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-09-16T18:43:09.750454] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-09-16T18:43:09.749708] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:43:09.750723] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-09-16T18:43:09.750844] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-09-16T18:43:09.751102] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-09-16T18:43:09.752145] [DEBUG] [LOCAL ] GSBD: Trimmed 42570 records to 28138 (keeping 150 days of data) [2025-09-16T18:43:09.752199] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-09-16T18:43:09.752333] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-09-16T18:43:10.244509] [INFO ] [REMOTE ] GTES: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:43:10.256825] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-09-16T18:43:10.258451] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-16T18:43:10.323866] [DEBUG] [LOCAL ] GSBD: Primary data saved (28138 records). [2025-09-16T18:43:10.324036] [INFO ] [MAIN ] GSBD: Full history saved. [2025-09-16T18:43:10.324117] [INFO ] [MAIN ] Update Progress: 974/2369 symbols completed. GSBD took 24.5s. Estimated remaining: 2h 27m 42s. Rate: 9.4 symbols/min [2025-09-16T18:43:10.494242] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:43:10.528887] [DEBUG] [LOCAL ] GTLS: Loaded 31961 existing records from primary storage. [2025-09-16T18:43:10.529048] [INFO ] [MAIN ] GTLS: Loaded 31961 existing records. [2025-09-16T18:43:10.707154] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:43:10.707455] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-09-16T18:43:10.707519] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-09-16T18:43:10.708286] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-09-16T18:43:10.708360] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-09-16T18:43:10.785468] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-09-16T18:43:11.062238] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:43:11.219794] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-16T18:43:11.574920] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-09-16T18:43:11.678063] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-16T18:43:12.208668] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-16T18:43:12.212860] [INFO ] [REMOTE ] GSL: Full fetch complete (37068 records). [2025-09-16T18:43:12.212943] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-09-16T18:43:12.378733] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-09-16T18:43:12.597832] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-09-16T18:43:12.597914] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-09-16T18:43:12.598579] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-09-16T18:43:12.598622] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-09-16T18:43:12.599428] [DEBUG] [LOCAL ] GSL: Trimmed 37068 records to 24570 (keeping 150 days of data) [2025-09-16T18:43:12.753802] [DEBUG] [LOCAL ] GSL: Primary data saved (24570 records). [2025-09-16T18:43:12.753964] [INFO ] [MAIN ] GSL: Full history saved. [2025-09-16T18:43:12.754055] [INFO ] [MAIN ] Update Progress: 975/2369 symbols completed. GSL took 24.6s. Estimated remaining: 2h 27m 30s. Rate: 9.5 symbols/min [2025-09-16T18:43:12.928858] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:43:12.964181] [DEBUG] [LOCAL ] GTN: Loaded 33382 existing records from primary storage. [2025-09-16T18:43:12.964345] [INFO ] [MAIN ] GTN: Loaded 33382 existing records. [2025-09-16T18:43:13.148578] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:43:13.148892] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-09-16T18:43:13.148943] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-09-16T18:43:13.149724] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-09-16T18:43:13.149775] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-09-16T18:43:13.181046] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-09-16T18:43:13.521543] [INFO ] [REMOTE ] GTN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:43:13.552277] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-16T18:43:13.930587] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-16T18:43:13.974845] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-09-16T18:43:14.771571] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-16T18:43:14.778891] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-09-16T18:43:15.574912] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-09-16T18:43:15.706995] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-16T18:43:16.374923] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-09-16T18:43:16.560620] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-16T18:43:17.174919] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-09-16T18:43:17.710256] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-16T18:43:17.718698] [INFO ] [REMOTE ] GS: Full fetch complete (56879 records). [2025-09-16T18:43:17.718943] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-09-16T18:43:17.985464] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-09-16T18:43:18.064067] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-16T18:43:18.152185] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-09-16T18:43:18.152387] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-09-16T18:43:18.153276] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-09-16T18:43:18.153341] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-09-16T18:43:18.154723] [DEBUG] [LOCAL ] GS: Trimmed 56879 records to 38615 (keeping 150 days of data) [2025-09-16T18:43:18.413738] [DEBUG] [LOCAL ] GS: Primary data saved (38615 records). [2025-09-16T18:43:18.413890] [INFO ] [MAIN ] GS: Full history saved. [2025-09-16T18:43:18.413991] [INFO ] [MAIN ] Update Progress: 976/2369 symbols completed. GS took 38.6s. Estimated remaining: 2h 27m 22s. Rate: 9.5 symbols/min [2025-09-16T18:43:18.593919] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-16T18:43:18.619596] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:43:18.641000] [DEBUG] [LOCAL ] GTY: Loaded 21698 existing records from primary storage. [2025-09-16T18:43:18.641143] [INFO ] [MAIN ] GTY: Loaded 21698 existing records. [2025-09-16T18:43:18.787452] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-09-16T18:43:18.823813] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:43:18.824038] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-09-16T18:43:18.824084] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-09-16T18:43:18.824712] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-09-16T18:43:18.824773] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-09-16T18:43:19.174936] [INFO ] [REMOTE ] GTY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:43:19.574891] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-09-16T18:43:19.671728] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-16T18:43:20.374895] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-09-16T18:43:20.442404] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-16T18:43:20.908744] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-16T18:43:21.174916] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-09-16T18:43:21.974903] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-09-16T18:43:22.013291] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-16T18:43:22.558258] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-16T18:43:22.774907] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-09-16T18:43:23.234162] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-16T18:43:23.574954] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-09-16T18:43:24.331397] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-16T18:43:24.374947] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-09-16T18:43:24.934957] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-16T18:43:25.174950] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-09-16T18:43:25.974942] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-09-16T18:43:26.295398] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-16T18:43:26.774974] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-09-16T18:43:26.893504] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-16T18:43:27.498965] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-16T18:43:27.574955] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-09-16T18:43:27.702994] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-16T18:43:28.374977] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-09-16T18:43:28.747160] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-16T18:43:29.179795] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-09-16T18:43:29.182601] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-16T18:43:29.974901] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-09-16T18:43:30.774908] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-09-16T18:43:30.883616] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-16T18:43:30.955401] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-16T18:43:31.574913] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-09-16T18:43:32.320387] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-16T18:43:32.326698] [INFO ] [REMOTE ] GTES: Full fetch complete (55303 records). [2025-09-16T18:43:32.326847] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-09-16T18:43:32.385814] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-09-16T18:43:32.729555] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-09-16T18:43:32.729661] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-09-16T18:43:32.730412] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-09-16T18:43:32.730454] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-09-16T18:43:32.731670] [DEBUG] [LOCAL ] GTES: Trimmed 55303 records to 37387 (keeping 150 days of data) [2025-09-16T18:43:32.954552] [DEBUG] [LOCAL ] GTES: Primary data saved (37387 records). [2025-09-16T18:43:32.954721] [INFO ] [MAIN ] GTES: Full history saved. [2025-09-16T18:43:32.954811] [INFO ] [MAIN ] Update Progress: 977/2369 symbols completed. GTES took 24.0s. Estimated remaining: 2h 27m 28s. Rate: 9.4 symbols/min [2025-09-16T18:43:33.166146] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:43:33.176059] [DEBUG] [LOCAL ] GUG: Loaded 8754 existing records from primary storage. [2025-09-16T18:43:33.175843] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-09-16T18:43:33.176192] [INFO ] [MAIN ] GUG: Loaded 8754 existing records. [2025-09-16T18:43:33.371096] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:43:33.371493] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-09-16T18:43:33.392041] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-09-16T18:43:33.395312] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-09-16T18:43:33.396415] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-16T18:43:33.396480] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-09-16T18:43:33.790575] [INFO ] [REMOTE ] GUG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:43:33.935130] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-16T18:43:33.974910] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-09-16T18:43:34.339833] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-16T18:43:34.774909] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-09-16T18:43:35.276447] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-16T18:43:35.282239] [INFO ] [REMOTE ] GTN: Full fetch complete (49879 records). [2025-09-16T18:43:35.282411] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-09-16T18:43:35.580282] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-09-16T18:43:35.690993] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-09-16T18:43:35.691093] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-09-16T18:43:35.691939] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-09-16T18:43:35.691989] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-09-16T18:43:35.693354] [DEBUG] [LOCAL ] GTN: Trimmed 49879 records to 33708 (keeping 150 days of data) [2025-09-16T18:43:35.898551] [DEBUG] [LOCAL ] GTN: Primary data saved (33708 records). [2025-09-16T18:43:35.898715] [INFO ] [MAIN ] GTN: Full history saved. [2025-09-16T18:43:35.898803] [INFO ] [MAIN ] Update Progress: 978/2369 symbols completed. GTN took 23.1s. Estimated remaining: 2h 27m 16s. Rate: 9.4 symbols/min [2025-09-16T18:43:36.081088] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:43:36.097886] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-16T18:43:36.113850] [DEBUG] [LOCAL ] GUT: Loaded 11442 existing records from primary storage. [2025-09-16T18:43:36.114030] [INFO ] [MAIN ] GUT: Loaded 11442 existing records. [2025-09-16T18:43:36.303895] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-16T18:43:36.309259] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:43:36.312884] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-09-16T18:43:36.312939] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-09-16T18:43:36.313372] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-09-16T18:43:36.313418] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-09-16T18:43:36.380019] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-09-16T18:43:36.685855] [INFO ] [REMOTE ] GUT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:43:37.046015] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-16T18:43:37.174907] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-09-16T18:43:37.974861] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-09-16T18:43:38.034429] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-16T18:43:38.037811] [INFO ] [REMOTE ] GTY: Full fetch complete (32954 records). [2025-09-16T18:43:38.037888] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-09-16T18:43:38.409164] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-09-16T18:43:38.409243] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-09-16T18:43:38.409823] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-09-16T18:43:38.409869] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-09-16T18:43:38.410634] [DEBUG] [LOCAL ] GTY: Trimmed 32954 records to 21887 (keeping 150 days of data) [2025-09-16T18:43:38.549288] [DEBUG] [LOCAL ] GTY: Primary data saved (21887 records). [2025-09-16T18:43:38.549419] [INFO ] [MAIN ] GTY: Full history saved. [2025-09-16T18:43:38.549502] [INFO ] [MAIN ] Update Progress: 979/2369 symbols completed. GTY took 20.1s. Estimated remaining: 2h 27m 5s. Rate: 9.5 symbols/min [2025-09-16T18:43:38.721140] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:43:38.747683] [DEBUG] [LOCAL ] GVA: Loaded 23856 existing records from primary storage. [2025-09-16T18:43:38.747830] [INFO ] [MAIN ] GVA: Loaded 23856 existing records. [2025-09-16T18:43:38.784041] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-09-16T18:43:38.944859] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:43:38.945102] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-09-16T18:43:38.945151] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-09-16T18:43:38.945795] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-09-16T18:43:38.945844] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-09-16T18:43:39.302253] [INFO ] [REMOTE ] GVA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:43:39.574910] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-09-16T18:43:39.766949] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-16T18:43:40.005661] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-16T18:43:40.374888] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-09-16T18:43:41.093344] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-16T18:43:41.174847] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-09-16T18:43:41.951000] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-16T18:43:41.956429] [INFO ] [REMOTE ] GTLS: Full fetch complete (46467 records). [2025-09-16T18:43:41.956523] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-09-16T18:43:41.979989] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-09-16T18:43:42.342084] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-09-16T18:43:42.342180] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-09-16T18:43:42.342889] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-09-16T18:43:42.342937] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-09-16T18:43:42.344294] [DEBUG] [LOCAL ] GTLS: Trimmed 46467 records to 32299 (keeping 150 days of data) [2025-09-16T18:43:42.483612] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-16T18:43:42.577485] [DEBUG] [LOCAL ] GTLS: Primary data saved (32299 records). [2025-09-16T18:43:42.577725] [INFO ] [MAIN ] GTLS: Full history saved. [2025-09-16T18:43:42.579050] [INFO ] [MAIN ] Update Progress: 980/2369 symbols completed. GTLS took 32.3s. Estimated remaining: 2h 26m 55s. Rate: 9.5 symbols/min [2025-09-16T18:43:42.751401] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:43:42.766907] [DEBUG] [LOCAL ] GWH: Loaded 12801 existing records from primary storage. [2025-09-16T18:43:42.767075] [INFO ] [MAIN ] GWH: Loaded 12801 existing records. [2025-09-16T18:43:42.780156] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-09-16T18:43:42.950692] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:43:42.951022] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-09-16T18:43:42.951068] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-09-16T18:43:42.951597] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-09-16T18:43:42.951676] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-09-16T18:43:43.081286] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-16T18:43:43.330712] [INFO ] [REMOTE ] GWH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:43:43.574936] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-09-16T18:43:44.159622] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-16T18:43:44.374910] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-09-16T18:43:44.519475] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-16T18:43:44.960251] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-16T18:43:45.174905] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-09-16T18:43:45.974906] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-09-16T18:43:46.046080] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-16T18:43:46.774883] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-09-16T18:43:46.933454] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-16T18:43:47.574946] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-09-16T18:43:47.923214] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-16T18:43:48.374935] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-09-16T18:43:48.423944] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-16T18:43:49.174937] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-09-16T18:43:49.741255] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-16T18:43:49.913808] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-16T18:43:49.974896] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-09-16T18:43:50.774869] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-09-16T18:43:50.988625] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-16T18:43:51.434486] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-16T18:43:51.574894] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-09-16T18:43:52.374873] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-09-16T18:43:52.695669] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-16T18:43:53.174874] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-09-16T18:43:53.457695] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-16T18:43:53.974937] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-09-16T18:43:54.079846] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-16T18:43:54.774916] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-09-16T18:43:55.574936] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-09-16T18:43:55.623361] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-16T18:43:55.654595] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-16T18:43:56.374898] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-09-16T18:43:56.506305] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-16T18:43:56.508224] [INFO ] [REMOTE ] GUG: Full fetch complete (13527 records). [2025-09-16T18:43:56.508298] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-09-16T18:43:56.871505] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-09-16T18:43:56.871727] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-09-16T18:43:56.872037] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-09-16T18:43:56.872077] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-09-16T18:43:56.872564] [DEBUG] [LOCAL ] GUG: Trimmed 13527 records to 8867 (keeping 150 days of data) [2025-09-16T18:43:56.928586] [DEBUG] [LOCAL ] GUG: Primary data saved (8867 records). [2025-09-16T18:43:56.928767] [INFO ] [MAIN ] GUG: Full history saved. [2025-09-16T18:43:56.928861] [INFO ] [MAIN ] Update Progress: 981/2369 symbols completed. GUG took 24.0s. Estimated remaining: 2h 27m 0s. Rate: 9.4 symbols/min [2025-09-16T18:43:57.106477] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:43:57.136369] [DEBUG] [LOCAL ] GWRE: Loaded 29708 existing records from primary storage. [2025-09-16T18:43:57.136527] [INFO ] [MAIN ] GWRE: Loaded 29708 existing records. [2025-09-16T18:43:57.180059] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-09-16T18:43:57.324595] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:43:57.324901] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-09-16T18:43:57.324949] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-09-16T18:43:57.325761] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-09-16T18:43:57.325816] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-09-16T18:43:57.705920] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:43:57.827337] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-16T18:43:57.974898] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-09-16T18:43:58.298214] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-16T18:43:58.774925] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-09-16T18:43:59.296156] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-16T18:43:59.299938] [INFO ] [REMOTE ] GVA: Full fetch complete (37257 records). [2025-09-16T18:43:59.300017] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-09-16T18:43:59.581744] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-09-16T18:43:59.670331] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-09-16T18:43:59.670414] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-09-16T18:43:59.671034] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-09-16T18:43:59.671078] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-09-16T18:43:59.671947] [DEBUG] [LOCAL ] GVA: Trimmed 37257 records to 24076 (keeping 150 days of data) [2025-09-16T18:43:59.814957] [DEBUG] [LOCAL ] GVA: Primary data saved (24076 records). [2025-09-16T18:43:59.815089] [INFO ] [MAIN ] GVA: Full history saved. [2025-09-16T18:43:59.815170] [INFO ] [MAIN ] Update Progress: 982/2369 symbols completed. GVA took 21.3s. Estimated remaining: 2h 26m 49s. Rate: 9.4 symbols/min [2025-09-16T18:43:59.998997] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:44:00.013904] [DEBUG] [LOCAL ] GWW: Loaded 13875 existing records from primary storage. [2025-09-16T18:44:00.014052] [INFO ] [MAIN ] GWW: Loaded 13875 existing records. [2025-09-16T18:44:00.188858] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:44:00.189104] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-09-16T18:44:00.189151] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-09-16T18:44:00.189696] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-09-16T18:44:00.189754] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-09-16T18:44:00.379984] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-09-16T18:44:00.554726] [INFO ] [REMOTE ] GWW: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:44:00.578820] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-16T18:44:00.751559] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-16T18:44:01.174910] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-09-16T18:44:01.815695] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-16T18:44:01.974938] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-09-16T18:44:02.160033] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-16T18:44:02.774902] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-09-16T18:44:02.898457] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-16T18:44:03.574899] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-09-16T18:44:04.374908] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-09-16T18:44:04.447282] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-16T18:44:04.628398] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-16T18:44:04.630937] [INFO ] [REMOTE ] GUT: Full fetch complete (16986 records). [2025-09-16T18:44:04.631015] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-09-16T18:44:05.018797] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-09-16T18:44:05.018967] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-09-16T18:44:05.019631] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-09-16T18:44:05.019716] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-09-16T18:44:05.021233] [DEBUG] [LOCAL ] GUT: Trimmed 16986 records to 11583 (keeping 150 days of data) [2025-09-16T18:44:05.096255] [DEBUG] [LOCAL ] GUT: Primary data saved (11583 records). [2025-09-16T18:44:05.096471] [INFO ] [MAIN ] GUT: Full history saved. [2025-09-16T18:44:05.096625] [INFO ] [MAIN ] Update Progress: 983/2369 symbols completed. GUT took 29.2s. Estimated remaining: 2h 26m 41s. Rate: 9.4 symbols/min [2025-09-16T18:44:05.180045] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-09-16T18:44:05.280354] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:44:05.317747] [DEBUG] [LOCAL ] GXO: Loaded 34160 existing records from primary storage. [2025-09-16T18:44:05.317966] [INFO ] [MAIN ] GXO: Loaded 34160 existing records. [2025-09-16T18:44:05.507910] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:44:05.508242] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-09-16T18:44:05.508294] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-09-16T18:44:05.509259] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-09-16T18:44:05.509316] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-09-16T18:44:05.847386] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-16T18:44:05.920562] [INFO ] [REMOTE ] GXO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:44:05.974918] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-09-16T18:44:06.724286] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-16T18:44:06.774867] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-09-16T18:44:07.206708] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-16T18:44:07.575002] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-09-16T18:44:08.311880] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-16T18:44:08.374948] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-09-16T18:44:08.680371] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-16T18:44:09.174914] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-09-16T18:44:09.318771] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-16T18:44:09.321075] [INFO ] [REMOTE ] GWH: Full fetch complete (16285 records). [2025-09-16T18:44:09.321177] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-09-16T18:44:09.694033] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-09-16T18:44:09.694129] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-09-16T18:44:09.694553] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-09-16T18:44:09.694611] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-09-16T18:44:09.695492] [DEBUG] [LOCAL ] GWH: Trimmed 16285 records to 12976 (keeping 150 days of data) [2025-09-16T18:44:09.770888] [DEBUG] [LOCAL ] GWH: Primary data saved (12976 records). [2025-09-16T18:44:09.771034] [INFO ] [MAIN ] GWH: Full history saved. [2025-09-16T18:44:09.771118] [INFO ] [MAIN ] Update Progress: 984/2369 symbols completed. GWH took 27.2s. Estimated remaining: 2h 26m 32s. Rate: 9.5 symbols/min [2025-09-16T18:44:09.948697] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:44:09.951694] [DEBUG] [LOCAL ] GYLD: Loaded 1104 existing records from primary storage. [2025-09-16T18:44:09.951764] [INFO ] [MAIN ] GYLD: Loaded 1104 existing records. [2025-09-16T18:44:09.982352] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-09-16T18:44:10.136942] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:44:10.137224] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-09-16T18:44:10.137273] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-09-16T18:44:10.137466] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-09-16T18:44:10.137510] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-09-16T18:44:10.508931] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:44:10.563050] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-16T18:44:10.774959] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-09-16T18:44:11.238193] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-16T18:44:11.574908] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-09-16T18:44:11.773826] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-16T18:44:12.040288] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-16T18:44:12.374926] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-09-16T18:44:12.857284] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-16T18:44:13.174912] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-09-16T18:44:13.535627] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-16T18:44:13.974941] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-09-16T18:44:14.774897] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-09-16T18:44:15.305591] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-16T18:44:15.574911] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-09-16T18:44:16.374937] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-09-16T18:44:16.751208] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-16T18:44:17.062901] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-16T18:44:17.174915] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-09-16T18:44:17.193755] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-16T18:44:17.610214] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-16T18:44:17.974904] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-09-16T18:44:18.774933] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-09-16T18:44:18.942238] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-16T18:44:19.574971] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-09-16T18:44:20.070783] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-16T18:44:20.347813] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-16T18:44:20.356007] [INFO ] [REMOTE ] GWRE: Full fetch complete (45395 records). [2025-09-16T18:44:20.356240] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-09-16T18:44:20.380128] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-09-16T18:44:20.772612] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-09-16T18:44:20.772740] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-09-16T18:44:20.773553] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-09-16T18:44:20.773612] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-09-16T18:44:20.775003] [DEBUG] [LOCAL ] GWRE: Trimmed 45395 records to 30089 (keeping 150 days of data) [2025-09-16T18:44:20.960959] [DEBUG] [LOCAL ] GWRE: Primary data saved (30089 records). [2025-09-16T18:44:20.961116] [INFO ] [MAIN ] GWRE: Full history saved. [2025-09-16T18:44:20.961227] [INFO ] [MAIN ] Update Progress: 985/2369 symbols completed. GWRE took 24.0s. Estimated remaining: 2h 26m 33s. Rate: 9.4 symbols/min [2025-09-16T18:44:21.145847] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:44:21.179371] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-09-16T18:44:21.180045] [DEBUG] [LOCAL ] H: Loaded 32936 existing records from primary storage. [2025-09-16T18:44:21.180952] [INFO ] [MAIN ] H: Loaded 32936 existing records. [2025-09-16T18:44:21.372586] [WARN ] [MAIN ] H: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:44:21.372890] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-09-16T18:44:21.372950] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-09-16T18:44:21.373830] [DEBUG] [LOCAL ] H: Deleted primary data file. [2025-09-16T18:44:21.373897] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-09-16T18:44:21.783523] [INFO ] [REMOTE ] H: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:44:21.974937] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-09-16T18:44:22.149672] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-16T18:44:22.350212] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-16T18:44:22.562305] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-16T18:44:22.774902] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-09-16T18:44:23.246011] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-16T18:44:23.246905] [INFO ] [REMOTE ] GYLD: Full fetch complete (1630 records). [2025-09-16T18:44:23.246985] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-09-16T18:44:23.584506] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-09-16T18:44:23.616512] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-09-16T18:44:23.616609] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-09-16T18:44:23.616739] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-09-16T18:44:23.616791] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-09-16T18:44:23.617157] [DEBUG] [LOCAL ] GYLD: Trimmed 1630 records to 1117 (keeping 150 days of data) [2025-09-16T18:44:23.625006] [DEBUG] [LOCAL ] GYLD: Primary data saved (1117 records). [2025-09-16T18:44:23.625098] [INFO ] [MAIN ] GYLD: Full history saved. [2025-09-16T18:44:23.625199] [INFO ] [MAIN ] Update Progress: 986/2369 symbols completed. GYLD took 13.9s. Estimated remaining: 2h 26m 21s. Rate: 9.4 symbols/min [2025-09-16T18:44:23.806519] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:44:23.834068] [DEBUG] [LOCAL ] HAE: Loaded 27848 existing records from primary storage. [2025-09-16T18:44:23.834218] [INFO ] [MAIN ] HAE: Loaded 27848 existing records. [2025-09-16T18:44:24.029009] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:44:24.029270] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-09-16T18:44:24.029315] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-09-16T18:44:24.030003] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-09-16T18:44:24.030052] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-09-16T18:44:24.380117] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-09-16T18:44:24.410940] [INFO ] [REMOTE ] HAE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:44:24.819968] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-16T18:44:25.174982] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-09-16T18:44:25.974910] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-09-16T18:44:26.035759] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-16T18:44:26.675243] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-16T18:44:26.774869] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-09-16T18:44:27.102490] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-16T18:44:27.105508] [INFO ] [REMOTE ] GWW: Full fetch complete (21835 records). [2025-09-16T18:44:27.105605] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-09-16T18:44:27.490829] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-09-16T18:44:27.490913] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-09-16T18:44:27.491379] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-09-16T18:44:27.491421] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-09-16T18:44:27.492214] [DEBUG] [LOCAL ] GWW: Trimmed 21835 records to 14090 (keeping 150 days of data) [2025-09-16T18:44:27.575386] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-09-16T18:44:27.589340] [DEBUG] [LOCAL ] GWW: Primary data saved (14090 records). [2025-09-16T18:44:27.589442] [INFO ] [MAIN ] GWW: Full history saved. [2025-09-16T18:44:27.589535] [INFO ] [MAIN ] Update Progress: 987/2369 symbols completed. GWW took 27.8s. Estimated remaining: 2h 26m 12s. Rate: 9.5 symbols/min [2025-09-16T18:44:27.761795] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:44:27.793942] [DEBUG] [LOCAL ] HAFN: Loaded 31519 existing records from primary storage. [2025-09-16T18:44:27.794097] [INFO ] [MAIN ] HAFN: Loaded 31519 existing records. [2025-09-16T18:44:27.974418] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:44:27.974694] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-09-16T18:44:27.974742] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-09-16T18:44:27.975558] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-09-16T18:44:27.975606] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-09-16T18:44:28.339225] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:44:28.374880] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-09-16T18:44:28.444839] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-16T18:44:29.173570] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-16T18:44:29.177040] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-09-16T18:44:29.974901] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-09-16T18:44:30.236785] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-16T18:44:30.774889] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-09-16T18:44:30.895436] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-16T18:44:31.574922] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-09-16T18:44:31.605724] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-16T18:44:31.940214] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-16T18:44:32.374907] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-09-16T18:44:33.070899] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-16T18:44:33.174884] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-09-16T18:44:33.606037] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-16T18:44:33.974915] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-09-16T18:44:34.678338] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-16T18:44:34.774892] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-09-16T18:44:35.516953] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-16T18:44:35.574860] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-09-16T18:44:36.380222] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-09-16T18:44:36.386188] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-16T18:44:36.851836] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-16T18:44:37.174902] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-09-16T18:44:37.803604] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-16T18:44:37.974902] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-09-16T18:44:38.332975] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-16T18:44:38.774920] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-09-16T18:44:39.103901] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-16T18:44:39.574910] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-09-16T18:44:40.318992] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-16T18:44:40.374898] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-09-16T18:44:40.761702] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-16T18:44:41.174900] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-09-16T18:44:41.426553] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-16T18:44:41.974898] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-09-16T18:44:42.635840] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-16T18:44:42.774899] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-09-16T18:44:43.531846] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-16T18:44:43.537348] [INFO ] [REMOTE ] GXO: Full fetch complete (52490 records). [2025-09-16T18:44:43.537495] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-09-16T18:44:43.580031] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-09-16T18:44:43.923460] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-09-16T18:44:43.923539] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-09-16T18:44:43.924300] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-09-16T18:44:43.924355] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-09-16T18:44:43.926401] [DEBUG] [LOCAL ] GXO: Trimmed 52490 records to 34488 (keeping 150 days of data) [2025-09-16T18:44:44.128918] [DEBUG] [LOCAL ] GXO: Primary data saved (34488 records). [2025-09-16T18:44:44.129057] [INFO ] [MAIN ] GXO: Full history saved. [2025-09-16T18:44:44.129159] [INFO ] [MAIN ] Update Progress: 988/2369 symbols completed. GXO took 39.0s. Estimated remaining: 2h 26m 19s. Rate: 9.4 symbols/min [2025-09-16T18:44:44.305702] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:44:44.346922] [DEBUG] [LOCAL ] HAL: Loaded 39678 existing records from primary storage. [2025-09-16T18:44:44.347088] [INFO ] [MAIN ] HAL: Loaded 39678 existing records. [2025-09-16T18:44:44.379941] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-09-16T18:44:44.528724] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:44:44.529088] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-09-16T18:44:44.529336] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-09-16T18:44:44.538849] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-09-16T18:44:44.552470] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-09-16T18:44:44.602858] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-16T18:44:44.919407] [INFO ] [REMOTE ] HAL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:44:45.174889] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-09-16T18:44:45.301924] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-16T18:44:45.307513] [INFO ] [REMOTE ] H: Full fetch complete (49142 records). [2025-09-16T18:44:45.307621] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-09-16T18:44:45.693260] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-09-16T18:44:45.693369] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-09-16T18:44:45.694203] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-09-16T18:44:45.694272] [DEBUG] [LOCAL ] H: Saving primary data. [2025-09-16T18:44:45.696348] [DEBUG] [LOCAL ] H: Trimmed 49142 records to 33240 (keeping 150 days of data) [2025-09-16T18:44:45.917472] [DEBUG] [LOCAL ] H: Primary data saved (33240 records). [2025-09-16T18:44:45.917734] [INFO ] [MAIN ] H: Full history saved. [2025-09-16T18:44:45.917929] [INFO ] [MAIN ] Update Progress: 989/2369 symbols completed. H took 25.0s. Estimated remaining: 2h 26m 7s. Rate: 9.4 symbols/min [2025-09-16T18:44:45.975008] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-09-16T18:44:46.052136] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-16T18:44:46.132174] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:44:46.171390] [DEBUG] [LOCAL ] HASI: Loaded 35139 existing records from primary storage. [2025-09-16T18:44:46.171547] [INFO ] [MAIN ] HASI: Loaded 35139 existing records. [2025-09-16T18:44:46.356749] [WARN ] [MAIN ] HASI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:44:46.357040] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-09-16T18:44:46.357088] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-09-16T18:44:46.357869] [DEBUG] [LOCAL ] HASI: Deleted primary data file. [2025-09-16T18:44:46.357928] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-09-16T18:44:46.723276] [INFO ] [REMOTE ] HASI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:44:46.774899] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-09-16T18:44:46.998926] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-16T18:44:47.397415] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-16T18:44:47.574910] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-09-16T18:44:48.374958] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-09-16T18:44:48.413595] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-16T18:44:48.419273] [INFO ] [REMOTE ] HAE: Full fetch complete (43903 records). [2025-09-16T18:44:48.419428] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-09-16T18:44:48.799087] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-09-16T18:44:48.799184] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-09-16T18:44:48.799850] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-09-16T18:44:48.799894] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-09-16T18:44:48.800941] [DEBUG] [LOCAL ] HAE: Trimmed 43903 records to 28192 (keeping 150 days of data) [2025-09-16T18:44:48.968362] [DEBUG] [LOCAL ] HAE: Primary data saved (28192 records). [2025-09-16T18:44:48.968501] [INFO ] [MAIN ] HAE: Full history saved. [2025-09-16T18:44:48.968602] [INFO ] [MAIN ] Update Progress: 990/2369 symbols completed. HAE took 25.3s. Estimated remaining: 2h 25m 56s. Rate: 9.4 symbols/min [2025-09-16T18:44:49.139175] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:44:49.168057] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-16T18:44:49.176752] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-09-16T18:44:49.207803] [DEBUG] [LOCAL ] HAYW: Loaded 35753 existing records from primary storage. [2025-09-16T18:44:49.207952] [INFO ] [MAIN ] HAYW: Loaded 35753 existing records. [2025-09-16T18:44:49.385991] [WARN ] [MAIN ] HAYW: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:44:49.386229] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-09-16T18:44:49.386286] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-09-16T18:44:49.387078] [DEBUG] [LOCAL ] HAYW: Deleted primary data file. [2025-09-16T18:44:49.387135] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-09-16T18:44:49.736936] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:44:49.959873] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-16T18:44:49.974846] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-09-16T18:44:50.777210] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-09-16T18:44:50.783324] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-16T18:44:51.398555] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-16T18:44:51.574885] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-09-16T18:44:52.281664] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-16T18:44:52.286713] [INFO ] [REMOTE ] HAFN: Full fetch complete (48287 records). [2025-09-16T18:44:52.286814] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-09-16T18:44:52.381608] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-09-16T18:44:52.669397] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-09-16T18:44:52.669481] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-09-16T18:44:52.670175] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-09-16T18:44:52.670219] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-09-16T18:44:52.671321] [DEBUG] [LOCAL ] HAFN: Trimmed 48287 records to 31774 (keeping 150 days of data) [2025-09-16T18:44:52.861630] [DEBUG] [LOCAL ] HAFN: Primary data saved (31774 records). [2025-09-16T18:44:52.861779] [INFO ] [MAIN ] HAFN: Full history saved. [2025-09-16T18:44:52.861871] [INFO ] [MAIN ] Update Progress: 991/2369 symbols completed. HAFN took 25.3s. Estimated remaining: 2h 25m 46s. Rate: 9.5 symbols/min [2025-09-16T18:44:53.030669] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:44:53.030840] [DEBUG] [LOCAL ] HBB: No existing data file found in primary storage. [2025-09-16T18:44:53.030879] [WARN ] [MAIN ] HBB: No existing data found, performing full refresh instead. [2025-09-16T18:44:53.030994] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-09-16T18:44:53.031033] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-09-16T18:44:53.031074] [DEBUG] [LOCAL ] HBB: No primary data file found to delete. [2025-09-16T18:44:53.031107] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-09-16T18:44:53.179955] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-09-16T18:44:53.383114] [INFO ] [REMOTE ] HBB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:44:53.591341] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-16T18:44:53.974906] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-09-16T18:44:54.240584] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-16T18:44:54.774914] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-09-16T18:44:54.940789] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-16T18:44:55.251051] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-16T18:44:55.574879] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-09-16T18:44:55.822322] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-16T18:44:56.271947] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-16T18:44:56.374889] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-09-16T18:44:57.174919] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-09-16T18:44:57.974880] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-09-16T18:44:58.032784] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-16T18:44:58.774913] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-09-16T18:44:59.318608] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-16T18:44:59.368185] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-16T18:44:59.574907] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-09-16T18:45:00.240921] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-16T18:45:00.374994] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-09-16T18:45:01.174964] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-09-16T18:45:01.401023] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-16T18:45:01.651037] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-16T18:45:01.974988] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-09-16T18:45:02.774985] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-09-16T18:45:02.792358] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-16T18:45:02.974193] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-16T18:45:03.574901] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-09-16T18:45:04.374956] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-09-16T18:45:04.637031] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-16T18:45:05.174924] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-09-16T18:45:05.386261] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-16T18:45:05.948229] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-16T18:45:05.974870] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-09-16T18:45:06.779987] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-09-16T18:45:06.796165] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-16T18:45:07.574909] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-09-16T18:45:07.854017] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-16T18:45:07.860463] [INFO ] [REMOTE ] HAL: Full fetch complete (58398 records). [2025-09-16T18:45:07.860588] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-09-16T18:45:08.273104] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-09-16T18:45:08.273201] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-09-16T18:45:08.274023] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-09-16T18:45:08.274181] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-09-16T18:45:08.275753] [DEBUG] [LOCAL ] HAL: Trimmed 58398 records to 40068 (keeping 150 days of data) [2025-09-16T18:45:08.374894] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-09-16T18:45:08.408558] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-16T18:45:08.592754] [DEBUG] [LOCAL ] HAL: Primary data saved (40068 records). [2025-09-16T18:45:08.592953] [INFO ] [MAIN ] HAL: Full history saved. [2025-09-16T18:45:08.593105] [INFO ] [MAIN ] Update Progress: 992/2369 symbols completed. HAL took 24.5s. Estimated remaining: 2h 25m 53s. Rate: 9.4 symbols/min [2025-09-16T18:45:08.786795] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:45:08.842778] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-16T18:45:08.868893] [DEBUG] [LOCAL ] HBI: Loaded 39082 existing records from primary storage. [2025-09-16T18:45:08.869076] [INFO ] [MAIN ] HBI: Loaded 39082 existing records. [2025-09-16T18:45:09.057519] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:45:09.057929] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-09-16T18:45:09.057987] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-09-16T18:45:09.058937] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-09-16T18:45:09.059002] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-09-16T18:45:09.163717] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-16T18:45:09.175078] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-09-16T18:45:09.447121] [INFO ] [REMOTE ] HBI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:45:09.974937] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-09-16T18:45:10.602811] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-16T18:45:10.636798] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-16T18:45:10.774928] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-09-16T18:45:11.490189] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-16T18:45:11.574920] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-09-16T18:45:12.182957] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-16T18:45:12.184341] [INFO ] [REMOTE ] HBB: Full fetch complete (7576 records). [2025-09-16T18:45:12.184446] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-09-16T18:45:12.383268] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-09-16T18:45:12.555167] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present. [2025-09-16T18:45:12.555246] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed. [2025-09-16T18:45:12.555436] [INFO ] [MAIN ] HBB: Fetched primary data is valid. [2025-09-16T18:45:12.555475] [DEBUG] [LOCAL ] HBB: Saving primary data. [2025-09-16T18:45:12.555899] [DEBUG] [LOCAL ] HBB: Trimmed 7576 records to 4754 (keeping 150 days of data) [2025-09-16T18:45:12.585564] [DEBUG] [LOCAL ] HBB: Primary data saved (4754 records). [2025-09-16T18:45:12.585678] [INFO ] [MAIN ] HBB: Full history saved. [2025-09-16T18:45:12.585753] [INFO ] [MAIN ] Update Progress: 993/2369 symbols completed. HBB took 19.7s. Estimated remaining: 2h 25m 43s. Rate: 9.4 symbols/min [2025-09-16T18:45:12.774627] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:45:12.817798] [DEBUG] [LOCAL ] HBM: Loaded 38996 existing records from primary storage. [2025-09-16T18:45:12.817954] [INFO ] [MAIN ] HBM: Loaded 38996 existing records. [2025-09-16T18:45:13.015020] [WARN ] [MAIN ] HBM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:45:13.015292] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-09-16T18:45:13.015339] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-09-16T18:45:13.016342] [DEBUG] [LOCAL ] HBM: Deleted primary data file. [2025-09-16T18:45:13.016399] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-09-16T18:45:13.176597] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-09-16T18:45:13.382239] [INFO ] [REMOTE ] HBM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:45:13.977747] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-09-16T18:45:14.619182] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-09-16T18:45:14.774992] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-09-16T18:45:14.988629] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-16T18:45:14.995599] [INFO ] [REMOTE ] HAYW: Full fetch complete (52687 records). [2025-09-16T18:45:14.995809] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-09-16T18:45:14.996811] [FATAL] [VALIDATOR ] HAYW: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:45:14.996901] [FATAL] [MAIN ] HAYW: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:45:14.996958] [WARN ] [MAIN ] HAYW: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:45:14.997028] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-09-16T18:45:14.997113] [DEBUG] [LOCAL ] HAYW: No primary data file found to delete. [2025-09-16T18:45:14.997163] [INFO ] [LOCAL ] HAYW: Starting deletion of derivative data. [2025-09-16T18:45:14.997558] [DEBUG] [LOCAL ] HAYW: Deleted derivative data file. [2025-09-16T18:45:14.999203] [INFO ] [MAIN ] Update Progress: 994/2369 symbols completed. HAYW took 26.0s. Estimated remaining: 2h 25m 31s. Rate: 9.4 symbols/min [2025-09-16T18:45:15.185371] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:45:15.200941] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-16T18:45:15.206399] [INFO ] [REMOTE ] HASI: Full fetch complete (51041 records). [2025-09-16T18:45:15.206517] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-09-16T18:45:15.207424] [FATAL] [VALIDATOR ] HASI: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:45:15.207519] [FATAL] [MAIN ] HASI: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:45:15.207558] [WARN ] [MAIN ] HASI: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:45:15.207606] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-09-16T18:45:15.207714] [DEBUG] [LOCAL ] HASI: No primary data file found to delete. [2025-09-16T18:45:15.207756] [INFO ] [LOCAL ] HASI: Starting deletion of derivative data. [2025-09-16T18:45:15.208016] [DEBUG] [LOCAL ] HASI: Deleted derivative data file. [2025-09-16T18:45:15.208107] [INFO ] [MAIN ] Update Progress: 995/2369 symbols completed. HASI took 29.3s. Estimated remaining: 2h 25m 16s. Rate: 9.5 symbols/min [2025-09-16T18:45:15.399493] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:45:15.410817] [DEBUG] [LOCAL ] HCA: Loaded 34822 existing records from primary storage. [2025-09-16T18:45:15.410967] [INFO ] [MAIN ] HCA: Loaded 34822 existing records. [2025-09-16T18:45:15.583453] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-09-16T18:45:15.611985] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:45:15.613117] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-09-16T18:45:15.613177] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-09-16T18:45:15.614125] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-09-16T18:45:15.614224] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-09-16T18:45:15.732318] [DEBUG] [LOCAL ] HCC: Loaded 33376 existing records from primary storage. [2025-09-16T18:45:15.748057] [INFO ] [MAIN ] HCC: Loaded 33376 existing records. [2025-09-16T18:45:16.165908] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:45:16.197174] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-09-16T18:45:16.221290] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-09-16T18:45:16.221103] [INFO ] [REMOTE ] HCA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:45:16.222161] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-09-16T18:45:16.222282] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-09-16T18:45:16.377155] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-09-16T18:45:16.570664] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-16T18:45:16.706379] [INFO ] [REMOTE ] HCC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:45:17.174934] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-09-16T18:45:17.574487] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-16T18:45:17.974959] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-09-16T18:45:18.445179] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-16T18:45:18.558870] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-16T18:45:18.774943] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-09-16T18:45:19.386593] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-16T18:45:19.574919] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-09-16T18:45:20.374906] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-09-16T18:45:20.529477] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-16T18:45:21.174907] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-09-16T18:45:21.404322] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-16T18:45:21.974926] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-09-16T18:45:22.370148] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-16T18:45:22.774919] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-09-16T18:45:23.242249] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-16T18:45:23.574963] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-09-16T18:45:23.635212] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-16T18:45:24.374917] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-09-16T18:45:24.440314] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-16T18:45:25.174905] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-09-16T18:45:25.346122] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-16T18:45:25.974928] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-09-16T18:45:26.015060] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-16T18:45:26.774914] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-09-16T18:45:27.002488] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-16T18:45:27.567052] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-16T18:45:27.576569] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-09-16T18:45:28.374916] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-09-16T18:45:28.804887] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-16T18:45:29.174878] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-09-16T18:45:29.263032] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-16T18:45:29.779287] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-16T18:45:29.974871] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-09-16T18:45:30.774926] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-09-16T18:45:30.932568] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-16T18:45:31.575045] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-09-16T18:45:31.788323] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-16T18:45:32.374927] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-09-16T18:45:32.688399] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-16T18:45:33.174902] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-09-16T18:45:33.365126] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-16T18:45:33.974915] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-09-16T18:45:34.048889] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-16T18:45:34.055251] [INFO ] [REMOTE ] HBI: Full fetch complete (57723 records). [2025-09-16T18:45:34.055370] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-09-16T18:45:34.462672] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-09-16T18:45:34.462784] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-09-16T18:45:34.463557] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-09-16T18:45:34.463601] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-09-16T18:45:34.464831] [DEBUG] [LOCAL ] HBI: Trimmed 57723 records to 39471 (keeping 150 days of data) [2025-09-16T18:45:34.693148] [DEBUG] [LOCAL ] HBI: Primary data saved (39471 records). [2025-09-16T18:45:34.693310] [INFO ] [MAIN ] HBI: Full history saved. [2025-09-16T18:45:34.693430] [INFO ] [MAIN ] Update Progress: 996/2369 symbols completed. HBI took 26.1s. Estimated remaining: 2h 25m 28s. Rate: 9.4 symbols/min [2025-09-16T18:45:34.785805] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-09-16T18:45:34.868622] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:45:34.886197] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-16T18:45:34.894617] [INFO ] [REMOTE ] HBM: Full fetch complete (57559 records). [2025-09-16T18:45:34.894768] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-09-16T18:45:34.980579] [DEBUG] [LOCAL ] HCI: Loaded 10345 existing records from primary storage. [2025-09-16T18:45:35.004194] [INFO ] [MAIN ] HCI: Loaded 10345 existing records. [2025-09-16T18:45:35.347742] [WARN ] [MAIN ] HCI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:45:35.386875] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-09-16T18:45:35.399411] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-09-16T18:45:35.405159] [DEBUG] [LOCAL ] HCI: Deleted primary data file. [2025-09-16T18:45:35.415418] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-09-16T18:45:35.596733] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-09-16T18:45:35.617761] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-09-16T18:45:35.697537] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-09-16T18:45:35.732866] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-09-16T18:45:35.788627] [DEBUG] [LOCAL ] HBM: Trimmed 57559 records to 39386 (keeping 150 days of data) [2025-09-16T18:45:35.926145] [INFO ] [REMOTE ] HCI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:45:35.952832] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-09-16T18:45:35.989621] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-16T18:45:36.141816] [DEBUG] [LOCAL ] HBM: Primary data saved (39386 records). [2025-09-16T18:45:36.141958] [INFO ] [MAIN ] HBM: Full history saved. [2025-09-16T18:45:36.142060] [INFO ] [MAIN ] Update Progress: 997/2369 symbols completed. HBM took 23.6s. Estimated remaining: 2h 25m 15s. Rate: 9.4 symbols/min [2025-09-16T18:45:36.374884] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-09-16T18:45:36.452474] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-16T18:45:36.789481] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-16T18:45:37.174903] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-09-16T18:45:37.974893] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-09-16T18:45:38.123046] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-16T18:45:38.128393] [INFO ] [REMOTE ] HCA: Full fetch complete (51787 records). [2025-09-16T18:45:38.128485] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-09-16T18:45:38.515629] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-09-16T18:45:38.515770] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-09-16T18:45:38.516551] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-09-16T18:45:38.516596] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-09-16T18:45:38.517686] [DEBUG] [LOCAL ] HCA: Trimmed 51787 records to 35145 (keeping 150 days of data) [2025-09-16T18:45:38.740594] [DEBUG] [LOCAL ] HCA: Primary data saved (35145 records). [2025-09-16T18:45:38.740755] [INFO ] [MAIN ] HCA: Full history saved. [2025-09-16T18:45:38.741424] [INFO ] [MAIN ] Update Progress: 998/2369 symbols completed. HCA took 23.7s. Estimated remaining: 2h 25m 4s. Rate: 9.5 symbols/min [2025-09-16T18:45:38.765041] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-16T18:45:38.774832] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-09-16T18:45:38.827070] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-16T18:45:39.574951] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-09-16T18:45:40.256043] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-16T18:45:40.374889] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-09-16T18:45:40.558805] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-16T18:45:41.174898] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-09-16T18:45:41.903491] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-16T18:45:41.974952] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-09-16T18:45:42.065857] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-16T18:45:42.774945] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-09-16T18:45:43.194040] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-16T18:45:43.199354] [INFO ] [REMOTE ] HCC: Full fetch complete (49520 records). [2025-09-16T18:45:43.199456] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-09-16T18:45:43.590953] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-09-16T18:45:43.591049] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-09-16T18:45:43.591793] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-09-16T18:45:43.591841] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-09-16T18:45:43.593111] [DEBUG] [LOCAL ] HCC: Trimmed 49520 records to 33661 (keeping 150 days of data) [2025-09-16T18:45:43.804141] [DEBUG] [LOCAL ] HCC: Primary data saved (33661 records). [2025-09-16T18:45:43.804304] [INFO ] [MAIN ] HCC: Full history saved. [2025-09-16T18:45:43.804411] [INFO ] [MAIN ] Update Progress: 999/2369 symbols completed. HCC took 28.6s. Estimated remaining: 2h 24m 55s. Rate: 9.5 symbols/min [2025-09-16T18:45:43.814417] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-16T18:45:43.818409] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-09-16T18:45:44.955036] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-16T18:45:44.959137] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-09-16T18:45:45.958118] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-16T18:45:45.961483] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-09-16T18:45:46.695914] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-16T18:45:46.697916] [INFO ] [REMOTE ] HCI: Full fetch complete (14902 records). [2025-09-16T18:45:46.697984] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-09-16T18:45:46.698376] [FATAL] [VALIDATOR ] HCI: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:45:46.698467] [FATAL] [MAIN ] HCI: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:45:46.698504] [WARN ] [MAIN ] HCI: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:45:46.698540] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-09-16T18:45:46.698595] [DEBUG] [LOCAL ] HCI: No primary data file found to delete. [2025-09-16T18:45:46.698631] [INFO ] [LOCAL ] HCI: Starting deletion of derivative data. [2025-09-16T18:45:46.698991] [DEBUG] [LOCAL ] HCI: Deleted derivative data file. [2025-09-16T18:45:46.699068] [INFO ] [MAIN ] Update Progress: 1000/2369 symbols completed. HCI took 12.0s. Estimated remaining: 2h 24m 44s. Rate: 9.5 symbols/min [2025-09-16T18:45:47.204153] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:45:47.412904] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:45:47.416591] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:45:47.417905] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:45:47.418462] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-09-16T18:45:47.418729] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-09-16T18:45:47.422140] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-09-16T18:45:47.422289] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-16T18:45:47.422350] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-16T18:45:47.422394] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-09-16T18:45:47.750628] [DEBUG] [LOCAL ] HD: Loaded 39510 existing records from primary storage. [2025-09-16T18:45:47.783202] [DEBUG] [LOCAL ] HE: Loaded 35907 existing records from primary storage. [2025-09-16T18:45:47.781209] [INFO ] [MAIN ] HD: Loaded 39510 existing records. [2025-09-16T18:45:47.794015] [INFO ] [MAIN ] HE: Loaded 35907 existing records. [2025-09-16T18:45:47.864016] [DEBUG] [LOCAL ] HDB: Loaded 38022 existing records from primary storage. [2025-09-16T18:45:47.981468] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:45:48.000828] [INFO ] [MAIN ] HDB: Loaded 38022 existing records. [2025-09-16T18:45:48.016538] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-09-16T18:45:48.309093] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:45:48.369931] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-09-16T18:45:48.338881] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:45:48.386777] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-09-16T18:45:48.407615] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-09-16T18:45:48.407495] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:45:48.407777] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-09-16T18:45:48.407954] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-09-16T18:45:48.408004] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-09-16T18:45:48.408603] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-09-16T18:45:48.408675] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-09-16T18:45:48.419707] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-09-16T18:45:48.419670] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-09-16T18:45:48.438994] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-09-16T18:45:48.462977] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-09-16T18:45:49.065280] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-16T18:45:49.113736] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-09-16T18:45:49.478301] [INFO ] [REMOTE ] HDB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:45:49.490788] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-09-16T18:45:49.490389] [INFO ] [REMOTE ] HE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:45:49.542891] [INFO ] [REMOTE ] HD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:45:49.544214] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-09-16T18:45:49.543897] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-09-16T18:45:49.641874] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-16T18:45:49.974918] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-09-16T18:45:50.804038] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-16T18:45:50.804890] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-09-16T18:45:51.121451] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-16T18:45:51.575017] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-09-16T18:45:51.716029] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-09-16T18:45:51.795353] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-09-16T18:45:51.831320] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-16T18:45:51.840280] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-09-16T18:45:52.374951] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-09-16T18:45:53.174965] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-09-16T18:45:53.974922] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-09-16T18:45:54.215914] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-09-16T18:45:54.542672] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-16T18:45:54.774937] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-09-16T18:45:55.031269] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-16T18:45:55.112245] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-16T18:45:55.574926] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-09-16T18:45:56.134272] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-16T18:45:56.134951] [INFO ] [REMOTE ] HCXY: Full fetch complete (385 records). [2025-09-16T18:45:56.135017] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-09-16T18:45:56.310518] [WARN ] [VALIDATOR ] HCXY: Validation failed - insufficient historical data. Have 119 unique days, need 150 days [2025-09-16T18:45:56.310754] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:45:56.310826] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:45:56.310901] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-16T18:45:56.310970] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-16T18:45:56.311007] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-09-16T18:45:56.311049] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-09-16T18:45:56.311121] [INFO ] [MAIN ] Update Progress: 1001/2369 symbols completed. HCXY took 9.6s. Estimated remaining: 2h 24m 43s. Rate: 9.5 symbols/min [2025-09-16T18:45:56.380066] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-09-16T18:45:56.483850] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:45:56.506535] [DEBUG] [LOCAL ] HEI: Loaded 23374 existing records from primary storage. [2025-09-16T18:45:56.506721] [INFO ] [MAIN ] HEI: Loaded 23374 existing records. [2025-09-16T18:45:56.681137] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:45:56.681396] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-09-16T18:45:56.681446] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-09-16T18:45:56.682008] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-09-16T18:45:56.682056] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-09-16T18:45:57.051422] [INFO ] [REMOTE ] HEI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:45:57.174888] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-09-16T18:45:57.974925] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-09-16T18:45:58.201989] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-16T18:45:58.357807] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-16T18:45:58.775005] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-09-16T18:45:59.574910] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-09-16T18:46:00.269942] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-16T18:46:00.374923] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-09-16T18:46:00.487734] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-16T18:46:01.174917] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-09-16T18:46:01.662957] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-16T18:46:01.974953] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-09-16T18:46:02.133482] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-16T18:46:02.774955] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-09-16T18:46:02.867089] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-16T18:46:03.574876] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-09-16T18:46:04.176048] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-16T18:46:04.374938] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-09-16T18:46:04.990410] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-16T18:46:05.099826] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-16T18:46:05.174941] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-09-16T18:46:05.974913] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-09-16T18:46:06.420744] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-16T18:46:06.774929] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-09-16T18:46:06.970270] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-16T18:46:07.574886] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-09-16T18:46:07.701897] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-16T18:46:08.374950] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-09-16T18:46:09.028883] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-16T18:46:09.067109] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-16T18:46:09.174938] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-09-16T18:46:09.798565] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-16T18:46:09.974905] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-09-16T18:46:10.774907] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-09-16T18:46:11.176844] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-16T18:46:11.534276] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-16T18:46:11.574882] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-09-16T18:46:12.060994] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-16T18:46:12.374913] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-09-16T18:46:13.174886] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-09-16T18:46:13.291394] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-16T18:46:13.793196] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-16T18:46:13.802546] [INFO ] [REMOTE ] HE: Full fetch complete (53920 records). [2025-09-16T18:46:13.802780] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-09-16T18:46:13.977181] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-09-16T18:46:14.182979] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-09-16T18:46:14.183068] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-09-16T18:46:14.183827] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-09-16T18:46:14.183895] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-09-16T18:46:14.185163] [DEBUG] [LOCAL ] HE: Trimmed 53920 records to 36245 (keeping 150 days of data) [2025-09-16T18:46:14.413327] [DEBUG] [LOCAL ] HE: Primary data saved (36245 records). [2025-09-16T18:46:14.413518] [INFO ] [MAIN ] HE: Full history saved. [2025-09-16T18:46:14.413660] [INFO ] [MAIN ] Update Progress: 1002/2369 symbols completed. HE took 27.7s. Estimated remaining: 2h 24m 52s. Rate: 9.4 symbols/min [2025-09-16T18:46:14.592453] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:46:14.598940] [DEBUG] [LOCAL ] HEQ: Loaded 4271 existing records from primary storage. [2025-09-16T18:46:14.599087] [INFO ] [MAIN ] HEQ: Loaded 4271 existing records. [2025-09-16T18:46:14.783047] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-09-16T18:46:14.782866] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:46:14.784575] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-09-16T18:46:14.784716] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-09-16T18:46:14.785163] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-09-16T18:46:14.785319] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-09-16T18:46:15.109153] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-16T18:46:15.206571] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:46:15.574918] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-09-16T18:46:16.255177] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-16T18:46:16.261537] [INFO ] [REMOTE ] HD: Full fetch complete (58182 records). [2025-09-16T18:46:16.261661] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-09-16T18:46:16.380023] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-09-16T18:46:16.487420] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-16T18:46:16.653522] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-09-16T18:46:16.653608] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-09-16T18:46:16.654426] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-09-16T18:46:16.654478] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-09-16T18:46:16.671429] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-16T18:46:16.677986] [DEBUG] [LOCAL ] HD: Trimmed 58182 records to 39898 (keeping 150 days of data) [2025-09-16T18:46:16.679321] [INFO ] [REMOTE ] HDB: Full fetch complete (56505 records). [2025-09-16T18:46:16.679409] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-09-16T18:46:17.169176] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-09-16T18:46:17.169678] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-09-16T18:46:17.171569] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-09-16T18:46:17.171870] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-09-16T18:46:17.176986] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-09-16T18:46:17.177832] [DEBUG] [LOCAL ] HDB: Trimmed 56505 records to 38408 (keeping 150 days of data) [2025-09-16T18:46:17.558878] [DEBUG] [LOCAL ] HDB: Primary data saved (38408 records). [2025-09-16T18:46:17.559002] [INFO ] [MAIN ] HDB: Full history saved. [2025-09-16T18:46:17.559985] [INFO ] [MAIN ] Update Progress: 1003/2369 symbols completed. HDB took 30.9s. Estimated remaining: 2h 24m 41s. Rate: 9.4 symbols/min [2025-09-16T18:46:17.558798] [DEBUG] [LOCAL ] HD: Primary data saved (39898 records). [2025-09-16T18:46:17.571623] [INFO ] [MAIN ] HD: Full history saved. [2025-09-16T18:46:17.603443] [INFO ] [MAIN ] Update Progress: 1004/2369 symbols completed. HD took 30.9s. Estimated remaining: 2h 24m 27s. Rate: 9.5 symbols/min [2025-09-16T18:46:17.850247] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:46:17.903466] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:46:17.903996] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-09-16T18:46:17.904043] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-09-16T18:46:17.904486] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-09-16T18:46:17.904606] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-16T18:46:17.904841] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-09-16T18:46:17.904881] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-09-16T18:46:18.012825] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-16T18:46:18.037746] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-09-16T18:46:18.139823] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-16T18:46:18.222827] [DEBUG] [LOCAL ] HESM: Loaded 35628 existing records from primary storage. [2025-09-16T18:46:18.244870] [INFO ] [MAIN ] HESM: Loaded 35628 existing records. [2025-09-16T18:46:18.473038] [INFO ] [REMOTE ] HF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:46:18.529989] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:46:18.530156] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-09-16T18:46:18.530200] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-09-16T18:46:18.530961] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-09-16T18:46:18.531011] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-09-16T18:46:18.780039] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-09-16T18:46:18.896043] [INFO ] [REMOTE ] HESM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:46:18.959178] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-16T18:46:19.282433] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-16T18:46:19.574907] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-09-16T18:46:20.374939] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-09-16T18:46:21.136612] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-16T18:46:21.174890] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-09-16T18:46:21.422319] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-16T18:46:21.974943] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-09-16T18:46:22.209952] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-09-16T18:46:22.773266] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-16T18:46:22.782552] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-09-16T18:46:23.574900] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-09-16T18:46:23.846777] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.27 seconds). [2025-09-16T18:46:24.155958] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-16T18:46:24.159791] [INFO ] [REMOTE ] HEI: Full fetch complete (36409 records). [2025-09-16T18:46:24.159922] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-09-16T18:46:24.383614] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-09-16T18:46:24.569404] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-09-16T18:46:24.569486] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-09-16T18:46:24.570186] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-09-16T18:46:24.570252] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-09-16T18:46:24.571473] [DEBUG] [LOCAL ] HEI: Trimmed 36409 records to 23607 (keeping 150 days of data) [2025-09-16T18:46:24.728049] [DEBUG] [LOCAL ] HEI: Primary data saved (23607 records). [2025-09-16T18:46:24.728197] [INFO ] [MAIN ] HEI: Full history saved. [2025-09-16T18:46:24.728300] [INFO ] [MAIN ] Update Progress: 1005/2369 symbols completed. HEI took 28.4s. Estimated remaining: 2h 24m 21s. Rate: 9.4 symbols/min [2025-09-16T18:46:24.896596] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:46:24.896827] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-09-16T18:46:24.896868] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-09-16T18:46:24.897034] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-09-16T18:46:24.897075] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-16T18:46:24.897116] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-09-16T18:46:24.897148] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-09-16T18:46:25.180041] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-09-16T18:46:25.262455] [INFO ] [REMOTE ] HFND: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:46:25.690128] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-16T18:46:25.981136] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-09-16T18:46:25.987459] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-16T18:46:26.482136] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-16T18:46:26.774989] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-09-16T18:46:27.444819] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-16T18:46:27.574944] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-09-16T18:46:28.374960] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-09-16T18:46:28.960883] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-16T18:46:29.174890] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-09-16T18:46:29.218718] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-16T18:46:29.408303] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-09-16T18:46:29.974927] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-09-16T18:46:30.229224] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-09-16T18:46:30.774911] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-09-16T18:46:31.010717] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-09-16T18:46:31.574901] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-09-16T18:46:32.009221] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-16T18:46:32.374925] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-09-16T18:46:32.813491] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-16T18:46:33.174977] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-09-16T18:46:33.974936] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-09-16T18:46:34.616597] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-16T18:46:34.737023] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-16T18:46:34.774843] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-09-16T18:46:35.574897] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-09-16T18:46:36.374904] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-09-16T18:46:36.404931] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-16T18:46:36.406791] [INFO ] [REMOTE ] HEQ: Full fetch complete (6532 records). [2025-09-16T18:46:36.406890] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-09-16T18:46:36.620739] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-09-16T18:46:36.804927] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-09-16T18:46:36.805129] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-09-16T18:46:36.805389] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-09-16T18:46:36.805517] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-09-16T18:46:36.806272] [DEBUG] [LOCAL ] HEQ: Trimmed 6532 records to 4338 (keeping 150 days of data) [2025-09-16T18:46:36.859836] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-16T18:46:36.876529] [DEBUG] [LOCAL ] HEQ: Primary data saved (4338 records). [2025-09-16T18:46:36.876690] [INFO ] [MAIN ] HEQ: Full history saved. [2025-09-16T18:46:36.876814] [INFO ] [MAIN ] Update Progress: 1006/2369 symbols completed. HEQ took 22.5s. Estimated remaining: 2h 24m 23s. Rate: 9.4 symbols/min [2025-09-16T18:46:37.054386] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:46:37.070007] [DEBUG] [LOCAL ] HFRO: Loaded 11867 existing records from primary storage. [2025-09-16T18:46:37.070173] [INFO ] [MAIN ] HFRO: Loaded 11867 existing records. [2025-09-16T18:46:37.179977] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-09-16T18:46:37.256439] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:46:37.256742] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-09-16T18:46:37.256814] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-09-16T18:46:37.257281] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-09-16T18:46:37.257345] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-09-16T18:46:37.599268] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-16T18:46:37.631296] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:46:37.974889] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-09-16T18:46:38.279224] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-16T18:46:38.774891] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-09-16T18:46:39.574902] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-09-16T18:46:39.980080] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-16T18:46:39.980790] [INFO ] [REMOTE ] HF: Full fetch complete (293 records). [2025-09-16T18:46:39.980871] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-09-16T18:46:40.161516] [WARN ] [VALIDATOR ] HF: Validation failed - insufficient historical data. Have 102 unique days, need 150 days [2025-09-16T18:46:40.161701] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:46:40.161771] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:46:40.161821] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-16T18:46:40.161880] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-09-16T18:46:40.161918] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-09-16T18:46:40.161973] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-09-16T18:46:40.162060] [INFO ] [MAIN ] Update Progress: 1007/2369 symbols completed. HF took 22.5s. Estimated remaining: 2h 24m 12s. Rate: 9.4 symbols/min [2025-09-16T18:46:40.333310] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:46:40.345859] [DEBUG] [LOCAL ] HGER: Loaded 9870 existing records from primary storage. [2025-09-16T18:46:40.346001] [INFO ] [MAIN ] HGER: Loaded 9870 existing records. [2025-09-16T18:46:40.379972] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-09-16T18:46:40.528565] [WARN ] [MAIN ] HGER: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:46:40.528839] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-09-16T18:46:40.528923] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-09-16T18:46:40.529373] [DEBUG] [LOCAL ] HGER: Deleted primary data file. [2025-09-16T18:46:40.529441] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-09-16T18:46:40.924199] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-16T18:46:40.928205] [INFO ] [REMOTE ] HGER: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:46:41.174864] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-09-16T18:46:41.220138] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-16T18:46:41.974916] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-09-16T18:46:42.774926] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-09-16T18:46:42.835862] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-16T18:46:42.842669] [INFO ] [REMOTE ] HESM: Full fetch complete (52499 records). [2025-09-16T18:46:42.842786] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-09-16T18:46:43.171487] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-16T18:46:43.246118] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-16T18:46:43.265572] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-09-16T18:46:43.265690] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-09-16T18:46:43.266456] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-09-16T18:46:43.266512] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-09-16T18:46:43.267771] [DEBUG] [LOCAL ] HESM: Trimmed 52499 records to 35958 (keeping 150 days of data) [2025-09-16T18:46:43.494744] [DEBUG] [LOCAL ] HESM: Primary data saved (35958 records). [2025-09-16T18:46:43.494904] [INFO ] [MAIN ] HESM: Full history saved. [2025-09-16T18:46:43.495025] [INFO ] [MAIN ] Update Progress: 1008/2369 symbols completed. HESM took 25.9s. Estimated remaining: 2h 24m 2s. Rate: 9.4 symbols/min [2025-09-16T18:46:43.579986] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-09-16T18:46:43.691221] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:46:43.700942] [DEBUG] [LOCAL ] HGLB: Loaded 6515 existing records from primary storage. [2025-09-16T18:46:43.701070] [INFO ] [MAIN ] HGLB: Loaded 6515 existing records. [2025-09-16T18:46:43.887583] [WARN ] [MAIN ] HGLB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:46:43.887840] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-09-16T18:46:43.887887] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-09-16T18:46:43.888149] [DEBUG] [LOCAL ] HGLB: Deleted primary data file. [2025-09-16T18:46:43.888205] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-09-16T18:46:44.261767] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:46:44.374926] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-09-16T18:46:44.472484] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-16T18:46:45.174949] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-09-16T18:46:45.246052] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-16T18:46:45.442943] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-09-16T18:46:45.974941] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-09-16T18:46:46.764008] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-16T18:46:46.774841] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-09-16T18:46:47.574942] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-09-16T18:46:47.659322] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-16T18:46:48.365967] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-16T18:46:48.374844] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-09-16T18:46:49.174901] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-09-16T18:46:49.268013] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-16T18:46:49.887921] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-16T18:46:49.974930] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-09-16T18:46:50.445738] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-16T18:46:50.774949] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-09-16T18:46:51.253069] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-16T18:46:51.254328] [INFO ] [REMOTE ] HFND: Full fetch complete (1349 records). [2025-09-16T18:46:51.254431] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-09-16T18:46:51.454418] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 146 unique days, need 150 days [2025-09-16T18:46:51.454604] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:46:51.454673] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:46:51.454732] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-16T18:46:51.454811] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-09-16T18:46:51.454856] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-09-16T18:46:51.454921] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-09-16T18:46:51.455015] [INFO ] [MAIN ] Update Progress: 1009/2369 symbols completed. HFND took 26.7s. Estimated remaining: 2h 23m 58s. Rate: 9.4 symbols/min [2025-09-16T18:46:51.580024] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-09-16T18:46:51.643198] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:46:51.657613] [DEBUG] [LOCAL ] HGTY: Loaded 9760 existing records from primary storage. [2025-09-16T18:46:51.657771] [INFO ] [MAIN ] HGTY: Loaded 9760 existing records. [2025-09-16T18:46:51.843788] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:46:51.844075] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-09-16T18:46:51.844125] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-09-16T18:46:51.844541] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-09-16T18:46:51.844589] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-09-16T18:46:52.202500] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:46:52.345950] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-16T18:46:52.374871] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-09-16T18:46:53.165074] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-16T18:46:53.174852] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-09-16T18:46:53.901332] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-16T18:46:53.974915] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-09-16T18:46:54.774929] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-09-16T18:46:54.838275] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-16T18:46:55.312262] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-16T18:46:55.574902] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-09-16T18:46:56.374901] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-09-16T18:46:56.432628] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-16T18:46:57.174892] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-09-16T18:46:57.234163] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-16T18:46:57.235991] [INFO ] [REMOTE ] HGLB: Full fetch complete (10784 records). [2025-09-16T18:46:57.236059] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-09-16T18:46:57.592145] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-09-16T18:46:57.592223] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-09-16T18:46:57.592474] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-09-16T18:46:57.592516] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-09-16T18:46:57.592983] [DEBUG] [LOCAL ] HGLB: Trimmed 10784 records to 6562 (keeping 150 days of data) [2025-09-16T18:46:57.633325] [DEBUG] [LOCAL ] HGLB: Primary data saved (6562 records). [2025-09-16T18:46:57.633435] [INFO ] [MAIN ] HGLB: Full history saved. [2025-09-16T18:46:57.633521] [INFO ] [MAIN ] Update Progress: 1010/2369 symbols completed. HGLB took 14.1s. Estimated remaining: 2h 23m 51s. Rate: 9.4 symbols/min [2025-09-16T18:46:57.804989] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:46:57.839938] [DEBUG] [LOCAL ] HGV: Loaded 34755 existing records from primary storage. [2025-09-16T18:46:57.840079] [INFO ] [MAIN ] HGV: Loaded 34755 existing records. [2025-09-16T18:46:57.980902] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-09-16T18:46:58.017510] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:46:58.017777] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-09-16T18:46:58.017823] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-09-16T18:46:58.018728] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-09-16T18:46:58.018779] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-09-16T18:46:58.389914] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-16T18:46:58.421918] [INFO ] [REMOTE ] HGV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:46:58.545670] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-16T18:46:58.774912] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-09-16T18:46:59.574944] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-09-16T18:46:59.647458] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-16T18:47:00.106442] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-16T18:47:00.374918] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-09-16T18:47:01.174869] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-09-16T18:47:01.453066] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-16T18:47:01.455980] [INFO ] [REMOTE ] HGER: Full fetch complete (12968 records). [2025-09-16T18:47:01.456110] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-09-16T18:47:01.832822] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-09-16T18:47:01.832906] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-09-16T18:47:01.833195] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-09-16T18:47:01.833266] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-09-16T18:47:01.833869] [DEBUG] [LOCAL ] HGER: Trimmed 12968 records to 9995 (keeping 150 days of data) [2025-09-16T18:47:01.898936] [DEBUG] [LOCAL ] HGER: Primary data saved (9995 records). [2025-09-16T18:47:01.899077] [INFO ] [MAIN ] HGER: Full history saved. [2025-09-16T18:47:01.899163] [INFO ] [MAIN ] Update Progress: 1011/2369 symbols completed. HGER took 21.7s. Estimated remaining: 2h 23m 42s. Rate: 9.5 symbols/min [2025-09-16T18:47:01.980038] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-09-16T18:47:02.076983] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:47:02.102521] [DEBUG] [LOCAL ] HHH: Loaded 25501 existing records from primary storage. [2025-09-16T18:47:02.102676] [INFO ] [MAIN ] HHH: Loaded 25501 existing records. [2025-09-16T18:47:02.277970] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:47:02.278176] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-09-16T18:47:02.278223] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-09-16T18:47:02.278910] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-09-16T18:47:02.278961] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-09-16T18:47:02.637337] [INFO ] [REMOTE ] HHH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:47:02.661609] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-16T18:47:02.774867] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-09-16T18:47:02.802554] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-16T18:47:03.574904] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-09-16T18:47:04.153007] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-16T18:47:04.346784] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-16T18:47:04.374919] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-09-16T18:47:05.174920] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-09-16T18:47:05.971185] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-16T18:47:05.980171] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-09-16T18:47:06.104694] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-16T18:47:06.774909] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-09-16T18:47:06.917424] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-16T18:47:07.574860] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-09-16T18:47:07.766414] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-16T18:47:08.374905] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-09-16T18:47:08.504109] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-16T18:47:09.174916] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-09-16T18:47:09.933906] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-16T18:47:09.948371] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-16T18:47:09.974848] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-09-16T18:47:10.774889] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-09-16T18:47:11.398965] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-16T18:47:11.574897] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-09-16T18:47:11.762882] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-16T18:47:12.230482] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-16T18:47:12.374931] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-09-16T18:47:13.174921] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-09-16T18:47:13.193968] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-16T18:47:13.974931] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-09-16T18:47:14.532688] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-16T18:47:14.774942] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-09-16T18:47:15.393625] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-16T18:47:15.538969] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-16T18:47:15.541599] [INFO ] [REMOTE ] HFRO: Full fetch complete (19681 records). [2025-09-16T18:47:15.541720] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-09-16T18:47:15.579998] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-09-16T18:47:15.917562] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-09-16T18:47:15.917656] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-09-16T18:47:15.918075] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-09-16T18:47:15.918115] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-09-16T18:47:15.918665] [DEBUG] [LOCAL ] HFRO: Trimmed 19681 records to 11949 (keeping 150 days of data) [2025-09-16T18:47:15.994600] [DEBUG] [LOCAL ] HFRO: Primary data saved (11949 records). [2025-09-16T18:47:15.994773] [INFO ] [MAIN ] HFRO: Full history saved. [2025-09-16T18:47:15.994878] [INFO ] [MAIN ] Update Progress: 1012/2369 symbols completed. HFRO took 39.1s. Estimated remaining: 2h 23m 46s. Rate: 9.4 symbols/min [2025-09-16T18:47:16.166585] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:47:16.191421] [DEBUG] [LOCAL ] HI: Loaded 25684 existing records from primary storage. [2025-09-16T18:47:16.191572] [INFO ] [MAIN ] HI: Loaded 25684 existing records. [2025-09-16T18:47:16.367487] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:47:16.367730] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-09-16T18:47:16.367777] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-09-16T18:47:16.368516] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-09-16T18:47:16.368565] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-09-16T18:47:16.381250] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-09-16T18:47:16.710154] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-16T18:47:16.734755] [INFO ] [REMOTE ] HI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:47:16.734916] [INFO ] [REMOTE ] HGTY: Full fetch complete (13217 records). [2025-09-16T18:47:16.735347] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-09-16T18:47:17.099455] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-09-16T18:47:17.099552] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-09-16T18:47:17.099912] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-09-16T18:47:17.099958] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-09-16T18:47:17.100470] [DEBUG] [LOCAL ] HGTY: Trimmed 13217 records to 10001 (keeping 150 days of data) [2025-09-16T18:47:17.163116] [DEBUG] [LOCAL ] HGTY: Primary data saved (10001 records). [2025-09-16T18:47:17.163271] [INFO ] [MAIN ] HGTY: Full history saved. [2025-09-16T18:47:17.163386] [INFO ] [MAIN ] Update Progress: 1013/2369 symbols completed. HGTY took 25.7s. Estimated remaining: 2h 23m 33s. Rate: 9.4 symbols/min [2025-09-16T18:47:17.185209] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-09-16T18:47:17.337515] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:47:17.381315] [DEBUG] [LOCAL ] HIG: Loaded 37942 existing records from primary storage. [2025-09-16T18:47:17.381460] [INFO ] [MAIN ] HIG: Loaded 37942 existing records. [2025-09-16T18:47:17.557253] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:47:17.557505] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-09-16T18:47:17.557558] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-09-16T18:47:17.558516] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-09-16T18:47:17.558570] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-09-16T18:47:17.954582] [INFO ] [REMOTE ] HIG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:47:17.974858] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-09-16T18:47:18.126333] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-16T18:47:18.704499] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-16T18:47:18.774859] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-09-16T18:47:19.338887] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-16T18:47:19.574985] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-09-16T18:47:20.218573] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-16T18:47:20.223126] [INFO ] [REMOTE ] HHH: Full fetch complete (36038 records). [2025-09-16T18:47:20.223268] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-09-16T18:47:20.386129] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-09-16T18:47:20.644503] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-09-16T18:47:20.644601] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-09-16T18:47:20.645309] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-09-16T18:47:20.645359] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-09-16T18:47:20.646582] [DEBUG] [LOCAL ] HHH: Trimmed 36038 records to 25732 (keeping 150 days of data) [2025-09-16T18:47:20.807800] [DEBUG] [LOCAL ] HHH: Primary data saved (25732 records). [2025-09-16T18:47:20.807962] [INFO ] [MAIN ] HHH: Full history saved. [2025-09-16T18:47:20.808061] [INFO ] [MAIN ] Update Progress: 1014/2369 symbols completed. HHH took 18.9s. Estimated remaining: 2h 23m 23s. Rate: 9.5 symbols/min [2025-09-16T18:47:20.981092] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:47:21.004245] [DEBUG] [LOCAL ] HII: Loaded 24141 existing records from primary storage. [2025-09-16T18:47:21.004394] [INFO ] [MAIN ] HII: Loaded 24141 existing records. [2025-09-16T18:47:21.185065] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-09-16T18:47:21.185429] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:47:21.186821] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-09-16T18:47:21.186885] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-09-16T18:47:21.211755] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-09-16T18:47:21.212117] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-09-16T18:47:21.219285] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-16T18:47:21.590471] [INFO ] [REMOTE ] HII: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:47:21.909915] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-16T18:47:21.974891] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-09-16T18:47:22.774942] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-09-16T18:47:23.057941] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-16T18:47:23.370632] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-16T18:47:23.574888] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-09-16T18:47:24.374953] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-09-16T18:47:24.425553] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-16T18:47:25.140411] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-16T18:47:25.174853] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-09-16T18:47:25.974921] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-09-16T18:47:26.211383] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-16T18:47:26.245998] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-16T18:47:26.774957] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-09-16T18:47:27.340821] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-16T18:47:27.574980] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-09-16T18:47:28.374948] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-09-16T18:47:28.515334] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-16T18:47:28.890143] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-16T18:47:29.174910] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-09-16T18:47:29.974951] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-09-16T18:47:30.153378] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-16T18:47:30.584005] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-16T18:47:30.589509] [INFO ] [REMOTE ] HGV: Full fetch complete (51060 records). [2025-09-16T18:47:30.589594] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-09-16T18:47:30.781522] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-09-16T18:47:30.970717] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-09-16T18:47:30.970862] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-09-16T18:47:30.971661] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-09-16T18:47:30.971735] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-09-16T18:47:30.972996] [DEBUG] [LOCAL ] HGV: Trimmed 51060 records to 35072 (keeping 150 days of data) [2025-09-16T18:47:31.077238] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-16T18:47:31.201439] [DEBUG] [LOCAL ] HGV: Primary data saved (35072 records). [2025-09-16T18:47:31.201576] [INFO ] [MAIN ] HGV: Full history saved. [2025-09-16T18:47:31.201673] [INFO ] [MAIN ] Update Progress: 1015/2369 symbols completed. HGV took 33.6s. Estimated remaining: 2h 23m 22s. Rate: 9.4 symbols/min [2025-09-16T18:47:31.369945] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:47:31.406480] [DEBUG] [LOCAL ] HIMS: Loaded 39777 existing records from primary storage. [2025-09-16T18:47:31.406620] [INFO ] [MAIN ] HIMS: Loaded 39777 existing records. [2025-09-16T18:47:31.579627] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-09-16T18:47:31.582953] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:47:31.584103] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-09-16T18:47:31.584150] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-09-16T18:47:31.585071] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-09-16T18:47:31.585123] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-09-16T18:47:31.940061] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:47:32.374876] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-09-16T18:47:32.482262] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-16T18:47:32.820328] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-16T18:47:33.174945] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-09-16T18:47:33.974898] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-09-16T18:47:34.041017] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-16T18:47:34.308042] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-16T18:47:34.774902] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-09-16T18:47:35.574913] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-09-16T18:47:36.374907] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-09-16T18:47:36.431768] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-09-16T18:47:36.616900] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-16T18:47:37.011320] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-16T18:47:37.174916] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-09-16T18:47:37.630248] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-16T18:47:37.634537] [INFO ] [REMOTE ] HI: Full fetch complete (37974 records). [2025-09-16T18:47:37.634680] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-09-16T18:47:37.977908] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-09-16T18:47:38.008009] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-09-16T18:47:38.008087] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-09-16T18:47:38.008598] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-09-16T18:47:38.008669] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-09-16T18:47:38.009465] [DEBUG] [LOCAL ] HI: Trimmed 37974 records to 25850 (keeping 150 days of data) [2025-09-16T18:47:38.169246] [DEBUG] [LOCAL ] HI: Primary data saved (25850 records). [2025-09-16T18:47:38.169382] [INFO ] [MAIN ] HI: Full history saved. [2025-09-16T18:47:38.169481] [INFO ] [MAIN ] Update Progress: 1016/2369 symbols completed. HI took 22.2s. Estimated remaining: 2h 23m 16s. Rate: 9.4 symbols/min [2025-09-16T18:47:38.338950] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:47:38.353999] [DEBUG] [LOCAL ] HIO: Loaded 15857 existing records from primary storage. [2025-09-16T18:47:38.354120] [INFO ] [MAIN ] HIO: Loaded 15857 existing records. [2025-09-16T18:47:38.530535] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:47:38.530823] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-09-16T18:47:38.530871] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-09-16T18:47:38.531343] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-09-16T18:47:38.531391] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-09-16T18:47:38.780017] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-09-16T18:47:38.880472] [INFO ] [REMOTE ] HIO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:47:39.456329] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-16T18:47:39.581680] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-09-16T18:47:39.584450] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-09-16T18:47:40.060983] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-16T18:47:40.374898] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-09-16T18:47:40.582294] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-16T18:47:41.174921] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-09-16T18:47:41.724682] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-16T18:47:41.730885] [INFO ] [REMOTE ] HIG: Full fetch complete (55602 records). [2025-09-16T18:47:41.731006] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-09-16T18:47:41.983740] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-09-16T18:47:42.120132] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-09-16T18:47:42.120223] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-09-16T18:47:42.121045] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-09-16T18:47:42.121092] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-09-16T18:47:42.122341] [DEBUG] [LOCAL ] HIG: Trimmed 55602 records to 38323 (keeping 150 days of data) [2025-09-16T18:47:42.367581] [DEBUG] [LOCAL ] HIG: Primary data saved (38323 records). [2025-09-16T18:47:42.367746] [INFO ] [MAIN ] HIG: Full history saved. [2025-09-16T18:47:42.369473] [INFO ] [MAIN ] Update Progress: 1017/2369 symbols completed. HIG took 25.2s. Estimated remaining: 2h 23m 7s. Rate: 9.4 symbols/min [2025-09-16T18:47:42.541191] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:47:42.557725] [DEBUG] [LOCAL ] HIPO: Loaded 16581 existing records from primary storage. [2025-09-16T18:47:42.557858] [INFO ] [MAIN ] HIPO: Loaded 16581 existing records. [2025-09-16T18:47:42.740717] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:47:42.740993] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-09-16T18:47:42.741066] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-09-16T18:47:42.741548] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-09-16T18:47:42.741597] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-09-16T18:47:42.784534] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-09-16T18:47:43.094123] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:47:43.419438] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-16T18:47:43.531861] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-16T18:47:43.574862] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-09-16T18:47:44.345842] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-16T18:47:44.374847] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-09-16T18:47:45.174899] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-09-16T18:47:45.667173] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-16T18:47:45.696089] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-16T18:47:45.974891] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-09-16T18:47:46.468175] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-16T18:47:46.472174] [INFO ] [REMOTE ] HII: Full fetch complete (39745 records). [2025-09-16T18:47:46.472253] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-09-16T18:47:46.780117] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-09-16T18:47:46.856389] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-09-16T18:47:46.856475] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-09-16T18:47:46.857234] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-09-16T18:47:46.857282] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-09-16T18:47:46.858171] [DEBUG] [LOCAL ] HII: Trimmed 39745 records to 24405 (keeping 150 days of data) [2025-09-16T18:47:46.979892] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-16T18:47:47.045801] [DEBUG] [LOCAL ] HII: Primary data saved (24405 records). [2025-09-16T18:47:47.045969] [INFO ] [MAIN ] HII: Full history saved. [2025-09-16T18:47:47.046082] [INFO ] [MAIN ] Update Progress: 1018/2369 symbols completed. HII took 26.2s. Estimated remaining: 2h 22m 58s. Rate: 9.4 symbols/min [2025-09-16T18:47:47.215536] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:47:47.253224] [DEBUG] [LOCAL ] HIW: Loaded 32873 existing records from primary storage. [2025-09-16T18:47:47.253385] [INFO ] [MAIN ] HIW: Loaded 32873 existing records. [2025-09-16T18:47:47.429603] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:47:47.429886] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-09-16T18:47:47.429936] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-09-16T18:47:47.430825] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-09-16T18:47:47.430875] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-09-16T18:47:47.577110] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-09-16T18:47:47.791124] [INFO ] [REMOTE ] HIW: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:47:48.374889] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-09-16T18:47:48.708341] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-16T18:47:49.163206] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-09-16T18:47:49.174836] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-09-16T18:47:49.330877] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-16T18:47:49.974899] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-09-16T18:47:50.774947] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-09-16T18:47:50.918066] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-16T18:47:51.574896] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-09-16T18:47:51.745421] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-09-16T18:47:52.240448] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-16T18:47:52.374921] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-09-16T18:47:52.608179] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-16T18:47:53.174974] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-09-16T18:47:53.874076] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-16T18:47:53.924370] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-16T18:47:53.974861] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-09-16T18:47:54.774933] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-09-16T18:47:55.094041] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-16T18:47:55.574909] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-09-16T18:47:56.374918] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-09-16T18:47:56.715677] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-16T18:47:57.056163] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-09-16T18:47:57.174948] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-09-16T18:47:57.963863] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-16T18:47:57.974946] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-09-16T18:47:58.421764] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-16T18:47:58.425511] [INFO ] [REMOTE ] HIO: Full fetch complete (26825 records). [2025-09-16T18:47:58.425624] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-09-16T18:47:58.780500] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-09-16T18:47:58.810336] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-09-16T18:47:58.810434] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-09-16T18:47:58.811138] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-09-16T18:47:58.811185] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-09-16T18:47:58.811913] [DEBUG] [LOCAL ] HIO: Trimmed 26825 records to 16041 (keeping 150 days of data) [2025-09-16T18:47:58.904975] [DEBUG] [LOCAL ] HIO: Primary data saved (16041 records). [2025-09-16T18:47:58.905125] [INFO ] [MAIN ] HIO: Full history saved. [2025-09-16T18:47:58.905213] [INFO ] [MAIN ] Update Progress: 1019/2369 symbols completed. HIO took 20.7s. Estimated remaining: 2h 22m 59s. Rate: 9.4 symbols/min [2025-09-16T18:47:59.077427] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:47:59.092766] [DEBUG] [LOCAL ] HIX: Loaded 14901 existing records from primary storage. [2025-09-16T18:47:59.092881] [INFO ] [MAIN ] HIX: Loaded 14901 existing records. [2025-09-16T18:47:59.267932] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:47:59.268185] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-09-16T18:47:59.268238] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-09-16T18:47:59.268885] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-09-16T18:47:59.268941] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-09-16T18:47:59.579049] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-09-16T18:47:59.638391] [INFO ] [REMOTE ] HIX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:47:59.662339] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-16T18:47:59.908782] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-16T18:48:00.374928] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-09-16T18:48:01.174953] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-09-16T18:48:01.587611] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-16T18:48:01.975048] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-09-16T18:48:02.055280] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-09-16T18:48:02.063448] [INFO ] [REMOTE ] HIMS: Full fetch complete (58497 records). [2025-09-16T18:48:02.063959] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-09-16T18:48:02.147164] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-16T18:48:02.568923] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-09-16T18:48:02.569077] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-09-16T18:48:02.570473] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-09-16T18:48:02.570555] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-09-16T18:48:02.572266] [DEBUG] [LOCAL ] HIMS: Trimmed 58497 records to 40167 (keeping 150 days of data) [2025-09-16T18:48:02.782424] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-09-16T18:48:02.824913] [DEBUG] [LOCAL ] HIMS: Primary data saved (40167 records). [2025-09-16T18:48:02.825074] [INFO ] [MAIN ] HIMS: Full history saved. [2025-09-16T18:48:02.825172] [INFO ] [MAIN ] Update Progress: 1020/2369 symbols completed. HIMS took 31.6s. Estimated remaining: 2h 22m 50s. Rate: 9.4 symbols/min [2025-09-16T18:48:02.998469] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:48:03.037423] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-16T18:48:03.053165] [DEBUG] [LOCAL ] HKD: Loaded 13415 existing records from primary storage. [2025-09-16T18:48:03.053862] [INFO ] [MAIN ] HKD: Loaded 13415 existing records. [2025-09-16T18:48:03.237529] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:48:03.237835] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-09-16T18:48:03.237885] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-09-16T18:48:03.238268] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-09-16T18:48:03.238313] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-09-16T18:48:03.583015] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-09-16T18:48:03.598075] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-16T18:48:03.626608] [INFO ] [REMOTE ] HKD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:48:04.374953] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-09-16T18:48:04.602003] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-16T18:48:05.174890] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-09-16T18:48:05.488373] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-16T18:48:05.974916] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-09-16T18:48:06.706097] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-16T18:48:06.774966] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-09-16T18:48:06.920553] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-16T18:48:07.574934] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-09-16T18:48:08.280811] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-16T18:48:08.289168] [INFO ] [REMOTE ] HIW: Full fetch complete (48975 records). [2025-09-16T18:48:08.289288] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-09-16T18:48:08.380089] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-09-16T18:48:08.684108] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-09-16T18:48:08.684215] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-09-16T18:48:08.685103] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-09-16T18:48:08.685344] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-09-16T18:48:08.699353] [DEBUG] [LOCAL ] HIW: Trimmed 48975 records to 33209 (keeping 150 days of data) [2025-09-16T18:48:08.699917] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-16T18:48:08.911560] [DEBUG] [LOCAL ] HIW: Primary data saved (33209 records). [2025-09-16T18:48:08.911745] [INFO ] [MAIN ] HIW: Full history saved. [2025-09-16T18:48:08.913658] [INFO ] [MAIN ] Update Progress: 1021/2369 symbols completed. HIW took 21.9s. Estimated remaining: 2h 22m 43s. Rate: 9.4 symbols/min [2025-09-16T18:48:09.080821] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:48:09.119853] [DEBUG] [LOCAL ] HL: Loaded 39637 existing records from primary storage. [2025-09-16T18:48:09.120023] [INFO ] [MAIN ] HL: Loaded 39637 existing records. [2025-09-16T18:48:09.181061] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-09-16T18:48:09.297467] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:48:09.297719] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-09-16T18:48:09.297765] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-09-16T18:48:09.298624] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-09-16T18:48:09.298699] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-09-16T18:48:09.655482] [INFO ] [REMOTE ] HL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:48:09.668571] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-16T18:48:09.974988] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-09-16T18:48:10.401599] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-16T18:48:10.732084] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-16T18:48:10.774909] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-09-16T18:48:11.574959] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-09-16T18:48:11.799618] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-16T18:48:12.374995] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-09-16T18:48:12.552916] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-16T18:48:13.175008] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-09-16T18:48:13.423361] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-16T18:48:13.974968] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-09-16T18:48:14.205042] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-16T18:48:14.756441] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-16T18:48:14.759039] [INFO ] [REMOTE ] HIX: Full fetch complete (21811 records). [2025-09-16T18:48:14.759129] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-09-16T18:48:14.780913] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-09-16T18:48:15.157556] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-09-16T18:48:15.157669] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-09-16T18:48:15.158278] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-09-16T18:48:15.158347] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-09-16T18:48:15.159027] [DEBUG] [LOCAL ] HIX: Trimmed 21811 records to 15027 (keeping 150 days of data) [2025-09-16T18:48:15.247938] [DEBUG] [LOCAL ] HIX: Primary data saved (15027 records). [2025-09-16T18:48:15.248083] [INFO ] [MAIN ] HIX: Full history saved. [2025-09-16T18:48:15.248190] [INFO ] [MAIN ] Update Progress: 1022/2369 symbols completed. HIX took 16.3s. Estimated remaining: 2h 22m 37s. Rate: 9.4 symbols/min [2025-09-16T18:48:15.420080] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:48:15.456927] [DEBUG] [LOCAL ] HLF: Loaded 36076 existing records from primary storage. [2025-09-16T18:48:15.457093] [INFO ] [MAIN ] HLF: Loaded 36076 existing records. [2025-09-16T18:48:15.580127] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-09-16T18:48:15.641698] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:48:15.642007] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-09-16T18:48:15.642137] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-09-16T18:48:15.648164] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-09-16T18:48:15.654163] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-09-16T18:48:15.688164] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-16T18:48:15.762574] [INFO ] [REMOTE ] HIPO: Full fetch complete (24489 records). [2025-09-16T18:48:15.763117] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-09-16T18:48:16.245898] [INFO ] [REMOTE ] HLF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:48:16.380034] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-09-16T18:48:16.441969] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-09-16T18:48:16.442048] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-09-16T18:48:16.442619] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-09-16T18:48:16.442678] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-09-16T18:48:16.443373] [DEBUG] [LOCAL ] HIPO: Trimmed 24489 records to 16781 (keeping 150 days of data) [2025-09-16T18:48:16.547362] [DEBUG] [LOCAL ] HIPO: Primary data saved (16781 records). [2025-09-16T18:48:16.547508] [INFO ] [MAIN ] HIPO: Full history saved. [2025-09-16T18:48:16.547596] [INFO ] [MAIN ] Update Progress: 1023/2369 symbols completed. HIPO took 34.2s. Estimated remaining: 2h 22m 24s. Rate: 9.5 symbols/min [2025-09-16T18:48:16.718233] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:48:16.727484] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-16T18:48:16.750273] [DEBUG] [LOCAL ] HLI: Loaded 22468 existing records from primary storage. [2025-09-16T18:48:16.750408] [INFO ] [MAIN ] HLI: Loaded 22468 existing records. [2025-09-16T18:48:16.924422] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:48:16.924708] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-09-16T18:48:16.924774] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-09-16T18:48:16.925421] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-09-16T18:48:16.925471] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-09-16T18:48:17.180127] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-09-16T18:48:17.296533] [INFO ] [REMOTE ] HLI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:48:17.974880] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-09-16T18:48:18.016193] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-16T18:48:18.421824] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-16T18:48:18.774906] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-09-16T18:48:19.113708] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-16T18:48:19.574925] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-09-16T18:48:20.343153] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-16T18:48:20.374859] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-09-16T18:48:20.997085] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-16T18:48:21.174902] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-09-16T18:48:21.441323] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-16T18:48:21.974901] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-09-16T18:48:22.598266] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-16T18:48:22.774911] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-09-16T18:48:23.216207] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-16T18:48:23.574891] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-09-16T18:48:23.860217] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-16T18:48:24.374903] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-09-16T18:48:25.174879] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-09-16T18:48:25.313661] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-16T18:48:25.527105] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-16T18:48:25.974894] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-09-16T18:48:26.257244] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-16T18:48:26.774896] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-09-16T18:48:27.324400] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-16T18:48:27.574906] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-09-16T18:48:28.374872] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-09-16T18:48:28.778188] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-16T18:48:28.805409] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-16T18:48:29.174910] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-09-16T18:48:29.974917] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-09-16T18:48:30.039891] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-16T18:48:30.555368] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-16T18:48:30.774913] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-09-16T18:48:30.943229] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-16T18:48:30.946514] [INFO ] [REMOTE ] HKD: Full fetch complete (20089 records). [2025-09-16T18:48:30.946619] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-09-16T18:48:31.322048] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-09-16T18:48:31.322145] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-09-16T18:48:31.322740] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-09-16T18:48:31.322801] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-09-16T18:48:31.323477] [DEBUG] [LOCAL ] HKD: Trimmed 20089 records to 13531 (keeping 150 days of data) [2025-09-16T18:48:31.405500] [DEBUG] [LOCAL ] HKD: Primary data saved (13531 records). [2025-09-16T18:48:31.405675] [INFO ] [MAIN ] HKD: Full history saved. [2025-09-16T18:48:31.405790] [INFO ] [MAIN ] Update Progress: 1024/2369 symbols completed. HKD took 28.6s. Estimated remaining: 2h 22m 29s. Rate: 9.4 symbols/min [2025-09-16T18:48:31.578985] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-09-16T18:48:31.580596] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:48:31.603010] [DEBUG] [LOCAL ] HLIO: Loaded 21669 existing records from primary storage. [2025-09-16T18:48:31.603195] [INFO ] [MAIN ] HLIO: Loaded 21669 existing records. [2025-09-16T18:48:31.794213] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:48:31.794543] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-09-16T18:48:31.794596] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-09-16T18:48:31.795435] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-09-16T18:48:31.795486] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-09-16T18:48:32.150977] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:48:32.374871] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-09-16T18:48:32.507414] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-16T18:48:33.174861] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-09-16T18:48:33.269001] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-16T18:48:33.290044] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-16T18:48:33.974886] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-09-16T18:48:34.144123] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-16T18:48:34.774893] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-09-16T18:48:35.574857] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-09-16T18:48:35.954520] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-16T18:48:36.006028] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-16T18:48:36.009696] [INFO ] [REMOTE ] HLI: Full fetch complete (34060 records). [2025-09-16T18:48:36.009773] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-09-16T18:48:36.384950] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-09-16T18:48:36.383007] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-09-16T18:48:36.385061] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-09-16T18:48:36.386397] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-09-16T18:48:36.386450] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-09-16T18:48:36.387301] [DEBUG] [LOCAL ] HLI: Trimmed 34060 records to 22663 (keeping 150 days of data) [2025-09-16T18:48:36.533845] [DEBUG] [LOCAL ] HLI: Primary data saved (22663 records). [2025-09-16T18:48:36.534001] [INFO ] [MAIN ] HLI: Full history saved. [2025-09-16T18:48:36.534101] [INFO ] [MAIN ] Update Progress: 1025/2369 symbols completed. HLI took 20.0s. Estimated remaining: 2h 22m 21s. Rate: 9.4 symbols/min [2025-09-16T18:48:36.709709] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:48:36.727460] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-16T18:48:36.753378] [DEBUG] [LOCAL ] HLLY: Loaded 24451 existing records from primary storage. [2025-09-16T18:48:36.753526] [INFO ] [MAIN ] HLLY: Loaded 24451 existing records. [2025-09-16T18:48:36.936565] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:48:36.936868] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-09-16T18:48:36.936922] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-09-16T18:48:36.937445] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-09-16T18:48:36.937490] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-09-16T18:48:37.185176] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-09-16T18:48:37.301076] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:48:37.974899] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-09-16T18:48:38.200386] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-16T18:48:38.293854] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-16T18:48:38.774909] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-09-16T18:48:39.419914] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-16T18:48:39.574908] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-09-16T18:48:39.816082] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-16T18:48:40.374891] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-09-16T18:48:41.074826] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-16T18:48:41.080709] [INFO ] [REMOTE ] HLF: Full fetch complete (53449 records). [2025-09-16T18:48:41.080810] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-09-16T18:48:41.180084] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-09-16T18:48:41.463880] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-09-16T18:48:41.463989] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-09-16T18:48:41.464725] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-09-16T18:48:41.464813] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-09-16T18:48:41.467726] [DEBUG] [LOCAL ] HLF: Trimmed 53449 records to 36426 (keeping 150 days of data) [2025-09-16T18:48:41.685215] [DEBUG] [LOCAL ] HLF: Primary data saved (36426 records). [2025-09-16T18:48:41.685346] [INFO ] [MAIN ] HLF: Full history saved. [2025-09-16T18:48:41.685445] [INFO ] [MAIN ] Update Progress: 1026/2369 symbols completed. HLF took 26.4s. Estimated remaining: 2h 22m 13s. Rate: 9.4 symbols/min [2025-09-16T18:48:41.851043] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-16T18:48:41.880073] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:48:41.918415] [DEBUG] [LOCAL ] HLN: Loaded 39179 existing records from primary storage. [2025-09-16T18:48:41.918563] [INFO ] [MAIN ] HLN: Loaded 39179 existing records. [2025-09-16T18:48:41.984417] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-09-16T18:48:42.123705] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:48:42.124017] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-09-16T18:48:42.124093] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-09-16T18:48:42.125011] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-09-16T18:48:42.125080] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-09-16T18:48:42.481263] [INFO ] [REMOTE ] HLN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:48:42.542081] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-16T18:48:42.774974] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-09-16T18:48:43.574926] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-09-16T18:48:43.842839] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-16T18:48:43.885531] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-16T18:48:44.374941] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-09-16T18:48:45.174858] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-09-16T18:48:45.209768] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-16T18:48:45.686501] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-16T18:48:45.974901] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-09-16T18:48:46.774901] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-09-16T18:48:47.295935] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-16T18:48:47.302910] [INFO ] [REMOTE ] HL: Full fetch complete (58349 records). [2025-09-16T18:48:47.303016] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-09-16T18:48:47.580037] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-09-16T18:48:47.694020] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-09-16T18:48:47.694177] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-09-16T18:48:47.694983] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-09-16T18:48:47.695051] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-09-16T18:48:47.696459] [DEBUG] [LOCAL ] HL: Trimmed 58349 records to 40027 (keeping 150 days of data) [2025-09-16T18:48:47.830173] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-16T18:48:47.988194] [DEBUG] [LOCAL ] HL: Primary data saved (40027 records). [2025-09-16T18:48:47.988323] [INFO ] [MAIN ] HL: Full history saved. [2025-09-16T18:48:47.989112] [INFO ] [MAIN ] Update Progress: 1027/2369 symbols completed. HL took 39.1s. Estimated remaining: 2h 22m 6s. Rate: 9.4 symbols/min [2025-09-16T18:48:48.165714] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:48:48.187284] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-16T18:48:48.227390] [DEBUG] [LOCAL ] HLT: Loaded 37122 existing records from primary storage. [2025-09-16T18:48:48.227559] [INFO ] [MAIN ] HLT: Loaded 37122 existing records. [2025-09-16T18:48:48.380152] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-09-16T18:48:48.406878] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:48:48.407736] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-09-16T18:48:48.407787] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-09-16T18:48:48.408675] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-09-16T18:48:48.408730] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-09-16T18:48:48.787344] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-16T18:48:48.786405] [INFO ] [REMOTE ] HLT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:48:49.174903] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-09-16T18:48:49.815332] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-16T18:48:49.974941] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-09-16T18:48:50.774946] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-09-16T18:48:50.943095] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-16T18:48:51.574926] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-09-16T18:48:51.670558] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-16T18:48:52.046626] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-16T18:48:52.374960] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-09-16T18:48:52.774300] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-16T18:48:53.174948] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-09-16T18:48:53.974859] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-09-16T18:48:54.169923] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-16T18:48:54.279962] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-16T18:48:54.282962] [INFO ] [REMOTE ] HLIO: Full fetch complete (29729 records). [2025-09-16T18:48:54.283047] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-09-16T18:48:54.658754] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-09-16T18:48:54.658834] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-09-16T18:48:54.659463] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-09-16T18:48:54.659504] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-09-16T18:48:54.660755] [DEBUG] [LOCAL ] HLIO: Trimmed 29729 records to 21798 (keeping 150 days of data) [2025-09-16T18:48:54.785416] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-09-16T18:48:54.797067] [DEBUG] [LOCAL ] HLIO: Primary data saved (21798 records). [2025-09-16T18:48:54.797152] [INFO ] [MAIN ] HLIO: Full history saved. [2025-09-16T18:48:54.797247] [INFO ] [MAIN ] Update Progress: 1028/2369 symbols completed. HLIO took 23.4s. Estimated remaining: 2h 22m 0s. Rate: 9.4 symbols/min [2025-09-16T18:48:54.975425] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:48:55.011484] [DEBUG] [LOCAL ] HLX: Loaded 35148 existing records from primary storage. [2025-09-16T18:48:55.011631] [INFO ] [MAIN ] HLX: Loaded 35148 existing records. [2025-09-16T18:48:55.191188] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:48:55.191515] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-09-16T18:48:55.191578] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-09-16T18:48:55.192402] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-09-16T18:48:55.192461] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-09-16T18:48:55.578566] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-09-16T18:48:55.581913] [INFO ] [REMOTE ] HLX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:48:55.845743] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-16T18:48:56.000204] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-16T18:48:56.374930] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-09-16T18:48:57.174939] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-09-16T18:48:57.382561] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-16T18:48:57.974943] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-09-16T18:48:58.325250] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-16T18:48:58.738454] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-16T18:48:58.774854] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-09-16T18:48:59.574894] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-09-16T18:48:59.852062] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-16T18:48:59.972859] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-16T18:49:00.374927] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-09-16T18:49:01.146806] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-16T18:49:01.151562] [INFO ] [REMOTE ] HLLY: Full fetch complete (35039 records). [2025-09-16T18:49:01.151688] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-09-16T18:49:01.182673] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-09-16T18:49:01.521703] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-09-16T18:49:01.521789] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-09-16T18:49:01.522394] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-09-16T18:49:01.522437] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-09-16T18:49:01.523363] [DEBUG] [LOCAL ] HLLY: Trimmed 35039 records to 24752 (keeping 150 days of data) [2025-09-16T18:49:01.683229] [DEBUG] [LOCAL ] HLLY: Primary data saved (24752 records). [2025-09-16T18:49:01.683380] [INFO ] [MAIN ] HLLY: Full history saved. [2025-09-16T18:49:01.683479] [INFO ] [MAIN ] Update Progress: 1029/2369 symbols completed. HLLY took 25.1s. Estimated remaining: 2h 21m 55s. Rate: 9.4 symbols/min [2025-09-16T18:49:01.856831] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:49:01.906266] [DEBUG] [LOCAL ] HMC: Loaded 33997 existing records from primary storage. [2025-09-16T18:49:01.906475] [INFO ] [MAIN ] HMC: Loaded 33997 existing records. [2025-09-16T18:49:01.980758] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-09-16T18:49:02.101389] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:49:02.101659] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-09-16T18:49:02.101710] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-09-16T18:49:02.102447] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-09-16T18:49:02.102494] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-09-16T18:49:02.460555] [INFO ] [REMOTE ] HMC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:49:02.513826] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-16T18:49:02.774921] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-09-16T18:49:03.044378] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-16T18:49:03.574976] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-09-16T18:49:03.752246] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-16T18:49:04.374941] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-09-16T18:49:04.528932] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-16T18:49:05.174907] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-09-16T18:49:05.368242] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-16T18:49:05.945874] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-16T18:49:05.974855] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-09-16T18:49:06.777239] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-09-16T18:49:06.956745] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-16T18:49:07.497292] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-16T18:49:07.574922] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-09-16T18:49:08.374920] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-09-16T18:49:08.569550] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-16T18:49:08.576256] [INFO ] [REMOTE ] HLN: Full fetch complete (57684 records). [2025-09-16T18:49:08.576374] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-09-16T18:49:08.960233] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-09-16T18:49:08.960325] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-09-16T18:49:08.961122] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-09-16T18:49:08.961215] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-09-16T18:49:08.962507] [DEBUG] [LOCAL ] HLN: Trimmed 57684 records to 39568 (keeping 150 days of data) [2025-09-16T18:49:09.186604] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-09-16T18:49:09.220131] [DEBUG] [LOCAL ] HLN: Primary data saved (39568 records). [2025-09-16T18:49:09.220286] [INFO ] [MAIN ] HLN: Full history saved. [2025-09-16T18:49:09.220376] [INFO ] [MAIN ] Update Progress: 1030/2369 symbols completed. HLN took 27.5s. Estimated remaining: 2h 21m 50s. Rate: 9.4 symbols/min [2025-09-16T18:49:09.395157] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:49:09.427458] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-16T18:49:09.450433] [DEBUG] [LOCAL ] HMN: Loaded 17769 existing records from primary storage. [2025-09-16T18:49:09.450579] [INFO ] [MAIN ] HMN: Loaded 17769 existing records. [2025-09-16T18:49:09.632191] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:49:09.632426] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-09-16T18:49:09.632471] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-09-16T18:49:09.632962] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-09-16T18:49:09.633011] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-09-16T18:49:09.988700] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-09-16T18:49:10.024035] [INFO ] [REMOTE ] HMN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:49:10.108128] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-16T18:49:10.497072] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-16T18:49:10.774913] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-09-16T18:49:11.562535] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-16T18:49:11.574835] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-09-16T18:49:12.253892] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-16T18:49:12.374957] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-09-16T18:49:13.158971] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-16T18:49:13.174838] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-09-16T18:49:13.974909] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-09-16T18:49:14.082925] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-16T18:49:14.714622] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-16T18:49:14.774864] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-09-16T18:49:15.574907] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-09-16T18:49:15.628287] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-16T18:49:15.637093] [INFO ] [REMOTE ] HLX: Full fetch complete (52284 records). [2025-09-16T18:49:15.637262] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-09-16T18:49:16.023965] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-09-16T18:49:16.024051] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-09-16T18:49:16.024846] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-09-16T18:49:16.024896] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-09-16T18:49:16.025967] [DEBUG] [LOCAL ] HLX: Trimmed 52284 records to 35463 (keeping 150 days of data) [2025-09-16T18:49:16.225585] [DEBUG] [LOCAL ] HLX: Primary data saved (35463 records). [2025-09-16T18:49:16.225757] [INFO ] [MAIN ] HLX: Full history saved. [2025-09-16T18:49:16.225842] [INFO ] [MAIN ] Update Progress: 1031/2369 symbols completed. HLX took 21.4s. Estimated remaining: 2h 21m 44s. Rate: 9.4 symbols/min [2025-09-16T18:49:16.380016] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-09-16T18:49:16.402052] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:49:16.434567] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-16T18:49:16.479699] [DEBUG] [LOCAL ] HMY: Loaded 39146 existing records from primary storage. [2025-09-16T18:49:16.479865] [INFO ] [MAIN ] HMY: Loaded 39146 existing records. [2025-09-16T18:49:16.664291] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:49:16.664531] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-09-16T18:49:16.664578] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-09-16T18:49:16.665377] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-09-16T18:49:16.665426] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-09-16T18:49:17.032164] [INFO ] [REMOTE ] HMY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:49:17.050631] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-16T18:49:17.057192] [INFO ] [REMOTE ] HLT: Full fetch complete (55221 records). [2025-09-16T18:49:17.057348] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-09-16T18:49:17.176039] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-09-16T18:49:17.366705] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-16T18:49:17.457561] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-09-16T18:49:17.457661] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-09-16T18:49:17.458425] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-09-16T18:49:17.458469] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-09-16T18:49:17.459747] [DEBUG] [LOCAL ] HLT: Trimmed 55221 records to 37473 (keeping 150 days of data) [2025-09-16T18:49:17.696408] [DEBUG] [LOCAL ] HLT: Primary data saved (37473 records). [2025-09-16T18:49:17.696581] [INFO ] [MAIN ] HLT: Full history saved. [2025-09-16T18:49:17.697668] [INFO ] [MAIN ] Update Progress: 1032/2369 symbols completed. HLT took 29.7s. Estimated remaining: 2h 21m 32s. Rate: 9.4 symbols/min [2025-09-16T18:49:17.864548] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:49:17.864789] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-09-16T18:49:17.864829] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-09-16T18:49:17.864950] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-09-16T18:49:17.864990] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-16T18:49:17.865032] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-16T18:49:17.865065] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-09-16T18:49:17.980031] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-09-16T18:49:18.224741] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:49:18.774931] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-02. [2025-09-16T18:49:18.912177] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-16T18:49:18.970217] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T18:49:18.970577] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-02 [2025-09-16T18:49:19.451800] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-16T18:49:19.457318] [INFO ] [REMOTE ] HMC: Full fetch complete (51289 records). [2025-09-16T18:49:19.457440] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-09-16T18:49:19.580011] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-03. [2025-09-16T18:49:19.840972] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-09-16T18:49:19.841057] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-09-16T18:49:19.841815] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-09-16T18:49:19.841866] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-09-16T18:49:19.843045] [DEBUG] [LOCAL ] HMC: Trimmed 51289 records to 34329 (keeping 150 days of data) [2025-09-16T18:49:19.894715] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T18:49:19.903782] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-03 [2025-09-16T18:49:20.045548] [DEBUG] [LOCAL ] HMC: Primary data saved (34329 records). [2025-09-16T18:49:20.045715] [INFO ] [MAIN ] HMC: Full history saved. [2025-09-16T18:49:20.045815] [INFO ] [MAIN ] Update Progress: 1033/2369 symbols completed. HMC took 18.4s. Estimated remaining: 2h 21m 20s. Rate: 9.5 symbols/min [2025-09-16T18:49:20.213567] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:49:20.233523] [DEBUG] [LOCAL ] HNI: Loaded 21203 existing records from primary storage. [2025-09-16T18:49:20.233667] [INFO ] [MAIN ] HNI: Loaded 21203 existing records. [2025-09-16T18:49:20.385003] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-09-16T18:49:20.413479] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:49:20.413730] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-09-16T18:49:20.413786] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-09-16T18:49:20.414389] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-09-16T18:49:20.414438] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-09-16T18:49:20.766947] [INFO ] [REMOTE ] HNI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:49:21.174891] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-09-16T18:49:21.359872] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-16T18:49:21.974902] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-04. [2025-09-16T18:49:22.160811] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T18:49:22.161122] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-04 [2025-09-16T18:49:22.354424] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-16T18:49:22.774972] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-09-16T18:49:23.574923] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-09-16T18:49:24.066948] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-16T18:49:24.374908] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-05. [2025-09-16T18:49:25.174901] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-09-16T18:49:25.250133] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-16T18:49:25.579366] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-16T18:49:25.981448] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-06. [2025-09-16T18:49:25.985663] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-16T18:49:26.774907] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-09-16T18:49:27.573911] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-16T18:49:27.582442] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-09-16T18:49:28.374939] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-07. [2025-09-16T18:49:28.411123] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-16T18:49:28.564636] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-16T18:49:29.174942] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-09-16T18:49:29.877539] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-16T18:49:29.974952] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-08. [2025-09-16T18:49:30.450196] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-16T18:49:30.774915] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-09-16T18:49:31.516127] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-16T18:49:31.574883] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-09. [2025-09-16T18:49:32.374942] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-09-16T18:49:32.418682] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-16T18:49:33.174899] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-09-16T18:49:33.283284] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-16T18:49:33.288633] [INFO ] [REMOTE ] HNGE: Full fetch complete (24280 records). [2025-09-16T18:49:33.288733] [DEBUG] [VALIDATOR ] HNGE: Validating primary data. [2025-09-16T18:49:33.469336] [WARN ] [VALIDATOR ] HNGE: Validation failed - insufficient historical data. Have 80 unique days, need 150 days [2025-09-16T18:49:33.469750] [FATAL] [MAIN ] HNGE: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:49:33.469803] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:49:33.469847] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-16T18:49:33.469903] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-16T18:49:33.469938] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-09-16T18:49:33.469986] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-09-16T18:49:33.470047] [INFO ] [MAIN ] Update Progress: 1034/2369 symbols completed. HNGE took 15.8s. Estimated remaining: 2h 21m 23s. Rate: 9.4 symbols/min [2025-09-16T18:49:33.643182] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:49:33.657960] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-16T18:49:33.699034] [DEBUG] [LOCAL ] HOG: Loaded 37469 existing records from primary storage. [2025-09-16T18:49:33.699183] [INFO ] [MAIN ] HOG: Loaded 37469 existing records. [2025-09-16T18:49:33.883544] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:49:33.883818] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-09-16T18:49:33.883868] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-09-16T18:49:33.885370] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-09-16T18:49:33.885598] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-09-16T18:49:33.983188] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-09-16T18:49:34.252488] [INFO ] [REMOTE ] HOG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:49:34.422591] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-16T18:49:34.774900] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-09-16T18:49:35.574868] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-09-16T18:49:35.926975] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-16T18:49:36.117528] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-16T18:49:36.374912] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-09-16T18:49:36.865823] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-16T18:49:37.174888] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-09-16T18:49:37.523144] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-16T18:49:37.974899] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-09-16T18:49:38.774914] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-09-16T18:49:38.941494] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-16T18:49:38.987855] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-16T18:49:39.574896] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-09-16T18:49:40.309757] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-16T18:49:40.314512] [INFO ] [REMOTE ] HNI: Full fetch complete (31310 records). [2025-09-16T18:49:40.314614] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-09-16T18:49:40.382408] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-09-16T18:49:40.691547] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-09-16T18:49:40.691626] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-09-16T18:49:40.692217] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-09-16T18:49:40.692259] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-09-16T18:49:40.693040] [DEBUG] [LOCAL ] HNI: Trimmed 31310 records to 21452 (keeping 150 days of data) [2025-09-16T18:49:40.823579] [DEBUG] [LOCAL ] HNI: Primary data saved (21452 records). [2025-09-16T18:49:40.823723] [INFO ] [MAIN ] HNI: Full history saved. [2025-09-16T18:49:40.823804] [INFO ] [MAIN ] Update Progress: 1035/2369 symbols completed. HNI took 20.8s. Estimated remaining: 2h 21m 18s. Rate: 9.4 symbols/min [2025-09-16T18:49:40.994693] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:49:41.024562] [DEBUG] [LOCAL ] HOMB: Loaded 31393 existing records from primary storage. [2025-09-16T18:49:41.024721] [INFO ] [MAIN ] HOMB: Loaded 31393 existing records. [2025-09-16T18:49:41.177589] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-09-16T18:49:41.210386] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:49:41.211720] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-09-16T18:49:41.211773] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-09-16T18:49:41.212775] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-09-16T18:49:41.212829] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-09-16T18:49:41.539389] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-16T18:49:41.616997] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:49:41.974941] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-09-16T18:49:42.431991] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-16T18:49:42.451125] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-16T18:49:42.454107] [INFO ] [REMOTE ] HMN: Full fetch complete (24885 records). [2025-09-16T18:49:42.454225] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-09-16T18:49:42.780068] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-09-16T18:49:42.821286] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-09-16T18:49:42.821367] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-09-16T18:49:42.821890] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-09-16T18:49:42.821933] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-09-16T18:49:42.822550] [DEBUG] [LOCAL ] HMN: Trimmed 24885 records to 17941 (keeping 150 days of data) [2025-09-16T18:49:42.932083] [DEBUG] [LOCAL ] HMN: Primary data saved (17941 records). [2025-09-16T18:49:42.932229] [INFO ] [MAIN ] HMN: Full history saved. [2025-09-16T18:49:42.932328] [INFO ] [MAIN ] Update Progress: 1036/2369 symbols completed. HMN took 33.7s. Estimated remaining: 2h 21m 6s. Rate: 9.4 symbols/min [2025-09-16T18:49:43.102521] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:49:43.132319] [DEBUG] [LOCAL ] HOUS: Loaded 32545 existing records from primary storage. [2025-09-16T18:49:43.132486] [INFO ] [MAIN ] HOUS: Loaded 32545 existing records. [2025-09-16T18:49:43.313772] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:49:43.314067] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-09-16T18:49:43.314140] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-09-16T18:49:43.314832] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-09-16T18:49:43.314894] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-09-16T18:49:43.583697] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-09-16T18:49:43.678272] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:49:43.702115] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-16T18:49:44.374906] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-09-16T18:49:45.009093] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-16T18:49:45.174925] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-09-16T18:49:45.337890] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-16T18:49:45.753075] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-16T18:49:45.974914] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-09-16T18:49:46.774918] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-09-16T18:49:46.842603] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-16T18:49:47.217855] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-16T18:49:47.574966] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-09-16T18:49:48.374918] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-09-16T18:49:48.543261] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-16T18:49:49.032869] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-16T18:49:49.174923] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-09-16T18:49:49.974873] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-09-16T18:49:50.069700] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-16T18:49:50.777073] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-09-16T18:49:50.780563] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-16T18:49:51.212230] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-16T18:49:51.574911] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-09-16T18:49:52.299040] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-16T18:49:52.374916] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-09-16T18:49:53.174934] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-09-16T18:49:53.649955] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-16T18:49:53.656515] [INFO ] [REMOTE ] HMY: Full fetch complete (57772 records). [2025-09-16T18:49:53.656712] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-09-16T18:49:53.995369] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-09-16T18:49:54.046450] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-09-16T18:49:54.046687] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-09-16T18:49:54.047459] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-09-16T18:49:54.055554] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-09-16T18:49:54.071781] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-16T18:49:54.081244] [DEBUG] [LOCAL ] HMY: Trimmed 57772 records to 39534 (keeping 150 days of data) [2025-09-16T18:49:54.326277] [DEBUG] [LOCAL ] HMY: Primary data saved (39534 records). [2025-09-16T18:49:54.326435] [INFO ] [MAIN ] HMY: Full history saved. [2025-09-16T18:49:54.326526] [INFO ] [MAIN ] Update Progress: 1037/2369 symbols completed. HMY took 38.1s. Estimated remaining: 2h 21m 6s. Rate: 9.4 symbols/min [2025-09-16T18:49:54.435905] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-16T18:49:54.774906] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-09-16T18:49:55.574924] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-09-16T18:49:55.935237] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-16T18:49:56.200435] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-16T18:49:56.374908] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-09-16T18:49:57.075404] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-16T18:49:57.174952] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-09-16T18:49:57.865420] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-16T18:49:57.974924] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-09-16T18:49:58.737736] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-16T18:49:58.774850] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-09-16T18:49:59.574912] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-09-16T18:49:59.612023] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-16T18:49:59.618146] [INFO ] [REMOTE ] HOG: Full fetch complete (55905 records). [2025-09-16T18:49:59.618279] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-09-16T18:50:00.007290] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-09-16T18:50:00.007389] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-09-16T18:50:00.008191] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-09-16T18:50:00.008255] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-09-16T18:50:00.009689] [DEBUG] [LOCAL ] HOG: Trimmed 55905 records to 37825 (keeping 150 days of data) [2025-09-16T18:50:00.255924] [DEBUG] [LOCAL ] HOG: Primary data saved (37825 records). [2025-09-16T18:50:00.256195] [INFO ] [MAIN ] HOG: Full history saved. [2025-09-16T18:50:00.257030] [INFO ] [MAIN ] Update Progress: 1038/2369 symbols completed. HOG took 26.8s. Estimated remaining: 2h 20m 59s. Rate: 9.4 symbols/min [2025-09-16T18:50:00.277439] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-16T18:50:00.283862] [INFO ] [REMOTE ] HOUS: Full fetch complete (47615 records). [2025-09-16T18:50:00.284131] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-09-16T18:50:00.661041] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-09-16T18:50:00.661127] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-09-16T18:50:00.661886] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-09-16T18:50:00.661931] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-09-16T18:50:00.662956] [DEBUG] [LOCAL ] HOUS: Trimmed 47615 records to 32881 (keeping 150 days of data) [2025-09-16T18:50:00.849069] [DEBUG] [LOCAL ] HOUS: Primary data saved (32881 records). [2025-09-16T18:50:00.849216] [INFO ] [MAIN ] HOUS: Full history saved. [2025-09-16T18:50:00.849304] [INFO ] [MAIN ] Update Progress: 1039/2369 symbols completed. HOUS took 17.9s. Estimated remaining: 2h 20m 46s. Rate: 9.4 symbols/min [2025-09-16T18:50:01.009539] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-16T18:50:01.021547] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-09-16T18:50:02.582967] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-16T18:50:02.592744] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-09-16T18:50:04.136976] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-16T18:50:04.142545] [INFO ] [REMOTE ] HOMB: Full fetch complete (47566 records). [2025-09-16T18:50:04.142672] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-09-16T18:50:04.534432] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-09-16T18:50:04.534509] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-09-16T18:50:04.535223] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-09-16T18:50:04.535266] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-09-16T18:50:04.536213] [DEBUG] [LOCAL ] HOMB: Trimmed 47566 records to 31713 (keeping 150 days of data) [2025-09-16T18:50:04.730675] [DEBUG] [LOCAL ] HOMB: Primary data saved (31713 records). [2025-09-16T18:50:04.730820] [INFO ] [MAIN ] HOMB: Full history saved. [2025-09-16T18:50:04.730914] [INFO ] [MAIN ] Update Progress: 1040/2369 symbols completed. HOMB took 23.9s. Estimated remaining: 2h 20m 36s. Rate: 9.5 symbols/min [2025-09-16T18:50:05.311069] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:50:05.340262] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:50:05.419557] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:50:05.465383] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:50:05.472103] [DEBUG] [LOCAL ] HPF: Loaded 5553 existing records from primary storage. [2025-09-16T18:50:05.472369] [INFO ] [MAIN ] HPF: Loaded 5553 existing records. [2025-09-16T18:50:05.587686] [DEBUG] [LOCAL ] HOV: Loaded 10490 existing records from primary storage. [2025-09-16T18:50:05.598672] [INFO ] [MAIN ] HOV: Loaded 10490 existing records. [2025-09-16T18:50:05.737385] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:50:05.787749] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-09-16T18:50:05.798489] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-09-16T18:50:05.859216] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-09-16T18:50:05.878764] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:50:05.879006] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-09-16T18:50:05.880290] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-09-16T18:50:05.880053] [DEBUG] [LOCAL ] HP: Loaded 38311 existing records from primary storage. [2025-09-16T18:50:05.880523] [INFO ] [MAIN ] HP: Loaded 38311 existing records. [2025-09-16T18:50:05.891598] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-09-16T18:50:05.971625] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-09-16T18:50:05.977467] [DEBUG] [LOCAL ] HPE: Loaded 39657 existing records from primary storage. [2025-09-16T18:50:05.991152] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-09-16T18:50:06.021853] [INFO ] [MAIN ] HPE: Loaded 39657 existing records. [2025-09-16T18:50:06.369401] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:50:06.549173] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-09-16T18:50:06.633632] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-09-16T18:50:06.741891] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-09-16T18:50:06.802114] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-09-16T18:50:06.791786] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:50:06.852992] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-09-16T18:50:06.911615] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-09-16T18:50:06.953714] [INFO ] [REMOTE ] HPF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:50:06.982096] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-09-16T18:50:06.981803] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-09-16T18:50:07.030177] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-09-16T18:50:07.115376] [INFO ] [REMOTE ] HOV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:50:07.137194] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-09-16T18:50:07.633346] [INFO ] [REMOTE ] HP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:50:07.644127] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-09-16T18:50:07.723041] [INFO ] [REMOTE ] HPE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:50:07.723403] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-09-16T18:50:07.728895] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-16T18:50:07.730714] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-09-16T18:50:07.994394] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-16T18:50:07.997192] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-09-16T18:50:08.350211] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-16T18:50:08.353563] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-09-16T18:50:08.713373] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-16T18:50:08.716382] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-09-16T18:50:09.138244] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-16T18:50:09.152789] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-09-16T18:50:09.153499] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-16T18:50:09.174867] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-09-16T18:50:09.309473] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-16T18:50:09.654921] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-16T18:50:09.693636] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-16T18:50:09.974950] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-09-16T18:50:10.774915] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-09-16T18:50:10.868838] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-16T18:50:10.900000] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-16T18:50:11.574986] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-09-16T18:50:12.374899] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-09-16T18:50:12.450134] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-16T18:50:12.895113] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-16T18:50:13.174950] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-09-16T18:50:13.974915] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-09-16T18:50:14.020176] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-16T18:50:14.104714] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-16T18:50:14.774929] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-09-16T18:50:15.574887] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-09-16T18:50:15.777194] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-16T18:50:15.993182] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-16T18:50:15.992974] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-16T18:50:16.374944] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-09-16T18:50:17.174894] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-09-16T18:50:17.974937] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-09-16T18:50:18.268111] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-16T18:50:18.272962] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-16T18:50:18.288456] [INFO ] [REMOTE ] HPF: Full fetch complete (7740 records). [2025-09-16T18:50:18.289267] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-09-16T18:50:18.780341] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-09-16T18:50:18.881950] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-09-16T18:50:18.882044] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-09-16T18:50:18.882314] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-09-16T18:50:18.882358] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-09-16T18:50:18.883029] [DEBUG] [LOCAL ] HPF: Trimmed 7740 records to 5625 (keeping 150 days of data) [2025-09-16T18:50:18.929441] [DEBUG] [LOCAL ] HPF: Primary data saved (5625 records). [2025-09-16T18:50:18.929623] [INFO ] [MAIN ] HPF: Full history saved. [2025-09-16T18:50:18.929768] [INFO ] [MAIN ] Update Progress: 1041/2369 symbols completed. HPF took 14.2s. Estimated remaining: 2h 20m 40s. Rate: 9.4 symbols/min [2025-09-16T18:50:19.177327] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:50:19.187570] [DEBUG] [LOCAL ] HPI: Loaded 7603 existing records from primary storage. [2025-09-16T18:50:19.187762] [INFO ] [MAIN ] HPI: Loaded 7603 existing records. [2025-09-16T18:50:19.417467] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:50:19.417957] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-09-16T18:50:19.418030] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-09-16T18:50:19.418687] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-09-16T18:50:19.418809] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-09-16T18:50:19.589360] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-09-16T18:50:19.776506] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-16T18:50:19.865861] [INFO ] [REMOTE ] HPI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:50:20.374905] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-09-16T18:50:20.465461] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-16T18:50:20.679967] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-16T18:50:21.174917] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-09-16T18:50:21.974895] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-09-16T18:50:22.148506] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-16T18:50:22.237607] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-16T18:50:22.774920] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-09-16T18:50:23.374735] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-16T18:50:23.574911] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-09-16T18:50:23.855448] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-16T18:50:24.374942] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-09-16T18:50:24.541380] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-16T18:50:24.543406] [INFO ] [REMOTE ] HOV: Full fetch complete (14859 records). [2025-09-16T18:50:24.543483] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-09-16T18:50:24.909312] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-09-16T18:50:24.909418] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-09-16T18:50:24.909969] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-09-16T18:50:24.910039] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-09-16T18:50:24.910985] [DEBUG] [LOCAL ] HOV: Trimmed 14859 records to 10592 (keeping 150 days of data) [2025-09-16T18:50:24.986357] [DEBUG] [LOCAL ] HOV: Primary data saved (10592 records). [2025-09-16T18:50:24.986513] [INFO ] [MAIN ] HOV: Full history saved. [2025-09-16T18:50:24.986630] [INFO ] [MAIN ] Update Progress: 1042/2369 symbols completed. HOV took 20.3s. Estimated remaining: 2h 20m 33s. Rate: 9.4 symbols/min [2025-09-16T18:50:25.188591] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-09-16T18:50:25.199933] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:50:25.200904] [DEBUG] [LOCAL ] HPP: No existing data file found in primary storage. [2025-09-16T18:50:25.200946] [WARN ] [MAIN ] HPP: No existing data found, performing full refresh instead. [2025-09-16T18:50:25.201086] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-09-16T18:50:25.201127] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-09-16T18:50:25.201168] [DEBUG] [LOCAL ] HPP: No primary data file found to delete. [2025-09-16T18:50:25.201217] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-09-16T18:50:25.555231] [INFO ] [REMOTE ] HPP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:50:25.838524] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-16T18:50:25.974906] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-09-16T18:50:26.307553] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-16T18:50:26.774936] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-09-16T18:50:26.792928] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-16T18:50:27.574908] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-09-16T18:50:28.374920] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-09-16T18:50:28.501212] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-16T18:50:29.075688] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-16T18:50:29.174909] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-09-16T18:50:29.974873] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-09-16T18:50:30.379734] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-16T18:50:30.387080] [INFO ] [REMOTE ] HPE: Full fetch complete (58377 records). [2025-09-16T18:50:30.387235] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-09-16T18:50:30.782393] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-09-16T18:50:30.785775] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-09-16T18:50:30.790128] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-09-16T18:50:30.793477] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-09-16T18:50:30.794333] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-09-16T18:50:30.794720] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-16T18:50:30.798302] [DEBUG] [LOCAL ] HPE: Trimmed 58377 records to 40047 (keeping 150 days of data) [2025-09-16T18:50:31.051935] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-16T18:50:31.086184] [DEBUG] [LOCAL ] HPE: Primary data saved (40047 records). [2025-09-16T18:50:31.086309] [INFO ] [MAIN ] HPE: Full history saved. [2025-09-16T18:50:31.086423] [INFO ] [MAIN ] Update Progress: 1043/2369 symbols completed. HPE took 26.4s. Estimated remaining: 2h 20m 26s. Rate: 9.4 symbols/min [2025-09-16T18:50:31.297212] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:50:31.334911] [DEBUG] [LOCAL ] HPQ: Loaded 39632 existing records from primary storage. [2025-09-16T18:50:31.335059] [INFO ] [MAIN ] HPQ: Loaded 39632 existing records. [2025-09-16T18:50:31.514778] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:50:31.515065] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-09-16T18:50:31.515121] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-09-16T18:50:31.516096] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-09-16T18:50:31.516150] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-09-16T18:50:31.580064] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-09-16T18:50:31.880563] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:50:32.380001] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-09-16T18:50:32.396834] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-16T18:50:32.413152] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-16T18:50:33.174896] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-09-16T18:50:33.890726] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-16T18:50:33.896931] [INFO ] [REMOTE ] HP: Full fetch complete (56250 records). [2025-09-16T18:50:33.897074] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-09-16T18:50:33.979315] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-09-16T18:50:34.106911] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-16T18:50:34.306240] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-09-16T18:50:34.306326] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-09-16T18:50:34.307100] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-09-16T18:50:34.307147] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-09-16T18:50:34.308549] [DEBUG] [LOCAL ] HP: Trimmed 56250 records to 38678 (keeping 150 days of data) [2025-09-16T18:50:34.551297] [DEBUG] [LOCAL ] HP: Primary data saved (38678 records). [2025-09-16T18:50:34.551449] [INFO ] [MAIN ] HP: Full history saved. [2025-09-16T18:50:34.551563] [INFO ] [MAIN ] Update Progress: 1044/2369 symbols completed. HP took 29.8s. Estimated remaining: 2h 20m 16s. Rate: 9.4 symbols/min [2025-09-16T18:50:34.725178] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:50:34.734367] [DEBUG] [LOCAL ] HPS: Loaded 7654 existing records from primary storage. [2025-09-16T18:50:34.734467] [INFO ] [MAIN ] HPS: Loaded 7654 existing records. [2025-09-16T18:50:34.780116] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-09-16T18:50:34.914370] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:50:34.914614] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-09-16T18:50:34.914688] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-09-16T18:50:34.914998] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-09-16T18:50:34.915042] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-09-16T18:50:35.267399] [INFO ] [REMOTE ] HPS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:50:35.574874] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-09-16T18:50:35.640206] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-16T18:50:35.687888] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-16T18:50:36.141881] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-16T18:50:36.374906] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-09-16T18:50:37.174900] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-09-16T18:50:37.974903] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-09-16T18:50:38.324710] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-16T18:50:38.756356] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-16T18:50:38.774871] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-09-16T18:50:38.833174] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-16T18:50:39.500983] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-16T18:50:39.574898] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-09-16T18:50:40.374896] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-09-16T18:50:40.869589] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-16T18:50:41.174916] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-09-16T18:50:41.234106] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-16T18:50:41.974886] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-09-16T18:50:42.774865] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-09-16T18:50:43.317545] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-16T18:50:43.577114] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-09-16T18:50:43.579687] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-16T18:50:43.597626] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-16T18:50:44.374900] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-09-16T18:50:45.174960] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-09-16T18:50:45.527138] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-16T18:50:45.978003] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-09-16T18:50:45.979913] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-16T18:50:46.205251] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-16T18:50:46.774928] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-09-16T18:50:46.992961] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-16T18:50:46.995611] [INFO ] [REMOTE ] HPI: Full fetch complete (10279 records). [2025-09-16T18:50:46.995706] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-09-16T18:50:47.352520] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-09-16T18:50:47.352598] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-09-16T18:50:47.352848] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-09-16T18:50:47.352893] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-09-16T18:50:47.353353] [DEBUG] [LOCAL ] HPI: Trimmed 10279 records to 7756 (keeping 150 days of data) [2025-09-16T18:50:47.406790] [DEBUG] [LOCAL ] HPI: Primary data saved (7756 records). [2025-09-16T18:50:47.406937] [INFO ] [MAIN ] HPI: Full history saved. [2025-09-16T18:50:47.407028] [INFO ] [MAIN ] Update Progress: 1045/2369 symbols completed. HPI took 28.5s. Estimated remaining: 2h 20m 18s. Rate: 9.4 symbols/min [2025-09-16T18:50:47.580022] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-09-16T18:50:47.581676] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:50:47.603315] [DEBUG] [LOCAL ] HQH: Loaded 18689 existing records from primary storage. [2025-09-16T18:50:47.603464] [INFO ] [MAIN ] HQH: Loaded 18689 existing records. [2025-09-16T18:50:47.777941] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:50:47.778156] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-09-16T18:50:47.778203] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-09-16T18:50:47.778725] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-09-16T18:50:47.778781] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-09-16T18:50:48.126984] [INFO ] [REMOTE ] HQH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:50:48.374858] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-09-16T18:50:48.419280] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-16T18:50:49.174947] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-09-16T18:50:49.475741] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-16T18:50:49.500593] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-16T18:50:49.944982] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-16T18:50:49.974850] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-09-16T18:50:50.774892] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-09-16T18:50:50.912274] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-16T18:50:50.913916] [INFO ] [REMOTE ] HPS: Full fetch complete (11369 records). [2025-09-16T18:50:50.914003] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-09-16T18:50:51.269696] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-09-16T18:50:51.269774] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-09-16T18:50:51.270043] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-09-16T18:50:51.270083] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-09-16T18:50:51.270522] [DEBUG] [LOCAL ] HPS: Trimmed 11369 records to 7704 (keeping 150 days of data) [2025-09-16T18:50:51.319057] [DEBUG] [LOCAL ] HPS: Primary data saved (7704 records). [2025-09-16T18:50:51.319157] [INFO ] [MAIN ] HPS: Full history saved. [2025-09-16T18:50:51.319236] [INFO ] [MAIN ] Update Progress: 1046/2369 symbols completed. HPS took 16.8s. Estimated remaining: 2h 20m 9s. Rate: 9.4 symbols/min [2025-09-16T18:50:51.487747] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:50:51.499879] [DEBUG] [LOCAL ] HQL: Loaded 11683 existing records from primary storage. [2025-09-16T18:50:51.499999] [INFO ] [MAIN ] HQL: Loaded 11683 existing records. [2025-09-16T18:50:51.580062] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-09-16T18:50:51.677406] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:50:51.677687] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-09-16T18:50:51.677737] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-09-16T18:50:51.678173] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-09-16T18:50:51.678219] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-09-16T18:50:52.029628] [INFO ] [REMOTE ] HQL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:50:52.374909] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-09-16T18:50:52.812880] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-16T18:50:53.174982] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-09-16T18:50:53.281882] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-16T18:50:53.288879] [INFO ] [REMOTE ] HPP: Full fetch complete (54970 records). [2025-09-16T18:50:53.289014] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-09-16T18:50:53.530560] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-16T18:50:53.694188] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-09-16T18:50:53.694271] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-09-16T18:50:53.695091] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-09-16T18:50:53.695138] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-09-16T18:50:53.696307] [DEBUG] [LOCAL ] HPP: Trimmed 54970 records to 38143 (keeping 150 days of data) [2025-09-16T18:50:53.920470] [DEBUG] [LOCAL ] HPP: Primary data saved (38143 records). [2025-09-16T18:50:53.920627] [INFO ] [MAIN ] HPP: Full history saved. [2025-09-16T18:50:53.920729] [INFO ] [MAIN ] Update Progress: 1047/2369 symbols completed. HPP took 28.9s. Estimated remaining: 2h 19m 58s. Rate: 9.4 symbols/min [2025-09-16T18:50:53.985250] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-09-16T18:50:54.097040] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:50:54.112163] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-16T18:50:54.153154] [DEBUG] [LOCAL ] HR: Loaded 38391 existing records from primary storage. [2025-09-16T18:50:54.153351] [INFO ] [MAIN ] HR: Loaded 38391 existing records. [2025-09-16T18:50:54.340026] [WARN ] [MAIN ] HR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:50:54.340320] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-09-16T18:50:54.340370] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-09-16T18:50:54.341291] [DEBUG] [LOCAL ] HR: Deleted primary data file. [2025-09-16T18:50:54.341341] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-09-16T18:50:54.694935] [INFO ] [REMOTE ] HR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:50:54.774849] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-09-16T18:50:54.842239] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-16T18:50:55.574939] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-09-16T18:50:56.373402] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-16T18:50:56.376906] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-09-16T18:50:56.692937] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-16T18:50:57.174898] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-09-16T18:50:57.974940] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-09-16T18:50:58.434084] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-16T18:50:58.645753] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-16T18:50:58.774904] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-09-16T18:50:58.906535] [DEBUG] [REMOTE ] HR: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-09-16T18:50:58.906889] [WARN ] [REMOTE ] HR: No data returned for month 2025-04 [2025-09-16T18:50:58.987217] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-16T18:50:59.574927] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-09-16T18:51:00.374951] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-09-16T18:51:00.528974] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-16T18:51:01.174920] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-09-16T18:51:01.974970] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-09-16T18:51:02.130402] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-16T18:51:02.154314] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-16T18:51:02.774911] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-09-16T18:51:02.971413] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-16T18:51:03.574925] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-09-16T18:51:03.859898] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-16T18:51:04.374890] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-09-16T18:51:04.685312] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-16T18:51:05.174916] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-09-16T18:51:05.974943] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-09-16T18:51:06.432846] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-16T18:51:06.441989] [INFO ] [REMOTE ] HPQ: Full fetch complete (58347 records). [2025-09-16T18:51:06.442172] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-09-16T18:51:06.727782] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-16T18:51:06.785236] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-09-16T18:51:06.883743] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-09-16T18:51:06.883916] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-09-16T18:51:06.884914] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-09-16T18:51:06.884982] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-09-16T18:51:06.886604] [DEBUG] [LOCAL ] HPQ: Trimmed 58347 records to 40021 (keeping 150 days of data) [2025-09-16T18:51:07.021582] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-16T18:51:07.214183] [DEBUG] [LOCAL ] HPQ: Primary data saved (40021 records). [2025-09-16T18:51:07.214320] [INFO ] [MAIN ] HPQ: Full history saved. [2025-09-16T18:51:07.214406] [INFO ] [MAIN ] Update Progress: 1048/2369 symbols completed. HPQ took 36.1s. Estimated remaining: 2h 20m 0s. Rate: 9.4 symbols/min [2025-09-16T18:51:07.395187] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:51:07.428809] [DEBUG] [LOCAL ] HRB: Loaded 35716 existing records from primary storage. [2025-09-16T18:51:07.428957] [INFO ] [MAIN ] HRB: Loaded 35716 existing records. [2025-09-16T18:51:07.587599] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-09-16T18:51:07.629161] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:51:07.629399] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-09-16T18:51:07.629446] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-09-16T18:51:07.630341] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-09-16T18:51:07.630391] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-09-16T18:51:07.956473] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-16T18:51:07.961671] [INFO ] [REMOTE ] HQL: Full fetch complete (17804 records). [2025-09-16T18:51:07.972217] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-09-16T18:51:08.112926] [INFO ] [REMOTE ] HRB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:51:08.381668] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-09-16T18:51:08.407764] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-09-16T18:51:08.407849] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-09-16T18:51:08.408233] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-09-16T18:51:08.408273] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-09-16T18:51:08.408855] [DEBUG] [LOCAL ] HQL: Trimmed 17804 records to 11773 (keeping 150 days of data) [2025-09-16T18:51:08.483624] [DEBUG] [LOCAL ] HQL: Primary data saved (11773 records). [2025-09-16T18:51:08.483768] [INFO ] [MAIN ] HQL: Full history saved. [2025-09-16T18:51:08.483852] [INFO ] [MAIN ] Update Progress: 1049/2369 symbols completed. HQL took 17.2s. Estimated remaining: 2h 19m 47s. Rate: 9.4 symbols/min [2025-09-16T18:51:08.653694] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:51:08.677256] [DEBUG] [LOCAL ] HRI: Loaded 23844 existing records from primary storage. [2025-09-16T18:51:08.677394] [INFO ] [MAIN ] HRI: Loaded 23844 existing records. [2025-09-16T18:51:08.854873] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:51:08.855144] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-09-16T18:51:08.855205] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-09-16T18:51:08.855940] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-09-16T18:51:08.856003] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-09-16T18:51:09.204214] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-09-16T18:51:09.210598] [INFO ] [REMOTE ] HRI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:51:09.227508] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-16T18:51:09.974926] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-09-16T18:51:10.178797] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-16T18:51:10.774877] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-09-16T18:51:10.816298] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-16T18:51:11.225037] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-16T18:51:11.574972] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-09-16T18:51:12.374981] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-09-16T18:51:12.560755] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-16T18:51:13.174908] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-09-16T18:51:13.258713] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-16T18:51:13.442213] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-16T18:51:13.447036] [INFO ] [REMOTE ] HQH: Full fetch complete (27271 records). [2025-09-16T18:51:13.447236] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-09-16T18:51:13.823607] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-09-16T18:51:13.823702] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-09-16T18:51:13.824252] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-09-16T18:51:13.824294] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-09-16T18:51:13.824998] [DEBUG] [LOCAL ] HQH: Trimmed 27271 records to 18896 (keeping 150 days of data) [2025-09-16T18:51:13.944463] [DEBUG] [LOCAL ] HQH: Primary data saved (18896 records). [2025-09-16T18:51:13.944614] [INFO ] [MAIN ] HQH: Full history saved. [2025-09-16T18:51:13.944843] [INFO ] [MAIN ] Update Progress: 1050/2369 symbols completed. HQH took 26.5s. Estimated remaining: 2h 19m 40s. Rate: 9.4 symbols/min [2025-09-16T18:51:13.980031] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-09-16T18:51:14.119708] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:51:14.119910] [DEBUG] [LOCAL ] HRL: No existing data file found in primary storage. [2025-09-16T18:51:14.119950] [WARN ] [MAIN ] HRL: No existing data found, performing full refresh instead. [2025-09-16T18:51:14.120072] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-09-16T18:51:14.120115] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-09-16T18:51:14.120157] [DEBUG] [LOCAL ] HRL: No primary data file found to delete. [2025-09-16T18:51:14.120190] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-09-16T18:51:14.474944] [INFO ] [REMOTE ] HRL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:51:14.774964] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-09-16T18:51:14.951594] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-16T18:51:14.958032] [INFO ] [REMOTE ] HR: Full fetch complete (48443 records). [2025-09-16T18:51:14.958135] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-09-16T18:51:15.185472] [WARN ] [VALIDATOR ] HR: Validation failed - insufficient historical data. Have 129 unique days, need 150 days [2025-09-16T18:51:15.186097] [FATAL] [MAIN ] HR: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:51:15.186154] [WARN ] [MAIN ] HR: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:51:15.186201] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-09-16T18:51:15.186267] [DEBUG] [LOCAL ] HR: No primary data file found to delete. [2025-09-16T18:51:15.186305] [INFO ] [LOCAL ] HR: Starting deletion of derivative data. [2025-09-16T18:51:15.186687] [DEBUG] [LOCAL ] HR: Deleted derivative data file. [2025-09-16T18:51:15.186783] [INFO ] [MAIN ] Update Progress: 1051/2369 symbols completed. HR took 21.3s. Estimated remaining: 2h 19m 27s. Rate: 9.5 symbols/min [2025-09-16T18:51:15.358767] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:51:15.383397] [DEBUG] [LOCAL ] HRTG: Loaded 25072 existing records from primary storage. [2025-09-16T18:51:15.383598] [INFO ] [MAIN ] HRTG: Loaded 25072 existing records. [2025-09-16T18:51:15.567987] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:51:15.568309] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-09-16T18:51:15.568432] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-09-16T18:51:15.569210] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-09-16T18:51:15.569263] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-09-16T18:51:15.577006] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-09-16T18:51:15.941045] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-16T18:51:16.006973] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:51:16.374880] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-09-16T18:51:16.483318] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-16T18:51:16.681727] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-16T18:51:17.174935] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-09-16T18:51:17.762445] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-16T18:51:17.974911] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-09-16T18:51:18.774949] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-09-16T18:51:19.018220] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-16T18:51:19.413704] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-16T18:51:19.461828] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-16T18:51:19.574901] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-09-16T18:51:20.374861] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-09-16T18:51:20.735302] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-16T18:51:21.174903] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-09-16T18:51:21.548916] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-16T18:51:21.974899] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-09-16T18:51:22.516355] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-16T18:51:22.774920] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-09-16T18:51:23.532516] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-16T18:51:23.574859] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-09-16T18:51:24.260182] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-16T18:51:24.374911] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-09-16T18:51:24.938377] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-16T18:51:25.174908] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-09-16T18:51:25.788817] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-16T18:51:25.974868] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-09-16T18:51:26.610829] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-16T18:51:26.774889] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-09-16T18:51:27.088362] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-16T18:51:27.574967] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-09-16T18:51:28.112709] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-16T18:51:28.374923] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-09-16T18:51:29.174882] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-09-16T18:51:29.243600] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-16T18:51:29.683342] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-16T18:51:29.974909] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-09-16T18:51:30.180554] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-16T18:51:30.774889] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-09-16T18:51:31.574873] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-09-16T18:51:31.752279] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-16T18:51:31.809147] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-16T18:51:32.374948] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-09-16T18:51:32.725532] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-16T18:51:32.729436] [INFO ] [REMOTE ] HRTG: Full fetch complete (33787 records). [2025-09-16T18:51:32.729531] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-09-16T18:51:33.101151] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-09-16T18:51:33.101246] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-09-16T18:51:33.101866] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-09-16T18:51:33.101915] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-09-16T18:51:33.102944] [DEBUG] [LOCAL ] HRTG: Trimmed 33787 records to 25347 (keeping 150 days of data) [2025-09-16T18:51:33.188156] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-09-16T18:51:33.255944] [DEBUG] [LOCAL ] HRTG: Primary data saved (25347 records). [2025-09-16T18:51:33.256086] [INFO ] [MAIN ] HRTG: Full history saved. [2025-09-16T18:51:33.256177] [INFO ] [MAIN ] Update Progress: 1052/2369 symbols completed. HRTG took 18.1s. Estimated remaining: 2h 19m 35s. Rate: 9.4 symbols/min [2025-09-16T18:51:33.446760] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:51:33.459308] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-16T18:51:33.463863] [INFO ] [REMOTE ] HRI: Full fetch complete (36723 records). [2025-09-16T18:51:33.464093] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-09-16T18:51:33.711609] [DEBUG] [LOCAL ] HSBC: Loaded 37442 existing records from primary storage. [2025-09-16T18:51:33.776468] [INFO ] [MAIN ] HSBC: Loaded 37442 existing records. [2025-09-16T18:51:33.976296] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-09-16T18:51:34.101237] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-09-16T18:51:34.101526] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-09-16T18:51:34.101445] [WARN ] [MAIN ] HSBC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:51:34.102380] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-09-16T18:51:34.102451] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-09-16T18:51:34.102868] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-09-16T18:51:34.103246] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-09-16T18:51:34.103855] [DEBUG] [LOCAL ] HRI: Trimmed 36723 records to 24045 (keeping 150 days of data) [2025-09-16T18:51:34.104568] [DEBUG] [LOCAL ] HSBC: Deleted primary data file. [2025-09-16T18:51:34.104702] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-09-16T18:51:34.591732] [DEBUG] [LOCAL ] HRI: Primary data saved (24045 records). [2025-09-16T18:51:34.591880] [INFO ] [MAIN ] HRI: Full history saved. [2025-09-16T18:51:34.592226] [INFO ] [MAIN ] Update Progress: 1053/2369 symbols completed. HRI took 26.1s. Estimated remaining: 2h 19m 23s. Rate: 9.4 symbols/min [2025-09-16T18:51:34.768126] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:51:34.780335] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-09-16T18:51:34.860391] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:51:34.872546] [DEBUG] [LOCAL ] HSHP: Loaded 10106 existing records from primary storage. [2025-09-16T18:51:34.872719] [INFO ] [MAIN ] HSHP: Loaded 10106 existing records. [2025-09-16T18:51:35.053832] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:51:35.054276] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-09-16T18:51:35.054394] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-09-16T18:51:35.054831] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-09-16T18:51:35.054882] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-09-16T18:51:35.444221] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:51:35.446773] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-16T18:51:35.574887] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-09-16T18:51:35.738865] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-16T18:51:35.744924] [INFO ] [REMOTE ] HRB: Full fetch complete (52889 records). [2025-09-16T18:51:35.745032] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-09-16T18:51:36.126877] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-09-16T18:51:36.126952] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-09-16T18:51:36.127687] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-09-16T18:51:36.127733] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-09-16T18:51:36.128791] [DEBUG] [LOCAL ] HRB: Trimmed 52889 records to 36056 (keeping 150 days of data) [2025-09-16T18:51:36.354594] [DEBUG] [LOCAL ] HRB: Primary data saved (36056 records). [2025-09-16T18:51:36.354898] [INFO ] [MAIN ] HRB: Full history saved. [2025-09-16T18:51:36.355003] [INFO ] [MAIN ] Update Progress: 1054/2369 symbols completed. HRB took 29.1s. Estimated remaining: 2h 19m 11s. Rate: 9.4 symbols/min [2025-09-16T18:51:36.387635] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-09-16T18:51:36.532405] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:51:36.574864] [DEBUG] [LOCAL ] HSY: Loaded 37273 existing records from primary storage. [2025-09-16T18:51:36.575043] [INFO ] [MAIN ] HSY: Loaded 37273 existing records. [2025-09-16T18:51:36.755317] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:51:36.755720] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-09-16T18:51:36.755858] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-09-16T18:51:36.765177] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-09-16T18:51:36.778540] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-09-16T18:51:36.853475] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-16T18:51:37.165580] [INFO ] [REMOTE ] HSY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:51:37.185845] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-09-16T18:51:37.215315] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-16T18:51:37.576604] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-16T18:51:37.974937] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-09-16T18:51:38.774936] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-09-16T18:51:39.238389] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-16T18:51:39.574904] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-09-16T18:51:40.001853] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-16T18:51:40.374913] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-09-16T18:51:40.512566] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-16T18:51:40.643584] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-16T18:51:41.174910] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-09-16T18:51:41.951003] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-16T18:51:41.982149] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-09-16T18:51:41.987690] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-16T18:51:42.774934] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-09-16T18:51:43.578239] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-09-16T18:51:43.578094] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-16T18:51:43.708339] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-16T18:51:44.374912] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-09-16T18:51:45.174872] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-09-16T18:51:45.417951] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-16T18:51:45.425001] [INFO ] [REMOTE ] HRL: Full fetch complete (57725 records). [2025-09-16T18:51:45.425200] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-09-16T18:51:45.765903] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-16T18:51:45.841289] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-09-16T18:51:45.841374] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-09-16T18:51:45.842217] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-09-16T18:51:45.842287] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-09-16T18:51:45.843524] [DEBUG] [LOCAL ] HRL: Trimmed 57725 records to 39585 (keeping 150 days of data) [2025-09-16T18:51:46.022067] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-09-16T18:51:46.093840] [DEBUG] [LOCAL ] HRL: Primary data saved (39585 records). [2025-09-16T18:51:46.094032] [INFO ] [MAIN ] HRL: Full history saved. [2025-09-16T18:51:46.094118] [INFO ] [MAIN ] Update Progress: 1055/2369 symbols completed. HRL took 32.1s. Estimated remaining: 2h 19m 9s. Rate: 9.4 symbols/min [2025-09-16T18:51:46.265254] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:51:46.265469] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-09-16T18:51:46.265507] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-09-16T18:51:46.265631] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-09-16T18:51:46.265693] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-16T18:51:46.265736] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-09-16T18:51:46.265771] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-09-16T18:51:46.625599] [INFO ] [REMOTE ] HTB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:51:46.774969] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-02. [2025-09-16T18:51:47.031928] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-09-16T18:51:47.081332] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-16T18:51:47.574930] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-03. [2025-09-16T18:51:48.204134] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-16T18:51:48.220571] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-16T18:51:48.374895] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-09-16T18:51:49.174898] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-09-16T18:51:49.974921] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-09-16T18:51:50.343739] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-16T18:51:50.364246] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-16T18:51:50.774897] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-04. [2025-09-16T18:51:51.519621] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-16T18:51:51.535865] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-16T18:51:51.574850] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-09-16T18:51:52.374906] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-09-16T18:51:53.173880] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-16T18:51:53.176803] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-09-16T18:51:53.465185] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-16T18:51:53.974902] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-09-16T18:51:54.774870] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-09-16T18:51:54.906661] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-16T18:51:54.908992] [INFO ] [REMOTE ] HSHP: Full fetch complete (17524 records). [2025-09-16T18:51:54.909082] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-09-16T18:51:55.272404] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-09-16T18:51:55.272500] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-09-16T18:51:55.273021] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-09-16T18:51:55.273100] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-09-16T18:51:55.273848] [DEBUG] [LOCAL ] HSHP: Trimmed 17524 records to 10229 (keeping 150 days of data) [2025-09-16T18:51:55.355142] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-16T18:51:55.375615] [DEBUG] [LOCAL ] HSHP: Primary data saved (10229 records). [2025-09-16T18:51:55.375773] [INFO ] [MAIN ] HSHP: Full history saved. [2025-09-16T18:51:55.375864] [INFO ] [MAIN ] Update Progress: 1056/2369 symbols completed. HSHP took 20.8s. Estimated remaining: 2h 19m 6s. Rate: 9.4 symbols/min [2025-09-16T18:51:55.547990] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:51:55.558424] [DEBUG] [LOCAL ] HTD: Loaded 9858 existing records from primary storage. [2025-09-16T18:51:55.558531] [INFO ] [MAIN ] HTD: Loaded 9858 existing records. [2025-09-16T18:51:55.580051] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-05. [2025-09-16T18:51:55.741196] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:51:55.741460] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-09-16T18:51:55.741507] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-09-16T18:51:55.741969] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-09-16T18:51:55.742020] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-09-16T18:51:56.114884] [INFO ] [REMOTE ] HTD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:51:56.367105] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-16T18:51:56.374834] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-06. [2025-09-16T18:51:56.453612] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-16T18:51:57.085463] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-16T18:51:57.174872] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-09-16T18:51:57.974949] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-09-16T18:51:58.777036] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-07. [2025-09-16T18:51:58.779725] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-16T18:51:59.102932] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-16T18:51:59.514822] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-16T18:51:59.574846] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-08. [2025-09-16T18:52:00.293590] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-16T18:52:00.374897] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-09-16T18:52:01.174914] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-09. [2025-09-16T18:52:01.940779] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-16T18:52:01.943113] [INFO ] [REMOTE ] HTB: Full fetch complete (7011 records). [2025-09-16T18:52:01.943239] [DEBUG] [VALIDATOR ] HTB: Validating primary data. [2025-09-16T18:52:01.980001] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-09-16T18:52:02.132543] [WARN ] [VALIDATOR ] HTB: Validation failed - insufficient historical data. Have 138 unique days, need 150 days [2025-09-16T18:52:02.132787] [FATAL] [MAIN ] HTB: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:52:02.132838] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:52:02.132879] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-16T18:52:02.132957] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-09-16T18:52:02.132994] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-09-16T18:52:02.133034] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-09-16T18:52:02.133110] [INFO ] [MAIN ] Update Progress: 1057/2369 symbols completed. HTB took 16.0s. Estimated remaining: 2h 19m 0s. Rate: 9.4 symbols/min [2025-09-16T18:52:02.300292] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:52:02.300519] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-09-16T18:52:02.300662] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-09-16T18:52:02.300908] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-09-16T18:52:02.300977] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-16T18:52:02.301028] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-09-16T18:52:02.301200] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-09-16T18:52:02.449635] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-16T18:52:02.513480] [INFO ] [REMOTE ] HSBC: Full fetch complete (55800 records). [2025-09-16T18:52:02.583620] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-09-16T18:52:02.793238] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-09-16T18:52:02.796428] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:52:03.087013] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-16T18:52:03.089944] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-09-16T18:52:03.094694] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-09-16T18:52:03.096008] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-09-16T18:52:03.096564] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-09-16T18:52:03.097781] [DEBUG] [LOCAL ] HSBC: Trimmed 55800 records to 37817 (keeping 150 days of data) [2025-09-16T18:52:03.331216] [DEBUG] [LOCAL ] HSBC: Primary data saved (37817 records). [2025-09-16T18:52:03.331382] [INFO ] [MAIN ] HSBC: Full history saved. [2025-09-16T18:52:03.331480] [INFO ] [MAIN ] Update Progress: 1058/2369 symbols completed. HSBC took 30.1s. Estimated remaining: 2h 18m 47s. Rate: 9.4 symbols/min [2025-09-16T18:52:03.500415] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:52:03.534541] [DEBUG] [LOCAL ] HTGC: Loaded 34840 existing records from primary storage. [2025-09-16T18:52:03.534755] [INFO ] [MAIN ] HTGC: Loaded 34840 existing records. [2025-09-16T18:52:03.580121] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-09-16T18:52:03.771512] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:52:03.771916] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-09-16T18:52:03.772001] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-09-16T18:52:03.773075] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-09-16T18:52:03.773152] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-09-16T18:52:04.287254] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:52:04.374994] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-09-16T18:52:04.710215] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-16T18:52:04.745673] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-16T18:52:04.749718] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-16T18:52:05.174896] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-09-16T18:52:05.491742] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-16T18:52:05.974920] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-09-16T18:52:06.774922] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-09-16T18:52:07.574878] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-09-16T18:52:07.602906] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-16T18:52:07.707508] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-16T18:52:07.874962] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-09-16T18:52:08.374956] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-09-16T18:52:09.174921] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-09-16T18:52:09.974936] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-09-16T18:52:10.034595] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-16T18:52:10.198921] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-16T18:52:10.774901] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-09-16T18:52:11.574885] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-09-16T18:52:11.730535] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-16T18:52:11.783752] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-16T18:52:11.824760] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-09-16T18:52:12.374913] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-09-16T18:52:12.685383] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-16T18:52:13.174915] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-09-16T18:52:13.839688] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-16T18:52:13.974925] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-09-16T18:52:14.774919] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-09-16T18:52:14.968861] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-16T18:52:14.970998] [INFO ] [REMOTE ] HTD: Full fetch complete (14266 records). [2025-09-16T18:52:14.971070] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-09-16T18:52:15.335288] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-09-16T18:52:15.335360] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-09-16T18:52:15.335680] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-09-16T18:52:15.335724] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-09-16T18:52:15.336307] [DEBUG] [LOCAL ] HTD: Trimmed 14266 records to 10000 (keeping 150 days of data) [2025-09-16T18:52:15.398101] [DEBUG] [LOCAL ] HTD: Primary data saved (10000 records). [2025-09-16T18:52:15.398229] [INFO ] [MAIN ] HTD: Full history saved. [2025-09-16T18:52:15.398323] [INFO ] [MAIN ] Update Progress: 1059/2369 symbols completed. HTD took 20.0s. Estimated remaining: 2h 18m 48s. Rate: 9.4 symbols/min [2025-09-16T18:52:15.572502] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:52:15.574879] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-09-16T18:52:15.597580] [DEBUG] [LOCAL ] HTH: Loaded 24977 existing records from primary storage. [2025-09-16T18:52:15.597742] [INFO ] [MAIN ] HTH: Loaded 24977 existing records. [2025-09-16T18:52:15.783687] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:52:15.783967] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-09-16T18:52:15.784345] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-09-16T18:52:15.785288] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-09-16T18:52:15.785343] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-09-16T18:52:16.135509] [INFO ] [REMOTE ] HTH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:52:16.374910] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-09-16T18:52:16.504116] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-16T18:52:16.607422] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-09-16T18:52:17.174905] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-09-16T18:52:17.449187] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-16T18:52:17.455258] [INFO ] [REMOTE ] HSY: Full fetch complete (55099 records). [2025-09-16T18:52:17.455396] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-09-16T18:52:17.833162] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-09-16T18:52:17.833239] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-09-16T18:52:17.834018] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-09-16T18:52:17.834067] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-09-16T18:52:17.835132] [DEBUG] [LOCAL ] HSY: Trimmed 55099 records to 37663 (keeping 150 days of data) [2025-09-16T18:52:18.013360] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-09-16T18:52:18.083386] [DEBUG] [LOCAL ] HSY: Primary data saved (37663 records). [2025-09-16T18:52:18.083529] [INFO ] [MAIN ] HSY: Full history saved. [2025-09-16T18:52:18.083663] [INFO ] [MAIN ] Update Progress: 1060/2369 symbols completed. HSY took 41.7s. Estimated remaining: 2h 18m 37s. Rate: 9.4 symbols/min [2025-09-16T18:52:18.253679] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:52:18.279890] [DEBUG] [LOCAL ] HUBB: Loaded 26654 existing records from primary storage. [2025-09-16T18:52:18.280016] [INFO ] [MAIN ] HUBB: Loaded 26654 existing records. [2025-09-16T18:52:18.361728] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-16T18:52:18.459092] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:52:18.459330] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-09-16T18:52:18.459376] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-09-16T18:52:18.460173] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-09-16T18:52:18.460224] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-09-16T18:52:18.778486] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-09-16T18:52:18.843102] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:52:18.866934] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-16T18:52:19.574938] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-09-16T18:52:19.919158] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-16T18:52:19.919903] [INFO ] [REMOTE ] HTFC: Full fetch complete (629 records). [2025-09-16T18:52:19.919972] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-09-16T18:52:20.103678] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 139 unique days, need 150 days [2025-09-16T18:52:20.103847] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:52:20.103895] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:52:20.103953] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-16T18:52:20.104016] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-09-16T18:52:20.104050] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-09-16T18:52:20.104127] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-09-16T18:52:20.104189] [INFO ] [MAIN ] Update Progress: 1061/2369 symbols completed. HTFC took 18.0s. Estimated remaining: 2h 18m 25s. Rate: 9.4 symbols/min [2025-09-16T18:52:20.284293] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:52:20.317339] [DEBUG] [LOCAL ] HUBS: Loaded 28996 existing records from primary storage. [2025-09-16T18:52:20.317477] [INFO ] [MAIN ] HUBS: Loaded 28996 existing records. [2025-09-16T18:52:20.383189] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-09-16T18:52:20.503783] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:52:20.504045] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-09-16T18:52:20.504100] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-09-16T18:52:20.504847] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-09-16T18:52:20.504900] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-09-16T18:52:20.868954] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:52:20.898029] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-16T18:52:21.174869] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-09-16T18:52:21.974917] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-09-16T18:52:22.091506] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-16T18:52:22.579229] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-16T18:52:22.774885] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-09-16T18:52:23.520618] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-16T18:52:23.574871] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-09-16T18:52:24.374922] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-09-16T18:52:24.530306] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-16T18:52:24.840255] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-16T18:52:25.174902] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-09-16T18:52:25.360980] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-16T18:52:25.974902] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-09-16T18:52:26.774912] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-09-16T18:52:26.968094] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-16T18:52:27.574898] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-09-16T18:52:27.712156] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-16T18:52:28.374888] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-09-16T18:52:28.616179] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-16T18:52:29.174899] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-09-16T18:52:29.282791] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-16T18:52:29.981565] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-09-16T18:52:29.986967] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-16T18:52:30.361775] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-16T18:52:30.774927] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-09-16T18:52:31.574905] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-09-16T18:52:31.607527] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-16T18:52:31.613190] [INFO ] [REMOTE ] HTGC: Full fetch complete (51815 records). [2025-09-16T18:52:31.613286] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-09-16T18:52:32.000339] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-09-16T18:52:32.000424] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-09-16T18:52:32.001244] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-09-16T18:52:32.001323] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-09-16T18:52:32.002915] [DEBUG] [LOCAL ] HTGC: Trimmed 51815 records to 35199 (keeping 150 days of data) [2025-09-16T18:52:32.240194] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-16T18:52:32.257526] [DEBUG] [LOCAL ] HTGC: Primary data saved (35199 records). [2025-09-16T18:52:32.257669] [INFO ] [MAIN ] HTGC: Full history saved. [2025-09-16T18:52:32.257812] [INFO ] [MAIN ] Update Progress: 1062/2369 symbols completed. HTGC took 28.9s. Estimated remaining: 2h 18m 26s. Rate: 9.4 symbols/min [2025-09-16T18:52:32.380060] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-09-16T18:52:32.431703] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:52:32.479491] [DEBUG] [LOCAL ] HUM: Loaded 36176 existing records from primary storage. [2025-09-16T18:52:32.479671] [INFO ] [MAIN ] HUM: Loaded 36176 existing records. [2025-09-16T18:52:32.663292] [WARN ] [MAIN ] HUM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:52:32.663599] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-09-16T18:52:32.663674] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-09-16T18:52:32.664602] [DEBUG] [LOCAL ] HUM: Deleted primary data file. [2025-09-16T18:52:32.664688] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-09-16T18:52:33.019294] [INFO ] [REMOTE ] HUM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:52:33.035795] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-16T18:52:33.174866] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-09-16T18:52:33.500402] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-16T18:52:33.974903] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-09-16T18:52:34.459610] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-16T18:52:34.774896] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-09-16T18:52:35.574899] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-09-16T18:52:35.647752] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-16T18:52:35.830323] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-16T18:52:36.374896] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-09-16T18:52:37.174890] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-09-16T18:52:37.220067] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-16T18:52:37.890760] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-16T18:52:37.974890] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-09-16T18:52:38.774892] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-09-16T18:52:38.814372] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-16T18:52:38.973247] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-16T18:52:38.978557] [INFO ] [REMOTE ] HTH: Full fetch complete (36445 records). [2025-09-16T18:52:38.979131] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-09-16T18:52:39.354884] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-09-16T18:52:39.354979] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-09-16T18:52:39.355622] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-09-16T18:52:39.355683] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-09-16T18:52:39.356544] [DEBUG] [LOCAL ] HTH: Trimmed 36445 records to 25177 (keeping 150 days of data) [2025-09-16T18:52:39.514369] [DEBUG] [LOCAL ] HTH: Primary data saved (25177 records). [2025-09-16T18:52:39.514512] [INFO ] [MAIN ] HTH: Full history saved. [2025-09-16T18:52:39.514615] [INFO ] [MAIN ] Update Progress: 1063/2369 symbols completed. HTH took 24.1s. Estimated remaining: 2h 18m 21s. Rate: 9.4 symbols/min [2025-09-16T18:52:39.584608] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-09-16T18:52:39.699307] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:52:39.737752] [DEBUG] [LOCAL ] HUN: Loaded 39242 existing records from primary storage. [2025-09-16T18:52:39.737924] [INFO ] [MAIN ] HUN: Loaded 39242 existing records. [2025-09-16T18:52:39.914617] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:52:39.914861] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-09-16T18:52:39.914908] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-09-16T18:52:39.915748] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-09-16T18:52:39.915802] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-09-16T18:52:40.267727] [INFO ] [REMOTE ] HUN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:52:40.374849] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-09-16T18:52:40.447054] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-16T18:52:41.015296] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-16T18:52:41.174858] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-09-16T18:52:41.974874] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-09-16T18:52:42.023186] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-16T18:52:42.774892] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-09-16T18:52:43.034601] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-16T18:52:43.574886] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-09-16T18:52:43.590069] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-16T18:52:43.596902] [INFO ] [REMOTE ] HUBS: Full fetch complete (43321 records). [2025-09-16T18:52:43.597032] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-09-16T18:52:43.974128] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-09-16T18:52:43.974235] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-09-16T18:52:43.975046] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-09-16T18:52:43.975166] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-09-16T18:52:43.976365] [DEBUG] [LOCAL ] HUBS: Trimmed 43321 records to 29255 (keeping 150 days of data) [2025-09-16T18:52:44.088998] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-16T18:52:44.189781] [DEBUG] [LOCAL ] HUBS: Primary data saved (29255 records). [2025-09-16T18:52:44.189963] [INFO ] [MAIN ] HUBS: Full history saved. [2025-09-16T18:52:44.190085] [INFO ] [MAIN ] Update Progress: 1064/2369 symbols completed. HUBS took 24.1s. Estimated remaining: 2h 18m 13s. Rate: 9.4 symbols/min [2025-09-16T18:52:44.359823] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:52:44.379171] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-09-16T18:52:44.392953] [DEBUG] [LOCAL ] HUYA: Loaded 31968 existing records from primary storage. [2025-09-16T18:52:44.393098] [INFO ] [MAIN ] HUYA: Loaded 31968 existing records. [2025-09-16T18:52:44.568128] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:52:44.568339] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-09-16T18:52:44.568384] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-09-16T18:52:44.568989] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-09-16T18:52:44.569036] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-09-16T18:52:44.920121] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:52:45.175849] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-09-16T18:52:45.181523] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-16T18:52:45.813680] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-16T18:52:45.974906] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-09-16T18:52:46.774906] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-09-16T18:52:46.950433] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-16T18:52:47.574931] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-09-16T18:52:47.654287] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-16T18:52:47.969681] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-16T18:52:47.974336] [INFO ] [REMOTE ] HUBB: Full fetch complete (41273 records). [2025-09-16T18:52:47.974418] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-09-16T18:52:48.351841] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-09-16T18:52:48.351960] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-09-16T18:52:48.352878] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-09-16T18:52:48.352937] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-09-16T18:52:48.354006] [DEBUG] [LOCAL ] HUBB: Trimmed 41273 records to 26937 (keeping 150 days of data) [2025-09-16T18:52:48.428070] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-09-16T18:52:48.547760] [DEBUG] [LOCAL ] HUBB: Primary data saved (26937 records). [2025-09-16T18:52:48.547924] [INFO ] [MAIN ] HUBB: Full history saved. [2025-09-16T18:52:48.548012] [INFO ] [MAIN ] Update Progress: 1065/2369 symbols completed. HUBB took 30.5s. Estimated remaining: 2h 18m 4s. Rate: 9.4 symbols/min [2025-09-16T18:52:48.720178] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:52:48.731826] [DEBUG] [LOCAL ] HVT: Loaded 10975 existing records from primary storage. [2025-09-16T18:52:48.731937] [INFO ] [MAIN ] HVT: Loaded 10975 existing records. [2025-09-16T18:52:48.906018] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:52:48.906474] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-09-16T18:52:48.906601] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-09-16T18:52:48.907071] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-09-16T18:52:48.907132] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-09-16T18:52:49.183830] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-09-16T18:52:49.213811] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-16T18:52:49.304130] [INFO ] [REMOTE ] HVT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:52:49.974944] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-09-16T18:52:50.306598] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-16T18:52:50.774948] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-09-16T18:52:51.078793] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-16T18:52:51.475664] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-16T18:52:51.574855] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-09-16T18:52:52.379998] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-09-16T18:52:52.397126] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-16T18:52:52.633097] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-16T18:52:53.174914] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-09-16T18:52:53.974886] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-09-16T18:52:54.029393] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-16T18:52:54.670264] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-16T18:52:54.774951] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-09-16T18:52:55.574908] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-09-16T18:52:55.709553] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-16T18:52:56.374977] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-09-16T18:52:56.650169] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-16T18:52:56.657847] [INFO ] [REMOTE ] HUM: Full fetch complete (53285 records). [2025-09-16T18:52:56.658077] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-09-16T18:52:56.898579] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-16T18:52:57.176629] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-09-16T18:52:57.292154] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-09-16T18:52:57.292261] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-09-16T18:52:57.293199] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-09-16T18:52:57.293251] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-09-16T18:52:57.294799] [DEBUG] [LOCAL ] HUM: Trimmed 53285 records to 36539 (keeping 150 days of data) [2025-09-16T18:52:57.425746] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-16T18:52:57.572927] [DEBUG] [LOCAL ] HUM: Primary data saved (36539 records). [2025-09-16T18:52:57.573329] [INFO ] [MAIN ] HUM: Full history saved. [2025-09-16T18:52:57.573425] [INFO ] [MAIN ] Update Progress: 1066/2369 symbols completed. HUM took 25.3s. Estimated remaining: 2h 18m 1s. Rate: 9.4 symbols/min [2025-09-16T18:52:57.765980] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:52:57.811537] [DEBUG] [LOCAL ] HWM: Loaded 39128 existing records from primary storage. [2025-09-16T18:52:57.811749] [INFO ] [MAIN ] HWM: Loaded 39128 existing records. [2025-09-16T18:52:57.980069] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-09-16T18:52:58.017513] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:52:58.017825] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-09-16T18:52:58.017890] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-09-16T18:52:58.018916] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-09-16T18:52:58.018983] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-09-16T18:52:58.387924] [INFO ] [REMOTE ] HWM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:52:58.774881] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-09-16T18:52:59.043467] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-16T18:52:59.574896] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-09-16T18:52:59.723762] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-16T18:53:00.220119] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-16T18:53:00.374909] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-09-16T18:53:00.871612] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-16T18:53:01.174920] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-09-16T18:53:01.921945] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-16T18:53:01.974891] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-09-16T18:53:02.307236] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-16T18:53:02.774959] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-09-16T18:53:03.429437] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-16T18:53:03.435029] [INFO ] [REMOTE ] HUYA: Full fetch complete (48156 records). [2025-09-16T18:53:03.435130] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-09-16T18:53:03.580065] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-09-16T18:53:03.824662] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-09-16T18:53:03.824765] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-09-16T18:53:03.825566] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-09-16T18:53:03.825607] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-09-16T18:53:03.826611] [DEBUG] [LOCAL ] HUYA: Trimmed 48156 records to 32344 (keeping 150 days of data) [2025-09-16T18:53:04.013786] [DEBUG] [LOCAL ] HUYA: Primary data saved (32344 records). [2025-09-16T18:53:04.013920] [INFO ] [MAIN ] HUYA: Full history saved. [2025-09-16T18:53:04.014019] [INFO ] [MAIN ] Update Progress: 1067/2369 symbols completed. HUYA took 19.8s. Estimated remaining: 2h 17m 54s. Rate: 9.4 symbols/min [2025-09-16T18:53:04.184421] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:53:04.216057] [DEBUG] [LOCAL ] HXL: Loaded 33913 existing records from primary storage. [2025-09-16T18:53:04.216188] [INFO ] [MAIN ] HXL: Loaded 33913 existing records. [2025-09-16T18:53:04.378195] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-09-16T18:53:04.400282] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:53:04.400438] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-09-16T18:53:04.400481] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-09-16T18:53:04.401149] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-09-16T18:53:04.401196] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-09-16T18:53:04.780153] [INFO ] [REMOTE ] HXL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:53:04.780833] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-16T18:53:04.851526] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-16T18:53:05.174900] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-09-16T18:53:05.974993] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-09-16T18:53:06.303748] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-16T18:53:06.690704] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-16T18:53:06.698202] [INFO ] [REMOTE ] HUN: Full fetch complete (57851 records). [2025-09-16T18:53:06.698334] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-09-16T18:53:06.780036] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-09-16T18:53:07.084133] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-09-16T18:53:07.084217] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-09-16T18:53:07.085003] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-09-16T18:53:07.085050] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-09-16T18:53:07.086283] [DEBUG] [LOCAL ] HUN: Trimmed 57851 records to 39628 (keeping 150 days of data) [2025-09-16T18:53:07.326696] [DEBUG] [LOCAL ] HUN: Primary data saved (39628 records). [2025-09-16T18:53:07.326841] [INFO ] [MAIN ] HUN: Full history saved. [2025-09-16T18:53:07.328547] [INFO ] [MAIN ] Update Progress: 1068/2369 symbols completed. HUN took 27.8s. Estimated remaining: 2h 17m 44s. Rate: 9.4 symbols/min [2025-09-16T18:53:07.498226] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:53:07.525210] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-16T18:53:07.536609] [DEBUG] [LOCAL ] HY: Loaded 7126 existing records from primary storage. [2025-09-16T18:53:07.536717] [INFO ] [MAIN ] HY: Loaded 7126 existing records. [2025-09-16T18:53:07.580063] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-09-16T18:53:07.713718] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:53:07.714014] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-09-16T18:53:07.714068] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-09-16T18:53:07.714391] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-09-16T18:53:07.714436] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-09-16T18:53:08.068315] [INFO ] [REMOTE ] HY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:53:08.374879] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-09-16T18:53:08.463605] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-16T18:53:09.174890] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-09-16T18:53:09.233264] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-16T18:53:09.291284] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-16T18:53:09.974919] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-09-16T18:53:10.774879] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-09-16T18:53:10.810590] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-16T18:53:10.887243] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-16T18:53:11.403065] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-16T18:53:11.574940] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-09-16T18:53:12.374910] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-09-16T18:53:12.479221] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-16T18:53:13.174918] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-09-16T18:53:13.974933] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-09-16T18:53:14.177892] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-16T18:53:14.501584] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-16T18:53:14.774902] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-09-16T18:53:15.075083] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-16T18:53:15.554088] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-16T18:53:15.574876] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-09-16T18:53:16.362913] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-16T18:53:16.374844] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-09-16T18:53:17.180534] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-09-16T18:53:17.182334] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-16T18:53:17.974906] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-09-16T18:53:18.774918] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-09-16T18:53:18.836680] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-16T18:53:18.838953] [INFO ] [REMOTE ] HY: Full fetch complete (11439 records). [2025-09-16T18:53:18.839029] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-09-16T18:53:19.228925] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-09-16T18:53:19.229023] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-09-16T18:53:19.229408] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-09-16T18:53:19.229495] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-09-16T18:53:19.230162] [DEBUG] [LOCAL ] HY: Trimmed 11439 records to 7194 (keeping 150 days of data) [2025-09-16T18:53:19.275165] [DEBUG] [LOCAL ] HY: Primary data saved (7194 records). [2025-09-16T18:53:19.275388] [INFO ] [MAIN ] HY: Full history saved. [2025-09-16T18:53:19.275527] [INFO ] [MAIN ] Update Progress: 1069/2369 symbols completed. HY took 11.9s. Estimated remaining: 2h 17m 45s. Rate: 9.4 symbols/min [2025-09-16T18:53:19.470161] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-16T18:53:19.498314] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:53:19.498739] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-09-16T18:53:19.498870] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-09-16T18:53:19.498995] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-09-16T18:53:19.499036] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-16T18:53:19.499411] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-16T18:53:19.499464] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-09-16T18:53:19.580036] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-09-16T18:53:19.807460] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-16T18:53:19.877159] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:53:20.374932] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-09-16T18:53:20.711067] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-16T18:53:21.174953] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-09-16T18:53:21.460489] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-16T18:53:21.974916] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-09-16T18:53:22.190392] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-09-16T18:53:22.774908] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-09-16T18:53:22.855228] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-16T18:53:23.574902] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-09-16T18:53:23.754596] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-16T18:53:23.756694] [INFO ] [REMOTE ] HVT: Full fetch complete (17904 records). [2025-09-16T18:53:23.756764] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-09-16T18:53:24.138407] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-09-16T18:53:24.138541] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-09-16T18:53:24.139023] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-09-16T18:53:24.139083] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-09-16T18:53:24.139769] [DEBUG] [LOCAL ] HVT: Trimmed 17904 records to 11049 (keeping 150 days of data) [2025-09-16T18:53:24.209188] [DEBUG] [LOCAL ] HVT: Primary data saved (11049 records). [2025-09-16T18:53:24.209338] [INFO ] [MAIN ] HVT: Full history saved. [2025-09-16T18:53:24.209425] [INFO ] [MAIN ] Update Progress: 1070/2369 symbols completed. HVT took 35.7s. Estimated remaining: 2h 17m 37s. Rate: 9.4 symbols/min [2025-09-16T18:53:24.376001] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-09-16T18:53:24.377253] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:53:24.378119] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-09-16T18:53:24.378165] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-09-16T18:53:24.378318] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-09-16T18:53:24.378357] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-16T18:53:24.378397] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-09-16T18:53:24.378429] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-09-16T18:53:24.740717] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:53:25.174882] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-09-16T18:53:25.533633] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-16T18:53:25.550209] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-16T18:53:25.556675] [INFO ] [REMOTE ] HWM: Full fetch complete (57692 records). [2025-09-16T18:53:25.556785] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-09-16T18:53:25.935517] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-09-16T18:53:25.935598] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-09-16T18:53:25.936400] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-09-16T18:53:25.936448] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-09-16T18:53:25.937696] [DEBUG] [LOCAL ] HWM: Trimmed 57692 records to 39509 (keeping 150 days of data) [2025-09-16T18:53:26.001455] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-09-16T18:53:26.200713] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-16T18:53:26.238699] [DEBUG] [LOCAL ] HWM: Primary data saved (39509 records). [2025-09-16T18:53:26.238855] [INFO ] [MAIN ] HWM: Full history saved. [2025-09-16T18:53:26.238944] [INFO ] [MAIN ] Update Progress: 1071/2369 symbols completed. HWM took 28.7s. Estimated remaining: 2h 17m 25s. Rate: 9.4 symbols/min [2025-09-16T18:53:26.391898] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-16T18:53:26.421583] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:53:26.430025] [DEBUG] [LOCAL ] HYI: Loaded 6436 existing records from primary storage. [2025-09-16T18:53:26.430183] [INFO ] [MAIN ] HYI: Loaded 6436 existing records. [2025-09-16T18:53:26.604615] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:53:26.604903] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-09-16T18:53:26.604949] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-09-16T18:53:26.605348] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-09-16T18:53:26.605396] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-09-16T18:53:26.784422] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-09-16T18:53:26.973478] [INFO ] [REMOTE ] HYI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:53:27.117032] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-16T18:53:27.574905] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-09-16T18:53:28.374903] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-09-16T18:53:28.692307] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-16T18:53:29.174887] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-09-16T18:53:29.341409] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-16T18:53:29.483960] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-16T18:53:29.974905] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-09-16T18:53:30.300822] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-16T18:53:30.774973] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-09-16T18:53:31.101256] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-16T18:53:31.574895] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-09-16T18:53:32.283012] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-16T18:53:32.374889] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-09-16T18:53:32.787974] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-16T18:53:33.174887] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-09-16T18:53:33.402936] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-09-16T18:53:33.974915] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-09-16T18:53:34.774896] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-09-16T18:53:35.574909] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-09-16T18:53:35.632327] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-16T18:53:35.792873] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-16T18:53:35.895708] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-16T18:53:35.896578] [INFO ] [REMOTE ] HYAC: Full fetch complete (649 records). [2025-09-16T18:53:35.896691] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-09-16T18:53:35.897166] [FATAL] [VALIDATOR ] HYAC: Data is stale - most recent date (2025-09-11) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:53:35.897266] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:53:35.897321] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:53:35.897383] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-16T18:53:35.897470] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-16T18:53:35.897529] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-09-16T18:53:35.897630] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-09-16T18:53:35.897751] [INFO ] [MAIN ] Update Progress: 1072/2369 symbols completed. HYAC took 16.6s. Estimated remaining: 2h 17m 23s. Rate: 9.4 symbols/min [2025-09-16T18:53:36.080761] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:53:36.106905] [DEBUG] [LOCAL ] HYT: Loaded 24150 existing records from primary storage. [2025-09-16T18:53:36.107040] [INFO ] [MAIN ] HYT: Loaded 24150 existing records. [2025-09-16T18:53:36.283712] [WARN ] [MAIN ] HYT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:53:36.283945] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-09-16T18:53:36.283993] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-09-16T18:53:36.284622] [DEBUG] [LOCAL ] HYT: Deleted primary data file. [2025-09-16T18:53:36.284699] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-09-16T18:53:36.383128] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-09-16T18:53:36.639711] [INFO ] [REMOTE ] HYT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:53:36.720221] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-16T18:53:37.174914] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-09-16T18:53:37.974904] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-09-16T18:53:38.010412] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-16T18:53:38.281520] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-16T18:53:38.774923] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-09-16T18:53:39.410051] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-16T18:53:39.574903] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-09-16T18:53:40.358443] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-16T18:53:40.374852] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-09-16T18:53:41.046072] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-16T18:53:41.174891] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-09-16T18:53:41.974870] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-09-16T18:53:42.434683] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-16T18:53:42.567524] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-16T18:53:42.774889] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-09-16T18:53:43.574879] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-09-16T18:53:43.893382] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-16T18:53:44.010499] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-16T18:53:44.374912] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-09-16T18:53:44.820199] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-16T18:53:44.820888] [INFO ] [REMOTE ] HYBX: Full fetch complete (487 records). [2025-09-16T18:53:44.820954] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-09-16T18:53:45.007346] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 134 unique days, need 150 days [2025-09-16T18:53:45.007562] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:53:45.007620] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:53:45.007752] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-16T18:53:45.007843] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-09-16T18:53:45.007890] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-09-16T18:53:45.007949] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-09-16T18:53:45.008028] [INFO ] [MAIN ] Update Progress: 1073/2369 symbols completed. HYBX took 20.8s. Estimated remaining: 2h 17m 20s. Rate: 9.4 symbols/min [2025-09-16T18:53:45.180472] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-09-16T18:53:45.183610] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:53:45.188449] [DEBUG] [LOCAL ] HYTR: Loaded 2215 existing records from primary storage. [2025-09-16T18:53:45.188689] [INFO ] [MAIN ] HYTR: Loaded 2215 existing records. [2025-09-16T18:53:45.375380] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:53:45.375666] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-09-16T18:53:45.375720] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-09-16T18:53:45.376116] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-09-16T18:53:45.376165] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-09-16T18:53:45.744514] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:53:45.842809] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-16T18:53:45.844080] [INFO ] [REMOTE ] HYI: Full fetch complete (9678 records). [2025-09-16T18:53:45.844171] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-09-16T18:53:45.980035] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-09-16T18:53:46.219372] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-09-16T18:53:46.219449] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-09-16T18:53:46.219714] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-09-16T18:53:46.219773] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-09-16T18:53:46.220213] [DEBUG] [LOCAL ] HYI: Trimmed 9678 records to 6467 (keeping 150 days of data) [2025-09-16T18:53:46.259923] [DEBUG] [LOCAL ] HYI: Primary data saved (6467 records). [2025-09-16T18:53:46.260029] [INFO ] [MAIN ] HYI: Full history saved. [2025-09-16T18:53:46.260121] [INFO ] [MAIN ] Update Progress: 1074/2369 symbols completed. HYI took 20.0s. Estimated remaining: 2h 17m 7s. Rate: 9.4 symbols/min [2025-09-16T18:53:46.429872] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:53:46.449246] [DEBUG] [LOCAL ] HZO: Loaded 20526 existing records from primary storage. [2025-09-16T18:53:46.449370] [INFO ] [MAIN ] HZO: Loaded 20526 existing records. [2025-09-16T18:53:46.629767] [WARN ] [MAIN ] HZO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:53:46.630032] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-09-16T18:53:46.630089] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-09-16T18:53:46.630691] [DEBUG] [LOCAL ] HZO: Deleted primary data file. [2025-09-16T18:53:46.630742] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-09-16T18:53:46.775968] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-09-16T18:53:46.986254] [INFO ] [REMOTE ] HZO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:53:47.462710] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-16T18:53:47.531293] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-16T18:53:47.574875] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-09-16T18:53:48.374904] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-09-16T18:53:48.925116] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-16T18:53:48.935437] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-16T18:53:49.174932] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-09-16T18:53:49.974871] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-09-16T18:53:50.422452] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-16T18:53:50.774974] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-09-16T18:53:50.803419] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-16T18:53:51.574928] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-09-16T18:53:52.216579] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-16T18:53:52.374925] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-09-16T18:53:52.441381] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-16T18:53:53.174917] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-09-16T18:53:53.491513] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-16T18:53:53.729861] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-16T18:53:53.974895] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-09-16T18:53:54.774939] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-09-16T18:53:55.452346] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-16T18:53:55.574867] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-09-16T18:53:55.835937] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-16T18:53:55.839925] [INFO ] [REMOTE ] HYT: Full fetch complete (36032 records). [2025-09-16T18:53:55.840011] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-09-16T18:53:56.227438] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-09-16T18:53:56.227525] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-09-16T18:53:56.228240] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-09-16T18:53:56.228302] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-09-16T18:53:56.229234] [DEBUG] [LOCAL ] HYT: Trimmed 36032 records to 24402 (keeping 150 days of data) [2025-09-16T18:53:56.378226] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-09-16T18:53:56.387379] [DEBUG] [LOCAL ] HYT: Primary data saved (24402 records). [2025-09-16T18:53:56.387503] [INFO ] [MAIN ] HYT: Full history saved. [2025-09-16T18:53:56.387599] [INFO ] [MAIN ] Update Progress: 1075/2369 symbols completed. HYT took 20.5s. Estimated remaining: 2h 17m 5s. Rate: 9.4 symbols/min [2025-09-16T18:53:56.563933] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:53:56.570188] [DEBUG] [LOCAL ] IAE: Loaded 4215 existing records from primary storage. [2025-09-16T18:53:56.570333] [INFO ] [MAIN ] IAE: Loaded 4215 existing records. [2025-09-16T18:53:56.752171] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:53:56.752414] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-09-16T18:53:56.752464] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-09-16T18:53:56.752711] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-09-16T18:53:56.752758] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-09-16T18:53:57.126016] [INFO ] [REMOTE ] IAE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:53:57.141202] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-16T18:53:57.146800] [INFO ] [REMOTE ] HXL: Full fetch complete (50044 records). [2025-09-16T18:53:57.146930] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-09-16T18:53:57.179981] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-09-16T18:53:57.536718] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-09-16T18:53:57.536805] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-09-16T18:53:57.537623] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-09-16T18:53:57.537703] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-09-16T18:53:57.538822] [DEBUG] [LOCAL ] HXL: Trimmed 50044 records to 34210 (keeping 150 days of data) [2025-09-16T18:53:57.752844] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-16T18:53:57.783291] [DEBUG] [LOCAL ] HXL: Primary data saved (34210 records). [2025-09-16T18:53:57.783468] [INFO ] [MAIN ] HXL: Full history saved. [2025-09-16T18:53:57.783580] [INFO ] [MAIN ] Update Progress: 1076/2369 symbols completed. HXL took 53.8s. Estimated remaining: 2h 16m 53s. Rate: 9.4 symbols/min [2025-09-16T18:53:57.911164] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-16T18:53:57.968202] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:53:57.974867] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-09-16T18:53:58.006016] [DEBUG] [LOCAL ] IAG: Loaded 39458 existing records from primary storage. [2025-09-16T18:53:58.006160] [INFO ] [MAIN ] IAG: Loaded 39458 existing records. [2025-09-16T18:53:58.187974] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:53:58.188244] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-09-16T18:53:58.188292] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-09-16T18:53:58.189163] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-09-16T18:53:58.189215] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-09-16T18:53:58.541634] [INFO ] [REMOTE ] IAG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:53:58.634371] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-16T18:53:58.774923] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-09-16T18:53:59.411358] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-16T18:53:59.574869] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-09-16T18:54:00.170002] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-16T18:54:00.374957] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-09-16T18:54:01.174919] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-09-16T18:54:01.492246] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-16T18:54:01.974950] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-09-16T18:54:02.715265] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-16T18:54:02.779977] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-09-16T18:54:02.799504] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-16T18:54:03.574864] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-09-16T18:54:03.903669] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-16T18:54:04.374903] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-09-16T18:54:04.853526] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-16T18:54:05.174943] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-09-16T18:54:05.306628] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-16T18:54:05.974866] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-09-16T18:54:06.384420] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-16T18:54:06.774950] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-09-16T18:54:07.426146] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-16T18:54:07.574898] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-09-16T18:54:08.068745] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-16T18:54:08.374965] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-09-16T18:54:08.810244] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-16T18:54:09.174967] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-09-16T18:54:09.297220] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-16T18:54:09.777625] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-16T18:54:09.974891] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-09-16T18:54:10.774924] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-09-16T18:54:11.310543] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-16T18:54:11.574922] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-09-16T18:54:11.718035] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-16T18:54:12.374930] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-09-16T18:54:12.729219] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-16T18:54:13.174891] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-09-16T18:54:13.642731] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-16T18:54:13.974901] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-09-16T18:54:14.188979] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-16T18:54:14.774874] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-09-16T18:54:15.128485] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-16T18:54:15.131795] [INFO ] [REMOTE ] HZO: Full fetch complete (31518 records). [2025-09-16T18:54:15.131878] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-09-16T18:54:15.515516] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-09-16T18:54:15.515596] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-09-16T18:54:15.516202] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-09-16T18:54:15.516247] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-09-16T18:54:15.517080] [DEBUG] [LOCAL ] HZO: Trimmed 31518 records to 20719 (keeping 150 days of data) [2025-09-16T18:54:15.576912] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-09-16T18:54:15.642361] [DEBUG] [LOCAL ] HZO: Primary data saved (20719 records). [2025-09-16T18:54:15.642491] [INFO ] [MAIN ] HZO: Full history saved. [2025-09-16T18:54:15.642580] [INFO ] [MAIN ] Update Progress: 1077/2369 symbols completed. HZO took 29.4s. Estimated remaining: 2h 17m 1s. Rate: 9.4 symbols/min [2025-09-16T18:54:16.012412] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-16T18:54:16.013337] [INFO ] [REMOTE ] HYTR: Full fetch complete (3465 records). [2025-09-16T18:54:16.013404] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-09-16T18:54:16.377384] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-09-16T18:54:16.411519] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-09-16T18:54:16.411589] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-09-16T18:54:16.411725] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-09-16T18:54:16.411849] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-09-16T18:54:16.412310] [DEBUG] [LOCAL ] HYTR: Trimmed 3465 records to 2235 (keeping 150 days of data) [2025-09-16T18:54:16.428082] [DEBUG] [LOCAL ] HYTR: Primary data saved (2235 records). [2025-09-16T18:54:16.428280] [INFO ] [MAIN ] HYTR: Full history saved. [2025-09-16T18:54:16.428366] [INFO ] [MAIN ] Update Progress: 1078/2369 symbols completed. HYTR took 31.4s. Estimated remaining: 2h 16m 47s. Rate: 9.4 symbols/min [2025-09-16T18:54:16.459830] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-16T18:54:17.118157] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-16T18:54:17.119486] [INFO ] [REMOTE ] IAE: Full fetch complete (6375 records). [2025-09-16T18:54:17.119558] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-09-16T18:54:17.184982] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-09-16T18:54:17.492705] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-09-16T18:54:17.492794] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-09-16T18:54:17.493064] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-09-16T18:54:17.493106] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-09-16T18:54:17.493551] [DEBUG] [LOCAL ] IAE: Trimmed 6375 records to 4267 (keeping 150 days of data) [2025-09-16T18:54:17.519696] [DEBUG] [LOCAL ] IAE: Primary data saved (4267 records). [2025-09-16T18:54:17.519812] [INFO ] [MAIN ] IAE: Full history saved. [2025-09-16T18:54:17.519930] [INFO ] [MAIN ] Update Progress: 1079/2369 symbols completed. IAE took 21.1s. Estimated remaining: 2h 16m 35s. Rate: 9.4 symbols/min [2025-09-16T18:54:19.097941] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-16T18:54:19.106348] [INFO ] [REMOTE ] IAG: Full fetch complete (58099 records). [2025-09-16T18:54:19.106555] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-09-16T18:54:19.505280] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-09-16T18:54:19.505392] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-09-16T18:54:19.506290] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-09-16T18:54:19.506348] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-09-16T18:54:19.507897] [DEBUG] [LOCAL ] IAG: Trimmed 58099 records to 39848 (keeping 150 days of data) [2025-09-16T18:54:19.743793] [DEBUG] [LOCAL ] IAG: Primary data saved (39848 records). [2025-09-16T18:54:19.743977] [INFO ] [MAIN ] IAG: Full history saved. [2025-09-16T18:54:19.744089] [INFO ] [MAIN ] Update Progress: 1080/2369 symbols completed. IAG took 22.0s. Estimated remaining: 2h 16m 24s. Rate: 9.5 symbols/min [2025-09-16T18:54:20.362113] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:54:20.389001] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:54:20.389821] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:54:20.440632] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:54:20.467826] [DEBUG] [LOCAL ] IBP: Loaded 21527 existing records from primary storage. [2025-09-16T18:54:20.468170] [INFO ] [MAIN ] IBP: Loaded 21527 existing records. [2025-09-16T18:54:20.606352] [DEBUG] [LOCAL ] IBTA: Loaded 25982 existing records from primary storage. [2025-09-16T18:54:20.662263] [INFO ] [MAIN ] IBTA: Loaded 25982 existing records. [2025-09-16T18:54:20.735157] [DEBUG] [LOCAL ] IBN: Loaded 38999 existing records from primary storage. [2025-09-16T18:54:20.740480] [INFO ] [MAIN ] IBN: Loaded 38999 existing records. [2025-09-16T18:54:20.741070] [DEBUG] [LOCAL ] IBM: Loaded 39615 existing records from primary storage. [2025-09-16T18:54:20.699976] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:54:20.751591] [INFO ] [MAIN ] IBM: Loaded 39615 existing records. [2025-09-16T18:54:20.785236] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-09-16T18:54:20.886838] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-09-16T18:54:20.950047] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-09-16T18:54:20.980084] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-09-16T18:54:21.279627] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:54:21.332134] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:54:21.337843] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:54:21.359241] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-09-16T18:54:21.359460] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-09-16T18:54:21.370348] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-09-16T18:54:21.359599] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-09-16T18:54:21.380699] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-09-16T18:54:21.385924] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-09-16T18:54:21.370312] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-09-16T18:54:21.429322] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-09-16T18:54:21.429258] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-09-16T18:54:21.462192] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-09-16T18:54:21.462107] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-09-16T18:54:21.591359] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-09-16T18:54:22.101529] [INFO ] [REMOTE ] IBP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:54:22.162488] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-09-16T18:54:22.577781] [INFO ] [REMOTE ] IBN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:54:22.581732] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-09-16T18:54:22.737510] [INFO ] [REMOTE ] IBM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:54:22.741846] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:54:22.742596] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-09-16T18:54:22.742304] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-09-16T18:54:23.803735] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-16T18:54:23.809425] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-09-16T18:54:23.907360] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-16T18:54:23.912315] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-09-16T18:54:24.084349] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-16T18:54:24.094092] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-09-16T18:54:24.608328] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-16T18:54:24.618607] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-09-16T18:54:25.095109] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-16T18:54:25.101755] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-09-16T18:54:25.537886] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-16T18:54:25.548045] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-09-16T18:54:25.701784] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-16T18:54:25.974875] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-09-16T18:54:26.283261] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-16T18:54:26.322265] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-16T18:54:26.774914] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-09-16T18:54:27.137372] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-16T18:54:27.238902] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-16T18:54:27.574886] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-09-16T18:54:28.374910] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-09-16T18:54:29.092445] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-16T18:54:29.174865] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-09-16T18:54:29.451997] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-16T18:54:29.643094] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-16T18:54:29.974908] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-09-16T18:54:30.451819] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-16T18:54:30.774956] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-09-16T18:54:31.574894] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-09-16T18:54:31.972913] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-16T18:54:32.031438] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-16T18:54:32.374953] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-09-16T18:54:33.174913] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-09-16T18:54:33.275600] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-16T18:54:33.667674] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-16T18:54:33.974917] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-09-16T18:54:34.429114] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-16T18:54:34.774951] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-09-16T18:54:35.574913] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-09-16T18:54:35.886996] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-16T18:54:36.374906] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-09-16T18:54:36.722760] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-16T18:54:36.838548] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-16T18:54:37.174896] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-09-16T18:54:37.974888] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-09-16T18:54:38.190548] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-16T18:54:38.774910] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-09-16T18:54:38.920625] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-16T18:54:39.584696] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-09-16T18:54:39.606608] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-09-16T18:54:39.664081] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-16T18:54:39.668156] [INFO ] [REMOTE ] IBP: Full fetch complete (32122 records). [2025-09-16T18:54:39.668331] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-09-16T18:54:40.072557] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-09-16T18:54:40.072636] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-09-16T18:54:40.073424] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-09-16T18:54:40.073496] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-09-16T18:54:40.074296] [DEBUG] [LOCAL ] IBP: Trimmed 32122 records to 21669 (keeping 150 days of data) [2025-09-16T18:54:40.219833] [DEBUG] [LOCAL ] IBP: Primary data saved (21669 records). [2025-09-16T18:54:40.219969] [INFO ] [MAIN ] IBP: Full history saved. [2025-09-16T18:54:40.220097] [INFO ] [MAIN ] Update Progress: 1081/2369 symbols completed. IBP took 20.5s. Estimated remaining: 2h 16m 34s. Rate: 9.4 symbols/min [2025-09-16T18:54:40.386998] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-09-16T18:54:40.390121] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:54:40.433687] [DEBUG] [LOCAL ] ICE: Loaded 39028 existing records from primary storage. [2025-09-16T18:54:40.433823] [INFO ] [MAIN ] ICE: Loaded 39028 existing records. [2025-09-16T18:54:40.609742] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:54:40.609985] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-09-16T18:54:40.610038] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-09-16T18:54:40.610800] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-09-16T18:54:40.610889] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-09-16T18:54:40.964323] [INFO ] [REMOTE ] ICE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:54:41.174885] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-09-16T18:54:41.278789] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-16T18:54:41.285445] [INFO ] [REMOTE ] IBN: Full fetch complete (57536 records). [2025-09-16T18:54:41.285550] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-09-16T18:54:41.661768] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-09-16T18:54:41.661844] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-09-16T18:54:41.662593] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-09-16T18:54:41.662634] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-09-16T18:54:41.663723] [DEBUG] [LOCAL ] IBN: Trimmed 57536 records to 39380 (keeping 150 days of data) [2025-09-16T18:54:41.909555] [DEBUG] [LOCAL ] IBN: Primary data saved (39380 records). [2025-09-16T18:54:41.909707] [INFO ] [MAIN ] IBN: Full history saved. [2025-09-16T18:54:41.909814] [INFO ] [MAIN ] Update Progress: 1082/2369 symbols completed. IBN took 22.2s. Estimated remaining: 2h 16m 22s. Rate: 9.4 symbols/min [2025-09-16T18:54:41.980020] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-09-16T18:54:42.084253] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:54:42.109918] [DEBUG] [LOCAL ] ICL: Loaded 28261 existing records from primary storage. [2025-09-16T18:54:42.110075] [INFO ] [MAIN ] ICL: Loaded 28261 existing records. [2025-09-16T18:54:42.289329] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:54:42.289570] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-09-16T18:54:42.289625] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-09-16T18:54:42.290303] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-09-16T18:54:42.290353] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-09-16T18:54:42.640418] [INFO ] [REMOTE ] ICL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:54:42.774850] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-09-16T18:54:42.857534] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-09-16T18:54:43.003336] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-16T18:54:43.574876] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-09-16T18:54:43.697431] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-16T18:54:43.960220] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-16T18:54:44.374949] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-09-16T18:54:45.022759] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-16T18:54:45.174858] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-09-16T18:54:45.974911] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-09-16T18:54:46.655607] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-16T18:54:46.661880] [INFO ] [REMOTE ] IBM: Full fetch complete (58278 records). [2025-09-16T18:54:46.661987] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-09-16T18:54:46.784737] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-09-16T18:54:47.055275] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-09-16T18:54:47.055441] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-09-16T18:54:47.056608] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-09-16T18:54:47.056769] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-09-16T18:54:47.072431] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-16T18:54:47.090223] [DEBUG] [LOCAL ] IBM: Trimmed 58278 records to 40001 (keeping 150 days of data) [2025-09-16T18:54:47.106267] [INFO ] [REMOTE ] IBTA: Full fetch complete (40635 records). [2025-09-16T18:54:47.109934] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-09-16T18:54:47.113094] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-16T18:54:47.588022] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-09-16T18:54:47.646309] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-09-16T18:54:47.646674] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-09-16T18:54:47.648261] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-09-16T18:54:47.649191] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-09-16T18:54:47.652991] [DEBUG] [LOCAL ] IBTA: Trimmed 40635 records to 26290 (keeping 150 days of data) [2025-09-16T18:54:47.923142] [DEBUG] [LOCAL ] IBTA: Primary data saved (26290 records). [2025-09-16T18:54:47.924216] [INFO ] [MAIN ] IBTA: Full history saved. [2025-09-16T18:54:47.924580] [INFO ] [MAIN ] Update Progress: 1083/2369 symbols completed. IBTA took 28.2s. Estimated remaining: 2h 16m 15s. Rate: 9.4 symbols/min [2025-09-16T18:54:48.106283] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:54:48.142431] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-16T18:54:48.170868] [DEBUG] [LOCAL ] IDA: Loaded 24568 existing records from primary storage. [2025-09-16T18:54:48.172619] [INFO ] [MAIN ] IDA: Loaded 24568 existing records. [2025-09-16T18:54:48.336265] [DEBUG] [LOCAL ] IBM: Primary data saved (40001 records). [2025-09-16T18:54:48.339241] [INFO ] [MAIN ] IBM: Full history saved. [2025-09-16T18:54:48.339663] [INFO ] [MAIN ] Update Progress: 1084/2369 symbols completed. IBM took 28.6s. Estimated remaining: 2h 16m 2s. Rate: 9.4 symbols/min [2025-09-16T18:54:48.380077] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:54:48.379952] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-09-16T18:54:48.423380] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-09-16T18:54:48.460048] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-09-16T18:54:48.468273] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-09-16T18:54:48.483692] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-09-16T18:54:48.627462] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:54:48.755338] [DEBUG] [LOCAL ] IDE: Loaded 6534 existing records from primary storage. [2025-09-16T18:54:48.792779] [INFO ] [MAIN ] IDE: Loaded 6534 existing records. [2025-09-16T18:54:49.027236] [INFO ] [REMOTE ] IDA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:54:49.084301] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:54:49.084560] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-09-16T18:54:49.084618] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-09-16T18:54:49.084979] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-09-16T18:54:49.085026] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-09-16T18:54:49.183917] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-09-16T18:54:49.445718] [INFO ] [REMOTE ] IDE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:54:49.506806] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-16T18:54:49.507929] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-16T18:54:49.974951] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-09-16T18:54:50.105780] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-16T18:54:50.774905] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-09-16T18:54:51.449128] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-16T18:54:51.574942] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-09-16T18:54:51.738362] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-16T18:54:52.374906] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-09-16T18:54:53.174915] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-09-16T18:54:53.317822] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-16T18:54:53.386612] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-16T18:54:53.974903] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-09-16T18:54:54.170660] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-16T18:54:54.674140] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-16T18:54:54.774958] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-09-16T18:54:55.574957] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-09-16T18:54:56.245204] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-16T18:54:56.374874] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-09-16T18:54:56.981978] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-16T18:54:57.174891] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-09-16T18:54:57.700465] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-16T18:54:57.722701] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-16T18:54:57.974898] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-09-16T18:54:58.774908] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-09-16T18:54:59.487914] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-16T18:54:59.574931] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-09-16T18:55:00.252221] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-16T18:55:00.374954] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-09-16T18:55:00.977200] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-16T18:55:01.174996] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-09-16T18:55:01.715481] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-16T18:55:01.974908] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-09-16T18:55:02.774908] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-09-16T18:55:02.920666] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-16T18:55:02.968673] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-16T18:55:02.973422] [INFO ] [REMOTE ] ICL: Full fetch complete (42366 records). [2025-09-16T18:55:02.973538] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-09-16T18:55:03.357606] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-09-16T18:55:03.357707] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-09-16T18:55:03.358441] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-09-16T18:55:03.358493] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-09-16T18:55:03.359494] [DEBUG] [LOCAL ] ICL: Trimmed 42366 records to 28534 (keeping 150 days of data) [2025-09-16T18:55:03.526490] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-16T18:55:03.533599] [DEBUG] [LOCAL ] ICL: Primary data saved (28534 records). [2025-09-16T18:55:03.534066] [INFO ] [MAIN ] ICL: Full history saved. [2025-09-16T18:55:03.534165] [INFO ] [MAIN ] Update Progress: 1085/2369 symbols completed. ICL took 21.6s. Estimated remaining: 2h 16m 6s. Rate: 9.4 symbols/min [2025-09-16T18:55:03.579952] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-09-16T18:55:03.709233] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:55:03.723473] [DEBUG] [LOCAL ] IDT: Loaded 13084 existing records from primary storage. [2025-09-16T18:55:03.723612] [INFO ] [MAIN ] IDT: Loaded 13084 existing records. [2025-09-16T18:55:03.917929] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:55:03.918185] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-09-16T18:55:03.918232] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-09-16T18:55:03.918616] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-09-16T18:55:03.918686] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-09-16T18:55:04.276991] [INFO ] [REMOTE ] IDT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:55:04.374912] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-09-16T18:55:04.608614] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-16T18:55:04.611984] [INFO ] [REMOTE ] IDA: Full fetch complete (34568 records). [2025-09-16T18:55:04.612083] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-09-16T18:55:04.940180] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-16T18:55:05.005576] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-09-16T18:55:05.005678] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-09-16T18:55:05.006386] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-09-16T18:55:05.006429] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-09-16T18:55:05.007261] [DEBUG] [LOCAL ] IDA: Trimmed 34568 records to 24824 (keeping 150 days of data) [2025-09-16T18:55:05.165319] [DEBUG] [LOCAL ] IDA: Primary data saved (24824 records). [2025-09-16T18:55:05.165467] [INFO ] [MAIN ] IDA: Full history saved. [2025-09-16T18:55:05.165565] [INFO ] [MAIN ] Update Progress: 1086/2369 symbols completed. IDA took 17.2s. Estimated remaining: 2h 15m 54s. Rate: 9.4 symbols/min [2025-09-16T18:55:05.180012] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-09-16T18:55:05.352523] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:55:05.380286] [DEBUG] [LOCAL ] IEX: Loaded 28450 existing records from primary storage. [2025-09-16T18:55:05.380420] [INFO ] [MAIN ] IEX: Loaded 28450 existing records. [2025-09-16T18:55:05.562887] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:55:05.563108] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-09-16T18:55:05.563201] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-09-16T18:55:05.563985] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-09-16T18:55:05.564038] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-09-16T18:55:05.920975] [INFO ] [REMOTE ] IEX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:55:05.974859] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-09-16T18:55:06.774943] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-09-16T18:55:06.934134] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-16T18:55:06.940358] [INFO ] [REMOTE ] ICE: Full fetch complete (57650 records). [2025-09-16T18:55:06.940464] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-09-16T18:55:07.333966] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-09-16T18:55:07.334122] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-09-16T18:55:07.335005] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-09-16T18:55:07.335069] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-09-16T18:55:07.336434] [DEBUG] [LOCAL ] ICE: Trimmed 57650 records to 39416 (keeping 150 days of data) [2025-09-16T18:55:07.463128] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-16T18:55:07.510399] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-16T18:55:07.576674] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-09-16T18:55:07.649265] [DEBUG] [LOCAL ] ICE: Primary data saved (39416 records). [2025-09-16T18:55:07.649414] [INFO ] [MAIN ] ICE: Full history saved. [2025-09-16T18:55:07.650491] [INFO ] [MAIN ] Update Progress: 1087/2369 symbols completed. ICE took 27.4s. Estimated remaining: 2h 15m 43s. Rate: 9.4 symbols/min [2025-09-16T18:55:07.820725] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:55:07.860108] [DEBUG] [LOCAL ] IFF: Loaded 37546 existing records from primary storage. [2025-09-16T18:55:07.860249] [INFO ] [MAIN ] IFF: Loaded 37546 existing records. [2025-09-16T18:55:08.041702] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:55:08.041959] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-09-16T18:55:08.042006] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-09-16T18:55:08.042763] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-09-16T18:55:08.042813] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-09-16T18:55:08.379050] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-09-16T18:55:08.402531] [INFO ] [REMOTE ] IFF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:55:08.619002] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-16T18:55:09.174906] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-09-16T18:55:09.909679] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-16T18:55:09.974841] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-09-16T18:55:10.780070] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-09-16T18:55:10.793908] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-16T18:55:11.477959] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-16T18:55:11.553063] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-16T18:55:11.574846] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-09-16T18:55:12.374936] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-09-16T18:55:12.776267] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-16T18:55:13.174906] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-09-16T18:55:13.353211] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-16T18:55:13.974934] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-09-16T18:55:14.357714] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-16T18:55:14.774962] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-09-16T18:55:14.810638] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-16T18:55:15.574970] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-09-16T18:55:16.172795] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-16T18:55:16.309009] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-16T18:55:16.374902] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-09-16T18:55:17.174959] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-09-16T18:55:17.373508] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-16T18:55:17.974945] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-09-16T18:55:18.679128] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-16T18:55:18.774882] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-09-16T18:55:19.094849] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-16T18:55:19.574922] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-09-16T18:55:20.106081] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-16T18:55:20.113311] [INFO ] [REMOTE ] IEX: Full fetch complete (41299 records). [2025-09-16T18:55:20.113499] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-09-16T18:55:20.380008] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-09-16T18:55:20.493605] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-09-16T18:55:20.493699] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-09-16T18:55:20.494392] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-09-16T18:55:20.494441] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-09-16T18:55:20.495360] [DEBUG] [LOCAL ] IEX: Trimmed 41299 records to 28751 (keeping 150 days of data) [2025-09-16T18:55:20.672127] [DEBUG] [LOCAL ] IEX: Primary data saved (28751 records). [2025-09-16T18:55:20.672267] [INFO ] [MAIN ] IEX: Full history saved. [2025-09-16T18:55:20.672351] [INFO ] [MAIN ] Update Progress: 1088/2369 symbols completed. IEX took 15.5s. Estimated remaining: 2h 15m 45s. Rate: 9.4 symbols/min [2025-09-16T18:55:20.842186] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:55:20.856194] [DEBUG] [LOCAL ] IFN: Loaded 13576 existing records from primary storage. [2025-09-16T18:55:20.856316] [INFO ] [MAIN ] IFN: Loaded 13576 existing records. [2025-09-16T18:55:21.031533] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:55:21.031822] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-09-16T18:55:21.031873] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-09-16T18:55:21.032270] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-09-16T18:55:21.032314] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-09-16T18:55:21.183352] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-09-16T18:55:21.395187] [INFO ] [REMOTE ] IFN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:55:21.424089] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-16T18:55:21.527151] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-16T18:55:21.974972] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-09-16T18:55:21.985968] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-16T18:55:21.987924] [INFO ] [REMOTE ] IDE: Full fetch complete (9017 records). [2025-09-16T18:55:21.988017] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-09-16T18:55:22.369511] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-09-16T18:55:22.369628] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-09-16T18:55:22.369892] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-09-16T18:55:22.369933] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-09-16T18:55:22.370375] [DEBUG] [LOCAL ] IDE: Trimmed 9017 records to 6599 (keeping 150 days of data) [2025-09-16T18:55:22.414622] [DEBUG] [LOCAL ] IDE: Primary data saved (6599 records). [2025-09-16T18:55:22.414791] [INFO ] [MAIN ] IDE: Full history saved. [2025-09-16T18:55:22.414907] [INFO ] [MAIN ] Update Progress: 1089/2369 symbols completed. IDE took 34.1s. Estimated remaining: 2h 15m 33s. Rate: 9.4 symbols/min [2025-09-16T18:55:22.586628] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:55:22.608861] [DEBUG] [LOCAL ] IFS: Loaded 16343 existing records from primary storage. [2025-09-16T18:55:22.609024] [INFO ] [MAIN ] IFS: Loaded 16343 existing records. [2025-09-16T18:55:22.782766] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-09-16T18:55:22.787924] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:55:22.789155] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-09-16T18:55:22.789257] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-09-16T18:55:22.789773] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-09-16T18:55:22.789835] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-09-16T18:55:23.145713] [INFO ] [REMOTE ] IFS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:55:23.158673] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-16T18:55:23.574947] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-09-16T18:55:23.771519] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-16T18:55:24.374925] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-09-16T18:55:25.174918] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-09-16T18:55:25.233066] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-16T18:55:25.470445] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-16T18:55:25.974914] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-09-16T18:55:26.101450] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-16T18:55:26.103997] [INFO ] [REMOTE ] IDT: Full fetch complete (18233 records). [2025-09-16T18:55:26.104073] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-09-16T18:55:26.480625] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-09-16T18:55:26.480766] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-09-16T18:55:26.481201] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-09-16T18:55:26.481245] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-09-16T18:55:26.481886] [DEBUG] [LOCAL ] IDT: Trimmed 18233 records to 13221 (keeping 150 days of data) [2025-09-16T18:55:26.561870] [DEBUG] [LOCAL ] IDT: Primary data saved (13221 records). [2025-09-16T18:55:26.562017] [INFO ] [MAIN ] IDT: Full history saved. [2025-09-16T18:55:26.562128] [INFO ] [MAIN ] Update Progress: 1090/2369 symbols completed. IDT took 23.0s. Estimated remaining: 2h 15m 24s. Rate: 9.4 symbols/min [2025-09-16T18:55:26.741031] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:55:26.749768] [DEBUG] [LOCAL ] IGA: Loaded 6917 existing records from primary storage. [2025-09-16T18:55:26.749898] [INFO ] [MAIN ] IGA: Loaded 6917 existing records. [2025-09-16T18:55:26.780100] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-09-16T18:55:26.933819] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:55:26.934104] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-09-16T18:55:26.934153] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-09-16T18:55:26.934434] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-09-16T18:55:26.934480] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-09-16T18:55:27.295882] [INFO ] [REMOTE ] IGA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:55:27.310384] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-16T18:55:27.574885] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-09-16T18:55:27.838548] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-16T18:55:28.286115] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-16T18:55:28.374887] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-09-16T18:55:29.134333] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-16T18:55:29.174873] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-09-16T18:55:29.974907] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-09-16T18:55:30.129131] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-16T18:55:30.774902] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-09-16T18:55:31.330054] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-16T18:55:31.575427] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-09-16T18:55:31.581379] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-16T18:55:32.374871] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-09-16T18:55:32.435869] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-16T18:55:33.174906] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-09-16T18:55:33.882021] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-16T18:55:33.981579] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-09-16T18:55:34.000755] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-16T18:55:34.774898] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-09-16T18:55:35.110434] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-16T18:55:35.574851] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-09-16T18:55:35.574768] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-16T18:55:36.374897] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-09-16T18:55:37.095753] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-16T18:55:37.174880] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-09-16T18:55:37.254930] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-16T18:55:37.974896] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-09-16T18:55:38.171676] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-16T18:55:38.774898] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-09-16T18:55:39.035830] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-16T18:55:39.574904] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-09-16T18:55:40.360085] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-16T18:55:40.375525] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-09-16T18:55:40.376622] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-16T18:55:40.379757] [INFO ] [REMOTE ] IGA: Full fetch complete (10390 records). [2025-09-16T18:55:40.379874] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-09-16T18:55:40.757821] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-09-16T18:55:40.758030] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-09-16T18:55:40.758334] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-09-16T18:55:40.758396] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-09-16T18:55:40.758959] [DEBUG] [LOCAL ] IGA: Trimmed 10390 records to 7019 (keeping 150 days of data) [2025-09-16T18:55:40.802103] [DEBUG] [LOCAL ] IGA: Primary data saved (7019 records). [2025-09-16T18:55:40.802222] [INFO ] [MAIN ] IGA: Full history saved. [2025-09-16T18:55:40.802306] [INFO ] [MAIN ] Update Progress: 1091/2369 symbols completed. IGA took 14.2s. Estimated remaining: 2h 15m 27s. Rate: 9.4 symbols/min [2025-09-16T18:55:40.977100] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:55:40.991611] [DEBUG] [LOCAL ] IGD: Loaded 13795 existing records from primary storage. [2025-09-16T18:55:40.991772] [INFO ] [MAIN ] IGD: Loaded 13795 existing records. [2025-09-16T18:55:41.165406] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:55:41.165729] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-09-16T18:55:41.165777] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-09-16T18:55:41.166311] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-09-16T18:55:41.166357] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-09-16T18:55:41.180003] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-09-16T18:55:41.515593] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-16T18:55:41.552919] [INFO ] [REMOTE ] IGD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:55:41.974916] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-09-16T18:55:42.526969] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-16T18:55:42.774900] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-09-16T18:55:43.574878] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-09-16T18:55:43.641610] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-16T18:55:43.650945] [INFO ] [REMOTE ] IFF: Full fetch complete (55399 records). [2025-09-16T18:55:43.651156] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-09-16T18:55:43.952506] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-16T18:55:44.079780] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-09-16T18:55:44.079859] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-09-16T18:55:44.080594] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-09-16T18:55:44.080637] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-09-16T18:55:44.081763] [DEBUG] [LOCAL ] IFF: Trimmed 55399 records to 37927 (keeping 150 days of data) [2025-09-16T18:55:44.318546] [DEBUG] [LOCAL ] IFF: Primary data saved (37927 records). [2025-09-16T18:55:44.318746] [INFO ] [MAIN ] IFF: Full history saved. [2025-09-16T18:55:44.319666] [INFO ] [MAIN ] Update Progress: 1092/2369 symbols completed. IFF took 36.7s. Estimated remaining: 2h 15m 17s. Rate: 9.4 symbols/min [2025-09-16T18:55:44.382173] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-09-16T18:55:44.492581] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:55:44.497883] [DEBUG] [LOCAL ] IGI: Loaded 2713 existing records from primary storage. [2025-09-16T18:55:44.497990] [INFO ] [MAIN ] IGI: Loaded 2713 existing records. [2025-09-16T18:55:44.673658] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:55:44.673996] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-09-16T18:55:44.674198] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-09-16T18:55:44.674445] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-09-16T18:55:44.674538] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-09-16T18:55:44.794242] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-16T18:55:45.053297] [INFO ] [REMOTE ] IGI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:55:45.174932] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-09-16T18:55:45.544730] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-16T18:55:45.624306] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-16T18:55:45.974964] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-09-16T18:55:46.564761] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-16T18:55:46.774912] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-09-16T18:55:47.574917] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-09-16T18:55:47.899247] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-16T18:55:48.374947] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-09-16T18:55:48.607078] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-16T18:55:48.916578] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-16T18:55:49.174941] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-09-16T18:55:49.974911] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-09-16T18:55:50.157261] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-16T18:55:50.159695] [INFO ] [REMOTE ] IFN: Full fetch complete (20556 records). [2025-09-16T18:55:50.159770] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-09-16T18:55:50.446067] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-16T18:55:50.530087] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-09-16T18:55:50.530172] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-09-16T18:55:50.530636] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-09-16T18:55:50.530708] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-09-16T18:55:50.531308] [DEBUG] [LOCAL ] IFN: Trimmed 20556 records to 13709 (keeping 150 days of data) [2025-09-16T18:55:50.614141] [DEBUG] [LOCAL ] IFN: Primary data saved (13709 records). [2025-09-16T18:55:50.614282] [INFO ] [MAIN ] IFN: Full history saved. [2025-09-16T18:55:50.614364] [INFO ] [MAIN ] Update Progress: 1093/2369 symbols completed. IFN took 29.9s. Estimated remaining: 2h 15m 11s. Rate: 9.4 symbols/min [2025-09-16T18:55:50.782446] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-09-16T18:55:50.785066] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:55:50.806670] [DEBUG] [LOCAL ] IGR: Loaded 22380 existing records from primary storage. [2025-09-16T18:55:50.806799] [INFO ] [MAIN ] IGR: Loaded 22380 existing records. [2025-09-16T18:55:50.984341] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:55:50.984596] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-09-16T18:55:50.984660] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-09-16T18:55:50.985238] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-09-16T18:55:50.985287] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-09-16T18:55:51.350264] [INFO ] [REMOTE ] IGR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:55:51.574914] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-09-16T18:55:51.750792] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-16T18:55:52.374870] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-09-16T18:55:52.843440] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-16T18:55:53.174906] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-09-16T18:55:53.391704] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-16T18:55:53.501969] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-16T18:55:53.974943] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-09-16T18:55:54.774937] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-09-16T18:55:54.925543] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-16T18:55:55.574967] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-09-16T18:55:55.632165] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-16T18:55:56.374946] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-09-16T18:55:56.818843] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-16T18:55:57.174903] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-09-16T18:55:57.509227] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-16T18:55:57.974949] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-09-16T18:55:58.450395] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-16T18:55:58.774901] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-09-16T18:55:58.948541] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-16T18:55:59.368179] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-16T18:55:59.574940] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-09-16T18:56:00.374883] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-09-16T18:56:00.577060] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-16T18:56:00.580079] [INFO ] [REMOTE ] IFS: Full fetch complete (24972 records). [2025-09-16T18:56:00.580166] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-09-16T18:56:00.952869] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-09-16T18:56:00.952972] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-09-16T18:56:00.953565] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-09-16T18:56:00.953619] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-09-16T18:56:00.954711] [DEBUG] [LOCAL ] IFS: Trimmed 24972 records to 16478 (keeping 150 days of data) [2025-09-16T18:56:01.055851] [DEBUG] [LOCAL ] IFS: Primary data saved (16478 records). [2025-09-16T18:56:01.056016] [INFO ] [MAIN ] IFS: Full history saved. [2025-09-16T18:56:01.056125] [INFO ] [MAIN ] Update Progress: 1094/2369 symbols completed. IFS took 38.6s. Estimated remaining: 2h 15m 9s. Rate: 9.4 symbols/min [2025-09-16T18:56:01.180034] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-09-16T18:56:01.227763] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:56:01.231420] [DEBUG] [LOCAL ] IH: Loaded 2002 existing records from primary storage. [2025-09-16T18:56:01.231505] [INFO ] [MAIN ] IH: Loaded 2002 existing records. [2025-09-16T18:56:01.412824] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:56:01.413118] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-09-16T18:56:01.413290] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-09-16T18:56:01.419216] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-09-16T18:56:01.419438] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-16T18:56:01.419582] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-09-16T18:56:01.447671] [INFO ] [REMOTE ] IGD: Full fetch complete (21212 records). [2025-09-16T18:56:01.489817] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-09-16T18:56:01.980092] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-09-16T18:56:02.047051] [INFO ] [REMOTE ] IH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:56:02.194121] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-09-16T18:56:02.194229] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-09-16T18:56:02.194768] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-09-16T18:56:02.194815] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-09-16T18:56:02.195461] [DEBUG] [LOCAL ] IGD: Trimmed 21212 records to 13912 (keeping 150 days of data) [2025-09-16T18:56:02.281009] [DEBUG] [LOCAL ] IGD: Primary data saved (13912 records). [2025-09-16T18:56:02.281166] [INFO ] [MAIN ] IGD: Full history saved. [2025-09-16T18:56:02.281269] [INFO ] [MAIN ] Update Progress: 1095/2369 symbols completed. IGD took 21.5s. Estimated remaining: 2h 14m 57s. Rate: 9.4 symbols/min [2025-09-16T18:56:02.462661] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:56:02.469594] [DEBUG] [LOCAL ] IHD: Loaded 5148 existing records from primary storage. [2025-09-16T18:56:02.469734] [INFO ] [MAIN ] IHD: Loaded 5148 existing records. [2025-09-16T18:56:02.662518] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:56:02.662930] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-09-16T18:56:02.663007] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-09-16T18:56:02.663278] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-09-16T18:56:02.663323] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-09-16T18:56:02.780137] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-09-16T18:56:02.782128] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-16T18:56:02.882939] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-16T18:56:03.079108] [INFO ] [REMOTE ] IHD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:56:03.411955] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-16T18:56:03.574966] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-09-16T18:56:04.362674] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-16T18:56:04.374845] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-09-16T18:56:05.174916] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-09-16T18:56:05.197921] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-16T18:56:05.845601] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-16T18:56:05.846532] [INFO ] [REMOTE ] IGI: Full fetch complete (3976 records). [2025-09-16T18:56:05.846625] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-09-16T18:56:05.979962] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-09-16T18:56:06.217157] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-09-16T18:56:06.217264] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-09-16T18:56:06.217400] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-09-16T18:56:06.217440] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-09-16T18:56:06.217842] [DEBUG] [LOCAL ] IGI: Trimmed 3976 records to 2729 (keeping 150 days of data) [2025-09-16T18:56:06.235561] [DEBUG] [LOCAL ] IGI: Primary data saved (2729 records). [2025-09-16T18:56:06.235630] [INFO ] [MAIN ] IGI: Full history saved. [2025-09-16T18:56:06.235732] [INFO ] [MAIN ] Update Progress: 1096/2369 symbols completed. IGI took 21.9s. Estimated remaining: 2h 14m 48s. Rate: 9.4 symbols/min [2025-09-16T18:56:06.412784] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:56:06.432834] [DEBUG] [LOCAL ] IHG: Loaded 17602 existing records from primary storage. [2025-09-16T18:56:06.432979] [INFO ] [MAIN ] IHG: Loaded 17602 existing records. [2025-09-16T18:56:06.614700] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:56:06.614971] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-09-16T18:56:06.615029] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-09-16T18:56:06.615615] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-09-16T18:56:06.615696] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-09-16T18:56:06.792859] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-09-16T18:56:06.914458] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-16T18:56:06.997928] [INFO ] [REMOTE ] IHG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:56:07.574881] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-09-16T18:56:07.936846] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-16T18:56:08.024891] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-16T18:56:08.374911] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-09-16T18:56:09.174934] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-09-16T18:56:09.602969] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-16T18:56:09.937159] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-16T18:56:09.974863] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-09-16T18:56:10.682246] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-16T18:56:10.774915] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-09-16T18:56:11.574902] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-09-16T18:56:12.198046] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-16T18:56:12.374870] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-09-16T18:56:12.787509] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-16T18:56:13.136327] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-16T18:56:13.174871] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-09-16T18:56:13.783556] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-16T18:56:13.974907] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-09-16T18:56:14.668939] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-16T18:56:14.774902] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-09-16T18:56:15.358506] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-16T18:56:15.574895] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-09-16T18:56:16.217596] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-16T18:56:16.219178] [INFO ] [REMOTE ] IHD: Full fetch complete (8138 records). [2025-09-16T18:56:16.219256] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-09-16T18:56:16.380250] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-09-16T18:56:16.580699] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-09-16T18:56:16.580776] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-09-16T18:56:16.580981] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-09-16T18:56:16.581021] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-09-16T18:56:16.581416] [DEBUG] [LOCAL ] IHD: Trimmed 8138 records to 5213 (keeping 150 days of data) [2025-09-16T18:56:16.611491] [DEBUG] [LOCAL ] IHD: Primary data saved (5213 records). [2025-09-16T18:56:16.611561] [INFO ] [MAIN ] IHD: Full history saved. [2025-09-16T18:56:16.611666] [INFO ] [MAIN ] Update Progress: 1097/2369 symbols completed. IHD took 14.3s. Estimated remaining: 2h 14m 46s. Rate: 9.4 symbols/min [2025-09-16T18:56:16.783060] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:56:16.810069] [DEBUG] [LOCAL ] IHS: Loaded 29102 existing records from primary storage. [2025-09-16T18:56:16.810194] [INFO ] [MAIN ] IHS: Loaded 29102 existing records. [2025-09-16T18:56:16.984444] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:56:16.984725] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-09-16T18:56:16.984774] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-09-16T18:56:16.985446] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-09-16T18:56:16.985490] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-09-16T18:56:17.180379] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-09-16T18:56:17.337801] [INFO ] [REMOTE ] IHS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:56:17.660344] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-16T18:56:17.664749] [INFO ] [REMOTE ] IGR: Full fetch complete (33284 records). [2025-09-16T18:56:17.664847] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-09-16T18:56:17.980115] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-09-16T18:56:18.066049] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-09-16T18:56:18.066149] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-09-16T18:56:18.066860] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-09-16T18:56:18.066927] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-09-16T18:56:18.068018] [DEBUG] [LOCAL ] IGR: Trimmed 33284 records to 22600 (keeping 150 days of data) [2025-09-16T18:56:18.205354] [DEBUG] [LOCAL ] IGR: Primary data saved (22600 records). [2025-09-16T18:56:18.205492] [INFO ] [MAIN ] IGR: Full history saved. [2025-09-16T18:56:18.205603] [INFO ] [MAIN ] Update Progress: 1098/2369 symbols completed. IGR took 27.6s. Estimated remaining: 2h 14m 34s. Rate: 9.4 symbols/min [2025-09-16T18:56:18.385858] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:56:18.391866] [DEBUG] [LOCAL ] IIF: Loaded 4027 existing records from primary storage. [2025-09-16T18:56:18.391981] [INFO ] [MAIN ] IIF: Loaded 4027 existing records. [2025-09-16T18:56:18.511944] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-16T18:56:18.597694] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:56:18.597965] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-09-16T18:56:18.598011] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-09-16T18:56:18.598298] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-09-16T18:56:18.598352] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-09-16T18:56:18.784548] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-09-16T18:56:18.976714] [INFO ] [REMOTE ] IIF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:56:18.992912] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-16T18:56:19.574952] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-09-16T18:56:20.325407] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-16T18:56:20.374873] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-09-16T18:56:20.991218] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-16T18:56:21.174929] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-09-16T18:56:21.591217] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-16T18:56:21.700133] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-16T18:56:21.974901] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-09-16T18:56:22.774881] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-09-16T18:56:23.127200] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-16T18:56:23.574912] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-09-16T18:56:24.126993] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-16T18:56:24.324468] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-16T18:56:24.374912] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-09-16T18:56:24.961453] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-16T18:56:25.174913] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-09-16T18:56:25.974923] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-09-16T18:56:26.541701] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-16T18:56:26.774935] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-09-16T18:56:27.219285] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-16T18:56:27.475154] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-16T18:56:27.574863] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-09-16T18:56:27.959661] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-16T18:56:28.374922] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-09-16T18:56:29.174916] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-09-16T18:56:29.720928] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-16T18:56:29.721984] [INFO ] [REMOTE ] IH: Full fetch complete (4235 records). [2025-09-16T18:56:29.722056] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-09-16T18:56:29.977334] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-09-16T18:56:30.113976] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-09-16T18:56:30.114379] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-09-16T18:56:30.114552] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-09-16T18:56:30.116297] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-09-16T18:56:30.116202] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-16T18:56:30.116931] [DEBUG] [LOCAL ] IH: Trimmed 4235 records to 2033 (keeping 150 days of data) [2025-09-16T18:56:30.137671] [DEBUG] [LOCAL ] IH: Primary data saved (2033 records). [2025-09-16T18:56:30.137738] [INFO ] [MAIN ] IH: Full history saved. [2025-09-16T18:56:30.137823] [INFO ] [MAIN ] Update Progress: 1099/2369 symbols completed. IH took 29.1s. Estimated remaining: 2h 14m 34s. Rate: 9.4 symbols/min [2025-09-16T18:56:30.315307] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:56:30.331223] [DEBUG] [LOCAL ] IIIN: Loaded 11671 existing records from primary storage. [2025-09-16T18:56:30.331345] [INFO ] [MAIN ] IIIN: Loaded 11671 existing records. [2025-09-16T18:56:30.506215] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:56:30.506491] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-09-16T18:56:30.506548] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-09-16T18:56:30.506992] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-09-16T18:56:30.507055] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-09-16T18:56:30.780856] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-09-16T18:56:30.857753] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:56:31.174589] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-16T18:56:31.492561] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-16T18:56:31.574890] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-09-16T18:56:32.195435] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-16T18:56:32.374903] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-09-16T18:56:33.174908] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-09-16T18:56:33.401092] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-16T18:56:33.403984] [INFO ] [REMOTE ] IHG: Full fetch complete (27406 records). [2025-09-16T18:56:33.404081] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-09-16T18:56:33.771052] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-09-16T18:56:33.771133] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-09-16T18:56:33.771754] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-09-16T18:56:33.771799] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-09-16T18:56:33.772458] [DEBUG] [LOCAL ] IHG: Trimmed 27406 records to 17709 (keeping 150 days of data) [2025-09-16T18:56:33.864271] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-16T18:56:33.897387] [DEBUG] [LOCAL ] IHG: Primary data saved (17709 records). [2025-09-16T18:56:33.897527] [INFO ] [MAIN ] IHG: Full history saved. [2025-09-16T18:56:33.897631] [INFO ] [MAIN ] Update Progress: 1100/2369 symbols completed. IHG took 27.7s. Estimated remaining: 2h 14m 25s. Rate: 9.4 symbols/min [2025-09-16T18:56:33.980117] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-09-16T18:56:34.080401] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:56:34.092799] [DEBUG] [LOCAL ] IIM: Loaded 11317 existing records from primary storage. [2025-09-16T18:56:34.092901] [INFO ] [MAIN ] IIM: Loaded 11317 existing records. [2025-09-16T18:56:34.276752] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:56:34.277011] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-09-16T18:56:34.277058] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-09-16T18:56:34.277408] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-09-16T18:56:34.277452] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-09-16T18:56:34.670133] [INFO ] [REMOTE ] IIM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:56:34.774899] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-09-16T18:56:35.521519] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-16T18:56:35.547576] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-16T18:56:35.574859] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-09-16T18:56:36.374931] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-09-16T18:56:36.933734] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-16T18:56:37.174869] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-09-16T18:56:37.467553] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-16T18:56:37.974898] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-09-16T18:56:38.474012] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-16T18:56:38.479695] [INFO ] [REMOTE ] IHS: Full fetch complete (41405 records). [2025-09-16T18:56:38.479828] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-09-16T18:56:38.783113] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-09-16T18:56:38.912051] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-09-16T18:56:38.912144] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-09-16T18:56:38.912911] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-09-16T18:56:38.912961] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-09-16T18:56:38.914308] [DEBUG] [LOCAL ] IHS: Trimmed 41405 records to 29352 (keeping 150 days of data) [2025-09-16T18:56:39.036134] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-16T18:56:39.101522] [DEBUG] [LOCAL ] IHS: Primary data saved (29352 records). [2025-09-16T18:56:39.101690] [INFO ] [MAIN ] IHS: Full history saved. [2025-09-16T18:56:39.101784] [INFO ] [MAIN ] Update Progress: 1101/2369 symbols completed. IHS took 22.5s. Estimated remaining: 2h 14m 17s. Rate: 9.4 symbols/min [2025-09-16T18:56:39.272839] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:56:39.292540] [DEBUG] [LOCAL ] IIPR: Loaded 20582 existing records from primary storage. [2025-09-16T18:56:39.292691] [INFO ] [MAIN ] IIPR: Loaded 20582 existing records. [2025-09-16T18:56:39.473890] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:56:39.474163] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-09-16T18:56:39.474212] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-09-16T18:56:39.474838] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-09-16T18:56:39.474889] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-09-16T18:56:39.575801] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-09-16T18:56:39.827938] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:56:39.853853] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-16T18:56:40.374898] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-09-16T18:56:40.622575] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-16T18:56:41.174907] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-09-16T18:56:41.635788] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-16T18:56:41.709807] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-16T18:56:41.974910] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-09-16T18:56:42.774900] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-09-16T18:56:42.891963] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-16T18:56:43.574887] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-09-16T18:56:44.286848] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-16T18:56:44.308261] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-16T18:56:44.374848] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-09-16T18:56:45.174907] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-09-16T18:56:45.291480] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-16T18:56:45.974914] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-09-16T18:56:46.562843] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-16T18:56:46.587736] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-16T18:56:46.774931] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-09-16T18:56:47.514356] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-16T18:56:47.575038] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-09-16T18:56:48.374911] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-09-16T18:56:48.848311] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-16T18:56:49.174909] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-09-16T18:56:49.339698] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-16T18:56:49.799557] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-16T18:56:49.800576] [INFO ] [REMOTE ] IIF: Full fetch complete (6482 records). [2025-09-16T18:56:49.800670] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-09-16T18:56:49.980321] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-09-16T18:56:50.159985] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-09-16T18:56:50.160087] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-09-16T18:56:50.160279] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-09-16T18:56:50.160321] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-09-16T18:56:50.160915] [DEBUG] [LOCAL ] IIF: Trimmed 6482 records to 4047 (keeping 150 days of data) [2025-09-16T18:56:50.185152] [DEBUG] [LOCAL ] IIF: Primary data saved (4047 records). [2025-09-16T18:56:50.185270] [INFO ] [MAIN ] IIF: Full history saved. [2025-09-16T18:56:50.185381] [INFO ] [MAIN ] Update Progress: 1102/2369 symbols completed. IIF took 32.0s. Estimated remaining: 2h 14m 16s. Rate: 9.4 symbols/min [2025-09-16T18:56:50.354245] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:56:50.391788] [DEBUG] [LOCAL ] IMAX: Loaded 31543 existing records from primary storage. [2025-09-16T18:56:50.391961] [INFO ] [MAIN ] IMAX: Loaded 31543 existing records. [2025-09-16T18:56:50.564402] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:56:50.564628] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-09-16T18:56:50.564713] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-09-16T18:56:50.565455] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-09-16T18:56:50.565501] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-09-16T18:56:50.781261] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-09-16T18:56:50.917154] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:56:51.045961] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-16T18:56:51.574897] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-09-16T18:56:52.112201] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-16T18:56:52.175882] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-16T18:56:52.374900] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-09-16T18:56:53.100120] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-16T18:56:53.102799] [INFO ] [REMOTE ] IIM: Full fetch complete (18436 records). [2025-09-16T18:56:53.102871] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-09-16T18:56:53.180015] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-09-16T18:56:53.466830] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-09-16T18:56:53.466907] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-09-16T18:56:53.467290] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-09-16T18:56:53.467330] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-09-16T18:56:53.468000] [DEBUG] [LOCAL ] IIM: Trimmed 18436 records to 11438 (keeping 150 days of data) [2025-09-16T18:56:53.537614] [DEBUG] [LOCAL ] IIM: Primary data saved (11438 records). [2025-09-16T18:56:53.537757] [INFO ] [MAIN ] IIM: Full history saved. [2025-09-16T18:56:53.537850] [INFO ] [MAIN ] Update Progress: 1103/2369 symbols completed. IIM took 19.6s. Estimated remaining: 2h 14m 6s. Rate: 9.4 symbols/min [2025-09-16T18:56:53.707236] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:56:53.750306] [DEBUG] [LOCAL ] INFA: Loaded 36912 existing records from primary storage. [2025-09-16T18:56:53.750449] [INFO ] [MAIN ] INFA: Loaded 36912 existing records. [2025-09-16T18:56:53.930428] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:56:53.930724] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-09-16T18:56:53.930773] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-09-16T18:56:53.931590] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-09-16T18:56:53.931667] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-09-16T18:56:53.986515] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-09-16T18:56:54.292959] [INFO ] [REMOTE ] INFA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:56:54.578158] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-16T18:56:54.774923] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-09-16T18:56:55.446610] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-16T18:56:55.574926] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-09-16T18:56:56.165575] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-16T18:56:56.374923] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-09-16T18:56:56.591632] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-16T18:56:57.174902] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-09-16T18:56:57.950551] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-16T18:56:57.974857] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-09-16T18:56:57.997046] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-16T18:56:58.774907] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-09-16T18:56:59.574898] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-09-16T18:56:59.717348] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-16T18:57:00.235116] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-16T18:57:00.374869] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-09-16T18:57:00.478164] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-16T18:57:00.479995] [INFO ] [REMOTE ] IIIN: Full fetch complete (18454 records). [2025-09-16T18:57:00.480065] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-09-16T18:57:00.849136] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-09-16T18:57:00.849215] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-09-16T18:57:00.849660] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-09-16T18:57:00.849712] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-09-16T18:57:00.850365] [DEBUG] [LOCAL ] IIIN: Trimmed 18454 records to 11751 (keeping 150 days of data) [2025-09-16T18:57:00.925610] [DEBUG] [LOCAL ] IIIN: Primary data saved (11751 records). [2025-09-16T18:57:00.925772] [INFO ] [MAIN ] IIIN: Full history saved. [2025-09-16T18:57:00.925865] [INFO ] [MAIN ] Update Progress: 1104/2369 symbols completed. IIIN took 30.8s. Estimated remaining: 2h 14m 1s. Rate: 9.4 symbols/min [2025-09-16T18:57:01.100743] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:57:01.146726] [DEBUG] [LOCAL ] INFY: Loaded 39568 existing records from primary storage. [2025-09-16T18:57:01.146867] [INFO ] [MAIN ] INFY: Loaded 39568 existing records. [2025-09-16T18:57:01.180021] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-09-16T18:57:01.326633] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:57:01.326891] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-09-16T18:57:01.326939] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-09-16T18:57:01.327911] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-09-16T18:57:01.327963] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-09-16T18:57:01.679326] [INFO ] [REMOTE ] INFY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:57:01.974906] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-09-16T18:57:02.238760] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-16T18:57:02.541765] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-16T18:57:02.545484] [INFO ] [REMOTE ] IIPR: Full fetch complete (32119 records). [2025-09-16T18:57:02.545602] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-09-16T18:57:02.780084] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-09-16T18:57:02.925035] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-09-16T18:57:02.925114] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-09-16T18:57:02.925716] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-09-16T18:57:02.925760] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-09-16T18:57:02.926486] [DEBUG] [LOCAL ] IIPR: Trimmed 32119 records to 20792 (keeping 150 days of data) [2025-09-16T18:57:03.050452] [DEBUG] [LOCAL ] IIPR: Primary data saved (20792 records). [2025-09-16T18:57:03.050582] [INFO ] [MAIN ] IIPR: Full history saved. [2025-09-16T18:57:03.050695] [INFO ] [MAIN ] Update Progress: 1105/2369 symbols completed. IIPR took 23.9s. Estimated remaining: 2h 13m 50s. Rate: 9.4 symbols/min [2025-09-16T18:57:03.234480] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:57:03.272095] [DEBUG] [LOCAL ] ING: Loaded 37270 existing records from primary storage. [2025-09-16T18:57:03.272270] [INFO ] [MAIN ] ING: Loaded 37270 existing records. [2025-09-16T18:57:03.454666] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:57:03.455024] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-09-16T18:57:03.455105] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-09-16T18:57:03.456059] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-09-16T18:57:03.456121] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-09-16T18:57:03.576967] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-09-16T18:57:03.720820] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-16T18:57:03.871726] [INFO ] [REMOTE ] ING: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:57:04.027320] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-16T18:57:04.374930] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-09-16T18:57:05.174915] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-09-16T18:57:05.365291] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-16T18:57:05.494065] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-16T18:57:05.974930] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-09-16T18:57:06.699492] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-16T18:57:06.774905] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-09-16T18:57:07.581772] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-09-16T18:57:07.600915] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-16T18:57:08.374869] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-09-16T18:57:08.788186] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-16T18:57:08.854745] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-16T18:57:09.174915] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-09-16T18:57:09.777048] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-16T18:57:09.974874] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-09-16T18:57:10.774897] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-09-16T18:57:10.890499] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-16T18:57:11.574891] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-09-16T18:57:11.821771] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-16T18:57:12.374914] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-09-16T18:57:12.652252] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-16T18:57:12.871312] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-16T18:57:13.174909] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-09-16T18:57:13.663023] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-16T18:57:13.974905] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-09-16T18:57:14.626890] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-16T18:57:14.774898] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-09-16T18:57:15.447139] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-16T18:57:15.453159] [INFO ] [REMOTE ] INFA: Full fetch complete (54722 records). [2025-09-16T18:57:15.453271] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-09-16T18:57:15.580062] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-09-16T18:57:15.836773] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-09-16T18:57:15.836850] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-09-16T18:57:15.837597] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-09-16T18:57:15.837654] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-09-16T18:57:15.838742] [DEBUG] [LOCAL ] INFA: Trimmed 54722 records to 37288 (keeping 150 days of data) [2025-09-16T18:57:16.062222] [DEBUG] [LOCAL ] INFA: Primary data saved (37288 records). [2025-09-16T18:57:16.062367] [INFO ] [MAIN ] INFA: Full history saved. [2025-09-16T18:57:16.063296] [INFO ] [MAIN ] Update Progress: 1106/2369 symbols completed. INFA took 22.5s. Estimated remaining: 2h 13m 51s. Rate: 9.4 symbols/min [2025-09-16T18:57:16.233758] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:57:16.255293] [DEBUG] [LOCAL ] INGM: Loaded 20005 existing records from primary storage. [2025-09-16T18:57:16.255427] [INFO ] [MAIN ] INGM: Loaded 20005 existing records. [2025-09-16T18:57:16.379748] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-09-16T18:57:16.442018] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:57:16.442503] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-09-16T18:57:16.442615] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-09-16T18:57:16.443280] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-09-16T18:57:16.443330] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-09-16T18:57:16.625270] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-16T18:57:16.833789] [INFO ] [REMOTE ] INGM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:57:17.174872] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-09-16T18:57:17.266536] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-16T18:57:17.979956] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-09-16T18:57:17.996825] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-16T18:57:18.509726] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-16T18:57:18.774931] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-09-16T18:57:19.574904] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-09-16T18:57:19.932010] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-16T18:57:20.299112] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-16T18:57:20.374928] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-09-16T18:57:20.976772] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-16T18:57:20.982240] [INFO ] [REMOTE ] IMAX: Full fetch complete (46257 records). [2025-09-16T18:57:20.982388] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-09-16T18:57:21.183243] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-09-16T18:57:21.365771] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-09-16T18:57:21.365859] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-09-16T18:57:21.366613] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-09-16T18:57:21.366674] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-09-16T18:57:21.367665] [DEBUG] [LOCAL ] IMAX: Trimmed 46257 records to 31866 (keeping 150 days of data) [2025-09-16T18:57:21.558340] [DEBUG] [LOCAL ] IMAX: Primary data saved (31866 records). [2025-09-16T18:57:21.558615] [INFO ] [MAIN ] IMAX: Full history saved. [2025-09-16T18:57:21.558799] [INFO ] [MAIN ] Update Progress: 1107/2369 symbols completed. IMAX took 31.4s. Estimated remaining: 2h 13m 44s. Rate: 9.4 symbols/min [2025-09-16T18:57:21.739844] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:57:21.758782] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-16T18:57:21.791696] [DEBUG] [LOCAL ] INGR: Loaded 23872 existing records from primary storage. [2025-09-16T18:57:21.791917] [INFO ] [MAIN ] INGR: Loaded 23872 existing records. [2025-09-16T18:57:21.973301] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:57:21.973552] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-09-16T18:57:21.973598] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-09-16T18:57:21.974277] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-09-16T18:57:21.974324] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-09-16T18:57:21.985434] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-09-16T18:57:22.331113] [INFO ] [REMOTE ] INGR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:57:22.774941] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-09-16T18:57:22.980347] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-16T18:57:23.574904] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-09-16T18:57:23.911548] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-16T18:57:24.183675] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-16T18:57:24.374908] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-09-16T18:57:25.174878] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-09-16T18:57:25.192171] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-16T18:57:25.198563] [INFO ] [REMOTE ] ING: Full fetch complete (55237 records). [2025-09-16T18:57:25.198693] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-09-16T18:57:25.597194] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-09-16T18:57:25.597353] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-09-16T18:57:25.598222] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-09-16T18:57:25.598319] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-09-16T18:57:25.599822] [DEBUG] [LOCAL ] ING: Trimmed 55237 records to 37640 (keeping 150 days of data) [2025-09-16T18:57:25.724434] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-16T18:57:25.861796] [DEBUG] [LOCAL ] ING: Primary data saved (37640 records). [2025-09-16T18:57:25.861941] [INFO ] [MAIN ] ING: Full history saved. [2025-09-16T18:57:25.862023] [INFO ] [MAIN ] Update Progress: 1108/2369 symbols completed. ING took 22.8s. Estimated remaining: 2h 13m 35s. Rate: 9.4 symbols/min [2025-09-16T18:57:25.979980] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-09-16T18:57:26.035410] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:57:26.064678] [DEBUG] [LOCAL ] INN: Loaded 31262 existing records from primary storage. [2025-09-16T18:57:26.064815] [INFO ] [MAIN ] INN: Loaded 31262 existing records. [2025-09-16T18:57:26.240963] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:57:26.241235] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-09-16T18:57:26.241279] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-09-16T18:57:26.242016] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-09-16T18:57:26.242066] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-09-16T18:57:26.602316] [INFO ] [REMOTE ] INN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:57:26.623321] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-16T18:57:26.774905] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-09-16T18:57:27.574918] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-09-16T18:57:27.762290] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-16T18:57:27.768697] [INFO ] [REMOTE ] INFY: Full fetch complete (58272 records). [2025-09-16T18:57:27.768798] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-09-16T18:57:28.146286] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-09-16T18:57:28.146427] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-09-16T18:57:28.147270] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-09-16T18:57:28.147327] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-09-16T18:57:28.148605] [DEBUG] [LOCAL ] INFY: Trimmed 58272 records to 39957 (keeping 150 days of data) [2025-09-16T18:57:28.257997] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-16T18:57:28.391525] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-09-16T18:57:28.427533] [DEBUG] [LOCAL ] INFY: Primary data saved (39957 records). [2025-09-16T18:57:28.427709] [INFO ] [MAIN ] INFY: Full history saved. [2025-09-16T18:57:28.427836] [INFO ] [MAIN ] Update Progress: 1109/2369 symbols completed. INFY took 27.5s. Estimated remaining: 2h 13m 25s. Rate: 9.4 symbols/min [2025-09-16T18:57:28.599324] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:57:28.618333] [DEBUG] [LOCAL ] INR: Loaded 19051 existing records from primary storage. [2025-09-16T18:57:28.618466] [INFO ] [MAIN ] INR: Loaded 19051 existing records. [2025-09-16T18:57:28.791544] [WARN ] [MAIN ] INR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:57:28.791788] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-09-16T18:57:28.791834] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-09-16T18:57:28.792407] [DEBUG] [LOCAL ] INR: Deleted primary data file. [2025-09-16T18:57:28.792453] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-09-16T18:57:29.196543] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-09-16T18:57:29.206366] [INFO ] [REMOTE ] INR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:57:29.211243] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-16T18:57:29.782302] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-16T18:57:29.974920] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-02. [2025-09-16T18:57:30.024830] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-16T18:57:30.774928] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-09-16T18:57:31.253282] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-16T18:57:31.574906] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-09-16T18:57:31.861952] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-16T18:57:32.374910] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-03. [2025-09-16T18:57:32.845867] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-16T18:57:33.174917] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-09-16T18:57:33.680517] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-16T18:57:33.974902] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-04. [2025-09-16T18:57:34.579741] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-16T18:57:34.774928] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-09-16T18:57:35.028916] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-16T18:57:35.574905] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-05. [2025-09-16T18:57:35.980762] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-16T18:57:36.374871] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-09-16T18:57:36.690236] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-16T18:57:37.174906] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-06. [2025-09-16T18:57:37.637924] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-16T18:57:37.974911] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-09-16T18:57:38.184623] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-16T18:57:38.774903] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-09-16T18:57:39.079485] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-16T18:57:39.574914] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-07. [2025-09-16T18:57:39.945423] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-16T18:57:40.374876] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-09-16T18:57:40.830232] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-16T18:57:41.174874] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-08. [2025-09-16T18:57:41.357418] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-16T18:57:41.974871] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-09-16T18:57:42.387509] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-16T18:57:42.774890] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-09. [2025-09-16T18:57:43.299289] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-16T18:57:43.574899] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-09-16T18:57:44.015823] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-16T18:57:44.019308] [INFO ] [REMOTE ] INR: Full fetch complete (29750 records). [2025-09-16T18:57:44.019382] [DEBUG] [VALIDATOR ] INR: Validating primary data. [2025-09-16T18:57:44.384713] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-09-16T18:57:44.397886] [DEBUG] [VALIDATOR ] INR: All expected trading days are present. [2025-09-16T18:57:44.397947] [DEBUG] [VALIDATOR ] INR: Primary data validation passed. [2025-09-16T18:57:44.398619] [INFO ] [MAIN ] INR: Fetched primary data is valid. [2025-09-16T18:57:44.398779] [DEBUG] [LOCAL ] INR: Saving primary data. [2025-09-16T18:57:44.399600] [DEBUG] [LOCAL ] INR: Trimmed 29750 records to 19261 (keeping 150 days of data) [2025-09-16T18:57:44.513497] [DEBUG] [LOCAL ] INR: Primary data saved (19261 records). [2025-09-16T18:57:44.513679] [INFO ] [MAIN ] INR: Full history saved. [2025-09-16T18:57:44.513786] [INFO ] [MAIN ] Update Progress: 1110/2369 symbols completed. INR took 16.1s. Estimated remaining: 2h 13m 29s. Rate: 9.4 symbols/min [2025-09-16T18:57:44.696083] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:57:44.720623] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-16T18:57:44.750132] [DEBUG] [LOCAL ] INSP: Loaded 27714 existing records from primary storage. [2025-09-16T18:57:44.750264] [INFO ] [MAIN ] INSP: Loaded 27714 existing records. [2025-09-16T18:57:44.924587] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:57:44.924852] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-09-16T18:57:44.924898] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-09-16T18:57:44.925580] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-09-16T18:57:44.925633] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-09-16T18:57:45.180024] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-09-16T18:57:45.297287] [INFO ] [REMOTE ] INSP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:57:45.511680] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-16T18:57:45.974859] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-09-16T18:57:46.433325] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-16T18:57:46.774906] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-09-16T18:57:47.360258] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-16T18:57:47.574870] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-09-16T18:57:47.905615] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-16T18:57:47.909117] [INFO ] [REMOTE ] INGM: Full fetch complete (31545 records). [2025-09-16T18:57:47.909202] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-09-16T18:57:48.277535] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-09-16T18:57:48.277612] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-09-16T18:57:48.278293] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-09-16T18:57:48.278340] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-09-16T18:57:48.279161] [DEBUG] [LOCAL ] INGM: Trimmed 31545 records to 20171 (keeping 150 days of data) [2025-09-16T18:57:48.379729] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-09-16T18:57:48.410071] [DEBUG] [LOCAL ] INGM: Primary data saved (20171 records). [2025-09-16T18:57:48.410218] [INFO ] [MAIN ] INGM: Full history saved. [2025-09-16T18:57:48.410317] [INFO ] [MAIN ] Update Progress: 1111/2369 symbols completed. INGM took 32.3s. Estimated remaining: 2h 13m 20s. Rate: 9.4 symbols/min [2025-09-16T18:57:48.580950] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:57:48.611727] [DEBUG] [LOCAL ] INSW: Loaded 29210 existing records from primary storage. [2025-09-16T18:57:48.611903] [INFO ] [MAIN ] INSW: Loaded 29210 existing records. [2025-09-16T18:57:48.786787] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:57:48.787041] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-09-16T18:57:48.787092] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-09-16T18:57:48.787936] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-09-16T18:57:48.787990] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-09-16T18:57:49.154932] [INFO ] [REMOTE ] INSW: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:57:49.174368] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-16T18:57:49.181687] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-09-16T18:57:49.343299] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-16T18:57:49.348727] [INFO ] [REMOTE ] INGR: Full fetch complete (36808 records). [2025-09-16T18:57:49.348883] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-09-16T18:57:49.722512] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-09-16T18:57:49.722593] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-09-16T18:57:49.723246] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-09-16T18:57:49.723301] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-09-16T18:57:49.724179] [DEBUG] [LOCAL ] INGR: Trimmed 36808 records to 24186 (keeping 150 days of data) [2025-09-16T18:57:49.875243] [DEBUG] [LOCAL ] INGR: Primary data saved (24186 records). [2025-09-16T18:57:49.875394] [INFO ] [MAIN ] INGR: Full history saved. [2025-09-16T18:57:49.875480] [INFO ] [MAIN ] Update Progress: 1112/2369 symbols completed. INGR took 28.3s. Estimated remaining: 2h 13m 8s. Rate: 9.4 symbols/min [2025-09-16T18:57:49.980092] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-09-16T18:57:50.057066] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:57:50.095141] [DEBUG] [LOCAL ] INVH: Loaded 39223 existing records from primary storage. [2025-09-16T18:57:50.095318] [INFO ] [MAIN ] INVH: Loaded 39223 existing records. [2025-09-16T18:57:50.276658] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:57:50.277011] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-09-16T18:57:50.277064] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-09-16T18:57:50.277856] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-09-16T18:57:50.277906] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-09-16T18:57:50.442917] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-16T18:57:50.660138] [INFO ] [REMOTE ] INVH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:57:50.774949] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-09-16T18:57:51.319112] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-16T18:57:51.323898] [INFO ] [REMOTE ] INN: Full fetch complete (45094 records). [2025-09-16T18:57:51.324019] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-09-16T18:57:51.579976] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-09-16T18:57:51.703267] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-09-16T18:57:51.703360] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-09-16T18:57:51.704109] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-09-16T18:57:51.704158] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-09-16T18:57:51.705295] [DEBUG] [LOCAL ] INN: Trimmed 45094 records to 31561 (keeping 150 days of data) [2025-09-16T18:57:51.898445] [DEBUG] [LOCAL ] INN: Primary data saved (31561 records). [2025-09-16T18:57:51.898593] [INFO ] [MAIN ] INN: Full history saved. [2025-09-16T18:57:51.898694] [INFO ] [MAIN ] Update Progress: 1113/2369 symbols completed. INN took 26.0s. Estimated remaining: 2h 12m 57s. Rate: 9.4 symbols/min [2025-09-16T18:57:52.074483] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:57:52.094984] [DEBUG] [LOCAL ] INVX: Loaded 21242 existing records from primary storage. [2025-09-16T18:57:52.095135] [INFO ] [MAIN ] INVX: Loaded 21242 existing records. [2025-09-16T18:57:52.273406] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:57:52.273733] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-09-16T18:57:52.273800] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-09-16T18:57:52.274329] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-09-16T18:57:52.274380] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-09-16T18:57:52.377734] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-09-16T18:57:52.648821] [INFO ] [REMOTE ] INVX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:57:52.677542] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-16T18:57:52.728062] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-16T18:57:53.174966] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-09-16T18:57:53.807622] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-16T18:57:53.974907] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-09-16T18:57:54.774929] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-09-16T18:57:54.968570] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-16T18:57:55.415258] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-16T18:57:55.574902] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-09-16T18:57:55.747968] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-16T18:57:56.374927] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-09-16T18:57:56.890454] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-16T18:57:57.174962] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-09-16T18:57:57.574925] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-16T18:57:57.974916] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-09-16T18:57:58.195127] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-16T18:57:58.774956] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-09-16T18:57:59.452129] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-16T18:57:59.574982] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-09-16T18:58:00.380058] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-09-16T18:58:00.394136] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-16T18:58:01.084621] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-16T18:58:01.174948] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-09-16T18:58:01.974930] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-09-16T18:58:02.407428] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-16T18:58:02.774924] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-09-16T18:58:02.817011] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-16T18:58:03.473705] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-16T18:58:03.574894] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-09-16T18:58:03.611094] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-16T18:58:04.374941] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-09-16T18:58:05.036363] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-16T18:58:05.174906] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-09-16T18:58:05.486166] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-16T18:58:05.491740] [INFO ] [REMOTE ] INSP: Full fetch complete (39660 records). [2025-09-16T18:58:05.491861] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-09-16T18:58:05.870101] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-09-16T18:58:05.870183] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-09-16T18:58:05.870921] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-09-16T18:58:05.870982] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-09-16T18:58:05.872006] [DEBUG] [LOCAL ] INSP: Trimmed 39660 records to 28015 (keeping 150 days of data) [2025-09-16T18:58:05.979704] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-09-16T18:58:06.043277] [DEBUG] [LOCAL ] INSP: Primary data saved (28015 records). [2025-09-16T18:58:06.043415] [INFO ] [MAIN ] INSP: Full history saved. [2025-09-16T18:58:06.043537] [INFO ] [MAIN ] Update Progress: 1114/2369 symbols completed. INSP took 21.5s. Estimated remaining: 2h 12m 59s. Rate: 9.4 symbols/min [2025-09-16T18:58:06.215089] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:58:06.252352] [DEBUG] [LOCAL ] IONQ: Loaded 39748 existing records from primary storage. [2025-09-16T18:58:06.252496] [INFO ] [MAIN ] IONQ: Loaded 39748 existing records. [2025-09-16T18:58:06.428904] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:58:06.429131] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-09-16T18:58:06.429176] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-09-16T18:58:06.429899] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-09-16T18:58:06.429949] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-09-16T18:58:06.776983] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-09-16T18:58:06.796846] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:58:06.822364] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-16T18:58:06.849442] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-16T18:58:07.574896] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-09-16T18:58:08.374978] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-09-16T18:58:08.566176] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-16T18:58:08.592989] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-16T18:58:09.174950] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-09-16T18:58:09.967327] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-16T18:58:09.975338] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-09-16T18:58:10.271768] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-16T18:58:10.275134] [INFO ] [REMOTE ] INVX: Full fetch complete (31855 records). [2025-09-16T18:58:10.275289] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-09-16T18:58:10.645851] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-09-16T18:58:10.645936] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-09-16T18:58:10.646561] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-09-16T18:58:10.646602] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-09-16T18:58:10.647460] [DEBUG] [LOCAL ] INVX: Trimmed 31855 records to 21435 (keeping 150 days of data) [2025-09-16T18:58:10.776513] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-09-16T18:58:10.777071] [DEBUG] [LOCAL ] INVX: Primary data saved (21435 records). [2025-09-16T18:58:10.778446] [INFO ] [MAIN ] INVX: Full history saved. [2025-09-16T18:58:10.778577] [INFO ] [MAIN ] Update Progress: 1115/2369 symbols completed. INVX took 18.9s. Estimated remaining: 2h 12m 51s. Rate: 9.4 symbols/min [2025-09-16T18:58:10.960076] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:58:10.996926] [DEBUG] [LOCAL ] IOT: Loaded 39479 existing records from primary storage. [2025-09-16T18:58:10.997063] [INFO ] [MAIN ] IOT: Loaded 39479 existing records. [2025-09-16T18:58:11.175832] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:58:11.176052] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-09-16T18:58:11.176101] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-09-16T18:58:11.176930] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-09-16T18:58:11.176984] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-09-16T18:58:11.546824] [INFO ] [REMOTE ] IOT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:58:11.574854] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-09-16T18:58:11.677713] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-16T18:58:12.220321] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-16T18:58:12.374904] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-09-16T18:58:13.174895] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-09-16T18:58:13.321984] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-16T18:58:13.974941] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-09-16T18:58:14.774955] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-09-16T18:58:14.964022] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-16T18:58:15.003311] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.63 seconds). [2025-09-16T18:58:15.456608] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-16T18:58:15.461286] [INFO ] [REMOTE ] INSW: Full fetch complete (44610 records). [2025-09-16T18:58:15.461377] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-09-16T18:58:15.580029] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-09-16T18:58:15.837770] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-09-16T18:58:15.837846] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-09-16T18:58:15.838517] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-09-16T18:58:15.838557] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-09-16T18:58:15.839489] [DEBUG] [LOCAL ] INSW: Trimmed 44610 records to 29451 (keeping 150 days of data) [2025-09-16T18:58:16.018564] [DEBUG] [LOCAL ] INSW: Primary data saved (29451 records). [2025-09-16T18:58:16.018716] [INFO ] [MAIN ] INSW: Full history saved. [2025-09-16T18:58:16.019392] [INFO ] [MAIN ] Update Progress: 1116/2369 symbols completed. INSW took 27.6s. Estimated remaining: 2h 12m 44s. Rate: 9.4 symbols/min [2025-09-16T18:58:16.195335] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:58:16.236343] [DEBUG] [LOCAL ] IP: Loaded 39314 existing records from primary storage. [2025-09-16T18:58:16.236487] [INFO ] [MAIN ] IP: Loaded 39314 existing records. [2025-09-16T18:58:16.380110] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-09-16T18:58:16.416635] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:58:16.416879] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-09-16T18:58:16.416936] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-09-16T18:58:16.417751] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-09-16T18:58:16.417804] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-09-16T18:58:16.771732] [INFO ] [REMOTE ] IP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:58:16.805629] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-16T18:58:17.174861] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-09-16T18:58:17.268673] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-16T18:58:17.974902] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-09-16T18:58:18.774872] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-09-16T18:58:18.955716] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-09-16T18:58:18.995139] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-16T18:58:19.247605] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-16T18:58:19.254045] [INFO ] [REMOTE ] INVH: Full fetch complete (57745 records). [2025-09-16T18:58:19.254175] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-09-16T18:58:19.580030] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-09-16T18:58:19.661965] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-09-16T18:58:19.662060] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-09-16T18:58:19.662868] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-09-16T18:58:19.662913] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-09-16T18:58:19.664152] [DEBUG] [LOCAL ] INVH: Trimmed 57745 records to 39610 (keeping 150 days of data) [2025-09-16T18:58:19.906971] [DEBUG] [LOCAL ] INVH: Primary data saved (39610 records). [2025-09-16T18:58:19.907114] [INFO ] [MAIN ] INVH: Full history saved. [2025-09-16T18:58:19.907198] [INFO ] [MAIN ] Update Progress: 1117/2369 symbols completed. INVH took 30.0s. Estimated remaining: 2h 12m 35s. Rate: 9.4 symbols/min [2025-09-16T18:58:20.374875] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-09-16T18:58:20.413002] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-16T18:58:21.174917] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-09-16T18:58:21.466221] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-16T18:58:21.974958] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-09-16T18:58:22.739070] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-16T18:58:22.774856] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-09-16T18:58:22.829709] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-16T18:58:23.413115] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-16T18:58:23.574908] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-09-16T18:58:24.374931] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-09-16T18:58:25.413903] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-09-16T18:58:25.425386] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-09-16T18:58:25.616170] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-16T18:58:25.974952] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-09-16T18:58:26.181716] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-16T18:58:26.774927] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-09-16T18:58:27.749030] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-09-16T18:58:27.759885] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-09-16T18:58:27.909630] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-16T18:58:28.374925] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-09-16T18:58:28.688804] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-16T18:58:29.174930] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-09-16T18:58:30.312703] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-16T18:58:30.319048] [INFO ] [REMOTE ] IOT: Full fetch complete (58129 records). [2025-09-16T18:58:30.319150] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-09-16T18:58:30.709686] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-09-16T18:58:30.709819] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-09-16T18:58:30.710613] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-09-16T18:58:30.710764] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-09-16T18:58:30.712367] [DEBUG] [LOCAL ] IOT: Trimmed 58129 records to 39868 (keeping 150 days of data) [2025-09-16T18:58:30.857946] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (3.10 seconds). [2025-09-16T18:58:30.876382] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-16T18:58:30.887483] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-09-16T18:58:30.890995] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-09-16T18:58:31.035498] [DEBUG] [LOCAL ] IOT: Primary data saved (39868 records). [2025-09-16T18:58:31.035659] [INFO ] [MAIN ] IOT: Full history saved. [2025-09-16T18:58:31.035758] [INFO ] [MAIN ] Update Progress: 1118/2369 symbols completed. IOT took 20.3s. Estimated remaining: 2h 12m 34s. Rate: 9.4 symbols/min [2025-09-16T18:58:32.804822] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-16T18:58:32.816322] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-09-16T18:58:33.135718] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-16T18:58:33.147513] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-09-16T18:58:34.638426] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-16T18:58:34.649891] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-09-16T18:58:35.748241] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.60 seconds). [2025-09-16T18:58:35.755618] [INFO ] [REMOTE ] IONQ: Full fetch complete (58468 records). [2025-09-16T18:58:35.755753] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-09-16T18:58:36.148758] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-09-16T18:58:36.148837] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-09-16T18:58:36.149631] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-09-16T18:58:36.149692] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-09-16T18:58:36.151095] [DEBUG] [LOCAL ] IONQ: Trimmed 58468 records to 40138 (keeping 150 days of data) [2025-09-16T18:58:36.392531] [DEBUG] [LOCAL ] IONQ: Primary data saved (40138 records). [2025-09-16T18:58:36.392704] [INFO ] [MAIN ] IONQ: Full history saved. [2025-09-16T18:58:36.392829] [INFO ] [MAIN ] Update Progress: 1119/2369 symbols completed. IONQ took 30.3s. Estimated remaining: 2h 12m 26s. Rate: 9.4 symbols/min [2025-09-16T18:58:36.448027] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-16T18:58:36.454287] [INFO ] [REMOTE ] IP: Full fetch complete (58004 records). [2025-09-16T18:58:36.454380] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-09-16T18:58:36.872197] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-09-16T18:58:36.872293] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-09-16T18:58:36.873094] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-09-16T18:58:36.873146] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-09-16T18:58:36.874591] [DEBUG] [LOCAL ] IP: Trimmed 58004 records to 39704 (keeping 150 days of data) [2025-09-16T18:58:37.117658] [DEBUG] [LOCAL ] IP: Primary data saved (39704 records). [2025-09-16T18:58:37.117799] [INFO ] [MAIN ] IP: Full history saved. [2025-09-16T18:58:37.118454] [INFO ] [MAIN ] Update Progress: 1120/2369 symbols completed. IP took 21.1s. Estimated remaining: 2h 12m 13s. Rate: 9.4 symbols/min [2025-09-16T18:58:37.806489] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:58:37.798117] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:58:37.799010] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:58:37.837938] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:58:37.856839] [DEBUG] [LOCAL ] IPI: Loaded 15432 existing records from primary storage. [2025-09-16T18:58:37.857138] [INFO ] [MAIN ] IPI: Loaded 15432 existing records. [2025-09-16T18:58:37.904551] [DEBUG] [LOCAL ] IQI: Loaded 13437 existing records from primary storage. [2025-09-16T18:58:37.964740] [INFO ] [MAIN ] IQI: Loaded 13437 existing records. [2025-09-16T18:58:38.176771] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:58:38.199332] [DEBUG] [LOCAL ] IPG: Loaded 39313 existing records from primary storage. [2025-09-16T18:58:38.199563] [INFO ] [MAIN ] IPG: Loaded 39313 existing records. [2025-09-16T18:58:38.200078] [DEBUG] [LOCAL ] IQV: Loaded 37209 existing records from primary storage. [2025-09-16T18:58:38.244925] [INFO ] [MAIN ] IQV: Loaded 37209 existing records. [2025-09-16T18:58:38.384401] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-09-16T18:58:38.456063] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-09-16T18:58:38.438628] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:58:38.478617] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-09-16T18:58:38.493278] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-09-16T18:58:38.503578] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-09-16T18:58:38.518993] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-09-16T18:58:38.663458] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-09-16T18:58:38.693083] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-09-16T18:58:38.692864] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:58:38.693003] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:58:38.723857] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-09-16T18:58:38.739016] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-09-16T18:58:38.744441] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-09-16T18:58:38.744559] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-09-16T18:58:38.753266] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-09-16T18:58:38.785113] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-09-16T18:58:38.768846] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-09-16T18:58:38.800719] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-09-16T18:58:39.836046] [INFO ] [REMOTE ] IPI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:58:39.904079] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-09-16T18:58:40.037999] [INFO ] [REMOTE ] IQI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:58:40.076513] [INFO ] [REMOTE ] IPG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:58:40.077158] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-09-16T18:58:40.088037] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-09-16T18:58:40.150547] [INFO ] [REMOTE ] IQV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:58:40.151476] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-09-16T18:58:41.120293] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-16T18:58:41.124868] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-09-16T18:58:41.220515] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-16T18:58:41.225485] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-09-16T18:58:41.718800] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-16T18:58:41.728115] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-09-16T18:58:41.782121] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-16T18:58:41.792541] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-09-16T18:58:41.804154] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-16T18:58:41.808236] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-09-16T18:58:41.907591] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-16T18:58:41.912759] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-09-16T18:58:42.831022] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-16T18:58:42.836326] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-09-16T18:58:42.901918] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-16T18:58:42.907365] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-09-16T18:58:43.078587] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-16T18:58:43.565000] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-16T18:58:43.575716] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-09-16T18:58:43.704748] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-16T18:58:43.731614] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-16T18:58:44.374899] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-09-16T18:58:45.174907] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-09-16T18:58:45.376320] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-16T18:58:45.399540] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-16T18:58:45.715268] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-16T18:58:45.974918] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-09-16T18:58:46.774915] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-09-16T18:58:47.579694] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-09-16T18:58:47.598332] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-16T18:58:47.770852] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-16T18:58:48.374993] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-09-16T18:58:48.709765] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-16T18:58:49.174961] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-09-16T18:58:49.892715] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-16T18:58:49.974952] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-09-16T18:58:50.521195] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-16T18:58:50.774952] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-09-16T18:58:51.574894] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-09-16T18:58:51.728076] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-16T18:58:51.814203] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-16T18:58:51.819540] [INFO ] [REMOTE ] IQI: Full fetch complete (20074 records). [2025-09-16T18:58:51.820161] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-09-16T18:58:52.364268] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-09-16T18:58:52.364405] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-09-16T18:58:52.365183] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-09-16T18:58:52.365284] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-09-16T18:58:52.366599] [DEBUG] [LOCAL ] IQI: Trimmed 20074 records to 13543 (keeping 150 days of data) [2025-09-16T18:58:52.419606] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-09-16T18:58:52.497010] [DEBUG] [LOCAL ] IQI: Primary data saved (13543 records). [2025-09-16T18:58:52.497173] [INFO ] [MAIN ] IQI: Full history saved. [2025-09-16T18:58:52.497334] [INFO ] [MAIN ] Update Progress: 1121/2369 symbols completed. IQI took 15.4s. Estimated remaining: 2h 12m 17s. Rate: 9.4 symbols/min [2025-09-16T18:58:52.681027] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:58:52.697756] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-16T18:58:52.743935] [DEBUG] [LOCAL ] IR: Loaded 38888 existing records from primary storage. [2025-09-16T18:58:52.744125] [INFO ] [MAIN ] IR: Loaded 38888 existing records. [2025-09-16T18:58:52.926585] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:58:52.926884] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-09-16T18:58:52.926933] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-09-16T18:58:52.927995] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-09-16T18:58:52.928049] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-09-16T18:58:53.180181] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-09-16T18:58:53.292202] [INFO ] [REMOTE ] IR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:58:53.974995] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-09-16T18:58:54.225307] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-16T18:58:54.774908] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-09-16T18:58:54.829350] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-16T18:58:54.920855] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-16T18:58:54.923877] [INFO ] [REMOTE ] IPI: Full fetch complete (22884 records). [2025-09-16T18:58:54.924082] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-09-16T18:58:55.302602] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-09-16T18:58:55.302696] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-09-16T18:58:55.303220] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-09-16T18:58:55.303266] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-09-16T18:58:55.303860] [DEBUG] [LOCAL ] IPI: Trimmed 22884 records to 15552 (keeping 150 days of data) [2025-09-16T18:58:55.397350] [DEBUG] [LOCAL ] IPI: Primary data saved (15552 records). [2025-09-16T18:58:55.397504] [INFO ] [MAIN ] IPI: Full history saved. [2025-09-16T18:58:55.397617] [INFO ] [MAIN ] Update Progress: 1122/2369 symbols completed. IPI took 18.3s. Estimated remaining: 2h 12m 7s. Rate: 9.4 symbols/min [2025-09-16T18:58:55.576458] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-09-16T18:58:55.578037] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:58:55.614987] [DEBUG] [LOCAL ] IRM: Loaded 36011 existing records from primary storage. [2025-09-16T18:58:55.615152] [INFO ] [MAIN ] IRM: Loaded 36011 existing records. [2025-09-16T18:58:55.798780] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:58:55.799116] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-09-16T18:58:55.799173] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-09-16T18:58:55.800133] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-09-16T18:58:55.800185] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-09-16T18:58:56.169386] [INFO ] [REMOTE ] IRM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:58:56.374894] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-09-16T18:58:56.450324] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-16T18:58:57.183186] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-09-16T18:58:57.201421] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-16T18:58:57.714085] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-16T18:58:57.974912] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-09-16T18:58:58.703879] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-16T18:58:58.774935] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-09-16T18:58:59.574913] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-09-16T18:58:59.646099] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-16T18:58:59.652980] [INFO ] [REMOTE ] IPG: Full fetch complete (58003 records). [2025-09-16T18:58:59.653136] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-09-16T18:59:00.062403] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-09-16T18:59:00.062498] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-09-16T18:59:00.063312] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-09-16T18:59:00.063359] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-09-16T18:59:00.064560] [DEBUG] [LOCAL ] IPG: Trimmed 58003 records to 39697 (keeping 150 days of data) [2025-09-16T18:59:00.317936] [DEBUG] [LOCAL ] IPG: Primary data saved (39697 records). [2025-09-16T18:59:00.318094] [INFO ] [MAIN ] IPG: Full history saved. [2025-09-16T18:59:00.318184] [INFO ] [MAIN ] Update Progress: 1123/2369 symbols completed. IPG took 23.2s. Estimated remaining: 2h 11m 59s. Rate: 9.4 symbols/min [2025-09-16T18:59:00.390371] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-09-16T18:59:00.528824] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:59:00.564070] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-16T18:59:00.580688] [DEBUG] [LOCAL ] IRS: Loaded 16167 existing records from primary storage. [2025-09-16T18:59:00.580890] [INFO ] [MAIN ] IRS: Loaded 16167 existing records. [2025-09-16T18:59:00.756368] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:59:00.756595] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-09-16T18:59:00.756659] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-09-16T18:59:00.757185] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-09-16T18:59:00.757234] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-09-16T18:59:01.111204] [INFO ] [REMOTE ] IRS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:59:01.145545] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-16T18:59:01.175011] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-09-16T18:59:01.974887] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-09-16T18:59:02.020038] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-16T18:59:02.089412] [DEBUG] [REMOTE ] IQV: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-09-16T18:59:02.089785] [WARN ] [REMOTE ] IQV: No data returned for month 2025-09 [2025-09-16T18:59:02.089873] [INFO ] [REMOTE ] IQV: Full fetch complete (51148 records). [2025-09-16T18:59:02.089942] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-09-16T18:59:02.091481] [FATAL] [VALIDATOR ] IQV: Data is stale - most recent date (2025-08-29) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T18:59:02.091561] [FATAL] [MAIN ] IQV: Fetched primary data is invalid. Refusing to save it. [2025-09-16T18:59:02.091604] [WARN ] [MAIN ] IQV: Deleting existing primary and derivative data due to validation failure. [2025-09-16T18:59:02.091667] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-09-16T18:59:02.091727] [DEBUG] [LOCAL ] IQV: No primary data file found to delete. [2025-09-16T18:59:02.091764] [INFO ] [LOCAL ] IQV: Starting deletion of derivative data. [2025-09-16T18:59:02.092099] [DEBUG] [LOCAL ] IQV: Deleted derivative data file. [2025-09-16T18:59:02.092185] [INFO ] [MAIN ] Update Progress: 1124/2369 symbols completed. IQV took 25.0s. Estimated remaining: 2h 11m 48s. Rate: 9.4 symbols/min [2025-09-16T18:59:02.268738] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:59:02.281345] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-16T18:59:02.325661] [DEBUG] [LOCAL ] IRT: Loaded 37200 existing records from primary storage. [2025-09-16T18:59:02.325809] [INFO ] [MAIN ] IRT: Loaded 37200 existing records. [2025-09-16T18:59:02.498678] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:59:02.498914] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-09-16T18:59:02.498959] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-09-16T18:59:02.499893] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-09-16T18:59:02.499953] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-09-16T18:59:02.779972] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-09-16T18:59:02.852709] [INFO ] [REMOTE ] IRT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:59:03.574893] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-09-16T18:59:04.374922] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-09-16T18:59:04.558048] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-16T18:59:05.174952] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-09-16T18:59:05.362542] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-16T18:59:05.974908] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-09-16T18:59:06.475053] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-16T18:59:06.745677] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-16T18:59:06.774857] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-09-16T18:59:07.394661] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-16T18:59:07.574856] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-09-16T18:59:08.091631] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-16T18:59:08.374897] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-09-16T18:59:09.174904] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-09-16T18:59:09.438258] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-16T18:59:09.974880] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-09-16T18:59:10.031807] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-16T18:59:10.775004] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-09-16T18:59:10.842849] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-16T18:59:11.186709] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-16T18:59:11.574882] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-09-16T18:59:12.374928] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-09-16T18:59:12.432369] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-16T18:59:13.174942] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-09-16T18:59:13.307398] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-16T18:59:13.347055] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-16T18:59:13.974900] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-09-16T18:59:14.774878] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-09-16T18:59:14.962774] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-16T18:59:15.574880] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-09-16T18:59:15.655964] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-16T18:59:16.374896] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-09-16T18:59:16.456042] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-16T18:59:16.462305] [INFO ] [REMOTE ] IR: Full fetch complete (57330 records). [2025-09-16T18:59:16.462407] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-09-16T18:59:16.804153] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-16T18:59:16.877734] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-09-16T18:59:16.877808] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-09-16T18:59:16.878567] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-09-16T18:59:16.878610] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-09-16T18:59:16.879750] [DEBUG] [LOCAL ] IR: Trimmed 57330 records to 39275 (keeping 150 days of data) [2025-09-16T18:59:17.125559] [DEBUG] [LOCAL ] IR: Primary data saved (39275 records). [2025-09-16T18:59:17.125731] [INFO ] [MAIN ] IR: Full history saved. [2025-09-16T18:59:17.125841] [INFO ] [MAIN ] Update Progress: 1125/2369 symbols completed. IR took 24.6s. Estimated remaining: 2h 11m 51s. Rate: 9.4 symbols/min [2025-09-16T18:59:17.183697] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-09-16T18:59:17.341838] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:59:17.353762] [DEBUG] [LOCAL ] ISD: Loaded 11068 existing records from primary storage. [2025-09-16T18:59:17.353882] [INFO ] [MAIN ] ISD: Loaded 11068 existing records. [2025-09-16T18:59:17.534465] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:59:17.534881] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-09-16T18:59:17.535088] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-09-16T18:59:17.535583] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-09-16T18:59:17.535811] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-09-16T18:59:17.926851] [INFO ] [REMOTE ] ISD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:59:17.928898] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-16T18:59:17.974852] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-09-16T18:59:18.208897] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-16T18:59:18.774906] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-09-16T18:59:19.574898] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-09-16T18:59:19.621845] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-16T18:59:19.771807] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-16T18:59:20.374920] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-09-16T18:59:21.174913] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-09-16T18:59:21.250726] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-16T18:59:21.953008] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-16T18:59:21.959262] [INFO ] [REMOTE ] IRM: Full fetch complete (54142 records). [2025-09-16T18:59:21.959370] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-09-16T18:59:21.980707] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-09-16T18:59:22.343490] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-16T18:59:22.366014] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-09-16T18:59:22.366115] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-09-16T18:59:22.367041] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-09-16T18:59:22.367092] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-09-16T18:59:22.368445] [DEBUG] [LOCAL ] IRM: Trimmed 54142 records to 36386 (keeping 150 days of data) [2025-09-16T18:59:22.601007] [DEBUG] [LOCAL ] IRM: Primary data saved (36386 records). [2025-09-16T18:59:22.601168] [INFO ] [MAIN ] IRM: Full history saved. [2025-09-16T18:59:22.601267] [INFO ] [MAIN ] Update Progress: 1126/2369 symbols completed. IRM took 27.2s. Estimated remaining: 2h 11m 43s. Rate: 9.4 symbols/min [2025-09-16T18:59:22.775531] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-09-16T18:59:22.775450] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:59:22.809156] [DEBUG] [LOCAL ] IT: Loaded 30721 existing records from primary storage. [2025-09-16T18:59:22.809305] [INFO ] [MAIN ] IT: Loaded 30721 existing records. [2025-09-16T18:59:22.987570] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:59:22.987825] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-09-16T18:59:22.987876] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-09-16T18:59:22.988717] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-09-16T18:59:22.988766] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-09-16T18:59:23.296362] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-16T18:59:23.362149] [INFO ] [REMOTE ] IT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:59:23.513247] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-16T18:59:23.574859] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-09-16T18:59:24.374928] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-09-16T18:59:24.935155] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-16T18:59:25.174940] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-09-16T18:59:25.316277] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-16T18:59:25.974904] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-09-16T18:59:26.774939] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-09-16T18:59:26.913196] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-16T18:59:27.474519] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-16T18:59:27.574920] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-09-16T18:59:27.766006] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-16T18:59:28.374924] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-09-16T18:59:29.174868] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-09-16T18:59:29.237603] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-16T18:59:29.344985] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-16T18:59:29.974938] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-09-16T18:59:30.102007] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-16T18:59:30.774913] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-09-16T18:59:31.152080] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-16T18:59:31.156497] [INFO ] [REMOTE ] IRS: Full fetch complete (22838 records). [2025-09-16T18:59:31.156628] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-09-16T18:59:31.469326] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-16T18:59:31.538544] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-09-16T18:59:31.538620] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-09-16T18:59:31.539157] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-09-16T18:59:31.539203] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-09-16T18:59:31.539892] [DEBUG] [LOCAL ] IRS: Trimmed 22838 records to 16397 (keeping 150 days of data) [2025-09-16T18:59:31.580885] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-09-16T18:59:31.636295] [DEBUG] [LOCAL ] IRS: Primary data saved (16397 records). [2025-09-16T18:59:31.636434] [INFO ] [MAIN ] IRS: Full history saved. [2025-09-16T18:59:31.636523] [INFO ] [MAIN ] Update Progress: 1127/2369 symbols completed. IRS took 31.3s. Estimated remaining: 2h 11m 40s. Rate: 9.4 symbols/min [2025-09-16T18:59:31.808568] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:59:31.830630] [DEBUG] [LOCAL ] ITGR: Loaded 22027 existing records from primary storage. [2025-09-16T18:59:31.830789] [INFO ] [MAIN ] ITGR: Loaded 22027 existing records. [2025-09-16T18:59:32.005205] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:59:32.005447] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-09-16T18:59:32.005495] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-09-16T18:59:32.006023] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-09-16T18:59:32.006074] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-09-16T18:59:32.357786] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:59:32.374847] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-09-16T18:59:32.534913] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-16T18:59:32.537008] [INFO ] [REMOTE ] ISD: Full fetch complete (17302 records). [2025-09-16T18:59:32.537098] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-09-16T18:59:32.899284] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-09-16T18:59:32.899360] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-09-16T18:59:32.899709] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-09-16T18:59:32.899752] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-09-16T18:59:32.900310] [DEBUG] [LOCAL ] ISD: Trimmed 17302 records to 11160 (keeping 150 days of data) [2025-09-16T18:59:32.969182] [DEBUG] [LOCAL ] ISD: Primary data saved (11160 records). [2025-09-16T18:59:32.969314] [INFO ] [MAIN ] ISD: Full history saved. [2025-09-16T18:59:32.969398] [INFO ] [MAIN ] Update Progress: 1128/2369 symbols completed. ISD took 15.8s. Estimated remaining: 2h 11m 28s. Rate: 9.4 symbols/min [2025-09-16T18:59:33.144166] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:59:33.167691] [DEBUG] [LOCAL ] ITT: Loaded 23217 existing records from primary storage. [2025-09-16T18:59:33.167821] [INFO ] [MAIN ] ITT: Loaded 23217 existing records. [2025-09-16T18:59:33.180780] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-09-16T18:59:33.354614] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:59:33.355020] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-09-16T18:59:33.355083] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-09-16T18:59:33.356039] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-09-16T18:59:33.356113] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-09-16T18:59:33.711189] [INFO ] [REMOTE ] ITT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:59:33.725214] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-16T18:59:33.974855] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-09-16T18:59:34.774874] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-09-16T18:59:34.808211] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-16T18:59:35.277142] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-16T18:59:35.574892] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-09-16T18:59:36.351417] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-16T18:59:36.374840] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-09-16T18:59:36.925522] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-16T18:59:37.174908] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-09-16T18:59:37.965863] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-16T18:59:37.971881] [INFO ] [REMOTE ] IRT: Full fetch complete (54788 records). [2025-09-16T18:59:37.971977] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-09-16T18:59:37.983852] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-09-16T18:59:38.361582] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-09-16T18:59:38.361731] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-09-16T18:59:38.362497] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-09-16T18:59:38.362543] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-09-16T18:59:38.363786] [DEBUG] [LOCAL ] IRT: Trimmed 54788 records to 37574 (keeping 150 days of data) [2025-09-16T18:59:38.606444] [DEBUG] [LOCAL ] IRT: Primary data saved (37574 records). [2025-09-16T18:59:38.606652] [INFO ] [MAIN ] IRT: Full history saved. [2025-09-16T18:59:38.607631] [INFO ] [MAIN ] Update Progress: 1129/2369 symbols completed. IRT took 36.5s. Estimated remaining: 2h 11m 21s. Rate: 9.4 symbols/min [2025-09-16T18:59:38.775665] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-09-16T18:59:38.778063] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:59:38.814668] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-16T18:59:38.862653] [DEBUG] [LOCAL ] ITUB: Loaded 39382 existing records from primary storage. [2025-09-16T18:59:38.862839] [INFO ] [MAIN ] ITUB: Loaded 39382 existing records. [2025-09-16T18:59:39.036543] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:59:39.036792] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-09-16T18:59:39.036839] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-09-16T18:59:39.037726] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-09-16T18:59:39.037774] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-09-16T18:59:39.396181] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:59:39.428881] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-16T18:59:39.574873] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-09-16T18:59:40.131336] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-16T18:59:40.374923] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-09-16T18:59:41.174917] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-09-16T18:59:41.267261] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-16T18:59:41.863613] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-16T18:59:41.974901] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-09-16T18:59:42.503773] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-16T18:59:42.774904] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-09-16T18:59:43.574886] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-09-16T18:59:43.847356] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-16T18:59:44.383865] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-09-16T18:59:44.393373] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-16T18:59:44.540593] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-16T18:59:45.174924] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-09-16T18:59:45.931468] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-16T18:59:45.974852] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-09-16T18:59:46.774955] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-09-16T18:59:46.872358] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-16T18:59:46.879055] [INFO ] [REMOTE ] IT: Full fetch complete (43835 records). [2025-09-16T18:59:46.879154] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-09-16T18:59:47.262588] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-09-16T18:59:47.262683] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-09-16T18:59:47.263356] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-09-16T18:59:47.263399] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-09-16T18:59:47.264408] [DEBUG] [LOCAL ] IT: Trimmed 43835 records to 31073 (keeping 150 days of data) [2025-09-16T18:59:47.465573] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-16T18:59:47.488738] [DEBUG] [LOCAL ] IT: Primary data saved (31073 records). [2025-09-16T18:59:47.488883] [INFO ] [MAIN ] IT: Full history saved. [2025-09-16T18:59:47.488970] [INFO ] [MAIN ] Update Progress: 1130/2369 symbols completed. IT took 24.9s. Estimated remaining: 2h 11m 17s. Rate: 9.4 symbols/min [2025-09-16T18:59:47.581503] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-09-16T18:59:47.664341] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:59:47.700560] [DEBUG] [LOCAL ] ITW: Loaded 33742 existing records from primary storage. [2025-09-16T18:59:47.700716] [INFO ] [MAIN ] ITW: Loaded 33742 existing records. [2025-09-16T18:59:47.881175] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:59:47.881453] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-09-16T18:59:47.881500] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-09-16T18:59:47.882366] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-09-16T18:59:47.882416] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-09-16T18:59:48.253991] [INFO ] [REMOTE ] ITW: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:59:48.274399] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-16T18:59:48.374898] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-09-16T18:59:49.174882] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-09-16T18:59:49.236008] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-16T18:59:49.532909] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-16T18:59:49.974902] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-09-16T18:59:50.369688] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-16T18:59:50.774908] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-09-16T18:59:51.574902] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-09-16T18:59:51.786961] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-16T18:59:51.811473] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-16T18:59:51.815360] [INFO ] [REMOTE ] ITGR: Full fetch complete (33997 records). [2025-09-16T18:59:51.815481] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-09-16T18:59:52.187359] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-09-16T18:59:52.187452] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-09-16T18:59:52.188134] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-09-16T18:59:52.188199] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-09-16T18:59:52.189231] [DEBUG] [LOCAL ] ITGR: Trimmed 33997 records to 22250 (keeping 150 days of data) [2025-09-16T18:59:52.322208] [DEBUG] [LOCAL ] ITGR: Primary data saved (22250 records). [2025-09-16T18:59:52.322341] [INFO ] [MAIN ] ITGR: Full history saved. [2025-09-16T18:59:52.322425] [INFO ] [MAIN ] Update Progress: 1131/2369 symbols completed. ITGR took 20.7s. Estimated remaining: 2h 11m 9s. Rate: 9.4 symbols/min [2025-09-16T18:59:52.386388] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-09-16T18:59:52.499268] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:59:52.533017] [DEBUG] [LOCAL ] IVR: Loaded 34880 existing records from primary storage. [2025-09-16T18:59:52.533156] [INFO ] [MAIN ] IVR: Loaded 34880 existing records. [2025-09-16T18:59:52.710087] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:59:52.710324] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-09-16T18:59:52.710377] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-09-16T18:59:52.711264] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-09-16T18:59:52.711314] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-09-16T18:59:53.070904] [INFO ] [REMOTE ] IVR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:59:53.174881] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-09-16T18:59:53.247921] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-16T18:59:53.819246] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-16T18:59:53.974904] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-09-16T18:59:54.774899] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-09-16T18:59:54.829319] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-16T18:59:55.574927] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-09-16T18:59:55.799131] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-16T18:59:55.838008] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-16T18:59:56.374913] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-09-16T18:59:57.174903] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-09-16T18:59:57.290783] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-16T18:59:57.558927] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-16T18:59:57.974922] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-09-16T18:59:58.417765] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-16T18:59:58.421362] [INFO ] [REMOTE ] ITT: Full fetch complete (36469 records). [2025-09-16T18:59:58.421472] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-09-16T18:59:58.779541] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-09-16T18:59:58.802081] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-09-16T18:59:58.802182] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-09-16T18:59:58.802830] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-09-16T18:59:58.802886] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-09-16T18:59:58.803800] [DEBUG] [LOCAL ] ITT: Trimmed 36469 records to 23458 (keeping 150 days of data) [2025-09-16T18:59:58.953809] [DEBUG] [LOCAL ] ITT: Primary data saved (23458 records). [2025-09-16T18:59:58.953938] [INFO ] [MAIN ] ITT: Full history saved. [2025-09-16T18:59:58.954069] [INFO ] [MAIN ] Update Progress: 1132/2369 symbols completed. ITT took 26.0s. Estimated remaining: 2h 11m 3s. Rate: 9.4 symbols/min [2025-09-16T18:59:59.153438] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T18:59:59.175682] [DEBUG] [LOCAL ] IVT: Loaded 22298 existing records from primary storage. [2025-09-16T18:59:59.175815] [INFO ] [MAIN ] IVT: Loaded 22298 existing records. [2025-09-16T18:59:59.359700] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T18:59:59.359968] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-09-16T18:59:59.360024] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-09-16T18:59:59.360555] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-09-16T18:59:59.360602] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-09-16T18:59:59.580973] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-09-16T18:59:59.721677] [INFO ] [REMOTE ] IVT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T18:59:59.750980] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-16T19:00:00.374895] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-09-16T19:00:00.766842] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-16T19:00:01.174958] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-09-16T19:00:01.379896] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-16T19:00:01.974940] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-09-16T19:00:02.330685] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-16T19:00:02.774893] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-09-16T19:00:03.367945] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-16T19:00:03.574877] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-09-16T19:00:03.936084] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-16T19:00:04.272605] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-16T19:00:04.374851] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-09-16T19:00:05.174946] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-09-16T19:00:05.230273] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-16T19:00:05.642059] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-16T19:00:05.974966] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-09-16T19:00:06.774931] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-09-16T19:00:07.238334] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-16T19:00:07.290985] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-16T19:00:07.574901] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-09-16T19:00:08.086966] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-16T19:00:08.374906] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-09-16T19:00:08.789052] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-16T19:00:09.174943] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-09-16T19:00:09.974905] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-09-16T19:00:10.186724] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-16T19:00:10.774959] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-09-16T19:00:11.015781] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-16T19:00:11.557852] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-16T19:00:11.564402] [INFO ] [REMOTE ] ITUB: Full fetch complete (57962 records). [2025-09-16T19:00:11.564554] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-09-16T19:00:11.580081] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-09-16T19:00:11.971264] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-09-16T19:00:11.971358] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-09-16T19:00:11.972163] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-09-16T19:00:11.972211] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-09-16T19:00:11.973500] [DEBUG] [LOCAL ] ITUB: Trimmed 57962 records to 39769 (keeping 150 days of data) [2025-09-16T19:00:12.099567] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-16T19:00:12.245538] [DEBUG] [LOCAL ] ITUB: Primary data saved (39769 records). [2025-09-16T19:00:12.245748] [INFO ] [MAIN ] ITUB: Full history saved. [2025-09-16T19:00:12.246427] [INFO ] [MAIN ] Update Progress: 1133/2369 symbols completed. ITUB took 33.6s. Estimated remaining: 2h 11m 5s. Rate: 9.4 symbols/min [2025-09-16T19:00:12.389386] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-09-16T19:00:12.422159] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:00:12.463976] [DEBUG] [LOCAL ] IVZ: Loaded 39170 existing records from primary storage. [2025-09-16T19:00:12.464135] [INFO ] [MAIN ] IVZ: Loaded 39170 existing records. [2025-09-16T19:00:12.648776] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:00:12.649041] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-09-16T19:00:12.649089] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-09-16T19:00:12.650050] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-09-16T19:00:12.650101] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-09-16T19:00:13.009618] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:00:13.180604] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-09-16T19:00:13.182930] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-16T19:00:13.694991] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-16T19:00:13.974927] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-09-16T19:00:14.774929] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-09-16T19:00:15.012231] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-16T19:00:15.067135] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-16T19:00:15.071468] [INFO ] [REMOTE ] IVT: Full fetch complete (33845 records). [2025-09-16T19:00:15.071699] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-09-16T19:00:15.465662] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-09-16T19:00:15.465783] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-09-16T19:00:15.466967] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-09-16T19:00:15.467025] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-09-16T19:00:15.468418] [DEBUG] [LOCAL ] IVT: Trimmed 33845 records to 22503 (keeping 150 days of data) [2025-09-16T19:00:15.582498] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-09-16T19:00:15.609909] [DEBUG] [LOCAL ] IVT: Primary data saved (22503 records). [2025-09-16T19:00:15.610050] [INFO ] [MAIN ] IVT: Full history saved. [2025-09-16T19:00:15.610155] [INFO ] [MAIN ] Update Progress: 1134/2369 symbols completed. IVT took 16.7s. Estimated remaining: 2h 10m 55s. Rate: 9.4 symbols/min [2025-09-16T19:00:15.793894] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:00:15.812024] [DEBUG] [LOCAL ] IX: Loaded 16193 existing records from primary storage. [2025-09-16T19:00:15.812170] [INFO ] [MAIN ] IX: Loaded 16193 existing records. [2025-09-16T19:00:15.994638] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:00:15.994955] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-09-16T19:00:15.995014] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-09-16T19:00:15.995504] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-09-16T19:00:15.995557] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-09-16T19:00:16.369436] [INFO ] [REMOTE ] IX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:00:16.380470] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-09-16T19:00:16.401276] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-16T19:00:16.904538] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-16T19:00:16.910146] [INFO ] [REMOTE ] ITW: Full fetch complete (50587 records). [2025-09-16T19:00:16.910271] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-09-16T19:00:17.177914] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-09-16T19:00:17.289382] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-16T19:00:17.304846] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-09-16T19:00:17.304900] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-09-16T19:00:17.305614] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-09-16T19:00:17.305680] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-09-16T19:00:17.306635] [DEBUG] [LOCAL ] ITW: Trimmed 50587 records to 34070 (keeping 150 days of data) [2025-09-16T19:00:17.530310] [DEBUG] [LOCAL ] ITW: Primary data saved (34070 records). [2025-09-16T19:00:17.530462] [INFO ] [MAIN ] ITW: Full history saved. [2025-09-16T19:00:17.530549] [INFO ] [MAIN ] Update Progress: 1135/2369 symbols completed. ITW took 30.0s. Estimated remaining: 2h 10m 44s. Rate: 9.4 symbols/min [2025-09-16T19:00:17.707356] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:00:17.736214] [DEBUG] [LOCAL ] J: Loaded 29311 existing records from primary storage. [2025-09-16T19:00:17.736351] [INFO ] [MAIN ] J: Loaded 29311 existing records. [2025-09-16T19:00:17.914442] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:00:17.914692] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-09-16T19:00:17.914748] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-09-16T19:00:17.915447] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-09-16T19:00:17.915494] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-09-16T19:00:17.979990] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-09-16T19:00:18.295907] [INFO ] [REMOTE ] J: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:00:18.650289] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-16T19:00:18.655919] [INFO ] [REMOTE ] IVR: Full fetch complete (51803 records). [2025-09-16T19:00:18.656018] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-09-16T19:00:18.780066] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-09-16T19:00:19.039104] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-09-16T19:00:19.039204] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-09-16T19:00:19.040129] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-09-16T19:00:19.040181] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-09-16T19:00:19.041483] [DEBUG] [LOCAL ] IVR: Trimmed 51803 records to 35217 (keeping 150 days of data) [2025-09-16T19:00:19.174230] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-16T19:00:19.282462] [DEBUG] [LOCAL ] IVR: Primary data saved (35217 records). [2025-09-16T19:00:19.282668] [INFO ] [MAIN ] IVR: Full history saved. [2025-09-16T19:00:19.282802] [INFO ] [MAIN ] Update Progress: 1136/2369 symbols completed. IVR took 27.0s. Estimated remaining: 2h 10m 32s. Rate: 9.4 symbols/min [2025-09-16T19:00:19.458516] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:00:19.497782] [DEBUG] [LOCAL ] JBGS: Loaded 31240 existing records from primary storage. [2025-09-16T19:00:19.497985] [INFO ] [MAIN ] JBGS: Loaded 31240 existing records. [2025-09-16T19:00:19.580011] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-09-16T19:00:19.688392] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:00:19.688695] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-09-16T19:00:19.688760] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-09-16T19:00:19.689571] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-09-16T19:00:19.689633] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-09-16T19:00:20.074810] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:00:20.290767] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-16T19:00:20.374893] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-09-16T19:00:21.174876] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-09-16T19:00:21.216124] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-16T19:00:21.852035] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-16T19:00:21.974936] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-09-16T19:00:22.341815] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-16T19:00:22.774951] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-09-16T19:00:23.574891] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-09-16T19:00:23.646932] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-16T19:00:23.983988] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-16T19:00:24.374905] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-09-16T19:00:24.556390] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-16T19:00:25.174928] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-09-16T19:00:25.974902] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-09-16T19:00:26.308150] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-16T19:00:26.678471] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-16T19:00:26.774896] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-09-16T19:00:27.550219] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-16T19:00:27.574847] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-09-16T19:00:28.374911] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-09-16T19:00:28.609777] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-16T19:00:28.950117] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-16T19:00:29.174909] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-09-16T19:00:29.889938] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-16T19:00:29.974917] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-09-16T19:00:30.622305] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-16T19:00:30.774865] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-09-16T19:00:31.522948] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-16T19:00:31.574858] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-09-16T19:00:32.062448] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-16T19:00:32.374887] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-09-16T19:00:33.064599] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-16T19:00:33.174872] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-09-16T19:00:33.980026] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-09-16T19:00:33.993689] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-16T19:00:34.618435] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-16T19:00:34.623500] [INFO ] [REMOTE ] J: Full fetch complete (44406 records). [2025-09-16T19:00:34.623672] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-09-16T19:00:34.776389] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-09-16T19:00:35.019910] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-09-16T19:00:35.019997] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-09-16T19:00:35.020771] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-09-16T19:00:35.020844] [DEBUG] [LOCAL ] J: Saving primary data. [2025-09-16T19:00:35.021946] [DEBUG] [LOCAL ] J: Trimmed 44406 records to 29574 (keeping 150 days of data) [2025-09-16T19:00:35.147002] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-16T19:00:35.230828] [DEBUG] [LOCAL ] J: Primary data saved (29574 records). [2025-09-16T19:00:35.230963] [INFO ] [MAIN ] J: Full history saved. [2025-09-16T19:00:35.231076] [INFO ] [MAIN ] Update Progress: 1137/2369 symbols completed. J took 17.7s. Estimated remaining: 2h 10m 36s. Rate: 9.4 symbols/min [2025-09-16T19:00:35.406713] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:00:35.440941] [DEBUG] [LOCAL ] JBI: Loaded 31610 existing records from primary storage. [2025-09-16T19:00:35.441098] [INFO ] [MAIN ] JBI: Loaded 31610 existing records. [2025-09-16T19:00:35.585819] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-09-16T19:00:35.625482] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:00:35.625780] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-09-16T19:00:35.625843] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-09-16T19:00:35.626480] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-09-16T19:00:35.626549] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-09-16T19:00:35.994319] [INFO ] [REMOTE ] JBI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:00:36.374872] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-09-16T19:00:36.421139] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-16T19:00:37.174979] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-09-16T19:00:37.659149] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-16T19:00:37.707795] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-16T19:00:37.858707] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-16T19:00:37.974950] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-09-16T19:00:38.774902] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-09-16T19:00:39.574921] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-09-16T19:00:39.721090] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-16T19:00:40.151948] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-16T19:00:40.225392] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-16T19:00:40.227785] [INFO ] [REMOTE ] IX: Full fetch complete (23812 records). [2025-09-16T19:00:40.227865] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-09-16T19:00:40.380181] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-09-16T19:00:40.604633] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-09-16T19:00:40.604743] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-09-16T19:00:40.605242] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-09-16T19:00:40.605283] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-09-16T19:00:40.606009] [DEBUG] [LOCAL ] IX: Trimmed 23812 records to 16330 (keeping 150 days of data) [2025-09-16T19:00:40.709805] [DEBUG] [LOCAL ] IX: Primary data saved (16330 records). [2025-09-16T19:00:40.709963] [INFO ] [MAIN ] IX: Full history saved. [2025-09-16T19:00:40.710074] [INFO ] [MAIN ] Update Progress: 1138/2369 symbols completed. IX took 25.1s. Estimated remaining: 2h 10m 29s. Rate: 9.4 symbols/min [2025-09-16T19:00:40.886043] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:00:40.924729] [DEBUG] [LOCAL ] JBL: Loaded 35106 existing records from primary storage. [2025-09-16T19:00:40.924879] [INFO ] [MAIN ] JBL: Loaded 35106 existing records. [2025-09-16T19:00:41.129005] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:00:41.129298] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-09-16T19:00:41.129355] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-09-16T19:00:41.130240] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-09-16T19:00:41.130299] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-09-16T19:00:41.180022] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-09-16T19:00:41.490112] [INFO ] [REMOTE ] JBL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:00:41.974897] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-09-16T19:00:42.030578] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-16T19:00:42.649082] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-16T19:00:42.774896] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-09-16T19:00:43.562760] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-16T19:00:43.574839] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-09-16T19:00:44.085091] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-16T19:00:44.093332] [INFO ] [REMOTE ] IVZ: Full fetch complete (57733 records). [2025-09-16T19:00:44.093454] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-09-16T19:00:44.380048] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-09-16T19:00:44.491263] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-09-16T19:00:44.491367] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-09-16T19:00:44.492465] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-09-16T19:00:44.492539] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-09-16T19:00:44.493850] [DEBUG] [LOCAL ] IVZ: Trimmed 57733 records to 39555 (keeping 150 days of data) [2025-09-16T19:00:44.753713] [DEBUG] [LOCAL ] IVZ: Primary data saved (39555 records). [2025-09-16T19:00:44.753868] [INFO ] [MAIN ] IVZ: Full history saved. [2025-09-16T19:00:44.754596] [INFO ] [MAIN ] Update Progress: 1139/2369 symbols completed. IVZ took 32.5s. Estimated remaining: 2h 10m 20s. Rate: 9.4 symbols/min [2025-09-16T19:00:44.936077] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:00:44.958009] [DEBUG] [LOCAL ] JBND: Loaded 18819 existing records from primary storage. [2025-09-16T19:00:44.958156] [INFO ] [MAIN ] JBND: Loaded 18819 existing records. [2025-09-16T19:00:45.144332] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:00:45.144585] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-09-16T19:00:45.144637] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-09-16T19:00:45.145248] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-09-16T19:00:45.145298] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-09-16T19:00:45.188944] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-09-16T19:00:45.518315] [INFO ] [REMOTE ] JBND: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:00:45.555046] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-16T19:00:45.597352] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-16T19:00:45.974896] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-09-16T19:00:46.675917] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-16T19:00:46.774917] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-09-16T19:00:47.574903] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-09-16T19:00:47.763000] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-16T19:00:48.112158] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-16T19:00:48.117934] [INFO ] [REMOTE ] JBGS: Full fetch complete (45969 records). [2025-09-16T19:00:48.118074] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-09-16T19:00:48.379985] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-09-16T19:00:48.521615] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-09-16T19:00:48.521727] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-09-16T19:00:48.522507] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-09-16T19:00:48.522552] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-09-16T19:00:48.523777] [DEBUG] [LOCAL ] JBGS: Trimmed 45969 records to 31570 (keeping 150 days of data) [2025-09-16T19:00:48.726873] [DEBUG] [LOCAL ] JBGS: Primary data saved (31570 records). [2025-09-16T19:00:48.727033] [INFO ] [MAIN ] JBGS: Full history saved. [2025-09-16T19:00:48.727149] [INFO ] [MAIN ] Update Progress: 1140/2369 symbols completed. JBGS took 29.4s. Estimated remaining: 2h 10m 11s. Rate: 9.4 symbols/min [2025-09-16T19:00:48.896542] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:00:48.896756] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-09-16T19:00:48.896797] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-09-16T19:00:48.896919] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-09-16T19:00:48.896959] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-16T19:00:48.897001] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-09-16T19:00:48.897034] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-09-16T19:00:49.184354] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-09-16T19:00:49.262825] [INFO ] [REMOTE ] JBS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:00:49.286525] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-16T19:00:49.500039] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-16T19:00:49.974952] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-09-16T19:00:50.774952] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-09-16T19:00:50.939803] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-16T19:00:51.117489] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-16T19:00:51.574919] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-09-16T19:00:52.302107] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-16T19:00:52.374884] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-09-16T19:00:53.076533] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-16T19:00:53.174920] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-09-16T19:00:53.509934] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-16T19:00:53.975006] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-09-16T19:00:54.363349] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-16T19:00:54.774918] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-09-16T19:00:55.574895] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-09-16T19:00:55.849910] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-16T19:00:55.876582] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-16T19:00:55.883026] [INFO ] [REMOTE ] JBI: Full fetch complete (48081 records). [2025-09-16T19:00:55.883161] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-09-16T19:00:56.263831] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-09-16T19:00:56.263924] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-09-16T19:00:56.264869] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-09-16T19:00:56.264941] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-09-16T19:00:56.266089] [DEBUG] [LOCAL ] JBI: Trimmed 48081 records to 31900 (keeping 150 days of data) [2025-09-16T19:00:56.375412] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-02. [2025-09-16T19:00:56.470726] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-16T19:00:56.473708] [DEBUG] [LOCAL ] JBI: Primary data saved (31900 records). [2025-09-16T19:00:56.479359] [INFO ] [MAIN ] JBI: Full history saved. [2025-09-16T19:00:56.479813] [INFO ] [MAIN ] Update Progress: 1141/2369 symbols completed. JBI took 21.2s. Estimated remaining: 2h 10m 6s. Rate: 9.4 symbols/min [2025-09-16T19:00:56.651186] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:00:56.655418] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:00:56.655806] [WARN ] [REMOTE ] JBS: No data returned for month 2025-02 [2025-09-16T19:00:56.675989] [DEBUG] [LOCAL ] JBTM: Loaded 23791 existing records from primary storage. [2025-09-16T19:00:56.676145] [INFO ] [MAIN ] JBTM: Loaded 23791 existing records. [2025-09-16T19:00:56.854531] [WARN ] [MAIN ] JBTM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:00:56.854807] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-09-16T19:00:56.854854] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-09-16T19:00:56.855504] [DEBUG] [LOCAL ] JBTM: Deleted primary data file. [2025-09-16T19:00:56.855550] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-09-16T19:00:57.179002] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-03. [2025-09-16T19:00:57.213551] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:00:57.400061] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:00:57.401070] [WARN ] [REMOTE ] JBS: No data returned for month 2025-03 [2025-09-16T19:00:57.974966] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-09-16T19:00:58.774934] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-09-16T19:00:59.027301] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-16T19:00:59.574880] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-09-16T19:01:00.374912] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-02. [2025-09-16T19:01:00.514542] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-16T19:01:00.910081] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-16T19:01:01.174913] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-09-16T19:01:01.461143] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-16T19:01:01.974913] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-04. [2025-09-16T19:01:02.172261] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:01:02.172608] [WARN ] [REMOTE ] JBS: No data returned for month 2025-04 [2025-09-16T19:01:02.774921] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-05. [2025-09-16T19:01:02.978713] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:01:02.979043] [WARN ] [REMOTE ] JBS: No data returned for month 2025-05 [2025-09-16T19:01:03.129125] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-16T19:01:03.135202] [INFO ] [REMOTE ] JBL: Full fetch complete (52453 records). [2025-09-16T19:01:03.135349] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-09-16T19:01:03.525947] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-09-16T19:01:03.526037] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-09-16T19:01:03.527008] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-09-16T19:01:03.527056] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-09-16T19:01:03.528224] [DEBUG] [LOCAL ] JBL: Trimmed 52453 records to 35457 (keeping 150 days of data) [2025-09-16T19:01:03.590428] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-06. [2025-09-16T19:01:03.763047] [DEBUG] [LOCAL ] JBL: Primary data saved (35457 records). [2025-09-16T19:01:03.763207] [INFO ] [MAIN ] JBL: Full history saved. [2025-09-16T19:01:03.763304] [INFO ] [MAIN ] Update Progress: 1142/2369 symbols completed. JBL took 23.1s. Estimated remaining: 2h 10m 1s. Rate: 9.4 symbols/min [2025-09-16T19:01:03.933200] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:01:03.939842] [DEBUG] [LOCAL ] JCE: Loaded 4686 existing records from primary storage. [2025-09-16T19:01:03.939953] [INFO ] [MAIN ] JCE: Loaded 4686 existing records. [2025-09-16T19:01:04.114636] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:01:04.114884] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-09-16T19:01:04.114930] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-09-16T19:01:04.115208] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-09-16T19:01:04.115256] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-09-16T19:01:04.380372] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-09-16T19:01:04.468779] [INFO ] [REMOTE ] JCE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:01:04.820229] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-16T19:01:05.174950] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-07. [2025-09-16T19:01:05.689133] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-16T19:01:05.974949] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-09-16T19:01:06.595103] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-16T19:01:06.743514] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-16T19:01:06.774847] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-08. [2025-09-16T19:01:07.574919] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-09-16T19:01:08.374944] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-03. [2025-09-16T19:01:08.592924] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-16T19:01:08.695224] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-16T19:01:09.174901] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-09-16T19:01:09.701598] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-16T19:01:09.974868] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-04. [2025-09-16T19:01:09.976431] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-16T19:01:10.774900] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-09. [2025-09-16T19:01:11.575634] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-09-16T19:01:11.580089] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-16T19:01:12.207107] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-16T19:01:12.374913] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-09-16T19:01:12.461739] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-16T19:01:12.468018] [INFO ] [REMOTE ] JBS: Full fetch complete (24448 records). [2025-09-16T19:01:12.468106] [DEBUG] [VALIDATOR ] JBS: Validating primary data. [2025-09-16T19:01:12.653820] [WARN ] [VALIDATOR ] JBS: Validation failed - insufficient historical data. Have 64 unique days, need 150 days [2025-09-16T19:01:12.654270] [FATAL] [MAIN ] JBS: Fetched primary data is invalid. Refusing to save it. [2025-09-16T19:01:12.654378] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to validation failure. [2025-09-16T19:01:12.654450] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-16T19:01:12.654527] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-09-16T19:01:12.654590] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-09-16T19:01:12.654681] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-09-16T19:01:12.654783] [INFO ] [MAIN ] Update Progress: 1143/2369 symbols completed. JBS took 23.9s. Estimated remaining: 2h 9m 57s. Rate: 9.4 symbols/min [2025-09-16T19:01:12.824741] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:01:12.864597] [DEBUG] [LOCAL ] JCI: Loaded 39530 existing records from primary storage. [2025-09-16T19:01:12.864785] [INFO ] [MAIN ] JCI: Loaded 39530 existing records. [2025-09-16T19:01:13.042519] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:01:13.042783] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-09-16T19:01:13.042830] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-09-16T19:01:13.043788] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-09-16T19:01:13.043853] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-09-16T19:01:13.184155] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-09-16T19:01:13.249229] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-16T19:01:13.407307] [INFO ] [REMOTE ] JCI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:01:13.974908] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-09-16T19:01:14.774951] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-05. [2025-09-16T19:01:14.816852] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-16T19:01:14.821476] [INFO ] [REMOTE ] JBND: Full fetch complete (26445 records). [2025-09-16T19:01:14.821680] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-09-16T19:01:15.223503] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-09-16T19:01:15.223619] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-09-16T19:01:15.224334] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-09-16T19:01:15.224413] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-09-16T19:01:15.225407] [DEBUG] [LOCAL ] JBND: Trimmed 26445 records to 19070 (keeping 150 days of data) [2025-09-16T19:01:15.345525] [DEBUG] [LOCAL ] JBND: Primary data saved (19070 records). [2025-09-16T19:01:15.345705] [INFO ] [MAIN ] JBND: Full history saved. [2025-09-16T19:01:15.345825] [INFO ] [MAIN ] Update Progress: 1144/2369 symbols completed. JBND took 30.6s. Estimated remaining: 2h 9m 47s. Rate: 9.4 symbols/min [2025-09-16T19:01:15.520916] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:01:15.561076] [DEBUG] [LOCAL ] JEF: Loaded 36411 existing records from primary storage. [2025-09-16T19:01:15.561228] [INFO ] [MAIN ] JEF: Loaded 36411 existing records. [2025-09-16T19:01:15.593533] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-09-16T19:01:15.742352] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:01:15.742792] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-09-16T19:01:15.742870] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-09-16T19:01:15.743918] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-09-16T19:01:15.743997] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-09-16T19:01:16.150708] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-16T19:01:16.182724] [INFO ] [REMOTE ] JEF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:01:16.195672] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-16T19:01:16.216725] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-16T19:01:16.374875] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-09-16T19:01:17.174899] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-09-16T19:01:17.950560] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-16T19:01:17.974842] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-09-16T19:01:18.588323] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-16T19:01:18.774892] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-09-16T19:01:19.387517] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-16T19:01:19.574898] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-09-16T19:01:19.895669] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-16T19:01:20.374908] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-09-16T19:01:21.174920] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-09-16T19:01:21.487969] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-16T19:01:21.766062] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-16T19:01:21.767816] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-16T19:01:21.779746] [INFO ] [REMOTE ] JCE: Full fetch complete (6662 records). [2025-09-16T19:01:21.780040] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-09-16T19:01:21.984610] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-06. [2025-09-16T19:01:22.151552] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-09-16T19:01:22.151629] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-09-16T19:01:22.151840] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-09-16T19:01:22.151882] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-09-16T19:01:22.152274] [DEBUG] [LOCAL ] JCE: Trimmed 6662 records to 4761 (keeping 150 days of data) [2025-09-16T19:01:22.184308] [DEBUG] [LOCAL ] JCE: Primary data saved (4761 records). [2025-09-16T19:01:22.184410] [INFO ] [MAIN ] JCE: Full history saved. [2025-09-16T19:01:22.184494] [INFO ] [MAIN ] Update Progress: 1145/2369 symbols completed. JCE took 18.4s. Estimated remaining: 2h 9m 41s. Rate: 9.4 symbols/min [2025-09-16T19:01:22.353873] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:01:22.385415] [DEBUG] [LOCAL ] JELD: Loaded 34097 existing records from primary storage. [2025-09-16T19:01:22.385549] [INFO ] [MAIN ] JELD: Loaded 34097 existing records. [2025-09-16T19:01:22.561692] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:01:22.561915] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-09-16T19:01:22.561962] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-09-16T19:01:22.562667] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-09-16T19:01:22.562720] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-09-16T19:01:22.779967] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-09-16T19:01:22.924465] [INFO ] [REMOTE ] JELD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:01:23.470586] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-16T19:01:23.574870] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-07. [2025-09-16T19:01:24.374935] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-09-16T19:01:24.460239] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-16T19:01:25.049355] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-16T19:01:25.174886] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-08. [2025-09-16T19:01:25.461031] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-16T19:01:25.974900] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-09-16T19:01:26.459376] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-16T19:01:26.774903] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-09. [2025-09-16T19:01:27.574906] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-09-16T19:01:27.731209] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-16T19:01:28.045154] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-16T19:01:28.049376] [INFO ] [REMOTE ] JBTM: Full fetch complete (35139 records). [2025-09-16T19:01:28.049491] [DEBUG] [VALIDATOR ] JBTM: Validating primary data. [2025-09-16T19:01:28.385794] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-09-16T19:01:28.432177] [DEBUG] [VALIDATOR ] JBTM: All expected trading days are present. [2025-09-16T19:01:28.432261] [DEBUG] [VALIDATOR ] JBTM: Primary data validation passed. [2025-09-16T19:01:28.432891] [INFO ] [MAIN ] JBTM: Fetched primary data is valid. [2025-09-16T19:01:28.432936] [DEBUG] [LOCAL ] JBTM: Saving primary data. [2025-09-16T19:01:28.433854] [DEBUG] [LOCAL ] JBTM: Trimmed 35139 records to 24015 (keeping 150 days of data) [2025-09-16T19:01:28.590214] [DEBUG] [LOCAL ] JBTM: Primary data saved (24015 records). [2025-09-16T19:01:28.590477] [INFO ] [MAIN ] JBTM: Full history saved. [2025-09-16T19:01:28.590563] [INFO ] [MAIN ] Update Progress: 1146/2369 symbols completed. JBTM took 32.1s. Estimated remaining: 2h 9m 35s. Rate: 9.4 symbols/min [2025-09-16T19:01:28.759842] [INFO ] [MAIN ] JEQ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:01:28.767373] [DEBUG] [LOCAL ] JEQ: Loaded 5801 existing records from primary storage. [2025-09-16T19:01:28.767483] [INFO ] [MAIN ] JEQ: Loaded 5801 existing records. [2025-09-16T19:01:28.943681] [WARN ] [MAIN ] JEQ: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:01:28.943983] [INFO ] [MAIN ] JEQ: Wiping existing primary data before full refresh. [2025-09-16T19:01:28.944045] [INFO ] [LOCAL ] JEQ: Starting deletion of primary data. [2025-09-16T19:01:28.944661] [DEBUG] [LOCAL ] JEQ: Deleted primary data file. [2025-09-16T19:01:28.944719] [INFO ] [MAIN ] JEQ: Starting full primary refresh. [2025-09-16T19:01:29.193265] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-09-16T19:01:29.317586] [INFO ] [REMOTE ] JEQ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:01:29.379498] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-16T19:01:29.974896] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-02. [2025-09-16T19:01:30.308201] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-16T19:01:30.572600] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-16T19:01:30.774911] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-03. [2025-09-16T19:01:30.849550] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-16T19:01:31.574978] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-09-16T19:01:31.634405] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-16T19:01:32.374894] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-04. [2025-09-16T19:01:33.164482] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-16T19:01:33.174840] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-05. [2025-09-16T19:01:33.403826] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-16T19:01:33.900834] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-16T19:01:33.974871] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-06. [2025-09-16T19:01:34.544240] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-16T19:01:34.774899] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-09-16T19:01:35.574918] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-07. [2025-09-16T19:01:36.238535] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-16T19:01:36.374884] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-08. [2025-09-16T19:01:36.484342] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-16T19:01:36.492932] [INFO ] [REMOTE ] JCI: Full fetch complete (58225 records). [2025-09-16T19:01:36.493078] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-09-16T19:01:36.869087] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-09-16T19:01:36.869167] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-09-16T19:01:36.869963] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-09-16T19:01:36.870008] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-09-16T19:01:36.871189] [DEBUG] [LOCAL ] JCI: Trimmed 58225 records to 39917 (keeping 150 days of data) [2025-09-16T19:01:37.125313] [DEBUG] [LOCAL ] JCI: Primary data saved (39917 records). [2025-09-16T19:01:37.125476] [INFO ] [MAIN ] JCI: Full history saved. [2025-09-16T19:01:37.125586] [INFO ] [MAIN ] Update Progress: 1147/2369 symbols completed. JCI took 24.5s. Estimated remaining: 2h 9m 31s. Rate: 9.4 symbols/min [2025-09-16T19:01:37.180133] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-09-16T19:01:37.297900] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:01:37.318204] [DEBUG] [LOCAL ] JFR: Loaded 21424 existing records from primary storage. [2025-09-16T19:01:37.318364] [INFO ] [MAIN ] JFR: Loaded 21424 existing records. [2025-09-16T19:01:37.502026] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:01:37.502531] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-16T19:01:37.506240] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-09-16T19:01:37.506521] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-09-16T19:01:37.507023] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-09-16T19:01:37.507070] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-09-16T19:01:37.876584] [INFO ] [REMOTE ] JFR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:01:37.974895] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-09-16T19:01:38.774894] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-09-16T19:01:38.960408] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-16T19:01:39.574899] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-09-16T19:01:39.612345] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-16T19:01:40.125089] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-16T19:01:40.374894] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-09-16T19:01:41.174937] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-09. [2025-09-16T19:01:41.278603] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-16T19:01:41.974894] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-09-16T19:01:42.182732] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-16T19:01:42.197420] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-16T19:01:42.199205] [INFO ] [REMOTE ] JEQ: Full fetch complete (9435 records). [2025-09-16T19:01:42.199278] [DEBUG] [VALIDATOR ] JEQ: Validating primary data. [2025-09-16T19:01:42.574684] [DEBUG] [VALIDATOR ] JEQ: All expected trading days are present. [2025-09-16T19:01:42.574763] [DEBUG] [VALIDATOR ] JEQ: Primary data validation passed. [2025-09-16T19:01:42.575018] [INFO ] [MAIN ] JEQ: Fetched primary data is valid. [2025-09-16T19:01:42.575068] [DEBUG] [LOCAL ] JEQ: Saving primary data. [2025-09-16T19:01:42.575497] [DEBUG] [LOCAL ] JEQ: Trimmed 9435 records to 5934 (keeping 150 days of data) [2025-09-16T19:01:42.610111] [DEBUG] [LOCAL ] JEQ: Primary data saved (5934 records). [2025-09-16T19:01:42.610289] [INFO ] [MAIN ] JEQ: Full history saved. [2025-09-16T19:01:42.610379] [INFO ] [MAIN ] Update Progress: 1148/2369 symbols completed. JEQ took 14.0s. Estimated remaining: 2h 9m 24s. Rate: 9.4 symbols/min [2025-09-16T19:01:42.776300] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-09-16T19:01:42.795171] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:01:42.807458] [DEBUG] [LOCAL ] JGH: Loaded 8029 existing records from primary storage. [2025-09-16T19:01:42.807720] [INFO ] [MAIN ] JGH: Loaded 8029 existing records. [2025-09-16T19:01:42.996429] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:01:42.996745] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-09-16T19:01:42.996811] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-09-16T19:01:42.997130] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-09-16T19:01:42.997196] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-09-16T19:01:43.371526] [INFO ] [REMOTE ] JGH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:01:43.574912] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-09-16T19:01:43.621855] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-16T19:01:43.972374] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-16T19:01:44.371898] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-16T19:01:44.381935] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-09-16T19:01:45.146587] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-16T19:01:45.174847] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-09-16T19:01:45.974885] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-09-16T19:01:46.038085] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-16T19:01:46.774887] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-09-16T19:01:47.514349] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-16T19:01:47.520215] [INFO ] [REMOTE ] JEF: Full fetch complete (54480 records). [2025-09-16T19:01:47.520336] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-09-16T19:01:47.584544] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-09-16T19:01:47.634808] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-16T19:01:47.933184] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-09-16T19:01:47.933279] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-09-16T19:01:47.934600] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-09-16T19:01:47.934679] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-09-16T19:01:47.936208] [DEBUG] [LOCAL ] JEF: Trimmed 54480 records to 36773 (keeping 150 days of data) [2025-09-16T19:01:48.170714] [DEBUG] [LOCAL ] JEF: Primary data saved (36773 records). [2025-09-16T19:01:48.170863] [INFO ] [MAIN ] JEF: Full history saved. [2025-09-16T19:01:48.171509] [INFO ] [MAIN ] Update Progress: 1149/2369 symbols completed. JEF took 32.8s. Estimated remaining: 2h 9m 16s. Rate: 9.4 symbols/min [2025-09-16T19:01:48.348270] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:01:48.374900] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-09-16T19:01:48.388805] [DEBUG] [LOCAL ] JHG: Loaded 35163 existing records from primary storage. [2025-09-16T19:01:48.388932] [INFO ] [MAIN ] JHG: Loaded 35163 existing records. [2025-09-16T19:01:48.577772] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:01:48.578050] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-09-16T19:01:48.578099] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-09-16T19:01:48.579159] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-09-16T19:01:48.579214] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-09-16T19:01:49.074806] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-16T19:01:49.074057] [INFO ] [REMOTE ] JHG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:01:49.191042] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-09-16T19:01:49.222347] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-16T19:01:49.974958] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-09-16T19:01:50.111623] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-16T19:01:50.774944] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-09-16T19:01:51.122956] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-16T19:01:51.557276] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-16T19:01:51.574863] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-09-16T19:01:52.374946] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-09-16T19:01:52.581823] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-16T19:01:52.584014] [INFO ] [REMOTE ] JGH: Full fetch complete (11439 records). [2025-09-16T19:01:52.584084] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-09-16T19:01:52.968224] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-09-16T19:01:52.968319] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-09-16T19:01:52.968802] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-09-16T19:01:52.968847] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-09-16T19:01:52.969446] [DEBUG] [LOCAL ] JGH: Trimmed 11439 records to 8121 (keeping 150 days of data) [2025-09-16T19:01:53.023176] [DEBUG] [LOCAL ] JGH: Primary data saved (8121 records). [2025-09-16T19:01:53.023339] [INFO ] [MAIN ] JGH: Full history saved. [2025-09-16T19:01:53.023459] [INFO ] [MAIN ] Update Progress: 1150/2369 symbols completed. JGH took 10.4s. Estimated remaining: 2h 9m 9s. Rate: 9.4 symbols/min [2025-09-16T19:01:53.182126] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-09-16T19:01:53.208361] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:01:53.213952] [DEBUG] [LOCAL ] JHI: Loaded 2473 existing records from primary storage. [2025-09-16T19:01:53.214237] [INFO ] [MAIN ] JHI: Loaded 2473 existing records. [2025-09-16T19:01:53.397221] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:01:53.397444] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-09-16T19:01:53.397490] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-09-16T19:01:53.397731] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-09-16T19:01:53.397780] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-09-16T19:01:53.776818] [INFO ] [REMOTE ] JHI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:01:53.923801] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-16T19:01:53.974892] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-09-16T19:01:54.526710] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-16T19:01:54.774956] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-09-16T19:01:55.574920] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-09-16T19:01:55.643549] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-16T19:01:56.039058] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-16T19:01:56.083343] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-16T19:01:56.374910] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-09-16T19:01:57.174881] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-09-16T19:01:57.668112] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-16T19:01:57.974936] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-09-16T19:01:58.774902] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-09-16T19:01:58.934495] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-16T19:01:58.988843] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-16T19:01:59.574916] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-09-16T19:02:00.374917] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-09-16T19:02:00.410117] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-16T19:02:01.049613] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-16T19:02:01.071242] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-16T19:02:01.174914] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-09-16T19:02:01.873579] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-16T19:02:01.974910] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-09-16T19:02:02.774938] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-09-16T19:02:03.574902] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-09-16T19:02:03.672715] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-16T19:02:04.105363] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-16T19:02:04.110984] [INFO ] [REMOTE ] JFR: Full fetch complete (34558 records). [2025-09-16T19:02:04.111126] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-09-16T19:02:04.380061] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-09-16T19:02:04.502636] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-09-16T19:02:04.502726] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-09-16T19:02:04.503319] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-09-16T19:02:04.503360] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-09-16T19:02:04.504133] [DEBUG] [LOCAL ] JFR: Trimmed 34558 records to 21662 (keeping 150 days of data) [2025-09-16T19:02:04.632931] [DEBUG] [LOCAL ] JFR: Primary data saved (21662 records). [2025-09-16T19:02:04.633061] [INFO ] [MAIN ] JFR: Full history saved. [2025-09-16T19:02:04.633155] [INFO ] [MAIN ] Update Progress: 1151/2369 symbols completed. JFR took 27.5s. Estimated remaining: 2h 9m 8s. Rate: 9.4 symbols/min [2025-09-16T19:02:04.812859] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:02:04.816726] [DEBUG] [LOCAL ] JHS: Loaded 2257 existing records from primary storage. [2025-09-16T19:02:04.816804] [INFO ] [MAIN ] JHS: Loaded 2257 existing records. [2025-09-16T19:02:05.004793] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:02:05.005019] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-09-16T19:02:05.005097] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-09-16T19:02:05.005325] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-09-16T19:02:05.005368] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-09-16T19:02:05.179304] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-09-16T19:02:05.324371] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-16T19:02:05.375899] [INFO ] [REMOTE ] JELD: Full fetch complete (50033 records). [2025-09-16T19:02:05.399975] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-09-16T19:02:05.403207] [INFO ] [REMOTE ] JHS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:02:05.802225] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-09-16T19:02:05.802309] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-09-16T19:02:05.803101] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-09-16T19:02:05.803148] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-09-16T19:02:05.804229] [DEBUG] [LOCAL ] JELD: Trimmed 50033 records to 34406 (keeping 150 days of data) [2025-09-16T19:02:05.984899] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-09-16T19:02:05.990402] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-16T19:02:06.068904] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-16T19:02:06.095135] [DEBUG] [LOCAL ] JELD: Primary data saved (34406 records). [2025-09-16T19:02:06.095292] [INFO ] [MAIN ] JELD: Full history saved. [2025-09-16T19:02:06.095386] [INFO ] [MAIN ] Update Progress: 1152/2369 symbols completed. JELD took 43.9s. Estimated remaining: 2h 8m 56s. Rate: 9.4 symbols/min [2025-09-16T19:02:06.266236] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:02:06.304761] [DEBUG] [LOCAL ] JHX: Loaded 39218 existing records from primary storage. [2025-09-16T19:02:06.304916] [INFO ] [MAIN ] JHX: Loaded 39218 existing records. [2025-09-16T19:02:06.486597] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:02:06.486864] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-09-16T19:02:06.486911] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-09-16T19:02:06.487699] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-09-16T19:02:06.487749] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-09-16T19:02:06.746914] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-16T19:02:06.779026] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-09-16T19:02:06.859025] [INFO ] [REMOTE ] JHX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:02:07.371383] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-16T19:02:07.574923] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-09-16T19:02:08.374937] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-09-16T19:02:08.828171] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-16T19:02:09.174908] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-09-16T19:02:09.278233] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-16T19:02:09.974918] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-09-16T19:02:10.001159] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-16T19:02:10.774943] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-09-16T19:02:11.580514] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-09-16T19:02:11.598959] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-16T19:02:12.052272] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-16T19:02:12.066403] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-16T19:02:12.374966] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-09-16T19:02:12.821750] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-16T19:02:13.174920] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-09-16T19:02:13.754209] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-16T19:02:13.974922] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-09-16T19:02:14.774955] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-09-16T19:02:15.583615] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-09-16T19:02:15.611732] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-16T19:02:16.156994] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-16T19:02:16.317872] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-16T19:02:16.323606] [INFO ] [REMOTE ] JHG: Full fetch complete (52110 records). [2025-09-16T19:02:16.323782] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-09-16T19:02:16.385061] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-09-16T19:02:16.737725] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-09-16T19:02:16.737823] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-09-16T19:02:16.738708] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-09-16T19:02:16.738786] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-09-16T19:02:16.741223] [DEBUG] [LOCAL ] JHG: Trimmed 52110 records to 35502 (keeping 150 days of data) [2025-09-16T19:02:16.963611] [DEBUG] [LOCAL ] JHG: Primary data saved (35502 records). [2025-09-16T19:02:16.963788] [INFO ] [MAIN ] JHG: Full history saved. [2025-09-16T19:02:16.964480] [INFO ] [MAIN ] Update Progress: 1153/2369 symbols completed. JHG took 28.8s. Estimated remaining: 2h 8m 55s. Rate: 9.4 symbols/min [2025-09-16T19:02:17.144351] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:02:17.164981] [DEBUG] [LOCAL ] JILL: Loaded 11480 existing records from primary storage. [2025-09-16T19:02:17.165129] [INFO ] [MAIN ] JILL: Loaded 11480 existing records. [2025-09-16T19:02:17.180054] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-09-16T19:02:17.353452] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:02:17.353758] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-09-16T19:02:17.353818] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-09-16T19:02:17.354228] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-09-16T19:02:17.354292] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-09-16T19:02:17.716415] [INFO ] [REMOTE ] JILL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:02:17.720176] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-16T19:02:17.974908] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-09-16T19:02:18.412255] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-16T19:02:18.420002] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-16T19:02:18.774945] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-09-16T19:02:19.537762] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-16T19:02:19.574953] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-09-16T19:02:20.374917] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-09-16T19:02:20.580705] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-16T19:02:21.023808] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-16T19:02:21.025383] [INFO ] [REMOTE ] JHS: Full fetch complete (3241 records). [2025-09-16T19:02:21.025477] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-09-16T19:02:21.179118] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-09-16T19:02:21.406796] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-09-16T19:02:21.406901] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-09-16T19:02:21.407053] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-09-16T19:02:21.407100] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-09-16T19:02:21.407572] [DEBUG] [LOCAL ] JHS: Trimmed 3241 records to 2298 (keeping 150 days of data) [2025-09-16T19:02:21.423399] [DEBUG] [LOCAL ] JHS: Primary data saved (2298 records). [2025-09-16T19:02:21.423510] [INFO ] [MAIN ] JHS: Full history saved. [2025-09-16T19:02:21.423665] [INFO ] [MAIN ] Update Progress: 1154/2369 symbols completed. JHS took 16.8s. Estimated remaining: 2h 8m 46s. Rate: 9.4 symbols/min [2025-09-16T19:02:21.618017] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:02:21.653800] [DEBUG] [LOCAL ] JKS: Loaded 28310 existing records from primary storage. [2025-09-16T19:02:21.653978] [INFO ] [MAIN ] JKS: Loaded 28310 existing records. [2025-09-16T19:02:21.877366] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:02:21.877615] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-09-16T19:02:21.877683] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-09-16T19:02:21.878379] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-09-16T19:02:21.878448] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-09-16T19:02:21.981427] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-09-16T19:02:22.258143] [INFO ] [REMOTE ] JKS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:02:22.272035] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-16T19:02:22.774923] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-09-16T19:02:23.299083] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-16T19:02:23.580047] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-09-16T19:02:23.604193] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-16T19:02:24.374947] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-09-16T19:02:24.525603] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-16T19:02:25.174920] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-09-16T19:02:25.974918] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-09-16T19:02:26.020910] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-16T19:02:26.022539] [INFO ] [REMOTE ] JHI: Full fetch complete (4014 records). [2025-09-16T19:02:26.022740] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-09-16T19:02:26.068974] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-16T19:02:26.394167] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-09-16T19:02:26.394271] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-09-16T19:02:26.394449] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-09-16T19:02:26.394493] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-09-16T19:02:26.394880] [DEBUG] [LOCAL ] JHI: Trimmed 4014 records to 2505 (keeping 150 days of data) [2025-09-16T19:02:26.410636] [DEBUG] [LOCAL ] JHI: Primary data saved (2505 records). [2025-09-16T19:02:26.410725] [INFO ] [MAIN ] JHI: Full history saved. [2025-09-16T19:02:26.410824] [INFO ] [MAIN ] Update Progress: 1155/2369 symbols completed. JHI took 33.4s. Estimated remaining: 2h 8m 38s. Rate: 9.4 symbols/min [2025-09-16T19:02:26.580026] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:02:26.604453] [DEBUG] [LOCAL ] JLL: Loaded 23872 existing records from primary storage. [2025-09-16T19:02:26.604608] [INFO ] [MAIN ] JLL: Loaded 23872 existing records. [2025-09-16T19:02:26.779934] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-09-16T19:02:26.783240] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:02:26.784163] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-09-16T19:02:26.784211] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-09-16T19:02:26.784761] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-09-16T19:02:26.784881] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-09-16T19:02:27.153000] [INFO ] [REMOTE ] JLL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:02:27.574856] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-09-16T19:02:27.614460] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-16T19:02:27.914992] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-16T19:02:28.374904] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-09-16T19:02:28.940755] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-16T19:02:29.174920] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-09-16T19:02:29.974901] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-09-16T19:02:30.293766] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-16T19:02:30.377900] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-16T19:02:30.774956] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-09-16T19:02:30.906615] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-16T19:02:31.574918] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-09-16T19:02:32.126489] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-16T19:02:32.374962] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-09-16T19:02:33.174885] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-09-16T19:02:33.301152] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-16T19:02:33.577709] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-16T19:02:33.584327] [INFO ] [REMOTE ] JHX: Full fetch complete (49729 records). [2025-09-16T19:02:33.584462] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-09-16T19:02:33.980806] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-09-16T19:02:34.002564] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-09-16T19:02:34.002696] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-09-16T19:02:34.003622] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-09-16T19:02:34.003809] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-09-16T19:02:34.007362] [DEBUG] [LOCAL ] JHX: Trimmed 49729 records to 39604 (keeping 150 days of data) [2025-09-16T19:02:34.275787] [DEBUG] [LOCAL ] JHX: Primary data saved (39604 records). [2025-09-16T19:02:34.275957] [INFO ] [MAIN ] JHX: Full history saved. [2025-09-16T19:02:34.276059] [INFO ] [MAIN ] Update Progress: 1156/2369 symbols completed. JHX took 28.2s. Estimated remaining: 2h 8m 34s. Rate: 9.4 symbols/min [2025-09-16T19:02:34.456188] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:02:34.460951] [DEBUG] [LOCAL ] JLS: Loaded 2854 existing records from primary storage. [2025-09-16T19:02:34.461032] [INFO ] [MAIN ] JLS: Loaded 2854 existing records. [2025-09-16T19:02:34.647290] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:02:34.647569] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-09-16T19:02:34.647708] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-09-16T19:02:34.648239] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-09-16T19:02:34.648304] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-09-16T19:02:34.776174] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-09-16T19:02:34.943426] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-16T19:02:35.052707] [INFO ] [REMOTE ] JLS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:02:35.574901] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-09-16T19:02:35.852671] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-16T19:02:36.042948] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-16T19:02:36.045571] [INFO ] [REMOTE ] JILL: Full fetch complete (17792 records). [2025-09-16T19:02:36.045687] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-09-16T19:02:36.174629] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-16T19:02:36.380864] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-09-16T19:02:36.424053] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-09-16T19:02:36.424138] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-09-16T19:02:36.424568] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-09-16T19:02:36.424613] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-09-16T19:02:36.425462] [DEBUG] [LOCAL ] JILL: Trimmed 17792 records to 11627 (keeping 150 days of data) [2025-09-16T19:02:36.498079] [DEBUG] [LOCAL ] JILL: Primary data saved (11627 records). [2025-09-16T19:02:36.498237] [INFO ] [MAIN ] JILL: Full history saved. [2025-09-16T19:02:36.498327] [INFO ] [MAIN ] Update Progress: 1157/2369 symbols completed. JILL took 19.5s. Estimated remaining: 2h 8m 23s. Rate: 9.4 symbols/min [2025-09-16T19:02:37.174900] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-09-16T19:02:37.969895] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-16T19:02:37.977518] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-09-16T19:02:38.566156] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-16T19:02:38.583781] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-16T19:02:38.774914] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-09-16T19:02:39.574911] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-09-16T19:02:40.171873] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-16T19:02:40.212387] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-16T19:02:40.374903] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-09-16T19:02:41.025740] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-16T19:02:41.174921] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-09-16T19:02:41.974923] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-09-16T19:02:42.542633] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-16T19:02:42.774915] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-09-16T19:02:43.283513] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-16T19:02:43.352727] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-16T19:02:43.574949] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-09-16T19:02:44.145337] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-16T19:02:44.374930] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-09-16T19:02:44.938287] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-16T19:02:45.174907] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-09-16T19:02:45.974903] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-09-16T19:02:46.258097] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-16T19:02:46.610365] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-16T19:02:46.611820] [INFO ] [REMOTE ] JLS: Full fetch complete (4419 records). [2025-09-16T19:02:46.611906] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-09-16T19:02:46.785859] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-09-16T19:02:47.034208] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-09-16T19:02:47.034347] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-09-16T19:02:47.034575] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-09-16T19:02:47.034640] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-09-16T19:02:47.035392] [DEBUG] [LOCAL ] JLS: Trimmed 4419 records to 2896 (keeping 150 days of data) [2025-09-16T19:02:47.055736] [DEBUG] [LOCAL ] JLS: Primary data saved (2896 records). [2025-09-16T19:02:47.055896] [INFO ] [MAIN ] JLS: Full history saved. [2025-09-16T19:02:47.056013] [INFO ] [MAIN ] Update Progress: 1158/2369 symbols completed. JLS took 12.8s. Estimated remaining: 2h 8m 21s. Rate: 9.4 symbols/min [2025-09-16T19:02:47.575020] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-09-16T19:02:48.551384] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-16T19:02:48.564225] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-09-16T19:02:48.913161] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-16T19:02:49.175110] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-09-16T19:02:49.712017] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-16T19:02:49.720210] [INFO ] [REMOTE ] JKS: Full fetch complete (43926 records). [2025-09-16T19:02:49.720405] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-09-16T19:02:50.118040] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-09-16T19:02:50.118128] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-09-16T19:02:50.119038] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-09-16T19:02:50.119085] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-09-16T19:02:50.120163] [DEBUG] [LOCAL ] JKS: Trimmed 43926 records to 28572 (keeping 150 days of data) [2025-09-16T19:02:50.312814] [DEBUG] [LOCAL ] JKS: Primary data saved (28572 records). [2025-09-16T19:02:50.312970] [INFO ] [MAIN ] JKS: Full history saved. [2025-09-16T19:02:50.313063] [INFO ] [MAIN ] Update Progress: 1159/2369 symbols completed. JKS took 28.9s. Estimated remaining: 2h 8m 11s. Rate: 9.4 symbols/min [2025-09-16T19:02:50.535904] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-16T19:02:50.540169] [INFO ] [REMOTE ] JLL: Full fetch complete (35290 records). [2025-09-16T19:02:50.540333] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-09-16T19:02:50.923414] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-09-16T19:02:50.923701] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-09-16T19:02:50.924554] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-09-16T19:02:50.924596] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-09-16T19:02:50.925565] [DEBUG] [LOCAL ] JLL: Trimmed 35290 records to 24106 (keeping 150 days of data) [2025-09-16T19:02:51.079375] [DEBUG] [LOCAL ] JLL: Primary data saved (24106 records). [2025-09-16T19:02:51.079529] [INFO ] [MAIN ] JLL: Full history saved. [2025-09-16T19:02:51.079625] [INFO ] [MAIN ] Update Progress: 1160/2369 symbols completed. JLL took 24.7s. Estimated remaining: 2h 7m 59s. Rate: 9.4 symbols/min [2025-09-16T19:02:51.681876] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:02:51.680316] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:02:51.766910] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:02:51.787819] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-09-16T19:02:51.794408] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-09-16T19:02:51.801994] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-09-16T19:02:51.817095] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-16T19:02:51.820236] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:02:51.820527] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-09-16T19:02:51.820672] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-09-16T19:02:51.987672] [DEBUG] [LOCAL ] JMIA: Loaded 37586 existing records from primary storage. [2025-09-16T19:02:52.018882] [INFO ] [MAIN ] JMIA: Loaded 37586 existing records. [2025-09-16T19:02:52.054966] [DEBUG] [LOCAL ] JOBY: Loaded 39771 existing records from primary storage. [2025-09-16T19:02:52.161840] [INFO ] [MAIN ] JOBY: Loaded 39771 existing records. [2025-09-16T19:02:52.372158] [DEBUG] [LOCAL ] JNJ: Loaded 39713 existing records from primary storage. [2025-09-16T19:02:52.439188] [INFO ] [MAIN ] JNJ: Loaded 39713 existing records. [2025-09-16T19:02:52.559789] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:02:52.657156] [INFO ] [REMOTE ] JMM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:02:52.686731] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-09-16T19:02:52.692154] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-09-16T19:02:52.692310] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-09-16T19:02:52.774601] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-09-16T19:02:52.774780] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-09-16T19:02:52.809491] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:02:52.894150] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-09-16T19:02:52.906199] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-09-16T19:02:52.940617] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:02:52.969729] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-09-16T19:02:52.970142] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-09-16T19:02:52.970234] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-09-16T19:02:52.970334] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-09-16T19:02:53.027130] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-09-16T19:02:53.089451] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-09-16T19:02:53.349299] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-16T19:02:53.380106] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-09-16T19:02:53.839924] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:02:53.884142] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-16T19:02:53.898884] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-09-16T19:02:53.884044] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-09-16T19:02:53.936195] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:02:53.942330] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-09-16T19:02:54.028667] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:02:54.028988] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-09-16T19:02:54.393144] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-16T19:02:54.774962] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-09-16T19:02:55.239584] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-16T19:02:55.574979] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-09-16T19:02:55.849613] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-16T19:02:55.919691] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-16T19:02:56.012996] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-16T19:02:56.368567] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-09-16T19:02:56.378384] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-09-16T19:02:56.897279] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-16T19:02:57.174956] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-09-16T19:02:57.610756] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-16T19:02:57.974965] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-09-16T19:02:58.774936] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-09-16T19:02:59.574960] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-09-16T19:03:00.161463] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-16T19:03:00.335059] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-16T19:03:00.374880] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-09-16T19:03:01.174897] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-09-16T19:03:01.553756] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-16T19:03:01.974935] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-09-16T19:03:02.405469] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-16T19:03:02.774927] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-09-16T19:03:03.013720] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-16T19:03:03.574929] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-09-16T19:03:04.084152] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-16T19:03:04.106354] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-16T19:03:04.107334] [INFO ] [REMOTE ] JMM: Full fetch complete (1968 records). [2025-09-16T19:03:04.107416] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-09-16T19:03:04.307883] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 146 unique days, need 150 days [2025-09-16T19:03:04.308259] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-09-16T19:03:04.318131] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-09-16T19:03:04.331405] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-16T19:03:04.334233] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-09-16T19:03:04.334289] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-09-16T19:03:04.334887] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-09-16T19:03:04.335002] [INFO ] [MAIN ] Update Progress: 1161/2369 symbols completed. JMM took 13.3s. Estimated remaining: 2h 8m 0s. Rate: 9.4 symbols/min [2025-09-16T19:03:04.335901] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-16T19:03:04.384999] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-09-16T19:03:04.542388] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:03:04.559940] [DEBUG] [LOCAL ] JOE: Loaded 17669 existing records from primary storage. [2025-09-16T19:03:04.560067] [INFO ] [MAIN ] JOE: Loaded 17669 existing records. [2025-09-16T19:03:04.738932] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:03:04.739163] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-09-16T19:03:04.739209] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-09-16T19:03:04.739690] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-09-16T19:03:04.739742] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-09-16T19:03:05.097324] [INFO ] [REMOTE ] JOE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:03:05.174856] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-09-16T19:03:05.974916] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-09-16T19:03:06.190561] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-16T19:03:06.571836] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-16T19:03:06.774864] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-09-16T19:03:07.574906] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-09-16T19:03:08.250944] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-16T19:03:08.374938] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-09-16T19:03:08.570147] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-16T19:03:09.174958] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-09-16T19:03:09.324958] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-16T19:03:09.974917] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-09-16T19:03:10.774924] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-09-16T19:03:11.003938] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.63 seconds). [2025-09-16T19:03:11.312994] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-16T19:03:11.574883] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-09-16T19:03:11.720586] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-16T19:03:11.881168] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-16T19:03:12.375366] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-09-16T19:03:13.174926] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-09-16T19:03:13.604074] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-16T19:03:13.760574] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-16T19:03:13.974945] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-09-16T19:03:14.774949] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-09-16T19:03:15.532718] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-09-16T19:03:15.574856] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-09-16T19:03:16.149909] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-16T19:03:16.158019] [INFO ] [REMOTE ] JNJ: Full fetch complete (58433 records). [2025-09-16T19:03:16.158204] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-09-16T19:03:16.380808] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-09-16T19:03:16.556498] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-09-16T19:03:16.556625] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-09-16T19:03:16.557464] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-09-16T19:03:16.557509] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-09-16T19:03:16.558908] [DEBUG] [LOCAL ] JNJ: Trimmed 58433 records to 40103 (keeping 150 days of data) [2025-09-16T19:03:16.686949] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-16T19:03:16.860544] [DEBUG] [LOCAL ] JNJ: Primary data saved (40103 records). [2025-09-16T19:03:16.860696] [INFO ] [MAIN ] JNJ: Full history saved. [2025-09-16T19:03:16.860777] [INFO ] [MAIN ] Update Progress: 1162/2369 symbols completed. JNJ took 25.8s. Estimated remaining: 2h 8m 0s. Rate: 9.4 symbols/min [2025-09-16T19:03:17.042843] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:03:17.049488] [DEBUG] [LOCAL ] JOF: Loaded 5046 existing records from primary storage. [2025-09-16T19:03:17.049589] [INFO ] [MAIN ] JOF: Loaded 5046 existing records. [2025-09-16T19:03:17.180030] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-09-16T19:03:17.236874] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:03:17.237160] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-09-16T19:03:17.237219] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-09-16T19:03:17.237533] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-09-16T19:03:17.237577] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-09-16T19:03:17.591086] [INFO ] [REMOTE ] JOF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:03:17.607852] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-16T19:03:17.734778] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-16T19:03:17.974935] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-09-16T19:03:18.774868] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-09-16T19:03:18.807215] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-16T19:03:18.813478] [INFO ] [REMOTE ] JMIA: Full fetch complete (54839 records). [2025-09-16T19:03:18.813570] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-09-16T19:03:19.195438] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-09-16T19:03:19.195671] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-09-16T19:03:19.196467] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-09-16T19:03:19.196512] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-09-16T19:03:19.197736] [DEBUG] [LOCAL ] JMIA: Trimmed 54839 records to 37976 (keeping 150 days of data) [2025-09-16T19:03:19.418149] [DEBUG] [LOCAL ] JMIA: Primary data saved (37976 records). [2025-09-16T19:03:19.418290] [INFO ] [MAIN ] JMIA: Full history saved. [2025-09-16T19:03:19.418377] [INFO ] [MAIN ] Update Progress: 1163/2369 symbols completed. JMIA took 28.3s. Estimated remaining: 2h 7m 50s. Rate: 9.4 symbols/min [2025-09-16T19:03:19.587102] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-09-16T19:03:19.588377] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:03:19.614629] [DEBUG] [LOCAL ] JPC: Loaded 26736 existing records from primary storage. [2025-09-16T19:03:19.614775] [INFO ] [MAIN ] JPC: Loaded 26736 existing records. [2025-09-16T19:03:19.802756] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:03:19.803057] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-09-16T19:03:19.803104] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-09-16T19:03:19.803960] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-09-16T19:03:19.804035] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-09-16T19:03:19.983844] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-16T19:03:20.166421] [INFO ] [REMOTE ] JPC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:03:20.182056] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-16T19:03:20.204594] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-16T19:03:20.211190] [INFO ] [REMOTE ] JOBY: Full fetch complete (58475 records). [2025-09-16T19:03:20.211344] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-09-16T19:03:20.376738] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-09-16T19:03:20.606256] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-09-16T19:03:20.606338] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-09-16T19:03:20.607274] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-09-16T19:03:20.607326] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-09-16T19:03:20.608522] [DEBUG] [LOCAL ] JOBY: Trimmed 58475 records to 40161 (keeping 150 days of data) [2025-09-16T19:03:20.846410] [DEBUG] [LOCAL ] JOBY: Primary data saved (40161 records). [2025-09-16T19:03:20.846535] [INFO ] [MAIN ] JOBY: Full history saved. [2025-09-16T19:03:20.846615] [INFO ] [MAIN ] Update Progress: 1164/2369 symbols completed. JOBY took 29.8s. Estimated remaining: 2h 7m 38s. Rate: 9.4 symbols/min [2025-09-16T19:03:21.015942] [INFO ] [MAIN ] JPI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:03:21.021452] [DEBUG] [LOCAL ] JPI: Loaded 3826 existing records from primary storage. [2025-09-16T19:03:21.021553] [INFO ] [MAIN ] JPI: Loaded 3826 existing records. [2025-09-16T19:03:21.198745] [WARN ] [MAIN ] JPI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:03:21.198885] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-09-16T19:03:21.199516] [INFO ] [MAIN ] JPI: Wiping existing primary data before full refresh. [2025-09-16T19:03:21.200400] [INFO ] [LOCAL ] JPI: Starting deletion of primary data. [2025-09-16T19:03:21.209260] [DEBUG] [LOCAL ] JPI: Deleted primary data file. [2025-09-16T19:03:21.209726] [INFO ] [MAIN ] JPI: Starting full primary refresh. [2025-09-16T19:03:21.209621] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-16T19:03:21.568513] [INFO ] [REMOTE ] JPI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:03:21.974880] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-09-16T19:03:22.495070] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-16T19:03:22.774903] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-09-16T19:03:23.327696] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-16T19:03:23.449364] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-16T19:03:23.574850] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-09-16T19:03:24.374918] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-09-16T19:03:25.104092] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-16T19:03:25.174862] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-09-16T19:03:25.425140] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-16T19:03:25.974915] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-09-16T19:03:26.660447] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-16T19:03:26.689465] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-16T19:03:26.774945] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-09-16T19:03:27.574897] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-09-16T19:03:27.781243] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-16T19:03:27.784340] [INFO ] [REMOTE ] JOE: Full fetch complete (26932 records). [2025-09-16T19:03:27.784415] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-09-16T19:03:28.170071] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-09-16T19:03:28.170160] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-09-16T19:03:28.170806] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-09-16T19:03:28.170870] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-09-16T19:03:28.171625] [DEBUG] [LOCAL ] JOE: Trimmed 26932 records to 17782 (keeping 150 days of data) [2025-09-16T19:03:28.255716] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-16T19:03:28.288139] [DEBUG] [LOCAL ] JOE: Primary data saved (17782 records). [2025-09-16T19:03:28.288273] [INFO ] [MAIN ] JOE: Full history saved. [2025-09-16T19:03:28.288370] [INFO ] [MAIN ] Update Progress: 1165/2369 symbols completed. JOE took 24.0s. Estimated remaining: 2h 7m 33s. Rate: 9.4 symbols/min [2025-09-16T19:03:28.379988] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-02. [2025-09-16T19:03:28.462092] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:03:28.499666] [DEBUG] [LOCAL ] JPM: Loaded 39754 existing records from primary storage. [2025-09-16T19:03:28.499835] [INFO ] [MAIN ] JPM: Loaded 39754 existing records. [2025-09-16T19:03:28.673639] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:03:28.673912] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-09-16T19:03:28.673957] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-09-16T19:03:28.674933] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-09-16T19:03:28.674981] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-09-16T19:03:29.028731] [INFO ] [REMOTE ] JPM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:03:29.070280] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-16T19:03:29.174922] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-09-16T19:03:29.723333] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-16T19:03:29.974927] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-09-16T19:03:30.774893] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-03. [2025-09-16T19:03:31.353383] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-16T19:03:31.404201] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-16T19:03:31.574910] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-09-16T19:03:32.341931] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-16T19:03:32.374850] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-09-16T19:03:33.168666] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-16T19:03:33.170320] [INFO ] [REMOTE ] JOF: Full fetch complete (7542 records). [2025-09-16T19:03:33.170390] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-09-16T19:03:33.181538] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-09-16T19:03:33.545030] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-09-16T19:03:33.545161] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-09-16T19:03:33.545588] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-09-16T19:03:33.545703] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-09-16T19:03:33.546540] [DEBUG] [LOCAL ] JOF: Trimmed 7542 records to 5071 (keeping 150 days of data) [2025-09-16T19:03:33.587462] [DEBUG] [LOCAL ] JOF: Primary data saved (5071 records). [2025-09-16T19:03:33.587697] [INFO ] [MAIN ] JOF: Full history saved. [2025-09-16T19:03:33.587855] [INFO ] [MAIN ] Update Progress: 1166/2369 symbols completed. JOF took 16.7s. Estimated remaining: 2h 7m 26s. Rate: 9.4 symbols/min [2025-09-16T19:03:33.832510] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:03:33.865296] [DEBUG] [LOCAL ] JQC: Loaded 24051 existing records from primary storage. [2025-09-16T19:03:33.865468] [INFO ] [MAIN ] JQC: Loaded 24051 existing records. [2025-09-16T19:03:33.981025] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-04. [2025-09-16T19:03:34.163770] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:03:34.164942] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-09-16T19:03:34.165026] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-09-16T19:03:34.165675] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-09-16T19:03:34.165735] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-09-16T19:03:34.634472] [INFO ] [REMOTE ] JQC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:03:34.656562] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-16T19:03:34.727379] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-16T19:03:34.774882] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-09-16T19:03:35.574896] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-09-16T19:03:36.259715] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-16T19:03:36.374915] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-09-16T19:03:37.174912] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-05. [2025-09-16T19:03:37.714148] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-09-16T19:03:37.777920] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-16T19:03:37.878201] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-16T19:03:37.974897] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-09-16T19:03:38.774899] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-09-16T19:03:39.377318] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-16T19:03:39.381956] [INFO ] [REMOTE ] JPC: Full fetch complete (40697 records). [2025-09-16T19:03:39.382048] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-09-16T19:03:39.580695] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-09-16T19:03:39.756432] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-09-16T19:03:39.756511] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-09-16T19:03:39.757182] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-09-16T19:03:39.757228] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-09-16T19:03:39.758111] [DEBUG] [LOCAL ] JPC: Trimmed 40697 records to 27000 (keeping 150 days of data) [2025-09-16T19:03:39.924098] [DEBUG] [LOCAL ] JPC: Primary data saved (27000 records). [2025-09-16T19:03:39.924277] [INFO ] [MAIN ] JPC: Full history saved. [2025-09-16T19:03:39.924377] [INFO ] [MAIN ] Update Progress: 1167/2369 symbols completed. JPC took 20.5s. Estimated remaining: 2h 7m 19s. Rate: 9.4 symbols/min [2025-09-16T19:03:40.103045] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:03:40.121040] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-16T19:03:40.135893] [DEBUG] [LOCAL ] JRI: Loaded 11077 existing records from primary storage. [2025-09-16T19:03:40.136028] [INFO ] [MAIN ] JRI: Loaded 11077 existing records. [2025-09-16T19:03:40.309316] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:03:40.309543] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-09-16T19:03:40.309588] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-09-16T19:03:40.310031] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-09-16T19:03:40.310079] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-09-16T19:03:40.383039] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-09-16T19:03:40.661327] [INFO ] [REMOTE ] JRI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:03:41.174898] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-09-16T19:03:41.818331] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-16T19:03:41.974909] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-06. [2025-09-16T19:03:42.119848] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-09-16T19:03:42.147069] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-16T19:03:42.354800] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-16T19:03:42.774939] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-09-16T19:03:43.574911] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-09-16T19:03:43.773066] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-16T19:03:44.374906] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-09-16T19:03:44.978218] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-16T19:03:45.174911] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-09-16T19:03:45.284299] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-16T19:03:45.974903] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-09-16T19:03:46.555777] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-16T19:03:46.774936] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-09-16T19:03:46.976616] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-16T19:03:47.574917] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-09-16T19:03:48.374882] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-07. [2025-09-16T19:03:48.761161] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-16T19:03:48.786962] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-16T19:03:48.962463] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-16T19:03:49.174868] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-08. [2025-09-16T19:03:49.540836] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-16T19:03:49.974877] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-09-16T19:03:50.774934] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-09. [2025-09-16T19:03:50.875726] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-16T19:03:51.363280] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-16T19:03:51.364568] [INFO ] [REMOTE ] JPI: Full fetch complete (5872 records). [2025-09-16T19:03:51.364636] [DEBUG] [VALIDATOR ] JPI: Validating primary data. [2025-09-16T19:03:51.580083] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-09-16T19:03:51.717529] [DEBUG] [VALIDATOR ] JPI: All expected trading days are present. [2025-09-16T19:03:51.717600] [DEBUG] [VALIDATOR ] JPI: Primary data validation passed. [2025-09-16T19:03:51.717769] [INFO ] [MAIN ] JPI: Fetched primary data is valid. [2025-09-16T19:03:51.717810] [DEBUG] [LOCAL ] JPI: Saving primary data. [2025-09-16T19:03:51.718173] [DEBUG] [LOCAL ] JPI: Trimmed 5872 records to 3856 (keeping 150 days of data) [2025-09-16T19:03:51.741676] [DEBUG] [LOCAL ] JPI: Primary data saved (3856 records). [2025-09-16T19:03:51.741737] [INFO ] [MAIN ] JPI: Full history saved. [2025-09-16T19:03:51.741820] [INFO ] [MAIN ] Update Progress: 1168/2369 symbols completed. JPI took 30.9s. Estimated remaining: 2h 7m 19s. Rate: 9.4 symbols/min [2025-09-16T19:03:51.908059] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:03:51.917167] [DEBUG] [LOCAL ] JRS: Loaded 8279 existing records from primary storage. [2025-09-16T19:03:51.917268] [INFO ] [MAIN ] JRS: Loaded 8279 existing records. [2025-09-16T19:03:52.094330] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:03:52.094589] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-09-16T19:03:52.094664] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-09-16T19:03:52.094993] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-09-16T19:03:52.095037] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-09-16T19:03:52.380012] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-09-16T19:03:52.444549] [INFO ] [REMOTE ] JRS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:03:52.640893] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-16T19:03:53.174933] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-09-16T19:03:53.928126] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-16T19:03:53.974896] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-09-16T19:03:54.780467] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-09-16T19:03:54.786419] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-09-16T19:03:54.805289] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-16T19:03:55.574920] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-09-16T19:03:56.125163] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-16T19:03:56.363398] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-16T19:03:56.374840] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-09-16T19:03:57.174966] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-09-16T19:03:57.753043] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-16T19:03:57.974879] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-09-16T19:03:58.171233] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-16T19:03:58.174395] [INFO ] [REMOTE ] JRI: Full fetch complete (16788 records). [2025-09-16T19:03:58.174466] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-09-16T19:03:58.531898] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-09-16T19:03:58.531977] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-09-16T19:03:58.532320] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-09-16T19:03:58.532360] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-09-16T19:03:58.532925] [DEBUG] [LOCAL ] JRI: Trimmed 16788 records to 11215 (keeping 150 days of data) [2025-09-16T19:03:58.597513] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-16T19:03:58.613962] [DEBUG] [LOCAL ] JRI: Primary data saved (11215 records). [2025-09-16T19:03:58.614097] [INFO ] [MAIN ] JRI: Full history saved. [2025-09-16T19:03:58.614183] [INFO ] [MAIN ] Update Progress: 1169/2369 symbols completed. JRI took 18.7s. Estimated remaining: 2h 7m 13s. Rate: 9.4 symbols/min [2025-09-16T19:03:58.782994] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-09-16T19:03:58.785906] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:03:58.821381] [DEBUG] [LOCAL ] JXN: Loaded 32954 existing records from primary storage. [2025-09-16T19:03:58.821520] [INFO ] [MAIN ] JXN: Loaded 32954 existing records. [2025-09-16T19:03:59.032557] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:03:59.032851] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-09-16T19:03:59.032913] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-09-16T19:03:59.033766] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-09-16T19:03:59.033826] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-09-16T19:03:59.383510] [INFO ] [REMOTE ] JXN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:03:59.574909] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-09-16T19:03:59.620273] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-16T19:04:00.374903] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-09-16T19:04:00.911897] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-16T19:04:00.921806] [INFO ] [REMOTE ] JQC: Full fetch complete (36613 records). [2025-09-16T19:04:00.922016] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-09-16T19:04:01.182707] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-09-16T19:04:01.295969] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-09-16T19:04:01.296049] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-09-16T19:04:01.296727] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-09-16T19:04:01.296782] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-09-16T19:04:01.297842] [DEBUG] [LOCAL ] JQC: Trimmed 36613 records to 24293 (keeping 150 days of data) [2025-09-16T19:04:01.446107] [DEBUG] [LOCAL ] JQC: Primary data saved (24293 records). [2025-09-16T19:04:01.446248] [INFO ] [MAIN ] JQC: Full history saved. [2025-09-16T19:04:01.446347] [INFO ] [MAIN ] Update Progress: 1170/2369 symbols completed. JQC took 27.9s. Estimated remaining: 2h 7m 3s. Rate: 9.4 symbols/min [2025-09-16T19:04:01.618546] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:04:01.656738] [DEBUG] [LOCAL ] K: Loaded 37003 existing records from primary storage. [2025-09-16T19:04:01.656900] [INFO ] [MAIN ] K: Loaded 37003 existing records. [2025-09-16T19:04:01.851451] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:04:01.851829] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-09-16T19:04:01.851992] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-09-16T19:04:01.853003] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-09-16T19:04:01.853069] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-09-16T19:04:01.978782] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-09-16T19:04:02.134100] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-16T19:04:02.262970] [INFO ] [REMOTE ] K: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:04:02.266265] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-16T19:04:02.774995] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-09-16T19:04:03.575016] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-09-16T19:04:04.325258] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-09-16T19:04:04.375243] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-09-16T19:04:04.375160] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-16T19:04:05.174918] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-09-16T19:04:05.384151] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-16T19:04:05.429912] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-16T19:04:05.974913] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-09-16T19:04:06.774947] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-09-16T19:04:07.567568] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-16T19:04:07.577480] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-09-16T19:04:07.672266] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-09-16T19:04:08.381617] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-09-16T19:04:08.403849] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-16T19:04:08.423384] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-16T19:04:09.174943] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-09-16T19:04:09.965921] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-16T19:04:09.967724] [INFO ] [REMOTE ] JRS: Full fetch complete (11955 records). [2025-09-16T19:04:09.967839] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-09-16T19:04:09.980791] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-09-16T19:04:10.334376] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-09-16T19:04:10.334471] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-09-16T19:04:10.334780] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-09-16T19:04:10.334838] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-09-16T19:04:10.335315] [DEBUG] [LOCAL ] JRS: Trimmed 11955 records to 8343 (keeping 150 days of data) [2025-09-16T19:04:10.385651] [DEBUG] [LOCAL ] JRS: Primary data saved (8343 records). [2025-09-16T19:04:10.385796] [INFO ] [MAIN ] JRS: Full history saved. [2025-09-16T19:04:10.385944] [INFO ] [MAIN ] Update Progress: 1171/2369 symbols completed. JRS took 18.6s. Estimated remaining: 2h 6m 59s. Rate: 9.4 symbols/min [2025-09-16T19:04:10.557862] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:04:10.569635] [DEBUG] [LOCAL ] KAI: Loaded 9742 existing records from primary storage. [2025-09-16T19:04:10.569779] [INFO ] [MAIN ] KAI: Loaded 9742 existing records. [2025-09-16T19:04:10.752857] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:04:10.753162] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-09-16T19:04:10.753215] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-09-16T19:04:10.753630] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-09-16T19:04:10.753732] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-09-16T19:04:10.776620] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-09-16T19:04:10.962872] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (2.58 seconds). [2025-09-16T19:04:11.177960] [INFO ] [REMOTE ] KAI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:04:11.574933] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-09-16T19:04:11.794542] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-16T19:04:12.374914] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-09-16T19:04:12.449256] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-16T19:04:12.519762] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-16T19:04:13.174914] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-09-16T19:04:13.974880] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-09-16T19:04:14.053452] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-16T19:04:14.774913] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-09-16T19:04:14.989620] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-16T19:04:15.317790] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-16T19:04:15.324426] [INFO ] [REMOTE ] JPM: Full fetch complete (58474 records). [2025-09-16T19:04:15.324570] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-09-16T19:04:15.580008] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-09-16T19:04:15.705746] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-09-16T19:04:15.705827] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-09-16T19:04:15.706605] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-09-16T19:04:15.706665] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-09-16T19:04:15.708023] [DEBUG] [LOCAL ] JPM: Trimmed 58474 records to 40144 (keeping 150 days of data) [2025-09-16T19:04:15.972556] [DEBUG] [LOCAL ] JPM: Primary data saved (40144 records). [2025-09-16T19:04:15.972728] [INFO ] [MAIN ] JPM: Full history saved. [2025-09-16T19:04:15.972863] [INFO ] [MAIN ] Update Progress: 1172/2369 symbols completed. JPM took 47.7s. Estimated remaining: 2h 6m 52s. Rate: 9.4 symbols/min [2025-09-16T19:04:16.156052] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:04:16.188122] [DEBUG] [LOCAL ] KAR: Loaded 29474 existing records from primary storage. [2025-09-16T19:04:16.188268] [INFO ] [MAIN ] KAR: Loaded 29474 existing records. [2025-09-16T19:04:16.372749] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:04:16.373066] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-09-16T19:04:16.373127] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-09-16T19:04:16.373743] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-09-16T19:04:16.373792] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-09-16T19:04:16.379395] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-09-16T19:04:16.735161] [INFO ] [REMOTE ] KAR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:04:16.747636] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-16T19:04:16.779569] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-16T19:04:17.174908] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-09-16T19:04:17.974901] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-09-16T19:04:18.147500] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-16T19:04:18.623734] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-16T19:04:18.774912] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-09-16T19:04:18.916943] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-16T19:04:19.574913] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-09-16T19:04:20.381920] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-09-16T19:04:20.387319] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-16T19:04:21.138067] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-16T19:04:21.174871] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-09-16T19:04:21.327033] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-16T19:04:21.974926] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-09-16T19:04:22.492940] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-16T19:04:22.774901] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-09-16T19:04:23.245505] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-16T19:04:23.250897] [INFO ] [REMOTE ] JXN: Full fetch complete (50175 records). [2025-09-16T19:04:23.251042] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-09-16T19:04:23.580023] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-09-16T19:04:23.649482] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-09-16T19:04:23.649569] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-09-16T19:04:23.650386] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-09-16T19:04:23.650435] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-09-16T19:04:23.652515] [DEBUG] [LOCAL ] JXN: Trimmed 50175 records to 33286 (keeping 150 days of data) [2025-09-16T19:04:23.868144] [DEBUG] [LOCAL ] JXN: Primary data saved (33286 records). [2025-09-16T19:04:23.868303] [INFO ] [MAIN ] JXN: Full history saved. [2025-09-16T19:04:23.869511] [INFO ] [MAIN ] Update Progress: 1173/2369 symbols completed. JXN took 25.3s. Estimated remaining: 2h 6m 47s. Rate: 9.4 symbols/min [2025-09-16T19:04:24.040990] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:04:24.064804] [DEBUG] [LOCAL ] KB: Loaded 17840 existing records from primary storage. [2025-09-16T19:04:24.064956] [INFO ] [MAIN ] KB: Loaded 17840 existing records. [2025-09-16T19:04:24.244191] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:04:24.244493] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-09-16T19:04:24.244541] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-09-16T19:04:24.245169] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-09-16T19:04:24.245219] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-09-16T19:04:24.391690] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-09-16T19:04:24.458049] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-16T19:04:24.641115] [INFO ] [REMOTE ] KB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:04:24.681502] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-16T19:04:25.174953] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-09-16T19:04:25.963086] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-16T19:04:25.975109] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-09-16T19:04:26.013058] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-16T19:04:26.774987] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-09-16T19:04:27.528294] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-16T19:04:27.574853] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-09-16T19:04:27.637464] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-16T19:04:28.374906] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-09-16T19:04:28.956236] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-16T19:04:29.174946] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-09-16T19:04:29.974964] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-09-16T19:04:30.069011] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-16T19:04:30.070831] [INFO ] [REMOTE ] KAI: Full fetch complete (15399 records). [2025-09-16T19:04:30.070909] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-09-16T19:04:30.453432] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-09-16T19:04:30.453543] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-09-16T19:04:30.453988] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-09-16T19:04:30.454116] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-09-16T19:04:30.454597] [DEBUG] [LOCAL ] KAI: Trimmed 15399 records to 9846 (keeping 150 days of data) [2025-09-16T19:04:30.530268] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-16T19:04:30.553903] [DEBUG] [LOCAL ] KAI: Primary data saved (9846 records). [2025-09-16T19:04:30.554033] [INFO ] [MAIN ] KAI: Full history saved. [2025-09-16T19:04:30.554113] [INFO ] [MAIN ] Update Progress: 1174/2369 symbols completed. KAI took 20.2s. Estimated remaining: 2h 6m 41s. Rate: 9.4 symbols/min [2025-09-16T19:04:30.722740] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:04:30.738111] [DEBUG] [LOCAL ] KBDC: Loaded 14554 existing records from primary storage. [2025-09-16T19:04:30.738273] [INFO ] [MAIN ] KBDC: Loaded 14554 existing records. [2025-09-16T19:04:30.781406] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-09-16T19:04:30.922134] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:04:30.922385] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-09-16T19:04:30.922438] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-09-16T19:04:30.922882] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-09-16T19:04:30.922930] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-09-16T19:04:31.277277] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:04:31.295041] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-16T19:04:31.574929] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-09-16T19:04:32.386044] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-09-16T19:04:32.392372] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-16T19:04:32.746879] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-16T19:04:33.174905] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-09-16T19:04:33.979873] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-09-16T19:04:33.991228] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-16T19:04:33.998489] [INFO ] [REMOTE ] K: Full fetch complete (53997 records). [2025-09-16T19:04:33.998659] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-09-16T19:04:34.397127] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-09-16T19:04:34.397325] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-09-16T19:04:34.398186] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-09-16T19:04:34.398254] [DEBUG] [LOCAL ] K: Saving primary data. [2025-09-16T19:04:34.399832] [DEBUG] [LOCAL ] K: Trimmed 53997 records to 37359 (keeping 150 days of data) [2025-09-16T19:04:34.515082] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-16T19:04:34.672783] [DEBUG] [LOCAL ] K: Primary data saved (37359 records). [2025-09-16T19:04:34.672972] [INFO ] [MAIN ] K: Full history saved. [2025-09-16T19:04:34.673091] [INFO ] [MAIN ] Update Progress: 1175/2369 symbols completed. K took 33.2s. Estimated remaining: 2h 6m 32s. Rate: 9.4 symbols/min [2025-09-16T19:04:34.780100] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-09-16T19:04:34.850390] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:04:34.887829] [DEBUG] [LOCAL ] KBH: Loaded 35669 existing records from primary storage. [2025-09-16T19:04:34.888022] [INFO ] [MAIN ] KBH: Loaded 35669 existing records. [2025-09-16T19:04:35.088245] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-16T19:04:35.088423] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:04:35.092965] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-09-16T19:04:35.093032] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-09-16T19:04:35.093944] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-09-16T19:04:35.094007] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-09-16T19:04:35.442961] [INFO ] [REMOTE ] KBH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:04:35.574898] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-09-16T19:04:36.281299] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-16T19:04:36.374920] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-09-16T19:04:37.174926] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-09-16T19:04:37.223072] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-16T19:04:37.451877] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-16T19:04:37.974941] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-09-16T19:04:38.330748] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-16T19:04:38.336592] [INFO ] [REMOTE ] KAR: Full fetch complete (43743 records). [2025-09-16T19:04:38.336802] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-09-16T19:04:38.742139] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-09-16T19:04:38.742237] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-09-16T19:04:38.743006] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-09-16T19:04:38.743069] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-09-16T19:04:38.744551] [DEBUG] [LOCAL ] KAR: Trimmed 43743 records to 29727 (keeping 150 days of data) [2025-09-16T19:04:38.800138] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-09-16T19:04:38.948037] [DEBUG] [LOCAL ] KAR: Primary data saved (29727 records). [2025-09-16T19:04:38.948199] [INFO ] [MAIN ] KAR: Full history saved. [2025-09-16T19:04:38.948295] [INFO ] [MAIN ] Update Progress: 1176/2369 symbols completed. KAR took 23.0s. Estimated remaining: 2h 6m 24s. Rate: 9.4 symbols/min [2025-09-16T19:04:39.121280] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:04:39.136219] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-16T19:04:39.172097] [DEBUG] [LOCAL ] KBR: Loaded 35623 existing records from primary storage. [2025-09-16T19:04:39.172244] [INFO ] [MAIN ] KBR: Loaded 35623 existing records. [2025-09-16T19:04:39.348607] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:04:39.348862] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-09-16T19:04:39.348909] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-09-16T19:04:39.349676] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-09-16T19:04:39.349725] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-09-16T19:04:39.580040] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-09-16T19:04:39.706308] [INFO ] [REMOTE ] KBR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:04:40.374938] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-09-16T19:04:40.536757] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-16T19:04:40.894369] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-16T19:04:41.174901] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-09-16T19:04:41.800081] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-16T19:04:41.974936] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-09-16T19:04:42.774898] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-09-16T19:04:42.940724] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-16T19:04:43.574880] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-09-16T19:04:43.693925] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-16T19:04:43.882322] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-16T19:04:44.374975] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-09-16T19:04:44.964734] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-16T19:04:44.985529] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-16T19:04:45.174859] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-09-16T19:04:45.974917] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-09-16T19:04:46.774902] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-09-16T19:04:46.876536] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-16T19:04:47.059070] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-16T19:04:47.574967] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-09-16T19:04:47.711780] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-16T19:04:48.374927] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-09-16T19:04:49.174935] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-09-16T19:04:49.347520] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-16T19:04:49.396960] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-16T19:04:49.974922] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-09-16T19:04:50.774924] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-09-16T19:04:50.962892] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-16T19:04:51.574905] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-09-16T19:04:51.633223] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-16T19:04:51.692346] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-16T19:04:51.696309] [INFO ] [REMOTE ] KBDC: Full fetch complete (22097 records). [2025-09-16T19:04:51.696389] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-09-16T19:04:52.072700] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-09-16T19:04:52.072814] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-09-16T19:04:52.073266] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-09-16T19:04:52.073306] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-09-16T19:04:52.073901] [DEBUG] [LOCAL ] KBDC: Trimmed 22097 records to 14804 (keeping 150 days of data) [2025-09-16T19:04:52.166275] [DEBUG] [LOCAL ] KBDC: Primary data saved (14804 records). [2025-09-16T19:04:52.166435] [INFO ] [MAIN ] KBDC: Full history saved. [2025-09-16T19:04:52.166593] [INFO ] [MAIN ] Update Progress: 1177/2369 symbols completed. KBDC took 21.6s. Estimated remaining: 2h 6m 25s. Rate: 9.4 symbols/min [2025-09-16T19:04:52.340333] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:04:52.378829] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-09-16T19:04:52.380564] [DEBUG] [LOCAL ] KD: Loaded 38505 existing records from primary storage. [2025-09-16T19:04:52.380733] [INFO ] [MAIN ] KD: Loaded 38505 existing records. [2025-09-16T19:04:52.561386] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:04:52.561660] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-09-16T19:04:52.561710] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-09-16T19:04:52.562496] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-09-16T19:04:52.562542] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-09-16T19:04:52.942295] [INFO ] [REMOTE ] KD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:04:52.944442] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-16T19:04:53.174954] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-09-16T19:04:53.843632] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-16T19:04:53.850026] [INFO ] [REMOTE ] KBH: Full fetch complete (53033 records). [2025-09-16T19:04:53.850159] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-09-16T19:04:53.979973] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-09-16T19:04:54.231035] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-09-16T19:04:54.231112] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-09-16T19:04:54.231868] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-09-16T19:04:54.231913] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-09-16T19:04:54.232943] [DEBUG] [LOCAL ] KBH: Trimmed 53033 records to 36047 (keeping 150 days of data) [2025-09-16T19:04:54.450030] [DEBUG] [LOCAL ] KBH: Primary data saved (36047 records). [2025-09-16T19:04:54.450171] [INFO ] [MAIN ] KBH: Full history saved. [2025-09-16T19:04:54.450269] [INFO ] [MAIN ] Update Progress: 1178/2369 symbols completed. KBH took 19.8s. Estimated remaining: 2h 6m 14s. Rate: 9.4 symbols/min [2025-09-16T19:04:54.627069] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:04:54.632231] [DEBUG] [LOCAL ] KEN: Loaded 3286 existing records from primary storage. [2025-09-16T19:04:54.632312] [INFO ] [MAIN ] KEN: Loaded 3286 existing records. [2025-09-16T19:04:54.811573] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:04:54.783343] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-09-16T19:04:54.813309] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-09-16T19:04:54.813389] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-09-16T19:04:54.813670] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-09-16T19:04:54.813721] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-09-16T19:04:55.238396] [INFO ] [REMOTE ] KEN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:04:55.241557] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-16T19:04:55.257724] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-16T19:04:55.260908] [INFO ] [REMOTE ] KB: Full fetch complete (26755 records). [2025-09-16T19:04:55.260988] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-09-16T19:04:55.584560] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-09-16T19:04:55.627370] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-09-16T19:04:55.627453] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-09-16T19:04:55.628032] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-09-16T19:04:55.628076] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-09-16T19:04:55.628756] [DEBUG] [LOCAL ] KB: Trimmed 26755 records to 17934 (keeping 150 days of data) [2025-09-16T19:04:55.740256] [DEBUG] [LOCAL ] KB: Primary data saved (17934 records). [2025-09-16T19:04:55.740419] [INFO ] [MAIN ] KB: Full history saved. [2025-09-16T19:04:55.740519] [INFO ] [MAIN ] Update Progress: 1179/2369 symbols completed. KB took 31.9s. Estimated remaining: 2h 6m 3s. Rate: 9.4 symbols/min [2025-09-16T19:04:55.910934] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:04:55.934975] [DEBUG] [LOCAL ] KEP: Loaded 24216 existing records from primary storage. [2025-09-16T19:04:55.935126] [INFO ] [MAIN ] KEP: Loaded 24216 existing records. [2025-09-16T19:04:56.042107] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-16T19:04:56.125779] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:04:56.126556] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-09-16T19:04:56.126608] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-09-16T19:04:56.127572] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-09-16T19:04:56.127632] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-09-16T19:04:56.380924] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-09-16T19:04:56.527526] [INFO ] [REMOTE ] KEP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:04:56.570425] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-16T19:04:57.098022] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-16T19:04:57.174976] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-09-16T19:04:57.927335] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-16T19:04:57.974884] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-09-16T19:04:58.774924] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-09-16T19:04:59.574873] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-09-16T19:04:59.745216] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-16T19:04:59.860058] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-16T19:05:00.164091] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-16T19:05:00.374930] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-09-16T19:05:01.174903] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-09-16T19:05:01.682283] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-16T19:05:01.974920] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-09-16T19:05:02.757898] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-16T19:05:02.774841] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-09-16T19:05:03.383243] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-16T19:05:03.502657] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-16T19:05:03.574904] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-09-16T19:05:04.374905] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-09-16T19:05:05.082185] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-16T19:05:05.174946] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-09-16T19:05:05.966586] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-16T19:05:05.984530] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-09-16T19:05:06.006384] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-16T19:05:06.585432] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-16T19:05:06.586493] [INFO ] [REMOTE ] KEN: Full fetch complete (4877 records). [2025-09-16T19:05:06.586579] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-09-16T19:05:06.779998] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-09-16T19:05:06.967906] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-09-16T19:05:06.968004] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-09-16T19:05:06.968180] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-09-16T19:05:06.968222] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-09-16T19:05:06.968629] [DEBUG] [LOCAL ] KEN: Trimmed 4877 records to 3309 (keeping 150 days of data) [2025-09-16T19:05:06.989543] [DEBUG] [LOCAL ] KEN: Primary data saved (3309 records). [2025-09-16T19:05:06.989695] [INFO ] [MAIN ] KEN: Full history saved. [2025-09-16T19:05:06.989807] [INFO ] [MAIN ] Update Progress: 1180/2369 symbols completed. KEN took 12.5s. Estimated remaining: 2h 6m 1s. Rate: 9.4 symbols/min [2025-09-16T19:05:07.167385] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:05:07.195876] [DEBUG] [LOCAL ] KEX: Loaded 27514 existing records from primary storage. [2025-09-16T19:05:07.196013] [INFO ] [MAIN ] KEX: Loaded 27514 existing records. [2025-09-16T19:05:07.378137] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:05:07.378431] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-09-16T19:05:07.378485] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-09-16T19:05:07.379106] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-09-16T19:05:07.379153] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-09-16T19:05:07.580085] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-09-16T19:05:07.742005] [INFO ] [REMOTE ] KEX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:05:08.008378] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-16T19:05:08.374896] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-09-16T19:05:09.174993] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-09-16T19:05:09.482526] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-16T19:05:09.829687] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-16T19:05:09.974939] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-09-16T19:05:10.774904] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-09-16T19:05:10.999042] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-16T19:05:11.454481] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-16T19:05:11.574874] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-09-16T19:05:12.374898] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-09-16T19:05:13.174906] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-09-16T19:05:13.916531] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-16T19:05:13.974863] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-09-16T19:05:15.343385] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-16T19:05:15.350666] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-09-16T19:05:16.599045] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-16T19:05:16.604387] [INFO ] [REMOTE ] KEP: Full fetch complete (32063 records). [2025-09-16T19:05:16.604543] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-09-16T19:05:17.017342] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-09-16T19:05:17.017427] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-09-16T19:05:17.018043] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-09-16T19:05:17.018104] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-09-16T19:05:17.018957] [DEBUG] [LOCAL ] KEP: Trimmed 32063 records to 24401 (keeping 150 days of data) [2025-09-16T19:05:17.164222] [DEBUG] [LOCAL ] KEP: Primary data saved (24401 records). [2025-09-16T19:05:17.164353] [INFO ] [MAIN ] KEP: Full history saved. [2025-09-16T19:05:17.164436] [INFO ] [MAIN ] Update Progress: 1181/2369 symbols completed. KEP took 21.4s. Estimated remaining: 2h 5m 59s. Rate: 9.4 symbols/min [2025-09-16T19:05:17.340295] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:05:17.340504] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-09-16T19:05:17.340542] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-09-16T19:05:17.340684] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-09-16T19:05:17.340725] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-16T19:05:17.340766] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-09-16T19:05:17.340798] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-09-16T19:05:17.697812] [INFO ] [REMOTE ] KEY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:05:17.698142] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-09-16T19:05:19.482396] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-16T19:05:19.492746] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-09-16T19:05:21.329933] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-16T19:05:21.341678] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-09-16T19:05:23.365034] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-16T19:05:23.377737] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-09-16T19:05:25.247024] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-16T19:05:25.258887] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-09-16T19:05:53.274250] [DEBUG] [REMOTE ] KEX: Error fetching primary data for 2025-02: ("Connection broken: InvalidChunkLength(got length b'', 0 bytes read)", InvalidChunkLength(got length b'', 0 bytes read)) [2025-09-16T19:05:53.274447] [WARN ] [REMOTE ] KEX: No data returned for month 2025-02 [2025-09-16T19:05:53.275170] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-09-16T19:05:54.748964] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-16T19:05:54.757496] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-09-16T19:05:54.802246] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (29.54 seconds). [2025-09-16T19:05:54.814883] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-09-16T19:05:54.874921] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (43.30 seconds). [2025-09-16T19:05:54.887855] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-09-16T19:05:54.978170] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (41.80 seconds). [2025-09-16T19:05:54.989666] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-09-16T19:05:56.031893] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-16T19:05:56.040127] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-09-16T19:05:56.301721] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-16T19:05:56.307829] [INFO ] [REMOTE ] KBR: Full fetch complete (52832 records). [2025-09-16T19:05:56.307974] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-09-16T19:05:56.677947] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-16T19:05:56.755686] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-09-16T19:05:56.756048] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-09-16T19:05:56.755784] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-09-16T19:05:56.757841] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-09-16T19:05:56.758023] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-09-16T19:05:56.759513] [DEBUG] [LOCAL ] KBR: Trimmed 52832 records to 35949 (keeping 150 days of data) [2025-09-16T19:05:56.999766] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-16T19:05:57.021246] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-09-16T19:05:57.038197] [DEBUG] [LOCAL ] KBR: Primary data saved (35949 records). [2025-09-16T19:05:57.038306] [INFO ] [MAIN ] KBR: Full history saved. [2025-09-16T19:05:57.038411] [INFO ] [MAIN ] Update Progress: 1182/2369 symbols completed. KBR took 1m 18s. Estimated remaining: 2h 6m 26s. Rate: 9.4 symbols/min [2025-09-16T19:05:57.215147] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:05:57.249623] [DEBUG] [LOCAL ] KEYS: Loaded 31401 existing records from primary storage. [2025-09-16T19:05:57.249809] [INFO ] [MAIN ] KEYS: Loaded 31401 existing records. [2025-09-16T19:05:57.432553] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:05:57.433375] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-09-16T19:05:57.433565] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-09-16T19:05:57.434603] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-09-16T19:05:57.434703] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-09-16T19:05:57.719879] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-16T19:05:57.769320] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-09-16T19:05:57.848834] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:05:57.849208] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-09-16T19:05:58.682944] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-16T19:05:58.710900] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-16T19:05:58.717624] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-09-16T19:05:58.719023] [INFO ] [REMOTE ] KD: Full fetch complete (56903 records). [2025-09-16T19:05:58.719125] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-09-16T19:05:59.107589] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-09-16T19:05:59.107948] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-09-16T19:05:59.108870] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-09-16T19:05:59.108954] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-09-16T19:05:59.110304] [DEBUG] [LOCAL ] KD: Trimmed 56903 records to 38888 (keeping 150 days of data) [2025-09-16T19:05:59.336177] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-16T19:05:59.362843] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-09-16T19:05:59.372191] [DEBUG] [LOCAL ] KD: Primary data saved (38888 records). [2025-09-16T19:05:59.372348] [INFO ] [MAIN ] KD: Full history saved. [2025-09-16T19:05:59.372440] [INFO ] [MAIN ] Update Progress: 1183/2369 symbols completed. KD took 1m 7s. Estimated remaining: 2h 6m 15s. Rate: 9.4 symbols/min [2025-09-16T19:05:59.542756] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:05:59.546529] [DEBUG] [LOCAL ] KF: Loaded 1744 existing records from primary storage. [2025-09-16T19:05:59.546665] [INFO ] [MAIN ] KF: Loaded 1744 existing records. [2025-09-16T19:05:59.712571] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-16T19:05:59.754993] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-09-16T19:05:59.759313] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:05:59.760551] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-09-16T19:05:59.760603] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-09-16T19:05:59.760798] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-09-16T19:05:59.760845] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-09-16T19:06:00.119637] [INFO ] [REMOTE ] KF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:06:00.120124] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-09-16T19:06:00.166126] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-16T19:06:00.172362] [INFO ] [REMOTE ] KEY: Full fetch complete (57927 records). [2025-09-16T19:06:00.172522] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-09-16T19:06:00.372339] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-16T19:06:00.372957] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-09-16T19:06:00.373012] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-09-16T19:06:00.373059] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-16T19:06:00.373122] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-09-16T19:06:00.373181] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-09-16T19:06:00.373242] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-09-16T19:06:00.373316] [INFO ] [MAIN ] Update Progress: 1184/2369 symbols completed. KEY took 43.2s. Estimated remaining: 2h 6m 4s. Rate: 9.4 symbols/min [2025-09-16T19:06:00.545543] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:06:00.560799] [DEBUG] [LOCAL ] KFRC: Loaded 14809 existing records from primary storage. [2025-09-16T19:06:00.560922] [INFO ] [MAIN ] KFRC: Loaded 14809 existing records. [2025-09-16T19:06:00.745627] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:06:00.746091] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-09-16T19:06:00.746187] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-09-16T19:06:00.746989] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-09-16T19:06:00.747091] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-09-16T19:06:00.786282] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-16T19:06:00.821311] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-09-16T19:06:01.003750] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-16T19:06:01.078512] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-09-16T19:06:01.153929] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:06:01.154333] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-09-16T19:06:01.467226] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-16T19:06:01.468756] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-09-16T19:06:01.627124] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-16T19:06:01.636555] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-09-16T19:06:01.956464] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-16T19:06:01.957868] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-09-16T19:06:02.085114] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-16T19:06:02.088504] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-09-16T19:06:02.552712] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-16T19:06:02.554205] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-09-16T19:06:02.669471] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-16T19:06:02.678402] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-09-16T19:06:02.756603] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-16T19:06:02.760363] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-09-16T19:06:03.117409] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-16T19:06:03.127509] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-09-16T19:06:03.193230] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-16T19:06:03.194847] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-09-16T19:06:03.720507] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-16T19:06:03.721570] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-09-16T19:06:03.739030] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-16T19:06:03.743507] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-09-16T19:06:04.019238] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-16T19:06:04.024909] [INFO ] [REMOTE ] KEX: Full fetch complete (37388 records). [2025-09-16T19:06:04.025026] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-09-16T19:06:04.110932] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-16T19:06:04.146747] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-09-16T19:06:04.239406] [WARN ] [VALIDATOR ] KEX: Validation failed - insufficient historical data. Have 137 unique days, need 150 days [2025-09-16T19:06:04.239851] [FATAL] [MAIN ] KEX: Fetched primary data is invalid. Refusing to save it. [2025-09-16T19:06:04.239909] [WARN ] [MAIN ] KEX: Deleting existing primary and derivative data due to validation failure. [2025-09-16T19:06:04.239962] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-09-16T19:06:04.240021] [DEBUG] [LOCAL ] KEX: No primary data file found to delete. [2025-09-16T19:06:04.240057] [INFO ] [LOCAL ] KEX: Starting deletion of derivative data. [2025-09-16T19:06:04.240449] [DEBUG] [LOCAL ] KEX: Deleted derivative data file. [2025-09-16T19:06:04.240561] [INFO ] [MAIN ] Update Progress: 1185/2369 symbols completed. KEX took 57.3s. Estimated remaining: 2h 5m 55s. Rate: 9.4 symbols/min [2025-09-16T19:06:04.417046] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:06:04.448253] [DEBUG] [LOCAL ] KFS: Loaded 6290 existing records from primary storage. [2025-09-16T19:06:04.448396] [INFO ] [MAIN ] KFS: Loaded 6290 existing records. [2025-09-16T19:06:04.510470] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-16T19:06:04.573624] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-09-16T19:06:04.627410] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-16T19:06:04.652476] [INFO ] [REMOTE ] KF: Full fetch complete (2690 records). [2025-09-16T19:06:04.655856] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:06:04.655998] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-09-16T19:06:04.667927] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-09-16T19:06:04.701214] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-09-16T19:06:04.751076] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-09-16T19:06:04.758605] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-09-16T19:06:05.124569] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-16T19:06:05.255592] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-09-16T19:06:05.288377] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-09-16T19:06:05.338807] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-09-16T19:06:05.353092] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-09-16T19:06:05.386566] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-09-16T19:06:05.417146] [DEBUG] [LOCAL ] KF: Trimmed 2690 records to 1755 (keeping 150 days of data) [2025-09-16T19:06:05.420447] [INFO ] [REMOTE ] KFS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:06:05.421130] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-09-16T19:06:05.432430] [DEBUG] [LOCAL ] KF: Primary data saved (1755 records). [2025-09-16T19:06:05.432514] [INFO ] [MAIN ] KF: Full history saved. [2025-09-16T19:06:05.432614] [INFO ] [MAIN ] Update Progress: 1186/2369 symbols completed. KF took 6.1s. Estimated remaining: 2h 5m 43s. Rate: 9.4 symbols/min [2025-09-16T19:06:05.604770] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:06:05.626803] [DEBUG] [LOCAL ] KFY: Loaded 21543 existing records from primary storage. [2025-09-16T19:06:05.626976] [INFO ] [MAIN ] KFY: Loaded 21543 existing records. [2025-09-16T19:06:05.810206] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:06:05.810465] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-09-16T19:06:05.810514] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-09-16T19:06:05.811150] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-09-16T19:06:05.811202] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-09-16T19:06:06.111882] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-16T19:06:06.114091] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-09-16T19:06:06.194843] [INFO ] [REMOTE ] KFY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:06:06.195516] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-09-16T19:06:06.225810] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-16T19:06:06.237725] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-09-16T19:06:06.279594] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-16T19:06:06.283889] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-09-16T19:06:06.933035] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-16T19:06:06.934974] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-09-16T19:06:07.438024] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-16T19:06:07.446402] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-09-16T19:06:07.472726] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-16T19:06:07.477909] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-09-16T19:06:07.746014] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-16T19:06:07.748273] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-09-16T19:06:07.884680] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-16T19:06:07.894270] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-09-16T19:06:08.565014] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-16T19:06:08.568765] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-09-16T19:06:08.679878] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-16T19:06:08.686935] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-09-16T19:06:08.918472] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-16T19:06:08.927502] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-09-16T19:06:09.479710] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-16T19:06:09.482999] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-09-16T19:06:09.513441] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-16T19:06:09.524179] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-09-16T19:06:09.822314] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-16T19:06:09.825504] [INFO ] [REMOTE ] KFRC: Full fetch complete (20233 records). [2025-09-16T19:06:09.825599] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-09-16T19:06:10.238148] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-09-16T19:06:10.238244] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-09-16T19:06:10.238750] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-09-16T19:06:10.238806] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-09-16T19:06:10.240535] [DEBUG] [LOCAL ] KFRC: Trimmed 20233 records to 14991 (keeping 150 days of data) [2025-09-16T19:06:10.318799] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-16T19:06:10.323557] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-09-16T19:06:10.352233] [DEBUG] [LOCAL ] KFRC: Primary data saved (14991 records). [2025-09-16T19:06:10.352342] [INFO ] [MAIN ] KFRC: Full history saved. [2025-09-16T19:06:10.352435] [INFO ] [MAIN ] Update Progress: 1187/2369 symbols completed. KFRC took 10.0s. Estimated remaining: 2h 5m 35s. Rate: 9.4 symbols/min [2025-09-16T19:06:10.538663] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:06:10.542203] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-16T19:06:10.550107] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-09-16T19:06:10.595402] [DEBUG] [LOCAL ] KGC: Loaded 39660 existing records from primary storage. [2025-09-16T19:06:10.595547] [INFO ] [MAIN ] KGC: Loaded 39660 existing records. [2025-09-16T19:06:10.774550] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:06:10.774794] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-09-16T19:06:10.774842] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-09-16T19:06:10.775616] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-09-16T19:06:10.775685] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-09-16T19:06:11.126981] [INFO ] [REMOTE ] KGC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:06:11.127316] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-09-16T19:06:11.142750] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-16T19:06:11.154367] [INFO ] [REMOTE ] KEYS: Full fetch complete (47480 records). [2025-09-16T19:06:11.155116] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-16T19:06:11.155178] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-09-16T19:06:11.157899] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-09-16T19:06:11.561054] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-09-16T19:06:11.561164] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-09-16T19:06:11.561888] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-09-16T19:06:11.561932] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-09-16T19:06:11.563033] [DEBUG] [LOCAL ] KEYS: Trimmed 47480 records to 31718 (keeping 150 days of data) [2025-09-16T19:06:11.706054] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-16T19:06:11.713958] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-09-16T19:06:11.798346] [DEBUG] [LOCAL ] KEYS: Primary data saved (31718 records). [2025-09-16T19:06:11.798506] [INFO ] [MAIN ] KEYS: Full history saved. [2025-09-16T19:06:11.798603] [INFO ] [MAIN ] Update Progress: 1188/2369 symbols completed. KEYS took 14.8s. Estimated remaining: 2h 5m 24s. Rate: 9.4 symbols/min [2025-09-16T19:06:11.971245] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:06:12.006699] [DEBUG] [LOCAL ] KGS: Loaded 33588 existing records from primary storage. [2025-09-16T19:06:12.006843] [INFO ] [MAIN ] KGS: Loaded 33588 existing records. [2025-09-16T19:06:12.123669] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-16T19:06:12.154484] [INFO ] [REMOTE ] KFS: Full fetch complete (8397 records). [2025-09-16T19:06:12.187751] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-09-16T19:06:12.190987] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:06:12.191310] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-09-16T19:06:12.260409] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-09-16T19:06:12.291972] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-09-16T19:06:12.292091] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-09-16T19:06:12.898991] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-09-16T19:06:12.929721] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-09-16T19:06:12.937359] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-09-16T19:06:12.942661] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-09-16T19:06:12.973891] [INFO ] [REMOTE ] KGS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:06:12.974948] [DEBUG] [LOCAL ] KFS: Trimmed 8397 records to 6350 (keeping 150 days of data) [2025-09-16T19:06:12.975438] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-09-16T19:06:13.037598] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-16T19:06:13.053197] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-09-16T19:06:13.053394] [DEBUG] [LOCAL ] KFS: Primary data saved (6350 records). [2025-09-16T19:06:13.054750] [INFO ] [MAIN ] KFS: Full history saved. [2025-09-16T19:06:13.054990] [INFO ] [MAIN ] Update Progress: 1189/2369 symbols completed. KFS took 8.8s. Estimated remaining: 2h 5m 13s. Rate: 9.4 symbols/min [2025-09-16T19:06:13.209672] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-16T19:06:13.257111] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-09-16T19:06:13.283409] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:06:13.329960] [DEBUG] [LOCAL ] KIM: Loaded 39124 existing records from primary storage. [2025-09-16T19:06:13.330133] [INFO ] [MAIN ] KIM: Loaded 39124 existing records. [2025-09-16T19:06:13.505259] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:06:13.505538] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-09-16T19:06:13.505633] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-09-16T19:06:13.506529] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-09-16T19:06:13.506577] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-09-16T19:06:13.859037] [INFO ] [REMOTE ] KIM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:06:13.859416] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-09-16T19:06:14.402505] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-16T19:06:14.409779] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-09-16T19:06:14.460083] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-16T19:06:14.472837] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-09-16T19:06:14.992842] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-16T19:06:15.004562] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-09-16T19:06:15.423228] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-16T19:06:15.433491] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-09-16T19:06:15.503065] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-16T19:06:15.508799] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-09-16T19:06:15.817174] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-16T19:06:15.827075] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-09-16T19:06:16.822536] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-16T19:06:16.834239] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-09-16T19:06:17.052237] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-16T19:06:17.061813] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-09-16T19:06:17.174066] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-16T19:06:17.178483] [INFO ] [REMOTE ] KFY: Full fetch complete (33285 records). [2025-09-16T19:06:17.178579] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-09-16T19:06:17.557206] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-09-16T19:06:17.557357] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-09-16T19:06:17.558010] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-09-16T19:06:17.558066] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-09-16T19:06:17.559018] [DEBUG] [LOCAL ] KFY: Trimmed 33285 records to 21739 (keeping 150 days of data) [2025-09-16T19:06:17.681938] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-09-16T19:06:17.697924] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-09-16T19:06:17.737798] [DEBUG] [LOCAL ] KFY: Primary data saved (21739 records). [2025-09-16T19:06:17.737959] [INFO ] [MAIN ] KFY: Full history saved. [2025-09-16T19:06:17.738072] [INFO ] [MAIN ] Update Progress: 1190/2369 symbols completed. KFY took 12.3s. Estimated remaining: 2h 5m 5s. Rate: 9.4 symbols/min [2025-09-16T19:06:17.910238] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:06:17.927578] [DEBUG] [LOCAL ] KIO: Loaded 15394 existing records from primary storage. [2025-09-16T19:06:17.927755] [INFO ] [MAIN ] KIO: Loaded 15394 existing records. [2025-09-16T19:06:18.107422] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:06:18.107725] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-09-16T19:06:18.107772] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-09-16T19:06:18.108350] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-09-16T19:06:18.108397] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-09-16T19:06:18.463245] [INFO ] [REMOTE ] KIO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:06:18.463578] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-09-16T19:06:18.497922] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-16T19:06:18.509077] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-09-16T19:06:18.627957] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-16T19:06:18.637505] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-09-16T19:06:19.130607] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-16T19:06:19.142176] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-09-16T19:06:19.307758] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-16T19:06:19.312970] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-09-16T19:06:20.153248] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-16T19:06:20.162363] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-09-16T19:06:20.375421] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-16T19:06:20.380672] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-09-16T19:06:20.446234] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-16T19:06:20.457258] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-09-16T19:06:21.000723] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-16T19:06:21.011994] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-09-16T19:06:21.302198] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-16T19:06:21.307282] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-09-16T19:06:21.820059] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-16T19:06:21.830381] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-09-16T19:06:22.230532] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-16T19:06:22.243635] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-09-16T19:06:22.342523] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-16T19:06:22.347385] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-09-16T19:06:22.524596] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-16T19:06:22.535687] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-09-16T19:06:23.083470] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-16T19:06:23.096841] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-09-16T19:06:23.315129] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-16T19:06:23.319335] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-09-16T19:06:24.019366] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-16T19:06:24.031336] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-09-16T19:06:24.061940] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-16T19:06:24.374927] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-09-16T19:06:24.469876] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-16T19:06:24.567677] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-16T19:06:24.576144] [INFO ] [REMOTE ] KGS: Full fetch complete (49610 records). [2025-09-16T19:06:24.576404] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-09-16T19:06:24.967012] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-09-16T19:06:24.967108] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-09-16T19:06:24.967877] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-09-16T19:06:24.967925] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-09-16T19:06:24.969144] [DEBUG] [LOCAL ] KGS: Trimmed 49610 records to 33944 (keeping 150 days of data) [2025-09-16T19:06:25.174877] [DEBUG] [LOCAL ] KGS: Primary data saved (33944 records). [2025-09-16T19:06:25.174983] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-09-16T19:06:25.175876] [INFO ] [MAIN ] KGS: Full history saved. [2025-09-16T19:06:25.175964] [INFO ] [MAIN ] Update Progress: 1191/2369 symbols completed. KGS took 13.4s. Estimated remaining: 2h 4m 59s. Rate: 9.4 symbols/min [2025-09-16T19:06:25.348273] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:06:25.387837] [DEBUG] [LOCAL ] KKR: Loaded 39486 existing records from primary storage. [2025-09-16T19:06:25.387997] [INFO ] [MAIN ] KKR: Loaded 39486 existing records. [2025-09-16T19:06:25.563267] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:06:25.563474] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-09-16T19:06:25.563519] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-09-16T19:06:25.564559] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-09-16T19:06:25.564610] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-09-16T19:06:25.923569] [INFO ] [REMOTE ] KKR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:06:25.957878] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-16T19:06:25.974845] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-09-16T19:06:26.242992] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-16T19:06:26.304143] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-16T19:06:26.310996] [INFO ] [REMOTE ] KGC: Full fetch complete (58377 records). [2025-09-16T19:06:26.311135] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-09-16T19:06:26.720051] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-09-16T19:06:26.720148] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-09-16T19:06:26.721054] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-09-16T19:06:26.721104] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-09-16T19:06:26.722459] [DEBUG] [LOCAL ] KGC: Trimmed 58377 records to 40050 (keeping 150 days of data) [2025-09-16T19:06:26.799787] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-09-16T19:06:27.005656] [DEBUG] [LOCAL ] KGC: Primary data saved (40050 records). [2025-09-16T19:06:27.005787] [INFO ] [MAIN ] KGC: Full history saved. [2025-09-16T19:06:27.007420] [INFO ] [MAIN ] Update Progress: 1192/2369 symbols completed. KGC took 16.7s. Estimated remaining: 2h 4m 48s. Rate: 9.4 symbols/min [2025-09-16T19:06:27.203925] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:06:27.213293] [DEBUG] [LOCAL ] KKRS: Loaded 4474 existing records from primary storage. [2025-09-16T19:06:27.213451] [INFO ] [MAIN ] KKRS: Loaded 4474 existing records. [2025-09-16T19:06:27.407584] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:06:27.408127] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-09-16T19:06:27.408583] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-09-16T19:06:27.409028] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-09-16T19:06:27.409081] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-09-16T19:06:27.579836] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-09-16T19:06:27.816910] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:06:27.835161] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-16T19:06:27.841663] [INFO ] [REMOTE ] KIM: Full fetch complete (57694 records). [2025-09-16T19:06:27.841787] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-09-16T19:06:28.234133] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-09-16T19:06:28.234237] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-09-16T19:06:28.235106] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-09-16T19:06:28.235170] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-09-16T19:06:28.236512] [DEBUG] [LOCAL ] KIM: Trimmed 57694 records to 39507 (keeping 150 days of data) [2025-09-16T19:06:28.425789] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-09-16T19:06:28.494128] [DEBUG] [LOCAL ] KIM: Primary data saved (39507 records). [2025-09-16T19:06:28.494391] [INFO ] [MAIN ] KIM: Full history saved. [2025-09-16T19:06:28.494540] [INFO ] [MAIN ] Update Progress: 1193/2369 symbols completed. KIM took 15.4s. Estimated remaining: 2h 4m 37s. Rate: 9.4 symbols/min [2025-09-16T19:06:28.671262] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:06:28.671545] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-09-16T19:06:28.671597] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-09-16T19:06:28.671849] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-09-16T19:06:28.671902] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-16T19:06:28.671951] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-09-16T19:06:28.671985] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-09-16T19:06:28.785765] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-16T19:06:28.835178] [INFO ] [REMOTE ] KIO: Full fetch complete (23428 records). [2025-09-16T19:06:28.879044] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-09-16T19:06:29.015780] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-09-16T19:06:29.116974] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-16T19:06:29.175719] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-09-16T19:06:29.314487] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:06:29.517799] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-09-16T19:06:29.517884] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-09-16T19:06:29.518367] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-09-16T19:06:29.518408] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-09-16T19:06:29.519133] [DEBUG] [LOCAL ] KIO: Trimmed 23428 records to 15558 (keeping 150 days of data) [2025-09-16T19:06:29.617294] [DEBUG] [LOCAL ] KIO: Primary data saved (15558 records). [2025-09-16T19:06:29.617445] [INFO ] [MAIN ] KIO: Full history saved. [2025-09-16T19:06:29.617532] [INFO ] [MAIN ] Update Progress: 1194/2369 symbols completed. KIO took 11.9s. Estimated remaining: 2h 4m 26s. Rate: 9.4 symbols/min [2025-09-16T19:06:29.793219] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:06:29.793444] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-09-16T19:06:29.793485] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-09-16T19:06:29.793604] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-09-16T19:06:29.793661] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-16T19:06:29.793706] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-09-16T19:06:29.793738] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-09-16T19:06:29.984352] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-09-16T19:06:30.157574] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:06:30.647208] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-16T19:06:30.774876] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-09-16T19:06:31.260036] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-16T19:06:31.276423] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-16T19:06:31.574902] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-09-16T19:06:32.337471] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-16T19:06:32.374973] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-02. [2025-09-16T19:06:32.565828] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:06:32.566422] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-02 [2025-09-16T19:06:33.174962] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-03. [2025-09-16T19:06:33.405434] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:06:33.405887] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-03 [2025-09-16T19:06:33.974957] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-04. [2025-09-16T19:06:34.265501] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:06:34.265879] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-04 [2025-09-16T19:06:34.774942] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-02. [2025-09-16T19:06:34.969743] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:06:34.970077] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-02 [2025-09-16T19:06:35.574926] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-09-16T19:06:36.255462] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-16T19:06:36.374892] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-09-16T19:06:36.985581] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-16T19:06:37.174931] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-09-16T19:06:37.974900] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-05. [2025-09-16T19:06:38.409329] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-16T19:06:38.774907] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-06. [2025-09-16T19:06:39.058889] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-16T19:06:39.574882] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-09-16T19:06:39.900142] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-16T19:06:40.374890] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-03. [2025-09-16T19:06:40.581869] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:06:40.582175] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-03 [2025-09-16T19:06:41.174926] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-09-16T19:06:41.454658] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-16T19:06:41.791445] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-16T19:06:41.974920] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-09-16T19:06:42.724859] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-16T19:06:42.725986] [INFO ] [REMOTE ] KKRS: Full fetch complete (6284 records). [2025-09-16T19:06:42.726053] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-09-16T19:06:42.776677] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-07. [2025-09-16T19:06:43.108353] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-09-16T19:06:43.108431] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-09-16T19:06:43.108608] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-09-16T19:06:43.108666] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-09-16T19:06:43.109061] [DEBUG] [LOCAL ] KKRS: Trimmed 6284 records to 4505 (keeping 150 days of data) [2025-09-16T19:06:43.136728] [DEBUG] [LOCAL ] KKRS: Primary data saved (4505 records). [2025-09-16T19:06:43.136826] [INFO ] [MAIN ] KKRS: Full history saved. [2025-09-16T19:06:43.136918] [INFO ] [MAIN ] Update Progress: 1195/2369 symbols completed. KKRS took 16.1s. Estimated remaining: 2h 4m 26s. Rate: 9.4 symbols/min [2025-09-16T19:06:43.341795] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:06:43.372396] [DEBUG] [LOCAL ] KLC: Loaded 26104 existing records from primary storage. [2025-09-16T19:06:43.372533] [INFO ] [MAIN ] KLC: Loaded 26104 existing records. [2025-09-16T19:06:43.561839] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:06:43.562138] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-09-16T19:06:43.562194] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-09-16T19:06:43.562816] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-09-16T19:06:43.562870] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-09-16T19:06:43.583717] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-09-16T19:06:43.686849] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-16T19:06:43.931037] [INFO ] [REMOTE ] KLC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:06:44.374923] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-08. [2025-09-16T19:06:45.151416] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-16T19:06:45.174866] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-09. [2025-09-16T19:06:45.412782] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-16T19:06:45.916409] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-16T19:06:45.918027] [INFO ] [REMOTE ] KKRT: Full fetch complete (7991 records). [2025-09-16T19:06:45.918098] [DEBUG] [VALIDATOR ] KKRT: Validating primary data. [2025-09-16T19:06:45.980014] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-09-16T19:06:46.119175] [WARN ] [VALIDATOR ] KKRT: Validation failed - insufficient historical data. Have 75 unique days, need 150 days [2025-09-16T19:06:46.119487] [FATAL] [MAIN ] KKRT: Fetched primary data is invalid. Refusing to save it. [2025-09-16T19:06:46.119569] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to validation failure. [2025-09-16T19:06:46.119635] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-16T19:06:46.119739] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-09-16T19:06:46.119794] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-09-16T19:06:46.119866] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-09-16T19:06:46.119952] [INFO ] [MAIN ] Update Progress: 1196/2369 symbols completed. KKRT took 17.6s. Estimated remaining: 2h 4m 17s. Rate: 9.4 symbols/min [2025-09-16T19:06:46.294282] [INFO ] [MAIN ] KLG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:06:46.325610] [DEBUG] [LOCAL ] KLG: Loaded 30713 existing records from primary storage. [2025-09-16T19:06:46.325786] [INFO ] [MAIN ] KLG: Loaded 30713 existing records. [2025-09-16T19:06:46.506846] [WARN ] [MAIN ] KLG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:06:46.507189] [INFO ] [MAIN ] KLG: Wiping existing primary data before full refresh. [2025-09-16T19:06:46.507251] [INFO ] [LOCAL ] KLG: Starting deletion of primary data. [2025-09-16T19:06:46.508063] [DEBUG] [LOCAL ] KLG: Deleted primary data file. [2025-09-16T19:06:46.508126] [INFO ] [MAIN ] KLG: Starting full primary refresh. [2025-09-16T19:06:46.780395] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-04. [2025-09-16T19:06:46.870937] [INFO ] [REMOTE ] KLG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:06:47.043517] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:06:47.043891] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-04 [2025-09-16T19:06:47.189464] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-16T19:06:47.574900] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-02. [2025-09-16T19:06:48.374911] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-05. [2025-09-16T19:06:48.581473] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:06:48.581987] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-05 [2025-09-16T19:06:48.827400] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-16T19:06:49.174953] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-09-16T19:06:49.974916] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-03. [2025-09-16T19:06:50.774900] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-09-16T19:06:51.211751] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-16T19:06:51.491709] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-16T19:06:51.574912] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-04. [2025-09-16T19:06:51.872837] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-16T19:06:52.374936] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-09-16T19:06:53.176463] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-06. [2025-09-16T19:06:53.181713] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-16T19:06:53.385894] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:06:53.386267] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-06 [2025-09-16T19:06:53.942365] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-16T19:06:53.974865] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-09-16T19:06:54.774945] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-07. [2025-09-16T19:06:54.963591] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:06:54.964079] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-07 [2025-09-16T19:06:55.574899] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-08. [2025-09-16T19:06:55.759476] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-16T19:06:55.767062] [INFO ] [REMOTE ] KKR: Full fetch complete (58194 records). [2025-09-16T19:06:55.767249] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-09-16T19:06:55.808601] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:06:55.853847] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-08 [2025-09-16T19:06:56.181706] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-09-16T19:06:56.181845] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-09-16T19:06:56.182942] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-09-16T19:06:56.183006] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-09-16T19:06:56.185085] [DEBUG] [LOCAL ] KKR: Trimmed 58194 records to 39871 (keeping 150 days of data) [2025-09-16T19:06:56.375704] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-09-16T19:06:56.458978] [DEBUG] [LOCAL ] KKR: Primary data saved (39871 records). [2025-09-16T19:06:56.459212] [INFO ] [MAIN ] KKR: Full history saved. [2025-09-16T19:06:56.459357] [INFO ] [MAIN ] Update Progress: 1197/2369 symbols completed. KKR took 31.3s. Estimated remaining: 2h 4m 14s. Rate: 9.4 symbols/min [2025-09-16T19:06:57.174959] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-05. [2025-09-16T19:06:57.848236] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-16T19:06:57.974915] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-09-16T19:06:58.780038] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-09. [2025-09-16T19:06:58.799022] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-16T19:06:59.361995] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-16T19:06:59.578607] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-06. [2025-09-16T19:06:59.908410] [INFO ] [REMOTE ] KLAR: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-16T19:06:59.911318] [INFO ] [REMOTE ] KLAR: Full fetch complete (1733 records). [2025-09-16T19:06:59.911386] [DEBUG] [VALIDATOR ] KLAR: Validating primary data. [2025-09-16T19:07:00.089886] [WARN ] [VALIDATOR ] KLAR: Validation failed - insufficient historical data. Have 5 unique days, need 150 days [2025-09-16T19:07:00.090078] [FATAL] [MAIN ] KLAR: Fetched primary data is invalid. Refusing to save it. [2025-09-16T19:07:00.090120] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to validation failure. [2025-09-16T19:07:00.090158] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-16T19:07:00.090214] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-09-16T19:07:00.090251] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-09-16T19:07:00.090350] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-09-16T19:07:00.090428] [INFO ] [MAIN ] Update Progress: 1198/2369 symbols completed. KLAR took 30.5s. Estimated remaining: 2h 4m 5s. Rate: 9.4 symbols/min [2025-09-16T19:07:00.374957] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-09-16T19:07:01.207559] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-16T19:07:01.217425] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-07. [2025-09-16T19:07:01.446545] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-16T19:07:01.974947] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-09-16T19:07:03.080119] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-16T19:07:03.090752] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-08. [2025-09-16T19:07:03.151407] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-16T19:07:03.574907] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-09-16T19:07:04.626188] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-16T19:07:04.635236] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-09. [2025-09-16T19:07:04.744197] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-16T19:07:05.174917] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-09-16T19:07:05.961458] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-16T19:07:05.967066] [INFO ] [REMOTE ] KLG: Full fetch complete (45728 records). [2025-09-16T19:07:05.967230] [DEBUG] [VALIDATOR ] KLG: Validating primary data. [2025-09-16T19:07:06.369606] [DEBUG] [VALIDATOR ] KLG: All expected trading days are present. [2025-09-16T19:07:06.369723] [DEBUG] [VALIDATOR ] KLG: Primary data validation passed. [2025-09-16T19:07:06.370413] [INFO ] [MAIN ] KLG: Fetched primary data is valid. [2025-09-16T19:07:06.370466] [DEBUG] [LOCAL ] KLG: Saving primary data. [2025-09-16T19:07:06.371439] [DEBUG] [LOCAL ] KLG: Trimmed 45728 records to 31005 (keeping 150 days of data) [2025-09-16T19:07:06.573454] [DEBUG] [LOCAL ] KLG: Primary data saved (31005 records). [2025-09-16T19:07:06.573708] [INFO ] [MAIN ] KLG: Full history saved. [2025-09-16T19:07:06.573862] [INFO ] [MAIN ] Update Progress: 1199/2369 symbols completed. KLG took 20.5s. Estimated remaining: 2h 3m 59s. Rate: 9.4 symbols/min [2025-09-16T19:07:06.586614] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-16T19:07:06.591527] [INFO ] [REMOTE ] KLC: Full fetch complete (38552 records). [2025-09-16T19:07:06.591679] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-09-16T19:07:07.021385] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-09-16T19:07:07.021472] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-09-16T19:07:07.022199] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-09-16T19:07:07.022245] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-09-16T19:07:07.023257] [DEBUG] [LOCAL ] KLC: Trimmed 38552 records to 26417 (keeping 150 days of data) [2025-09-16T19:07:07.176606] [DEBUG] [LOCAL ] KLC: Primary data saved (26417 records). [2025-09-16T19:07:07.176758] [INFO ] [MAIN ] KLC: Full history saved. [2025-09-16T19:07:07.176845] [INFO ] [MAIN ] Update Progress: 1200/2369 symbols completed. KLC took 24.0s. Estimated remaining: 2h 3m 47s. Rate: 9.4 symbols/min [2025-09-16T19:07:07.749775] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:07:07.857312] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:07:07.879160] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:07:07.913397] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:07:07.916073] [DEBUG] [LOCAL ] KMPB: Loaded 2557 existing records from primary storage. [2025-09-16T19:07:07.916786] [INFO ] [MAIN ] KMPB: Loaded 2557 existing records. [2025-09-16T19:07:08.175589] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:07:08.175994] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-09-16T19:07:08.177890] [DEBUG] [LOCAL ] KMPR: Loaded 29002 existing records from primary storage. [2025-09-16T19:07:08.177285] [DEBUG] [LOCAL ] KMI: Loaded 39653 existing records from primary storage. [2025-09-16T19:07:08.178087] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-09-16T19:07:08.178191] [INFO ] [MAIN ] KMPR: Loaded 29002 existing records. [2025-09-16T19:07:08.178484] [INFO ] [MAIN ] KMI: Loaded 39653 existing records. [2025-09-16T19:07:08.179856] [DEBUG] [LOCAL ] KMT: Loaded 31670 existing records from primary storage. [2025-09-16T19:07:08.206145] [INFO ] [MAIN ] KMT: Loaded 31670 existing records. [2025-09-16T19:07:08.196288] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-09-16T19:07:08.251429] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-09-16T19:07:08.856979] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:07:08.902928] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:07:08.924068] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:07:08.924546] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-09-16T19:07:08.926423] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-09-16T19:07:08.951245] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-09-16T19:07:08.951165] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-09-16T19:07:08.979963] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-09-16T19:07:08.996378] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-09-16T19:07:08.996520] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-09-16T19:07:08.979853] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-09-16T19:07:09.005800] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-09-16T19:07:09.057116] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-09-16T19:07:09.077289] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-09-16T19:07:09.136332] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-09-16T19:07:09.381030] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:07:09.434920] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-09-16T19:07:10.091580] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-16T19:07:10.134331] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-09-16T19:07:10.108666] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:07:10.153610] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-09-16T19:07:10.222163] [INFO ] [REMOTE ] KMI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:07:10.226290] [INFO ] [REMOTE ] KMT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:07:10.227357] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-09-16T19:07:10.227620] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-09-16T19:07:10.773474] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-16T19:07:10.775120] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-09-16T19:07:11.460249] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-16T19:07:11.468936] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-09-16T19:07:11.480285] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-16T19:07:11.574934] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-09-16T19:07:11.783606] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-16T19:07:12.041148] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-16T19:07:12.172787] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-16T19:07:12.374908] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-09-16T19:07:12.828919] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-16T19:07:13.174954] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-09-16T19:07:13.974914] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-09-16T19:07:14.356573] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-16T19:07:14.774908] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-09-16T19:07:14.883711] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-16T19:07:15.117118] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-16T19:07:15.353180] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-16T19:07:15.574926] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-09-16T19:07:16.019909] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-16T19:07:16.374907] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-09-16T19:07:17.174947] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-09-16T19:07:17.760818] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-16T19:07:17.974877] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-09-16T19:07:18.447131] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-16T19:07:18.774919] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-09-16T19:07:19.401703] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-16T19:07:19.574872] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-09-16T19:07:19.970794] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-16T19:07:20.374906] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-09-16T19:07:21.116137] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-16T19:07:21.174861] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-09-16T19:07:21.974930] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-09-16T19:07:22.283094] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-16T19:07:22.684517] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-16T19:07:22.774945] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-09-16T19:07:23.389288] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-16T19:07:23.574927] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-09-16T19:07:23.967933] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-16T19:07:24.374892] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-09-16T19:07:24.976062] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-16T19:07:25.174974] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-09-16T19:07:25.948817] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-16T19:07:25.974970] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-09-16T19:07:26.774947] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-09-16T19:07:27.023887] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-16T19:07:27.080899] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-16T19:07:27.086304] [INFO ] [REMOTE ] KMT: Full fetch complete (46907 records). [2025-09-16T19:07:27.086458] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-09-16T19:07:27.465521] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-09-16T19:07:27.465606] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-09-16T19:07:27.466375] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-09-16T19:07:27.466432] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-09-16T19:07:27.467536] [DEBUG] [LOCAL ] KMT: Trimmed 46907 records to 32017 (keeping 150 days of data) [2025-09-16T19:07:27.576839] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-09-16T19:07:27.670278] [DEBUG] [LOCAL ] KMT: Primary data saved (32017 records). [2025-09-16T19:07:27.670470] [INFO ] [MAIN ] KMT: Full history saved. [2025-09-16T19:07:27.671536] [INFO ] [MAIN ] Update Progress: 1201/2369 symbols completed. KMT took 20.5s. Estimated remaining: 2h 3m 55s. Rate: 9.4 symbols/min [2025-09-16T19:07:27.840148] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:07:27.881484] [DEBUG] [LOCAL ] KMX: Loaded 39282 existing records from primary storage. [2025-09-16T19:07:27.881627] [INFO ] [MAIN ] KMX: Loaded 39282 existing records. [2025-09-16T19:07:28.058750] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:07:28.061891] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-16T19:07:28.061992] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-09-16T19:07:28.063069] [INFO ] [REMOTE ] KMPB: Full fetch complete (3858 records). [2025-09-16T19:07:28.063131] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-09-16T19:07:28.063288] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-09-16T19:07:28.095286] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-09-16T19:07:28.127887] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-09-16T19:07:28.379079] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-09-16T19:07:28.728823] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-09-16T19:07:28.763637] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-09-16T19:07:28.767943] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-09-16T19:07:28.773410] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-09-16T19:07:28.800727] [INFO ] [REMOTE ] KMX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:07:28.801599] [DEBUG] [LOCAL ] KMPB: Trimmed 3858 records to 2577 (keeping 150 days of data) [2025-09-16T19:07:28.818667] [DEBUG] [LOCAL ] KMPB: Primary data saved (2577 records). [2025-09-16T19:07:28.818851] [INFO ] [MAIN ] KMPB: Full history saved. [2025-09-16T19:07:28.819022] [INFO ] [MAIN ] Update Progress: 1202/2369 symbols completed. KMPB took 21.6s. Estimated remaining: 2h 3m 43s. Rate: 9.4 symbols/min [2025-09-16T19:07:28.953107] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-16T19:07:29.033507] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:07:29.061180] [DEBUG] [LOCAL ] KN: Loaded 27770 existing records from primary storage. [2025-09-16T19:07:29.061348] [INFO ] [MAIN ] KN: Loaded 27770 existing records. [2025-09-16T19:07:29.180019] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-09-16T19:07:29.252877] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:07:29.253149] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-09-16T19:07:29.253199] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-09-16T19:07:29.253867] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-09-16T19:07:29.253925] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-09-16T19:07:29.614339] [INFO ] [REMOTE ] KN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:07:29.974947] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-09-16T19:07:30.668722] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-16T19:07:30.774857] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-09-16T19:07:31.528079] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-16T19:07:31.530086] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-09-16T19:07:31.574847] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-09-16T19:07:32.374917] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-09-16T19:07:32.777663] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-16T19:07:33.022331] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-16T19:07:33.174910] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-09-16T19:07:33.974900] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-09-16T19:07:34.121680] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-16T19:07:34.665996] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-16T19:07:34.672832] [INFO ] [REMOTE ] KMPR: Full fetch complete (39894 records). [2025-09-16T19:07:34.672963] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-09-16T19:07:34.776716] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-09-16T19:07:35.052280] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-09-16T19:07:35.052365] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-09-16T19:07:35.053074] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-09-16T19:07:35.053118] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-09-16T19:07:35.054051] [DEBUG] [LOCAL ] KMPR: Trimmed 39894 records to 29360 (keeping 150 days of data) [2025-09-16T19:07:35.262326] [DEBUG] [LOCAL ] KMPR: Primary data saved (29360 records). [2025-09-16T19:07:35.262908] [INFO ] [MAIN ] KMPR: Full history saved. [2025-09-16T19:07:35.264077] [INFO ] [MAIN ] Update Progress: 1203/2369 symbols completed. KMPR took 28.1s. Estimated remaining: 2h 3m 37s. Rate: 9.4 symbols/min [2025-09-16T19:07:35.263932] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-16T19:07:35.449365] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:07:35.476030] [DEBUG] [LOCAL ] KNF: Loaded 26473 existing records from primary storage. [2025-09-16T19:07:35.476169] [INFO ] [MAIN ] KNF: Loaded 26473 existing records. [2025-09-16T19:07:35.577088] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-09-16T19:07:35.656908] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:07:35.657168] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-09-16T19:07:35.657230] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-09-16T19:07:35.657905] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-09-16T19:07:35.657968] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-09-16T19:07:36.025656] [INFO ] [REMOTE ] KNF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:07:36.374874] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-09-16T19:07:36.791326] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-16T19:07:36.798000] [INFO ] [REMOTE ] KMI: Full fetch complete (58373 records). [2025-09-16T19:07:36.798144] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-09-16T19:07:37.185422] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-09-16T19:07:37.188323] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-09-16T19:07:37.189628] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-09-16T19:07:37.190575] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-09-16T19:07:37.190758] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-09-16T19:07:37.192208] [DEBUG] [LOCAL ] KMI: Trimmed 58373 records to 40043 (keeping 150 days of data) [2025-09-16T19:07:37.448357] [DEBUG] [LOCAL ] KMI: Primary data saved (40043 records). [2025-09-16T19:07:37.448490] [INFO ] [MAIN ] KMI: Full history saved. [2025-09-16T19:07:37.448584] [INFO ] [MAIN ] Update Progress: 1204/2369 symbols completed. KMI took 30.3s. Estimated remaining: 2h 3m 26s. Rate: 9.4 symbols/min [2025-09-16T19:07:37.622255] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:07:37.655772] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-16T19:07:37.659202] [DEBUG] [LOCAL ] KNOP: Loaded 6609 existing records from primary storage. [2025-09-16T19:07:37.665322] [INFO ] [MAIN ] KNOP: Loaded 6609 existing records. [2025-09-16T19:07:37.799314] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-16T19:07:37.886436] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:07:37.886715] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-09-16T19:07:37.886765] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-09-16T19:07:37.887122] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-09-16T19:07:37.887172] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-09-16T19:07:37.982902] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-09-16T19:07:38.248171] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:07:38.267187] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-16T19:07:38.774903] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-09-16T19:07:39.530281] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-16T19:07:39.574854] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-09-16T19:07:39.916280] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-16T19:07:40.092292] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-16T19:07:40.374884] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-09-16T19:07:41.174935] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-09-16T19:07:41.759560] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-16T19:07:41.974912] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-09-16T19:07:42.485814] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-16T19:07:42.774944] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-09-16T19:07:43.347632] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-16T19:07:43.574922] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-09-16T19:07:44.217957] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-16T19:07:44.374999] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-09-16T19:07:44.981862] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-16T19:07:45.001559] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-16T19:07:45.174921] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-09-16T19:07:45.974921] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-09-16T19:07:46.498737] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-16T19:07:46.503439] [INFO ] [REMOTE ] KN: Full fetch complete (42843 records). [2025-09-16T19:07:46.503563] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-09-16T19:07:46.780207] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-09-16T19:07:46.904129] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-09-16T19:07:46.904225] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-09-16T19:07:46.905130] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-09-16T19:07:46.905196] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-09-16T19:07:46.906129] [DEBUG] [LOCAL ] KN: Trimmed 42843 records to 28017 (keeping 150 days of data) [2025-09-16T19:07:47.077466] [DEBUG] [LOCAL ] KN: Primary data saved (28017 records). [2025-09-16T19:07:47.077706] [INFO ] [MAIN ] KN: Full history saved. [2025-09-16T19:07:47.077860] [INFO ] [MAIN ] Update Progress: 1205/2369 symbols completed. KN took 18.3s. Estimated remaining: 2h 3m 23s. Rate: 9.4 symbols/min [2025-09-16T19:07:47.247935] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:07:47.267373] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-16T19:07:47.286610] [DEBUG] [LOCAL ] KNSL: Loaded 13501 existing records from primary storage. [2025-09-16T19:07:47.286760] [INFO ] [MAIN ] KNSL: Loaded 13501 existing records. [2025-09-16T19:07:47.466539] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:07:47.466841] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-09-16T19:07:47.466889] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-09-16T19:07:47.467382] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-09-16T19:07:47.467440] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-09-16T19:07:47.580095] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-09-16T19:07:47.806501] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-16T19:07:47.832606] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:07:48.374973] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-09-16T19:07:49.174963] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-09-16T19:07:49.375616] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-16T19:07:49.825132] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-16T19:07:49.974839] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-16T19:07:49.974937] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-09-16T19:07:50.774917] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-09-16T19:07:51.339387] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-16T19:07:51.574905] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-09-16T19:07:51.627219] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-16T19:07:52.374925] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-09-16T19:07:53.174916] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-09-16T19:07:53.678906] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-16T19:07:53.791580] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-16T19:07:53.974879] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-09-16T19:07:54.313200] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-16T19:07:54.774916] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-09-16T19:07:55.058365] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-16T19:07:55.063276] [INFO ] [REMOTE ] KNF: Full fetch complete (38670 records). [2025-09-16T19:07:55.063374] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-09-16T19:07:55.434888] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-09-16T19:07:55.434968] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-09-16T19:07:55.435684] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-09-16T19:07:55.435731] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-09-16T19:07:55.436607] [DEBUG] [LOCAL ] KNF: Trimmed 38670 records to 26715 (keeping 150 days of data) [2025-09-16T19:07:55.583547] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-09-16T19:07:55.589395] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-16T19:07:55.613365] [DEBUG] [LOCAL ] KNF: Primary data saved (26715 records). [2025-09-16T19:07:55.613501] [INFO ] [MAIN ] KNF: Full history saved. [2025-09-16T19:07:55.613592] [INFO ] [MAIN ] Update Progress: 1206/2369 symbols completed. KNF took 20.3s. Estimated remaining: 2h 3m 19s. Rate: 9.4 symbols/min [2025-09-16T19:07:55.785374] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:07:55.820882] [DEBUG] [LOCAL ] KNTK: Loaded 34724 existing records from primary storage. [2025-09-16T19:07:55.821027] [INFO ] [MAIN ] KNTK: Loaded 34724 existing records. [2025-09-16T19:07:55.997189] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:07:55.997438] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-09-16T19:07:55.997503] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-09-16T19:07:55.998360] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-09-16T19:07:55.998409] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-09-16T19:07:56.349866] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:07:56.374878] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-09-16T19:07:56.587542] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-16T19:07:57.174913] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-09-16T19:07:57.974902] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-09-16T19:07:58.289697] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-16T19:07:58.594357] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-16T19:07:58.774903] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-09-16T19:07:58.812040] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-16T19:07:59.550969] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-16T19:07:59.552770] [INFO ] [REMOTE ] KNOP: Full fetch complete (10644 records). [2025-09-16T19:07:59.552838] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-09-16T19:07:59.582056] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-09-16T19:07:59.916891] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-09-16T19:07:59.916990] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-09-16T19:07:59.917253] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-09-16T19:07:59.917295] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-09-16T19:07:59.917764] [DEBUG] [LOCAL ] KNOP: Trimmed 10644 records to 6647 (keeping 150 days of data) [2025-09-16T19:07:59.958831] [DEBUG] [LOCAL ] KNOP: Primary data saved (6647 records). [2025-09-16T19:07:59.958943] [INFO ] [MAIN ] KNOP: Full history saved. [2025-09-16T19:07:59.959042] [INFO ] [MAIN ] Update Progress: 1207/2369 symbols completed. KNOP took 22.5s. Estimated remaining: 2h 3m 11s. Rate: 9.4 symbols/min [2025-09-16T19:08:00.129072] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:08:00.171559] [DEBUG] [LOCAL ] KNX: Loaded 38684 existing records from primary storage. [2025-09-16T19:08:00.171720] [INFO ] [MAIN ] KNX: Loaded 38684 existing records. [2025-09-16T19:08:00.349669] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:08:00.349925] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-09-16T19:08:00.349970] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-09-16T19:08:00.350813] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-09-16T19:08:00.350862] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-09-16T19:08:00.381230] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-09-16T19:08:00.705725] [INFO ] [REMOTE ] KNX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:08:00.727800] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-16T19:08:01.174905] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-09-16T19:08:01.974919] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-09-16T19:08:02.226061] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-16T19:08:02.234224] [INFO ] [REMOTE ] KMX: Full fetch complete (57412 records). [2025-09-16T19:08:02.234393] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-09-16T19:08:02.634734] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-09-16T19:08:02.634815] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-09-16T19:08:02.635720] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-09-16T19:08:02.635778] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-09-16T19:08:02.637072] [DEBUG] [LOCAL ] KMX: Trimmed 57412 records to 39668 (keeping 150 days of data) [2025-09-16T19:08:02.812622] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-09-16T19:08:02.899251] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-16T19:08:02.922040] [DEBUG] [LOCAL ] KMX: Primary data saved (39668 records). [2025-09-16T19:08:02.922214] [INFO ] [MAIN ] KMX: Full history saved. [2025-09-16T19:08:02.923799] [INFO ] [MAIN ] Update Progress: 1208/2369 symbols completed. KMX took 35.3s. Estimated remaining: 2h 3m 1s. Rate: 9.4 symbols/min [2025-09-16T19:08:03.093554] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:08:03.104762] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-16T19:08:03.147025] [DEBUG] [LOCAL ] KO: Loaded 39778 existing records from primary storage. [2025-09-16T19:08:03.147217] [INFO ] [MAIN ] KO: Loaded 39778 existing records. [2025-09-16T19:08:03.320110] [WARN ] [MAIN ] KO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:08:03.320375] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-09-16T19:08:03.320421] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-09-16T19:08:03.321273] [DEBUG] [LOCAL ] KO: Deleted primary data file. [2025-09-16T19:08:03.321321] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-09-16T19:08:03.580023] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-09-16T19:08:03.681692] [INFO ] [REMOTE ] KO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:08:04.224411] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-16T19:08:04.374906] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-09-16T19:08:04.914823] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-16T19:08:05.174931] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-09-16T19:08:05.946076] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-16T19:08:05.974840] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-09-16T19:08:06.774900] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-09-16T19:08:07.574895] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-09-16T19:08:07.630870] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-16T19:08:07.681746] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.51 seconds). [2025-09-16T19:08:08.374951] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-09-16T19:08:08.615089] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-16T19:08:08.637809] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-16T19:08:09.174925] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-09-16T19:08:09.974946] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-09-16T19:08:10.030707] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-16T19:08:10.033309] [INFO ] [REMOTE ] KNSL: Full fetch complete (19973 records). [2025-09-16T19:08:10.033412] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-09-16T19:08:10.399357] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-09-16T19:08:10.399436] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-09-16T19:08:10.399742] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-09-16T19:08:10.399785] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-09-16T19:08:10.400313] [DEBUG] [LOCAL ] KNSL: Trimmed 19973 records to 13618 (keeping 150 days of data) [2025-09-16T19:08:10.488998] [DEBUG] [LOCAL ] KNSL: Primary data saved (13618 records). [2025-09-16T19:08:10.489139] [INFO ] [MAIN ] KNSL: Full history saved. [2025-09-16T19:08:10.489226] [INFO ] [MAIN ] Update Progress: 1209/2369 symbols completed. KNSL took 23.4s. Estimated remaining: 2h 2m 56s. Rate: 9.4 symbols/min [2025-09-16T19:08:10.658016] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:08:10.692007] [DEBUG] [LOCAL ] KODK: Loaded 31957 existing records from primary storage. [2025-09-16T19:08:10.692176] [INFO ] [MAIN ] KODK: Loaded 31957 existing records. [2025-09-16T19:08:10.784159] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-09-16T19:08:10.876225] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:08:10.876524] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-09-16T19:08:10.876672] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-09-16T19:08:10.877505] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-09-16T19:08:10.877568] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-09-16T19:08:11.230054] [INFO ] [REMOTE ] KODK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:08:11.260547] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.89 seconds). [2025-09-16T19:08:11.574914] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-09-16T19:08:11.815303] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-16T19:08:12.374879] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-09-16T19:08:12.444717] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-16T19:08:13.103960] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-16T19:08:13.174867] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-09-16T19:08:13.974915] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-09-16T19:08:14.143014] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-16T19:08:14.776864] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-09-16T19:08:14.782124] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-16T19:08:15.574943] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-09-16T19:08:16.374902] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-09-16T19:08:16.573905] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-16T19:08:16.647014] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-09-16T19:08:17.174955] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-09-16T19:08:17.238913] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-16T19:08:17.974982] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-09-16T19:08:18.039199] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-16T19:08:18.753939] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-16T19:08:18.774875] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-09-16T19:08:19.574934] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-09-16T19:08:20.284203] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-16T19:08:20.289881] [INFO ] [REMOTE ] KNTK: Full fetch complete (49790 records). [2025-09-16T19:08:20.290008] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-09-16T19:08:20.379994] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-09-16T19:08:20.678797] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.70 seconds). [2025-09-16T19:08:20.719469] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-09-16T19:08:20.719622] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-09-16T19:08:20.720380] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-09-16T19:08:20.720435] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-09-16T19:08:20.721583] [DEBUG] [LOCAL ] KNTK: Trimmed 49790 records to 35014 (keeping 150 days of data) [2025-09-16T19:08:20.955292] [DEBUG] [LOCAL ] KNTK: Primary data saved (35014 records). [2025-09-16T19:08:20.955458] [INFO ] [MAIN ] KNTK: Full history saved. [2025-09-16T19:08:20.955572] [INFO ] [MAIN ] Update Progress: 1210/2369 symbols completed. KNTK took 25.3s. Estimated remaining: 2h 2m 53s. Rate: 9.4 symbols/min [2025-09-16T19:08:21.126332] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:08:21.144825] [DEBUG] [LOCAL ] KOF: Loaded 19529 existing records from primary storage. [2025-09-16T19:08:21.144988] [INFO ] [MAIN ] KOF: Loaded 19529 existing records. [2025-09-16T19:08:21.177007] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-09-16T19:08:21.326855] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:08:21.327131] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-09-16T19:08:21.327181] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-09-16T19:08:21.327778] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-09-16T19:08:21.327892] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-09-16T19:08:21.523760] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-16T19:08:21.755770] [INFO ] [REMOTE ] KOF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:08:21.974886] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-09-16T19:08:22.180406] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-16T19:08:22.774930] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-09-16T19:08:23.437148] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-16T19:08:23.475593] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-09-16T19:08:23.574891] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-09-16T19:08:23.962849] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-16T19:08:24.374902] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-09-16T19:08:25.174934] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-09-16T19:08:25.974924] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-09-16T19:08:26.089859] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-16T19:08:26.278662] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (2.70 seconds). [2025-09-16T19:08:26.387745] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-16T19:08:26.774888] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-09-16T19:08:27.058827] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-16T19:08:27.574906] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-09-16T19:08:28.374914] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-09-16T19:08:28.881540] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-16T19:08:29.174901] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-09-16T19:08:29.362563] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.59 seconds). [2025-09-16T19:08:29.620564] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-16T19:08:29.627923] [INFO ] [REMOTE ] KNX: Full fetch complete (57177 records). [2025-09-16T19:08:29.628131] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-09-16T19:08:29.980505] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-09-16T19:08:30.022190] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-09-16T19:08:30.022284] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-09-16T19:08:30.023161] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-09-16T19:08:30.023211] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-09-16T19:08:30.025601] [DEBUG] [LOCAL ] KNX: Trimmed 57177 records to 39070 (keeping 150 days of data) [2025-09-16T19:08:30.270612] [DEBUG] [LOCAL ] KNX: Primary data saved (39070 records). [2025-09-16T19:08:30.270795] [INFO ] [MAIN ] KNX: Full history saved. [2025-09-16T19:08:30.270889] [INFO ] [MAIN ] Update Progress: 1211/2369 symbols completed. KNX took 30.3s. Estimated remaining: 2h 2m 50s. Rate: 9.4 symbols/min [2025-09-16T19:08:30.448143] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:08:30.461319] [DEBUG] [LOCAL ] KOP: Loaded 12639 existing records from primary storage. [2025-09-16T19:08:30.461431] [INFO ] [MAIN ] KOP: Loaded 12639 existing records. [2025-09-16T19:08:30.646198] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:08:30.646444] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-09-16T19:08:30.646493] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-09-16T19:08:30.646962] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-09-16T19:08:30.647012] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-09-16T19:08:30.780008] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-09-16T19:08:31.024270] [INFO ] [REMOTE ] KOP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:08:31.053725] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-16T19:08:31.574901] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-09-16T19:08:31.832551] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-16T19:08:32.374919] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-09-16T19:08:32.674841] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (2.69 seconds). [2025-09-16T19:08:32.681562] [INFO ] [REMOTE ] KO: Full fetch complete (58498 records). [2025-09-16T19:08:32.681717] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-09-16T19:08:33.058938] [DEBUG] [VALIDATOR ] KO: All expected trading days are present. [2025-09-16T19:08:33.059147] [DEBUG] [VALIDATOR ] KO: Primary data validation passed. [2025-09-16T19:08:33.059994] [INFO ] [MAIN ] KO: Fetched primary data is valid. [2025-09-16T19:08:33.060060] [DEBUG] [LOCAL ] KO: Saving primary data. [2025-09-16T19:08:33.073140] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-16T19:08:33.077821] [DEBUG] [LOCAL ] KO: Trimmed 58498 records to 40168 (keeping 150 days of data) [2025-09-16T19:08:33.078831] [INFO ] [REMOTE ] KODK: Full fetch complete (47193 records). [2025-09-16T19:08:33.078921] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-09-16T19:08:33.181895] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-09-16T19:08:33.569705] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-09-16T19:08:33.570343] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-09-16T19:08:33.571618] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-09-16T19:08:33.571746] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-09-16T19:08:33.576092] [DEBUG] [LOCAL ] KODK: Trimmed 47193 records to 32256 (keeping 150 days of data) [2025-09-16T19:08:33.689489] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-16T19:08:33.925076] [DEBUG] [LOCAL ] KODK: Primary data saved (32256 records). [2025-09-16T19:08:33.929186] [INFO ] [MAIN ] KODK: Full history saved. [2025-09-16T19:08:33.929605] [INFO ] [MAIN ] Update Progress: 1212/2369 symbols completed. KODK took 23.4s. Estimated remaining: 2h 2m 41s. Rate: 9.4 symbols/min [2025-09-16T19:08:33.929463] [DEBUG] [LOCAL ] KO: Primary data saved (40168 records). [2025-09-16T19:08:33.929736] [INFO ] [MAIN ] KO: Full history saved. [2025-09-16T19:08:33.962835] [INFO ] [MAIN ] Update Progress: 1213/2369 symbols completed. KO took 31.0s. Estimated remaining: 2h 2m 29s. Rate: 9.4 symbols/min [2025-09-16T19:08:33.986115] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-09-16T19:08:34.208185] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:08:34.280768] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:08:34.282757] [DEBUG] [LOCAL ] KORE: Loaded 1525 existing records from primary storage. [2025-09-16T19:08:34.282888] [INFO ] [MAIN ] KORE: Loaded 1525 existing records. [2025-09-16T19:08:34.369413] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-16T19:08:34.493065] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:08:34.494010] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-09-16T19:08:34.494202] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-09-16T19:08:34.505775] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-09-16T19:08:34.505735] [DEBUG] [LOCAL ] KOS: Loaded 39184 existing records from primary storage. [2025-09-16T19:08:34.505842] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-09-16T19:08:34.537745] [INFO ] [MAIN ] KOS: Loaded 39184 existing records. [2025-09-16T19:08:34.781401] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-09-16T19:08:34.896814] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:08:34.958251] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-09-16T19:08:34.970044] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-09-16T19:08:34.976163] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-09-16T19:08:34.986413] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-09-16T19:08:35.127394] [INFO ] [REMOTE ] KORE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:08:35.409458] [INFO ] [REMOTE ] KOS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:08:35.425668] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-16T19:08:35.574900] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-09-16T19:08:35.932821] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-16T19:08:36.374906] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-09-16T19:08:36.704316] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-16T19:08:36.862834] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-16T19:08:37.174906] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-09-16T19:08:37.602981] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-16T19:08:37.974901] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-09-16T19:08:38.774888] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-09-16T19:08:39.125408] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-16T19:08:39.129238] [INFO ] [REMOTE ] KOF: Full fetch complete (28660 records). [2025-09-16T19:08:39.129347] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-09-16T19:08:39.502864] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-09-16T19:08:39.502980] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-09-16T19:08:39.503583] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-09-16T19:08:39.503624] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-09-16T19:08:39.504352] [DEBUG] [LOCAL ] KOF: Trimmed 28660 records to 19629 (keeping 150 days of data) [2025-09-16T19:08:39.592330] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-09-16T19:08:39.630015] [DEBUG] [LOCAL ] KOF: Primary data saved (19629 records). [2025-09-16T19:08:39.630265] [INFO ] [MAIN ] KOF: Full history saved. [2025-09-16T19:08:39.630364] [INFO ] [MAIN ] Update Progress: 1214/2369 symbols completed. KOF took 18.7s. Estimated remaining: 2h 2m 22s. Rate: 9.4 symbols/min [2025-09-16T19:08:39.801870] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:08:39.819166] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-16T19:08:39.858922] [DEBUG] [LOCAL ] KR: Loaded 39643 existing records from primary storage. [2025-09-16T19:08:39.859137] [INFO ] [MAIN ] KR: Loaded 39643 existing records. [2025-09-16T19:08:40.033300] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:08:40.033561] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-09-16T19:08:40.033608] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-09-16T19:08:40.034908] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-09-16T19:08:40.034960] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-09-16T19:08:40.384118] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-09-16T19:08:40.388784] [INFO ] [REMOTE ] KR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:08:40.846612] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-16T19:08:41.180430] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-09-16T19:08:41.202822] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-16T19:08:41.974971] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-09-16T19:08:42.405681] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-16T19:08:42.772950] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-16T19:08:42.782450] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-09-16T19:08:43.574960] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-09-16T19:08:43.995769] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-16T19:08:44.291807] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-16T19:08:44.374891] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-09-16T19:08:45.174920] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-09-16T19:08:45.337416] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-16T19:08:45.974909] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-09-16T19:08:46.691109] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-16T19:08:46.774888] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-09-16T19:08:47.574921] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-09-16T19:08:47.713115] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-16T19:08:48.048428] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-16T19:08:48.380021] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-09-16T19:08:48.396882] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-16T19:08:48.826811] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-16T19:08:49.174959] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-09-16T19:08:49.968231] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-16T19:08:49.974852] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-09-16T19:08:50.774929] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-09-16T19:08:50.865042] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-16T19:08:51.574950] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-09-16T19:08:52.374958] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-09-16T19:08:52.511976] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-16T19:08:52.761542] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-16T19:08:52.822946] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-16T19:08:52.823917] [INFO ] [REMOTE ] KORE: Full fetch complete (2235 records). [2025-09-16T19:08:52.824020] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-09-16T19:08:53.177170] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-09-16T19:08:53.199195] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-09-16T19:08:53.199326] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-09-16T19:08:53.199469] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-09-16T19:08:53.201033] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-09-16T19:08:53.202014] [DEBUG] [LOCAL ] KORE: Trimmed 2235 records to 1535 (keeping 150 days of data) [2025-09-16T19:08:53.213012] [DEBUG] [LOCAL ] KORE: Primary data saved (1535 records). [2025-09-16T19:08:53.213125] [INFO ] [MAIN ] KORE: Full history saved. [2025-09-16T19:08:53.213229] [INFO ] [MAIN ] Update Progress: 1215/2369 symbols completed. KORE took 19.3s. Estimated remaining: 2h 2m 22s. Rate: 9.4 symbols/min [2025-09-16T19:08:53.398172] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:08:53.431609] [DEBUG] [LOCAL ] KRC: Loaded 35359 existing records from primary storage. [2025-09-16T19:08:53.431772] [INFO ] [MAIN ] KRC: Loaded 35359 existing records. [2025-09-16T19:08:53.624909] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:08:53.625179] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-09-16T19:08:53.625237] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-09-16T19:08:53.626119] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-09-16T19:08:53.626174] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-09-16T19:08:53.985276] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-09-16T19:08:53.990612] [INFO ] [REMOTE ] KRC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:08:54.774959] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-09-16T19:08:54.977467] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-16T19:08:54.980532] [INFO ] [REMOTE ] KOP: Full fetch complete (19539 records). [2025-09-16T19:08:54.980606] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-09-16T19:08:55.347730] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-09-16T19:08:55.347838] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-09-16T19:08:55.348357] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-09-16T19:08:55.348446] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-09-16T19:08:55.349248] [DEBUG] [LOCAL ] KOP: Trimmed 19539 records to 12808 (keeping 150 days of data) [2025-09-16T19:08:55.447439] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-09-16T19:08:55.474354] [DEBUG] [LOCAL ] KOP: Primary data saved (12808 records). [2025-09-16T19:08:55.474528] [INFO ] [MAIN ] KOP: Full history saved. [2025-09-16T19:08:55.474624] [INFO ] [MAIN ] Update Progress: 1216/2369 symbols completed. KOP took 25.2s. Estimated remaining: 2h 2m 12s. Rate: 9.4 symbols/min [2025-09-16T19:08:55.575727] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-09-16T19:08:55.663731] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:08:55.690301] [DEBUG] [LOCAL ] KREF: Loaded 27019 existing records from primary storage. [2025-09-16T19:08:55.690488] [INFO ] [MAIN ] KREF: Loaded 27019 existing records. [2025-09-16T19:08:55.866465] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:08:55.866721] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-09-16T19:08:55.866771] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-09-16T19:08:55.867394] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-09-16T19:08:55.867441] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-09-16T19:08:56.220585] [INFO ] [REMOTE ] KREF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:08:56.245841] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-16T19:08:56.374859] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-09-16T19:08:57.174914] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-09-16T19:08:57.219629] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-16T19:08:57.658408] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-16T19:08:57.974914] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-09-16T19:08:58.774864] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-09-16T19:08:58.803876] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-16T19:08:59.574958] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-09-16T19:08:59.888194] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-16T19:09:00.374911] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-09-16T19:09:00.602464] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-16T19:09:00.990285] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-16T19:09:01.174952] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-09-16T19:09:01.974953] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-09-16T19:09:02.325396] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-16T19:09:02.774935] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-09-16T19:09:03.088632] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-16T19:09:03.344312] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-16T19:09:03.574908] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-09-16T19:09:04.210583] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-16T19:09:04.374945] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-09-16T19:09:04.888889] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-16T19:09:05.174957] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-09-16T19:09:05.974964] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-09-16T19:09:06.179282] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-16T19:09:06.186358] [INFO ] [REMOTE ] KOS: Full fetch complete (57711 records). [2025-09-16T19:09:06.186524] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-09-16T19:09:06.581702] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-09-16T19:09:06.581801] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-09-16T19:09:06.582606] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-09-16T19:09:06.582686] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-09-16T19:09:06.584015] [DEBUG] [LOCAL ] KOS: Trimmed 57711 records to 39572 (keeping 150 days of data) [2025-09-16T19:09:06.779534] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-09-16T19:09:06.815623] [DEBUG] [LOCAL ] KOS: Primary data saved (39572 records). [2025-09-16T19:09:06.815795] [INFO ] [MAIN ] KOS: Full history saved. [2025-09-16T19:09:06.816697] [INFO ] [MAIN ] Update Progress: 1217/2369 symbols completed. KOS took 32.8s. Estimated remaining: 2h 2m 10s. Rate: 9.4 symbols/min [2025-09-16T19:09:06.998910] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:09:07.031380] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-16T19:09:07.077038] [DEBUG] [LOCAL ] KRG: Loaded 36082 existing records from primary storage. [2025-09-16T19:09:07.077188] [INFO ] [MAIN ] KRG: Loaded 36082 existing records. [2025-09-16T19:09:07.261762] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:09:07.262018] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-09-16T19:09:07.262065] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-09-16T19:09:07.262943] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-09-16T19:09:07.262993] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-09-16T19:09:07.583256] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-09-16T19:09:07.671492] [INFO ] [REMOTE ] KRG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:09:07.696814] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-16T19:09:08.374941] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-09-16T19:09:08.650589] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-16T19:09:09.174932] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-09-16T19:09:09.334982] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-16T19:09:09.719932] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-16T19:09:09.974916] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-09-16T19:09:10.689976] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-16T19:09:10.697022] [INFO ] [REMOTE ] KR: Full fetch complete (58358 records). [2025-09-16T19:09:10.697154] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-09-16T19:09:10.780054] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-09-16T19:09:11.119549] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-09-16T19:09:11.119632] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-09-16T19:09:11.120471] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-09-16T19:09:11.120532] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-09-16T19:09:11.121766] [DEBUG] [LOCAL ] KR: Trimmed 58358 records to 40033 (keeping 150 days of data) [2025-09-16T19:09:11.374581] [DEBUG] [LOCAL ] KR: Primary data saved (40033 records). [2025-09-16T19:09:11.374729] [INFO ] [MAIN ] KR: Full history saved. [2025-09-16T19:09:11.374848] [INFO ] [MAIN ] Update Progress: 1218/2369 symbols completed. KR took 31.7s. Estimated remaining: 2h 2m 2s. Rate: 9.4 symbols/min [2025-09-16T19:09:11.551920] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:09:11.552199] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-09-16T19:09:11.552267] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-09-16T19:09:11.552701] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-09-16T19:09:11.552754] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-16T19:09:11.552806] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-09-16T19:09:11.552848] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-09-16T19:09:11.583119] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-09-16T19:09:11.867983] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-16T19:09:11.956720] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:09:11.981804] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-16T19:09:12.374904] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-09-16T19:09:13.174969] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-09-16T19:09:13.223260] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-16T19:09:13.228994] [INFO ] [REMOTE ] KRC: Full fetch complete (52789 records). [2025-09-16T19:09:13.229086] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-09-16T19:09:13.609076] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-09-16T19:09:13.609198] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-09-16T19:09:13.610058] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-09-16T19:09:13.610150] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-09-16T19:09:13.611447] [DEBUG] [LOCAL ] KRC: Trimmed 52789 records to 35713 (keeping 150 days of data) [2025-09-16T19:09:13.736379] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-16T19:09:13.862440] [DEBUG] [LOCAL ] KRC: Primary data saved (35713 records). [2025-09-16T19:09:13.862582] [INFO ] [MAIN ] KRC: Full history saved. [2025-09-16T19:09:13.862702] [INFO ] [MAIN ] Update Progress: 1219/2369 symbols completed. KRC took 20.6s. Estimated remaining: 2h 1m 52s. Rate: 9.4 symbols/min [2025-09-16T19:09:13.979975] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-02. [2025-09-16T19:09:14.035438] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:09:14.054419] [DEBUG] [LOCAL ] KRO: Loaded 19369 existing records from primary storage. [2025-09-16T19:09:14.054548] [INFO ] [MAIN ] KRO: Loaded 19369 existing records. [2025-09-16T19:09:14.231260] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:09:14.231529] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-09-16T19:09:14.231585] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-09-16T19:09:14.232081] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-09-16T19:09:14.232130] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-09-16T19:09:14.589042] [INFO ] [REMOTE ] KRO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:09:14.629946] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-16T19:09:14.774874] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-09-16T19:09:14.804221] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-16T19:09:15.574902] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-03. [2025-09-16T19:09:16.374907] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-09-16T19:09:16.511049] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-16T19:09:16.933955] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-16T19:09:17.173976] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-16T19:09:17.182492] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-09-16T19:09:17.974910] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-09-16T19:09:18.522594] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-16T19:09:18.711086] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-16T19:09:18.774850] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-04. [2025-09-16T19:09:19.574944] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-09-16T19:09:20.342377] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-16T19:09:20.374843] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-05. [2025-09-16T19:09:21.146300] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-16T19:09:21.174859] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-09-16T19:09:21.838126] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-16T19:09:21.974923] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-09-16T19:09:22.396773] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-16T19:09:22.774903] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-06. [2025-09-16T19:09:23.288560] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-16T19:09:23.574920] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-09-16T19:09:24.237048] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-16T19:09:24.374939] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-07. [2025-09-16T19:09:24.937073] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-16T19:09:24.941409] [INFO ] [REMOTE ] KREF: Full fetch complete (39329 records). [2025-09-16T19:09:24.941514] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-09-16T19:09:25.180126] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-09-16T19:09:25.340438] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-09-16T19:09:25.340547] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-09-16T19:09:25.341250] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-09-16T19:09:25.341297] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-09-16T19:09:25.342496] [DEBUG] [LOCAL ] KREF: Trimmed 39329 records to 27305 (keeping 150 days of data) [2025-09-16T19:09:25.509248] [DEBUG] [LOCAL ] KREF: Primary data saved (27305 records). [2025-09-16T19:09:25.509426] [INFO ] [MAIN ] KREF: Full history saved. [2025-09-16T19:09:25.509558] [INFO ] [MAIN ] Update Progress: 1220/2369 symbols completed. KREF took 30.0s. Estimated remaining: 2h 1m 51s. Rate: 9.4 symbols/min [2025-09-16T19:09:25.686656] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:09:25.712752] [DEBUG] [LOCAL ] KRP: Loaded 26642 existing records from primary storage. [2025-09-16T19:09:25.712891] [INFO ] [MAIN ] KRP: Loaded 26642 existing records. [2025-09-16T19:09:25.888715] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:09:25.888996] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-09-16T19:09:25.889091] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-09-16T19:09:25.889766] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-09-16T19:09:25.889815] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-09-16T19:09:25.984803] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-09-16T19:09:26.259134] [INFO ] [REMOTE ] KRP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:09:26.295769] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-16T19:09:26.332566] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-16T19:09:26.774928] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-09-16T19:09:27.574937] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-08. [2025-09-16T19:09:27.666914] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-16T19:09:27.740931] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-16T19:09:28.374906] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-09-16T19:09:29.039894] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-16T19:09:29.174932] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-09-16T19:09:29.937549] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-16T19:09:29.975028] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-09. [2025-09-16T19:09:30.454134] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-16T19:09:30.774933] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-09-16T19:09:31.326854] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-16T19:09:31.332848] [INFO ] [REMOTE ] KRMN: Full fetch complete (47758 records). [2025-09-16T19:09:31.332983] [DEBUG] [VALIDATOR ] KRMN: Validating primary data. [2025-09-16T19:09:31.520359] [WARN ] [VALIDATOR ] KRMN: Validation failed - insufficient historical data. Have 148 unique days, need 150 days [2025-09-16T19:09:31.520933] [FATAL] [MAIN ] KRMN: Fetched primary data is invalid. Refusing to save it. [2025-09-16T19:09:31.520999] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to validation failure. [2025-09-16T19:09:31.521055] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-16T19:09:31.521120] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-09-16T19:09:31.521166] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-09-16T19:09:31.521218] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-09-16T19:09:31.521287] [INFO ] [MAIN ] Update Progress: 1221/2369 symbols completed. KRMN took 20.1s. Estimated remaining: 2h 1m 44s. Rate: 9.4 symbols/min [2025-09-16T19:09:31.585159] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-09-16T19:09:31.696089] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:09:31.733539] [DEBUG] [LOCAL ] KSS: Loaded 39575 existing records from primary storage. [2025-09-16T19:09:31.733709] [INFO ] [MAIN ] KSS: Loaded 39575 existing records. [2025-09-16T19:09:31.917281] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:09:31.917584] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-09-16T19:09:31.917635] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-09-16T19:09:31.918446] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-09-16T19:09:31.918505] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-09-16T19:09:32.276048] [INFO ] [REMOTE ] KSS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:09:32.297765] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-16T19:09:32.374850] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-09-16T19:09:32.910194] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-16T19:09:33.174910] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-09-16T19:09:33.974936] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-09-16T19:09:34.157667] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-16T19:09:34.774942] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-09-16T19:09:34.877692] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-16T19:09:35.404792] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-16T19:09:35.574895] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-09-16T19:09:36.374910] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-09-16T19:09:36.785175] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-16T19:09:37.024843] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-16T19:09:37.174902] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-09-16T19:09:37.242988] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-16T19:09:37.246473] [INFO ] [REMOTE ] KRO: Full fetch complete (27067 records). [2025-09-16T19:09:37.246544] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-09-16T19:09:37.614852] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-09-16T19:09:37.614935] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-09-16T19:09:37.615615] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-09-16T19:09:37.615682] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-09-16T19:09:37.616475] [DEBUG] [LOCAL ] KRO: Trimmed 27067 records to 19557 (keeping 150 days of data) [2025-09-16T19:09:37.732171] [DEBUG] [LOCAL ] KRO: Primary data saved (19557 records). [2025-09-16T19:09:37.732321] [INFO ] [MAIN ] KRO: Full history saved. [2025-09-16T19:09:37.732432] [INFO ] [MAIN ] Update Progress: 1222/2369 symbols completed. KRO took 23.9s. Estimated remaining: 2h 1m 37s. Rate: 9.4 symbols/min [2025-09-16T19:09:37.905055] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:09:37.940405] [DEBUG] [LOCAL ] KT: Loaded 33182 existing records from primary storage. [2025-09-16T19:09:37.940544] [INFO ] [MAIN ] KT: Loaded 33182 existing records. [2025-09-16T19:09:37.982572] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-09-16T19:09:38.120397] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:09:38.120699] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-09-16T19:09:38.120751] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-09-16T19:09:38.121690] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-09-16T19:09:38.121748] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-09-16T19:09:38.486750] [INFO ] [REMOTE ] KT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:09:38.521553] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-16T19:09:38.774915] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-09-16T19:09:39.574896] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-09-16T19:09:40.117363] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-16T19:09:40.311325] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-16T19:09:40.374882] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-09-16T19:09:41.046823] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-16T19:09:41.174946] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-09-16T19:09:41.663049] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-16T19:09:41.669579] [INFO ] [REMOTE ] KRG: Full fetch complete (53446 records). [2025-09-16T19:09:41.669735] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-09-16T19:09:41.980093] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-09-16T19:09:42.058944] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-09-16T19:09:42.059036] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-09-16T19:09:42.059859] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-09-16T19:09:42.059931] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-09-16T19:09:42.061304] [DEBUG] [LOCAL ] KRG: Trimmed 53446 records to 36453 (keeping 150 days of data) [2025-09-16T19:09:42.291278] [DEBUG] [LOCAL ] KRG: Primary data saved (36453 records). [2025-09-16T19:09:42.291430] [INFO ] [MAIN ] KRG: Full history saved. [2025-09-16T19:09:42.292186] [INFO ] [MAIN ] Update Progress: 1223/2369 symbols completed. KRG took 35.5s. Estimated remaining: 2h 1m 29s. Rate: 9.4 symbols/min [2025-09-16T19:09:42.467501] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:09:42.503835] [DEBUG] [LOCAL ] KTB: Loaded 30183 existing records from primary storage. [2025-09-16T19:09:42.503979] [INFO ] [MAIN ] KTB: Loaded 30183 existing records. [2025-09-16T19:09:42.687390] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:09:42.687718] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-09-16T19:09:42.687772] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-09-16T19:09:42.688431] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-09-16T19:09:42.688510] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-09-16T19:09:42.783157] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-09-16T19:09:43.068992] [INFO ] [REMOTE ] KTB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:09:43.095871] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-16T19:09:43.574932] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-09-16T19:09:43.712188] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-16T19:09:43.738198] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-16T19:09:43.742585] [INFO ] [REMOTE ] KRP: Full fetch complete (41621 records). [2025-09-16T19:09:43.742718] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-09-16T19:09:44.121578] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-09-16T19:09:44.121681] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-09-16T19:09:44.122521] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-09-16T19:09:44.122567] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-09-16T19:09:44.123605] [DEBUG] [LOCAL ] KRP: Trimmed 41621 records to 26905 (keeping 150 days of data) [2025-09-16T19:09:44.297111] [DEBUG] [LOCAL ] KRP: Primary data saved (26905 records). [2025-09-16T19:09:44.297252] [INFO ] [MAIN ] KRP: Full history saved. [2025-09-16T19:09:44.297522] [INFO ] [MAIN ] Update Progress: 1224/2369 symbols completed. KRP took 18.8s. Estimated remaining: 2h 1m 19s. Rate: 9.4 symbols/min [2025-09-16T19:09:44.380115] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-09-16T19:09:44.469631] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:09:44.479410] [DEBUG] [LOCAL ] KTF: Loaded 8631 existing records from primary storage. [2025-09-16T19:09:44.479540] [INFO ] [MAIN ] KTF: Loaded 8631 existing records. [2025-09-16T19:09:44.655960] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:09:44.656218] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-09-16T19:09:44.656287] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-09-16T19:09:44.656593] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-09-16T19:09:44.656636] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-09-16T19:09:45.007373] [INFO ] [REMOTE ] KTF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:09:45.178071] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-09-16T19:09:45.182968] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-16T19:09:45.974755] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-16T19:09:45.974912] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-09-16T19:09:46.376043] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-16T19:09:46.774859] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-09-16T19:09:47.556572] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-16T19:09:47.574941] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-09-16T19:09:48.292207] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-16T19:09:48.374874] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-09-16T19:09:49.174888] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-09-16T19:09:49.206087] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-16T19:09:49.971427] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-16T19:09:49.980408] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-09-16T19:09:49.994703] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-16T19:09:50.774969] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-09-16T19:09:51.574908] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-09-16T19:09:52.107799] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-16T19:09:52.374927] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-09-16T19:09:52.443190] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-16T19:09:52.636148] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-16T19:09:53.174937] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-09-16T19:09:53.881772] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-16T19:09:53.974866] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-09-16T19:09:54.774880] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-09-16T19:09:55.286820] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-16T19:09:55.491162] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-16T19:09:55.574907] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-09-16T19:09:56.374962] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-09-16T19:09:56.376313] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-16T19:09:57.039456] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-16T19:09:57.174944] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-09-16T19:09:57.974913] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-09-16T19:09:58.289766] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-16T19:09:58.296454] [INFO ] [REMOTE ] KSS: Full fetch complete (58288 records). [2025-09-16T19:09:58.296572] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-09-16T19:09:58.681630] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-09-16T19:09:58.681831] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-09-16T19:09:58.682720] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-09-16T19:09:58.682807] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-09-16T19:09:58.693424] [DEBUG] [LOCAL ] KSS: Trimmed 58288 records to 39965 (keeping 150 days of data) [2025-09-16T19:09:58.710348] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-16T19:09:58.779047] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-09-16T19:09:58.964303] [DEBUG] [LOCAL ] KSS: Primary data saved (39965 records). [2025-09-16T19:09:58.964460] [INFO ] [MAIN ] KSS: Full history saved. [2025-09-16T19:09:58.964561] [INFO ] [MAIN ] Update Progress: 1225/2369 symbols completed. KSS took 27.4s. Estimated remaining: 2h 1m 20s. Rate: 9.4 symbols/min [2025-09-16T19:09:59.140271] [INFO ] [MAIN ] KUKE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:09:59.140464] [DEBUG] [LOCAL ] KUKE: No existing data file found in primary storage. [2025-09-16T19:09:59.140509] [WARN ] [MAIN ] KUKE: No existing data found, performing full refresh instead. [2025-09-16T19:09:59.140632] [INFO ] [MAIN ] KUKE: Wiping existing primary data before full refresh. [2025-09-16T19:09:59.140699] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-16T19:09:59.140754] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-09-16T19:09:59.140797] [INFO ] [MAIN ] KUKE: Starting full primary refresh. [2025-09-16T19:09:59.497561] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:09:59.534571] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-16T19:09:59.577877] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-09-16T19:09:59.578944] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-16T19:10:00.235362] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-16T19:10:00.374955] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-09-16T19:10:01.174950] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-09-16T19:10:01.974949] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-09-16T19:10:02.067197] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-16T19:10:02.073280] [INFO ] [REMOTE ] KT: Full fetch complete (50074 records). [2025-09-16T19:10:02.073445] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-09-16T19:10:02.477962] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-09-16T19:10:02.478063] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-09-16T19:10:02.478926] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-09-16T19:10:02.478978] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-09-16T19:10:02.480238] [DEBUG] [LOCAL ] KT: Trimmed 50074 records to 33570 (keeping 150 days of data) [2025-09-16T19:10:02.704385] [DEBUG] [LOCAL ] KT: Primary data saved (33570 records). [2025-09-16T19:10:02.704608] [INFO ] [MAIN ] KT: Full history saved. [2025-09-16T19:10:02.704729] [INFO ] [MAIN ] Update Progress: 1226/2369 symbols completed. KT took 25.0s. Estimated remaining: 2h 1m 12s. Rate: 9.4 symbols/min [2025-09-16T19:10:02.779976] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-09-16T19:10:02.894601] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:10:02.906230] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-16T19:10:02.940539] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-16T19:10:02.978091] [DEBUG] [LOCAL ] KVUE: Loaded 39627 existing records from primary storage. [2025-09-16T19:10:02.978252] [INFO ] [MAIN ] KVUE: Loaded 39627 existing records. [2025-09-16T19:10:03.158565] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:10:03.158860] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-09-16T19:10:03.158909] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-09-16T19:10:03.160121] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-09-16T19:10:03.160176] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-09-16T19:10:03.529265] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:10:03.574866] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-09-16T19:10:03.778449] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-16T19:10:04.374910] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-09-16T19:10:05.174880] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-09-16T19:10:05.188374] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-16T19:10:05.262957] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-16T19:10:05.974910] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-09-16T19:10:06.596032] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-16T19:10:06.600707] [INFO ] [REMOTE ] KTB: Full fetch complete (45366 records). [2025-09-16T19:10:06.600807] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-09-16T19:10:06.779772] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-09-16T19:10:06.984082] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-09-16T19:10:06.984181] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-09-16T19:10:06.985078] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-09-16T19:10:06.985125] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-09-16T19:10:06.986287] [DEBUG] [LOCAL ] KTB: Trimmed 45366 records to 30470 (keeping 150 days of data) [2025-09-16T19:10:07.180679] [DEBUG] [LOCAL ] KTB: Primary data saved (30470 records). [2025-09-16T19:10:07.180844] [INFO ] [MAIN ] KTB: Full history saved. [2025-09-16T19:10:07.181801] [INFO ] [MAIN ] Update Progress: 1227/2369 symbols completed. KTB took 24.9s. Estimated remaining: 2h 1m 3s. Rate: 9.4 symbols/min [2025-09-16T19:10:07.353707] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:10:07.392204] [DEBUG] [LOCAL ] KVYO: Loaded 37223 existing records from primary storage. [2025-09-16T19:10:07.392363] [INFO ] [MAIN ] KVYO: Loaded 37223 existing records. [2025-09-16T19:10:07.575519] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-09-16T19:10:07.578719] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:10:07.580227] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-09-16T19:10:07.580284] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-09-16T19:10:07.581145] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-09-16T19:10:07.581253] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-09-16T19:10:07.955581] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:10:07.957233] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-16T19:10:07.992733] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-16T19:10:08.219286] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-16T19:10:08.374903] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-09-16T19:10:09.174922] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-09-16T19:10:09.687392] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-16T19:10:09.982663] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-09-16T19:10:09.985374] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-16T19:10:10.428593] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-16T19:10:10.774922] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-09-16T19:10:10.930438] [DEBUG] [REMOTE ] KUKE: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-09-16T19:10:10.930777] [WARN ] [REMOTE ] KUKE: No data returned for month 2025-07 [2025-09-16T19:10:11.574897] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-09-16T19:10:12.374934] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-09-16T19:10:12.392305] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-16T19:10:12.394777] [INFO ] [REMOTE ] KTF: Full fetch complete (14197 records). [2025-09-16T19:10:12.394864] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-09-16T19:10:12.759796] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-09-16T19:10:12.759872] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-09-16T19:10:12.760183] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-09-16T19:10:12.760223] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-09-16T19:10:12.760706] [DEBUG] [LOCAL ] KTF: Trimmed 14197 records to 8672 (keeping 150 days of data) [2025-09-16T19:10:12.814166] [DEBUG] [LOCAL ] KTF: Primary data saved (8672 records). [2025-09-16T19:10:12.814301] [INFO ] [MAIN ] KTF: Full history saved. [2025-09-16T19:10:12.814384] [INFO ] [MAIN ] Update Progress: 1228/2369 symbols completed. KTF took 28.5s. Estimated remaining: 2h 0m 56s. Rate: 9.4 symbols/min [2025-09-16T19:10:12.986353] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:10:13.014170] [DEBUG] [LOCAL ] KW: Loaded 29877 existing records from primary storage. [2025-09-16T19:10:13.014313] [INFO ] [MAIN ] KW: Loaded 29877 existing records. [2025-09-16T19:10:13.191139] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-09-16T19:10:13.196905] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:10:13.197101] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-09-16T19:10:13.197146] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-09-16T19:10:13.197845] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-09-16T19:10:13.197893] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-09-16T19:10:13.556127] [INFO ] [REMOTE ] KW: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:10:13.974902] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-09-16T19:10:14.078045] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-16T19:10:14.692733] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-16T19:10:14.774895] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-09-16T19:10:15.286433] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-16T19:10:15.574903] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-09-16T19:10:16.374907] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-09-16T19:10:16.490999] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-16T19:10:17.146050] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-16T19:10:17.174888] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-09-16T19:10:17.791018] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-16T19:10:17.974914] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-09-16T19:10:18.387311] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-16T19:10:18.774892] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-09-16T19:10:19.451078] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-16T19:10:19.574852] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-09-16T19:10:20.333235] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-16T19:10:20.374851] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-09-16T19:10:21.160170] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-16T19:10:21.174853] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-09-16T19:10:21.415456] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-16T19:10:21.974916] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-09-16T19:10:22.541206] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-16T19:10:22.774983] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-09-16T19:10:23.575000] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-09-16T19:10:23.826933] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-16T19:10:23.958121] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-16T19:10:24.238101] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-16T19:10:24.374901] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-09-16T19:10:25.174920] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-09-16T19:10:25.784145] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-16T19:10:25.784296] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-16T19:10:25.793493] [INFO ] [REMOTE ] KUKE: Full fetch complete (4644 records). [2025-09-16T19:10:25.793753] [DEBUG] [VALIDATOR ] KUKE: Validating primary data. [2025-09-16T19:10:25.984225] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-09-16T19:10:25.991886] [WARN ] [VALIDATOR ] KUKE: Validation failed - insufficient historical data. Have 128 unique days, need 150 days [2025-09-16T19:10:25.993098] [FATAL] [MAIN ] KUKE: Fetched primary data is invalid. Refusing to save it. [2025-09-16T19:10:25.993210] [WARN ] [MAIN ] KUKE: Deleting existing primary and derivative data due to validation failure. [2025-09-16T19:10:25.993291] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-16T19:10:25.993366] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-09-16T19:10:25.993417] [INFO ] [LOCAL ] KUKE: Starting deletion of derivative data. [2025-09-16T19:10:25.993492] [DEBUG] [LOCAL ] KUKE: No derivative data file found to delete. [2025-09-16T19:10:25.993714] [INFO ] [MAIN ] Update Progress: 1229/2369 symbols completed. KUKE took 27.0s. Estimated remaining: 2h 0m 56s. Rate: 9.4 symbols/min [2025-09-16T19:10:26.180932] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:10:26.194784] [DEBUG] [LOCAL ] KWR: Loaded 12280 existing records from primary storage. [2025-09-16T19:10:26.194919] [INFO ] [MAIN ] KWR: Loaded 12280 existing records. [2025-09-16T19:10:26.371466] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:10:26.371721] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-09-16T19:10:26.371767] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-09-16T19:10:26.372238] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-09-16T19:10:26.372283] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-09-16T19:10:26.728063] [INFO ] [REMOTE ] KWR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:10:26.774902] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-09-16T19:10:27.574916] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-09-16T19:10:27.890930] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-16T19:10:28.026105] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-16T19:10:28.030945] [INFO ] [REMOTE ] KW: Full fetch complete (43766 records). [2025-09-16T19:10:28.031046] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-09-16T19:10:28.400266] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-09-16T19:10:28.416446] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-09-16T19:10:28.416536] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-09-16T19:10:28.417363] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-09-16T19:10:28.417411] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-09-16T19:10:28.418415] [DEBUG] [LOCAL ] KW: Trimmed 43766 records to 30155 (keeping 150 days of data) [2025-09-16T19:10:28.592503] [DEBUG] [LOCAL ] KW: Primary data saved (30155 records). [2025-09-16T19:10:28.592668] [INFO ] [MAIN ] KW: Full history saved. [2025-09-16T19:10:28.592779] [INFO ] [MAIN ] Update Progress: 1230/2369 symbols completed. KW took 15.8s. Estimated remaining: 2h 0m 47s. Rate: 9.4 symbols/min [2025-09-16T19:10:28.765232] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:10:28.787301] [DEBUG] [LOCAL ] KYN: Loaded 21836 existing records from primary storage. [2025-09-16T19:10:28.787438] [INFO ] [MAIN ] KYN: Loaded 21836 existing records. [2025-09-16T19:10:28.964374] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:10:28.964685] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-09-16T19:10:28.964735] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-09-16T19:10:28.965471] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-09-16T19:10:28.965520] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-09-16T19:10:29.174914] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-09-16T19:10:29.334669] [INFO ] [REMOTE ] KYN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:10:29.370934] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-16T19:10:29.402016] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-16T19:10:29.974911] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-09-16T19:10:30.774897] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-09-16T19:10:30.922381] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-16T19:10:30.950506] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-16T19:10:31.574900] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-09-16T19:10:32.374915] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-09-16T19:10:32.420204] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-16T19:10:32.426376] [INFO ] [REMOTE ] KVYO: Full fetch complete (54096 records). [2025-09-16T19:10:32.426465] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-09-16T19:10:32.808663] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-09-16T19:10:32.808794] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-09-16T19:10:32.809601] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-09-16T19:10:32.809658] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-09-16T19:10:32.810868] [DEBUG] [LOCAL ] KVYO: Trimmed 54096 records to 37611 (keeping 150 days of data) [2025-09-16T19:10:33.029606] [DEBUG] [LOCAL ] KVYO: Primary data saved (37611 records). [2025-09-16T19:10:33.029758] [INFO ] [MAIN ] KVYO: Full history saved. [2025-09-16T19:10:33.031339] [INFO ] [MAIN ] Update Progress: 1231/2369 symbols completed. KVYO took 25.8s. Estimated remaining: 2h 0m 38s. Rate: 9.4 symbols/min [2025-09-16T19:10:33.178400] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-09-16T19:10:33.201114] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:10:33.229112] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-16T19:10:33.239819] [INFO ] [REMOTE ] KVUE: Full fetch complete (58347 records). [2025-09-16T19:10:33.240034] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-09-16T19:10:33.448236] [DEBUG] [LOCAL ] L: Loaded 30026 existing records from primary storage. [2025-09-16T19:10:33.498194] [INFO ] [MAIN ] L: Loaded 30026 existing records. [2025-09-16T19:10:33.818897] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-09-16T19:10:33.838407] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:10:33.838538] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-09-16T19:10:33.839629] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-09-16T19:10:33.839767] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-09-16T19:10:33.839797] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-09-16T19:10:33.839981] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-09-16T19:10:33.840924] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-09-16T19:10:33.841123] [DEBUG] [LOCAL ] KVUE: Trimmed 58347 records to 40017 (keeping 150 days of data) [2025-09-16T19:10:33.841010] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-09-16T19:10:34.054423] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-16T19:10:34.193602] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-09-16T19:10:34.471291] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-16T19:10:34.516297] [INFO ] [REMOTE ] L: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:10:34.530789] [DEBUG] [LOCAL ] KVUE: Primary data saved (40017 records). [2025-09-16T19:10:34.530881] [INFO ] [MAIN ] KVUE: Full history saved. [2025-09-16T19:10:34.530957] [INFO ] [MAIN ] Update Progress: 1232/2369 symbols completed. KVUE took 31.8s. Estimated remaining: 2h 0m 28s. Rate: 9.4 symbols/min [2025-09-16T19:10:34.699036] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:10:34.734629] [DEBUG] [LOCAL ] LAC: Loaded 38655 existing records from primary storage. [2025-09-16T19:10:34.734795] [INFO ] [MAIN ] LAC: Loaded 38655 existing records. [2025-09-16T19:10:34.779997] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-09-16T19:10:34.935770] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:10:34.936037] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-09-16T19:10:34.936082] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-09-16T19:10:34.936958] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-09-16T19:10:34.937008] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-09-16T19:10:35.288843] [INFO ] [REMOTE ] LAC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:10:35.574904] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-09-16T19:10:35.713044] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-16T19:10:35.886174] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-16T19:10:36.374906] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-09-16T19:10:37.174898] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-09-16T19:10:37.322290] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-16T19:10:37.402170] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-16T19:10:37.974917] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-09-16T19:10:38.428513] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-16T19:10:38.770976] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-16T19:10:38.775026] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-09-16T19:10:39.574920] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-09-16T19:10:40.256574] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-16T19:10:40.374885] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-09-16T19:10:40.708779] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-16T19:10:41.174969] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-09-16T19:10:41.344870] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-16T19:10:41.974921] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-09-16T19:10:42.774922] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-09-16T19:10:43.094511] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-16T19:10:43.266563] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-16T19:10:43.574955] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-09-16T19:10:43.796961] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-16T19:10:44.374912] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-09-16T19:10:45.174960] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-09-16T19:10:45.496799] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-16T19:10:45.559170] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-16T19:10:45.974932] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-09-16T19:10:46.309236] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-16T19:10:46.774937] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-09-16T19:10:47.574918] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-09-16T19:10:47.684249] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-16T19:10:47.686606] [INFO ] [REMOTE ] KWR: Full fetch complete (18429 records). [2025-09-16T19:10:47.686738] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-09-16T19:10:48.070329] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-09-16T19:10:48.070503] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-09-16T19:10:48.070934] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-09-16T19:10:48.070986] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-09-16T19:10:48.071732] [DEBUG] [LOCAL ] KWR: Trimmed 18429 records to 12353 (keeping 150 days of data) [2025-09-16T19:10:48.166980] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-16T19:10:48.198109] [DEBUG] [LOCAL ] KWR: Primary data saved (12353 records). [2025-09-16T19:10:48.198248] [INFO ] [MAIN ] KWR: Full history saved. [2025-09-16T19:10:48.198352] [INFO ] [MAIN ] Update Progress: 1233/2369 symbols completed. KWR took 22.2s. Estimated remaining: 2h 0m 28s. Rate: 9.4 symbols/min [2025-09-16T19:10:48.366918] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:10:48.375940] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-09-16T19:10:48.384761] [DEBUG] [LOCAL ] LAD: Loaded 16862 existing records from primary storage. [2025-09-16T19:10:48.384903] [INFO ] [MAIN ] LAD: Loaded 16862 existing records. [2025-09-16T19:10:48.589964] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:10:48.591153] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-16T19:10:48.591382] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-09-16T19:10:48.594991] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-09-16T19:10:48.595236] [INFO ] [REMOTE ] KYN: Full fetch complete (33162 records). [2025-09-16T19:10:48.595312] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-09-16T19:10:48.595526] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-09-16T19:10:48.595582] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-09-16T19:10:49.175534] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-09-16T19:10:49.363866] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-09-16T19:10:49.363778] [INFO ] [REMOTE ] LAD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:10:49.364220] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-09-16T19:10:49.365042] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-09-16T19:10:49.365095] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-09-16T19:10:49.366016] [DEBUG] [LOCAL ] KYN: Trimmed 33162 records to 22074 (keeping 150 days of data) [2025-09-16T19:10:49.502263] [DEBUG] [LOCAL ] KYN: Primary data saved (22074 records). [2025-09-16T19:10:49.502400] [INFO ] [MAIN ] KYN: Full history saved. [2025-09-16T19:10:49.502492] [INFO ] [MAIN ] Update Progress: 1234/2369 symbols completed. KYN took 20.9s. Estimated remaining: 2h 0m 17s. Rate: 9.4 symbols/min [2025-09-16T19:10:49.675407] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:10:49.705131] [DEBUG] [LOCAL ] LADR: Loaded 28214 existing records from primary storage. [2025-09-16T19:10:49.705288] [INFO ] [MAIN ] LADR: Loaded 28214 existing records. [2025-09-16T19:10:49.897635] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:10:49.897984] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-09-16T19:10:49.898083] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-09-16T19:10:49.898779] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-09-16T19:10:49.898834] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-09-16T19:10:49.977636] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-09-16T19:10:50.262417] [INFO ] [REMOTE ] LADR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:10:50.291843] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-16T19:10:50.774924] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-09-16T19:10:50.893281] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-16T19:10:51.209488] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-16T19:10:51.574953] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-09-16T19:10:52.374894] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-09-16T19:10:52.771207] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-16T19:10:52.825744] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-16T19:10:53.174938] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-09-16T19:10:53.696808] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-16T19:10:53.974914] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-09-16T19:10:54.198733] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-16T19:10:54.774953] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-09-16T19:10:55.135740] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-16T19:10:55.574936] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-09-16T19:10:55.838305] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-16T19:10:56.374914] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-09-16T19:10:57.011583] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-16T19:10:57.174912] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-09-16T19:10:57.974908] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-09-16T19:10:58.518668] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-16T19:10:58.733395] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-16T19:10:58.774859] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-09-16T19:10:59.140148] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-16T19:10:59.574911] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-09-16T19:11:00.093874] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-16T19:11:00.374902] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-09-16T19:11:01.169225] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-16T19:11:01.177306] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-09-16T19:11:01.974900] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-09-16T19:11:02.299848] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-16T19:11:02.306292] [INFO ] [REMOTE ] LAC: Full fetch complete (56835 records). [2025-09-16T19:11:02.306457] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-09-16T19:11:02.663860] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-16T19:11:02.718819] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-09-16T19:11:02.718900] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-09-16T19:11:02.719777] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-09-16T19:11:02.719836] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-09-16T19:11:02.720993] [DEBUG] [LOCAL ] LAC: Trimmed 56835 records to 39040 (keeping 150 days of data) [2025-09-16T19:11:02.778716] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-09-16T19:11:02.951210] [DEBUG] [LOCAL ] LAC: Primary data saved (39040 records). [2025-09-16T19:11:02.951376] [INFO ] [MAIN ] LAC: Full history saved. [2025-09-16T19:11:02.951463] [INFO ] [MAIN ] Update Progress: 1235/2369 symbols completed. LAC took 28.4s. Estimated remaining: 2h 0m 17s. Rate: 9.4 symbols/min [2025-09-16T19:11:03.126505] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:11:03.129915] [DEBUG] [LOCAL ] LANV: Loaded 1908 existing records from primary storage. [2025-09-16T19:11:03.129995] [INFO ] [MAIN ] LANV: Loaded 1908 existing records. [2025-09-16T19:11:03.307307] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:11:03.307725] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-09-16T19:11:03.307809] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-09-16T19:11:03.308104] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-09-16T19:11:03.308238] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-09-16T19:11:03.428411] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-16T19:11:03.494079] [INFO ] [REMOTE ] L: Full fetch complete (44518 records). [2025-09-16T19:11:03.510420] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-09-16T19:11:03.578956] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-09-16T19:11:03.856635] [INFO ] [REMOTE ] LANV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:11:04.106714] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-09-16T19:11:04.106801] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-09-16T19:11:04.107505] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-09-16T19:11:04.107558] [DEBUG] [LOCAL ] L: Saving primary data. [2025-09-16T19:11:04.108660] [DEBUG] [LOCAL ] L: Trimmed 44518 records to 30321 (keeping 150 days of data) [2025-09-16T19:11:04.312481] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-16T19:11:04.338251] [DEBUG] [LOCAL ] L: Primary data saved (30321 records). [2025-09-16T19:11:04.338387] [INFO ] [MAIN ] L: Full history saved. [2025-09-16T19:11:04.339116] [INFO ] [MAIN ] Update Progress: 1236/2369 symbols completed. L took 31.3s. Estimated remaining: 2h 0m 6s. Rate: 9.4 symbols/min [2025-09-16T19:11:04.381426] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-09-16T19:11:04.510596] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:11:04.545427] [DEBUG] [LOCAL ] LAR: Loaded 33317 existing records from primary storage. [2025-09-16T19:11:04.545572] [INFO ] [MAIN ] LAR: Loaded 33317 existing records. [2025-09-16T19:11:04.719988] [WARN ] [MAIN ] LAR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:11:04.720252] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-09-16T19:11:04.720320] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-09-16T19:11:04.721152] [DEBUG] [LOCAL ] LAR: Deleted primary data file. [2025-09-16T19:11:04.721214] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-09-16T19:11:04.952664] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-16T19:11:05.103977] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-16T19:11:05.109035] [INFO ] [REMOTE ] LAR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:11:05.174911] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-09-16T19:11:05.974944] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-09-16T19:11:06.519993] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-16T19:11:06.726086] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-16T19:11:06.774850] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-09-16T19:11:07.574962] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-09-16T19:11:08.170267] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-16T19:11:08.374904] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-02. [2025-09-16T19:11:08.596545] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-16T19:11:09.174938] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-09-16T19:11:09.602970] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-16T19:11:09.982315] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-09-16T19:11:09.999265] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-16T19:11:10.774894] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-09-16T19:11:11.234114] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-16T19:11:11.556336] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-16T19:11:11.561178] [INFO ] [REMOTE ] LADR: Full fetch complete (41424 records). [2025-09-16T19:11:11.561279] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-09-16T19:11:11.582151] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-09-16T19:11:11.940673] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-09-16T19:11:11.940770] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-09-16T19:11:11.941434] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-09-16T19:11:11.941480] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-09-16T19:11:11.942567] [DEBUG] [LOCAL ] LADR: Trimmed 41424 records to 28533 (keeping 150 days of data) [2025-09-16T19:11:12.114826] [DEBUG] [LOCAL ] LADR: Primary data saved (28533 records). [2025-09-16T19:11:12.114973] [INFO ] [MAIN ] LADR: Full history saved. [2025-09-16T19:11:12.115059] [INFO ] [MAIN ] Update Progress: 1237/2369 symbols completed. LADR took 22.6s. Estimated remaining: 2h 0m 1s. Rate: 9.4 symbols/min [2025-09-16T19:11:12.374943] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-03. [2025-09-16T19:11:12.753670] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-16T19:11:13.174905] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-09-16T19:11:13.723950] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-16T19:11:13.974913] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-04. [2025-09-16T19:11:14.277404] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-16T19:11:14.280453] [INFO ] [REMOTE ] LAD: Full fetch complete (26576 records). [2025-09-16T19:11:14.280593] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-09-16T19:11:14.664300] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-09-16T19:11:14.664427] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-09-16T19:11:14.665095] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-09-16T19:11:14.665144] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-09-16T19:11:14.666089] [DEBUG] [LOCAL ] LAD: Trimmed 26576 records to 16994 (keeping 150 days of data) [2025-09-16T19:11:14.775868] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-09-16T19:11:14.778892] [DEBUG] [LOCAL ] LAD: Primary data saved (16994 records). [2025-09-16T19:11:14.780023] [INFO ] [MAIN ] LAD: Full history saved. [2025-09-16T19:11:14.780127] [INFO ] [MAIN ] Update Progress: 1238/2369 symbols completed. LAD took 26.6s. Estimated remaining: 1h 59m 51s. Rate: 9.4 symbols/min [2025-09-16T19:11:15.202956] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-16T19:11:15.574969] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-09-16T19:11:15.679530] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-16T19:11:16.139705] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-16T19:11:16.374900] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-09-16T19:11:16.931017] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-16T19:11:17.174958] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-09-16T19:11:17.769860] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-16T19:11:17.770951] [INFO ] [REMOTE ] LANV: Full fetch complete (2814 records). [2025-09-16T19:11:17.771020] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-09-16T19:11:17.980459] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-05. [2025-09-16T19:11:18.127102] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-09-16T19:11:18.127181] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-09-16T19:11:18.127293] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-09-16T19:11:18.127333] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-09-16T19:11:18.127699] [DEBUG] [LOCAL ] LANV: Trimmed 2814 records to 1929 (keeping 150 days of data) [2025-09-16T19:11:18.138674] [DEBUG] [LOCAL ] LANV: Primary data saved (1929 records). [2025-09-16T19:11:18.138737] [INFO ] [MAIN ] LANV: Full history saved. [2025-09-16T19:11:18.138819] [INFO ] [MAIN ] Update Progress: 1239/2369 symbols completed. LANV took 15.2s. Estimated remaining: 1h 59m 42s. Rate: 9.4 symbols/min [2025-09-16T19:11:19.632332] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-16T19:11:19.641870] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-06. [2025-09-16T19:11:21.201118] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-16T19:11:21.210305] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-07. [2025-09-16T19:11:22.895508] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-16T19:11:22.906991] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-08. [2025-09-16T19:11:24.339477] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-16T19:11:24.349713] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-09. [2025-09-16T19:11:25.918481] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-16T19:11:25.924341] [INFO ] [REMOTE ] LAR: Full fetch complete (48912 records). [2025-09-16T19:11:25.924469] [DEBUG] [VALIDATOR ] LAR: Validating primary data. [2025-09-16T19:11:26.308304] [DEBUG] [VALIDATOR ] LAR: All expected trading days are present. [2025-09-16T19:11:26.308386] [DEBUG] [VALIDATOR ] LAR: Primary data validation passed. [2025-09-16T19:11:26.309143] [INFO ] [MAIN ] LAR: Fetched primary data is valid. [2025-09-16T19:11:26.309189] [DEBUG] [LOCAL ] LAR: Saving primary data. [2025-09-16T19:11:26.310285] [DEBUG] [LOCAL ] LAR: Trimmed 48912 records to 33661 (keeping 150 days of data) [2025-09-16T19:11:26.507275] [DEBUG] [LOCAL ] LAR: Primary data saved (33661 records). [2025-09-16T19:11:26.507429] [INFO ] [MAIN ] LAR: Full history saved. [2025-09-16T19:11:26.508135] [INFO ] [MAIN ] Update Progress: 1240/2369 symbols completed. LAR took 22.2s. Estimated remaining: 1h 59m 38s. Rate: 9.4 symbols/min [2025-09-16T19:11:27.169084] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:11:27.201521] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:11:27.228332] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:11:27.261699] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:11:27.274029] [DEBUG] [LOCAL ] LAW: Loaded 10545 existing records from primary storage. [2025-09-16T19:11:27.274343] [INFO ] [MAIN ] LAW: Loaded 10545 existing records. [2025-09-16T19:11:27.464016] [DEBUG] [LOCAL ] LB: Loaded 27501 existing records from primary storage. [2025-09-16T19:11:27.511580] [DEBUG] [LOCAL ] LAZ: Loaded 33117 existing records from primary storage. [2025-09-16T19:11:27.511141] [INFO ] [MAIN ] LB: Loaded 27501 existing records. [2025-09-16T19:11:27.510693] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:11:27.511730] [INFO ] [MAIN ] LAZ: Loaded 33117 existing records. [2025-09-16T19:11:27.573256] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-09-16T19:11:27.583707] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-09-16T19:11:27.589561] [DEBUG] [LOCAL ] LBRT: Loaded 39012 existing records from primary storage. [2025-09-16T19:11:27.632249] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-09-16T19:11:27.650867] [INFO ] [MAIN ] LBRT: Loaded 39012 existing records. [2025-09-16T19:11:27.669709] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-09-16T19:11:28.246491] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:11:28.264368] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:11:28.330946] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-09-16T19:11:28.336586] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-09-16T19:11:28.390543] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-09-16T19:11:28.400940] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-09-16T19:11:28.415532] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:11:28.435150] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-09-16T19:11:28.435269] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-09-16T19:11:28.435329] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-09-16T19:11:28.445782] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-09-16T19:11:28.485011] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-09-16T19:11:28.467201] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-09-16T19:11:28.539864] [INFO ] [REMOTE ] LAW: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:11:28.563143] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-09-16T19:11:28.624761] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-09-16T19:11:28.683476] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-09-16T19:11:29.604184] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:11:29.675952] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-09-16T19:11:29.707160] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:11:29.742176] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-09-16T19:11:29.727422] [INFO ] [REMOTE ] LB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:11:29.743275] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-09-16T19:11:29.747784] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-16T19:11:29.754284] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-09-16T19:11:30.619221] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-16T19:11:30.623115] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-09-16T19:11:31.188957] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-16T19:11:31.193015] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-09-16T19:11:31.217170] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-16T19:11:31.226611] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-09-16T19:11:31.361910] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-16T19:11:31.371023] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-09-16T19:11:31.416565] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-16T19:11:31.426690] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-09-16T19:11:32.171419] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-16T19:11:32.175113] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-09-16T19:11:32.828890] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-16T19:11:32.837618] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-09-16T19:11:33.013278] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-16T19:11:33.023294] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-09-16T19:11:33.066717] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-16T19:11:33.080084] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-09-16T19:11:33.096410] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-16T19:11:33.174897] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-09-16T19:11:34.170070] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-16T19:11:34.173850] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-09-16T19:11:34.317427] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-16T19:11:34.635085] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-16T19:11:34.774873] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-09-16T19:11:34.861837] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-16T19:11:34.953990] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-16T19:11:35.574927] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-09-16T19:11:36.374918] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-09-16T19:11:36.431436] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-16T19:11:36.885300] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-16T19:11:37.174916] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-09-16T19:11:37.395176] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-16T19:11:37.974893] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-09-16T19:11:38.435728] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-16T19:11:38.774830] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-09-16T19:11:39.574868] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-09-16T19:11:39.678051] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-16T19:11:40.186325] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-16T19:11:40.374855] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-09-16T19:11:41.165738] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-16T19:11:41.175485] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-09-16T19:11:41.579612] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-16T19:11:41.800758] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-16T19:11:41.802964] [INFO ] [REMOTE ] LAW: Full fetch complete (15466 records). [2025-09-16T19:11:41.803079] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-09-16T19:11:41.980272] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-09-16T19:11:42.172521] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-09-16T19:11:42.172601] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-09-16T19:11:42.173050] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-09-16T19:11:42.173122] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-09-16T19:11:42.174196] [DEBUG] [LOCAL ] LAW: Trimmed 15466 records to 10628 (keeping 150 days of data) [2025-09-16T19:11:42.236490] [DEBUG] [LOCAL ] LAW: Primary data saved (10628 records). [2025-09-16T19:11:42.236663] [INFO ] [MAIN ] LAW: Full history saved. [2025-09-16T19:11:42.236806] [INFO ] [MAIN ] Update Progress: 1241/2369 symbols completed. LAW took 15.7s. Estimated remaining: 1h 59m 40s. Rate: 9.4 symbols/min [2025-09-16T19:11:42.413131] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:11:42.456837] [DEBUG] [LOCAL ] LC: Loaded 35229 existing records from primary storage. [2025-09-16T19:11:42.457000] [INFO ] [MAIN ] LC: Loaded 35229 existing records. [2025-09-16T19:11:42.648341] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:11:42.648617] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-09-16T19:11:42.648689] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-09-16T19:11:42.649410] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-09-16T19:11:42.649470] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-09-16T19:11:42.780148] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-09-16T19:11:43.026990] [INFO ] [REMOTE ] LC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:11:43.556529] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-16T19:11:43.574844] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-09-16T19:11:44.374913] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-09-16T19:11:44.769815] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-16T19:11:44.995149] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-16T19:11:44.999666] [INFO ] [REMOTE ] LB: Full fetch complete (41404 records). [2025-09-16T19:11:44.999763] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-09-16T19:11:45.179711] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-09-16T19:11:45.382857] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-09-16T19:11:45.382958] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-09-16T19:11:45.383747] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-09-16T19:11:45.383853] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-09-16T19:11:45.384815] [DEBUG] [LOCAL ] LB: Trimmed 41404 records to 27672 (keeping 150 days of data) [2025-09-16T19:11:45.561147] [DEBUG] [LOCAL ] LB: Primary data saved (27672 records). [2025-09-16T19:11:45.561306] [INFO ] [MAIN ] LB: Full history saved. [2025-09-16T19:11:45.561419] [INFO ] [MAIN ] Update Progress: 1242/2369 symbols completed. LB took 19.1s. Estimated remaining: 1h 59m 31s. Rate: 9.4 symbols/min [2025-09-16T19:11:45.735153] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:11:45.755813] [DEBUG] [LOCAL ] LCII: Loaded 20124 existing records from primary storage. [2025-09-16T19:11:45.755962] [INFO ] [MAIN ] LCII: Loaded 20124 existing records. [2025-09-16T19:11:45.932941] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:11:45.933233] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-09-16T19:11:45.933298] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-09-16T19:11:45.934188] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-09-16T19:11:45.934303] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-09-16T19:11:45.997875] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-09-16T19:11:46.253565] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-16T19:11:46.350562] [INFO ] [REMOTE ] LCII: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:11:46.676435] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-16T19:11:46.774865] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-09-16T19:11:47.574984] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-09-16T19:11:47.760216] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-16T19:11:47.910858] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-16T19:11:48.374901] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-09-16T19:11:49.060321] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-16T19:11:49.067343] [INFO ] [REMOTE ] LAZ: Full fetch complete (49565 records). [2025-09-16T19:11:49.067506] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-09-16T19:11:49.180021] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-09-16T19:11:49.454326] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-09-16T19:11:49.454449] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-09-16T19:11:49.455246] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-09-16T19:11:49.455303] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-09-16T19:11:49.456681] [DEBUG] [LOCAL ] LAZ: Trimmed 49565 records to 33463 (keeping 150 days of data) [2025-09-16T19:11:49.669453] [DEBUG] [LOCAL ] LAZ: Primary data saved (33463 records). [2025-09-16T19:11:49.669606] [INFO ] [MAIN ] LAZ: Full history saved. [2025-09-16T19:11:49.669719] [INFO ] [MAIN ] Update Progress: 1243/2369 symbols completed. LAZ took 23.2s. Estimated remaining: 1h 59m 22s. Rate: 9.4 symbols/min [2025-09-16T19:11:49.842924] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:11:49.876012] [DEBUG] [LOCAL ] LDI: Loaded 31881 existing records from primary storage. [2025-09-16T19:11:49.876184] [INFO ] [MAIN ] LDI: Loaded 31881 existing records. [2025-09-16T19:11:49.978968] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-09-16T19:11:50.057471] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:11:50.057876] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-09-16T19:11:50.057963] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-09-16T19:11:50.058582] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-09-16T19:11:50.058629] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-09-16T19:11:50.384196] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-16T19:11:50.481132] [INFO ] [REMOTE ] LDI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:11:50.774926] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-09-16T19:11:51.047710] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-16T19:11:51.055629] [INFO ] [REMOTE ] LBRT: Full fetch complete (57542 records). [2025-09-16T19:11:51.055791] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-09-16T19:11:51.440614] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-09-16T19:11:51.440756] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-09-16T19:11:51.441669] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-09-16T19:11:51.441755] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-09-16T19:11:51.443187] [DEBUG] [LOCAL ] LBRT: Trimmed 57542 records to 39400 (keeping 150 days of data) [2025-09-16T19:11:51.524091] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-16T19:11:51.574927] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-09-16T19:11:51.717821] [DEBUG] [LOCAL ] LBRT: Primary data saved (39400 records). [2025-09-16T19:11:51.718026] [INFO ] [MAIN ] LBRT: Full history saved. [2025-09-16T19:11:51.718127] [INFO ] [MAIN ] Update Progress: 1244/2369 symbols completed. LBRT took 25.2s. Estimated remaining: 1h 59m 12s. Rate: 9.4 symbols/min [2025-09-16T19:11:51.890312] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:11:51.926652] [DEBUG] [LOCAL ] LDOS: Loaded 33182 existing records from primary storage. [2025-09-16T19:11:51.926803] [INFO ] [MAIN ] LDOS: Loaded 33182 existing records. [2025-09-16T19:11:52.101305] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:11:52.101557] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-09-16T19:11:52.101610] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-09-16T19:11:52.102433] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-09-16T19:11:52.102480] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-09-16T19:11:52.379281] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-09-16T19:11:52.457300] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:11:52.503311] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-16T19:11:53.055882] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-16T19:11:53.174952] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-09-16T19:11:53.684389] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-16T19:11:53.974909] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-09-16T19:11:54.774875] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-09-16T19:11:54.880865] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-16T19:11:55.100757] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-16T19:11:55.574898] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-09-16T19:11:56.374930] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-09-16T19:11:56.502960] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-16T19:11:57.065580] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-16T19:11:57.174903] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-09-16T19:11:57.974925] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-09-16T19:11:58.110498] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-16T19:11:58.590437] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-16T19:11:58.774924] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-09-16T19:11:59.018919] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-16T19:11:59.574938] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-09-16T19:12:00.259573] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-16T19:12:00.374876] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-09-16T19:12:00.818846] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-16T19:12:01.174930] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-09-16T19:12:01.951329] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-16T19:12:01.974868] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-09-16T19:12:02.104051] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-16T19:12:02.774902] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-09-16T19:12:03.574889] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-09-16T19:12:03.829466] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-16T19:12:03.972451] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-16T19:12:04.374917] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-09-16T19:12:05.022753] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-16T19:12:05.174949] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-09-16T19:12:05.974898] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-09-16T19:12:06.023891] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-16T19:12:06.774923] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-09-16T19:12:06.865259] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-16T19:12:07.575030] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-09-16T19:12:07.756079] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-16T19:12:08.342390] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-16T19:12:08.348398] [INFO ] [REMOTE ] LC: Full fetch complete (52437 records). [2025-09-16T19:12:08.348562] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-09-16T19:12:08.380962] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-09-16T19:12:08.761619] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-09-16T19:12:08.761718] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-09-16T19:12:08.762663] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-09-16T19:12:08.762709] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-09-16T19:12:08.763944] [DEBUG] [LOCAL ] LC: Trimmed 52437 records to 35580 (keeping 150 days of data) [2025-09-16T19:12:09.002043] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-16T19:12:09.023046] [DEBUG] [LOCAL ] LC: Primary data saved (35580 records). [2025-09-16T19:12:09.023210] [INFO ] [MAIN ] LC: Full history saved. [2025-09-16T19:12:09.023297] [INFO ] [MAIN ] Update Progress: 1245/2369 symbols completed. LC took 26.8s. Estimated remaining: 1h 59m 16s. Rate: 9.4 symbols/min [2025-09-16T19:12:09.182022] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-09-16T19:12:09.201088] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:12:09.213585] [DEBUG] [LOCAL ] LDP: Loaded 9342 existing records from primary storage. [2025-09-16T19:12:09.213778] [INFO ] [MAIN ] LDP: Loaded 9342 existing records. [2025-09-16T19:12:09.408257] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:12:09.408575] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-09-16T19:12:09.408634] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-09-16T19:12:09.409095] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-09-16T19:12:09.409150] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-09-16T19:12:09.841487] [INFO ] [REMOTE ] LDP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:12:09.927052] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-16T19:12:09.974932] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-09-16T19:12:10.319935] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-16T19:12:10.322850] [INFO ] [REMOTE ] LCII: Full fetch complete (30976 records). [2025-09-16T19:12:10.322943] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-09-16T19:12:10.701007] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-09-16T19:12:10.701086] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-09-16T19:12:10.701701] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-09-16T19:12:10.701744] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-09-16T19:12:10.702429] [DEBUG] [LOCAL ] LCII: Trimmed 30976 records to 20266 (keeping 150 days of data) [2025-09-16T19:12:10.792193] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-09-16T19:12:10.828809] [DEBUG] [LOCAL ] LCII: Primary data saved (20266 records). [2025-09-16T19:12:10.828936] [INFO ] [MAIN ] LCII: Full history saved. [2025-09-16T19:12:10.829036] [INFO ] [MAIN ] Update Progress: 1246/2369 symbols completed. LCII took 25.3s. Estimated remaining: 1h 59m 5s. Rate: 9.4 symbols/min [2025-09-16T19:12:10.997071] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:12:11.031474] [DEBUG] [LOCAL ] LEA: Loaded 30256 existing records from primary storage. [2025-09-16T19:12:11.031612] [INFO ] [MAIN ] LEA: Loaded 30256 existing records. [2025-09-16T19:12:11.209692] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:12:11.209936] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-09-16T19:12:11.209982] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-09-16T19:12:11.210744] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-09-16T19:12:11.210804] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-09-16T19:12:11.576774] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-09-16T19:12:11.582733] [INFO ] [REMOTE ] LEA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:12:11.616119] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-16T19:12:12.374874] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-09-16T19:12:12.434904] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-16T19:12:12.686084] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-16T19:12:12.692390] [INFO ] [REMOTE ] LDI: Full fetch complete (46391 records). [2025-09-16T19:12:12.692543] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-09-16T19:12:13.066097] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-09-16T19:12:13.066176] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-09-16T19:12:13.066902] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-09-16T19:12:13.066947] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-09-16T19:12:13.067967] [DEBUG] [LOCAL ] LDI: Trimmed 46391 records to 32271 (keeping 150 days of data) [2025-09-16T19:12:13.180392] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-09-16T19:12:13.253342] [DEBUG] [LOCAL ] LDI: Primary data saved (32271 records). [2025-09-16T19:12:13.253491] [INFO ] [MAIN ] LDI: Full history saved. [2025-09-16T19:12:13.253588] [INFO ] [MAIN ] Update Progress: 1247/2369 symbols completed. LDI took 23.6s. Estimated remaining: 1h 58m 55s. Rate: 9.4 symbols/min [2025-09-16T19:12:13.422662] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:12:13.422833] [DEBUG] [LOCAL ] LEG: No existing data file found in primary storage. [2025-09-16T19:12:13.422871] [WARN ] [MAIN ] LEG: No existing data found, performing full refresh instead. [2025-09-16T19:12:13.422995] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-09-16T19:12:13.423036] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-09-16T19:12:13.423079] [DEBUG] [LOCAL ] LEG: No primary data file found to delete. [2025-09-16T19:12:13.423113] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-09-16T19:12:13.794661] [INFO ] [REMOTE ] LEG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:12:13.817602] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-16T19:12:13.974908] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-09-16T19:12:14.109368] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-16T19:12:14.774928] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-09-16T19:12:15.548373] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-16T19:12:15.574883] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-09-16T19:12:15.668102] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-16T19:12:16.374907] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-09-16T19:12:17.033516] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-16T19:12:17.174920] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-09-16T19:12:17.977067] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-09-16T19:12:17.982452] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-16T19:12:18.642944] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-16T19:12:18.648436] [INFO ] [REMOTE ] LDOS: Full fetch complete (50528 records). [2025-09-16T19:12:18.648603] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-09-16T19:12:18.790154] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-09-16T19:12:19.025186] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-09-16T19:12:19.025267] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-09-16T19:12:19.026096] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-09-16T19:12:19.026162] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-09-16T19:12:19.027229] [DEBUG] [LOCAL ] LDOS: Trimmed 50528 records to 33529 (keeping 150 days of data) [2025-09-16T19:12:19.258818] [DEBUG] [LOCAL ] LDOS: Primary data saved (33529 records). [2025-09-16T19:12:19.258958] [INFO ] [MAIN ] LDOS: Full history saved. [2025-09-16T19:12:19.259962] [INFO ] [MAIN ] Update Progress: 1248/2369 symbols completed. LDOS took 27.5s. Estimated remaining: 1h 58m 49s. Rate: 9.4 symbols/min [2025-09-16T19:12:19.431491] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:12:19.474503] [DEBUG] [LOCAL ] LEN: Loaded 39223 existing records from primary storage. [2025-09-16T19:12:19.474661] [INFO ] [MAIN ] LEN: Loaded 39223 existing records. [2025-09-16T19:12:19.576864] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-09-16T19:12:19.655094] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:12:19.655401] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-09-16T19:12:19.655501] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-09-16T19:12:19.656328] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-09-16T19:12:19.656389] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-09-16T19:12:20.040150] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-16T19:12:20.038466] [INFO ] [REMOTE ] LEN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:12:20.319285] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-16T19:12:20.374863] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-09-16T19:12:20.499962] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-16T19:12:21.174904] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-09-16T19:12:21.816064] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-16T19:12:21.974933] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-09-16T19:12:22.777428] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-09-16T19:12:22.780608] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-16T19:12:22.940429] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-16T19:12:23.574932] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-09-16T19:12:24.300788] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-16T19:12:24.374943] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-09-16T19:12:24.545557] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-16T19:12:25.174904] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-09-16T19:12:25.974893] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-09-16T19:12:26.254334] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-16T19:12:26.594573] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-16T19:12:26.774917] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-09-16T19:12:26.837854] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-16T19:12:27.574914] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-09-16T19:12:28.374889] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-09-16T19:12:28.510515] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-16T19:12:29.174955] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-09-16T19:12:29.530106] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-16T19:12:29.574860] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-16T19:12:29.974941] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-09-16T19:12:30.780476] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-09-16T19:12:30.800950] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-16T19:12:31.440931] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-16T19:12:31.574904] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-09-16T19:12:31.894845] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-16T19:12:31.900170] [INFO ] [REMOTE ] LEA: Full fetch complete (45333 records). [2025-09-16T19:12:31.900274] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-09-16T19:12:32.322259] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-09-16T19:12:32.322384] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-09-16T19:12:32.323110] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-09-16T19:12:32.323157] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-09-16T19:12:32.324278] [DEBUG] [LOCAL ] LEA: Trimmed 45333 records to 30603 (keeping 150 days of data) [2025-09-16T19:12:32.386087] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-09-16T19:12:32.564094] [DEBUG] [LOCAL ] LEA: Primary data saved (30603 records). [2025-09-16T19:12:32.564259] [INFO ] [MAIN ] LEA: Full history saved. [2025-09-16T19:12:32.564358] [INFO ] [MAIN ] Update Progress: 1249/2369 symbols completed. LEA took 21.7s. Estimated remaining: 1h 58m 48s. Rate: 9.4 symbols/min [2025-09-16T19:12:32.709470] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-16T19:12:32.753084] [INFO ] [REMOTE ] LDP: Full fetch complete (14178 records). [2025-09-16T19:12:32.760480] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-09-16T19:12:32.786005] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:12:32.992777] [DEBUG] [LOCAL ] LEO: Loaded 11897 existing records from primary storage. [2025-09-16T19:12:33.060428] [INFO ] [MAIN ] LEO: Loaded 11897 existing records. [2025-09-16T19:12:33.183626] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-09-16T19:12:33.311630] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-09-16T19:12:33.321971] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-09-16T19:12:33.337706] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-09-16T19:12:33.372278] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-09-16T19:12:33.394231] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:12:33.394769] [DEBUG] [LOCAL ] LDP: Trimmed 14178 records to 9457 (keeping 150 days of data) [2025-09-16T19:12:33.395249] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-09-16T19:12:33.395302] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-09-16T19:12:33.396071] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-09-16T19:12:33.396122] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-09-16T19:12:33.838858] [DEBUG] [LOCAL ] LDP: Primary data saved (9457 records). [2025-09-16T19:12:33.856851] [INFO ] [MAIN ] LDP: Full history saved. [2025-09-16T19:12:33.876490] [INFO ] [REMOTE ] LEO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:12:33.876696] [INFO ] [MAIN ] Update Progress: 1250/2369 symbols completed. LDP took 24.9s. Estimated remaining: 1h 58m 38s. Rate: 9.4 symbols/min [2025-09-16T19:12:33.985882] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-09-16T19:12:34.059942] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:12:34.096287] [DEBUG] [LOCAL ] LEVI: Loaded 37969 existing records from primary storage. [2025-09-16T19:12:34.096457] [INFO ] [MAIN ] LEVI: Loaded 37969 existing records. [2025-09-16T19:12:34.275234] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:12:34.275530] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-09-16T19:12:34.275613] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-09-16T19:12:34.276491] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-09-16T19:12:34.276544] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-09-16T19:12:34.559787] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-16T19:12:34.685837] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:12:34.765874] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-16T19:12:34.776607] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-09-16T19:12:35.061984] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-16T19:12:35.574892] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-09-16T19:12:36.349227] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-16T19:12:36.374861] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-09-16T19:12:37.174890] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-09-16T19:12:37.347997] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-16T19:12:37.974907] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-09-16T19:12:38.125710] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-16T19:12:38.774883] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-09-16T19:12:39.019499] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-16T19:12:39.081913] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-16T19:12:39.574924] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-09-16T19:12:40.349106] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-16T19:12:40.355084] [INFO ] [REMOTE ] LEG: Full fetch complete (54874 records). [2025-09-16T19:12:40.355185] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-09-16T19:12:40.380025] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-09-16T19:12:40.772051] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-09-16T19:12:40.772291] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-09-16T19:12:40.773127] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-09-16T19:12:40.773182] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-09-16T19:12:40.788696] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-16T19:12:40.788137] [DEBUG] [LOCAL ] LEG: Trimmed 54874 records to 37283 (keeping 150 days of data) [2025-09-16T19:12:41.025459] [DEBUG] [LOCAL ] LEG: Primary data saved (37283 records). [2025-09-16T19:12:41.025619] [INFO ] [MAIN ] LEG: Full history saved. [2025-09-16T19:12:41.025719] [INFO ] [MAIN ] Update Progress: 1251/2369 symbols completed. LEG took 27.8s. Estimated remaining: 1h 58m 32s. Rate: 9.4 symbols/min [2025-09-16T19:12:41.174943] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-09-16T19:12:41.198327] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:12:41.212689] [DEBUG] [LOCAL ] LFT: Loaded 13970 existing records from primary storage. [2025-09-16T19:12:41.212813] [INFO ] [MAIN ] LFT: Loaded 13970 existing records. [2025-09-16T19:12:41.386968] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:12:41.387244] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-09-16T19:12:41.387290] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-09-16T19:12:41.387829] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-09-16T19:12:41.387879] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-09-16T19:12:41.739330] [INFO ] [REMOTE ] LFT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:12:41.974857] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-09-16T19:12:42.099942] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-16T19:12:42.371471] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-16T19:12:42.483631] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-16T19:12:42.774898] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-09-16T19:12:43.574912] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-09-16T19:12:44.236973] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-16T19:12:44.374905] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-09-16T19:12:45.174897] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-09-16T19:12:45.610707] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-16T19:12:45.974888] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-09-16T19:12:46.177419] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-16T19:12:46.198423] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-16T19:12:46.774917] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-09-16T19:12:46.876433] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-16T19:12:47.574934] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-09-16T19:12:47.750820] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-16T19:12:48.374948] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-09-16T19:12:49.174898] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-09-16T19:12:49.772890] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-16T19:12:49.779283] [INFO ] [REMOTE ] LEN: Full fetch complete (57811 records). [2025-09-16T19:12:49.779383] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-09-16T19:12:49.980156] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-09-16T19:12:50.091549] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-16T19:12:50.115477] [INFO ] [REMOTE ] LEO: Full fetch complete (19620 records). [2025-09-16T19:12:50.144119] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-09-16T19:12:50.222847] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-09-16T19:12:50.223113] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-09-16T19:12:50.231161] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-09-16T19:12:50.231319] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-09-16T19:12:50.299027] [DEBUG] [LOCAL ] LEN: Trimmed 57811 records to 39613 (keeping 150 days of data) [2025-09-16T19:12:50.662784] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-09-16T19:12:50.663147] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-09-16T19:12:50.663863] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-09-16T19:12:50.664252] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-09-16T19:12:50.667438] [DEBUG] [LOCAL ] LEO: Trimmed 19620 records to 12057 (keeping 150 days of data) [2025-09-16T19:12:50.757343] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-09-16T19:12:50.775596] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-09-16T19:12:50.860118] [DEBUG] [LOCAL ] LEO: Primary data saved (12057 records). [2025-09-16T19:12:50.868730] [INFO ] [MAIN ] LEO: Full history saved. [2025-09-16T19:12:50.868855] [INFO ] [MAIN ] Update Progress: 1252/2369 symbols completed. LEO took 18.3s. Estimated remaining: 1h 58m 29s. Rate: 9.4 symbols/min [2025-09-16T19:12:51.075607] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:12:51.090657] [DEBUG] [LOCAL ] LGI: Loaded 7281 existing records from primary storage. [2025-09-16T19:12:51.091864] [INFO ] [MAIN ] LGI: Loaded 7281 existing records. [2025-09-16T19:12:51.194079] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-16T19:12:51.301839] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:12:51.313306] [DEBUG] [LOCAL ] LEN: Primary data saved (39613 records). [2025-09-16T19:12:51.313482] [INFO ] [MAIN ] LEN: Full history saved. [2025-09-16T19:12:51.314302] [INFO ] [MAIN ] Update Progress: 1253/2369 symbols completed. LEN took 32.1s. Estimated remaining: 1h 58m 17s. Rate: 9.4 symbols/min [2025-09-16T19:12:51.313376] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-09-16T19:12:51.357505] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-09-16T19:12:51.416416] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-09-16T19:12:51.416570] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-09-16T19:12:51.587943] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-09-16T19:12:51.594186] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:12:51.891032] [DEBUG] [LOCAL ] LH: Loaded 27924 existing records from primary storage. [2025-09-16T19:12:51.907037] [INFO ] [MAIN ] LH: Loaded 27924 existing records. [2025-09-16T19:12:51.909946] [INFO ] [REMOTE ] LGI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:12:52.097587] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:12:52.097867] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-09-16T19:12:52.097913] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-09-16T19:12:52.098684] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-09-16T19:12:52.098741] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-09-16T19:12:52.375993] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-09-16T19:12:52.484985] [INFO ] [REMOTE ] LH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:12:52.517023] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-16T19:12:52.615050] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-16T19:12:53.174901] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-09-16T19:12:53.210597] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-16T19:12:53.974906] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-09-16T19:12:54.778393] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-09-16T19:12:54.783000] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-16T19:12:55.509952] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-16T19:12:55.579463] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-09-16T19:12:55.583275] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-16T19:12:56.374908] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-09-16T19:12:57.172016] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-16T19:12:57.175008] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-09-16T19:12:57.677610] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-16T19:12:57.974900] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-09-16T19:12:58.371062] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-16T19:12:58.774972] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-09-16T19:12:59.574927] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-09-16T19:12:59.758126] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-16T19:12:59.799939] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-16T19:13:00.081975] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-16T19:13:00.374929] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-09-16T19:13:01.174879] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-09-16T19:13:01.269831] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-16T19:13:01.271815] [INFO ] [REMOTE ] LFT: Full fetch complete (18600 records). [2025-09-16T19:13:01.271884] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-09-16T19:13:01.635084] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-09-16T19:13:01.635166] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-09-16T19:13:01.635606] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-09-16T19:13:01.635673] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-09-16T19:13:01.636286] [DEBUG] [LOCAL ] LFT: Trimmed 18600 records to 14075 (keeping 150 days of data) [2025-09-16T19:13:01.727010] [DEBUG] [LOCAL ] LFT: Primary data saved (14075 records). [2025-09-16T19:13:01.727180] [INFO ] [MAIN ] LFT: Full history saved. [2025-09-16T19:13:01.727286] [INFO ] [MAIN ] Update Progress: 1254/2369 symbols completed. LFT took 20.7s. Estimated remaining: 1h 58m 14s. Rate: 9.4 symbols/min [2025-09-16T19:13:01.914850] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:13:01.951968] [DEBUG] [LOCAL ] LHX: Loaded 36187 existing records from primary storage. [2025-09-16T19:13:01.952129] [INFO ] [MAIN ] LHX: Loaded 36187 existing records. [2025-09-16T19:13:01.982989] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-09-16T19:13:02.107942] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-16T19:13:02.146017] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:13:02.146282] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-09-16T19:13:02.146331] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-09-16T19:13:02.147256] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-09-16T19:13:02.147306] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-09-16T19:13:02.499704] [INFO ] [REMOTE ] LHX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:13:02.774892] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-09-16T19:13:03.574905] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-09-16T19:13:03.653903] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-16T19:13:04.064568] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-16T19:13:04.374907] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-09-16T19:13:05.174909] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-09-16T19:13:05.282730] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-16T19:13:05.892397] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-16T19:13:05.974888] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-09-16T19:13:06.155759] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-16T19:13:06.774992] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-09-16T19:13:06.920060] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-16T19:13:07.574895] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-09-16T19:13:08.374917] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-09-16T19:13:08.404493] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-16T19:13:08.410771] [INFO ] [REMOTE ] LEVI: Full fetch complete (55933 records). [2025-09-16T19:13:08.410882] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-09-16T19:13:08.801351] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-09-16T19:13:08.801444] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-09-16T19:13:08.802393] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-09-16T19:13:08.802525] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-09-16T19:13:08.803989] [DEBUG] [LOCAL ] LEVI: Trimmed 55933 records to 38348 (keeping 150 days of data) [2025-09-16T19:13:08.917479] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-16T19:13:09.069677] [DEBUG] [LOCAL ] LEVI: Primary data saved (38348 records). [2025-09-16T19:13:09.069841] [INFO ] [MAIN ] LEVI: Full history saved. [2025-09-16T19:13:09.069956] [INFO ] [MAIN ] Update Progress: 1255/2369 symbols completed. LEVI took 35.2s. Estimated remaining: 1h 58m 9s. Rate: 9.4 symbols/min [2025-09-16T19:13:09.180095] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-09-16T19:13:09.244556] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:13:09.264175] [DEBUG] [LOCAL ] LII: Loaded 20183 existing records from primary storage. [2025-09-16T19:13:09.264301] [INFO ] [MAIN ] LII: Loaded 20183 existing records. [2025-09-16T19:13:09.442158] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:13:09.442425] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-09-16T19:13:09.442473] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-09-16T19:13:09.443155] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-09-16T19:13:09.443209] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-09-16T19:13:09.804094] [INFO ] [REMOTE ] LII: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:13:09.974866] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-09-16T19:13:10.274278] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-16T19:13:10.774909] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-09-16T19:13:11.311574] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-16T19:13:11.338479] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-16T19:13:11.574948] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-09-16T19:13:12.374915] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-09-16T19:13:12.681775] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-16T19:13:13.130798] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-16T19:13:13.132257] [INFO ] [REMOTE ] LGI: Full fetch complete (11050 records). [2025-09-16T19:13:13.132325] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-09-16T19:13:13.175689] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-09-16T19:13:13.520270] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-09-16T19:13:13.520370] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-09-16T19:13:13.520620] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-09-16T19:13:13.521147] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-09-16T19:13:13.521990] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-16T19:13:13.531160] [DEBUG] [LOCAL ] LGI: Trimmed 11050 records to 7314 (keeping 150 days of data) [2025-09-16T19:13:13.577318] [DEBUG] [LOCAL ] LGI: Primary data saved (7314 records). [2025-09-16T19:13:13.577427] [INFO ] [MAIN ] LGI: Full history saved. [2025-09-16T19:13:13.577522] [INFO ] [MAIN ] Update Progress: 1256/2369 symbols completed. LGI took 22.7s. Estimated remaining: 1h 58m 1s. Rate: 9.4 symbols/min [2025-09-16T19:13:13.746581] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:13:13.778443] [DEBUG] [LOCAL ] LION: Loaded 35366 existing records from primary storage. [2025-09-16T19:13:13.778576] [INFO ] [MAIN ] LION: Loaded 35366 existing records. [2025-09-16T19:13:13.956716] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:13:13.956938] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-09-16T19:13:13.956984] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-09-16T19:13:13.957689] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-09-16T19:13:13.957741] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-09-16T19:13:13.980046] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-09-16T19:13:14.333347] [INFO ] [REMOTE ] LION: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:13:14.687819] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-16T19:13:14.774863] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-09-16T19:13:15.574889] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-09-16T19:13:15.968473] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-16T19:13:16.245784] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-16T19:13:16.279363] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-16T19:13:16.374929] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-09-16T19:13:17.174983] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-09-16T19:13:17.740234] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-16T19:13:17.974991] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-09-16T19:13:18.774926] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-09-16T19:13:18.868879] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-16T19:13:19.575015] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-09-16T19:13:19.840778] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-16T19:13:19.963013] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-16T19:13:20.374916] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-09-16T19:13:20.505312] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-16T19:13:20.509323] [INFO ] [REMOTE ] LH: Full fetch complete (42197 records). [2025-09-16T19:13:20.509426] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-09-16T19:13:20.902000] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-09-16T19:13:20.902084] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-09-16T19:13:20.902854] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-09-16T19:13:20.902901] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-09-16T19:13:20.903984] [DEBUG] [LOCAL ] LH: Trimmed 42197 records to 28126 (keeping 150 days of data) [2025-09-16T19:13:21.089669] [DEBUG] [LOCAL ] LH: Primary data saved (28126 records). [2025-09-16T19:13:21.089824] [INFO ] [MAIN ] LH: Full history saved. [2025-09-16T19:13:21.089916] [INFO ] [MAIN ] Update Progress: 1257/2369 symbols completed. LH took 29.8s. Estimated remaining: 1h 57m 55s. Rate: 9.4 symbols/min [2025-09-16T19:13:21.180053] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-09-16T19:13:21.269181] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:13:21.273124] [DEBUG] [LOCAL ] LITB: Loaded 2317 existing records from primary storage. [2025-09-16T19:13:21.273202] [INFO ] [MAIN ] LITB: Loaded 2317 existing records. [2025-09-16T19:13:21.451709] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:13:21.452098] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-09-16T19:13:21.452212] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-09-16T19:13:21.459184] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-09-16T19:13:21.469866] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-09-16T19:13:21.531262] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-16T19:13:21.846021] [INFO ] [REMOTE ] LITB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:13:21.974934] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-09-16T19:13:22.720583] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-16T19:13:22.774935] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-09-16T19:13:22.837247] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-16T19:13:23.574958] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-09-16T19:13:24.374921] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-09-16T19:13:24.853215] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-16T19:13:24.944117] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-16T19:13:25.174901] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-09-16T19:13:25.761694] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-16T19:13:25.767874] [INFO ] [REMOTE ] LHX: Full fetch complete (53583 records). [2025-09-16T19:13:25.767997] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-09-16T19:13:25.985477] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-09-16T19:13:26.143291] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-09-16T19:13:26.143371] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-09-16T19:13:26.144162] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-09-16T19:13:26.144209] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-09-16T19:13:26.145327] [DEBUG] [LOCAL ] LHX: Trimmed 53583 records to 36532 (keeping 150 days of data) [2025-09-16T19:13:26.387631] [DEBUG] [LOCAL ] LHX: Primary data saved (36532 records). [2025-09-16T19:13:26.387817] [INFO ] [MAIN ] LHX: Full history saved. [2025-09-16T19:13:26.387945] [INFO ] [MAIN ] Update Progress: 1258/2369 symbols completed. LHX took 24.7s. Estimated remaining: 1h 57m 48s. Rate: 9.4 symbols/min [2025-09-16T19:13:26.558261] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:13:26.568857] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-16T19:13:26.610783] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-16T19:13:26.634905] [DEBUG] [LOCAL ] LLY: Loaded 39337 existing records from primary storage. [2025-09-16T19:13:26.635056] [INFO ] [MAIN ] LLY: Loaded 39337 existing records. [2025-09-16T19:13:26.784682] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-09-16T19:13:26.812479] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:13:26.812664] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-09-16T19:13:26.812711] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-09-16T19:13:26.813564] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-09-16T19:13:26.813612] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-09-16T19:13:27.172662] [INFO ] [REMOTE ] LLY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:13:27.574927] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-09-16T19:13:28.374897] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-09-16T19:13:28.566556] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-16T19:13:29.072815] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-16T19:13:29.174899] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-09-16T19:13:29.883832] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-09-16T19:13:29.974897] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-09-16T19:13:30.193525] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-16T19:13:30.774886] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-09-16T19:13:31.545397] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-16T19:13:31.574843] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-09-16T19:13:32.128955] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-16T19:13:32.377717] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-09-16T19:13:32.383083] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-09-16T19:13:33.174906] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-09-16T19:13:33.974920] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-09-16T19:13:34.002490] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-16T19:13:34.006370] [INFO ] [REMOTE ] LII: Full fetch complete (31483 records). [2025-09-16T19:13:34.006497] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-09-16T19:13:34.382600] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-09-16T19:13:34.382717] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-09-16T19:13:34.383311] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-09-16T19:13:34.383353] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-09-16T19:13:34.384176] [DEBUG] [LOCAL ] LII: Trimmed 31483 records to 20348 (keeping 150 days of data) [2025-09-16T19:13:34.513925] [DEBUG] [LOCAL ] LII: Primary data saved (20348 records). [2025-09-16T19:13:34.514073] [INFO ] [MAIN ] LII: Full history saved. [2025-09-16T19:13:34.514189] [INFO ] [MAIN ] Update Progress: 1259/2369 symbols completed. LII took 25.4s. Estimated remaining: 1h 57m 43s. Rate: 9.4 symbols/min [2025-09-16T19:13:34.681518] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:13:34.719748] [DEBUG] [LOCAL ] LMND: Loaded 38437 existing records from primary storage. [2025-09-16T19:13:34.719889] [INFO ] [MAIN ] LMND: Loaded 38437 existing records. [2025-09-16T19:13:34.782426] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-09-16T19:13:34.902424] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:13:34.902700] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-09-16T19:13:34.902754] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-09-16T19:13:34.903433] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-09-16T19:13:34.903477] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-09-16T19:13:35.254866] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-16T19:13:35.257855] [INFO ] [REMOTE ] LMND: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:13:35.574857] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-09-16T19:13:35.684278] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-16T19:13:35.779887] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-09-16T19:13:36.374924] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-09-16T19:13:37.174919] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-09-16T19:13:37.495585] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-16T19:13:37.974918] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-09-16T19:13:38.640954] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-16T19:13:38.646912] [INFO ] [REMOTE ] LION: Full fetch complete (43966 records). [2025-09-16T19:13:38.647032] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-09-16T19:13:38.780001] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-09-16T19:13:39.045426] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-09-16T19:13:39.045695] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-09-16T19:13:39.046691] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-09-16T19:13:39.046827] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-09-16T19:13:39.049302] [DEBUG] [LOCAL ] LION: Trimmed 43966 records to 35711 (keeping 150 days of data) [2025-09-16T19:13:39.165941] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.79 seconds). [2025-09-16T19:13:39.298264] [DEBUG] [LOCAL ] LION: Primary data saved (35711 records). [2025-09-16T19:13:39.298411] [INFO ] [MAIN ] LION: Full history saved. [2025-09-16T19:13:39.298542] [INFO ] [MAIN ] Update Progress: 1260/2369 symbols completed. LION took 25.7s. Estimated remaining: 1h 57m 36s. Rate: 9.4 symbols/min [2025-09-16T19:13:39.471133] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:13:39.475798] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-16T19:13:39.548530] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-16T19:13:39.546948] [DEBUG] [LOCAL ] LMT: Loaded 36693 existing records from primary storage. [2025-09-16T19:13:39.559115] [INFO ] [MAIN ] LMT: Loaded 36693 existing records. [2025-09-16T19:13:39.581000] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-09-16T19:13:39.788336] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:13:39.788695] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-09-16T19:13:39.788746] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-09-16T19:13:39.789612] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-09-16T19:13:39.789690] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-09-16T19:13:40.127858] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-16T19:13:40.146731] [INFO ] [REMOTE ] LMT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:13:40.374898] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-09-16T19:13:41.174911] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-09-16T19:13:41.902527] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-16T19:13:41.903961] [INFO ] [REMOTE ] LITB: Full fetch complete (4460 records). [2025-09-16T19:13:41.904050] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-09-16T19:13:41.980079] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-09-16T19:13:42.260290] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-09-16T19:13:42.260366] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-09-16T19:13:42.260522] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-09-16T19:13:42.260569] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-09-16T19:13:42.260959] [DEBUG] [LOCAL ] LITB: Trimmed 4460 records to 2344 (keeping 150 days of data) [2025-09-16T19:13:42.275337] [DEBUG] [LOCAL ] LITB: Primary data saved (2344 records). [2025-09-16T19:13:42.275457] [INFO ] [MAIN ] LITB: Full history saved. [2025-09-16T19:13:42.275570] [INFO ] [MAIN ] Update Progress: 1261/2369 symbols completed. LITB took 21.2s. Estimated remaining: 1h 57m 26s. Rate: 9.4 symbols/min [2025-09-16T19:13:42.444422] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:13:42.489593] [DEBUG] [LOCAL ] LNC: Loaded 37942 existing records from primary storage. [2025-09-16T19:13:42.489750] [INFO ] [MAIN ] LNC: Loaded 37942 existing records. [2025-09-16T19:13:42.674213] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:13:42.674657] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-09-16T19:13:42.674779] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-09-16T19:13:42.675674] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-09-16T19:13:42.675810] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-09-16T19:13:42.776443] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-09-16T19:13:43.010579] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.64 seconds). [2025-09-16T19:13:43.080613] [INFO ] [REMOTE ] LNC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:13:43.574922] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-09-16T19:13:43.942932] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-16T19:13:44.374918] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-09-16T19:13:44.696610] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-16T19:13:44.870792] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-16T19:13:45.174920] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-09-16T19:13:45.974910] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-09-16T19:13:46.774918] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-09-16T19:13:46.861569] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-09-16T19:13:47.574963] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-09-16T19:13:47.775282] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (2.60 seconds). [2025-09-16T19:13:47.960585] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-16T19:13:48.374919] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-09-16T19:13:48.504330] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-16T19:13:49.174905] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-09-16T19:13:49.974867] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-09-16T19:13:50.077635] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-16T19:13:50.188767] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (2.61 seconds). [2025-09-16T19:13:50.601324] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-16T19:13:50.774922] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-09-16T19:13:51.574901] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-09-16T19:13:51.800369] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-16T19:13:52.374938] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-09-16T19:13:52.975634] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-16T19:13:52.984205] [INFO ] [REMOTE ] LLY: Full fetch complete (57940 records). [2025-09-16T19:13:52.984343] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-09-16T19:13:53.180167] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-09-16T19:13:53.376370] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-09-16T19:13:53.376554] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-09-16T19:13:53.377417] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-09-16T19:13:53.377479] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-09-16T19:13:53.379011] [DEBUG] [LOCAL ] LLY: Trimmed 57940 records to 39727 (keeping 150 days of data) [2025-09-16T19:13:53.514442] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-16T19:13:53.590167] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-16T19:13:53.767255] [DEBUG] [LOCAL ] LLY: Primary data saved (39727 records). [2025-09-16T19:13:53.767428] [INFO ] [MAIN ] LLY: Full history saved. [2025-09-16T19:13:53.767520] [INFO ] [MAIN ] Update Progress: 1262/2369 symbols completed. LLY took 27.4s. Estimated remaining: 1h 57m 24s. Rate: 9.4 symbols/min [2025-09-16T19:13:53.969365] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:13:53.975701] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-09-16T19:13:53.975607] [DEBUG] [LOCAL ] LND: Loaded 3604 existing records from primary storage. [2025-09-16T19:13:53.976191] [INFO ] [MAIN ] LND: Loaded 3604 existing records. [2025-09-16T19:13:54.159014] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:13:54.159334] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-09-16T19:13:54.159389] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-09-16T19:13:54.159633] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-09-16T19:13:54.159704] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-09-16T19:13:54.508265] [INFO ] [REMOTE ] LND: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:13:54.774891] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-09-16T19:13:55.276675] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-16T19:13:55.574880] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-09-16T19:13:56.106715] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-16T19:13:56.198188] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-16T19:13:56.374889] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-09-16T19:13:57.174872] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-09-16T19:13:57.693497] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-16T19:13:57.974960] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-09-16T19:13:58.268735] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-16T19:13:58.775008] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-16T19:13:58.775130] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-09-16T19:13:59.239213] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-16T19:13:59.442124] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-16T19:13:59.449845] [INFO ] [REMOTE ] LMND: Full fetch complete (56478 records). [2025-09-16T19:13:59.450020] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-09-16T19:13:59.580042] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-09-16T19:13:59.840181] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-09-16T19:13:59.840257] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-09-16T19:13:59.841057] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-09-16T19:13:59.841101] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-09-16T19:13:59.843363] [DEBUG] [LOCAL ] LMND: Trimmed 56478 records to 38824 (keeping 150 days of data) [2025-09-16T19:14:00.078426] [DEBUG] [LOCAL ] LMND: Primary data saved (38824 records). [2025-09-16T19:14:00.078573] [INFO ] [MAIN ] LMND: Full history saved. [2025-09-16T19:14:00.080386] [INFO ] [MAIN ] Update Progress: 1263/2369 symbols completed. LMND took 25.6s. Estimated remaining: 1h 57m 18s. Rate: 9.4 symbols/min [2025-09-16T19:14:00.252156] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:14:00.294494] [DEBUG] [LOCAL ] LNG: Loaded 37954 existing records from primary storage. [2025-09-16T19:14:00.294682] [INFO ] [MAIN ] LNG: Loaded 37954 existing records. [2025-09-16T19:14:00.380127] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-09-16T19:14:00.474399] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:14:00.474595] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-09-16T19:14:00.474667] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-09-16T19:14:00.475564] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-09-16T19:14:00.475613] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-09-16T19:14:00.834625] [INFO ] [REMOTE ] LNG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:14:01.174988] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-09-16T19:14:01.646168] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-16T19:14:01.974961] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-09-16T19:14:02.246828] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-16T19:14:02.774931] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-09-16T19:14:03.066942] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-16T19:14:03.325939] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-16T19:14:03.572852] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-16T19:14:03.578166] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-09-16T19:14:03.580950] [INFO ] [REMOTE ] LMT: Full fetch complete (54556 records). [2025-09-16T19:14:03.581772] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-09-16T19:14:03.959846] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-09-16T19:14:03.959921] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-09-16T19:14:03.960706] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-09-16T19:14:03.960751] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-09-16T19:14:03.961891] [DEBUG] [LOCAL ] LMT: Trimmed 54556 records to 37058 (keeping 150 days of data) [2025-09-16T19:14:04.207218] [DEBUG] [LOCAL ] LMT: Primary data saved (37058 records). [2025-09-16T19:14:04.207364] [INFO ] [MAIN ] LMT: Full history saved. [2025-09-16T19:14:04.207463] [INFO ] [MAIN ] Update Progress: 1264/2369 symbols completed. LMT took 24.9s. Estimated remaining: 1h 57m 10s. Rate: 9.4 symbols/min [2025-09-16T19:14:04.375198] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-09-16T19:14:04.377780] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:14:04.384789] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-16T19:14:04.395167] [DEBUG] [LOCAL ] LNN: Loaded 8087 existing records from primary storage. [2025-09-16T19:14:04.395785] [INFO ] [MAIN ] LNN: Loaded 8087 existing records. [2025-09-16T19:14:04.571256] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:14:04.571530] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-09-16T19:14:04.571577] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-09-16T19:14:04.572000] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-09-16T19:14:04.572078] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-09-16T19:14:04.923445] [INFO ] [REMOTE ] LNN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:14:05.174935] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-09-16T19:14:05.945706] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-16T19:14:05.974847] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-09-16T19:14:06.407851] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-16T19:14:06.414416] [INFO ] [REMOTE ] LNC: Full fetch complete (56135 records). [2025-09-16T19:14:06.414526] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-09-16T19:14:06.777265] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-09-16T19:14:06.795871] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-09-16T19:14:06.796088] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-09-16T19:14:06.796948] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-09-16T19:14:06.797033] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-09-16T19:14:06.805430] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-16T19:14:06.808660] [DEBUG] [LOCAL ] LNC: Trimmed 56135 records to 38332 (keeping 150 days of data) [2025-09-16T19:14:07.042709] [DEBUG] [LOCAL ] LNC: Primary data saved (38332 records). [2025-09-16T19:14:07.042868] [INFO ] [MAIN ] LNC: Full history saved. [2025-09-16T19:14:07.043918] [INFO ] [MAIN ] Update Progress: 1265/2369 symbols completed. LNC took 24.8s. Estimated remaining: 1h 57m 0s. Rate: 9.4 symbols/min [2025-09-16T19:14:07.215243] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:14:07.250586] [DEBUG] [LOCAL ] LOAR: Loaded 32217 existing records from primary storage. [2025-09-16T19:14:07.250784] [INFO ] [MAIN ] LOAR: Loaded 32217 existing records. [2025-09-16T19:14:07.427041] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:14:07.427293] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-09-16T19:14:07.427343] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-09-16T19:14:07.427944] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-09-16T19:14:07.427996] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-09-16T19:14:07.580026] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-09-16T19:14:07.793083] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:14:08.259109] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-16T19:14:08.374917] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-09-16T19:14:08.571554] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-16T19:14:09.174883] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-09-16T19:14:09.382792] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-16T19:14:09.974932] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-09-16T19:14:10.774952] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-09-16T19:14:10.979279] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-16T19:14:11.033778] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-16T19:14:11.268450] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-16T19:14:11.574961] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-09-16T19:14:12.374975] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-09-16T19:14:12.482856] [DEBUG] [REMOTE ] LNG: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-09-16T19:14:12.483267] [WARN ] [REMOTE ] LNG: No data returned for month 2025-05 [2025-09-16T19:14:13.174927] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-09-16T19:14:13.283391] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-16T19:14:13.758192] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-16T19:14:13.974913] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-09-16T19:14:14.774920] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-09-16T19:14:15.574914] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-09-16T19:14:15.721914] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-16T19:14:16.304555] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-16T19:14:16.335874] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-16T19:14:16.374889] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-09-16T19:14:17.174926] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-09-16T19:14:17.200058] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-16T19:14:17.974908] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-09-16T19:14:18.440787] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-16T19:14:18.774882] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-09-16T19:14:18.870457] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-16T19:14:19.574914] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-09-16T19:14:20.374900] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-09-16T19:14:20.744807] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-16T19:14:21.026001] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-16T19:14:21.174883] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-09-16T19:14:21.320704] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-16T19:14:21.974893] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-09-16T19:14:22.642661] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-16T19:14:22.644064] [INFO ] [REMOTE ] LND: Full fetch complete (5932 records). [2025-09-16T19:14:22.644141] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-09-16T19:14:22.788704] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-09-16T19:14:23.020618] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-09-16T19:14:23.020852] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-09-16T19:14:23.021074] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-09-16T19:14:23.021163] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-09-16T19:14:23.021754] [DEBUG] [LOCAL ] LND: Trimmed 5932 records to 3632 (keeping 150 days of data) [2025-09-16T19:14:23.043636] [DEBUG] [LOCAL ] LND: Primary data saved (3632 records). [2025-09-16T19:14:23.043774] [INFO ] [MAIN ] LND: Full history saved. [2025-09-16T19:14:23.043867] [INFO ] [MAIN ] Update Progress: 1266/2369 symbols completed. LND took 29.3s. Estimated remaining: 1h 57m 2s. Rate: 9.4 symbols/min [2025-09-16T19:14:23.219430] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:14:23.252861] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-16T19:14:23.278165] [DEBUG] [LOCAL ] LOB: Loaded 19142 existing records from primary storage. [2025-09-16T19:14:23.278339] [INFO ] [MAIN ] LOB: Loaded 19142 existing records. [2025-09-16T19:14:23.467428] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-16T19:14:23.473045] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:14:23.476892] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-09-16T19:14:23.476967] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-09-16T19:14:23.477719] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-09-16T19:14:23.477793] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-09-16T19:14:23.580033] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-09-16T19:14:23.844507] [INFO ] [REMOTE ] LOB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:14:24.374901] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-09-16T19:14:24.619406] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-16T19:14:24.621136] [INFO ] [REMOTE ] LNN: Full fetch complete (11944 records). [2025-09-16T19:14:24.621205] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-09-16T19:14:24.986830] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-09-16T19:14:24.986923] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-09-16T19:14:24.987217] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-09-16T19:14:24.987258] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-09-16T19:14:24.987845] [DEBUG] [LOCAL ] LNN: Trimmed 11944 records to 8163 (keeping 150 days of data) [2025-09-16T19:14:25.040365] [DEBUG] [LOCAL ] LNN: Primary data saved (8163 records). [2025-09-16T19:14:25.040517] [INFO ] [MAIN ] LNN: Full history saved. [2025-09-16T19:14:25.040605] [INFO ] [MAIN ] Update Progress: 1267/2369 symbols completed. LNN took 20.8s. Estimated remaining: 1h 56m 52s. Rate: 9.4 symbols/min [2025-09-16T19:14:25.182881] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-09-16T19:14:25.213408] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:14:25.216886] [DEBUG] [LOCAL ] LOCL: Loaded 1941 existing records from primary storage. [2025-09-16T19:14:25.216957] [INFO ] [MAIN ] LOCL: Loaded 1941 existing records. [2025-09-16T19:14:25.397381] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:14:25.397639] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-09-16T19:14:25.397705] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-09-16T19:14:25.397913] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-09-16T19:14:25.397956] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-09-16T19:14:25.756584] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:14:25.966926] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-16T19:14:25.975846] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-09-16T19:14:26.304843] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-16T19:14:26.774963] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-09-16T19:14:27.152886] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-16T19:14:27.188136] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-16T19:14:27.574943] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-09-16T19:14:28.374913] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-09-16T19:14:29.073775] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-16T19:14:29.078996] [INFO ] [REMOTE ] LOAR: Full fetch complete (44360 records). [2025-09-16T19:14:29.079083] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-09-16T19:14:29.178573] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-09-16T19:14:29.480178] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-09-16T19:14:29.480266] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-09-16T19:14:29.481040] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-09-16T19:14:29.481087] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-09-16T19:14:29.482137] [DEBUG] [LOCAL ] LOAR: Trimmed 44360 records to 32474 (keeping 150 days of data) [2025-09-16T19:14:29.674923] [DEBUG] [LOCAL ] LOAR: Primary data saved (32474 records). [2025-09-16T19:14:29.675078] [INFO ] [MAIN ] LOAR: Full history saved. [2025-09-16T19:14:29.675751] [INFO ] [MAIN ] Update Progress: 1268/2369 symbols completed. LOAR took 22.6s. Estimated remaining: 1h 56m 44s. Rate: 9.4 symbols/min [2025-09-16T19:14:29.845568] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:14:29.869442] [DEBUG] [LOCAL ] LOMA: Loaded 22980 existing records from primary storage. [2025-09-16T19:14:29.869578] [INFO ] [MAIN ] LOMA: Loaded 22980 existing records. [2025-09-16T19:14:29.976841] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-09-16T19:14:30.055934] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-16T19:14:30.059679] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:14:30.063360] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-09-16T19:14:30.063417] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-09-16T19:14:30.063963] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-09-16T19:14:30.064036] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-09-16T19:14:30.438345] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:14:30.440121] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-16T19:14:30.446470] [INFO ] [REMOTE ] LNG: Full fetch complete (48387 records). [2025-09-16T19:14:30.446661] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-09-16T19:14:30.638377] [WARN ] [VALIDATOR ] LNG: Validation failed - insufficient historical data. Have 129 unique days, need 150 days [2025-09-16T19:14:30.639011] [FATAL] [MAIN ] LNG: Fetched primary data is invalid. Refusing to save it. [2025-09-16T19:14:30.639090] [WARN ] [MAIN ] LNG: Deleting existing primary and derivative data due to validation failure. [2025-09-16T19:14:30.639145] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-09-16T19:14:30.639219] [DEBUG] [LOCAL ] LNG: No primary data file found to delete. [2025-09-16T19:14:30.639265] [INFO ] [LOCAL ] LNG: Starting deletion of derivative data. [2025-09-16T19:14:30.639740] [DEBUG] [LOCAL ] LNG: Deleted derivative data file. [2025-09-16T19:14:30.640289] [INFO ] [MAIN ] Update Progress: 1269/2369 symbols completed. LNG took 30.6s. Estimated remaining: 1h 56m 33s. Rate: 9.4 symbols/min [2025-09-16T19:14:30.784630] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-09-16T19:14:30.814526] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:14:30.856612] [DEBUG] [LOCAL ] LOW: Loaded 39109 existing records from primary storage. [2025-09-16T19:14:30.856830] [INFO ] [MAIN ] LOW: Loaded 39109 existing records. [2025-09-16T19:14:31.034809] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:14:31.035073] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-09-16T19:14:31.035156] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-09-16T19:14:31.036247] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-09-16T19:14:31.036297] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-09-16T19:14:31.226521] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-16T19:14:31.357515] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-16T19:14:31.414099] [INFO ] [REMOTE ] LOW: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:14:31.574955] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-09-16T19:14:32.374900] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-09-16T19:14:32.946192] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-16T19:14:33.174902] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-09-16T19:14:33.663932] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-16T19:14:33.805440] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-16T19:14:33.974907] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-09-16T19:14:34.294752] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-16T19:14:34.774907] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-09-16T19:14:35.574949] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-09-16T19:14:36.374878] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-09-16T19:14:36.719720] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-16T19:14:36.825892] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-16T19:14:36.846423] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-16T19:14:37.174907] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-09-16T19:14:37.974925] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-09-16T19:14:38.774954] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-09-16T19:14:39.076361] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-16T19:14:39.241161] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-16T19:14:39.574929] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-09-16T19:14:39.896539] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-16T19:14:40.374961] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-09-16T19:14:40.669216] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-16T19:14:41.174917] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-09-16T19:14:41.407040] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-16T19:14:41.974914] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-09-16T19:14:42.774867] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-09-16T19:14:42.830695] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-16T19:14:43.200956] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-16T19:14:43.574946] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-09-16T19:14:44.022680] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-16T19:14:44.374932] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-09-16T19:14:45.174889] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-09-16T19:14:45.217073] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-16T19:14:45.523633] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-16T19:14:45.765478] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-16T19:14:45.766754] [INFO ] [REMOTE ] LOCL: Full fetch complete (3360 records). [2025-09-16T19:14:45.766830] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-09-16T19:14:45.979987] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-09-16T19:14:46.133270] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-09-16T19:14:46.133357] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-09-16T19:14:46.133546] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-09-16T19:14:46.133589] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-09-16T19:14:46.133963] [DEBUG] [LOCAL ] LOCL: Trimmed 3360 records to 1993 (keeping 150 days of data) [2025-09-16T19:14:46.145656] [DEBUG] [LOCAL ] LOCL: Primary data saved (1993 records). [2025-09-16T19:14:46.145721] [INFO ] [MAIN ] LOCL: Full history saved. [2025-09-16T19:14:46.145796] [INFO ] [MAIN ] Update Progress: 1270/2369 symbols completed. LOCL took 21.1s. Estimated remaining: 1h 56m 35s. Rate: 9.4 symbols/min [2025-09-16T19:14:46.313549] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:14:46.343092] [DEBUG] [LOCAL ] LPG: Loaded 29546 existing records from primary storage. [2025-09-16T19:14:46.343238] [INFO ] [MAIN ] LPG: Loaded 29546 existing records. [2025-09-16T19:14:46.533238] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:14:46.533503] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-09-16T19:14:46.533549] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-09-16T19:14:46.534248] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-09-16T19:14:46.534296] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-09-16T19:14:46.780372] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-09-16T19:14:46.897591] [INFO ] [REMOTE ] LPG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:14:47.117341] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-16T19:14:47.120807] [INFO ] [REMOTE ] LOB: Full fetch complete (29390 records). [2025-09-16T19:14:47.120906] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-09-16T19:14:47.490781] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-09-16T19:14:47.490866] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-09-16T19:14:47.491494] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-09-16T19:14:47.491535] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-09-16T19:14:47.492374] [DEBUG] [LOCAL ] LOB: Trimmed 29390 records to 19344 (keeping 150 days of data) [2025-09-16T19:14:47.578094] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-09-16T19:14:47.613034] [DEBUG] [LOCAL ] LOB: Primary data saved (19344 records). [2025-09-16T19:14:47.613189] [INFO ] [MAIN ] LOB: Full history saved. [2025-09-16T19:14:47.613278] [INFO ] [MAIN ] Update Progress: 1271/2369 symbols completed. LOB took 24.6s. Estimated remaining: 1h 56m 24s. Rate: 9.4 symbols/min [2025-09-16T19:14:47.783702] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:14:47.802499] [DEBUG] [LOCAL ] LPL: Loaded 19036 existing records from primary storage. [2025-09-16T19:14:47.802635] [INFO ] [MAIN ] LPL: Loaded 19036 existing records. [2025-09-16T19:14:47.976372] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:14:47.976607] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-09-16T19:14:47.976672] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-09-16T19:14:47.977283] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-09-16T19:14:47.977332] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-09-16T19:14:48.327524] [INFO ] [REMOTE ] LPL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:14:48.347481] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-16T19:14:48.374849] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-09-16T19:14:49.064770] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-16T19:14:49.174915] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-09-16T19:14:49.365906] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-16T19:14:49.974935] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-09-16T19:14:50.729846] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-16T19:14:50.774910] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-09-16T19:14:51.000276] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-16T19:14:51.575007] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-09-16T19:14:52.222232] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-16T19:14:52.374922] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-09-16T19:14:52.797414] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-16T19:14:53.174882] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-09-16T19:14:53.567177] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-16T19:14:53.826796] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-16T19:14:53.974902] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-09-16T19:14:54.774882] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-09-16T19:14:55.213634] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-16T19:14:55.447167] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-16T19:14:55.574905] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-09-16T19:14:56.374867] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-09-16T19:14:56.832523] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-16T19:14:57.174901] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-09-16T19:14:57.974878] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-09-16T19:14:58.243064] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-16T19:14:58.326422] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-16T19:14:58.774895] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-09-16T19:14:59.518672] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-16T19:14:59.524075] [INFO ] [REMOTE ] LOMA: Full fetch complete (34261 records). [2025-09-16T19:14:59.524167] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-09-16T19:14:59.579999] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-09-16T19:14:59.909426] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-09-16T19:14:59.909518] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-09-16T19:14:59.910158] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-09-16T19:14:59.910202] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-09-16T19:14:59.910951] [DEBUG] [LOCAL ] LOMA: Trimmed 34261 records to 23279 (keeping 150 days of data) [2025-09-16T19:15:00.045921] [DEBUG] [LOCAL ] LOMA: Primary data saved (23279 records). [2025-09-16T19:15:00.046056] [INFO ] [MAIN ] LOMA: Full history saved. [2025-09-16T19:15:00.046140] [INFO ] [MAIN ] Update Progress: 1272/2369 symbols completed. LOMA took 30.4s. Estimated remaining: 1h 56m 23s. Rate: 9.4 symbols/min [2025-09-16T19:15:00.214926] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:15:00.249719] [DEBUG] [LOCAL ] LPX: Loaded 29378 existing records from primary storage. [2025-09-16T19:15:00.250101] [INFO ] [MAIN ] LPX: Loaded 29378 existing records. [2025-09-16T19:15:00.379312] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-09-16T19:15:00.436433] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:15:00.437240] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-09-16T19:15:00.437365] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-09-16T19:15:00.438174] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-09-16T19:15:00.438228] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-09-16T19:15:00.642942] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-16T19:15:00.829464] [INFO ] [REMOTE ] LPX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:15:01.174906] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-09-16T19:15:01.541576] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-16T19:15:01.969340] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-16T19:15:01.977161] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-09-16T19:15:02.279012] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-16T19:15:02.774934] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-09-16T19:15:03.574949] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-09-16T19:15:03.677383] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-16T19:15:03.683840] [INFO ] [REMOTE ] LOW: Full fetch complete (57572 records). [2025-09-16T19:15:03.683999] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-09-16T19:15:04.074427] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-09-16T19:15:04.074509] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-09-16T19:15:04.075335] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-09-16T19:15:04.075379] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-09-16T19:15:04.076521] [DEBUG] [LOCAL ] LOW: Trimmed 57572 records to 39480 (keeping 150 days of data) [2025-09-16T19:15:04.330464] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-16T19:15:04.363371] [DEBUG] [LOCAL ] LOW: Primary data saved (39480 records). [2025-09-16T19:15:04.363527] [INFO ] [MAIN ] LOW: Full history saved. [2025-09-16T19:15:04.364214] [INFO ] [MAIN ] Update Progress: 1273/2369 symbols completed. LOW took 33.7s. Estimated remaining: 1h 56m 15s. Rate: 9.4 symbols/min [2025-09-16T19:15:04.385450] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-09-16T19:15:04.544165] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:15:04.583863] [DEBUG] [LOCAL ] LRN: Loaded 29198 existing records from primary storage. [2025-09-16T19:15:04.584045] [INFO ] [MAIN ] LRN: Loaded 29198 existing records. [2025-09-16T19:15:04.862222] [WARN ] [MAIN ] LRN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:15:04.862504] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-09-16T19:15:04.862559] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-09-16T19:15:04.863514] [DEBUG] [LOCAL ] LRN: Deleted primary data file. [2025-09-16T19:15:04.863587] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-09-16T19:15:05.194824] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-09-16T19:15:05.291676] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-16T19:15:05.485095] [INFO ] [REMOTE ] LRN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:15:05.711153] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-16T19:15:05.718378] [INFO ] [REMOTE ] LPL: Full fetch complete (26271 records). [2025-09-16T19:15:05.718520] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-09-16T19:15:05.980045] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-09-16T19:15:06.110417] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-09-16T19:15:06.110487] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-09-16T19:15:06.111020] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-09-16T19:15:06.111070] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-09-16T19:15:06.111742] [DEBUG] [LOCAL ] LPL: Trimmed 26271 records to 19329 (keeping 150 days of data) [2025-09-16T19:15:06.221018] [DEBUG] [LOCAL ] LPL: Primary data saved (19329 records). [2025-09-16T19:15:06.221154] [INFO ] [MAIN ] LPL: Full history saved. [2025-09-16T19:15:06.221257] [INFO ] [MAIN ] Update Progress: 1274/2369 symbols completed. LPL took 18.6s. Estimated remaining: 1h 56m 5s. Rate: 9.4 symbols/min [2025-09-16T19:15:06.391017] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:15:06.421018] [DEBUG] [LOCAL ] LSPD: Loaded 30931 existing records from primary storage. [2025-09-16T19:15:06.421152] [INFO ] [MAIN ] LSPD: Loaded 30931 existing records. [2025-09-16T19:15:06.598307] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:15:06.598598] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-09-16T19:15:06.598672] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-09-16T19:15:06.599319] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-09-16T19:15:06.599370] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-09-16T19:15:06.779031] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-09-16T19:15:06.965556] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:15:06.988976] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-16T19:15:07.469228] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-16T19:15:07.574955] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-02. [2025-09-16T19:15:08.316274] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-16T19:15:08.374957] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-09-16T19:15:09.174940] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-09-16T19:15:09.430904] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-16T19:15:09.513923] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-16T19:15:09.974902] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-09-16T19:15:10.494234] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-16T19:15:10.774892] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-06. [2025-09-16T19:15:10.993318] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-16T19:15:10.998207] [INFO ] [REMOTE ] LPG: Full fetch complete (44435 records). [2025-09-16T19:15:10.998317] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-09-16T19:15:11.369517] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-09-16T19:15:11.369593] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-09-16T19:15:11.370313] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-09-16T19:15:11.370377] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-09-16T19:15:11.371305] [DEBUG] [LOCAL ] LPG: Trimmed 44435 records to 29760 (keeping 150 days of data) [2025-09-16T19:15:11.559743] [DEBUG] [LOCAL ] LPG: Primary data saved (29760 records). [2025-09-16T19:15:11.559911] [INFO ] [MAIN ] LPG: Full history saved. [2025-09-16T19:15:11.560016] [INFO ] [MAIN ] Update Progress: 1275/2369 symbols completed. LPG took 25.4s. Estimated remaining: 1h 55m 57s. Rate: 9.4 symbols/min [2025-09-16T19:15:11.581347] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-09-16T19:15:11.736219] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:15:11.757272] [DEBUG] [LOCAL ] LTC: Loaded 22112 existing records from primary storage. [2025-09-16T19:15:11.757436] [INFO ] [MAIN ] LTC: Loaded 22112 existing records. [2025-09-16T19:15:11.938503] [WARN ] [MAIN ] LTC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:15:11.938801] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-09-16T19:15:11.938848] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-09-16T19:15:11.939465] [DEBUG] [LOCAL ] LTC: Deleted primary data file. [2025-09-16T19:15:11.939516] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-09-16T19:15:12.331237] [INFO ] [REMOTE ] LTC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:15:12.360289] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-16T19:15:12.374864] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-07. [2025-09-16T19:15:13.064803] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-16T19:15:13.174929] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-09-16T19:15:13.288251] [DEBUG] [REMOTE ] LRN: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-09-16T19:15:13.288575] [WARN ] [REMOTE ] LRN: No data returned for month 2025-04 [2025-09-16T19:15:13.850678] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-16T19:15:13.974857] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-08. [2025-09-16T19:15:14.774940] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-09-16T19:15:15.537178] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-16T19:15:15.574875] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-09. [2025-09-16T19:15:16.379975] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-02. [2025-09-16T19:15:16.394414] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-16T19:15:17.080673] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-16T19:15:17.085400] [INFO ] [REMOTE ] LPX: Full fetch complete (43576 records). [2025-09-16T19:15:17.085519] [DEBUG] [VALIDATOR ] LPX: Validating primary data. [2025-09-16T19:15:17.182682] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-06. [2025-09-16T19:15:17.459773] [DEBUG] [VALIDATOR ] LPX: All expected trading days are present. [2025-09-16T19:15:17.459848] [DEBUG] [VALIDATOR ] LPX: Primary data validation passed. [2025-09-16T19:15:17.460539] [INFO ] [MAIN ] LPX: Fetched primary data is valid. [2025-09-16T19:15:17.460587] [DEBUG] [LOCAL ] LPX: Saving primary data. [2025-09-16T19:15:17.461500] [DEBUG] [LOCAL ] LPX: Trimmed 43576 records to 29644 (keeping 150 days of data) [2025-09-16T19:15:17.594559] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-16T19:15:17.667549] [DEBUG] [LOCAL ] LPX: Primary data saved (29644 records). [2025-09-16T19:15:17.667700] [INFO ] [MAIN ] LPX: Full history saved. [2025-09-16T19:15:17.668371] [INFO ] [MAIN ] Update Progress: 1276/2369 symbols completed. LPX took 17.6s. Estimated remaining: 1h 55m 51s. Rate: 9.4 symbols/min [2025-09-16T19:15:17.844173] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:15:17.883293] [DEBUG] [LOCAL ] LTH: Loaded 38227 existing records from primary storage. [2025-09-16T19:15:17.883426] [INFO ] [MAIN ] LTH: Loaded 38227 existing records. [2025-09-16T19:15:17.982215] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-03. [2025-09-16T19:15:18.062198] [WARN ] [MAIN ] LTH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:15:18.062416] [INFO ] [MAIN ] LTH: Wiping existing primary data before full refresh. [2025-09-16T19:15:18.062463] [INFO ] [LOCAL ] LTH: Starting deletion of primary data. [2025-09-16T19:15:18.063189] [DEBUG] [LOCAL ] LTH: Deleted primary data file. [2025-09-16T19:15:18.063241] [INFO ] [MAIN ] LTH: Starting full primary refresh. [2025-09-16T19:15:18.419277] [INFO ] [REMOTE ] LTH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:15:18.781459] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-03. [2025-09-16T19:15:18.796869] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-16T19:15:19.250088] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-16T19:15:19.574903] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-02. [2025-09-16T19:15:20.374871] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-04. [2025-09-16T19:15:20.452394] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-16T19:15:21.174870] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-04. [2025-09-16T19:15:21.203962] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-16T19:15:21.974898] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-03. [2025-09-16T19:15:22.100868] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-16T19:15:22.351069] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-16T19:15:22.774932] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-05. [2025-09-16T19:15:23.574919] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-07. [2025-09-16T19:15:23.771459] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-16T19:15:23.840517] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-16T19:15:24.374904] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-04. [2025-09-16T19:15:25.018730] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-16T19:15:25.174899] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-06. [2025-09-16T19:15:25.881623] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-16T19:15:25.974870] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-05. [2025-09-16T19:15:26.732792] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-16T19:15:26.774866] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-07. [2025-09-16T19:15:27.574931] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-08. [2025-09-16T19:15:27.655014] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-16T19:15:28.025949] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-16T19:15:28.374908] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-06. [2025-09-16T19:15:29.174910] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-05. [2025-09-16T19:15:29.398250] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-16T19:15:29.791171] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-16T19:15:29.974900] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-08. [2025-09-16T19:15:30.485775] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-16T19:15:30.774900] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-07. [2025-09-16T19:15:31.416397] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-16T19:15:31.574903] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-09. [2025-09-16T19:15:32.238305] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-16T19:15:32.374893] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-06. [2025-09-16T19:15:33.065104] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-16T19:15:33.072376] [INFO ] [REMOTE ] LRN: Full fetch complete (36831 records). [2025-09-16T19:15:33.072536] [DEBUG] [VALIDATOR ] LRN: Validating primary data. [2025-09-16T19:15:33.179251] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-08. [2025-09-16T19:15:33.266602] [WARN ] [VALIDATOR ] LRN: Validation failed - insufficient historical data. Have 129 unique days, need 150 days [2025-09-16T19:15:33.267078] [FATAL] [MAIN ] LRN: Fetched primary data is invalid. Refusing to save it. [2025-09-16T19:15:33.267131] [WARN ] [MAIN ] LRN: Deleting existing primary and derivative data due to validation failure. [2025-09-16T19:15:33.267176] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-09-16T19:15:33.267231] [DEBUG] [LOCAL ] LRN: No primary data file found to delete. [2025-09-16T19:15:33.267278] [INFO ] [LOCAL ] LRN: Starting deletion of derivative data. [2025-09-16T19:15:33.267586] [DEBUG] [LOCAL ] LRN: Deleted derivative data file. [2025-09-16T19:15:33.267701] [INFO ] [MAIN ] Update Progress: 1277/2369 symbols completed. LRN took 28.9s. Estimated remaining: 1h 55m 52s. Rate: 9.4 symbols/min [2025-09-16T19:15:33.329374] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-16T19:15:33.974904] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-09. [2025-09-16T19:15:34.774916] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-07. [2025-09-16T19:15:34.838072] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-16T19:15:35.399693] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-16T19:15:35.407817] [INFO ] [REMOTE ] LSPD: Full fetch complete (47915 records). [2025-09-16T19:15:35.408061] [DEBUG] [VALIDATOR ] LSPD: Validating primary data. [2025-09-16T19:15:35.581109] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-09. [2025-09-16T19:15:35.847869] [DEBUG] [VALIDATOR ] LSPD: All expected trading days are present. [2025-09-16T19:15:35.848049] [DEBUG] [VALIDATOR ] LSPD: Primary data validation passed. [2025-09-16T19:15:35.849253] [INFO ] [MAIN ] LSPD: Fetched primary data is valid. [2025-09-16T19:15:35.849328] [DEBUG] [LOCAL ] LSPD: Saving primary data. [2025-09-16T19:15:35.851185] [DEBUG] [LOCAL ] LSPD: Trimmed 47915 records to 31234 (keeping 150 days of data) [2025-09-16T19:15:36.055389] [DEBUG] [LOCAL ] LSPD: Primary data saved (31234 records). [2025-09-16T19:15:36.055612] [INFO ] [MAIN ] LSPD: Full history saved. [2025-09-16T19:15:36.055760] [INFO ] [MAIN ] Update Progress: 1278/2369 symbols completed. LSPD took 29.8s. Estimated remaining: 1h 55m 43s. Rate: 9.4 symbols/min [2025-09-16T19:15:36.311140] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-16T19:15:36.374878] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-08. [2025-09-16T19:15:36.918524] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-16T19:15:36.925339] [INFO ] [REMOTE ] LTH: Full fetch complete (56378 records). [2025-09-16T19:15:36.925506] [DEBUG] [VALIDATOR ] LTH: Validating primary data. [2025-09-16T19:15:37.332337] [DEBUG] [VALIDATOR ] LTH: All expected trading days are present. [2025-09-16T19:15:37.332477] [DEBUG] [VALIDATOR ] LTH: Primary data validation passed. [2025-09-16T19:15:37.333971] [INFO ] [MAIN ] LTH: Fetched primary data is valid. [2025-09-16T19:15:37.334175] [DEBUG] [LOCAL ] LTH: Saving primary data. [2025-09-16T19:15:37.336313] [DEBUG] [LOCAL ] LTH: Trimmed 56378 records to 38610 (keeping 150 days of data) [2025-09-16T19:15:37.590808] [DEBUG] [LOCAL ] LTH: Primary data saved (38610 records). [2025-09-16T19:15:37.609092] [INFO ] [MAIN ] LTH: Full history saved. [2025-09-16T19:15:37.610358] [INFO ] [MAIN ] Update Progress: 1279/2369 symbols completed. LTH took 19.9s. Estimated remaining: 1h 55m 32s. Rate: 9.4 symbols/min [2025-09-16T19:15:37.611123] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-16T19:15:37.618202] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-09. [2025-09-16T19:15:38.799066] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-16T19:15:38.802625] [INFO ] [REMOTE ] LTC: Full fetch complete (32479 records). [2025-09-16T19:15:38.802726] [DEBUG] [VALIDATOR ] LTC: Validating primary data. [2025-09-16T19:15:39.173321] [DEBUG] [VALIDATOR ] LTC: All expected trading days are present. [2025-09-16T19:15:39.173405] [DEBUG] [VALIDATOR ] LTC: Primary data validation passed. [2025-09-16T19:15:39.174174] [INFO ] [MAIN ] LTC: Fetched primary data is valid. [2025-09-16T19:15:39.174226] [DEBUG] [LOCAL ] LTC: Saving primary data. [2025-09-16T19:15:39.175038] [DEBUG] [LOCAL ] LTC: Trimmed 32479 records to 22342 (keeping 150 days of data) [2025-09-16T19:15:39.313063] [DEBUG] [LOCAL ] LTC: Primary data saved (22342 records). [2025-09-16T19:15:39.313216] [INFO ] [MAIN ] LTC: Full history saved. [2025-09-16T19:15:39.313347] [INFO ] [MAIN ] Update Progress: 1280/2369 symbols completed. LTC took 27.8s. Estimated remaining: 1h 55m 22s. Rate: 9.4 symbols/min [2025-09-16T19:15:39.874492] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:15:39.987394] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:15:39.985237] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:15:40.006075] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:15:40.057242] [DEBUG] [LOCAL ] LUCK: Loaded 17494 existing records from primary storage. [2025-09-16T19:15:40.057579] [INFO ] [MAIN ] LUCK: Loaded 17494 existing records. [2025-09-16T19:15:40.141871] [DEBUG] [LOCAL ] LTM: Loaded 27982 existing records from primary storage. [2025-09-16T19:15:40.168250] [INFO ] [MAIN ] LTM: Loaded 27982 existing records. [2025-09-16T19:15:40.174107] [DEBUG] [LOCAL ] LUMN: Loaded 39620 existing records from primary storage. [2025-09-16T19:15:40.200377] [INFO ] [MAIN ] LUMN: Loaded 39620 existing records. [2025-09-16T19:15:40.250138] [DEBUG] [LOCAL ] LU: Loaded 36227 existing records from primary storage. [2025-09-16T19:15:40.296253] [INFO ] [MAIN ] LU: Loaded 36227 existing records. [2025-09-16T19:15:40.577196] [WARN ] [MAIN ] LUCK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:15:40.670942] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-09-16T19:15:40.712842] [WARN ] [MAIN ] LTM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:15:40.743875] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-09-16T19:15:40.834408] [WARN ] [MAIN ] LUMN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:15:40.834627] [INFO ] [MAIN ] LUMN: Wiping existing primary data before full refresh. [2025-09-16T19:15:40.834292] [WARN ] [MAIN ] LU: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:15:40.834699] [INFO ] [LOCAL ] LUMN: Starting deletion of primary data. [2025-09-16T19:15:40.834907] [INFO ] [MAIN ] LU: Wiping existing primary data before full refresh. [2025-09-16T19:15:40.834956] [INFO ] [LOCAL ] LU: Starting deletion of primary data. [2025-09-16T19:15:40.835009] [DEBUG] [LOCAL ] LUCK: Deleted primary data file. [2025-09-16T19:15:40.835070] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-09-16T19:15:40.841010] [INFO ] [MAIN ] LTM: Wiping existing primary data before full refresh. [2025-09-16T19:15:40.840839] [DEBUG] [LOCAL ] LU: Deleted primary data file. [2025-09-16T19:15:40.840784] [DEBUG] [LOCAL ] LUMN: Deleted primary data file. [2025-09-16T19:15:40.853823] [INFO ] [MAIN ] LU: Starting full primary refresh. [2025-09-16T19:15:40.885190] [INFO ] [LOCAL ] LTM: Starting deletion of primary data. [2025-09-16T19:15:40.885116] [INFO ] [MAIN ] LUMN: Starting full primary refresh. [2025-09-16T19:15:40.946988] [DEBUG] [LOCAL ] LTM: Deleted primary data file. [2025-09-16T19:15:40.978089] [INFO ] [MAIN ] LTM: Starting full primary refresh. [2025-09-16T19:15:42.166824] [INFO ] [REMOTE ] LUMN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:15:42.291208] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:15:42.337768] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-09-16T19:15:42.326625] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-02. [2025-09-16T19:15:42.369054] [INFO ] [REMOTE ] LU: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:15:42.373903] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-02. [2025-09-16T19:15:42.462346] [INFO ] [REMOTE ] LTM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:15:42.462779] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-02. [2025-09-16T19:15:43.630765] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-16T19:15:43.636570] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-03. [2025-09-16T19:15:43.765208] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-16T19:15:43.772767] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-09-16T19:15:43.934536] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-16T19:15:43.944683] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-03. [2025-09-16T19:15:44.002579] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-16T19:15:44.012163] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-03. [2025-09-16T19:15:44.577366] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-16T19:15:44.583751] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-04. [2025-09-16T19:15:45.093288] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-16T19:15:45.174940] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-09-16T19:15:45.749933] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-16T19:15:45.836933] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-16T19:15:45.975575] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-05. [2025-09-16T19:15:45.978763] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-16T19:15:46.221158] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-16T19:15:46.774896] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-04. [2025-09-16T19:15:47.422556] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-16T19:15:47.574871] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-06. [2025-09-16T19:15:48.374978] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-04. [2025-09-16T19:15:48.478294] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-16T19:15:48.938473] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-16T19:15:49.174917] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-05. [2025-09-16T19:15:49.974886] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-07. [2025-09-16T19:15:50.083418] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-16T19:15:50.774897] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-05. [2025-09-16T19:15:50.860576] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-16T19:15:51.430581] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-16T19:15:51.574907] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-08. [2025-09-16T19:15:52.374934] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-09-16T19:15:52.412080] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-16T19:15:53.133260] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-16T19:15:53.174866] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-09. [2025-09-16T19:15:53.566085] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-16T19:15:53.974905] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-09-16T19:15:54.687702] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-16T19:15:54.693409] [INFO ] [REMOTE ] LTM: Full fetch complete (37654 records). [2025-09-16T19:15:54.693531] [DEBUG] [VALIDATOR ] LTM: Validating primary data. [2025-09-16T19:15:54.784735] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-06. [2025-09-16T19:15:55.082221] [DEBUG] [VALIDATOR ] LTM: All expected trading days are present. [2025-09-16T19:15:55.082346] [DEBUG] [VALIDATOR ] LTM: Primary data validation passed. [2025-09-16T19:15:55.083095] [INFO ] [MAIN ] LTM: Fetched primary data is valid. [2025-09-16T19:15:55.083170] [DEBUG] [LOCAL ] LTM: Saving primary data. [2025-09-16T19:15:55.098895] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-16T19:15:55.104517] [DEBUG] [LOCAL ] LTM: Trimmed 37654 records to 28294 (keeping 150 days of data) [2025-09-16T19:15:55.275097] [DEBUG] [LOCAL ] LTM: Primary data saved (28294 records). [2025-09-16T19:15:55.275229] [INFO ] [MAIN ] LTM: Full history saved. [2025-09-16T19:15:55.275363] [INFO ] [MAIN ] Update Progress: 1281/2369 symbols completed. LTM took 16.0s. Estimated remaining: 1h 55m 24s. Rate: 9.4 symbols/min [2025-09-16T19:15:55.449141] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:15:55.490299] [DEBUG] [LOCAL ] LUV: Loaded 39649 existing records from primary storage. [2025-09-16T19:15:55.490439] [INFO ] [MAIN ] LUV: Loaded 39649 existing records. [2025-09-16T19:15:55.580084] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-06. [2025-09-16T19:15:55.677194] [WARN ] [MAIN ] LUV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:15:55.677438] [INFO ] [MAIN ] LUV: Wiping existing primary data before full refresh. [2025-09-16T19:15:55.677484] [INFO ] [LOCAL ] LUV: Starting deletion of primary data. [2025-09-16T19:15:55.678485] [DEBUG] [LOCAL ] LUV: Deleted primary data file. [2025-09-16T19:15:55.678557] [INFO ] [MAIN ] LUV: Starting full primary refresh. [2025-09-16T19:15:56.050823] [INFO ] [REMOTE ] LUV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:15:56.374909] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-02. [2025-09-16T19:15:56.481610] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-16T19:15:57.174964] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-07. [2025-09-16T19:15:57.566871] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-16T19:15:57.906903] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-16T19:15:57.974987] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-09-16T19:15:58.774915] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-03. [2025-09-16T19:15:58.891123] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-16T19:15:59.193818] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-16T19:15:59.574948] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-08. [2025-09-16T19:16:00.374911] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-07. [2025-09-16T19:16:00.616716] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-16T19:16:00.809992] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-16T19:16:01.174941] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-04. [2025-09-16T19:16:01.974909] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-09. [2025-09-16T19:16:02.331704] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-16T19:16:02.774984] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-08. [2025-09-16T19:16:03.287924] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-16T19:16:03.574967] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-05. [2025-09-16T19:16:03.673554] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-16T19:16:03.683524] [INFO ] [REMOTE ] LU: Full fetch complete (53134 records). [2025-09-16T19:16:03.683741] [DEBUG] [VALIDATOR ] LU: Validating primary data. [2025-09-16T19:16:04.072566] [DEBUG] [VALIDATOR ] LU: All expected trading days are present. [2025-09-16T19:16:04.072667] [DEBUG] [VALIDATOR ] LU: Primary data validation passed. [2025-09-16T19:16:04.073484] [INFO ] [MAIN ] LU: Fetched primary data is valid. [2025-09-16T19:16:04.073530] [DEBUG] [LOCAL ] LU: Saving primary data. [2025-09-16T19:16:04.074704] [DEBUG] [LOCAL ] LU: Trimmed 53134 records to 36575 (keeping 150 days of data) [2025-09-16T19:16:04.282840] [DEBUG] [LOCAL ] LU: Primary data saved (36575 records). [2025-09-16T19:16:04.282991] [INFO ] [MAIN ] LU: Full history saved. [2025-09-16T19:16:04.283092] [INFO ] [MAIN ] Update Progress: 1282/2369 symbols completed. LU took 25.0s. Estimated remaining: 1h 55m 20s. Rate: 9.4 symbols/min [2025-09-16T19:16:04.381513] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-09-16T19:16:04.467481] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:16:04.467721] [DEBUG] [LOCAL ] LUXE: No existing data file found in primary storage. [2025-09-16T19:16:04.467762] [WARN ] [MAIN ] LUXE: No existing data found, performing full refresh instead. [2025-09-16T19:16:04.467887] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-09-16T19:16:04.467934] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-09-16T19:16:04.467977] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-09-16T19:16:04.468009] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-09-16T19:16:04.848460] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:16:04.888171] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-16T19:16:05.174939] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-02. [2025-09-16T19:16:05.390450] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:16:05.391179] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-02 [2025-09-16T19:16:05.421202] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-16T19:16:05.458465] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-16T19:16:05.974908] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-09-16T19:16:06.774888] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-06. [2025-09-16T19:16:06.881116] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-16T19:16:06.884267] [INFO ] [REMOTE ] LUCK: Full fetch complete (28776 records). [2025-09-16T19:16:06.884356] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-09-16T19:16:07.283874] [DEBUG] [VALIDATOR ] LUCK: All expected trading days are present. [2025-09-16T19:16:07.284005] [DEBUG] [VALIDATOR ] LUCK: Primary data validation passed. [2025-09-16T19:16:07.284672] [INFO ] [MAIN ] LUCK: Fetched primary data is valid. [2025-09-16T19:16:07.284720] [DEBUG] [LOCAL ] LUCK: Saving primary data. [2025-09-16T19:16:07.285728] [DEBUG] [LOCAL ] LUCK: Trimmed 28776 records to 17666 (keeping 150 days of data) [2025-09-16T19:16:07.396873] [DEBUG] [LOCAL ] LUCK: Primary data saved (17666 records). [2025-09-16T19:16:07.397033] [INFO ] [MAIN ] LUCK: Full history saved. [2025-09-16T19:16:07.397139] [INFO ] [MAIN ] Update Progress: 1283/2369 symbols completed. LUCK took 28.1s. Estimated remaining: 1h 55m 11s. Rate: 9.4 symbols/min [2025-09-16T19:16:07.569519] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:16:07.574915] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-09. [2025-09-16T19:16:07.614700] [DEBUG] [LOCAL ] LVS: Loaded 39539 existing records from primary storage. [2025-09-16T19:16:07.614864] [INFO ] [MAIN ] LVS: Loaded 39539 existing records. [2025-09-16T19:16:07.815848] [WARN ] [MAIN ] LVS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:16:07.816143] [INFO ] [MAIN ] LVS: Wiping existing primary data before full refresh. [2025-09-16T19:16:07.816192] [INFO ] [LOCAL ] LVS: Starting deletion of primary data. [2025-09-16T19:16:07.817469] [DEBUG] [LOCAL ] LVS: Deleted primary data file. [2025-09-16T19:16:07.817529] [INFO ] [MAIN ] LVS: Starting full primary refresh. [2025-09-16T19:16:08.193638] [INFO ] [REMOTE ] LVS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:16:08.342653] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-16T19:16:08.374847] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-07. [2025-09-16T19:16:09.174953] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-03. [2025-09-16T19:16:09.396615] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:16:09.397122] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-03 [2025-09-16T19:16:09.733188] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-16T19:16:09.739613] [INFO ] [REMOTE ] LUMN: Full fetch complete (58306 records). [2025-09-16T19:16:09.739753] [DEBUG] [VALIDATOR ] LUMN: Validating primary data. [2025-09-16T19:16:09.979707] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-02. [2025-09-16T19:16:10.124458] [DEBUG] [VALIDATOR ] LUMN: All expected trading days are present. [2025-09-16T19:16:10.124556] [DEBUG] [VALIDATOR ] LUMN: Primary data validation passed. [2025-09-16T19:16:10.125436] [INFO ] [MAIN ] LUMN: Fetched primary data is valid. [2025-09-16T19:16:10.125486] [DEBUG] [LOCAL ] LUMN: Saving primary data. [2025-09-16T19:16:10.126773] [DEBUG] [LOCAL ] LUMN: Trimmed 58306 records to 40009 (keeping 150 days of data) [2025-09-16T19:16:10.392234] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-16T19:16:10.424688] [DEBUG] [LOCAL ] LUMN: Primary data saved (40009 records). [2025-09-16T19:16:10.424873] [INFO ] [MAIN ] LUMN: Full history saved. [2025-09-16T19:16:10.424991] [INFO ] [MAIN ] Update Progress: 1284/2369 symbols completed. LUMN took 31.1s. Estimated remaining: 1h 55m 2s. Rate: 9.4 symbols/min [2025-09-16T19:16:10.615556] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:16:10.631133] [DEBUG] [LOCAL ] LVWR: Loaded 15660 existing records from primary storage. [2025-09-16T19:16:10.631261] [INFO ] [MAIN ] LVWR: Loaded 15660 existing records. [2025-09-16T19:16:10.776902] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-04. [2025-09-16T19:16:10.810359] [WARN ] [MAIN ] LVWR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:16:10.810604] [INFO ] [MAIN ] LVWR: Wiping existing primary data before full refresh. [2025-09-16T19:16:10.810672] [INFO ] [LOCAL ] LVWR: Starting deletion of primary data. [2025-09-16T19:16:10.811179] [DEBUG] [LOCAL ] LVWR: Deleted primary data file. [2025-09-16T19:16:10.811224] [INFO ] [MAIN ] LVWR: Starting full primary refresh. [2025-09-16T19:16:11.062804] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:16:11.090288] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-04 [2025-09-16T19:16:11.176337] [INFO ] [REMOTE ] LVWR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:16:11.571201] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-16T19:16:11.580513] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-05. [2025-09-16T19:16:12.374867] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-03. [2025-09-16T19:16:12.729307] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-16T19:16:13.174933] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-08. [2025-09-16T19:16:13.974913] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-02. [2025-09-16T19:16:14.085442] [DEBUG] [REMOTE ] LVWR: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-09-16T19:16:14.085792] [WARN ] [REMOTE ] LVWR: No data returned for month 2025-02 [2025-09-16T19:16:14.222547] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-16T19:16:14.774892] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-03. [2025-09-16T19:16:14.911237] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-16T19:16:15.146113] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-16T19:16:15.574880] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-04. [2025-09-16T19:16:16.208801] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-16T19:16:16.374908] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-04. [2025-09-16T19:16:17.174912] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-06. [2025-09-16T19:16:17.974904] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-09. [2025-09-16T19:16:18.073349] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-16T19:16:18.391178] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-16T19:16:18.774938] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-05. [2025-09-16T19:16:19.574903] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-07. [2025-09-16T19:16:19.972975] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-16T19:16:19.979840] [INFO ] [REMOTE ] LUV: Full fetch complete (58368 records). [2025-09-16T19:16:19.989206] [DEBUG] [VALIDATOR ] LUV: Validating primary data. [2025-09-16T19:16:19.990138] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-16T19:16:20.381569] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-05. [2025-09-16T19:16:20.382299] [DEBUG] [VALIDATOR ] LUV: All expected trading days are present. [2025-09-16T19:16:20.383275] [DEBUG] [VALIDATOR ] LUV: Primary data validation passed. [2025-09-16T19:16:20.384210] [INFO ] [MAIN ] LUV: Fetched primary data is valid. [2025-09-16T19:16:20.384353] [DEBUG] [LOCAL ] LUV: Saving primary data. [2025-09-16T19:16:20.385662] [DEBUG] [LOCAL ] LUV: Trimmed 58368 records to 40039 (keeping 150 days of data) [2025-09-16T19:16:20.586909] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-16T19:16:20.655000] [DEBUG] [LOCAL ] LUV: Primary data saved (40039 records). [2025-09-16T19:16:20.655134] [INFO ] [MAIN ] LUV: Full history saved. [2025-09-16T19:16:20.656128] [INFO ] [MAIN ] Update Progress: 1285/2369 symbols completed. LUV took 25.4s. Estimated remaining: 1h 54m 58s. Rate: 9.4 symbols/min [2025-09-16T19:16:20.823553] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:16:20.860720] [DEBUG] [LOCAL ] LW: Loaded 37616 existing records from primary storage. [2025-09-16T19:16:20.860857] [INFO ] [MAIN ] LW: Loaded 37616 existing records. [2025-09-16T19:16:21.044453] [WARN ] [MAIN ] LW: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:16:21.044716] [INFO ] [MAIN ] LW: Wiping existing primary data before full refresh. [2025-09-16T19:16:21.044764] [INFO ] [LOCAL ] LW: Starting deletion of primary data. [2025-09-16T19:16:21.045754] [DEBUG] [LOCAL ] LW: Deleted primary data file. [2025-09-16T19:16:21.045803] [INFO ] [MAIN ] LW: Starting full primary refresh. [2025-09-16T19:16:21.186911] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-06. [2025-09-16T19:16:21.402473] [INFO ] [REMOTE ] LW: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:16:21.974914] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-02. [2025-09-16T19:16:22.311773] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-16T19:16:22.774908] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-06. [2025-09-16T19:16:22.992947] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-16T19:16:23.574927] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-08. [2025-09-16T19:16:23.621148] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-16T19:16:24.374933] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-03. [2025-09-16T19:16:24.483474] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-16T19:16:24.506360] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-16T19:16:25.174910] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-09. [2025-09-16T19:16:25.936276] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-16T19:16:25.974886] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-04. [2025-09-16T19:16:26.128472] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-16T19:16:26.131521] [INFO ] [REMOTE ] LUXE: Full fetch complete (11831 records). [2025-09-16T19:16:26.131603] [DEBUG] [VALIDATOR ] LUXE: Validating primary data. [2025-09-16T19:16:26.315013] [WARN ] [VALIDATOR ] LUXE: Validation failed - insufficient historical data. Have 95 unique days, need 150 days [2025-09-16T19:16:26.315267] [FATAL] [MAIN ] LUXE: Fetched primary data is invalid. Refusing to save it. [2025-09-16T19:16:26.315315] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to validation failure. [2025-09-16T19:16:26.315359] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-09-16T19:16:26.315445] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-09-16T19:16:26.315483] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-09-16T19:16:26.315533] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-09-16T19:16:26.315616] [INFO ] [MAIN ] Update Progress: 1286/2369 symbols completed. LUXE took 22.0s. Estimated remaining: 1h 54m 51s. Rate: 9.4 symbols/min [2025-09-16T19:16:26.485847] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:16:26.499774] [DEBUG] [LOCAL ] LXFR: Loaded 12308 existing records from primary storage. [2025-09-16T19:16:26.499910] [INFO ] [MAIN ] LXFR: Loaded 12308 existing records. [2025-09-16T19:16:26.678478] [WARN ] [MAIN ] LXFR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:16:26.678760] [INFO ] [MAIN ] LXFR: Wiping existing primary data before full refresh. [2025-09-16T19:16:26.678810] [INFO ] [LOCAL ] LXFR: Starting deletion of primary data. [2025-09-16T19:16:26.679226] [DEBUG] [LOCAL ] LXFR: Deleted primary data file. [2025-09-16T19:16:26.679273] [INFO ] [MAIN ] LXFR: Starting full primary refresh. [2025-09-16T19:16:26.782037] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-07. [2025-09-16T19:16:27.049629] [INFO ] [REMOTE ] LXFR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:16:27.574877] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-02. [2025-09-16T19:16:27.693498] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-16T19:16:27.819104] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-16T19:16:28.374895] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-08. [2025-09-16T19:16:28.585617] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-16T19:16:29.174900] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-07. [2025-09-16T19:16:29.238076] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-16T19:16:29.974946] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-09. [2025-09-16T19:16:30.774867] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-05. [2025-09-16T19:16:30.984212] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-16T19:16:30.987042] [INFO ] [REMOTE ] LVWR: Full fetch complete (16869 records). [2025-09-16T19:16:30.987129] [DEBUG] [VALIDATOR ] LVWR: Validating primary data. [2025-09-16T19:16:31.168950] [WARN ] [VALIDATOR ] LVWR: Validation failed - insufficient historical data. Have 137 unique days, need 150 days [2025-09-16T19:16:31.169352] [FATAL] [MAIN ] LVWR: Fetched primary data is invalid. Refusing to save it. [2025-09-16T19:16:31.169490] [WARN ] [MAIN ] LVWR: Deleting existing primary and derivative data due to validation failure. [2025-09-16T19:16:31.169620] [INFO ] [LOCAL ] LVWR: Starting deletion of primary data. [2025-09-16T19:16:31.169755] [DEBUG] [LOCAL ] LVWR: No primary data file found to delete. [2025-09-16T19:16:31.169825] [INFO ] [LOCAL ] LVWR: Starting deletion of derivative data. [2025-09-16T19:16:31.170143] [DEBUG] [LOCAL ] LVWR: Deleted derivative data file. [2025-09-16T19:16:31.170226] [INFO ] [MAIN ] Update Progress: 1287/2369 symbols completed. LVWR took 20.7s. Estimated remaining: 1h 54m 44s. Rate: 9.4 symbols/min [2025-09-16T19:16:31.341470] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-16T19:16:31.380984] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:16:31.415623] [DEBUG] [LOCAL ] LXP: Loaded 37393 existing records from primary storage. [2025-09-16T19:16:31.415802] [INFO ] [MAIN ] LXP: Loaded 37393 existing records. [2025-09-16T19:16:31.583662] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-03. [2025-09-16T19:16:31.594811] [WARN ] [MAIN ] LXP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:16:31.595063] [INFO ] [MAIN ] LXP: Wiping existing primary data before full refresh. [2025-09-16T19:16:31.595125] [INFO ] [LOCAL ] LXP: Starting deletion of primary data. [2025-09-16T19:16:31.595970] [DEBUG] [LOCAL ] LXP: Deleted primary data file. [2025-09-16T19:16:31.596033] [INFO ] [MAIN ] LXP: Starting full primary refresh. [2025-09-16T19:16:31.957557] [INFO ] [REMOTE ] LXP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:16:32.374894] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-02. [2025-09-16T19:16:32.539699] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-16T19:16:32.661211] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-16T19:16:33.174943] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-04. [2025-09-16T19:16:33.928777] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-16T19:16:33.974879] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-03. [2025-09-16T19:16:34.215902] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-16T19:16:34.774899] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-05. [2025-09-16T19:16:35.570154] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-16T19:16:35.580029] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-06. [2025-09-16T19:16:35.780597] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-16T19:16:36.374933] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-08. [2025-09-16T19:16:36.966103] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-16T19:16:37.174890] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-07. [2025-09-16T19:16:37.851180] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-16T19:16:37.974876] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-09. [2025-09-16T19:16:38.682754] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-16T19:16:38.774865] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-08. [2025-09-16T19:16:39.574891] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-04. [2025-09-16T19:16:39.859437] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-16T19:16:39.866201] [INFO ] [REMOTE ] LVS: Full fetch complete (58244 records). [2025-09-16T19:16:39.866331] [DEBUG] [VALIDATOR ] LVS: Validating primary data. [2025-09-16T19:16:40.259465] [DEBUG] [VALIDATOR ] LVS: All expected trading days are present. [2025-09-16T19:16:40.259550] [DEBUG] [VALIDATOR ] LVS: Primary data validation passed. [2025-09-16T19:16:40.260517] [INFO ] [MAIN ] LVS: Fetched primary data is valid. [2025-09-16T19:16:40.260568] [DEBUG] [LOCAL ] LVS: Saving primary data. [2025-09-16T19:16:40.261851] [DEBUG] [LOCAL ] LVS: Trimmed 58244 records to 39929 (keeping 150 days of data) [2025-09-16T19:16:40.375913] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-06. [2025-09-16T19:16:40.422089] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-16T19:16:40.557660] [DEBUG] [LOCAL ] LVS: Primary data saved (39929 records). [2025-09-16T19:16:40.557804] [INFO ] [MAIN ] LVS: Full history saved. [2025-09-16T19:16:40.559022] [INFO ] [MAIN ] Update Progress: 1288/2369 symbols completed. LVS took 33.2s. Estimated remaining: 1h 54m 40s. Rate: 9.4 symbols/min [2025-09-16T19:16:40.727762] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:16:40.750608] [DEBUG] [LOCAL ] LXU: Loaded 23480 existing records from primary storage. [2025-09-16T19:16:40.750762] [INFO ] [MAIN ] LXU: Loaded 23480 existing records. [2025-09-16T19:16:40.925188] [WARN ] [MAIN ] LXU: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:16:40.925441] [INFO ] [MAIN ] LXU: Wiping existing primary data before full refresh. [2025-09-16T19:16:40.925490] [INFO ] [LOCAL ] LXU: Starting deletion of primary data. [2025-09-16T19:16:40.926056] [DEBUG] [LOCAL ] LXU: Deleted primary data file. [2025-09-16T19:16:40.926106] [INFO ] [MAIN ] LXU: Starting full primary refresh. [2025-09-16T19:16:41.178556] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-09. [2025-09-16T19:16:41.292056] [INFO ] [REMOTE ] LXU: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:16:41.323701] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-16T19:16:41.344457] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-16T19:16:41.974907] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-02. [2025-09-16T19:16:42.582963] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-16T19:16:42.589176] [INFO ] [REMOTE ] LW: Full fetch complete (55912 records). [2025-09-16T19:16:42.589283] [DEBUG] [VALIDATOR ] LW: Validating primary data. [2025-09-16T19:16:42.784344] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-05. [2025-09-16T19:16:42.991862] [DEBUG] [VALIDATOR ] LW: All expected trading days are present. [2025-09-16T19:16:42.991994] [DEBUG] [VALIDATOR ] LW: Primary data validation passed. [2025-09-16T19:16:42.992859] [INFO ] [MAIN ] LW: Fetched primary data is valid. [2025-09-16T19:16:42.992906] [DEBUG] [LOCAL ] LW: Saving primary data. [2025-09-16T19:16:42.994262] [DEBUG] [LOCAL ] LW: Trimmed 55912 records to 37983 (keeping 150 days of data) [2025-09-16T19:16:43.220023] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-16T19:16:43.255006] [DEBUG] [LOCAL ] LW: Primary data saved (37983 records). [2025-09-16T19:16:43.255195] [INFO ] [MAIN ] LW: Full history saved. [2025-09-16T19:16:43.256094] [INFO ] [MAIN ] Update Progress: 1289/2369 symbols completed. LW took 22.6s. Estimated remaining: 1h 54m 31s. Rate: 9.4 symbols/min [2025-09-16T19:16:43.423894] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:16:43.462954] [DEBUG] [LOCAL ] LYB: Loaded 39585 existing records from primary storage. [2025-09-16T19:16:43.463097] [INFO ] [MAIN ] LYB: Loaded 39585 existing records. [2025-09-16T19:16:43.588042] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-03. [2025-09-16T19:16:43.671248] [WARN ] [MAIN ] LYB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:16:43.671506] [INFO ] [MAIN ] LYB: Wiping existing primary data before full refresh. [2025-09-16T19:16:43.671568] [INFO ] [LOCAL ] LYB: Starting deletion of primary data. [2025-09-16T19:16:43.672552] [DEBUG] [LOCAL ] LYB: Deleted primary data file. [2025-09-16T19:16:43.672771] [INFO ] [MAIN ] LYB: Starting full primary refresh. [2025-09-16T19:16:44.031054] [INFO ] [REMOTE ] LYB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:16:44.374934] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-07. [2025-09-16T19:16:44.529268] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-16T19:16:45.078151] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-16T19:16:45.174949] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-04. [2025-09-16T19:16:45.349360] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-16T19:16:45.974902] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-06. [2025-09-16T19:16:46.592808] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-16T19:16:46.774851] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-05. [2025-09-16T19:16:47.530406] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-16T19:16:47.574845] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-07. [2025-09-16T19:16:47.908320] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-16T19:16:48.374957] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-06. [2025-09-16T19:16:49.174971] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-02. [2025-09-16T19:16:49.309990] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-16T19:16:49.376908] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-16T19:16:49.974952] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-08. [2025-09-16T19:16:50.774878] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-07. [2025-09-16T19:16:50.861292] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-16T19:16:51.023961] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-16T19:16:51.574870] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-03. [2025-09-16T19:16:52.035807] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-16T19:16:52.374911] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-08. [2025-09-16T19:16:53.174871] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-08. [2025-09-16T19:16:53.437134] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-16T19:16:53.672054] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-16T19:16:53.974920] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-04. [2025-09-16T19:16:54.425941] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-16T19:16:54.774906] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-09. [2025-09-16T19:16:55.574938] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-09. [2025-09-16T19:16:55.800113] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-16T19:16:56.366231] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-16T19:16:56.372029] [INFO ] [REMOTE ] LXP: Full fetch complete (54783 records). [2025-09-16T19:16:56.372124] [DEBUG] [VALIDATOR ] LXP: Validating primary data. [2025-09-16T19:16:56.383901] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-09. [2025-09-16T19:16:56.492907] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-16T19:16:56.544851] [INFO ] [REMOTE ] LXFR: Full fetch complete (18853 records). [2025-09-16T19:16:56.568932] [DEBUG] [VALIDATOR ] LXFR: Validating primary data. [2025-09-16T19:16:57.031868] [DEBUG] [VALIDATOR ] LXP: All expected trading days are present. [2025-09-16T19:16:57.043469] [DEBUG] [VALIDATOR ] LXP: Primary data validation passed. [2025-09-16T19:16:57.065093] [INFO ] [MAIN ] LXP: Fetched primary data is valid. [2025-09-16T19:16:57.065174] [DEBUG] [LOCAL ] LXP: Saving primary data. [2025-09-16T19:16:57.094694] [DEBUG] [LOCAL ] LXP: Trimmed 54783 records to 37755 (keeping 150 days of data) [2025-09-16T19:16:57.151368] [DEBUG] [VALIDATOR ] LXFR: All expected trading days are present. [2025-09-16T19:16:57.151446] [DEBUG] [VALIDATOR ] LXFR: Primary data validation passed. [2025-09-16T19:16:57.151670] [INFO ] [MAIN ] LXFR: Fetched primary data is valid. [2025-09-16T19:16:57.151716] [DEBUG] [LOCAL ] LXFR: Saving primary data. [2025-09-16T19:16:57.152372] [DEBUG] [LOCAL ] LXFR: Trimmed 18853 records to 12410 (keeping 150 days of data) [2025-09-16T19:16:57.204235] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-05. [2025-09-16T19:16:57.321245] [DEBUG] [LOCAL ] LXFR: Primary data saved (12410 records). [2025-09-16T19:16:57.321873] [INFO ] [MAIN ] LXFR: Full history saved. [2025-09-16T19:16:57.322469] [INFO ] [MAIN ] Update Progress: 1290/2369 symbols completed. LXFR took 31.0s. Estimated remaining: 1h 54m 31s. Rate: 9.4 symbols/min [2025-09-16T19:16:57.504901] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:16:57.643716] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-16T19:16:57.648822] [INFO ] [REMOTE ] LXU: Full fetch complete (34714 records). [2025-09-16T19:16:57.650266] [DEBUG] [VALIDATOR ] LXU: Validating primary data. [2025-09-16T19:16:57.667535] [DEBUG] [LOCAL ] LYG: Loaded 38981 existing records from primary storage. [2025-09-16T19:16:57.709700] [DEBUG] [LOCAL ] LXP: Primary data saved (37755 records). [2025-09-16T19:16:57.709573] [INFO ] [MAIN ] LYG: Loaded 38981 existing records. [2025-09-16T19:16:57.726352] [INFO ] [MAIN ] LXP: Full history saved. [2025-09-16T19:16:57.771167] [INFO ] [MAIN ] Update Progress: 1291/2369 symbols completed. LXP took 26.6s. Estimated remaining: 1h 54m 19s. Rate: 9.4 symbols/min [2025-09-16T19:16:58.239849] [WARN ] [MAIN ] LYG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:16:58.313270] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:16:58.328131] [INFO ] [MAIN ] LYG: Wiping existing primary data before full refresh. [2025-09-16T19:16:58.331946] [INFO ] [LOCAL ] LYG: Starting deletion of primary data. [2025-09-16T19:16:58.338460] [DEBUG] [LOCAL ] LYG: Deleted primary data file. [2025-09-16T19:16:58.359386] [INFO ] [MAIN ] LYG: Starting full primary refresh. [2025-09-16T19:16:58.490606] [DEBUG] [VALIDATOR ] LXU: All expected trading days are present. [2025-09-16T19:16:58.507808] [DEBUG] [VALIDATOR ] LXU: Primary data validation passed. [2025-09-16T19:16:58.520202] [INFO ] [MAIN ] LXU: Fetched primary data is valid. [2025-09-16T19:16:58.539891] [DEBUG] [LOCAL ] LXU: Saving primary data. [2025-09-16T19:16:58.626806] [DEBUG] [LOCAL ] LXU: Trimmed 34714 records to 23663 (keeping 150 days of data) [2025-09-16T19:16:58.635784] [DEBUG] [LOCAL ] LYV: Loaded 37576 existing records from primary storage. [2025-09-16T19:16:58.663426] [INFO ] [MAIN ] LYV: Loaded 37576 existing records. [2025-09-16T19:16:59.103320] [INFO ] [REMOTE ] LYG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:16:59.103873] [WARN ] [MAIN ] LYV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:16:59.125158] [INFO ] [MAIN ] LYV: Wiping existing primary data before full refresh. [2025-09-16T19:16:59.120134] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-02. [2025-09-16T19:16:59.126232] [INFO ] [LOCAL ] LYV: Starting deletion of primary data. [2025-09-16T19:16:59.132143] [DEBUG] [LOCAL ] LXU: Primary data saved (23663 records). [2025-09-16T19:16:59.132191] [DEBUG] [LOCAL ] LYV: Deleted primary data file. [2025-09-16T19:16:59.132489] [INFO ] [MAIN ] LXU: Full history saved. [2025-09-16T19:16:59.133204] [INFO ] [MAIN ] Update Progress: 1292/2369 symbols completed. LXU took 18.6s. Estimated remaining: 1h 54m 9s. Rate: 9.4 symbols/min [2025-09-16T19:16:59.133271] [INFO ] [MAIN ] LYV: Starting full primary refresh. [2025-09-16T19:16:59.472775] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:16:59.684784] [INFO ] [REMOTE ] LYV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:16:59.685162] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-02. [2025-09-16T19:16:59.695480] [DEBUG] [LOCAL ] LZB: Loaded 26036 existing records from primary storage. [2025-09-16T19:16:59.695756] [INFO ] [MAIN ] LZB: Loaded 26036 existing records. [2025-09-16T19:16:59.845412] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-09-16T19:16:59.922360] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-06. [2025-09-16T19:16:59.922485] [WARN ] [MAIN ] LZB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:16:59.923473] [INFO ] [MAIN ] LZB: Wiping existing primary data before full refresh. [2025-09-16T19:16:59.923530] [INFO ] [LOCAL ] LZB: Starting deletion of primary data. [2025-09-16T19:16:59.924271] [DEBUG] [LOCAL ] LZB: Deleted primary data file. [2025-09-16T19:16:59.924322] [INFO ] [MAIN ] LZB: Starting full primary refresh. [2025-09-16T19:17:00.274046] [INFO ] [REMOTE ] LZB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:17:00.374848] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-02. [2025-09-16T19:17:00.965238] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-16T19:17:01.174952] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-03. [2025-09-16T19:17:01.440910] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-16T19:17:01.478306] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-16T19:17:01.974912] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-03. [2025-09-16T19:17:02.144197] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-09-16T19:17:02.629354] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-16T19:17:02.774888] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-04. [2025-09-16T19:17:03.574928] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-07. [2025-09-16T19:17:03.931425] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-16T19:17:04.374895] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-03. [2025-09-16T19:17:04.667291] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-16T19:17:05.174900] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-05. [2025-09-16T19:17:05.445799] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-16T19:17:05.591803] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-16T19:17:05.974909] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-08. [2025-09-16T19:17:06.763521] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-16T19:17:06.775083] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-04. [2025-09-16T19:17:07.574867] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-06. [2025-09-16T19:17:08.089186] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-16T19:17:08.331018] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-16T19:17:08.374917] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-09. [2025-09-16T19:17:09.174968] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-05. [2025-09-16T19:17:09.288470] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-16T19:17:09.932435] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-16T19:17:09.940913] [INFO ] [REMOTE ] LYB: Full fetch complete (58194 records). [2025-09-16T19:17:09.941123] [DEBUG] [VALIDATOR ] LYB: Validating primary data. [2025-09-16T19:17:09.988251] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-07. [2025-09-16T19:17:10.490430] [DEBUG] [VALIDATOR ] LYB: All expected trading days are present. [2025-09-16T19:17:10.490540] [DEBUG] [VALIDATOR ] LYB: Primary data validation passed. [2025-09-16T19:17:10.491426] [INFO ] [MAIN ] LYB: Fetched primary data is valid. [2025-09-16T19:17:10.491511] [DEBUG] [LOCAL ] LYB: Saving primary data. [2025-09-16T19:17:10.492966] [DEBUG] [LOCAL ] LYB: Trimmed 58194 records to 39975 (keeping 150 days of data) [2025-09-16T19:17:10.752037] [DEBUG] [LOCAL ] LYB: Primary data saved (39975 records). [2025-09-16T19:17:10.752298] [INFO ] [MAIN ] LYB: Full history saved. [2025-09-16T19:17:10.753224] [INFO ] [MAIN ] Update Progress: 1293/2369 symbols completed. LYB took 27.5s. Estimated remaining: 1h 54m 7s. Rate: 9.4 symbols/min [2025-09-16T19:17:10.786169] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-04. [2025-09-16T19:17:10.965668] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:17:10.967505] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-16T19:17:10.989738] [DEBUG] [LOCAL ] LZM: Loaded 8818 existing records from primary storage. [2025-09-16T19:17:10.989887] [INFO ] [MAIN ] LZM: Loaded 8818 existing records. [2025-09-16T19:17:11.175303] [WARN ] [MAIN ] LZM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:17:11.175570] [INFO ] [MAIN ] LZM: Wiping existing primary data before full refresh. [2025-09-16T19:17:11.175618] [INFO ] [LOCAL ] LZM: Starting deletion of primary data. [2025-09-16T19:17:11.176046] [DEBUG] [LOCAL ] LZM: Deleted primary data file. [2025-09-16T19:17:11.176096] [INFO ] [MAIN ] LZM: Starting full primary refresh. [2025-09-16T19:17:11.547436] [INFO ] [REMOTE ] LZM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:17:11.574891] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-02. [2025-09-16T19:17:11.608297] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-16T19:17:12.099779] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-16T19:17:12.300983] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-16T19:17:12.374934] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-05. [2025-09-16T19:17:13.174983] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-08. [2025-09-16T19:17:13.386329] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-16T19:17:13.974920] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-03. [2025-09-16T19:17:14.774893] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-06. [2025-09-16T19:17:14.883532] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-16T19:17:14.926835] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-16T19:17:15.574955] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-04. [2025-09-16T19:17:16.374913] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-09. [2025-09-16T19:17:16.542072] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-16T19:17:16.591691] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-16T19:17:17.174908] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-06. [2025-09-16T19:17:17.827128] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-16T19:17:17.833429] [INFO ] [REMOTE ] LYG: Full fetch complete (57507 records). [2025-09-16T19:17:17.833591] [DEBUG] [VALIDATOR ] LYG: Validating primary data. [2025-09-16T19:17:17.979992] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-07. [2025-09-16T19:17:18.233810] [DEBUG] [VALIDATOR ] LYG: All expected trading days are present. [2025-09-16T19:17:18.233924] [DEBUG] [VALIDATOR ] LYG: Primary data validation passed. [2025-09-16T19:17:18.234976] [INFO ] [MAIN ] LYG: Fetched primary data is valid. [2025-09-16T19:17:18.235054] [DEBUG] [LOCAL ] LYG: Saving primary data. [2025-09-16T19:17:18.236489] [DEBUG] [LOCAL ] LYG: Trimmed 57507 records to 39363 (keeping 150 days of data) [2025-09-16T19:17:18.484172] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-16T19:17:18.518301] [DEBUG] [LOCAL ] LYG: Primary data saved (39363 records). [2025-09-16T19:17:18.518492] [INFO ] [MAIN ] LYG: Full history saved. [2025-09-16T19:17:18.518635] [INFO ] [MAIN ] Update Progress: 1294/2369 symbols completed. LYG took 21.2s. Estimated remaining: 1h 54m 2s. Rate: 9.4 symbols/min [2025-09-16T19:17:18.715219] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:17:18.754868] [DEBUG] [LOCAL ] M: Loaded 39519 existing records from primary storage. [2025-09-16T19:17:18.755026] [INFO ] [MAIN ] M: Loaded 39519 existing records. [2025-09-16T19:17:18.785517] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-07. [2025-09-16T19:17:18.939825] [WARN ] [MAIN ] M: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:17:18.940098] [INFO ] [MAIN ] M: Wiping existing primary data before full refresh. [2025-09-16T19:17:18.940148] [INFO ] [LOCAL ] M: Starting deletion of primary data. [2025-09-16T19:17:18.941069] [DEBUG] [LOCAL ] M: Deleted primary data file. [2025-09-16T19:17:18.941127] [INFO ] [MAIN ] M: Starting full primary refresh. [2025-09-16T19:17:19.313430] [INFO ] [REMOTE ] M: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:17:19.534847] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-16T19:17:19.574926] [INFO ] [REMOTE ] M: Fetching primary data for 2025-02. [2025-09-16T19:17:20.222561] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-16T19:17:20.374906] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-05. [2025-09-16T19:17:21.174995] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-08. [2025-09-16T19:17:21.354498] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-16T19:17:21.357361] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-16T19:17:21.974973] [INFO ] [REMOTE ] M: Fetching primary data for 2025-03. [2025-09-16T19:17:22.257303] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-16T19:17:22.774932] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-09. [2025-09-16T19:17:23.574960] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-06. [2025-09-16T19:17:23.915944] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-16T19:17:24.049891] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-16T19:17:24.291527] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-16T19:17:24.296396] [INFO ] [REMOTE ] LZB: Full fetch complete (38846 records). [2025-09-16T19:17:24.296496] [DEBUG] [VALIDATOR ] LZB: Validating primary data. [2025-09-16T19:17:24.379990] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-07. [2025-09-16T19:17:24.678546] [DEBUG] [VALIDATOR ] LZB: All expected trading days are present. [2025-09-16T19:17:24.678633] [DEBUG] [VALIDATOR ] LZB: Primary data validation passed. [2025-09-16T19:17:24.679316] [INFO ] [MAIN ] LZB: Fetched primary data is valid. [2025-09-16T19:17:24.679358] [DEBUG] [LOCAL ] LZB: Saving primary data. [2025-09-16T19:17:24.680205] [DEBUG] [LOCAL ] LZB: Trimmed 38846 records to 26279 (keeping 150 days of data) [2025-09-16T19:17:24.841920] [DEBUG] [LOCAL ] LZB: Primary data saved (26279 records). [2025-09-16T19:17:24.842058] [INFO ] [MAIN ] LZB: Full history saved. [2025-09-16T19:17:24.842162] [INFO ] [MAIN ] Update Progress: 1295/2369 symbols completed. LZB took 25.7s. Estimated remaining: 1h 53m 55s. Rate: 9.4 symbols/min [2025-09-16T19:17:25.019373] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:17:25.058393] [DEBUG] [LOCAL ] MA: Loaded 38662 existing records from primary storage. [2025-09-16T19:17:25.058530] [INFO ] [MAIN ] MA: Loaded 38662 existing records. [2025-09-16T19:17:25.179996] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-08. [2025-09-16T19:17:25.239726] [WARN ] [MAIN ] MA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:17:25.239958] [INFO ] [MAIN ] MA: Wiping existing primary data before full refresh. [2025-09-16T19:17:25.240007] [INFO ] [LOCAL ] MA: Starting deletion of primary data. [2025-09-16T19:17:25.240983] [DEBUG] [LOCAL ] MA: Deleted primary data file. [2025-09-16T19:17:25.241043] [INFO ] [MAIN ] MA: Starting full primary refresh. [2025-09-16T19:17:25.472688] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-16T19:17:25.608456] [INFO ] [REMOTE ] MA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:17:25.974897] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-08. [2025-09-16T19:17:26.774891] [INFO ] [REMOTE ] M: Fetching primary data for 2025-04. [2025-09-16T19:17:26.821779] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-16T19:17:27.003245] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-16T19:17:27.574936] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-09. [2025-09-16T19:17:28.241233] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-16T19:17:28.243951] [INFO ] [REMOTE ] LZM: Full fetch complete (14141 records). [2025-09-16T19:17:28.244082] [DEBUG] [VALIDATOR ] LZM: Validating primary data. [2025-09-16T19:17:28.391456] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-09. [2025-09-16T19:17:28.622233] [DEBUG] [VALIDATOR ] LZM: All expected trading days are present. [2025-09-16T19:17:28.622376] [DEBUG] [VALIDATOR ] LZM: Primary data validation passed. [2025-09-16T19:17:28.622797] [INFO ] [MAIN ] LZM: Fetched primary data is valid. [2025-09-16T19:17:28.622854] [DEBUG] [LOCAL ] LZM: Saving primary data. [2025-09-16T19:17:28.623360] [DEBUG] [LOCAL ] LZM: Trimmed 14141 records to 8881 (keeping 150 days of data) [2025-09-16T19:17:28.674477] [DEBUG] [LOCAL ] LZM: Primary data saved (8881 records). [2025-09-16T19:17:28.674673] [INFO ] [MAIN ] LZM: Full history saved. [2025-09-16T19:17:28.674811] [INFO ] [MAIN ] Update Progress: 1296/2369 symbols completed. LZM took 17.9s. Estimated remaining: 1h 53m 47s. Rate: 9.4 symbols/min [2025-09-16T19:17:28.913521] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:17:28.916014] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-16T19:17:28.961043] [DEBUG] [LOCAL ] MAA: Loaded 31623 existing records from primary storage. [2025-09-16T19:17:28.961182] [INFO ] [MAIN ] MAA: Loaded 31623 existing records. [2025-09-16T19:17:29.142036] [WARN ] [MAIN ] MAA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:17:29.142266] [INFO ] [MAIN ] MAA: Wiping existing primary data before full refresh. [2025-09-16T19:17:29.142314] [INFO ] [LOCAL ] MAA: Starting deletion of primary data. [2025-09-16T19:17:29.143704] [DEBUG] [LOCAL ] MAA: Deleted primary data file. [2025-09-16T19:17:29.143757] [INFO ] [MAIN ] MAA: Starting full primary refresh. [2025-09-16T19:17:29.180086] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-02. [2025-09-16T19:17:29.510057] [INFO ] [REMOTE ] MAA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:17:29.974916] [INFO ] [REMOTE ] M: Fetching primary data for 2025-05. [2025-09-16T19:17:30.096281] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-16T19:17:30.103917] [INFO ] [REMOTE ] LYV: Full fetch complete (55901 records). [2025-09-16T19:17:30.104048] [DEBUG] [VALIDATOR ] LYV: Validating primary data. [2025-09-16T19:17:30.490132] [DEBUG] [VALIDATOR ] LYV: All expected trading days are present. [2025-09-16T19:17:30.490220] [DEBUG] [VALIDATOR ] LYV: Primary data validation passed. [2025-09-16T19:17:30.491121] [INFO ] [MAIN ] LYV: Fetched primary data is valid. [2025-09-16T19:17:30.491168] [DEBUG] [LOCAL ] LYV: Saving primary data. [2025-09-16T19:17:30.492283] [DEBUG] [LOCAL ] LYV: Trimmed 55901 records to 37955 (keeping 150 days of data) [2025-09-16T19:17:30.725069] [DEBUG] [LOCAL ] LYV: Primary data saved (37955 records). [2025-09-16T19:17:30.725218] [INFO ] [MAIN ] LYV: Full history saved. [2025-09-16T19:17:30.725305] [INFO ] [MAIN ] Update Progress: 1297/2369 symbols completed. LYV took 32.9s. Estimated remaining: 1h 53m 37s. Rate: 9.4 symbols/min [2025-09-16T19:17:30.789399] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-02. [2025-09-16T19:17:30.897360] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:17:30.933533] [DEBUG] [LOCAL ] MAC: Loaded 36424 existing records from primary storage. [2025-09-16T19:17:30.933694] [INFO ] [MAIN ] MAC: Loaded 36424 existing records. [2025-09-16T19:17:31.112522] [WARN ] [MAIN ] MAC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:17:31.112885] [INFO ] [MAIN ] MAC: Wiping existing primary data before full refresh. [2025-09-16T19:17:31.113017] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-09-16T19:17:31.113888] [DEBUG] [LOCAL ] MAC: Deleted primary data file. [2025-09-16T19:17:31.113939] [INFO ] [MAIN ] MAC: Starting full primary refresh. [2025-09-16T19:17:31.252628] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-16T19:17:31.537081] [INFO ] [REMOTE ] MAC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:17:31.570716] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-16T19:17:31.581120] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-03. [2025-09-16T19:17:32.374906] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-02. [2025-09-16T19:17:32.680810] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-16T19:17:33.174933] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-03. [2025-09-16T19:17:33.564072] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-16T19:17:33.682582] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-16T19:17:33.974901] [INFO ] [REMOTE ] M: Fetching primary data for 2025-06. [2025-09-16T19:17:34.785550] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-03. [2025-09-16T19:17:34.788300] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-16T19:17:35.574910] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-04. [2025-09-16T19:17:35.838530] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-16T19:17:36.374909] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-04. [2025-09-16T19:17:36.520995] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-16T19:17:37.174884] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-04. [2025-09-16T19:17:37.654864] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-16T19:17:37.974905] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-05. [2025-09-16T19:17:38.161618] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-16T19:17:38.774873] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-05. [2025-09-16T19:17:38.829087] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-16T19:17:39.574872] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-05. [2025-09-16T19:17:40.028504] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-16T19:17:40.302350] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-16T19:17:40.374905] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-06. [2025-09-16T19:17:41.174884] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-06. [2025-09-16T19:17:41.278503] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-16T19:17:41.974948] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-06. [2025-09-16T19:17:42.414910] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-16T19:17:42.537762] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-16T19:17:42.774891] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-07. [2025-09-16T19:17:43.308798] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-16T19:17:43.574947] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-07. [2025-09-16T19:17:44.374905] [INFO ] [REMOTE ] M: Fetching primary data for 2025-07. [2025-09-16T19:17:44.621502] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-16T19:17:45.161224] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-16T19:17:45.174847] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-08. [2025-09-16T19:17:45.974903] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-08. [2025-09-16T19:17:46.406794] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-16T19:17:46.713484] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-16T19:17:46.774887] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-09. [2025-09-16T19:17:47.574920] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-07. [2025-09-16T19:17:47.736107] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-16T19:17:48.304310] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-16T19:17:48.310094] [INFO ] [REMOTE ] MAA: Full fetch complete (46726 records). [2025-09-16T19:17:48.310259] [DEBUG] [VALIDATOR ] MAA: Validating primary data. [2025-09-16T19:17:48.382126] [INFO ] [REMOTE ] M: Fetching primary data for 2025-08. [2025-09-16T19:17:48.715175] [DEBUG] [VALIDATOR ] MAA: All expected trading days are present. [2025-09-16T19:17:48.715254] [DEBUG] [VALIDATOR ] MAA: Primary data validation passed. [2025-09-16T19:17:48.716007] [INFO ] [MAIN ] MAA: Fetched primary data is valid. [2025-09-16T19:17:48.716062] [DEBUG] [LOCAL ] MAA: Saving primary data. [2025-09-16T19:17:48.717054] [DEBUG] [LOCAL ] MAA: Trimmed 46726 records to 31954 (keeping 150 days of data) [2025-09-16T19:17:48.917969] [DEBUG] [LOCAL ] MAA: Primary data saved (31954 records). [2025-09-16T19:17:48.918106] [INFO ] [MAIN ] MAA: Full history saved. [2025-09-16T19:17:48.918205] [INFO ] [MAIN ] Update Progress: 1298/2369 symbols completed. MAA took 20.2s. Estimated remaining: 1h 53m 40s. Rate: 9.4 symbols/min [2025-09-16T19:17:49.095830] [INFO ] [MAIN ] MAGN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:17:49.123260] [DEBUG] [LOCAL ] MAGN: Loaded 26043 existing records from primary storage. [2025-09-16T19:17:49.123405] [INFO ] [MAIN ] MAGN: Loaded 26043 existing records. [2025-09-16T19:17:49.189104] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-09. [2025-09-16T19:17:49.306563] [WARN ] [MAIN ] MAGN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:17:49.306827] [INFO ] [MAIN ] MAGN: Wiping existing primary data before full refresh. [2025-09-16T19:17:49.306882] [INFO ] [LOCAL ] MAGN: Starting deletion of primary data. [2025-09-16T19:17:49.307451] [DEBUG] [LOCAL ] MAGN: Deleted primary data file. [2025-09-16T19:17:49.307513] [INFO ] [MAIN ] MAGN: Starting full primary refresh. [2025-09-16T19:17:49.667690] [INFO ] [REMOTE ] MAGN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:17:49.695983] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-16T19:17:49.974870] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-08. [2025-09-16T19:17:50.296674] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-16T19:17:50.774886] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-02. [2025-09-16T19:17:50.918044] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-16T19:17:50.926956] [INFO ] [REMOTE ] MA: Full fetch complete (57188 records). [2025-09-16T19:17:50.927060] [DEBUG] [VALIDATOR ] MA: Validating primary data. [2025-09-16T19:17:51.335135] [DEBUG] [VALIDATOR ] MA: All expected trading days are present. [2025-09-16T19:17:51.335258] [DEBUG] [VALIDATOR ] MA: Primary data validation passed. [2025-09-16T19:17:51.336202] [INFO ] [MAIN ] MA: Fetched primary data is valid. [2025-09-16T19:17:51.336271] [DEBUG] [LOCAL ] MA: Saving primary data. [2025-09-16T19:17:51.338024] [DEBUG] [LOCAL ] MA: Trimmed 57188 records to 39040 (keeping 150 days of data) [2025-09-16T19:17:51.476474] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-16T19:17:51.598775] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-09. [2025-09-16T19:17:51.632126] [DEBUG] [LOCAL ] MA: Primary data saved (39040 records). [2025-09-16T19:17:51.632237] [INFO ] [MAIN ] MA: Full history saved. [2025-09-16T19:17:51.633023] [INFO ] [MAIN ] Update Progress: 1299/2369 symbols completed. MA took 26.8s. Estimated remaining: 1h 53m 31s. Rate: 9.4 symbols/min [2025-09-16T19:17:51.809223] [INFO ] [MAIN ] MAIN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:17:51.846892] [DEBUG] [LOCAL ] MAIN: Loaded 30333 existing records from primary storage. [2025-09-16T19:17:51.847058] [INFO ] [MAIN ] MAIN: Loaded 30333 existing records. [2025-09-16T19:17:52.020781] [WARN ] [MAIN ] MAIN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:17:52.021026] [INFO ] [MAIN ] MAIN: Wiping existing primary data before full refresh. [2025-09-16T19:17:52.021073] [INFO ] [LOCAL ] MAIN: Starting deletion of primary data. [2025-09-16T19:17:52.021769] [DEBUG] [LOCAL ] MAIN: Deleted primary data file. [2025-09-16T19:17:52.021819] [INFO ] [MAIN ] MAIN: Starting full primary refresh. [2025-09-16T19:17:52.392507] [INFO ] [REMOTE ] M: Fetching primary data for 2025-09. [2025-09-16T19:17:52.399078] [INFO ] [REMOTE ] MAIN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:17:52.400765] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-16T19:17:52.953118] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-16T19:17:52.963183] [INFO ] [REMOTE ] MAC: Full fetch complete (53971 records). [2025-09-16T19:17:52.963365] [DEBUG] [VALIDATOR ] MAC: Validating primary data. [2025-09-16T19:17:53.182249] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-02. [2025-09-16T19:17:53.342481] [DEBUG] [VALIDATOR ] MAC: All expected trading days are present. [2025-09-16T19:17:53.342573] [DEBUG] [VALIDATOR ] MAC: Primary data validation passed. [2025-09-16T19:17:53.343396] [INFO ] [MAIN ] MAC: Fetched primary data is valid. [2025-09-16T19:17:53.343444] [DEBUG] [LOCAL ] MAC: Saving primary data. [2025-09-16T19:17:53.344624] [DEBUG] [LOCAL ] MAC: Trimmed 53971 records to 36799 (keeping 150 days of data) [2025-09-16T19:17:53.577078] [DEBUG] [LOCAL ] MAC: Primary data saved (36799 records). [2025-09-16T19:17:53.577218] [INFO ] [MAIN ] MAC: Full history saved. [2025-09-16T19:17:53.577301] [INFO ] [MAIN ] Update Progress: 1300/2369 symbols completed. MAC took 22.9s. Estimated remaining: 1h 53m 21s. Rate: 9.4 symbols/min [2025-09-16T19:17:53.751892] [INFO ] [MAIN ] MAN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:17:53.784665] [DEBUG] [LOCAL ] MAN: Loaded 32327 existing records from primary storage. [2025-09-16T19:17:53.784806] [INFO ] [MAIN ] MAN: Loaded 32327 existing records. [2025-09-16T19:17:53.960785] [WARN ] [MAIN ] MAN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:17:53.961008] [INFO ] [MAIN ] MAN: Wiping existing primary data before full refresh. [2025-09-16T19:17:53.961088] [INFO ] [LOCAL ] MAN: Starting deletion of primary data. [2025-09-16T19:17:53.961759] [DEBUG] [LOCAL ] MAN: Deleted primary data file. [2025-09-16T19:17:53.961808] [INFO ] [MAIN ] MAN: Starting full primary refresh. [2025-09-16T19:17:53.993111] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-03. [2025-09-16T19:17:54.341870] [INFO ] [REMOTE ] MAN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:17:54.360025] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-16T19:17:54.367419] [INFO ] [REMOTE ] M: Full fetch complete (58188 records). [2025-09-16T19:17:54.367529] [DEBUG] [VALIDATOR ] M: Validating primary data. [2025-09-16T19:17:54.756993] [DEBUG] [VALIDATOR ] M: All expected trading days are present. [2025-09-16T19:17:54.757096] [DEBUG] [VALIDATOR ] M: Primary data validation passed. [2025-09-16T19:17:54.758087] [INFO ] [MAIN ] M: Fetched primary data is valid. [2025-09-16T19:17:54.758160] [DEBUG] [LOCAL ] M: Saving primary data. [2025-09-16T19:17:54.759768] [DEBUG] [LOCAL ] M: Trimmed 58188 records to 39907 (keeping 150 days of data) [2025-09-16T19:17:54.819905] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-02. [2025-09-16T19:17:54.923996] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-16T19:17:55.056202] [DEBUG] [LOCAL ] M: Primary data saved (39907 records). [2025-09-16T19:17:55.056362] [INFO ] [MAIN ] M: Full history saved. [2025-09-16T19:17:55.056478] [INFO ] [MAIN ] Update Progress: 1301/2369 symbols completed. M took 36.5s. Estimated remaining: 1h 53m 11s. Rate: 9.4 symbols/min [2025-09-16T19:17:55.244509] [INFO ] [MAIN ] MANU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:17:55.264167] [DEBUG] [LOCAL ] MANU: Loaded 19151 existing records from primary storage. [2025-09-16T19:17:55.264286] [INFO ] [MAIN ] MANU: Loaded 19151 existing records. [2025-09-16T19:17:55.444909] [WARN ] [MAIN ] MANU: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:17:55.445407] [INFO ] [MAIN ] MANU: Wiping existing primary data before full refresh. [2025-09-16T19:17:55.445488] [INFO ] [LOCAL ] MANU: Starting deletion of primary data. [2025-09-16T19:17:55.446120] [DEBUG] [LOCAL ] MANU: Deleted primary data file. [2025-09-16T19:17:55.446173] [INFO ] [MAIN ] MANU: Starting full primary refresh. [2025-09-16T19:17:55.577211] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-03. [2025-09-16T19:17:55.583733] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-16T19:17:55.846086] [INFO ] [REMOTE ] MANU: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:17:55.871554] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-16T19:17:56.374918] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-02. [2025-09-16T19:17:57.174982] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-03. [2025-09-16T19:17:57.390374] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-16T19:17:57.545782] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-16T19:17:57.974959] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-04. [2025-09-16T19:17:58.613004] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-16T19:17:58.774909] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-04. [2025-09-16T19:17:59.574939] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-04. [2025-09-16T19:17:59.808314] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-16T19:18:00.121802] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-16T19:18:00.374930] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-05. [2025-09-16T19:18:00.665467] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-16T19:18:01.174895] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-03. [2025-09-16T19:18:01.974980] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-05. [2025-09-16T19:18:02.078474] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-16T19:18:02.285716] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-16T19:18:02.774896] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-04. [2025-09-16T19:18:03.568801] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-16T19:18:03.576525] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-06. [2025-09-16T19:18:03.688820] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-16T19:18:04.374946] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-05. [2025-09-16T19:18:05.016192] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-16T19:18:05.174939] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-05. [2025-09-16T19:18:05.534120] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-16T19:18:05.974952] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-07. [2025-09-16T19:18:06.774890] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-06. [2025-09-16T19:18:07.059828] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-16T19:18:07.433117] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-16T19:18:07.574918] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-08. [2025-09-16T19:18:08.169245] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-16T19:18:08.374930] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-06. [2025-09-16T19:18:09.086213] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-16T19:18:09.174889] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-09. [2025-09-16T19:18:09.740916] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-16T19:18:09.974937] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-06. [2025-09-16T19:18:10.295121] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-16T19:18:10.300316] [INFO ] [REMOTE ] MAN: Full fetch complete (47027 records). [2025-09-16T19:18:10.300396] [DEBUG] [VALIDATOR ] MAN: Validating primary data. [2025-09-16T19:18:10.671821] [DEBUG] [VALIDATOR ] MAN: All expected trading days are present. [2025-09-16T19:18:10.671915] [DEBUG] [VALIDATOR ] MAN: Primary data validation passed. [2025-09-16T19:18:10.672684] [INFO ] [MAIN ] MAN: Fetched primary data is valid. [2025-09-16T19:18:10.672733] [DEBUG] [LOCAL ] MAN: Saving primary data. [2025-09-16T19:18:10.673922] [DEBUG] [LOCAL ] MAN: Trimmed 47027 records to 32640 (keeping 150 days of data) [2025-09-16T19:18:10.776213] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-07. [2025-09-16T19:18:10.872622] [DEBUG] [LOCAL ] MAN: Primary data saved (32640 records). [2025-09-16T19:18:10.872779] [INFO ] [MAIN ] MAN: Full history saved. [2025-09-16T19:18:10.872874] [INFO ] [MAIN ] Update Progress: 1302/2369 symbols completed. MAN took 17.3s. Estimated remaining: 1h 53m 12s. Rate: 9.4 symbols/min [2025-09-16T19:18:11.041002] [INFO ] [MAIN ] MAS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:18:11.075659] [DEBUG] [LOCAL ] MAS: Loaded 38615 existing records from primary storage. [2025-09-16T19:18:11.075804] [INFO ] [MAIN ] MAS: Loaded 38615 existing records. [2025-09-16T19:18:11.252662] [WARN ] [MAIN ] MAS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:18:11.252954] [INFO ] [MAIN ] MAS: Wiping existing primary data before full refresh. [2025-09-16T19:18:11.253002] [INFO ] [LOCAL ] MAS: Starting deletion of primary data. [2025-09-16T19:18:11.253837] [DEBUG] [LOCAL ] MAS: Deleted primary data file. [2025-09-16T19:18:11.253887] [INFO ] [MAIN ] MAS: Starting full primary refresh. [2025-09-16T19:18:11.575300] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-07. [2025-09-16T19:18:11.604177] [INFO ] [REMOTE ] MAS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:18:11.685430] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-16T19:18:12.066955] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-16T19:18:12.374908] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-02. [2025-09-16T19:18:13.035422] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-16T19:18:13.174935] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-08. [2025-09-16T19:18:13.528846] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-16T19:18:13.974887] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-08. [2025-09-16T19:18:14.284511] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-16T19:18:14.774890] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-03. [2025-09-16T19:18:15.032078] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-16T19:18:15.574941] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-07. [2025-09-16T19:18:16.206702] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-16T19:18:16.374919] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-04. [2025-09-16T19:18:17.174900] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-09. [2025-09-16T19:18:17.279934] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-16T19:18:17.974961] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-08. [2025-09-16T19:18:18.152227] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-16T19:18:18.312596] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-16T19:18:18.316614] [INFO ] [REMOTE ] MANU: Full fetch complete (29456 records). [2025-09-16T19:18:18.316762] [DEBUG] [VALIDATOR ] MANU: Validating primary data. [2025-09-16T19:18:18.695204] [DEBUG] [VALIDATOR ] MANU: All expected trading days are present. [2025-09-16T19:18:18.695315] [DEBUG] [VALIDATOR ] MANU: Primary data validation passed. [2025-09-16T19:18:18.695941] [INFO ] [MAIN ] MANU: Fetched primary data is valid. [2025-09-16T19:18:18.695988] [DEBUG] [LOCAL ] MANU: Saving primary data. [2025-09-16T19:18:18.696847] [DEBUG] [LOCAL ] MANU: Trimmed 29456 records to 19379 (keeping 150 days of data) [2025-09-16T19:18:18.780392] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-09. [2025-09-16T19:18:18.815558] [DEBUG] [LOCAL ] MANU: Primary data saved (19379 records). [2025-09-16T19:18:18.815774] [INFO ] [MAIN ] MANU: Full history saved. [2025-09-16T19:18:18.815879] [INFO ] [MAIN ] Update Progress: 1303/2369 symbols completed. MANU took 23.8s. Estimated remaining: 1h 53m 7s. Rate: 9.4 symbols/min [2025-09-16T19:18:19.034330] [INFO ] [MAIN ] MATV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:18:19.061997] [DEBUG] [LOCAL ] MATV: Loaded 26656 existing records from primary storage. [2025-09-16T19:18:19.062157] [INFO ] [MAIN ] MATV: Loaded 26656 existing records. [2025-09-16T19:18:19.249932] [WARN ] [MAIN ] MATV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:18:19.250206] [INFO ] [MAIN ] MATV: Wiping existing primary data before full refresh. [2025-09-16T19:18:19.250253] [INFO ] [LOCAL ] MATV: Starting deletion of primary data. [2025-09-16T19:18:19.250943] [DEBUG] [LOCAL ] MATV: Deleted primary data file. [2025-09-16T19:18:19.250995] [INFO ] [MAIN ] MATV: Starting full primary refresh. [2025-09-16T19:18:19.577825] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-05. [2025-09-16T19:18:19.613174] [INFO ] [REMOTE ] MATV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:18:19.727174] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-16T19:18:20.070080] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-16T19:18:20.074247] [INFO ] [REMOTE ] MAGN: Full fetch complete (38316 records). [2025-09-16T19:18:20.074334] [DEBUG] [VALIDATOR ] MAGN: Validating primary data. [2025-09-16T19:18:20.380019] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-09. [2025-09-16T19:18:20.449963] [DEBUG] [VALIDATOR ] MAGN: All expected trading days are present. [2025-09-16T19:18:20.450039] [DEBUG] [VALIDATOR ] MAGN: Primary data validation passed. [2025-09-16T19:18:20.450789] [INFO ] [MAIN ] MAGN: Fetched primary data is valid. [2025-09-16T19:18:20.450835] [DEBUG] [LOCAL ] MAGN: Saving primary data. [2025-09-16T19:18:20.451733] [DEBUG] [LOCAL ] MAGN: Trimmed 38316 records to 26255 (keeping 150 days of data) [2025-09-16T19:18:20.604666] [DEBUG] [LOCAL ] MAGN: Primary data saved (26255 records). [2025-09-16T19:18:20.604799] [INFO ] [MAIN ] MAGN: Full history saved. [2025-09-16T19:18:20.604904] [INFO ] [MAIN ] Update Progress: 1304/2369 symbols completed. MAGN took 31.7s. Estimated remaining: 1h 52m 57s. Rate: 9.4 symbols/min [2025-09-16T19:18:20.774713] [INFO ] [MAIN ] MATX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:18:20.798824] [DEBUG] [LOCAL ] MATX: Loaded 23548 existing records from primary storage. [2025-09-16T19:18:20.798951] [INFO ] [MAIN ] MATX: Loaded 23548 existing records. [2025-09-16T19:18:20.976076] [WARN ] [MAIN ] MATX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:18:20.976318] [INFO ] [MAIN ] MATX: Wiping existing primary data before full refresh. [2025-09-16T19:18:20.976381] [INFO ] [LOCAL ] MATX: Starting deletion of primary data. [2025-09-16T19:18:20.977152] [DEBUG] [LOCAL ] MATX: Deleted primary data file. [2025-09-16T19:18:20.977213] [INFO ] [MAIN ] MATX: Starting full primary refresh. [2025-09-16T19:18:21.180017] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-02. [2025-09-16T19:18:21.345589] [INFO ] [REMOTE ] MATX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:18:21.399017] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-16T19:18:21.974946] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-06. [2025-09-16T19:18:22.013505] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-16T19:18:22.019109] [INFO ] [REMOTE ] MAIN: Full fetch complete (45061 records). [2025-09-16T19:18:22.019247] [DEBUG] [VALIDATOR ] MAIN: Validating primary data. [2025-09-16T19:18:22.425410] [DEBUG] [VALIDATOR ] MAIN: All expected trading days are present. [2025-09-16T19:18:22.425549] [DEBUG] [VALIDATOR ] MAIN: Primary data validation passed. [2025-09-16T19:18:22.426474] [INFO ] [MAIN ] MAIN: Fetched primary data is valid. [2025-09-16T19:18:22.426571] [DEBUG] [LOCAL ] MAIN: Saving primary data. [2025-09-16T19:18:22.450990] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-16T19:18:22.449852] [DEBUG] [LOCAL ] MAIN: Trimmed 45061 records to 30668 (keeping 150 days of data) [2025-09-16T19:18:22.647022] [DEBUG] [LOCAL ] MAIN: Primary data saved (30668 records). [2025-09-16T19:18:22.647156] [INFO ] [MAIN ] MAIN: Full history saved. [2025-09-16T19:18:22.648378] [INFO ] [MAIN ] Update Progress: 1305/2369 symbols completed. MAIN took 31.0s. Estimated remaining: 1h 52m 47s. Rate: 9.4 symbols/min [2025-09-16T19:18:22.787994] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-03. [2025-09-16T19:18:22.816974] [INFO ] [MAIN ] MAX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:18:22.843394] [DEBUG] [LOCAL ] MAX: Loaded 22023 existing records from primary storage. [2025-09-16T19:18:22.843539] [INFO ] [MAIN ] MAX: Loaded 22023 existing records. [2025-09-16T19:18:23.029795] [WARN ] [MAIN ] MAX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:18:23.030086] [INFO ] [MAIN ] MAX: Wiping existing primary data before full refresh. [2025-09-16T19:18:23.030145] [INFO ] [LOCAL ] MAX: Starting deletion of primary data. [2025-09-16T19:18:23.030768] [DEBUG] [LOCAL ] MAX: Deleted primary data file. [2025-09-16T19:18:23.030833] [INFO ] [MAIN ] MAX: Starting full primary refresh. [2025-09-16T19:18:23.397786] [INFO ] [REMOTE ] MAX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:18:23.574942] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-02. [2025-09-16T19:18:23.736387] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-16T19:18:24.290013] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-16T19:18:24.374902] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-04. [2025-09-16T19:18:24.992121] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-16T19:18:25.174926] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-07. [2025-09-16T19:18:25.856825] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-16T19:18:25.974901] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-05. [2025-09-16T19:18:26.774956] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-02. [2025-09-16T19:18:26.840839] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-16T19:18:26.939978] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-16T19:18:27.574914] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-06. [2025-09-16T19:18:27.740630] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-16T19:18:28.374908] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-03. [2025-09-16T19:18:29.049995] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-16T19:18:29.174867] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-07. [2025-09-16T19:18:29.545015] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-16T19:18:29.974910] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-03. [2025-09-16T19:18:30.589045] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-16T19:18:30.774900] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-08. [2025-09-16T19:18:30.978581] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-16T19:18:31.574903] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-08. [2025-09-16T19:18:32.306220] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-16T19:18:32.374882] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-09. [2025-09-16T19:18:33.061393] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-16T19:18:33.174906] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-04. [2025-09-16T19:18:33.974880] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-09. [2025-09-16T19:18:34.039245] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-16T19:18:34.045849] [INFO ] [REMOTE ] MAS: Full fetch complete (56776 records). [2025-09-16T19:18:34.045976] [DEBUG] [VALIDATOR ] MAS: Validating primary data. [2025-09-16T19:18:34.441085] [DEBUG] [VALIDATOR ] MAS: All expected trading days are present. [2025-09-16T19:18:34.441166] [DEBUG] [VALIDATOR ] MAS: Primary data validation passed. [2025-09-16T19:18:34.442354] [INFO ] [MAIN ] MAS: Fetched primary data is valid. [2025-09-16T19:18:34.442399] [DEBUG] [LOCAL ] MAS: Saving primary data. [2025-09-16T19:18:34.443550] [DEBUG] [LOCAL ] MAS: Trimmed 56776 records to 39000 (keeping 150 days of data) [2025-09-16T19:18:34.678333] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-16T19:18:34.713584] [DEBUG] [LOCAL ] MAS: Primary data saved (39000 records). [2025-09-16T19:18:34.713761] [INFO ] [MAIN ] MAS: Full history saved. [2025-09-16T19:18:34.713866] [INFO ] [MAIN ] Update Progress: 1306/2369 symbols completed. MAS took 23.8s. Estimated remaining: 1h 52m 45s. Rate: 9.4 symbols/min [2025-09-16T19:18:34.780006] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-05. [2025-09-16T19:18:34.887547] [INFO ] [MAIN ] MBC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:18:34.918199] [DEBUG] [LOCAL ] MBC: Loaded 31444 existing records from primary storage. [2025-09-16T19:18:34.918349] [INFO ] [MAIN ] MBC: Loaded 31444 existing records. [2025-09-16T19:18:35.097586] [WARN ] [MAIN ] MBC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:18:35.097848] [INFO ] [MAIN ] MBC: Wiping existing primary data before full refresh. [2025-09-16T19:18:35.097895] [INFO ] [LOCAL ] MBC: Starting deletion of primary data. [2025-09-16T19:18:35.098690] [DEBUG] [LOCAL ] MBC: Deleted primary data file. [2025-09-16T19:18:35.098754] [INFO ] [MAIN ] MBC: Starting full primary refresh. [2025-09-16T19:18:35.268078] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-16T19:18:35.369493] [INFO ] [REMOTE ] MATV: Full fetch complete (41301 records). [2025-09-16T19:18:35.386806] [DEBUG] [VALIDATOR ] MATV: Validating primary data. [2025-09-16T19:18:35.587424] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-04. [2025-09-16T19:18:35.592339] [INFO ] [REMOTE ] MBC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:18:35.875263] [DEBUG] [VALIDATOR ] MATV: All expected trading days are present. [2025-09-16T19:18:35.875368] [DEBUG] [VALIDATOR ] MATV: Primary data validation passed. [2025-09-16T19:18:35.876260] [INFO ] [MAIN ] MATV: Fetched primary data is valid. [2025-09-16T19:18:35.876321] [DEBUG] [LOCAL ] MATV: Saving primary data. [2025-09-16T19:18:35.877316] [DEBUG] [LOCAL ] MATV: Trimmed 41301 records to 26810 (keeping 150 days of data) [2025-09-16T19:18:36.039376] [DEBUG] [LOCAL ] MATV: Primary data saved (26810 records). [2025-09-16T19:18:36.039516] [INFO ] [MAIN ] MATV: Full history saved. [2025-09-16T19:18:36.039663] [INFO ] [MAIN ] Update Progress: 1307/2369 symbols completed. MATV took 17.2s. Estimated remaining: 1h 52m 35s. Rate: 9.4 symbols/min [2025-09-16T19:18:36.219412] [INFO ] [MAIN ] MBI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:18:36.236711] [DEBUG] [LOCAL ] MBI: Loaded 17482 existing records from primary storage. [2025-09-16T19:18:36.236838] [INFO ] [MAIN ] MBI: Loaded 17482 existing records. [2025-09-16T19:18:36.389108] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-02. [2025-09-16T19:18:36.428680] [WARN ] [MAIN ] MBI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:18:36.428985] [INFO ] [MAIN ] MBI: Wiping existing primary data before full refresh. [2025-09-16T19:18:36.429062] [INFO ] [LOCAL ] MBI: Starting deletion of primary data. [2025-09-16T19:18:36.437008] [DEBUG] [LOCAL ] MBI: Deleted primary data file. [2025-09-16T19:18:36.449850] [INFO ] [MAIN ] MBI: Starting full primary refresh. [2025-09-16T19:18:36.483047] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-16T19:18:36.844985] [INFO ] [REMOTE ] MBI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:18:36.928076] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-16T19:18:37.174895] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-05. [2025-09-16T19:18:37.605111] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-16T19:18:37.974896] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-02. [2025-09-16T19:18:38.481969] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-16T19:18:38.767875] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-16T19:18:38.774831] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-03. [2025-09-16T19:18:39.574880] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-06. [2025-09-16T19:18:39.950275] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-16T19:18:40.374897] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-04. [2025-09-16T19:18:40.621301] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-16T19:18:41.174917] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-07. [2025-09-16T19:18:41.628445] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-16T19:18:41.974869] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-03. [2025-09-16T19:18:42.417561] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-16T19:18:42.774923] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-05. [2025-09-16T19:18:43.173285] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-16T19:18:43.538635] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-16T19:18:43.574874] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-08. [2025-09-16T19:18:44.374925] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-06. [2025-09-16T19:18:44.936289] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-16T19:18:45.174889] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-09. [2025-09-16T19:18:45.220564] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-16T19:18:45.974950] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-07. [2025-09-16T19:18:46.414074] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-16T19:18:46.419072] [INFO ] [REMOTE ] MAX: Full fetch complete (33979 records). [2025-09-16T19:18:46.419529] [DEBUG] [VALIDATOR ] MAX: Validating primary data. [2025-09-16T19:18:46.778669] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-06. [2025-09-16T19:18:46.809393] [DEBUG] [VALIDATOR ] MAX: All expected trading days are present. [2025-09-16T19:18:46.809574] [DEBUG] [VALIDATOR ] MAX: Primary data validation passed. [2025-09-16T19:18:46.810315] [INFO ] [MAIN ] MAX: Fetched primary data is valid. [2025-09-16T19:18:46.810360] [DEBUG] [LOCAL ] MAX: Saving primary data. [2025-09-16T19:18:46.811136] [DEBUG] [LOCAL ] MAX: Trimmed 33979 records to 22245 (keeping 150 days of data) [2025-09-16T19:18:46.940191] [DEBUG] [LOCAL ] MAX: Primary data saved (22245 records). [2025-09-16T19:18:46.940322] [INFO ] [MAIN ] MAX: Full history saved. [2025-09-16T19:18:46.940433] [INFO ] [MAIN ] Update Progress: 1308/2369 symbols completed. MAX took 24.3s. Estimated remaining: 1h 52m 32s. Rate: 9.4 symbols/min [2025-09-16T19:18:47.112488] [INFO ] [MAIN ] MC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:18:47.125861] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-16T19:18:47.160112] [DEBUG] [LOCAL ] MC: Loaded 32268 existing records from primary storage. [2025-09-16T19:18:47.160261] [INFO ] [MAIN ] MC: Loaded 32268 existing records. [2025-09-16T19:18:47.342819] [WARN ] [MAIN ] MC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:18:47.343094] [INFO ] [MAIN ] MC: Wiping existing primary data before full refresh. [2025-09-16T19:18:47.343142] [INFO ] [LOCAL ] MC: Starting deletion of primary data. [2025-09-16T19:18:47.343798] [DEBUG] [LOCAL ] MC: Deleted primary data file. [2025-09-16T19:18:47.343848] [INFO ] [MAIN ] MC: Starting full primary refresh. [2025-09-16T19:18:47.584121] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-04. [2025-09-16T19:18:47.713507] [INFO ] [REMOTE ] MC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:18:47.906917] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-16T19:18:48.374916] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-07. [2025-09-16T19:18:48.786917] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-16T19:18:49.174914] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-05. [2025-09-16T19:18:49.724800] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-16T19:18:49.974926] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-08. [2025-09-16T19:18:50.680046] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-16T19:18:50.774912] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-06. [2025-09-16T19:18:51.139323] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-16T19:18:51.574912] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-02. [2025-09-16T19:18:52.254457] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-16T19:18:52.374978] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-08. [2025-09-16T19:18:53.179969] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-07. [2025-09-16T19:18:53.192286] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-16T19:18:53.544389] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-16T19:18:53.974976] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-09. [2025-09-16T19:18:54.573993] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-16T19:18:54.775007] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-09. [2025-09-16T19:18:55.183017] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-16T19:18:55.186468] [INFO ] [REMOTE ] MBI: Full fetch complete (27263 records). [2025-09-16T19:18:55.186550] [DEBUG] [VALIDATOR ] MBI: Validating primary data. [2025-09-16T19:18:55.551337] [DEBUG] [VALIDATOR ] MBI: All expected trading days are present. [2025-09-16T19:18:55.551417] [DEBUG] [VALIDATOR ] MBI: Primary data validation passed. [2025-09-16T19:18:55.551985] [INFO ] [MAIN ] MBI: Fetched primary data is valid. [2025-09-16T19:18:55.552029] [DEBUG] [LOCAL ] MBI: Saving primary data. [2025-09-16T19:18:55.552696] [DEBUG] [LOCAL ] MBI: Trimmed 27263 records to 17717 (keeping 150 days of data) [2025-09-16T19:18:55.593885] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-03. [2025-09-16T19:18:55.654522] [DEBUG] [LOCAL ] MBI: Primary data saved (17717 records). [2025-09-16T19:18:55.654664] [INFO ] [MAIN ] MBI: Full history saved. [2025-09-16T19:18:55.654750] [INFO ] [MAIN ] Update Progress: 1309/2369 symbols completed. MBI took 19.6s. Estimated remaining: 1h 52m 28s. Rate: 9.4 symbols/min [2025-09-16T19:18:55.825547] [INFO ] [MAIN ] MCB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:18:55.838085] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-16T19:18:55.843808] [INFO ] [REMOTE ] MATX: Full fetch complete (34385 records). [2025-09-16T19:18:55.843928] [DEBUG] [VALIDATOR ] MATX: Validating primary data. [2025-09-16T19:18:55.915497] [DEBUG] [LOCAL ] MCB: Loaded 8093 existing records from primary storage. [2025-09-16T19:18:55.927143] [INFO ] [MAIN ] MCB: Loaded 8093 existing records. [2025-09-16T19:18:56.309089] [WARN ] [MAIN ] MCB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:18:56.330195] [INFO ] [MAIN ] MCB: Wiping existing primary data before full refresh. [2025-09-16T19:18:56.330452] [INFO ] [LOCAL ] MCB: Starting deletion of primary data. [2025-09-16T19:18:56.356488] [DEBUG] [LOCAL ] MCB: Deleted primary data file. [2025-09-16T19:18:56.383677] [INFO ] [MAIN ] MCB: Starting full primary refresh. [2025-09-16T19:18:56.378570] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-08. [2025-09-16T19:18:56.517746] [DEBUG] [VALIDATOR ] MATX: All expected trading days are present. [2025-09-16T19:18:56.520176] [DEBUG] [VALIDATOR ] MATX: Primary data validation passed. [2025-09-16T19:18:56.521206] [INFO ] [MAIN ] MATX: Fetched primary data is valid. [2025-09-16T19:18:56.521573] [DEBUG] [LOCAL ] MATX: Saving primary data. [2025-09-16T19:18:56.581935] [DEBUG] [LOCAL ] MATX: Trimmed 34385 records to 23742 (keeping 150 days of data) [2025-09-16T19:18:56.921019] [INFO ] [REMOTE ] MCB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:18:56.947959] [DEBUG] [LOCAL ] MATX: Primary data saved (23742 records). [2025-09-16T19:18:56.948149] [INFO ] [MAIN ] MATX: Full history saved. [2025-09-16T19:18:56.948259] [INFO ] [MAIN ] Update Progress: 1310/2369 symbols completed. MATX took 36.3s. Estimated remaining: 1h 52m 17s. Rate: 9.4 symbols/min [2025-09-16T19:18:57.128715] [INFO ] [MAIN ] MCD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:18:57.170708] [DEBUG] [LOCAL ] MCD: Loaded 39466 existing records from primary storage. [2025-09-16T19:18:57.170858] [INFO ] [MAIN ] MCD: Loaded 39466 existing records. [2025-09-16T19:18:57.182497] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-02. [2025-09-16T19:18:57.380318] [WARN ] [MAIN ] MCD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:18:57.380762] [INFO ] [MAIN ] MCD: Wiping existing primary data before full refresh. [2025-09-16T19:18:57.380889] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-09-16T19:18:57.381980] [DEBUG] [LOCAL ] MCD: Deleted primary data file. [2025-09-16T19:18:57.382040] [INFO ] [MAIN ] MCD: Starting full primary refresh. [2025-09-16T19:18:57.693112] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-16T19:18:57.776915] [INFO ] [REMOTE ] MCD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:18:57.974911] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-04. [2025-09-16T19:18:58.071562] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-16T19:18:58.101323] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-16T19:18:58.774903] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-02. [2025-09-16T19:18:59.574915] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-03. [2025-09-16T19:18:59.625223] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-16T19:19:00.380308] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-09. [2025-09-16T19:19:00.384561] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-16T19:19:00.454065] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-16T19:19:01.174904] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-03. [2025-09-16T19:19:01.843547] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-16T19:19:01.849174] [INFO ] [REMOTE ] MBC: Full fetch complete (46898 records). [2025-09-16T19:19:01.849266] [DEBUG] [VALIDATOR ] MBC: Validating primary data. [2025-09-16T19:19:01.989948] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-04. [2025-09-16T19:19:02.226107] [DEBUG] [VALIDATOR ] MBC: All expected trading days are present. [2025-09-16T19:19:02.226190] [DEBUG] [VALIDATOR ] MBC: Primary data validation passed. [2025-09-16T19:19:02.226939] [INFO ] [MAIN ] MBC: Fetched primary data is valid. [2025-09-16T19:19:02.226985] [DEBUG] [LOCAL ] MBC: Saving primary data. [2025-09-16T19:19:02.228052] [DEBUG] [LOCAL ] MBC: Trimmed 46898 records to 31783 (keeping 150 days of data) [2025-09-16T19:19:02.412253] [DEBUG] [LOCAL ] MBC: Primary data saved (31783 records). [2025-09-16T19:19:02.412400] [INFO ] [MAIN ] MBC: Full history saved. [2025-09-16T19:19:02.412491] [INFO ] [MAIN ] Update Progress: 1311/2369 symbols completed. MBC took 27.7s. Estimated remaining: 1h 52m 10s. Rate: 9.4 symbols/min [2025-09-16T19:19:02.587203] [INFO ] [MAIN ] MCI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:19:02.593891] [DEBUG] [LOCAL ] MCI: Loaded 4602 existing records from primary storage. [2025-09-16T19:19:02.594019] [INFO ] [MAIN ] MCI: Loaded 4602 existing records. [2025-09-16T19:19:02.772389] [WARN ] [MAIN ] MCI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:19:02.773126] [INFO ] [MAIN ] MCI: Wiping existing primary data before full refresh. [2025-09-16T19:19:02.773187] [INFO ] [LOCAL ] MCI: Starting deletion of primary data. [2025-09-16T19:19:02.773475] [DEBUG] [LOCAL ] MCI: Deleted primary data file. [2025-09-16T19:19:02.773521] [INFO ] [MAIN ] MCI: Starting full primary refresh. [2025-09-16T19:19:02.787709] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-05. [2025-09-16T19:19:03.126862] [INFO ] [REMOTE ] MCI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:19:03.161957] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-16T19:19:03.336437] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-16T19:19:03.574909] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-04. [2025-09-16T19:19:04.184795] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-16T19:19:04.374956] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-05. [2025-09-16T19:19:05.174914] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-06. [2025-09-16T19:19:05.191329] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-16T19:19:05.455719] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-16T19:19:05.974903] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-06. [2025-09-16T19:19:06.524505] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-16T19:19:06.607947] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-16T19:19:06.774936] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-07. [2025-09-16T19:19:07.574979] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-05. [2025-09-16T19:19:08.291363] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-16T19:19:08.374856] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-08. [2025-09-16T19:19:09.174910] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-02. [2025-09-16T19:19:09.662218] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-16T19:19:09.826453] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-16T19:19:09.854089] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-16T19:19:09.974872] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-03. [2025-09-16T19:19:10.658803] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-16T19:19:10.774859] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-04. [2025-09-16T19:19:11.415336] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-16T19:19:11.575049] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-05. [2025-09-16T19:19:12.335136] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-16T19:19:12.374882] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-06. [2025-09-16T19:19:13.088791] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-16T19:19:13.174874] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-07. [2025-09-16T19:19:13.699768] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-16T19:19:13.974895] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-08. [2025-09-16T19:19:14.654138] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-16T19:19:14.774899] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-09. [2025-09-16T19:19:15.574918] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-06. [2025-09-16T19:19:15.594211] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-16T19:19:15.595579] [INFO ] [REMOTE ] MCI: Full fetch complete (7531 records). [2025-09-16T19:19:15.595667] [DEBUG] [VALIDATOR ] MCI: Validating primary data. [2025-09-16T19:19:15.958194] [DEBUG] [VALIDATOR ] MCI: All expected trading days are present. [2025-09-16T19:19:15.958276] [DEBUG] [VALIDATOR ] MCI: Primary data validation passed. [2025-09-16T19:19:15.958489] [INFO ] [MAIN ] MCI: Fetched primary data is valid. [2025-09-16T19:19:15.958554] [DEBUG] [LOCAL ] MCI: Saving primary data. [2025-09-16T19:19:15.958994] [DEBUG] [LOCAL ] MCI: Trimmed 7531 records to 4644 (keeping 150 days of data) [2025-09-16T19:19:15.988149] [DEBUG] [LOCAL ] MCI: Primary data saved (4644 records). [2025-09-16T19:19:15.988290] [INFO ] [MAIN ] MCI: Full history saved. [2025-09-16T19:19:15.988377] [INFO ] [MAIN ] Update Progress: 1312/2369 symbols completed. MCI took 13.6s. Estimated remaining: 1h 52m 9s. Rate: 9.4 symbols/min [2025-09-16T19:19:16.163681] [INFO ] [MAIN ] MCK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:19:16.192516] [DEBUG] [LOCAL ] MCK: Loaded 28290 existing records from primary storage. [2025-09-16T19:19:16.192669] [INFO ] [MAIN ] MCK: Loaded 28290 existing records. [2025-09-16T19:19:16.371303] [WARN ] [MAIN ] MCK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:19:16.371578] [INFO ] [MAIN ] MCK: Wiping existing primary data before full refresh. [2025-09-16T19:19:16.371624] [INFO ] [LOCAL ] MCK: Starting deletion of primary data. [2025-09-16T19:19:16.372252] [DEBUG] [LOCAL ] MCK: Deleted primary data file. [2025-09-16T19:19:16.372298] [INFO ] [MAIN ] MCK: Starting full primary refresh. [2025-09-16T19:19:16.383347] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-07. [2025-09-16T19:19:16.729360] [INFO ] [REMOTE ] MCK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:19:17.174920] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-02. [2025-09-16T19:19:17.352858] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-16T19:19:17.564204] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-16T19:19:17.974930] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-08. [2025-09-16T19:19:18.714327] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-16T19:19:18.748411] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-16T19:19:18.774869] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-03. [2025-09-16T19:19:19.574913] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-09. [2025-09-16T19:19:20.366511] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-16T19:19:20.375432] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-07. [2025-09-16T19:19:21.071760] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-16T19:19:21.077255] [INFO ] [REMOTE ] MC: Full fetch complete (48242 records). [2025-09-16T19:19:21.077450] [DEBUG] [VALIDATOR ] MC: Validating primary data. [2025-09-16T19:19:21.183012] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-09. [2025-09-16T19:19:21.468335] [DEBUG] [VALIDATOR ] MC: All expected trading days are present. [2025-09-16T19:19:21.468420] [DEBUG] [VALIDATOR ] MC: Primary data validation passed. [2025-09-16T19:19:21.469305] [INFO ] [MAIN ] MC: Fetched primary data is valid. [2025-09-16T19:19:21.469359] [DEBUG] [LOCAL ] MC: Saving primary data. [2025-09-16T19:19:21.470440] [DEBUG] [LOCAL ] MC: Trimmed 48242 records to 32527 (keeping 150 days of data) [2025-09-16T19:19:21.677627] [DEBUG] [LOCAL ] MC: Primary data saved (32527 records). [2025-09-16T19:19:21.677801] [INFO ] [MAIN ] MC: Full history saved. [2025-09-16T19:19:21.678543] [INFO ] [MAIN ] Update Progress: 1313/2369 symbols completed. MC took 34.7s. Estimated remaining: 1h 52m 3s. Rate: 9.4 symbols/min [2025-09-16T19:19:21.854453] [INFO ] [MAIN ] MCN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:19:21.863631] [DEBUG] [LOCAL ] MCN: Loaded 5926 existing records from primary storage. [2025-09-16T19:19:21.863826] [INFO ] [MAIN ] MCN: Loaded 5926 existing records. [2025-09-16T19:19:21.985342] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-04. [2025-09-16T19:19:22.048135] [WARN ] [MAIN ] MCN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:19:22.055297] [INFO ] [MAIN ] MCN: Wiping existing primary data before full refresh. [2025-09-16T19:19:22.055735] [INFO ] [LOCAL ] MCN: Starting deletion of primary data. [2025-09-16T19:19:22.055632] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-16T19:19:22.058332] [DEBUG] [LOCAL ] MCN: Deleted primary data file. [2025-09-16T19:19:22.058522] [INFO ] [MAIN ] MCN: Starting full primary refresh. [2025-09-16T19:19:22.058477] [INFO ] [REMOTE ] MCB: Full fetch complete (12560 records). [2025-09-16T19:19:22.127194] [DEBUG] [VALIDATOR ] MCB: Validating primary data. [2025-09-16T19:19:22.701075] [INFO ] [REMOTE ] MCN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:19:22.787949] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-02. [2025-09-16T19:19:22.894118] [DEBUG] [VALIDATOR ] MCB: All expected trading days are present. [2025-09-16T19:19:22.894213] [DEBUG] [VALIDATOR ] MCB: Primary data validation passed. [2025-09-16T19:19:22.894719] [INFO ] [MAIN ] MCB: Fetched primary data is valid. [2025-09-16T19:19:22.894799] [DEBUG] [LOCAL ] MCB: Saving primary data. [2025-09-16T19:19:22.895510] [DEBUG] [LOCAL ] MCB: Trimmed 12560 records to 8210 (keeping 150 days of data) [2025-09-16T19:19:22.986594] [DEBUG] [LOCAL ] MCB: Primary data saved (8210 records). [2025-09-16T19:19:22.987009] [INFO ] [MAIN ] MCB: Full history saved. [2025-09-16T19:19:22.988353] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-09-16T19:19:22.988550] [INFO ] [MAIN ] Update Progress: 1314/2369 symbols completed. MCB took 27.3s. Estimated remaining: 1h 51m 52s. Rate: 9.4 symbols/min [2025-09-16T19:19:23.169177] [INFO ] [MAIN ] MCO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:19:23.196417] [DEBUG] [LOCAL ] MCO: Loaded 27717 existing records from primary storage. [2025-09-16T19:19:23.196559] [INFO ] [MAIN ] MCO: Loaded 27717 existing records. [2025-09-16T19:19:23.378439] [WARN ] [MAIN ] MCO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:19:23.378715] [INFO ] [MAIN ] MCO: Wiping existing primary data before full refresh. [2025-09-16T19:19:23.378764] [INFO ] [LOCAL ] MCO: Starting deletion of primary data. [2025-09-16T19:19:23.379527] [DEBUG] [LOCAL ] MCO: Deleted primary data file. [2025-09-16T19:19:23.379576] [INFO ] [MAIN ] MCO: Starting full primary refresh. [2025-09-16T19:19:23.595562] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-08. [2025-09-16T19:19:23.617175] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-16T19:19:23.758775] [INFO ] [REMOTE ] MCO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:19:23.790422] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-16T19:19:24.374908] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-02. [2025-09-16T19:19:25.174909] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-03. [2025-09-16T19:19:25.845946] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-16T19:19:25.938943] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-16T19:19:25.982588] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-04. [2025-09-16T19:19:25.998500] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-16T19:19:26.628104] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-16T19:19:26.774896] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-09. [2025-09-16T19:19:27.574905] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-03. [2025-09-16T19:19:28.374906] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-05. [2025-09-16T19:19:28.981238] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-16T19:19:28.987919] [INFO ] [REMOTE ] MCD: Full fetch complete (58136 records). [2025-09-16T19:19:28.988046] [DEBUG] [VALIDATOR ] MCD: Validating primary data. [2025-09-16T19:19:29.178599] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-05. [2025-09-16T19:19:29.390349] [DEBUG] [VALIDATOR ] MCD: All expected trading days are present. [2025-09-16T19:19:29.390533] [DEBUG] [VALIDATOR ] MCD: Primary data validation passed. [2025-09-16T19:19:29.391525] [INFO ] [MAIN ] MCD: Fetched primary data is valid. [2025-09-16T19:19:29.391587] [DEBUG] [LOCAL ] MCD: Saving primary data. [2025-09-16T19:19:29.393024] [DEBUG] [LOCAL ] MCD: Trimmed 58136 records to 39855 (keeping 150 days of data) [2025-09-16T19:19:29.492168] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-16T19:19:29.693524] [DEBUG] [LOCAL ] MCD: Primary data saved (39855 records). [2025-09-16T19:19:29.693706] [INFO ] [MAIN ] MCD: Full history saved. [2025-09-16T19:19:29.694922] [INFO ] [MAIN ] Update Progress: 1315/2369 symbols completed. MCD took 32.7s. Estimated remaining: 1h 51m 46s. Rate: 9.4 symbols/min [2025-09-16T19:19:29.865482] [INFO ] [MAIN ] MCR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:19:29.874336] [DEBUG] [LOCAL ] MCR: Loaded 6518 existing records from primary storage. [2025-09-16T19:19:29.874595] [INFO ] [MAIN ] MCR: Loaded 6518 existing records. [2025-09-16T19:19:29.978047] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-04. [2025-09-16T19:19:30.039285] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-16T19:19:30.064522] [WARN ] [MAIN ] MCR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:19:30.067750] [INFO ] [MAIN ] MCR: Wiping existing primary data before full refresh. [2025-09-16T19:19:30.068294] [INFO ] [LOCAL ] MCR: Starting deletion of primary data. [2025-09-16T19:19:30.068688] [DEBUG] [LOCAL ] MCR: Deleted primary data file. [2025-09-16T19:19:30.068740] [INFO ] [MAIN ] MCR: Starting full primary refresh. [2025-09-16T19:19:30.446780] [INFO ] [REMOTE ] MCR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:19:30.448607] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-16T19:19:30.774945] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-06. [2025-09-16T19:19:31.546579] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-16T19:19:31.574850] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-06. [2025-09-16T19:19:31.874951] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-16T19:19:32.374954] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-02. [2025-09-16T19:19:33.021977] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-16T19:19:33.098419] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-16T19:19:33.174871] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-03. [2025-09-16T19:19:33.817423] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-16T19:19:33.974896] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-04. [2025-09-16T19:19:34.751274] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-16T19:19:34.774846] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-05. [2025-09-16T19:19:35.528212] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-16T19:19:35.574866] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-06. [2025-09-16T19:19:36.373413] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-16T19:19:36.379038] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-05. [2025-09-16T19:19:37.174891] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-07. [2025-09-16T19:19:37.887137] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-16T19:19:37.912524] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-16T19:19:37.974887] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-06. [2025-09-16T19:19:38.774893] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-07. [2025-09-16T19:19:39.406893] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-16T19:19:39.574897] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-07. [2025-09-16T19:19:39.911492] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-16T19:19:39.979594] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-16T19:19:40.374895] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-07. [2025-09-16T19:19:41.174914] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-08. [2025-09-16T19:19:41.847100] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-16T19:19:41.974892] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-08. [2025-09-16T19:19:42.018622] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-16T19:19:42.774919] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-08. [2025-09-16T19:19:43.578840] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-09. [2025-09-16T19:19:43.591160] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-16T19:19:44.217898] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-16T19:19:44.374950] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-09. [2025-09-16T19:19:44.473577] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-16T19:19:44.474975] [INFO ] [REMOTE ] MCR: Full fetch complete (9809 records). [2025-09-16T19:19:44.475046] [DEBUG] [VALIDATOR ] MCR: Validating primary data. [2025-09-16T19:19:44.847865] [DEBUG] [VALIDATOR ] MCR: All expected trading days are present. [2025-09-16T19:19:44.847941] [DEBUG] [VALIDATOR ] MCR: Primary data validation passed. [2025-09-16T19:19:44.848155] [INFO ] [MAIN ] MCR: Fetched primary data is valid. [2025-09-16T19:19:44.848195] [DEBUG] [LOCAL ] MCR: Saving primary data. [2025-09-16T19:19:44.848633] [DEBUG] [LOCAL ] MCR: Trimmed 9809 records to 6564 (keeping 150 days of data) [2025-09-16T19:19:44.887020] [DEBUG] [LOCAL ] MCR: Primary data saved (6564 records). [2025-09-16T19:19:44.887129] [INFO ] [MAIN ] MCR: Full history saved. [2025-09-16T19:19:44.887210] [INFO ] [MAIN ] Update Progress: 1316/2369 symbols completed. MCR took 15.2s. Estimated remaining: 1h 51m 47s. Rate: 9.4 symbols/min [2025-09-16T19:19:45.062882] [INFO ] [MAIN ] MCS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:19:45.079230] [DEBUG] [LOCAL ] MCS: Loaded 15437 existing records from primary storage. [2025-09-16T19:19:45.079352] [INFO ] [MAIN ] MCS: Loaded 15437 existing records. [2025-09-16T19:19:45.183820] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-08. [2025-09-16T19:19:45.265951] [WARN ] [MAIN ] MCS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:19:45.266210] [INFO ] [MAIN ] MCS: Wiping existing primary data before full refresh. [2025-09-16T19:19:45.266266] [INFO ] [LOCAL ] MCS: Starting deletion of primary data. [2025-09-16T19:19:45.266729] [DEBUG] [LOCAL ] MCS: Deleted primary data file. [2025-09-16T19:19:45.266786] [INFO ] [MAIN ] MCS: Starting full primary refresh. [2025-09-16T19:19:45.619666] [INFO ] [REMOTE ] MCS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:19:45.881856] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-16T19:19:45.898574] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-16T19:19:45.904006] [INFO ] [REMOTE ] MCO: Full fetch complete (43517 records). [2025-09-16T19:19:45.904163] [DEBUG] [VALIDATOR ] MCO: Validating primary data. [2025-09-16T19:19:45.980030] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-09. [2025-09-16T19:19:46.290663] [DEBUG] [VALIDATOR ] MCO: All expected trading days are present. [2025-09-16T19:19:46.290745] [DEBUG] [VALIDATOR ] MCO: Primary data validation passed. [2025-09-16T19:19:46.291457] [INFO ] [MAIN ] MCO: Fetched primary data is valid. [2025-09-16T19:19:46.291498] [DEBUG] [LOCAL ] MCO: Saving primary data. [2025-09-16T19:19:46.292473] [DEBUG] [LOCAL ] MCO: Trimmed 43517 records to 27948 (keeping 150 days of data) [2025-09-16T19:19:46.471608] [DEBUG] [LOCAL ] MCO: Primary data saved (27948 records). [2025-09-16T19:19:46.471754] [INFO ] [MAIN ] MCO: Full history saved. [2025-09-16T19:19:46.471837] [INFO ] [MAIN ] Update Progress: 1317/2369 symbols completed. MCO took 23.5s. Estimated remaining: 1h 51m 37s. Rate: 9.4 symbols/min [2025-09-16T19:19:46.774900] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-09. [2025-09-16T19:19:47.447499] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-16T19:19:47.452253] [INFO ] [REMOTE ] MCK: Full fetch complete (43160 records). [2025-09-16T19:19:47.452387] [DEBUG] [VALIDATOR ] MCK: Validating primary data. [2025-09-16T19:19:47.579040] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-02. [2025-09-16T19:19:47.591758] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-16T19:19:47.605632] [INFO ] [REMOTE ] MCN: Full fetch complete (8896 records). [2025-09-16T19:19:47.648364] [DEBUG] [VALIDATOR ] MCN: Validating primary data. [2025-09-16T19:19:48.390512] [DEBUG] [VALIDATOR ] MCK: All expected trading days are present. [2025-09-16T19:19:48.422973] [DEBUG] [VALIDATOR ] MCK: Primary data validation passed. [2025-09-16T19:19:48.427209] [INFO ] [MAIN ] MCK: Fetched primary data is valid. [2025-09-16T19:19:48.437961] [DEBUG] [LOCAL ] MCK: Saving primary data. [2025-09-16T19:19:48.508724] [DEBUG] [VALIDATOR ] MCN: All expected trading days are present. [2025-09-16T19:19:48.508877] [DEBUG] [VALIDATOR ] MCN: Primary data validation passed. [2025-09-16T19:19:48.509150] [INFO ] [MAIN ] MCN: Fetched primary data is valid. [2025-09-16T19:19:48.509201] [DEBUG] [LOCAL ] MCN: Saving primary data. [2025-09-16T19:19:48.509302] [DEBUG] [LOCAL ] MCK: Trimmed 43160 records to 28557 (keeping 150 days of data) [2025-09-16T19:19:48.510528] [DEBUG] [LOCAL ] MCN: Trimmed 8896 records to 5967 (keeping 150 days of data) [2025-09-16T19:19:48.689930] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-16T19:19:48.697612] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-03. [2025-09-16T19:19:48.709085] [DEBUG] [LOCAL ] MCN: Primary data saved (5967 records). [2025-09-16T19:19:48.709457] [INFO ] [MAIN ] MCN: Full history saved. [2025-09-16T19:19:48.709882] [INFO ] [MAIN ] Update Progress: 1318/2369 symbols completed. MCN took 27.0s. Estimated remaining: 1h 51m 27s. Rate: 9.4 symbols/min [2025-09-16T19:19:48.783152] [DEBUG] [LOCAL ] MCK: Primary data saved (28557 records). [2025-09-16T19:19:48.783287] [INFO ] [MAIN ] MCK: Full history saved. [2025-09-16T19:19:48.783369] [INFO ] [MAIN ] Update Progress: 1319/2369 symbols completed. MCK took 32.8s. Estimated remaining: 1h 51m 15s. Rate: 9.4 symbols/min [2025-09-16T19:19:49.857078] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-16T19:19:49.863997] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-04. [2025-09-16T19:19:50.897129] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-16T19:19:50.901795] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-05. [2025-09-16T19:19:52.030917] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-16T19:19:52.036768] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-06. [2025-09-16T19:19:52.926380] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-16T19:19:52.930477] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-07. [2025-09-16T19:19:54.059937] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-16T19:19:54.065782] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-08. [2025-09-16T19:19:55.161097] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-16T19:19:55.166829] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-09. [2025-09-16T19:19:56.178840] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-16T19:19:56.182809] [INFO ] [REMOTE ] MCS: Full fetch complete (23386 records). [2025-09-16T19:19:56.182933] [DEBUG] [VALIDATOR ] MCS: Validating primary data. [2025-09-16T19:19:56.637367] [DEBUG] [VALIDATOR ] MCS: All expected trading days are present. [2025-09-16T19:19:56.637449] [DEBUG] [VALIDATOR ] MCS: Primary data validation passed. [2025-09-16T19:19:56.638002] [INFO ] [MAIN ] MCS: Fetched primary data is valid. [2025-09-16T19:19:56.638047] [DEBUG] [LOCAL ] MCS: Saving primary data. [2025-09-16T19:19:56.638724] [DEBUG] [LOCAL ] MCS: Trimmed 23386 records to 15589 (keeping 150 days of data) [2025-09-16T19:19:56.734568] [DEBUG] [LOCAL ] MCS: Primary data saved (15589 records). [2025-09-16T19:19:56.734719] [INFO ] [MAIN ] MCS: Full history saved. [2025-09-16T19:19:56.734804] [INFO ] [MAIN ] Update Progress: 1320/2369 symbols completed. MCS took 11.8s. Estimated remaining: 1h 51m 10s. Rate: 9.4 symbols/min [2025-09-16T19:19:57.341840] [INFO ] [MAIN ] MCY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:19:57.418484] [INFO ] [MAIN ] MDST: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:19:57.439186] [INFO ] [MAIN ] MD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:19:57.438135] [INFO ] [MAIN ] MDT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:19:57.449864] [DEBUG] [LOCAL ] MDST: Loaded 4046 existing records from primary storage. [2025-09-16T19:19:57.450159] [INFO ] [MAIN ] MDST: Loaded 4046 existing records. [2025-09-16T19:19:57.572751] [DEBUG] [LOCAL ] MCY: Loaded 17493 existing records from primary storage. [2025-09-16T19:19:57.578349] [INFO ] [MAIN ] MCY: Loaded 17493 existing records. [2025-09-16T19:19:57.658706] [WARN ] [MAIN ] MDST: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:19:57.712858] [DEBUG] [LOCAL ] MD: Loaded 28839 existing records from primary storage. [2025-09-16T19:19:57.712995] [INFO ] [MAIN ] MDST: Wiping existing primary data before full refresh. [2025-09-16T19:19:57.718425] [INFO ] [LOCAL ] MDST: Starting deletion of primary data. [2025-09-16T19:19:57.718366] [INFO ] [MAIN ] MD: Loaded 28839 existing records. [2025-09-16T19:19:57.762421] [DEBUG] [LOCAL ] MDST: Deleted primary data file. [2025-09-16T19:19:57.778296] [INFO ] [MAIN ] MDST: Starting full primary refresh. [2025-09-16T19:19:57.980077] [DEBUG] [LOCAL ] MDT: Loaded 39638 existing records from primary storage. [2025-09-16T19:19:58.019257] [INFO ] [MAIN ] MDT: Loaded 39638 existing records. [2025-09-16T19:19:58.068908] [WARN ] [MAIN ] MCY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:19:58.229261] [WARN ] [MAIN ] MD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:19:58.229149] [INFO ] [MAIN ] MCY: Wiping existing primary data before full refresh. [2025-09-16T19:19:58.278082] [INFO ] [MAIN ] MD: Wiping existing primary data before full refresh. [2025-09-16T19:19:58.267581] [INFO ] [LOCAL ] MCY: Starting deletion of primary data. [2025-09-16T19:19:58.353286] [DEBUG] [LOCAL ] MCY: Deleted primary data file. [2025-09-16T19:19:58.358484] [INFO ] [LOCAL ] MD: Starting deletion of primary data. [2025-09-16T19:19:58.379113] [INFO ] [MAIN ] MCY: Starting full primary refresh. [2025-09-16T19:19:58.460408] [DEBUG] [LOCAL ] MD: Deleted primary data file. [2025-09-16T19:19:58.606287] [INFO ] [MAIN ] MD: Starting full primary refresh. [2025-09-16T19:19:58.621859] [WARN ] [MAIN ] MDT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:19:58.656120] [INFO ] [MAIN ] MDT: Wiping existing primary data before full refresh. [2025-09-16T19:19:58.695807] [INFO ] [LOCAL ] MDT: Starting deletion of primary data. [2025-09-16T19:19:58.787934] [INFO ] [REMOTE ] MDST: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:19:58.803403] [DEBUG] [LOCAL ] MDT: Deleted primary data file. [2025-09-16T19:19:58.813892] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-02. [2025-09-16T19:19:58.865941] [INFO ] [MAIN ] MDT: Starting full primary refresh. [2025-09-16T19:19:59.351305] [INFO ] [REMOTE ] MCY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:19:59.413226] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-02. [2025-09-16T19:19:59.593412] [INFO ] [REMOTE ] MD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:19:59.618284] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-02. [2025-09-16T19:19:59.696261] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-16T19:19:59.700465] [INFO ] [REMOTE ] MDT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:19:59.702151] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-02. [2025-09-16T19:19:59.702563] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-03. [2025-09-16T19:20:00.373066] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-16T19:20:00.374982] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-04. [2025-09-16T19:20:01.281012] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-16T19:20:01.281619] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-16T19:20:01.292773] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-03. [2025-09-16T19:20:01.294315] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-05. [2025-09-16T19:20:01.436106] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-16T19:20:01.444335] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-03. [2025-09-16T19:20:01.677777] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-16T19:20:01.688181] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-03. [2025-09-16T19:20:01.731069] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-16T19:20:01.974948] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-06. [2025-09-16T19:20:02.561015] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-16T19:20:02.592206] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-16T19:20:02.779982] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-04. [2025-09-16T19:20:02.793142] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-16T19:20:03.416299] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-16T19:20:03.574898] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-04. [2025-09-16T19:20:04.003561] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-16T19:20:04.374906] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-07. [2025-09-16T19:20:04.839713] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-16T19:20:05.077030] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-16T19:20:05.174891] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-05. [2025-09-16T19:20:05.974932] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-04. [2025-09-16T19:20:06.518763] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-16T19:20:06.774904] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-05. [2025-09-16T19:20:07.574889] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-08. [2025-09-16T19:20:07.646329] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-16T19:20:08.187796] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-16T19:20:08.213501] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-16T19:20:08.374929] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-06. [2025-09-16T19:20:09.174889] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-06. [2025-09-16T19:20:09.470976] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-16T19:20:09.974900] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-05. [2025-09-16T19:20:10.190220] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-16T19:20:10.774906] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-09. [2025-09-16T19:20:11.346475] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-16T19:20:11.347966] [INFO ] [REMOTE ] MDST: Full fetch complete (6038 records). [2025-09-16T19:20:11.348035] [DEBUG] [VALIDATOR ] MDST: Validating primary data. [2025-09-16T19:20:11.585256] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-07. [2025-09-16T19:20:11.720491] [DEBUG] [VALIDATOR ] MDST: All expected trading days are present. [2025-09-16T19:20:11.720665] [DEBUG] [VALIDATOR ] MDST: Primary data validation passed. [2025-09-16T19:20:11.720971] [INFO ] [MAIN ] MDST: Fetched primary data is valid. [2025-09-16T19:20:11.721074] [DEBUG] [LOCAL ] MDST: Saving primary data. [2025-09-16T19:20:11.721703] [DEBUG] [LOCAL ] MDST: Trimmed 6038 records to 4121 (keeping 150 days of data) [2025-09-16T19:20:11.748658] [DEBUG] [LOCAL ] MDST: Primary data saved (4121 records). [2025-09-16T19:20:11.748823] [INFO ] [MAIN ] MDST: Full history saved. [2025-09-16T19:20:11.748954] [INFO ] [MAIN ] Update Progress: 1321/2369 symbols completed. MDST took 15.0s. Estimated remaining: 1h 51m 11s. Rate: 9.4 symbols/min [2025-09-16T19:20:11.921678] [INFO ] [MAIN ] MDU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:20:11.961064] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-16T19:20:11.998268] [DEBUG] [LOCAL ] MDU: Loaded 34744 existing records from primary storage. [2025-09-16T19:20:11.998415] [INFO ] [MAIN ] MDU: Loaded 34744 existing records. [2025-09-16T19:20:12.170469] [WARN ] [MAIN ] MDU: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:20:12.170751] [INFO ] [MAIN ] MDU: Wiping existing primary data before full refresh. [2025-09-16T19:20:12.170820] [INFO ] [LOCAL ] MDU: Starting deletion of primary data. [2025-09-16T19:20:12.171715] [DEBUG] [LOCAL ] MDU: Deleted primary data file. [2025-09-16T19:20:12.171765] [INFO ] [MAIN ] MDU: Starting full primary refresh. [2025-09-16T19:20:12.385113] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-07. [2025-09-16T19:20:12.523191] [INFO ] [REMOTE ] MDU: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:20:12.815334] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-16T19:20:13.174869] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-02. [2025-09-16T19:20:13.555953] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-16T19:20:13.974908] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-08. [2025-09-16T19:20:14.578528] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-16T19:20:14.774859] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-03. [2025-09-16T19:20:14.937082] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-16T19:20:15.574896] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-08. [2025-09-16T19:20:16.374900] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-06. [2025-09-16T19:20:16.539422] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-16T19:20:17.183688] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-04. [2025-09-16T19:20:17.186792] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-16T19:20:17.974929] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-09. [2025-09-16T19:20:18.246470] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-16T19:20:18.774913] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-09. [2025-09-16T19:20:18.890927] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-16T19:20:19.114956] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-16T19:20:19.117703] [INFO ] [REMOTE ] MCY: Full fetch complete (29416 records). [2025-09-16T19:20:19.117783] [DEBUG] [VALIDATOR ] MCY: Validating primary data. [2025-09-16T19:20:19.490776] [DEBUG] [VALIDATOR ] MCY: All expected trading days are present. [2025-09-16T19:20:19.490888] [DEBUG] [VALIDATOR ] MCY: Primary data validation passed. [2025-09-16T19:20:19.491483] [INFO ] [MAIN ] MCY: Fetched primary data is valid. [2025-09-16T19:20:19.491525] [DEBUG] [LOCAL ] MCY: Saving primary data. [2025-09-16T19:20:19.492291] [DEBUG] [LOCAL ] MCY: Trimmed 29416 records to 17638 (keeping 150 days of data) [2025-09-16T19:20:19.576012] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-05. [2025-09-16T19:20:19.610680] [DEBUG] [LOCAL ] MCY: Primary data saved (17638 records). [2025-09-16T19:20:19.610834] [INFO ] [MAIN ] MCY: Full history saved. [2025-09-16T19:20:19.610944] [INFO ] [MAIN ] Update Progress: 1322/2369 symbols completed. MCY took 22.9s. Estimated remaining: 1h 51m 6s. Rate: 9.4 symbols/min [2025-09-16T19:20:19.786787] [INFO ] [MAIN ] MDV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:20:19.794774] [DEBUG] [LOCAL ] MDV: Loaded 6491 existing records from primary storage. [2025-09-16T19:20:19.794874] [INFO ] [MAIN ] MDV: Loaded 6491 existing records. [2025-09-16T19:20:19.974288] [WARN ] [MAIN ] MDV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:20:19.974617] [INFO ] [MAIN ] MDV: Wiping existing primary data before full refresh. [2025-09-16T19:20:19.974700] [INFO ] [LOCAL ] MDV: Starting deletion of primary data. [2025-09-16T19:20:19.975060] [DEBUG] [LOCAL ] MDV: Deleted primary data file. [2025-09-16T19:20:19.975132] [INFO ] [MAIN ] MDV: Starting full primary refresh. [2025-09-16T19:20:20.276174] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-16T19:20:20.336171] [INFO ] [REMOTE ] MD: Full fetch complete (42257 records). [2025-09-16T19:20:20.357791] [DEBUG] [VALIDATOR ] MD: Validating primary data. [2025-09-16T19:20:20.357718] [INFO ] [REMOTE ] MDV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:20:20.379946] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-02. [2025-09-16T19:20:20.733879] [DEBUG] [VALIDATOR ] MD: All expected trading days are present. [2025-09-16T19:20:20.733955] [DEBUG] [VALIDATOR ] MD: Primary data validation passed. [2025-09-16T19:20:20.734660] [INFO ] [MAIN ] MD: Fetched primary data is valid. [2025-09-16T19:20:20.734704] [DEBUG] [LOCAL ] MD: Saving primary data. [2025-09-16T19:20:20.735623] [DEBUG] [LOCAL ] MD: Trimmed 42257 records to 29126 (keeping 150 days of data) [2025-09-16T19:20:20.915352] [DEBUG] [LOCAL ] MD: Primary data saved (29126 records). [2025-09-16T19:20:20.915486] [INFO ] [MAIN ] MD: Full history saved. [2025-09-16T19:20:20.915579] [INFO ] [MAIN ] Update Progress: 1323/2369 symbols completed. MD took 24.2s. Estimated remaining: 1h 50m 55s. Rate: 9.4 symbols/min [2025-09-16T19:20:21.086500] [INFO ] [MAIN ] MEC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:20:21.091443] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-16T19:20:21.104608] [DEBUG] [LOCAL ] MEC: Loaded 12261 existing records from primary storage. [2025-09-16T19:20:21.104735] [INFO ] [MAIN ] MEC: Loaded 12261 existing records. [2025-09-16T19:20:21.176215] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-03. [2025-09-16T19:20:21.291671] [WARN ] [MAIN ] MEC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:20:21.292079] [INFO ] [MAIN ] MEC: Wiping existing primary data before full refresh. [2025-09-16T19:20:21.292265] [INFO ] [LOCAL ] MEC: Starting deletion of primary data. [2025-09-16T19:20:21.292811] [DEBUG] [LOCAL ] MEC: Deleted primary data file. [2025-09-16T19:20:21.292963] [INFO ] [MAIN ] MEC: Starting full primary refresh. [2025-09-16T19:20:21.500087] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-16T19:20:21.695233] [INFO ] [REMOTE ] MEC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:20:21.756326] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-16T19:20:21.974916] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-07. [2025-09-16T19:20:22.774954] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-06. [2025-09-16T19:20:23.574902] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-04. [2025-09-16T19:20:23.951366] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-16T19:20:24.258979] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-16T19:20:24.365713] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-16T19:20:24.374850] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-05. [2025-09-16T19:20:25.114224] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-16T19:20:25.174920] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-07. [2025-09-16T19:20:25.974927] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-06. [2025-09-16T19:20:26.740536] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-16T19:20:26.774855] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-07. [2025-09-16T19:20:26.859663] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-16T19:20:27.510997] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-16T19:20:27.574971] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-02. [2025-09-16T19:20:28.374935] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-08. [2025-09-16T19:20:28.393388] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-16T19:20:29.174927] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-08. [2025-09-16T19:20:29.918068] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-16T19:20:29.975377] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-16T19:20:29.975444] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-08. [2025-09-16T19:20:30.774916] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-03. [2025-09-16T19:20:31.574890] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-09. [2025-09-16T19:20:31.905786] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-16T19:20:31.928093] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-16T19:20:32.374907] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-04. [2025-09-16T19:20:33.127387] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-16T19:20:33.134410] [INFO ] [REMOTE ] MDU: Full fetch complete (52242 records). [2025-09-16T19:20:33.134684] [DEBUG] [VALIDATOR ] MDU: Validating primary data. [2025-09-16T19:20:33.181373] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-09. [2025-09-16T19:20:33.456678] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-16T19:20:33.547343] [DEBUG] [VALIDATOR ] MDU: All expected trading days are present. [2025-09-16T19:20:33.547416] [DEBUG] [VALIDATOR ] MDU: Primary data validation passed. [2025-09-16T19:20:33.548238] [INFO ] [MAIN ] MDU: Fetched primary data is valid. [2025-09-16T19:20:33.548284] [DEBUG] [LOCAL ] MDU: Saving primary data. [2025-09-16T19:20:33.549358] [DEBUG] [LOCAL ] MDU: Trimmed 52242 records to 35119 (keeping 150 days of data) [2025-09-16T19:20:33.770330] [DEBUG] [LOCAL ] MDU: Primary data saved (35119 records). [2025-09-16T19:20:33.770466] [INFO ] [MAIN ] MDU: Full history saved. [2025-09-16T19:20:33.770548] [INFO ] [MAIN ] Update Progress: 1324/2369 symbols completed. MDU took 22.0s. Estimated remaining: 1h 50m 54s. Rate: 9.4 symbols/min [2025-09-16T19:20:33.947252] [INFO ] [MAIN ] MED: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:20:33.928714] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-16T19:20:33.948849] [INFO ] [REMOTE ] MDV: Full fetch complete (9397 records). [2025-09-16T19:20:33.948921] [DEBUG] [VALIDATOR ] MDV: Validating primary data. [2025-09-16T19:20:33.980020] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-05. [2025-09-16T19:20:34.120221] [DEBUG] [LOCAL ] MED: Loaded 15589 existing records from primary storage. [2025-09-16T19:20:34.129329] [INFO ] [MAIN ] MED: Loaded 15589 existing records. [2025-09-16T19:20:34.543098] [WARN ] [MAIN ] MED: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:20:34.551480] [DEBUG] [VALIDATOR ] MDV: All expected trading days are present. [2025-09-16T19:20:34.551770] [INFO ] [MAIN ] MED: Wiping existing primary data before full refresh. [2025-09-16T19:20:34.551868] [DEBUG] [VALIDATOR ] MDV: Primary data validation passed. [2025-09-16T19:20:34.551929] [INFO ] [LOCAL ] MED: Starting deletion of primary data. [2025-09-16T19:20:34.552501] [INFO ] [MAIN ] MDV: Fetched primary data is valid. [2025-09-16T19:20:34.552671] [DEBUG] [LOCAL ] MDV: Saving primary data. [2025-09-16T19:20:34.553111] [DEBUG] [LOCAL ] MED: Deleted primary data file. [2025-09-16T19:20:34.553305] [INFO ] [MAIN ] MED: Starting full primary refresh. [2025-09-16T19:20:34.587840] [DEBUG] [LOCAL ] MDV: Trimmed 9397 records to 6546 (keeping 150 days of data) [2025-09-16T19:20:34.785030] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-09. [2025-09-16T19:20:34.915791] [DEBUG] [LOCAL ] MDV: Primary data saved (6546 records). [2025-09-16T19:20:34.921536] [INFO ] [MAIN ] MDV: Full history saved. [2025-09-16T19:20:34.936949] [INFO ] [MAIN ] Update Progress: 1325/2369 symbols completed. MDV took 15.3s. Estimated remaining: 1h 50m 44s. Rate: 9.4 symbols/min [2025-09-16T19:20:35.029231] [INFO ] [REMOTE ] MED: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:20:35.163575] [INFO ] [MAIN ] MEG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:20:35.174356] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-16T19:20:35.198137] [DEBUG] [LOCAL ] MEG: Loaded 22278 existing records from primary storage. [2025-09-16T19:20:35.198276] [INFO ] [MAIN ] MEG: Loaded 22278 existing records. [2025-09-16T19:20:35.372718] [WARN ] [MAIN ] MEG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:20:35.372953] [INFO ] [MAIN ] MEG: Wiping existing primary data before full refresh. [2025-09-16T19:20:35.373006] [INFO ] [LOCAL ] MEG: Starting deletion of primary data. [2025-09-16T19:20:35.373607] [DEBUG] [LOCAL ] MEG: Deleted primary data file. [2025-09-16T19:20:35.373684] [INFO ] [MAIN ] MEG: Starting full primary refresh. [2025-09-16T19:20:35.580014] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-02. [2025-09-16T19:20:35.743074] [INFO ] [REMOTE ] MEG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:20:36.374915] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-02. [2025-09-16T19:20:36.540255] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-16T19:20:36.547099] [INFO ] [REMOTE ] MDT: Full fetch complete (58358 records). [2025-09-16T19:20:36.547209] [DEBUG] [VALIDATOR ] MDT: Validating primary data. [2025-09-16T19:20:36.930244] [DEBUG] [VALIDATOR ] MDT: All expected trading days are present. [2025-09-16T19:20:36.930354] [DEBUG] [VALIDATOR ] MDT: Primary data validation passed. [2025-09-16T19:20:36.931209] [INFO ] [MAIN ] MDT: Fetched primary data is valid. [2025-09-16T19:20:36.931267] [DEBUG] [LOCAL ] MDT: Saving primary data. [2025-09-16T19:20:36.946196] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-16T19:20:36.951267] [DEBUG] [LOCAL ] MDT: Trimmed 58358 records to 40028 (keeping 150 days of data) [2025-09-16T19:20:37.174922] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-06. [2025-09-16T19:20:37.204765] [DEBUG] [LOCAL ] MDT: Primary data saved (40028 records). [2025-09-16T19:20:37.204877] [INFO ] [MAIN ] MDT: Full history saved. [2025-09-16T19:20:37.204961] [INFO ] [MAIN ] Update Progress: 1326/2369 symbols completed. MDT took 40.5s. Estimated remaining: 1h 50m 34s. Rate: 9.4 symbols/min [2025-09-16T19:20:37.404348] [INFO ] [MAIN ] MEGI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:20:37.419728] [DEBUG] [LOCAL ] MEGI: Loaded 14795 existing records from primary storage. [2025-09-16T19:20:37.419855] [INFO ] [MAIN ] MEGI: Loaded 14795 existing records. [2025-09-16T19:20:37.599946] [WARN ] [MAIN ] MEGI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:20:37.600301] [INFO ] [MAIN ] MEGI: Wiping existing primary data before full refresh. [2025-09-16T19:20:37.600401] [INFO ] [LOCAL ] MEGI: Starting deletion of primary data. [2025-09-16T19:20:37.600969] [DEBUG] [LOCAL ] MEGI: Deleted primary data file. [2025-09-16T19:20:37.601109] [INFO ] [MAIN ] MEGI: Starting full primary refresh. [2025-09-16T19:20:37.747214] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-16T19:20:37.980031] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-03. [2025-09-16T19:20:37.983793] [INFO ] [REMOTE ] MEGI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:20:38.172737] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-16T19:20:38.774949] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-02. [2025-09-16T19:20:39.041124] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-16T19:20:39.574900] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-03. [2025-09-16T19:20:39.752771] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-16T19:20:40.374923] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-04. [2025-09-16T19:20:40.806607] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-16T19:20:41.174966] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-07. [2025-09-16T19:20:41.571778] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-16T19:20:41.974918] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-04. [2025-09-16T19:20:42.066541] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-16T19:20:42.774908] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-03. [2025-09-16T19:20:43.249536] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-16T19:20:43.574890] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-05. [2025-09-16T19:20:43.619670] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-16T19:20:44.374898] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-04. [2025-09-16T19:20:44.636979] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-16T19:20:45.174928] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-05. [2025-09-16T19:20:45.208608] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-16T19:20:45.974932] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-06. [2025-09-16T19:20:46.493858] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-16T19:20:46.774888] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-08. [2025-09-16T19:20:47.046990] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-16T19:20:47.531961] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-16T19:20:47.574862] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-06. [2025-09-16T19:20:48.374940] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-05. [2025-09-16T19:20:48.567855] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-16T19:20:49.174939] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-09. [2025-09-16T19:20:49.361942] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-16T19:20:49.974947] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-06. [2025-09-16T19:20:50.093249] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-16T19:20:50.096595] [INFO ] [REMOTE ] MEC: Full fetch complete (17508 records). [2025-09-16T19:20:50.096737] [DEBUG] [VALIDATOR ] MEC: Validating primary data. [2025-09-16T19:20:50.461941] [DEBUG] [VALIDATOR ] MEC: All expected trading days are present. [2025-09-16T19:20:50.462019] [DEBUG] [VALIDATOR ] MEC: Primary data validation passed. [2025-09-16T19:20:50.462388] [INFO ] [MAIN ] MEC: Fetched primary data is valid. [2025-09-16T19:20:50.462469] [DEBUG] [LOCAL ] MEC: Saving primary data. [2025-09-16T19:20:50.463033] [DEBUG] [LOCAL ] MEC: Trimmed 17508 records to 12359 (keeping 150 days of data) [2025-09-16T19:20:50.535832] [DEBUG] [LOCAL ] MEC: Primary data saved (12359 records). [2025-09-16T19:20:50.535984] [INFO ] [MAIN ] MEC: Full history saved. [2025-09-16T19:20:50.536076] [INFO ] [MAIN ] Update Progress: 1327/2369 symbols completed. MEC took 29.6s. Estimated remaining: 1h 50m 33s. Rate: 9.4 symbols/min [2025-09-16T19:20:50.710102] [INFO ] [MAIN ] MEI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:20:50.731809] [DEBUG] [LOCAL ] MEI: Loaded 23106 existing records from primary storage. [2025-09-16T19:20:50.731953] [INFO ] [MAIN ] MEI: Loaded 23106 existing records. [2025-09-16T19:20:50.787090] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-07. [2025-09-16T19:20:50.912664] [WARN ] [MAIN ] MEI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:20:50.921666] [INFO ] [MAIN ] MEI: Wiping existing primary data before full refresh. [2025-09-16T19:20:50.921822] [INFO ] [LOCAL ] MEI: Starting deletion of primary data. [2025-09-16T19:20:50.922611] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-16T19:20:50.923898] [DEBUG] [LOCAL ] MEI: Deleted primary data file. [2025-09-16T19:20:50.926326] [INFO ] [MAIN ] MEI: Starting full primary refresh. [2025-09-16T19:20:51.276612] [INFO ] [REMOTE ] MEI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:20:51.574867] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-07. [2025-09-16T19:20:51.893186] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-16T19:20:52.374875] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-07. [2025-09-16T19:20:52.695335] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-16T19:20:53.174895] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-08. [2025-09-16T19:20:53.517083] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-16T19:20:53.974960] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-08. [2025-09-16T19:20:54.270313] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-16T19:20:54.774937] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-02. [2025-09-16T19:20:55.128984] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-16T19:20:55.574884] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-08. [2025-09-16T19:20:55.921173] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-16T19:20:56.374915] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-09. [2025-09-16T19:20:56.715472] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-16T19:20:57.174885] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-09. [2025-09-16T19:20:57.367310] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-16T19:20:57.369796] [INFO ] [REMOTE ] MED: Full fetch complete (24383 records). [2025-09-16T19:20:57.369869] [DEBUG] [VALIDATOR ] MED: Validating primary data. [2025-09-16T19:20:57.751608] [DEBUG] [VALIDATOR ] MED: All expected trading days are present. [2025-09-16T19:20:57.751701] [DEBUG] [VALIDATOR ] MED: Primary data validation passed. [2025-09-16T19:20:57.752194] [INFO ] [MAIN ] MED: Fetched primary data is valid. [2025-09-16T19:20:57.752235] [DEBUG] [LOCAL ] MED: Saving primary data. [2025-09-16T19:20:57.752985] [DEBUG] [LOCAL ] MED: Trimmed 24383 records to 15705 (keeping 150 days of data) [2025-09-16T19:20:57.849884] [DEBUG] [LOCAL ] MED: Primary data saved (15705 records). [2025-09-16T19:20:57.850038] [INFO ] [MAIN ] MED: Full history saved. [2025-09-16T19:20:57.850146] [INFO ] [MAIN ] Update Progress: 1328/2369 symbols completed. MED took 24.1s. Estimated remaining: 1h 50m 28s. Rate: 9.4 symbols/min [2025-09-16T19:20:57.979935] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-09. [2025-09-16T19:20:58.015095] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-16T19:20:58.042348] [INFO ] [MAIN ] MET: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:20:58.042671] [INFO ] [REMOTE ] MEGI: Full fetch complete (22190 records). [2025-09-16T19:20:58.043103] [DEBUG] [VALIDATOR ] MEGI: Validating primary data. [2025-09-16T19:20:58.357857] [DEBUG] [LOCAL ] MET: Loaded 39323 existing records from primary storage. [2025-09-16T19:20:58.363614] [INFO ] [MAIN ] MET: Loaded 39323 existing records. [2025-09-16T19:20:58.558389] [DEBUG] [VALIDATOR ] MEGI: All expected trading days are present. [2025-09-16T19:20:58.558796] [DEBUG] [VALIDATOR ] MEGI: Primary data validation passed. [2025-09-16T19:20:58.569853] [INFO ] [MAIN ] MEGI: Fetched primary data is valid. [2025-09-16T19:20:58.575019] [DEBUG] [LOCAL ] MEGI: Saving primary data. [2025-09-16T19:20:58.641958] [DEBUG] [LOCAL ] MEGI: Trimmed 22190 records to 15098 (keeping 150 days of data) [2025-09-16T19:20:58.642092] [WARN ] [MAIN ] MET: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:20:58.642717] [INFO ] [MAIN ] MET: Wiping existing primary data before full refresh. [2025-09-16T19:20:58.642821] [INFO ] [LOCAL ] MET: Starting deletion of primary data. [2025-09-16T19:20:58.643808] [DEBUG] [LOCAL ] MET: Deleted primary data file. [2025-09-16T19:20:58.691184] [INFO ] [MAIN ] MET: Starting full primary refresh. [2025-09-16T19:20:58.784620] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-03. [2025-09-16T19:20:58.951601] [DEBUG] [LOCAL ] MEGI: Primary data saved (15098 records). [2025-09-16T19:20:58.962399] [INFO ] [MAIN ] MEGI: Full history saved. [2025-09-16T19:20:59.025143] [INFO ] [MAIN ] Update Progress: 1329/2369 symbols completed. MEGI took 21.8s. Estimated remaining: 1h 50m 17s. Rate: 9.4 symbols/min [2025-09-16T19:20:59.387360] [INFO ] [REMOTE ] MET: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:20:59.514152] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-16T19:20:59.526143] [INFO ] [MAIN ] MFA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:20:59.523702] [INFO ] [REMOTE ] MEG: Full fetch complete (34914 records). [2025-09-16T19:20:59.527428] [DEBUG] [VALIDATOR ] MEG: Validating primary data. [2025-09-16T19:20:59.577947] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-02. [2025-09-16T19:20:59.729355] [DEBUG] [LOCAL ] MFA: Loaded 32905 existing records from primary storage. [2025-09-16T19:20:59.729567] [INFO ] [MAIN ] MFA: Loaded 32905 existing records. [2025-09-16T19:21:00.191332] [WARN ] [MAIN ] MFA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:21:00.201113] [INFO ] [MAIN ] MFA: Wiping existing primary data before full refresh. [2025-09-16T19:21:00.216708] [INFO ] [LOCAL ] MFA: Starting deletion of primary data. [2025-09-16T19:21:00.256356] [DEBUG] [LOCAL ] MFA: Deleted primary data file. [2025-09-16T19:21:00.275930] [INFO ] [MAIN ] MFA: Starting full primary refresh. [2025-09-16T19:21:00.284664] [DEBUG] [VALIDATOR ] MEG: All expected trading days are present. [2025-09-16T19:21:00.284804] [DEBUG] [VALIDATOR ] MEG: Primary data validation passed. [2025-09-16T19:21:00.316797] [INFO ] [MAIN ] MEG: Fetched primary data is valid. [2025-09-16T19:21:00.341098] [DEBUG] [LOCAL ] MEG: Saving primary data. [2025-09-16T19:21:00.394594] [DEBUG] [LOCAL ] MEG: Trimmed 34914 records to 22538 (keeping 150 days of data) [2025-09-16T19:21:00.734397] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-16T19:21:00.798065] [INFO ] [REMOTE ] MFA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:21:00.799171] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-04. [2025-09-16T19:21:00.855504] [DEBUG] [LOCAL ] MEG: Primary data saved (22538 records). [2025-09-16T19:21:00.855661] [INFO ] [MAIN ] MEG: Full history saved. [2025-09-16T19:21:00.855754] [INFO ] [MAIN ] Update Progress: 1330/2369 symbols completed. MEG took 25.9s. Estimated remaining: 1h 50m 7s. Rate: 9.4 symbols/min [2025-09-16T19:21:01.029142] [INFO ] [MAIN ] MFAN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:21:01.033571] [DEBUG] [LOCAL ] MFAN: Loaded 3011 existing records from primary storage. [2025-09-16T19:21:01.033670] [INFO ] [MAIN ] MFAN: Loaded 3011 existing records. [2025-09-16T19:21:01.184448] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-02. [2025-09-16T19:21:01.211540] [WARN ] [MAIN ] MFAN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:21:01.212658] [INFO ] [MAIN ] MFAN: Wiping existing primary data before full refresh. [2025-09-16T19:21:01.212708] [INFO ] [LOCAL ] MFAN: Starting deletion of primary data. [2025-09-16T19:21:01.212922] [DEBUG] [LOCAL ] MFAN: Deleted primary data file. [2025-09-16T19:21:01.212966] [INFO ] [MAIN ] MFAN: Starting full primary refresh. [2025-09-16T19:21:01.579873] [INFO ] [REMOTE ] MFAN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:21:01.611393] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-16T19:21:01.974955] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-02. [2025-09-16T19:21:02.272491] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-16T19:21:02.448346] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-16T19:21:02.460170] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-16T19:21:02.774949] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-03. [2025-09-16T19:21:03.574904] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-05. [2025-09-16T19:21:04.349228] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-16T19:21:04.374864] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-06. [2025-09-16T19:21:04.579112] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-16T19:21:05.174902] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-04. [2025-09-16T19:21:05.625580] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-16T19:21:05.974909] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-03. [2025-09-16T19:21:06.774929] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-03. [2025-09-16T19:21:06.997699] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-16T19:21:07.341943] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-16T19:21:07.582815] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-04. [2025-09-16T19:21:07.600098] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-16T19:21:08.272990] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-16T19:21:08.374909] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-05. [2025-09-16T19:21:09.174909] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-05. [2025-09-16T19:21:09.757604] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-16T19:21:09.974910] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-04. [2025-09-16T19:21:10.227041] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-16T19:21:10.774906] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-06. [2025-09-16T19:21:11.339006] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-16T19:21:11.497474] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-16T19:21:11.574882] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-07. [2025-09-16T19:21:12.192017] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-16T19:21:12.374935] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-05. [2025-09-16T19:21:13.174955] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-06. [2025-09-16T19:21:13.983328] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-08. [2025-09-16T19:21:14.016412] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-16T19:21:14.514277] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-16T19:21:14.774900] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-09. [2025-09-16T19:21:14.876273] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-16T19:21:15.326266] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-16T19:21:15.327405] [INFO ] [REMOTE ] MFAN: Full fetch complete (4540 records). [2025-09-16T19:21:15.327500] [DEBUG] [VALIDATOR ] MFAN: Validating primary data. [2025-09-16T19:21:15.580051] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-07. [2025-09-16T19:21:15.707508] [DEBUG] [VALIDATOR ] MFAN: All expected trading days are present. [2025-09-16T19:21:15.707591] [DEBUG] [VALIDATOR ] MFAN: Primary data validation passed. [2025-09-16T19:21:15.707746] [INFO ] [MAIN ] MFAN: Fetched primary data is valid. [2025-09-16T19:21:15.707821] [DEBUG] [LOCAL ] MFAN: Saving primary data. [2025-09-16T19:21:15.708293] [DEBUG] [LOCAL ] MFAN: Trimmed 4540 records to 3025 (keeping 150 days of data) [2025-09-16T19:21:15.728188] [DEBUG] [LOCAL ] MFAN: Primary data saved (3025 records). [2025-09-16T19:21:15.728315] [INFO ] [MAIN ] MFAN: Full history saved. [2025-09-16T19:21:15.728412] [INFO ] [MAIN ] Update Progress: 1331/2369 symbols completed. MFAN took 14.9s. Estimated remaining: 1h 50m 8s. Rate: 9.4 symbols/min [2025-09-16T19:21:15.899384] [INFO ] [MAIN ] MFAO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:21:15.903921] [DEBUG] [LOCAL ] MFAO: Loaded 2818 existing records from primary storage. [2025-09-16T19:21:15.904008] [INFO ] [MAIN ] MFAO: Loaded 2818 existing records. [2025-09-16T19:21:16.082728] [WARN ] [MAIN ] MFAO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:21:16.082970] [INFO ] [MAIN ] MFAO: Wiping existing primary data before full refresh. [2025-09-16T19:21:16.083018] [INFO ] [LOCAL ] MFAO: Starting deletion of primary data. [2025-09-16T19:21:16.083241] [DEBUG] [LOCAL ] MFAO: Deleted primary data file. [2025-09-16T19:21:16.083287] [INFO ] [MAIN ] MFAO: Starting full primary refresh. [2025-09-16T19:21:16.375035] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-06. [2025-09-16T19:21:16.454486] [INFO ] [REMOTE ] MFAO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:21:17.174940] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-02. [2025-09-16T19:21:17.518663] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-16T19:21:17.864225] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-16T19:21:17.974865] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-03. [2025-09-16T19:21:18.002848] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-16T19:21:18.353447] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-16T19:21:18.774906] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-07. [2025-09-16T19:21:19.574921] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-04. [2025-09-16T19:21:20.208770] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-16T19:21:20.342934] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-16T19:21:20.374871] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-08. [2025-09-16T19:21:21.174915] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-08. [2025-09-16T19:21:21.894256] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-16T19:21:21.974946] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-07. [2025-09-16T19:21:22.628343] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-16T19:21:22.774925] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-05. [2025-09-16T19:21:23.348598] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-16T19:21:23.394509] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-16T19:21:23.574933] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-09. [2025-09-16T19:21:24.374905] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-06. [2025-09-16T19:21:25.052993] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-16T19:21:25.174905] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-07. [2025-09-16T19:21:25.407461] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-16T19:21:25.413771] [INFO ] [REMOTE ] MET: Full fetch complete (57960 records). [2025-09-16T19:21:25.413892] [DEBUG] [VALIDATOR ] MET: Validating primary data. [2025-09-16T19:21:25.528450] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-16T19:21:25.810227] [DEBUG] [VALIDATOR ] MET: All expected trading days are present. [2025-09-16T19:21:25.810319] [DEBUG] [VALIDATOR ] MET: Primary data validation passed. [2025-09-16T19:21:25.811162] [INFO ] [MAIN ] MET: Fetched primary data is valid. [2025-09-16T19:21:25.811211] [DEBUG] [LOCAL ] MET: Saving primary data. [2025-09-16T19:21:25.812502] [DEBUG] [LOCAL ] MET: Trimmed 57960 records to 39713 (keeping 150 days of data) [2025-09-16T19:21:26.023073] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-09. [2025-09-16T19:21:26.100067] [DEBUG] [LOCAL ] MET: Primary data saved (39713 records). [2025-09-16T19:21:26.100224] [INFO ] [MAIN ] MET: Full history saved. [2025-09-16T19:21:26.100311] [INFO ] [MAIN ] Update Progress: 1332/2369 symbols completed. MET took 28.3s. Estimated remaining: 1h 50m 4s. Rate: 9.4 symbols/min [2025-09-16T19:21:26.275782] [INFO ] [MAIN ] MFC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:21:26.314183] [DEBUG] [LOCAL ] MFC: Loaded 37624 existing records from primary storage. [2025-09-16T19:21:26.314352] [INFO ] [MAIN ] MFC: Loaded 37624 existing records. [2025-09-16T19:21:26.490941] [WARN ] [MAIN ] MFC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:21:26.491204] [INFO ] [MAIN ] MFC: Wiping existing primary data before full refresh. [2025-09-16T19:21:26.491257] [INFO ] [LOCAL ] MFC: Starting deletion of primary data. [2025-09-16T19:21:26.492136] [DEBUG] [LOCAL ] MFC: Deleted primary data file. [2025-09-16T19:21:26.492185] [INFO ] [MAIN ] MFC: Starting full primary refresh. [2025-09-16T19:21:26.777030] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-08. [2025-09-16T19:21:26.856116] [INFO ] [REMOTE ] MFC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:21:27.574909] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-08. [2025-09-16T19:21:27.633074] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-16T19:21:27.638520] [INFO ] [REMOTE ] MFA: Full fetch complete (48976 records). [2025-09-16T19:21:27.638613] [DEBUG] [VALIDATOR ] MFA: Validating primary data. [2025-09-16T19:21:28.023652] [DEBUG] [VALIDATOR ] MFA: All expected trading days are present. [2025-09-16T19:21:28.023788] [DEBUG] [VALIDATOR ] MFA: Primary data validation passed. [2025-09-16T19:21:28.024618] [INFO ] [MAIN ] MFA: Fetched primary data is valid. [2025-09-16T19:21:28.024706] [DEBUG] [LOCAL ] MFA: Saving primary data. [2025-09-16T19:21:28.044120] [DEBUG] [LOCAL ] MFA: Trimmed 48976 records to 33246 (keeping 150 days of data) [2025-09-16T19:21:28.044850] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-16T19:21:28.148565] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-16T19:21:28.260767] [DEBUG] [LOCAL ] MFA: Primary data saved (33246 records). [2025-09-16T19:21:28.260924] [INFO ] [MAIN ] MFA: Full history saved. [2025-09-16T19:21:28.261012] [INFO ] [MAIN ] Update Progress: 1333/2369 symbols completed. MFA took 29.2s. Estimated remaining: 1h 49m 55s. Rate: 9.4 symbols/min [2025-09-16T19:21:28.380024] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-09. [2025-09-16T19:21:28.434991] [INFO ] [MAIN ] MFG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:21:28.473728] [DEBUG] [LOCAL ] MFG: Loaded 36559 existing records from primary storage. [2025-09-16T19:21:28.473941] [INFO ] [MAIN ] MFG: Loaded 36559 existing records. [2025-09-16T19:21:28.666087] [WARN ] [MAIN ] MFG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:21:28.666363] [INFO ] [MAIN ] MFG: Wiping existing primary data before full refresh. [2025-09-16T19:21:28.666411] [INFO ] [LOCAL ] MFG: Starting deletion of primary data. [2025-09-16T19:21:28.667124] [DEBUG] [LOCAL ] MFG: Deleted primary data file. [2025-09-16T19:21:28.667172] [INFO ] [MAIN ] MFG: Starting full primary refresh. [2025-09-16T19:21:29.018635] [INFO ] [REMOTE ] MFG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:21:29.174906] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-09. [2025-09-16T19:21:29.739057] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-16T19:21:29.740058] [INFO ] [REMOTE ] MFAO: Full fetch complete (4185 records). [2025-09-16T19:21:29.740127] [DEBUG] [VALIDATOR ] MFAO: Validating primary data. [2025-09-16T19:21:29.978449] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-02. [2025-09-16T19:21:29.999953] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-16T19:21:30.033208] [INFO ] [REMOTE ] MEI: Full fetch complete (34604 records). [2025-09-16T19:21:30.045990] [DEBUG] [VALIDATOR ] MEI: Validating primary data. [2025-09-16T19:21:30.272499] [DEBUG] [VALIDATOR ] MFAO: All expected trading days are present. [2025-09-16T19:21:30.286725] [DEBUG] [VALIDATOR ] MFAO: Primary data validation passed. [2025-09-16T19:21:30.304157] [INFO ] [MAIN ] MFAO: Fetched primary data is valid. [2025-09-16T19:21:30.304849] [DEBUG] [LOCAL ] MFAO: Saving primary data. [2025-09-16T19:21:30.337764] [DEBUG] [LOCAL ] MFAO: Trimmed 4185 records to 2842 (keeping 150 days of data) [2025-09-16T19:21:30.452474] [DEBUG] [LOCAL ] MFAO: Primary data saved (2842 records). [2025-09-16T19:21:30.452616] [INFO ] [MAIN ] MFAO: Full history saved. [2025-09-16T19:21:30.453020] [INFO ] [MAIN ] Update Progress: 1334/2369 symbols completed. MFAO took 14.7s. Estimated remaining: 1h 49m 45s. Rate: 9.4 symbols/min [2025-09-16T19:21:30.650294] [DEBUG] [VALIDATOR ] MEI: All expected trading days are present. [2025-09-16T19:21:30.655485] [DEBUG] [VALIDATOR ] MEI: Primary data validation passed. [2025-09-16T19:21:30.680706] [INFO ] [MAIN ] MEI: Fetched primary data is valid. [2025-09-16T19:21:30.687329] [DEBUG] [LOCAL ] MEI: Saving primary data. [2025-09-16T19:21:30.711876] [INFO ] [MAIN ] MFM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:21:30.712760] [DEBUG] [LOCAL ] MEI: Trimmed 34604 records to 23284 (keeping 150 days of data) [2025-09-16T19:21:30.775300] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-02. [2025-09-16T19:21:30.810000] [DEBUG] [LOCAL ] MFM: Loaded 9588 existing records from primary storage. [2025-09-16T19:21:30.811451] [INFO ] [MAIN ] MFM: Loaded 9588 existing records. [2025-09-16T19:21:31.018711] [WARN ] [MAIN ] MFM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:21:31.021818] [INFO ] [MAIN ] MFM: Wiping existing primary data before full refresh. [2025-09-16T19:21:31.025891] [INFO ] [LOCAL ] MFM: Starting deletion of primary data. [2025-09-16T19:21:31.040959] [DEBUG] [LOCAL ] MFM: Deleted primary data file. [2025-09-16T19:21:31.042178] [INFO ] [MAIN ] MFM: Starting full primary refresh. [2025-09-16T19:21:31.119977] [DEBUG] [LOCAL ] MEI: Primary data saved (23284 records). [2025-09-16T19:21:31.142754] [INFO ] [MAIN ] MEI: Full history saved. [2025-09-16T19:21:31.169466] [INFO ] [MAIN ] Update Progress: 1335/2369 symbols completed. MEI took 40.6s. Estimated remaining: 1h 49m 34s. Rate: 9.4 symbols/min [2025-09-16T19:21:31.571172] [INFO ] [MAIN ] MFSB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:21:31.597504] [DEBUG] [LOCAL ] MFSB: No existing data file found in primary storage. [2025-09-16T19:21:31.636068] [INFO ] [REMOTE ] MFM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:21:31.636409] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-02. [2025-09-16T19:21:31.631427] [WARN ] [MAIN ] MFSB: No existing data found, performing full refresh instead. [2025-09-16T19:21:31.636668] [INFO ] [MAIN ] MFSB: Wiping existing primary data before full refresh. [2025-09-16T19:21:31.637570] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-09-16T19:21:31.637682] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-09-16T19:21:31.637729] [INFO ] [MAIN ] MFSB: Starting full primary refresh. [2025-09-16T19:21:32.057571] [INFO ] [REMOTE ] MFSB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:21:32.060842] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-16T19:21:32.373362] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-16T19:21:32.385089] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-03. [2025-09-16T19:21:32.478878] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-16T19:21:33.174905] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-02. [2025-09-16T19:21:33.403081] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-09-16T19:21:33.974899] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-03. [2025-09-16T19:21:34.195306] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-16T19:21:34.353589] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-16T19:21:34.774900] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-04. [2025-09-16T19:21:35.574900] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-03. [2025-09-16T19:21:36.374922] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-04. [2025-09-16T19:21:36.694260] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-09-16T19:21:37.174910] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-03. [2025-09-16T19:21:37.969573] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-16T19:21:37.974831] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-04. [2025-09-16T19:21:38.774933] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-05. [2025-09-16T19:21:39.018979] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-09-16T19:21:39.125112] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-16T19:21:39.574934] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-05. [2025-09-16T19:21:40.102345] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-04 (5.33 seconds). [2025-09-16T19:21:40.374945] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-06. [2025-09-16T19:21:40.707788] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-16T19:21:41.174958] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-07. [2025-09-16T19:21:41.490416] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-16T19:21:41.876996] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-03 (6.30 seconds). [2025-09-16T19:21:41.974974] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-05. [2025-09-16T19:21:42.232232] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-05 (2.66 seconds). [2025-09-16T19:21:42.774904] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-04. [2025-09-16T19:21:43.574917] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-06. [2025-09-16T19:21:43.739835] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-16T19:21:44.374902] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-08. [2025-09-16T19:21:44.482228] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-16T19:21:44.519792] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-16T19:21:44.824236] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-16T19:21:45.175046] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-07. [2025-09-16T19:21:45.974939] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-09. [2025-09-16T19:21:46.111609] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-16T19:21:46.626482] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-16T19:21:46.627458] [INFO ] [REMOTE ] MFSB: Full fetch complete (1132 records). [2025-09-16T19:21:46.627528] [DEBUG] [VALIDATOR ] MFSB: Validating primary data. [2025-09-16T19:21:46.780039] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-06. [2025-09-16T19:21:46.808667] [WARN ] [VALIDATOR ] MFSB: Validation failed - insufficient historical data. Have 132 unique days, need 150 days [2025-09-16T19:21:46.808890] [FATAL] [MAIN ] MFSB: Fetched primary data is invalid. Refusing to save it. [2025-09-16T19:21:46.808971] [WARN ] [MAIN ] MFSB: Deleting existing primary and derivative data due to validation failure. [2025-09-16T19:21:46.809033] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-09-16T19:21:46.809109] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-09-16T19:21:46.809170] [INFO ] [LOCAL ] MFSB: Starting deletion of derivative data. [2025-09-16T19:21:46.809235] [DEBUG] [LOCAL ] MFSB: No derivative data file found to delete. [2025-09-16T19:21:46.809333] [INFO ] [MAIN ] Update Progress: 1336/2369 symbols completed. MFSB took 15.6s. Estimated remaining: 1h 49m 35s. Rate: 9.4 symbols/min [2025-09-16T19:21:46.991300] [INFO ] [MAIN ] MFSG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:21:46.997454] [DEBUG] [LOCAL ] MFSG: Loaded 3906 existing records from primary storage. [2025-09-16T19:21:46.997556] [INFO ] [MAIN ] MFSG: Loaded 3906 existing records. [2025-09-16T19:21:47.183867] [WARN ] [MAIN ] MFSG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:21:47.184166] [INFO ] [MAIN ] MFSG: Wiping existing primary data before full refresh. [2025-09-16T19:21:47.184216] [INFO ] [LOCAL ] MFSG: Starting deletion of primary data. [2025-09-16T19:21:47.184452] [DEBUG] [LOCAL ] MFSG: Deleted primary data file. [2025-09-16T19:21:47.184498] [INFO ] [MAIN ] MFSG: Starting full primary refresh. [2025-09-16T19:21:47.543720] [INFO ] [REMOTE ] MFSG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:21:47.574905] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-02. [2025-09-16T19:21:48.000162] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-16T19:21:48.374864] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-05. [2025-09-16T19:21:48.488098] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-16T19:21:49.174952] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-07. [2025-09-16T19:21:49.974943] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-03. [2025-09-16T19:21:50.184115] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-16T19:21:50.412771] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-16T19:21:50.716965] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-16T19:21:50.774907] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-08. [2025-09-16T19:21:51.574958] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-08. [2025-09-16T19:21:52.374970] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-06. [2025-09-16T19:21:53.174973] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-04. [2025-09-16T19:21:53.519483] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-08 (2.74 seconds). [2025-09-16T19:21:53.656186] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-16T19:21:53.754237] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-16T19:21:53.974917] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-05. [2025-09-16T19:21:54.670007] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-09-16T19:21:54.688745] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-16T19:21:54.774892] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-06. [2025-09-16T19:21:55.375880] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-16T19:21:55.574906] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-09. [2025-09-16T19:21:56.374919] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-07. [2025-09-16T19:21:57.175805] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-09. [2025-09-16T19:21:57.176998] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-16T19:21:57.183560] [INFO ] [REMOTE ] MFC: Full fetch complete (55970 records). [2025-09-16T19:21:57.183674] [DEBUG] [VALIDATOR ] MFC: Validating primary data. [2025-09-16T19:21:57.575677] [DEBUG] [VALIDATOR ] MFC: All expected trading days are present. [2025-09-16T19:21:57.575791] [DEBUG] [VALIDATOR ] MFC: Primary data validation passed. [2025-09-16T19:21:57.576726] [INFO ] [MAIN ] MFC: Fetched primary data is valid. [2025-09-16T19:21:57.576781] [DEBUG] [LOCAL ] MFC: Saving primary data. [2025-09-16T19:21:57.577956] [DEBUG] [LOCAL ] MFC: Trimmed 55970 records to 37998 (keeping 150 days of data) [2025-09-16T19:21:57.814414] [DEBUG] [LOCAL ] MFC: Primary data saved (37998 records). [2025-09-16T19:21:57.814687] [INFO ] [MAIN ] MFC: Full history saved. [2025-09-16T19:21:57.814795] [INFO ] [MAIN ] Update Progress: 1337/2369 symbols completed. MFC took 31.7s. Estimated remaining: 1h 49m 32s. Rate: 9.4 symbols/min [2025-09-16T19:21:57.975940] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-07. [2025-09-16T19:21:57.994023] [INFO ] [MAIN ] MFSI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:21:58.004763] [DEBUG] [LOCAL ] MFSI: Loaded 8872 existing records from primary storage. [2025-09-16T19:21:58.005142] [INFO ] [MAIN ] MFSI: Loaded 8872 existing records. [2025-09-16T19:21:58.184679] [WARN ] [MAIN ] MFSI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:21:58.192159] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-16T19:21:58.192240] [INFO ] [MAIN ] MFSI: Wiping existing primary data before full refresh. [2025-09-16T19:21:58.192422] [INFO ] [LOCAL ] MFSI: Starting deletion of primary data. [2025-09-16T19:21:58.195584] [INFO ] [REMOTE ] MFM: Full fetch complete (15255 records). [2025-09-16T19:21:58.195672] [DEBUG] [LOCAL ] MFSI: Deleted primary data file. [2025-09-16T19:21:58.195900] [INFO ] [MAIN ] MFSI: Starting full primary refresh. [2025-09-16T19:21:58.195814] [DEBUG] [VALIDATOR ] MFM: Validating primary data. [2025-09-16T19:21:58.511243] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-16T19:21:58.723392] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-09-16T19:21:58.796736] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-08. [2025-09-16T19:21:58.937852] [DEBUG] [VALIDATOR ] MFM: All expected trading days are present. [2025-09-16T19:21:58.958822] [DEBUG] [VALIDATOR ] MFM: Primary data validation passed. [2025-09-16T19:21:58.975915] [INFO ] [MAIN ] MFM: Fetched primary data is valid. [2025-09-16T19:21:58.976008] [DEBUG] [LOCAL ] MFM: Saving primary data. [2025-09-16T19:21:58.999254] [INFO ] [REMOTE ] MFSI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:21:58.999674] [DEBUG] [LOCAL ] MFM: Trimmed 15255 records to 9639 (keeping 150 days of data) [2025-09-16T19:21:59.058166] [DEBUG] [LOCAL ] MFM: Primary data saved (9639 records). [2025-09-16T19:21:59.058337] [INFO ] [MAIN ] MFM: Full history saved. [2025-09-16T19:21:59.058437] [INFO ] [MAIN ] Update Progress: 1338/2369 symbols completed. MFM took 28.6s. Estimated remaining: 1h 49m 22s. Rate: 9.4 symbols/min [2025-09-16T19:21:59.227361] [INFO ] [MAIN ] MFSV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:21:59.230681] [DEBUG] [LOCAL ] MFSV: Loaded 1681 existing records from primary storage. [2025-09-16T19:21:59.230760] [INFO ] [MAIN ] MFSV: Loaded 1681 existing records. [2025-09-16T19:21:59.409037] [WARN ] [MAIN ] MFSV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:21:59.409297] [INFO ] [MAIN ] MFSV: Wiping existing primary data before full refresh. [2025-09-16T19:21:59.409345] [INFO ] [LOCAL ] MFSV: Starting deletion of primary data. [2025-09-16T19:21:59.409529] [DEBUG] [LOCAL ] MFSV: Deleted primary data file. [2025-09-16T19:21:59.409572] [INFO ] [MAIN ] MFSV: Starting full primary refresh. [2025-09-16T19:21:59.581517] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-02. [2025-09-16T19:21:59.682677] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-16T19:21:59.770772] [INFO ] [REMOTE ] MFSV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:22:00.234447] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-16T19:22:00.374980] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-08. [2025-09-16T19:22:01.174928] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-02. [2025-09-16T19:22:01.630874] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-16T19:22:01.981603] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-09. [2025-09-16T19:22:02.007674] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-16T19:22:02.774922] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-03. [2025-09-16T19:22:02.822877] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-16T19:22:02.824335] [INFO ] [REMOTE ] MFSG: Full fetch complete (4976 records). [2025-09-16T19:22:02.824404] [DEBUG] [VALIDATOR ] MFSG: Validating primary data. [2025-09-16T19:22:03.188502] [DEBUG] [VALIDATOR ] MFSG: All expected trading days are present. [2025-09-16T19:22:03.188580] [DEBUG] [VALIDATOR ] MFSG: Primary data validation passed. [2025-09-16T19:22:03.188763] [INFO ] [MAIN ] MFSG: Fetched primary data is valid. [2025-09-16T19:22:03.188808] [DEBUG] [LOCAL ] MFSG: Saving primary data. [2025-09-16T19:22:03.189493] [DEBUG] [LOCAL ] MFSG: Trimmed 4976 records to 3995 (keeping 150 days of data) [2025-09-16T19:22:03.211837] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-16T19:22:03.219239] [DEBUG] [LOCAL ] MFSG: Primary data saved (3995 records). [2025-09-16T19:22:03.219313] [INFO ] [MAIN ] MFSG: Full history saved. [2025-09-16T19:22:03.219412] [INFO ] [MAIN ] Update Progress: 1339/2369 symbols completed. MFSG took 16.4s. Estimated remaining: 1h 49m 14s. Rate: 9.4 symbols/min [2025-09-16T19:22:03.393583] [INFO ] [MAIN ] MG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:22:03.405331] [DEBUG] [LOCAL ] MG: Loaded 11429 existing records from primary storage. [2025-09-16T19:22:03.405444] [INFO ] [MAIN ] MG: Loaded 11429 existing records. [2025-09-16T19:22:03.581488] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-04. [2025-09-16T19:22:03.587569] [WARN ] [MAIN ] MG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:22:03.588576] [INFO ] [MAIN ] MG: Wiping existing primary data before full refresh. [2025-09-16T19:22:03.588663] [INFO ] [LOCAL ] MG: Starting deletion of primary data. [2025-09-16T19:22:03.589043] [DEBUG] [LOCAL ] MG: Deleted primary data file. [2025-09-16T19:22:03.589107] [INFO ] [MAIN ] MG: Starting full primary refresh. [2025-09-16T19:22:03.951914] [INFO ] [REMOTE ] MG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:22:04.131710] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-16T19:22:04.374934] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-05. [2025-09-16T19:22:04.799201] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-16T19:22:05.174942] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-02. [2025-09-16T19:22:05.973713] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-16T19:22:05.974892] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-09. [2025-09-16T19:22:06.774929] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-03. [2025-09-16T19:22:07.403627] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-16T19:22:07.500874] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-16T19:22:07.512833] [INFO ] [REMOTE ] MFG: Full fetch complete (52796 records). [2025-09-16T19:22:07.513006] [DEBUG] [VALIDATOR ] MFG: Validating primary data. [2025-09-16T19:22:07.579997] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-06. [2025-09-16T19:22:07.893722] [DEBUG] [VALIDATOR ] MFG: All expected trading days are present. [2025-09-16T19:22:07.893805] [DEBUG] [VALIDATOR ] MFG: Primary data validation passed. [2025-09-16T19:22:07.894610] [INFO ] [MAIN ] MFG: Fetched primary data is valid. [2025-09-16T19:22:07.894676] [DEBUG] [LOCAL ] MFG: Saving primary data. [2025-09-16T19:22:07.896297] [DEBUG] [LOCAL ] MFG: Trimmed 52796 records to 36915 (keeping 150 days of data) [2025-09-16T19:22:08.106578] [DEBUG] [LOCAL ] MFG: Primary data saved (36915 records). [2025-09-16T19:22:08.106745] [INFO ] [MAIN ] MFG: Full history saved. [2025-09-16T19:22:08.106845] [INFO ] [MAIN ] Update Progress: 1340/2369 symbols completed. MFG took 39.8s. Estimated remaining: 1h 49m 6s. Rate: 9.4 symbols/min [2025-09-16T19:22:08.189904] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-16T19:22:08.286267] [INFO ] [MAIN ] MGA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:22:08.286464] [DEBUG] [LOCAL ] MGA: No existing data file found in primary storage. [2025-09-16T19:22:08.286508] [WARN ] [MAIN ] MGA: No existing data found, performing full refresh instead. [2025-09-16T19:22:08.286677] [INFO ] [MAIN ] MGA: Wiping existing primary data before full refresh. [2025-09-16T19:22:08.286757] [INFO ] [LOCAL ] MGA: Starting deletion of primary data. [2025-09-16T19:22:08.286833] [DEBUG] [LOCAL ] MGA: No primary data file found to delete. [2025-09-16T19:22:08.286897] [INFO ] [MAIN ] MGA: Starting full primary refresh. [2025-09-16T19:22:08.383969] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-07. [2025-09-16T19:22:08.641409] [INFO ] [REMOTE ] MGA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:22:08.845344] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-16T19:22:09.174930] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-02. [2025-09-16T19:22:09.974896] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-03. [2025-09-16T19:22:10.774872] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-04. [2025-09-16T19:22:10.915871] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-16T19:22:11.129934] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-16T19:22:11.169231] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-16T19:22:11.574918] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-03. [2025-09-16T19:22:12.374959] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-04. [2025-09-16T19:22:13.174929] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-05. [2025-09-16T19:22:13.357394] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-16T19:22:13.392617] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-16T19:22:13.943281] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-16T19:22:13.974916] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-08. [2025-09-16T19:22:14.592061] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-16T19:22:14.774908] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-04. [2025-09-16T19:22:15.574926] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-06. [2025-09-16T19:22:16.374902] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-09. [2025-09-16T19:22:16.475111] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-16T19:22:16.518369] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-16T19:22:17.019972] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-16T19:22:17.021552] [INFO ] [REMOTE ] MFSV: Full fetch complete (2394 records). [2025-09-16T19:22:17.021721] [DEBUG] [VALIDATOR ] MFSV: Validating primary data. [2025-09-16T19:22:17.180345] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-05. [2025-09-16T19:22:17.378327] [DEBUG] [VALIDATOR ] MFSV: All expected trading days are present. [2025-09-16T19:22:17.378402] [DEBUG] [VALIDATOR ] MFSV: Primary data validation passed. [2025-09-16T19:22:17.378493] [INFO ] [MAIN ] MFSV: Fetched primary data is valid. [2025-09-16T19:22:17.378542] [DEBUG] [LOCAL ] MFSV: Saving primary data. [2025-09-16T19:22:17.378891] [DEBUG] [LOCAL ] MFSV: Trimmed 2394 records to 1713 (keeping 150 days of data) [2025-09-16T19:22:17.390286] [DEBUG] [LOCAL ] MFSV: Primary data saved (1713 records). [2025-09-16T19:22:17.390345] [INFO ] [MAIN ] MFSV: Full history saved. [2025-09-16T19:22:17.390461] [INFO ] [MAIN ] Update Progress: 1341/2369 symbols completed. MFSV took 18.3s. Estimated remaining: 1h 49m 2s. Rate: 9.4 symbols/min [2025-09-16T19:22:17.556749] [INFO ] [MAIN ] MGF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:22:17.562064] [DEBUG] [LOCAL ] MGF: Loaded 3170 existing records from primary storage. [2025-09-16T19:22:17.562139] [INFO ] [MAIN ] MGF: Loaded 3170 existing records. [2025-09-16T19:22:17.733708] [WARN ] [MAIN ] MGF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:22:17.733922] [INFO ] [MAIN ] MGF: Wiping existing primary data before full refresh. [2025-09-16T19:22:17.733967] [INFO ] [LOCAL ] MGF: Starting deletion of primary data. [2025-09-16T19:22:17.734246] [DEBUG] [LOCAL ] MGF: Deleted primary data file. [2025-09-16T19:22:17.734292] [INFO ] [MAIN ] MGF: Starting full primary refresh. [2025-09-16T19:22:17.976059] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-05. [2025-09-16T19:22:18.090852] [INFO ] [REMOTE ] MGF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:22:18.286063] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-16T19:22:18.774901] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-02. [2025-09-16T19:22:19.333395] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-16T19:22:19.574884] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-06. [2025-09-16T19:22:19.687526] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-16T19:22:20.313882] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-16T19:22:20.374971] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-03. [2025-09-16T19:22:20.885664] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-16T19:22:21.174960] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-04. [2025-09-16T19:22:21.740195] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-16T19:22:21.974950] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-06. [2025-09-16T19:22:22.774911] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-07. [2025-09-16T19:22:23.580215] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-07. [2025-09-16T19:22:23.598966] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-16T19:22:23.644758] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-16T19:22:24.374965] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-05. [2025-09-16T19:22:24.490892] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-16T19:22:24.907522] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-16T19:22:25.174929] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-06. [2025-09-16T19:22:25.622886] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-16T19:22:25.974933] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-07. [2025-09-16T19:22:26.513693] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-16T19:22:26.774906] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-08. [2025-09-16T19:22:27.574962] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-08. [2025-09-16T19:22:27.706069] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-16T19:22:28.159579] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-16T19:22:28.374897] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-08. [2025-09-16T19:22:29.174958] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-09. [2025-09-16T19:22:29.249509] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-16T19:22:29.694020] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-16T19:22:29.695341] [INFO ] [REMOTE ] MGF: Full fetch complete (4458 records). [2025-09-16T19:22:29.695431] [DEBUG] [VALIDATOR ] MGF: Validating primary data. [2025-09-16T19:22:29.980166] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-07. [2025-09-16T19:22:30.094833] [DEBUG] [VALIDATOR ] MGF: All expected trading days are present. [2025-09-16T19:22:30.094915] [DEBUG] [VALIDATOR ] MGF: Primary data validation passed. [2025-09-16T19:22:30.095072] [INFO ] [MAIN ] MGF: Fetched primary data is valid. [2025-09-16T19:22:30.095113] [DEBUG] [LOCAL ] MGF: Saving primary data. [2025-09-16T19:22:30.095543] [DEBUG] [LOCAL ] MGF: Trimmed 4458 records to 3182 (keeping 150 days of data) [2025-09-16T19:22:30.116150] [DEBUG] [LOCAL ] MGF: Primary data saved (3182 records). [2025-09-16T19:22:30.116258] [INFO ] [MAIN ] MGF: Full history saved. [2025-09-16T19:22:30.116369] [INFO ] [MAIN ] Update Progress: 1342/2369 symbols completed. MGF took 12.7s. Estimated remaining: 1h 49m 1s. Rate: 9.4 symbols/min [2025-09-16T19:22:30.289978] [INFO ] [MAIN ] MGM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:22:30.336429] [DEBUG] [LOCAL ] MGM: Loaded 39574 existing records from primary storage. [2025-09-16T19:22:30.336577] [INFO ] [MAIN ] MGM: Loaded 39574 existing records. [2025-09-16T19:22:30.512417] [WARN ] [MAIN ] MGM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:22:30.512707] [INFO ] [MAIN ] MGM: Wiping existing primary data before full refresh. [2025-09-16T19:22:30.512766] [INFO ] [LOCAL ] MGM: Starting deletion of primary data. [2025-09-16T19:22:30.513745] [DEBUG] [LOCAL ] MGM: Deleted primary data file. [2025-09-16T19:22:30.513795] [INFO ] [MAIN ] MGM: Starting full primary refresh. [2025-09-16T19:22:30.780029] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-09. [2025-09-16T19:22:30.868717] [INFO ] [REMOTE ] MGM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:22:31.574900] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-09. [2025-09-16T19:22:31.722093] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-16T19:22:31.746146] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-16T19:22:31.748588] [INFO ] [REMOTE ] MFSI: Full fetch complete (10984 records). [2025-09-16T19:22:31.748688] [DEBUG] [VALIDATOR ] MFSI: Validating primary data. [2025-09-16T19:22:32.111728] [DEBUG] [VALIDATOR ] MFSI: All expected trading days are present. [2025-09-16T19:22:32.111807] [DEBUG] [VALIDATOR ] MFSI: Primary data validation passed. [2025-09-16T19:22:32.112052] [INFO ] [MAIN ] MFSI: Fetched primary data is valid. [2025-09-16T19:22:32.112092] [DEBUG] [LOCAL ] MFSI: Saving primary data. [2025-09-16T19:22:32.112551] [DEBUG] [LOCAL ] MFSI: Trimmed 10984 records to 9004 (keeping 150 days of data) [2025-09-16T19:22:32.171720] [DEBUG] [LOCAL ] MFSI: Primary data saved (9004 records). [2025-09-16T19:22:32.171867] [INFO ] [MAIN ] MFSI: Full history saved. [2025-09-16T19:22:32.171964] [INFO ] [MAIN ] Update Progress: 1343/2369 symbols completed. MFSI took 34.4s. Estimated remaining: 1h 48m 51s. Rate: 9.4 symbols/min [2025-09-16T19:22:32.342396] [INFO ] [MAIN ] MGR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:22:32.348598] [DEBUG] [LOCAL ] MGR: Loaded 4099 existing records from primary storage. [2025-09-16T19:22:32.348729] [INFO ] [MAIN ] MGR: Loaded 4099 existing records. [2025-09-16T19:22:32.380053] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-08. [2025-09-16T19:22:32.460132] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-16T19:22:32.504616] [INFO ] [REMOTE ] MG: Full fetch complete (18051 records). [2025-09-16T19:22:32.522627] [DEBUG] [VALIDATOR ] MG: Validating primary data. [2025-09-16T19:22:32.547264] [WARN ] [MAIN ] MGR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:22:32.628722] [INFO ] [MAIN ] MGR: Wiping existing primary data before full refresh. [2025-09-16T19:22:32.650037] [INFO ] [LOCAL ] MGR: Starting deletion of primary data. [2025-09-16T19:22:32.666214] [DEBUG] [LOCAL ] MGR: Deleted primary data file. [2025-09-16T19:22:32.690021] [INFO ] [MAIN ] MGR: Starting full primary refresh. [2025-09-16T19:22:33.179435] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-02. [2025-09-16T19:22:33.195594] [DEBUG] [VALIDATOR ] MG: All expected trading days are present. [2025-09-16T19:22:33.207371] [DEBUG] [VALIDATOR ] MG: Primary data validation passed. [2025-09-16T19:22:33.207845] [INFO ] [MAIN ] MG: Fetched primary data is valid. [2025-09-16T19:22:33.208237] [DEBUG] [LOCAL ] MG: Saving primary data. [2025-09-16T19:22:33.268728] [DEBUG] [LOCAL ] MG: Trimmed 18051 records to 11519 (keeping 150 days of data) [2025-09-16T19:22:33.289758] [INFO ] [REMOTE ] MGR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:22:33.362436] [DEBUG] [LOCAL ] MG: Primary data saved (11519 records). [2025-09-16T19:22:33.362603] [INFO ] [MAIN ] MG: Full history saved. [2025-09-16T19:22:33.362718] [INFO ] [MAIN ] Update Progress: 1344/2369 symbols completed. MG took 30.1s. Estimated remaining: 1h 48m 41s. Rate: 9.4 symbols/min [2025-09-16T19:22:33.533742] [INFO ] [MAIN ] MGRB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:22:33.538513] [DEBUG] [LOCAL ] MGRB: Loaded 3036 existing records from primary storage. [2025-09-16T19:22:33.538628] [INFO ] [MAIN ] MGRB: Loaded 3036 existing records. [2025-09-16T19:22:33.713411] [WARN ] [MAIN ] MGRB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:22:33.713633] [INFO ] [MAIN ] MGRB: Wiping existing primary data before full refresh. [2025-09-16T19:22:33.713699] [INFO ] [LOCAL ] MGRB: Starting deletion of primary data. [2025-09-16T19:22:33.713906] [DEBUG] [LOCAL ] MGRB: Deleted primary data file. [2025-09-16T19:22:33.713949] [INFO ] [MAIN ] MGRB: Starting full primary refresh. [2025-09-16T19:22:33.984376] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-02. [2025-09-16T19:22:34.064771] [INFO ] [REMOTE ] MGRB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:22:34.207060] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-16T19:22:34.577135] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-16T19:22:34.774912] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-09. [2025-09-16T19:22:34.866245] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-16T19:22:35.574929] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-03. [2025-09-16T19:22:36.210838] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-16T19:22:36.216838] [INFO ] [REMOTE ] MGA: Full fetch complete (55097 records). [2025-09-16T19:22:36.216934] [DEBUG] [VALIDATOR ] MGA: Validating primary data. [2025-09-16T19:22:36.391406] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-02. [2025-09-16T19:22:36.598945] [DEBUG] [VALIDATOR ] MGA: All expected trading days are present. [2025-09-16T19:22:36.599025] [DEBUG] [VALIDATOR ] MGA: Primary data validation passed. [2025-09-16T19:22:36.599836] [INFO ] [MAIN ] MGA: Fetched primary data is valid. [2025-09-16T19:22:36.599880] [DEBUG] [LOCAL ] MGA: Saving primary data. [2025-09-16T19:22:36.601052] [DEBUG] [LOCAL ] MGA: Trimmed 55097 records to 37416 (keeping 150 days of data) [2025-09-16T19:22:36.834779] [DEBUG] [LOCAL ] MGA: Primary data saved (37416 records). [2025-09-16T19:22:36.834903] [INFO ] [MAIN ] MGA: Full history saved. [2025-09-16T19:22:36.835021] [INFO ] [MAIN ] Update Progress: 1345/2369 symbols completed. MGA took 28.7s. Estimated remaining: 1h 48m 32s. Rate: 9.4 symbols/min [2025-09-16T19:22:37.005026] [INFO ] [MAIN ] MGRD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:22:37.008195] [DEBUG] [LOCAL ] MGRD: Loaded 1640 existing records from primary storage. [2025-09-16T19:22:37.008264] [INFO ] [MAIN ] MGRD: Loaded 1640 existing records. [2025-09-16T19:22:37.112883] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-16T19:22:37.185497] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-03. [2025-09-16T19:22:37.190200] [WARN ] [MAIN ] MGRD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:22:37.191250] [INFO ] [MAIN ] MGRD: Wiping existing primary data before full refresh. [2025-09-16T19:22:37.191321] [INFO ] [LOCAL ] MGRD: Starting deletion of primary data. [2025-09-16T19:22:37.191522] [DEBUG] [LOCAL ] MGRD: Deleted primary data file. [2025-09-16T19:22:37.191567] [INFO ] [MAIN ] MGRD: Starting full primary refresh. [2025-09-16T19:22:37.555232] [INFO ] [REMOTE ] MGRD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:22:37.585596] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-16T19:22:37.612697] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-16T19:22:37.974878] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-02. [2025-09-16T19:22:38.422359] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-16T19:22:38.774913] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-03. [2025-09-16T19:22:39.203462] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-16T19:22:39.574892] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-04. [2025-09-16T19:22:40.374975] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-04. [2025-09-16T19:22:40.892015] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-16T19:22:41.174950] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-03. [2025-09-16T19:22:41.545951] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-16T19:22:41.656906] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-16T19:22:41.974911] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-05. [2025-09-16T19:22:42.422554] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-16T19:22:42.774940] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-04. [2025-09-16T19:22:43.372147] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-16T19:22:43.574952] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-04. [2025-09-16T19:22:44.277883] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-16T19:22:44.374966] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-05. [2025-09-16T19:22:44.973704] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-16T19:22:45.174968] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-05. [2025-09-16T19:22:45.754764] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-16T19:22:45.974910] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-06. [2025-09-16T19:22:46.658242] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-16T19:22:46.774901] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-05. [2025-09-16T19:22:47.574908] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-06. [2025-09-16T19:22:48.018292] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-16T19:22:48.374950] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-06. [2025-09-16T19:22:48.626972] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-16T19:22:48.773691] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-16T19:22:49.174970] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-07. [2025-09-16T19:22:49.737620] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-16T19:22:49.974953] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-07. [2025-09-16T19:22:50.442714] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-16T19:22:50.774937] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-08. [2025-09-16T19:22:51.212849] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-16T19:22:51.574934] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-09. [2025-09-16T19:22:52.028774] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-16T19:22:52.029556] [INFO ] [REMOTE ] MGRD: Full fetch complete (2516 records). [2025-09-16T19:22:52.029624] [DEBUG] [VALIDATOR ] MGRD: Validating primary data. [2025-09-16T19:22:52.377277] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-08. [2025-09-16T19:22:52.382623] [DEBUG] [VALIDATOR ] MGRD: All expected trading days are present. [2025-09-16T19:22:52.382729] [DEBUG] [VALIDATOR ] MGRD: Primary data validation passed. [2025-09-16T19:22:52.382861] [INFO ] [MAIN ] MGRD: Fetched primary data is valid. [2025-09-16T19:22:52.382900] [DEBUG] [LOCAL ] MGRD: Saving primary data. [2025-09-16T19:22:52.383274] [DEBUG] [LOCAL ] MGRD: Trimmed 2516 records to 1647 (keeping 150 days of data) [2025-09-16T19:22:52.394270] [DEBUG] [LOCAL ] MGRD: Primary data saved (1647 records). [2025-09-16T19:22:52.394361] [INFO ] [MAIN ] MGRD: Full history saved. [2025-09-16T19:22:52.394462] [INFO ] [MAIN ] Update Progress: 1346/2369 symbols completed. MGRD took 15.6s. Estimated remaining: 1h 48m 33s. Rate: 9.4 symbols/min [2025-09-16T19:22:52.577087] [INFO ] [MAIN ] MGRE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:22:52.584316] [DEBUG] [LOCAL ] MGRE: Loaded 4814 existing records from primary storage. [2025-09-16T19:22:52.584445] [INFO ] [MAIN ] MGRE: Loaded 4814 existing records. [2025-09-16T19:22:52.771182] [WARN ] [MAIN ] MGRE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:22:52.771445] [INFO ] [MAIN ] MGRE: Wiping existing primary data before full refresh. [2025-09-16T19:22:52.771492] [INFO ] [LOCAL ] MGRE: Starting deletion of primary data. [2025-09-16T19:22:52.771813] [DEBUG] [LOCAL ] MGRE: Deleted primary data file. [2025-09-16T19:22:52.771860] [INFO ] [MAIN ] MGRE: Starting full primary refresh. [2025-09-16T19:22:53.058925] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-16T19:22:53.135942] [INFO ] [REMOTE ] MGRE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:22:53.174862] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-09. [2025-09-16T19:22:53.714192] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-16T19:22:53.715154] [INFO ] [REMOTE ] MGRB: Full fetch complete (4542 records). [2025-09-16T19:22:53.715226] [DEBUG] [VALIDATOR ] MGRB: Validating primary data. [2025-09-16T19:22:53.980083] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-06. [2025-09-16T19:22:54.087736] [DEBUG] [VALIDATOR ] MGRB: All expected trading days are present. [2025-09-16T19:22:54.087820] [DEBUG] [VALIDATOR ] MGRB: Primary data validation passed. [2025-09-16T19:22:54.087960] [INFO ] [MAIN ] MGRB: Fetched primary data is valid. [2025-09-16T19:22:54.087999] [DEBUG] [LOCAL ] MGRB: Saving primary data. [2025-09-16T19:22:54.088362] [DEBUG] [LOCAL ] MGRB: Trimmed 4542 records to 3049 (keeping 150 days of data) [2025-09-16T19:22:54.106805] [DEBUG] [LOCAL ] MGRB: Primary data saved (3049 records). [2025-09-16T19:22:54.106872] [INFO ] [MAIN ] MGRB: Full history saved. [2025-09-16T19:22:54.106955] [INFO ] [MAIN ] Update Progress: 1347/2369 symbols completed. MGRB took 20.7s. Estimated remaining: 1h 48m 23s. Rate: 9.4 symbols/min [2025-09-16T19:22:54.279249] [INFO ] [MAIN ] MGY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:22:54.319608] [DEBUG] [LOCAL ] MGY: Loaded 38628 existing records from primary storage. [2025-09-16T19:22:54.319769] [INFO ] [MAIN ] MGY: Loaded 38628 existing records. [2025-09-16T19:22:54.498391] [WARN ] [MAIN ] MGY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:22:54.498630] [INFO ] [MAIN ] MGY: Wiping existing primary data before full refresh. [2025-09-16T19:22:54.498697] [INFO ] [LOCAL ] MGY: Starting deletion of primary data. [2025-09-16T19:22:54.499565] [DEBUG] [LOCAL ] MGY: Deleted primary data file. [2025-09-16T19:22:54.499612] [INFO ] [MAIN ] MGY: Starting full primary refresh. [2025-09-16T19:22:54.778981] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-02. [2025-09-16T19:22:54.858759] [INFO ] [REMOTE ] MGY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:22:55.571785] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-16T19:22:55.574834] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-03. [2025-09-16T19:22:56.124943] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-16T19:22:56.274524] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-16T19:22:56.374855] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-07. [2025-09-16T19:22:57.174911] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-07. [2025-09-16T19:22:57.895992] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-16T19:22:57.974934] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-02. [2025-09-16T19:22:58.352515] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-16T19:22:58.774904] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-04. [2025-09-16T19:22:59.264270] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-16T19:22:59.574898] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-08. [2025-09-16T19:23:00.374909] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-08. [2025-09-16T19:23:01.174980] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-03. [2025-09-16T19:23:02.263185] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-16T19:23:02.275053] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-09. [2025-09-16T19:23:02.795523] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-16T19:23:02.806519] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-04. [2025-09-16T19:23:03.810118] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-04 (5.04 seconds). [2025-09-16T19:23:03.812988] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-05. [2025-09-16T19:23:03.941301] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-08 (4.37 seconds). [2025-09-16T19:23:04.350389] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-16T19:23:04.359488] [INFO ] [REMOTE ] MGM: Full fetch complete (58282 records). [2025-09-16T19:23:04.359774] [DEBUG] [VALIDATOR ] MGM: Validating primary data. [2025-09-16T19:23:04.395742] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-09. [2025-09-16T19:23:04.499099] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-16T19:23:04.775080] [DEBUG] [VALIDATOR ] MGM: All expected trading days are present. [2025-09-16T19:23:04.775247] [DEBUG] [VALIDATOR ] MGM: Primary data validation passed. [2025-09-16T19:23:04.776197] [INFO ] [MAIN ] MGM: Fetched primary data is valid. [2025-09-16T19:23:04.776261] [DEBUG] [LOCAL ] MGM: Saving primary data. [2025-09-16T19:23:04.777744] [DEBUG] [LOCAL ] MGM: Trimmed 58282 records to 39964 (keeping 150 days of data) [2025-09-16T19:23:04.897307] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-16T19:23:05.054259] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-16T19:23:05.056239] [INFO ] [REMOTE ] MGR: Full fetch complete (6047 records). [2025-09-16T19:23:05.056818] [DEBUG] [VALIDATOR ] MGR: Validating primary data. [2025-09-16T19:23:05.176077] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-05. [2025-09-16T19:23:05.289036] [DEBUG] [LOCAL ] MGM: Primary data saved (39964 records). [2025-09-16T19:23:05.328757] [INFO ] [MAIN ] MGM: Full history saved. [2025-09-16T19:23:05.340138] [INFO ] [MAIN ] Update Progress: 1348/2369 symbols completed. MGM took 35.2s. Estimated remaining: 1h 48m 20s. Rate: 9.4 symbols/min [2025-09-16T19:23:05.567846] [DEBUG] [VALIDATOR ] MGR: All expected trading days are present. [2025-09-16T19:23:05.578173] [DEBUG] [VALIDATOR ] MGR: Primary data validation passed. [2025-09-16T19:23:05.598710] [INFO ] [MAIN ] MGR: Fetched primary data is valid. [2025-09-16T19:23:05.611998] [DEBUG] [LOCAL ] MGR: Saving primary data. [2025-09-16T19:23:05.630572] [INFO ] [MAIN ] MH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:23:05.631137] [DEBUG] [LOCAL ] MGR: Trimmed 6047 records to 4160 (keeping 150 days of data) [2025-09-16T19:23:05.631236] [DEBUG] [LOCAL ] MH: No existing data file found in primary storage. [2025-09-16T19:23:05.631598] [WARN ] [MAIN ] MH: No existing data found, performing full refresh instead. [2025-09-16T19:23:05.632002] [INFO ] [MAIN ] MH: Wiping existing primary data before full refresh. [2025-09-16T19:23:05.632074] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-09-16T19:23:05.632131] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-09-16T19:23:05.644678] [INFO ] [MAIN ] MH: Starting full primary refresh. [2025-09-16T19:23:05.769612] [DEBUG] [LOCAL ] MGR: Primary data saved (4160 records). [2025-09-16T19:23:05.785330] [INFO ] [MAIN ] MGR: Full history saved. [2025-09-16T19:23:05.785475] [INFO ] [MAIN ] Update Progress: 1349/2369 symbols completed. MGR took 33.6s. Estimated remaining: 1h 48m 10s. Rate: 9.4 symbols/min [2025-09-16T19:23:05.981172] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-06. [2025-09-16T19:23:06.148371] [INFO ] [MAIN ] MHD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:23:06.204027] [INFO ] [REMOTE ] MH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:23:06.214394] [DEBUG] [LOCAL ] MHD: Loaded 8707 existing records from primary storage. [2025-09-16T19:23:06.214545] [INFO ] [MAIN ] MHD: Loaded 8707 existing records. [2025-09-16T19:23:06.393307] [WARN ] [MAIN ] MHD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:23:06.393571] [INFO ] [MAIN ] MHD: Wiping existing primary data before full refresh. [2025-09-16T19:23:06.393618] [INFO ] [LOCAL ] MHD: Starting deletion of primary data. [2025-09-16T19:23:06.393991] [DEBUG] [LOCAL ] MHD: Deleted primary data file. [2025-09-16T19:23:06.394062] [INFO ] [MAIN ] MHD: Starting full primary refresh. [2025-09-16T19:23:06.766675] [INFO ] [REMOTE ] MHD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:23:06.774852] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-02. [2025-09-16T19:23:06.907685] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-16T19:23:06.932502] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-16T19:23:07.297381] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-16T19:23:07.574918] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-03. [2025-09-16T19:23:08.372300] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-16T19:23:08.375139] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-02. [2025-09-16T19:23:08.577257] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:23:08.577632] [WARN ] [REMOTE ] MH: No data returned for month 2025-02 [2025-09-16T19:23:09.174885] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-07. [2025-09-16T19:23:09.877325] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-16T19:23:09.974985] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-08. [2025-09-16T19:23:10.676417] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-16T19:23:10.774907] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-04. [2025-09-16T19:23:11.574926] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-03. [2025-09-16T19:23:11.727403] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-16T19:23:11.786104] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:23:11.786445] [WARN ] [REMOTE ] MH: No data returned for month 2025-03 [2025-09-16T19:23:12.374902] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-04. [2025-09-16T19:23:12.572574] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:23:12.572933] [WARN ] [REMOTE ] MH: No data returned for month 2025-04 [2025-09-16T19:23:13.174914] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-09. [2025-09-16T19:23:13.966351] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-16T19:23:13.967791] [INFO ] [REMOTE ] MGRE: Full fetch complete (7158 records). [2025-09-16T19:23:13.967872] [DEBUG] [VALIDATOR ] MGRE: Validating primary data. [2025-09-16T19:23:13.979971] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-05. [2025-09-16T19:23:14.234922] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:23:14.261459] [WARN ] [REMOTE ] MH: No data returned for month 2025-05 [2025-09-16T19:23:14.344280] [DEBUG] [VALIDATOR ] MGRE: All expected trading days are present. [2025-09-16T19:23:14.344365] [DEBUG] [VALIDATOR ] MGRE: Primary data validation passed. [2025-09-16T19:23:14.344572] [INFO ] [MAIN ] MGRE: Fetched primary data is valid. [2025-09-16T19:23:14.344615] [DEBUG] [LOCAL ] MGRE: Saving primary data. [2025-09-16T19:23:14.345043] [DEBUG] [LOCAL ] MGRE: Trimmed 7158 records to 4916 (keeping 150 days of data) [2025-09-16T19:23:14.373933] [DEBUG] [LOCAL ] MGRE: Primary data saved (4916 records). [2025-09-16T19:23:14.374010] [INFO ] [MAIN ] MGRE: Full history saved. [2025-09-16T19:23:14.374106] [INFO ] [MAIN ] Update Progress: 1350/2369 symbols completed. MGRE took 22.0s. Estimated remaining: 1h 48m 5s. Rate: 9.4 symbols/min [2025-09-16T19:23:14.551769] [INFO ] [MAIN ] MHF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:23:14.559812] [DEBUG] [LOCAL ] MHF: Loaded 6816 existing records from primary storage. [2025-09-16T19:23:14.559916] [INFO ] [MAIN ] MHF: Loaded 6816 existing records. [2025-09-16T19:23:14.749932] [WARN ] [MAIN ] MHF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:23:14.750183] [INFO ] [MAIN ] MHF: Wiping existing primary data before full refresh. [2025-09-16T19:23:14.750231] [INFO ] [LOCAL ] MHF: Starting deletion of primary data. [2025-09-16T19:23:14.750556] [DEBUG] [LOCAL ] MHF: Deleted primary data file. [2025-09-16T19:23:14.750602] [INFO ] [MAIN ] MHF: Starting full primary refresh. [2025-09-16T19:23:14.780066] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-05. [2025-09-16T19:23:15.109266] [INFO ] [REMOTE ] MHF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:23:15.574902] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-06. [2025-09-16T19:23:15.660084] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-16T19:23:15.768553] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:23:15.768883] [WARN ] [REMOTE ] MH: No data returned for month 2025-06 [2025-09-16T19:23:16.374916] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-06. [2025-09-16T19:23:17.174914] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-06. [2025-09-16T19:23:17.974881] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-07. [2025-09-16T19:23:18.046387] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-16T19:23:18.057586] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-16T19:23:18.572405] [INFO ] [REMOTE ] MH: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-16T19:23:18.774911] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-07. [2025-09-16T19:23:19.359145] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-16T19:23:19.574886] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-07. [2025-09-16T19:23:20.374978] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-02. [2025-09-16T19:23:21.149922] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-16T19:23:21.174881] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-03. [2025-09-16T19:23:21.331104] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-16T19:23:21.888150] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-16T19:23:21.974862] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-08. [2025-09-16T19:23:22.774896] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-08. [2025-09-16T19:23:23.480122] [INFO ] [REMOTE ] MH: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-16T19:23:23.574873] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-08. [2025-09-16T19:23:24.376998] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-09. [2025-09-16T19:23:24.383316] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-16T19:23:24.403797] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-16T19:23:25.174910] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-04. [2025-09-16T19:23:25.432121] [INFO ] [REMOTE ] MH: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-16T19:23:25.436772] [INFO ] [REMOTE ] MH: Full fetch complete (10717 records). [2025-09-16T19:23:25.436892] [DEBUG] [VALIDATOR ] MH: Validating primary data. [2025-09-16T19:23:25.617197] [WARN ] [VALIDATOR ] MH: Validation failed - insufficient historical data. Have 38 unique days, need 150 days [2025-09-16T19:23:25.617438] [FATAL] [MAIN ] MH: Fetched primary data is invalid. Refusing to save it. [2025-09-16T19:23:25.617486] [WARN ] [MAIN ] MH: Deleting existing primary and derivative data due to validation failure. [2025-09-16T19:23:25.617531] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-09-16T19:23:25.617587] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-09-16T19:23:25.617622] [INFO ] [LOCAL ] MH: Starting deletion of derivative data. [2025-09-16T19:23:25.617704] [DEBUG] [LOCAL ] MH: No derivative data file found to delete. [2025-09-16T19:23:25.617766] [INFO ] [MAIN ] Update Progress: 1351/2369 symbols completed. MH took 20.3s. Estimated remaining: 1h 48m 2s. Rate: 9.4 symbols/min [2025-09-16T19:23:25.787681] [INFO ] [MAIN ] MHK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:23:25.818379] [DEBUG] [LOCAL ] MHK: Loaded 31379 existing records from primary storage. [2025-09-16T19:23:25.818518] [INFO ] [MAIN ] MHK: Loaded 31379 existing records. [2025-09-16T19:23:25.964181] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-16T19:23:25.995799] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-09. [2025-09-16T19:23:26.002014] [WARN ] [MAIN ] MHK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:23:26.002854] [INFO ] [MAIN ] MHK: Wiping existing primary data before full refresh. [2025-09-16T19:23:26.003041] [INFO ] [LOCAL ] MHK: Starting deletion of primary data. [2025-09-16T19:23:26.004279] [DEBUG] [LOCAL ] MHK: Deleted primary data file. [2025-09-16T19:23:26.004330] [INFO ] [MAIN ] MHK: Starting full primary refresh. [2025-09-16T19:23:26.359598] [INFO ] [REMOTE ] MHK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:23:26.774874] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-05. [2025-09-16T19:23:26.967354] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-16T19:23:26.969603] [INFO ] [REMOTE ] MHD: Full fetch complete (13289 records). [2025-09-16T19:23:26.969693] [DEBUG] [VALIDATOR ] MHD: Validating primary data. [2025-09-16T19:23:27.251542] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-16T19:23:27.338248] [DEBUG] [VALIDATOR ] MHD: All expected trading days are present. [2025-09-16T19:23:27.338385] [DEBUG] [VALIDATOR ] MHD: Primary data validation passed. [2025-09-16T19:23:27.338700] [INFO ] [MAIN ] MHD: Fetched primary data is valid. [2025-09-16T19:23:27.338742] [DEBUG] [LOCAL ] MHD: Saving primary data. [2025-09-16T19:23:27.339244] [DEBUG] [LOCAL ] MHD: Trimmed 13289 records to 8795 (keeping 150 days of data) [2025-09-16T19:23:27.393606] [DEBUG] [LOCAL ] MHD: Primary data saved (8795 records). [2025-09-16T19:23:27.393752] [INFO ] [MAIN ] MHD: Full history saved. [2025-09-16T19:23:27.393838] [INFO ] [MAIN ] Update Progress: 1352/2369 symbols completed. MHD took 21.6s. Estimated remaining: 1h 47m 52s. Rate: 9.4 symbols/min [2025-09-16T19:23:27.560904] [INFO ] [MAIN ] MHLA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:23:27.561100] [DEBUG] [LOCAL ] MHLA: No existing data file found in primary storage. [2025-09-16T19:23:27.561136] [WARN ] [MAIN ] MHLA: No existing data found, performing full refresh instead. [2025-09-16T19:23:27.561290] [INFO ] [MAIN ] MHLA: Wiping existing primary data before full refresh. [2025-09-16T19:23:27.561329] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-09-16T19:23:27.561368] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-09-16T19:23:27.561400] [INFO ] [MAIN ] MHLA: Starting full primary refresh. [2025-09-16T19:23:27.581484] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-02. [2025-09-16T19:23:27.910926] [INFO ] [REMOTE ] MHLA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:23:28.374904] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-09. [2025-09-16T19:23:29.174876] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-02. [2025-09-16T19:23:29.245752] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-16T19:23:29.497913] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-16T19:23:29.974889] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-03. [2025-09-16T19:23:30.054102] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-16T19:23:30.060452] [INFO ] [REMOTE ] MGY: Full fetch complete (57000 records). [2025-09-16T19:23:30.060565] [DEBUG] [VALIDATOR ] MGY: Validating primary data. [2025-09-16T19:23:30.245107] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-09-16T19:23:30.465078] [DEBUG] [VALIDATOR ] MGY: All expected trading days are present. [2025-09-16T19:23:30.465169] [DEBUG] [VALIDATOR ] MGY: Primary data validation passed. [2025-09-16T19:23:30.466101] [INFO ] [MAIN ] MGY: Fetched primary data is valid. [2025-09-16T19:23:30.466149] [DEBUG] [LOCAL ] MGY: Saving primary data. [2025-09-16T19:23:30.467462] [DEBUG] [LOCAL ] MGY: Trimmed 57000 records to 39012 (keeping 150 days of data) [2025-09-16T19:23:30.704426] [DEBUG] [LOCAL ] MGY: Primary data saved (39012 records). [2025-09-16T19:23:30.704571] [INFO ] [MAIN ] MGY: Full history saved. [2025-09-16T19:23:30.705573] [INFO ] [MAIN ] Update Progress: 1353/2369 symbols completed. MGY took 36.6s. Estimated remaining: 1h 47m 44s. Rate: 9.4 symbols/min [2025-09-16T19:23:30.780040] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-03. [2025-09-16T19:23:30.885635] [INFO ] [MAIN ] MHN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:23:30.894504] [DEBUG] [LOCAL ] MHN: Loaded 5513 existing records from primary storage. [2025-09-16T19:23:30.894629] [INFO ] [MAIN ] MHN: Loaded 5513 existing records. [2025-09-16T19:23:31.077706] [WARN ] [MAIN ] MHN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:23:31.077945] [INFO ] [MAIN ] MHN: Wiping existing primary data before full refresh. [2025-09-16T19:23:31.077995] [INFO ] [LOCAL ] MHN: Starting deletion of primary data. [2025-09-16T19:23:31.078264] [DEBUG] [LOCAL ] MHN: Deleted primary data file. [2025-09-16T19:23:31.078313] [INFO ] [MAIN ] MHN: Starting full primary refresh. [2025-09-16T19:23:31.442171] [INFO ] [REMOTE ] MHN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:23:31.574898] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-06. [2025-09-16T19:23:32.221427] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-16T19:23:32.357784] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-16T19:23:32.374843] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-04. [2025-09-16T19:23:33.174896] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-04. [2025-09-16T19:23:33.602566] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-16T19:23:33.979958] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-05. [2025-09-16T19:23:33.996872] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-16T19:23:34.509683] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-16T19:23:34.774892] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-02. [2025-09-16T19:23:35.572572] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-16T19:23:35.574991] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-03. [2025-09-16T19:23:36.306468] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-16T19:23:36.374868] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-04. [2025-09-16T19:23:37.174932] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-05. [2025-09-16T19:23:37.209495] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-16T19:23:37.974917] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-06. [2025-09-16T19:23:38.307953] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-16T19:23:38.765036] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-16T19:23:38.774839] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-06. [2025-09-16T19:23:39.574894] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-05. [2025-09-16T19:23:40.125891] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-16T19:23:40.277593] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-16T19:23:40.374938] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-06. [2025-09-16T19:23:40.859625] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-16T19:23:41.174919] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-07. [2025-09-16T19:23:41.923204] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-16T19:23:41.974890] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-08. [2025-09-16T19:23:42.763058] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-16T19:23:42.774848] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-09. [2025-09-16T19:23:43.500040] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-16T19:23:43.501629] [INFO ] [REMOTE ] MHN: Full fetch complete (8344 records). [2025-09-16T19:23:43.501713] [DEBUG] [VALIDATOR ] MHN: Validating primary data. [2025-09-16T19:23:43.580093] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-07. [2025-09-16T19:23:43.863470] [DEBUG] [VALIDATOR ] MHN: All expected trading days are present. [2025-09-16T19:23:43.863546] [DEBUG] [VALIDATOR ] MHN: Primary data validation passed. [2025-09-16T19:23:43.863791] [INFO ] [MAIN ] MHN: Fetched primary data is valid. [2025-09-16T19:23:43.863836] [DEBUG] [LOCAL ] MHN: Saving primary data. [2025-09-16T19:23:43.864263] [DEBUG] [LOCAL ] MHN: Trimmed 8344 records to 5615 (keeping 150 days of data) [2025-09-16T19:23:43.898156] [DEBUG] [LOCAL ] MHN: Primary data saved (5615 records). [2025-09-16T19:23:43.898245] [INFO ] [MAIN ] MHN: Full history saved. [2025-09-16T19:23:43.898319] [INFO ] [MAIN ] Update Progress: 1354/2369 symbols completed. MHN took 13.2s. Estimated remaining: 1h 47m 42s. Rate: 9.4 symbols/min [2025-09-16T19:23:44.067505] [INFO ] [MAIN ] MHO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:23:44.085724] [DEBUG] [LOCAL ] MHO: Loaded 17637 existing records from primary storage. [2025-09-16T19:23:44.085844] [INFO ] [MAIN ] MHO: Loaded 17637 existing records. [2025-09-16T19:23:44.262988] [WARN ] [MAIN ] MHO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:23:44.263238] [INFO ] [MAIN ] MHO: Wiping existing primary data before full refresh. [2025-09-16T19:23:44.263284] [INFO ] [LOCAL ] MHO: Starting deletion of primary data. [2025-09-16T19:23:44.263844] [DEBUG] [LOCAL ] MHO: Deleted primary data file. [2025-09-16T19:23:44.263892] [INFO ] [MAIN ] MHO: Starting full primary refresh. [2025-09-16T19:23:44.380162] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-07. [2025-09-16T19:23:44.617005] [INFO ] [REMOTE ] MHO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:23:44.659465] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-09-16T19:23:45.174898] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-08. [2025-09-16T19:23:45.304936] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-16T19:23:45.506612] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-16T19:23:45.974950] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-09. [2025-09-16T19:23:46.310240] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-16T19:23:46.310921] [INFO ] [REMOTE ] MHLA: Full fetch complete (1157 records). [2025-09-16T19:23:46.310986] [DEBUG] [VALIDATOR ] MHLA: Validating primary data. [2025-09-16T19:23:46.489714] [WARN ] [VALIDATOR ] MHLA: Validation failed - insufficient historical data. Have 133 unique days, need 150 days [2025-09-16T19:23:46.489893] [FATAL] [MAIN ] MHLA: Fetched primary data is invalid. Refusing to save it. [2025-09-16T19:23:46.489964] [WARN ] [MAIN ] MHLA: Deleting existing primary and derivative data due to validation failure. [2025-09-16T19:23:46.490034] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-09-16T19:23:46.490100] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-09-16T19:23:46.490137] [INFO ] [LOCAL ] MHLA: Starting deletion of derivative data. [2025-09-16T19:23:46.490177] [DEBUG] [LOCAL ] MHLA: No derivative data file found to delete. [2025-09-16T19:23:46.490248] [INFO ] [MAIN ] Update Progress: 1355/2369 symbols completed. MHLA took 19.1s. Estimated remaining: 1h 47m 33s. Rate: 9.4 symbols/min [2025-09-16T19:23:46.661555] [INFO ] [MAIN ] MIAX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:23:46.661741] [DEBUG] [LOCAL ] MIAX: No existing data file found in primary storage. [2025-09-16T19:23:46.661781] [WARN ] [MAIN ] MIAX: No existing data found, performing full refresh instead. [2025-09-16T19:23:46.661950] [INFO ] [MAIN ] MIAX: Wiping existing primary data before full refresh. [2025-09-16T19:23:46.662015] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-09-16T19:23:46.662062] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-09-16T19:23:46.662096] [INFO ] [MAIN ] MIAX: Starting full primary refresh. [2025-09-16T19:23:46.780039] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-02. [2025-09-16T19:23:47.025406] [INFO ] [REMOTE ] MIAX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:23:47.574897] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-02. [2025-09-16T19:23:47.761295] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:23:47.761571] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-02 [2025-09-16T19:23:48.085923] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-16T19:23:48.374914] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-03. [2025-09-16T19:23:49.174896] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-08. [2025-09-16T19:23:49.278897] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-16T19:23:49.974938] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-03. [2025-09-16T19:23:50.164308] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:23:50.164620] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-03 [2025-09-16T19:23:50.650678] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-16T19:23:50.774917] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-09. [2025-09-16T19:23:51.574941] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-07. [2025-09-16T19:23:52.216444] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-16T19:23:52.221569] [INFO ] [REMOTE ] MHK: Full fetch complete (46077 records). [2025-09-16T19:23:52.221710] [DEBUG] [VALIDATOR ] MHK: Validating primary data. [2025-09-16T19:23:52.376409] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-04. [2025-09-16T19:23:52.526031] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-16T19:23:52.619347] [DEBUG] [VALIDATOR ] MHK: All expected trading days are present. [2025-09-16T19:23:52.619452] [DEBUG] [VALIDATOR ] MHK: Primary data validation passed. [2025-09-16T19:23:52.620310] [INFO ] [MAIN ] MHK: Fetched primary data is valid. [2025-09-16T19:23:52.620389] [DEBUG] [LOCAL ] MHK: Saving primary data. [2025-09-16T19:23:52.621609] [DEBUG] [LOCAL ] MHK: Trimmed 46077 records to 31599 (keeping 150 days of data) [2025-09-16T19:23:52.676974] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:23:52.713041] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-04 [2025-09-16T19:23:52.818208] [DEBUG] [LOCAL ] MHK: Primary data saved (31599 records). [2025-09-16T19:23:52.818382] [INFO ] [MAIN ] MHK: Full history saved. [2025-09-16T19:23:52.818481] [INFO ] [MAIN ] Update Progress: 1356/2369 symbols completed. MHK took 27.2s. Estimated remaining: 1h 47m 27s. Rate: 9.4 symbols/min [2025-09-16T19:23:52.985252] [INFO ] [MAIN ] MIN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:23:52.995624] [DEBUG] [LOCAL ] MIN: Loaded 10623 existing records from primary storage. [2025-09-16T19:23:52.995769] [INFO ] [MAIN ] MIN: Loaded 10623 existing records. [2025-09-16T19:23:53.167670] [WARN ] [MAIN ] MIN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:23:53.167870] [INFO ] [MAIN ] MIN: Wiping existing primary data before full refresh. [2025-09-16T19:23:53.167914] [INFO ] [LOCAL ] MIN: Starting deletion of primary data. [2025-09-16T19:23:53.168293] [DEBUG] [LOCAL ] MIN: Deleted primary data file. [2025-09-16T19:23:53.168338] [INFO ] [MAIN ] MIN: Starting full primary refresh. [2025-09-16T19:23:53.180216] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-04. [2025-09-16T19:23:53.548910] [INFO ] [REMOTE ] MIN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:23:53.974958] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-08. [2025-09-16T19:23:54.395323] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-16T19:23:54.762686] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-16T19:23:54.774850] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-09. [2025-09-16T19:23:55.572932] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-16T19:23:55.574716] [INFO ] [REMOTE ] MHF: Full fetch complete (9397 records). [2025-09-16T19:23:55.574785] [DEBUG] [VALIDATOR ] MHF: Validating primary data. [2025-09-16T19:23:55.574893] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-05. [2025-09-16T19:23:55.860310] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:23:55.863011] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-05 [2025-09-16T19:23:55.943269] [DEBUG] [VALIDATOR ] MHF: All expected trading days are present. [2025-09-16T19:23:55.943364] [DEBUG] [VALIDATOR ] MHF: Primary data validation passed. [2025-09-16T19:23:55.943690] [INFO ] [MAIN ] MHF: Fetched primary data is valid. [2025-09-16T19:23:55.943736] [DEBUG] [LOCAL ] MHF: Saving primary data. [2025-09-16T19:23:55.944323] [DEBUG] [LOCAL ] MHF: Trimmed 9397 records to 6905 (keeping 150 days of data) [2025-09-16T19:23:55.987779] [DEBUG] [LOCAL ] MHF: Primary data saved (6905 records). [2025-09-16T19:23:55.987945] [INFO ] [MAIN ] MHF: Full history saved. [2025-09-16T19:23:55.988053] [INFO ] [MAIN ] Update Progress: 1357/2369 symbols completed. MHF took 41.6s. Estimated remaining: 1h 47m 18s. Rate: 9.4 symbols/min [2025-09-16T19:23:56.374906] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-05. [2025-09-16T19:23:57.174928] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-02. [2025-09-16T19:23:57.245215] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-16T19:23:57.937673] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-16T19:23:57.974867] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-06. [2025-09-16T19:23:58.158284] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:23:58.158628] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-06 [2025-09-16T19:23:58.774959] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-03. [2025-09-16T19:23:59.528283] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-16T19:23:59.574872] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-04. [2025-09-16T19:24:00.374947] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-07. [2025-09-16T19:24:00.403750] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-16T19:24:00.569561] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:24:00.569911] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-07 [2025-09-16T19:24:01.174906] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-08. [2025-09-16T19:24:01.974886] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-06. [2025-09-16T19:24:02.379202] [INFO ] [REMOTE ] MIAX: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-16T19:24:02.774932] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-05. [2025-09-16T19:24:03.076833] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-16T19:24:03.411774] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-16T19:24:03.574899] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-06. [2025-09-16T19:24:04.374955] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-09. [2025-09-16T19:24:04.467955] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-16T19:24:05.174922] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-07. [2025-09-16T19:24:05.653815] [INFO ] [REMOTE ] MIAX: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-16T19:24:05.658341] [INFO ] [REMOTE ] MIAX: Full fetch complete (7082 records). [2025-09-16T19:24:05.658430] [DEBUG] [VALIDATOR ] MIAX: Validating primary data. [2025-09-16T19:24:05.838196] [WARN ] [VALIDATOR ] MIAX: Validation failed - insufficient historical data. Have 23 unique days, need 150 days [2025-09-16T19:24:05.838423] [FATAL] [MAIN ] MIAX: Fetched primary data is invalid. Refusing to save it. [2025-09-16T19:24:05.838492] [WARN ] [MAIN ] MIAX: Deleting existing primary and derivative data due to validation failure. [2025-09-16T19:24:05.838545] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-09-16T19:24:05.838622] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-09-16T19:24:05.838705] [INFO ] [LOCAL ] MIAX: Starting deletion of derivative data. [2025-09-16T19:24:05.838767] [DEBUG] [LOCAL ] MIAX: No derivative data file found to delete. [2025-09-16T19:24:05.838861] [INFO ] [MAIN ] Update Progress: 1358/2369 symbols completed. MIAX took 19.3s. Estimated remaining: 1h 47m 14s. Rate: 9.4 symbols/min [2025-09-16T19:24:05.898483] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-16T19:24:05.974916] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-07. [2025-09-16T19:24:06.774931] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-08. [2025-09-16T19:24:07.299215] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-16T19:24:07.401835] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-16T19:24:07.574911] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-09. [2025-09-16T19:24:08.374929] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-08. [2025-09-16T19:24:08.503169] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-16T19:24:08.505030] [INFO ] [REMOTE ] MIN: Full fetch complete (13926 records). [2025-09-16T19:24:08.505101] [DEBUG] [VALIDATOR ] MIN: Validating primary data. [2025-09-16T19:24:08.865096] [DEBUG] [VALIDATOR ] MIN: All expected trading days are present. [2025-09-16T19:24:08.865171] [DEBUG] [VALIDATOR ] MIN: Primary data validation passed. [2025-09-16T19:24:08.865490] [INFO ] [MAIN ] MIN: Fetched primary data is valid. [2025-09-16T19:24:08.865537] [DEBUG] [LOCAL ] MIN: Saving primary data. [2025-09-16T19:24:08.866035] [DEBUG] [LOCAL ] MIN: Trimmed 13926 records to 10688 (keeping 150 days of data) [2025-09-16T19:24:08.928512] [DEBUG] [LOCAL ] MIN: Primary data saved (10688 records). [2025-09-16T19:24:08.928662] [INFO ] [MAIN ] MIN: Full history saved. [2025-09-16T19:24:08.928751] [INFO ] [MAIN ] Update Progress: 1359/2369 symbols completed. MIN took 16.1s. Estimated remaining: 1h 47m 6s. Rate: 9.4 symbols/min [2025-09-16T19:24:09.500753] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-16T19:24:09.506701] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-09. [2025-09-16T19:24:10.601461] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-16T19:24:10.604588] [INFO ] [REMOTE ] MHO: Full fetch complete (26988 records). [2025-09-16T19:24:10.604706] [DEBUG] [VALIDATOR ] MHO: Validating primary data. [2025-09-16T19:24:10.971370] [DEBUG] [VALIDATOR ] MHO: All expected trading days are present. [2025-09-16T19:24:10.971459] [DEBUG] [VALIDATOR ] MHO: Primary data validation passed. [2025-09-16T19:24:10.972037] [INFO ] [MAIN ] MHO: Fetched primary data is valid. [2025-09-16T19:24:10.972080] [DEBUG] [LOCAL ] MHO: Saving primary data. [2025-09-16T19:24:10.972793] [DEBUG] [LOCAL ] MHO: Trimmed 26988 records to 17852 (keeping 150 days of data) [2025-09-16T19:24:11.081220] [DEBUG] [LOCAL ] MHO: Primary data saved (17852 records). [2025-09-16T19:24:11.081371] [INFO ] [MAIN ] MHO: Full history saved. [2025-09-16T19:24:11.081465] [INFO ] [MAIN ] Update Progress: 1360/2369 symbols completed. MHO took 27.2s. Estimated remaining: 1h 46m 56s. Rate: 9.4 symbols/min [2025-09-16T19:24:11.669253] [INFO ] [MAIN ] MITP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:24:11.737826] [INFO ] [MAIN ] MITT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:24:11.773339] [INFO ] [MAIN ] MIR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:24:11.830882] [INFO ] [MAIN ] MITN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:24:11.831394] [DEBUG] [LOCAL ] MITN: No existing data file found in primary storage. [2025-09-16T19:24:11.831285] [DEBUG] [LOCAL ] MITP: Loaded 1616 existing records from primary storage. [2025-09-16T19:24:11.831537] [WARN ] [MAIN ] MITN: No existing data found, performing full refresh instead. [2025-09-16T19:24:11.831850] [INFO ] [MAIN ] MITN: Wiping existing primary data before full refresh. [2025-09-16T19:24:11.831899] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-09-16T19:24:11.831961] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-09-16T19:24:11.831999] [INFO ] [MAIN ] MITN: Starting full primary refresh. [2025-09-16T19:24:11.831669] [INFO ] [MAIN ] MITP: Loaded 1616 existing records. [2025-09-16T19:24:12.110819] [DEBUG] [LOCAL ] MITT: Loaded 15605 existing records from primary storage. [2025-09-16T19:24:12.158019] [DEBUG] [LOCAL ] MIR: Loaded 37755 existing records from primary storage. [2025-09-16T19:24:12.229285] [INFO ] [MAIN ] MITT: Loaded 15605 existing records. [2025-09-16T19:24:12.249351] [WARN ] [MAIN ] MITP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:24:12.249487] [INFO ] [MAIN ] MIR: Loaded 37755 existing records. [2025-09-16T19:24:12.328504] [INFO ] [MAIN ] MITP: Wiping existing primary data before full refresh. [2025-09-16T19:24:12.343573] [INFO ] [LOCAL ] MITP: Starting deletion of primary data. [2025-09-16T19:24:12.424730] [DEBUG] [LOCAL ] MITP: Deleted primary data file. [2025-09-16T19:24:12.492221] [INFO ] [MAIN ] MITP: Starting full primary refresh. [2025-09-16T19:24:12.740920] [WARN ] [MAIN ] MITT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:24:12.873318] [INFO ] [REMOTE ] MITN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:24:12.904111] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-02. [2025-09-16T19:24:12.898005] [INFO ] [MAIN ] MITT: Wiping existing primary data before full refresh. [2025-09-16T19:24:12.940049] [INFO ] [LOCAL ] MITT: Starting deletion of primary data. [2025-09-16T19:24:12.958699] [DEBUG] [LOCAL ] MITT: Deleted primary data file. [2025-09-16T19:24:12.962274] [WARN ] [MAIN ] MIR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:24:12.986950] [INFO ] [MAIN ] MITT: Starting full primary refresh. [2025-09-16T19:24:12.990340] [INFO ] [MAIN ] MIR: Wiping existing primary data before full refresh. [2025-09-16T19:24:13.001550] [INFO ] [LOCAL ] MIR: Starting deletion of primary data. [2025-09-16T19:24:13.026588] [DEBUG] [LOCAL ] MIR: Deleted primary data file. [2025-09-16T19:24:13.038811] [INFO ] [MAIN ] MIR: Starting full primary refresh. [2025-09-16T19:24:13.410848] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-16T19:24:13.455610] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-03. [2025-09-16T19:24:13.818365] [INFO ] [REMOTE ] MITP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:24:13.862079] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-02. [2025-09-16T19:24:13.943478] [INFO ] [REMOTE ] MITT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:24:13.988311] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-02. [2025-09-16T19:24:14.011995] [INFO ] [REMOTE ] MIR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:24:14.012519] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-02. [2025-09-16T19:24:14.117620] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-16T19:24:14.119328] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-04. [2025-09-16T19:24:14.370866] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-16T19:24:14.670765] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-16T19:24:14.774919] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-03. [2025-09-16T19:24:15.158539] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-16T19:24:15.175093] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-16T19:24:15.558239] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-16T19:24:15.574847] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-03. [2025-09-16T19:24:16.374924] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-05. [2025-09-16T19:24:16.788794] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-16T19:24:17.066300] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-16T19:24:17.174875] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-06. [2025-09-16T19:24:17.508762] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-16T19:24:17.974967] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-04. [2025-09-16T19:24:18.774923] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-03. [2025-09-16T19:24:18.909112] [DEBUG] [REMOTE ] MITT: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-09-16T19:24:18.909484] [WARN ] [REMOTE ] MITT: No data returned for month 2025-03 [2025-09-16T19:24:19.574911] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-04. [2025-09-16T19:24:19.688578] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-16T19:24:19.930907] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-16T19:24:20.374947] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-04. [2025-09-16T19:24:21.174913] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-07. [2025-09-16T19:24:21.499833] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-16T19:24:21.781862] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-16T19:24:21.974912] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-05. [2025-09-16T19:24:22.774914] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-08. [2025-09-16T19:24:22.964487] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-16T19:24:23.123387] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-16T19:24:23.574913] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-09. [2025-09-16T19:24:23.924604] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-16T19:24:23.925476] [INFO ] [REMOTE ] MITN: Full fetch complete (1933 records). [2025-09-16T19:24:23.925557] [DEBUG] [VALIDATOR ] MITN: Validating primary data. [2025-09-16T19:24:24.115054] [WARN ] [VALIDATOR ] MITN: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-16T19:24:24.115240] [FATAL] [MAIN ] MITN: Fetched primary data is invalid. Refusing to save it. [2025-09-16T19:24:24.115288] [WARN ] [MAIN ] MITN: Deleting existing primary and derivative data due to validation failure. [2025-09-16T19:24:24.115333] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-09-16T19:24:24.115391] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-09-16T19:24:24.115446] [INFO ] [LOCAL ] MITN: Starting deletion of derivative data. [2025-09-16T19:24:24.115489] [DEBUG] [LOCAL ] MITN: No derivative data file found to delete. [2025-09-16T19:24:24.115548] [INFO ] [MAIN ] Update Progress: 1361/2369 symbols completed. MITN took 13.0s. Estimated remaining: 1h 46m 55s. Rate: 9.4 symbols/min [2025-09-16T19:24:24.303383] [INFO ] [MAIN ] MIY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:24:24.310087] [DEBUG] [LOCAL ] MIY: Loaded 4318 existing records from primary storage. [2025-09-16T19:24:24.310213] [INFO ] [MAIN ] MIY: Loaded 4318 existing records. [2025-09-16T19:24:24.379987] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-05. [2025-09-16T19:24:24.494381] [WARN ] [MAIN ] MIY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:24:24.494634] [INFO ] [MAIN ] MIY: Wiping existing primary data before full refresh. [2025-09-16T19:24:24.494699] [INFO ] [LOCAL ] MIY: Starting deletion of primary data. [2025-09-16T19:24:24.494930] [DEBUG] [LOCAL ] MIY: Deleted primary data file. [2025-09-16T19:24:24.494975] [INFO ] [MAIN ] MIY: Starting full primary refresh. [2025-09-16T19:24:24.843430] [INFO ] [REMOTE ] MIY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:24:25.025330] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-16T19:24:25.174928] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-06. [2025-09-16T19:24:25.668165] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-16T19:24:25.974908] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-02. [2025-09-16T19:24:26.545987] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-16T19:24:26.774907] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-03. [2025-09-16T19:24:27.270170] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-16T19:24:27.574921] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-06. [2025-09-16T19:24:28.374893] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-04. [2025-09-16T19:24:28.677768] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-16T19:24:29.055751] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-16T19:24:29.174911] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-07. [2025-09-16T19:24:29.594703] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-16T19:24:29.974906] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-08. [2025-09-16T19:24:30.332824] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-16T19:24:30.774915] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-09. [2025-09-16T19:24:31.105174] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-16T19:24:31.105931] [INFO ] [REMOTE ] MITP: Full fetch complete (2544 records). [2025-09-16T19:24:31.105999] [DEBUG] [VALIDATOR ] MITP: Validating primary data. [2025-09-16T19:24:31.462339] [DEBUG] [VALIDATOR ] MITP: All expected trading days are present. [2025-09-16T19:24:31.462416] [DEBUG] [VALIDATOR ] MITP: Primary data validation passed. [2025-09-16T19:24:31.462519] [INFO ] [MAIN ] MITP: Fetched primary data is valid. [2025-09-16T19:24:31.462557] [DEBUG] [LOCAL ] MITP: Saving primary data. [2025-09-16T19:24:31.462909] [DEBUG] [LOCAL ] MITP: Trimmed 2544 records to 1620 (keeping 150 days of data) [2025-09-16T19:24:31.472780] [DEBUG] [LOCAL ] MITP: Primary data saved (1620 records). [2025-09-16T19:24:31.472843] [INFO ] [MAIN ] MITP: Full history saved. [2025-09-16T19:24:31.472936] [INFO ] [MAIN ] Update Progress: 1362/2369 symbols completed. MITP took 20.4s. Estimated remaining: 1h 46m 49s. Rate: 9.4 symbols/min [2025-09-16T19:24:31.575718] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-05. [2025-09-16T19:24:31.648193] [INFO ] [MAIN ] MKC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:24:31.686876] [DEBUG] [LOCAL ] MKC: Loaded 38721 existing records from primary storage. [2025-09-16T19:24:31.687036] [INFO ] [MAIN ] MKC: Loaded 38721 existing records. [2025-09-16T19:24:31.868802] [WARN ] [MAIN ] MKC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:24:31.869047] [INFO ] [MAIN ] MKC: Wiping existing primary data before full refresh. [2025-09-16T19:24:31.869101] [INFO ] [LOCAL ] MKC: Starting deletion of primary data. [2025-09-16T19:24:31.870021] [DEBUG] [LOCAL ] MKC: Deleted primary data file. [2025-09-16T19:24:31.870089] [INFO ] [MAIN ] MKC: Starting full primary refresh. [2025-09-16T19:24:32.244574] [INFO ] [REMOTE ] MKC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:24:32.374878] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-07. [2025-09-16T19:24:33.174897] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-02. [2025-09-16T19:24:33.333669] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-16T19:24:33.408474] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-16T19:24:33.974911] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-06. [2025-09-16T19:24:34.623661] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-16T19:24:34.774854] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-03. [2025-09-16T19:24:35.574890] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-05. [2025-09-16T19:24:35.670896] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-16T19:24:36.244773] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-16T19:24:36.374907] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-06. [2025-09-16T19:24:36.534570] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-16T19:24:37.147095] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-16T19:24:37.174978] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-07. [2025-09-16T19:24:37.910478] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-16T19:24:37.974908] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-08. [2025-09-16T19:24:38.571141] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-16T19:24:38.774921] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-08. [2025-09-16T19:24:39.574891] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-09. [2025-09-16T19:24:39.808429] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-16T19:24:40.301042] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-16T19:24:40.302667] [INFO ] [REMOTE ] MIY: Full fetch complete (6427 records). [2025-09-16T19:24:40.302746] [DEBUG] [VALIDATOR ] MIY: Validating primary data. [2025-09-16T19:24:40.380047] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-09. [2025-09-16T19:24:40.668313] [DEBUG] [VALIDATOR ] MIY: All expected trading days are present. [2025-09-16T19:24:40.668413] [DEBUG] [VALIDATOR ] MIY: Primary data validation passed. [2025-09-16T19:24:40.668631] [INFO ] [MAIN ] MIY: Fetched primary data is valid. [2025-09-16T19:24:40.668708] [DEBUG] [LOCAL ] MIY: Saving primary data. [2025-09-16T19:24:40.669140] [DEBUG] [LOCAL ] MIY: Trimmed 6427 records to 4430 (keeping 150 days of data) [2025-09-16T19:24:40.697063] [DEBUG] [LOCAL ] MIY: Primary data saved (4430 records). [2025-09-16T19:24:40.697161] [INFO ] [MAIN ] MIY: Full history saved. [2025-09-16T19:24:40.697265] [INFO ] [MAIN ] Update Progress: 1363/2369 symbols completed. MIY took 16.6s. Estimated remaining: 1h 46m 45s. Rate: 9.4 symbols/min [2025-09-16T19:24:40.871616] [INFO ] [MAIN ] MKL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:24:40.898874] [DEBUG] [LOCAL ] MKL: Loaded 25028 existing records from primary storage. [2025-09-16T19:24:40.899024] [INFO ] [MAIN ] MKL: Loaded 25028 existing records. [2025-09-16T19:24:41.081606] [WARN ] [MAIN ] MKL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:24:41.081897] [INFO ] [MAIN ] MKL: Wiping existing primary data before full refresh. [2025-09-16T19:24:41.081962] [INFO ] [LOCAL ] MKL: Starting deletion of primary data. [2025-09-16T19:24:41.082561] [DEBUG] [LOCAL ] MKL: Deleted primary data file. [2025-09-16T19:24:41.082616] [INFO ] [MAIN ] MKL: Starting full primary refresh. [2025-09-16T19:24:41.180304] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-04. [2025-09-16T19:24:41.436968] [INFO ] [REMOTE ] MKL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:24:41.468639] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-16T19:24:41.471601] [INFO ] [REMOTE ] MITT: Full fetch complete (20955 records). [2025-09-16T19:24:41.471724] [DEBUG] [VALIDATOR ] MITT: Validating primary data. [2025-09-16T19:24:41.668207] [WARN ] [VALIDATOR ] MITT: Validation failed - insufficient historical data. Have 129 unique days, need 150 days [2025-09-16T19:24:41.668594] [FATAL] [MAIN ] MITT: Fetched primary data is invalid. Refusing to save it. [2025-09-16T19:24:41.668683] [WARN ] [MAIN ] MITT: Deleting existing primary and derivative data due to validation failure. [2025-09-16T19:24:41.668787] [INFO ] [LOCAL ] MITT: Starting deletion of primary data. [2025-09-16T19:24:41.668866] [DEBUG] [LOCAL ] MITT: No primary data file found to delete. [2025-09-16T19:24:41.668904] [INFO ] [LOCAL ] MITT: Starting deletion of derivative data. [2025-09-16T19:24:41.669230] [DEBUG] [LOCAL ] MITT: Deleted derivative data file. [2025-09-16T19:24:41.669349] [INFO ] [MAIN ] Update Progress: 1364/2369 symbols completed. MITT took 30.6s. Estimated remaining: 1h 46m 34s. Rate: 9.4 symbols/min [2025-09-16T19:24:41.848777] [INFO ] [MAIN ] MLI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:24:41.893348] [DEBUG] [LOCAL ] MLI: Loaded 31883 existing records from primary storage. [2025-09-16T19:24:41.893552] [INFO ] [MAIN ] MLI: Loaded 31883 existing records. [2025-09-16T19:24:41.980020] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-07. [2025-09-16T19:24:42.082161] [WARN ] [MAIN ] MLI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:24:42.082452] [INFO ] [MAIN ] MLI: Wiping existing primary data before full refresh. [2025-09-16T19:24:42.082533] [INFO ] [LOCAL ] MLI: Starting deletion of primary data. [2025-09-16T19:24:42.083309] [DEBUG] [LOCAL ] MLI: Deleted primary data file. [2025-09-16T19:24:42.083370] [INFO ] [MAIN ] MLI: Starting full primary refresh. [2025-09-16T19:24:42.453299] [INFO ] [REMOTE ] MLI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:24:42.774951] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-02. [2025-09-16T19:24:43.023697] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-16T19:24:43.574917] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-02. [2025-09-16T19:24:43.737441] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-16T19:24:44.250593] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-16T19:24:44.374904] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-08. [2025-09-16T19:24:44.858750] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-16T19:24:45.175126] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-05. [2025-09-16T19:24:45.974939] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-03. [2025-09-16T19:24:46.032476] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-16T19:24:46.774935] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-03. [2025-09-16T19:24:46.961926] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-16T19:24:47.574926] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-09. [2025-09-16T19:24:47.628587] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-16T19:24:48.156344] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-16T19:24:48.374951] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-04. [2025-09-16T19:24:48.899282] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-16T19:24:48.905600] [INFO ] [REMOTE ] MIR: Full fetch complete (55151 records). [2025-09-16T19:24:48.905759] [DEBUG] [VALIDATOR ] MIR: Validating primary data. [2025-09-16T19:24:49.184599] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-04. [2025-09-16T19:24:49.305098] [DEBUG] [VALIDATOR ] MIR: All expected trading days are present. [2025-09-16T19:24:49.305188] [DEBUG] [VALIDATOR ] MIR: Primary data validation passed. [2025-09-16T19:24:49.306110] [INFO ] [MAIN ] MIR: Fetched primary data is valid. [2025-09-16T19:24:49.306191] [DEBUG] [LOCAL ] MIR: Saving primary data. [2025-09-16T19:24:49.307581] [DEBUG] [LOCAL ] MIR: Trimmed 55151 records to 38141 (keeping 150 days of data) [2025-09-16T19:24:49.536274] [DEBUG] [LOCAL ] MIR: Primary data saved (38141 records). [2025-09-16T19:24:49.536413] [INFO ] [MAIN ] MIR: Full history saved. [2025-09-16T19:24:49.536517] [INFO ] [MAIN ] Update Progress: 1365/2369 symbols completed. MIR took 38.5s. Estimated remaining: 1h 46m 29s. Rate: 9.4 symbols/min [2025-09-16T19:24:49.710972] [INFO ] [MAIN ] MLM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:24:49.731930] [DEBUG] [LOCAL ] MLM: Loaded 21374 existing records from primary storage. [2025-09-16T19:24:49.732053] [INFO ] [MAIN ] MLM: Loaded 21374 existing records. [2025-09-16T19:24:49.915449] [WARN ] [MAIN ] MLM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:24:49.915769] [INFO ] [MAIN ] MLM: Wiping existing primary data before full refresh. [2025-09-16T19:24:49.915837] [INFO ] [LOCAL ] MLM: Starting deletion of primary data. [2025-09-16T19:24:49.916490] [DEBUG] [LOCAL ] MLM: Deleted primary data file. [2025-09-16T19:24:49.916539] [INFO ] [MAIN ] MLM: Starting full primary refresh. [2025-09-16T19:24:49.980423] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-06. [2025-09-16T19:24:50.386348] [INFO ] [REMOTE ] MLM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:24:50.422072] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-16T19:24:50.767518] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-16T19:24:50.778769] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-05. [2025-09-16T19:24:51.575037] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-05. [2025-09-16T19:24:51.780707] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-16T19:24:52.318220] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-16T19:24:52.374924] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-06. [2025-09-16T19:24:53.055258] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-16T19:24:53.175024] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-02. [2025-09-16T19:24:53.974925] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-06. [2025-09-16T19:24:54.026629] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-16T19:24:54.659890] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-16T19:24:54.774919] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-03. [2025-09-16T19:24:55.195587] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-16T19:24:55.574934] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-07. [2025-09-16T19:24:56.232805] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-16T19:24:56.374919] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-07. [2025-09-16T19:24:57.174905] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-04. [2025-09-16T19:24:57.219534] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-16T19:24:57.774160] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-16T19:24:57.974897] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-08. [2025-09-16T19:24:58.325779] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-16T19:24:58.774936] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-07. [2025-09-16T19:24:59.271515] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-16T19:24:59.574880] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-08. [2025-09-16T19:25:00.116757] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-16T19:25:00.374903] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-05. [2025-09-16T19:25:01.175000] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-08. [2025-09-16T19:25:01.492142] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-16T19:25:01.531115] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-16T19:25:01.974945] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-06. [2025-09-16T19:25:02.510404] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-16T19:25:02.774948] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-09. [2025-09-16T19:25:03.248326] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-16T19:25:03.574917] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-07. [2025-09-16T19:25:04.273275] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-16T19:25:04.278992] [INFO ] [REMOTE ] MLI: Full fetch complete (47790 records). [2025-09-16T19:25:04.279140] [DEBUG] [VALIDATOR ] MLI: Validating primary data. [2025-09-16T19:25:04.383678] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-09. [2025-09-16T19:25:04.675716] [DEBUG] [VALIDATOR ] MLI: All expected trading days are present. [2025-09-16T19:25:04.675894] [DEBUG] [VALIDATOR ] MLI: Primary data validation passed. [2025-09-16T19:25:04.676978] [INFO ] [MAIN ] MLI: Fetched primary data is valid. [2025-09-16T19:25:04.677058] [DEBUG] [LOCAL ] MLI: Saving primary data. [2025-09-16T19:25:04.678475] [DEBUG] [LOCAL ] MLI: Trimmed 47790 records to 32230 (keeping 150 days of data) [2025-09-16T19:25:04.790072] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-16T19:25:04.909334] [DEBUG] [LOCAL ] MLI: Primary data saved (32230 records). [2025-09-16T19:25:04.909533] [INFO ] [MAIN ] MLI: Full history saved. [2025-09-16T19:25:04.911130] [INFO ] [MAIN ] Update Progress: 1366/2369 symbols completed. MLI took 23.2s. Estimated remaining: 1h 46m 29s. Rate: 9.4 symbols/min [2025-09-16T19:25:05.082784] [INFO ] [MAIN ] MLNK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:25:05.103150] [DEBUG] [LOCAL ] MLNK: Loaded 18738 existing records from primary storage. [2025-09-16T19:25:05.103297] [INFO ] [MAIN ] MLNK: Loaded 18738 existing records. [2025-09-16T19:25:05.180137] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-09. [2025-09-16T19:25:05.281083] [WARN ] [MAIN ] MLNK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:25:05.281358] [INFO ] [MAIN ] MLNK: Wiping existing primary data before full refresh. [2025-09-16T19:25:05.281405] [INFO ] [LOCAL ] MLNK: Starting deletion of primary data. [2025-09-16T19:25:05.281944] [DEBUG] [LOCAL ] MLNK: Deleted primary data file. [2025-09-16T19:25:05.281993] [INFO ] [MAIN ] MLNK: Starting full primary refresh. [2025-09-16T19:25:05.650179] [INFO ] [REMOTE ] MLNK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:25:05.661719] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-16T19:25:05.666246] [INFO ] [REMOTE ] MKL: Full fetch complete (37642 records). [2025-09-16T19:25:05.666414] [DEBUG] [VALIDATOR ] MKL: Validating primary data. [2025-09-16T19:25:05.980122] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-02. [2025-09-16T19:25:06.065600] [DEBUG] [VALIDATOR ] MKL: All expected trading days are present. [2025-09-16T19:25:06.065711] [DEBUG] [VALIDATOR ] MKL: Primary data validation passed. [2025-09-16T19:25:06.066527] [INFO ] [MAIN ] MKL: Fetched primary data is valid. [2025-09-16T19:25:06.066572] [DEBUG] [LOCAL ] MKL: Saving primary data. [2025-09-16T19:25:06.067538] [DEBUG] [LOCAL ] MKL: Trimmed 37642 records to 25288 (keeping 150 days of data) [2025-09-16T19:25:06.233061] [DEBUG] [LOCAL ] MKL: Primary data saved (25288 records). [2025-09-16T19:25:06.233199] [INFO ] [MAIN ] MKL: Full history saved. [2025-09-16T19:25:06.233286] [INFO ] [MAIN ] Update Progress: 1367/2369 symbols completed. MKL took 25.5s. Estimated remaining: 1h 46m 19s. Rate: 9.4 symbols/min [2025-09-16T19:25:06.403215] [INFO ] [MAIN ] MLP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:25:06.407084] [DEBUG] [LOCAL ] MLP: Loaded 2255 existing records from primary storage. [2025-09-16T19:25:06.407174] [INFO ] [MAIN ] MLP: Loaded 2255 existing records. [2025-09-16T19:25:06.583538] [WARN ] [MAIN ] MLP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:25:06.583787] [INFO ] [MAIN ] MLP: Wiping existing primary data before full refresh. [2025-09-16T19:25:06.583834] [INFO ] [LOCAL ] MLP: Starting deletion of primary data. [2025-09-16T19:25:06.584076] [DEBUG] [LOCAL ] MLP: Deleted primary data file. [2025-09-16T19:25:06.584127] [INFO ] [MAIN ] MLP: Starting full primary refresh. [2025-09-16T19:25:06.791501] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-08. [2025-09-16T19:25:06.939216] [INFO ] [REMOTE ] MLP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:25:06.957251] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-16T19:25:06.963986] [INFO ] [REMOTE ] MKC: Full fetch complete (57009 records). [2025-09-16T19:25:06.964137] [DEBUG] [VALIDATOR ] MKC: Validating primary data. [2025-09-16T19:25:07.222978] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-16T19:25:07.373925] [DEBUG] [VALIDATOR ] MKC: All expected trading days are present. [2025-09-16T19:25:07.374014] [DEBUG] [VALIDATOR ] MKC: Primary data validation passed. [2025-09-16T19:25:07.374906] [INFO ] [MAIN ] MKC: Fetched primary data is valid. [2025-09-16T19:25:07.374953] [DEBUG] [LOCAL ] MKC: Saving primary data. [2025-09-16T19:25:07.376500] [DEBUG] [LOCAL ] MKC: Trimmed 57009 records to 39110 (keeping 150 days of data) [2025-09-16T19:25:07.590859] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-02. [2025-09-16T19:25:07.627506] [DEBUG] [LOCAL ] MKC: Primary data saved (39110 records). [2025-09-16T19:25:07.627690] [INFO ] [MAIN ] MKC: Full history saved. [2025-09-16T19:25:07.627783] [INFO ] [MAIN ] Update Progress: 1368/2369 symbols completed. MKC took 36.2s. Estimated remaining: 1h 46m 9s. Rate: 9.4 symbols/min [2025-09-16T19:25:07.796935] [INFO ] [MAIN ] MLR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:25:07.807757] [DEBUG] [LOCAL ] MLR: Loaded 8409 existing records from primary storage. [2025-09-16T19:25:07.807902] [INFO ] [MAIN ] MLR: Loaded 8409 existing records. [2025-09-16T19:25:07.985255] [WARN ] [MAIN ] MLR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:25:07.985486] [INFO ] [MAIN ] MLR: Wiping existing primary data before full refresh. [2025-09-16T19:25:07.985531] [INFO ] [LOCAL ] MLR: Starting deletion of primary data. [2025-09-16T19:25:07.985896] [DEBUG] [LOCAL ] MLR: Deleted primary data file. [2025-09-16T19:25:07.985942] [INFO ] [MAIN ] MLR: Starting full primary refresh. [2025-09-16T19:25:08.095622] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-16T19:25:08.343875] [INFO ] [REMOTE ] MLR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:25:08.362309] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-16T19:25:08.374838] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-09. [2025-09-16T19:25:09.174915] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-03. [2025-09-16T19:25:09.631072] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-16T19:25:09.634656] [INFO ] [REMOTE ] MLM: Full fetch complete (35261 records). [2025-09-16T19:25:09.634738] [DEBUG] [VALIDATOR ] MLM: Validating primary data. [2025-09-16T19:25:09.731417] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-16T19:25:09.983063] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-04. [2025-09-16T19:25:10.021380] [DEBUG] [VALIDATOR ] MLM: All expected trading days are present. [2025-09-16T19:25:10.021460] [DEBUG] [VALIDATOR ] MLM: Primary data validation passed. [2025-09-16T19:25:10.022217] [INFO ] [MAIN ] MLM: Fetched primary data is valid. [2025-09-16T19:25:10.022271] [DEBUG] [LOCAL ] MLM: Saving primary data. [2025-09-16T19:25:10.023132] [DEBUG] [LOCAL ] MLM: Trimmed 35261 records to 21554 (keeping 150 days of data) [2025-09-16T19:25:10.160627] [DEBUG] [LOCAL ] MLM: Primary data saved (21554 records). [2025-09-16T19:25:10.160815] [INFO ] [MAIN ] MLM: Full history saved. [2025-09-16T19:25:10.160899] [INFO ] [MAIN ] Update Progress: 1369/2369 symbols completed. MLM took 20.6s. Estimated remaining: 1h 46m 0s. Rate: 9.4 symbols/min [2025-09-16T19:25:10.328709] [INFO ] [MAIN ] MMC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:25:10.368340] [DEBUG] [LOCAL ] MMC: Loaded 38185 existing records from primary storage. [2025-09-16T19:25:10.368485] [INFO ] [MAIN ] MMC: Loaded 38185 existing records. [2025-09-16T19:25:10.552178] [WARN ] [MAIN ] MMC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:25:10.552433] [INFO ] [MAIN ] MMC: Wiping existing primary data before full refresh. [2025-09-16T19:25:10.552480] [INFO ] [LOCAL ] MMC: Starting deletion of primary data. [2025-09-16T19:25:10.553524] [DEBUG] [LOCAL ] MMC: Deleted primary data file. [2025-09-16T19:25:10.553577] [INFO ] [MAIN ] MMC: Starting full primary refresh. [2025-09-16T19:25:10.668021] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-16T19:25:10.780118] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-02. [2025-09-16T19:25:10.920771] [INFO ] [REMOTE ] MMC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:25:11.574963] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-02. [2025-09-16T19:25:11.661325] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-16T19:25:12.374899] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-03. [2025-09-16T19:25:13.174873] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-05. [2025-09-16T19:25:13.226055] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-16T19:25:13.537067] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-16T19:25:13.804337] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-16T19:25:13.974905] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-03. [2025-09-16T19:25:14.774969] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-04. [2025-09-16T19:25:15.574909] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-06. [2025-09-16T19:25:15.742901] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-16T19:25:15.910311] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-16T19:25:15.963539] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-16T19:25:16.374912] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-05. [2025-09-16T19:25:17.174899] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-03. [2025-09-16T19:25:17.471269] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-16T19:25:17.974911] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-07. [2025-09-16T19:25:18.025587] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-16T19:25:18.291015] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-16T19:25:18.774973] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-04. [2025-09-16T19:25:19.574918] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-08. [2025-09-16T19:25:19.717317] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-16T19:25:20.036365] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-16T19:25:20.374905] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-04. [2025-09-16T19:25:21.174907] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-05. [2025-09-16T19:25:21.975374] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-06. [2025-09-16T19:25:21.977131] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-16T19:25:22.193703] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-16T19:25:22.774948] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-06. [2025-09-16T19:25:23.117187] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-16T19:25:23.574866] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-09. [2025-09-16T19:25:23.582280] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-16T19:25:24.136364] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-16T19:25:24.137426] [INFO ] [REMOTE ] MLP: Full fetch complete (3228 records). [2025-09-16T19:25:24.137502] [DEBUG] [VALIDATOR ] MLP: Validating primary data. [2025-09-16T19:25:24.380009] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-07. [2025-09-16T19:25:24.499069] [DEBUG] [VALIDATOR ] MLP: All expected trading days are present. [2025-09-16T19:25:24.499155] [DEBUG] [VALIDATOR ] MLP: Primary data validation passed. [2025-09-16T19:25:24.499289] [INFO ] [MAIN ] MLP: Fetched primary data is valid. [2025-09-16T19:25:24.499329] [DEBUG] [LOCAL ] MLP: Saving primary data. [2025-09-16T19:25:24.499700] [DEBUG] [LOCAL ] MLP: Trimmed 3228 records to 2271 (keeping 150 days of data) [2025-09-16T19:25:24.513549] [DEBUG] [LOCAL ] MLP: Primary data saved (2271 records). [2025-09-16T19:25:24.513660] [INFO ] [MAIN ] MLP: Full history saved. [2025-09-16T19:25:24.513744] [INFO ] [MAIN ] Update Progress: 1370/2369 symbols completed. MLP took 18.3s. Estimated remaining: 1h 45m 60s. Rate: 9.4 symbols/min [2025-09-16T19:25:24.685518] [INFO ] [MAIN ] MMD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:25:24.695257] [DEBUG] [LOCAL ] MMD: Loaded 7760 existing records from primary storage. [2025-09-16T19:25:24.695394] [INFO ] [MAIN ] MMD: Loaded 7760 existing records. [2025-09-16T19:25:24.880508] [WARN ] [MAIN ] MMD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:25:24.880769] [INFO ] [MAIN ] MMD: Wiping existing primary data before full refresh. [2025-09-16T19:25:24.880816] [INFO ] [LOCAL ] MMD: Starting deletion of primary data. [2025-09-16T19:25:24.881182] [DEBUG] [LOCAL ] MMD: Deleted primary data file. [2025-09-16T19:25:24.881227] [INFO ] [MAIN ] MMD: Starting full primary refresh. [2025-09-16T19:25:25.180015] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-05. [2025-09-16T19:25:25.239820] [INFO ] [REMOTE ] MMD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:25:25.337868] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-16T19:25:25.974904] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-07. [2025-09-16T19:25:26.774925] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-02. [2025-09-16T19:25:27.029015] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-16T19:25:27.089575] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-16T19:25:27.574938] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-08. [2025-09-16T19:25:27.598209] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-16T19:25:28.374915] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-06. [2025-09-16T19:25:28.640339] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-16T19:25:29.174905] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-09. [2025-09-16T19:25:29.663340] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-16T19:25:29.974914] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-03. [2025-09-16T19:25:30.066171] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-16T19:25:30.068250] [INFO ] [REMOTE ] MLR: Full fetch complete (14400 records). [2025-09-16T19:25:30.068353] [DEBUG] [VALIDATOR ] MLR: Validating primary data. [2025-09-16T19:25:30.429663] [DEBUG] [VALIDATOR ] MLR: All expected trading days are present. [2025-09-16T19:25:30.429748] [DEBUG] [VALIDATOR ] MLR: Primary data validation passed. [2025-09-16T19:25:30.430070] [INFO ] [MAIN ] MLR: Fetched primary data is valid. [2025-09-16T19:25:30.430110] [DEBUG] [LOCAL ] MLR: Saving primary data. [2025-09-16T19:25:30.430702] [DEBUG] [LOCAL ] MLR: Trimmed 14400 records to 8483 (keeping 150 days of data) [2025-09-16T19:25:30.484894] [DEBUG] [LOCAL ] MLR: Primary data saved (8483 records). [2025-09-16T19:25:30.485043] [INFO ] [MAIN ] MLR: Full history saved. [2025-09-16T19:25:30.485133] [INFO ] [MAIN ] Update Progress: 1371/2369 symbols completed. MLR took 22.9s. Estimated remaining: 1h 45m 53s. Rate: 9.4 symbols/min [2025-09-16T19:25:30.656580] [INFO ] [MAIN ] MMI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:25:30.666022] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-16T19:25:30.682479] [DEBUG] [LOCAL ] MMI: Loaded 10782 existing records from primary storage. [2025-09-16T19:25:30.682738] [INFO ] [MAIN ] MMI: Loaded 10782 existing records. [2025-09-16T19:25:30.780042] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-07. [2025-09-16T19:25:30.883670] [WARN ] [MAIN ] MMI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:25:30.883922] [INFO ] [MAIN ] MMI: Wiping existing primary data before full refresh. [2025-09-16T19:25:30.883967] [INFO ] [LOCAL ] MMI: Starting deletion of primary data. [2025-09-16T19:25:30.884349] [DEBUG] [LOCAL ] MMI: Deleted primary data file. [2025-09-16T19:25:30.884404] [INFO ] [MAIN ] MMI: Starting full primary refresh. [2025-09-16T19:25:31.237389] [INFO ] [REMOTE ] MMI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:25:31.574901] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-04. [2025-09-16T19:25:32.374900] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-08. [2025-09-16T19:25:32.536853] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-16T19:25:32.643713] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-16T19:25:33.174882] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-08. [2025-09-16T19:25:33.242635] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-16T19:25:33.974894] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-09. [2025-09-16T19:25:34.775013] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-02. [2025-09-16T19:25:34.989878] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-16T19:25:35.322566] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-16T19:25:35.326565] [INFO ] [REMOTE ] MLNK: Full fetch complete (27273 records). [2025-09-16T19:25:35.326666] [DEBUG] [VALIDATOR ] MLNK: Validating primary data. [2025-09-16T19:25:35.581968] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-09. [2025-09-16T19:25:35.692725] [DEBUG] [VALIDATOR ] MLNK: All expected trading days are present. [2025-09-16T19:25:35.692802] [DEBUG] [VALIDATOR ] MLNK: Primary data validation passed. [2025-09-16T19:25:35.693354] [INFO ] [MAIN ] MLNK: Fetched primary data is valid. [2025-09-16T19:25:35.693394] [DEBUG] [LOCAL ] MLNK: Saving primary data. [2025-09-16T19:25:35.694179] [DEBUG] [LOCAL ] MLNK: Trimmed 27273 records to 19036 (keeping 150 days of data) [2025-09-16T19:25:35.803004] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-16T19:25:35.818579] [DEBUG] [LOCAL ] MLNK: Primary data saved (19036 records). [2025-09-16T19:25:35.818715] [INFO ] [MAIN ] MLNK: Full history saved. [2025-09-16T19:25:35.818796] [INFO ] [MAIN ] Update Progress: 1372/2369 symbols completed. MLNK took 30.9s. Estimated remaining: 1h 45m 46s. Rate: 9.4 symbols/min [2025-09-16T19:25:35.986971] [INFO ] [MAIN ] MMKT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:25:35.987187] [DEBUG] [LOCAL ] MMKT: No existing data file found in primary storage. [2025-09-16T19:25:35.987232] [WARN ] [MAIN ] MMKT: No existing data found, performing full refresh instead. [2025-09-16T19:25:35.987384] [INFO ] [MAIN ] MMKT: Wiping existing primary data before full refresh. [2025-09-16T19:25:35.987424] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-09-16T19:25:35.987465] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-09-16T19:25:35.987498] [INFO ] [MAIN ] MMKT: Starting full primary refresh. [2025-09-16T19:25:36.340728] [INFO ] [REMOTE ] MMKT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:25:36.374844] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-02. [2025-09-16T19:25:36.712777] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-16T19:25:37.068204] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-16T19:25:37.074358] [INFO ] [REMOTE ] MMC: Full fetch complete (56292 records). [2025-09-16T19:25:37.074479] [DEBUG] [VALIDATOR ] MMC: Validating primary data. [2025-09-16T19:25:37.178122] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-03. [2025-09-16T19:25:37.485558] [DEBUG] [VALIDATOR ] MMC: All expected trading days are present. [2025-09-16T19:25:37.485659] [DEBUG] [VALIDATOR ] MMC: Primary data validation passed. [2025-09-16T19:25:37.486549] [INFO ] [MAIN ] MMC: Fetched primary data is valid. [2025-09-16T19:25:37.487057] [DEBUG] [LOCAL ] MMC: Saving primary data. [2025-09-16T19:25:37.488268] [DEBUG] [LOCAL ] MMC: Trimmed 56292 records to 38574 (keeping 150 days of data) [2025-09-16T19:25:37.703409] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-16T19:25:37.741164] [DEBUG] [LOCAL ] MMC: Primary data saved (38574 records). [2025-09-16T19:25:37.741460] [INFO ] [MAIN ] MMC: Full history saved. [2025-09-16T19:25:37.742519] [INFO ] [MAIN ] Update Progress: 1373/2369 symbols completed. MMC took 27.6s. Estimated remaining: 1h 45m 36s. Rate: 9.4 symbols/min [2025-09-16T19:25:37.913269] [INFO ] [MAIN ] MMM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:25:37.955670] [DEBUG] [LOCAL ] MMM: Loaded 39261 existing records from primary storage. [2025-09-16T19:25:37.955831] [INFO ] [MAIN ] MMM: Loaded 39261 existing records. [2025-09-16T19:25:37.984678] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-04. [2025-09-16T19:25:38.133635] [WARN ] [MAIN ] MMM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:25:38.133883] [INFO ] [MAIN ] MMM: Wiping existing primary data before full refresh. [2025-09-16T19:25:38.133928] [INFO ] [LOCAL ] MMM: Starting deletion of primary data. [2025-09-16T19:25:38.134942] [DEBUG] [LOCAL ] MMM: Deleted primary data file. [2025-09-16T19:25:38.134991] [INFO ] [MAIN ] MMM: Starting full primary refresh. [2025-09-16T19:25:38.490500] [INFO ] [REMOTE ] MMM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:25:38.493875] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-16T19:25:38.774892] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-02. [2025-09-16T19:25:39.574902] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-03. [2025-09-16T19:25:40.374860] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-05. [2025-09-16T19:25:40.481783] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-16T19:25:40.644678] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-16T19:25:40.961705] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-16T19:25:41.174885] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-03. [2025-09-16T19:25:41.974886] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-04. [2025-09-16T19:25:42.774957] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-05. [2025-09-16T19:25:43.007903] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-16T19:25:43.088625] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-16T19:25:43.128324] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-16T19:25:43.574978] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-06. [2025-09-16T19:25:43.914906] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-16T19:25:44.374907] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-04. [2025-09-16T19:25:45.174912] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-07. [2025-09-16T19:25:45.780969] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-16T19:25:45.974941] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-08. [2025-09-16T19:25:46.024273] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-16T19:25:46.414903] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-16T19:25:46.774910] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-09. [2025-09-16T19:25:47.276008] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-16T19:25:47.276803] [INFO ] [REMOTE ] MMKT: Full fetch complete (1520 records). [2025-09-16T19:25:47.276872] [DEBUG] [VALIDATOR ] MMKT: Validating primary data. [2025-09-16T19:25:47.463632] [WARN ] [VALIDATOR ] MMKT: Validation failed - insufficient historical data. Have 148 unique days, need 150 days [2025-09-16T19:25:47.463858] [FATAL] [MAIN ] MMKT: Fetched primary data is invalid. Refusing to save it. [2025-09-16T19:25:47.463904] [WARN ] [MAIN ] MMKT: Deleting existing primary and derivative data due to validation failure. [2025-09-16T19:25:47.463950] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-09-16T19:25:47.464008] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-09-16T19:25:47.464061] [INFO ] [LOCAL ] MMKT: Starting deletion of derivative data. [2025-09-16T19:25:47.464104] [DEBUG] [LOCAL ] MMKT: No derivative data file found to delete. [2025-09-16T19:25:47.464163] [INFO ] [MAIN ] Update Progress: 1374/2369 symbols completed. MMKT took 11.6s. Estimated remaining: 1h 45m 32s. Rate: 9.4 symbols/min [2025-09-16T19:25:47.580002] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-06. [2025-09-16T19:25:47.645881] [INFO ] [MAIN ] MMS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:25:47.669128] [DEBUG] [LOCAL ] MMS: Loaded 24361 existing records from primary storage. [2025-09-16T19:25:47.669260] [INFO ] [MAIN ] MMS: Loaded 24361 existing records. [2025-09-16T19:25:47.857727] [WARN ] [MAIN ] MMS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:25:47.858625] [INFO ] [MAIN ] MMS: Wiping existing primary data before full refresh. [2025-09-16T19:25:47.858697] [INFO ] [LOCAL ] MMS: Starting deletion of primary data. [2025-09-16T19:25:47.859616] [DEBUG] [LOCAL ] MMS: Deleted primary data file. [2025-09-16T19:25:47.859708] [INFO ] [MAIN ] MMS: Starting full primary refresh. [2025-09-16T19:25:48.233872] [INFO ] [REMOTE ] MMS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:25:48.240393] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-16T19:25:48.374893] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-07. [2025-09-16T19:25:49.147253] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-16T19:25:49.174864] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-08. [2025-09-16T19:25:49.974940] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-02. [2025-09-16T19:25:50.088890] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-16T19:25:50.774901] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-09. [2025-09-16T19:25:51.465807] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-16T19:25:51.485904] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-16T19:25:51.487557] [INFO ] [REMOTE ] MMD: Full fetch complete (12217 records). [2025-09-16T19:25:51.487623] [DEBUG] [VALIDATOR ] MMD: Validating primary data. [2025-09-16T19:25:51.579983] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-05. [2025-09-16T19:25:51.849356] [DEBUG] [VALIDATOR ] MMD: All expected trading days are present. [2025-09-16T19:25:51.849434] [DEBUG] [VALIDATOR ] MMD: Primary data validation passed. [2025-09-16T19:25:51.849723] [INFO ] [MAIN ] MMD: Fetched primary data is valid. [2025-09-16T19:25:51.849768] [DEBUG] [LOCAL ] MMD: Saving primary data. [2025-09-16T19:25:51.850200] [DEBUG] [LOCAL ] MMD: Trimmed 12217 records to 7827 (keeping 150 days of data) [2025-09-16T19:25:51.897864] [DEBUG] [LOCAL ] MMD: Primary data saved (7827 records). [2025-09-16T19:25:51.897976] [INFO ] [MAIN ] MMD: Full history saved. [2025-09-16T19:25:51.898059] [INFO ] [MAIN ] Update Progress: 1375/2369 symbols completed. MMD took 27.4s. Estimated remaining: 1h 45m 25s. Rate: 9.4 symbols/min [2025-09-16T19:25:52.066994] [INFO ] [MAIN ] MMT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:25:52.075584] [DEBUG] [LOCAL ] MMT: Loaded 7640 existing records from primary storage. [2025-09-16T19:25:52.075734] [INFO ] [MAIN ] MMT: Loaded 7640 existing records. [2025-09-16T19:25:52.250632] [WARN ] [MAIN ] MMT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:25:52.250866] [INFO ] [MAIN ] MMT: Wiping existing primary data before full refresh. [2025-09-16T19:25:52.250911] [INFO ] [LOCAL ] MMT: Starting deletion of primary data. [2025-09-16T19:25:52.251175] [DEBUG] [LOCAL ] MMT: Deleted primary data file. [2025-09-16T19:25:52.251219] [INFO ] [MAIN ] MMT: Starting full primary refresh. [2025-09-16T19:25:52.379982] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-03. [2025-09-16T19:25:52.611675] [INFO ] [REMOTE ] MMT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:25:52.621765] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-16T19:25:53.174914] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-02. [2025-09-16T19:25:53.950508] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-16T19:25:53.974854] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-03. [2025-09-16T19:25:54.007896] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-16T19:25:54.774909] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-06. [2025-09-16T19:25:54.941434] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-16T19:25:55.519855] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-16T19:25:55.574854] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-07. [2025-09-16T19:25:56.374897] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-05. [2025-09-16T19:25:56.468893] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-16T19:25:57.174913] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-08. [2025-09-16T19:25:57.974931] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-04. [2025-09-16T19:25:58.021407] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-16T19:25:58.488228] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-16T19:25:58.697011] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-16T19:25:58.774868] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-04. [2025-09-16T19:25:59.574889] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-06. [2025-09-16T19:26:00.271145] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-16T19:26:00.374897] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-05. [2025-09-16T19:26:01.174873] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-09. [2025-09-16T19:26:01.274313] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-16T19:26:01.666862] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-16T19:26:01.794694] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-16T19:26:01.798089] [INFO ] [REMOTE ] MMI: Full fetch complete (16809 records). [2025-09-16T19:26:01.798244] [DEBUG] [VALIDATOR ] MMI: Validating primary data. [2025-09-16T19:26:01.980125] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-06. [2025-09-16T19:26:02.209087] [DEBUG] [VALIDATOR ] MMI: All expected trading days are present. [2025-09-16T19:26:02.209168] [DEBUG] [VALIDATOR ] MMI: Primary data validation passed. [2025-09-16T19:26:02.209531] [INFO ] [MAIN ] MMI: Fetched primary data is valid. [2025-09-16T19:26:02.209582] [DEBUG] [LOCAL ] MMI: Saving primary data. [2025-09-16T19:26:02.210199] [DEBUG] [LOCAL ] MMI: Trimmed 16809 records to 10858 (keeping 150 days of data) [2025-09-16T19:26:02.280304] [DEBUG] [LOCAL ] MMI: Primary data saved (10858 records). [2025-09-16T19:26:02.280457] [INFO ] [MAIN ] MMI: Full history saved. [2025-09-16T19:26:02.280579] [INFO ] [MAIN ] Update Progress: 1376/2369 symbols completed. MMI took 31.8s. Estimated remaining: 1h 45m 21s. Rate: 9.4 symbols/min [2025-09-16T19:26:02.452450] [INFO ] [MAIN ] MMU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:26:02.464838] [DEBUG] [LOCAL ] MMU: Loaded 12090 existing records from primary storage. [2025-09-16T19:26:02.464978] [INFO ] [MAIN ] MMU: Loaded 12090 existing records. [2025-09-16T19:26:02.645714] [WARN ] [MAIN ] MMU: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:26:02.645996] [INFO ] [MAIN ] MMU: Wiping existing primary data before full refresh. [2025-09-16T19:26:02.646044] [INFO ] [LOCAL ] MMU: Starting deletion of primary data. [2025-09-16T19:26:02.646487] [DEBUG] [LOCAL ] MMU: Deleted primary data file. [2025-09-16T19:26:02.646534] [INFO ] [MAIN ] MMU: Starting full primary refresh. [2025-09-16T19:26:02.785939] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-05. [2025-09-16T19:26:03.013969] [INFO ] [REMOTE ] MMU: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:26:03.465873] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-16T19:26:03.482083] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-16T19:26:03.574864] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-07. [2025-09-16T19:26:04.374897] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-07. [2025-09-16T19:26:04.878537] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-16T19:26:05.174914] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-02. [2025-09-16T19:26:05.831869] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-16T19:26:05.974929] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-06. [2025-09-16T19:26:06.418762] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-16T19:26:06.745944] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-16T19:26:06.774893] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-07. [2025-09-16T19:26:07.564602] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-16T19:26:07.574842] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-08. [2025-09-16T19:26:08.212040] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-16T19:26:08.374904] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-08. [2025-09-16T19:26:09.174924] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-09. [2025-09-16T19:26:09.909073] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-16T19:26:09.910461] [INFO ] [REMOTE ] MMT: Full fetch complete (12480 records). [2025-09-16T19:26:09.910544] [DEBUG] [VALIDATOR ] MMT: Validating primary data. [2025-09-16T19:26:09.980004] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-03. [2025-09-16T19:26:10.269003] [DEBUG] [VALIDATOR ] MMT: All expected trading days are present. [2025-09-16T19:26:10.269093] [DEBUG] [VALIDATOR ] MMT: Primary data validation passed. [2025-09-16T19:26:10.269451] [INFO ] [MAIN ] MMT: Fetched primary data is valid. [2025-09-16T19:26:10.269514] [DEBUG] [LOCAL ] MMT: Saving primary data. [2025-09-16T19:26:10.270071] [DEBUG] [LOCAL ] MMT: Trimmed 12480 records to 7760 (keeping 150 days of data) [2025-09-16T19:26:10.316387] [DEBUG] [LOCAL ] MMT: Primary data saved (7760 records). [2025-09-16T19:26:10.316544] [INFO ] [MAIN ] MMT: Full history saved. [2025-09-16T19:26:10.316695] [INFO ] [MAIN ] Update Progress: 1377/2369 symbols completed. MMT took 18.4s. Estimated remaining: 1h 45m 16s. Rate: 9.4 symbols/min [2025-09-16T19:26:10.463842] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-16T19:26:10.528296] [INFO ] [MAIN ] MNR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:26:10.546923] [DEBUG] [LOCAL ] MNR: Loaded 18562 existing records from primary storage. [2025-09-16T19:26:10.547045] [INFO ] [MAIN ] MNR: Loaded 18562 existing records. [2025-09-16T19:26:10.726715] [WARN ] [MAIN ] MNR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:26:10.726978] [INFO ] [MAIN ] MNR: Wiping existing primary data before full refresh. [2025-09-16T19:26:10.727024] [INFO ] [LOCAL ] MNR: Starting deletion of primary data. [2025-09-16T19:26:10.727589] [DEBUG] [LOCAL ] MNR: Deleted primary data file. [2025-09-16T19:26:10.727633] [INFO ] [MAIN ] MNR: Starting full primary refresh. [2025-09-16T19:26:10.781253] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-08. [2025-09-16T19:26:11.100110] [INFO ] [REMOTE ] MNR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:26:11.106561] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-16T19:26:11.574950] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-09. [2025-09-16T19:26:12.235878] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-16T19:26:12.374898] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-09. [2025-09-16T19:26:13.174934] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-04. [2025-09-16T19:26:13.408531] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-16T19:26:13.430095] [INFO ] [REMOTE ] MMM: Full fetch complete (57925 records). [2025-09-16T19:26:13.430967] [DEBUG] [VALIDATOR ] MMM: Validating primary data. [2025-09-16T19:26:13.431951] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-16T19:26:13.517197] [INFO ] [REMOTE ] MMS: Full fetch complete (37710 records). [2025-09-16T19:26:13.539425] [DEBUG] [VALIDATOR ] MMS: Validating primary data. [2025-09-16T19:26:13.989188] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-02. [2025-09-16T19:26:14.147931] [DEBUG] [VALIDATOR ] MMM: All expected trading days are present. [2025-09-16T19:26:14.151692] [DEBUG] [VALIDATOR ] MMM: Primary data validation passed. [2025-09-16T19:26:14.171991] [INFO ] [MAIN ] MMM: Fetched primary data is valid. [2025-09-16T19:26:14.177199] [DEBUG] [LOCAL ] MMM: Saving primary data. [2025-09-16T19:26:14.201051] [DEBUG] [LOCAL ] MMM: Trimmed 57925 records to 39647 (keeping 150 days of data) [2025-09-16T19:26:14.397580] [DEBUG] [VALIDATOR ] MMS: All expected trading days are present. [2025-09-16T19:26:14.397480] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-16T19:26:14.403507] [DEBUG] [VALIDATOR ] MMS: Primary data validation passed. [2025-09-16T19:26:14.404561] [INFO ] [MAIN ] MMS: Fetched primary data is valid. [2025-09-16T19:26:14.405188] [DEBUG] [LOCAL ] MMS: Saving primary data. [2025-09-16T19:26:14.412990] [DEBUG] [LOCAL ] MMS: Trimmed 37710 records to 24619 (keeping 150 days of data) [2025-09-16T19:26:14.725933] [DEBUG] [LOCAL ] MMS: Primary data saved (24619 records). [2025-09-16T19:26:14.727772] [INFO ] [MAIN ] MMS: Full history saved. [2025-09-16T19:26:14.728155] [INFO ] [MAIN ] Update Progress: 1378/2369 symbols completed. MMS took 27.3s. Estimated remaining: 1h 45m 8s. Rate: 9.4 symbols/min [2025-09-16T19:26:14.785611] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-05. [2025-09-16T19:26:14.913511] [INFO ] [MAIN ] MNSO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:26:14.915888] [DEBUG] [LOCAL ] MMM: Primary data saved (39647 records). [2025-09-16T19:26:14.916071] [INFO ] [MAIN ] MMM: Full history saved. [2025-09-16T19:26:14.916975] [INFO ] [MAIN ] Update Progress: 1379/2369 symbols completed. MMM took 37.2s. Estimated remaining: 1h 44m 57s. Rate: 9.4 symbols/min [2025-09-16T19:26:15.099166] [INFO ] [MAIN ] MNTN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:26:15.099971] [DEBUG] [LOCAL ] MNTN: No existing data file found in primary storage. [2025-09-16T19:26:15.100030] [WARN ] [MAIN ] MNTN: No existing data found, performing full refresh instead. [2025-09-16T19:26:15.109821] [INFO ] [MAIN ] MNTN: Wiping existing primary data before full refresh. [2025-09-16T19:26:15.109926] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-09-16T19:26:15.110489] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-09-16T19:26:15.110559] [INFO ] [MAIN ] MNTN: Starting full primary refresh. [2025-09-16T19:26:15.110403] [DEBUG] [LOCAL ] MNSO: Loaded 31713 existing records from primary storage. [2025-09-16T19:26:15.143394] [INFO ] [MAIN ] MNSO: Loaded 31713 existing records. [2025-09-16T19:26:15.507941] [WARN ] [MAIN ] MNSO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:26:15.593089] [INFO ] [MAIN ] MNSO: Wiping existing primary data before full refresh. [2025-09-16T19:26:15.597981] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-16T19:26:15.601616] [INFO ] [LOCAL ] MNSO: Starting deletion of primary data. [2025-09-16T19:26:15.602520] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-06. [2025-09-16T19:26:15.660526] [DEBUG] [LOCAL ] MNSO: Deleted primary data file. [2025-09-16T19:26:15.685350] [INFO ] [MAIN ] MNSO: Starting full primary refresh. [2025-09-16T19:26:15.685283] [INFO ] [REMOTE ] MNTN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:26:15.861982] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-16T19:26:16.076905] [INFO ] [REMOTE ] MNSO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:26:16.374906] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-03. [2025-09-16T19:26:16.601812] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-16T19:26:17.174934] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-02. [2025-09-16T19:26:17.290493] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-16T19:26:17.372115] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:26:17.372383] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-02 [2025-09-16T19:26:17.974916] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-02. [2025-09-16T19:26:18.774907] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-03. [2025-09-16T19:26:18.952841] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:26:18.953298] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-03 [2025-09-16T19:26:19.574931] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-07. [2025-09-16T19:26:19.626270] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-16T19:26:20.101464] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-16T19:26:20.374933] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-08. [2025-09-16T19:26:21.174915] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-04. [2025-09-16T19:26:21.451535] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-16T19:26:21.974934] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-09. [2025-09-16T19:26:22.339002] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-16T19:26:22.636991] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-16T19:26:22.639726] [INFO ] [REMOTE ] MMU: Full fetch complete (18739 records). [2025-09-16T19:26:22.639824] [DEBUG] [VALIDATOR ] MMU: Validating primary data. [2025-09-16T19:26:22.780051] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-03. [2025-09-16T19:26:23.026448] [DEBUG] [VALIDATOR ] MMU: All expected trading days are present. [2025-09-16T19:26:23.026531] [DEBUG] [VALIDATOR ] MMU: Primary data validation passed. [2025-09-16T19:26:23.026949] [INFO ] [MAIN ] MMU: Fetched primary data is valid. [2025-09-16T19:26:23.026997] [DEBUG] [LOCAL ] MMU: Saving primary data. [2025-09-16T19:26:23.027721] [DEBUG] [LOCAL ] MMU: Trimmed 18739 records to 12224 (keeping 150 days of data) [2025-09-16T19:26:23.103636] [DEBUG] [LOCAL ] MMU: Primary data saved (12224 records). [2025-09-16T19:26:23.103826] [INFO ] [MAIN ] MMU: Full history saved. [2025-09-16T19:26:23.103928] [INFO ] [MAIN ] Update Progress: 1380/2369 symbols completed. MMU took 20.8s. Estimated remaining: 1h 44m 52s. Rate: 9.4 symbols/min [2025-09-16T19:26:23.277468] [INFO ] [MAIN ] MO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:26:23.318746] [DEBUG] [LOCAL ] MO: Loaded 39714 existing records from primary storage. [2025-09-16T19:26:23.318907] [INFO ] [MAIN ] MO: Loaded 39714 existing records. [2025-09-16T19:26:23.504523] [WARN ] [MAIN ] MO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:26:23.504903] [INFO ] [MAIN ] MO: Wiping existing primary data before full refresh. [2025-09-16T19:26:23.504951] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-09-16T19:26:23.505964] [DEBUG] [LOCAL ] MO: Deleted primary data file. [2025-09-16T19:26:23.506013] [INFO ] [MAIN ] MO: Starting full primary refresh. [2025-09-16T19:26:23.581521] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-05. [2025-09-16T19:26:23.867946] [INFO ] [REMOTE ] MO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:26:24.374930] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-04. [2025-09-16T19:26:24.607815] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:26:24.608143] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-04 [2025-09-16T19:26:24.662072] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-16T19:26:24.663380] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-16T19:26:25.174934] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-02. [2025-09-16T19:26:25.974893] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-05. [2025-09-16T19:26:26.774898] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-06. [2025-09-16T19:26:26.797792] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-16T19:26:27.379995] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-09-16T19:26:27.574863] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-06. [2025-09-16T19:26:28.063680] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-16T19:26:28.374902] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-04. [2025-09-16T19:26:28.991522] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-16T19:26:29.174893] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-07. [2025-09-16T19:26:29.892292] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-16T19:26:29.974851] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-05. [2025-09-16T19:26:30.312466] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-16T19:26:30.774929] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-08. [2025-09-16T19:26:31.574910] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-03. [2025-09-16T19:26:31.802984] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-16T19:26:31.971912] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-16T19:26:32.374933] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-07. [2025-09-16T19:26:33.174936] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-06. [2025-09-16T19:26:33.933599] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-09-16T19:26:33.974885] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-09. [2025-09-16T19:26:34.037214] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-16T19:26:34.403337] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-16T19:26:34.774895] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-07. [2025-09-16T19:26:34.975730] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-16T19:26:34.978528] [INFO ] [REMOTE ] MNR: Full fetch complete (27882 records). [2025-09-16T19:26:34.978600] [DEBUG] [VALIDATOR ] MNR: Validating primary data. [2025-09-16T19:26:35.365588] [DEBUG] [VALIDATOR ] MNR: All expected trading days are present. [2025-09-16T19:26:35.365737] [DEBUG] [VALIDATOR ] MNR: Primary data validation passed. [2025-09-16T19:26:35.366403] [INFO ] [MAIN ] MNR: Fetched primary data is valid. [2025-09-16T19:26:35.366461] [DEBUG] [LOCAL ] MNR: Saving primary data. [2025-09-16T19:26:35.367360] [DEBUG] [LOCAL ] MNR: Trimmed 27882 records to 18688 (keeping 150 days of data) [2025-09-16T19:26:35.496735] [DEBUG] [LOCAL ] MNR: Primary data saved (18688 records). [2025-09-16T19:26:35.496902] [INFO ] [MAIN ] MNR: Full history saved. [2025-09-16T19:26:35.497024] [INFO ] [MAIN ] Update Progress: 1381/2369 symbols completed. MNR took 25.2s. Estimated remaining: 1h 44m 50s. Rate: 9.4 symbols/min [2025-09-16T19:26:35.580055] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-08. [2025-09-16T19:26:35.724033] [INFO ] [MAIN ] MOD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:26:35.777200] [DEBUG] [LOCAL ] MOD: Loaded 32979 existing records from primary storage. [2025-09-16T19:26:35.777410] [INFO ] [MAIN ] MOD: Loaded 32979 existing records. [2025-09-16T19:26:36.024126] [WARN ] [MAIN ] MOD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:26:36.024605] [INFO ] [MAIN ] MOD: Wiping existing primary data before full refresh. [2025-09-16T19:26:36.024707] [INFO ] [LOCAL ] MOD: Starting deletion of primary data. [2025-09-16T19:26:36.026017] [DEBUG] [LOCAL ] MOD: Deleted primary data file. [2025-09-16T19:26:36.026091] [INFO ] [MAIN ] MOD: Starting full primary refresh. [2025-09-16T19:26:36.275129] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-16T19:26:36.382695] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-08. [2025-09-16T19:26:36.559417] [INFO ] [REMOTE ] MOD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:26:37.174877] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-04. [2025-09-16T19:26:37.230183] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-16T19:26:37.974877] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-09. [2025-09-16T19:26:38.065778] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-16T19:26:38.774886] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-09. [2025-09-16T19:26:39.230587] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-16T19:26:39.273842] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-16T19:26:39.278722] [INFO ] [REMOTE ] MNTN: Full fetch complete (23218 records). [2025-09-16T19:26:39.278804] [DEBUG] [VALIDATOR ] MNTN: Validating primary data. [2025-09-16T19:26:39.462191] [WARN ] [VALIDATOR ] MNTN: Validation failed - insufficient historical data. Have 80 unique days, need 150 days [2025-09-16T19:26:39.462559] [FATAL] [MAIN ] MNTN: Fetched primary data is invalid. Refusing to save it. [2025-09-16T19:26:39.462623] [WARN ] [MAIN ] MNTN: Deleting existing primary and derivative data due to validation failure. [2025-09-16T19:26:39.462694] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-09-16T19:26:39.462756] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-09-16T19:26:39.462802] [INFO ] [LOCAL ] MNTN: Starting deletion of derivative data. [2025-09-16T19:26:39.462859] [DEBUG] [LOCAL ] MNTN: No derivative data file found to delete. [2025-09-16T19:26:39.462938] [INFO ] [MAIN ] Update Progress: 1382/2369 symbols completed. MNTN took 24.5s. Estimated remaining: 1h 44m 42s. Rate: 9.4 symbols/min [2025-09-16T19:26:39.580160] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-02. [2025-09-16T19:26:39.641480] [INFO ] [MAIN ] MODG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:26:39.681548] [DEBUG] [LOCAL ] MODG: Loaded 38153 existing records from primary storage. [2025-09-16T19:26:39.681730] [INFO ] [MAIN ] MODG: Loaded 38153 existing records. [2025-09-16T19:26:39.863141] [WARN ] [MAIN ] MODG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:26:39.863369] [INFO ] [MAIN ] MODG: Wiping existing primary data before full refresh. [2025-09-16T19:26:39.863423] [INFO ] [LOCAL ] MODG: Starting deletion of primary data. [2025-09-16T19:26:39.864162] [DEBUG] [LOCAL ] MODG: Deleted primary data file. [2025-09-16T19:26:39.864226] [INFO ] [MAIN ] MODG: Starting full primary refresh. [2025-09-16T19:26:40.219939] [INFO ] [REMOTE ] MODG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:26:40.328869] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-16T19:26:40.335671] [INFO ] [REMOTE ] MNSO: Full fetch complete (48509 records). [2025-09-16T19:26:40.335775] [DEBUG] [VALIDATOR ] MNSO: Validating primary data. [2025-09-16T19:26:40.380055] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-05. [2025-09-16T19:26:40.713107] [DEBUG] [VALIDATOR ] MNSO: All expected trading days are present. [2025-09-16T19:26:40.713230] [DEBUG] [VALIDATOR ] MNSO: Primary data validation passed. [2025-09-16T19:26:40.714007] [INFO ] [MAIN ] MNSO: Fetched primary data is valid. [2025-09-16T19:26:40.714067] [DEBUG] [LOCAL ] MNSO: Saving primary data. [2025-09-16T19:26:40.715046] [DEBUG] [LOCAL ] MNSO: Trimmed 48509 records to 31998 (keeping 150 days of data) [2025-09-16T19:26:40.925471] [DEBUG] [LOCAL ] MNSO: Primary data saved (31998 records). [2025-09-16T19:26:40.925683] [INFO ] [MAIN ] MNSO: Full history saved. [2025-09-16T19:26:40.926399] [INFO ] [MAIN ] Update Progress: 1383/2369 symbols completed. MNSO took 26.2s. Estimated remaining: 1h 44m 32s. Rate: 9.4 symbols/min [2025-09-16T19:26:41.096499] [INFO ] [MAIN ] MOH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:26:41.136484] [DEBUG] [LOCAL ] MOH: Loaded 31518 existing records from primary storage. [2025-09-16T19:26:41.136619] [INFO ] [MAIN ] MOH: Loaded 31518 existing records. [2025-09-16T19:26:41.180082] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-02. [2025-09-16T19:26:41.317673] [WARN ] [MAIN ] MOH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:26:41.318043] [INFO ] [MAIN ] MOH: Wiping existing primary data before full refresh. [2025-09-16T19:26:41.318126] [INFO ] [LOCAL ] MOH: Starting deletion of primary data. [2025-09-16T19:26:41.318880] [DEBUG] [LOCAL ] MOH: Deleted primary data file. [2025-09-16T19:26:41.318935] [INFO ] [MAIN ] MOH: Starting full primary refresh. [2025-09-16T19:26:41.675105] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-16T19:26:41.719077] [INFO ] [REMOTE ] MOH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:26:41.974902] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-02. [2025-09-16T19:26:42.423426] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-16T19:26:42.621592] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-16T19:26:42.774910] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-03. [2025-09-16T19:26:43.521898] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-16T19:26:43.574931] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-03. [2025-09-16T19:26:44.131246] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-16T19:26:44.374935] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-04. [2025-09-16T19:26:44.716530] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-16T19:26:45.174954] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-06. [2025-09-16T19:26:45.974971] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-04. [2025-09-16T19:26:46.134442] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-16T19:26:46.774949] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-03. [2025-09-16T19:26:47.377931] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-16T19:26:47.572385] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-16T19:26:47.580542] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-07. [2025-09-16T19:26:48.374955] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-05. [2025-09-16T19:26:48.589235] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-16T19:26:49.174973] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-04. [2025-09-16T19:26:49.855274] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-16T19:26:49.905440] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-16T19:26:49.974913] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-08. [2025-09-16T19:26:50.616364] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-16T19:26:50.774911] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-05. [2025-09-16T19:26:51.574967] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-05. [2025-09-16T19:26:51.890441] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-16T19:26:52.375048] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-06. [2025-09-16T19:26:52.374971] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-16T19:26:53.174937] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-06. [2025-09-16T19:26:53.334457] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-16T19:26:53.687621] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-16T19:26:53.974941] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-06. [2025-09-16T19:26:54.768949] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-16T19:26:54.777415] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-07. [2025-09-16T19:26:55.585253] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-09. [2025-09-16T19:26:55.604817] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-16T19:26:56.374934] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-07. [2025-09-16T19:26:56.735724] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-16T19:26:57.174969] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-07. [2025-09-16T19:26:57.725947] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-16T19:26:57.732655] [INFO ] [REMOTE ] MO: Full fetch complete (58433 records). [2025-09-16T19:26:57.732767] [DEBUG] [VALIDATOR ] MO: Validating primary data. [2025-09-16T19:26:57.990098] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-08. [2025-09-16T19:26:58.119439] [DEBUG] [VALIDATOR ] MO: All expected trading days are present. [2025-09-16T19:26:58.119532] [DEBUG] [VALIDATOR ] MO: Primary data validation passed. [2025-09-16T19:26:58.120411] [INFO ] [MAIN ] MO: Fetched primary data is valid. [2025-09-16T19:26:58.120468] [DEBUG] [LOCAL ] MO: Saving primary data. [2025-09-16T19:26:58.121955] [DEBUG] [LOCAL ] MO: Trimmed 58433 records to 40104 (keeping 150 days of data) [2025-09-16T19:26:58.260726] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-16T19:26:58.447091] [DEBUG] [LOCAL ] MO: Primary data saved (40104 records). [2025-09-16T19:26:58.448569] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-16T19:26:58.447599] [INFO ] [MAIN ] MO: Full history saved. [2025-09-16T19:26:58.458140] [INFO ] [MAIN ] Update Progress: 1384/2369 symbols completed. MO took 35.4s. Estimated remaining: 1h 44m 34s. Rate: 9.4 symbols/min [2025-09-16T19:26:58.626958] [INFO ] [MAIN ] MOS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:26:58.665312] [DEBUG] [LOCAL ] MOS: Loaded 39505 existing records from primary storage. [2025-09-16T19:26:58.665489] [INFO ] [MAIN ] MOS: Loaded 39505 existing records. [2025-09-16T19:26:58.780053] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-08. [2025-09-16T19:26:58.846765] [WARN ] [MAIN ] MOS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:26:58.847000] [INFO ] [MAIN ] MOS: Wiping existing primary data before full refresh. [2025-09-16T19:26:58.847091] [INFO ] [LOCAL ] MOS: Starting deletion of primary data. [2025-09-16T19:26:58.848512] [DEBUG] [LOCAL ] MOS: Deleted primary data file. [2025-09-16T19:26:58.848571] [INFO ] [MAIN ] MOS: Starting full primary refresh. [2025-09-16T19:26:59.197382] [INFO ] [REMOTE ] MOS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:26:59.574883] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-02. [2025-09-16T19:26:59.721430] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-16T19:27:00.374927] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-08. [2025-09-16T19:27:00.627350] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-16T19:27:01.155186] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-16T19:27:01.174845] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-03. [2025-09-16T19:27:01.974936] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-09. [2025-09-16T19:27:02.092103] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-16T19:27:02.774906] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-09. [2025-09-16T19:27:03.017889] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-16T19:27:03.574903] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-09. [2025-09-16T19:27:03.677465] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-16T19:27:03.684977] [INFO ] [REMOTE ] MODG: Full fetch complete (56163 records). [2025-09-16T19:27:03.685097] [DEBUG] [VALIDATOR ] MODG: Validating primary data. [2025-09-16T19:27:04.070494] [DEBUG] [VALIDATOR ] MODG: All expected trading days are present. [2025-09-16T19:27:04.070571] [DEBUG] [VALIDATOR ] MODG: Primary data validation passed. [2025-09-16T19:27:04.071439] [INFO ] [MAIN ] MODG: Fetched primary data is valid. [2025-09-16T19:27:04.071507] [DEBUG] [LOCAL ] MODG: Saving primary data. [2025-09-16T19:27:04.072859] [DEBUG] [LOCAL ] MODG: Trimmed 56163 records to 38532 (keeping 150 days of data) [2025-09-16T19:27:04.296291] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-16T19:27:04.303880] [INFO ] [REMOTE ] MOD: Full fetch complete (50282 records). [2025-09-16T19:27:04.304781] [DEBUG] [VALIDATOR ] MOD: Validating primary data. [2025-09-16T19:27:04.379598] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-04. [2025-09-16T19:27:04.549920] [DEBUG] [LOCAL ] MODG: Primary data saved (38532 records). [2025-09-16T19:27:04.588669] [INFO ] [MAIN ] MODG: Full history saved. [2025-09-16T19:27:04.599665] [INFO ] [MAIN ] Update Progress: 1385/2369 symbols completed. MODG took 25.1s. Estimated remaining: 1h 44m 27s. Rate: 9.4 symbols/min [2025-09-16T19:27:04.890073] [INFO ] [MAIN ] MOV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:27:04.887610] [DEBUG] [VALIDATOR ] MOD: All expected trading days are present. [2025-09-16T19:27:04.890264] [DEBUG] [VALIDATOR ] MOD: Primary data validation passed. [2025-09-16T19:27:04.891289] [INFO ] [MAIN ] MOD: Fetched primary data is valid. [2025-09-16T19:27:04.891421] [DEBUG] [LOCAL ] MOD: Saving primary data. [2025-09-16T19:27:04.893490] [DEBUG] [LOCAL ] MOD: Trimmed 50282 records to 33252 (keeping 150 days of data) [2025-09-16T19:27:04.993242] [DEBUG] [LOCAL ] MOV: Loaded 15399 existing records from primary storage. [2025-09-16T19:27:04.994605] [INFO ] [MAIN ] MOV: Loaded 15399 existing records. [2025-09-16T19:27:05.180072] [WARN ] [MAIN ] MOV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:27:05.184630] [INFO ] [MAIN ] MOV: Wiping existing primary data before full refresh. [2025-09-16T19:27:05.185810] [INFO ] [LOCAL ] MOV: Starting deletion of primary data. [2025-09-16T19:27:05.186882] [DEBUG] [LOCAL ] MOV: Deleted primary data file. [2025-09-16T19:27:05.187428] [INFO ] [MAIN ] MOV: Starting full primary refresh. [2025-09-16T19:27:05.610916] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-16T19:27:05.647784] [INFO ] [REMOTE ] MOV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:27:05.648541] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-02. [2025-09-16T19:27:05.648255] [INFO ] [REMOTE ] MOH: Full fetch complete (45472 records). [2025-09-16T19:27:05.649581] [DEBUG] [VALIDATOR ] MOH: Validating primary data. [2025-09-16T19:27:05.985841] [DEBUG] [LOCAL ] MOD: Primary data saved (33252 records). [2025-09-16T19:27:05.991178] [INFO ] [MAIN ] MOD: Full history saved. [2025-09-16T19:27:05.996575] [INFO ] [MAIN ] Update Progress: 1386/2369 symbols completed. MOD took 30.5s. Estimated remaining: 1h 44m 18s. Rate: 9.4 symbols/min [2025-09-16T19:27:06.082769] [DEBUG] [VALIDATOR ] MOH: All expected trading days are present. [2025-09-16T19:27:06.098181] [DEBUG] [VALIDATOR ] MOH: Primary data validation passed. [2025-09-16T19:27:06.131470] [INFO ] [MAIN ] MOH: Fetched primary data is valid. [2025-09-16T19:27:06.148286] [DEBUG] [LOCAL ] MOH: Saving primary data. [2025-09-16T19:27:06.181207] [DEBUG] [LOCAL ] MOH: Trimmed 45472 records to 31868 (keeping 150 days of data) [2025-09-16T19:27:06.235563] [INFO ] [MAIN ] MP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:27:06.356877] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-16T19:27:06.375450] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-05. [2025-09-16T19:27:06.398856] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-16T19:27:06.422087] [DEBUG] [LOCAL ] MP: Loaded 39704 existing records from primary storage. [2025-09-16T19:27:06.422886] [INFO ] [MAIN ] MP: Loaded 39704 existing records. [2025-09-16T19:27:06.607788] [WARN ] [MAIN ] MP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:27:06.609247] [INFO ] [MAIN ] MP: Wiping existing primary data before full refresh. [2025-09-16T19:27:06.609795] [INFO ] [LOCAL ] MP: Starting deletion of primary data. [2025-09-16T19:27:06.611515] [DEBUG] [LOCAL ] MP: Deleted primary data file. [2025-09-16T19:27:06.611885] [INFO ] [MAIN ] MP: Starting full primary refresh. [2025-09-16T19:27:06.777050] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-03. [2025-09-16T19:27:07.045273] [INFO ] [REMOTE ] MP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:27:07.065793] [DEBUG] [LOCAL ] MOH: Primary data saved (31868 records). [2025-09-16T19:27:07.065973] [INFO ] [MAIN ] MOH: Full history saved. [2025-09-16T19:27:07.067440] [INFO ] [MAIN ] Update Progress: 1387/2369 symbols completed. MOH took 26.1s. Estimated remaining: 1h 44m 7s. Rate: 9.4 symbols/min [2025-09-16T19:27:07.248121] [INFO ] [MAIN ] MPA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:27:07.255182] [DEBUG] [LOCAL ] MPA: Loaded 3946 existing records from primary storage. [2025-09-16T19:27:07.255305] [INFO ] [MAIN ] MPA: Loaded 3946 existing records. [2025-09-16T19:27:07.430097] [WARN ] [MAIN ] MPA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:27:07.430334] [INFO ] [MAIN ] MPA: Wiping existing primary data before full refresh. [2025-09-16T19:27:07.430380] [INFO ] [LOCAL ] MPA: Starting deletion of primary data. [2025-09-16T19:27:07.430620] [DEBUG] [LOCAL ] MPA: Deleted primary data file. [2025-09-16T19:27:07.430722] [INFO ] [MAIN ] MPA: Starting full primary refresh. [2025-09-16T19:27:07.580008] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-02. [2025-09-16T19:27:07.785894] [INFO ] [REMOTE ] MPA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:27:08.036560] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-16T19:27:08.249935] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-16T19:27:08.374877] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-02. [2025-09-16T19:27:08.973852] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-16T19:27:09.174884] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-04. [2025-09-16T19:27:09.553793] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-16T19:27:09.974899] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-03. [2025-09-16T19:27:10.546332] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-16T19:27:10.565468] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-16T19:27:10.774917] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-06. [2025-09-16T19:27:11.574902] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-05. [2025-09-16T19:27:12.374957] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-04. [2025-09-16T19:27:12.616886] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-16T19:27:12.669685] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-16T19:27:13.178362] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-03. [2025-09-16T19:27:13.180598] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-16T19:27:13.974960] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-05. [2025-09-16T19:27:14.565077] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-16T19:27:14.774899] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-06. [2025-09-16T19:27:14.887946] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-16T19:27:15.549802] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-16T19:27:15.574879] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-07. [2025-09-16T19:27:16.374922] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-06. [2025-09-16T19:27:17.174920] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-04. [2025-09-16T19:27:17.391519] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-16T19:27:17.457442] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-16T19:27:17.974947] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-08. [2025-09-16T19:27:18.774955] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-07. [2025-09-16T19:27:19.421401] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-16T19:27:19.574947] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-05. [2025-09-16T19:27:19.834334] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-16T19:27:19.858574] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-16T19:27:20.374966] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-07. [2025-09-16T19:27:20.993520] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-16T19:27:21.174972] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-08. [2025-09-16T19:27:21.585535] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-16T19:27:21.974925] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-09. [2025-09-16T19:27:22.164943] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-16T19:27:22.774916] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-06. [2025-09-16T19:27:23.574947] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-08. [2025-09-16T19:27:23.615527] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-16T19:27:23.621941] [INFO ] [REMOTE ] MOS: Full fetch complete (58190 records). [2025-09-16T19:27:23.622075] [DEBUG] [VALIDATOR ] MOS: Validating primary data. [2025-09-16T19:27:24.002038] [DEBUG] [VALIDATOR ] MOS: All expected trading days are present. [2025-09-16T19:27:24.002126] [DEBUG] [VALIDATOR ] MOS: Primary data validation passed. [2025-09-16T19:27:24.003001] [INFO ] [MAIN ] MOS: Fetched primary data is valid. [2025-09-16T19:27:24.003049] [DEBUG] [LOCAL ] MOS: Saving primary data. [2025-09-16T19:27:24.004210] [DEBUG] [LOCAL ] MOS: Trimmed 58190 records to 39894 (keeping 150 days of data) [2025-09-16T19:27:24.223028] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-16T19:27:24.259496] [DEBUG] [LOCAL ] MOS: Primary data saved (39894 records). [2025-09-16T19:27:24.259717] [INFO ] [MAIN ] MOS: Full history saved. [2025-09-16T19:27:24.259836] [INFO ] [MAIN ] Update Progress: 1388/2369 symbols completed. MOS took 25.8s. Estimated remaining: 1h 44m 9s. Rate: 9.4 symbols/min [2025-09-16T19:27:24.380006] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-09. [2025-09-16T19:27:24.431237] [INFO ] [MAIN ] MPC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:27:24.469764] [DEBUG] [LOCAL ] MPC: Loaded 38350 existing records from primary storage. [2025-09-16T19:27:24.469908] [INFO ] [MAIN ] MPC: Loaded 38350 existing records. [2025-09-16T19:27:24.647877] [WARN ] [MAIN ] MPC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:27:24.648115] [INFO ] [MAIN ] MPC: Wiping existing primary data before full refresh. [2025-09-16T19:27:24.648163] [INFO ] [LOCAL ] MPC: Starting deletion of primary data. [2025-09-16T19:27:24.649069] [DEBUG] [LOCAL ] MPC: Deleted primary data file. [2025-09-16T19:27:24.649118] [INFO ] [MAIN ] MPC: Starting full primary refresh. [2025-09-16T19:27:25.003711] [INFO ] [REMOTE ] MPC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:27:25.174937] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-02. [2025-09-16T19:27:25.409598] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-06 (2.63 seconds). [2025-09-16T19:27:25.521194] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-16T19:27:25.524354] [INFO ] [REMOTE ] MOV: Full fetch complete (24008 records). [2025-09-16T19:27:25.524457] [DEBUG] [VALIDATOR ] MOV: Validating primary data. [2025-09-16T19:27:25.883335] [DEBUG] [VALIDATOR ] MOV: All expected trading days are present. [2025-09-16T19:27:25.883456] [DEBUG] [VALIDATOR ] MOV: Primary data validation passed. [2025-09-16T19:27:25.884006] [INFO ] [MAIN ] MOV: Fetched primary data is valid. [2025-09-16T19:27:25.884082] [DEBUG] [LOCAL ] MOV: Saving primary data. [2025-09-16T19:27:25.884776] [DEBUG] [LOCAL ] MOV: Trimmed 24008 records to 15530 (keeping 150 days of data) [2025-09-16T19:27:25.980789] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-09. [2025-09-16T19:27:25.989721] [DEBUG] [LOCAL ] MOV: Primary data saved (15530 records). [2025-09-16T19:27:25.989856] [INFO ] [MAIN ] MOV: Full history saved. [2025-09-16T19:27:25.989956] [INFO ] [MAIN ] Update Progress: 1389/2369 symbols completed. MOV took 21.4s. Estimated remaining: 1h 43m 59s. Rate: 9.4 symbols/min [2025-09-16T19:27:26.194320] [INFO ] [MAIN ] MPLX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:27:26.229862] [DEBUG] [LOCAL ] MPLX: Loaded 37164 existing records from primary storage. [2025-09-16T19:27:26.230005] [INFO ] [MAIN ] MPLX: Loaded 37164 existing records. [2025-09-16T19:27:26.404436] [WARN ] [MAIN ] MPLX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:27:26.404714] [INFO ] [MAIN ] MPLX: Wiping existing primary data before full refresh. [2025-09-16T19:27:26.404785] [INFO ] [LOCAL ] MPLX: Starting deletion of primary data. [2025-09-16T19:27:26.405678] [DEBUG] [LOCAL ] MPLX: Deleted primary data file. [2025-09-16T19:27:26.405734] [INFO ] [MAIN ] MPLX: Starting full primary refresh. [2025-09-16T19:27:26.688452] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-16T19:27:26.715565] [INFO ] [REMOTE ] MPA: Full fetch complete (5711 records). [2025-09-16T19:27:26.715709] [DEBUG] [VALIDATOR ] MPA: Validating primary data. [2025-09-16T19:27:26.789479] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-07. [2025-09-16T19:27:26.768597] [INFO ] [REMOTE ] MPLX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:27:27.139529] [DEBUG] [VALIDATOR ] MPA: All expected trading days are present. [2025-09-16T19:27:27.139670] [DEBUG] [VALIDATOR ] MPA: Primary data validation passed. [2025-09-16T19:27:27.139917] [INFO ] [MAIN ] MPA: Fetched primary data is valid. [2025-09-16T19:27:27.139971] [DEBUG] [LOCAL ] MPA: Saving primary data. [2025-09-16T19:27:27.140563] [DEBUG] [LOCAL ] MPA: Trimmed 5711 records to 4016 (keeping 150 days of data) [2025-09-16T19:27:27.167159] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-16T19:27:27.201689] [DEBUG] [LOCAL ] MPA: Primary data saved (4016 records). [2025-09-16T19:27:27.201782] [INFO ] [MAIN ] MPA: Full history saved. [2025-09-16T19:27:27.201862] [INFO ] [MAIN ] Update Progress: 1390/2369 symbols completed. MPA took 20.1s. Estimated remaining: 1h 43m 49s. Rate: 9.4 symbols/min [2025-09-16T19:27:27.374256] [INFO ] [MAIN ] MPV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:27:27.379098] [DEBUG] [LOCAL ] MPV: Loaded 3301 existing records from primary storage. [2025-09-16T19:27:27.379183] [INFO ] [MAIN ] MPV: Loaded 3301 existing records. [2025-09-16T19:27:27.565919] [WARN ] [MAIN ] MPV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:27:27.566315] [INFO ] [MAIN ] MPV: Wiping existing primary data before full refresh. [2025-09-16T19:27:27.566366] [INFO ] [LOCAL ] MPV: Starting deletion of primary data. [2025-09-16T19:27:27.566609] [DEBUG] [LOCAL ] MPV: Deleted primary data file. [2025-09-16T19:27:27.566684] [INFO ] [MAIN ] MPV: Starting full primary refresh. [2025-09-16T19:27:27.580084] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-03. [2025-09-16T19:27:27.931178] [INFO ] [REMOTE ] MPV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:27:28.375044] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-02. [2025-09-16T19:27:29.174965] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-02. [2025-09-16T19:27:29.486792] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-07 (2.70 seconds). [2025-09-16T19:27:29.573752] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-16T19:27:29.792395] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-16T19:27:29.974936] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-04. [2025-09-16T19:27:30.057779] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-16T19:27:30.774920] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-08. [2025-09-16T19:27:31.574946] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-03. [2025-09-16T19:27:31.897203] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-16T19:27:32.133037] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-16T19:27:32.374889] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-05. [2025-09-16T19:27:33.148230] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-16T19:27:33.174865] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-09. [2025-09-16T19:27:33.974894] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-04. [2025-09-16T19:27:34.218948] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-16T19:27:34.437110] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-16T19:27:34.774911] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-03. [2025-09-16T19:27:35.574904] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-05. [2025-09-16T19:27:35.774731] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-09 (2.60 seconds). [2025-09-16T19:27:35.781842] [INFO ] [REMOTE ] MP: Full fetch complete (58249 records). [2025-09-16T19:27:35.782053] [DEBUG] [VALIDATOR ] MP: Validating primary data. [2025-09-16T19:27:36.185050] [DEBUG] [VALIDATOR ] MP: All expected trading days are present. [2025-09-16T19:27:36.185144] [DEBUG] [VALIDATOR ] MP: Primary data validation passed. [2025-09-16T19:27:36.186031] [INFO ] [MAIN ] MP: Fetched primary data is valid. [2025-09-16T19:27:36.186080] [DEBUG] [LOCAL ] MP: Saving primary data. [2025-09-16T19:27:36.187420] [DEBUG] [LOCAL ] MP: Trimmed 58249 records to 40094 (keeping 150 days of data) [2025-09-16T19:27:36.284686] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-16T19:27:36.381088] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-06. [2025-09-16T19:27:36.455362] [DEBUG] [LOCAL ] MP: Primary data saved (40094 records). [2025-09-16T19:27:36.455560] [INFO ] [MAIN ] MP: Full history saved. [2025-09-16T19:27:36.455671] [INFO ] [MAIN ] Update Progress: 1391/2369 symbols completed. MP took 30.4s. Estimated remaining: 1h 43m 45s. Rate: 9.4 symbols/min [2025-09-16T19:27:36.635202] [INFO ] [MAIN ] MPW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:27:36.667306] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-16T19:27:36.711039] [DEBUG] [LOCAL ] MPW: Loaded 39513 existing records from primary storage. [2025-09-16T19:27:36.711215] [INFO ] [MAIN ] MPW: Loaded 39513 existing records. [2025-09-16T19:27:36.891794] [WARN ] [MAIN ] MPW: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:27:36.892084] [INFO ] [MAIN ] MPW: Wiping existing primary data before full refresh. [2025-09-16T19:27:36.892131] [INFO ] [LOCAL ] MPW: Starting deletion of primary data. [2025-09-16T19:27:36.893487] [DEBUG] [LOCAL ] MPW: Deleted primary data file. [2025-09-16T19:27:36.893551] [INFO ] [MAIN ] MPW: Starting full primary refresh. [2025-09-16T19:27:37.053182] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-16T19:27:37.179983] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-04. [2025-09-16T19:27:37.283393] [INFO ] [REMOTE ] MPW: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:27:37.974898] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-02. [2025-09-16T19:27:38.774893] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-07. [2025-09-16T19:27:39.169666] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-16T19:27:39.195801] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-16T19:27:39.574913] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-05. [2025-09-16T19:27:39.723282] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-16T19:27:40.374918] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-03. [2025-09-16T19:27:40.998958] [DEBUG] [REMOTE ] MPW: Error fetching primary data for 2025-03: Server request status code is 503. [2025-09-16T19:27:40.999277] [WARN ] [REMOTE ] MPW: No data returned for month 2025-03 [2025-09-16T19:27:41.174933] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-04. [2025-09-16T19:27:41.330297] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-16T19:27:41.974984] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-06. [2025-09-16T19:27:42.774933] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-06. [2025-09-16T19:27:43.186591] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-16T19:27:43.574877] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-05. [2025-09-16T19:27:43.659459] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-16T19:27:44.237291] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-16T19:27:44.374939] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-08. [2025-09-16T19:27:44.676300] [DEBUG] [REMOTE ] MPV: Error fetching primary data for 2025-08: Server request status code is 503. [2025-09-16T19:27:44.676621] [WARN ] [REMOTE ] MPV: No data returned for month 2025-08 [2025-09-16T19:27:45.161124] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-16T19:27:45.174870] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-06. [2025-09-16T19:27:45.974922] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-09. [2025-09-16T19:27:46.595297] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-16T19:27:46.596443] [INFO ] [REMOTE ] MPV: Full fetch complete (5250 records). [2025-09-16T19:27:46.596513] [DEBUG] [VALIDATOR ] MPV: Validating primary data. [2025-09-16T19:27:46.780461] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-07. [2025-09-16T19:27:46.786405] [WARN ] [VALIDATOR ] MPV: Validation failed - insufficient historical data. Have 129 unique days, need 150 days [2025-09-16T19:27:46.787831] [FATAL] [MAIN ] MPV: Fetched primary data is invalid. Refusing to save it. [2025-09-16T19:27:46.787891] [WARN ] [MAIN ] MPV: Deleting existing primary and derivative data due to validation failure. [2025-09-16T19:27:46.787938] [INFO ] [LOCAL ] MPV: Starting deletion of primary data. [2025-09-16T19:27:46.788006] [DEBUG] [LOCAL ] MPV: No primary data file found to delete. [2025-09-16T19:27:46.788046] [INFO ] [LOCAL ] MPV: Starting deletion of derivative data. [2025-09-16T19:27:46.788369] [DEBUG] [LOCAL ] MPV: Deleted derivative data file. [2025-09-16T19:27:46.788553] [INFO ] [MAIN ] Update Progress: 1392/2369 symbols completed. MPV took 19.6s. Estimated remaining: 1h 43m 41s. Rate: 9.4 symbols/min [2025-09-16T19:27:46.962601] [INFO ] [MAIN ] MPX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:27:46.967140] [DEBUG] [LOCAL ] MPX: Loaded 2844 existing records from primary storage. [2025-09-16T19:27:46.967221] [INFO ] [MAIN ] MPX: Loaded 2844 existing records. [2025-09-16T19:27:47.154183] [WARN ] [MAIN ] MPX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:27:47.154715] [INFO ] [MAIN ] MPX: Wiping existing primary data before full refresh. [2025-09-16T19:27:47.154930] [INFO ] [LOCAL ] MPX: Starting deletion of primary data. [2025-09-16T19:27:47.155392] [DEBUG] [LOCAL ] MPX: Deleted primary data file. [2025-09-16T19:27:47.155451] [INFO ] [MAIN ] MPX: Starting full primary refresh. [2025-09-16T19:27:47.458271] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-09-16T19:27:47.581546] [INFO ] [REMOTE ] MPX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:27:47.581685] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-07. [2025-09-16T19:27:48.372066] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-16T19:27:48.381773] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-07. [2025-09-16T19:27:49.174907] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-08. [2025-09-16T19:27:49.493254] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-16T19:27:49.974931] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-02. [2025-09-16T19:27:50.275140] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-16T19:27:50.362876] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-16T19:27:50.712758] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-16T19:27:50.774932] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-03. [2025-09-16T19:27:51.386454] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-16T19:27:51.574912] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-04. [2025-09-16T19:27:52.154511] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-16T19:27:52.374966] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-05. [2025-09-16T19:27:52.847988] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-16T19:27:53.174912] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-09. [2025-09-16T19:27:53.974919] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-06. [2025-09-16T19:27:54.539619] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-16T19:27:54.774940] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-08. [2025-09-16T19:27:54.901672] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-16T19:27:54.907940] [INFO ] [REMOTE ] MPLX: Full fetch complete (55382 records). [2025-09-16T19:27:54.908045] [DEBUG] [VALIDATOR ] MPLX: Validating primary data. [2025-09-16T19:27:55.293239] [DEBUG] [VALIDATOR ] MPLX: All expected trading days are present. [2025-09-16T19:27:55.293319] [DEBUG] [VALIDATOR ] MPLX: Primary data validation passed. [2025-09-16T19:27:55.294139] [INFO ] [MAIN ] MPLX: Fetched primary data is valid. [2025-09-16T19:27:55.294203] [DEBUG] [LOCAL ] MPLX: Saving primary data. [2025-09-16T19:27:55.295301] [DEBUG] [LOCAL ] MPLX: Trimmed 55382 records to 37526 (keeping 150 days of data) [2025-09-16T19:27:55.527555] [DEBUG] [LOCAL ] MPLX: Primary data saved (37526 records). [2025-09-16T19:27:55.527737] [INFO ] [MAIN ] MPLX: Full history saved. [2025-09-16T19:27:55.528819] [INFO ] [MAIN ] Update Progress: 1393/2369 symbols completed. MPLX took 29.5s. Estimated remaining: 1h 43m 36s. Rate: 9.4 symbols/min [2025-09-16T19:27:55.585462] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-08. [2025-09-16T19:27:55.703155] [INFO ] [MAIN ] MQT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:27:55.710415] [DEBUG] [LOCAL ] MQT: Loaded 5280 existing records from primary storage. [2025-09-16T19:27:55.710551] [INFO ] [MAIN ] MQT: Loaded 5280 existing records. [2025-09-16T19:27:55.886093] [WARN ] [MAIN ] MQT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:27:55.886330] [INFO ] [MAIN ] MQT: Wiping existing primary data before full refresh. [2025-09-16T19:27:55.886378] [INFO ] [LOCAL ] MQT: Starting deletion of primary data. [2025-09-16T19:27:55.886743] [DEBUG] [LOCAL ] MQT: Deleted primary data file. [2025-09-16T19:27:55.886801] [INFO ] [MAIN ] MQT: Starting full primary refresh. [2025-09-16T19:27:56.241582] [INFO ] [REMOTE ] MQT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:27:56.374862] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-02. [2025-09-16T19:27:56.469556] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-16T19:27:56.831068] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-16T19:27:57.174940] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-03. [2025-09-16T19:27:57.974935] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-07. [2025-09-16T19:27:57.991918] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-16T19:27:58.317841] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-08 (2.73 seconds). [2025-09-16T19:27:58.569611] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-16T19:27:58.774929] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-04. [2025-09-16T19:27:59.574904] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-09. [2025-09-16T19:27:59.628055] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-16T19:28:00.374908] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-08. [2025-09-16T19:28:00.968680] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-16T19:28:01.174931] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-05. [2025-09-16T19:28:01.370130] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-16T19:28:01.376570] [INFO ] [REMOTE ] MPC: Full fetch complete (56772 records). [2025-09-16T19:28:01.376770] [DEBUG] [VALIDATOR ] MPC: Validating primary data. [2025-09-16T19:28:01.675435] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-16T19:28:01.772924] [DEBUG] [VALIDATOR ] MPC: All expected trading days are present. [2025-09-16T19:28:01.773014] [DEBUG] [VALIDATOR ] MPC: Primary data validation passed. [2025-09-16T19:28:01.774023] [INFO ] [MAIN ] MPC: Fetched primary data is valid. [2025-09-16T19:28:01.774115] [DEBUG] [LOCAL ] MPC: Saving primary data. [2025-09-16T19:28:01.775406] [DEBUG] [LOCAL ] MPC: Trimmed 56772 records to 38723 (keeping 150 days of data) [2025-09-16T19:28:01.996487] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-09. [2025-09-16T19:28:02.031483] [DEBUG] [LOCAL ] MPC: Primary data saved (38723 records). [2025-09-16T19:28:02.031617] [INFO ] [MAIN ] MPC: Full history saved. [2025-09-16T19:28:02.033248] [INFO ] [MAIN ] Update Progress: 1394/2369 symbols completed. MPC took 37.8s. Estimated remaining: 1h 43m 30s. Rate: 9.4 symbols/min [2025-09-16T19:28:02.200341] [INFO ] [MAIN ] MQY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:28:02.216118] [DEBUG] [LOCAL ] MQY: Loaded 11648 existing records from primary storage. [2025-09-16T19:28:02.216247] [INFO ] [MAIN ] MQY: Loaded 11648 existing records. [2025-09-16T19:28:02.390544] [WARN ] [MAIN ] MQY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:28:02.390810] [INFO ] [MAIN ] MQY: Wiping existing primary data before full refresh. [2025-09-16T19:28:02.390856] [INFO ] [LOCAL ] MQY: Starting deletion of primary data. [2025-09-16T19:28:02.391216] [DEBUG] [LOCAL ] MQY: Deleted primary data file. [2025-09-16T19:28:02.391260] [INFO ] [MAIN ] MQY: Starting full primary refresh. [2025-09-16T19:28:02.674422] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-16T19:28:02.681003] [INFO ] [REMOTE ] MPX: Full fetch complete (4786 records). [2025-09-16T19:28:02.691257] [DEBUG] [VALIDATOR ] MPX: Validating primary data. [2025-09-16T19:28:02.783314] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-06. [2025-09-16T19:28:02.822795] [INFO ] [REMOTE ] MQY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:28:03.109213] [DEBUG] [VALIDATOR ] MPX: All expected trading days are present. [2025-09-16T19:28:03.109289] [DEBUG] [VALIDATOR ] MPX: Primary data validation passed. [2025-09-16T19:28:03.109429] [INFO ] [MAIN ] MPX: Fetched primary data is valid. [2025-09-16T19:28:03.109469] [DEBUG] [LOCAL ] MPX: Saving primary data. [2025-09-16T19:28:03.109857] [DEBUG] [LOCAL ] MPX: Trimmed 4786 records to 2879 (keeping 150 days of data) [2025-09-16T19:28:03.127689] [DEBUG] [LOCAL ] MPX: Primary data saved (2879 records). [2025-09-16T19:28:03.127755] [INFO ] [MAIN ] MPX: Full history saved. [2025-09-16T19:28:03.127842] [INFO ] [MAIN ] Update Progress: 1395/2369 symbols completed. MPX took 16.3s. Estimated remaining: 1h 43m 20s. Rate: 9.4 symbols/min [2025-09-16T19:28:03.299797] [INFO ] [MAIN ] MRC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:28:03.326276] [DEBUG] [LOCAL ] MRC: Loaded 26794 existing records from primary storage. [2025-09-16T19:28:03.326426] [INFO ] [MAIN ] MRC: Loaded 26794 existing records. [2025-09-16T19:28:03.505401] [WARN ] [MAIN ] MRC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:28:03.505637] [INFO ] [MAIN ] MRC: Wiping existing primary data before full refresh. [2025-09-16T19:28:03.505706] [INFO ] [LOCAL ] MRC: Starting deletion of primary data. [2025-09-16T19:28:03.506185] [DEBUG] [LOCAL ] MRC: Deleted primary data file. [2025-09-16T19:28:03.506230] [INFO ] [MAIN ] MRC: Starting full primary refresh. [2025-09-16T19:28:03.576834] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-02. [2025-09-16T19:28:03.615253] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-16T19:28:03.866795] [INFO ] [REMOTE ] MRC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:28:04.374900] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-02. [2025-09-16T19:28:04.489384] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-16T19:28:05.174948] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-07. [2025-09-16T19:28:05.875198] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-16T19:28:05.902837] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-16T19:28:05.974924] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-09. [2025-09-16T19:28:06.774910] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-08. [2025-09-16T19:28:07.492663] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-16T19:28:07.574992] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-03. [2025-09-16T19:28:07.912787] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-16T19:28:07.919346] [INFO ] [REMOTE ] MPW: Full fetch complete (49996 records). [2025-09-16T19:28:07.919468] [DEBUG] [VALIDATOR ] MPW: Validating primary data. [2025-09-16T19:28:08.106831] [WARN ] [VALIDATOR ] MPW: Validation failed - insufficient historical data. Have 129 unique days, need 150 days [2025-09-16T19:28:08.107369] [FATAL] [MAIN ] MPW: Fetched primary data is invalid. Refusing to save it. [2025-09-16T19:28:08.107419] [WARN ] [MAIN ] MPW: Deleting existing primary and derivative data due to validation failure. [2025-09-16T19:28:08.107459] [INFO ] [LOCAL ] MPW: Starting deletion of primary data. [2025-09-16T19:28:08.107519] [DEBUG] [LOCAL ] MPW: No primary data file found to delete. [2025-09-16T19:28:08.107570] [INFO ] [LOCAL ] MPW: Starting deletion of derivative data. [2025-09-16T19:28:08.107853] [DEBUG] [LOCAL ] MPW: Deleted derivative data file. [2025-09-16T19:28:08.107956] [INFO ] [MAIN ] Update Progress: 1396/2369 symbols completed. MPW took 31.7s. Estimated remaining: 1h 43m 13s. Rate: 9.4 symbols/min [2025-09-16T19:28:08.278176] [INFO ] [MAIN ] MRK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:28:08.316536] [DEBUG] [LOCAL ] MRK: Loaded 39751 existing records from primary storage. [2025-09-16T19:28:08.316732] [INFO ] [MAIN ] MRK: Loaded 39751 existing records. [2025-09-16T19:28:08.380097] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-03. [2025-09-16T19:28:08.495053] [WARN ] [MAIN ] MRK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:28:08.495293] [INFO ] [MAIN ] MRK: Wiping existing primary data before full refresh. [2025-09-16T19:28:08.495339] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-09-16T19:28:08.496178] [DEBUG] [LOCAL ] MRK: Deleted primary data file. [2025-09-16T19:28:08.496239] [INFO ] [MAIN ] MRK: Starting full primary refresh. [2025-09-16T19:28:08.818140] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-16T19:28:08.885972] [INFO ] [REMOTE ] MRK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:28:09.174911] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-02. [2025-09-16T19:28:09.665547] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-16T19:28:09.974935] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-09. [2025-09-16T19:28:10.739785] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-16T19:28:10.741628] [INFO ] [REMOTE ] MQT: Full fetch complete (9341 records). [2025-09-16T19:28:10.741750] [DEBUG] [VALIDATOR ] MQT: Validating primary data. [2025-09-16T19:28:10.784867] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-04. [2025-09-16T19:28:11.105131] [DEBUG] [VALIDATOR ] MQT: All expected trading days are present. [2025-09-16T19:28:11.105221] [DEBUG] [VALIDATOR ] MQT: Primary data validation passed. [2025-09-16T19:28:11.105450] [INFO ] [MAIN ] MQT: Fetched primary data is valid. [2025-09-16T19:28:11.105489] [DEBUG] [LOCAL ] MQT: Saving primary data. [2025-09-16T19:28:11.105921] [DEBUG] [LOCAL ] MQT: Trimmed 9341 records to 5341 (keeping 150 days of data) [2025-09-16T19:28:11.142501] [DEBUG] [LOCAL ] MQT: Primary data saved (5341 records). [2025-09-16T19:28:11.142765] [INFO ] [MAIN ] MQT: Full history saved. [2025-09-16T19:28:11.142871] [INFO ] [MAIN ] Update Progress: 1397/2369 symbols completed. MQT took 15.6s. Estimated remaining: 1h 43m 4s. Rate: 9.4 symbols/min [2025-09-16T19:28:11.222763] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-16T19:28:11.494583] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-16T19:28:11.574865] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-05. [2025-09-16T19:28:12.374905] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-03. [2025-09-16T19:28:12.578263] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-16T19:28:13.174949] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-04. [2025-09-16T19:28:13.975002] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-06. [2025-09-16T19:28:14.306735] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-16T19:28:14.631663] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-16T19:28:14.658801] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-16T19:28:14.774886] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-05. [2025-09-16T19:28:15.574945] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-07. [2025-09-16T19:28:16.178839] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-16T19:28:16.374938] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-04. [2025-09-16T19:28:16.526506] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-16T19:28:17.174904] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-08. [2025-09-16T19:28:17.925380] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-16T19:28:17.974854] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-09. [2025-09-16T19:28:18.620733] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-16T19:28:18.695659] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-16T19:28:18.698587] [INFO ] [REMOTE ] MQY: Full fetch complete (18324 records). [2025-09-16T19:28:18.698689] [DEBUG] [VALIDATOR ] MQY: Validating primary data. [2025-09-16T19:28:18.779974] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-06. [2025-09-16T19:28:19.094855] [DEBUG] [VALIDATOR ] MQY: All expected trading days are present. [2025-09-16T19:28:19.094949] [DEBUG] [VALIDATOR ] MQY: Primary data validation passed. [2025-09-16T19:28:19.095379] [INFO ] [MAIN ] MQY: Fetched primary data is valid. [2025-09-16T19:28:19.095427] [DEBUG] [LOCAL ] MQY: Saving primary data. [2025-09-16T19:28:19.096021] [DEBUG] [LOCAL ] MQY: Trimmed 18324 records to 11779 (keeping 150 days of data) [2025-09-16T19:28:19.169931] [DEBUG] [LOCAL ] MQY: Primary data saved (11779 records). [2025-09-16T19:28:19.170076] [INFO ] [MAIN ] MQY: Full history saved. [2025-09-16T19:28:19.170164] [INFO ] [MAIN ] Update Progress: 1398/2369 symbols completed. MQY took 17.1s. Estimated remaining: 1h 42m 59s. Rate: 9.4 symbols/min [2025-09-16T19:28:19.574906] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-05. [2025-09-16T19:28:19.811059] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-16T19:28:20.374913] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-07. [2025-09-16T19:28:21.643976] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-16T19:28:21.653568] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-08. [2025-09-16T19:28:21.920540] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-09-16T19:28:21.974912] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-06. [2025-09-16T19:28:22.939332] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-16T19:28:22.947259] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-09. [2025-09-16T19:28:24.127443] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-16T19:28:24.139554] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-07. [2025-09-16T19:28:24.164771] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-16T19:28:24.169092] [INFO ] [REMOTE ] MRC: Full fetch complete (41079 records). [2025-09-16T19:28:24.169189] [DEBUG] [VALIDATOR ] MRC: Validating primary data. [2025-09-16T19:28:24.567309] [DEBUG] [VALIDATOR ] MRC: All expected trading days are present. [2025-09-16T19:28:24.567399] [DEBUG] [VALIDATOR ] MRC: Primary data validation passed. [2025-09-16T19:28:24.568108] [INFO ] [MAIN ] MRC: Fetched primary data is valid. [2025-09-16T19:28:24.568158] [DEBUG] [LOCAL ] MRC: Saving primary data. [2025-09-16T19:28:24.569252] [DEBUG] [LOCAL ] MRC: Trimmed 41079 records to 27104 (keeping 150 days of data) [2025-09-16T19:28:24.739396] [DEBUG] [LOCAL ] MRC: Primary data saved (27104 records). [2025-09-16T19:28:24.739554] [INFO ] [MAIN ] MRC: Full history saved. [2025-09-16T19:28:24.739751] [INFO ] [MAIN ] Update Progress: 1399/2369 symbols completed. MRC took 21.6s. Estimated remaining: 1h 42m 52s. Rate: 9.4 symbols/min [2025-09-16T19:28:26.474101] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-09-16T19:28:26.485969] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-08. [2025-09-16T19:28:28.592729] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-16T19:28:28.604288] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-09. [2025-09-16T19:28:30.776942] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-16T19:28:30.789845] [INFO ] [REMOTE ] MRK: Full fetch complete (58469 records). [2025-09-16T19:28:30.790091] [DEBUG] [VALIDATOR ] MRK: Validating primary data. [2025-09-16T19:28:31.191453] [DEBUG] [VALIDATOR ] MRK: All expected trading days are present. [2025-09-16T19:28:31.191531] [DEBUG] [VALIDATOR ] MRK: Primary data validation passed. [2025-09-16T19:28:31.192372] [INFO ] [MAIN ] MRK: Fetched primary data is valid. [2025-09-16T19:28:31.192419] [DEBUG] [LOCAL ] MRK: Saving primary data. [2025-09-16T19:28:31.193705] [DEBUG] [LOCAL ] MRK: Trimmed 58469 records to 40141 (keeping 150 days of data) [2025-09-16T19:28:31.441748] [DEBUG] [LOCAL ] MRK: Primary data saved (40141 records). [2025-09-16T19:28:31.441874] [INFO ] [MAIN ] MRK: Full history saved. [2025-09-16T19:28:31.441980] [INFO ] [MAIN ] Update Progress: 1400/2369 symbols completed. MRK took 23.3s. Estimated remaining: 1h 42m 46s. Rate: 9.4 symbols/min [2025-09-16T19:28:32.116121] [INFO ] [MAIN ] MS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:28:32.117911] [INFO ] [MAIN ] MRP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:28:32.204307] [INFO ] [MAIN ] MSB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:28:32.209824] [INFO ] [MAIN ] MSA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:28:32.221565] [DEBUG] [LOCAL ] MSB: Loaded 5948 existing records from primary storage. [2025-09-16T19:28:32.221837] [INFO ] [MAIN ] MSB: Loaded 5948 existing records. [2025-09-16T19:28:32.347736] [DEBUG] [LOCAL ] MSA: Loaded 13825 existing records from primary storage. [2025-09-16T19:28:32.357287] [INFO ] [MAIN ] MSA: Loaded 13825 existing records. [2025-09-16T19:28:32.526078] [DEBUG] [LOCAL ] MRP: Loaded 34180 existing records from primary storage. [2025-09-16T19:28:32.529861] [WARN ] [MAIN ] MSB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:28:32.545542] [INFO ] [MAIN ] MRP: Loaded 34180 existing records. [2025-09-16T19:28:32.556728] [DEBUG] [LOCAL ] MS: Loaded 39657 existing records from primary storage. [2025-09-16T19:28:32.597043] [INFO ] [MAIN ] MSB: Wiping existing primary data before full refresh. [2025-09-16T19:28:32.597270] [INFO ] [MAIN ] MS: Loaded 39657 existing records. [2025-09-16T19:28:32.608115] [INFO ] [LOCAL ] MSB: Starting deletion of primary data. [2025-09-16T19:28:32.657142] [DEBUG] [LOCAL ] MSB: Deleted primary data file. [2025-09-16T19:28:32.685438] [INFO ] [MAIN ] MSB: Starting full primary refresh. [2025-09-16T19:28:32.917507] [WARN ] [MAIN ] MSA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:28:32.987377] [INFO ] [MAIN ] MSA: Wiping existing primary data before full refresh. [2025-09-16T19:28:33.018983] [INFO ] [LOCAL ] MSA: Starting deletion of primary data. [2025-09-16T19:28:33.048961] [WARN ] [MAIN ] MRP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:28:33.092158] [DEBUG] [LOCAL ] MSA: Deleted primary data file. [2025-09-16T19:28:33.114891] [INFO ] [MAIN ] MSA: Starting full primary refresh. [2025-09-16T19:28:33.115018] [WARN ] [MAIN ] MS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:28:33.115156] [INFO ] [MAIN ] MRP: Wiping existing primary data before full refresh. [2025-09-16T19:28:33.142030] [INFO ] [MAIN ] MS: Wiping existing primary data before full refresh. [2025-09-16T19:28:33.156420] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-09-16T19:28:33.161606] [INFO ] [LOCAL ] MS: Starting deletion of primary data. [2025-09-16T19:28:33.187356] [DEBUG] [LOCAL ] MS: Deleted primary data file. [2025-09-16T19:28:33.197663] [DEBUG] [LOCAL ] MRP: Deleted primary data file. [2025-09-16T19:28:33.203341] [INFO ] [MAIN ] MRP: Starting full primary refresh. [2025-09-16T19:28:33.220695] [INFO ] [MAIN ] MS: Starting full primary refresh. [2025-09-16T19:28:34.221792] [INFO ] [REMOTE ] MSB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:28:34.254945] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-02. [2025-09-16T19:28:34.428257] [INFO ] [REMOTE ] MSA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:28:34.461743] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-02. [2025-09-16T19:28:34.465829] [INFO ] [REMOTE ] MRP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:28:34.491331] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-02. [2025-09-16T19:28:34.539944] [INFO ] [REMOTE ] MS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:28:34.540509] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-02. [2025-09-16T19:28:35.285343] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-16T19:28:35.288198] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-03. [2025-09-16T19:28:35.540939] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-16T19:28:35.545076] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-03. [2025-09-16T19:28:35.981254] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-16T19:28:35.995833] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-03. [2025-09-16T19:28:36.014982] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-16T19:28:36.018256] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-04. [2025-09-16T19:28:36.049279] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-16T19:28:36.059259] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-03. [2025-09-16T19:28:36.450282] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-16T19:28:36.454800] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-04. [2025-09-16T19:28:36.502404] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-16T19:28:36.506125] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-05. [2025-09-16T19:28:36.985139] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-16T19:28:36.987517] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-06. [2025-09-16T19:28:37.358599] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-16T19:28:37.369823] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-04. [2025-09-16T19:28:37.385138] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-16T19:28:37.390545] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-05. [2025-09-16T19:28:37.411279] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-16T19:28:37.413575] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-07. [2025-09-16T19:28:38.063000] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-16T19:28:38.074623] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-04. [2025-09-16T19:28:38.280009] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-16T19:28:38.472969] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-16T19:28:38.707805] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-16T19:28:38.774895] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-08. [2025-09-16T19:28:39.537903] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-16T19:28:39.574917] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-05. [2025-09-16T19:28:40.202998] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-16T19:28:40.374958] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-05. [2025-09-16T19:28:40.803731] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-16T19:28:41.174919] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-09. [2025-09-16T19:28:41.902369] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-16T19:28:41.903678] [INFO ] [REMOTE ] MSB: Full fetch complete (9134 records). [2025-09-16T19:28:41.903773] [DEBUG] [VALIDATOR ] MSB: Validating primary data. [2025-09-16T19:28:41.979990] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-06. [2025-09-16T19:28:42.286078] [DEBUG] [VALIDATOR ] MSB: All expected trading days are present. [2025-09-16T19:28:42.286206] [DEBUG] [VALIDATOR ] MSB: Primary data validation passed. [2025-09-16T19:28:42.286507] [INFO ] [MAIN ] MSB: Fetched primary data is valid. [2025-09-16T19:28:42.286605] [DEBUG] [LOCAL ] MSB: Saving primary data. [2025-09-16T19:28:42.287244] [DEBUG] [LOCAL ] MSB: Trimmed 9134 records to 5977 (keeping 150 days of data) [2025-09-16T19:28:42.325623] [DEBUG] [LOCAL ] MSB: Primary data saved (5977 records). [2025-09-16T19:28:42.325876] [INFO ] [MAIN ] MSB: Full history saved. [2025-09-16T19:28:42.326054] [INFO ] [MAIN ] Update Progress: 1401/2369 symbols completed. MSB took 10.9s. Estimated remaining: 1h 42m 43s. Rate: 9.4 symbols/min [2025-09-16T19:28:42.525587] [INFO ] [MAIN ] MSC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:28:42.528588] [DEBUG] [LOCAL ] MSC: No existing data file found in primary storage. [2025-09-16T19:28:42.528662] [WARN ] [MAIN ] MSC: No existing data found, performing full refresh instead. [2025-09-16T19:28:42.530588] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-16T19:28:42.529366] [INFO ] [MAIN ] MSC: Wiping existing primary data before full refresh. [2025-09-16T19:28:42.541166] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-09-16T19:28:42.541299] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-09-16T19:28:42.541481] [INFO ] [MAIN ] MSC: Starting full primary refresh. [2025-09-16T19:28:42.782738] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-06. [2025-09-16T19:28:42.903356] [INFO ] [REMOTE ] MSC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:28:43.509674] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-16T19:28:43.574918] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-07. [2025-09-16T19:28:44.374907] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-02. [2025-09-16T19:28:44.795508] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-16T19:28:44.912574] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-16T19:28:45.174871] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-07. [2025-09-16T19:28:45.217734] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-16T19:28:45.974907] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-08. [2025-09-16T19:28:46.774861] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-03. [2025-09-16T19:28:47.199793] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-16T19:28:47.298237] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-16T19:28:47.565522] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-16T19:28:47.574880] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-04. [2025-09-16T19:28:47.893165] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-09-16T19:28:48.374931] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-09. [2025-09-16T19:28:49.174976] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-05. [2025-09-16T19:28:49.504116] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-16T19:28:49.974427] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-16T19:28:49.979661] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-08. [2025-09-16T19:28:49.981625] [INFO ] [REMOTE ] MRP: Full fetch complete (51748 records). [2025-09-16T19:28:49.981726] [DEBUG] [VALIDATOR ] MRP: Validating primary data. [2025-09-16T19:28:50.359885] [DEBUG] [VALIDATOR ] MRP: All expected trading days are present. [2025-09-16T19:28:50.359975] [DEBUG] [VALIDATOR ] MRP: Primary data validation passed. [2025-09-16T19:28:50.360890] [INFO ] [MAIN ] MRP: Fetched primary data is valid. [2025-09-16T19:28:50.360940] [DEBUG] [LOCAL ] MRP: Saving primary data. [2025-09-16T19:28:50.362231] [DEBUG] [LOCAL ] MRP: Trimmed 51748 records to 34515 (keeping 150 days of data) [2025-09-16T19:28:50.571625] [DEBUG] [LOCAL ] MRP: Primary data saved (34515 records). [2025-09-16T19:28:50.571781] [INFO ] [MAIN ] MRP: Full history saved. [2025-09-16T19:28:50.571880] [INFO ] [MAIN ] Update Progress: 1402/2369 symbols completed. MRP took 19.1s. Estimated remaining: 1h 42m 38s. Rate: 9.4 symbols/min [2025-09-16T19:28:50.758473] [INFO ] [MAIN ] MSCI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:28:50.774910] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-06. [2025-09-16T19:28:50.785113] [DEBUG] [LOCAL ] MSCI: Loaded 25068 existing records from primary storage. [2025-09-16T19:28:50.785253] [INFO ] [MAIN ] MSCI: Loaded 25068 existing records. [2025-09-16T19:28:50.972843] [WARN ] [MAIN ] MSCI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:28:50.973102] [INFO ] [MAIN ] MSCI: Wiping existing primary data before full refresh. [2025-09-16T19:28:50.973171] [INFO ] [LOCAL ] MSCI: Starting deletion of primary data. [2025-09-16T19:28:50.973849] [DEBUG] [LOCAL ] MSCI: Deleted primary data file. [2025-09-16T19:28:50.973898] [INFO ] [MAIN ] MSCI: Starting full primary refresh. [2025-09-16T19:28:51.234235] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-16T19:28:51.345683] [INFO ] [REMOTE ] MSCI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:28:51.574900] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-02. [2025-09-16T19:28:52.087950] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-16T19:28:52.374928] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-07. [2025-09-16T19:28:52.821579] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-16T19:28:53.113234] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-16T19:28:53.174905] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-03. [2025-09-16T19:28:53.974893] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-09. [2025-09-16T19:28:54.782140] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-06. [2025-09-16T19:28:54.787949] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-16T19:28:55.574925] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-08. [2025-09-16T19:28:55.594128] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-16T19:28:55.602925] [INFO ] [REMOTE ] MS: Full fetch complete (58374 records). [2025-09-16T19:28:55.603156] [DEBUG] [VALIDATOR ] MS: Validating primary data. [2025-09-16T19:28:55.900399] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-16T19:28:56.031670] [DEBUG] [VALIDATOR ] MS: All expected trading days are present. [2025-09-16T19:28:56.031837] [DEBUG] [VALIDATOR ] MS: Primary data validation passed. [2025-09-16T19:28:56.033173] [INFO ] [MAIN ] MS: Fetched primary data is valid. [2025-09-16T19:28:56.033742] [DEBUG] [LOCAL ] MS: Saving primary data. [2025-09-16T19:28:56.033659] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-16T19:28:56.038913] [DEBUG] [LOCAL ] MS: Trimmed 58374 records to 40047 (keeping 150 days of data) [2025-09-16T19:28:56.295955] [DEBUG] [LOCAL ] MS: Primary data saved (40047 records). [2025-09-16T19:28:56.296082] [INFO ] [MAIN ] MS: Full history saved. [2025-09-16T19:28:56.296173] [INFO ] [MAIN ] Update Progress: 1403/2369 symbols completed. MS took 24.9s. Estimated remaining: 1h 42m 31s. Rate: 9.4 symbols/min [2025-09-16T19:28:56.380098] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-07. [2025-09-16T19:28:56.467988] [INFO ] [MAIN ] MSD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:28:56.479874] [DEBUG] [LOCAL ] MSD: Loaded 11977 existing records from primary storage. [2025-09-16T19:28:56.479997] [INFO ] [MAIN ] MSD: Loaded 11977 existing records. [2025-09-16T19:28:56.652199] [WARN ] [MAIN ] MSD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:28:56.652475] [INFO ] [MAIN ] MSD: Wiping existing primary data before full refresh. [2025-09-16T19:28:56.652520] [INFO ] [LOCAL ] MSD: Starting deletion of primary data. [2025-09-16T19:28:56.652889] [DEBUG] [LOCAL ] MSD: Deleted primary data file. [2025-09-16T19:28:56.652936] [INFO ] [MAIN ] MSD: Starting full primary refresh. [2025-09-16T19:28:57.000317] [INFO ] [REMOTE ] MSD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:28:57.175017] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-09. [2025-09-16T19:28:57.547110] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-16T19:28:57.599071] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-16T19:28:57.600636] [INFO ] [REMOTE ] MSC: Full fetch complete (1883 records). [2025-09-16T19:28:57.600744] [DEBUG] [VALIDATOR ] MSC: Validating primary data. [2025-09-16T19:28:57.801833] [WARN ] [VALIDATOR ] MSC: Validation failed - insufficient historical data. Have 143 unique days, need 150 days [2025-09-16T19:28:57.802130] [FATAL] [MAIN ] MSC: Fetched primary data is invalid. Refusing to save it. [2025-09-16T19:28:57.802220] [WARN ] [MAIN ] MSC: Deleting existing primary and derivative data due to validation failure. [2025-09-16T19:28:57.802288] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-09-16T19:28:57.802379] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-09-16T19:28:57.802436] [INFO ] [LOCAL ] MSC: Starting deletion of derivative data. [2025-09-16T19:28:57.802506] [DEBUG] [LOCAL ] MSC: No derivative data file found to delete. [2025-09-16T19:28:57.802593] [INFO ] [MAIN ] Update Progress: 1404/2369 symbols completed. MSC took 15.5s. Estimated remaining: 1h 42m 21s. Rate: 9.4 symbols/min [2025-09-16T19:28:57.974169] [INFO ] [MAIN ] MSDL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:28:57.974904] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-08. [2025-09-16T19:28:58.002260] [DEBUG] [LOCAL ] MSDL: Loaded 27074 existing records from primary storage. [2025-09-16T19:28:58.002403] [INFO ] [MAIN ] MSDL: Loaded 27074 existing records. [2025-09-16T19:28:58.181202] [WARN ] [MAIN ] MSDL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:28:58.181480] [INFO ] [MAIN ] MSDL: Wiping existing primary data before full refresh. [2025-09-16T19:28:58.181528] [INFO ] [LOCAL ] MSDL: Starting deletion of primary data. [2025-09-16T19:28:58.182305] [DEBUG] [LOCAL ] MSDL: Deleted primary data file. [2025-09-16T19:28:58.182357] [INFO ] [MAIN ] MSDL: Starting full primary refresh. [2025-09-16T19:28:58.540912] [INFO ] [REMOTE ] MSDL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:28:58.774904] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-02. [2025-09-16T19:28:59.027196] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-16T19:28:59.574938] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-09. [2025-09-16T19:29:00.211897] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-16T19:29:00.374850] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-02. [2025-09-16T19:29:00.685312] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-16T19:29:00.687979] [INFO ] [REMOTE ] MSA: Full fetch complete (20281 records). [2025-09-16T19:29:00.688053] [DEBUG] [VALIDATOR ] MSA: Validating primary data. [2025-09-16T19:29:01.052142] [DEBUG] [VALIDATOR ] MSA: All expected trading days are present. [2025-09-16T19:29:01.052228] [DEBUG] [VALIDATOR ] MSA: Primary data validation passed. [2025-09-16T19:29:01.052635] [INFO ] [MAIN ] MSA: Fetched primary data is valid. [2025-09-16T19:29:01.052695] [DEBUG] [LOCAL ] MSA: Saving primary data. [2025-09-16T19:29:01.053296] [DEBUG] [LOCAL ] MSA: Trimmed 20281 records to 13942 (keeping 150 days of data) [2025-09-16T19:29:01.148839] [DEBUG] [LOCAL ] MSA: Primary data saved (13942 records). [2025-09-16T19:29:01.148987] [INFO ] [MAIN ] MSA: Full history saved. [2025-09-16T19:29:01.149071] [INFO ] [MAIN ] Update Progress: 1405/2369 symbols completed. MSA took 29.7s. Estimated remaining: 1h 42m 13s. Rate: 9.4 symbols/min [2025-09-16T19:29:01.180116] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-03. [2025-09-16T19:29:01.323382] [INFO ] [MAIN ] MSGE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:29:01.342467] [DEBUG] [LOCAL ] MSGE: Loaded 19047 existing records from primary storage. [2025-09-16T19:29:01.342607] [INFO ] [MAIN ] MSGE: Loaded 19047 existing records. [2025-09-16T19:29:01.510589] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-16T19:29:01.532542] [WARN ] [MAIN ] MSGE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:29:01.532754] [INFO ] [MAIN ] MSGE: Wiping existing primary data before full refresh. [2025-09-16T19:29:01.532801] [INFO ] [LOCAL ] MSGE: Starting deletion of primary data. [2025-09-16T19:29:01.533328] [DEBUG] [LOCAL ] MSGE: Deleted primary data file. [2025-09-16T19:29:01.533378] [INFO ] [MAIN ] MSGE: Starting full primary refresh. [2025-09-16T19:29:01.881967] [INFO ] [REMOTE ] MSGE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:29:01.974855] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-02. [2025-09-16T19:29:02.539797] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-16T19:29:02.774938] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-04. [2025-09-16T19:29:02.883949] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-16T19:29:03.574903] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-03. [2025-09-16T19:29:04.251511] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-16T19:29:04.374940] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-04. [2025-09-16T19:29:04.845751] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-16T19:29:05.174974] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-03. [2025-09-16T19:29:05.870334] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-16T19:29:05.974938] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-04. [2025-09-16T19:29:06.111841] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-16T19:29:06.774932] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-05. [2025-09-16T19:29:07.291478] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-16T19:29:07.574950] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-05. [2025-09-16T19:29:08.094136] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-16T19:29:08.374868] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-06. [2025-09-16T19:29:08.790809] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-16T19:29:09.174908] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-06. [2025-09-16T19:29:09.696111] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-16T19:29:09.974885] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-07. [2025-09-16T19:29:10.462554] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-16T19:29:10.774894] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-07. [2025-09-16T19:29:11.307011] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-16T19:29:11.574943] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-08. [2025-09-16T19:29:11.921345] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-16T19:29:12.374916] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-05. [2025-09-16T19:29:13.129913] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-16T19:29:13.174865] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-09. [2025-09-16T19:29:13.813032] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-16T19:29:13.974945] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-08. [2025-09-16T19:29:14.607512] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-16T19:29:14.612573] [INFO ] [REMOTE ] MSCI: Full fetch complete (38002 records). [2025-09-16T19:29:14.612694] [DEBUG] [VALIDATOR ] MSCI: Validating primary data. [2025-09-16T19:29:14.783979] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-04. [2025-09-16T19:29:14.985511] [DEBUG] [VALIDATOR ] MSCI: All expected trading days are present. [2025-09-16T19:29:14.985603] [DEBUG] [VALIDATOR ] MSCI: Primary data validation passed. [2025-09-16T19:29:14.986319] [INFO ] [MAIN ] MSCI: Fetched primary data is valid. [2025-09-16T19:29:14.986367] [DEBUG] [LOCAL ] MSCI: Saving primary data. [2025-09-16T19:29:14.987437] [DEBUG] [LOCAL ] MSCI: Trimmed 38002 records to 25367 (keeping 150 days of data) [2025-09-16T19:29:15.150267] [DEBUG] [LOCAL ] MSCI: Primary data saved (25367 records). [2025-09-16T19:29:15.150413] [INFO ] [MAIN ] MSCI: Full history saved. [2025-09-16T19:29:15.150666] [INFO ] [MAIN ] Update Progress: 1406/2369 symbols completed. MSCI took 24.6s. Estimated remaining: 1h 42m 11s. Rate: 9.4 symbols/min [2025-09-16T19:29:15.290349] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-16T19:29:15.344400] [INFO ] [MAIN ] MSGS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:29:15.357257] [DEBUG] [LOCAL ] MSGS: Loaded 12220 existing records from primary storage. [2025-09-16T19:29:15.357378] [INFO ] [MAIN ] MSGS: Loaded 12220 existing records. [2025-09-16T19:29:15.538277] [WARN ] [MAIN ] MSGS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:29:15.538494] [INFO ] [MAIN ] MSGS: Wiping existing primary data before full refresh. [2025-09-16T19:29:15.538538] [INFO ] [LOCAL ] MSGS: Starting deletion of primary data. [2025-09-16T19:29:15.538933] [DEBUG] [LOCAL ] MSGS: Deleted primary data file. [2025-09-16T19:29:15.538979] [INFO ] [MAIN ] MSGS: Starting full primary refresh. [2025-09-16T19:29:15.581616] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-09. [2025-09-16T19:29:15.888788] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-16T19:29:15.924309] [INFO ] [REMOTE ] MSGS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:29:16.374911] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-02. [2025-09-16T19:29:16.555055] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-16T19:29:16.558785] [INFO ] [REMOTE ] MSGE: Full fetch complete (29247 records). [2025-09-16T19:29:16.558866] [DEBUG] [VALIDATOR ] MSGE: Validating primary data. [2025-09-16T19:29:16.940471] [DEBUG] [VALIDATOR ] MSGE: All expected trading days are present. [2025-09-16T19:29:16.940550] [DEBUG] [VALIDATOR ] MSGE: Primary data validation passed. [2025-09-16T19:29:16.941203] [INFO ] [MAIN ] MSGE: Fetched primary data is valid. [2025-09-16T19:29:16.941247] [DEBUG] [LOCAL ] MSGE: Saving primary data. [2025-09-16T19:29:16.941978] [DEBUG] [LOCAL ] MSGE: Trimmed 29247 records to 19265 (keeping 150 days of data) [2025-09-16T19:29:17.054798] [DEBUG] [LOCAL ] MSGE: Primary data saved (19265 records). [2025-09-16T19:29:17.054929] [INFO ] [MAIN ] MSGE: Full history saved. [2025-09-16T19:29:17.055008] [INFO ] [MAIN ] Update Progress: 1407/2369 symbols completed. MSGE took 15.9s. Estimated remaining: 1h 42m 2s. Rate: 9.4 symbols/min [2025-09-16T19:29:17.179994] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-06. [2025-09-16T19:29:17.247007] [INFO ] [MAIN ] MSI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:29:17.284238] [DEBUG] [LOCAL ] MSI: Loaded 29648 existing records from primary storage. [2025-09-16T19:29:17.284406] [INFO ] [MAIN ] MSI: Loaded 29648 existing records. [2025-09-16T19:29:17.474301] [WARN ] [MAIN ] MSI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:29:17.475245] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-16T19:29:17.475522] [INFO ] [MAIN ] MSI: Wiping existing primary data before full refresh. [2025-09-16T19:29:17.478990] [INFO ] [LOCAL ] MSI: Starting deletion of primary data. [2025-09-16T19:29:17.479826] [DEBUG] [LOCAL ] MSI: Deleted primary data file. [2025-09-16T19:29:17.479902] [INFO ] [MAIN ] MSI: Starting full primary refresh. [2025-09-16T19:29:17.826949] [INFO ] [REMOTE ] MSI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:29:17.974888] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-02. [2025-09-16T19:29:18.664608] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-16T19:29:18.774853] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-07. [2025-09-16T19:29:19.466718] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-16T19:29:19.574988] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-03. [2025-09-16T19:29:20.262949] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-16T19:29:20.330141] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-16T19:29:20.374966] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-08. [2025-09-16T19:29:21.174934] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-05. [2025-09-16T19:29:21.881237] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-16T19:29:21.904318] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-16T19:29:21.974887] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-03. [2025-09-16T19:29:22.774900] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-06. [2025-09-16T19:29:23.458670] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-16T19:29:23.574886] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-07. [2025-09-16T19:29:23.619496] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-16T19:29:24.374882] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-09. [2025-09-16T19:29:24.683099] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-16T19:29:25.174946] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-08. [2025-09-16T19:29:25.627997] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-16T19:29:25.632824] [INFO ] [REMOTE ] MSDL: Full fetch complete (41569 records). [2025-09-16T19:29:25.632895] [DEBUG] [VALIDATOR ] MSDL: Validating primary data. [2025-09-16T19:29:25.982707] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-04. [2025-09-16T19:29:26.009883] [DEBUG] [VALIDATOR ] MSDL: All expected trading days are present. [2025-09-16T19:29:26.009960] [DEBUG] [VALIDATOR ] MSDL: Primary data validation passed. [2025-09-16T19:29:26.010663] [INFO ] [MAIN ] MSDL: Fetched primary data is valid. [2025-09-16T19:29:26.010707] [DEBUG] [LOCAL ] MSDL: Saving primary data. [2025-09-16T19:29:26.011672] [DEBUG] [LOCAL ] MSDL: Trimmed 41569 records to 27398 (keeping 150 days of data) [2025-09-16T19:29:26.190398] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-16T19:29:26.201292] [DEBUG] [LOCAL ] MSDL: Primary data saved (27398 records). [2025-09-16T19:29:26.206893] [INFO ] [MAIN ] MSDL: Full history saved. [2025-09-16T19:29:26.207009] [INFO ] [MAIN ] Update Progress: 1408/2369 symbols completed. MSDL took 28.4s. Estimated remaining: 1h 41m 58s. Rate: 9.4 symbols/min [2025-09-16T19:29:26.377833] [INFO ] [MAIN ] MSIF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:29:26.389382] [DEBUG] [LOCAL ] MSIF: Loaded 10557 existing records from primary storage. [2025-09-16T19:29:26.389513] [INFO ] [MAIN ] MSIF: Loaded 10557 existing records. [2025-09-16T19:29:26.566117] [WARN ] [MAIN ] MSIF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:29:26.566373] [INFO ] [MAIN ] MSIF: Wiping existing primary data before full refresh. [2025-09-16T19:29:26.566419] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-09-16T19:29:26.566878] [DEBUG] [LOCAL ] MSIF: Deleted primary data file. [2025-09-16T19:29:26.566931] [INFO ] [MAIN ] MSIF: Starting full primary refresh. [2025-09-16T19:29:26.780101] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-04. [2025-09-16T19:29:26.927519] [INFO ] [REMOTE ] MSIF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:29:27.574950] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-09. [2025-09-16T19:29:27.626280] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-16T19:29:27.916147] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-16T19:29:28.374910] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-05. [2025-09-16T19:29:28.438144] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-16T19:29:28.440898] [INFO ] [REMOTE ] MSD: Full fetch complete (16671 records). [2025-09-16T19:29:28.440971] [DEBUG] [VALIDATOR ] MSD: Validating primary data. [2025-09-16T19:29:28.815193] [DEBUG] [VALIDATOR ] MSD: All expected trading days are present. [2025-09-16T19:29:28.815269] [DEBUG] [VALIDATOR ] MSD: Primary data validation passed. [2025-09-16T19:29:28.815620] [INFO ] [MAIN ] MSD: Fetched primary data is valid. [2025-09-16T19:29:28.815677] [DEBUG] [LOCAL ] MSD: Saving primary data. [2025-09-16T19:29:28.816274] [DEBUG] [LOCAL ] MSD: Trimmed 16671 records to 12137 (keeping 150 days of data) [2025-09-16T19:29:28.894236] [DEBUG] [LOCAL ] MSD: Primary data saved (12137 records). [2025-09-16T19:29:28.894499] [INFO ] [MAIN ] MSD: Full history saved. [2025-09-16T19:29:28.894598] [INFO ] [MAIN ] Update Progress: 1409/2369 symbols completed. MSD took 32.6s. Estimated remaining: 1h 41m 49s. Rate: 9.4 symbols/min [2025-09-16T19:29:29.068572] [INFO ] [MAIN ] MSM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:29:29.093065] [DEBUG] [LOCAL ] MSM: Loaded 25248 existing records from primary storage. [2025-09-16T19:29:29.093202] [INFO ] [MAIN ] MSM: Loaded 25248 existing records. [2025-09-16T19:29:29.183811] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-05. [2025-09-16T19:29:29.274385] [WARN ] [MAIN ] MSM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:29:29.274698] [INFO ] [MAIN ] MSM: Wiping existing primary data before full refresh. [2025-09-16T19:29:29.274747] [INFO ] [LOCAL ] MSM: Starting deletion of primary data. [2025-09-16T19:29:29.275611] [DEBUG] [LOCAL ] MSM: Deleted primary data file. [2025-09-16T19:29:29.275685] [INFO ] [MAIN ] MSM: Starting full primary refresh. [2025-09-16T19:29:29.517855] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-16T19:29:29.669927] [INFO ] [REMOTE ] MSM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:29:29.974917] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-02. [2025-09-16T19:29:30.774972] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-06. [2025-09-16T19:29:30.818974] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-16T19:29:30.857273] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-16T19:29:31.574913] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-02. [2025-09-16T19:29:31.908490] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-16T19:29:32.374939] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-03. [2025-09-16T19:29:32.896914] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-16T19:29:33.174493] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-16T19:29:33.177243] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-03. [2025-09-16T19:29:33.974914] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-06. [2025-09-16T19:29:34.443845] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-16T19:29:34.774905] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-04. [2025-09-16T19:29:35.435333] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-16T19:29:35.574901] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-07. [2025-09-16T19:29:36.153069] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-16T19:29:36.374898] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-05. [2025-09-16T19:29:37.160305] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-16T19:29:37.174861] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-08. [2025-09-16T19:29:37.417825] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-16T19:29:37.974897] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-04. [2025-09-16T19:29:38.686011] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-16T19:29:38.712191] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-16T19:29:38.774861] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-09. [2025-09-16T19:29:39.574914] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-05. [2025-09-16T19:29:39.932975] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-16T19:29:39.937575] [INFO ] [REMOTE ] MSI: Full fetch complete (44563 records). [2025-09-16T19:29:39.937708] [DEBUG] [VALIDATOR ] MSI: Validating primary data. [2025-09-16T19:29:40.230144] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-16T19:29:40.350586] [DEBUG] [VALIDATOR ] MSI: All expected trading days are present. [2025-09-16T19:29:40.350685] [DEBUG] [VALIDATOR ] MSI: Primary data validation passed. [2025-09-16T19:29:40.351407] [INFO ] [MAIN ] MSI: Fetched primary data is valid. [2025-09-16T19:29:40.351448] [DEBUG] [LOCAL ] MSI: Saving primary data. [2025-09-16T19:29:40.352424] [DEBUG] [LOCAL ] MSI: Trimmed 44563 records to 29947 (keeping 150 days of data) [2025-09-16T19:29:40.409151] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-06. [2025-09-16T19:29:40.542359] [DEBUG] [LOCAL ] MSI: Primary data saved (29947 records). [2025-09-16T19:29:40.542499] [INFO ] [MAIN ] MSI: Full history saved. [2025-09-16T19:29:40.543581] [INFO ] [MAIN ] Update Progress: 1410/2369 symbols completed. MSI took 23.5s. Estimated remaining: 1h 41m 46s. Rate: 9.4 symbols/min [2025-09-16T19:29:40.714475] [INFO ] [MAIN ] MT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:29:40.752702] [DEBUG] [LOCAL ] MT: Loaded 37095 existing records from primary storage. [2025-09-16T19:29:40.752845] [INFO ] [MAIN ] MT: Loaded 37095 existing records. [2025-09-16T19:29:40.929560] [WARN ] [MAIN ] MT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:29:40.929801] [INFO ] [MAIN ] MT: Wiping existing primary data before full refresh. [2025-09-16T19:29:40.929850] [INFO ] [LOCAL ] MT: Starting deletion of primary data. [2025-09-16T19:29:40.930631] [DEBUG] [LOCAL ] MT: Deleted primary data file. [2025-09-16T19:29:40.930705] [INFO ] [MAIN ] MT: Starting full primary refresh. [2025-09-16T19:29:41.180177] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-06. [2025-09-16T19:29:41.294574] [INFO ] [REMOTE ] MT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:29:41.731009] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-16T19:29:41.974914] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-02. [2025-09-16T19:29:42.223035] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-16T19:29:42.774910] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-07. [2025-09-16T19:29:43.574911] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-07. [2025-09-16T19:29:43.711761] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-16T19:29:44.244988] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-16T19:29:44.374922] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-08. [2025-09-16T19:29:44.579032] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-16T19:29:45.174931] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-07. [2025-09-16T19:29:45.737610] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-16T19:29:45.943879] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-16T19:29:45.974847] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-08. [2025-09-16T19:29:46.774928] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-08. [2025-09-16T19:29:46.819496] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-16T19:29:47.574903] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-09. [2025-09-16T19:29:47.825738] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-16T19:29:48.374930] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-09. [2025-09-16T19:29:48.617191] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-16T19:29:48.621697] [INFO ] [REMOTE ] MSM: Full fetch complete (38121 records). [2025-09-16T19:29:48.621801] [DEBUG] [VALIDATOR ] MSM: Validating primary data. [2025-09-16T19:29:48.996651] [DEBUG] [VALIDATOR ] MSM: All expected trading days are present. [2025-09-16T19:29:48.996744] [DEBUG] [VALIDATOR ] MSM: Primary data validation passed. [2025-09-16T19:29:48.997504] [INFO ] [MAIN ] MSM: Fetched primary data is valid. [2025-09-16T19:29:48.997551] [DEBUG] [LOCAL ] MSM: Saving primary data. [2025-09-16T19:29:48.998594] [DEBUG] [LOCAL ] MSM: Trimmed 38121 records to 25497 (keeping 150 days of data) [2025-09-16T19:29:49.105955] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-16T19:29:49.127542] [INFO ] [REMOTE ] MSIF: Full fetch complete (14376 records). [2025-09-16T19:29:49.128498] [DEBUG] [VALIDATOR ] MSIF: Validating primary data. [2025-09-16T19:29:49.184505] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-09. [2025-09-16T19:29:49.367749] [DEBUG] [LOCAL ] MSM: Primary data saved (25497 records). [2025-09-16T19:29:49.410528] [INFO ] [MAIN ] MSM: Full history saved. [2025-09-16T19:29:49.432419] [INFO ] [MAIN ] Update Progress: 1411/2369 symbols completed. MSM took 20.5s. Estimated remaining: 1h 41m 41s. Rate: 9.4 symbols/min [2025-09-16T19:29:49.725892] [DEBUG] [VALIDATOR ] MSIF: All expected trading days are present. [2025-09-16T19:29:49.753745] [DEBUG] [VALIDATOR ] MSIF: Primary data validation passed. [2025-09-16T19:29:49.757831] [INFO ] [MAIN ] MSIF: Fetched primary data is valid. [2025-09-16T19:29:49.757947] [DEBUG] [LOCAL ] MSIF: Saving primary data. [2025-09-16T19:29:49.757266] [INFO ] [MAIN ] MTAL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:29:49.759063] [DEBUG] [LOCAL ] MSIF: Trimmed 14376 records to 10694 (keeping 150 days of data) [2025-09-16T19:29:49.828260] [DEBUG] [LOCAL ] MSIF: Primary data saved (10694 records). [2025-09-16T19:29:49.828436] [INFO ] [MAIN ] MSIF: Full history saved. [2025-09-16T19:29:49.828616] [INFO ] [MAIN ] Update Progress: 1412/2369 symbols completed. MSIF took 23.6s. Estimated remaining: 1h 41m 31s. Rate: 9.4 symbols/min [2025-09-16T19:29:49.947718] [DEBUG] [LOCAL ] MTAL: Loaded 27153 existing records from primary storage. [2025-09-16T19:29:49.953570] [INFO ] [MAIN ] MTAL: Loaded 27153 existing records. [2025-09-16T19:29:50.001998] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-03. [2025-09-16T19:29:50.127433] [INFO ] [MAIN ] MTB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:29:50.228964] [WARN ] [MAIN ] MTAL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:29:50.229396] [INFO ] [MAIN ] MTAL: Wiping existing primary data before full refresh. [2025-09-16T19:29:50.229469] [INFO ] [LOCAL ] MTAL: Starting deletion of primary data. [2025-09-16T19:29:50.238707] [DEBUG] [LOCAL ] MTAL: Deleted primary data file. [2025-09-16T19:29:50.238880] [INFO ] [MAIN ] MTAL: Starting full primary refresh. [2025-09-16T19:29:50.370777] [DEBUG] [LOCAL ] MTB: Loaded 34251 existing records from primary storage. [2025-09-16T19:29:50.376620] [INFO ] [MAIN ] MTB: Loaded 34251 existing records. [2025-09-16T19:29:50.588526] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-16T19:29:50.657272] [INFO ] [REMOTE ] MSGS: Full fetch complete (17781 records). [2025-09-16T19:29:50.678454] [DEBUG] [VALIDATOR ] MSGS: Validating primary data. [2025-09-16T19:29:50.870005] [WARN ] [MAIN ] MTB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:29:50.919561] [INFO ] [REMOTE ] MTAL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:29:50.923277] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-02. [2025-09-16T19:29:50.923407] [INFO ] [MAIN ] MTB: Wiping existing primary data before full refresh. [2025-09-16T19:29:50.923496] [INFO ] [LOCAL ] MTB: Starting deletion of primary data. [2025-09-16T19:29:50.934244] [DEBUG] [LOCAL ] MTB: Deleted primary data file. [2025-09-16T19:29:50.934354] [INFO ] [MAIN ] MTB: Starting full primary refresh. [2025-09-16T19:29:51.526096] [DEBUG] [VALIDATOR ] MSGS: All expected trading days are present. [2025-09-16T19:29:51.538019] [DEBUG] [VALIDATOR ] MSGS: Primary data validation passed. [2025-09-16T19:29:51.548316] [INFO ] [MAIN ] MSGS: Fetched primary data is valid. [2025-09-16T19:29:51.556985] [DEBUG] [LOCAL ] MSGS: Saving primary data. [2025-09-16T19:29:51.578224] [INFO ] [REMOTE ] MTB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:29:51.578858] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-02. [2025-09-16T19:29:51.578579] [DEBUG] [LOCAL ] MSGS: Trimmed 17781 records to 12394 (keeping 150 days of data) [2025-09-16T19:29:51.655910] [DEBUG] [LOCAL ] MSGS: Primary data saved (12394 records). [2025-09-16T19:29:51.656057] [INFO ] [MAIN ] MSGS: Full history saved. [2025-09-16T19:29:51.656148] [INFO ] [MAIN ] Update Progress: 1413/2369 symbols completed. MSGS took 36.5s. Estimated remaining: 1h 41m 21s. Rate: 9.4 symbols/min [2025-09-16T19:29:51.836664] [INFO ] [MAIN ] MTD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:29:51.857637] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-16T19:29:51.868910] [DEBUG] [LOCAL ] MTD: Loaded 11010 existing records from primary storage. [2025-09-16T19:29:51.869125] [INFO ] [MAIN ] MTD: Loaded 11010 existing records. [2025-09-16T19:29:52.048261] [WARN ] [MAIN ] MTD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:29:52.048733] [INFO ] [MAIN ] MTD: Wiping existing primary data before full refresh. [2025-09-16T19:29:52.048849] [INFO ] [LOCAL ] MTD: Starting deletion of primary data. [2025-09-16T19:29:52.049262] [DEBUG] [LOCAL ] MTD: Deleted primary data file. [2025-09-16T19:29:52.049340] [INFO ] [MAIN ] MTD: Starting full primary refresh. [2025-09-16T19:29:52.220639] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-16T19:29:52.380016] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-03. [2025-09-16T19:29:52.445684] [INFO ] [REMOTE ] MTD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:29:52.889560] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-16T19:29:53.174943] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-02. [2025-09-16T19:29:53.315792] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-16T19:29:53.767909] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-16T19:29:53.974902] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-03. [2025-09-16T19:29:54.774943] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-04. [2025-09-16T19:29:54.910586] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-16T19:29:55.574915] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-04. [2025-09-16T19:29:56.374956] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-04. [2025-09-16T19:29:56.597519] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-16T19:29:56.901527] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-16T19:29:57.174916] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-05. [2025-09-16T19:29:57.459837] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-16T19:29:57.974950] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-05. [2025-09-16T19:29:58.006068] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-16T19:29:58.774964] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-06. [2025-09-16T19:29:59.574878] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-03. [2025-09-16T19:29:59.608815] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-16T19:29:59.648546] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-16T19:30:00.374917] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-06. [2025-09-16T19:30:01.174875] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-07. [2025-09-16T19:30:01.384936] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-16T19:30:01.909613] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-16T19:30:01.974882] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-08. [2025-09-16T19:30:02.032720] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-16T19:30:02.774888] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-04. [2025-09-16T19:30:02.886239] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-16T19:30:03.574908] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-05. [2025-09-16T19:30:04.374947] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-07. [2025-09-16T19:30:04.490489] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-16T19:30:05.113984] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-16T19:30:05.175045] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-06. [2025-09-16T19:30:05.974892] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-09. [2025-09-16T19:30:06.242537] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-16T19:30:06.468720] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-16T19:30:06.774891] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-08. [2025-09-16T19:30:06.918505] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-16T19:30:06.920186] [INFO ] [REMOTE ] MTD: Full fetch complete (16600 records). [2025-09-16T19:30:06.920283] [DEBUG] [VALIDATOR ] MTD: Validating primary data. [2025-09-16T19:30:07.282824] [DEBUG] [VALIDATOR ] MTD: All expected trading days are present. [2025-09-16T19:30:07.282908] [DEBUG] [VALIDATOR ] MTD: Primary data validation passed. [2025-09-16T19:30:07.283312] [INFO ] [MAIN ] MTD: Fetched primary data is valid. [2025-09-16T19:30:07.283369] [DEBUG] [LOCAL ] MTD: Saving primary data. [2025-09-16T19:30:07.283925] [DEBUG] [LOCAL ] MTD: Trimmed 16600 records to 11088 (keeping 150 days of data) [2025-09-16T19:30:07.357273] [DEBUG] [LOCAL ] MTD: Primary data saved (11088 records). [2025-09-16T19:30:07.357434] [INFO ] [MAIN ] MTD: Full history saved. [2025-09-16T19:30:07.357558] [INFO ] [MAIN ] Update Progress: 1414/2369 symbols completed. MTD took 15.7s. Estimated remaining: 1h 41m 21s. Rate: 9.4 symbols/min [2025-09-16T19:30:07.537169] [INFO ] [MAIN ] MTDR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:30:07.580988] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-05. [2025-09-16T19:30:07.583663] [DEBUG] [LOCAL ] MTDR: Loaded 37997 existing records from primary storage. [2025-09-16T19:30:07.583766] [INFO ] [MAIN ] MTDR: Loaded 37997 existing records. [2025-09-16T19:30:07.800548] [WARN ] [MAIN ] MTDR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:30:07.800843] [INFO ] [MAIN ] MTDR: Wiping existing primary data before full refresh. [2025-09-16T19:30:07.800892] [INFO ] [LOCAL ] MTDR: Starting deletion of primary data. [2025-09-16T19:30:07.801766] [DEBUG] [LOCAL ] MTDR: Deleted primary data file. [2025-09-16T19:30:07.801816] [INFO ] [MAIN ] MTDR: Starting full primary refresh. [2025-09-16T19:30:08.152351] [INFO ] [REMOTE ] MTDR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:30:08.374912] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-02. [2025-09-16T19:30:08.602246] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-16T19:30:08.933298] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-16T19:30:09.174947] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-06. [2025-09-16T19:30:09.974931] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-09. [2025-09-16T19:30:09.988974] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-16T19:30:10.665791] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-16T19:30:10.774897] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-07. [2025-09-16T19:30:11.574904] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-07. [2025-09-16T19:30:11.826211] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-16T19:30:11.832291] [INFO ] [REMOTE ] MT: Full fetch complete (55393 records). [2025-09-16T19:30:11.832397] [DEBUG] [VALIDATOR ] MT: Validating primary data. [2025-09-16T19:30:12.216528] [DEBUG] [VALIDATOR ] MT: All expected trading days are present. [2025-09-16T19:30:12.216655] [DEBUG] [VALIDATOR ] MT: Primary data validation passed. [2025-09-16T19:30:12.217488] [INFO ] [MAIN ] MT: Fetched primary data is valid. [2025-09-16T19:30:12.217532] [DEBUG] [LOCAL ] MT: Saving primary data. [2025-09-16T19:30:12.218853] [DEBUG] [LOCAL ] MT: Trimmed 55393 records to 37445 (keeping 150 days of data) [2025-09-16T19:30:12.393834] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-03. [2025-09-16T19:30:12.455652] [DEBUG] [LOCAL ] MT: Primary data saved (37445 records). [2025-09-16T19:30:12.455818] [INFO ] [MAIN ] MT: Full history saved. [2025-09-16T19:30:12.456777] [INFO ] [MAIN ] Update Progress: 1415/2369 symbols completed. MT took 31.9s. Estimated remaining: 1h 41m 14s. Rate: 9.4 symbols/min [2025-09-16T19:30:12.631361] [INFO ] [MAIN ] MTG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:30:12.670462] [DEBUG] [LOCAL ] MTG: Loaded 37536 existing records from primary storage. [2025-09-16T19:30:12.670610] [INFO ] [MAIN ] MTG: Loaded 37536 existing records. [2025-09-16T19:30:12.857841] [WARN ] [MAIN ] MTG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:30:12.858172] [INFO ] [MAIN ] MTG: Wiping existing primary data before full refresh. [2025-09-16T19:30:12.858281] [INFO ] [LOCAL ] MTG: Starting deletion of primary data. [2025-09-16T19:30:12.859166] [DEBUG] [LOCAL ] MTG: Deleted primary data file. [2025-09-16T19:30:12.859217] [INFO ] [MAIN ] MTG: Starting full primary refresh. [2025-09-16T19:30:13.020872] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-16T19:30:13.177321] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-08. [2025-09-16T19:30:13.281854] [INFO ] [REMOTE ] MTG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:30:13.304490] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-16T19:30:13.974932] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-08. [2025-09-16T19:30:14.248674] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-16T19:30:14.773408] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-16T19:30:14.782396] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-02. [2025-09-16T19:30:15.231693] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-16T19:30:15.574924] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-09. [2025-09-16T19:30:16.257067] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-16T19:30:16.374936] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-04. [2025-09-16T19:30:17.177961] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-03. [2025-09-16T19:30:17.180243] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-16T19:30:17.186417] [INFO ] [REMOTE ] MTB: Full fetch complete (51317 records). [2025-09-16T19:30:17.186553] [DEBUG] [VALIDATOR ] MTB: Validating primary data. [2025-09-16T19:30:17.565827] [DEBUG] [VALIDATOR ] MTB: All expected trading days are present. [2025-09-16T19:30:17.565915] [DEBUG] [VALIDATOR ] MTB: Primary data validation passed. [2025-09-16T19:30:17.566795] [INFO ] [MAIN ] MTB: Fetched primary data is valid. [2025-09-16T19:30:17.566846] [DEBUG] [LOCAL ] MTB: Saving primary data. [2025-09-16T19:30:17.567908] [DEBUG] [LOCAL ] MTB: Trimmed 51317 records to 34580 (keeping 150 days of data) [2025-09-16T19:30:17.798713] [DEBUG] [LOCAL ] MTB: Primary data saved (34580 records). [2025-09-16T19:30:17.798882] [INFO ] [MAIN ] MTB: Full history saved. [2025-09-16T19:30:17.799011] [INFO ] [MAIN ] Update Progress: 1416/2369 symbols completed. MTB took 28.0s. Estimated remaining: 1h 41m 7s. Rate: 9.4 symbols/min [2025-09-16T19:30:17.969242] [INFO ] [MAIN ] MTH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:30:17.974973] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-09. [2025-09-16T19:30:18.004722] [DEBUG] [LOCAL ] MTH: Loaded 32137 existing records from primary storage. [2025-09-16T19:30:18.004895] [INFO ] [MAIN ] MTH: Loaded 32137 existing records. [2025-09-16T19:30:18.185056] [WARN ] [MAIN ] MTH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:30:18.185355] [INFO ] [MAIN ] MTH: Wiping existing primary data before full refresh. [2025-09-16T19:30:18.185426] [INFO ] [LOCAL ] MTH: Starting deletion of primary data. [2025-09-16T19:30:18.186157] [DEBUG] [LOCAL ] MTH: Deleted primary data file. [2025-09-16T19:30:18.186211] [INFO ] [MAIN ] MTH: Starting full primary refresh. [2025-09-16T19:30:18.543352] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-16T19:30:18.625490] [INFO ] [REMOTE ] MTH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:30:18.774908] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-02. [2025-09-16T19:30:18.932011] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-16T19:30:19.574930] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-04. [2025-09-16T19:30:20.076176] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-16T19:30:20.375020] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-05. [2025-09-16T19:30:20.905055] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-09 (2.93 seconds). [2025-09-16T19:30:20.910508] [INFO ] [REMOTE ] MTAL: Full fetch complete (37829 records). [2025-09-16T19:30:20.910620] [DEBUG] [VALIDATOR ] MTAL: Validating primary data. [2025-09-16T19:30:20.911579] [FATAL] [VALIDATOR ] MTAL: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T19:30:20.911691] [FATAL] [MAIN ] MTAL: Fetched primary data is invalid. Refusing to save it. [2025-09-16T19:30:20.911731] [WARN ] [MAIN ] MTAL: Deleting existing primary and derivative data due to validation failure. [2025-09-16T19:30:20.911791] [INFO ] [LOCAL ] MTAL: Starting deletion of primary data. [2025-09-16T19:30:20.911852] [DEBUG] [LOCAL ] MTAL: No primary data file found to delete. [2025-09-16T19:30:20.911888] [INFO ] [LOCAL ] MTAL: Starting deletion of derivative data. [2025-09-16T19:30:20.912184] [DEBUG] [LOCAL ] MTAL: Deleted derivative data file. [2025-09-16T19:30:20.912274] [INFO ] [MAIN ] Update Progress: 1417/2369 symbols completed. MTAL took 31.5s. Estimated remaining: 1h 40m 59s. Rate: 9.4 symbols/min [2025-09-16T19:30:21.082385] [INFO ] [MAIN ] MTN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:30:21.117264] [DEBUG] [LOCAL ] MTN: Loaded 28572 existing records from primary storage. [2025-09-16T19:30:21.117413] [INFO ] [MAIN ] MTN: Loaded 28572 existing records. [2025-09-16T19:30:21.183658] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-03. [2025-09-16T19:30:21.300072] [WARN ] [MAIN ] MTN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:30:21.300445] [INFO ] [MAIN ] MTN: Wiping existing primary data before full refresh. [2025-09-16T19:30:21.300532] [INFO ] [LOCAL ] MTN: Starting deletion of primary data. [2025-09-16T19:30:21.301175] [DEBUG] [LOCAL ] MTN: Deleted primary data file. [2025-09-16T19:30:21.301230] [INFO ] [MAIN ] MTN: Starting full primary refresh. [2025-09-16T19:30:21.611238] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-16T19:30:21.698429] [INFO ] [REMOTE ] MTN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:30:21.974859] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-05. [2025-09-16T19:30:22.105763] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-16T19:30:22.774956] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-02. [2025-09-16T19:30:22.829995] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-16T19:30:23.574908] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-06. [2025-09-16T19:30:23.673788] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-16T19:30:23.828927] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-16T19:30:24.374902] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-03. [2025-09-16T19:30:25.174957] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-06. [2025-09-16T19:30:25.643488] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-16T19:30:25.715198] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-16T19:30:25.974959] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-07. [2025-09-16T19:30:26.774908] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-04. [2025-09-16T19:30:26.845653] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-16T19:30:27.444898] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-16T19:30:27.574940] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-07. [2025-09-16T19:30:28.356009] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-16T19:30:28.374870] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-05. [2025-09-16T19:30:29.174968] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-08. [2025-09-16T19:30:29.474531] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-16T19:30:29.936501] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-16T19:30:29.974949] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-04. [2025-09-16T19:30:30.694241] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-16T19:30:30.774858] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-09. [2025-09-16T19:30:31.255751] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-16T19:30:31.574907] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-08. [2025-09-16T19:30:32.297490] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-16T19:30:32.306359] [INFO ] [REMOTE ] MTDR: Full fetch complete (55961 records). [2025-09-16T19:30:32.306497] [DEBUG] [VALIDATOR ] MTDR: Validating primary data. [2025-09-16T19:30:32.379974] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-05. [2025-09-16T19:30:32.691257] [DEBUG] [VALIDATOR ] MTDR: All expected trading days are present. [2025-09-16T19:30:32.691341] [DEBUG] [VALIDATOR ] MTDR: Primary data validation passed. [2025-09-16T19:30:32.692278] [INFO ] [MAIN ] MTDR: Fetched primary data is valid. [2025-09-16T19:30:32.692362] [DEBUG] [LOCAL ] MTDR: Saving primary data. [2025-09-16T19:30:32.693594] [DEBUG] [LOCAL ] MTDR: Trimmed 55961 records to 38375 (keeping 150 days of data) [2025-09-16T19:30:32.929083] [DEBUG] [LOCAL ] MTDR: Primary data saved (38375 records). [2025-09-16T19:30:32.929245] [INFO ] [MAIN ] MTDR: Full history saved. [2025-09-16T19:30:32.930106] [INFO ] [MAIN ] Update Progress: 1418/2369 symbols completed. MTDR took 25.6s. Estimated remaining: 1h 40m 56s. Rate: 9.4 symbols/min [2025-09-16T19:30:33.113629] [INFO ] [MAIN ] MTR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:30:33.119147] [DEBUG] [LOCAL ] MTR: Loaded 1586 existing records from primary storage. [2025-09-16T19:30:33.119238] [INFO ] [MAIN ] MTR: Loaded 1586 existing records. [2025-09-16T19:30:33.183068] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-06. [2025-09-16T19:30:33.302608] [WARN ] [MAIN ] MTR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:30:33.302979] [INFO ] [MAIN ] MTR: Wiping existing primary data before full refresh. [2025-09-16T19:30:33.303130] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-09-16T19:30:33.303482] [DEBUG] [LOCAL ] MTR: Deleted primary data file. [2025-09-16T19:30:33.303578] [INFO ] [MAIN ] MTR: Starting full primary refresh. [2025-09-16T19:30:33.608866] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-16T19:30:33.743728] [INFO ] [REMOTE ] MTR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:30:33.974885] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-09. [2025-09-16T19:30:34.053758] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-16T19:30:34.744530] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-16T19:30:34.774842] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-07. [2025-09-16T19:30:35.531496] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-16T19:30:35.541121] [INFO ] [REMOTE ] MTG: Full fetch complete (55869 records). [2025-09-16T19:30:35.541374] [DEBUG] [VALIDATOR ] MTG: Validating primary data. [2025-09-16T19:30:35.580182] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-06. [2025-09-16T19:30:35.950344] [DEBUG] [VALIDATOR ] MTG: All expected trading days are present. [2025-09-16T19:30:35.950428] [DEBUG] [VALIDATOR ] MTG: Primary data validation passed. [2025-09-16T19:30:35.951340] [INFO ] [MAIN ] MTG: Fetched primary data is valid. [2025-09-16T19:30:35.951387] [DEBUG] [LOCAL ] MTG: Saving primary data. [2025-09-16T19:30:35.952624] [DEBUG] [LOCAL ] MTG: Trimmed 55869 records to 37903 (keeping 150 days of data) [2025-09-16T19:30:36.194807] [DEBUG] [LOCAL ] MTG: Primary data saved (37903 records). [2025-09-16T19:30:36.195020] [INFO ] [MAIN ] MTG: Full history saved. [2025-09-16T19:30:36.195735] [INFO ] [MAIN ] Update Progress: 1419/2369 symbols completed. MTG took 23.7s. Estimated remaining: 1h 40m 48s. Rate: 9.4 symbols/min [2025-09-16T19:30:36.369327] [INFO ] [MAIN ] MTRN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:30:36.379343] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-02. [2025-09-16T19:30:36.406827] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-16T19:30:36.428142] [DEBUG] [LOCAL ] MTRN: Loaded 13585 existing records from primary storage. [2025-09-16T19:30:36.428279] [INFO ] [MAIN ] MTRN: Loaded 13585 existing records. [2025-09-16T19:30:36.609336] [WARN ] [MAIN ] MTRN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:30:36.609581] [INFO ] [MAIN ] MTRN: Wiping existing primary data before full refresh. [2025-09-16T19:30:36.609633] [INFO ] [LOCAL ] MTRN: Starting deletion of primary data. [2025-09-16T19:30:36.610182] [DEBUG] [LOCAL ] MTRN: Deleted primary data file. [2025-09-16T19:30:36.610235] [INFO ] [MAIN ] MTRN: Starting full primary refresh. [2025-09-16T19:30:36.876539] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-16T19:30:36.984848] [INFO ] [REMOTE ] MTRN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:30:37.174888] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-03. [2025-09-16T19:30:37.213615] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-16T19:30:37.532868] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-16T19:30:37.974963] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-02. [2025-09-16T19:30:38.774971] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-04. [2025-09-16T19:30:38.844619] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-16T19:30:39.072732] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-09-16T19:30:39.574931] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-03. [2025-09-16T19:30:40.374898] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-05. [2025-09-16T19:30:40.644065] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-16T19:30:40.736078] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-16T19:30:41.174920] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-07. [2025-09-16T19:30:41.974895] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-08. [2025-09-16T19:30:42.742635] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-16T19:30:42.774862] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-08. [2025-09-16T19:30:43.336902] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-16T19:30:43.574913] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-04. [2025-09-16T19:30:44.070945] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-16T19:30:44.374918] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-09. [2025-09-16T19:30:44.617965] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-16T19:30:45.174910] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-05. [2025-09-16T19:30:45.974952] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-06. [2025-09-16T19:30:46.091761] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-16T19:30:46.097220] [INFO ] [REMOTE ] MTH: Full fetch complete (47968 records). [2025-09-16T19:30:46.097377] [DEBUG] [VALIDATOR ] MTH: Validating primary data. [2025-09-16T19:30:46.508467] [DEBUG] [VALIDATOR ] MTH: All expected trading days are present. [2025-09-16T19:30:46.509254] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-16T19:30:46.509396] [DEBUG] [VALIDATOR ] MTH: Primary data validation passed. [2025-09-16T19:30:46.514980] [INFO ] [MAIN ] MTH: Fetched primary data is valid. [2025-09-16T19:30:46.515635] [DEBUG] [LOCAL ] MTH: Saving primary data. [2025-09-16T19:30:46.516615] [DEBUG] [LOCAL ] MTH: Trimmed 47968 records to 32475 (keeping 150 days of data) [2025-09-16T19:30:46.721882] [DEBUG] [LOCAL ] MTH: Primary data saved (32475 records). [2025-09-16T19:30:46.722019] [INFO ] [MAIN ] MTH: Full history saved. [2025-09-16T19:30:46.722135] [INFO ] [MAIN ] Update Progress: 1420/2369 symbols completed. MTH took 28.9s. Estimated remaining: 1h 40m 44s. Rate: 9.4 symbols/min [2025-09-16T19:30:46.786230] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-06. [2025-09-16T19:30:46.888788] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-16T19:30:46.906507] [INFO ] [MAIN ] MTUS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:30:46.928523] [DEBUG] [LOCAL ] MTUS: Loaded 20687 existing records from primary storage. [2025-09-16T19:30:46.928695] [INFO ] [MAIN ] MTUS: Loaded 20687 existing records. [2025-09-16T19:30:47.104468] [WARN ] [MAIN ] MTUS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:30:47.104714] [INFO ] [MAIN ] MTUS: Wiping existing primary data before full refresh. [2025-09-16T19:30:47.104771] [INFO ] [LOCAL ] MTUS: Starting deletion of primary data. [2025-09-16T19:30:47.105300] [DEBUG] [LOCAL ] MTUS: Deleted primary data file. [2025-09-16T19:30:47.105345] [INFO ] [MAIN ] MTUS: Starting full primary refresh. [2025-09-16T19:30:47.461568] [INFO ] [REMOTE ] MTUS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:30:47.574888] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-09. [2025-09-16T19:30:47.742635] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-16T19:30:48.374964] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-07. [2025-09-16T19:30:48.732096] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-16T19:30:48.737170] [INFO ] [REMOTE ] MTN: Full fetch complete (42420 records). [2025-09-16T19:30:48.737323] [DEBUG] [VALIDATOR ] MTN: Validating primary data. [2025-09-16T19:30:48.915066] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-16T19:30:49.114197] [DEBUG] [VALIDATOR ] MTN: All expected trading days are present. [2025-09-16T19:30:49.114281] [DEBUG] [VALIDATOR ] MTN: Primary data validation passed. [2025-09-16T19:30:49.115084] [INFO ] [MAIN ] MTN: Fetched primary data is valid. [2025-09-16T19:30:49.115129] [DEBUG] [LOCAL ] MTN: Saving primary data. [2025-09-16T19:30:49.116082] [DEBUG] [LOCAL ] MTN: Trimmed 42420 records to 28880 (keeping 150 days of data) [2025-09-16T19:30:49.178499] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-07. [2025-09-16T19:30:49.307290] [DEBUG] [LOCAL ] MTN: Primary data saved (28880 records). [2025-09-16T19:30:49.307445] [INFO ] [MAIN ] MTN: Full history saved. [2025-09-16T19:30:49.307550] [INFO ] [MAIN ] Update Progress: 1421/2369 symbols completed. MTN took 28.4s. Estimated remaining: 1h 40m 35s. Rate: 9.4 symbols/min [2025-09-16T19:30:49.474331] [INFO ] [MAIN ] MTW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:30:49.494940] [DEBUG] [LOCAL ] MTW: Loaded 19697 existing records from primary storage. [2025-09-16T19:30:49.495071] [INFO ] [MAIN ] MTW: Loaded 19697 existing records. [2025-09-16T19:30:49.668437] [WARN ] [MAIN ] MTW: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:30:49.668728] [INFO ] [MAIN ] MTW: Wiping existing primary data before full refresh. [2025-09-16T19:30:49.668789] [INFO ] [LOCAL ] MTW: Starting deletion of primary data. [2025-09-16T19:30:49.669348] [DEBUG] [LOCAL ] MTW: Deleted primary data file. [2025-09-16T19:30:49.669397] [INFO ] [MAIN ] MTW: Starting full primary refresh. [2025-09-16T19:30:49.989410] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-08. [2025-09-16T19:30:50.028013] [INFO ] [REMOTE ] MTW: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:30:50.195761] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-16T19:30:50.385714] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-16T19:30:50.774905] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-02. [2025-09-16T19:30:51.574917] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-02. [2025-09-16T19:30:51.941406] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-16T19:30:52.374898] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-03. [2025-09-16T19:30:52.911134] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-16T19:30:53.174929] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-03. [2025-09-16T19:30:53.757506] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-16T19:30:53.974979] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-04. [2025-09-16T19:30:54.277808] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-16T19:30:54.774945] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-09. [2025-09-16T19:30:55.269219] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-16T19:30:55.294940] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-16T19:30:55.295771] [INFO ] [REMOTE ] MTR: Full fetch complete (1924 records). [2025-09-16T19:30:55.295892] [DEBUG] [VALIDATOR ] MTR: Validating primary data. [2025-09-16T19:30:55.580141] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-05. [2025-09-16T19:30:55.661191] [DEBUG] [VALIDATOR ] MTR: All expected trading days are present. [2025-09-16T19:30:55.661411] [DEBUG] [VALIDATOR ] MTR: Primary data validation passed. [2025-09-16T19:30:55.661530] [INFO ] [MAIN ] MTR: Fetched primary data is valid. [2025-09-16T19:30:55.661569] [DEBUG] [LOCAL ] MTR: Saving primary data. [2025-09-16T19:30:55.661997] [DEBUG] [LOCAL ] MTR: Trimmed 1924 records to 1590 (keeping 150 days of data) [2025-09-16T19:30:55.672787] [DEBUG] [LOCAL ] MTR: Primary data saved (1590 records). [2025-09-16T19:30:55.672876] [INFO ] [MAIN ] MTR: Full history saved. [2025-09-16T19:30:55.672969] [INFO ] [MAIN ] Update Progress: 1422/2369 symbols completed. MTR took 22.7s. Estimated remaining: 1h 40m 29s. Rate: 9.4 symbols/min [2025-09-16T19:30:55.847596] [INFO ] [MAIN ] MTX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:30:55.874378] [DEBUG] [LOCAL ] MTX: Loaded 17395 existing records from primary storage. [2025-09-16T19:30:55.874577] [INFO ] [MAIN ] MTX: Loaded 17395 existing records. [2025-09-16T19:30:56.058609] [WARN ] [MAIN ] MTX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:30:56.058876] [INFO ] [MAIN ] MTX: Wiping existing primary data before full refresh. [2025-09-16T19:30:56.058922] [INFO ] [LOCAL ] MTX: Starting deletion of primary data. [2025-09-16T19:30:56.059566] [DEBUG] [LOCAL ] MTX: Deleted primary data file. [2025-09-16T19:30:56.059613] [INFO ] [MAIN ] MTX: Starting full primary refresh. [2025-09-16T19:30:56.384298] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-04. [2025-09-16T19:30:56.422572] [INFO ] [REMOTE ] MTX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:30:56.969140] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-16T19:30:57.174921] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-02. [2025-09-16T19:30:57.706166] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-16T19:30:57.974909] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-05. [2025-09-16T19:30:58.235142] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-16T19:30:58.774916] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-06. [2025-09-16T19:30:59.430518] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-16T19:30:59.574968] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-06. [2025-09-16T19:30:59.943546] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-16T19:31:00.374957] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-08. [2025-09-16T19:31:01.174921] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-07. [2025-09-16T19:31:01.253667] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-16T19:31:01.470036] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-16T19:31:01.974916] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-09. [2025-09-16T19:31:02.425166] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-16T19:31:02.774885] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-07. [2025-09-16T19:31:02.982627] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-16T19:31:02.985013] [INFO ] [REMOTE ] MTRN: Full fetch complete (18914 records). [2025-09-16T19:31:02.985092] [DEBUG] [VALIDATOR ] MTRN: Validating primary data. [2025-09-16T19:31:03.353511] [DEBUG] [VALIDATOR ] MTRN: All expected trading days are present. [2025-09-16T19:31:03.353636] [DEBUG] [VALIDATOR ] MTRN: Primary data validation passed. [2025-09-16T19:31:03.354172] [INFO ] [MAIN ] MTRN: Fetched primary data is valid. [2025-09-16T19:31:03.354219] [DEBUG] [LOCAL ] MTRN: Saving primary data. [2025-09-16T19:31:03.354875] [DEBUG] [LOCAL ] MTRN: Trimmed 18914 records to 13726 (keeping 150 days of data) [2025-09-16T19:31:03.442736] [DEBUG] [LOCAL ] MTRN: Primary data saved (13726 records). [2025-09-16T19:31:03.442880] [INFO ] [MAIN ] MTRN: Full history saved. [2025-09-16T19:31:03.442960] [INFO ] [MAIN ] Update Progress: 1423/2369 symbols completed. MTRN took 27.2s. Estimated remaining: 1h 40m 23s. Rate: 9.4 symbols/min [2025-09-16T19:31:03.583101] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-03. [2025-09-16T19:31:03.613972] [INFO ] [MAIN ] MTZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:31:03.652603] [DEBUG] [LOCAL ] MTZ: Loaded 31459 existing records from primary storage. [2025-09-16T19:31:03.652796] [INFO ] [MAIN ] MTZ: Loaded 31459 existing records. [2025-09-16T19:31:03.832485] [WARN ] [MAIN ] MTZ: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:31:03.832790] [INFO ] [MAIN ] MTZ: Wiping existing primary data before full refresh. [2025-09-16T19:31:03.832838] [INFO ] [LOCAL ] MTZ: Starting deletion of primary data. [2025-09-16T19:31:03.833519] [DEBUG] [LOCAL ] MTZ: Deleted primary data file. [2025-09-16T19:31:03.833566] [INFO ] [MAIN ] MTZ: Starting full primary refresh. [2025-09-16T19:31:04.204987] [INFO ] [REMOTE ] MTZ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:31:04.227057] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-16T19:31:04.374905] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-02. [2025-09-16T19:31:04.722563] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-16T19:31:05.174904] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-04. [2025-09-16T19:31:05.636507] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-16T19:31:05.974951] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-08. [2025-09-16T19:31:06.316073] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-16T19:31:06.774917] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-03. [2025-09-16T19:31:07.151176] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-16T19:31:07.574905] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-09. [2025-09-16T19:31:08.374887] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-05. [2025-09-16T19:31:08.571325] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-16T19:31:08.619764] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-16T19:31:08.623348] [INFO ] [REMOTE ] MTUS: Full fetch complete (31780 records). [2025-09-16T19:31:08.623439] [DEBUG] [VALIDATOR ] MTUS: Validating primary data. [2025-09-16T19:31:09.018480] [DEBUG] [VALIDATOR ] MTUS: All expected trading days are present. [2025-09-16T19:31:09.018561] [DEBUG] [VALIDATOR ] MTUS: Primary data validation passed. [2025-09-16T19:31:09.019284] [INFO ] [MAIN ] MTUS: Fetched primary data is valid. [2025-09-16T19:31:09.019332] [DEBUG] [LOCAL ] MTUS: Saving primary data. [2025-09-16T19:31:09.020129] [DEBUG] [LOCAL ] MTUS: Trimmed 31780 records to 20861 (keeping 150 days of data) [2025-09-16T19:31:09.146082] [DEBUG] [LOCAL ] MTUS: Primary data saved (20861 records). [2025-09-16T19:31:09.146218] [INFO ] [MAIN ] MTUS: Full history saved. [2025-09-16T19:31:09.146306] [INFO ] [MAIN ] Update Progress: 1424/2369 symbols completed. MTUS took 22.4s. Estimated remaining: 1h 40m 16s. Rate: 9.4 symbols/min [2025-09-16T19:31:09.179963] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-08. [2025-09-16T19:31:09.330589] [INFO ] [MAIN ] MUA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:31:09.341049] [DEBUG] [LOCAL ] MUA: Loaded 8367 existing records from primary storage. [2025-09-16T19:31:09.341182] [INFO ] [MAIN ] MUA: Loaded 8367 existing records. [2025-09-16T19:31:09.534202] [WARN ] [MAIN ] MUA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:31:09.534615] [INFO ] [MAIN ] MUA: Wiping existing primary data before full refresh. [2025-09-16T19:31:09.534772] [INFO ] [LOCAL ] MUA: Starting deletion of primary data. [2025-09-16T19:31:09.540224] [DEBUG] [LOCAL ] MUA: Deleted primary data file. [2025-09-16T19:31:09.548401] [INFO ] [MAIN ] MUA: Starting full primary refresh. [2025-09-16T19:31:09.555963] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-16T19:31:09.932893] [INFO ] [REMOTE ] MUA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:31:09.974867] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-06. [2025-09-16T19:31:10.305237] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-16T19:31:10.774913] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-02. [2025-09-16T19:31:11.127313] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-16T19:31:11.574904] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-07. [2025-09-16T19:31:11.817382] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-16T19:31:12.374871] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-03. [2025-09-16T19:31:12.790041] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-16T19:31:13.139307] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-16T19:31:13.174905] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-08. [2025-09-16T19:31:13.974921] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-04. [2025-09-16T19:31:14.354324] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-16T19:31:14.774942] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-09. [2025-09-16T19:31:14.901696] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-16T19:31:15.574886] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-04. [2025-09-16T19:31:15.865055] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-16T19:31:15.869459] [INFO ] [REMOTE ] MTX: Full fetch complete (24921 records). [2025-09-16T19:31:15.869596] [DEBUG] [VALIDATOR ] MTX: Validating primary data. [2025-09-16T19:31:16.261869] [DEBUG] [VALIDATOR ] MTX: All expected trading days are present. [2025-09-16T19:31:16.261957] [DEBUG] [VALIDATOR ] MTX: Primary data validation passed. [2025-09-16T19:31:16.262521] [INFO ] [MAIN ] MTX: Fetched primary data is valid. [2025-09-16T19:31:16.262565] [DEBUG] [LOCAL ] MTX: Saving primary data. [2025-09-16T19:31:16.263408] [DEBUG] [LOCAL ] MTX: Trimmed 24921 records to 17516 (keeping 150 days of data) [2025-09-16T19:31:16.370634] [DEBUG] [LOCAL ] MTX: Primary data saved (17516 records). [2025-09-16T19:31:16.370782] [INFO ] [MAIN ] MTX: Full history saved. [2025-09-16T19:31:16.370865] [INFO ] [MAIN ] Update Progress: 1425/2369 symbols completed. MTX took 20.7s. Estimated remaining: 1h 40m 11s. Rate: 9.4 symbols/min [2025-09-16T19:31:16.382262] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-05. [2025-09-16T19:31:16.548258] [INFO ] [MAIN ] MUC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:31:16.563253] [DEBUG] [LOCAL ] MUC: Loaded 14348 existing records from primary storage. [2025-09-16T19:31:16.563404] [INFO ] [MAIN ] MUC: Loaded 14348 existing records. [2025-09-16T19:31:16.743121] [WARN ] [MAIN ] MUC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:31:16.743362] [INFO ] [MAIN ] MUC: Wiping existing primary data before full refresh. [2025-09-16T19:31:16.743409] [INFO ] [LOCAL ] MUC: Starting deletion of primary data. [2025-09-16T19:31:16.743846] [DEBUG] [LOCAL ] MUC: Deleted primary data file. [2025-09-16T19:31:16.743895] [INFO ] [MAIN ] MUC: Starting full primary refresh. [2025-09-16T19:31:17.099261] [INFO ] [REMOTE ] MUC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:31:17.184203] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-02. [2025-09-16T19:31:17.202887] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-16T19:31:17.225369] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-16T19:31:17.975026] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-05. [2025-09-16T19:31:18.245128] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-16T19:31:18.775019] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-03. [2025-09-16T19:31:19.574966] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-09. [2025-09-16T19:31:19.712757] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-16T19:31:20.006471] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-16T19:31:20.374952] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-06. [2025-09-16T19:31:20.471681] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-16T19:31:20.475022] [INFO ] [REMOTE ] MTW: Full fetch complete (29439 records). [2025-09-16T19:31:20.475121] [DEBUG] [VALIDATOR ] MTW: Validating primary data. [2025-09-16T19:31:20.896498] [DEBUG] [VALIDATOR ] MTW: All expected trading days are present. [2025-09-16T19:31:20.896581] [DEBUG] [VALIDATOR ] MTW: Primary data validation passed. [2025-09-16T19:31:20.897235] [INFO ] [MAIN ] MTW: Fetched primary data is valid. [2025-09-16T19:31:20.897283] [DEBUG] [LOCAL ] MTW: Saving primary data. [2025-09-16T19:31:20.898100] [DEBUG] [LOCAL ] MTW: Trimmed 29439 records to 19869 (keeping 150 days of data) [2025-09-16T19:31:21.013880] [DEBUG] [LOCAL ] MTW: Primary data saved (19869 records). [2025-09-16T19:31:21.014177] [INFO ] [MAIN ] MTW: Full history saved. [2025-09-16T19:31:21.014314] [INFO ] [MAIN ] Update Progress: 1426/2369 symbols completed. MTW took 31.7s. Estimated remaining: 1h 40m 3s. Rate: 9.4 symbols/min [2025-09-16T19:31:21.183274] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-06. [2025-09-16T19:31:21.185856] [INFO ] [MAIN ] MUE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:31:21.196851] [DEBUG] [LOCAL ] MUE: Loaded 9308 existing records from primary storage. [2025-09-16T19:31:21.196975] [INFO ] [MAIN ] MUE: Loaded 9308 existing records. [2025-09-16T19:31:21.375582] [WARN ] [MAIN ] MUE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:31:21.375851] [INFO ] [MAIN ] MUE: Wiping existing primary data before full refresh. [2025-09-16T19:31:21.375897] [INFO ] [LOCAL ] MUE: Starting deletion of primary data. [2025-09-16T19:31:21.376260] [DEBUG] [LOCAL ] MUE: Deleted primary data file. [2025-09-16T19:31:21.376309] [INFO ] [MAIN ] MUE: Starting full primary refresh. [2025-09-16T19:31:21.736436] [INFO ] [REMOTE ] MUE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:31:21.973749] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-16T19:31:21.982195] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-02. [2025-09-16T19:31:22.024689] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-16T19:31:22.698406] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-16T19:31:22.774915] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-07. [2025-09-16T19:31:23.574975] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-07. [2025-09-16T19:31:24.374918] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-04. [2025-09-16T19:31:24.428086] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-16T19:31:24.457218] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-16T19:31:25.174903] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-08. [2025-09-16T19:31:25.496799] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-16T19:31:25.974890] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-05. [2025-09-16T19:31:26.102587] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-16T19:31:26.728053] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-16T19:31:26.774866] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-08. [2025-09-16T19:31:27.574944] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-06. [2025-09-16T19:31:28.374909] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-03. [2025-09-16T19:31:28.530772] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-16T19:31:28.581776] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-16T19:31:28.838097] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-16T19:31:29.174890] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-07. [2025-09-16T19:31:29.974893] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-09. [2025-09-16T19:31:30.307807] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-16T19:31:30.774908] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-09. [2025-09-16T19:31:31.557466] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-16T19:31:31.562666] [INFO ] [REMOTE ] MTZ: Full fetch complete (47573 records). [2025-09-16T19:31:31.562812] [DEBUG] [VALIDATOR ] MTZ: Validating primary data. [2025-09-16T19:31:31.584320] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-04. [2025-09-16T19:31:31.696591] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-16T19:31:31.748369] [INFO ] [REMOTE ] MUA: Full fetch complete (13571 records). [2025-09-16T19:31:31.758701] [DEBUG] [VALIDATOR ] MUA: Validating primary data. [2025-09-16T19:31:32.248975] [DEBUG] [VALIDATOR ] MTZ: All expected trading days are present. [2025-09-16T19:31:32.268167] [DEBUG] [VALIDATOR ] MTZ: Primary data validation passed. [2025-09-16T19:31:32.271253] [INFO ] [MAIN ] MTZ: Fetched primary data is valid. [2025-09-16T19:31:32.271578] [DEBUG] [LOCAL ] MTZ: Saving primary data. [2025-09-16T19:31:32.328204] [DEBUG] [LOCAL ] MTZ: Trimmed 47573 records to 31729 (keeping 150 days of data) [2025-09-16T19:31:32.351884] [DEBUG] [VALIDATOR ] MUA: All expected trading days are present. [2025-09-16T19:31:32.352203] [DEBUG] [VALIDATOR ] MUA: Primary data validation passed. [2025-09-16T19:31:32.352373] [INFO ] [MAIN ] MUA: Fetched primary data is valid. [2025-09-16T19:31:32.352593] [DEBUG] [LOCAL ] MUA: Saving primary data. [2025-09-16T19:31:32.353190] [DEBUG] [LOCAL ] MUA: Trimmed 13571 records to 8428 (keeping 150 days of data) [2025-09-16T19:31:32.426390] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-08. [2025-09-16T19:31:32.502479] [DEBUG] [LOCAL ] MUA: Primary data saved (8428 records). [2025-09-16T19:31:32.505670] [INFO ] [MAIN ] MUA: Full history saved. [2025-09-16T19:31:32.506500] [INFO ] [MAIN ] Update Progress: 1427/2369 symbols completed. MUA took 23.4s. Estimated remaining: 1h 40m 0s. Rate: 9.4 symbols/min [2025-09-16T19:31:32.645385] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-16T19:31:32.711050] [INFO ] [MAIN ] MUFG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:31:32.806737] [DEBUG] [LOCAL ] MUFG: Loaded 38767 existing records from primary storage. [2025-09-16T19:31:32.809941] [INFO ] [MAIN ] MUFG: Loaded 38767 existing records. [2025-09-16T19:31:32.809874] [DEBUG] [LOCAL ] MTZ: Primary data saved (31729 records). [2025-09-16T19:31:32.810045] [INFO ] [MAIN ] MTZ: Full history saved. [2025-09-16T19:31:32.842592] [INFO ] [MAIN ] Update Progress: 1428/2369 symbols completed. MTZ took 29.4s. Estimated remaining: 1h 39m 50s. Rate: 9.4 symbols/min [2025-09-16T19:31:33.135745] [WARN ] [MAIN ] MUFG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:31:33.167861] [INFO ] [MAIN ] MUJ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:31:33.166776] [INFO ] [MAIN ] MUFG: Wiping existing primary data before full refresh. [2025-09-16T19:31:33.168025] [INFO ] [LOCAL ] MUFG: Starting deletion of primary data. [2025-09-16T19:31:33.169469] [DEBUG] [LOCAL ] MUFG: Deleted primary data file. [2025-09-16T19:31:33.169833] [INFO ] [MAIN ] MUFG: Starting full primary refresh. [2025-09-16T19:31:33.175053] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-05. [2025-09-16T19:31:33.312411] [DEBUG] [LOCAL ] MUJ: Loaded 10188 existing records from primary storage. [2025-09-16T19:31:33.360005] [INFO ] [MAIN ] MUJ: Loaded 10188 existing records. [2025-09-16T19:31:33.713914] [WARN ] [MAIN ] MUJ: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:31:33.731194] [INFO ] [REMOTE ] MUFG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:31:33.732072] [INFO ] [MAIN ] MUJ: Wiping existing primary data before full refresh. [2025-09-16T19:31:33.733261] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-16T19:31:33.733320] [INFO ] [LOCAL ] MUJ: Starting deletion of primary data. [2025-09-16T19:31:33.738385] [DEBUG] [LOCAL ] MUJ: Deleted primary data file. [2025-09-16T19:31:33.738441] [INFO ] [MAIN ] MUJ: Starting full primary refresh. [2025-09-16T19:31:33.983039] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-09. [2025-09-16T19:31:34.094104] [INFO ] [REMOTE ] MUJ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:31:34.101566] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-16T19:31:34.774874] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-02. [2025-09-16T19:31:35.062599] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-16T19:31:35.066996] [INFO ] [REMOTE ] MUC: Full fetch complete (21408 records). [2025-09-16T19:31:35.067095] [DEBUG] [VALIDATOR ] MUC: Validating primary data. [2025-09-16T19:31:35.428728] [DEBUG] [VALIDATOR ] MUC: All expected trading days are present. [2025-09-16T19:31:35.428806] [DEBUG] [VALIDATOR ] MUC: Primary data validation passed. [2025-09-16T19:31:35.429251] [INFO ] [MAIN ] MUC: Fetched primary data is valid. [2025-09-16T19:31:35.429290] [DEBUG] [LOCAL ] MUC: Saving primary data. [2025-09-16T19:31:35.429940] [DEBUG] [LOCAL ] MUC: Trimmed 21408 records to 14448 (keeping 150 days of data) [2025-09-16T19:31:35.517288] [DEBUG] [LOCAL ] MUC: Primary data saved (14448 records). [2025-09-16T19:31:35.517421] [INFO ] [MAIN ] MUC: Full history saved. [2025-09-16T19:31:35.517515] [INFO ] [MAIN ] Update Progress: 1429/2369 symbols completed. MUC took 19.1s. Estimated remaining: 1h 39m 41s. Rate: 9.4 symbols/min [2025-09-16T19:31:35.583966] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-02. [2025-09-16T19:31:35.692682] [INFO ] [MAIN ] MUR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:31:35.731274] [DEBUG] [LOCAL ] MUR: Loaded 38975 existing records from primary storage. [2025-09-16T19:31:35.731410] [INFO ] [MAIN ] MUR: Loaded 38975 existing records. [2025-09-16T19:31:35.906360] [WARN ] [MAIN ] MUR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:31:35.906613] [INFO ] [MAIN ] MUR: Wiping existing primary data before full refresh. [2025-09-16T19:31:35.906676] [INFO ] [LOCAL ] MUR: Starting deletion of primary data. [2025-09-16T19:31:35.907504] [DEBUG] [LOCAL ] MUR: Deleted primary data file. [2025-09-16T19:31:35.907550] [INFO ] [MAIN ] MUR: Starting full primary refresh. [2025-09-16T19:31:36.254069] [INFO ] [REMOTE ] MUR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:31:36.300196] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-16T19:31:36.374817] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-06. [2025-09-16T19:31:36.428952] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-16T19:31:37.174898] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-03. [2025-09-16T19:31:37.405064] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-16T19:31:37.945236] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-16T19:31:37.974924] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-02. [2025-09-16T19:31:38.774902] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-07. [2025-09-16T19:31:39.586687] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-03. [2025-09-16T19:31:39.608448] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-16T19:31:39.630903] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-16T19:31:40.374893] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-08. [2025-09-16T19:31:41.174946] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-03. [2025-09-16T19:31:41.284039] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-16T19:31:41.645284] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-16T19:31:41.974908] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-09. [2025-09-16T19:31:42.726897] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-16T19:31:42.729034] [INFO ] [REMOTE ] MUE: Full fetch complete (12557 records). [2025-09-16T19:31:42.729104] [DEBUG] [VALIDATOR ] MUE: Validating primary data. [2025-09-16T19:31:42.784039] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-04. [2025-09-16T19:31:43.125002] [DEBUG] [VALIDATOR ] MUE: All expected trading days are present. [2025-09-16T19:31:43.127794] [DEBUG] [VALIDATOR ] MUE: Primary data validation passed. [2025-09-16T19:31:43.128085] [INFO ] [MAIN ] MUE: Fetched primary data is valid. [2025-09-16T19:31:43.128271] [DEBUG] [LOCAL ] MUE: Saving primary data. [2025-09-16T19:31:43.129958] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-16T19:31:43.140833] [DEBUG] [LOCAL ] MUE: Trimmed 12557 records to 9379 (keeping 150 days of data) [2025-09-16T19:31:43.197377] [DEBUG] [LOCAL ] MUE: Primary data saved (9379 records). [2025-09-16T19:31:43.197519] [INFO ] [MAIN ] MUE: Full history saved. [2025-09-16T19:31:43.197636] [INFO ] [MAIN ] Update Progress: 1430/2369 symbols completed. MUE took 22.2s. Estimated remaining: 1h 39m 36s. Rate: 9.4 symbols/min [2025-09-16T19:31:43.374762] [INFO ] [MAIN ] MUSA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:31:43.392999] [DEBUG] [LOCAL ] MUSA: Loaded 18513 existing records from primary storage. [2025-09-16T19:31:43.393124] [INFO ] [MAIN ] MUSA: Loaded 18513 existing records. [2025-09-16T19:31:43.567773] [WARN ] [MAIN ] MUSA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:31:43.568004] [INFO ] [MAIN ] MUSA: Wiping existing primary data before full refresh. [2025-09-16T19:31:43.568057] [INFO ] [LOCAL ] MUSA: Starting deletion of primary data. [2025-09-16T19:31:43.568587] [DEBUG] [LOCAL ] MUSA: Deleted primary data file. [2025-09-16T19:31:43.568631] [INFO ] [MAIN ] MUSA: Starting full primary refresh. [2025-09-16T19:31:43.581224] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-04. [2025-09-16T19:31:43.738877] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-16T19:31:43.938979] [INFO ] [REMOTE ] MUSA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:31:44.374932] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-02. [2025-09-16T19:31:45.174865] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-04. [2025-09-16T19:31:45.629843] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-16T19:31:45.736527] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-16T19:31:45.974928] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-03. [2025-09-16T19:31:46.689433] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-16T19:31:46.774893] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-05. [2025-09-16T19:31:47.020445] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-16T19:31:47.574961] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-05. [2025-09-16T19:31:48.374901] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-04. [2025-09-16T19:31:48.493816] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-16T19:31:48.561131] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-16T19:31:49.174884] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-06. [2025-09-16T19:31:49.552816] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-16T19:31:49.938098] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-16T19:31:49.974871] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-06. [2025-09-16T19:31:50.775004] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-07. [2025-09-16T19:31:51.574879] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-05. [2025-09-16T19:31:51.645448] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-16T19:31:51.665091] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-16T19:31:52.374885] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-07. [2025-09-16T19:31:52.971491] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-16T19:31:53.174897] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-06. [2025-09-16T19:31:53.983632] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-08. [2025-09-16T19:31:53.986691] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-16T19:31:54.338710] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-16T19:31:54.774924] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-07. [2025-09-16T19:31:54.900964] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-16T19:31:55.574948] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-05. [2025-09-16T19:31:56.053791] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-16T19:31:56.374943] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-08. [2025-09-16T19:31:57.110822] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-16T19:31:57.174872] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-06. [2025-09-16T19:31:57.974953] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-08. [2025-09-16T19:31:58.175570] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-16T19:31:58.759241] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-16T19:31:58.774845] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-09. [2025-09-16T19:31:58.987494] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-16T19:31:59.574944] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-07. [2025-09-16T19:32:00.072439] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-16T19:32:00.077250] [INFO ] [REMOTE ] MUSA: Full fetch complete (27540 records). [2025-09-16T19:32:00.077381] [DEBUG] [VALIDATOR ] MUSA: Validating primary data. [2025-09-16T19:32:00.380032] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-09. [2025-09-16T19:32:00.453063] [DEBUG] [VALIDATOR ] MUSA: All expected trading days are present. [2025-09-16T19:32:00.453143] [DEBUG] [VALIDATOR ] MUSA: Primary data validation passed. [2025-09-16T19:32:00.453739] [INFO ] [MAIN ] MUSA: Fetched primary data is valid. [2025-09-16T19:32:00.453799] [DEBUG] [LOCAL ] MUSA: Saving primary data. [2025-09-16T19:32:00.454636] [DEBUG] [LOCAL ] MUSA: Trimmed 27540 records to 18704 (keeping 150 days of data) [2025-09-16T19:32:00.573301] [DEBUG] [LOCAL ] MUSA: Primary data saved (18704 records). [2025-09-16T19:32:00.573454] [INFO ] [MAIN ] MUSA: Full history saved. [2025-09-16T19:32:00.573578] [INFO ] [MAIN ] Update Progress: 1431/2369 symbols completed. MUSA took 17.4s. Estimated remaining: 1h 39m 36s. Rate: 9.4 symbols/min [2025-09-16T19:32:00.750163] [INFO ] [MAIN ] MUSE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:32:00.750387] [DEBUG] [LOCAL ] MUSE: No existing data file found in primary storage. [2025-09-16T19:32:00.750433] [WARN ] [MAIN ] MUSE: No existing data found, performing full refresh instead. [2025-09-16T19:32:00.750578] [INFO ] [MAIN ] MUSE: Wiping existing primary data before full refresh. [2025-09-16T19:32:00.750619] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-09-16T19:32:00.750687] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-09-16T19:32:00.750721] [INFO ] [MAIN ] MUSE: Starting full primary refresh. [2025-09-16T19:32:01.109515] [INFO ] [REMOTE ] MUSE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:32:01.174930] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-09. [2025-09-16T19:32:01.613394] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-16T19:32:01.974897] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-08. [2025-09-16T19:32:02.120675] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-16T19:32:02.124246] [INFO ] [REMOTE ] MUJ: Full fetch complete (13866 records). [2025-09-16T19:32:02.124359] [DEBUG] [VALIDATOR ] MUJ: Validating primary data. [2025-09-16T19:32:02.458543] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-16T19:32:02.517987] [INFO ] [REMOTE ] MUFG: Full fetch complete (57164 records). [2025-09-16T19:32:02.525407] [DEBUG] [VALIDATOR ] MUJ: All expected trading days are present. [2025-09-16T19:32:02.525535] [DEBUG] [VALIDATOR ] MUFG: Validating primary data. [2025-09-16T19:32:02.525624] [DEBUG] [VALIDATOR ] MUJ: Primary data validation passed. [2025-09-16T19:32:02.526163] [INFO ] [MAIN ] MUJ: Fetched primary data is valid. [2025-09-16T19:32:02.526288] [DEBUG] [LOCAL ] MUJ: Saving primary data. [2025-09-16T19:32:02.618911] [DEBUG] [LOCAL ] MUJ: Trimmed 13866 records to 10300 (keeping 150 days of data) [2025-09-16T19:32:02.801985] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-02. [2025-09-16T19:32:02.968812] [DEBUG] [VALIDATOR ] MUFG: All expected trading days are present. [2025-09-16T19:32:02.971777] [DEBUG] [VALIDATOR ] MUFG: Primary data validation passed. [2025-09-16T19:32:02.973344] [INFO ] [MAIN ] MUFG: Fetched primary data is valid. [2025-09-16T19:32:02.973917] [DEBUG] [LOCAL ] MUFG: Saving primary data. [2025-09-16T19:32:02.977346] [DEBUG] [LOCAL ] MUFG: Trimmed 57164 records to 39152 (keeping 150 days of data) [2025-09-16T19:32:02.981031] [DEBUG] [LOCAL ] MUJ: Primary data saved (10300 records). [2025-09-16T19:32:02.981160] [INFO ] [MAIN ] MUJ: Full history saved. [2025-09-16T19:32:02.981275] [INFO ] [MAIN ] Update Progress: 1432/2369 symbols completed. MUJ took 30.1s. Estimated remaining: 1h 39m 27s. Rate: 9.4 symbols/min [2025-09-16T19:32:03.111997] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:32:03.170331] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-02 [2025-09-16T19:32:03.278596] [INFO ] [MAIN ] MUX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:32:03.408958] [DEBUG] [LOCAL ] MUFG: Primary data saved (39152 records). [2025-09-16T19:32:03.409234] [INFO ] [MAIN ] MUFG: Full history saved. [2025-09-16T19:32:03.409393] [INFO ] [MAIN ] Update Progress: 1433/2369 symbols completed. MUFG took 30.9s. Estimated remaining: 1h 39m 17s. Rate: 9.4 symbols/min [2025-09-16T19:32:03.506391] [DEBUG] [LOCAL ] MUX: Loaded 30886 existing records from primary storage. [2025-09-16T19:32:03.522586] [INFO ] [MAIN ] MUX: Loaded 30886 existing records. [2025-09-16T19:32:03.576010] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-03. [2025-09-16T19:32:03.700410] [INFO ] [MAIN ] MVF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:32:03.773267] [WARN ] [MAIN ] MUX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:32:03.773763] [INFO ] [MAIN ] MUX: Wiping existing primary data before full refresh. [2025-09-16T19:32:03.773832] [INFO ] [LOCAL ] MUX: Starting deletion of primary data. [2025-09-16T19:32:03.779141] [DEBUG] [LOCAL ] MUX: Deleted primary data file. [2025-09-16T19:32:03.779312] [INFO ] [MAIN ] MUX: Starting full primary refresh. [2025-09-16T19:32:03.898067] [DEBUG] [LOCAL ] MVF: Loaded 8769 existing records from primary storage. [2025-09-16T19:32:03.905750] [INFO ] [MAIN ] MVF: Loaded 8769 existing records. [2025-09-16T19:32:03.905668] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-16T19:32:04.022726] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-16T19:32:04.286533] [WARN ] [MAIN ] MVF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:32:04.286815] [INFO ] [MAIN ] MVF: Wiping existing primary data before full refresh. [2025-09-16T19:32:04.287064] [INFO ] [LOCAL ] MVF: Starting deletion of primary data. [2025-09-16T19:32:04.302818] [DEBUG] [LOCAL ] MVF: Deleted primary data file. [2025-09-16T19:32:04.313061] [INFO ] [MAIN ] MVF: Starting full primary refresh. [2025-09-16T19:32:04.379136] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-09. [2025-09-16T19:32:04.462883] [INFO ] [REMOTE ] MUX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:32:04.743314] [INFO ] [REMOTE ] MVF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:32:05.174910] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-02. [2025-09-16T19:32:05.974880] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-02. [2025-09-16T19:32:06.125810] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-16T19:32:06.132342] [INFO ] [REMOTE ] MUR: Full fetch complete (57587 records). [2025-09-16T19:32:06.132448] [DEBUG] [VALIDATOR ] MUR: Validating primary data. [2025-09-16T19:32:06.517547] [DEBUG] [VALIDATOR ] MUR: All expected trading days are present. [2025-09-16T19:32:06.517716] [DEBUG] [VALIDATOR ] MUR: Primary data validation passed. [2025-09-16T19:32:06.518715] [INFO ] [MAIN ] MUR: Fetched primary data is valid. [2025-09-16T19:32:06.518807] [DEBUG] [LOCAL ] MUR: Saving primary data. [2025-09-16T19:32:06.527244] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-16T19:32:06.530531] [DEBUG] [LOCAL ] MUR: Trimmed 57587 records to 39364 (keeping 150 days of data) [2025-09-16T19:32:06.648571] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-16T19:32:06.777570] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-03. [2025-09-16T19:32:06.815328] [DEBUG] [LOCAL ] MUR: Primary data saved (39364 records). [2025-09-16T19:32:06.815505] [INFO ] [MAIN ] MUR: Full history saved. [2025-09-16T19:32:06.816209] [INFO ] [MAIN ] Update Progress: 1434/2369 symbols completed. MUR took 31.3s. Estimated remaining: 1h 39m 9s. Rate: 9.4 symbols/min [2025-09-16T19:32:07.002260] [INFO ] [MAIN ] MVO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:32:07.011883] [DEBUG] [LOCAL ] MVO: Loaded 6388 existing records from primary storage. [2025-09-16T19:32:07.012106] [INFO ] [MAIN ] MVO: Loaded 6388 existing records. [2025-09-16T19:32:07.202378] [WARN ] [MAIN ] MVO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:32:07.202638] [INFO ] [MAIN ] MVO: Wiping existing primary data before full refresh. [2025-09-16T19:32:07.202706] [INFO ] [LOCAL ] MVO: Starting deletion of primary data. [2025-09-16T19:32:07.203036] [DEBUG] [LOCAL ] MVO: Deleted primary data file. [2025-09-16T19:32:07.203084] [INFO ] [MAIN ] MVO: Starting full primary refresh. [2025-09-16T19:32:07.558487] [INFO ] [REMOTE ] MVO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:32:07.574945] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-03. [2025-09-16T19:32:07.677741] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-16T19:32:08.374935] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-04. [2025-09-16T19:32:08.973362] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-16T19:32:09.121447] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-16T19:32:09.174944] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-04. [2025-09-16T19:32:09.410284] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-04 (0.24 seconds). [2025-09-16T19:32:09.974904] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-05. [2025-09-16T19:32:10.188627] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-05 (0.21 seconds). [2025-09-16T19:32:10.774945] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-06. [2025-09-16T19:32:11.017664] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-09-16T19:32:11.574923] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-02. [2025-09-16T19:32:12.293116] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-16T19:32:12.374945] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-04. [2025-09-16T19:32:13.174947] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-05. [2025-09-16T19:32:13.847974] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-16T19:32:13.948911] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-16T19:32:13.974858] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-06. [2025-09-16T19:32:14.774919] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-05. [2025-09-16T19:32:14.802836] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-16T19:32:15.574918] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-07. [2025-09-16T19:32:15.803680] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-09-16T19:32:16.001491] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-16T19:32:16.374914] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-07. [2025-09-16T19:32:17.174903] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-03. [2025-09-16T19:32:17.246043] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-16T19:32:17.755756] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-16T19:32:17.974941] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-08. [2025-09-16T19:32:18.774902] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-06. [2025-09-16T19:32:18.817946] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-16T19:32:19.574932] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-08. [2025-09-16T19:32:19.828488] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-09-16T19:32:20.332064] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-16T19:32:20.374858] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-07. [2025-09-16T19:32:21.174934] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-04. [2025-09-16T19:32:21.959877] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-16T19:32:21.976615] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-09. [2025-09-16T19:32:21.977597] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-16T19:32:22.397136] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:32:22.397506] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-09 [2025-09-16T19:32:22.397611] [INFO ] [REMOTE ] MUSE: Full fetch complete (95 records). [2025-09-16T19:32:22.397713] [DEBUG] [VALIDATOR ] MUSE: Validating primary data. [2025-09-16T19:32:22.398411] [FATAL] [VALIDATOR ] MUSE: Data is stale - most recent date (2025-08-05) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T19:32:22.398494] [FATAL] [MAIN ] MUSE: Fetched primary data is invalid. Refusing to save it. [2025-09-16T19:32:22.398547] [WARN ] [MAIN ] MUSE: Deleting existing primary and derivative data due to validation failure. [2025-09-16T19:32:22.398602] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-09-16T19:32:22.398692] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-09-16T19:32:22.398740] [INFO ] [LOCAL ] MUSE: Starting deletion of derivative data. [2025-09-16T19:32:22.398809] [DEBUG] [LOCAL ] MUSE: No derivative data file found to delete. [2025-09-16T19:32:22.398904] [INFO ] [MAIN ] Update Progress: 1435/2369 symbols completed. MUSE took 21.8s. Estimated remaining: 1h 39m 9s. Rate: 9.4 symbols/min [2025-09-16T19:32:22.583393] [INFO ] [MAIN ] MVT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:32:22.592540] [DEBUG] [LOCAL ] MVT: Loaded 7340 existing records from primary storage. [2025-09-16T19:32:22.592718] [INFO ] [MAIN ] MVT: Loaded 7340 existing records. [2025-09-16T19:32:22.776478] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-09. [2025-09-16T19:32:22.776355] [WARN ] [MAIN ] MVT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:32:22.777832] [INFO ] [MAIN ] MVT: Wiping existing primary data before full refresh. [2025-09-16T19:32:22.777904] [INFO ] [LOCAL ] MVT: Starting deletion of primary data. [2025-09-16T19:32:22.778291] [DEBUG] [LOCAL ] MVT: Deleted primary data file. [2025-09-16T19:32:22.778366] [INFO ] [MAIN ] MVT: Starting full primary refresh. [2025-09-16T19:32:23.128079] [INFO ] [REMOTE ] MVT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:32:23.574945] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-08. [2025-09-16T19:32:23.670582] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-16T19:32:23.673973] [INFO ] [REMOTE ] MVF: Full fetch complete (13823 records). [2025-09-16T19:32:23.674179] [DEBUG] [VALIDATOR ] MVF: Validating primary data. [2025-09-16T19:32:24.071474] [DEBUG] [VALIDATOR ] MVF: All expected trading days are present. [2025-09-16T19:32:24.071562] [DEBUG] [VALIDATOR ] MVF: Primary data validation passed. [2025-09-16T19:32:24.071993] [INFO ] [MAIN ] MVF: Fetched primary data is valid. [2025-09-16T19:32:24.072046] [DEBUG] [LOCAL ] MVF: Saving primary data. [2025-09-16T19:32:24.072561] [DEBUG] [LOCAL ] MVF: Trimmed 13823 records to 8944 (keeping 150 days of data) [2025-09-16T19:32:24.128663] [DEBUG] [LOCAL ] MVF: Primary data saved (8944 records). [2025-09-16T19:32:24.128810] [INFO ] [MAIN ] MVF: Full history saved. [2025-09-16T19:32:24.128945] [INFO ] [MAIN ] Update Progress: 1436/2369 symbols completed. MVF took 20.7s. Estimated remaining: 1h 38m 59s. Rate: 9.4 symbols/min [2025-09-16T19:32:24.305248] [INFO ] [MAIN ] MWA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:32:24.340168] [DEBUG] [LOCAL ] MWA: Loaded 33785 existing records from primary storage. [2025-09-16T19:32:24.340312] [INFO ] [MAIN ] MWA: Loaded 33785 existing records. [2025-09-16T19:32:24.385073] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-02. [2025-09-16T19:32:24.526285] [WARN ] [MAIN ] MWA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:32:24.526547] [INFO ] [MAIN ] MWA: Wiping existing primary data before full refresh. [2025-09-16T19:32:24.526594] [INFO ] [LOCAL ] MWA: Starting deletion of primary data. [2025-09-16T19:32:24.527377] [DEBUG] [LOCAL ] MWA: Deleted primary data file. [2025-09-16T19:32:24.527425] [INFO ] [MAIN ] MWA: Starting full primary refresh. [2025-09-16T19:32:24.891406] [INFO ] [REMOTE ] MWA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:32:24.974194] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-16T19:32:25.174905] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-03. [2025-09-16T19:32:25.456923] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-16T19:32:25.974919] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-09. [2025-09-16T19:32:25.974804] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-16T19:32:26.774906] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-04. [2025-09-16T19:32:27.278768] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-16T19:32:27.284844] [INFO ] [REMOTE ] MUX: Full fetch complete (45641 records). [2025-09-16T19:32:27.284943] [DEBUG] [VALIDATOR ] MUX: Validating primary data. [2025-09-16T19:32:27.585277] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-05. [2025-09-16T19:32:27.683191] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-16T19:32:27.698078] [DEBUG] [VALIDATOR ] MUX: All expected trading days are present. [2025-09-16T19:32:27.698891] [DEBUG] [VALIDATOR ] MUX: Primary data validation passed. [2025-09-16T19:32:27.699729] [INFO ] [MAIN ] MUX: Fetched primary data is valid. [2025-09-16T19:32:27.699781] [DEBUG] [LOCAL ] MUX: Saving primary data. [2025-09-16T19:32:27.700903] [DEBUG] [LOCAL ] MUX: Trimmed 45641 records to 31233 (keeping 150 days of data) [2025-09-16T19:32:27.889100] [DEBUG] [LOCAL ] MUX: Primary data saved (31233 records). [2025-09-16T19:32:27.889247] [INFO ] [MAIN ] MUX: Full history saved. [2025-09-16T19:32:27.889933] [INFO ] [MAIN ] Update Progress: 1437/2369 symbols completed. MUX took 24.9s. Estimated remaining: 1h 38m 51s. Rate: 9.4 symbols/min [2025-09-16T19:32:28.313986] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-16T19:32:28.374917] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-06. [2025-09-16T19:32:29.174974] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-05. [2025-09-16T19:32:29.205117] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-16T19:32:29.708744] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-16T19:32:29.974951] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-02. [2025-09-16T19:32:30.774899] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-06. [2025-09-16T19:32:31.487934] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-16T19:32:31.528174] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-16T19:32:31.574857] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-07. [2025-09-16T19:32:32.362419] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-16T19:32:32.374841] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-08. [2025-09-16T19:32:33.159430] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-16T19:32:33.174843] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-03. [2025-09-16T19:32:33.974936] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-07. [2025-09-16T19:32:34.774899] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-09. [2025-09-16T19:32:35.032475] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-16T19:32:35.054397] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-16T19:32:35.574901] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-08. [2025-09-16T19:32:35.591716] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-16T19:32:35.593623] [INFO ] [REMOTE ] MVT: Full fetch complete (10504 records). [2025-09-16T19:32:35.593758] [DEBUG] [VALIDATOR ] MVT: Validating primary data. [2025-09-16T19:32:35.963215] [DEBUG] [VALIDATOR ] MVT: All expected trading days are present. [2025-09-16T19:32:35.963298] [DEBUG] [VALIDATOR ] MVT: Primary data validation passed. [2025-09-16T19:32:35.963572] [INFO ] [MAIN ] MVT: Fetched primary data is valid. [2025-09-16T19:32:35.963637] [DEBUG] [LOCAL ] MVT: Saving primary data. [2025-09-16T19:32:35.964121] [DEBUG] [LOCAL ] MVT: Trimmed 10504 records to 7404 (keeping 150 days of data) [2025-09-16T19:32:36.011996] [DEBUG] [LOCAL ] MVT: Primary data saved (7404 records). [2025-09-16T19:32:36.012114] [INFO ] [MAIN ] MVT: Full history saved. [2025-09-16T19:32:36.012228] [INFO ] [MAIN ] Update Progress: 1438/2369 symbols completed. MVT took 13.6s. Estimated remaining: 1h 38m 46s. Rate: 9.4 symbols/min [2025-09-16T19:32:36.324135] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-16T19:32:36.374900] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-04. [2025-09-16T19:32:37.174963] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-09. [2025-09-16T19:32:37.899967] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-16T19:32:37.901962] [INFO ] [REMOTE ] MVO: Full fetch complete (10013 records). [2025-09-16T19:32:37.902052] [DEBUG] [VALIDATOR ] MVO: Validating primary data. [2025-09-16T19:32:38.284819] [DEBUG] [VALIDATOR ] MVO: All expected trading days are present. [2025-09-16T19:32:38.284959] [DEBUG] [VALIDATOR ] MVO: Primary data validation passed. [2025-09-16T19:32:38.285219] [INFO ] [MAIN ] MVO: Fetched primary data is valid. [2025-09-16T19:32:38.285272] [DEBUG] [LOCAL ] MVO: Saving primary data. [2025-09-16T19:32:38.285893] [DEBUG] [LOCAL ] MVO: Trimmed 10013 records to 6446 (keeping 150 days of data) [2025-09-16T19:32:38.349304] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-16T19:32:38.362225] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-05. [2025-09-16T19:32:38.365143] [DEBUG] [LOCAL ] MVO: Primary data saved (6446 records). [2025-09-16T19:32:38.365299] [INFO ] [MAIN ] MVO: Full history saved. [2025-09-16T19:32:38.365418] [INFO ] [MAIN ] Update Progress: 1439/2369 symbols completed. MVO took 31.5s. Estimated remaining: 1h 38m 37s. Rate: 9.4 symbols/min [2025-09-16T19:32:39.982995] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-16T19:32:39.993964] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-06. [2025-09-16T19:32:41.533941] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-16T19:32:41.543834] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-07. [2025-09-16T19:32:43.025153] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-16T19:32:43.034981] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-08. [2025-09-16T19:32:44.726789] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-16T19:32:44.736366] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-09. [2025-09-16T19:32:46.271983] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-16T19:32:46.277062] [INFO ] [REMOTE ] MWA: Full fetch complete (51448 records). [2025-09-16T19:32:46.277183] [DEBUG] [VALIDATOR ] MWA: Validating primary data. [2025-09-16T19:32:46.660802] [DEBUG] [VALIDATOR ] MWA: All expected trading days are present. [2025-09-16T19:32:46.660910] [DEBUG] [VALIDATOR ] MWA: Primary data validation passed. [2025-09-16T19:32:46.661749] [INFO ] [MAIN ] MWA: Fetched primary data is valid. [2025-09-16T19:32:46.661797] [DEBUG] [LOCAL ] MWA: Saving primary data. [2025-09-16T19:32:46.663924] [DEBUG] [LOCAL ] MWA: Trimmed 51448 records to 34072 (keeping 150 days of data) [2025-09-16T19:32:46.871623] [DEBUG] [LOCAL ] MWA: Primary data saved (34072 records). [2025-09-16T19:32:46.871781] [INFO ] [MAIN ] MWA: Full history saved. [2025-09-16T19:32:46.871911] [INFO ] [MAIN ] Update Progress: 1440/2369 symbols completed. MWA took 22.7s. Estimated remaining: 1h 38m 32s. Rate: 9.4 symbols/min [2025-09-16T19:32:47.432813] [INFO ] [MAIN ] MX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:32:47.455002] [INFO ] [MAIN ] MYD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:32:47.558900] [INFO ] [MAIN ] MXE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:32:47.587272] [INFO ] [MAIN ] MXF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:32:47.587666] [DEBUG] [LOCAL ] MXE: No existing data file found in primary storage. [2025-09-16T19:32:47.592980] [WARN ] [MAIN ] MXE: No existing data found, performing full refresh instead. [2025-09-16T19:32:47.593209] [INFO ] [MAIN ] MXE: Wiping existing primary data before full refresh. [2025-09-16T19:32:47.599294] [DEBUG] [LOCAL ] MYD: Loaded 9151 existing records from primary storage. [2025-09-16T19:32:47.599552] [INFO ] [MAIN ] MYD: Loaded 9151 existing records. [2025-09-16T19:32:47.599029] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-09-16T19:32:47.599684] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-09-16T19:32:47.604850] [INFO ] [MAIN ] MXE: Starting full primary refresh. [2025-09-16T19:32:47.665062] [DEBUG] [LOCAL ] MX: Loaded 16505 existing records from primary storage. [2025-09-16T19:32:47.741085] [INFO ] [MAIN ] MX: Loaded 16505 existing records. [2025-09-16T19:32:47.757758] [DEBUG] [LOCAL ] MXF: Loaded 4055 existing records from primary storage. [2025-09-16T19:32:47.824105] [INFO ] [MAIN ] MXF: Loaded 4055 existing records. [2025-09-16T19:32:48.112011] [WARN ] [MAIN ] MYD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:32:48.199330] [INFO ] [MAIN ] MYD: Wiping existing primary data before full refresh. [2025-09-16T19:32:48.234629] [INFO ] [LOCAL ] MYD: Starting deletion of primary data. [2025-09-16T19:32:48.314117] [DEBUG] [LOCAL ] MYD: Deleted primary data file. [2025-09-16T19:32:48.372501] [INFO ] [MAIN ] MYD: Starting full primary refresh. [2025-09-16T19:32:48.421528] [WARN ] [MAIN ] MXF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:32:48.475759] [INFO ] [MAIN ] MXF: Wiping existing primary data before full refresh. [2025-09-16T19:32:48.475465] [WARN ] [MAIN ] MX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:32:48.488723] [INFO ] [LOCAL ] MXF: Starting deletion of primary data. [2025-09-16T19:32:48.504943] [INFO ] [MAIN ] MX: Wiping existing primary data before full refresh. [2025-09-16T19:32:48.524870] [INFO ] [LOCAL ] MX: Starting deletion of primary data. [2025-09-16T19:32:48.559687] [DEBUG] [LOCAL ] MXF: Deleted primary data file. [2025-09-16T19:32:48.570183] [INFO ] [MAIN ] MXF: Starting full primary refresh. [2025-09-16T19:32:48.575375] [DEBUG] [LOCAL ] MX: Deleted primary data file. [2025-09-16T19:32:48.615471] [INFO ] [MAIN ] MX: Starting full primary refresh. [2025-09-16T19:32:48.697415] [INFO ] [REMOTE ] MXE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:32:48.741479] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-02. [2025-09-16T19:32:49.477286] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-16T19:32:49.486435] [INFO ] [REMOTE ] MYD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:32:49.522191] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-02. [2025-09-16T19:32:49.521869] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-03. [2025-09-16T19:32:49.600345] [INFO ] [REMOTE ] MX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:32:49.649143] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-02. [2025-09-16T19:32:49.670009] [INFO ] [REMOTE ] MXF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:32:49.671207] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-02. [2025-09-16T19:32:50.054291] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-16T19:32:50.055332] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-04. [2025-09-16T19:32:50.243689] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-16T19:32:50.245915] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-03. [2025-09-16T19:32:50.325768] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-16T19:32:50.329283] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-03. [2025-09-16T19:32:50.415710] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-16T19:32:50.421346] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-03. [2025-09-16T19:32:50.494324] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-16T19:32:50.495476] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-05. [2025-09-16T19:32:50.819958] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-16T19:32:50.821165] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-06. [2025-09-16T19:32:50.828688] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-16T19:32:50.831356] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-04. [2025-09-16T19:32:50.914812] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-16T19:32:51.193368] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-16T19:32:51.375938] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-16T19:32:51.574911] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-04. [2025-09-16T19:32:51.709770] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-16T19:32:52.374921] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-05. [2025-09-16T19:32:52.457386] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-16T19:32:52.980606] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-16T19:32:53.174907] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-06. [2025-09-16T19:32:53.774547] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-16T19:32:53.974909] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-07. [2025-09-16T19:32:54.422313] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-16T19:32:54.774968] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-07. [2025-09-16T19:32:55.436485] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-16T19:32:55.574907] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-08. [2025-09-16T19:32:56.064574] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-16T19:32:56.374917] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-09. [2025-09-16T19:32:56.874893] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-16T19:32:56.875861] [INFO ] [REMOTE ] MXF: Full fetch complete (6935 records). [2025-09-16T19:32:56.875943] [DEBUG] [VALIDATOR ] MXF: Validating primary data. [2025-09-16T19:32:57.180024] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-05. [2025-09-16T19:32:57.243910] [DEBUG] [VALIDATOR ] MXF: All expected trading days are present. [2025-09-16T19:32:57.244004] [DEBUG] [VALIDATOR ] MXF: Primary data validation passed. [2025-09-16T19:32:57.244277] [INFO ] [MAIN ] MXF: Fetched primary data is valid. [2025-09-16T19:32:57.244322] [DEBUG] [LOCAL ] MXF: Saving primary data. [2025-09-16T19:32:57.244878] [DEBUG] [LOCAL ] MXF: Trimmed 6935 records to 4061 (keeping 150 days of data) [2025-09-16T19:32:57.271144] [DEBUG] [LOCAL ] MXF: Primary data saved (4061 records). [2025-09-16T19:32:57.271298] [INFO ] [MAIN ] MXF: Full history saved. [2025-09-16T19:32:57.271405] [INFO ] [MAIN ] Update Progress: 1441/2369 symbols completed. MXF took 10.4s. Estimated remaining: 1h 38m 28s. Rate: 9.4 symbols/min [2025-09-16T19:32:57.440108] [INFO ] [MAIN ] MYE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:32:57.458602] [DEBUG] [LOCAL ] MYE: Loaded 17475 existing records from primary storage. [2025-09-16T19:32:57.458748] [INFO ] [MAIN ] MYE: Loaded 17475 existing records. [2025-09-16T19:32:57.639860] [WARN ] [MAIN ] MYE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:32:57.640104] [INFO ] [MAIN ] MYE: Wiping existing primary data before full refresh. [2025-09-16T19:32:57.640151] [INFO ] [LOCAL ] MYE: Starting deletion of primary data. [2025-09-16T19:32:57.640920] [DEBUG] [LOCAL ] MYE: Deleted primary data file. [2025-09-16T19:32:57.640977] [INFO ] [MAIN ] MYE: Starting full primary refresh. [2025-09-16T19:32:57.993233] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-08. [2025-09-16T19:32:57.997224] [INFO ] [REMOTE ] MYE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:32:58.059241] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-16T19:32:58.367241] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-16T19:32:58.774914] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-02. [2025-09-16T19:32:59.574872] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-09. [2025-09-16T19:32:59.925127] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-16T19:33:00.132455] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-16T19:33:00.133444] [INFO ] [REMOTE ] MXE: Full fetch complete (1819 records). [2025-09-16T19:33:00.133523] [DEBUG] [VALIDATOR ] MXE: Validating primary data. [2025-09-16T19:33:00.339108] [WARN ] [VALIDATOR ] MXE: Validation failed - insufficient historical data. Have 148 unique days, need 150 days [2025-09-16T19:33:00.339362] [FATAL] [MAIN ] MXE: Fetched primary data is invalid. Refusing to save it. [2025-09-16T19:33:00.339433] [WARN ] [MAIN ] MXE: Deleting existing primary and derivative data due to validation failure. [2025-09-16T19:33:00.339499] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-09-16T19:33:00.339574] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-09-16T19:33:00.339612] [INFO ] [LOCAL ] MXE: Starting deletion of derivative data. [2025-09-16T19:33:00.339673] [DEBUG] [LOCAL ] MXE: No derivative data file found to delete. [2025-09-16T19:33:00.339739] [INFO ] [MAIN ] Update Progress: 1442/2369 symbols completed. MXE took 13.5s. Estimated remaining: 1h 38m 20s. Rate: 9.4 symbols/min [2025-09-16T19:33:00.380071] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-04. [2025-09-16T19:33:00.518471] [INFO ] [MAIN ] MYI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:33:00.535722] [DEBUG] [LOCAL ] MYI: Loaded 13412 existing records from primary storage. [2025-09-16T19:33:00.535867] [INFO ] [MAIN ] MYI: Loaded 13412 existing records. [2025-09-16T19:33:00.712890] [WARN ] [MAIN ] MYI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:33:00.713183] [INFO ] [MAIN ] MYI: Wiping existing primary data before full refresh. [2025-09-16T19:33:00.713228] [INFO ] [LOCAL ] MYI: Starting deletion of primary data. [2025-09-16T19:33:00.713763] [DEBUG] [LOCAL ] MYI: Deleted primary data file. [2025-09-16T19:33:00.713811] [INFO ] [MAIN ] MYI: Starting full primary refresh. [2025-09-16T19:33:01.064292] [INFO ] [REMOTE ] MYI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:33:01.174891] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-02. [2025-09-16T19:33:01.502875] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-16T19:33:01.974922] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-05. [2025-09-16T19:33:02.212094] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-16T19:33:02.774867] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-06. [2025-09-16T19:33:03.094688] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-16T19:33:03.542212] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-16T19:33:03.574842] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-07. [2025-09-16T19:33:04.374886] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-03. [2025-09-16T19:33:04.495104] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-16T19:33:05.174920] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-06. [2025-09-16T19:33:05.232578] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-16T19:33:05.861114] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-16T19:33:05.974895] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-07. [2025-09-16T19:33:06.774931] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-03. [2025-09-16T19:33:06.991116] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-16T19:33:07.574902] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-08. [2025-09-16T19:33:08.056334] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-16T19:33:08.374908] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-08. [2025-09-16T19:33:08.931697] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-16T19:33:09.174900] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-09. [2025-09-16T19:33:09.974951] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-04. [2025-09-16T19:33:10.326863] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-16T19:33:10.329807] [INFO ] [REMOTE ] MX: Full fetch complete (24706 records). [2025-09-16T19:33:10.329887] [DEBUG] [VALIDATOR ] MX: Validating primary data. [2025-09-16T19:33:10.694724] [DEBUG] [VALIDATOR ] MX: All expected trading days are present. [2025-09-16T19:33:10.694815] [DEBUG] [VALIDATOR ] MX: Primary data validation passed. [2025-09-16T19:33:10.695404] [INFO ] [MAIN ] MX: Fetched primary data is valid. [2025-09-16T19:33:10.695458] [DEBUG] [LOCAL ] MX: Saving primary data. [2025-09-16T19:33:10.696162] [DEBUG] [LOCAL ] MX: Trimmed 24706 records to 16635 (keeping 150 days of data) [2025-09-16T19:33:10.776210] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-04. [2025-09-16T19:33:10.797538] [DEBUG] [LOCAL ] MX: Primary data saved (16635 records). [2025-09-16T19:33:10.797661] [INFO ] [MAIN ] MX: Full history saved. [2025-09-16T19:33:10.797755] [INFO ] [MAIN ] Update Progress: 1443/2369 symbols completed. MX took 23.9s. Estimated remaining: 1h 38m 16s. Rate: 9.4 symbols/min [2025-09-16T19:33:10.970144] [INFO ] [MAIN ] MYN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:33:10.978688] [DEBUG] [LOCAL ] MYN: Loaded 7468 existing records from primary storage. [2025-09-16T19:33:10.978873] [INFO ] [MAIN ] MYN: Loaded 7468 existing records. [2025-09-16T19:33:11.159709] [WARN ] [MAIN ] MYN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:33:11.159958] [INFO ] [MAIN ] MYN: Wiping existing primary data before full refresh. [2025-09-16T19:33:11.160005] [INFO ] [LOCAL ] MYN: Starting deletion of primary data. [2025-09-16T19:33:11.160282] [DEBUG] [LOCAL ] MYN: Deleted primary data file. [2025-09-16T19:33:11.160329] [INFO ] [MAIN ] MYN: Starting full primary refresh. [2025-09-16T19:33:11.519702] [INFO ] [REMOTE ] MYN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:33:11.537077] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-16T19:33:11.574887] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-05. [2025-09-16T19:33:11.948373] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-16T19:33:12.374871] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-02. [2025-09-16T19:33:12.682457] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-16T19:33:12.919222] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-16T19:33:13.174884] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-03. [2025-09-16T19:33:13.974928] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-05. [2025-09-16T19:33:13.983898] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-16T19:33:14.774915] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-06. [2025-09-16T19:33:15.574944] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-04. [2025-09-16T19:33:15.924113] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-16T19:33:16.356069] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-16T19:33:16.374864] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-05. [2025-09-16T19:33:17.099927] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-16T19:33:17.174929] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-07. [2025-09-16T19:33:17.974901] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-06. [2025-09-16T19:33:18.759248] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-16T19:33:18.774865] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-07. [2025-09-16T19:33:19.527853] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-16T19:33:19.574870] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-08. [2025-09-16T19:33:20.362519] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-16T19:33:20.374848] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-09. [2025-09-16T19:33:21.170106] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-16T19:33:21.172021] [INFO ] [REMOTE ] MYN: Full fetch complete (11039 records). [2025-09-16T19:33:21.172089] [DEBUG] [VALIDATOR ] MYN: Validating primary data. [2025-09-16T19:33:21.540620] [DEBUG] [VALIDATOR ] MYN: All expected trading days are present. [2025-09-16T19:33:21.540724] [DEBUG] [VALIDATOR ] MYN: Primary data validation passed. [2025-09-16T19:33:21.541149] [INFO ] [MAIN ] MYN: Fetched primary data is valid. [2025-09-16T19:33:21.541214] [DEBUG] [LOCAL ] MYN: Saving primary data. [2025-09-16T19:33:21.541789] [DEBUG] [LOCAL ] MYN: Trimmed 11039 records to 7569 (keeping 150 days of data) [2025-09-16T19:33:21.596240] [DEBUG] [LOCAL ] MYN: Primary data saved (7569 records). [2025-09-16T19:33:21.596399] [INFO ] [MAIN ] MYN: Full history saved. [2025-09-16T19:33:21.596494] [INFO ] [MAIN ] Update Progress: 1444/2369 symbols completed. MYN took 10.8s. Estimated remaining: 1h 38m 12s. Rate: 9.4 symbols/min [2025-09-16T19:33:21.789049] [INFO ] [MAIN ] NABL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:33:21.828290] [DEBUG] [LOCAL ] NABL: Loaded 29090 existing records from primary storage. [2025-09-16T19:33:21.828488] [INFO ] [MAIN ] NABL: Loaded 29090 existing records. [2025-09-16T19:33:22.130782] [WARN ] [MAIN ] NABL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:33:22.132059] [INFO ] [MAIN ] NABL: Wiping existing primary data before full refresh. [2025-09-16T19:33:22.132131] [INFO ] [LOCAL ] NABL: Starting deletion of primary data. [2025-09-16T19:33:22.132964] [DEBUG] [LOCAL ] NABL: Deleted primary data file. [2025-09-16T19:33:22.133031] [INFO ] [MAIN ] NABL: Starting full primary refresh. [2025-09-16T19:33:22.358738] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-05 (8.38 seconds). [2025-09-16T19:33:22.409506] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-06. [2025-09-16T19:33:22.714912] [INFO ] [REMOTE ] NABL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:33:22.715305] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-02. [2025-09-16T19:33:22.738494] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-07 (5.56 seconds). [2025-09-16T19:33:22.775000] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-08. [2025-09-16T19:33:23.552772] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-16T19:33:23.574909] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-07. [2025-09-16T19:33:23.836521] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-16T19:33:23.932466] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-16T19:33:24.374915] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-09. [2025-09-16T19:33:24.592608] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-16T19:33:25.174907] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-08. [2025-09-16T19:33:25.293695] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-16T19:33:25.296989] [INFO ] [REMOTE ] MYE: Full fetch complete (27637 records). [2025-09-16T19:33:25.297080] [DEBUG] [VALIDATOR ] MYE: Validating primary data. [2025-09-16T19:33:25.668396] [DEBUG] [VALIDATOR ] MYE: All expected trading days are present. [2025-09-16T19:33:25.668479] [DEBUG] [VALIDATOR ] MYE: Primary data validation passed. [2025-09-16T19:33:25.669297] [INFO ] [MAIN ] MYE: Fetched primary data is valid. [2025-09-16T19:33:25.669348] [DEBUG] [LOCAL ] MYE: Saving primary data. [2025-09-16T19:33:25.670040] [DEBUG] [LOCAL ] MYE: Trimmed 27637 records to 17614 (keeping 150 days of data) [2025-09-16T19:33:25.783404] [DEBUG] [LOCAL ] MYE: Primary data saved (17614 records). [2025-09-16T19:33:25.783551] [INFO ] [MAIN ] MYE: Full history saved. [2025-09-16T19:33:25.783658] [INFO ] [MAIN ] Update Progress: 1445/2369 symbols completed. MYE took 28.5s. Estimated remaining: 1h 38m 5s. Rate: 9.4 symbols/min [2025-09-16T19:33:25.952420] [INFO ] [MAIN ] NAC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:33:25.970163] [DEBUG] [LOCAL ] NAC: Loaded 17588 existing records from primary storage. [2025-09-16T19:33:25.970295] [INFO ] [MAIN ] NAC: Loaded 17588 existing records. [2025-09-16T19:33:26.001847] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-03. [2025-09-16T19:33:26.149273] [WARN ] [MAIN ] NAC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:33:26.149560] [INFO ] [MAIN ] NAC: Wiping existing primary data before full refresh. [2025-09-16T19:33:26.149628] [INFO ] [LOCAL ] NAC: Starting deletion of primary data. [2025-09-16T19:33:26.150195] [DEBUG] [LOCAL ] NAC: Deleted primary data file. [2025-09-16T19:33:26.150249] [INFO ] [MAIN ] NAC: Starting full primary refresh. [2025-09-16T19:33:26.431818] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-16T19:33:26.539466] [INFO ] [REMOTE ] NAC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:33:26.774904] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-02. [2025-09-16T19:33:27.574908] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-09. [2025-09-16T19:33:27.604133] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-16T19:33:27.651446] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-16T19:33:28.363786] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-16T19:33:28.366924] [INFO ] [REMOTE ] MYI: Full fetch complete (21166 records). [2025-09-16T19:33:28.367011] [DEBUG] [VALIDATOR ] MYI: Validating primary data. [2025-09-16T19:33:28.380112] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-03. [2025-09-16T19:33:28.524713] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-08 (20.15 seconds). [2025-09-16T19:33:28.760749] [DEBUG] [VALIDATOR ] MYI: All expected trading days are present. [2025-09-16T19:33:28.760824] [DEBUG] [VALIDATOR ] MYI: Primary data validation passed. [2025-09-16T19:33:28.761260] [INFO ] [MAIN ] MYI: Fetched primary data is valid. [2025-09-16T19:33:28.761300] [DEBUG] [LOCAL ] MYI: Saving primary data. [2025-09-16T19:33:28.761892] [DEBUG] [LOCAL ] MYI: Trimmed 21166 records to 13530 (keeping 150 days of data) [2025-09-16T19:33:28.848022] [DEBUG] [LOCAL ] MYI: Primary data saved (13530 records). [2025-09-16T19:33:28.848171] [INFO ] [MAIN ] MYI: Full history saved. [2025-09-16T19:33:28.848258] [INFO ] [MAIN ] Update Progress: 1446/2369 symbols completed. MYI took 28.5s. Estimated remaining: 1h 37m 56s. Rate: 9.4 symbols/min [2025-09-16T19:33:29.019263] [INFO ] [MAIN ] NAD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:33:29.042933] [DEBUG] [LOCAL ] NAD: Loaded 24848 existing records from primary storage. [2025-09-16T19:33:29.043062] [INFO ] [MAIN ] NAD: Loaded 24848 existing records. [2025-09-16T19:33:29.187520] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-09. [2025-09-16T19:33:29.227091] [WARN ] [MAIN ] NAD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:33:29.227334] [INFO ] [MAIN ] NAD: Wiping existing primary data before full refresh. [2025-09-16T19:33:29.227382] [INFO ] [LOCAL ] NAD: Starting deletion of primary data. [2025-09-16T19:33:29.227975] [DEBUG] [LOCAL ] NAD: Deleted primary data file. [2025-09-16T19:33:29.228024] [INFO ] [MAIN ] NAD: Starting full primary refresh. [2025-09-16T19:33:29.590814] [INFO ] [REMOTE ] NAD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:33:29.620175] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-16T19:33:29.974909] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-04. [2025-09-16T19:33:30.107985] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-16T19:33:30.109943] [INFO ] [REMOTE ] MYD: Full fetch complete (14891 records). [2025-09-16T19:33:30.110016] [DEBUG] [VALIDATOR ] MYD: Validating primary data. [2025-09-16T19:33:30.520892] [DEBUG] [VALIDATOR ] MYD: All expected trading days are present. [2025-09-16T19:33:30.520975] [DEBUG] [VALIDATOR ] MYD: Primary data validation passed. [2025-09-16T19:33:30.521302] [INFO ] [MAIN ] MYD: Fetched primary data is valid. [2025-09-16T19:33:30.521343] [DEBUG] [LOCAL ] MYD: Saving primary data. [2025-09-16T19:33:30.521890] [DEBUG] [LOCAL ] MYD: Trimmed 14891 records to 9219 (keeping 150 days of data) [2025-09-16T19:33:30.577603] [DEBUG] [LOCAL ] MYD: Primary data saved (9219 records). [2025-09-16T19:33:30.577743] [INFO ] [MAIN ] MYD: Full history saved. [2025-09-16T19:33:30.577827] [INFO ] [MAIN ] Update Progress: 1447/2369 symbols completed. MYD took 43.7s. Estimated remaining: 1h 37m 47s. Rate: 9.4 symbols/min [2025-09-16T19:33:30.746378] [INFO ] [MAIN ] NAN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:33:30.755136] [DEBUG] [LOCAL ] NAN: Loaded 6267 existing records from primary storage. [2025-09-16T19:33:30.755243] [INFO ] [MAIN ] NAN: Loaded 6267 existing records. [2025-09-16T19:33:30.785615] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-04. [2025-09-16T19:33:30.934030] [WARN ] [MAIN ] NAN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:33:30.934267] [INFO ] [MAIN ] NAN: Wiping existing primary data before full refresh. [2025-09-16T19:33:30.934314] [INFO ] [LOCAL ] NAN: Starting deletion of primary data. [2025-09-16T19:33:30.934589] [DEBUG] [LOCAL ] NAN: Deleted primary data file. [2025-09-16T19:33:30.934635] [INFO ] [MAIN ] NAN: Starting full primary refresh. [2025-09-16T19:33:31.293131] [INFO ] [REMOTE ] NAN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:33:31.320794] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-16T19:33:31.574902] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-05. [2025-09-16T19:33:32.182365] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-16T19:33:32.374901] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-05. [2025-09-16T19:33:33.048804] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-16T19:33:33.109917] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-16T19:33:33.174896] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-06. [2025-09-16T19:33:33.974890] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-02. [2025-09-16T19:33:34.257120] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-16T19:33:34.774888] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-07. [2025-09-16T19:33:35.171947] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-16T19:33:35.574903] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-03. [2025-09-16T19:33:35.906904] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-16T19:33:36.374872] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-08. [2025-09-16T19:33:36.480445] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-16T19:33:37.174952] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-02. [2025-09-16T19:33:37.406923] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-16T19:33:37.941558] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-16T19:33:37.974849] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-03. [2025-09-16T19:33:38.774933] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-06. [2025-09-16T19:33:38.890242] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-16T19:33:39.574930] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-09. [2025-09-16T19:33:40.132428] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-16T19:33:40.374894] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-04. [2025-09-16T19:33:40.668971] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-16T19:33:40.672928] [INFO ] [REMOTE ] NAC: Full fetch complete (26667 records). [2025-09-16T19:33:40.673038] [DEBUG] [VALIDATOR ] NAC: Validating primary data. [2025-09-16T19:33:41.052298] [DEBUG] [VALIDATOR ] NAC: All expected trading days are present. [2025-09-16T19:33:41.052471] [DEBUG] [VALIDATOR ] NAC: Primary data validation passed. [2025-09-16T19:33:41.053235] [INFO ] [MAIN ] NAC: Fetched primary data is valid. [2025-09-16T19:33:41.053308] [DEBUG] [LOCAL ] NAC: Saving primary data. [2025-09-16T19:33:41.054615] [DEBUG] [LOCAL ] NAC: Trimmed 26667 records to 17830 (keeping 150 days of data) [2025-09-16T19:33:41.173788] [DEBUG] [LOCAL ] NAC: Primary data saved (17830 records). [2025-09-16T19:33:41.173975] [INFO ] [MAIN ] NAC: Full history saved. [2025-09-16T19:33:41.174106] [INFO ] [MAIN ] Update Progress: 1448/2369 symbols completed. NAC took 15.4s. Estimated remaining: 1h 37m 43s. Rate: 9.4 symbols/min [2025-09-16T19:33:41.185685] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-07. [2025-09-16T19:33:41.367620] [INFO ] [MAIN ] NAT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:33:41.423406] [DEBUG] [LOCAL ] NAT: Loaded 35875 existing records from primary storage. [2025-09-16T19:33:41.423576] [INFO ] [MAIN ] NAT: Loaded 35875 existing records. [2025-09-16T19:33:41.603386] [WARN ] [MAIN ] NAT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:33:41.603619] [INFO ] [MAIN ] NAT: Wiping existing primary data before full refresh. [2025-09-16T19:33:41.603686] [INFO ] [LOCAL ] NAT: Starting deletion of primary data. [2025-09-16T19:33:41.604449] [DEBUG] [LOCAL ] NAT: Deleted primary data file. [2025-09-16T19:33:41.604499] [INFO ] [MAIN ] NAT: Starting full primary refresh. [2025-09-16T19:33:41.962865] [INFO ] [REMOTE ] NAT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:33:41.979981] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-02. [2025-09-16T19:33:42.005817] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-16T19:33:42.350874] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-16T19:33:42.774918] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-05. [2025-09-16T19:33:43.574916] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-08. [2025-09-16T19:33:43.680742] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-16T19:33:44.256984] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-16T19:33:44.374865] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-06. [2025-09-16T19:33:45.180032] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-03. [2025-09-16T19:33:45.191324] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-16T19:33:45.978489] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-04. [2025-09-16T19:33:45.980670] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-16T19:33:46.774872] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-07. [2025-09-16T19:33:47.018848] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-16T19:33:47.281152] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-16T19:33:47.574963] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-09. [2025-09-16T19:33:48.248259] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-16T19:33:48.374947] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-04. [2025-09-16T19:33:48.936104] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-16T19:33:48.940793] [INFO ] [REMOTE ] NABL: Full fetch complete (43835 records). [2025-09-16T19:33:48.940882] [DEBUG] [VALIDATOR ] NABL: Validating primary data. [2025-09-16T19:33:49.180115] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-08. [2025-09-16T19:33:49.325592] [DEBUG] [VALIDATOR ] NABL: All expected trading days are present. [2025-09-16T19:33:49.325702] [DEBUG] [VALIDATOR ] NABL: Primary data validation passed. [2025-09-16T19:33:49.326428] [INFO ] [MAIN ] NABL: Fetched primary data is valid. [2025-09-16T19:33:49.326473] [DEBUG] [LOCAL ] NABL: Saving primary data. [2025-09-16T19:33:49.327547] [DEBUG] [LOCAL ] NABL: Trimmed 43835 records to 29329 (keeping 150 days of data) [2025-09-16T19:33:49.504495] [DEBUG] [LOCAL ] NABL: Primary data saved (29329 records). [2025-09-16T19:33:49.504804] [INFO ] [MAIN ] NABL: Full history saved. [2025-09-16T19:33:49.504899] [INFO ] [MAIN ] Update Progress: 1449/2369 symbols completed. NABL took 27.9s. Estimated remaining: 1h 37m 38s. Rate: 9.4 symbols/min [2025-09-16T19:33:49.682672] [INFO ] [MAIN ] NATL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:33:49.705190] [DEBUG] [LOCAL ] NATL: Loaded 24035 existing records from primary storage. [2025-09-16T19:33:49.705328] [INFO ] [MAIN ] NATL: Loaded 24035 existing records. [2025-09-16T19:33:49.883778] [WARN ] [MAIN ] NATL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:33:49.884166] [INFO ] [MAIN ] NATL: Wiping existing primary data before full refresh. [2025-09-16T19:33:49.884431] [INFO ] [LOCAL ] NATL: Starting deletion of primary data. [2025-09-16T19:33:49.885312] [DEBUG] [LOCAL ] NATL: Deleted primary data file. [2025-09-16T19:33:49.885365] [INFO ] [MAIN ] NATL: Starting full primary refresh. [2025-09-16T19:33:49.984607] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-05. [2025-09-16T19:33:50.249437] [INFO ] [REMOTE ] NATL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:33:50.344244] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-16T19:33:50.623891] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-16T19:33:50.774384] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-16T19:33:50.777151] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-06. [2025-09-16T19:33:51.408098] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-16T19:33:51.574898] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-05. [2025-09-16T19:33:52.374919] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-02. [2025-09-16T19:33:53.174975] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-09. [2025-09-16T19:33:53.235741] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-16T19:33:53.580918] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-16T19:33:53.974890] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-06. [2025-09-16T19:33:54.398943] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-16T19:33:54.403674] [INFO ] [REMOTE ] NAD: Full fetch complete (36749 records). [2025-09-16T19:33:54.403759] [DEBUG] [VALIDATOR ] NAD: Validating primary data. [2025-09-16T19:33:54.776267] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-07. [2025-09-16T19:33:54.776804] [DEBUG] [VALIDATOR ] NAD: All expected trading days are present. [2025-09-16T19:33:54.776896] [DEBUG] [VALIDATOR ] NAD: Primary data validation passed. [2025-09-16T19:33:54.777618] [INFO ] [MAIN ] NAD: Fetched primary data is valid. [2025-09-16T19:33:54.777704] [DEBUG] [LOCAL ] NAD: Saving primary data. [2025-09-16T19:33:54.779451] [DEBUG] [LOCAL ] NAD: Trimmed 36749 records to 25046 (keeping 150 days of data) [2025-09-16T19:33:54.938432] [DEBUG] [LOCAL ] NAD: Primary data saved (25046 records). [2025-09-16T19:33:54.938567] [INFO ] [MAIN ] NAD: Full history saved. [2025-09-16T19:33:54.938682] [INFO ] [MAIN ] Update Progress: 1450/2369 symbols completed. NAD took 26.1s. Estimated remaining: 1h 37m 31s. Rate: 9.4 symbols/min [2025-09-16T19:33:55.114446] [INFO ] [MAIN ] NAZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:33:55.118346] [DEBUG] [LOCAL ] NAZ: Loaded 1952 existing records from primary storage. [2025-09-16T19:33:55.118429] [INFO ] [MAIN ] NAZ: Loaded 1952 existing records. [2025-09-16T19:33:55.295453] [WARN ] [MAIN ] NAZ: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:33:55.295738] [INFO ] [MAIN ] NAZ: Wiping existing primary data before full refresh. [2025-09-16T19:33:55.295789] [INFO ] [LOCAL ] NAZ: Starting deletion of primary data. [2025-09-16T19:33:55.295998] [DEBUG] [LOCAL ] NAZ: Deleted primary data file. [2025-09-16T19:33:55.296041] [INFO ] [MAIN ] NAZ: Starting full primary refresh. [2025-09-16T19:33:55.580064] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-03. [2025-09-16T19:33:55.648550] [INFO ] [REMOTE ] NAZ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:33:55.819722] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-16T19:33:55.926760] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-16T19:33:56.374962] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-07. [2025-09-16T19:33:56.767451] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-16T19:33:57.174939] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-04. [2025-09-16T19:33:57.974908] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-02. [2025-09-16T19:33:58.323944] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-16T19:33:58.555318] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-16T19:33:58.774941] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-08. [2025-09-16T19:33:58.808083] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-16T19:33:59.574954] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-03. [2025-09-16T19:34:00.153137] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-16T19:34:00.374923] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-05. [2025-09-16T19:34:00.501336] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-16T19:34:01.174938] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-09. [2025-09-16T19:34:01.686477] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-16T19:34:01.974897] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-08. [2025-09-16T19:34:02.769359] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-16T19:34:02.774835] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-09. [2025-09-16T19:34:02.869823] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-16T19:34:02.878746] [INFO ] [REMOTE ] NAT: Full fetch complete (53632 records). [2025-09-16T19:34:02.878926] [DEBUG] [VALIDATOR ] NAT: Validating primary data. [2025-09-16T19:34:03.267782] [DEBUG] [VALIDATOR ] NAT: All expected trading days are present. [2025-09-16T19:34:03.267865] [DEBUG] [VALIDATOR ] NAT: Primary data validation passed. [2025-09-16T19:34:03.268686] [INFO ] [MAIN ] NAT: Fetched primary data is valid. [2025-09-16T19:34:03.268745] [DEBUG] [LOCAL ] NAT: Saving primary data. [2025-09-16T19:34:03.270026] [DEBUG] [LOCAL ] NAT: Trimmed 53632 records to 36263 (keeping 150 days of data) [2025-09-16T19:34:03.380329] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-16T19:34:03.384790] [INFO ] [REMOTE ] NAN: Full fetch complete (9903 records). [2025-09-16T19:34:03.385770] [DEBUG] [VALIDATOR ] NAN: Validating primary data. [2025-09-16T19:34:03.575133] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-04. [2025-09-16T19:34:03.857799] [DEBUG] [VALIDATOR ] NAN: All expected trading days are present. [2025-09-16T19:34:03.860377] [DEBUG] [VALIDATOR ] NAN: Primary data validation passed. [2025-09-16T19:34:03.860621] [INFO ] [MAIN ] NAN: Fetched primary data is valid. [2025-09-16T19:34:03.861171] [DEBUG] [LOCAL ] NAN: Saving primary data. [2025-09-16T19:34:03.862692] [DEBUG] [LOCAL ] NAN: Trimmed 9903 records to 6308 (keeping 150 days of data) [2025-09-16T19:34:03.910159] [DEBUG] [LOCAL ] NAN: Primary data saved (6308 records). [2025-09-16T19:34:03.911271] [INFO ] [MAIN ] NAN: Full history saved. [2025-09-16T19:34:03.911585] [INFO ] [MAIN ] Update Progress: 1451/2369 symbols completed. NAN took 33.3s. Estimated remaining: 1h 37m 26s. Rate: 9.4 symbols/min [2025-09-16T19:34:04.024184] [DEBUG] [LOCAL ] NAT: Primary data saved (36263 records). [2025-09-16T19:34:04.027028] [INFO ] [MAIN ] NAT: Full history saved. [2025-09-16T19:34:04.027421] [INFO ] [MAIN ] Update Progress: 1452/2369 symbols completed. NAT took 22.9s. Estimated remaining: 1h 37m 16s. Rate: 9.4 symbols/min [2025-09-16T19:34:04.251102] [INFO ] [MAIN ] NBB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:34:04.260862] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-16T19:34:04.339665] [INFO ] [MAIN ] NBHC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:34:04.339930] [DEBUG] [LOCAL ] NBB: Loaded 6403 existing records from primary storage. [2025-09-16T19:34:04.340159] [INFO ] [MAIN ] NBB: Loaded 6403 existing records. [2025-09-16T19:34:04.340247] [DEBUG] [LOCAL ] NBHC: No existing data file found in primary storage. [2025-09-16T19:34:04.380040] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-06. [2025-09-16T19:34:04.385338] [WARN ] [MAIN ] NBHC: No existing data found, performing full refresh instead. [2025-09-16T19:34:04.453440] [INFO ] [MAIN ] NBHC: Wiping existing primary data before full refresh. [2025-09-16T19:34:04.453586] [INFO ] [LOCAL ] NBHC: Starting deletion of primary data. [2025-09-16T19:34:04.453662] [DEBUG] [LOCAL ] NBHC: No primary data file found to delete. [2025-09-16T19:34:04.454006] [INFO ] [MAIN ] NBHC: Starting full primary refresh. [2025-09-16T19:34:04.629776] [WARN ] [MAIN ] NBB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:34:04.641312] [INFO ] [MAIN ] NBB: Wiping existing primary data before full refresh. [2025-09-16T19:34:04.656891] [INFO ] [LOCAL ] NBB: Starting deletion of primary data. [2025-09-16T19:34:04.681076] [DEBUG] [LOCAL ] NBB: Deleted primary data file. [2025-09-16T19:34:04.696346] [INFO ] [MAIN ] NBB: Starting full primary refresh. [2025-09-16T19:34:05.139922] [INFO ] [REMOTE ] NBHC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:34:05.180149] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-05. [2025-09-16T19:34:05.277809] [INFO ] [REMOTE ] NBB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:34:05.599121] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-16T19:34:05.672524] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-16T19:34:05.974914] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-02. [2025-09-16T19:34:06.774918] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-06. [2025-09-16T19:34:06.955581] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-16T19:34:07.290009] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-16T19:34:07.574907] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-03. [2025-09-16T19:34:08.259145] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-16T19:34:08.374881] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-04. [2025-09-16T19:34:09.179693] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-02. [2025-09-16T19:34:09.182524] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-16T19:34:09.974908] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-05. [2025-09-16T19:34:10.234390] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-16T19:34:10.708955] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-16T19:34:10.774879] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-06. [2025-09-16T19:34:11.356591] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-16T19:34:11.574904] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-03. [2025-09-16T19:34:12.374907] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-07. [2025-09-16T19:34:12.532603] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-16T19:34:12.937824] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-16T19:34:13.174942] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-07. [2025-09-16T19:34:13.974904] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-07. [2025-09-16T19:34:14.656888] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-16T19:34:14.670319] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-16T19:34:14.774988] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-08. [2025-09-16T19:34:15.575113] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-04. [2025-09-16T19:34:15.623136] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-16T19:34:16.374867] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-08. [2025-09-16T19:34:16.815836] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-16T19:34:16.860809] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-16T19:34:17.174966] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-08. [2025-09-16T19:34:17.974900] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-09. [2025-09-16T19:34:18.739044] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-16T19:34:18.749470] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-16T19:34:18.752370] [INFO ] [REMOTE ] NBB: Full fetch complete (9618 records). [2025-09-16T19:34:18.752479] [DEBUG] [VALIDATOR ] NBB: Validating primary data. [2025-09-16T19:34:18.780019] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-05. [2025-09-16T19:34:19.126664] [DEBUG] [VALIDATOR ] NBB: All expected trading days are present. [2025-09-16T19:34:19.126749] [DEBUG] [VALIDATOR ] NBB: Primary data validation passed. [2025-09-16T19:34:19.126981] [INFO ] [MAIN ] NBB: Fetched primary data is valid. [2025-09-16T19:34:19.127027] [DEBUG] [LOCAL ] NBB: Saving primary data. [2025-09-16T19:34:19.127463] [DEBUG] [LOCAL ] NBB: Trimmed 9618 records to 6451 (keeping 150 days of data) [2025-09-16T19:34:19.170198] [DEBUG] [LOCAL ] NBB: Primary data saved (6451 records). [2025-09-16T19:34:19.170349] [INFO ] [MAIN ] NBB: Full history saved. [2025-09-16T19:34:19.170462] [INFO ] [MAIN ] Update Progress: 1453/2369 symbols completed. NBB took 15.3s. Estimated remaining: 1h 37m 15s. Rate: 9.4 symbols/min [2025-09-16T19:34:19.353707] [INFO ] [MAIN ] NBR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:34:19.379800] [DEBUG] [LOCAL ] NBR: Loaded 25999 existing records from primary storage. [2025-09-16T19:34:19.379940] [INFO ] [MAIN ] NBR: Loaded 25999 existing records. [2025-09-16T19:34:19.557419] [WARN ] [MAIN ] NBR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:34:19.557685] [INFO ] [MAIN ] NBR: Wiping existing primary data before full refresh. [2025-09-16T19:34:19.557736] [INFO ] [LOCAL ] NBR: Starting deletion of primary data. [2025-09-16T19:34:19.558313] [DEBUG] [LOCAL ] NBR: Deleted primary data file. [2025-09-16T19:34:19.558378] [INFO ] [MAIN ] NBR: Starting full primary refresh. [2025-09-16T19:34:19.579992] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-09. [2025-09-16T19:34:19.926993] [INFO ] [REMOTE ] NBR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:34:19.972406] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-16T19:34:20.374920] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-09. [2025-09-16T19:34:21.034034] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-16T19:34:21.038793] [INFO ] [REMOTE ] NATL: Full fetch complete (34985 records). [2025-09-16T19:34:21.038964] [DEBUG] [VALIDATOR ] NATL: Validating primary data. [2025-09-16T19:34:21.140361] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-16T19:34:21.155538] [INFO ] [REMOTE ] NAZ: Full fetch complete (3012 records). [2025-09-16T19:34:21.155747] [DEBUG] [VALIDATOR ] NAZ: Validating primary data. [2025-09-16T19:34:21.186794] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-06. [2025-09-16T19:34:21.775339] [DEBUG] [VALIDATOR ] NATL: All expected trading days are present. [2025-09-16T19:34:21.790866] [DEBUG] [VALIDATOR ] NATL: Primary data validation passed. [2025-09-16T19:34:21.818625] [INFO ] [MAIN ] NATL: Fetched primary data is valid. [2025-09-16T19:34:21.839388] [DEBUG] [LOCAL ] NATL: Saving primary data. [2025-09-16T19:34:21.862597] [DEBUG] [VALIDATOR ] NAZ: All expected trading days are present. [2025-09-16T19:34:21.862952] [DEBUG] [VALIDATOR ] NAZ: Primary data validation passed. [2025-09-16T19:34:21.863077] [INFO ] [MAIN ] NAZ: Fetched primary data is valid. [2025-09-16T19:34:21.863428] [DEBUG] [LOCAL ] NAZ: Saving primary data. [2025-09-16T19:34:21.864208] [DEBUG] [LOCAL ] NAZ: Trimmed 3012 records to 1976 (keeping 150 days of data) [2025-09-16T19:34:21.864867] [DEBUG] [LOCAL ] NATL: Trimmed 34985 records to 24282 (keeping 150 days of data) [2025-09-16T19:34:21.878238] [DEBUG] [LOCAL ] NAZ: Primary data saved (1976 records). [2025-09-16T19:34:21.930240] [INFO ] [MAIN ] NAZ: Full history saved. [2025-09-16T19:34:21.939264] [INFO ] [MAIN ] Update Progress: 1454/2369 symbols completed. NAZ took 27.0s. Estimated remaining: 1h 37m 7s. Rate: 9.4 symbols/min [2025-09-16T19:34:21.980258] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-02. [2025-09-16T19:34:22.195732] [INFO ] [MAIN ] NBXG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:34:22.237375] [DEBUG] [LOCAL ] NBXG: Loaded 15978 existing records from primary storage. [2025-09-16T19:34:22.238551] [INFO ] [MAIN ] NBXG: Loaded 15978 existing records. [2025-09-16T19:34:22.239422] [DEBUG] [LOCAL ] NATL: Primary data saved (24282 records). [2025-09-16T19:34:22.282074] [INFO ] [MAIN ] NATL: Full history saved. [2025-09-16T19:34:22.308126] [INFO ] [MAIN ] Update Progress: 1455/2369 symbols completed. NATL took 32.8s. Estimated remaining: 1h 36m 56s. Rate: 9.4 symbols/min [2025-09-16T19:34:22.526674] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-16T19:34:22.566194] [WARN ] [MAIN ] NBXG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:34:22.619930] [INFO ] [MAIN ] NBXG: Wiping existing primary data before full refresh. [2025-09-16T19:34:22.622746] [INFO ] [LOCAL ] NBXG: Starting deletion of primary data. [2025-09-16T19:34:22.622618] [INFO ] [MAIN ] NC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:34:22.623480] [DEBUG] [LOCAL ] NBXG: Deleted primary data file. [2025-09-16T19:34:22.623533] [INFO ] [MAIN ] NBXG: Starting full primary refresh. [2025-09-16T19:34:22.704533] [DEBUG] [LOCAL ] NC: Loaded 1162 existing records from primary storage. [2025-09-16T19:34:22.725323] [INFO ] [MAIN ] NC: Loaded 1162 existing records. [2025-09-16T19:34:22.789720] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-07. [2025-09-16T19:34:23.100132] [WARN ] [MAIN ] NC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:34:23.135265] [INFO ] [MAIN ] NC: Wiping existing primary data before full refresh. [2025-09-16T19:34:23.154820] [INFO ] [REMOTE ] NBXG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:34:23.150625] [INFO ] [LOCAL ] NC: Starting deletion of primary data. [2025-09-16T19:34:23.155314] [DEBUG] [LOCAL ] NC: Deleted primary data file. [2025-09-16T19:34:23.155368] [INFO ] [MAIN ] NC: Starting full primary refresh. [2025-09-16T19:34:23.503451] [INFO ] [REMOTE ] NC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:34:23.574885] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-02. [2025-09-16T19:34:23.743538] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-16T19:34:23.971190] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-16T19:34:23.990235] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-16T19:34:24.374907] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-03. [2025-09-16T19:34:25.174957] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-03. [2025-09-16T19:34:25.836540] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-16T19:34:25.974891] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-02. [2025-09-16T19:34:26.034635] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-16T19:34:26.774900] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-04. [2025-09-16T19:34:27.208216] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-16T19:34:27.574960] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-04. [2025-09-16T19:34:28.158738] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-16T19:34:28.185213] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-16T19:34:28.374899] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-08. [2025-09-16T19:34:29.174901] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-05. [2025-09-16T19:34:29.607777] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-16T19:34:29.974883] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-09. [2025-09-16T19:34:30.634962] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-16T19:34:30.774859] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-06. [2025-09-16T19:34:30.941216] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-16T19:34:30.944774] [INFO ] [REMOTE ] NBHC: Full fetch complete (24401 records). [2025-09-16T19:34:30.944847] [DEBUG] [VALIDATOR ] NBHC: Validating primary data. [2025-09-16T19:34:31.316391] [DEBUG] [VALIDATOR ] NBHC: All expected trading days are present. [2025-09-16T19:34:31.316470] [DEBUG] [VALIDATOR ] NBHC: Primary data validation passed. [2025-09-16T19:34:31.316982] [INFO ] [MAIN ] NBHC: Fetched primary data is valid. [2025-09-16T19:34:31.317034] [DEBUG] [LOCAL ] NBHC: Saving primary data. [2025-09-16T19:34:31.317738] [DEBUG] [LOCAL ] NBHC: Trimmed 24401 records to 16614 (keeping 150 days of data) [2025-09-16T19:34:31.423667] [DEBUG] [LOCAL ] NBHC: Primary data saved (16614 records). [2025-09-16T19:34:31.423816] [INFO ] [MAIN ] NBHC: Full history saved. [2025-09-16T19:34:31.423908] [INFO ] [MAIN ] Update Progress: 1456/2369 symbols completed. NBHC took 27.4s. Estimated remaining: 1h 36m 52s. Rate: 9.4 symbols/min [2025-09-16T19:34:31.582254] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-05. [2025-09-16T19:34:31.608535] [INFO ] [MAIN ] NCA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:34:31.616824] [DEBUG] [LOCAL ] NCA: Loaded 7083 existing records from primary storage. [2025-09-16T19:34:31.616929] [INFO ] [MAIN ] NCA: Loaded 7083 existing records. [2025-09-16T19:34:31.811274] [WARN ] [MAIN ] NCA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:34:31.811535] [INFO ] [MAIN ] NCA: Wiping existing primary data before full refresh. [2025-09-16T19:34:31.811628] [INFO ] [LOCAL ] NCA: Starting deletion of primary data. [2025-09-16T19:34:31.811967] [DEBUG] [LOCAL ] NCA: Deleted primary data file. [2025-09-16T19:34:31.812031] [INFO ] [MAIN ] NCA: Starting full primary refresh. [2025-09-16T19:34:32.042097] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-16T19:34:32.181719] [INFO ] [REMOTE ] NCA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:34:32.203896] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-16T19:34:32.374861] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-07. [2025-09-16T19:34:33.174896] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-06. [2025-09-16T19:34:33.608099] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-16T19:34:33.859190] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-16T19:34:33.974853] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-08. [2025-09-16T19:34:34.774913] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-03. [2025-09-16T19:34:35.470813] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-16T19:34:35.574976] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-07. [2025-09-16T19:34:35.577278] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-16T19:34:35.979923] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-16T19:34:36.374920] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-09. [2025-09-16T19:34:37.174906] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-02. [2025-09-16T19:34:37.947052] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-16T19:34:37.953954] [INFO ] [REMOTE ] NBR: Full fetch complete (38101 records). [2025-09-16T19:34:37.954180] [DEBUG] [VALIDATOR ] NBR: Validating primary data. [2025-09-16T19:34:37.981154] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-04. [2025-09-16T19:34:38.283636] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-16T19:34:38.365924] [DEBUG] [VALIDATOR ] NBR: All expected trading days are present. [2025-09-16T19:34:38.366005] [DEBUG] [VALIDATOR ] NBR: Primary data validation passed. [2025-09-16T19:34:38.366732] [INFO ] [MAIN ] NBR: Fetched primary data is valid. [2025-09-16T19:34:38.366786] [DEBUG] [LOCAL ] NBR: Saving primary data. [2025-09-16T19:34:38.367585] [DEBUG] [LOCAL ] NBR: Trimmed 38101 records to 26240 (keeping 150 days of data) [2025-09-16T19:34:38.524077] [DEBUG] [LOCAL ] NBR: Primary data saved (26240 records). [2025-09-16T19:34:38.524232] [INFO ] [MAIN ] NBR: Full history saved. [2025-09-16T19:34:38.524343] [INFO ] [MAIN ] Update Progress: 1457/2369 symbols completed. NBR took 19.4s. Estimated remaining: 1h 36m 46s. Rate: 9.4 symbols/min [2025-09-16T19:34:38.693494] [INFO ] [MAIN ] NCDL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:34:38.711072] [DEBUG] [LOCAL ] NCDL: Loaded 14866 existing records from primary storage. [2025-09-16T19:34:38.711219] [INFO ] [MAIN ] NCDL: Loaded 14866 existing records. [2025-09-16T19:34:38.780055] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-03. [2025-09-16T19:34:38.899865] [WARN ] [MAIN ] NCDL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:34:38.900164] [INFO ] [MAIN ] NCDL: Wiping existing primary data before full refresh. [2025-09-16T19:34:38.900219] [INFO ] [LOCAL ] NCDL: Starting deletion of primary data. [2025-09-16T19:34:38.900630] [DEBUG] [LOCAL ] NCDL: Deleted primary data file. [2025-09-16T19:34:38.900702] [INFO ] [MAIN ] NCDL: Starting full primary refresh. [2025-09-16T19:34:39.265920] [INFO ] [REMOTE ] NCDL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:34:39.313106] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-16T19:34:39.325394] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-16T19:34:39.574914] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-05. [2025-09-16T19:34:40.374914] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-04. [2025-09-16T19:34:40.643351] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-16T19:34:41.095577] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-16T19:34:41.174928] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-08. [2025-09-16T19:34:41.561184] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-16T19:34:41.974895] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-09. [2025-09-16T19:34:42.376386] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-16T19:34:42.377323] [INFO ] [REMOTE ] NC: Full fetch complete (2046 records). [2025-09-16T19:34:42.377400] [DEBUG] [VALIDATOR ] NC: Validating primary data. [2025-09-16T19:34:42.733144] [DEBUG] [VALIDATOR ] NC: All expected trading days are present. [2025-09-16T19:34:42.733231] [DEBUG] [VALIDATOR ] NC: Primary data validation passed. [2025-09-16T19:34:42.733424] [INFO ] [MAIN ] NC: Fetched primary data is valid. [2025-09-16T19:34:42.733483] [DEBUG] [LOCAL ] NC: Saving primary data. [2025-09-16T19:34:42.733870] [DEBUG] [LOCAL ] NC: Trimmed 2046 records to 1170 (keeping 150 days of data) [2025-09-16T19:34:42.741945] [DEBUG] [LOCAL ] NC: Primary data saved (1170 records). [2025-09-16T19:34:42.742047] [INFO ] [MAIN ] NC: Full history saved. [2025-09-16T19:34:42.742168] [INFO ] [MAIN ] Update Progress: 1458/2369 symbols completed. NC took 20.4s. Estimated remaining: 1h 36m 38s. Rate: 9.4 symbols/min [2025-09-16T19:34:42.780106] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-02. [2025-09-16T19:34:42.920861] [INFO ] [MAIN ] NCLH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:34:42.965834] [DEBUG] [LOCAL ] NCLH: Loaded 39713 existing records from primary storage. [2025-09-16T19:34:42.965981] [INFO ] [MAIN ] NCLH: Loaded 39713 existing records. [2025-09-16T19:34:43.139091] [WARN ] [MAIN ] NCLH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:34:43.139319] [INFO ] [MAIN ] NCLH: Wiping existing primary data before full refresh. [2025-09-16T19:34:43.139366] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-09-16T19:34:43.140311] [DEBUG] [LOCAL ] NCLH: Deleted primary data file. [2025-09-16T19:34:43.140385] [INFO ] [MAIN ] NCLH: Starting full primary refresh. [2025-09-16T19:34:43.496110] [INFO ] [REMOTE ] NCLH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:34:43.574851] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-05. [2025-09-16T19:34:43.966998] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-16T19:34:44.365857] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-16T19:34:44.374842] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-06. [2025-09-16T19:34:45.174868] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-03. [2025-09-16T19:34:45.471002] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-16T19:34:45.974889] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-02. [2025-09-16T19:34:46.775837] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-06. [2025-09-16T19:34:46.778482] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-16T19:34:47.574955] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-07. [2025-09-16T19:34:47.808875] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-16T19:34:47.862826] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-16T19:34:48.374902] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-03. [2025-09-16T19:34:48.411356] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-16T19:34:49.174900] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-08. [2025-09-16T19:34:49.899566] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-16T19:34:49.974869] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-07. [2025-09-16T19:34:50.518969] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-16T19:34:50.733581] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-16T19:34:50.774902] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-04. [2025-09-16T19:34:51.574925] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-08. [2025-09-16T19:34:51.924727] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-16T19:34:52.374936] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-09. [2025-09-16T19:34:52.711756] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-16T19:34:53.142118] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-16T19:34:53.143704] [INFO ] [REMOTE ] NCA: Full fetch complete (11039 records). [2025-09-16T19:34:53.143776] [DEBUG] [VALIDATOR ] NCA: Validating primary data. [2025-09-16T19:34:53.179991] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-09. [2025-09-16T19:34:53.523564] [DEBUG] [VALIDATOR ] NCA: All expected trading days are present. [2025-09-16T19:34:53.523699] [DEBUG] [VALIDATOR ] NCA: Primary data validation passed. [2025-09-16T19:34:53.524026] [INFO ] [MAIN ] NCA: Fetched primary data is valid. [2025-09-16T19:34:53.524116] [DEBUG] [LOCAL ] NCA: Saving primary data. [2025-09-16T19:34:53.525000] [DEBUG] [LOCAL ] NCA: Trimmed 11039 records to 7192 (keeping 150 days of data) [2025-09-16T19:34:53.574115] [DEBUG] [LOCAL ] NCA: Primary data saved (7192 records). [2025-09-16T19:34:53.574287] [INFO ] [MAIN ] NCA: Full history saved. [2025-09-16T19:34:53.574393] [INFO ] [MAIN ] Update Progress: 1459/2369 symbols completed. NCA took 22.2s. Estimated remaining: 1h 36m 35s. Rate: 9.4 symbols/min [2025-09-16T19:34:53.748251] [INFO ] [MAIN ] NCV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:34:53.761843] [DEBUG] [LOCAL ] NCV: Loaded 9518 existing records from primary storage. [2025-09-16T19:34:53.761983] [INFO ] [MAIN ] NCV: Loaded 9518 existing records. [2025-09-16T19:34:53.946993] [WARN ] [MAIN ] NCV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:34:53.947259] [INFO ] [MAIN ] NCV: Wiping existing primary data before full refresh. [2025-09-16T19:34:53.947306] [INFO ] [LOCAL ] NCV: Starting deletion of primary data. [2025-09-16T19:34:53.947763] [DEBUG] [LOCAL ] NCV: Deleted primary data file. [2025-09-16T19:34:53.947823] [INFO ] [MAIN ] NCV: Starting full primary refresh. [2025-09-16T19:34:53.980017] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-05. [2025-09-16T19:34:54.311396] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-16T19:34:54.315503] [INFO ] [REMOTE ] NCV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:34:54.319102] [INFO ] [REMOTE ] NBXG: Full fetch complete (25028 records). [2025-09-16T19:34:54.319253] [DEBUG] [VALIDATOR ] NBXG: Validating primary data. [2025-09-16T19:34:54.694059] [DEBUG] [VALIDATOR ] NBXG: All expected trading days are present. [2025-09-16T19:34:54.694145] [DEBUG] [VALIDATOR ] NBXG: Primary data validation passed. [2025-09-16T19:34:54.694685] [INFO ] [MAIN ] NBXG: Fetched primary data is valid. [2025-09-16T19:34:54.694730] [DEBUG] [LOCAL ] NBXG: Saving primary data. [2025-09-16T19:34:54.695446] [DEBUG] [LOCAL ] NBXG: Trimmed 25028 records to 16130 (keeping 150 days of data) [2025-09-16T19:34:54.774970] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-04. [2025-09-16T19:34:54.805292] [DEBUG] [LOCAL ] NBXG: Primary data saved (16130 records). [2025-09-16T19:34:54.805444] [INFO ] [MAIN ] NBXG: Full history saved. [2025-09-16T19:34:54.805547] [INFO ] [MAIN ] Update Progress: 1460/2369 symbols completed. NBXG took 32.9s. Estimated remaining: 1h 36m 25s. Rate: 9.4 symbols/min [2025-09-16T19:34:54.977392] [INFO ] [MAIN ] NCZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:34:54.991812] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-16T19:34:55.003840] [DEBUG] [LOCAL ] NCZ: Loaded 8108 existing records from primary storage. [2025-09-16T19:34:55.004006] [INFO ] [MAIN ] NCZ: Loaded 8108 existing records. [2025-09-16T19:34:55.184713] [WARN ] [MAIN ] NCZ: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:34:55.184993] [INFO ] [MAIN ] NCZ: Wiping existing primary data before full refresh. [2025-09-16T19:34:55.185049] [INFO ] [LOCAL ] NCZ: Starting deletion of primary data. [2025-09-16T19:34:55.185384] [DEBUG] [LOCAL ] NCZ: Deleted primary data file. [2025-09-16T19:34:55.185429] [INFO ] [MAIN ] NCZ: Starting full primary refresh. [2025-09-16T19:34:55.543609] [INFO ] [REMOTE ] NCZ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:34:55.574854] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-02. [2025-09-16T19:34:56.374903] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-06. [2025-09-16T19:34:56.593101] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-16T19:34:56.881918] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-16T19:34:57.174868] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-03. [2025-09-16T19:34:57.478380] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-16T19:34:57.903240] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-16T19:34:57.974860] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-04. [2025-09-16T19:34:58.774958] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-05. [2025-09-16T19:34:58.889358] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-16T19:34:59.574950] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-05. [2025-09-16T19:35:00.374912] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-02. [2025-09-16T19:35:00.474963] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-16T19:35:00.958112] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-16T19:35:01.174981] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-06. [2025-09-16T19:35:01.653805] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-16T19:35:01.974951] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-03. [2025-09-16T19:35:02.774952] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-06. [2025-09-16T19:35:02.937777] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-16T19:35:03.320203] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-16T19:35:03.336702] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-16T19:35:03.574923] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-07. [2025-09-16T19:35:04.374890] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-07. [2025-09-16T19:35:04.746563] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-16T19:35:05.174905] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-08. [2025-09-16T19:35:05.927107] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-16T19:35:05.974915] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-07. [2025-09-16T19:35:06.634490] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-16T19:35:06.666865] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-16T19:35:06.774896] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-08. [2025-09-16T19:35:07.574977] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-09. [2025-09-16T19:35:08.374955] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-04. [2025-09-16T19:35:08.562046] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-16T19:35:08.565476] [INFO ] [REMOTE ] NCDL: Full fetch complete (23932 records). [2025-09-16T19:35:08.565691] [DEBUG] [VALIDATOR ] NCDL: Validating primary data. [2025-09-16T19:35:08.990791] [DEBUG] [VALIDATOR ] NCDL: All expected trading days are present. [2025-09-16T19:35:08.990918] [DEBUG] [VALIDATOR ] NCDL: Primary data validation passed. [2025-09-16T19:35:08.991416] [INFO ] [MAIN ] NCDL: Fetched primary data is valid. [2025-09-16T19:35:08.991471] [DEBUG] [LOCAL ] NCDL: Saving primary data. [2025-09-16T19:35:09.021777] [DEBUG] [LOCAL ] NCDL: Trimmed 23932 records to 15032 (keeping 150 days of data) [2025-09-16T19:35:09.028058] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-16T19:35:09.133538] [DEBUG] [LOCAL ] NCDL: Primary data saved (15032 records). [2025-09-16T19:35:09.133705] [INFO ] [MAIN ] NCDL: Full history saved. [2025-09-16T19:35:09.133795] [INFO ] [MAIN ] Update Progress: 1461/2369 symbols completed. NCDL took 30.6s. Estimated remaining: 1h 36m 24s. Rate: 9.4 symbols/min [2025-09-16T19:35:09.180139] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-08. [2025-09-16T19:35:09.311196] [INFO ] [MAIN ] NDMO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:35:09.325799] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-16T19:35:09.343804] [DEBUG] [LOCAL ] NDMO: Loaded 12480 existing records from primary storage. [2025-09-16T19:35:09.344004] [INFO ] [MAIN ] NDMO: Loaded 12480 existing records. [2025-09-16T19:35:09.522559] [WARN ] [MAIN ] NDMO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:35:09.522837] [INFO ] [MAIN ] NDMO: Wiping existing primary data before full refresh. [2025-09-16T19:35:09.522884] [INFO ] [LOCAL ] NDMO: Starting deletion of primary data. [2025-09-16T19:35:09.523284] [DEBUG] [LOCAL ] NDMO: Deleted primary data file. [2025-09-16T19:35:09.523328] [INFO ] [MAIN ] NDMO: Starting full primary refresh. [2025-09-16T19:35:09.873108] [INFO ] [REMOTE ] NDMO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:35:09.974884] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-02. [2025-09-16T19:35:10.023094] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-16T19:35:10.774930] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-09. [2025-09-16T19:35:10.991932] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-16T19:35:11.574927] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-03. [2025-09-16T19:35:12.379905] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-09. [2025-09-16T19:35:12.384098] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-16T19:35:12.738933] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-16T19:35:12.746121] [INFO ] [REMOTE ] NCLH: Full fetch complete (58433 records). [2025-09-16T19:35:12.746282] [DEBUG] [VALIDATOR ] NCLH: Validating primary data. [2025-09-16T19:35:13.136858] [DEBUG] [VALIDATOR ] NCLH: All expected trading days are present. [2025-09-16T19:35:13.136946] [DEBUG] [VALIDATOR ] NCLH: Primary data validation passed. [2025-09-16T19:35:13.137905] [INFO ] [MAIN ] NCLH: Fetched primary data is valid. [2025-09-16T19:35:13.137977] [DEBUG] [LOCAL ] NCLH: Saving primary data. [2025-09-16T19:35:13.139831] [DEBUG] [LOCAL ] NCLH: Trimmed 58433 records to 40103 (keeping 150 days of data) [2025-09-16T19:35:13.195903] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-04. [2025-09-16T19:35:13.239615] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-16T19:35:13.242671] [INFO ] [REMOTE ] NCZ: Full fetch complete (13296 records). [2025-09-16T19:35:13.243549] [DEBUG] [VALIDATOR ] NCZ: Validating primary data. [2025-09-16T19:35:13.647003] [DEBUG] [VALIDATOR ] NCZ: All expected trading days are present. [2025-09-16T19:35:13.647592] [DEBUG] [VALIDATOR ] NCZ: Primary data validation passed. [2025-09-16T19:35:13.648758] [INFO ] [MAIN ] NCZ: Fetched primary data is valid. [2025-09-16T19:35:13.648824] [DEBUG] [LOCAL ] NCZ: Saving primary data. [2025-09-16T19:35:13.651207] [DEBUG] [LOCAL ] NCZ: Trimmed 13296 records to 8195 (keeping 150 days of data) [2025-09-16T19:35:13.807778] [DEBUG] [LOCAL ] NCZ: Primary data saved (8195 records). [2025-09-16T19:35:13.808150] [INFO ] [MAIN ] NCZ: Full history saved. [2025-09-16T19:35:13.808772] [INFO ] [MAIN ] Update Progress: 1462/2369 symbols completed. NCZ took 19.0s. Estimated remaining: 1h 36m 16s. Rate: 9.4 symbols/min [2025-09-16T19:35:13.975113] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-05. [2025-09-16T19:35:14.000970] [INFO ] [MAIN ] NE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:35:14.022996] [DEBUG] [LOCAL ] NCLH: Primary data saved (40103 records). [2025-09-16T19:35:14.023153] [INFO ] [MAIN ] NCLH: Full history saved. [2025-09-16T19:35:14.024232] [INFO ] [MAIN ] Update Progress: 1463/2369 symbols completed. NCLH took 31.3s. Estimated remaining: 1h 36m 6s. Rate: 9.4 symbols/min [2025-09-16T19:35:14.166937] [DEBUG] [LOCAL ] NE: Loaded 38574 existing records from primary storage. [2025-09-16T19:35:14.191286] [INFO ] [MAIN ] NE: Loaded 38574 existing records. [2025-09-16T19:35:14.257508] [INFO ] [MAIN ] NEA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:35:14.445120] [WARN ] [MAIN ] NE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:35:14.450797] [INFO ] [MAIN ] NE: Wiping existing primary data before full refresh. [2025-09-16T19:35:14.456196] [INFO ] [LOCAL ] NE: Starting deletion of primary data. [2025-09-16T19:35:14.459284] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-16T19:35:14.463726] [DEBUG] [LOCAL ] NE: Deleted primary data file. [2025-09-16T19:35:14.464450] [INFO ] [MAIN ] NE: Starting full primary refresh. [2025-09-16T19:35:14.586148] [DEBUG] [LOCAL ] NEA: Loaded 25889 existing records from primary storage. [2025-09-16T19:35:14.588955] [INFO ] [MAIN ] NEA: Loaded 25889 existing records. [2025-09-16T19:35:14.778077] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-05. [2025-09-16T19:35:14.953353] [WARN ] [MAIN ] NEA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:35:14.977364] [INFO ] [MAIN ] NEA: Wiping existing primary data before full refresh. [2025-09-16T19:35:14.993401] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-16T19:35:14.987758] [INFO ] [LOCAL ] NEA: Starting deletion of primary data. [2025-09-16T19:35:15.033114] [DEBUG] [LOCAL ] NEA: Deleted primary data file. [2025-09-16T19:35:15.052816] [INFO ] [REMOTE ] NE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:35:15.048701] [INFO ] [MAIN ] NEA: Starting full primary refresh. [2025-09-16T19:35:15.405737] [INFO ] [REMOTE ] NEA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:35:15.574874] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-02. [2025-09-16T19:35:15.890142] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-16T19:35:16.374899] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-06. [2025-09-16T19:35:16.963078] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-16T19:35:17.159746] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-16T19:35:17.174862] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-07. [2025-09-16T19:35:17.974934] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-02. [2025-09-16T19:35:18.107460] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-16T19:35:18.774962] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-03. [2025-09-16T19:35:19.574949] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-08. [2025-09-16T19:35:19.609714] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-16T19:35:20.374935] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-03. [2025-09-16T19:35:20.509456] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-16T19:35:20.533254] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-16T19:35:21.174914] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-06. [2025-09-16T19:35:21.689300] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-16T19:35:21.957091] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-16T19:35:21.974838] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-07. [2025-09-16T19:35:22.774889] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-04. [2025-09-16T19:35:22.989070] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-16T19:35:23.574903] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-08. [2025-09-16T19:35:24.374923] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-09. [2025-09-16T19:35:24.569901] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-16T19:35:24.600378] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-16T19:35:25.174916] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-09. [2025-09-16T19:35:25.453277] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-16T19:35:25.455382] [INFO ] [REMOTE ] NCV: Full fetch complete (14926 records). [2025-09-16T19:35:25.455472] [DEBUG] [VALIDATOR ] NCV: Validating primary data. [2025-09-16T19:35:25.813473] [DEBUG] [VALIDATOR ] NCV: All expected trading days are present. [2025-09-16T19:35:25.813548] [DEBUG] [VALIDATOR ] NCV: Primary data validation passed. [2025-09-16T19:35:25.813876] [INFO ] [MAIN ] NCV: Fetched primary data is valid. [2025-09-16T19:35:25.813919] [DEBUG] [LOCAL ] NCV: Saving primary data. [2025-09-16T19:35:25.814433] [DEBUG] [LOCAL ] NCV: Trimmed 14926 records to 9628 (keeping 150 days of data) [2025-09-16T19:35:25.876543] [DEBUG] [LOCAL ] NCV: Primary data saved (9628 records). [2025-09-16T19:35:25.876681] [INFO ] [MAIN ] NCV: Full history saved. [2025-09-16T19:35:25.876764] [INFO ] [MAIN ] Update Progress: 1464/2369 symbols completed. NCV took 32.3s. Estimated remaining: 1h 36m 3s. Rate: 9.4 symbols/min [2025-09-16T19:35:25.978253] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-05. [2025-09-16T19:35:26.050461] [INFO ] [MAIN ] NEE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:35:26.092971] [DEBUG] [LOCAL ] NEE: Loaded 39667 existing records from primary storage. [2025-09-16T19:35:26.093124] [INFO ] [MAIN ] NEE: Loaded 39667 existing records. [2025-09-16T19:35:26.268221] [WARN ] [MAIN ] NEE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:35:26.275795] [INFO ] [MAIN ] NEE: Wiping existing primary data before full refresh. [2025-09-16T19:35:26.275570] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-16T19:35:26.275873] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-09-16T19:35:26.278731] [INFO ] [REMOTE ] NDMO: Full fetch complete (17508 records). [2025-09-16T19:35:26.278813] [DEBUG] [VALIDATOR ] NDMO: Validating primary data. [2025-09-16T19:35:26.310047] [DEBUG] [LOCAL ] NEE: Deleted primary data file. [2025-09-16T19:35:26.321372] [INFO ] [MAIN ] NEE: Starting full primary refresh. [2025-09-16T19:35:26.785419] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-04. [2025-09-16T19:35:27.015950] [DEBUG] [VALIDATOR ] NDMO: All expected trading days are present. [2025-09-16T19:35:27.028098] [DEBUG] [VALIDATOR ] NDMO: Primary data validation passed. [2025-09-16T19:35:27.048772] [INFO ] [MAIN ] NDMO: Fetched primary data is valid. [2025-09-16T19:35:27.048843] [DEBUG] [LOCAL ] NDMO: Saving primary data. [2025-09-16T19:35:27.048239] [INFO ] [REMOTE ] NEE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:35:27.049795] [DEBUG] [LOCAL ] NDMO: Trimmed 17508 records to 12625 (keeping 150 days of data) [2025-09-16T19:35:27.129408] [DEBUG] [LOCAL ] NDMO: Primary data saved (12625 records). [2025-09-16T19:35:27.129556] [INFO ] [MAIN ] NDMO: Full history saved. [2025-09-16T19:35:27.129663] [INFO ] [MAIN ] Update Progress: 1465/2369 symbols completed. NDMO took 18.0s. Estimated remaining: 1h 35m 54s. Rate: 9.4 symbols/min [2025-09-16T19:35:27.309059] [INFO ] [MAIN ] NEM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:35:27.351045] [DEBUG] [LOCAL ] NEM: Loaded 39668 existing records from primary storage. [2025-09-16T19:35:27.351206] [INFO ] [MAIN ] NEM: Loaded 39668 existing records. [2025-09-16T19:35:27.530468] [WARN ] [MAIN ] NEM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:35:27.530747] [INFO ] [MAIN ] NEM: Wiping existing primary data before full refresh. [2025-09-16T19:35:27.530794] [INFO ] [LOCAL ] NEM: Starting deletion of primary data. [2025-09-16T19:35:27.531918] [DEBUG] [LOCAL ] NEM: Deleted primary data file. [2025-09-16T19:35:27.531969] [INFO ] [MAIN ] NEM: Starting full primary refresh. [2025-09-16T19:35:27.575503] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-02. [2025-09-16T19:35:27.897382] [INFO ] [REMOTE ] NEM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:35:27.929671] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-16T19:35:28.331221] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-16T19:35:28.374851] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-05. [2025-09-16T19:35:29.174915] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-02. [2025-09-16T19:35:29.298728] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-16T19:35:29.360062] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-16T19:35:29.974895] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-06. [2025-09-16T19:35:30.774912] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-03. [2025-09-16T19:35:31.201449] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-16T19:35:31.369745] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-16T19:35:31.574905] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-07. [2025-09-16T19:35:32.374951] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-03. [2025-09-16T19:35:32.858256] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-16T19:35:33.174870] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-04. [2025-09-16T19:35:33.346996] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-16T19:35:33.974884] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-06. [2025-09-16T19:35:34.638230] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-16T19:35:34.774867] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-04. [2025-09-16T19:35:34.885748] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-16T19:35:35.292453] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-16T19:35:35.574890] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-08. [2025-09-16T19:35:36.374912] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-07. [2025-09-16T19:35:37.131354] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-16T19:35:37.174886] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-05. [2025-09-16T19:35:37.323998] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-16T19:35:37.773475] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-16T19:35:37.974908] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-05. [2025-09-16T19:35:38.774921] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-09. [2025-09-16T19:35:39.349813] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-16T19:35:39.574867] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-06. [2025-09-16T19:35:40.079038] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-16T19:35:40.374915] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-06. [2025-09-16T19:35:40.515092] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-16T19:35:40.521543] [INFO ] [REMOTE ] NE: Full fetch complete (56984 records). [2025-09-16T19:35:40.521707] [DEBUG] [VALIDATOR ] NE: Validating primary data. [2025-09-16T19:35:40.905846] [DEBUG] [VALIDATOR ] NE: All expected trading days are present. [2025-09-16T19:35:40.905941] [DEBUG] [VALIDATOR ] NE: Primary data validation passed. [2025-09-16T19:35:40.906914] [INFO ] [MAIN ] NE: Fetched primary data is valid. [2025-09-16T19:35:40.906965] [DEBUG] [LOCAL ] NE: Saving primary data. [2025-09-16T19:35:40.908234] [DEBUG] [LOCAL ] NE: Trimmed 56984 records to 38963 (keeping 150 days of data) [2025-09-16T19:35:41.160920] [DEBUG] [LOCAL ] NE: Primary data saved (38963 records). [2025-09-16T19:35:41.161080] [INFO ] [MAIN ] NE: Full history saved. [2025-09-16T19:35:41.161171] [INFO ] [MAIN ] Update Progress: 1466/2369 symbols completed. NE took 27.4s. Estimated remaining: 1h 35m 52s. Rate: 9.4 symbols/min [2025-09-16T19:35:41.192542] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-08. [2025-09-16T19:35:41.336497] [INFO ] [MAIN ] NET: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:35:41.375253] [DEBUG] [LOCAL ] NET: Loaded 39108 existing records from primary storage. [2025-09-16T19:35:41.375432] [INFO ] [MAIN ] NET: Loaded 39108 existing records. [2025-09-16T19:35:41.555229] [WARN ] [MAIN ] NET: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:35:41.555554] [INFO ] [MAIN ] NET: Wiping existing primary data before full refresh. [2025-09-16T19:35:41.555606] [INFO ] [LOCAL ] NET: Starting deletion of primary data. [2025-09-16T19:35:41.556372] [DEBUG] [LOCAL ] NET: Deleted primary data file. [2025-09-16T19:35:41.556422] [INFO ] [MAIN ] NET: Starting full primary refresh. [2025-09-16T19:35:41.838476] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-09-16T19:35:41.979006] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-07. [2025-09-16T19:35:41.978928] [INFO ] [REMOTE ] NET: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:35:42.019072] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-16T19:35:42.781344] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-07. [2025-09-16T19:35:42.800805] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-16T19:35:43.574954] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-09. [2025-09-16T19:35:44.214909] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-16T19:35:44.374925] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-08. [2025-09-16T19:35:44.803525] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-16T19:35:44.809548] [INFO ] [REMOTE ] NEA: Full fetch complete (38480 records). [2025-09-16T19:35:44.809697] [DEBUG] [VALIDATOR ] NEA: Validating primary data. [2025-09-16T19:35:45.194395] [DEBUG] [VALIDATOR ] NEA: All expected trading days are present. [2025-09-16T19:35:45.180519] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-02. [2025-09-16T19:35:45.195302] [DEBUG] [VALIDATOR ] NEA: Primary data validation passed. [2025-09-16T19:35:45.196105] [INFO ] [MAIN ] NEA: Fetched primary data is valid. [2025-09-16T19:35:45.196204] [DEBUG] [LOCAL ] NEA: Saving primary data. [2025-09-16T19:35:45.197454] [DEBUG] [LOCAL ] NEA: Trimmed 38480 records to 26143 (keeping 150 days of data) [2025-09-16T19:35:45.325712] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-09-16T19:35:45.412162] [DEBUG] [LOCAL ] NEA: Primary data saved (26143 records). [2025-09-16T19:35:45.412320] [INFO ] [MAIN ] NEA: Full history saved. [2025-09-16T19:35:45.412441] [INFO ] [MAIN ] Update Progress: 1467/2369 symbols completed. NEA took 31.4s. Estimated remaining: 1h 35m 44s. Rate: 9.4 symbols/min [2025-09-16T19:35:45.590062] [INFO ] [MAIN ] NEU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:35:45.600004] [DEBUG] [LOCAL ] NEU: Loaded 6787 existing records from primary storage. [2025-09-16T19:35:45.600150] [INFO ] [MAIN ] NEU: Loaded 6787 existing records. [2025-09-16T19:35:45.791857] [WARN ] [MAIN ] NEU: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:35:45.792198] [INFO ] [MAIN ] NEU: Wiping existing primary data before full refresh. [2025-09-16T19:35:45.792267] [INFO ] [LOCAL ] NEU: Starting deletion of primary data. [2025-09-16T19:35:45.792611] [DEBUG] [LOCAL ] NEU: Deleted primary data file. [2025-09-16T19:35:45.792706] [INFO ] [MAIN ] NEU: Starting full primary refresh. [2025-09-16T19:35:46.004836] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-08. [2025-09-16T19:35:46.159287] [INFO ] [REMOTE ] NEU: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:35:46.673340] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-16T19:35:46.774957] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-02. [2025-09-16T19:35:47.377359] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-09-16T19:35:47.500103] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-16T19:35:47.574882] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-03. [2025-09-16T19:35:48.076089] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-16T19:35:48.242432] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-16T19:35:48.374941] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-09. [2025-09-16T19:35:49.174941] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-04. [2025-09-16T19:35:49.916057] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-16T19:35:49.974899] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-05. [2025-09-16T19:35:50.465224] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-16T19:35:50.471816] [INFO ] [REMOTE ] NEE: Full fetch complete (58387 records). [2025-09-16T19:35:50.471967] [DEBUG] [VALIDATOR ] NEE: Validating primary data. [2025-09-16T19:35:50.711018] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-16T19:35:50.780080] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-06. [2025-09-16T19:35:50.873779] [DEBUG] [VALIDATOR ] NEE: All expected trading days are present. [2025-09-16T19:35:50.873865] [DEBUG] [VALIDATOR ] NEE: Primary data validation passed. [2025-09-16T19:35:50.874784] [INFO ] [MAIN ] NEE: Fetched primary data is valid. [2025-09-16T19:35:50.874834] [DEBUG] [LOCAL ] NEE: Saving primary data. [2025-09-16T19:35:50.876145] [DEBUG] [LOCAL ] NEE: Trimmed 58387 records to 40057 (keeping 150 days of data) [2025-09-16T19:35:51.127886] [DEBUG] [LOCAL ] NEE: Primary data saved (40057 records). [2025-09-16T19:35:51.128012] [INFO ] [MAIN ] NEE: Full history saved. [2025-09-16T19:35:51.128094] [INFO ] [MAIN ] Update Progress: 1468/2369 symbols completed. NEE took 25.3s. Estimated remaining: 1h 35m 37s. Rate: 9.4 symbols/min [2025-09-16T19:35:51.299462] [INFO ] [MAIN ] NEUE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:35:51.302614] [DEBUG] [LOCAL ] NEUE: Loaded 1185 existing records from primary storage. [2025-09-16T19:35:51.302752] [INFO ] [MAIN ] NEUE: Loaded 1185 existing records. [2025-09-16T19:35:51.480222] [WARN ] [MAIN ] NEUE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:35:51.480520] [INFO ] [MAIN ] NEUE: Wiping existing primary data before full refresh. [2025-09-16T19:35:51.480568] [INFO ] [LOCAL ] NEUE: Starting deletion of primary data. [2025-09-16T19:35:51.480781] [DEBUG] [LOCAL ] NEUE: Deleted primary data file. [2025-09-16T19:35:51.480829] [INFO ] [MAIN ] NEUE: Starting full primary refresh. [2025-09-16T19:35:51.580809] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-09. [2025-09-16T19:35:51.844343] [INFO ] [REMOTE ] NEUE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:35:51.947055] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-16T19:35:52.374918] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-03. [2025-09-16T19:35:53.174962] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-07. [2025-09-16T19:35:53.553353] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-16T19:35:53.559853] [INFO ] [REMOTE ] NEM: Full fetch complete (58388 records). [2025-09-16T19:35:53.559987] [DEBUG] [VALIDATOR ] NEM: Validating primary data. [2025-09-16T19:35:53.943766] [DEBUG] [VALIDATOR ] NEM: All expected trading days are present. [2025-09-16T19:35:53.943851] [DEBUG] [VALIDATOR ] NEM: Primary data validation passed. [2025-09-16T19:35:53.944818] [INFO ] [MAIN ] NEM: Fetched primary data is valid. [2025-09-16T19:35:53.944871] [DEBUG] [LOCAL ] NEM: Saving primary data. [2025-09-16T19:35:53.946176] [DEBUG] [LOCAL ] NEM: Trimmed 58388 records to 40058 (keeping 150 days of data) [2025-09-16T19:35:54.004490] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-02. [2025-09-16T19:35:54.148884] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-16T19:35:54.214930] [DEBUG] [LOCAL ] NEM: Primary data saved (40058 records). [2025-09-16T19:35:54.215095] [INFO ] [MAIN ] NEM: Full history saved. [2025-09-16T19:35:54.215201] [INFO ] [MAIN ] Update Progress: 1469/2369 symbols completed. NEM took 27.1s. Estimated remaining: 1h 35m 29s. Rate: 9.4 symbols/min [2025-09-16T19:35:54.388575] [INFO ] [MAIN ] NEXA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:35:54.393447] [DEBUG] [LOCAL ] NEXA: Loaded 2952 existing records from primary storage. [2025-09-16T19:35:54.393558] [INFO ] [MAIN ] NEXA: Loaded 2952 existing records. [2025-09-16T19:35:54.609456] [WARN ] [MAIN ] NEXA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:35:54.615157] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-16T19:35:54.615012] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-16T19:35:54.615527] [INFO ] [MAIN ] NEXA: Wiping existing primary data before full refresh. [2025-09-16T19:35:54.627133] [INFO ] [LOCAL ] NEXA: Starting deletion of primary data. [2025-09-16T19:35:54.627872] [DEBUG] [LOCAL ] NEXA: Deleted primary data file. [2025-09-16T19:35:54.627930] [INFO ] [MAIN ] NEXA: Starting full primary refresh. [2025-09-16T19:35:54.783507] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-08. [2025-09-16T19:35:54.993225] [INFO ] [REMOTE ] NEXA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:35:55.574911] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-02. [2025-09-16T19:35:55.713685] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-16T19:35:56.348198] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-16T19:35:56.374865] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-03. [2025-09-16T19:35:56.905244] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-16T19:35:57.174933] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-09. [2025-09-16T19:35:57.974877] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-04. [2025-09-16T19:35:58.074314] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-16T19:35:58.075931] [INFO ] [REMOTE ] NEU: Full fetch complete (8600 records). [2025-09-16T19:35:58.076012] [DEBUG] [VALIDATOR ] NEU: Validating primary data. [2025-09-16T19:35:58.456871] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-16T19:35:58.456949] [DEBUG] [VALIDATOR ] NEU: All expected trading days are present. [2025-09-16T19:35:58.458342] [DEBUG] [VALIDATOR ] NEU: Primary data validation passed. [2025-09-16T19:35:58.458584] [INFO ] [MAIN ] NEU: Fetched primary data is valid. [2025-09-16T19:35:58.458625] [DEBUG] [LOCAL ] NEU: Saving primary data. [2025-09-16T19:35:58.459073] [DEBUG] [LOCAL ] NEU: Trimmed 8600 records to 6819 (keeping 150 days of data) [2025-09-16T19:35:58.504104] [DEBUG] [LOCAL ] NEU: Primary data saved (6819 records). [2025-09-16T19:35:58.504242] [INFO ] [MAIN ] NEU: Full history saved. [2025-09-16T19:35:58.504325] [INFO ] [MAIN ] Update Progress: 1470/2369 symbols completed. NEU took 13.1s. Estimated remaining: 1h 35m 21s. Rate: 9.4 symbols/min [2025-09-16T19:35:58.679120] [INFO ] [MAIN ] NFG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:35:58.705273] [DEBUG] [LOCAL ] NFG: Loaded 27895 existing records from primary storage. [2025-09-16T19:35:58.705432] [INFO ] [MAIN ] NFG: Loaded 27895 existing records. [2025-09-16T19:35:58.779972] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-05. [2025-09-16T19:35:58.882788] [WARN ] [MAIN ] NFG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:35:58.883014] [INFO ] [MAIN ] NFG: Wiping existing primary data before full refresh. [2025-09-16T19:35:58.883058] [INFO ] [LOCAL ] NFG: Starting deletion of primary data. [2025-09-16T19:35:58.883787] [DEBUG] [LOCAL ] NFG: Deleted primary data file. [2025-09-16T19:35:58.883837] [INFO ] [MAIN ] NFG: Starting full primary refresh. [2025-09-16T19:35:59.249816] [INFO ] [REMOTE ] NFG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:35:59.382767] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-16T19:35:59.574962] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-02. [2025-09-16T19:36:00.374904] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-04. [2025-09-16T19:36:01.174935] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-06. [2025-09-16T19:36:01.367210] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-16T19:36:01.793159] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-16T19:36:01.974920] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-07. [2025-09-16T19:36:02.707252] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-16T19:36:02.781993] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-08. [2025-09-16T19:36:02.792553] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-09-16T19:36:03.286012] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-16T19:36:03.574907] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-09. [2025-09-16T19:36:04.165213] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-16T19:36:04.166379] [INFO ] [REMOTE ] NEXA: Full fetch complete (4316 records). [2025-09-16T19:36:04.166446] [DEBUG] [VALIDATOR ] NEXA: Validating primary data. [2025-09-16T19:36:04.384445] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-05. [2025-09-16T19:36:04.556787] [DEBUG] [VALIDATOR ] NEXA: All expected trading days are present. [2025-09-16T19:36:04.556873] [DEBUG] [VALIDATOR ] NEXA: Primary data validation passed. [2025-09-16T19:36:04.557026] [INFO ] [MAIN ] NEXA: Fetched primary data is valid. [2025-09-16T19:36:04.557094] [DEBUG] [LOCAL ] NEXA: Saving primary data. [2025-09-16T19:36:04.557526] [DEBUG] [LOCAL ] NEXA: Trimmed 4316 records to 3014 (keeping 150 days of data) [2025-09-16T19:36:04.575050] [DEBUG] [LOCAL ] NEXA: Primary data saved (3014 records). [2025-09-16T19:36:04.575171] [INFO ] [MAIN ] NEXA: Full history saved. [2025-09-16T19:36:04.575264] [INFO ] [MAIN ] Update Progress: 1471/2369 symbols completed. NEXA took 10.4s. Estimated remaining: 1h 35m 15s. Rate: 9.4 symbols/min [2025-09-16T19:36:04.748550] [INFO ] [MAIN ] NFJ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:36:04.764214] [DEBUG] [LOCAL ] NFJ: Loaded 14409 existing records from primary storage. [2025-09-16T19:36:04.764347] [INFO ] [MAIN ] NFJ: Loaded 14409 existing records. [2025-09-16T19:36:04.960411] [WARN ] [MAIN ] NFJ: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:36:04.960722] [INFO ] [MAIN ] NFJ: Wiping existing primary data before full refresh. [2025-09-16T19:36:04.960769] [INFO ] [LOCAL ] NFJ: Starting deletion of primary data. [2025-09-16T19:36:04.961247] [DEBUG] [LOCAL ] NFJ: Deleted primary data file. [2025-09-16T19:36:04.961296] [INFO ] [MAIN ] NFJ: Starting full primary refresh. [2025-09-16T19:36:05.183388] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-03. [2025-09-16T19:36:05.316657] [INFO ] [REMOTE ] NFJ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:36:05.974925] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-02. [2025-09-16T19:36:06.728768] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-09-16T19:36:06.774871] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-06. [2025-09-16T19:36:06.895056] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-16T19:36:07.008440] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-16T19:36:07.574903] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-04. [2025-09-16T19:36:08.374964] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-03. [2025-09-16T19:36:08.716893] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-16T19:36:09.174905] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-07. [2025-09-16T19:36:09.477023] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-16T19:36:09.649152] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-16T19:36:09.974958] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-03. [2025-09-16T19:36:10.496406] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-16T19:36:10.774928] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-05. [2025-09-16T19:36:11.587011] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-04. [2025-09-16T19:36:11.589806] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-16T19:36:12.271933] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-16T19:36:12.374922] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-08. [2025-09-16T19:36:12.760270] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-16T19:36:13.174916] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-04. [2025-09-16T19:36:13.687570] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-16T19:36:13.974900] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-05. [2025-09-16T19:36:14.411894] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-16T19:36:14.575233] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-16T19:36:14.774933] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-06. [2025-09-16T19:36:15.574896] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-06. [2025-09-16T19:36:15.920154] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-16T19:36:16.028751] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-16T19:36:16.374897] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-07. [2025-09-16T19:36:17.174906] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-09. [2025-09-16T19:36:17.965117] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-16T19:36:17.974836] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-08. [2025-09-16T19:36:18.774901] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-07. [2025-09-16T19:36:18.810558] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-16T19:36:18.816820] [INFO ] [REMOTE ] NET: Full fetch complete (57765 records). [2025-09-16T19:36:18.816929] [DEBUG] [VALIDATOR ] NET: Validating primary data. [2025-09-16T19:36:19.205388] [DEBUG] [VALIDATOR ] NET: All expected trading days are present. [2025-09-16T19:36:19.205571] [DEBUG] [VALIDATOR ] NET: Primary data validation passed. [2025-09-16T19:36:19.206451] [INFO ] [MAIN ] NET: Fetched primary data is valid. [2025-09-16T19:36:19.206557] [DEBUG] [LOCAL ] NET: Saving primary data. [2025-09-16T19:36:19.210256] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-16T19:36:19.212198] [DEBUG] [LOCAL ] NET: Trimmed 57765 records to 39495 (keeping 150 days of data) [2025-09-16T19:36:19.326847] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-16T19:36:19.503946] [DEBUG] [LOCAL ] NET: Primary data saved (39495 records). [2025-09-16T19:36:19.504190] [INFO ] [MAIN ] NET: Full history saved. [2025-09-16T19:36:19.504312] [INFO ] [MAIN ] Update Progress: 1472/2369 symbols completed. NET took 38.3s. Estimated remaining: 1h 35m 14s. Rate: 9.4 symbols/min [2025-09-16T19:36:19.580176] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-08. [2025-09-16T19:36:19.724833] [INFO ] [MAIN ] NGG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:36:19.759543] [DEBUG] [LOCAL ] NGG: Loaded 34488 existing records from primary storage. [2025-09-16T19:36:19.759725] [INFO ] [MAIN ] NGG: Loaded 34488 existing records. [2025-09-16T19:36:20.000410] [WARN ] [MAIN ] NGG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:36:20.000785] [INFO ] [MAIN ] NGG: Wiping existing primary data before full refresh. [2025-09-16T19:36:20.000860] [INFO ] [LOCAL ] NGG: Starting deletion of primary data. [2025-09-16T19:36:20.001922] [DEBUG] [LOCAL ] NGG: Deleted primary data file. [2025-09-16T19:36:20.002003] [INFO ] [MAIN ] NGG: Starting full primary refresh. [2025-09-16T19:36:20.128282] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-16T19:36:20.380112] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-09. [2025-09-16T19:36:20.526974] [INFO ] [REMOTE ] NGG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:36:20.914290] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-16T19:36:20.915468] [INFO ] [REMOTE ] NEUE: Full fetch complete (2397 records). [2025-09-16T19:36:20.915552] [DEBUG] [VALIDATOR ] NEUE: Validating primary data. [2025-09-16T19:36:21.180112] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-02. [2025-09-16T19:36:21.344635] [DEBUG] [VALIDATOR ] NEUE: All expected trading days are present. [2025-09-16T19:36:21.344736] [DEBUG] [VALIDATOR ] NEUE: Primary data validation passed. [2025-09-16T19:36:21.344837] [INFO ] [MAIN ] NEUE: Fetched primary data is valid. [2025-09-16T19:36:21.344878] [DEBUG] [LOCAL ] NEUE: Saving primary data. [2025-09-16T19:36:21.345244] [DEBUG] [LOCAL ] NEUE: Trimmed 2397 records to 1188 (keeping 150 days of data) [2025-09-16T19:36:21.352456] [DEBUG] [LOCAL ] NEUE: Primary data saved (1188 records). [2025-09-16T19:36:21.352534] [INFO ] [MAIN ] NEUE: Full history saved. [2025-09-16T19:36:21.352609] [INFO ] [MAIN ] Update Progress: 1473/2369 symbols completed. NEUE took 30.2s. Estimated remaining: 1h 35m 5s. Rate: 9.4 symbols/min [2025-09-16T19:36:21.541049] [INFO ] [MAIN ] NGL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:36:21.563621] [DEBUG] [LOCAL ] NGL: Loaded 22541 existing records from primary storage. [2025-09-16T19:36:21.563787] [INFO ] [MAIN ] NGL: Loaded 22541 existing records. [2025-09-16T19:36:21.753199] [WARN ] [MAIN ] NGL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:36:21.753479] [INFO ] [MAIN ] NGL: Wiping existing primary data before full refresh. [2025-09-16T19:36:21.753531] [INFO ] [LOCAL ] NGL: Starting deletion of primary data. [2025-09-16T19:36:21.754261] [DEBUG] [LOCAL ] NGL: Deleted primary data file. [2025-09-16T19:36:21.754314] [INFO ] [MAIN ] NGL: Starting full primary refresh. [2025-09-16T19:36:21.983403] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-09. [2025-09-16T19:36:22.124698] [INFO ] [REMOTE ] NGL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:36:22.774917] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-02. [2025-09-16T19:36:23.044446] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-16T19:36:23.417562] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-16T19:36:23.422485] [INFO ] [REMOTE ] NFG: Full fetch complete (42448 records). [2025-09-16T19:36:23.422634] [DEBUG] [VALIDATOR ] NFG: Validating primary data. [2025-09-16T19:36:23.576965] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-03. [2025-09-16T19:36:23.840365] [DEBUG] [VALIDATOR ] NFG: All expected trading days are present. [2025-09-16T19:36:23.840453] [DEBUG] [VALIDATOR ] NFG: Primary data validation passed. [2025-09-16T19:36:23.841213] [INFO ] [MAIN ] NFG: Fetched primary data is valid. [2025-09-16T19:36:23.841259] [DEBUG] [LOCAL ] NFG: Saving primary data. [2025-09-16T19:36:23.842340] [DEBUG] [LOCAL ] NFG: Trimmed 42448 records to 28137 (keeping 150 days of data) [2025-09-16T19:36:24.029175] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-16T19:36:24.036071] [DEBUG] [LOCAL ] NFG: Primary data saved (28137 records). [2025-09-16T19:36:24.036789] [INFO ] [MAIN ] NFG: Full history saved. [2025-09-16T19:36:24.036885] [INFO ] [MAIN ] Update Progress: 1474/2369 symbols completed. NFG took 25.5s. Estimated remaining: 1h 34m 56s. Rate: 9.4 symbols/min [2025-09-16T19:36:24.211324] [INFO ] [MAIN ] NGS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:36:24.220283] [DEBUG] [LOCAL ] NGS: Loaded 8037 existing records from primary storage. [2025-09-16T19:36:24.220379] [INFO ] [MAIN ] NGS: Loaded 8037 existing records. [2025-09-16T19:36:24.378404] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-05. [2025-09-16T19:36:24.398960] [WARN ] [MAIN ] NGS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:36:24.399922] [INFO ] [MAIN ] NGS: Wiping existing primary data before full refresh. [2025-09-16T19:36:24.399977] [INFO ] [LOCAL ] NGS: Starting deletion of primary data. [2025-09-16T19:36:24.400316] [DEBUG] [LOCAL ] NGS: Deleted primary data file. [2025-09-16T19:36:24.400382] [INFO ] [MAIN ] NGS: Starting full primary refresh. [2025-09-16T19:36:24.762329] [INFO ] [REMOTE ] NGS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:36:25.174926] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-02. [2025-09-16T19:36:25.851838] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-16T19:36:25.899133] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-16T19:36:25.910075] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-16T19:36:25.974909] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-04. [2025-09-16T19:36:26.774895] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-03. [2025-09-16T19:36:27.574905] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-06. [2025-09-16T19:36:27.874343] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-16T19:36:28.023662] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-16T19:36:28.374906] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-03. [2025-09-16T19:36:28.608377] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-16T19:36:29.034384] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-16T19:36:29.174910] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-05. [2025-09-16T19:36:29.974921] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-07. [2025-09-16T19:36:30.774920] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-04. [2025-09-16T19:36:30.944702] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-16T19:36:31.184581] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-16T19:36:31.574897] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-08. [2025-09-16T19:36:31.813588] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-16T19:36:32.374937] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-05. [2025-09-16T19:36:32.572558] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-16T19:36:33.174913] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-06. [2025-09-16T19:36:33.447889] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-16T19:36:33.974902] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-09. [2025-09-16T19:36:34.641895] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-16T19:36:34.774892] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-04. [2025-09-16T19:36:34.904861] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-16T19:36:34.908830] [INFO ] [REMOTE ] NFJ: Full fetch complete (22047 records). [2025-09-16T19:36:34.908971] [DEBUG] [VALIDATOR ] NFJ: Validating primary data. [2025-09-16T19:36:35.296974] [DEBUG] [VALIDATOR ] NFJ: All expected trading days are present. [2025-09-16T19:36:35.297063] [DEBUG] [VALIDATOR ] NFJ: Primary data validation passed. [2025-09-16T19:36:35.297683] [INFO ] [MAIN ] NFJ: Fetched primary data is valid. [2025-09-16T19:36:35.297729] [DEBUG] [LOCAL ] NFJ: Saving primary data. [2025-09-16T19:36:35.298373] [DEBUG] [LOCAL ] NFJ: Trimmed 22047 records to 14583 (keeping 150 days of data) [2025-09-16T19:36:35.391985] [DEBUG] [LOCAL ] NFJ: Primary data saved (14583 records). [2025-09-16T19:36:35.392134] [INFO ] [MAIN ] NFJ: Full history saved. [2025-09-16T19:36:35.392263] [INFO ] [MAIN ] Update Progress: 1475/2369 symbols completed. NFJ took 30.8s. Estimated remaining: 1h 34m 53s. Rate: 9.4 symbols/min [2025-09-16T19:36:35.563099] [INFO ] [MAIN ] NGVC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:36:35.580051] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-07. [2025-09-16T19:36:35.580812] [DEBUG] [LOCAL ] NGVC: Loaded 17227 existing records from primary storage. [2025-09-16T19:36:35.581232] [INFO ] [MAIN ] NGVC: Loaded 17227 existing records. [2025-09-16T19:36:35.758874] [WARN ] [MAIN ] NGVC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:36:35.759153] [INFO ] [MAIN ] NGVC: Wiping existing primary data before full refresh. [2025-09-16T19:36:35.759239] [INFO ] [LOCAL ] NGVC: Starting deletion of primary data. [2025-09-16T19:36:35.759821] [DEBUG] [LOCAL ] NGVC: Deleted primary data file. [2025-09-16T19:36:35.759871] [INFO ] [MAIN ] NGVC: Starting full primary refresh. [2025-09-16T19:36:36.054288] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-16T19:36:36.136558] [INFO ] [REMOTE ] NGVC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:36:36.374906] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-02. [2025-09-16T19:36:37.174968] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-05. [2025-09-16T19:36:37.471481] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-16T19:36:37.672061] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-16T19:36:37.974969] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-06. [2025-09-16T19:36:38.060463] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-16T19:36:38.774951] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-06. [2025-09-16T19:36:39.333678] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-16T19:36:39.574988] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-08. [2025-09-16T19:36:39.815009] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-16T19:36:40.374970] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-07. [2025-09-16T19:36:41.129448] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-16T19:36:41.180079] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-08. [2025-09-16T19:36:41.199996] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-16T19:36:41.834453] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-16T19:36:41.974922] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-09. [2025-09-16T19:36:42.774960] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-07. [2025-09-16T19:36:43.504350] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-16T19:36:43.509835] [INFO ] [REMOTE ] NGG: Full fetch complete (50091 records). [2025-09-16T19:36:43.509969] [DEBUG] [VALIDATOR ] NGG: Validating primary data. [2025-09-16T19:36:43.580066] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-09. [2025-09-16T19:36:43.907924] [DEBUG] [VALIDATOR ] NGG: All expected trading days are present. [2025-09-16T19:36:43.908019] [DEBUG] [VALIDATOR ] NGG: Primary data validation passed. [2025-09-16T19:36:43.908878] [INFO ] [MAIN ] NGG: Fetched primary data is valid. [2025-09-16T19:36:43.908942] [DEBUG] [LOCAL ] NGG: Saving primary data. [2025-09-16T19:36:43.910657] [DEBUG] [LOCAL ] NGG: Trimmed 50091 records to 34801 (keeping 150 days of data) [2025-09-16T19:36:44.140747] [DEBUG] [LOCAL ] NGG: Primary data saved (34801 records). [2025-09-16T19:36:44.140976] [INFO ] [MAIN ] NGG: Full history saved. [2025-09-16T19:36:44.141150] [INFO ] [MAIN ] Update Progress: 1476/2369 symbols completed. NGG took 24.6s. Estimated remaining: 1h 34m 48s. Rate: 9.4 symbols/min [2025-09-16T19:36:44.284523] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-16T19:36:44.366311] [INFO ] [MAIN ] NGVT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:36:44.377398] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-08. [2025-09-16T19:36:44.387292] [DEBUG] [LOCAL ] NGVT: Loaded 17832 existing records from primary storage. [2025-09-16T19:36:44.387442] [INFO ] [MAIN ] NGVT: Loaded 17832 existing records. [2025-09-16T19:36:44.573324] [WARN ] [MAIN ] NGVT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:36:44.578400] [INFO ] [MAIN ] NGVT: Wiping existing primary data before full refresh. [2025-09-16T19:36:44.578997] [INFO ] [LOCAL ] NGVT: Starting deletion of primary data. [2025-09-16T19:36:44.579182] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-16T19:36:44.580605] [DEBUG] [LOCAL ] NGVT: Deleted primary data file. [2025-09-16T19:36:44.581048] [INFO ] [MAIN ] NGVT: Starting full primary refresh. [2025-09-16T19:36:44.586279] [INFO ] [REMOTE ] NGS: Full fetch complete (12598 records). [2025-09-16T19:36:44.625128] [DEBUG] [VALIDATOR ] NGS: Validating primary data. [2025-09-16T19:36:45.177111] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-03. [2025-09-16T19:36:45.241459] [INFO ] [REMOTE ] NGVT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:36:45.317107] [DEBUG] [VALIDATOR ] NGS: All expected trading days are present. [2025-09-16T19:36:45.317184] [DEBUG] [VALIDATOR ] NGS: Primary data validation passed. [2025-09-16T19:36:45.317464] [INFO ] [MAIN ] NGS: Fetched primary data is valid. [2025-09-16T19:36:45.317503] [DEBUG] [LOCAL ] NGS: Saving primary data. [2025-09-16T19:36:45.317996] [DEBUG] [LOCAL ] NGS: Trimmed 12598 records to 8086 (keeping 150 days of data) [2025-09-16T19:36:45.368148] [DEBUG] [LOCAL ] NGS: Primary data saved (8086 records). [2025-09-16T19:36:45.368275] [INFO ] [MAIN ] NGS: Full history saved. [2025-09-16T19:36:45.368379] [INFO ] [MAIN ] Update Progress: 1477/2369 symbols completed. NGS took 21.3s. Estimated remaining: 1h 34m 38s. Rate: 9.4 symbols/min [2025-09-16T19:36:45.788611] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-16T19:36:45.933879] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-16T19:36:45.974894] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-04. [2025-09-16T19:36:46.774859] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-09. [2025-09-16T19:36:47.131020] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-16T19:36:47.574964] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-05. [2025-09-16T19:36:47.846251] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-16T19:36:47.850788] [INFO ] [REMOTE ] NGL: Full fetch complete (32750 records). [2025-09-16T19:36:47.850879] [DEBUG] [VALIDATOR ] NGL: Validating primary data. [2025-09-16T19:36:48.213089] [DEBUG] [VALIDATOR ] NGL: All expected trading days are present. [2025-09-16T19:36:48.213165] [DEBUG] [VALIDATOR ] NGL: Primary data validation passed. [2025-09-16T19:36:48.213820] [INFO ] [MAIN ] NGL: Fetched primary data is valid. [2025-09-16T19:36:48.213863] [DEBUG] [LOCAL ] NGL: Saving primary data. [2025-09-16T19:36:48.214628] [DEBUG] [LOCAL ] NGL: Trimmed 32750 records to 22839 (keeping 150 days of data) [2025-09-16T19:36:48.352251] [DEBUG] [LOCAL ] NGL: Primary data saved (22839 records). [2025-09-16T19:36:48.352389] [INFO ] [MAIN ] NGL: Full history saved. [2025-09-16T19:36:48.352518] [INFO ] [MAIN ] Update Progress: 1478/2369 symbols completed. NGL took 27.0s. Estimated remaining: 1h 34m 30s. Rate: 9.4 symbols/min [2025-09-16T19:36:48.375038] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-02. [2025-09-16T19:36:48.575765] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-16T19:36:49.174957] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-06. [2025-09-16T19:36:49.689693] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-16T19:36:49.974946] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-03. [2025-09-16T19:36:50.111448] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-16T19:36:50.774915] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-07. [2025-09-16T19:36:50.794364] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-16T19:36:51.574960] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-04. [2025-09-16T19:36:51.949158] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-16T19:36:52.374920] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-08. [2025-09-16T19:36:52.798237] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-16T19:36:53.174907] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-05. [2025-09-16T19:36:53.563227] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-16T19:36:53.974964] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-09. [2025-09-16T19:36:54.892531] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-16T19:36:54.900487] [INFO ] [REMOTE ] NGVC: Full fetch complete (24162 records). [2025-09-16T19:36:54.900702] [DEBUG] [VALIDATOR ] NGVC: Validating primary data. [2025-09-16T19:36:55.305381] [DEBUG] [VALIDATOR ] NGVC: All expected trading days are present. [2025-09-16T19:36:55.305478] [DEBUG] [VALIDATOR ] NGVC: Primary data validation passed. [2025-09-16T19:36:55.306120] [INFO ] [MAIN ] NGVC: Fetched primary data is valid. [2025-09-16T19:36:55.306196] [DEBUG] [LOCAL ] NGVC: Saving primary data. [2025-09-16T19:36:55.306978] [DEBUG] [LOCAL ] NGVC: Trimmed 24162 records to 17387 (keeping 150 days of data) [2025-09-16T19:36:55.423798] [DEBUG] [LOCAL ] NGVC: Primary data saved (17387 records). [2025-09-16T19:36:55.423949] [INFO ] [MAIN ] NGVC: Full history saved. [2025-09-16T19:36:55.424054] [INFO ] [MAIN ] Update Progress: 1479/2369 symbols completed. NGVC took 20.0s. Estimated remaining: 1h 34m 24s. Rate: 9.4 symbols/min [2025-09-16T19:36:57.724576] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-05 (4.55 seconds). [2025-09-16T19:36:57.730458] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-06. [2025-09-16T19:36:58.625966] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-16T19:36:58.630921] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-07. [2025-09-16T19:36:59.780503] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-16T19:36:59.785869] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-08. [2025-09-16T19:37:00.976484] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-16T19:37:00.982526] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-09. [2025-09-16T19:37:02.086324] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-16T19:37:02.089421] [INFO ] [REMOTE ] NGVT: Full fetch complete (26880 records). [2025-09-16T19:37:02.089512] [DEBUG] [VALIDATOR ] NGVT: Validating primary data. [2025-09-16T19:37:02.469134] [DEBUG] [VALIDATOR ] NGVT: All expected trading days are present. [2025-09-16T19:37:02.469215] [DEBUG] [VALIDATOR ] NGVT: Primary data validation passed. [2025-09-16T19:37:02.469783] [INFO ] [MAIN ] NGVT: Fetched primary data is valid. [2025-09-16T19:37:02.469825] [DEBUG] [LOCAL ] NGVT: Saving primary data. [2025-09-16T19:37:02.470547] [DEBUG] [LOCAL ] NGVT: Trimmed 26880 records to 17986 (keeping 150 days of data) [2025-09-16T19:37:02.577167] [DEBUG] [LOCAL ] NGVT: Primary data saved (17986 records). [2025-09-16T19:37:02.577310] [INFO ] [MAIN ] NGVT: Full history saved. [2025-09-16T19:37:02.577392] [INFO ] [MAIN ] Update Progress: 1480/2369 symbols completed. NGVT took 18.4s. Estimated remaining: 1h 34m 18s. Rate: 9.4 symbols/min [2025-09-16T19:37:03.150748] [INFO ] [MAIN ] NIE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:37:03.202778] [INFO ] [MAIN ] NIC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:37:03.224824] [INFO ] [MAIN ] NHI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:37:03.292503] [INFO ] [MAIN ] NI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:37:03.299538] [DEBUG] [LOCAL ] NIE: Loaded 8108 existing records from primary storage. [2025-09-16T19:37:03.299729] [INFO ] [MAIN ] NIE: Loaded 8108 existing records. [2025-09-16T19:37:03.363675] [DEBUG] [LOCAL ] NIC: Loaded 6420 existing records from primary storage. [2025-09-16T19:37:03.370962] [INFO ] [MAIN ] NIC: Loaded 6420 existing records. [2025-09-16T19:37:03.490381] [DEBUG] [LOCAL ] NHI: Loaded 16297 existing records from primary storage. [2025-09-16T19:37:03.507341] [INFO ] [MAIN ] NHI: Loaded 16297 existing records. [2025-09-16T19:37:03.741149] [WARN ] [MAIN ] NIE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:37:03.785676] [INFO ] [MAIN ] NIE: Wiping existing primary data before full refresh. [2025-09-16T19:37:03.808137] [INFO ] [LOCAL ] NIE: Starting deletion of primary data. [2025-09-16T19:37:03.817766] [DEBUG] [LOCAL ] NI: Loaded 39409 existing records from primary storage. [2025-09-16T19:37:03.818193] [DEBUG] [LOCAL ] NIE: Deleted primary data file. [2025-09-16T19:37:03.844242] [INFO ] [MAIN ] NIE: Starting full primary refresh. [2025-09-16T19:37:03.833834] [INFO ] [MAIN ] NI: Loaded 39409 existing records. [2025-09-16T19:37:04.011088] [WARN ] [MAIN ] NHI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:37:04.094163] [INFO ] [MAIN ] NHI: Wiping existing primary data before full refresh. [2025-09-16T19:37:04.099693] [INFO ] [LOCAL ] NHI: Starting deletion of primary data. [2025-09-16T19:37:04.067716] [WARN ] [MAIN ] NIC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:37:04.151355] [INFO ] [MAIN ] NIC: Wiping existing primary data before full refresh. [2025-09-16T19:37:04.140895] [DEBUG] [LOCAL ] NHI: Deleted primary data file. [2025-09-16T19:37:04.168475] [INFO ] [MAIN ] NHI: Starting full primary refresh. [2025-09-16T19:37:04.168545] [INFO ] [LOCAL ] NIC: Starting deletion of primary data. [2025-09-16T19:37:04.202838] [DEBUG] [LOCAL ] NIC: Deleted primary data file. [2025-09-16T19:37:04.228739] [INFO ] [MAIN ] NIC: Starting full primary refresh. [2025-09-16T19:37:04.523169] [WARN ] [MAIN ] NI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:37:04.755942] [INFO ] [MAIN ] NI: Wiping existing primary data before full refresh. [2025-09-16T19:37:04.799784] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-09-16T19:37:04.820571] [DEBUG] [LOCAL ] NI: Deleted primary data file. [2025-09-16T19:37:04.855194] [INFO ] [MAIN ] NI: Starting full primary refresh. [2025-09-16T19:37:05.175571] [INFO ] [REMOTE ] NIE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:37:05.218147] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-02. [2025-09-16T19:37:05.359818] [INFO ] [REMOTE ] NHI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:37:05.415114] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-02. [2025-09-16T19:37:05.537505] [INFO ] [REMOTE ] NIC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:37:05.549173] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-02. [2025-09-16T19:37:05.649497] [INFO ] [REMOTE ] NI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:37:05.649841] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-02. [2025-09-16T19:37:06.142595] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-16T19:37:06.144941] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-03. [2025-09-16T19:37:06.533469] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-16T19:37:06.538568] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-03. [2025-09-16T19:37:06.545991] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-16T19:37:06.548308] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-03. [2025-09-16T19:37:06.970968] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-16T19:37:06.974357] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-04. [2025-09-16T19:37:07.098030] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-16T19:37:07.111367] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-04. [2025-09-16T19:37:07.113141] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-16T19:37:07.124372] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-03. [2025-09-16T19:37:07.411107] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-16T19:37:07.415925] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-04. [2025-09-16T19:37:07.878035] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-16T19:37:07.881463] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-05. [2025-09-16T19:37:07.953674] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-16T19:37:07.956524] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-05. [2025-09-16T19:37:08.257173] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-16T19:37:08.359933] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-16T19:37:08.374839] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-06. [2025-09-16T19:37:08.496115] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-16T19:37:08.951425] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-16T19:37:09.163745] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-16T19:37:09.174842] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-07. [2025-09-16T19:37:09.974906] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-04. [2025-09-16T19:37:10.088103] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-16T19:37:10.774916] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-08. [2025-09-16T19:37:11.540497] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-16T19:37:11.574911] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-05. [2025-09-16T19:37:11.813560] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-16T19:37:12.374956] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-05. [2025-09-16T19:37:12.738581] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-16T19:37:13.174916] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-09. [2025-09-16T19:37:13.974929] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-06. [2025-09-16T19:37:13.995113] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-16T19:37:13.996719] [INFO ] [REMOTE ] NIE: Full fetch complete (12451 records). [2025-09-16T19:37:13.996788] [DEBUG] [VALIDATOR ] NIE: Validating primary data. [2025-09-16T19:37:14.405605] [DEBUG] [VALIDATOR ] NIE: All expected trading days are present. [2025-09-16T19:37:14.407720] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-16T19:37:14.407930] [DEBUG] [VALIDATOR ] NIE: Primary data validation passed. [2025-09-16T19:37:14.419078] [INFO ] [MAIN ] NIE: Fetched primary data is valid. [2025-09-16T19:37:14.419147] [DEBUG] [LOCAL ] NIE: Saving primary data. [2025-09-16T19:37:14.420439] [DEBUG] [LOCAL ] NIE: Trimmed 12451 records to 8168 (keeping 150 days of data) [2025-09-16T19:37:14.469690] [DEBUG] [LOCAL ] NIE: Primary data saved (8168 records). [2025-09-16T19:37:14.469805] [INFO ] [MAIN ] NIE: Full history saved. [2025-09-16T19:37:14.469899] [INFO ] [MAIN ] Update Progress: 1481/2369 symbols completed. NIE took 11.9s. Estimated remaining: 1h 34m 15s. Rate: 9.4 symbols/min [2025-09-16T19:37:14.639703] [INFO ] [MAIN ] NIM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:37:14.643778] [DEBUG] [LOCAL ] NIM: Loaded 2724 existing records from primary storage. [2025-09-16T19:37:14.643861] [INFO ] [MAIN ] NIM: Loaded 2724 existing records. [2025-09-16T19:37:14.783247] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-06. [2025-09-16T19:37:14.823425] [WARN ] [MAIN ] NIM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:37:14.823738] [INFO ] [MAIN ] NIM: Wiping existing primary data before full refresh. [2025-09-16T19:37:14.823791] [INFO ] [LOCAL ] NIM: Starting deletion of primary data. [2025-09-16T19:37:14.824072] [DEBUG] [LOCAL ] NIM: Deleted primary data file. [2025-09-16T19:37:14.824119] [INFO ] [MAIN ] NIM: Starting full primary refresh. [2025-09-16T19:37:15.185367] [INFO ] [REMOTE ] NIM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:37:15.200088] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-16T19:37:15.574935] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-02. [2025-09-16T19:37:16.374920] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-07. [2025-09-16T19:37:16.477414] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-16T19:37:16.505195] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-16T19:37:17.174946] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-07. [2025-09-16T19:37:17.231206] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-16T19:37:17.974911] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-03. [2025-09-16T19:37:18.560957] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-16T19:37:18.774964] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-08. [2025-09-16T19:37:19.015153] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-16T19:37:19.574937] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-04. [2025-09-16T19:37:19.875364] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-16T19:37:19.936284] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-16T19:37:20.374924] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-08. [2025-09-16T19:37:21.174911] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-05. [2025-09-16T19:37:21.743004] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-16T19:37:21.974940] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-06. [2025-09-16T19:37:22.148243] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-16T19:37:22.574117] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-16T19:37:22.774941] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-07. [2025-09-16T19:37:23.407276] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-16T19:37:23.574952] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-09. [2025-09-16T19:37:24.374909] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-06. [2025-09-16T19:37:24.923587] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-16T19:37:25.147525] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-16T19:37:25.154081] [INFO ] [REMOTE ] NI: Full fetch complete (58089 records). [2025-09-16T19:37:25.154248] [DEBUG] [VALIDATOR ] NI: Validating primary data. [2025-09-16T19:37:25.187158] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-07. [2025-09-16T19:37:25.561688] [DEBUG] [VALIDATOR ] NI: All expected trading days are present. [2025-09-16T19:37:25.561778] [DEBUG] [VALIDATOR ] NI: Primary data validation passed. [2025-09-16T19:37:25.562625] [INFO ] [MAIN ] NI: Fetched primary data is valid. [2025-09-16T19:37:25.562686] [DEBUG] [LOCAL ] NI: Saving primary data. [2025-09-16T19:37:25.563964] [DEBUG] [LOCAL ] NI: Trimmed 58089 records to 39798 (keeping 150 days of data) [2025-09-16T19:37:25.674856] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-16T19:37:25.815719] [DEBUG] [LOCAL ] NI: Primary data saved (39798 records). [2025-09-16T19:37:25.815874] [INFO ] [MAIN ] NI: Full history saved. [2025-09-16T19:37:25.815960] [INFO ] [MAIN ] Update Progress: 1482/2369 symbols completed. NI took 23.2s. Estimated remaining: 1h 34m 12s. Rate: 9.4 symbols/min [2025-09-16T19:37:25.985408] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-08. [2025-09-16T19:37:25.989586] [INFO ] [MAIN ] NINE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:37:26.010094] [DEBUG] [LOCAL ] NINE: Loaded 21617 existing records from primary storage. [2025-09-16T19:37:26.010240] [INFO ] [MAIN ] NINE: Loaded 21617 existing records. [2025-09-16T19:37:26.183137] [WARN ] [MAIN ] NINE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:37:26.183379] [INFO ] [MAIN ] NINE: Wiping existing primary data before full refresh. [2025-09-16T19:37:26.183449] [INFO ] [LOCAL ] NINE: Starting deletion of primary data. [2025-09-16T19:37:26.184134] [DEBUG] [LOCAL ] NINE: Deleted primary data file. [2025-09-16T19:37:26.184183] [INFO ] [MAIN ] NINE: Starting full primary refresh. [2025-09-16T19:37:26.531896] [INFO ] [REMOTE ] NINE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:37:26.722898] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-16T19:37:26.774919] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-08. [2025-09-16T19:37:27.232985] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-16T19:37:27.574907] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-09. [2025-09-16T19:37:28.374914] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-02. [2025-09-16T19:37:28.631028] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-16T19:37:28.634156] [INFO ] [REMOTE ] NHI: Full fetch complete (24074 records). [2025-09-16T19:37:28.634271] [DEBUG] [VALIDATOR ] NHI: Validating primary data. [2025-09-16T19:37:29.032607] [DEBUG] [VALIDATOR ] NHI: All expected trading days are present. [2025-09-16T19:37:29.032791] [DEBUG] [VALIDATOR ] NHI: Primary data validation passed. [2025-09-16T19:37:29.033572] [INFO ] [MAIN ] NHI: Fetched primary data is valid. [2025-09-16T19:37:29.033619] [DEBUG] [LOCAL ] NHI: Saving primary data. [2025-09-16T19:37:29.034854] [DEBUG] [LOCAL ] NHI: Trimmed 24074 records to 16442 (keeping 150 days of data) [2025-09-16T19:37:29.143677] [DEBUG] [LOCAL ] NHI: Primary data saved (16442 records). [2025-09-16T19:37:29.143839] [INFO ] [MAIN ] NHI: Full history saved. [2025-09-16T19:37:29.143926] [INFO ] [MAIN ] Update Progress: 1483/2369 symbols completed. NHI took 26.6s. Estimated remaining: 1h 34m 3s. Rate: 9.4 symbols/min [2025-09-16T19:37:29.180102] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-09. [2025-09-16T19:37:29.327139] [INFO ] [MAIN ] NIO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:37:29.373714] [DEBUG] [LOCAL ] NIO: Loaded 39762 existing records from primary storage. [2025-09-16T19:37:29.373865] [INFO ] [MAIN ] NIO: Loaded 39762 existing records. [2025-09-16T19:37:29.554946] [WARN ] [MAIN ] NIO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:37:29.555340] [INFO ] [MAIN ] NIO: Wiping existing primary data before full refresh. [2025-09-16T19:37:29.555455] [INFO ] [LOCAL ] NIO: Starting deletion of primary data. [2025-09-16T19:37:29.561943] [DEBUG] [LOCAL ] NIO: Deleted primary data file. [2025-09-16T19:37:29.571828] [INFO ] [MAIN ] NIO: Starting full primary refresh. [2025-09-16T19:37:29.617866] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-16T19:37:29.837296] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-16T19:37:29.859728] [INFO ] [REMOTE ] NIM: Full fetch complete (4654 records). [2025-09-16T19:37:29.867432] [DEBUG] [VALIDATOR ] NIM: Validating primary data. [2025-09-16T19:37:29.975903] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-03. [2025-09-16T19:37:30.041337] [INFO ] [REMOTE ] NIO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:37:30.335492] [DEBUG] [VALIDATOR ] NIM: All expected trading days are present. [2025-09-16T19:37:30.335573] [DEBUG] [VALIDATOR ] NIM: Primary data validation passed. [2025-09-16T19:37:30.335746] [INFO ] [MAIN ] NIM: Fetched primary data is valid. [2025-09-16T19:37:30.335791] [DEBUG] [LOCAL ] NIM: Saving primary data. [2025-09-16T19:37:30.336177] [DEBUG] [LOCAL ] NIM: Trimmed 4654 records to 2731 (keeping 150 days of data) [2025-09-16T19:37:30.353255] [DEBUG] [LOCAL ] NIM: Primary data saved (2731 records). [2025-09-16T19:37:30.353343] [INFO ] [MAIN ] NIM: Full history saved. [2025-09-16T19:37:30.353423] [INFO ] [MAIN ] Update Progress: 1484/2369 symbols completed. NIM took 15.9s. Estimated remaining: 1h 33m 54s. Rate: 9.4 symbols/min [2025-09-16T19:37:30.534122] [INFO ] [MAIN ] NIQ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:37:30.534319] [DEBUG] [LOCAL ] NIQ: No existing data file found in primary storage. [2025-09-16T19:37:30.534358] [WARN ] [MAIN ] NIQ: No existing data found, performing full refresh instead. [2025-09-16T19:37:30.534533] [INFO ] [MAIN ] NIQ: Wiping existing primary data before full refresh. [2025-09-16T19:37:30.534587] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-09-16T19:37:30.534631] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-09-16T19:37:30.534687] [INFO ] [MAIN ] NIQ: Starting full primary refresh. [2025-09-16T19:37:30.780797] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-02. [2025-09-16T19:37:30.910677] [INFO ] [REMOTE ] NIQ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:37:31.480624] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-16T19:37:31.574886] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-02. [2025-09-16T19:37:31.768532] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:37:31.768898] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-02 [2025-09-16T19:37:32.374907] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-03. [2025-09-16T19:37:32.565043] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:37:32.565388] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-03 [2025-09-16T19:37:33.174890] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-04. [2025-09-16T19:37:33.352070] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-02 (2.57 seconds). [2025-09-16T19:37:33.974909] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-03. [2025-09-16T19:37:34.136085] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-16T19:37:34.775170] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-09. [2025-09-16T19:37:35.478833] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-16T19:37:35.480242] [INFO ] [REMOTE ] NIC: Full fetch complete (9611 records). [2025-09-16T19:37:35.480311] [DEBUG] [VALIDATOR ] NIC: Validating primary data. [2025-09-16T19:37:35.579989] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-04. [2025-09-16T19:37:35.836415] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:37:35.842892] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-04 [2025-09-16T19:37:35.842805] [DEBUG] [VALIDATOR ] NIC: All expected trading days are present. [2025-09-16T19:37:35.843236] [DEBUG] [VALIDATOR ] NIC: Primary data validation passed. [2025-09-16T19:37:35.843501] [INFO ] [MAIN ] NIC: Fetched primary data is valid. [2025-09-16T19:37:35.843541] [DEBUG] [LOCAL ] NIC: Saving primary data. [2025-09-16T19:37:35.844025] [DEBUG] [LOCAL ] NIC: Trimmed 9611 records to 6454 (keeping 150 days of data) [2025-09-16T19:37:35.885015] [DEBUG] [LOCAL ] NIC: Primary data saved (6454 records). [2025-09-16T19:37:35.885145] [INFO ] [MAIN ] NIC: Full history saved. [2025-09-16T19:37:35.885243] [INFO ] [MAIN ] Update Progress: 1485/2369 symbols completed. NIC took 33.3s. Estimated remaining: 1h 33m 47s. Rate: 9.4 symbols/min [2025-09-16T19:37:36.055042] [INFO ] [MAIN ] NJR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:37:36.082477] [DEBUG] [LOCAL ] NJR: Loaded 27763 existing records from primary storage. [2025-09-16T19:37:36.082613] [INFO ] [MAIN ] NJR: Loaded 27763 existing records. [2025-09-16T19:37:36.266159] [WARN ] [MAIN ] NJR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:37:36.266601] [INFO ] [MAIN ] NJR: Wiping existing primary data before full refresh. [2025-09-16T19:37:36.266687] [INFO ] [LOCAL ] NJR: Starting deletion of primary data. [2025-09-16T19:37:36.267433] [DEBUG] [LOCAL ] NJR: Deleted primary data file. [2025-09-16T19:37:36.267487] [INFO ] [MAIN ] NJR: Starting full primary refresh. [2025-09-16T19:37:36.375045] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-05. [2025-09-16T19:37:36.666216] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-03 (2.69 seconds). [2025-09-16T19:37:36.671339] [INFO ] [REMOTE ] NJR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:37:36.683086] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:37:36.684340] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-05 [2025-09-16T19:37:37.174917] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-06. [2025-09-16T19:37:37.366385] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:37:37.366744] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-06 [2025-09-16T19:37:37.974954] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-04. [2025-09-16T19:37:38.774950] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-02. [2025-09-16T19:37:39.574960] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-07. [2025-09-16T19:37:40.167904] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-16T19:37:40.374947] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-03. [2025-09-16T19:37:40.559557] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-09-16T19:37:40.603724] [INFO ] [REMOTE ] NIQ: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-16T19:37:41.174899] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-08. [2025-09-16T19:37:41.871740] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-16T19:37:41.974854] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-04. [2025-09-16T19:37:42.774933] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-05. [2025-09-16T19:37:42.890585] [INFO ] [REMOTE ] NIQ: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-16T19:37:43.176617] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-16T19:37:43.574939] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-05. [2025-09-16T19:37:44.374917] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-05. [2025-09-16T19:37:45.031959] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-16T19:37:45.174882] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-06. [2025-09-16T19:37:45.280627] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-09-16T19:37:45.802019] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-16T19:37:45.974925] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-06. [2025-09-16T19:37:46.719874] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-16T19:37:46.774851] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-07. [2025-09-16T19:37:47.574945] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-06. [2025-09-16T19:37:48.120809] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-16T19:37:48.324424] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-09-16T19:37:48.374859] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-07. [2025-09-16T19:37:48.955729] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-16T19:37:49.174896] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-08. [2025-09-16T19:37:49.974956] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-07. [2025-09-16T19:37:50.363105] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-16T19:37:50.549761] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-16T19:37:50.774911] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-09. [2025-09-16T19:37:51.389805] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-16T19:37:51.574916] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-08. [2025-09-16T19:37:51.953345] [INFO ] [REMOTE ] NIQ: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-16T19:37:51.958808] [INFO ] [REMOTE ] NIQ: Full fetch complete (13337 records). [2025-09-16T19:37:51.958897] [DEBUG] [VALIDATOR ] NIQ: Validating primary data. [2025-09-16T19:37:52.138650] [WARN ] [VALIDATOR ] NIQ: Validation failed - insufficient historical data. Have 39 unique days, need 150 days [2025-09-16T19:37:52.139014] [FATAL] [MAIN ] NIQ: Fetched primary data is invalid. Refusing to save it. [2025-09-16T19:37:52.139088] [WARN ] [MAIN ] NIQ: Deleting existing primary and derivative data due to validation failure. [2025-09-16T19:37:52.139150] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-09-16T19:37:52.139289] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-09-16T19:37:52.139335] [INFO ] [LOCAL ] NIQ: Starting deletion of derivative data. [2025-09-16T19:37:52.139386] [DEBUG] [LOCAL ] NIQ: No derivative data file found to delete. [2025-09-16T19:37:52.139449] [INFO ] [MAIN ] Update Progress: 1486/2369 symbols completed. NIQ took 21.8s. Estimated remaining: 1h 33m 47s. Rate: 9.4 symbols/min [2025-09-16T19:37:52.308100] [INFO ] [MAIN ] NKE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:37:52.308286] [DEBUG] [LOCAL ] NKE: No existing data file found in primary storage. [2025-09-16T19:37:52.308323] [WARN ] [MAIN ] NKE: No existing data found, performing full refresh instead. [2025-09-16T19:37:52.308485] [INFO ] [MAIN ] NKE: Wiping existing primary data before full refresh. [2025-09-16T19:37:52.308533] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-09-16T19:37:52.308575] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-09-16T19:37:52.308607] [INFO ] [MAIN ] NKE: Starting full primary refresh. [2025-09-16T19:37:52.380126] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-08. [2025-09-16T19:37:52.676020] [INFO ] [REMOTE ] NKE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:37:53.174904] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-02. [2025-09-16T19:37:53.868295] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-16T19:37:53.974867] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-09. [2025-09-16T19:37:54.124328] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-08 (2.55 seconds). [2025-09-16T19:37:54.774908] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-09. [2025-09-16T19:37:55.110575] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-16T19:37:55.115295] [INFO ] [REMOTE ] NJR: Full fetch complete (40850 records). [2025-09-16T19:37:55.115392] [DEBUG] [VALIDATOR ] NJR: Validating primary data. [2025-09-16T19:37:55.508864] [DEBUG] [VALIDATOR ] NJR: All expected trading days are present. [2025-09-16T19:37:55.508963] [DEBUG] [VALIDATOR ] NJR: Primary data validation passed. [2025-09-16T19:37:55.509996] [INFO ] [MAIN ] NJR: Fetched primary data is valid. [2025-09-16T19:37:55.510132] [DEBUG] [LOCAL ] NJR: Saving primary data. [2025-09-16T19:37:55.511352] [DEBUG] [LOCAL ] NJR: Trimmed 40850 records to 28028 (keeping 150 days of data) [2025-09-16T19:37:55.577970] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-09. [2025-09-16T19:37:55.639923] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-09-16T19:37:55.719947] [DEBUG] [LOCAL ] NJR: Primary data saved (28028 records). [2025-09-16T19:37:55.720093] [INFO ] [MAIN ] NJR: Full history saved. [2025-09-16T19:37:55.720179] [INFO ] [MAIN ] Update Progress: 1487/2369 symbols completed. NJR took 19.8s. Estimated remaining: 1h 33m 39s. Rate: 9.4 symbols/min [2025-09-16T19:37:55.886276] [INFO ] [MAIN ] NKX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:37:55.897614] [DEBUG] [LOCAL ] NKX: Loaded 10202 existing records from primary storage. [2025-09-16T19:37:55.897747] [INFO ] [MAIN ] NKX: Loaded 10202 existing records. [2025-09-16T19:37:56.075588] [WARN ] [MAIN ] NKX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:37:56.075896] [INFO ] [MAIN ] NKX: Wiping existing primary data before full refresh. [2025-09-16T19:37:56.075951] [INFO ] [LOCAL ] NKX: Starting deletion of primary data. [2025-09-16T19:37:56.076360] [DEBUG] [LOCAL ] NKX: Deleted primary data file. [2025-09-16T19:37:56.076404] [INFO ] [MAIN ] NKX: Starting full primary refresh. [2025-09-16T19:37:56.388351] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-03. [2025-09-16T19:37:56.425373] [INFO ] [REMOTE ] NKX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:37:56.628552] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-16T19:37:56.631468] [INFO ] [REMOTE ] NINE: Full fetch complete (31558 records). [2025-09-16T19:37:56.631544] [DEBUG] [VALIDATOR ] NINE: Validating primary data. [2025-09-16T19:37:57.010265] [DEBUG] [VALIDATOR ] NINE: All expected trading days are present. [2025-09-16T19:37:57.010354] [DEBUG] [VALIDATOR ] NINE: Primary data validation passed. [2025-09-16T19:37:57.011151] [INFO ] [MAIN ] NINE: Fetched primary data is valid. [2025-09-16T19:37:57.011206] [DEBUG] [LOCAL ] NINE: Saving primary data. [2025-09-16T19:37:57.012131] [DEBUG] [LOCAL ] NINE: Trimmed 31558 records to 21737 (keeping 150 days of data) [2025-09-16T19:37:57.140759] [DEBUG] [LOCAL ] NINE: Primary data saved (21737 records). [2025-09-16T19:37:57.140892] [INFO ] [MAIN ] NINE: Full history saved. [2025-09-16T19:37:57.140985] [INFO ] [MAIN ] Update Progress: 1488/2369 symbols completed. NINE took 31.3s. Estimated remaining: 1h 33m 29s. Rate: 9.4 symbols/min [2025-09-16T19:37:57.186863] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-02. [2025-09-16T19:37:57.322514] [INFO ] [MAIN ] NL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:37:57.322764] [DEBUG] [LOCAL ] NL: No existing data file found in primary storage. [2025-09-16T19:37:57.322877] [WARN ] [MAIN ] NL: No existing data found, performing full refresh instead. [2025-09-16T19:37:57.323245] [INFO ] [MAIN ] NL: Wiping existing primary data before full refresh. [2025-09-16T19:37:57.323490] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-09-16T19:37:57.323591] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-09-16T19:37:57.323662] [INFO ] [MAIN ] NL: Starting full primary refresh. [2025-09-16T19:37:57.443530] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-09 (2.67 seconds). [2025-09-16T19:37:57.463885] [INFO ] [REMOTE ] NIO: Full fetch complete (58482 records). [2025-09-16T19:37:57.479349] [DEBUG] [VALIDATOR ] NIO: Validating primary data. [2025-09-16T19:37:57.990756] [INFO ] [REMOTE ] NL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:37:58.002493] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-02. [2025-09-16T19:37:58.125810] [DEBUG] [VALIDATOR ] NIO: All expected trading days are present. [2025-09-16T19:37:58.131178] [DEBUG] [VALIDATOR ] NIO: Primary data validation passed. [2025-09-16T19:37:58.136336] [INFO ] [MAIN ] NIO: Fetched primary data is valid. [2025-09-16T19:37:58.136977] [DEBUG] [LOCAL ] NIO: Saving primary data. [2025-09-16T19:37:58.137407] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-16T19:37:58.142444] [DEBUG] [LOCAL ] NIO: Trimmed 58482 records to 40152 (keeping 150 days of data) [2025-09-16T19:37:58.373177] [DEBUG] [LOCAL ] NIO: Primary data saved (40152 records). [2025-09-16T19:37:58.373307] [INFO ] [MAIN ] NIO: Full history saved. [2025-09-16T19:37:58.374207] [INFO ] [MAIN ] Update Progress: 1489/2369 symbols completed. NIO took 29.2s. Estimated remaining: 1h 33m 20s. Rate: 9.4 symbols/min [2025-09-16T19:37:58.573946] [INFO ] [MAIN ] NLOP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:37:58.585054] [DEBUG] [LOCAL ] NLOP: Loaded 8370 existing records from primary storage. [2025-09-16T19:37:58.585190] [INFO ] [MAIN ] NLOP: Loaded 8370 existing records. [2025-09-16T19:37:58.702928] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-16T19:37:58.776964] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-03. [2025-09-16T19:37:58.776830] [WARN ] [MAIN ] NLOP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:37:58.777681] [INFO ] [MAIN ] NLOP: Wiping existing primary data before full refresh. [2025-09-16T19:37:58.779155] [INFO ] [LOCAL ] NLOP: Starting deletion of primary data. [2025-09-16T19:37:58.779553] [DEBUG] [LOCAL ] NLOP: Deleted primary data file. [2025-09-16T19:37:58.779679] [INFO ] [MAIN ] NLOP: Starting full primary refresh. [2025-09-16T19:37:59.175168] [INFO ] [REMOTE ] NLOP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:37:59.177468] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-03 (2.79 seconds). [2025-09-16T19:37:59.574939] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-04. [2025-09-16T19:37:59.749439] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-16T19:38:00.374941] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-02. [2025-09-16T19:38:01.174944] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-04. [2025-09-16T19:38:01.196525] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-16T19:38:01.974932] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-03. [2025-09-16T19:38:02.028551] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-16T19:38:02.254324] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-09-16T19:38:02.539355] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-16T19:38:02.774956] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-03. [2025-09-16T19:38:03.574994] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-05. [2025-09-16T19:38:03.593722] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-16T19:38:04.374948] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-04. [2025-09-16T19:38:04.449696] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-16T19:38:04.963609] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-16T19:38:05.174963] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-04. [2025-09-16T19:38:05.974929] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-06. [2025-09-16T19:38:06.201234] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-16T19:38:06.774919] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-05. [2025-09-16T19:38:07.038323] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-16T19:38:07.142821] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-16T19:38:07.574950] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-06. [2025-09-16T19:38:08.225804] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-16T19:38:08.374986] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-05. [2025-09-16T19:38:09.161747] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-16T19:38:09.174847] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-06. [2025-09-16T19:38:09.974920] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-07. [2025-09-16T19:38:10.021040] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-16T19:38:10.774904] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-07. [2025-09-16T19:38:10.965557] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-16T19:38:11.549334] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-16T19:38:11.574871] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-08. [2025-09-16T19:38:12.374897] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-05. [2025-09-16T19:38:12.505250] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-16T19:38:13.174906] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-08. [2025-09-16T19:38:13.974917] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-09. [2025-09-16T19:38:13.985724] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-16T19:38:14.774874] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-07. [2025-09-16T19:38:14.989828] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-05 (2.61 seconds). [2025-09-16T19:38:15.064185] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-16T19:38:15.066384] [INFO ] [REMOTE ] NLOP: Full fetch complete (12930 records). [2025-09-16T19:38:15.066465] [DEBUG] [VALIDATOR ] NLOP: Validating primary data. [2025-09-16T19:38:15.381499] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-16T19:38:15.454689] [DEBUG] [VALIDATOR ] NLOP: All expected trading days are present. [2025-09-16T19:38:15.454797] [DEBUG] [VALIDATOR ] NLOP: Primary data validation passed. [2025-09-16T19:38:15.455195] [INFO ] [MAIN ] NLOP: Fetched primary data is valid. [2025-09-16T19:38:15.455249] [DEBUG] [LOCAL ] NLOP: Saving primary data. [2025-09-16T19:38:15.455801] [DEBUG] [LOCAL ] NLOP: Trimmed 12930 records to 8444 (keeping 150 days of data) [2025-09-16T19:38:15.509238] [DEBUG] [LOCAL ] NLOP: Primary data saved (8444 records). [2025-09-16T19:38:15.509376] [INFO ] [MAIN ] NLOP: Full history saved. [2025-09-16T19:38:15.509487] [INFO ] [MAIN ] Update Progress: 1490/2369 symbols completed. NLOP took 17.1s. Estimated remaining: 1h 33m 20s. Rate: 9.4 symbols/min [2025-09-16T19:38:15.580102] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-06. [2025-09-16T19:38:15.679227] [INFO ] [MAIN ] NLY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:38:15.723386] [DEBUG] [LOCAL ] NLY: Loaded 39550 existing records from primary storage. [2025-09-16T19:38:15.723557] [INFO ] [MAIN ] NLY: Loaded 39550 existing records. [2025-09-16T19:38:15.899067] [WARN ] [MAIN ] NLY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:38:15.899312] [INFO ] [MAIN ] NLY: Wiping existing primary data before full refresh. [2025-09-16T19:38:15.899361] [INFO ] [LOCAL ] NLY: Starting deletion of primary data. [2025-09-16T19:38:15.900265] [DEBUG] [LOCAL ] NLY: Deleted primary data file. [2025-09-16T19:38:15.900314] [INFO ] [MAIN ] NLY: Starting full primary refresh. [2025-09-16T19:38:16.254211] [INFO ] [REMOTE ] NLY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:38:16.374902] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-09. [2025-09-16T19:38:17.153754] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-16T19:38:17.156068] [INFO ] [REMOTE ] NKX: Full fetch complete (14687 records). [2025-09-16T19:38:17.156148] [DEBUG] [VALIDATOR ] NKX: Validating primary data. [2025-09-16T19:38:17.187058] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-02. [2025-09-16T19:38:17.518089] [DEBUG] [VALIDATOR ] NKX: All expected trading days are present. [2025-09-16T19:38:17.518196] [DEBUG] [VALIDATOR ] NKX: Primary data validation passed. [2025-09-16T19:38:17.518575] [INFO ] [MAIN ] NKX: Fetched primary data is valid. [2025-09-16T19:38:17.518616] [DEBUG] [LOCAL ] NKX: Saving primary data. [2025-09-16T19:38:17.519138] [DEBUG] [LOCAL ] NKX: Trimmed 14687 records to 10327 (keeping 150 days of data) [2025-09-16T19:38:17.585186] [DEBUG] [LOCAL ] NKX: Primary data saved (10327 records). [2025-09-16T19:38:17.585337] [INFO ] [MAIN ] NKX: Full history saved. [2025-09-16T19:38:17.585448] [INFO ] [MAIN ] Update Progress: 1491/2369 symbols completed. NKX took 21.9s. Estimated remaining: 1h 33m 11s. Rate: 9.4 symbols/min [2025-09-16T19:38:17.753508] [INFO ] [MAIN ] NMAI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:38:17.764582] [DEBUG] [LOCAL ] NMAI: Loaded 9248 existing records from primary storage. [2025-09-16T19:38:17.764732] [INFO ] [MAIN ] NMAI: Loaded 9248 existing records. [2025-09-16T19:38:17.940333] [WARN ] [MAIN ] NMAI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:38:17.940605] [INFO ] [MAIN ] NMAI: Wiping existing primary data before full refresh. [2025-09-16T19:38:17.940883] [INFO ] [LOCAL ] NMAI: Starting deletion of primary data. [2025-09-16T19:38:17.941249] [DEBUG] [LOCAL ] NMAI: Deleted primary data file. [2025-09-16T19:38:17.941350] [INFO ] [MAIN ] NMAI: Starting full primary refresh. [2025-09-16T19:38:17.984212] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-08. [2025-09-16T19:38:18.306506] [INFO ] [REMOTE ] NMAI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:38:18.336780] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-06 (2.76 seconds). [2025-09-16T19:38:18.765772] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-16T19:38:18.774849] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-09. [2025-09-16T19:38:19.033229] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-16T19:38:19.336318] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-16T19:38:19.337361] [INFO ] [REMOTE ] NL: Full fetch complete (5215 records). [2025-09-16T19:38:19.337429] [DEBUG] [VALIDATOR ] NL: Validating primary data. [2025-09-16T19:38:19.516049] [WARN ] [VALIDATOR ] NL: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-16T19:38:19.516269] [FATAL] [MAIN ] NL: Fetched primary data is invalid. Refusing to save it. [2025-09-16T19:38:19.516320] [WARN ] [MAIN ] NL: Deleting existing primary and derivative data due to validation failure. [2025-09-16T19:38:19.516365] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-09-16T19:38:19.516422] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-09-16T19:38:19.516497] [INFO ] [LOCAL ] NL: Starting deletion of derivative data. [2025-09-16T19:38:19.516542] [DEBUG] [LOCAL ] NL: No derivative data file found to delete. [2025-09-16T19:38:19.516601] [INFO ] [MAIN ] Update Progress: 1492/2369 symbols completed. NL took 22.4s. Estimated remaining: 1h 33m 2s. Rate: 9.4 symbols/min [2025-09-16T19:38:19.579967] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-07. [2025-09-16T19:38:19.687194] [INFO ] [MAIN ] NMAX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:38:19.687347] [DEBUG] [LOCAL ] NMAX: No existing data file found in primary storage. [2025-09-16T19:38:19.687383] [WARN ] [MAIN ] NMAX: No existing data found, performing full refresh instead. [2025-09-16T19:38:19.687502] [INFO ] [MAIN ] NMAX: Wiping existing primary data before full refresh. [2025-09-16T19:38:19.687540] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-09-16T19:38:19.687581] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-09-16T19:38:19.687631] [INFO ] [MAIN ] NMAX: Starting full primary refresh. [2025-09-16T19:38:20.044519] [INFO ] [REMOTE ] NMAX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:38:20.374934] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-03. [2025-09-16T19:38:21.174912] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-02. [2025-09-16T19:38:21.365752] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:38:21.366106] [WARN ] [REMOTE ] NMAX: No data returned for month 2025-02 [2025-09-16T19:38:21.974905] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-02. [2025-09-16T19:38:22.269466] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-16T19:38:22.399900] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-07 (2.82 seconds). [2025-09-16T19:38:22.774943] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-08. [2025-09-16T19:38:22.902677] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-16T19:38:23.574927] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-03. [2025-09-16T19:38:24.374900] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-04. [2025-09-16T19:38:24.522983] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-16T19:38:25.113775] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-16T19:38:25.174866] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-09. [2025-09-16T19:38:25.974899] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-03. [2025-09-16T19:38:26.066764] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-16T19:38:26.357290] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-16T19:38:26.774911] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-04. [2025-09-16T19:38:27.033846] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-16T19:38:27.039711] [INFO ] [REMOTE ] NKE: Full fetch complete (57717 records). [2025-09-16T19:38:27.039817] [DEBUG] [VALIDATOR ] NKE: Validating primary data. [2025-09-16T19:38:27.231242] [WARN ] [VALIDATOR ] NKE: Validation failed - insufficient historical data. Have 148 unique days, need 150 days [2025-09-16T19:38:27.231940] [FATAL] [MAIN ] NKE: Fetched primary data is invalid. Refusing to save it. [2025-09-16T19:38:27.231998] [WARN ] [MAIN ] NKE: Deleting existing primary and derivative data due to validation failure. [2025-09-16T19:38:27.232056] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-09-16T19:38:27.232124] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-09-16T19:38:27.232161] [INFO ] [LOCAL ] NKE: Starting deletion of derivative data. [2025-09-16T19:38:27.232201] [DEBUG] [LOCAL ] NKE: No derivative data file found to delete. [2025-09-16T19:38:27.232286] [INFO ] [MAIN ] Update Progress: 1493/2369 symbols completed. NKE took 35.1s. Estimated remaining: 1h 32m 56s. Rate: 9.4 symbols/min [2025-09-16T19:38:27.406139] [INFO ] [MAIN ] NMCO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:38:27.419116] [DEBUG] [LOCAL ] NMCO: Loaded 12266 existing records from primary storage. [2025-09-16T19:38:27.419244] [INFO ] [MAIN ] NMCO: Loaded 12266 existing records. [2025-09-16T19:38:27.588092] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-04. [2025-09-16T19:38:27.593427] [WARN ] [MAIN ] NMCO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:38:27.593671] [INFO ] [MAIN ] NMCO: Wiping existing primary data before full refresh. [2025-09-16T19:38:27.593726] [INFO ] [LOCAL ] NMCO: Starting deletion of primary data. [2025-09-16T19:38:27.594188] [DEBUG] [LOCAL ] NMCO: Deleted primary data file. [2025-09-16T19:38:27.594297] [INFO ] [MAIN ] NMCO: Starting full primary refresh. [2025-09-16T19:38:27.945182] [INFO ] [REMOTE ] NMCO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:38:28.374917] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-02. [2025-09-16T19:38:28.515548] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-16T19:38:29.051856] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-16T19:38:29.134419] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-16T19:38:29.174892] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-05. [2025-09-16T19:38:29.974898] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-03. [2025-09-16T19:38:30.728264] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-16T19:38:30.771318] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-16T19:38:30.774836] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-04. [2025-09-16T19:38:31.574871] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-05. [2025-09-16T19:38:31.891256] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-16T19:38:32.374900] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-05. [2025-09-16T19:38:33.174869] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-05. [2025-09-16T19:38:33.352514] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-16T19:38:33.556793] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-16T19:38:33.952376] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-16T19:38:33.974857] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-06. [2025-09-16T19:38:34.662240] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-16T19:38:34.774946] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-07. [2025-09-16T19:38:35.574880] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-06. [2025-09-16T19:38:35.778176] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-16T19:38:36.374900] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-08. [2025-09-16T19:38:36.503475] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-16T19:38:37.174912] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-07. [2025-09-16T19:38:37.268419] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-16T19:38:37.878478] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-16T19:38:37.974873] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-08. [2025-09-16T19:38:38.774927] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-06. [2025-09-16T19:38:38.940043] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-16T19:38:39.574950] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-09. [2025-09-16T19:38:40.374864] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-09. [2025-09-16T19:38:40.651266] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-16T19:38:40.667478] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-16T19:38:40.670086] [INFO ] [REMOTE ] NMCO: Full fetch complete (17493 records). [2025-09-16T19:38:40.670160] [DEBUG] [VALIDATOR ] NMCO: Validating primary data. [2025-09-16T19:38:41.035175] [DEBUG] [VALIDATOR ] NMCO: All expected trading days are present. [2025-09-16T19:38:41.035254] [DEBUG] [VALIDATOR ] NMCO: Primary data validation passed. [2025-09-16T19:38:41.035631] [INFO ] [MAIN ] NMCO: Fetched primary data is valid. [2025-09-16T19:38:41.035696] [DEBUG] [LOCAL ] NMCO: Saving primary data. [2025-09-16T19:38:41.036244] [DEBUG] [LOCAL ] NMCO: Trimmed 17493 records to 12358 (keeping 150 days of data) [2025-09-16T19:38:41.112338] [DEBUG] [LOCAL ] NMCO: Primary data saved (12358 records). [2025-09-16T19:38:41.112475] [INFO ] [MAIN ] NMCO: Full history saved. [2025-09-16T19:38:41.112570] [INFO ] [MAIN ] Update Progress: 1494/2369 symbols completed. NMCO took 13.9s. Estimated remaining: 1h 32m 54s. Rate: 9.4 symbols/min [2025-09-16T19:38:41.180062] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-06. [2025-09-16T19:38:41.291977] [INFO ] [MAIN ] NMG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:38:41.300505] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-16T19:38:41.302919] [INFO ] [REMOTE ] NMAI: Full fetch complete (14369 records). [2025-09-16T19:38:41.303027] [DEBUG] [VALIDATOR ] NMAI: Validating primary data. [2025-09-16T19:38:41.305854] [DEBUG] [LOCAL ] NMG: Loaded 5659 existing records from primary storage. [2025-09-16T19:38:41.375358] [INFO ] [MAIN ] NMG: Loaded 5659 existing records. [2025-09-16T19:38:41.784188] [WARN ] [MAIN ] NMG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:38:41.795344] [INFO ] [MAIN ] NMG: Wiping existing primary data before full refresh. [2025-09-16T19:38:41.810752] [INFO ] [LOCAL ] NMG: Starting deletion of primary data. [2025-09-16T19:38:41.842398] [DEBUG] [LOCAL ] NMG: Deleted primary data file. [2025-09-16T19:38:41.865031] [INFO ] [MAIN ] NMG: Starting full primary refresh. [2025-09-16T19:38:41.865199] [DEBUG] [VALIDATOR ] NMAI: All expected trading days are present. [2025-09-16T19:38:41.865284] [DEBUG] [VALIDATOR ] NMAI: Primary data validation passed. [2025-09-16T19:38:41.889543] [INFO ] [MAIN ] NMAI: Fetched primary data is valid. [2025-09-16T19:38:41.916714] [DEBUG] [LOCAL ] NMAI: Saving primary data. [2025-09-16T19:38:41.979550] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-07. [2025-09-16T19:38:41.992320] [DEBUG] [LOCAL ] NMAI: Trimmed 14369 records to 9353 (keeping 150 days of data) [2025-09-16T19:38:42.303709] [INFO ] [REMOTE ] NMG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:38:42.314317] [DEBUG] [LOCAL ] NMAI: Primary data saved (9353 records). [2025-09-16T19:38:42.314402] [INFO ] [MAIN ] NMAI: Full history saved. [2025-09-16T19:38:42.314510] [INFO ] [MAIN ] Update Progress: 1495/2369 symbols completed. NMAI took 24.7s. Estimated remaining: 1h 32m 45s. Rate: 9.4 symbols/min [2025-09-16T19:38:42.483519] [INFO ] [MAIN ] NMI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:38:42.488530] [DEBUG] [LOCAL ] NMI: Loaded 3338 existing records from primary storage. [2025-09-16T19:38:42.488634] [INFO ] [MAIN ] NMI: Loaded 3338 existing records. [2025-09-16T19:38:42.665449] [WARN ] [MAIN ] NMI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:38:42.665710] [INFO ] [MAIN ] NMI: Wiping existing primary data before full refresh. [2025-09-16T19:38:42.665758] [INFO ] [LOCAL ] NMI: Starting deletion of primary data. [2025-09-16T19:38:42.665994] [DEBUG] [LOCAL ] NMI: Deleted primary data file. [2025-09-16T19:38:42.666037] [INFO ] [MAIN ] NMI: Starting full primary refresh. [2025-09-16T19:38:42.780056] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-02. [2025-09-16T19:38:43.026601] [INFO ] [REMOTE ] NMI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:38:43.121689] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-16T19:38:43.250601] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-16T19:38:43.511045] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-16T19:38:43.574934] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-03. [2025-09-16T19:38:44.179221] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-16T19:38:44.374960] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-08. [2025-09-16T19:38:45.174906] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-07. [2025-09-16T19:38:45.974905] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-04. [2025-09-16T19:38:46.125668] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-16T19:38:46.398488] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-16T19:38:46.774871] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-09. [2025-09-16T19:38:46.936837] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-16T19:38:47.574941] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-08. [2025-09-16T19:38:48.380881] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-05. [2025-09-16T19:38:48.383573] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-16T19:38:48.389303] [INFO ] [REMOTE ] NMAX: Full fetch complete (38469 records). [2025-09-16T19:38:48.389450] [DEBUG] [VALIDATOR ] NMAX: Validating primary data. [2025-09-16T19:38:48.586351] [WARN ] [VALIDATOR ] NMAX: Validation failed - insufficient historical data. Have 117 unique days, need 150 days [2025-09-16T19:38:48.586918] [FATAL] [MAIN ] NMAX: Fetched primary data is invalid. Refusing to save it. [2025-09-16T19:38:48.587010] [WARN ] [MAIN ] NMAX: Deleting existing primary and derivative data due to validation failure. [2025-09-16T19:38:48.587081] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-09-16T19:38:48.587170] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-09-16T19:38:48.587210] [INFO ] [LOCAL ] NMAX: Starting deletion of derivative data. [2025-09-16T19:38:48.587249] [DEBUG] [LOCAL ] NMAX: No derivative data file found to delete. [2025-09-16T19:38:48.587337] [INFO ] [MAIN ] Update Progress: 1496/2369 symbols completed. NMAX took 29.1s. Estimated remaining: 1h 32m 39s. Rate: 9.4 symbols/min [2025-09-16T19:38:48.755181] [INFO ] [MAIN ] NMM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:38:48.767846] [DEBUG] [LOCAL ] NMM: Loaded 9879 existing records from primary storage. [2025-09-16T19:38:48.767961] [INFO ] [MAIN ] NMM: Loaded 9879 existing records. [2025-09-16T19:38:48.942176] [WARN ] [MAIN ] NMM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:38:48.942421] [INFO ] [MAIN ] NMM: Wiping existing primary data before full refresh. [2025-09-16T19:38:48.942472] [INFO ] [LOCAL ] NMM: Starting deletion of primary data. [2025-09-16T19:38:48.942861] [DEBUG] [LOCAL ] NMM: Deleted primary data file. [2025-09-16T19:38:48.942909] [INFO ] [MAIN ] NMM: Starting full primary refresh. [2025-09-16T19:38:49.175595] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-02. [2025-09-16T19:38:49.163561] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-16T19:38:49.315982] [INFO ] [REMOTE ] NMM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:38:49.389829] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-16T19:38:49.974880] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-02. [2025-09-16T19:38:50.087913] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-16T19:38:50.774950] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-03. [2025-09-16T19:38:51.231213] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-16T19:38:51.297062] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-16T19:38:51.574899] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-06. [2025-09-16T19:38:52.084061] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-16T19:38:52.374914] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-04. [2025-09-16T19:38:52.937071] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-16T19:38:53.174955] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-09. [2025-09-16T19:38:53.974909] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-07. [2025-09-16T19:38:54.774897] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-03. [2025-09-16T19:38:54.844858] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-16T19:38:55.019736] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-16T19:38:55.027724] [INFO ] [REMOTE ] NLY: Full fetch complete (58251 records). [2025-09-16T19:38:55.027898] [DEBUG] [VALIDATOR ] NLY: Validating primary data. [2025-09-16T19:38:55.424212] [DEBUG] [VALIDATOR ] NLY: All expected trading days are present. [2025-09-16T19:38:55.424110] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-16T19:38:55.424405] [DEBUG] [VALIDATOR ] NLY: Primary data validation passed. [2025-09-16T19:38:55.428309] [INFO ] [MAIN ] NLY: Fetched primary data is valid. [2025-09-16T19:38:55.429002] [DEBUG] [LOCAL ] NLY: Saving primary data. [2025-09-16T19:38:55.430863] [DEBUG] [LOCAL ] NLY: Trimmed 58251 records to 39940 (keeping 150 days of data) [2025-09-16T19:38:55.614272] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-04. [2025-09-16T19:38:55.682149] [DEBUG] [LOCAL ] NLY: Primary data saved (39940 records). [2025-09-16T19:38:55.682292] [INFO ] [MAIN ] NLY: Full history saved. [2025-09-16T19:38:55.683034] [INFO ] [MAIN ] Update Progress: 1497/2369 symbols completed. NLY took 40.2s. Estimated remaining: 1h 32m 33s. Rate: 9.4 symbols/min [2025-09-16T19:38:55.851938] [INFO ] [MAIN ] NMR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:38:55.877486] [DEBUG] [LOCAL ] NMR: Loaded 25248 existing records from primary storage. [2025-09-16T19:38:55.877614] [INFO ] [MAIN ] NMR: Loaded 25248 existing records. [2025-09-16T19:38:56.054977] [WARN ] [MAIN ] NMR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:38:56.055250] [INFO ] [MAIN ] NMR: Wiping existing primary data before full refresh. [2025-09-16T19:38:56.055305] [INFO ] [LOCAL ] NMR: Starting deletion of primary data. [2025-09-16T19:38:56.056078] [DEBUG] [LOCAL ] NMR: Deleted primary data file. [2025-09-16T19:38:56.056127] [INFO ] [MAIN ] NMR: Starting full primary refresh. [2025-09-16T19:38:56.375142] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-08. [2025-09-16T19:38:56.441300] [INFO ] [REMOTE ] NMR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:38:56.547312] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-16T19:38:57.152044] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-16T19:38:57.174855] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-09. [2025-09-16T19:38:57.974910] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-02. [2025-09-16T19:38:58.202731] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-16T19:38:58.204077] [INFO ] [REMOTE ] NMG: Full fetch complete (7997 records). [2025-09-16T19:38:58.204145] [DEBUG] [VALIDATOR ] NMG: Validating primary data. [2025-09-16T19:38:58.619413] [DEBUG] [VALIDATOR ] NMG: All expected trading days are present. [2025-09-16T19:38:58.619544] [DEBUG] [VALIDATOR ] NMG: Primary data validation passed. [2025-09-16T19:38:58.620059] [INFO ] [MAIN ] NMG: Fetched primary data is valid. [2025-09-16T19:38:58.620142] [DEBUG] [LOCAL ] NMG: Saving primary data. [2025-09-16T19:38:58.621009] [DEBUG] [LOCAL ] NMG: Trimmed 7997 records to 5702 (keeping 150 days of data) [2025-09-16T19:38:58.680979] [DEBUG] [LOCAL ] NMG: Primary data saved (5702 records). [2025-09-16T19:38:58.681196] [INFO ] [MAIN ] NMG: Full history saved. [2025-09-16T19:38:58.681318] [INFO ] [MAIN ] Update Progress: 1498/2369 symbols completed. NMG took 17.6s. Estimated remaining: 1h 32m 24s. Rate: 9.4 symbols/min [2025-09-16T19:38:58.780297] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-05. [2025-09-16T19:38:58.963547] [INFO ] [MAIN ] NMS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:38:58.969749] [DEBUG] [LOCAL ] NMS: Loaded 2278 existing records from primary storage. [2025-09-16T19:38:58.969918] [INFO ] [MAIN ] NMS: Loaded 2278 existing records. [2025-09-16T19:38:59.234634] [WARN ] [MAIN ] NMS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:38:59.235146] [INFO ] [MAIN ] NMS: Wiping existing primary data before full refresh. [2025-09-16T19:38:59.235221] [INFO ] [LOCAL ] NMS: Starting deletion of primary data. [2025-09-16T19:38:59.235523] [DEBUG] [LOCAL ] NMS: Deleted primary data file. [2025-09-16T19:38:59.235600] [INFO ] [MAIN ] NMS: Starting full primary refresh. [2025-09-16T19:38:59.424267] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-16T19:38:59.579979] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-06. [2025-09-16T19:38:59.710136] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-16T19:38:59.812196] [INFO ] [REMOTE ] NMS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:39:00.120943] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-16T19:39:00.374943] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-03. [2025-09-16T19:39:01.174903] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-02. [2025-09-16T19:39:01.746011] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-16T19:39:01.831709] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-16T19:39:01.974935] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-04. [2025-09-16T19:39:02.774928] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-05. [2025-09-16T19:39:03.453849] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-16T19:39:03.543008] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-16T19:39:03.574856] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-05. [2025-09-16T19:39:04.374903] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-03. [2025-09-16T19:39:04.913313] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-16T19:39:04.937324] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-16T19:39:05.174907] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-04. [2025-09-16T19:39:05.679418] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-16T19:39:05.974903] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-07. [2025-09-16T19:39:06.498369] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-16T19:39:06.774914] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-06. [2025-09-16T19:39:07.574917] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-05. [2025-09-16T19:39:07.803081] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-16T19:39:08.127282] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-16T19:39:08.374910] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-06. [2025-09-16T19:39:09.029757] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-16T19:39:09.174924] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-07. [2025-09-16T19:39:09.974920] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-06. [2025-09-16T19:39:10.631213] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-16T19:39:10.774887] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-08. [2025-09-16T19:39:10.839708] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-16T19:39:11.574941] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-07. [2025-09-16T19:39:12.022009] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-16T19:39:12.078317] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-16T19:39:12.374913] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-08. [2025-09-16T19:39:13.042262] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-16T19:39:13.174908] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-09. [2025-09-16T19:39:13.974933] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-09. [2025-09-16T19:39:14.476868] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-16T19:39:14.483243] [INFO ] [REMOTE ] NMR: Full fetch complete (38057 records). [2025-09-16T19:39:14.483447] [DEBUG] [VALIDATOR ] NMR: Validating primary data. [2025-09-16T19:39:14.775201] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-07. [2025-09-16T19:39:14.812332] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-16T19:39:14.818438] [INFO ] [REMOTE ] NMI: Full fetch complete (4475 records). [2025-09-16T19:39:14.828988] [DEBUG] [VALIDATOR ] NMI: Validating primary data. [2025-09-16T19:39:14.984710] [DEBUG] [VALIDATOR ] NMR: All expected trading days are present. [2025-09-16T19:39:15.011820] [DEBUG] [VALIDATOR ] NMR: Primary data validation passed. [2025-09-16T19:39:15.012760] [INFO ] [MAIN ] NMR: Fetched primary data is valid. [2025-09-16T19:39:15.013080] [DEBUG] [LOCAL ] NMR: Saving primary data. [2025-09-16T19:39:15.093194] [DEBUG] [LOCAL ] NMR: Trimmed 38057 records to 25500 (keeping 150 days of data) [2025-09-16T19:39:15.364774] [DEBUG] [VALIDATOR ] NMI: All expected trading days are present. [2025-09-16T19:39:15.365418] [DEBUG] [VALIDATOR ] NMI: Primary data validation passed. [2025-09-16T19:39:15.365621] [INFO ] [MAIN ] NMI: Fetched primary data is valid. [2025-09-16T19:39:15.366598] [DEBUG] [LOCAL ] NMI: Saving primary data. [2025-09-16T19:39:15.369567] [DEBUG] [LOCAL ] NMI: Trimmed 4475 records to 3398 (keeping 150 days of data) [2025-09-16T19:39:15.393375] [DEBUG] [LOCAL ] NMI: Primary data saved (3398 records). [2025-09-16T19:39:15.395301] [INFO ] [MAIN ] NMI: Full history saved. [2025-09-16T19:39:15.396089] [INFO ] [MAIN ] Update Progress: 1499/2369 symbols completed. NMI took 33.1s. Estimated remaining: 1h 32m 24s. Rate: 9.4 symbols/min [2025-09-16T19:39:15.579615] [INFO ] [MAIN ] NMT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:39:15.576498] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-08. [2025-09-16T19:39:15.603299] [DEBUG] [LOCAL ] NMT: Loaded 2149 existing records from primary storage. [2025-09-16T19:39:15.604359] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-16T19:39:15.605183] [INFO ] [MAIN ] NMT: Loaded 2149 existing records. [2025-09-16T19:39:15.836185] [WARN ] [MAIN ] NMT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:39:15.839578] [INFO ] [MAIN ] NMT: Wiping existing primary data before full refresh. [2025-09-16T19:39:15.840596] [INFO ] [LOCAL ] NMT: Starting deletion of primary data. [2025-09-16T19:39:15.842351] [DEBUG] [LOCAL ] NMT: Deleted primary data file. [2025-09-16T19:39:15.843055] [INFO ] [MAIN ] NMT: Starting full primary refresh. [2025-09-16T19:39:15.946600] [DEBUG] [LOCAL ] NMR: Primary data saved (25500 records). [2025-09-16T19:39:15.949581] [INFO ] [MAIN ] NMR: Full history saved. [2025-09-16T19:39:15.976349] [INFO ] [MAIN ] Update Progress: 1500/2369 symbols completed. NMR took 20.3s. Estimated remaining: 1h 32m 14s. Rate: 9.4 symbols/min [2025-09-16T19:39:16.170460] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-16T19:39:16.380410] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-09. [2025-09-16T19:39:16.422064] [INFO ] [MAIN ] NMZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:39:16.426167] [INFO ] [REMOTE ] NMT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:39:16.444211] [DEBUG] [LOCAL ] NMZ: Loaded 15373 existing records from primary storage. [2025-09-16T19:39:16.444388] [INFO ] [MAIN ] NMZ: Loaded 15373 existing records. [2025-09-16T19:39:16.628849] [WARN ] [MAIN ] NMZ: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:39:16.629123] [INFO ] [MAIN ] NMZ: Wiping existing primary data before full refresh. [2025-09-16T19:39:16.629172] [INFO ] [LOCAL ] NMZ: Starting deletion of primary data. [2025-09-16T19:39:16.629744] [DEBUG] [LOCAL ] NMZ: Deleted primary data file. [2025-09-16T19:39:16.629798] [INFO ] [MAIN ] NMZ: Starting full primary refresh. [2025-09-16T19:39:16.970970] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-16T19:39:16.990665] [INFO ] [REMOTE ] NMZ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:39:16.992696] [INFO ] [REMOTE ] NMS: Full fetch complete (3149 records). [2025-09-16T19:39:16.993272] [DEBUG] [VALIDATOR ] NMS: Validating primary data. [2025-09-16T19:39:17.178442] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-02. [2025-09-16T19:39:17.394231] [DEBUG] [VALIDATOR ] NMS: All expected trading days are present. [2025-09-16T19:39:17.394344] [DEBUG] [VALIDATOR ] NMS: Primary data validation passed. [2025-09-16T19:39:17.394511] [INFO ] [MAIN ] NMS: Fetched primary data is valid. [2025-09-16T19:39:17.394554] [DEBUG] [LOCAL ] NMS: Saving primary data. [2025-09-16T19:39:17.395116] [DEBUG] [LOCAL ] NMS: Trimmed 3149 records to 2310 (keeping 150 days of data) [2025-09-16T19:39:17.411057] [DEBUG] [LOCAL ] NMS: Primary data saved (2310 records). [2025-09-16T19:39:17.411243] [INFO ] [MAIN ] NMS: Full history saved. [2025-09-16T19:39:17.411358] [INFO ] [MAIN ] Update Progress: 1501/2369 symbols completed. NMS took 18.7s. Estimated remaining: 1h 32m 5s. Rate: 9.4 symbols/min [2025-09-16T19:39:17.608882] [INFO ] [MAIN ] NNI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:39:17.609149] [DEBUG] [LOCAL ] NNI: No existing data file found in primary storage. [2025-09-16T19:39:17.609189] [WARN ] [MAIN ] NNI: No existing data found, performing full refresh instead. [2025-09-16T19:39:17.609328] [INFO ] [MAIN ] NNI: Wiping existing primary data before full refresh. [2025-09-16T19:39:17.609372] [INFO ] [LOCAL ] NNI: Starting deletion of primary data. [2025-09-16T19:39:17.609414] [DEBUG] [LOCAL ] NNI: No primary data file found to delete. [2025-09-16T19:39:17.609451] [INFO ] [MAIN ] NNI: Starting full primary refresh. [2025-09-16T19:39:17.981502] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-08. [2025-09-16T19:39:17.987662] [INFO ] [REMOTE ] NNI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:39:18.549170] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-16T19:39:18.774904] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-02. [2025-09-16T19:39:18.898389] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-16T19:39:19.437799] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-16T19:39:19.574895] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-03. [2025-09-16T19:39:20.215787] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-16T19:39:20.374907] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-03. [2025-09-16T19:39:21.174881] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-04. [2025-09-16T19:39:21.430440] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-16T19:39:21.974908] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-04. [2025-09-16T19:39:22.013367] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-16T19:39:22.774913] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-05. [2025-09-16T19:39:23.028454] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-16T19:39:23.574913] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-09. [2025-09-16T19:39:23.606167] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-16T19:39:24.374908] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-05. [2025-09-16T19:39:24.533265] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-16T19:39:24.535412] [INFO ] [REMOTE ] NMM: Full fetch complete (15899 records). [2025-09-16T19:39:24.535481] [DEBUG] [VALIDATOR ] NMM: Validating primary data. [2025-09-16T19:39:24.900203] [DEBUG] [VALIDATOR ] NMM: All expected trading days are present. [2025-09-16T19:39:24.900286] [DEBUG] [VALIDATOR ] NMM: Primary data validation passed. [2025-09-16T19:39:24.900630] [INFO ] [MAIN ] NMM: Fetched primary data is valid. [2025-09-16T19:39:24.900690] [DEBUG] [LOCAL ] NMM: Saving primary data. [2025-09-16T19:39:24.901185] [DEBUG] [LOCAL ] NMM: Trimmed 15899 records to 9943 (keeping 150 days of data) [2025-09-16T19:39:24.964146] [DEBUG] [LOCAL ] NMM: Primary data saved (9943 records). [2025-09-16T19:39:24.964282] [INFO ] [MAIN ] NMM: Full history saved. [2025-09-16T19:39:24.964369] [INFO ] [MAIN ] Update Progress: 1502/2369 symbols completed. NMM took 36.4s. Estimated remaining: 1h 31m 59s. Rate: 9.4 symbols/min [2025-09-16T19:39:25.136253] [INFO ] [MAIN ] NNN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:39:25.177048] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-02. [2025-09-16T19:39:25.177765] [DEBUG] [LOCAL ] NNN: Loaded 35485 existing records from primary storage. [2025-09-16T19:39:25.178738] [INFO ] [MAIN ] NNN: Loaded 35485 existing records. [2025-09-16T19:39:25.360877] [WARN ] [MAIN ] NNN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:39:25.361110] [INFO ] [MAIN ] NNN: Wiping existing primary data before full refresh. [2025-09-16T19:39:25.361156] [INFO ] [LOCAL ] NNN: Starting deletion of primary data. [2025-09-16T19:39:25.362090] [DEBUG] [LOCAL ] NNN: Deleted primary data file. [2025-09-16T19:39:25.362142] [INFO ] [MAIN ] NNN: Starting full primary refresh. [2025-09-16T19:39:25.717228] [INFO ] [REMOTE ] NNN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:39:25.728499] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-16T19:39:25.974876] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-06. [2025-09-16T19:39:26.001258] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-16T19:39:26.771490] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-16T19:39:26.774833] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-07. [2025-09-16T19:39:27.555997] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-16T19:39:27.574861] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-08. [2025-09-16T19:39:28.375714] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-16T19:39:28.374867] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-06. [2025-09-16T19:39:29.174877] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-09. [2025-09-16T19:39:29.462283] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-16T19:39:29.974897] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-07. [2025-09-16T19:39:30.070533] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-16T19:39:30.072442] [INFO ] [REMOTE ] NNI: Full fetch complete (10219 records). [2025-09-16T19:39:30.072512] [DEBUG] [VALIDATOR ] NNI: Validating primary data. [2025-09-16T19:39:30.451073] [DEBUG] [VALIDATOR ] NNI: All expected trading days are present. [2025-09-16T19:39:30.451159] [DEBUG] [VALIDATOR ] NNI: Primary data validation passed. [2025-09-16T19:39:30.451425] [INFO ] [MAIN ] NNI: Fetched primary data is valid. [2025-09-16T19:39:30.451466] [DEBUG] [LOCAL ] NNI: Saving primary data. [2025-09-16T19:39:30.451938] [DEBUG] [LOCAL ] NNI: Trimmed 10219 records to 8009 (keeping 150 days of data) [2025-09-16T19:39:30.504506] [DEBUG] [LOCAL ] NNI: Primary data saved (8009 records). [2025-09-16T19:39:30.504657] [INFO ] [MAIN ] NNI: Full history saved. [2025-09-16T19:39:30.504737] [INFO ] [MAIN ] Update Progress: 1503/2369 symbols completed. NNI took 13.1s. Estimated remaining: 1h 31m 53s. Rate: 9.4 symbols/min [2025-09-16T19:39:30.686237] [INFO ] [MAIN ] NNY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:39:30.692360] [DEBUG] [LOCAL ] NNY: Loaded 4225 existing records from primary storage. [2025-09-16T19:39:30.692465] [INFO ] [MAIN ] NNY: Loaded 4225 existing records. [2025-09-16T19:39:30.779981] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-02. [2025-09-16T19:39:30.879803] [WARN ] [MAIN ] NNY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:39:30.880284] [INFO ] [MAIN ] NNY: Wiping existing primary data before full refresh. [2025-09-16T19:39:30.880334] [INFO ] [LOCAL ] NNY: Starting deletion of primary data. [2025-09-16T19:39:30.880564] [DEBUG] [LOCAL ] NNY: Deleted primary data file. [2025-09-16T19:39:30.880607] [INFO ] [MAIN ] NNY: Starting full primary refresh. [2025-09-16T19:39:31.271449] [INFO ] [REMOTE ] NNY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:39:31.272858] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-16T19:39:31.574900] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-08. [2025-09-16T19:39:32.192847] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-16T19:39:32.374899] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-03. [2025-09-16T19:39:32.655049] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-16T19:39:33.174904] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-09. [2025-09-16T19:39:33.974899] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-02. [2025-09-16T19:39:34.032462] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-16T19:39:34.079788] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-16T19:39:34.082960] [INFO ] [REMOTE ] NMZ: Full fetch complete (23319 records). [2025-09-16T19:39:34.083038] [DEBUG] [VALIDATOR ] NMZ: Validating primary data. [2025-09-16T19:39:34.453105] [DEBUG] [VALIDATOR ] NMZ: All expected trading days are present. [2025-09-16T19:39:34.453204] [DEBUG] [VALIDATOR ] NMZ: Primary data validation passed. [2025-09-16T19:39:34.453716] [INFO ] [MAIN ] NMZ: Fetched primary data is valid. [2025-09-16T19:39:34.453798] [DEBUG] [LOCAL ] NMZ: Saving primary data. [2025-09-16T19:39:34.454545] [DEBUG] [LOCAL ] NMZ: Trimmed 23319 records to 15515 (keeping 150 days of data) [2025-09-16T19:39:34.550550] [DEBUG] [LOCAL ] NMZ: Primary data saved (15515 records). [2025-09-16T19:39:34.550709] [INFO ] [MAIN ] NMZ: Full history saved. [2025-09-16T19:39:34.550796] [INFO ] [MAIN ] Update Progress: 1504/2369 symbols completed. NMZ took 18.5s. Estimated remaining: 1h 31m 45s. Rate: 9.4 symbols/min [2025-09-16T19:39:34.720537] [INFO ] [MAIN ] NOA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:39:34.732815] [DEBUG] [LOCAL ] NOA: Loaded 11300 existing records from primary storage. [2025-09-16T19:39:34.732933] [INFO ] [MAIN ] NOA: Loaded 11300 existing records. [2025-09-16T19:39:34.779983] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-03. [2025-09-16T19:39:34.915783] [WARN ] [MAIN ] NOA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:39:34.916578] [INFO ] [MAIN ] NOA: Wiping existing primary data before full refresh. [2025-09-16T19:39:34.916626] [INFO ] [LOCAL ] NOA: Starting deletion of primary data. [2025-09-16T19:39:34.917319] [DEBUG] [LOCAL ] NOA: Deleted primary data file. [2025-09-16T19:39:34.917365] [INFO ] [MAIN ] NOA: Starting full primary refresh. [2025-09-16T19:39:35.035128] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-16T19:39:35.203463] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-16T19:39:35.281529] [INFO ] [REMOTE ] NOA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:39:35.574906] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-04. [2025-09-16T19:39:36.374930] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-03. [2025-09-16T19:39:36.968491] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-16T19:39:37.174920] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-02. [2025-09-16T19:39:37.308903] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-16T19:39:37.974927] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-04. [2025-09-16T19:39:38.038288] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-16T19:39:38.435819] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-16T19:39:38.774906] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-05. [2025-09-16T19:39:39.363094] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-16T19:39:39.574938] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-06. [2025-09-16T19:39:40.150394] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-16T19:39:40.374947] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-03. [2025-09-16T19:39:41.174878] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-07. [2025-09-16T19:39:41.463978] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-16T19:39:41.575397] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-16T19:39:41.974909] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-08. [2025-09-16T19:39:42.559889] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-16T19:39:42.774925] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-04. [2025-09-16T19:39:43.329287] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-16T19:39:43.574921] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-04. [2025-09-16T19:39:44.374911] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-09. [2025-09-16T19:39:44.660763] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-16T19:39:45.174939] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-05. [2025-09-16T19:39:45.190218] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-16T19:39:45.191735] [INFO ] [REMOTE ] NNY: Full fetch complete (6117 records). [2025-09-16T19:39:45.191803] [DEBUG] [VALIDATOR ] NNY: Validating primary data. [2025-09-16T19:39:45.548704] [DEBUG] [VALIDATOR ] NNY: All expected trading days are present. [2025-09-16T19:39:45.548784] [DEBUG] [VALIDATOR ] NNY: Primary data validation passed. [2025-09-16T19:39:45.548951] [INFO ] [MAIN ] NNY: Fetched primary data is valid. [2025-09-16T19:39:45.548992] [DEBUG] [LOCAL ] NNY: Saving primary data. [2025-09-16T19:39:45.549384] [DEBUG] [LOCAL ] NNY: Trimmed 6117 records to 4241 (keeping 150 days of data) [2025-09-16T19:39:45.574444] [DEBUG] [LOCAL ] NNY: Primary data saved (4241 records). [2025-09-16T19:39:45.574538] [INFO ] [MAIN ] NNY: Full history saved. [2025-09-16T19:39:45.574629] [INFO ] [MAIN ] Update Progress: 1505/2369 symbols completed. NNY took 15.1s. Estimated remaining: 1h 31m 41s. Rate: 9.4 symbols/min [2025-09-16T19:39:45.743879] [INFO ] [MAIN ] NOAH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:39:45.758915] [DEBUG] [LOCAL ] NOAH: Loaded 14278 existing records from primary storage. [2025-09-16T19:39:45.759032] [INFO ] [MAIN ] NOAH: Loaded 14278 existing records. [2025-09-16T19:39:45.933926] [WARN ] [MAIN ] NOAH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:39:45.934206] [INFO ] [MAIN ] NOAH: Wiping existing primary data before full refresh. [2025-09-16T19:39:45.934254] [INFO ] [LOCAL ] NOAH: Starting deletion of primary data. [2025-09-16T19:39:45.934777] [DEBUG] [LOCAL ] NOAH: Deleted primary data file. [2025-09-16T19:39:45.934832] [INFO ] [MAIN ] NOAH: Starting full primary refresh. [2025-09-16T19:39:45.980139] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-05. [2025-09-16T19:39:46.318263] [INFO ] [REMOTE ] NOAH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:39:46.783780] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-05. [2025-09-16T19:39:46.789018] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-16T19:39:46.973561] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-16T19:39:47.301177] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-16T19:39:47.574940] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-06. [2025-09-16T19:39:48.374901] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-02. [2025-09-16T19:39:49.111961] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-16T19:39:49.160012] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-16T19:39:49.174843] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-03. [2025-09-16T19:39:49.974907] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-06. [2025-09-16T19:39:50.114850] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-16T19:39:50.641431] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-16T19:39:50.774904] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-07. [2025-09-16T19:39:51.574915] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-06. [2025-09-16T19:39:51.715388] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-16T19:39:52.048330] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-16T19:39:52.374935] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-08. [2025-09-16T19:39:53.174891] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-07. [2025-09-16T19:39:53.330819] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-16T19:39:53.974927] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-07. [2025-09-16T19:39:54.445181] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-16T19:39:54.774873] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-08. [2025-09-16T19:39:54.829582] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-16T19:39:55.298554] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-16T19:39:55.574911] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-09. [2025-09-16T19:39:56.189020] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-16T19:39:56.190014] [INFO ] [REMOTE ] NMT: Full fetch complete (3018 records). [2025-09-16T19:39:56.190080] [DEBUG] [VALIDATOR ] NMT: Validating primary data. [2025-09-16T19:39:56.380013] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-08. [2025-09-16T19:39:56.546449] [DEBUG] [VALIDATOR ] NMT: All expected trading days are present. [2025-09-16T19:39:56.546530] [DEBUG] [VALIDATOR ] NMT: Primary data validation passed. [2025-09-16T19:39:56.546636] [INFO ] [MAIN ] NMT: Fetched primary data is valid. [2025-09-16T19:39:56.546717] [DEBUG] [LOCAL ] NMT: Saving primary data. [2025-09-16T19:39:56.547089] [DEBUG] [LOCAL ] NMT: Trimmed 3018 records to 2165 (keeping 150 days of data) [2025-09-16T19:39:56.561100] [DEBUG] [LOCAL ] NMT: Primary data saved (2165 records). [2025-09-16T19:39:56.561198] [INFO ] [MAIN ] NMT: Full history saved. [2025-09-16T19:39:56.561282] [INFO ] [MAIN ] Update Progress: 1506/2369 symbols completed. NMT took 41.2s. Estimated remaining: 1h 31m 37s. Rate: 9.4 symbols/min [2025-09-16T19:39:56.731309] [INFO ] [MAIN ] NOC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:39:56.768402] [DEBUG] [LOCAL ] NOC: Loaded 31028 existing records from primary storage. [2025-09-16T19:39:56.768538] [INFO ] [MAIN ] NOC: Loaded 31028 existing records. [2025-09-16T19:39:56.949194] [WARN ] [MAIN ] NOC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:39:56.949460] [INFO ] [MAIN ] NOC: Wiping existing primary data before full refresh. [2025-09-16T19:39:56.949507] [INFO ] [LOCAL ] NOC: Starting deletion of primary data. [2025-09-16T19:39:56.950340] [DEBUG] [LOCAL ] NOC: Deleted primary data file. [2025-09-16T19:39:56.950392] [INFO ] [MAIN ] NOC: Starting full primary refresh. [2025-09-16T19:39:57.181144] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-09. [2025-09-16T19:39:57.305763] [INFO ] [REMOTE ] NOC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:39:57.974942] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-04. [2025-09-16T19:39:58.090357] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-16T19:39:58.234490] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-16T19:39:58.238105] [INFO ] [REMOTE ] NOA: Full fetch complete (17721 records). [2025-09-16T19:39:58.238223] [DEBUG] [VALIDATOR ] NOA: Validating primary data. [2025-09-16T19:39:58.615356] [DEBUG] [VALIDATOR ] NOA: All expected trading days are present. [2025-09-16T19:39:58.615439] [DEBUG] [VALIDATOR ] NOA: Primary data validation passed. [2025-09-16T19:39:58.615887] [INFO ] [MAIN ] NOA: Fetched primary data is valid. [2025-09-16T19:39:58.615939] [DEBUG] [LOCAL ] NOA: Saving primary data. [2025-09-16T19:39:58.616833] [DEBUG] [LOCAL ] NOA: Trimmed 17721 records to 11427 (keeping 150 days of data) [2025-09-16T19:39:58.687611] [DEBUG] [LOCAL ] NOA: Primary data saved (11427 records). [2025-09-16T19:39:58.687799] [INFO ] [MAIN ] NOA: Full history saved. [2025-09-16T19:39:58.687924] [INFO ] [MAIN ] Update Progress: 1507/2369 symbols completed. NOA took 24.1s. Estimated remaining: 1h 31m 29s. Rate: 9.4 symbols/min [2025-09-16T19:39:58.780510] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-02. [2025-09-16T19:39:58.900496] [INFO ] [MAIN ] NOG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:39:58.937183] [DEBUG] [LOCAL ] NOG: Loaded 37625 existing records from primary storage. [2025-09-16T19:39:58.937337] [INFO ] [MAIN ] NOG: Loaded 37625 existing records. [2025-09-16T19:39:59.120777] [WARN ] [MAIN ] NOG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:39:59.121030] [INFO ] [MAIN ] NOG: Wiping existing primary data before full refresh. [2025-09-16T19:39:59.121083] [INFO ] [LOCAL ] NOG: Starting deletion of primary data. [2025-09-16T19:39:59.121941] [DEBUG] [LOCAL ] NOG: Deleted primary data file. [2025-09-16T19:39:59.122001] [INFO ] [MAIN ] NOG: Starting full primary refresh. [2025-09-16T19:39:59.472769] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-16T19:39:59.500001] [INFO ] [REMOTE ] NOG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:39:59.574869] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-05. [2025-09-16T19:40:00.374863] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-09. [2025-09-16T19:40:00.398061] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-16T19:40:00.478191] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-16T19:40:01.174903] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-03. [2025-09-16T19:40:01.879783] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-16T19:40:01.887147] [INFO ] [REMOTE ] NNN: Full fetch complete (52807 records). [2025-09-16T19:40:01.887452] [DEBUG] [VALIDATOR ] NNN: Validating primary data. [2025-09-16T19:40:01.980093] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-02. [2025-09-16T19:40:02.304256] [DEBUG] [VALIDATOR ] NNN: All expected trading days are present. [2025-09-16T19:40:02.304370] [DEBUG] [VALIDATOR ] NNN: Primary data validation passed. [2025-09-16T19:40:02.305327] [INFO ] [MAIN ] NNN: Fetched primary data is valid. [2025-09-16T19:40:02.305376] [DEBUG] [LOCAL ] NNN: Saving primary data. [2025-09-16T19:40:02.306843] [DEBUG] [LOCAL ] NNN: Trimmed 52807 records to 35852 (keeping 150 days of data) [2025-09-16T19:40:02.538697] [DEBUG] [LOCAL ] NNN: Primary data saved (35852 records). [2025-09-16T19:40:02.538860] [INFO ] [MAIN ] NNN: Full history saved. [2025-09-16T19:40:02.538972] [INFO ] [MAIN ] Update Progress: 1508/2369 symbols completed. NNN took 37.6s. Estimated remaining: 1h 31m 21s. Rate: 9.4 symbols/min [2025-09-16T19:40:02.722456] [INFO ] [MAIN ] NOK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:40:02.765039] [DEBUG] [LOCAL ] NOK: Loaded 39582 existing records from primary storage. [2025-09-16T19:40:02.765240] [INFO ] [MAIN ] NOK: Loaded 39582 existing records. [2025-09-16T19:40:02.799131] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-06. [2025-09-16T19:40:02.973273] [WARN ] [MAIN ] NOK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:40:02.973569] [INFO ] [MAIN ] NOK: Wiping existing primary data before full refresh. [2025-09-16T19:40:02.973720] [INFO ] [LOCAL ] NOK: Starting deletion of primary data. [2025-09-16T19:40:02.974619] [DEBUG] [LOCAL ] NOK: Deleted primary data file. [2025-09-16T19:40:02.974707] [INFO ] [MAIN ] NOK: Starting full primary refresh. [2025-09-16T19:40:03.378455] [INFO ] [REMOTE ] NOK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:40:03.380016] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-16T19:40:03.574863] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-04. [2025-09-16T19:40:03.662392] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-16T19:40:03.985317] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-16T19:40:04.374909] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-02. [2025-09-16T19:40:05.174919] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-07. [2025-09-16T19:40:05.454353] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-16T19:40:05.959431] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-16T19:40:05.974837] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-03. [2025-09-16T19:40:06.204776] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-16T19:40:06.774957] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-03. [2025-09-16T19:40:07.574946] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-05. [2025-09-16T19:40:08.213033] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-16T19:40:08.374920] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-04. [2025-09-16T19:40:08.601905] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-16T19:40:09.174911] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-08. [2025-09-16T19:40:09.448746] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-16T19:40:09.974962] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-06. [2025-09-16T19:40:10.187976] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-16T19:40:10.523942] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-16T19:40:10.774981] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-05. [2025-09-16T19:40:11.574916] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-04. [2025-09-16T19:40:11.814285] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-16T19:40:12.374882] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-07. [2025-09-16T19:40:12.677820] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-16T19:40:13.174905] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-06. [2025-09-16T19:40:13.372969] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-16T19:40:13.818276] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-16T19:40:13.974922] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-05. [2025-09-16T19:40:14.774907] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-08. [2025-09-16T19:40:15.197980] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-16T19:40:15.465343] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-16T19:40:15.574878] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-06. [2025-09-16T19:40:16.374913] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-07. [2025-09-16T19:40:16.417464] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-16T19:40:17.174907] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-09. [2025-09-16T19:40:17.345257] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-16T19:40:17.974915] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-07. [2025-09-16T19:40:18.206290] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-16T19:40:18.673322] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-16T19:40:18.677875] [INFO ] [REMOTE ] NOC: Full fetch complete (47107 records). [2025-09-16T19:40:18.677969] [DEBUG] [VALIDATOR ] NOC: Validating primary data. [2025-09-16T19:40:18.781637] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-09. [2025-09-16T19:40:19.067898] [DEBUG] [VALIDATOR ] NOC: All expected trading days are present. [2025-09-16T19:40:19.067995] [DEBUG] [VALIDATOR ] NOC: Primary data validation passed. [2025-09-16T19:40:19.068806] [INFO ] [MAIN ] NOC: Fetched primary data is valid. [2025-09-16T19:40:19.068854] [DEBUG] [LOCAL ] NOC: Saving primary data. [2025-09-16T19:40:19.070046] [DEBUG] [LOCAL ] NOC: Trimmed 47107 records to 31318 (keeping 150 days of data) [2025-09-16T19:40:19.289619] [DEBUG] [LOCAL ] NOC: Primary data saved (31318 records). [2025-09-16T19:40:19.289805] [INFO ] [MAIN ] NOC: Full history saved. [2025-09-16T19:40:19.289952] [INFO ] [MAIN ] Update Progress: 1509/2369 symbols completed. NOC took 22.7s. Estimated remaining: 1h 31m 20s. Rate: 9.4 symbols/min [2025-09-16T19:40:19.468432] [INFO ] [MAIN ] NOM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:40:19.468678] [DEBUG] [LOCAL ] NOM: No existing data file found in primary storage. [2025-09-16T19:40:19.468720] [WARN ] [MAIN ] NOM: No existing data found, performing full refresh instead. [2025-09-16T19:40:19.468822] [INFO ] [MAIN ] NOM: Wiping existing primary data before full refresh. [2025-09-16T19:40:19.468863] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-09-16T19:40:19.468906] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-09-16T19:40:19.468939] [INFO ] [MAIN ] NOM: Starting full primary refresh. [2025-09-16T19:40:19.575759] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-08. [2025-09-16T19:40:19.848424] [INFO ] [REMOTE ] NOM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:40:19.859971] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-16T19:40:19.863839] [INFO ] [REMOTE ] NOAH: Full fetch complete (21514 records). [2025-09-16T19:40:19.863981] [DEBUG] [VALIDATOR ] NOAH: Validating primary data. [2025-09-16T19:40:20.027059] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-16T19:40:20.328205] [DEBUG] [VALIDATOR ] NOAH: All expected trading days are present. [2025-09-16T19:40:20.328296] [DEBUG] [VALIDATOR ] NOAH: Primary data validation passed. [2025-09-16T19:40:20.328950] [INFO ] [MAIN ] NOAH: Fetched primary data is valid. [2025-09-16T19:40:20.329003] [DEBUG] [LOCAL ] NOAH: Saving primary data. [2025-09-16T19:40:20.329787] [DEBUG] [LOCAL ] NOAH: Trimmed 21514 records to 14444 (keeping 150 days of data) [2025-09-16T19:40:20.377384] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-02. [2025-09-16T19:40:20.427880] [DEBUG] [LOCAL ] NOAH: Primary data saved (14444 records). [2025-09-16T19:40:20.428065] [INFO ] [MAIN ] NOAH: Full history saved. [2025-09-16T19:40:20.428181] [INFO ] [MAIN ] Update Progress: 1510/2369 symbols completed. NOAH took 34.9s. Estimated remaining: 1h 31m 11s. Rate: 9.4 symbols/min [2025-09-16T19:40:20.599924] [INFO ] [MAIN ] NOMD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:40:20.635710] [DEBUG] [LOCAL ] NOMD: Loaded 30839 existing records from primary storage. [2025-09-16T19:40:20.635847] [INFO ] [MAIN ] NOMD: Loaded 30839 existing records. [2025-09-16T19:40:20.788147] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-16T19:40:20.821180] [WARN ] [MAIN ] NOMD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:40:20.821416] [INFO ] [MAIN ] NOMD: Wiping existing primary data before full refresh. [2025-09-16T19:40:20.821489] [INFO ] [LOCAL ] NOMD: Starting deletion of primary data. [2025-09-16T19:40:20.822453] [DEBUG] [LOCAL ] NOMD: Deleted primary data file. [2025-09-16T19:40:20.822504] [INFO ] [MAIN ] NOMD: Starting full primary refresh. [2025-09-16T19:40:21.168808] [INFO ] [REMOTE ] NOMD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:40:21.174848] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-02. [2025-09-16T19:40:21.761605] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-16T19:40:21.974929] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-09. [2025-09-16T19:40:22.520567] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-16T19:40:22.774898] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-03. [2025-09-16T19:40:23.574929] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-08. [2025-09-16T19:40:23.690290] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-16T19:40:23.697015] [INFO ] [REMOTE ] NOK: Full fetch complete (58297 records). [2025-09-16T19:40:23.697156] [DEBUG] [VALIDATOR ] NOK: Validating primary data. [2025-09-16T19:40:24.105309] [DEBUG] [VALIDATOR ] NOK: All expected trading days are present. [2025-09-16T19:40:24.105489] [DEBUG] [VALIDATOR ] NOK: Primary data validation passed. [2025-09-16T19:40:24.106411] [INFO ] [MAIN ] NOK: Fetched primary data is valid. [2025-09-16T19:40:24.106477] [DEBUG] [LOCAL ] NOK: Saving primary data. [2025-09-16T19:40:24.107905] [DEBUG] [LOCAL ] NOK: Trimmed 58297 records to 39972 (keeping 150 days of data) [2025-09-16T19:40:24.223899] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-16T19:40:24.376672] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-04. [2025-09-16T19:40:24.376819] [DEBUG] [LOCAL ] NOK: Primary data saved (39972 records). [2025-09-16T19:40:24.377160] [INFO ] [MAIN ] NOK: Full history saved. [2025-09-16T19:40:24.378511] [INFO ] [MAIN ] Update Progress: 1511/2369 symbols completed. NOK took 21.8s. Estimated remaining: 1h 31m 3s. Rate: 9.4 symbols/min [2025-09-16T19:40:24.562824] [INFO ] [MAIN ] NOTE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:40:24.602340] [DEBUG] [LOCAL ] NOTE: Loaded 32429 existing records from primary storage. [2025-09-16T19:40:24.602502] [INFO ] [MAIN ] NOTE: Loaded 32429 existing records. [2025-09-16T19:40:24.782889] [WARN ] [MAIN ] NOTE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:40:24.783174] [INFO ] [MAIN ] NOTE: Wiping existing primary data before full refresh. [2025-09-16T19:40:24.783222] [INFO ] [LOCAL ] NOTE: Starting deletion of primary data. [2025-09-16T19:40:24.783855] [DEBUG] [LOCAL ] NOTE: Deleted primary data file. [2025-09-16T19:40:24.783927] [INFO ] [MAIN ] NOTE: Starting full primary refresh. [2025-09-16T19:40:25.132250] [INFO ] [REMOTE ] NOTE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:40:25.174858] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-02. [2025-09-16T19:40:25.505141] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-16T19:40:25.806510] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-16T19:40:25.974918] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-05. [2025-09-16T19:40:26.774910] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-03. [2025-09-16T19:40:27.068635] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-16T19:40:27.162259] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-16T19:40:27.584054] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-09. [2025-09-16T19:40:27.589064] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-16T19:40:28.374900] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-06. [2025-09-16T19:40:29.174900] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-04. [2025-09-16T19:40:29.226291] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-16T19:40:29.232451] [INFO ] [REMOTE ] NOG: Full fetch complete (55661 records). [2025-09-16T19:40:29.232610] [DEBUG] [VALIDATOR ] NOG: Validating primary data. [2025-09-16T19:40:29.642798] [DEBUG] [VALIDATOR ] NOG: All expected trading days are present. [2025-09-16T19:40:29.642545] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-16T19:40:29.642991] [DEBUG] [VALIDATOR ] NOG: Primary data validation passed. [2025-09-16T19:40:29.645113] [INFO ] [MAIN ] NOG: Fetched primary data is valid. [2025-09-16T19:40:29.645184] [DEBUG] [LOCAL ] NOG: Saving primary data. [2025-09-16T19:40:29.684540] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-16T19:40:29.684749] [DEBUG] [LOCAL ] NOG: Trimmed 55661 records to 37995 (keeping 150 days of data) [2025-09-16T19:40:29.938145] [DEBUG] [LOCAL ] NOG: Primary data saved (37995 records). [2025-09-16T19:40:29.938306] [INFO ] [MAIN ] NOG: Full history saved. [2025-09-16T19:40:29.939062] [INFO ] [MAIN ] Update Progress: 1512/2369 symbols completed. NOG took 31.3s. Estimated remaining: 1h 30m 56s. Rate: 9.4 symbols/min [2025-09-16T19:40:29.980079] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-03. [2025-09-16T19:40:30.116576] [INFO ] [MAIN ] NOV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:40:30.161459] [DEBUG] [LOCAL ] NOV: Loaded 39200 existing records from primary storage. [2025-09-16T19:40:30.161625] [INFO ] [MAIN ] NOV: Loaded 39200 existing records. [2025-09-16T19:40:30.336241] [WARN ] [MAIN ] NOV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:40:30.336492] [INFO ] [MAIN ] NOV: Wiping existing primary data before full refresh. [2025-09-16T19:40:30.336536] [INFO ] [LOCAL ] NOV: Starting deletion of primary data. [2025-09-16T19:40:30.337381] [DEBUG] [LOCAL ] NOV: Deleted primary data file. [2025-09-16T19:40:30.337431] [INFO ] [MAIN ] NOV: Starting full primary refresh. [2025-09-16T19:40:30.693793] [INFO ] [REMOTE ] NOV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:40:30.774906] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-05. [2025-09-16T19:40:31.266665] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-16T19:40:31.574900] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-02. [2025-09-16T19:40:31.755659] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-16T19:40:32.374913] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-06. [2025-09-16T19:40:32.731383] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-16T19:40:33.174898] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-04. [2025-09-16T19:40:33.211529] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-16T19:40:33.974900] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-07. [2025-09-16T19:40:34.380405] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-16T19:40:34.767335] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-16T19:40:34.775597] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-08. [2025-09-16T19:40:35.181681] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-16T19:40:35.574886] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-05. [2025-09-16T19:40:36.374928] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-07. [2025-09-16T19:40:37.174943] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-09. [2025-09-16T19:40:37.319864] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-16T19:40:37.690672] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-16T19:40:37.691859] [INFO ] [REMOTE ] NOM: Full fetch complete (1255 records). [2025-09-16T19:40:37.691954] [DEBUG] [VALIDATOR ] NOM: Validating primary data. [2025-09-16T19:40:37.893544] [WARN ] [VALIDATOR ] NOM: Validation failed - insufficient historical data. Have 143 unique days, need 150 days [2025-09-16T19:40:37.893786] [FATAL] [MAIN ] NOM: Fetched primary data is invalid. Refusing to save it. [2025-09-16T19:40:37.893908] [WARN ] [MAIN ] NOM: Deleting existing primary and derivative data due to validation failure. [2025-09-16T19:40:37.893974] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-09-16T19:40:37.894088] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-09-16T19:40:37.894139] [INFO ] [LOCAL ] NOM: Starting deletion of derivative data. [2025-09-16T19:40:37.894300] [DEBUG] [LOCAL ] NOM: No derivative data file found to delete. [2025-09-16T19:40:37.894446] [INFO ] [MAIN ] Update Progress: 1513/2369 symbols completed. NOM took 18.6s. Estimated remaining: 1h 30m 51s. Rate: 9.4 symbols/min [2025-09-16T19:40:37.983868] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-03. [2025-09-16T19:40:38.085820] [INFO ] [MAIN ] NOW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:40:38.096239] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-16T19:40:38.143892] [DEBUG] [LOCAL ] NOW: Loaded 35412 existing records from primary storage. [2025-09-16T19:40:38.144047] [INFO ] [MAIN ] NOW: Loaded 35412 existing records. [2025-09-16T19:40:38.323080] [WARN ] [MAIN ] NOW: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:40:38.323315] [INFO ] [MAIN ] NOW: Wiping existing primary data before full refresh. [2025-09-16T19:40:38.323367] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-09-16T19:40:38.324099] [DEBUG] [LOCAL ] NOW: Deleted primary data file. [2025-09-16T19:40:38.324148] [INFO ] [MAIN ] NOW: Starting full primary refresh. [2025-09-16T19:40:38.679697] [INFO ] [REMOTE ] NOW: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:40:38.774917] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-02. [2025-09-16T19:40:39.574874] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-08. [2025-09-16T19:40:39.652136] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-16T19:40:40.374895] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-04. [2025-09-16T19:40:40.715104] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-16T19:40:40.774085] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-16T19:40:41.174926] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-06. [2025-09-16T19:40:41.974901] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-03. [2025-09-16T19:40:42.522372] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-16T19:40:42.774901] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-05. [2025-09-16T19:40:42.898142] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-16T19:40:43.574904] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-07. [2025-09-16T19:40:44.242125] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-16T19:40:44.374892] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-06. [2025-09-16T19:40:45.174943] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-09. [2025-09-16T19:40:45.471752] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-16T19:40:45.536086] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-03 (3.56 seconds). [2025-09-16T19:40:45.761316] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-16T19:40:45.974900] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-08. [2025-09-16T19:40:46.605916] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-16T19:40:46.614100] [INFO ] [REMOTE ] NOMD: Full fetch complete (44671 records). [2025-09-16T19:40:46.614236] [DEBUG] [VALIDATOR ] NOMD: Validating primary data. [2025-09-16T19:40:46.788519] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-07. [2025-09-16T19:40:46.992709] [DEBUG] [VALIDATOR ] NOMD: All expected trading days are present. [2025-09-16T19:40:46.992791] [DEBUG] [VALIDATOR ] NOMD: Primary data validation passed. [2025-09-16T19:40:46.993573] [INFO ] [MAIN ] NOMD: Fetched primary data is valid. [2025-09-16T19:40:46.993677] [DEBUG] [LOCAL ] NOMD: Saving primary data. [2025-09-16T19:40:46.994771] [DEBUG] [LOCAL ] NOMD: Trimmed 44671 records to 31155 (keeping 150 days of data) [2025-09-16T19:40:47.189309] [DEBUG] [LOCAL ] NOMD: Primary data saved (31155 records). [2025-09-16T19:40:47.189449] [INFO ] [MAIN ] NOMD: Full history saved. [2025-09-16T19:40:47.189557] [INFO ] [MAIN ] Update Progress: 1514/2369 symbols completed. NOMD took 26.8s. Estimated remaining: 1h 30m 46s. Rate: 9.4 symbols/min [2025-09-16T19:40:47.357796] [INFO ] [MAIN ] NPB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:40:47.357942] [DEBUG] [LOCAL ] NPB: No existing data file found in primary storage. [2025-09-16T19:40:47.357978] [WARN ] [MAIN ] NPB: No existing data found, performing full refresh instead. [2025-09-16T19:40:47.358100] [INFO ] [MAIN ] NPB: Wiping existing primary data before full refresh. [2025-09-16T19:40:47.358139] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-09-16T19:40:47.358179] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-09-16T19:40:47.358231] [INFO ] [MAIN ] NPB: Starting full primary refresh. [2025-09-16T19:40:47.595211] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-04. [2025-09-16T19:40:47.709251] [INFO ] [REMOTE ] NPB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:40:47.765051] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-16T19:40:48.374901] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-02. [2025-09-16T19:40:48.781483] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-16T19:40:48.802751] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-16T19:40:49.174901] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-03. [2025-09-16T19:40:49.968572] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-16T19:40:49.979427] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-08. [2025-09-16T19:40:49.993766] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-16T19:40:50.774962] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-04. [2025-09-16T19:40:51.574882] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-05. [2025-09-16T19:40:51.584674] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-16T19:40:51.674214] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-16T19:40:52.374893] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-09. [2025-09-16T19:40:53.174868] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-09. [2025-09-16T19:40:53.652214] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-16T19:40:53.846528] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-16T19:40:53.850318] [INFO ] [REMOTE ] NOTE: Full fetch complete (48100 records). [2025-09-16T19:40:53.850413] [DEBUG] [VALIDATOR ] NOTE: Validating primary data. [2025-09-16T19:40:53.979987] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-05. [2025-09-16T19:40:54.234583] [DEBUG] [VALIDATOR ] NOTE: All expected trading days are present. [2025-09-16T19:40:54.234677] [DEBUG] [VALIDATOR ] NOTE: Primary data validation passed. [2025-09-16T19:40:54.235422] [INFO ] [MAIN ] NOTE: Fetched primary data is valid. [2025-09-16T19:40:54.235463] [DEBUG] [LOCAL ] NOTE: Saving primary data. [2025-09-16T19:40:54.236442] [DEBUG] [LOCAL ] NOTE: Trimmed 48100 records to 32557 (keeping 150 days of data) [2025-09-16T19:40:54.430116] [DEBUG] [LOCAL ] NOTE: Primary data saved (32557 records). [2025-09-16T19:40:54.430258] [INFO ] [MAIN ] NOTE: Full history saved. [2025-09-16T19:40:54.430349] [INFO ] [MAIN ] Update Progress: 1515/2369 symbols completed. NOTE took 30.1s. Estimated remaining: 1h 30m 40s. Rate: 9.4 symbols/min [2025-09-16T19:40:54.604363] [INFO ] [MAIN ] NPCT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:40:54.618814] [DEBUG] [LOCAL ] NPCT: Loaded 12728 existing records from primary storage. [2025-09-16T19:40:54.618927] [INFO ] [MAIN ] NPCT: Loaded 12728 existing records. [2025-09-16T19:40:54.789408] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-06. [2025-09-16T19:40:54.793629] [WARN ] [MAIN ] NPCT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:40:54.794739] [INFO ] [MAIN ] NPCT: Wiping existing primary data before full refresh. [2025-09-16T19:40:54.794837] [INFO ] [LOCAL ] NPCT: Starting deletion of primary data. [2025-09-16T19:40:54.795318] [DEBUG] [LOCAL ] NPCT: Deleted primary data file. [2025-09-16T19:40:54.795363] [INFO ] [MAIN ] NPCT: Starting full primary refresh. [2025-09-16T19:40:54.917262] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-16T19:40:55.166377] [INFO ] [REMOTE ] NPCT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:40:55.345426] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-16T19:40:55.352302] [INFO ] [REMOTE ] NOV: Full fetch complete (57853 records). [2025-09-16T19:40:55.352407] [DEBUG] [VALIDATOR ] NOV: Validating primary data. [2025-09-16T19:40:55.584537] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-02. [2025-09-16T19:40:55.737866] [DEBUG] [VALIDATOR ] NOV: All expected trading days are present. [2025-09-16T19:40:55.737945] [DEBUG] [VALIDATOR ] NOV: Primary data validation passed. [2025-09-16T19:40:55.738796] [INFO ] [MAIN ] NOV: Fetched primary data is valid. [2025-09-16T19:40:55.738840] [DEBUG] [LOCAL ] NOV: Saving primary data. [2025-09-16T19:40:55.739995] [DEBUG] [LOCAL ] NOV: Trimmed 57853 records to 39589 (keeping 150 days of data) [2025-09-16T19:40:55.989105] [DEBUG] [LOCAL ] NOV: Primary data saved (39589 records). [2025-09-16T19:40:55.989245] [INFO ] [MAIN ] NOV: Full history saved. [2025-09-16T19:40:55.990342] [INFO ] [MAIN ] Update Progress: 1516/2369 symbols completed. NOV took 26.1s. Estimated remaining: 1h 30m 31s. Rate: 9.4 symbols/min [2025-09-16T19:40:56.166113] [INFO ] [MAIN ] NPFD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:40:56.176451] [DEBUG] [LOCAL ] NPFD: Loaded 6724 existing records from primary storage. [2025-09-16T19:40:56.176589] [INFO ] [MAIN ] NPFD: Loaded 6724 existing records. [2025-09-16T19:40:56.369449] [WARN ] [MAIN ] NPFD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:40:56.369765] [INFO ] [MAIN ] NPFD: Wiping existing primary data before full refresh. [2025-09-16T19:40:56.369813] [INFO ] [LOCAL ] NPFD: Starting deletion of primary data. [2025-09-16T19:40:56.370186] [DEBUG] [LOCAL ] NPFD: Deleted primary data file. [2025-09-16T19:40:56.370246] [INFO ] [MAIN ] NPFD: Starting full primary refresh. [2025-09-16T19:40:56.404236] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-06. [2025-09-16T19:40:56.697549] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-16T19:40:56.800543] [INFO ] [REMOTE ] NPFD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:40:56.828385] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-16T19:40:57.174915] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-02. [2025-09-16T19:40:57.456709] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-16T19:40:57.912379] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-16T19:40:57.974918] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-03. [2025-09-16T19:40:58.774906] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-07. [2025-09-16T19:40:58.799763] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-16T19:40:59.574902] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-07. [2025-09-16T19:40:59.784947] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-16T19:41:00.374911] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-04. [2025-09-16T19:41:01.174939] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-08. [2025-09-16T19:41:01.184195] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-16T19:41:01.580254] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-16T19:41:01.974916] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-03. [2025-09-16T19:41:02.226548] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-16T19:41:02.774982] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-09. [2025-09-16T19:41:02.916022] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-16T19:41:03.574953] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-08. [2025-09-16T19:41:03.892835] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-16T19:41:03.896557] [INFO ] [REMOTE ] NPB: Full fetch complete (15434 records). [2025-09-16T19:41:03.896715] [DEBUG] [VALIDATOR ] NPB: Validating primary data. [2025-09-16T19:41:04.091145] [WARN ] [VALIDATOR ] NPB: Validation failed - insufficient historical data. Have 147 unique days, need 150 days [2025-09-16T19:41:04.091431] [FATAL] [MAIN ] NPB: Fetched primary data is invalid. Refusing to save it. [2025-09-16T19:41:04.091481] [WARN ] [MAIN ] NPB: Deleting existing primary and derivative data due to validation failure. [2025-09-16T19:41:04.091526] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-09-16T19:41:04.091583] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-09-16T19:41:04.091618] [INFO ] [LOCAL ] NPB: Starting deletion of derivative data. [2025-09-16T19:41:04.091677] [DEBUG] [LOCAL ] NPB: No derivative data file found to delete. [2025-09-16T19:41:04.091739] [INFO ] [MAIN ] Update Progress: 1517/2369 symbols completed. NPB took 16.9s. Estimated remaining: 1h 30m 26s. Rate: 9.4 symbols/min [2025-09-16T19:41:04.374899] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-04. [2025-09-16T19:41:05.174945] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-05. [2025-09-16T19:41:05.340893] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-16T19:41:05.748199] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-16T19:41:05.766423] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-16T19:41:05.974896] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-09. [2025-09-16T19:41:06.774905] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-06. [2025-09-16T19:41:07.554843] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-16T19:41:07.574920] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-07. [2025-09-16T19:41:08.063828] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-16T19:41:08.070310] [INFO ] [REMOTE ] NOW: Full fetch complete (53465 records). [2025-09-16T19:41:08.070490] [DEBUG] [VALIDATOR ] NOW: Validating primary data. [2025-09-16T19:41:08.380063] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-05. [2025-09-16T19:41:08.508816] [DEBUG] [VALIDATOR ] NOW: All expected trading days are present. [2025-09-16T19:41:08.509015] [DEBUG] [VALIDATOR ] NOW: Primary data validation passed. [2025-09-16T19:41:08.517757] [INFO ] [MAIN ] NOW: Fetched primary data is valid. [2025-09-16T19:41:08.518773] [DEBUG] [LOCAL ] NOW: Saving primary data. [2025-09-16T19:41:08.518693] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-16T19:41:08.523620] [DEBUG] [LOCAL ] NOW: Trimmed 53465 records to 35748 (keeping 150 days of data) [2025-09-16T19:41:08.784353] [DEBUG] [LOCAL ] NOW: Primary data saved (35748 records). [2025-09-16T19:41:08.784500] [INFO ] [MAIN ] NOW: Full history saved. [2025-09-16T19:41:08.784585] [INFO ] [MAIN ] Update Progress: 1518/2369 symbols completed. NOW took 30.9s. Estimated remaining: 1h 30m 19s. Rate: 9.4 symbols/min [2025-09-16T19:41:09.174970] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-08. [2025-09-16T19:41:09.645173] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-16T19:41:09.937682] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-16T19:41:09.974914] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-06. [2025-09-16T19:41:10.774933] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-09. [2025-09-16T19:41:11.043883] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-16T19:41:11.353942] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-16T19:41:11.356222] [INFO ] [REMOTE ] NPFD: Full fetch complete (10706 records). [2025-09-16T19:41:11.356351] [DEBUG] [VALIDATOR ] NPFD: Validating primary data. [2025-09-16T19:41:11.588707] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-07. [2025-09-16T19:41:11.738812] [DEBUG] [VALIDATOR ] NPFD: All expected trading days are present. [2025-09-16T19:41:11.738898] [DEBUG] [VALIDATOR ] NPFD: Primary data validation passed. [2025-09-16T19:41:11.739193] [INFO ] [MAIN ] NPFD: Fetched primary data is valid. [2025-09-16T19:41:11.739235] [DEBUG] [LOCAL ] NPFD: Saving primary data. [2025-09-16T19:41:11.739781] [DEBUG] [LOCAL ] NPFD: Trimmed 10706 records to 6777 (keeping 150 days of data) [2025-09-16T19:41:11.783271] [DEBUG] [LOCAL ] NPFD: Primary data saved (6777 records). [2025-09-16T19:41:11.783421] [INFO ] [MAIN ] NPFD: Full history saved. [2025-09-16T19:41:11.783532] [INFO ] [MAIN ] Update Progress: 1519/2369 symbols completed. NPFD took 15.8s. Estimated remaining: 1h 30m 10s. Rate: 9.4 symbols/min [2025-09-16T19:41:12.584457] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-16T19:41:12.589249] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-08. [2025-09-16T19:41:13.491306] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-16T19:41:13.494951] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-09. [2025-09-16T19:41:14.555981] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-16T19:41:14.558543] [INFO ] [REMOTE ] NPCT: Full fetch complete (18295 records). [2025-09-16T19:41:14.558625] [DEBUG] [VALIDATOR ] NPCT: Validating primary data. [2025-09-16T19:41:14.923037] [DEBUG] [VALIDATOR ] NPCT: All expected trading days are present. [2025-09-16T19:41:14.923120] [DEBUG] [VALIDATOR ] NPCT: Primary data validation passed. [2025-09-16T19:41:14.923520] [INFO ] [MAIN ] NPCT: Fetched primary data is valid. [2025-09-16T19:41:14.923562] [DEBUG] [LOCAL ] NPCT: Saving primary data. [2025-09-16T19:41:14.924259] [DEBUG] [LOCAL ] NPCT: Trimmed 18295 records to 12794 (keeping 150 days of data) [2025-09-16T19:41:15.004346] [DEBUG] [LOCAL ] NPCT: Primary data saved (12794 records). [2025-09-16T19:41:15.004504] [INFO ] [MAIN ] NPCT: Full history saved. [2025-09-16T19:41:15.004602] [INFO ] [MAIN ] Update Progress: 1520/2369 symbols completed. NPCT took 20.6s. Estimated remaining: 1h 30m 2s. Rate: 9.4 symbols/min [2025-09-16T19:41:15.543761] [INFO ] [MAIN ] NPK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:41:15.625106] [INFO ] [MAIN ] NPKI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:41:15.729846] [INFO ] [MAIN ] NPV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:41:15.738923] [INFO ] [MAIN ] NPO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:41:15.743409] [DEBUG] [LOCAL ] NPK: Loaded 6354 existing records from primary storage. [2025-09-16T19:41:15.743660] [INFO ] [MAIN ] NPK: Loaded 6354 existing records. [2025-09-16T19:41:15.839472] [DEBUG] [LOCAL ] NPV: Loaded 3779 existing records from primary storage. [2025-09-16T19:41:15.868981] [DEBUG] [LOCAL ] NPO: Loaded 9291 existing records from primary storage. [2025-09-16T19:41:15.874528] [INFO ] [MAIN ] NPO: Loaded 9291 existing records. [2025-09-16T19:41:15.874429] [INFO ] [MAIN ] NPV: Loaded 3779 existing records. [2025-09-16T19:41:16.103475] [DEBUG] [LOCAL ] NPKI: Loaded 30274 existing records from primary storage. [2025-09-16T19:41:16.113946] [INFO ] [MAIN ] NPKI: Loaded 30274 existing records. [2025-09-16T19:41:16.083372] [WARN ] [MAIN ] NPK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:41:16.184432] [INFO ] [MAIN ] NPK: Wiping existing primary data before full refresh. [2025-09-16T19:41:16.227572] [INFO ] [LOCAL ] NPK: Starting deletion of primary data. [2025-09-16T19:41:16.374338] [DEBUG] [LOCAL ] NPK: Deleted primary data file. [2025-09-16T19:41:16.450915] [WARN ] [MAIN ] NPO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:41:16.450754] [INFO ] [MAIN ] NPK: Starting full primary refresh. [2025-09-16T19:41:16.478962] [INFO ] [MAIN ] NPO: Wiping existing primary data before full refresh. [2025-09-16T19:41:16.495528] [INFO ] [LOCAL ] NPO: Starting deletion of primary data. [2025-09-16T19:41:16.478729] [WARN ] [MAIN ] NPV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:41:16.520694] [DEBUG] [LOCAL ] NPO: Deleted primary data file. [2025-09-16T19:41:16.574254] [INFO ] [MAIN ] NPV: Wiping existing primary data before full refresh. [2025-09-16T19:41:16.583366] [INFO ] [LOCAL ] NPV: Starting deletion of primary data. [2025-09-16T19:41:16.583272] [INFO ] [MAIN ] NPO: Starting full primary refresh. [2025-09-16T19:41:16.622778] [DEBUG] [LOCAL ] NPV: Deleted primary data file. [2025-09-16T19:41:16.664277] [INFO ] [MAIN ] NPV: Starting full primary refresh. [2025-09-16T19:41:16.669663] [WARN ] [MAIN ] NPKI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:41:16.794312] [INFO ] [MAIN ] NPKI: Wiping existing primary data before full refresh. [2025-09-16T19:41:16.971581] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-09-16T19:41:17.141575] [DEBUG] [LOCAL ] NPKI: Deleted primary data file. [2025-09-16T19:41:17.215805] [INFO ] [MAIN ] NPKI: Starting full primary refresh. [2025-09-16T19:41:17.511829] [INFO ] [REMOTE ] NPK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:41:17.604900] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-02. [2025-09-16T19:41:17.701758] [INFO ] [REMOTE ] NPV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:41:17.750031] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-02. [2025-09-16T19:41:17.947371] [INFO ] [REMOTE ] NPO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:41:17.959593] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-02. [2025-09-16T19:41:18.058707] [INFO ] [REMOTE ] NPKI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:41:18.059042] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-02. [2025-09-16T19:41:18.383229] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-16T19:41:18.384963] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-03. [2025-09-16T19:41:18.706158] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-16T19:41:18.707549] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-03. [2025-09-16T19:41:18.860500] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-16T19:41:18.863552] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-03. [2025-09-16T19:41:19.237693] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-16T19:41:19.472832] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-16T19:41:19.574856] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-04. [2025-09-16T19:41:19.714424] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-16T19:41:19.854629] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-16T19:41:20.374899] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-03. [2025-09-16T19:41:20.598360] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-16T19:41:21.174945] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-05. [2025-09-16T19:41:21.927360] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-16T19:41:21.974909] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-04. [2025-09-16T19:41:22.220473] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-16T19:41:22.774924] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-06. [2025-09-16T19:41:23.570315] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-16T19:41:23.579604] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-04. [2025-09-16T19:41:23.592529] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-16T19:41:24.282485] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-16T19:41:24.374903] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-05. [2025-09-16T19:41:25.174895] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-04. [2025-09-16T19:41:25.974921] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-07. [2025-09-16T19:41:26.064356] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-16T19:41:26.093580] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-16T19:41:26.479891] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-16T19:41:26.774902] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-08. [2025-09-16T19:41:27.575078] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-05. [2025-09-16T19:41:27.672740] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-16T19:41:28.065672] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-16T19:41:28.374908] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-09. [2025-09-16T19:41:29.174895] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-06. [2025-09-16T19:41:29.471094] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-16T19:41:29.472921] [INFO ] [REMOTE ] NPO: Full fetch complete (14105 records). [2025-09-16T19:41:29.473000] [DEBUG] [VALIDATOR ] NPO: Validating primary data. [2025-09-16T19:41:29.854297] [DEBUG] [VALIDATOR ] NPO: All expected trading days are present. [2025-09-16T19:41:29.854391] [DEBUG] [VALIDATOR ] NPO: Primary data validation passed. [2025-09-16T19:41:29.854764] [INFO ] [MAIN ] NPO: Fetched primary data is valid. [2025-09-16T19:41:29.854810] [DEBUG] [LOCAL ] NPO: Saving primary data. [2025-09-16T19:41:29.855336] [DEBUG] [LOCAL ] NPO: Trimmed 14105 records to 9372 (keeping 150 days of data) [2025-09-16T19:41:29.916364] [DEBUG] [LOCAL ] NPO: Primary data saved (9372 records). [2025-09-16T19:41:29.916523] [INFO ] [MAIN ] NPO: Full history saved. [2025-09-16T19:41:29.916622] [INFO ] [MAIN ] Update Progress: 1521/2369 symbols completed. NPO took 14.9s. Estimated remaining: 1h 30m 1s. Rate: 9.4 symbols/min [2025-09-16T19:41:29.983302] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-05. [2025-09-16T19:41:30.096989] [INFO ] [MAIN ] NPWR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:41:30.131561] [DEBUG] [LOCAL ] NPWR: Loaded 31832 existing records from primary storage. [2025-09-16T19:41:30.131736] [INFO ] [MAIN ] NPWR: Loaded 31832 existing records. [2025-09-16T19:41:30.314147] [WARN ] [MAIN ] NPWR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:41:30.314407] [INFO ] [MAIN ] NPWR: Wiping existing primary data before full refresh. [2025-09-16T19:41:30.314452] [INFO ] [LOCAL ] NPWR: Starting deletion of primary data. [2025-09-16T19:41:30.315267] [DEBUG] [LOCAL ] NPWR: Deleted primary data file. [2025-09-16T19:41:30.315319] [INFO ] [MAIN ] NPWR: Starting full primary refresh. [2025-09-16T19:41:30.686121] [INFO ] [REMOTE ] NPWR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:41:30.729275] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-16T19:41:30.739212] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-16T19:41:30.774910] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-02. [2025-09-16T19:41:31.574905] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-06. [2025-09-16T19:41:32.374915] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-07. [2025-09-16T19:41:32.387341] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-16T19:41:32.500617] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-16T19:41:33.174910] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-03. [2025-09-16T19:41:33.883307] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-16T19:41:33.974844] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-08. [2025-09-16T19:41:34.774894] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-07. [2025-09-16T19:41:34.960065] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-16T19:41:35.102475] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-16T19:41:35.574889] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-09. [2025-09-16T19:41:35.689564] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-16T19:41:36.374905] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-06. [2025-09-16T19:41:36.883297] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-16T19:41:36.887984] [INFO ] [REMOTE ] NPKI: Full fetch complete (43592 records). [2025-09-16T19:41:36.888093] [DEBUG] [VALIDATOR ] NPKI: Validating primary data. [2025-09-16T19:41:36.999381] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-16T19:41:37.180041] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-04. [2025-09-16T19:41:37.270729] [DEBUG] [VALIDATOR ] NPKI: All expected trading days are present. [2025-09-16T19:41:37.270831] [DEBUG] [VALIDATOR ] NPKI: Primary data validation passed. [2025-09-16T19:41:37.271690] [INFO ] [MAIN ] NPKI: Fetched primary data is valid. [2025-09-16T19:41:37.271740] [DEBUG] [LOCAL ] NPKI: Saving primary data. [2025-09-16T19:41:37.272954] [DEBUG] [LOCAL ] NPKI: Trimmed 43592 records to 30489 (keeping 150 days of data) [2025-09-16T19:41:37.448564] [DEBUG] [LOCAL ] NPKI: Primary data saved (30489 records). [2025-09-16T19:41:37.448713] [INFO ] [MAIN ] NPKI: Full history saved. [2025-09-16T19:41:37.448797] [INFO ] [MAIN ] Update Progress: 1522/2369 symbols completed. NPKI took 22.4s. Estimated remaining: 1h 29m 55s. Rate: 9.4 symbols/min [2025-09-16T19:41:37.618296] [INFO ] [MAIN ] NQP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:41:37.626872] [DEBUG] [LOCAL ] NQP: Loaded 6678 existing records from primary storage. [2025-09-16T19:41:37.626982] [INFO ] [MAIN ] NQP: Loaded 6678 existing records. [2025-09-16T19:41:37.807492] [WARN ] [MAIN ] NQP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:41:37.807806] [INFO ] [MAIN ] NQP: Wiping existing primary data before full refresh. [2025-09-16T19:41:37.807859] [INFO ] [LOCAL ] NQP: Starting deletion of primary data. [2025-09-16T19:41:37.808234] [DEBUG] [LOCAL ] NQP: Deleted primary data file. [2025-09-16T19:41:37.808280] [INFO ] [MAIN ] NQP: Starting full primary refresh. [2025-09-16T19:41:37.980012] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-07. [2025-09-16T19:41:38.161838] [INFO ] [REMOTE ] NQP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:41:38.710280] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-16T19:41:38.770790] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-16T19:41:38.774865] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-08. [2025-09-16T19:41:39.404560] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-16T19:41:39.574960] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-05. [2025-09-16T19:41:40.374957] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-08. [2025-09-16T19:41:41.174881] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-02. [2025-09-16T19:41:41.182446] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-16T19:41:41.489897] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-16T19:41:41.974966] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-09. [2025-09-16T19:41:42.069825] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-16T19:41:42.755462] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-16T19:41:42.756875] [INFO ] [REMOTE ] NPV: Full fetch complete (5294 records). [2025-09-16T19:41:42.756948] [DEBUG] [VALIDATOR ] NPV: Validating primary data. [2025-09-16T19:41:42.780025] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-06. [2025-09-16T19:41:43.118584] [DEBUG] [VALIDATOR ] NPV: All expected trading days are present. [2025-09-16T19:41:43.118682] [DEBUG] [VALIDATOR ] NPV: Primary data validation passed. [2025-09-16T19:41:43.118833] [INFO ] [MAIN ] NPV: Fetched primary data is valid. [2025-09-16T19:41:43.118873] [DEBUG] [LOCAL ] NPV: Saving primary data. [2025-09-16T19:41:43.119345] [DEBUG] [LOCAL ] NPV: Trimmed 5294 records to 3802 (keeping 150 days of data) [2025-09-16T19:41:43.144350] [DEBUG] [LOCAL ] NPV: Primary data saved (3802 records). [2025-09-16T19:41:43.144503] [INFO ] [MAIN ] NPV: Full history saved. [2025-09-16T19:41:43.144611] [INFO ] [MAIN ] Update Progress: 1523/2369 symbols completed. NPV took 28.1s. Estimated remaining: 1h 29m 48s. Rate: 9.4 symbols/min [2025-09-16T19:41:43.313208] [INFO ] [MAIN ] NRDY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:41:43.336117] [DEBUG] [LOCAL ] NRDY: Loaded 23866 existing records from primary storage. [2025-09-16T19:41:43.336257] [INFO ] [MAIN ] NRDY: Loaded 23866 existing records. [2025-09-16T19:41:43.515359] [WARN ] [MAIN ] NRDY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:41:43.515660] [INFO ] [MAIN ] NRDY: Wiping existing primary data before full refresh. [2025-09-16T19:41:43.515712] [INFO ] [LOCAL ] NRDY: Starting deletion of primary data. [2025-09-16T19:41:43.516296] [DEBUG] [LOCAL ] NRDY: Deleted primary data file. [2025-09-16T19:41:43.516345] [INFO ] [MAIN ] NRDY: Starting full primary refresh. [2025-09-16T19:41:43.579993] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-03. [2025-09-16T19:41:43.875826] [INFO ] [REMOTE ] NRDY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:41:44.189152] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-16T19:41:44.350190] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-16T19:41:44.374855] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-04. [2025-09-16T19:41:45.140551] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-16T19:41:45.174903] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-02. [2025-09-16T19:41:45.974922] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-05. [2025-09-16T19:41:46.639441] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-16T19:41:46.781274] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-09. [2025-09-16T19:41:46.796404] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-16T19:41:47.420218] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-16T19:41:47.422036] [INFO ] [REMOTE ] NPK: Full fetch complete (8687 records). [2025-09-16T19:41:47.422127] [DEBUG] [VALIDATOR ] NPK: Validating primary data. [2025-09-16T19:41:47.580936] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-03. [2025-09-16T19:41:47.820824] [DEBUG] [VALIDATOR ] NPK: All expected trading days are present. [2025-09-16T19:41:47.820930] [DEBUG] [VALIDATOR ] NPK: Primary data validation passed. [2025-09-16T19:41:47.821186] [INFO ] [MAIN ] NPK: Fetched primary data is valid. [2025-09-16T19:41:47.821242] [DEBUG] [LOCAL ] NPK: Saving primary data. [2025-09-16T19:41:47.821795] [DEBUG] [LOCAL ] NPK: Trimmed 8687 records to 6388 (keeping 150 days of data) [2025-09-16T19:41:47.860279] [DEBUG] [LOCAL ] NPK: Primary data saved (6388 records). [2025-09-16T19:41:47.860399] [INFO ] [MAIN ] NPK: Full history saved. [2025-09-16T19:41:47.860507] [INFO ] [MAIN ] Update Progress: 1524/2369 symbols completed. NPK took 32.9s. Estimated remaining: 1h 29m 41s. Rate: 9.4 symbols/min [2025-09-16T19:41:48.033421] [INFO ] [MAIN ] NREF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:41:48.040515] [DEBUG] [LOCAL ] NREF: Loaded 5557 existing records from primary storage. [2025-09-16T19:41:48.040618] [INFO ] [MAIN ] NREF: Loaded 5557 existing records. [2025-09-16T19:41:48.219046] [WARN ] [MAIN ] NREF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:41:48.219294] [INFO ] [MAIN ] NREF: Wiping existing primary data before full refresh. [2025-09-16T19:41:48.219342] [INFO ] [LOCAL ] NREF: Starting deletion of primary data. [2025-09-16T19:41:48.219621] [DEBUG] [LOCAL ] NREF: Deleted primary data file. [2025-09-16T19:41:48.219695] [INFO ] [MAIN ] NREF: Starting full primary refresh. [2025-09-16T19:41:48.382547] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-06. [2025-09-16T19:41:48.586376] [INFO ] [REMOTE ] NREF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:41:49.086603] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-16T19:41:49.174930] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-07. [2025-09-16T19:41:49.260283] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-16T19:41:49.974936] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-07. [2025-09-16T19:41:50.774895] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-02. [2025-09-16T19:41:50.878601] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-16T19:41:50.897104] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-16T19:41:51.394802] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-16T19:41:51.574954] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-03. [2025-09-16T19:41:52.374890] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-04. [2025-09-16T19:41:52.386304] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-16T19:41:53.174919] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-08. [2025-09-16T19:41:53.673321] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-16T19:41:53.773177] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-16T19:41:53.974938] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-08. [2025-09-16T19:41:54.774905] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-05. [2025-09-16T19:41:55.479931] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-16T19:41:55.575005] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-04. [2025-09-16T19:41:55.949476] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-16T19:41:56.350329] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-16T19:41:56.374951] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-09. [2025-09-16T19:41:57.174947] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-05. [2025-09-16T19:41:57.204594] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-16T19:41:57.206318] [INFO ] [REMOTE ] NQP: Full fetch complete (9862 records). [2025-09-16T19:41:57.206403] [DEBUG] [VALIDATOR ] NQP: Validating primary data. [2025-09-16T19:41:57.615805] [DEBUG] [VALIDATOR ] NQP: All expected trading days are present. [2025-09-16T19:41:57.615892] [DEBUG] [VALIDATOR ] NQP: Primary data validation passed. [2025-09-16T19:41:57.616161] [INFO ] [MAIN ] NQP: Fetched primary data is valid. [2025-09-16T19:41:57.616295] [DEBUG] [LOCAL ] NQP: Saving primary data. [2025-09-16T19:41:57.616779] [DEBUG] [LOCAL ] NQP: Trimmed 9862 records to 6743 (keeping 150 days of data) [2025-09-16T19:41:57.659738] [DEBUG] [LOCAL ] NQP: Primary data saved (6743 records). [2025-09-16T19:41:57.659860] [INFO ] [MAIN ] NQP: Full history saved. [2025-09-16T19:41:57.659943] [INFO ] [MAIN ] Update Progress: 1525/2369 symbols completed. NQP took 20.2s. Estimated remaining: 1h 29m 36s. Rate: 9.4 symbols/min [2025-09-16T19:41:57.811771] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-16T19:41:57.837408] [INFO ] [MAIN ] NRG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:41:57.877059] [DEBUG] [LOCAL ] NRG: Loaded 39072 existing records from primary storage. [2025-09-16T19:41:57.877212] [INFO ] [MAIN ] NRG: Loaded 39072 existing records. [2025-09-16T19:41:57.979991] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-09. [2025-09-16T19:41:58.069910] [WARN ] [MAIN ] NRG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:41:58.070196] [INFO ] [MAIN ] NRG: Wiping existing primary data before full refresh. [2025-09-16T19:41:58.070246] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-09-16T19:41:58.071192] [DEBUG] [LOCAL ] NRG: Deleted primary data file. [2025-09-16T19:41:58.071247] [INFO ] [MAIN ] NRG: Starting full primary refresh. [2025-09-16T19:41:58.422208] [INFO ] [REMOTE ] NRG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:41:58.774926] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-06. [2025-09-16T19:41:59.453544] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-16T19:41:59.458175] [INFO ] [REMOTE ] NPWR: Full fetch complete (45889 records). [2025-09-16T19:41:59.458284] [DEBUG] [VALIDATOR ] NPWR: Validating primary data. [2025-09-16T19:41:59.580027] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-06. [2025-09-16T19:41:59.843239] [DEBUG] [VALIDATOR ] NPWR: All expected trading days are present. [2025-09-16T19:41:59.843324] [DEBUG] [VALIDATOR ] NPWR: Primary data validation passed. [2025-09-16T19:41:59.844103] [INFO ] [MAIN ] NPWR: Fetched primary data is valid. [2025-09-16T19:41:59.844151] [DEBUG] [LOCAL ] NPWR: Saving primary data. [2025-09-16T19:41:59.845258] [DEBUG] [LOCAL ] NPWR: Trimmed 45889 records to 32076 (keeping 150 days of data) [2025-09-16T19:42:00.034566] [DEBUG] [LOCAL ] NPWR: Primary data saved (32076 records). [2025-09-16T19:42:00.034785] [INFO ] [MAIN ] NPWR: Full history saved. [2025-09-16T19:42:00.035540] [INFO ] [MAIN ] Update Progress: 1526/2369 symbols completed. NPWR took 30.1s. Estimated remaining: 1h 29m 28s. Rate: 9.4 symbols/min [2025-09-16T19:42:00.218037] [INFO ] [MAIN ] NRGV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:42:00.252147] [DEBUG] [LOCAL ] NRGV: Loaded 30946 existing records from primary storage. [2025-09-16T19:42:00.252286] [INFO ] [MAIN ] NRGV: Loaded 30946 existing records. [2025-09-16T19:42:00.380188] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-02. [2025-09-16T19:42:00.435023] [WARN ] [MAIN ] NRGV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:42:00.436525] [INFO ] [MAIN ] NRGV: Wiping existing primary data before full refresh. [2025-09-16T19:42:00.436724] [INFO ] [LOCAL ] NRGV: Starting deletion of primary data. [2025-09-16T19:42:00.443461] [DEBUG] [LOCAL ] NRGV: Deleted primary data file. [2025-09-16T19:42:00.444338] [INFO ] [MAIN ] NRGV: Starting full primary refresh. [2025-09-16T19:42:00.456491] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-16T19:42:00.807659] [INFO ] [REMOTE ] NRGV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:42:00.829599] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-16T19:42:01.174899] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-02. [2025-09-16T19:42:01.974957] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-07. [2025-09-16T19:42:02.275690] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-16T19:42:02.593778] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-16T19:42:02.774915] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-03. [2025-09-16T19:42:02.828081] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-16T19:42:03.574916] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-03. [2025-09-16T19:42:04.374909] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-07. [2025-09-16T19:42:04.654593] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-16T19:42:04.731352] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-16T19:42:05.174927] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-04. [2025-09-16T19:42:05.432072] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-16T19:42:05.974940] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-08. [2025-09-16T19:42:06.673248] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-16T19:42:06.774900] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-08. [2025-09-16T19:42:06.907023] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-16T19:42:07.574988] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-05. [2025-09-16T19:42:08.203222] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-16T19:42:08.374917] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-09. [2025-09-16T19:42:09.059828] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-16T19:42:09.061417] [INFO ] [REMOTE ] NREF: Full fetch complete (8274 records). [2025-09-16T19:42:09.061485] [DEBUG] [VALIDATOR ] NREF: Validating primary data. [2025-09-16T19:42:09.179984] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-09. [2025-09-16T19:42:09.422089] [DEBUG] [VALIDATOR ] NREF: All expected trading days are present. [2025-09-16T19:42:09.422185] [DEBUG] [VALIDATOR ] NREF: Primary data validation passed. [2025-09-16T19:42:09.422506] [INFO ] [MAIN ] NREF: Fetched primary data is valid. [2025-09-16T19:42:09.422589] [DEBUG] [LOCAL ] NREF: Saving primary data. [2025-09-16T19:42:09.423083] [DEBUG] [LOCAL ] NREF: Trimmed 8274 records to 5655 (keeping 150 days of data) [2025-09-16T19:42:09.458344] [DEBUG] [LOCAL ] NREF: Primary data saved (5655 records). [2025-09-16T19:42:09.458509] [INFO ] [MAIN ] NREF: Full history saved. [2025-09-16T19:42:09.458625] [INFO ] [MAIN ] Update Progress: 1527/2369 symbols completed. NREF took 21.6s. Estimated remaining: 1h 29m 23s. Rate: 9.4 symbols/min [2025-09-16T19:42:09.631619] [INFO ] [MAIN ] NRK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:42:09.646148] [DEBUG] [LOCAL ] NRK: Loaded 14847 existing records from primary storage. [2025-09-16T19:42:09.646259] [INFO ] [MAIN ] NRK: Loaded 14847 existing records. [2025-09-16T19:42:09.837305] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-16T19:42:09.885714] [WARN ] [MAIN ] NRK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:42:09.885964] [INFO ] [MAIN ] NRK: Wiping existing primary data before full refresh. [2025-09-16T19:42:09.886010] [INFO ] [LOCAL ] NRK: Starting deletion of primary data. [2025-09-16T19:42:09.886473] [DEBUG] [LOCAL ] NRK: Deleted primary data file. [2025-09-16T19:42:09.886519] [INFO ] [MAIN ] NRK: Starting full primary refresh. [2025-09-16T19:42:09.982121] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-04. [2025-09-16T19:42:10.234538] [INFO ] [REMOTE ] NRK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:42:10.452520] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-16T19:42:10.456256] [INFO ] [REMOTE ] NRDY: Full fetch complete (36910 records). [2025-09-16T19:42:10.456335] [DEBUG] [VALIDATOR ] NRDY: Validating primary data. [2025-09-16T19:42:10.780085] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-06. [2025-09-16T19:42:10.828592] [DEBUG] [VALIDATOR ] NRDY: All expected trading days are present. [2025-09-16T19:42:10.828707] [DEBUG] [VALIDATOR ] NRDY: Primary data validation passed. [2025-09-16T19:42:10.829481] [INFO ] [MAIN ] NRDY: Fetched primary data is valid. [2025-09-16T19:42:10.829527] [DEBUG] [LOCAL ] NRDY: Saving primary data. [2025-09-16T19:42:10.830592] [DEBUG] [LOCAL ] NRDY: Trimmed 36910 records to 24025 (keeping 150 days of data) [2025-09-16T19:42:10.969123] [DEBUG] [LOCAL ] NRDY: Primary data saved (24025 records). [2025-09-16T19:42:10.969269] [INFO ] [MAIN ] NRDY: Full history saved. [2025-09-16T19:42:10.969372] [INFO ] [MAIN ] Update Progress: 1528/2369 symbols completed. NRDY took 27.8s. Estimated remaining: 1h 29m 14s. Rate: 9.4 symbols/min [2025-09-16T19:42:11.149679] [INFO ] [MAIN ] NRP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:42:11.154435] [DEBUG] [LOCAL ] NRP: Loaded 2777 existing records from primary storage. [2025-09-16T19:42:11.154544] [INFO ] [MAIN ] NRP: Loaded 2777 existing records. [2025-09-16T19:42:11.327940] [WARN ] [MAIN ] NRP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:42:11.328220] [INFO ] [MAIN ] NRP: Wiping existing primary data before full refresh. [2025-09-16T19:42:11.328280] [INFO ] [LOCAL ] NRP: Starting deletion of primary data. [2025-09-16T19:42:11.328483] [DEBUG] [LOCAL ] NRP: Deleted primary data file. [2025-09-16T19:42:11.328525] [INFO ] [MAIN ] NRP: Starting full primary refresh. [2025-09-16T19:42:11.578159] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-02. [2025-09-16T19:42:11.684738] [INFO ] [REMOTE ] NRP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:42:11.745633] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-16T19:42:12.374969] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-05. [2025-09-16T19:42:12.790353] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-16T19:42:12.986406] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-16T19:42:13.174926] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-02. [2025-09-16T19:42:13.596994] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-16T19:42:13.699914] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-16T19:42:13.974884] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-03. [2025-09-16T19:42:14.410616] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-16T19:42:14.774943] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-04. [2025-09-16T19:42:15.364990] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-16T19:42:15.574925] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-07. [2025-09-16T19:42:16.375015] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-06. [2025-09-16T19:42:17.174939] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-05. [2025-09-16T19:42:17.568563] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-16T19:42:17.757177] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-16T19:42:17.865860] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-16T19:42:17.974856] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-07. [2025-09-16T19:42:18.774935] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-03. [2025-09-16T19:42:19.574907] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-06. [2025-09-16T19:42:19.626017] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-16T19:42:19.694298] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-16T19:42:20.145012] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-16T19:42:20.375018] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-07. [2025-09-16T19:42:20.934188] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-16T19:42:21.174972] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-08. [2025-09-16T19:42:21.974977] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-04. [2025-09-16T19:42:22.775024] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-08. [2025-09-16T19:42:22.885839] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-16T19:42:23.000579] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-16T19:42:23.574956] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-08. [2025-09-16T19:42:23.993921] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-16T19:42:24.374943] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-05. [2025-09-16T19:42:24.684262] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-16T19:42:25.174955] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-09. [2025-09-16T19:42:25.625063] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-16T19:42:25.974894] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-06. [2025-09-16T19:42:26.080861] [DEBUG] [REMOTE ] NRK: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-09-16T19:42:26.081155] [WARN ] [REMOTE ] NRK: No data returned for month 2025-06 [2025-09-16T19:42:26.686500] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-16T19:42:26.696087] [INFO ] [REMOTE ] NRG: Full fetch complete (57597 records). [2025-09-16T19:42:26.696275] [DEBUG] [VALIDATOR ] NRG: Validating primary data. [2025-09-16T19:42:26.779989] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-07. [2025-09-16T19:42:27.088954] [DEBUG] [VALIDATOR ] NRG: All expected trading days are present. [2025-09-16T19:42:27.089056] [DEBUG] [VALIDATOR ] NRG: Primary data validation passed. [2025-09-16T19:42:27.090184] [INFO ] [MAIN ] NRG: Fetched primary data is valid. [2025-09-16T19:42:27.090243] [DEBUG] [LOCAL ] NRG: Saving primary data. [2025-09-16T19:42:27.091566] [DEBUG] [LOCAL ] NRG: Trimmed 57597 records to 39448 (keeping 150 days of data) [2025-09-16T19:42:27.360352] [DEBUG] [LOCAL ] NRG: Primary data saved (39448 records). [2025-09-16T19:42:27.360553] [INFO ] [MAIN ] NRG: Full history saved. [2025-09-16T19:42:27.360744] [INFO ] [MAIN ] Update Progress: 1529/2369 symbols completed. NRG took 29.7s. Estimated remaining: 1h 29m 13s. Rate: 9.4 symbols/min [2025-09-16T19:42:27.545193] [INFO ] [MAIN ] NRT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:42:27.551504] [DEBUG] [LOCAL ] NRT: Loaded 3659 existing records from primary storage. [2025-09-16T19:42:27.551662] [INFO ] [MAIN ] NRT: Loaded 3659 existing records. [2025-09-16T19:42:27.582965] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-09. [2025-09-16T19:42:27.742350] [WARN ] [MAIN ] NRT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:42:27.742589] [INFO ] [MAIN ] NRT: Wiping existing primary data before full refresh. [2025-09-16T19:42:27.742672] [INFO ] [LOCAL ] NRT: Starting deletion of primary data. [2025-09-16T19:42:27.742890] [DEBUG] [LOCAL ] NRT: Deleted primary data file. [2025-09-16T19:42:27.742945] [INFO ] [MAIN ] NRT: Starting full primary refresh. [2025-09-16T19:42:28.102574] [INFO ] [REMOTE ] NRT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:42:28.116554] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-16T19:42:28.374900] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-08. [2025-09-16T19:42:29.083942] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-16T19:42:29.089856] [INFO ] [REMOTE ] NRGV: Full fetch complete (45649 records). [2025-09-16T19:42:29.090007] [DEBUG] [VALIDATOR ] NRGV: Validating primary data. [2025-09-16T19:42:29.180069] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-09. [2025-09-16T19:42:29.494821] [DEBUG] [VALIDATOR ] NRGV: All expected trading days are present. [2025-09-16T19:42:29.495073] [DEBUG] [VALIDATOR ] NRGV: Primary data validation passed. [2025-09-16T19:42:29.496146] [INFO ] [MAIN ] NRGV: Fetched primary data is valid. [2025-09-16T19:42:29.496240] [DEBUG] [LOCAL ] NRGV: Saving primary data. [2025-09-16T19:42:29.512104] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-16T19:42:29.512578] [DEBUG] [LOCAL ] NRGV: Trimmed 45649 records to 31331 (keeping 150 days of data) [2025-09-16T19:42:29.718410] [DEBUG] [LOCAL ] NRGV: Primary data saved (31331 records). [2025-09-16T19:42:29.718559] [INFO ] [MAIN ] NRGV: Full history saved. [2025-09-16T19:42:29.719308] [INFO ] [MAIN ] Update Progress: 1530/2369 symbols completed. NRGV took 29.7s. Estimated remaining: 1h 29m 5s. Rate: 9.4 symbols/min [2025-09-16T19:42:29.901406] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-16T19:42:29.902975] [INFO ] [MAIN ] NRUC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:42:29.904571] [INFO ] [REMOTE ] NRP: Full fetch complete (4583 records). [2025-09-16T19:42:29.904707] [DEBUG] [VALIDATOR ] NRP: Validating primary data. [2025-09-16T19:42:29.974977] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-09. [2025-09-16T19:42:30.001828] [DEBUG] [LOCAL ] NRUC: Loaded 2214 existing records from primary storage. [2025-09-16T19:42:30.022582] [INFO ] [MAIN ] NRUC: Loaded 2214 existing records. [2025-09-16T19:42:30.408363] [WARN ] [MAIN ] NRUC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:42:30.414430] [INFO ] [MAIN ] NRUC: Wiping existing primary data before full refresh. [2025-09-16T19:42:30.424699] [INFO ] [LOCAL ] NRUC: Starting deletion of primary data. [2025-09-16T19:42:30.440248] [DEBUG] [LOCAL ] NRUC: Deleted primary data file. [2025-09-16T19:42:30.463581] [INFO ] [MAIN ] NRUC: Starting full primary refresh. [2025-09-16T19:42:30.613251] [DEBUG] [VALIDATOR ] NRP: All expected trading days are present. [2025-09-16T19:42:30.613378] [DEBUG] [VALIDATOR ] NRP: Primary data validation passed. [2025-09-16T19:42:30.613519] [INFO ] [MAIN ] NRP: Fetched primary data is valid. [2025-09-16T19:42:30.613568] [DEBUG] [LOCAL ] NRP: Saving primary data. [2025-09-16T19:42:30.635094] [DEBUG] [LOCAL ] NRP: Trimmed 4583 records to 2791 (keeping 150 days of data) [2025-09-16T19:42:30.781920] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-02. [2025-09-16T19:42:30.863631] [DEBUG] [LOCAL ] NRP: Primary data saved (2791 records). [2025-09-16T19:42:30.894268] [INFO ] [MAIN ] NRP: Full history saved. [2025-09-16T19:42:30.897690] [INFO ] [REMOTE ] NRUC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:42:30.897905] [INFO ] [MAIN ] Update Progress: 1531/2369 symbols completed. NRP took 19.9s. Estimated remaining: 1h 28m 56s. Rate: 9.4 symbols/min [2025-09-16T19:42:31.077090] [INFO ] [MAIN ] NSA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:42:31.116150] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-16T19:42:31.119728] [INFO ] [REMOTE ] NRK: Full fetch complete (18117 records). [2025-09-16T19:42:31.119870] [DEBUG] [VALIDATOR ] NRK: Validating primary data. [2025-09-16T19:42:31.236063] [DEBUG] [LOCAL ] NSA: Loaded 33417 existing records from primary storage. [2025-09-16T19:42:31.241803] [INFO ] [MAIN ] NSA: Loaded 33417 existing records. [2025-09-16T19:42:31.411703] [WARN ] [VALIDATOR ] NRK: Validation failed - insufficient historical data. Have 130 unique days, need 150 days [2025-09-16T19:42:31.442076] [FATAL] [MAIN ] NRK: Fetched primary data is invalid. Refusing to save it. [2025-09-16T19:42:31.463722] [WARN ] [MAIN ] NRK: Deleting existing primary and derivative data due to validation failure. [2025-09-16T19:42:31.490291] [INFO ] [LOCAL ] NRK: Starting deletion of primary data. [2025-09-16T19:42:31.510880] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-16T19:42:31.509212] [DEBUG] [LOCAL ] NRK: No primary data file found to delete. [2025-09-16T19:42:31.532273] [INFO ] [LOCAL ] NRK: Starting deletion of derivative data. [2025-09-16T19:42:31.532383] [WARN ] [MAIN ] NSA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:42:31.532631] [INFO ] [MAIN ] NSA: Wiping existing primary data before full refresh. [2025-09-16T19:42:31.532694] [INFO ] [LOCAL ] NSA: Starting deletion of primary data. [2025-09-16T19:42:31.532866] [DEBUG] [LOCAL ] NRK: Deleted derivative data file. [2025-09-16T19:42:31.532972] [INFO ] [MAIN ] Update Progress: 1532/2369 symbols completed. NRK took 22.1s. Estimated remaining: 1h 28m 46s. Rate: 9.4 symbols/min [2025-09-16T19:42:31.576091] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-02. [2025-09-16T19:42:31.564163] [DEBUG] [LOCAL ] NSA: Deleted primary data file. [2025-09-16T19:42:31.609912] [INFO ] [MAIN ] NSA: Starting full primary refresh. [2025-09-16T19:42:31.880525] [INFO ] [MAIN ] NSC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:42:32.110278] [INFO ] [REMOTE ] NSA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:42:32.123408] [DEBUG] [LOCAL ] NSC: Loaded 36140 existing records from primary storage. [2025-09-16T19:42:32.123547] [INFO ] [MAIN ] NSC: Loaded 36140 existing records. [2025-09-16T19:42:32.306624] [WARN ] [MAIN ] NSC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:42:32.306904] [INFO ] [MAIN ] NSC: Wiping existing primary data before full refresh. [2025-09-16T19:42:32.306953] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-09-16T19:42:32.308015] [DEBUG] [LOCAL ] NSC: Deleted primary data file. [2025-09-16T19:42:32.308076] [INFO ] [MAIN ] NSC: Starting full primary refresh. [2025-09-16T19:42:32.380033] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-02. [2025-09-16T19:42:32.591517] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-16T19:42:32.705068] [INFO ] [REMOTE ] NSC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:42:33.174894] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-03. [2025-09-16T19:42:33.721420] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-16T19:42:33.746487] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-16T19:42:33.974863] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-03. [2025-09-16T19:42:34.576909] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-16T19:42:34.774967] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-02. [2025-09-16T19:42:35.574916] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-03. [2025-09-16T19:42:36.373758] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-16T19:42:36.382728] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-04. [2025-09-16T19:42:37.040620] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-16T19:42:37.152729] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-16T19:42:37.174848] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-04. [2025-09-16T19:42:37.974917] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-03. [2025-09-16T19:42:38.774902] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-05. [2025-09-16T19:42:38.873613] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-16T19:42:39.182411] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-16T19:42:39.574920] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-04. [2025-09-16T19:42:39.806453] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-16T19:42:40.145746] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-16T19:42:40.374874] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-05. [2025-09-16T19:42:40.931900] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-16T19:42:41.174898] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-05. [2025-09-16T19:42:41.974981] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-04. [2025-09-16T19:42:42.778224] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-06. [2025-09-16T19:42:42.783897] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-16T19:42:43.478351] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-16T19:42:43.574870] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-06. [2025-09-16T19:42:43.692433] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-16T19:42:44.042702] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-16T19:42:44.374903] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-07. [2025-09-16T19:42:44.831139] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-16T19:42:45.174901] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-06. [2025-09-16T19:42:45.974896] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-07. [2025-09-16T19:42:46.587303] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-16T19:42:46.672048] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-16T19:42:46.774884] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-08. [2025-09-16T19:42:47.291058] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-16T19:42:47.574940] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-09. [2025-09-16T19:42:48.125129] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-16T19:42:48.126865] [INFO ] [REMOTE ] NRUC: Full fetch complete (3702 records). [2025-09-16T19:42:48.126976] [DEBUG] [VALIDATOR ] NRUC: Validating primary data. [2025-09-16T19:42:48.380264] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-05. [2025-09-16T19:42:48.703316] [DEBUG] [VALIDATOR ] NRUC: All expected trading days are present. [2025-09-16T19:42:48.703435] [DEBUG] [VALIDATOR ] NRUC: Primary data validation passed. [2025-09-16T19:42:48.703699] [INFO ] [MAIN ] NRUC: Fetched primary data is valid. [2025-09-16T19:42:48.703775] [DEBUG] [LOCAL ] NRUC: Saving primary data. [2025-09-16T19:42:48.704510] [DEBUG] [LOCAL ] NRUC: Trimmed 3702 records to 2230 (keeping 150 days of data) [2025-09-16T19:42:48.728384] [DEBUG] [LOCAL ] NRUC: Primary data saved (2230 records). [2025-09-16T19:42:48.728578] [INFO ] [MAIN ] NRUC: Full history saved. [2025-09-16T19:42:48.728780] [INFO ] [MAIN ] Update Progress: 1533/2369 symbols completed. NRUC took 19.0s. Estimated remaining: 1h 28m 46s. Rate: 9.4 symbols/min [2025-09-16T19:42:48.905941] [INFO ] [MAIN ] NSP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:42:48.936436] [DEBUG] [LOCAL ] NSP: Loaded 26270 existing records from primary storage. [2025-09-16T19:42:48.936593] [INFO ] [MAIN ] NSP: Loaded 26270 existing records. [2025-09-16T19:42:49.156533] [WARN ] [MAIN ] NSP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:42:49.156855] [INFO ] [MAIN ] NSP: Wiping existing primary data before full refresh. [2025-09-16T19:42:49.156920] [INFO ] [LOCAL ] NSP: Starting deletion of primary data. [2025-09-16T19:42:49.157692] [DEBUG] [LOCAL ] NSP: Deleted primary data file. [2025-09-16T19:42:49.157754] [INFO ] [MAIN ] NSP: Starting full primary refresh. [2025-09-16T19:42:49.179986] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-08. [2025-09-16T19:42:49.517344] [INFO ] [REMOTE ] NSP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:42:49.975000] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-07. [2025-09-16T19:42:50.040386] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-16T19:42:50.175489] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-16T19:42:50.774915] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-06. [2025-09-16T19:42:51.408403] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-16T19:42:51.574914] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-08. [2025-09-16T19:42:52.362327] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-16T19:42:52.374841] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-07. [2025-09-16T19:42:53.176564] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-16T19:42:53.174894] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-02. [2025-09-16T19:42:53.974932] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-09. [2025-09-16T19:42:54.198464] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-16T19:42:54.503185] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-16T19:42:54.504406] [INFO ] [REMOTE ] NRT: Full fetch complete (5411 records). [2025-09-16T19:42:54.504479] [DEBUG] [VALIDATOR ] NRT: Validating primary data. [2025-09-16T19:42:54.777731] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-08. [2025-09-16T19:42:54.788278] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-16T19:42:54.919008] [DEBUG] [VALIDATOR ] NRT: All expected trading days are present. [2025-09-16T19:42:54.919108] [DEBUG] [VALIDATOR ] NRT: Primary data validation passed. [2025-09-16T19:42:54.919324] [INFO ] [MAIN ] NRT: Fetched primary data is valid. [2025-09-16T19:42:54.919367] [DEBUG] [LOCAL ] NRT: Saving primary data. [2025-09-16T19:42:54.919823] [DEBUG] [LOCAL ] NRT: Trimmed 5411 records to 3683 (keeping 150 days of data) [2025-09-16T19:42:54.941868] [DEBUG] [LOCAL ] NRT: Primary data saved (3683 records). [2025-09-16T19:42:54.942002] [INFO ] [MAIN ] NRT: Full history saved. [2025-09-16T19:42:54.942087] [INFO ] [MAIN ] Update Progress: 1534/2369 symbols completed. NRT took 27.6s. Estimated remaining: 1h 28m 39s. Rate: 9.4 symbols/min [2025-09-16T19:42:55.117093] [INFO ] [MAIN ] NTB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:42:55.133742] [DEBUG] [LOCAL ] NTB: Loaded 14614 existing records from primary storage. [2025-09-16T19:42:55.133918] [INFO ] [MAIN ] NTB: Loaded 14614 existing records. [2025-09-16T19:42:55.318107] [WARN ] [MAIN ] NTB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:42:55.318460] [INFO ] [MAIN ] NTB: Wiping existing primary data before full refresh. [2025-09-16T19:42:55.318511] [INFO ] [LOCAL ] NTB: Starting deletion of primary data. [2025-09-16T19:42:55.319178] [DEBUG] [LOCAL ] NTB: Deleted primary data file. [2025-09-16T19:42:55.319230] [INFO ] [MAIN ] NTB: Starting full primary refresh. [2025-09-16T19:42:55.580018] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-03. [2025-09-16T19:42:55.688760] [INFO ] [REMOTE ] NTB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:42:56.374925] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-02. [2025-09-16T19:42:56.545438] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-16T19:42:57.045948] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-16T19:42:57.115453] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-16T19:42:57.174882] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-09. [2025-09-16T19:42:57.974945] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-03. [2025-09-16T19:42:58.774891] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-09. [2025-09-16T19:42:58.963152] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-16T19:42:58.969150] [INFO ] [REMOTE ] NSC: Full fetch complete (53513 records). [2025-09-16T19:42:58.969260] [DEBUG] [VALIDATOR ] NSC: Validating primary data. [2025-09-16T19:42:59.369602] [DEBUG] [VALIDATOR ] NSC: All expected trading days are present. [2025-09-16T19:42:59.369748] [DEBUG] [VALIDATOR ] NSC: Primary data validation passed. [2025-09-16T19:42:59.383553] [INFO ] [MAIN ] NSC: Fetched primary data is valid. [2025-09-16T19:42:59.384757] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-16T19:42:59.384168] [DEBUG] [LOCAL ] NSC: Saving primary data. [2025-09-16T19:42:59.391037] [DEBUG] [LOCAL ] NSC: Trimmed 53513 records to 36514 (keeping 150 days of data) [2025-09-16T19:42:59.577866] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-04. [2025-09-16T19:42:59.631240] [DEBUG] [LOCAL ] NSC: Primary data saved (36514 records). [2025-09-16T19:42:59.631395] [INFO ] [MAIN ] NSC: Full history saved. [2025-09-16T19:42:59.631496] [INFO ] [MAIN ] Update Progress: 1535/2369 symbols completed. NSC took 28.1s. Estimated remaining: 1h 28m 32s. Rate: 9.4 symbols/min [2025-09-16T19:42:59.801636] [INFO ] [MAIN ] NTEST: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:42:59.801837] [DEBUG] [LOCAL ] NTEST: No existing data file found in primary storage. [2025-09-16T19:42:59.801884] [WARN ] [MAIN ] NTEST: No existing data found, performing full refresh instead. [2025-09-16T19:42:59.802023] [INFO ] [MAIN ] NTEST: Wiping existing primary data before full refresh. [2025-09-16T19:42:59.802061] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-09-16T19:42:59.802101] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-09-16T19:42:59.802184] [INFO ] [MAIN ] NTEST: Starting full primary refresh. [2025-09-16T19:43:00.161098] [INFO ] [REMOTE ] NTEST: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:43:00.176710] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-16T19:43:00.182471] [INFO ] [REMOTE ] NSA: Full fetch complete (47961 records). [2025-09-16T19:43:00.182582] [DEBUG] [VALIDATOR ] NSA: Validating primary data. [2025-09-16T19:43:00.384949] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-02. [2025-09-16T19:43:00.565501] [DEBUG] [VALIDATOR ] NSA: All expected trading days are present. [2025-09-16T19:43:00.565583] [DEBUG] [VALIDATOR ] NSA: Primary data validation passed. [2025-09-16T19:43:00.566367] [INFO ] [MAIN ] NSA: Fetched primary data is valid. [2025-09-16T19:43:00.566413] [DEBUG] [LOCAL ] NSA: Saving primary data. [2025-09-16T19:43:00.567501] [DEBUG] [LOCAL ] NSA: Trimmed 47961 records to 33725 (keeping 150 days of data) [2025-09-16T19:43:00.779888] [DEBUG] [LOCAL ] NSA: Primary data saved (33725 records). [2025-09-16T19:43:00.780039] [INFO ] [MAIN ] NSA: Full history saved. [2025-09-16T19:43:00.780127] [INFO ] [MAIN ] Update Progress: 1536/2369 symbols completed. NSA took 29.9s. Estimated remaining: 1h 28m 23s. Rate: 9.4 symbols/min [2025-09-16T19:43:00.950803] [INFO ] [MAIN ] NTR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:43:00.986719] [DEBUG] [LOCAL ] NTR: Loaded 38745 existing records from primary storage. [2025-09-16T19:43:00.986862] [INFO ] [MAIN ] NTR: Loaded 38745 existing records. [2025-09-16T19:43:01.167325] [WARN ] [MAIN ] NTR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:43:01.167794] [INFO ] [MAIN ] NTR: Wiping existing primary data before full refresh. [2025-09-16T19:43:01.167852] [INFO ] [LOCAL ] NTR: Starting deletion of primary data. [2025-09-16T19:43:01.175105] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-04. [2025-09-16T19:43:01.181043] [DEBUG] [LOCAL ] NTR: Deleted primary data file. [2025-09-16T19:43:01.189340] [INFO ] [MAIN ] NTR: Starting full primary refresh. [2025-09-16T19:43:01.273905] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-16T19:43:01.293192] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-16T19:43:01.575335] [INFO ] [REMOTE ] NTR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:43:01.974866] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-05. [2025-09-16T19:43:02.372096] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-16T19:43:02.774906] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-05. [2025-09-16T19:43:03.191263] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-16T19:43:03.527189] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-16T19:43:03.574850] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-06. [2025-09-16T19:43:04.374896] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-06. [2025-09-16T19:43:04.655785] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-16T19:43:05.174875] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-02. [2025-09-16T19:43:05.632055] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-16T19:43:05.974954] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-07. [2025-09-16T19:43:06.774903] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-07. [2025-09-16T19:43:06.829436] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-16T19:43:06.966269] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-16T19:43:07.574958] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-03. [2025-09-16T19:43:07.751092] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-16T19:43:08.374891] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-03. [2025-09-16T19:43:08.786018] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-16T19:43:09.100106] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-16T19:43:09.174901] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-04. [2025-09-16T19:43:09.974966] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-04. [2025-09-16T19:43:10.454853] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-16T19:43:10.585295] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-16T19:43:10.774979] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-08. [2025-09-16T19:43:11.574933] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-05. [2025-09-16T19:43:11.608907] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-16T19:43:12.374944] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-05. [2025-09-16T19:43:13.174859] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-09. [2025-09-16T19:43:13.254538] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-16T19:43:13.341701] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-16T19:43:13.974900] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-06. [2025-09-16T19:43:14.040349] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-16T19:43:14.043970] [INFO ] [REMOTE ] NTB: Full fetch complete (22929 records). [2025-09-16T19:43:14.044075] [DEBUG] [VALIDATOR ] NTB: Validating primary data. [2025-09-16T19:43:14.423631] [DEBUG] [VALIDATOR ] NTB: All expected trading days are present. [2025-09-16T19:43:14.423731] [DEBUG] [VALIDATOR ] NTB: Primary data validation passed. [2025-09-16T19:43:14.424307] [INFO ] [MAIN ] NTB: Fetched primary data is valid. [2025-09-16T19:43:14.424351] [DEBUG] [LOCAL ] NTB: Saving primary data. [2025-09-16T19:43:14.425052] [DEBUG] [LOCAL ] NTB: Trimmed 22929 records to 14787 (keeping 150 days of data) [2025-09-16T19:43:14.496227] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-16T19:43:14.522696] [DEBUG] [LOCAL ] NTB: Primary data saved (14787 records). [2025-09-16T19:43:14.522850] [INFO ] [MAIN ] NTB: Full history saved. [2025-09-16T19:43:14.522936] [INFO ] [MAIN ] Update Progress: 1537/2369 symbols completed. NTB took 19.6s. Estimated remaining: 1h 28m 20s. Rate: 9.4 symbols/min [2025-09-16T19:43:14.697558] [INFO ] [MAIN ] NTST: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:43:14.732249] [DEBUG] [LOCAL ] NTST: Loaded 31978 existing records from primary storage. [2025-09-16T19:43:14.732395] [INFO ] [MAIN ] NTST: Loaded 31978 existing records. [2025-09-16T19:43:14.780064] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-06. [2025-09-16T19:43:14.921191] [WARN ] [MAIN ] NTST: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:43:14.921450] [INFO ] [MAIN ] NTST: Wiping existing primary data before full refresh. [2025-09-16T19:43:14.921499] [INFO ] [LOCAL ] NTST: Starting deletion of primary data. [2025-09-16T19:43:14.922348] [DEBUG] [LOCAL ] NTST: Deleted primary data file. [2025-09-16T19:43:14.922401] [INFO ] [MAIN ] NTST: Starting full primary refresh. [2025-09-16T19:43:15.272937] [INFO ] [REMOTE ] NTST: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:43:15.574907] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-07. [2025-09-16T19:43:16.211817] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-16T19:43:16.374965] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-08. [2025-09-16T19:43:16.577818] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-16T19:43:16.877383] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-16T19:43:17.174912] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-02. [2025-09-16T19:43:17.974917] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-07. [2025-09-16T19:43:18.617099] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-16T19:43:18.774926] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-08. [2025-09-16T19:43:19.497429] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-16T19:43:19.574856] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-08. [2025-09-16T19:43:20.258855] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-16T19:43:20.374921] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-09. [2025-09-16T19:43:20.901759] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-16T19:43:20.914750] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-16T19:43:20.915878] [INFO ] [REMOTE ] NTEST: Full fetch complete (1670 records). [2025-09-16T19:43:20.916054] [DEBUG] [VALIDATOR ] NTEST: Validating primary data. [2025-09-16T19:43:21.102994] [WARN ] [VALIDATOR ] NTEST: Validation failed - insufficient historical data. Have 134 unique days, need 150 days [2025-09-16T19:43:21.103218] [FATAL] [MAIN ] NTEST: Fetched primary data is invalid. Refusing to save it. [2025-09-16T19:43:21.103288] [WARN ] [MAIN ] NTEST: Deleting existing primary and derivative data due to validation failure. [2025-09-16T19:43:21.103356] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-09-16T19:43:21.103424] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-09-16T19:43:21.103461] [INFO ] [LOCAL ] NTEST: Starting deletion of derivative data. [2025-09-16T19:43:21.103525] [DEBUG] [LOCAL ] NTEST: No derivative data file found to delete. [2025-09-16T19:43:21.103590] [INFO ] [MAIN ] Update Progress: 1538/2369 symbols completed. NTEST took 21.5s. Estimated remaining: 1h 28m 14s. Rate: 9.4 symbols/min [2025-09-16T19:43:21.179987] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-03. [2025-09-16T19:43:21.279876] [INFO ] [MAIN ] NU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:43:21.318740] [DEBUG] [LOCAL ] NU: Loaded 39706 existing records from primary storage. [2025-09-16T19:43:21.318890] [INFO ] [MAIN ] NU: Loaded 39706 existing records. [2025-09-16T19:43:21.496724] [WARN ] [MAIN ] NU: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:43:21.497010] [INFO ] [MAIN ] NU: Wiping existing primary data before full refresh. [2025-09-16T19:43:21.497060] [INFO ] [LOCAL ] NU: Starting deletion of primary data. [2025-09-16T19:43:21.498036] [DEBUG] [LOCAL ] NU: Deleted primary data file. [2025-09-16T19:43:21.498088] [INFO ] [MAIN ] NU: Starting full primary refresh. [2025-09-16T19:43:21.847367] [INFO ] [REMOTE ] NU: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:43:21.974887] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-09. [2025-09-16T19:43:22.760542] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-16T19:43:22.774856] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-04. [2025-09-16T19:43:23.574920] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-02. [2025-09-16T19:43:23.855390] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-16T19:43:23.863134] [INFO ] [REMOTE ] NTR: Full fetch complete (57262 records). [2025-09-16T19:43:23.863396] [DEBUG] [VALIDATOR ] NTR: Validating primary data. [2025-09-16T19:43:24.256579] [DEBUG] [VALIDATOR ] NTR: All expected trading days are present. [2025-09-16T19:43:24.256676] [DEBUG] [VALIDATOR ] NTR: Primary data validation passed. [2025-09-16T19:43:24.257521] [INFO ] [MAIN ] NTR: Fetched primary data is valid. [2025-09-16T19:43:24.257564] [DEBUG] [LOCAL ] NTR: Saving primary data. [2025-09-16T19:43:24.258773] [DEBUG] [LOCAL ] NTR: Trimmed 57262 records to 39127 (keeping 150 days of data) [2025-09-16T19:43:24.383252] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-09. [2025-09-16T19:43:24.495127] [DEBUG] [LOCAL ] NTR: Primary data saved (39127 records). [2025-09-16T19:43:24.495367] [INFO ] [MAIN ] NTR: Full history saved. [2025-09-16T19:43:24.495502] [INFO ] [MAIN ] Update Progress: 1539/2369 symbols completed. NTR took 23.7s. Estimated remaining: 1h 28m 6s. Rate: 9.4 symbols/min [2025-09-16T19:43:24.673515] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-16T19:43:24.708115] [INFO ] [MAIN ] NUE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:43:24.708686] [DEBUG] [LOCAL ] NUE: No existing data file found in primary storage. [2025-09-16T19:43:24.708729] [WARN ] [MAIN ] NUE: No existing data found, performing full refresh instead. [2025-09-16T19:43:24.708848] [INFO ] [MAIN ] NUE: Wiping existing primary data before full refresh. [2025-09-16T19:43:24.708887] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-09-16T19:43:24.708929] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-09-16T19:43:24.708962] [INFO ] [MAIN ] NUE: Starting full primary refresh. [2025-09-16T19:43:25.058891] [INFO ] [REMOTE ] NUE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:43:25.174895] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-02. [2025-09-16T19:43:25.857072] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-09-16T19:43:25.878881] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-16T19:43:25.883400] [INFO ] [REMOTE ] NSP: Full fetch complete (37899 records). [2025-09-16T19:43:25.883479] [DEBUG] [VALIDATOR ] NSP: Validating primary data. [2025-09-16T19:43:25.981599] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-05. [2025-09-16T19:43:26.255742] [DEBUG] [VALIDATOR ] NSP: All expected trading days are present. [2025-09-16T19:43:26.255822] [DEBUG] [VALIDATOR ] NSP: Primary data validation passed. [2025-09-16T19:43:26.256498] [INFO ] [MAIN ] NSP: Fetched primary data is valid. [2025-09-16T19:43:26.256539] [DEBUG] [LOCAL ] NSP: Saving primary data. [2025-09-16T19:43:26.257361] [DEBUG] [LOCAL ] NSP: Trimmed 37899 records to 26492 (keeping 150 days of data) [2025-09-16T19:43:26.424069] [DEBUG] [LOCAL ] NSP: Primary data saved (26492 records). [2025-09-16T19:43:26.424215] [INFO ] [MAIN ] NSP: Full history saved. [2025-09-16T19:43:26.424313] [INFO ] [MAIN ] Update Progress: 1540/2369 symbols completed. NSP took 37.7s. Estimated remaining: 1h 27m 57s. Rate: 9.4 symbols/min [2025-09-16T19:43:26.596532] [INFO ] [MAIN ] NUS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:43:26.624882] [DEBUG] [LOCAL ] NUS: Loaded 26383 existing records from primary storage. [2025-09-16T19:43:26.625022] [INFO ] [MAIN ] NUS: Loaded 26383 existing records. [2025-09-16T19:43:26.782905] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-03. [2025-09-16T19:43:26.801375] [WARN ] [MAIN ] NUS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:43:26.802366] [INFO ] [MAIN ] NUS: Wiping existing primary data before full refresh. [2025-09-16T19:43:26.802416] [INFO ] [LOCAL ] NUS: Starting deletion of primary data. [2025-09-16T19:43:26.803004] [DEBUG] [LOCAL ] NUS: Deleted primary data file. [2025-09-16T19:43:26.803072] [INFO ] [MAIN ] NUS: Starting full primary refresh. [2025-09-16T19:43:27.162782] [INFO ] [REMOTE ] NUS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:43:27.191198] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-16T19:43:27.461062] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-16T19:43:27.574910] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-06. [2025-09-16T19:43:28.374904] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-02. [2025-09-16T19:43:28.795072] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-16T19:43:28.976318] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-16T19:43:29.174902] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-04. [2025-09-16T19:43:29.619669] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-16T19:43:29.974898] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-03. [2025-09-16T19:43:30.774903] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-03. [2025-09-16T19:43:31.161563] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-16T19:43:31.574897] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-05. [2025-09-16T19:43:31.916893] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-16T19:43:31.950112] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-16T19:43:32.374888] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-07. [2025-09-16T19:43:33.174899] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-04. [2025-09-16T19:43:33.674923] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-16T19:43:33.948063] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-16T19:43:33.974858] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-08. [2025-09-16T19:43:34.561804] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-16T19:43:34.774902] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-04. [2025-09-16T19:43:35.399082] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-16T19:43:35.574899] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-09. [2025-09-16T19:43:36.374932] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-06. [2025-09-16T19:43:36.574000] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-16T19:43:36.932204] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-16T19:43:36.938058] [INFO ] [REMOTE ] NTST: Full fetch complete (46630 records). [2025-09-16T19:43:36.938176] [DEBUG] [VALIDATOR ] NTST: Validating primary data. [2025-09-16T19:43:37.180089] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-05. [2025-09-16T19:43:37.336517] [DEBUG] [VALIDATOR ] NTST: All expected trading days are present. [2025-09-16T19:43:37.336597] [DEBUG] [VALIDATOR ] NTST: Primary data validation passed. [2025-09-16T19:43:37.337365] [INFO ] [MAIN ] NTST: Fetched primary data is valid. [2025-09-16T19:43:37.337415] [DEBUG] [LOCAL ] NTST: Saving primary data. [2025-09-16T19:43:37.338428] [DEBUG] [LOCAL ] NTST: Trimmed 46630 records to 32324 (keeping 150 days of data) [2025-09-16T19:43:37.545758] [DEBUG] [LOCAL ] NTST: Primary data saved (32324 records). [2025-09-16T19:43:37.545945] [INFO ] [MAIN ] NTST: Full history saved. [2025-09-16T19:43:37.546069] [INFO ] [MAIN ] Update Progress: 1541/2369 symbols completed. NTST took 23.0s. Estimated remaining: 1h 27m 53s. Rate: 9.4 symbols/min [2025-09-16T19:43:37.721525] [INFO ] [MAIN ] NUV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:43:37.737797] [DEBUG] [LOCAL ] NUV: Loaded 16294 existing records from primary storage. [2025-09-16T19:43:37.737923] [INFO ] [MAIN ] NUV: Loaded 16294 existing records. [2025-09-16T19:43:37.915538] [WARN ] [MAIN ] NUV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:43:37.915814] [INFO ] [MAIN ] NUV: Wiping existing primary data before full refresh. [2025-09-16T19:43:37.915861] [INFO ] [LOCAL ] NUV: Starting deletion of primary data. [2025-09-16T19:43:37.916333] [DEBUG] [LOCAL ] NUV: Deleted primary data file. [2025-09-16T19:43:37.916379] [INFO ] [MAIN ] NUV: Starting full primary refresh. [2025-09-16T19:43:37.984556] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-05. [2025-09-16T19:43:38.274983] [INFO ] [REMOTE ] NUV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:43:38.310280] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-16T19:43:38.774922] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-07. [2025-09-16T19:43:38.900548] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-16T19:43:39.073314] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-16T19:43:39.574934] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-06. [2025-09-16T19:43:40.374910] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-02. [2025-09-16T19:43:41.044038] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-16T19:43:41.174925] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-08. [2025-09-16T19:43:41.465378] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-16T19:43:41.499287] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-16T19:43:41.974926] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-07. [2025-09-16T19:43:42.774911] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-06. [2025-09-16T19:43:43.404530] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-16T19:43:43.574909] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-09. [2025-09-16T19:43:43.938496] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-16T19:43:44.126341] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-16T19:43:44.374930] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-03. [2025-09-16T19:43:45.174962] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-07. [2025-09-16T19:43:45.420269] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-16T19:43:45.426843] [INFO ] [REMOTE ] NU: Full fetch complete (58426 records). [2025-09-16T19:43:45.427015] [DEBUG] [VALIDATOR ] NU: Validating primary data. [2025-09-16T19:43:45.622578] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-16T19:43:45.840908] [DEBUG] [VALIDATOR ] NU: All expected trading days are present. [2025-09-16T19:43:45.841014] [DEBUG] [VALIDATOR ] NU: Primary data validation passed. [2025-09-16T19:43:45.842027] [INFO ] [MAIN ] NU: Fetched primary data is valid. [2025-09-16T19:43:45.842086] [DEBUG] [LOCAL ] NU: Saving primary data. [2025-09-16T19:43:45.843356] [DEBUG] [LOCAL ] NU: Trimmed 58426 records to 40096 (keeping 150 days of data) [2025-09-16T19:43:46.016429] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-08. [2025-09-16T19:43:46.088310] [DEBUG] [LOCAL ] NU: Primary data saved (40096 records). [2025-09-16T19:43:46.088457] [INFO ] [MAIN ] NU: Full history saved. [2025-09-16T19:43:46.088543] [INFO ] [MAIN ] Update Progress: 1542/2369 symbols completed. NU took 25.0s. Estimated remaining: 1h 27m 48s. Rate: 9.4 symbols/min [2025-09-16T19:43:46.257461] [INFO ] [MAIN ] NUVB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:43:46.293035] [DEBUG] [LOCAL ] NUVB: Loaded 38079 existing records from primary storage. [2025-09-16T19:43:46.293183] [INFO ] [MAIN ] NUVB: Loaded 38079 existing records. [2025-09-16T19:43:46.472169] [WARN ] [MAIN ] NUVB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:43:46.472600] [INFO ] [MAIN ] NUVB: Wiping existing primary data before full refresh. [2025-09-16T19:43:46.472698] [INFO ] [LOCAL ] NUVB: Starting deletion of primary data. [2025-09-16T19:43:46.480996] [DEBUG] [LOCAL ] NUVB: Deleted primary data file. [2025-09-16T19:43:46.489081] [INFO ] [MAIN ] NUVB: Starting full primary refresh. [2025-09-16T19:43:46.580946] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-16T19:43:46.780086] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-04. [2025-09-16T19:43:46.879593] [INFO ] [REMOTE ] NUVB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:43:47.574916] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-02. [2025-09-16T19:43:47.911031] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-16T19:43:48.046781] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-16T19:43:48.374977] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-05. [2025-09-16T19:43:49.037904] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-16T19:43:49.174988] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-08. [2025-09-16T19:43:49.541159] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-16T19:43:49.974933] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-09. [2025-09-16T19:43:50.648584] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-16T19:43:50.774921] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-06. [2025-09-16T19:43:51.574929] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-09. [2025-09-16T19:43:51.687426] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-16T19:43:51.694568] [INFO ] [REMOTE ] NUE: Full fetch complete (55945 records). [2025-09-16T19:43:51.694740] [DEBUG] [VALIDATOR ] NUE: Validating primary data. [2025-09-16T19:43:51.892078] [WARN ] [VALIDATOR ] NUE: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-16T19:43:51.904207] [FATAL] [MAIN ] NUE: Fetched primary data is invalid. Refusing to save it. [2025-09-16T19:43:51.905377] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-16T19:43:51.904764] [WARN ] [MAIN ] NUE: Deleting existing primary and derivative data due to validation failure. [2025-09-16T19:43:51.909692] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-09-16T19:43:51.910138] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-09-16T19:43:51.910451] [INFO ] [LOCAL ] NUE: Starting deletion of derivative data. [2025-09-16T19:43:51.910498] [DEBUG] [LOCAL ] NUE: No derivative data file found to delete. [2025-09-16T19:43:51.910565] [INFO ] [MAIN ] Update Progress: 1543/2369 symbols completed. NUE took 27.4s. Estimated remaining: 1h 27m 42s. Rate: 9.4 symbols/min [2025-09-16T19:43:52.081115] [INFO ] [MAIN ] NUW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:43:52.088112] [DEBUG] [LOCAL ] NUW: Loaded 5084 existing records from primary storage. [2025-09-16T19:43:52.088302] [INFO ] [MAIN ] NUW: Loaded 5084 existing records. [2025-09-16T19:43:52.268410] [WARN ] [MAIN ] NUW: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:43:52.268732] [INFO ] [MAIN ] NUW: Wiping existing primary data before full refresh. [2025-09-16T19:43:52.268781] [INFO ] [LOCAL ] NUW: Starting deletion of primary data. [2025-09-16T19:43:52.269029] [DEBUG] [LOCAL ] NUW: Deleted primary data file. [2025-09-16T19:43:52.269072] [INFO ] [MAIN ] NUW: Starting full primary refresh. [2025-09-16T19:43:52.380011] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-03. [2025-09-16T19:43:52.620752] [INFO ] [REMOTE ] NUW: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:43:52.855772] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-16T19:43:52.859844] [INFO ] [REMOTE ] NUS: Full fetch complete (40353 records). [2025-09-16T19:43:52.859941] [DEBUG] [VALIDATOR ] NUS: Validating primary data. [2025-09-16T19:43:53.186807] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-07. [2025-09-16T19:43:53.233233] [DEBUG] [VALIDATOR ] NUS: All expected trading days are present. [2025-09-16T19:43:53.233323] [DEBUG] [VALIDATOR ] NUS: Primary data validation passed. [2025-09-16T19:43:53.234105] [INFO ] [MAIN ] NUS: Fetched primary data is valid. [2025-09-16T19:43:53.234169] [DEBUG] [LOCAL ] NUS: Saving primary data. [2025-09-16T19:43:53.235153] [DEBUG] [LOCAL ] NUS: Trimmed 40353 records to 26600 (keeping 150 days of data) [2025-09-16T19:43:53.397331] [DEBUG] [LOCAL ] NUS: Primary data saved (26600 records). [2025-09-16T19:43:53.397493] [INFO ] [MAIN ] NUS: Full history saved. [2025-09-16T19:43:53.397608] [INFO ] [MAIN ] Update Progress: 1544/2369 symbols completed. NUS took 27.0s. Estimated remaining: 1h 27m 33s. Rate: 9.4 symbols/min [2025-09-16T19:43:53.591458] [INFO ] [MAIN ] NVG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:43:53.615150] [DEBUG] [LOCAL ] NVG: Loaded 19940 existing records from primary storage. [2025-09-16T19:43:53.615301] [INFO ] [MAIN ] NVG: Loaded 19940 existing records. [2025-09-16T19:43:53.799937] [WARN ] [MAIN ] NVG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:43:53.800198] [INFO ] [MAIN ] NVG: Wiping existing primary data before full refresh. [2025-09-16T19:43:53.800244] [INFO ] [LOCAL ] NVG: Starting deletion of primary data. [2025-09-16T19:43:53.800820] [DEBUG] [LOCAL ] NVG: Deleted primary data file. [2025-09-16T19:43:53.800868] [INFO ] [MAIN ] NVG: Starting full primary refresh. [2025-09-16T19:43:53.982696] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-02. [2025-09-16T19:43:54.162677] [INFO ] [REMOTE ] NVG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:43:54.181812] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-16T19:43:54.217975] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-16T19:43:54.527386] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-16T19:43:54.774909] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-02. [2025-09-16T19:43:55.574905] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-03. [2025-09-16T19:43:55.915770] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-16T19:43:56.374914] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-08. [2025-09-16T19:43:56.400701] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-16T19:43:57.174926] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-03. [2025-09-16T19:43:57.462588] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-16T19:43:57.974919] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-04. [2025-09-16T19:43:58.430237] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-16T19:43:58.444219] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-16T19:43:58.774948] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-04. [2025-09-16T19:43:59.574910] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-04. [2025-09-16T19:44:00.277380] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-16T19:44:00.374941] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-05. [2025-09-16T19:44:00.838824] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-16T19:44:01.174922] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-05. [2025-09-16T19:44:01.896586] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-16T19:44:01.974978] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-05. [2025-09-16T19:44:02.063979] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-16T19:44:02.774935] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-06. [2025-09-16T19:44:03.067723] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-16T19:44:03.574913] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-06. [2025-09-16T19:44:04.374905] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-06. [2025-09-16T19:44:04.498831] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-16T19:44:04.553724] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-16T19:44:04.902419] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-16T19:44:05.174925] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-09. [2025-09-16T19:44:05.974882] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-07. [2025-09-16T19:44:06.208867] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-16T19:44:06.211854] [INFO ] [REMOTE ] NUV: Full fetch complete (24903 records). [2025-09-16T19:44:06.211940] [DEBUG] [VALIDATOR ] NUV: Validating primary data. [2025-09-16T19:44:06.595863] [DEBUG] [VALIDATOR ] NUV: All expected trading days are present. [2025-09-16T19:44:06.595956] [DEBUG] [VALIDATOR ] NUV: Primary data validation passed. [2025-09-16T19:44:06.596566] [INFO ] [MAIN ] NUV: Fetched primary data is valid. [2025-09-16T19:44:06.596616] [DEBUG] [LOCAL ] NUV: Saving primary data. [2025-09-16T19:44:06.597361] [DEBUG] [LOCAL ] NUV: Trimmed 24903 records to 16417 (keeping 150 days of data) [2025-09-16T19:44:06.698870] [DEBUG] [LOCAL ] NUV: Primary data saved (16417 records). [2025-09-16T19:44:06.699019] [INFO ] [MAIN ] NUV: Full history saved. [2025-09-16T19:44:06.699136] [INFO ] [MAIN ] Update Progress: 1545/2369 symbols completed. NUV took 29.2s. Estimated remaining: 1h 27m 30s. Rate: 9.4 symbols/min [2025-09-16T19:44:06.780078] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-07. [2025-09-16T19:44:06.878499] [INFO ] [MAIN ] NVGS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:44:06.896761] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-16T19:44:06.920494] [DEBUG] [LOCAL ] NVGS: Loaded 23312 existing records from primary storage. [2025-09-16T19:44:06.920657] [INFO ] [MAIN ] NVGS: Loaded 23312 existing records. [2025-09-16T19:44:07.105126] [WARN ] [MAIN ] NVGS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:44:07.105389] [INFO ] [MAIN ] NVGS: Wiping existing primary data before full refresh. [2025-09-16T19:44:07.105495] [INFO ] [LOCAL ] NVGS: Starting deletion of primary data. [2025-09-16T19:44:07.106160] [DEBUG] [LOCAL ] NVGS: Deleted primary data file. [2025-09-16T19:44:07.106210] [INFO ] [MAIN ] NVGS: Starting full primary refresh. [2025-09-16T19:44:07.474895] [INFO ] [REMOTE ] NVGS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:44:07.479934] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-16T19:44:07.574941] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-08. [2025-09-16T19:44:08.374908] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-07. [2025-09-16T19:44:08.809899] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-16T19:44:09.174909] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-08. [2025-09-16T19:44:09.831659] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-16T19:44:09.974916] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-09. [2025-09-16T19:44:10.325512] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-16T19:44:10.420540] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-16T19:44:10.421830] [INFO ] [REMOTE ] NUW: Full fetch complete (8130 records). [2025-09-16T19:44:10.421899] [DEBUG] [VALIDATOR ] NUW: Validating primary data. [2025-09-16T19:44:10.776415] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-08. [2025-09-16T19:44:10.781914] [DEBUG] [VALIDATOR ] NUW: All expected trading days are present. [2025-09-16T19:44:10.782710] [DEBUG] [VALIDATOR ] NUW: Primary data validation passed. [2025-09-16T19:44:10.782944] [INFO ] [MAIN ] NUW: Fetched primary data is valid. [2025-09-16T19:44:10.782984] [DEBUG] [LOCAL ] NUW: Saving primary data. [2025-09-16T19:44:10.783417] [DEBUG] [LOCAL ] NUW: Trimmed 8130 records to 5126 (keeping 150 days of data) [2025-09-16T19:44:10.817020] [DEBUG] [LOCAL ] NUW: Primary data saved (5126 records). [2025-09-16T19:44:10.817147] [INFO ] [MAIN ] NUW: Full history saved. [2025-09-16T19:44:10.817229] [INFO ] [MAIN ] Update Progress: 1546/2369 symbols completed. NUW took 18.9s. Estimated remaining: 1h 27m 22s. Rate: 9.4 symbols/min [2025-09-16T19:44:10.984858] [INFO ] [MAIN ] NVO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:44:11.021970] [DEBUG] [LOCAL ] NVO: Loaded 39744 existing records from primary storage. [2025-09-16T19:44:11.022109] [INFO ] [MAIN ] NVO: Loaded 39744 existing records. [2025-09-16T19:44:11.199718] [WARN ] [MAIN ] NVO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:44:11.199977] [INFO ] [MAIN ] NVO: Wiping existing primary data before full refresh. [2025-09-16T19:44:11.200022] [INFO ] [LOCAL ] NVO: Starting deletion of primary data. [2025-09-16T19:44:11.201111] [DEBUG] [LOCAL ] NVO: Deleted primary data file. [2025-09-16T19:44:11.201173] [INFO ] [MAIN ] NVO: Starting full primary refresh. [2025-09-16T19:44:11.567531] [INFO ] [REMOTE ] NVO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:44:11.574849] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-02. [2025-09-16T19:44:12.374904] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-02. [2025-09-16T19:44:12.559718] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-16T19:44:13.174886] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-09. [2025-09-16T19:44:13.280470] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-16T19:44:13.533553] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-16T19:44:13.974908] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-03. [2025-09-16T19:44:14.774900] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-09. [2025-09-16T19:44:15.082178] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-16T19:44:15.091864] [INFO ] [REMOTE ] NUVB: Full fetch complete (54967 records). [2025-09-16T19:44:15.092012] [DEBUG] [VALIDATOR ] NUVB: Validating primary data. [2025-09-16T19:44:15.511836] [DEBUG] [VALIDATOR ] NUVB: All expected trading days are present. [2025-09-16T19:44:15.511985] [DEBUG] [VALIDATOR ] NUVB: Primary data validation passed. [2025-09-16T19:44:15.513001] [INFO ] [MAIN ] NUVB: Fetched primary data is valid. [2025-09-16T19:44:15.513065] [DEBUG] [LOCAL ] NUVB: Saving primary data. [2025-09-16T19:44:15.532741] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-16T19:44:15.539360] [DEBUG] [LOCAL ] NUVB: Trimmed 54967 records to 38462 (keeping 150 days of data) [2025-09-16T19:44:15.590809] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-04. [2025-09-16T19:44:15.773776] [DEBUG] [LOCAL ] NUVB: Primary data saved (38462 records). [2025-09-16T19:44:15.773942] [INFO ] [MAIN ] NUVB: Full history saved. [2025-09-16T19:44:15.774065] [INFO ] [MAIN ] Update Progress: 1547/2369 symbols completed. NUVB took 29.7s. Estimated remaining: 1h 27m 15s. Rate: 9.4 symbols/min [2025-09-16T19:44:15.955594] [INFO ] [MAIN ] NVR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:44:15.969907] [DEBUG] [LOCAL ] NVR: Loaded 12975 existing records from primary storage. [2025-09-16T19:44:15.970043] [INFO ] [MAIN ] NVR: Loaded 12975 existing records. [2025-09-16T19:44:16.157550] [WARN ] [MAIN ] NVR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:44:16.168269] [INFO ] [MAIN ] NVR: Wiping existing primary data before full refresh. [2025-09-16T19:44:16.168382] [INFO ] [LOCAL ] NVR: Starting deletion of primary data. [2025-09-16T19:44:16.169698] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-16T19:44:16.169735] [DEBUG] [LOCAL ] NVR: Deleted primary data file. [2025-09-16T19:44:16.173537] [INFO ] [MAIN ] NVR: Starting full primary refresh. [2025-09-16T19:44:16.206722] [INFO ] [REMOTE ] NVG: Full fetch complete (29574 records). [2025-09-16T19:44:16.240557] [DEBUG] [VALIDATOR ] NVG: Validating primary data. [2025-09-16T19:44:16.379995] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-03. [2025-09-16T19:44:16.814759] [INFO ] [REMOTE ] NVR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:44:16.935511] [DEBUG] [VALIDATOR ] NVG: All expected trading days are present. [2025-09-16T19:44:16.935630] [DEBUG] [VALIDATOR ] NVG: Primary data validation passed. [2025-09-16T19:44:16.936495] [INFO ] [MAIN ] NVG: Fetched primary data is valid. [2025-09-16T19:44:16.936616] [DEBUG] [LOCAL ] NVG: Saving primary data. [2025-09-16T19:44:16.961065] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-16T19:44:16.961209] [DEBUG] [LOCAL ] NVG: Trimmed 29574 records to 20150 (keeping 150 days of data) [2025-09-16T19:44:17.095903] [DEBUG] [LOCAL ] NVG: Primary data saved (20150 records). [2025-09-16T19:44:17.096041] [INFO ] [MAIN ] NVG: Full history saved. [2025-09-16T19:44:17.096156] [INFO ] [MAIN ] Update Progress: 1548/2369 symbols completed. NVG took 23.7s. Estimated remaining: 1h 27m 6s. Rate: 9.4 symbols/min [2025-09-16T19:44:17.180145] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-02. [2025-09-16T19:44:17.274511] [INFO ] [MAIN ] NVRI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:44:17.305990] [DEBUG] [LOCAL ] NVRI: Loaded 28047 existing records from primary storage. [2025-09-16T19:44:17.306164] [INFO ] [MAIN ] NVRI: Loaded 28047 existing records. [2025-09-16T19:44:17.481555] [WARN ] [MAIN ] NVRI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:44:17.481824] [INFO ] [MAIN ] NVRI: Wiping existing primary data before full refresh. [2025-09-16T19:44:17.481879] [INFO ] [LOCAL ] NVRI: Starting deletion of primary data. [2025-09-16T19:44:17.482543] [DEBUG] [LOCAL ] NVRI: Deleted primary data file. [2025-09-16T19:44:17.482589] [INFO ] [MAIN ] NVRI: Starting full primary refresh. [2025-09-16T19:44:17.851318] [INFO ] [REMOTE ] NVRI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:44:17.974930] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-02. [2025-09-16T19:44:18.409483] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-16T19:44:18.558461] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-16T19:44:18.774913] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-03. [2025-09-16T19:44:19.174843] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-16T19:44:19.574899] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-03. [2025-09-16T19:44:19.946260] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-16T19:44:20.374914] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-05. [2025-09-16T19:44:20.919266] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-16T19:44:21.174877] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-04. [2025-09-16T19:44:21.616589] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-16T19:44:21.974911] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-04. [2025-09-16T19:44:22.209005] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-16T19:44:22.774901] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-04. [2025-09-16T19:44:23.454523] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-16T19:44:23.574891] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-06. [2025-09-16T19:44:24.374913] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-05. [2025-09-16T19:44:24.855195] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-16T19:44:25.174918] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-07. [2025-09-16T19:44:25.496681] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-16T19:44:25.559797] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-04 (2.78 seconds). [2025-09-16T19:44:25.974925] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-06. [2025-09-16T19:44:26.656675] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-16T19:44:26.774856] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-05. [2025-09-16T19:44:26.905822] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-16T19:44:27.574944] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-05. [2025-09-16T19:44:28.236366] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-16T19:44:28.374921] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-07. [2025-09-16T19:44:29.174902] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-06. [2025-09-16T19:44:29.259762] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-16T19:44:29.974896] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-08. [2025-09-16T19:44:30.228635] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-05 (2.65 seconds). [2025-09-16T19:44:30.508948] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-16T19:44:30.774879] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-06. [2025-09-16T19:44:30.955999] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-16T19:44:31.574891] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-07. [2025-09-16T19:44:32.374867] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-09. [2025-09-16T19:44:32.845606] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-16T19:44:33.174878] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-08. [2025-09-16T19:44:33.279267] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-16T19:44:33.282033] [INFO ] [REMOTE ] NVR: Full fetch complete (21543 records). [2025-09-16T19:44:33.282227] [DEBUG] [VALIDATOR ] NVR: Validating primary data. [2025-09-16T19:44:33.530779] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-06 (2.76 seconds). [2025-09-16T19:44:33.716244] [DEBUG] [VALIDATOR ] NVR: All expected trading days are present. [2025-09-16T19:44:33.716331] [DEBUG] [VALIDATOR ] NVR: Primary data validation passed. [2025-09-16T19:44:33.716956] [INFO ] [MAIN ] NVR: Fetched primary data is valid. [2025-09-16T19:44:33.717026] [DEBUG] [LOCAL ] NVR: Saving primary data. [2025-09-16T19:44:33.717781] [DEBUG] [LOCAL ] NVR: Trimmed 21543 records to 13127 (keeping 150 days of data) [2025-09-16T19:44:33.804325] [DEBUG] [LOCAL ] NVR: Primary data saved (13127 records). [2025-09-16T19:44:33.804477] [INFO ] [MAIN ] NVR: Full history saved. [2025-09-16T19:44:33.804615] [INFO ] [MAIN ] Update Progress: 1549/2369 symbols completed. NVR took 18.0s. Estimated remaining: 1h 27m 5s. Rate: 9.4 symbols/min [2025-09-16T19:44:33.980898] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-07. [2025-09-16T19:44:33.983891] [INFO ] [MAIN ] NVS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:44:34.028573] [DEBUG] [LOCAL ] NVS: Loaded 37898 existing records from primary storage. [2025-09-16T19:44:34.028757] [INFO ] [MAIN ] NVS: Loaded 37898 existing records. [2025-09-16T19:44:34.227735] [WARN ] [MAIN ] NVS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:44:34.227984] [INFO ] [MAIN ] NVS: Wiping existing primary data before full refresh. [2025-09-16T19:44:34.228030] [INFO ] [LOCAL ] NVS: Starting deletion of primary data. [2025-09-16T19:44:34.228868] [DEBUG] [LOCAL ] NVS: Deleted primary data file. [2025-09-16T19:44:34.228931] [INFO ] [MAIN ] NVS: Starting full primary refresh. [2025-09-16T19:44:34.610069] [INFO ] [REMOTE ] NVS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:44:34.647894] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-16T19:44:34.774912] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-09. [2025-09-16T19:44:35.574950] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-08. [2025-09-16T19:44:36.209723] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-16T19:44:36.214906] [INFO ] [REMOTE ] NVRI: Full fetch complete (42160 records). [2025-09-16T19:44:36.215033] [DEBUG] [VALIDATOR ] NVRI: Validating primary data. [2025-09-16T19:44:36.394200] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-02. [2025-09-16T19:44:36.608141] [DEBUG] [VALIDATOR ] NVRI: All expected trading days are present. [2025-09-16T19:44:36.608336] [DEBUG] [VALIDATOR ] NVRI: Primary data validation passed. [2025-09-16T19:44:36.609213] [INFO ] [MAIN ] NVRI: Fetched primary data is valid. [2025-09-16T19:44:36.609294] [DEBUG] [LOCAL ] NVRI: Saving primary data. [2025-09-16T19:44:36.611297] [DEBUG] [LOCAL ] NVRI: Trimmed 42160 records to 28361 (keeping 150 days of data) [2025-09-16T19:44:36.745782] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-07 (2.76 seconds). [2025-09-16T19:44:36.826163] [DEBUG] [LOCAL ] NVRI: Primary data saved (28361 records). [2025-09-16T19:44:36.826311] [INFO ] [MAIN ] NVRI: Full history saved. [2025-09-16T19:44:36.827211] [INFO ] [MAIN ] Update Progress: 1550/2369 symbols completed. NVRI took 19.7s. Estimated remaining: 1h 26m 57s. Rate: 9.4 symbols/min [2025-09-16T19:44:36.996145] [INFO ] [MAIN ] NVST: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:44:37.016187] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-16T19:44:37.057983] [DEBUG] [LOCAL ] NVST: Loaded 37889 existing records from primary storage. [2025-09-16T19:44:37.058141] [INFO ] [MAIN ] NVST: Loaded 37889 existing records. [2025-09-16T19:44:37.180083] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-08. [2025-09-16T19:44:37.240326] [WARN ] [MAIN ] NVST: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:44:37.240510] [INFO ] [MAIN ] NVST: Wiping existing primary data before full refresh. [2025-09-16T19:44:37.240561] [INFO ] [LOCAL ] NVST: Starting deletion of primary data. [2025-09-16T19:44:37.241358] [DEBUG] [LOCAL ] NVST: Deleted primary data file. [2025-09-16T19:44:37.241407] [INFO ] [MAIN ] NVST: Starting full primary refresh. [2025-09-16T19:44:37.590178] [INFO ] [REMOTE ] NVST: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:44:37.882338] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-16T19:44:37.974849] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-03. [2025-09-16T19:44:38.774995] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-09. [2025-09-16T19:44:39.574922] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-02. [2025-09-16T19:44:39.769864] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-16T19:44:39.932146] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-16T19:44:39.935509] [INFO ] [REMOTE ] NVGS: Full fetch complete (33566 records). [2025-09-16T19:44:39.935590] [DEBUG] [VALIDATOR ] NVGS: Validating primary data. [2025-09-16T19:44:40.312873] [DEBUG] [VALIDATOR ] NVGS: All expected trading days are present. [2025-09-16T19:44:40.313072] [DEBUG] [VALIDATOR ] NVGS: Primary data validation passed. [2025-09-16T19:44:40.313960] [INFO ] [MAIN ] NVGS: Fetched primary data is valid. [2025-09-16T19:44:40.330218] [DEBUG] [LOCAL ] NVGS: Saving primary data. [2025-09-16T19:44:40.344107] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-08 (3.16 seconds). [2025-09-16T19:44:40.355192] [DEBUG] [LOCAL ] NVGS: Trimmed 33566 records to 23457 (keeping 150 days of data) [2025-09-16T19:44:40.416043] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-09. [2025-09-16T19:44:40.505970] [DEBUG] [LOCAL ] NVGS: Primary data saved (23457 records). [2025-09-16T19:44:40.506095] [INFO ] [MAIN ] NVGS: Full history saved. [2025-09-16T19:44:40.506175] [INFO ] [MAIN ] Update Progress: 1551/2369 symbols completed. NVGS took 33.8s. Estimated remaining: 1h 26m 49s. Rate: 9.4 symbols/min [2025-09-16T19:44:40.675188] [INFO ] [MAIN ] NVT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:44:40.711704] [DEBUG] [LOCAL ] NVT: Loaded 37884 existing records from primary storage. [2025-09-16T19:44:40.711882] [INFO ] [MAIN ] NVT: Loaded 37884 existing records. [2025-09-16T19:44:40.887923] [WARN ] [MAIN ] NVT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:44:40.888217] [INFO ] [MAIN ] NVT: Wiping existing primary data before full refresh. [2025-09-16T19:44:40.888268] [INFO ] [LOCAL ] NVT: Starting deletion of primary data. [2025-09-16T19:44:40.889269] [DEBUG] [LOCAL ] NVT: Deleted primary data file. [2025-09-16T19:44:40.889345] [INFO ] [MAIN ] NVT: Starting full primary refresh. [2025-09-16T19:44:41.178723] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-04. [2025-09-16T19:44:41.251413] [INFO ] [REMOTE ] NVT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:44:41.270170] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-16T19:44:41.301476] [INFO ] [REMOTE ] NVO: Full fetch complete (58464 records). [2025-09-16T19:44:41.301703] [DEBUG] [VALIDATOR ] NVO: Validating primary data. [2025-09-16T19:44:41.303300] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-16T19:44:41.694187] [DEBUG] [VALIDATOR ] NVO: All expected trading days are present. [2025-09-16T19:44:41.694271] [DEBUG] [VALIDATOR ] NVO: Primary data validation passed. [2025-09-16T19:44:41.695138] [INFO ] [MAIN ] NVO: Fetched primary data is valid. [2025-09-16T19:44:41.695183] [DEBUG] [LOCAL ] NVO: Saving primary data. [2025-09-16T19:44:41.696393] [DEBUG] [LOCAL ] NVO: Trimmed 58464 records to 40134 (keeping 150 days of data) [2025-09-16T19:44:41.950525] [DEBUG] [LOCAL ] NVO: Primary data saved (40134 records). [2025-09-16T19:44:41.950678] [INFO ] [MAIN ] NVO: Full history saved. [2025-09-16T19:44:41.950768] [INFO ] [MAIN ] Update Progress: 1552/2369 symbols completed. NVO took 31.1s. Estimated remaining: 1h 26m 40s. Rate: 9.4 symbols/min [2025-09-16T19:44:41.981780] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-03. [2025-09-16T19:44:42.124116] [INFO ] [MAIN ] NWG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:44:42.163499] [DEBUG] [LOCAL ] NWG: Loaded 38033 existing records from primary storage. [2025-09-16T19:44:42.163705] [INFO ] [MAIN ] NWG: Loaded 38033 existing records. [2025-09-16T19:44:42.339038] [WARN ] [MAIN ] NWG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:44:42.339300] [INFO ] [MAIN ] NWG: Wiping existing primary data before full refresh. [2025-09-16T19:44:42.339345] [INFO ] [LOCAL ] NWG: Starting deletion of primary data. [2025-09-16T19:44:42.340123] [DEBUG] [LOCAL ] NWG: Deleted primary data file. [2025-09-16T19:44:42.340172] [INFO ] [MAIN ] NWG: Starting full primary refresh. [2025-09-16T19:44:42.691332] [INFO ] [REMOTE ] NWG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:44:42.746527] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-16T19:44:42.774853] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-05. [2025-09-16T19:44:43.562671] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-16T19:44:43.574858] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-04. [2025-09-16T19:44:44.374908] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-02. [2025-09-16T19:44:44.683558] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-16T19:44:45.174884] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-06. [2025-09-16T19:44:45.226880] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-16T19:44:45.673142] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-16T19:44:45.974906] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-05. [2025-09-16T19:44:46.774945] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-03. [2025-09-16T19:44:46.968044] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-16T19:44:47.205774] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-16T19:44:47.574901] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-06. [2025-09-16T19:44:48.374913] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-07. [2025-09-16T19:44:48.505302] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-16T19:44:49.124486] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-16T19:44:49.174871] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-07. [2025-09-16T19:44:49.984951] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-04. [2025-09-16T19:44:49.990394] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-16T19:44:50.436889] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-16T19:44:50.774919] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-08. [2025-09-16T19:44:51.574875] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-02. [2025-09-16T19:44:51.694870] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-16T19:44:52.067438] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-16T19:44:52.374889] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-08. [2025-09-16T19:44:53.067050] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-16T19:44:53.174868] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-05. [2025-09-16T19:44:53.733489] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-16T19:44:53.974923] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-03. [2025-09-16T19:44:54.774985] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-09. [2025-09-16T19:44:55.012079] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-16T19:44:55.468596] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-16T19:44:55.574900] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-06. [2025-09-16T19:44:56.334061] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-16T19:44:56.340095] [INFO ] [REMOTE ] NVS: Full fetch complete (56316 records). [2025-09-16T19:44:56.340204] [DEBUG] [VALIDATOR ] NVS: Validating primary data. [2025-09-16T19:44:56.380072] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-04. [2025-09-16T19:44:56.731719] [DEBUG] [VALIDATOR ] NVS: All expected trading days are present. [2025-09-16T19:44:56.731813] [DEBUG] [VALIDATOR ] NVS: Primary data validation passed. [2025-09-16T19:44:56.732715] [INFO ] [MAIN ] NVS: Fetched primary data is valid. [2025-09-16T19:44:56.732764] [DEBUG] [LOCAL ] NVS: Saving primary data. [2025-09-16T19:44:56.734067] [DEBUG] [LOCAL ] NVS: Trimmed 56316 records to 38269 (keeping 150 days of data) [2025-09-16T19:44:56.974340] [DEBUG] [LOCAL ] NVS: Primary data saved (38269 records). [2025-09-16T19:44:56.974500] [INFO ] [MAIN ] NVS: Full history saved. [2025-09-16T19:44:56.974592] [INFO ] [MAIN ] Update Progress: 1553/2369 symbols completed. NVS took 23.2s. Estimated remaining: 1h 26m 39s. Rate: 9.4 symbols/min [2025-09-16T19:44:57.144149] [INFO ] [MAIN ] NWN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:44:57.163033] [DEBUG] [LOCAL ] NWN: Loaded 20122 existing records from primary storage. [2025-09-16T19:44:57.163151] [INFO ] [MAIN ] NWN: Loaded 20122 existing records. [2025-09-16T19:44:57.194483] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-09. [2025-09-16T19:44:57.345728] [WARN ] [MAIN ] NWN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:44:57.371529] [INFO ] [MAIN ] NWN: Wiping existing primary data before full refresh. [2025-09-16T19:44:57.373018] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-16T19:44:57.373104] [INFO ] [LOCAL ] NWN: Starting deletion of primary data. [2025-09-16T19:44:57.384174] [DEBUG] [LOCAL ] NWN: Deleted primary data file. [2025-09-16T19:44:57.384417] [INFO ] [MAIN ] NWN: Starting full primary refresh. [2025-09-16T19:44:57.765880] [INFO ] [REMOTE ] NWN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:44:57.974974] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-07. [2025-09-16T19:44:58.208404] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-16T19:44:58.637035] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-16T19:44:58.642966] [INFO ] [REMOTE ] NVST: Full fetch complete (56053 records). [2025-09-16T19:44:58.643064] [DEBUG] [VALIDATOR ] NVST: Validating primary data. [2025-09-16T19:44:58.785147] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-02. [2025-09-16T19:44:59.032509] [DEBUG] [VALIDATOR ] NVST: All expected trading days are present. [2025-09-16T19:44:59.032608] [DEBUG] [VALIDATOR ] NVST: Primary data validation passed. [2025-09-16T19:44:59.033572] [INFO ] [MAIN ] NVST: Fetched primary data is valid. [2025-09-16T19:44:59.033662] [DEBUG] [LOCAL ] NVST: Saving primary data. [2025-09-16T19:44:59.034950] [DEBUG] [LOCAL ] NVST: Trimmed 56053 records to 38272 (keeping 150 days of data) [2025-09-16T19:44:59.262327] [DEBUG] [LOCAL ] NVST: Primary data saved (38272 records). [2025-09-16T19:44:59.262480] [INFO ] [MAIN ] NVST: Full history saved. [2025-09-16T19:44:59.263466] [INFO ] [MAIN ] Update Progress: 1554/2369 symbols completed. NVST took 22.4s. Estimated remaining: 1h 26m 30s. Rate: 9.4 symbols/min [2025-09-16T19:44:59.433405] [INFO ] [MAIN ] NX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:44:59.458288] [DEBUG] [LOCAL ] NX: Loaded 24040 existing records from primary storage. [2025-09-16T19:44:59.458420] [INFO ] [MAIN ] NX: Loaded 24040 existing records. [2025-09-16T19:44:59.575235] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-05. [2025-09-16T19:44:59.640711] [WARN ] [MAIN ] NX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:44:59.641003] [INFO ] [MAIN ] NX: Wiping existing primary data before full refresh. [2025-09-16T19:44:59.641053] [INFO ] [LOCAL ] NX: Starting deletion of primary data. [2025-09-16T19:44:59.641675] [DEBUG] [LOCAL ] NX: Deleted primary data file. [2025-09-16T19:44:59.641769] [INFO ] [MAIN ] NX: Starting full primary refresh. [2025-09-16T19:45:00.004480] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-16T19:45:00.034682] [INFO ] [REMOTE ] NX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:45:00.068184] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-16T19:45:00.374923] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-03. [2025-09-16T19:45:01.174930] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-08. [2025-09-16T19:45:01.397857] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-16T19:45:01.459504] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-16T19:45:01.974936] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-02. [2025-09-16T19:45:02.542080] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-16T19:45:02.774908] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-06. [2025-09-16T19:45:03.228307] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-16T19:45:03.574907] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-09. [2025-09-16T19:45:04.191960] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-16T19:45:04.374926] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-03. [2025-09-16T19:45:05.150614] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-16T19:45:05.156900] [INFO ] [REMOTE ] NVT: Full fetch complete (56140 records). [2025-09-16T19:45:05.157017] [DEBUG] [VALIDATOR ] NVT: Validating primary data. [2025-09-16T19:45:05.179989] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-07. [2025-09-16T19:45:05.546307] [DEBUG] [VALIDATOR ] NVT: All expected trading days are present. [2025-09-16T19:45:05.546391] [DEBUG] [VALIDATOR ] NVT: Primary data validation passed. [2025-09-16T19:45:05.547249] [INFO ] [MAIN ] NVT: Fetched primary data is valid. [2025-09-16T19:45:05.547294] [DEBUG] [LOCAL ] NVT: Saving primary data. [2025-09-16T19:45:05.548442] [DEBUG] [LOCAL ] NVT: Trimmed 56140 records to 38225 (keeping 150 days of data) [2025-09-16T19:45:05.816466] [DEBUG] [LOCAL ] NVT: Primary data saved (38225 records). [2025-09-16T19:45:05.816711] [INFO ] [MAIN ] NVT: Full history saved. [2025-09-16T19:45:05.816814] [INFO ] [MAIN ] Update Progress: 1555/2369 symbols completed. NVT took 25.3s. Estimated remaining: 1h 26m 24s. Rate: 9.4 symbols/min [2025-09-16T19:45:05.849822] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-16T19:45:05.975678] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-04. [2025-09-16T19:45:06.005617] [INFO ] [MAIN ] NXC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:45:06.011238] [DEBUG] [LOCAL ] NXC: Loaded 2940 existing records from primary storage. [2025-09-16T19:45:06.011325] [INFO ] [MAIN ] NXC: Loaded 2940 existing records. [2025-09-16T19:45:06.196493] [WARN ] [MAIN ] NXC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:45:06.196783] [INFO ] [MAIN ] NXC: Wiping existing primary data before full refresh. [2025-09-16T19:45:06.196832] [INFO ] [LOCAL ] NXC: Starting deletion of primary data. [2025-09-16T19:45:06.197060] [DEBUG] [LOCAL ] NXC: Deleted primary data file. [2025-09-16T19:45:06.197105] [INFO ] [MAIN ] NXC: Starting full primary refresh. [2025-09-16T19:45:06.565195] [INFO ] [REMOTE ] NXC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:45:06.774928] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-02. [2025-09-16T19:45:06.931262] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-16T19:45:07.028157] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-16T19:45:07.347336] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-16T19:45:07.574939] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-04. [2025-09-16T19:45:08.374920] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-03. [2025-09-16T19:45:08.895045] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-16T19:45:08.923692] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-16T19:45:09.174956] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-04. [2025-09-16T19:45:09.869586] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-16T19:45:09.974926] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-05. [2025-09-16T19:45:10.774923] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-05. [2025-09-16T19:45:11.461375] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-16T19:45:11.574917] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-08. [2025-09-16T19:45:12.214817] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-16T19:45:12.374929] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-05. [2025-09-16T19:45:12.912365] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-16T19:45:13.174945] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-06. [2025-09-16T19:45:13.400968] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-16T19:45:13.974912] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-06. [2025-09-16T19:45:14.134436] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-16T19:45:14.774892] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-09. [2025-09-16T19:45:15.143369] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-16T19:45:15.574920] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-07. [2025-09-16T19:45:16.353959] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-16T19:45:16.360298] [INFO ] [REMOTE ] NWG: Full fetch complete (56016 records). [2025-09-16T19:45:16.360463] [DEBUG] [VALIDATOR ] NWG: Validating primary data. [2025-09-16T19:45:16.383051] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-06. [2025-09-16T19:45:16.752981] [DEBUG] [VALIDATOR ] NWG: All expected trading days are present. [2025-09-16T19:45:16.753074] [DEBUG] [VALIDATOR ] NWG: Primary data validation passed. [2025-09-16T19:45:16.753961] [INFO ] [MAIN ] NWG: Fetched primary data is valid. [2025-09-16T19:45:16.754011] [DEBUG] [LOCAL ] NWG: Saving primary data. [2025-09-16T19:45:16.755399] [DEBUG] [LOCAL ] NWG: Trimmed 56016 records to 38406 (keeping 150 days of data) [2025-09-16T19:45:16.853001] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-16T19:45:16.986984] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-16T19:45:17.025010] [DEBUG] [LOCAL ] NWG: Primary data saved (38406 records). [2025-09-16T19:45:17.025141] [INFO ] [MAIN ] NWG: Full history saved. [2025-09-16T19:45:17.025222] [INFO ] [MAIN ] Update Progress: 1556/2369 symbols completed. NWG took 35.1s. Estimated remaining: 1h 26m 20s. Rate: 9.4 symbols/min [2025-09-16T19:45:17.178673] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-07. [2025-09-16T19:45:17.198005] [INFO ] [MAIN ] NXDR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:45:17.198862] [DEBUG] [LOCAL ] NXDR: No existing data file found in primary storage. [2025-09-16T19:45:17.198920] [WARN ] [MAIN ] NXDR: No existing data found, performing full refresh instead. [2025-09-16T19:45:17.199074] [INFO ] [MAIN ] NXDR: Wiping existing primary data before full refresh. [2025-09-16T19:45:17.199130] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-09-16T19:45:17.199188] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-09-16T19:45:17.199235] [INFO ] [MAIN ] NXDR: Starting full primary refresh. [2025-09-16T19:45:17.555695] [INFO ] [REMOTE ] NXDR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:45:17.865241] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-16T19:45:17.974943] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-07. [2025-09-16T19:45:18.774912] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-08. [2025-09-16T19:45:19.343914] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-16T19:45:19.574998] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-08. [2025-09-16T19:45:19.994488] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-16T19:45:20.374949] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-08. [2025-09-16T19:45:20.639063] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-16T19:45:20.693614] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-16T19:45:21.174896] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-09. [2025-09-16T19:45:21.752478] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-16T19:45:21.753837] [INFO ] [REMOTE ] NXC: Full fetch complete (4431 records). [2025-09-16T19:45:21.753915] [DEBUG] [VALIDATOR ] NXC: Validating primary data. [2025-09-16T19:45:21.979977] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-09. [2025-09-16T19:45:22.139481] [DEBUG] [VALIDATOR ] NXC: All expected trading days are present. [2025-09-16T19:45:22.139567] [DEBUG] [VALIDATOR ] NXC: Primary data validation passed. [2025-09-16T19:45:22.139769] [INFO ] [MAIN ] NXC: Fetched primary data is valid. [2025-09-16T19:45:22.139817] [DEBUG] [LOCAL ] NXC: Saving primary data. [2025-09-16T19:45:22.140312] [DEBUG] [LOCAL ] NXC: Trimmed 4431 records to 2965 (keeping 150 days of data) [2025-09-16T19:45:22.160475] [DEBUG] [LOCAL ] NXC: Primary data saved (2965 records). [2025-09-16T19:45:22.160631] [INFO ] [MAIN ] NXC: Full history saved. [2025-09-16T19:45:22.160758] [INFO ] [MAIN ] Update Progress: 1557/2369 symbols completed. NXC took 16.3s. Estimated remaining: 1h 26m 13s. Rate: 9.4 symbols/min [2025-09-16T19:45:22.774941] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-02. [2025-09-16T19:45:22.965713] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:45:22.966019] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-02 [2025-09-16T19:45:23.452990] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-16T19:45:23.458521] [INFO ] [REMOTE ] NX: Full fetch complete (36310 records). [2025-09-16T19:45:23.458637] [DEBUG] [VALIDATOR ] NX: Validating primary data. [2025-09-16T19:45:23.580051] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-09. [2025-09-16T19:45:23.849866] [DEBUG] [VALIDATOR ] NX: All expected trading days are present. [2025-09-16T19:45:23.849945] [DEBUG] [VALIDATOR ] NX: Primary data validation passed. [2025-09-16T19:45:23.850634] [INFO ] [MAIN ] NX: Fetched primary data is valid. [2025-09-16T19:45:23.850694] [DEBUG] [LOCAL ] NX: Saving primary data. [2025-09-16T19:45:23.851522] [DEBUG] [LOCAL ] NX: Trimmed 36310 records to 24326 (keeping 150 days of data) [2025-09-16T19:45:24.011139] [DEBUG] [LOCAL ] NX: Primary data saved (24326 records). [2025-09-16T19:45:24.011338] [INFO ] [MAIN ] NX: Full history saved. [2025-09-16T19:45:24.011427] [INFO ] [MAIN ] Update Progress: 1558/2369 symbols completed. NX took 24.7s. Estimated remaining: 1h 26m 4s. Rate: 9.4 symbols/min [2025-09-16T19:45:24.374915] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-03. [2025-09-16T19:45:24.609703] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:45:24.610078] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-03 [2025-09-16T19:45:24.714264] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-16T19:45:24.717438] [INFO ] [REMOTE ] NWN: Full fetch complete (28888 records). [2025-09-16T19:45:24.717516] [DEBUG] [VALIDATOR ] NWN: Validating primary data. [2025-09-16T19:45:25.083528] [DEBUG] [VALIDATOR ] NWN: All expected trading days are present. [2025-09-16T19:45:25.083610] [DEBUG] [VALIDATOR ] NWN: Primary data validation passed. [2025-09-16T19:45:25.084326] [INFO ] [MAIN ] NWN: Fetched primary data is valid. [2025-09-16T19:45:25.084386] [DEBUG] [LOCAL ] NWN: Saving primary data. [2025-09-16T19:45:25.085116] [DEBUG] [LOCAL ] NWN: Trimmed 28888 records to 20316 (keeping 150 days of data) [2025-09-16T19:45:25.175517] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-04. [2025-09-16T19:45:25.209335] [DEBUG] [LOCAL ] NWN: Primary data saved (20316 records). [2025-09-16T19:45:25.209470] [INFO ] [MAIN ] NWN: Full history saved. [2025-09-16T19:45:25.209552] [INFO ] [MAIN ] Update Progress: 1559/2369 symbols completed. NWN took 28.2s. Estimated remaining: 1h 25m 55s. Rate: 9.4 symbols/min [2025-09-16T19:45:25.379888] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:45:25.380713] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-04 [2025-09-16T19:45:25.974917] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-05. [2025-09-16T19:45:26.169709] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:45:26.170025] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-05 [2025-09-16T19:45:26.774898] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-06. [2025-09-16T19:45:26.962203] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:45:26.962505] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-06 [2025-09-16T19:45:27.574905] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-07. [2025-09-16T19:45:27.682038] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-09-16T19:45:27.682378] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-07 [2025-09-16T19:45:28.374933] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-08. [2025-09-16T19:45:30.036838] [INFO ] [REMOTE ] NXDR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-16T19:45:30.047514] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-09. [2025-09-16T19:45:31.552609] [INFO ] [REMOTE ] NXDR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-16T19:45:31.558443] [INFO ] [REMOTE ] NXDR: Full fetch complete (11435 records). [2025-09-16T19:45:31.558519] [DEBUG] [VALIDATOR ] NXDR: Validating primary data. [2025-09-16T19:45:31.741331] [WARN ] [VALIDATOR ] NXDR: Validation failed - insufficient historical data. Have 32 unique days, need 150 days [2025-09-16T19:45:31.741816] [FATAL] [MAIN ] NXDR: Fetched primary data is invalid. Refusing to save it. [2025-09-16T19:45:31.741869] [WARN ] [MAIN ] NXDR: Deleting existing primary and derivative data due to validation failure. [2025-09-16T19:45:31.741910] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-09-16T19:45:31.741979] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-09-16T19:45:31.742015] [INFO ] [LOCAL ] NXDR: Starting deletion of derivative data. [2025-09-16T19:45:31.742069] [DEBUG] [LOCAL ] NXDR: No derivative data file found to delete. [2025-09-16T19:45:31.742129] [INFO ] [MAIN ] Update Progress: 1560/2369 symbols completed. NXDR took 14.7s. Estimated remaining: 1h 25m 49s. Rate: 9.4 symbols/min [2025-09-16T19:45:32.356287] [INFO ] [MAIN ] NXG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:45:32.394456] [INFO ] [MAIN ] NXE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:45:32.444184] [INFO ] [MAIN ] NXJ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:45:32.425424] [INFO ] [MAIN ] NXDT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:45:32.453184] [DEBUG] [LOCAL ] NXG: Loaded 7370 existing records from primary storage. [2025-09-16T19:45:32.453478] [INFO ] [MAIN ] NXG: Loaded 7370 existing records. [2025-09-16T19:45:32.575754] [DEBUG] [LOCAL ] NXDT: Loaded 10717 existing records from primary storage. [2025-09-16T19:45:32.575255] [DEBUG] [LOCAL ] NXJ: Loaded 11607 existing records from primary storage. [2025-09-16T19:45:32.579465] [INFO ] [MAIN ] NXJ: Loaded 11607 existing records. [2025-09-16T19:45:32.579355] [INFO ] [MAIN ] NXDT: Loaded 10717 existing records. [2025-09-16T19:45:32.763254] [WARN ] [MAIN ] NXG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:45:32.843840] [INFO ] [MAIN ] NXG: Wiping existing primary data before full refresh. [2025-09-16T19:45:32.838565] [DEBUG] [LOCAL ] NXE: Loaded 39107 existing records from primary storage. [2025-09-16T19:45:32.854568] [INFO ] [MAIN ] NXE: Loaded 39107 existing records. [2025-09-16T19:45:32.859893] [INFO ] [LOCAL ] NXG: Starting deletion of primary data. [2025-09-16T19:45:32.940513] [DEBUG] [LOCAL ] NXG: Deleted primary data file. [2025-09-16T19:45:33.043083] [INFO ] [MAIN ] NXG: Starting full primary refresh. [2025-09-16T19:45:33.126734] [WARN ] [MAIN ] NXDT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:45:33.132614] [WARN ] [MAIN ] NXJ: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:45:33.170944] [INFO ] [MAIN ] NXDT: Wiping existing primary data before full refresh. [2025-09-16T19:45:33.203919] [INFO ] [LOCAL ] NXDT: Starting deletion of primary data. [2025-09-16T19:45:33.176467] [INFO ] [MAIN ] NXJ: Wiping existing primary data before full refresh. [2025-09-16T19:45:33.204155] [INFO ] [LOCAL ] NXJ: Starting deletion of primary data. [2025-09-16T19:45:33.225053] [DEBUG] [LOCAL ] NXDT: Deleted primary data file. [2025-09-16T19:45:33.240522] [DEBUG] [LOCAL ] NXJ: Deleted primary data file. [2025-09-16T19:45:33.256059] [INFO ] [MAIN ] NXDT: Starting full primary refresh. [2025-09-16T19:45:33.280055] [INFO ] [MAIN ] NXJ: Starting full primary refresh. [2025-09-16T19:45:33.316272] [WARN ] [MAIN ] NXE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:45:33.471765] [INFO ] [MAIN ] NXE: Wiping existing primary data before full refresh. [2025-09-16T19:45:33.574265] [INFO ] [LOCAL ] NXE: Starting deletion of primary data. [2025-09-16T19:45:33.648323] [DEBUG] [LOCAL ] NXE: Deleted primary data file. [2025-09-16T19:45:33.692684] [INFO ] [MAIN ] NXE: Starting full primary refresh. [2025-09-16T19:45:34.245267] [INFO ] [REMOTE ] NXG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:45:34.321123] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-02. [2025-09-16T19:45:34.511322] [INFO ] [REMOTE ] NXJ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:45:34.565256] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-02. [2025-09-16T19:45:34.584890] [INFO ] [REMOTE ] NXDT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:45:34.586151] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-02. [2025-09-16T19:45:34.667742] [INFO ] [REMOTE ] NXE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:45:34.668162] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-02. [2025-09-16T19:45:35.196298] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-16T19:45:35.198321] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-03. [2025-09-16T19:45:35.451444] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-16T19:45:35.458440] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-03. [2025-09-16T19:45:35.691276] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-16T19:45:35.695381] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-03. [2025-09-16T19:45:35.766454] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-16T19:45:35.769678] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-04. [2025-09-16T19:45:35.996521] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-16T19:45:36.124126] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-16T19:45:36.223808] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-16T19:45:36.374893] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-03. [2025-09-16T19:45:36.421801] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-16T19:45:37.174901] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-05. [2025-09-16T19:45:37.974900] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-04. [2025-09-16T19:45:38.060152] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-16T19:45:38.097864] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-16T19:45:38.603869] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-16T19:45:38.774912] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-06. [2025-09-16T19:45:39.567010] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-16T19:45:39.574846] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-07. [2025-09-16T19:45:40.374867] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-05. [2025-09-16T19:45:40.481191] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-16T19:45:41.174912] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-08. [2025-09-16T19:45:41.928851] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-16T19:45:41.974867] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-06. [2025-09-16T19:45:42.022876] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-16T19:45:42.636768] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-16T19:45:42.774932] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-04. [2025-09-16T19:45:43.574908] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-07. [2025-09-16T19:45:44.374890] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-09. [2025-09-16T19:45:44.412866] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-16T19:45:44.538793] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-16T19:45:45.174897] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-04. [2025-09-16T19:45:45.321158] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-16T19:45:45.323043] [INFO ] [REMOTE ] NXG: Full fetch complete (11219 records). [2025-09-16T19:45:45.323117] [DEBUG] [VALIDATOR ] NXG: Validating primary data. [2025-09-16T19:45:45.684060] [DEBUG] [VALIDATOR ] NXG: All expected trading days are present. [2025-09-16T19:45:45.684144] [DEBUG] [VALIDATOR ] NXG: Primary data validation passed. [2025-09-16T19:45:45.684447] [INFO ] [MAIN ] NXG: Fetched primary data is valid. [2025-09-16T19:45:45.684494] [DEBUG] [LOCAL ] NXG: Saving primary data. [2025-09-16T19:45:45.685003] [DEBUG] [LOCAL ] NXG: Trimmed 11219 records to 7436 (keeping 150 days of data) [2025-09-16T19:45:45.731113] [DEBUG] [LOCAL ] NXG: Primary data saved (7436 records). [2025-09-16T19:45:45.731232] [INFO ] [MAIN ] NXG: Full history saved. [2025-09-16T19:45:45.731342] [INFO ] [MAIN ] Update Progress: 1561/2369 symbols completed. NXG took 14.0s. Estimated remaining: 1h 25m 46s. Rate: 9.4 symbols/min [2025-09-16T19:45:45.899771] [INFO ] [MAIN ] NXN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:45:45.903226] [DEBUG] [LOCAL ] NXN: Loaded 1734 existing records from primary storage. [2025-09-16T19:45:45.903300] [INFO ] [MAIN ] NXN: Loaded 1734 existing records. [2025-09-16T19:45:45.980036] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-08. [2025-09-16T19:45:46.083020] [WARN ] [MAIN ] NXN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:45:46.083258] [INFO ] [MAIN ] NXN: Wiping existing primary data before full refresh. [2025-09-16T19:45:46.083306] [INFO ] [LOCAL ] NXN: Starting deletion of primary data. [2025-09-16T19:45:46.083514] [DEBUG] [LOCAL ] NXN: Deleted primary data file. [2025-09-16T19:45:46.083559] [INFO ] [MAIN ] NXN: Starting full primary refresh. [2025-09-16T19:45:46.443385] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-16T19:45:46.462660] [INFO ] [REMOTE ] NXN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:45:46.774969] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-05. [2025-09-16T19:45:47.469596] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-16T19:45:47.574980] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-09. [2025-09-16T19:45:47.763689] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-16T19:45:48.374928] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-02. [2025-09-16T19:45:48.783000] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-16T19:45:48.785532] [INFO ] [REMOTE ] NXJ: Full fetch complete (15553 records). [2025-09-16T19:45:48.785615] [DEBUG] [VALIDATOR ] NXJ: Validating primary data. [2025-09-16T19:45:48.890263] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-16T19:45:49.152598] [DEBUG] [VALIDATOR ] NXJ: All expected trading days are present. [2025-09-16T19:45:49.152692] [DEBUG] [VALIDATOR ] NXJ: Primary data validation passed. [2025-09-16T19:45:49.153032] [INFO ] [MAIN ] NXJ: Fetched primary data is valid. [2025-09-16T19:45:49.153080] [DEBUG] [LOCAL ] NXJ: Saving primary data. [2025-09-16T19:45:49.153601] [DEBUG] [LOCAL ] NXJ: Trimmed 15553 records to 11778 (keeping 150 days of data) [2025-09-16T19:45:49.185177] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-05. [2025-09-16T19:45:49.228173] [DEBUG] [LOCAL ] NXJ: Primary data saved (11778 records). [2025-09-16T19:45:49.228289] [INFO ] [MAIN ] NXJ: Full history saved. [2025-09-16T19:45:49.228388] [INFO ] [MAIN ] Update Progress: 1562/2369 symbols completed. NXJ took 17.5s. Estimated remaining: 1h 25m 39s. Rate: 9.4 symbols/min [2025-09-16T19:45:49.399333] [INFO ] [MAIN ] NXP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:45:49.409572] [DEBUG] [LOCAL ] NXP: Loaded 9046 existing records from primary storage. [2025-09-16T19:45:49.409698] [INFO ] [MAIN ] NXP: Loaded 9046 existing records. [2025-09-16T19:45:49.609746] [WARN ] [MAIN ] NXP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:45:49.609990] [INFO ] [MAIN ] NXP: Wiping existing primary data before full refresh. [2025-09-16T19:45:49.610036] [INFO ] [LOCAL ] NXP: Starting deletion of primary data. [2025-09-16T19:45:49.610344] [DEBUG] [LOCAL ] NXP: Deleted primary data file. [2025-09-16T19:45:49.610388] [INFO ] [MAIN ] NXP: Starting full primary refresh. [2025-09-16T19:45:49.961503] [INFO ] [REMOTE ] NXP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:45:49.974872] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-02. [2025-09-16T19:45:50.774945] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-03. [2025-09-16T19:45:50.791458] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-16T19:45:50.963665] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-16T19:45:51.222479] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-16T19:45:51.574952] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-03. [2025-09-16T19:45:52.374915] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-06. [2025-09-16T19:45:52.432074] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-16T19:45:53.174942] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-06. [2025-09-16T19:45:53.390247] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-16T19:45:53.974935] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-07. [2025-09-16T19:45:54.774961] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-04. [2025-09-16T19:45:54.874455] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-16T19:45:54.899751] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-16T19:45:55.574927] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-08. [2025-09-16T19:45:55.682375] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-16T19:45:56.374936] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-05. [2025-09-16T19:45:56.670624] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-16T19:45:57.174927] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-09. [2025-09-16T19:45:57.303611] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-16T19:45:57.974925] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-04. [2025-09-16T19:45:58.130797] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-16T19:45:58.132912] [INFO ] [REMOTE ] NXDT: Full fetch complete (18220 records). [2025-09-16T19:45:58.132985] [DEBUG] [VALIDATOR ] NXDT: Validating primary data. [2025-09-16T19:45:58.504739] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-16T19:45:58.504590] [DEBUG] [VALIDATOR ] NXDT: All expected trading days are present. [2025-09-16T19:45:58.505973] [DEBUG] [VALIDATOR ] NXDT: Primary data validation passed. [2025-09-16T19:45:58.506391] [INFO ] [MAIN ] NXDT: Fetched primary data is valid. [2025-09-16T19:45:58.506441] [DEBUG] [LOCAL ] NXDT: Saving primary data. [2025-09-16T19:45:58.506979] [DEBUG] [LOCAL ] NXDT: Trimmed 18220 records to 10785 (keeping 150 days of data) [2025-09-16T19:45:58.569349] [DEBUG] [LOCAL ] NXDT: Primary data saved (10785 records). [2025-09-16T19:45:58.569491] [INFO ] [MAIN ] NXDT: Full history saved. [2025-09-16T19:45:58.569604] [INFO ] [MAIN ] Update Progress: 1563/2369 symbols completed. NXDT took 26.8s. Estimated remaining: 1h 25m 34s. Rate: 9.4 symbols/min [2025-09-16T19:45:58.742690] [INFO ] [MAIN ] NXRT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:45:58.757483] [DEBUG] [LOCAL ] NXRT: Loaded 13545 existing records from primary storage. [2025-09-16T19:45:58.757612] [INFO ] [MAIN ] NXRT: Loaded 13545 existing records. [2025-09-16T19:45:58.780287] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-05. [2025-09-16T19:45:58.942474] [WARN ] [MAIN ] NXRT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:45:58.942753] [INFO ] [MAIN ] NXRT: Wiping existing primary data before full refresh. [2025-09-16T19:45:58.942809] [INFO ] [LOCAL ] NXRT: Starting deletion of primary data. [2025-09-16T19:45:58.943177] [DEBUG] [LOCAL ] NXRT: Deleted primary data file. [2025-09-16T19:45:58.943223] [INFO ] [MAIN ] NXRT: Starting full primary refresh. [2025-09-16T19:45:59.298085] [INFO ] [REMOTE ] NXRT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:45:59.332230] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-16T19:45:59.574912] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-06. [2025-09-16T19:46:00.091699] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-16T19:46:00.374944] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-06. [2025-09-16T19:46:01.174905] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-07. [2025-09-16T19:46:01.231245] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-16T19:46:01.974945] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-07. [2025-09-16T19:46:02.548529] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-16T19:46:02.774953] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-08. [2025-09-16T19:46:03.574912] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-02. [2025-09-16T19:46:03.628048] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-16T19:46:03.629938] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-09-16T19:46:04.374911] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-07. [2025-09-16T19:46:04.521151] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-16T19:46:05.174892] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-03. [2025-09-16T19:46:05.320857] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-16T19:46:05.974913] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-09. [2025-09-16T19:46:06.105483] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-16T19:46:06.774897] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-04. [2025-09-16T19:46:06.925053] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-16T19:46:06.925904] [INFO ] [REMOTE ] NXN: Full fetch complete (2541 records). [2025-09-16T19:46:06.925974] [DEBUG] [VALIDATOR ] NXN: Validating primary data. [2025-09-16T19:46:07.278903] [DEBUG] [VALIDATOR ] NXN: All expected trading days are present. [2025-09-16T19:46:07.278978] [DEBUG] [VALIDATOR ] NXN: Primary data validation passed. [2025-09-16T19:46:07.279073] [INFO ] [MAIN ] NXN: Fetched primary data is valid. [2025-09-16T19:46:07.279111] [DEBUG] [LOCAL ] NXN: Saving primary data. [2025-09-16T19:46:07.279436] [DEBUG] [LOCAL ] NXN: Trimmed 2541 records to 1750 (keeping 150 days of data) [2025-09-16T19:46:07.290510] [DEBUG] [LOCAL ] NXN: Primary data saved (1750 records). [2025-09-16T19:46:07.290570] [INFO ] [MAIN ] NXN: Full history saved. [2025-09-16T19:46:07.290663] [INFO ] [MAIN ] Update Progress: 1564/2369 symbols completed. NXN took 21.6s. Estimated remaining: 1h 25m 29s. Rate: 9.4 symbols/min [2025-09-16T19:46:07.463611] [INFO ] [MAIN ] NYC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:46:07.463816] [DEBUG] [LOCAL ] NYC: No existing data file found in primary storage. [2025-09-16T19:46:07.463856] [WARN ] [MAIN ] NYC: No existing data found, performing full refresh instead. [2025-09-16T19:46:07.463978] [INFO ] [MAIN ] NYC: Wiping existing primary data before full refresh. [2025-09-16T19:46:07.464043] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-09-16T19:46:07.464091] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-09-16T19:46:07.464124] [INFO ] [MAIN ] NYC: Starting full primary refresh. [2025-09-16T19:46:07.580027] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-08. [2025-09-16T19:46:07.821052] [INFO ] [REMOTE ] NYC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:46:07.833976] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-16T19:46:08.374916] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-08. [2025-09-16T19:46:09.075725] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-16T19:46:09.174898] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-09. [2025-09-16T19:46:09.629304] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-16T19:46:09.974926] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-02. [2025-09-16T19:46:10.042248] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-16T19:46:10.044613] [INFO ] [REMOTE ] NXP: Full fetch complete (12946 records). [2025-09-16T19:46:10.044736] [DEBUG] [VALIDATOR ] NXP: Validating primary data. [2025-09-16T19:46:10.430951] [DEBUG] [VALIDATOR ] NXP: All expected trading days are present. [2025-09-16T19:46:10.431062] [DEBUG] [VALIDATOR ] NXP: Primary data validation passed. [2025-09-16T19:46:10.431354] [INFO ] [MAIN ] NXP: Fetched primary data is valid. [2025-09-16T19:46:10.431395] [DEBUG] [LOCAL ] NXP: Saving primary data. [2025-09-16T19:46:10.431957] [DEBUG] [LOCAL ] NXP: Trimmed 12946 records to 9142 (keeping 150 days of data) [2025-09-16T19:46:10.488081] [DEBUG] [LOCAL ] NXP: Primary data saved (9142 records). [2025-09-16T19:46:10.488209] [INFO ] [MAIN ] NXP: Full history saved. [2025-09-16T19:46:10.488296] [INFO ] [MAIN ] Update Progress: 1565/2369 symbols completed. NXP took 21.3s. Estimated remaining: 1h 25m 21s. Rate: 9.4 symbols/min [2025-09-16T19:46:10.591231] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-16T19:46:10.664584] [INFO ] [MAIN ] NYT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:46:10.699070] [DEBUG] [LOCAL ] NYT: Loaded 36763 existing records from primary storage. [2025-09-16T19:46:10.699215] [INFO ] [MAIN ] NYT: Loaded 36763 existing records. [2025-09-16T19:46:10.780026] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-03. [2025-09-16T19:46:10.884217] [WARN ] [MAIN ] NYT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:46:10.884502] [INFO ] [MAIN ] NYT: Wiping existing primary data before full refresh. [2025-09-16T19:46:10.884548] [INFO ] [LOCAL ] NYT: Starting deletion of primary data. [2025-09-16T19:46:10.885412] [DEBUG] [LOCAL ] NYT: Deleted primary data file. [2025-09-16T19:46:10.885460] [INFO ] [MAIN ] NYT: Starting full primary refresh. [2025-09-16T19:46:11.238282] [INFO ] [REMOTE ] NYT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:46:11.570899] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-16T19:46:11.574834] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-04. [2025-09-16T19:46:11.874240] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-09-16T19:46:12.374929] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-05. [2025-09-16T19:46:12.730852] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-16T19:46:13.174909] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-09. [2025-09-16T19:46:13.974903] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-02. [2025-09-16T19:46:14.774896] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-06. [2025-09-16T19:46:15.014582] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-16T19:46:15.021272] [INFO ] [REMOTE ] NXE: Full fetch complete (57610 records). [2025-09-16T19:46:15.021451] [DEBUG] [VALIDATOR ] NXE: Validating primary data. [2025-09-16T19:46:15.208621] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-16T19:46:15.422798] [DEBUG] [VALIDATOR ] NXE: All expected trading days are present. [2025-09-16T19:46:15.422881] [DEBUG] [VALIDATOR ] NXE: Primary data validation passed. [2025-09-16T19:46:15.423924] [INFO ] [MAIN ] NXE: Fetched primary data is valid. [2025-09-16T19:46:15.424043] [DEBUG] [LOCAL ] NXE: Saving primary data. [2025-09-16T19:46:15.425242] [DEBUG] [LOCAL ] NXE: Trimmed 57610 records to 39497 (keeping 150 days of data) [2025-09-16T19:46:15.590212] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-07. [2025-09-16T19:46:15.659815] [DEBUG] [LOCAL ] NXE: Primary data saved (39497 records). [2025-09-16T19:46:15.659965] [INFO ] [MAIN ] NXE: Full history saved. [2025-09-16T19:46:15.660062] [INFO ] [MAIN ] Update Progress: 1566/2369 symbols completed. NXE took 43.9s. Estimated remaining: 1h 25m 14s. Rate: 9.4 symbols/min [2025-09-16T19:46:15.861068] [INFO ] [MAIN ] NZF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:46:15.891966] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-16T19:46:15.918349] [DEBUG] [LOCAL ] NZF: Loaded 21113 existing records from primary storage. [2025-09-16T19:46:15.918485] [INFO ] [MAIN ] NZF: Loaded 21113 existing records. [2025-09-16T19:46:16.048215] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-16T19:46:16.099870] [WARN ] [MAIN ] NZF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:46:16.100101] [INFO ] [MAIN ] NZF: Wiping existing primary data before full refresh. [2025-09-16T19:46:16.100147] [INFO ] [LOCAL ] NZF: Starting deletion of primary data. [2025-09-16T19:46:16.100802] [DEBUG] [LOCAL ] NZF: Deleted primary data file. [2025-09-16T19:46:16.100851] [INFO ] [MAIN ] NZF: Starting full primary refresh. [2025-09-16T19:46:16.383313] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-08. [2025-09-16T19:46:16.466467] [INFO ] [REMOTE ] NZF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:46:16.759504] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-16T19:46:17.174914] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-05. [2025-09-16T19:46:17.974923] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-02. [2025-09-16T19:46:18.234815] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-16T19:46:18.774895] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-09. [2025-09-16T19:46:19.042703] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-16T19:46:19.212983] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-16T19:46:19.213840] [INFO ] [REMOTE ] NYC: Full fetch complete (1356 records). [2025-09-16T19:46:19.213909] [DEBUG] [VALIDATOR ] NYC: Validating primary data. [2025-09-16T19:46:19.397821] [WARN ] [VALIDATOR ] NYC: Validation failed - insufficient historical data. Have 146 unique days, need 150 days [2025-09-16T19:46:19.398086] [FATAL] [MAIN ] NYC: Fetched primary data is invalid. Refusing to save it. [2025-09-16T19:46:19.398147] [WARN ] [MAIN ] NYC: Deleting existing primary and derivative data due to validation failure. [2025-09-16T19:46:19.398208] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-09-16T19:46:19.398271] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-09-16T19:46:19.398307] [INFO ] [LOCAL ] NYC: Starting deletion of derivative data. [2025-09-16T19:46:19.398347] [DEBUG] [LOCAL ] NYC: No derivative data file found to delete. [2025-09-16T19:46:19.398440] [INFO ] [MAIN ] Update Progress: 1567/2369 symbols completed. NYC took 12.1s. Estimated remaining: 1h 25m 6s. Rate: 9.4 symbols/min [2025-09-16T19:46:19.569922] [INFO ] [MAIN ] O: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:46:19.570125] [DEBUG] [LOCAL ] O: No existing data file found in primary storage. [2025-09-16T19:46:19.570164] [WARN ] [MAIN ] O: No existing data found, performing full refresh instead. [2025-09-16T19:46:19.570336] [INFO ] [MAIN ] O: Wiping existing primary data before full refresh. [2025-09-16T19:46:19.570377] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-09-16T19:46:19.570421] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-09-16T19:46:19.570454] [INFO ] [MAIN ] O: Starting full primary refresh. [2025-09-16T19:46:19.581635] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-03. [2025-09-16T19:46:19.935021] [INFO ] [REMOTE ] O: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:46:20.374899] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-03. [2025-09-16T19:46:21.174930] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-06. [2025-09-16T19:46:21.393536] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-16T19:46:21.455340] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-16T19:46:21.974898] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-04. [2025-09-16T19:46:22.286092] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-16T19:46:22.774942] [INFO ] [REMOTE ] O: Fetching primary data for 2025-02. [2025-09-16T19:46:23.571802] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-16T19:46:23.581627] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-07. [2025-09-16T19:46:24.259970] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-16T19:46:24.374914] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-04. [2025-09-16T19:46:24.939130] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-09-16T19:46:25.174890] [INFO ] [REMOTE ] O: Fetching primary data for 2025-03. [2025-09-16T19:46:25.726187] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-16T19:46:25.974903] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-05. [2025-09-16T19:46:26.774901] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-05. [2025-09-16T19:46:27.574868] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-08. [2025-09-16T19:46:27.725728] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-09-16T19:46:28.066039] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-16T19:46:28.114907] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-16T19:46:28.374874] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-06. [2025-09-16T19:46:28.937161] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-16T19:46:29.174902] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-06. [2025-09-16T19:46:29.974898] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-09. [2025-09-16T19:46:30.039673] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-16T19:46:30.512608] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-16T19:46:30.689693] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-16T19:46:30.692287] [INFO ] [REMOTE ] NXRT: Full fetch complete (20221 records). [2025-09-16T19:46:30.692358] [DEBUG] [VALIDATOR ] NXRT: Validating primary data. [2025-09-16T19:46:30.780046] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-07. [2025-09-16T19:46:31.082400] [DEBUG] [VALIDATOR ] NXRT: All expected trading days are present. [2025-09-16T19:46:31.082479] [DEBUG] [VALIDATOR ] NXRT: Primary data validation passed. [2025-09-16T19:46:31.082989] [INFO ] [MAIN ] NXRT: Fetched primary data is valid. [2025-09-16T19:46:31.083066] [DEBUG] [LOCAL ] NXRT: Saving primary data. [2025-09-16T19:46:31.083666] [DEBUG] [LOCAL ] NXRT: Trimmed 20221 records to 13690 (keeping 150 days of data) [2025-09-16T19:46:31.170961] [DEBUG] [LOCAL ] NXRT: Primary data saved (13690 records). [2025-09-16T19:46:31.171095] [INFO ] [MAIN ] NXRT: Full history saved. [2025-09-16T19:46:31.171197] [INFO ] [MAIN ] Update Progress: 1568/2369 symbols completed. NXRT took 32.6s. Estimated remaining: 1h 25m 2s. Rate: 9.4 symbols/min [2025-09-16T19:46:31.350299] [INFO ] [MAIN ] OBDC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:46:31.388569] [DEBUG] [LOCAL ] OBDC: Loaded 37788 existing records from primary storage. [2025-09-16T19:46:31.388726] [INFO ] [MAIN ] OBDC: Loaded 37788 existing records. [2025-09-16T19:46:31.576085] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-07. [2025-09-16T19:46:31.579381] [WARN ] [MAIN ] OBDC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:46:31.580722] [INFO ] [MAIN ] OBDC: Wiping existing primary data before full refresh. [2025-09-16T19:46:31.580781] [INFO ] [LOCAL ] OBDC: Starting deletion of primary data. [2025-09-16T19:46:31.581694] [DEBUG] [LOCAL ] OBDC: Deleted primary data file. [2025-09-16T19:46:31.581759] [INFO ] [MAIN ] OBDC: Starting full primary refresh. [2025-09-16T19:46:31.951000] [INFO ] [REMOTE ] OBDC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:46:32.374879] [INFO ] [REMOTE ] O: Fetching primary data for 2025-04. [2025-09-16T19:46:32.476737] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-16T19:46:32.909746] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-16T19:46:33.174911] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-08. [2025-09-16T19:46:33.974950] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-02. [2025-09-16T19:46:34.774876] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-08. [2025-09-16T19:46:34.900245] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-04 (2.53 seconds). [2025-09-16T19:46:34.943999] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-16T19:46:35.436067] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-16T19:46:35.574875] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-03. [2025-09-16T19:46:35.668844] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-16T19:46:36.374910] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-09. [2025-09-16T19:46:37.174907] [INFO ] [REMOTE ] O: Fetching primary data for 2025-05. [2025-09-16T19:46:37.348580] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-16T19:46:37.637385] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-16T19:46:37.642458] [INFO ] [REMOTE ] NZF: Full fetch complete (31881 records). [2025-09-16T19:46:37.642596] [DEBUG] [VALIDATOR ] NZF: Validating primary data. [2025-09-16T19:46:37.980076] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-04. [2025-09-16T19:46:38.029259] [DEBUG] [VALIDATOR ] NZF: All expected trading days are present. [2025-09-16T19:46:38.029351] [DEBUG] [VALIDATOR ] NZF: Primary data validation passed. [2025-09-16T19:46:38.030048] [INFO ] [MAIN ] NZF: Fetched primary data is valid. [2025-09-16T19:46:38.030095] [DEBUG] [LOCAL ] NZF: Saving primary data. [2025-09-16T19:46:38.030991] [DEBUG] [LOCAL ] NZF: Trimmed 31881 records to 21331 (keeping 150 days of data) [2025-09-16T19:46:38.175278] [DEBUG] [LOCAL ] NZF: Primary data saved (21331 records). [2025-09-16T19:46:38.175419] [INFO ] [MAIN ] NZF: Full history saved. [2025-09-16T19:46:38.175559] [INFO ] [MAIN ] Update Progress: 1569/2369 symbols completed. NZF took 22.5s. Estimated remaining: 1h 24m 56s. Rate: 9.4 symbols/min [2025-09-16T19:46:38.362884] [INFO ] [MAIN ] OBK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:46:38.376116] [DEBUG] [LOCAL ] OBK: Loaded 11716 existing records from primary storage. [2025-09-16T19:46:38.376256] [INFO ] [MAIN ] OBK: Loaded 11716 existing records. [2025-09-16T19:46:38.563507] [WARN ] [MAIN ] OBK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:46:38.563804] [INFO ] [MAIN ] OBK: Wiping existing primary data before full refresh. [2025-09-16T19:46:38.563852] [INFO ] [LOCAL ] OBK: Starting deletion of primary data. [2025-09-16T19:46:38.564344] [DEBUG] [LOCAL ] OBK: Deleted primary data file. [2025-09-16T19:46:38.564397] [INFO ] [MAIN ] OBK: Starting full primary refresh. [2025-09-16T19:46:38.788024] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-09. [2025-09-16T19:46:38.938318] [INFO ] [REMOTE ] OBK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:46:39.574957] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-02. [2025-09-16T19:46:39.766262] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-05 (2.59 seconds). [2025-09-16T19:46:39.829875] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-16T19:46:40.049773] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-16T19:46:40.061107] [INFO ] [REMOTE ] NYT: Full fetch complete (54655 records). [2025-09-16T19:46:40.061340] [DEBUG] [VALIDATOR ] NYT: Validating primary data. [2025-09-16T19:46:40.244580] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-16T19:46:40.384104] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-03. [2025-09-16T19:46:40.668859] [DEBUG] [VALIDATOR ] NYT: All expected trading days are present. [2025-09-16T19:46:40.668961] [DEBUG] [VALIDATOR ] NYT: Primary data validation passed. [2025-09-16T19:46:40.669958] [INFO ] [MAIN ] NYT: Fetched primary data is valid. [2025-09-16T19:46:40.670049] [DEBUG] [LOCAL ] NYT: Saving primary data. [2025-09-16T19:46:40.671918] [DEBUG] [LOCAL ] NYT: Trimmed 54655 records to 37131 (keeping 150 days of data) [2025-09-16T19:46:40.947555] [DEBUG] [LOCAL ] NYT: Primary data saved (37131 records). [2025-09-16T19:46:40.947829] [INFO ] [MAIN ] NYT: Full history saved. [2025-09-16T19:46:40.947936] [INFO ] [MAIN ] Update Progress: 1570/2369 symbols completed. NYT took 30.5s. Estimated remaining: 1h 24m 48s. Rate: 9.4 symbols/min [2025-09-16T19:46:41.134912] [INFO ] [MAIN ] OC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:46:41.174196] [DEBUG] [LOCAL ] OC: Loaded 32462 existing records from primary storage. [2025-09-16T19:46:41.174379] [INFO ] [MAIN ] OC: Loaded 32462 existing records. [2025-09-16T19:46:41.185630] [INFO ] [REMOTE ] O: Fetching primary data for 2025-06. [2025-09-16T19:46:41.354633] [WARN ] [MAIN ] OC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:46:41.354873] [INFO ] [MAIN ] OC: Wiping existing primary data before full refresh. [2025-09-16T19:46:41.354936] [INFO ] [LOCAL ] OC: Starting deletion of primary data. [2025-09-16T19:46:41.355692] [DEBUG] [LOCAL ] OC: Deleted primary data file. [2025-09-16T19:46:41.355741] [INFO ] [MAIN ] OC: Starting full primary refresh. [2025-09-16T19:46:41.704347] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-16T19:46:41.725734] [INFO ] [REMOTE ] OC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:46:41.974909] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-02. [2025-09-16T19:46:42.774991] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-05. [2025-09-16T19:46:43.416004] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-16T19:46:43.563040] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-16T19:46:43.574845] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-03. [2025-09-16T19:46:44.119050] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-16T19:46:44.374919] [INFO ] [REMOTE ] O: Fetching primary data for 2025-07. [2025-09-16T19:46:45.174925] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-04. [2025-09-16T19:46:45.496660] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-16T19:46:45.974916] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-06. [2025-09-16T19:46:46.376533] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-16T19:46:46.774926] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-05. [2025-09-16T19:46:46.959756] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-09-16T19:46:47.574920] [INFO ] [REMOTE ] O: Fetching primary data for 2025-08. [2025-09-16T19:46:47.680159] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-16T19:46:47.703145] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-16T19:46:48.374925] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-07. [2025-09-16T19:46:49.174945] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-06. [2025-09-16T19:46:49.980180] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-04. [2025-09-16T19:46:49.983475] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-09-16T19:46:50.107446] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-16T19:46:50.127882] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-16T19:46:50.774900] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-07. [2025-09-16T19:46:51.574862] [INFO ] [REMOTE ] O: Fetching primary data for 2025-09. [2025-09-16T19:46:51.672379] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-16T19:46:51.901459] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-16T19:46:52.374892] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-05. [2025-09-16T19:46:53.174946] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-08. [2025-09-16T19:46:53.869311] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-09-16T19:46:53.878032] [INFO ] [REMOTE ] O: Full fetch complete (58076 records). [2025-09-16T19:46:53.878167] [DEBUG] [VALIDATOR ] O: Validating primary data. [2025-09-16T19:46:53.984609] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-08. [2025-09-16T19:46:54.079101] [WARN ] [VALIDATOR ] O: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-16T19:46:54.080246] [FATAL] [MAIN ] O: Fetched primary data is invalid. Refusing to save it. [2025-09-16T19:46:54.080334] [WARN ] [MAIN ] O: Deleting existing primary and derivative data due to validation failure. [2025-09-16T19:46:54.080417] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-09-16T19:46:54.080537] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-09-16T19:46:54.080611] [INFO ] [LOCAL ] O: Starting deletion of derivative data. [2025-09-16T19:46:54.080692] [DEBUG] [LOCAL ] O: No derivative data file found to delete. [2025-09-16T19:46:54.080823] [INFO ] [MAIN ] Update Progress: 1571/2369 symbols completed. O took 34.7s. Estimated remaining: 1h 24m 45s. Rate: 9.4 symbols/min [2025-09-16T19:46:54.254146] [INFO ] [MAIN ] OCFT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:46:54.282070] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-16T19:46:54.294976] [DEBUG] [LOCAL ] OCFT: Loaded 5759 existing records from primary storage. [2025-09-16T19:46:54.295367] [INFO ] [MAIN ] OCFT: Loaded 5759 existing records. [2025-09-16T19:46:54.470998] [WARN ] [MAIN ] OCFT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:46:54.471283] [INFO ] [MAIN ] OCFT: Wiping existing primary data before full refresh. [2025-09-16T19:46:54.471332] [INFO ] [LOCAL ] OCFT: Starting deletion of primary data. [2025-09-16T19:46:54.471716] [DEBUG] [LOCAL ] OCFT: Deleted primary data file. [2025-09-16T19:46:54.471764] [INFO ] [MAIN ] OCFT: Starting full primary refresh. [2025-09-16T19:46:54.777355] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-06. [2025-09-16T19:46:54.866460] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-16T19:46:54.874265] [INFO ] [REMOTE ] OCFT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:46:54.909524] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-16T19:46:55.574903] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-09. [2025-09-16T19:46:56.374959] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-02. [2025-09-16T19:46:56.483044] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-16T19:46:56.539299] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-16T19:46:56.541917] [INFO ] [REMOTE ] OBK: Full fetch complete (17549 records). [2025-09-16T19:46:56.541990] [DEBUG] [VALIDATOR ] OBK: Validating primary data. [2025-09-16T19:46:56.906747] [DEBUG] [VALIDATOR ] OBK: All expected trading days are present. [2025-09-16T19:46:56.906832] [DEBUG] [VALIDATOR ] OBK: Primary data validation passed. [2025-09-16T19:46:56.907236] [INFO ] [MAIN ] OBK: Fetched primary data is valid. [2025-09-16T19:46:56.907277] [DEBUG] [LOCAL ] OBK: Saving primary data. [2025-09-16T19:46:56.907900] [DEBUG] [LOCAL ] OBK: Trimmed 17549 records to 11883 (keeping 150 days of data) [2025-09-16T19:46:56.981389] [DEBUG] [LOCAL ] OBK: Primary data saved (11883 records). [2025-09-16T19:46:56.981534] [INFO ] [MAIN ] OBK: Full history saved. [2025-09-16T19:46:56.981661] [INFO ] [MAIN ] Update Progress: 1572/2369 symbols completed. OBK took 18.8s. Estimated remaining: 1h 24m 37s. Rate: 9.4 symbols/min [2025-09-16T19:46:57.152167] [INFO ] [MAIN ] ODC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:46:57.160096] [DEBUG] [LOCAL ] ODC: Loaded 6421 existing records from primary storage. [2025-09-16T19:46:57.160232] [INFO ] [MAIN ] ODC: Loaded 6421 existing records. [2025-09-16T19:46:57.180443] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-09. [2025-09-16T19:46:57.226744] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-16T19:46:57.353634] [WARN ] [MAIN ] ODC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:46:57.353913] [INFO ] [MAIN ] ODC: Wiping existing primary data before full refresh. [2025-09-16T19:46:57.353960] [INFO ] [LOCAL ] ODC: Starting deletion of primary data. [2025-09-16T19:46:57.354318] [DEBUG] [LOCAL ] ODC: Deleted primary data file. [2025-09-16T19:46:57.354365] [INFO ] [MAIN ] ODC: Starting full primary refresh. [2025-09-16T19:46:57.707542] [INFO ] [REMOTE ] ODC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:46:57.974899] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-03. [2025-09-16T19:46:58.774948] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-07. [2025-09-16T19:46:58.909001] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-16T19:46:58.915339] [INFO ] [REMOTE ] OBDC: Full fetch complete (56208 records). [2025-09-16T19:46:58.915538] [DEBUG] [VALIDATOR ] OBDC: Validating primary data. [2025-09-16T19:46:59.243633] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-16T19:46:59.340258] [DEBUG] [VALIDATOR ] OBDC: All expected trading days are present. [2025-09-16T19:46:59.340350] [DEBUG] [VALIDATOR ] OBDC: Primary data validation passed. [2025-09-16T19:46:59.341239] [INFO ] [MAIN ] OBDC: Fetched primary data is valid. [2025-09-16T19:46:59.341288] [DEBUG] [LOCAL ] OBDC: Saving primary data. [2025-09-16T19:46:59.342533] [DEBUG] [LOCAL ] OBDC: Trimmed 56208 records to 38178 (keeping 150 days of data) [2025-09-16T19:46:59.575288] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-04. [2025-09-16T19:46:59.582902] [DEBUG] [LOCAL ] OBDC: Primary data saved (38178 records). [2025-09-16T19:46:59.582994] [INFO ] [MAIN ] OBDC: Full history saved. [2025-09-16T19:46:59.583074] [INFO ] [MAIN ] Update Progress: 1573/2369 symbols completed. OBDC took 28.4s. Estimated remaining: 1h 24m 29s. Rate: 9.4 symbols/min [2025-09-16T19:46:59.764365] [INFO ] [MAIN ] ODV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:46:59.783455] [DEBUG] [LOCAL ] ODV: Loaded 19786 existing records from primary storage. [2025-09-16T19:46:59.783581] [INFO ] [MAIN ] ODV: Loaded 19786 existing records. [2025-09-16T19:46:59.961630] [WARN ] [MAIN ] ODV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:46:59.961889] [INFO ] [MAIN ] ODV: Wiping existing primary data before full refresh. [2025-09-16T19:46:59.961941] [INFO ] [LOCAL ] ODV: Starting deletion of primary data. [2025-09-16T19:46:59.962510] [DEBUG] [LOCAL ] ODV: Deleted primary data file. [2025-09-16T19:46:59.962558] [INFO ] [MAIN ] ODV: Starting full primary refresh. [2025-09-16T19:47:00.293674] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-16T19:47:00.334475] [INFO ] [REMOTE ] ODV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:47:00.384949] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-02. [2025-09-16T19:47:00.390107] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-16T19:47:00.832408] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-16T19:47:01.174939] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-03. [2025-09-16T19:47:01.974913] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-02. [2025-09-16T19:47:02.150359] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-16T19:47:02.764476] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-16T19:47:02.774842] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-03. [2025-09-16T19:47:03.574897] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-04. [2025-09-16T19:47:03.706210] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-16T19:47:04.346577] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-16T19:47:04.374855] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-05. [2025-09-16T19:47:05.174729] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-16T19:47:05.174874] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-05. [2025-09-16T19:47:05.958886] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-16T19:47:05.974864] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-06. [2025-09-16T19:47:06.701337] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-16T19:47:06.774911] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-06. [2025-09-16T19:47:07.574939] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-07. [2025-09-16T19:47:07.614190] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-16T19:47:08.374914] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-04. [2025-09-16T19:47:08.396208] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-16T19:47:09.174913] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-08. [2025-09-16T19:47:09.436687] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-16T19:47:09.793312] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-16T19:47:09.974905] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-05. [2025-09-16T19:47:10.774895] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-07. [2025-09-16T19:47:11.071173] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-16T19:47:11.320481] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-16T19:47:11.574911] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-06. [2025-09-16T19:47:12.374913] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-09. [2025-09-16T19:47:12.646771] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-16T19:47:12.968221] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-16T19:47:12.969351] [INFO ] [REMOTE ] OCFT: Full fetch complete (10348 records). [2025-09-16T19:47:12.969421] [DEBUG] [VALIDATOR ] OCFT: Validating primary data. [2025-09-16T19:47:13.184827] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-07. [2025-09-16T19:47:13.352303] [DEBUG] [VALIDATOR ] OCFT: All expected trading days are present. [2025-09-16T19:47:13.352394] [DEBUG] [VALIDATOR ] OCFT: Primary data validation passed. [2025-09-16T19:47:13.352816] [INFO ] [MAIN ] OCFT: Fetched primary data is valid. [2025-09-16T19:47:13.352869] [DEBUG] [LOCAL ] OCFT: Saving primary data. [2025-09-16T19:47:13.353547] [DEBUG] [LOCAL ] OCFT: Trimmed 10348 records to 5772 (keeping 150 days of data) [2025-09-16T19:47:13.385770] [DEBUG] [LOCAL ] OCFT: Primary data saved (5772 records). [2025-09-16T19:47:13.385911] [INFO ] [MAIN ] OCFT: Full history saved. [2025-09-16T19:47:13.386014] [INFO ] [MAIN ] Update Progress: 1574/2369 symbols completed. OCFT took 19.3s. Estimated remaining: 1h 24m 26s. Rate: 9.4 symbols/min [2025-09-16T19:47:13.566186] [INFO ] [MAIN ] OEC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:47:13.566350] [DEBUG] [LOCAL ] OEC: No existing data file found in primary storage. [2025-09-16T19:47:13.566451] [WARN ] [MAIN ] OEC: No existing data found, performing full refresh instead. [2025-09-16T19:47:13.566562] [INFO ] [MAIN ] OEC: Wiping existing primary data before full refresh. [2025-09-16T19:47:13.566603] [INFO ] [LOCAL ] OEC: Starting deletion of primary data. [2025-09-16T19:47:13.566664] [DEBUG] [LOCAL ] OEC: No primary data file found to delete. [2025-09-16T19:47:13.566702] [INFO ] [MAIN ] OEC: Starting full primary refresh. [2025-09-16T19:47:13.918765] [INFO ] [REMOTE ] OEC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:47:13.974861] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-02. [2025-09-16T19:47:14.421787] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-16T19:47:14.774909] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-08. [2025-09-16T19:47:15.287990] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-16T19:47:15.574944] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-08. [2025-09-16T19:47:16.217164] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-16T19:47:16.374851] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-09. [2025-09-16T19:47:17.137679] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-16T19:47:17.174916] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-08. [2025-09-16T19:47:17.837706] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-16T19:47:17.842965] [INFO ] [REMOTE ] ODV: Full fetch complete (25737 records). [2025-09-16T19:47:17.843132] [DEBUG] [VALIDATOR ] ODV: Validating primary data. [2025-09-16T19:47:17.993166] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-09. [2025-09-16T19:47:18.028027] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-16T19:47:18.228958] [DEBUG] [VALIDATOR ] ODV: All expected trading days are present. [2025-09-16T19:47:18.229035] [DEBUG] [VALIDATOR ] ODV: Primary data validation passed. [2025-09-16T19:47:18.229556] [INFO ] [MAIN ] ODV: Fetched primary data is valid. [2025-09-16T19:47:18.229596] [DEBUG] [LOCAL ] ODV: Saving primary data. [2025-09-16T19:47:18.230228] [DEBUG] [LOCAL ] ODV: Trimmed 25737 records to 20103 (keeping 150 days of data) [2025-09-16T19:47:18.340533] [DEBUG] [LOCAL ] ODV: Primary data saved (20103 records). [2025-09-16T19:47:18.340676] [INFO ] [MAIN ] ODV: Full history saved. [2025-09-16T19:47:18.340771] [INFO ] [MAIN ] Update Progress: 1575/2369 symbols completed. ODV took 18.8s. Estimated remaining: 1h 24m 19s. Rate: 9.4 symbols/min [2025-09-16T19:47:18.521173] [INFO ] [MAIN ] OFG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:47:18.536237] [DEBUG] [LOCAL ] OFG: Loaded 15190 existing records from primary storage. [2025-09-16T19:47:18.536361] [INFO ] [MAIN ] OFG: Loaded 15190 existing records. [2025-09-16T19:47:18.718272] [WARN ] [MAIN ] OFG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:47:18.718532] [INFO ] [MAIN ] OFG: Wiping existing primary data before full refresh. [2025-09-16T19:47:18.718590] [INFO ] [LOCAL ] OFG: Starting deletion of primary data. [2025-09-16T19:47:18.719082] [DEBUG] [LOCAL ] OFG: Deleted primary data file. [2025-09-16T19:47:18.719134] [INFO ] [MAIN ] OFG: Starting full primary refresh. [2025-09-16T19:47:18.785604] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-03. [2025-09-16T19:47:19.087516] [INFO ] [REMOTE ] OFG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:47:19.574905] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-09. [2025-09-16T19:47:19.700374] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-16T19:47:19.707798] [INFO ] [REMOTE ] OC: Full fetch complete (48851 records). [2025-09-16T19:47:19.707947] [DEBUG] [VALIDATOR ] OC: Validating primary data. [2025-09-16T19:47:20.136263] [DEBUG] [VALIDATOR ] OC: All expected trading days are present. [2025-09-16T19:47:20.136385] [DEBUG] [VALIDATOR ] OC: Primary data validation passed. [2025-09-16T19:47:20.137268] [INFO ] [MAIN ] OC: Fetched primary data is valid. [2025-09-16T19:47:20.137320] [DEBUG] [LOCAL ] OC: Saving primary data. [2025-09-16T19:47:20.138730] [DEBUG] [LOCAL ] OC: Trimmed 48851 records to 32752 (keeping 150 days of data) [2025-09-16T19:47:20.163848] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-16T19:47:20.375002] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-02. [2025-09-16T19:47:20.379031] [DEBUG] [LOCAL ] OC: Primary data saved (32752 records). [2025-09-16T19:47:20.379134] [INFO ] [MAIN ] OC: Full history saved. [2025-09-16T19:47:20.379217] [INFO ] [MAIN ] Update Progress: 1576/2369 symbols completed. OC took 39.4s. Estimated remaining: 1h 24m 10s. Rate: 9.4 symbols/min [2025-09-16T19:47:20.499136] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-16T19:47:20.506338] [INFO ] [REMOTE ] ODC: Full fetch complete (8828 records). [2025-09-16T19:47:20.521793] [DEBUG] [VALIDATOR ] ODC: Validating primary data. [2025-09-16T19:47:20.633721] [INFO ] [MAIN ] OGE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:47:20.939440] [DEBUG] [LOCAL ] OGE: Loaded 34067 existing records from primary storage. [2025-09-16T19:47:20.960808] [INFO ] [MAIN ] OGE: Loaded 34067 existing records. [2025-09-16T19:47:21.042636] [DEBUG] [VALIDATOR ] ODC: All expected trading days are present. [2025-09-16T19:47:21.080006] [DEBUG] [VALIDATOR ] ODC: Primary data validation passed. [2025-09-16T19:47:21.107369] [INFO ] [MAIN ] ODC: Fetched primary data is valid. [2025-09-16T19:47:21.117708] [DEBUG] [LOCAL ] ODC: Saving primary data. [2025-09-16T19:47:21.134564] [DEBUG] [LOCAL ] ODC: Trimmed 8828 records to 6472 (keeping 150 days of data) [2025-09-16T19:47:21.176338] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-04. [2025-09-16T19:47:21.246193] [WARN ] [MAIN ] OGE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:47:21.248419] [INFO ] [MAIN ] OGE: Wiping existing primary data before full refresh. [2025-09-16T19:47:21.249329] [INFO ] [LOCAL ] OGE: Starting deletion of primary data. [2025-09-16T19:47:21.250075] [DEBUG] [LOCAL ] ODC: Primary data saved (6472 records). [2025-09-16T19:47:21.250312] [INFO ] [MAIN ] ODC: Full history saved. [2025-09-16T19:47:21.250430] [INFO ] [MAIN ] Update Progress: 1577/2369 symbols completed. ODC took 24.3s. Estimated remaining: 1h 24m 1s. Rate: 9.4 symbols/min [2025-09-16T19:47:21.256385] [DEBUG] [LOCAL ] OGE: Deleted primary data file. [2025-09-16T19:47:21.258880] [INFO ] [MAIN ] OGE: Starting full primary refresh. [2025-09-16T19:47:21.593728] [INFO ] [MAIN ] OGN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:47:21.818572] [INFO ] [REMOTE ] OGE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:47:21.838548] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-16T19:47:21.858445] [DEBUG] [LOCAL ] OGN: Loaded 39217 existing records from primary storage. [2025-09-16T19:47:21.858612] [INFO ] [MAIN ] OGN: Loaded 39217 existing records. [2025-09-16T19:47:21.980001] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-03. [2025-09-16T19:47:22.060755] [WARN ] [MAIN ] OGN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:47:22.060980] [INFO ] [MAIN ] OGN: Wiping existing primary data before full refresh. [2025-09-16T19:47:22.061049] [INFO ] [LOCAL ] OGN: Starting deletion of primary data. [2025-09-16T19:47:22.062176] [DEBUG] [LOCAL ] OGN: Deleted primary data file. [2025-09-16T19:47:22.062229] [INFO ] [MAIN ] OGN: Starting full primary refresh. [2025-09-16T19:47:22.420487] [INFO ] [REMOTE ] OGN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:47:22.666677] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-16T19:47:22.774855] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-05. [2025-09-16T19:47:23.391923] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-16T19:47:23.574906] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-02. [2025-09-16T19:47:24.281193] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-16T19:47:24.374889] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-06. [2025-09-16T19:47:25.174897] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-02. [2025-09-16T19:47:25.340312] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-16T19:47:25.435524] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-16T19:47:25.974891] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-03. [2025-09-16T19:47:26.774873] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-04. [2025-09-16T19:47:26.893112] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-16T19:47:27.574901] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-03. [2025-09-16T19:47:27.626784] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-16T19:47:28.097959] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-16T19:47:28.374888] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-05. [2025-09-16T19:47:29.174894] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-04. [2025-09-16T19:47:29.298459] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-16T19:47:29.499176] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-16T19:47:29.974892] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-04. [2025-09-16T19:47:30.769049] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-16T19:47:30.778846] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-07. [2025-09-16T19:47:31.574965] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-06. [2025-09-16T19:47:31.834454] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-16T19:47:31.894861] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-16T19:47:32.374939] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-08. [2025-09-16T19:47:32.645339] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-16T19:47:33.174934] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-05. [2025-09-16T19:47:33.416036] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-16T19:47:33.974915] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-07. [2025-09-16T19:47:34.774894] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-05. [2025-09-16T19:47:35.087844] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-16T19:47:35.130649] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-16T19:47:35.574918] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-06. [2025-09-16T19:47:36.221015] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-16T19:47:36.374908] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-06. [2025-09-16T19:47:37.174878] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-09. [2025-09-16T19:47:37.261043] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-16T19:47:37.485567] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-16T19:47:37.974954] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-07. [2025-09-16T19:47:38.291391] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-16T19:47:38.295970] [INFO ] [REMOTE ] OEC: Full fetch complete (40687 records). [2025-09-16T19:47:38.296062] [DEBUG] [VALIDATOR ] OEC: Validating primary data. [2025-09-16T19:47:38.686261] [DEBUG] [VALIDATOR ] OEC: All expected trading days are present. [2025-09-16T19:47:38.686342] [DEBUG] [VALIDATOR ] OEC: Primary data validation passed. [2025-09-16T19:47:38.687173] [INFO ] [MAIN ] OEC: Fetched primary data is valid. [2025-09-16T19:47:38.687234] [DEBUG] [LOCAL ] OEC: Saving primary data. [2025-09-16T19:47:38.688132] [DEBUG] [LOCAL ] OEC: Trimmed 40687 records to 27552 (keeping 150 days of data) [2025-09-16T19:47:38.783788] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-07. [2025-09-16T19:47:38.862654] [DEBUG] [LOCAL ] OEC: Primary data saved (27552 records). [2025-09-16T19:47:38.862810] [INFO ] [MAIN ] OEC: Full history saved. [2025-09-16T19:47:38.862888] [INFO ] [MAIN ] Update Progress: 1578/2369 symbols completed. OEC took 25.5s. Estimated remaining: 1h 24m 1s. Rate: 9.4 symbols/min [2025-09-16T19:47:39.034619] [INFO ] [MAIN ] OGS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:47:39.059471] [DEBUG] [LOCAL ] OGS: Loaded 25749 existing records from primary storage. [2025-09-16T19:47:39.059630] [INFO ] [MAIN ] OGS: Loaded 25749 existing records. [2025-09-16T19:47:39.242123] [WARN ] [MAIN ] OGS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:47:39.242456] [INFO ] [MAIN ] OGS: Wiping existing primary data before full refresh. [2025-09-16T19:47:39.242514] [INFO ] [LOCAL ] OGS: Starting deletion of primary data. [2025-09-16T19:47:39.243202] [DEBUG] [LOCAL ] OGS: Deleted primary data file. [2025-09-16T19:47:39.243252] [INFO ] [MAIN ] OGS: Starting full primary refresh. [2025-09-16T19:47:39.599735] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-08. [2025-09-16T19:47:39.605082] [INFO ] [REMOTE ] OGS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:47:39.801497] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-16T19:47:40.045821] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-16T19:47:40.374969] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-08. [2025-09-16T19:47:40.653065] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-16T19:47:41.174927] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-08. [2025-09-16T19:47:41.880877] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-16T19:47:41.974915] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-09. [2025-09-16T19:47:42.706708] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-16T19:47:42.774937] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-09. [2025-09-16T19:47:43.028242] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-16T19:47:43.030868] [INFO ] [REMOTE ] OFG: Full fetch complete (25065 records). [2025-09-16T19:47:43.030951] [DEBUG] [VALIDATOR ] OFG: Validating primary data. [2025-09-16T19:47:43.406042] [DEBUG] [VALIDATOR ] OFG: All expected trading days are present. [2025-09-16T19:47:43.406123] [DEBUG] [VALIDATOR ] OFG: Primary data validation passed. [2025-09-16T19:47:43.406746] [INFO ] [MAIN ] OFG: Fetched primary data is valid. [2025-09-16T19:47:43.406801] [DEBUG] [LOCAL ] OFG: Saving primary data. [2025-09-16T19:47:43.407431] [DEBUG] [LOCAL ] OFG: Trimmed 25065 records to 15322 (keeping 150 days of data) [2025-09-16T19:47:43.502889] [DEBUG] [LOCAL ] OFG: Primary data saved (15322 records). [2025-09-16T19:47:43.503033] [INFO ] [MAIN ] OFG: Full history saved. [2025-09-16T19:47:43.503118] [INFO ] [MAIN ] Update Progress: 1579/2369 symbols completed. OFG took 25.2s. Estimated remaining: 1h 23m 53s. Rate: 9.4 symbols/min [2025-09-16T19:47:43.580052] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-02. [2025-09-16T19:47:43.681664] [INFO ] [MAIN ] OHI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:47:43.718956] [DEBUG] [LOCAL ] OHI: Loaded 38444 existing records from primary storage. [2025-09-16T19:47:43.719119] [INFO ] [MAIN ] OHI: Loaded 38444 existing records. [2025-09-16T19:47:43.896598] [WARN ] [MAIN ] OHI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:47:43.896902] [INFO ] [MAIN ] OHI: Wiping existing primary data before full refresh. [2025-09-16T19:47:43.896950] [INFO ] [LOCAL ] OHI: Starting deletion of primary data. [2025-09-16T19:47:43.897836] [DEBUG] [LOCAL ] OHI: Deleted primary data file. [2025-09-16T19:47:43.897886] [INFO ] [MAIN ] OHI: Starting full primary refresh. [2025-09-16T19:47:44.245211] [INFO ] [REMOTE ] OHI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:47:44.331086] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-16T19:47:44.337746] [INFO ] [REMOTE ] OGN: Full fetch complete (57759 records). [2025-09-16T19:47:44.337890] [DEBUG] [VALIDATOR ] OGN: Validating primary data. [2025-09-16T19:47:44.381445] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-09. [2025-09-16T19:47:44.733256] [DEBUG] [VALIDATOR ] OGN: All expected trading days are present. [2025-09-16T19:47:44.733357] [DEBUG] [VALIDATOR ] OGN: Primary data validation passed. [2025-09-16T19:47:44.734359] [INFO ] [MAIN ] OGN: Fetched primary data is valid. [2025-09-16T19:47:44.734420] [DEBUG] [LOCAL ] OGN: Saving primary data. [2025-09-16T19:47:44.735816] [DEBUG] [LOCAL ] OGN: Trimmed 57759 records to 39602 (keeping 150 days of data) [2025-09-16T19:47:44.987369] [DEBUG] [LOCAL ] OGN: Primary data saved (39602 records). [2025-09-16T19:47:44.987574] [INFO ] [MAIN ] OGN: Full history saved. [2025-09-16T19:47:44.987724] [INFO ] [MAIN ] Update Progress: 1580/2369 symbols completed. OGN took 23.7s. Estimated remaining: 1h 23m 45s. Rate: 9.4 symbols/min [2025-09-16T19:47:45.178614] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-02. [2025-09-16T19:47:45.195143] [INFO ] [MAIN ] OI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:47:45.199849] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-16T19:47:45.239491] [DEBUG] [LOCAL ] OI: Loaded 34667 existing records from primary storage. [2025-09-16T19:47:45.239659] [INFO ] [MAIN ] OI: Loaded 34667 existing records. [2025-09-16T19:47:45.418713] [WARN ] [MAIN ] OI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:47:45.418976] [INFO ] [MAIN ] OI: Wiping existing primary data before full refresh. [2025-09-16T19:47:45.419024] [INFO ] [LOCAL ] OI: Starting deletion of primary data. [2025-09-16T19:47:45.419886] [DEBUG] [LOCAL ] OI: Deleted primary data file. [2025-09-16T19:47:45.419938] [INFO ] [MAIN ] OI: Starting full primary refresh. [2025-09-16T19:47:45.776864] [INFO ] [REMOTE ] OI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:47:45.979998] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-02. [2025-09-16T19:47:45.990188] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-16T19:47:45.996808] [INFO ] [REMOTE ] OGE: Full fetch complete (50727 records). [2025-09-16T19:47:45.996955] [DEBUG] [VALIDATOR ] OGE: Validating primary data. [2025-09-16T19:47:46.384572] [DEBUG] [VALIDATOR ] OGE: All expected trading days are present. [2025-09-16T19:47:46.384677] [DEBUG] [VALIDATOR ] OGE: Primary data validation passed. [2025-09-16T19:47:46.385594] [INFO ] [MAIN ] OGE: Fetched primary data is valid. [2025-09-16T19:47:46.385670] [DEBUG] [LOCAL ] OGE: Saving primary data. [2025-09-16T19:47:46.386800] [DEBUG] [LOCAL ] OGE: Trimmed 50727 records to 34385 (keeping 150 days of data) [2025-09-16T19:47:46.606863] [DEBUG] [LOCAL ] OGE: Primary data saved (34385 records). [2025-09-16T19:47:46.607022] [INFO ] [MAIN ] OGE: Full history saved. [2025-09-16T19:47:46.607132] [INFO ] [MAIN ] Update Progress: 1581/2369 symbols completed. OGE took 26.2s. Estimated remaining: 1h 23m 36s. Rate: 9.4 symbols/min [2025-09-16T19:47:46.787839] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-03. [2025-09-16T19:47:46.791235] [INFO ] [MAIN ] OIA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:47:46.803572] [DEBUG] [LOCAL ] OIA: Loaded 9824 existing records from primary storage. [2025-09-16T19:47:46.803750] [INFO ] [MAIN ] OIA: Loaded 9824 existing records. [2025-09-16T19:47:46.990827] [WARN ] [MAIN ] OIA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:47:46.991283] [INFO ] [MAIN ] OIA: Wiping existing primary data before full refresh. [2025-09-16T19:47:46.991351] [INFO ] [LOCAL ] OIA: Starting deletion of primary data. [2025-09-16T19:47:46.991788] [DEBUG] [LOCAL ] OIA: Deleted primary data file. [2025-09-16T19:47:46.991840] [INFO ] [MAIN ] OIA: Starting full primary refresh. [2025-09-16T19:47:47.287266] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-16T19:47:47.398439] [INFO ] [REMOTE ] OIA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:47:47.507883] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-16T19:47:47.574860] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-03. [2025-09-16T19:47:48.273977] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-16T19:47:48.374957] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-04. [2025-09-16T19:47:49.174924] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-02. [2025-09-16T19:47:49.234237] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-16T19:47:49.780915] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-16T19:47:49.974914] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-03. [2025-09-16T19:47:50.179084] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-16T19:47:50.774926] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-05. [2025-09-16T19:47:51.574978] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-04. [2025-09-16T19:47:51.890887] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-16T19:47:52.068260] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-16T19:47:52.374929] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-04. [2025-09-16T19:47:52.932944] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-16T19:47:53.174925] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-06. [2025-09-16T19:47:53.974897] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-03. [2025-09-16T19:47:54.192087] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-16T19:47:54.276152] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-16T19:47:54.568127] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-16T19:47:54.774900] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-04. [2025-09-16T19:47:55.488763] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-16T19:47:55.574919] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-05. [2025-09-16T19:47:56.374917] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-05. [2025-09-16T19:47:56.423997] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-16T19:47:57.174914] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-05. [2025-09-16T19:47:57.974917] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-06. [2025-09-16T19:47:58.306962] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-16T19:47:58.769567] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-16T19:47:58.778875] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-07. [2025-09-16T19:47:58.823323] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-16T19:47:59.574890] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-06. [2025-09-16T19:48:00.275771] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-16T19:48:00.374851] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-08. [2025-09-16T19:48:01.120194] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-16T19:48:01.174888] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-07. [2025-09-16T19:48:01.548345] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-16T19:48:01.974928] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-07. [2025-09-16T19:48:02.783008] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-06. [2025-09-16T19:48:02.803554] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-16T19:48:02.820770] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-16T19:48:03.574898] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-08. [2025-09-16T19:48:04.374874] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-09. [2025-09-16T19:48:04.644335] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-16T19:48:04.666891] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-16T19:48:05.174901] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-08. [2025-09-16T19:48:05.709820] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-16T19:48:05.713604] [INFO ] [REMOTE ] OGS: Full fetch complete (36989 records). [2025-09-16T19:48:05.713715] [DEBUG] [VALIDATOR ] OGS: Validating primary data. [2025-09-16T19:48:05.980102] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-09. [2025-09-16T19:48:06.082073] [DEBUG] [VALIDATOR ] OGS: All expected trading days are present. [2025-09-16T19:48:06.082147] [DEBUG] [VALIDATOR ] OGS: Primary data validation passed. [2025-09-16T19:48:06.082843] [INFO ] [MAIN ] OGS: Fetched primary data is valid. [2025-09-16T19:48:06.082886] [DEBUG] [LOCAL ] OGS: Saving primary data. [2025-09-16T19:48:06.083689] [DEBUG] [LOCAL ] OGS: Trimmed 36989 records to 25928 (keeping 150 days of data) [2025-09-16T19:48:06.249968] [DEBUG] [LOCAL ] OGS: Primary data saved (25928 records). [2025-09-16T19:48:06.250146] [INFO ] [MAIN ] OGS: Full history saved. [2025-09-16T19:48:06.250258] [INFO ] [MAIN ] Update Progress: 1582/2369 symbols completed. OGS took 27.4s. Estimated remaining: 1h 23m 36s. Rate: 9.4 symbols/min [2025-09-16T19:48:06.426712] [INFO ] [MAIN ] OII: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:48:06.459252] [DEBUG] [LOCAL ] OII: Loaded 31144 existing records from primary storage. [2025-09-16T19:48:06.459403] [INFO ] [MAIN ] OII: Loaded 31144 existing records. [2025-09-16T19:48:06.641478] [WARN ] [MAIN ] OII: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:48:06.641763] [INFO ] [MAIN ] OII: Wiping existing primary data before full refresh. [2025-09-16T19:48:06.641811] [INFO ] [LOCAL ] OII: Starting deletion of primary data. [2025-09-16T19:48:06.642512] [DEBUG] [LOCAL ] OII: Deleted primary data file. [2025-09-16T19:48:06.642559] [INFO ] [MAIN ] OII: Starting full primary refresh. [2025-09-16T19:48:06.796165] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-07. [2025-09-16T19:48:07.038627] [INFO ] [REMOTE ] OII: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:48:07.045634] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-16T19:48:07.074632] [INFO ] [REMOTE ] OIA: Full fetch complete (14923 records). [2025-09-16T19:48:07.076539] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-16T19:48:07.076609] [DEBUG] [VALIDATOR ] OIA: Validating primary data. [2025-09-16T19:48:07.446536] [DEBUG] [VALIDATOR ] OIA: All expected trading days are present. [2025-09-16T19:48:07.446615] [DEBUG] [VALIDATOR ] OIA: Primary data validation passed. [2025-09-16T19:48:07.446962] [INFO ] [MAIN ] OIA: Fetched primary data is valid. [2025-09-16T19:48:07.447004] [DEBUG] [LOCAL ] OIA: Saving primary data. [2025-09-16T19:48:07.447529] [DEBUG] [LOCAL ] OIA: Trimmed 14923 records to 9965 (keeping 150 days of data) [2025-09-16T19:48:07.505756] [DEBUG] [LOCAL ] OIA: Primary data saved (9965 records). [2025-09-16T19:48:07.505904] [INFO ] [MAIN ] OIA: Full history saved. [2025-09-16T19:48:07.505994] [INFO ] [MAIN ] Update Progress: 1583/2369 symbols completed. OIA took 20.9s. Estimated remaining: 1h 23m 27s. Rate: 9.4 symbols/min [2025-09-16T19:48:07.580248] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-09. [2025-09-16T19:48:07.684099] [INFO ] [MAIN ] OIS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:48:07.710941] [DEBUG] [LOCAL ] OIS: Loaded 29521 existing records from primary storage. [2025-09-16T19:48:07.711072] [INFO ] [MAIN ] OIS: Loaded 29521 existing records. [2025-09-16T19:48:07.889532] [WARN ] [MAIN ] OIS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:48:07.889817] [INFO ] [MAIN ] OIS: Wiping existing primary data before full refresh. [2025-09-16T19:48:07.889871] [INFO ] [LOCAL ] OIS: Starting deletion of primary data. [2025-09-16T19:48:07.890438] [DEBUG] [LOCAL ] OIS: Deleted primary data file. [2025-09-16T19:48:07.890482] [INFO ] [MAIN ] OIS: Starting full primary refresh. [2025-09-16T19:48:08.244852] [INFO ] [REMOTE ] OIS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:48:08.374890] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-02. [2025-09-16T19:48:08.914408] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-16T19:48:08.944425] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-16T19:48:08.951450] [INFO ] [REMOTE ] OI: Full fetch complete (51372 records). [2025-09-16T19:48:08.951541] [DEBUG] [VALIDATOR ] OI: Validating primary data. [2025-09-16T19:48:09.182934] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-08. [2025-09-16T19:48:09.331992] [DEBUG] [VALIDATOR ] OI: All expected trading days are present. [2025-09-16T19:48:09.332080] [DEBUG] [VALIDATOR ] OI: Primary data validation passed. [2025-09-16T19:48:09.332954] [INFO ] [MAIN ] OI: Fetched primary data is valid. [2025-09-16T19:48:09.333032] [DEBUG] [LOCAL ] OI: Saving primary data. [2025-09-16T19:48:09.334365] [DEBUG] [LOCAL ] OI: Trimmed 51372 records to 34975 (keeping 150 days of data) [2025-09-16T19:48:09.413180] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-16T19:48:09.563718] [DEBUG] [LOCAL ] OI: Primary data saved (34975 records). [2025-09-16T19:48:09.563852] [INFO ] [MAIN ] OI: Full history saved. [2025-09-16T19:48:09.564810] [INFO ] [MAIN ] Update Progress: 1584/2369 symbols completed. OI took 24.6s. Estimated remaining: 1h 23m 19s. Rate: 9.4 symbols/min [2025-09-16T19:48:09.732472] [INFO ] [MAIN ] OKE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:48:09.774507] [DEBUG] [LOCAL ] OKE: Loaded 39550 existing records from primary storage. [2025-09-16T19:48:09.774685] [INFO ] [MAIN ] OKE: Loaded 39550 existing records. [2025-09-16T19:48:09.949050] [WARN ] [MAIN ] OKE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:48:09.949308] [INFO ] [MAIN ] OKE: Wiping existing primary data before full refresh. [2025-09-16T19:48:09.949361] [INFO ] [LOCAL ] OKE: Starting deletion of primary data. [2025-09-16T19:48:09.950128] [DEBUG] [LOCAL ] OKE: Deleted primary data file. [2025-09-16T19:48:09.950180] [INFO ] [MAIN ] OKE: Starting full primary refresh. [2025-09-16T19:48:09.980436] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-03. [2025-09-16T19:48:10.305602] [INFO ] [REMOTE ] OKE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:48:10.774884] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-02. [2025-09-16T19:48:11.050458] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-16T19:48:11.526360] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-16T19:48:11.574855] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-04. [2025-09-16T19:48:12.372868] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-16T19:48:12.382789] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-09. [2025-09-16T19:48:13.031257] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-16T19:48:13.174877] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-03. [2025-09-16T19:48:13.830458] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-16T19:48:13.836718] [INFO ] [REMOTE ] OHI: Full fetch complete (56693 records). [2025-09-16T19:48:13.836850] [DEBUG] [VALIDATOR ] OHI: Validating primary data. [2025-09-16T19:48:13.979905] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-05. [2025-09-16T19:48:14.214780] [DEBUG] [VALIDATOR ] OHI: All expected trading days are present. [2025-09-16T19:48:14.214871] [DEBUG] [VALIDATOR ] OHI: Primary data validation passed. [2025-09-16T19:48:14.215746] [INFO ] [MAIN ] OHI: Fetched primary data is valid. [2025-09-16T19:48:14.215792] [DEBUG] [LOCAL ] OHI: Saving primary data. [2025-09-16T19:48:14.216916] [DEBUG] [LOCAL ] OHI: Trimmed 56693 records to 38819 (keeping 150 days of data) [2025-09-16T19:48:14.452407] [DEBUG] [LOCAL ] OHI: Primary data saved (38819 records). [2025-09-16T19:48:14.452532] [INFO ] [MAIN ] OHI: Full history saved. [2025-09-16T19:48:14.452627] [INFO ] [MAIN ] Update Progress: 1585/2369 symbols completed. OHI took 30.9s. Estimated remaining: 1h 23m 12s. Rate: 9.4 symbols/min [2025-09-16T19:48:14.627762] [INFO ] [MAIN ] OKLO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:48:14.664883] [DEBUG] [LOCAL ] OKLO: Loaded 39779 existing records from primary storage. [2025-09-16T19:48:14.665023] [INFO ] [MAIN ] OKLO: Loaded 39779 existing records. [2025-09-16T19:48:14.780059] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-02. [2025-09-16T19:48:14.841714] [WARN ] [MAIN ] OKLO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:48:14.841909] [INFO ] [MAIN ] OKLO: Wiping existing primary data before full refresh. [2025-09-16T19:48:14.841962] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-09-16T19:48:14.842726] [DEBUG] [LOCAL ] OKLO: Deleted primary data file. [2025-09-16T19:48:14.842787] [INFO ] [MAIN ] OKLO: Starting full primary refresh. [2025-09-16T19:48:15.205757] [INFO ] [REMOTE ] OKLO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:48:15.240937] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-16T19:48:15.568134] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-16T19:48:15.576404] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-02. [2025-09-16T19:48:16.243663] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-16T19:48:16.374957] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-06. [2025-09-16T19:48:17.174956] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-04. [2025-09-16T19:48:17.913264] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-16T19:48:17.974851] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-07. [2025-09-16T19:48:18.157331] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-02 (2.58 seconds). [2025-09-16T19:48:18.780303] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-03. [2025-09-16T19:48:18.794931] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-16T19:48:19.443399] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-16T19:48:19.574856] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-08. [2025-09-16T19:48:20.374955] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-03. [2025-09-16T19:48:21.167659] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-16T19:48:21.175239] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-05. [2025-09-16T19:48:21.320172] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-09-16T19:48:21.974910] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-09. [2025-09-16T19:48:22.050330] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-16T19:48:22.631043] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-16T19:48:22.774895] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-04. [2025-09-16T19:48:23.088233] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-16T19:48:23.092400] [INFO ] [REMOTE ] OIS: Full fetch complete (44459 records). [2025-09-16T19:48:23.092590] [DEBUG] [VALIDATOR ] OIS: Validating primary data. [2025-09-16T19:48:23.478455] [DEBUG] [VALIDATOR ] OIS: All expected trading days are present. [2025-09-16T19:48:23.478533] [DEBUG] [VALIDATOR ] OIS: Primary data validation passed. [2025-09-16T19:48:23.479292] [INFO ] [MAIN ] OIS: Fetched primary data is valid. [2025-09-16T19:48:23.479354] [DEBUG] [LOCAL ] OIS: Saving primary data. [2025-09-16T19:48:23.480253] [DEBUG] [LOCAL ] OIS: Trimmed 44459 records to 29731 (keeping 150 days of data) [2025-09-16T19:48:23.595983] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-04. [2025-09-16T19:48:23.656781] [DEBUG] [LOCAL ] OIS: Primary data saved (29731 records). [2025-09-16T19:48:23.656973] [INFO ] [MAIN ] OIS: Full history saved. [2025-09-16T19:48:23.657165] [INFO ] [MAIN ] Update Progress: 1586/2369 symbols completed. OIS took 16.2s. Estimated remaining: 1h 23m 7s. Rate: 9.4 symbols/min [2025-09-16T19:48:23.825962] [INFO ] [MAIN ] OLN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:48:23.875997] [DEBUG] [LOCAL ] OLN: Loaded 38332 existing records from primary storage. [2025-09-16T19:48:23.876135] [INFO ] [MAIN ] OLN: Loaded 38332 existing records. [2025-09-16T19:48:24.056201] [WARN ] [MAIN ] OLN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:48:24.056460] [INFO ] [MAIN ] OLN: Wiping existing primary data before full refresh. [2025-09-16T19:48:24.056506] [INFO ] [LOCAL ] OLN: Starting deletion of primary data. [2025-09-16T19:48:24.057533] [DEBUG] [LOCAL ] OLN: Deleted primary data file. [2025-09-16T19:48:24.057594] [INFO ] [MAIN ] OLN: Starting full primary refresh. [2025-09-16T19:48:24.395962] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-06. [2025-09-16T19:48:24.435615] [INFO ] [REMOTE ] OLN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:48:24.466559] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-16T19:48:25.174898] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-05. [2025-09-16T19:48:25.974917] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-02. [2025-09-16T19:48:26.089597] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-16T19:48:26.250325] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-16T19:48:26.416949] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-04 (2.82 seconds). [2025-09-16T19:48:26.774905] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-07. [2025-09-16T19:48:27.574877] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-05. [2025-09-16T19:48:27.662658] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-16T19:48:28.374899] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-03. [2025-09-16T19:48:28.749747] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-16T19:48:29.174889] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-06. [2025-09-16T19:48:29.974882] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-08. [2025-09-16T19:48:30.110698] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-16T19:48:30.420451] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-05 (2.85 seconds). [2025-09-16T19:48:30.484571] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-16T19:48:30.774898] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-06. [2025-09-16T19:48:31.574869] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-04. [2025-09-16T19:48:31.666981] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-16T19:48:32.374946] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-09. [2025-09-16T19:48:33.179998] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-07. [2025-09-16T19:48:33.196035] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-16T19:48:33.383388] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-06 (2.61 seconds). [2025-09-16T19:48:33.974928] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-07. [2025-09-16T19:48:34.173798] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-16T19:48:34.181322] [INFO ] [REMOTE ] OKE: Full fetch complete (58212 records). [2025-09-16T19:48:34.181458] [DEBUG] [VALIDATOR ] OKE: Validating primary data. [2025-09-16T19:48:34.564115] [DEBUG] [VALIDATOR ] OKE: All expected trading days are present. [2025-09-16T19:48:34.564193] [DEBUG] [VALIDATOR ] OKE: Primary data validation passed. [2025-09-16T19:48:34.565076] [INFO ] [MAIN ] OKE: Fetched primary data is valid. [2025-09-16T19:48:34.565121] [DEBUG] [LOCAL ] OKE: Saving primary data. [2025-09-16T19:48:34.566777] [DEBUG] [LOCAL ] OKE: Trimmed 58212 records to 39937 (keeping 150 days of data) [2025-09-16T19:48:34.791706] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-05. [2025-09-16T19:48:34.832223] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-16T19:48:34.867615] [DEBUG] [LOCAL ] OKE: Primary data saved (39937 records). [2025-09-16T19:48:34.867793] [INFO ] [MAIN ] OKE: Full history saved. [2025-09-16T19:48:34.868526] [INFO ] [MAIN ] Update Progress: 1587/2369 symbols completed. OKE took 25.3s. Estimated remaining: 1h 23m 3s. Rate: 9.4 symbols/min [2025-09-16T19:48:35.039210] [INFO ] [MAIN ] OLP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:48:35.048623] [DEBUG] [LOCAL ] OLP: Loaded 6858 existing records from primary storage. [2025-09-16T19:48:35.048769] [INFO ] [MAIN ] OLP: Loaded 6858 existing records. [2025-09-16T19:48:35.230240] [WARN ] [MAIN ] OLP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:48:35.230535] [INFO ] [MAIN ] OLP: Wiping existing primary data before full refresh. [2025-09-16T19:48:35.230586] [INFO ] [LOCAL ] OLP: Starting deletion of primary data. [2025-09-16T19:48:35.230933] [DEBUG] [LOCAL ] OLP: Deleted primary data file. [2025-09-16T19:48:35.230988] [INFO ] [MAIN ] OLP: Starting full primary refresh. [2025-09-16T19:48:35.580472] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-08. [2025-09-16T19:48:35.601118] [INFO ] [REMOTE ] OLP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:48:36.374908] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-02. [2025-09-16T19:48:36.627448] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-16T19:48:36.670863] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-07 (2.70 seconds). [2025-09-16T19:48:36.706896] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-16T19:48:37.155501] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-16T19:48:37.174863] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-06. [2025-09-16T19:48:37.974941] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-09. [2025-09-16T19:48:38.774861] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-08. [2025-09-16T19:48:38.881910] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-16T19:48:39.373612] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-16T19:48:39.378555] [INFO ] [REMOTE ] OII: Full fetch complete (47031 records). [2025-09-16T19:48:39.378726] [DEBUG] [VALIDATOR ] OII: Validating primary data. [2025-09-16T19:48:39.579988] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-03. [2025-09-16T19:48:39.759851] [DEBUG] [VALIDATOR ] OII: All expected trading days are present. [2025-09-16T19:48:39.759941] [DEBUG] [VALIDATOR ] OII: Primary data validation passed. [2025-09-16T19:48:39.760752] [INFO ] [MAIN ] OII: Fetched primary data is valid. [2025-09-16T19:48:39.760802] [DEBUG] [LOCAL ] OII: Saving primary data. [2025-09-16T19:48:39.761948] [DEBUG] [LOCAL ] OII: Trimmed 47031 records to 31404 (keeping 150 days of data) [2025-09-16T19:48:39.956312] [DEBUG] [LOCAL ] OII: Primary data saved (31404 records). [2025-09-16T19:48:39.956527] [INFO ] [MAIN ] OII: Full history saved. [2025-09-16T19:48:39.956632] [INFO ] [MAIN ] Update Progress: 1588/2369 symbols completed. OII took 33.7s. Estimated remaining: 1h 22m 56s. Rate: 9.4 symbols/min [2025-09-16T19:48:40.125906] [INFO ] [MAIN ] OMC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:48:40.165204] [DEBUG] [LOCAL ] OMC: Loaded 39281 existing records from primary storage. [2025-09-16T19:48:40.165352] [INFO ] [MAIN ] OMC: Loaded 39281 existing records. [2025-09-16T19:48:40.344119] [WARN ] [MAIN ] OMC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:48:40.344401] [INFO ] [MAIN ] OMC: Wiping existing primary data before full refresh. [2025-09-16T19:48:40.344467] [INFO ] [LOCAL ] OMC: Starting deletion of primary data. [2025-09-16T19:48:40.345267] [DEBUG] [LOCAL ] OMC: Deleted primary data file. [2025-09-16T19:48:40.345314] [INFO ] [MAIN ] OMC: Starting full primary refresh. [2025-09-16T19:48:40.388529] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-07. [2025-09-16T19:48:40.717879] [INFO ] [REMOTE ] OMC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:48:40.718473] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-16T19:48:41.174949] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-02. [2025-09-16T19:48:41.566663] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-08 (2.79 seconds). [2025-09-16T19:48:41.974904] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-09. [2025-09-16T19:48:42.232772] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-16T19:48:42.774957] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-04. [2025-09-16T19:48:42.836726] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-16T19:48:43.577521] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-03. [2025-09-16T19:48:43.580101] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-16T19:48:44.374952] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-08. [2025-09-16T19:48:44.448426] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-09-16T19:48:44.459845] [INFO ] [REMOTE ] OKLO: Full fetch complete (58499 records). [2025-09-16T19:48:44.460086] [DEBUG] [VALIDATOR ] OKLO: Validating primary data. [2025-09-16T19:48:45.057715] [DEBUG] [VALIDATOR ] OKLO: All expected trading days are present. [2025-09-16T19:48:45.057832] [DEBUG] [VALIDATOR ] OKLO: Primary data validation passed. [2025-09-16T19:48:45.059083] [INFO ] [MAIN ] OKLO: Fetched primary data is valid. [2025-09-16T19:48:45.059159] [DEBUG] [LOCAL ] OKLO: Saving primary data. [2025-09-16T19:48:45.060666] [DEBUG] [LOCAL ] OKLO: Trimmed 58499 records to 40169 (keeping 150 days of data) [2025-09-16T19:48:45.186620] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-05. [2025-09-16T19:48:45.369779] [DEBUG] [LOCAL ] OKLO: Primary data saved (40169 records). [2025-09-16T19:48:45.369922] [INFO ] [MAIN ] OKLO: Full history saved. [2025-09-16T19:48:45.370008] [INFO ] [MAIN ] Update Progress: 1589/2369 symbols completed. OKLO took 30.9s. Estimated remaining: 1h 22m 49s. Rate: 9.4 symbols/min [2025-09-16T19:48:45.554637] [INFO ] [MAIN ] OMF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:48:45.585588] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-16T19:48:45.629024] [DEBUG] [LOCAL ] OMF: Loaded 33661 existing records from primary storage. [2025-09-16T19:48:45.629200] [INFO ] [MAIN ] OMF: Loaded 33661 existing records. [2025-09-16T19:48:45.805375] [WARN ] [MAIN ] OMF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:48:45.805601] [INFO ] [MAIN ] OMF: Wiping existing primary data before full refresh. [2025-09-16T19:48:45.805666] [INFO ] [LOCAL ] OMF: Starting deletion of primary data. [2025-09-16T19:48:45.806440] [DEBUG] [LOCAL ] OMF: Deleted primary data file. [2025-09-16T19:48:45.806486] [INFO ] [MAIN ] OMF: Starting full primary refresh. [2025-09-16T19:48:45.978426] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-04. [2025-09-16T19:48:46.092626] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-16T19:48:46.171622] [INFO ] [REMOTE ] OMF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:48:46.202097] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-16T19:48:46.774901] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-06. [2025-09-16T19:48:47.554511] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-16T19:48:47.574857] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-07. [2025-09-16T19:48:47.837093] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-16T19:48:48.365792] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-16T19:48:48.374840] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-08. [2025-09-16T19:48:49.174905] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-05. [2025-09-16T19:48:49.232962] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-16T19:48:49.974903] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-09. [2025-09-16T19:48:50.746664] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-16T19:48:50.748463] [INFO ] [REMOTE ] OLP: Full fetch complete (10305 records). [2025-09-16T19:48:50.748539] [DEBUG] [VALIDATOR ] OLP: Validating primary data. [2025-09-16T19:48:50.780579] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-02. [2025-09-16T19:48:51.149473] [DEBUG] [VALIDATOR ] OLP: All expected trading days are present. [2025-09-16T19:48:51.149587] [DEBUG] [VALIDATOR ] OLP: Primary data validation passed. [2025-09-16T19:48:51.149899] [INFO ] [MAIN ] OLP: Fetched primary data is valid. [2025-09-16T19:48:51.150036] [DEBUG] [LOCAL ] OLP: Saving primary data. [2025-09-16T19:48:51.151866] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-16T19:48:51.162600] [DEBUG] [LOCAL ] OLP: Trimmed 10305 records to 6931 (keeping 150 days of data) [2025-09-16T19:48:51.204947] [DEBUG] [LOCAL ] OLP: Primary data saved (6931 records). [2025-09-16T19:48:51.205074] [INFO ] [MAIN ] OLP: Full history saved. [2025-09-16T19:48:51.205158] [INFO ] [MAIN ] Update Progress: 1590/2369 symbols completed. OLP took 16.3s. Estimated remaining: 1h 22m 42s. Rate: 9.4 symbols/min [2025-09-16T19:48:51.375282] [INFO ] [MAIN ] OMI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:48:51.411906] [DEBUG] [LOCAL ] OMI: Loaded 33471 existing records from primary storage. [2025-09-16T19:48:51.412042] [INFO ] [MAIN ] OMI: Loaded 33471 existing records. [2025-09-16T19:48:51.587131] [WARN ] [MAIN ] OMI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:48:51.583013] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-06. [2025-09-16T19:48:51.588092] [INFO ] [MAIN ] OMI: Wiping existing primary data before full refresh. [2025-09-16T19:48:51.588154] [INFO ] [LOCAL ] OMI: Starting deletion of primary data. [2025-09-16T19:48:51.588964] [DEBUG] [LOCAL ] OMI: Deleted primary data file. [2025-09-16T19:48:51.589027] [INFO ] [MAIN ] OMI: Starting full primary refresh. [2025-09-16T19:48:51.942443] [INFO ] [REMOTE ] OMI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:48:52.337869] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-16T19:48:52.374857] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-03. [2025-09-16T19:48:53.116599] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-16T19:48:53.174869] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-07. [2025-09-16T19:48:53.974904] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-09. [2025-09-16T19:48:54.119467] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-16T19:48:54.774904] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-02. [2025-09-16T19:48:54.979540] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-16T19:48:55.574922] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-08. [2025-09-16T19:48:55.702388] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-16T19:48:55.708747] [INFO ] [REMOTE ] OLN: Full fetch complete (56092 records). [2025-09-16T19:48:55.708910] [DEBUG] [VALIDATOR ] OLN: Validating primary data. [2025-09-16T19:48:56.090121] [DEBUG] [VALIDATOR ] OLN: All expected trading days are present. [2025-09-16T19:48:56.090200] [DEBUG] [VALIDATOR ] OLN: Primary data validation passed. [2025-09-16T19:48:56.091042] [INFO ] [MAIN ] OLN: Fetched primary data is valid. [2025-09-16T19:48:56.091089] [DEBUG] [LOCAL ] OLN: Saving primary data. [2025-09-16T19:48:56.092226] [DEBUG] [LOCAL ] OLN: Trimmed 56092 records to 38719 (keeping 150 days of data) [2025-09-16T19:48:56.334247] [DEBUG] [LOCAL ] OLN: Primary data saved (38719 records). [2025-09-16T19:48:56.334417] [INFO ] [MAIN ] OLN: Full history saved. [2025-09-16T19:48:56.334505] [INFO ] [MAIN ] Update Progress: 1591/2369 symbols completed. OLN took 32.7s. Estimated remaining: 1h 22m 35s. Rate: 9.4 symbols/min [2025-09-16T19:48:56.380467] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-04. [2025-09-16T19:48:56.513048] [INFO ] [MAIN ] ONIT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:48:56.557898] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-16T19:48:56.558164] [DEBUG] [LOCAL ] ONIT: Loaded 5740 existing records from primary storage. [2025-09-16T19:48:56.567773] [INFO ] [MAIN ] ONIT: Loaded 5740 existing records. [2025-09-16T19:48:56.743491] [WARN ] [MAIN ] ONIT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:48:56.743755] [INFO ] [MAIN ] ONIT: Wiping existing primary data before full refresh. [2025-09-16T19:48:56.743802] [INFO ] [LOCAL ] ONIT: Starting deletion of primary data. [2025-09-16T19:48:56.744126] [DEBUG] [LOCAL ] ONIT: Deleted primary data file. [2025-09-16T19:48:56.744172] [INFO ] [MAIN ] ONIT: Starting full primary refresh. [2025-09-16T19:48:57.098266] [INFO ] [REMOTE ] ONIT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:48:57.143242] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-16T19:48:57.174859] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-02. [2025-09-16T19:48:57.970969] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-16T19:48:57.974833] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-03. [2025-09-16T19:48:58.181962] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-16T19:48:58.414079] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-16T19:48:58.774897] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-05. [2025-09-16T19:48:59.574906] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-03. [2025-09-16T19:49:00.204113] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-16T19:49:00.374902] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-09. [2025-09-16T19:49:01.175810] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-06. [2025-09-16T19:49:01.181489] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-16T19:49:01.974969] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-04. [2025-09-16T19:49:02.052718] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-16T19:49:02.059215] [INFO ] [REMOTE ] OMC: Full fetch complete (57934 records). [2025-09-16T19:49:02.059365] [DEBUG] [VALIDATOR ] OMC: Validating primary data. [2025-09-16T19:49:02.500910] [DEBUG] [VALIDATOR ] OMC: All expected trading days are present. [2025-09-16T19:49:02.501027] [DEBUG] [VALIDATOR ] OMC: Primary data validation passed. [2025-09-16T19:49:02.501995] [INFO ] [MAIN ] OMC: Fetched primary data is valid. [2025-09-16T19:49:02.502081] [DEBUG] [LOCAL ] OMC: Saving primary data. [2025-09-16T19:49:02.524829] [DEBUG] [LOCAL ] OMC: Trimmed 57934 records to 39669 (keeping 150 days of data) [2025-09-16T19:49:02.525576] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-16T19:49:02.775805] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-04. [2025-09-16T19:49:02.786224] [DEBUG] [LOCAL ] OMC: Primary data saved (39669 records). [2025-09-16T19:49:02.786375] [INFO ] [MAIN ] OMC: Full history saved. [2025-09-16T19:49:02.786478] [INFO ] [MAIN ] Update Progress: 1592/2369 symbols completed. OMC took 22.8s. Estimated remaining: 1h 22m 29s. Rate: 9.4 symbols/min [2025-09-16T19:49:02.957000] [INFO ] [MAIN ] ONL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:49:02.983451] [DEBUG] [LOCAL ] ONL: Loaded 22091 existing records from primary storage. [2025-09-16T19:49:02.983609] [INFO ] [MAIN ] ONL: Loaded 22091 existing records. [2025-09-16T19:49:03.158620] [WARN ] [MAIN ] ONL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:49:03.158862] [INFO ] [MAIN ] ONL: Wiping existing primary data before full refresh. [2025-09-16T19:49:03.158909] [INFO ] [LOCAL ] ONL: Starting deletion of primary data. [2025-09-16T19:49:03.159470] [DEBUG] [LOCAL ] ONL: Deleted primary data file. [2025-09-16T19:49:03.159516] [INFO ] [MAIN ] ONL: Starting full primary refresh. [2025-09-16T19:49:03.512268] [INFO ] [REMOTE ] ONL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:49:03.538502] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-16T19:49:03.554247] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-16T19:49:03.574842] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-05. [2025-09-16T19:49:04.374934] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-05. [2025-09-16T19:49:04.383174] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-16T19:49:05.174897] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-02. [2025-09-16T19:49:05.929403] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-16T19:49:05.974893] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-06. [2025-09-16T19:49:06.206433] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-16T19:49:06.774911] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-06. [2025-09-16T19:49:07.417829] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-16T19:49:07.511629] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-16T19:49:07.574892] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-07. [2025-09-16T19:49:08.314610] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-16T19:49:08.374908] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-07. [2025-09-16T19:49:09.174897] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-03. [2025-09-16T19:49:09.878508] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-16T19:49:09.974855] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-08. [2025-09-16T19:49:10.647678] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-16T19:49:10.774868] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-04. [2025-09-16T19:49:11.212361] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-16T19:49:11.574894] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-07. [2025-09-16T19:49:11.873720] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-16T19:49:12.374966] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-05. [2025-09-16T19:49:13.174888] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-08. [2025-09-16T19:49:13.317559] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-16T19:49:13.806910] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-16T19:49:13.954450] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-16T19:49:13.974847] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-09. [2025-09-16T19:49:14.774892] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-09. [2025-09-16T19:49:14.821751] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-16T19:49:14.823237] [INFO ] [REMOTE ] ONIT: Full fetch complete (8539 records). [2025-09-16T19:49:14.823304] [DEBUG] [VALIDATOR ] ONIT: Validating primary data. [2025-09-16T19:49:15.177287] [DEBUG] [VALIDATOR ] ONIT: All expected trading days are present. [2025-09-16T19:49:15.177364] [DEBUG] [VALIDATOR ] ONIT: Primary data validation passed. [2025-09-16T19:49:15.177578] [INFO ] [MAIN ] ONIT: Fetched primary data is valid. [2025-09-16T19:49:15.177617] [DEBUG] [LOCAL ] ONIT: Saving primary data. [2025-09-16T19:49:15.178053] [DEBUG] [LOCAL ] ONIT: Trimmed 8539 records to 5817 (keeping 150 days of data) [2025-09-16T19:49:15.212584] [DEBUG] [LOCAL ] ONIT: Primary data saved (5817 records). [2025-09-16T19:49:15.212723] [INFO ] [MAIN ] ONIT: Full history saved. [2025-09-16T19:49:15.212808] [INFO ] [MAIN ] Update Progress: 1593/2369 symbols completed. ONIT took 18.9s. Estimated remaining: 1h 22m 25s. Rate: 9.4 symbols/min [2025-09-16T19:49:15.379782] [INFO ] [MAIN ] ONON: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:49:15.415412] [DEBUG] [LOCAL ] ONON: Loaded 39581 existing records from primary storage. [2025-09-16T19:49:15.415550] [INFO ] [MAIN ] ONON: Loaded 39581 existing records. [2025-09-16T19:49:15.590199] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-08. [2025-09-16T19:49:15.595209] [WARN ] [MAIN ] ONON: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:49:15.595378] [INFO ] [MAIN ] ONON: Wiping existing primary data before full refresh. [2025-09-16T19:49:15.595427] [INFO ] [LOCAL ] ONON: Starting deletion of primary data. [2025-09-16T19:49:15.596229] [DEBUG] [LOCAL ] ONON: Deleted primary data file. [2025-09-16T19:49:15.596289] [INFO ] [MAIN ] ONON: Starting full primary refresh. [2025-09-16T19:49:15.946979] [INFO ] [REMOTE ] ONON: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:49:16.379542] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-02. [2025-09-16T19:49:16.383662] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-16T19:49:16.390199] [INFO ] [REMOTE ] OMI: Full fetch complete (50143 records). [2025-09-16T19:49:16.390352] [DEBUG] [VALIDATOR ] OMI: Validating primary data. [2025-09-16T19:49:16.773436] [DEBUG] [VALIDATOR ] OMI: All expected trading days are present. [2025-09-16T19:49:16.773549] [DEBUG] [VALIDATOR ] OMI: Primary data validation passed. [2025-09-16T19:49:16.774383] [INFO ] [MAIN ] OMI: Fetched primary data is valid. [2025-09-16T19:49:16.774429] [DEBUG] [LOCAL ] OMI: Saving primary data. [2025-09-16T19:49:16.775445] [DEBUG] [LOCAL ] OMI: Trimmed 50143 records to 33837 (keeping 150 days of data) [2025-09-16T19:49:16.963912] [DEBUG] [LOCAL ] OMI: Primary data saved (33837 records). [2025-09-16T19:49:16.964066] [INFO ] [MAIN ] OMI: Full history saved. [2025-09-16T19:49:16.964915] [INFO ] [MAIN ] Update Progress: 1594/2369 symbols completed. OMI took 25.8s. Estimated remaining: 1h 22m 17s. Rate: 9.4 symbols/min [2025-09-16T19:49:17.140676] [INFO ] [MAIN ] ONTF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:49:17.160094] [DEBUG] [LOCAL ] ONTF: Loaded 17112 existing records from primary storage. [2025-09-16T19:49:17.160218] [INFO ] [MAIN ] ONTF: Loaded 17112 existing records. [2025-09-16T19:49:17.191384] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-06. [2025-09-16T19:49:17.340663] [WARN ] [MAIN ] ONTF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:49:17.341087] [INFO ] [MAIN ] ONTF: Wiping existing primary data before full refresh. [2025-09-16T19:49:17.354908] [INFO ] [LOCAL ] ONTF: Starting deletion of primary data. [2025-09-16T19:49:17.364671] [DEBUG] [LOCAL ] ONTF: Deleted primary data file. [2025-09-16T19:49:17.365604] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-16T19:49:17.365678] [INFO ] [MAIN ] ONTF: Starting full primary refresh. [2025-09-16T19:49:17.737367] [INFO ] [REMOTE ] ONTF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:49:17.974876] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-02. [2025-09-16T19:49:18.340082] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-16T19:49:18.630668] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-16T19:49:18.774923] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-09. [2025-09-16T19:49:18.968612] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-16T19:49:19.574911] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-03. [2025-09-16T19:49:20.173765] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-16T19:49:20.179061] [INFO ] [REMOTE ] OMF: Full fetch complete (50232 records). [2025-09-16T19:49:20.179180] [DEBUG] [VALIDATOR ] OMF: Validating primary data. [2025-09-16T19:49:20.385335] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-03. [2025-09-16T19:49:20.564551] [DEBUG] [VALIDATOR ] OMF: All expected trading days are present. [2025-09-16T19:49:20.564635] [DEBUG] [VALIDATOR ] OMF: Primary data validation passed. [2025-09-16T19:49:20.565765] [INFO ] [MAIN ] OMF: Fetched primary data is valid. [2025-09-16T19:49:20.565811] [DEBUG] [LOCAL ] OMF: Saving primary data. [2025-09-16T19:49:20.566906] [DEBUG] [LOCAL ] OMF: Trimmed 50232 records to 34025 (keeping 150 days of data) [2025-09-16T19:49:20.782311] [DEBUG] [LOCAL ] OMF: Primary data saved (34025 records). [2025-09-16T19:49:20.782557] [INFO ] [MAIN ] OMF: Full history saved. [2025-09-16T19:49:20.795699] [INFO ] [MAIN ] Update Progress: 1595/2369 symbols completed. OMF took 35.4s. Estimated remaining: 1h 22m 9s. Rate: 9.4 symbols/min [2025-09-16T19:49:20.797124] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-16T19:49:20.980841] [INFO ] [MAIN ] ONTO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:49:21.014404] [DEBUG] [LOCAL ] ONTO: Loaded 34701 existing records from primary storage. [2025-09-16T19:49:21.014542] [INFO ] [MAIN ] ONTO: Loaded 34701 existing records. [2025-09-16T19:49:21.185431] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-04. [2025-09-16T19:49:21.189972] [WARN ] [MAIN ] ONTO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:49:21.190880] [INFO ] [MAIN ] ONTO: Wiping existing primary data before full refresh. [2025-09-16T19:49:21.190946] [INFO ] [LOCAL ] ONTO: Starting deletion of primary data. [2025-09-16T19:49:21.191911] [DEBUG] [LOCAL ] ONTO: Deleted primary data file. [2025-09-16T19:49:21.191981] [INFO ] [MAIN ] ONTO: Starting full primary refresh. [2025-09-16T19:49:21.551022] [INFO ] [REMOTE ] ONTO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:49:21.974872] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-07. [2025-09-16T19:49:22.226348] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-16T19:49:22.514538] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-16T19:49:22.774912] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-04. [2025-09-16T19:49:23.346573] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-16T19:49:23.574907] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-08. [2025-09-16T19:49:24.374906] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-05. [2025-09-16T19:49:24.694372] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-16T19:49:24.834607] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-16T19:49:25.174868] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-09. [2025-09-16T19:49:25.239393] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-16T19:49:25.974923] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-06. [2025-09-16T19:49:26.319536] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-16T19:49:26.322675] [INFO ] [REMOTE ] ONL: Full fetch complete (34076 records). [2025-09-16T19:49:26.322751] [DEBUG] [VALIDATOR ] ONL: Validating primary data. [2025-09-16T19:49:26.688844] [DEBUG] [VALIDATOR ] ONL: All expected trading days are present. [2025-09-16T19:49:26.688920] [DEBUG] [VALIDATOR ] ONL: Primary data validation passed. [2025-09-16T19:49:26.689633] [INFO ] [MAIN ] ONL: Fetched primary data is valid. [2025-09-16T19:49:26.689693] [DEBUG] [LOCAL ] ONL: Saving primary data. [2025-09-16T19:49:26.690466] [DEBUG] [LOCAL ] ONL: Trimmed 34076 records to 22251 (keeping 150 days of data) [2025-09-16T19:49:26.777095] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-05. [2025-09-16T19:49:26.833524] [DEBUG] [LOCAL ] ONL: Primary data saved (22251 records). [2025-09-16T19:49:26.833674] [INFO ] [MAIN ] ONL: Full history saved. [2025-09-16T19:49:26.833758] [INFO ] [MAIN ] Update Progress: 1596/2369 symbols completed. ONL took 24.0s. Estimated remaining: 1h 22m 3s. Rate: 9.4 symbols/min [2025-09-16T19:49:27.006222] [INFO ] [MAIN ] OOMA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:49:27.006379] [DEBUG] [LOCAL ] OOMA: No existing data file found in primary storage. [2025-09-16T19:49:27.006415] [WARN ] [MAIN ] OOMA: No existing data found, performing full refresh instead. [2025-09-16T19:49:27.006541] [INFO ] [MAIN ] OOMA: Wiping existing primary data before full refresh. [2025-09-16T19:49:27.006581] [INFO ] [LOCAL ] OOMA: Starting deletion of primary data. [2025-09-16T19:49:27.006622] [DEBUG] [LOCAL ] OOMA: No primary data file found to delete. [2025-09-16T19:49:27.006689] [INFO ] [MAIN ] OOMA: Starting full primary refresh. [2025-09-16T19:49:27.323970] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-16T19:49:27.387409] [INFO ] [REMOTE ] OOMA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:49:27.574914] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-02. [2025-09-16T19:49:28.374932] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-07. [2025-09-16T19:49:28.509009] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-16T19:49:28.719018] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-16T19:49:29.174943] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-03. [2025-09-16T19:49:29.441603] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-16T19:49:29.974855] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-02. [2025-09-16T19:49:30.026059] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-16T19:49:30.774922] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-06. [2025-09-16T19:49:31.570038] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-16T19:49:31.578262] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-04. [2025-09-16T19:49:32.374911] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-03. [2025-09-16T19:49:32.582076] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-16T19:49:32.706137] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-16T19:49:33.174929] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-05. [2025-09-16T19:49:33.801024] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-16T19:49:33.829698] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-16T19:49:33.974957] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-06. [2025-09-16T19:49:34.774896] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-04. [2025-09-16T19:49:35.004664] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-16T19:49:35.574895] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-07. [2025-09-16T19:49:36.374923] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-07. [2025-09-16T19:49:36.529731] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-16T19:49:37.174921] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-08. [2025-09-16T19:49:37.386722] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-16T19:49:37.549139] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-16T19:49:37.974973] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-05. [2025-09-16T19:49:38.244917] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-16T19:49:38.774908] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-08. [2025-09-16T19:49:39.574953] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-08. [2025-09-16T19:49:39.920570] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-16T19:49:40.238684] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-16T19:49:40.374888] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-06. [2025-09-16T19:49:40.877098] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-16T19:49:41.174931] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-09. [2025-09-16T19:49:41.974943] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-09. [2025-09-16T19:49:42.050626] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-16T19:49:42.774953] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-09. [2025-09-16T19:49:42.958063] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-16T19:49:42.961313] [INFO ] [REMOTE ] ONTF: Full fetch complete (24599 records). [2025-09-16T19:49:42.961388] [DEBUG] [VALIDATOR ] ONTF: Validating primary data. [2025-09-16T19:49:43.356813] [DEBUG] [VALIDATOR ] ONTF: All expected trading days are present. [2025-09-16T19:49:43.356940] [DEBUG] [VALIDATOR ] ONTF: Primary data validation passed. [2025-09-16T19:49:43.357578] [INFO ] [MAIN ] ONTF: Fetched primary data is valid. [2025-09-16T19:49:43.357670] [DEBUG] [LOCAL ] ONTF: Saving primary data. [2025-09-16T19:49:43.359239] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-16T19:49:43.365972] [DEBUG] [LOCAL ] ONTF: Trimmed 24599 records to 17288 (keeping 150 days of data) [2025-09-16T19:49:43.366103] [INFO ] [REMOTE ] ONON: Full fetch complete (58292 records). [2025-09-16T19:49:43.366587] [DEBUG] [VALIDATOR ] ONON: Validating primary data. [2025-09-16T19:49:43.578281] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-07. [2025-09-16T19:49:43.578183] [DEBUG] [LOCAL ] ONTF: Primary data saved (17288 records). [2025-09-16T19:49:43.594811] [INFO ] [MAIN ] ONTF: Full history saved. [2025-09-16T19:49:43.626258] [INFO ] [MAIN ] Update Progress: 1597/2369 symbols completed. ONTF took 26.7s. Estimated remaining: 1h 22m 1s. Rate: 9.4 symbols/min [2025-09-16T19:49:43.847397] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-16T19:49:43.867527] [DEBUG] [VALIDATOR ] ONON: All expected trading days are present. [2025-09-16T19:49:43.867744] [DEBUG] [VALIDATOR ] ONON: Primary data validation passed. [2025-09-16T19:49:43.867683] [INFO ] [REMOTE ] OOMA: Full fetch complete (20472 records). [2025-09-16T19:49:43.867890] [DEBUG] [VALIDATOR ] OOMA: Validating primary data. [2025-09-16T19:49:43.869019] [INFO ] [MAIN ] ONON: Fetched primary data is valid. [2025-09-16T19:49:43.869142] [DEBUG] [LOCAL ] ONON: Saving primary data. [2025-09-16T19:49:43.978306] [DEBUG] [LOCAL ] ONON: Trimmed 58292 records to 39970 (keeping 150 days of data) [2025-09-16T19:49:44.336929] [DEBUG] [VALIDATOR ] OOMA: All expected trading days are present. [2025-09-16T19:49:44.337560] [DEBUG] [VALIDATOR ] OOMA: Primary data validation passed. [2025-09-16T19:49:44.338229] [INFO ] [MAIN ] OOMA: Fetched primary data is valid. [2025-09-16T19:49:44.338553] [DEBUG] [LOCAL ] OOMA: Saving primary data. [2025-09-16T19:49:44.344991] [DEBUG] [LOCAL ] OOMA: Trimmed 20472 records to 13831 (keeping 150 days of data) [2025-09-16T19:49:44.526046] [DEBUG] [LOCAL ] OOMA: Primary data saved (13831 records). [2025-09-16T19:49:44.528697] [INFO ] [MAIN ] OOMA: Full history saved. [2025-09-16T19:49:44.530055] [INFO ] [MAIN ] Update Progress: 1598/2369 symbols completed. OOMA took 17.7s. Estimated remaining: 1h 21m 52s. Rate: 9.4 symbols/min [2025-09-16T19:49:44.558279] [DEBUG] [LOCAL ] ONON: Primary data saved (39970 records). [2025-09-16T19:49:44.558428] [INFO ] [MAIN ] ONON: Full history saved. [2025-09-16T19:49:44.558514] [INFO ] [MAIN ] Update Progress: 1599/2369 symbols completed. ONON took 29.3s. Estimated remaining: 1h 21m 43s. Rate: 9.4 symbols/min [2025-09-16T19:49:45.317463] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-16T19:49:45.328093] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-08. [2025-09-16T19:49:47.100910] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-16T19:49:47.111568] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-09. [2025-09-16T19:49:48.807152] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-16T19:49:48.814161] [INFO ] [REMOTE ] ONTO: Full fetch complete (50443 records). [2025-09-16T19:49:48.814365] [DEBUG] [VALIDATOR ] ONTO: Validating primary data. [2025-09-16T19:49:49.222387] [DEBUG] [VALIDATOR ] ONTO: All expected trading days are present. [2025-09-16T19:49:49.222500] [DEBUG] [VALIDATOR ] ONTO: Primary data validation passed. [2025-09-16T19:49:49.223608] [INFO ] [MAIN ] ONTO: Fetched primary data is valid. [2025-09-16T19:49:49.223674] [DEBUG] [LOCAL ] ONTO: Saving primary data. [2025-09-16T19:49:49.225260] [DEBUG] [LOCAL ] ONTO: Trimmed 50443 records to 35074 (keeping 150 days of data) [2025-09-16T19:49:49.452574] [DEBUG] [LOCAL ] ONTO: Primary data saved (35074 records). [2025-09-16T19:49:49.452825] [INFO ] [MAIN ] ONTO: Full history saved. [2025-09-16T19:49:49.452940] [INFO ] [MAIN ] Update Progress: 1600/2369 symbols completed. ONTO took 28.7s. Estimated remaining: 1h 21m 36s. Rate: 9.4 symbols/min [2025-09-16T19:49:50.050339] [INFO ] [MAIN ] OPP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:49:50.119467] [INFO ] [MAIN ] OPY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:49:50.157893] [DEBUG] [LOCAL ] OPY: No existing data file found in primary storage. [2025-09-16T19:49:50.199272] [INFO ] [MAIN ] OPFI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:49:50.199426] [WARN ] [MAIN ] OPY: No existing data found, performing full refresh instead. [2025-09-16T19:49:50.180232] [INFO ] [MAIN ] OPAD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:49:50.202751] [INFO ] [MAIN ] OPY: Wiping existing primary data before full refresh. [2025-09-16T19:49:50.203032] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-09-16T19:49:50.203120] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-09-16T19:49:50.203186] [INFO ] [MAIN ] OPY: Starting full primary refresh. [2025-09-16T19:49:50.208183] [DEBUG] [LOCAL ] OPP: Loaded 8670 existing records from primary storage. [2025-09-16T19:49:50.208371] [INFO ] [MAIN ] OPP: Loaded 8670 existing records. [2025-09-16T19:49:50.431889] [DEBUG] [LOCAL ] OPAD: Loaded 16476 existing records from primary storage. [2025-09-16T19:49:50.453388] [INFO ] [MAIN ] OPAD: Loaded 16476 existing records. [2025-09-16T19:49:50.594611] [DEBUG] [LOCAL ] OPFI: Loaded 34322 existing records from primary storage. [2025-09-16T19:49:50.646916] [WARN ] [MAIN ] OPP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:49:50.612908] [INFO ] [MAIN ] OPFI: Loaded 34322 existing records. [2025-09-16T19:49:50.695820] [INFO ] [MAIN ] OPP: Wiping existing primary data before full refresh. [2025-09-16T19:49:50.830352] [INFO ] [LOCAL ] OPP: Starting deletion of primary data. [2025-09-16T19:49:50.891884] [DEBUG] [LOCAL ] OPP: Deleted primary data file. [2025-09-16T19:49:50.958405] [INFO ] [MAIN ] OPP: Starting full primary refresh. [2025-09-16T19:49:51.052628] [WARN ] [MAIN ] OPAD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:49:51.080913] [INFO ] [REMOTE ] OPY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:49:51.211751] [INFO ] [MAIN ] OPAD: Wiping existing primary data before full refresh. [2025-09-16T19:49:51.174740] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-02. [2025-09-16T19:49:51.217030] [INFO ] [LOCAL ] OPAD: Starting deletion of primary data. [2025-09-16T19:49:51.206565] [WARN ] [MAIN ] OPFI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:49:51.232697] [DEBUG] [LOCAL ] OPAD: Deleted primary data file. [2025-09-16T19:49:51.238808] [INFO ] [MAIN ] OPAD: Starting full primary refresh. [2025-09-16T19:49:51.238603] [INFO ] [MAIN ] OPFI: Wiping existing primary data before full refresh. [2025-09-16T19:49:51.260418] [INFO ] [LOCAL ] OPFI: Starting deletion of primary data. [2025-09-16T19:49:51.326183] [DEBUG] [LOCAL ] OPFI: Deleted primary data file. [2025-09-16T19:49:51.352159] [INFO ] [MAIN ] OPFI: Starting full primary refresh. [2025-09-16T19:49:51.988005] [INFO ] [REMOTE ] OPP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:49:52.032757] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-02. [2025-09-16T19:49:52.167441] [INFO ] [REMOTE ] OPAD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:49:52.168332] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-02. [2025-09-16T19:49:52.173762] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-16T19:49:52.186269] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-03. [2025-09-16T19:49:52.265869] [INFO ] [REMOTE ] OPFI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:49:52.266203] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-02. [2025-09-16T19:49:52.827024] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-16T19:49:52.828985] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-03. [2025-09-16T19:49:52.833602] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-16T19:49:52.835322] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-04. [2025-09-16T19:49:52.990491] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-16T19:49:52.993295] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-03. [2025-09-16T19:49:53.436855] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-16T19:49:53.444067] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-16T19:49:53.443876] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-05. [2025-09-16T19:49:53.447776] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-04. [2025-09-16T19:49:54.008908] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-16T19:49:54.011868] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-04. [2025-09-16T19:49:54.169149] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-16T19:49:54.217478] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-16T19:49:54.260942] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-16T19:49:54.703669] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-16T19:49:54.774902] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-06. [2025-09-16T19:49:55.570771] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-16T19:49:55.574845] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-07. [2025-09-16T19:49:56.287134] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-16T19:49:56.374905] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-05. [2025-09-16T19:49:57.174930] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-03. [2025-09-16T19:49:57.225895] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-16T19:49:57.974903] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-05. [2025-09-16T19:49:58.522085] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-16T19:49:58.774915] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-08. [2025-09-16T19:49:58.966272] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-16T19:49:59.542738] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-16T19:49:59.574863] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-04. [2025-09-16T19:50:00.374911] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-06. [2025-09-16T19:50:01.053249] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-16T19:50:01.174912] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-07. [2025-09-16T19:50:01.370155] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-16T19:50:01.788443] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-16T19:50:01.974944] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-09. [2025-09-16T19:50:02.774874] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-05. [2025-09-16T19:50:02.871333] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-16T19:50:02.873245] [INFO ] [REMOTE ] OPY: Full fetch complete (8246 records). [2025-09-16T19:50:02.873314] [DEBUG] [VALIDATOR ] OPY: Validating primary data. [2025-09-16T19:50:03.052592] [WARN ] [VALIDATOR ] OPY: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-16T19:50:03.052896] [FATAL] [MAIN ] OPY: Fetched primary data is invalid. Refusing to save it. [2025-09-16T19:50:03.052969] [WARN ] [MAIN ] OPY: Deleting existing primary and derivative data due to validation failure. [2025-09-16T19:50:03.053037] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-09-16T19:50:03.053104] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-09-16T19:50:03.053150] [INFO ] [LOCAL ] OPY: Starting deletion of derivative data. [2025-09-16T19:50:03.053195] [DEBUG] [LOCAL ] OPY: No derivative data file found to delete. [2025-09-16T19:50:03.053321] [INFO ] [MAIN ] Update Progress: 1601/2369 symbols completed. OPY took 13.6s. Estimated remaining: 1h 21m 33s. Rate: 9.4 symbols/min [2025-09-16T19:50:03.250337] [INFO ] [MAIN ] OR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:50:03.280903] [DEBUG] [LOCAL ] OR: Loaded 33580 existing records from primary storage. [2025-09-16T19:50:03.281095] [INFO ] [MAIN ] OR: Loaded 33580 existing records. [2025-09-16T19:50:03.456913] [WARN ] [MAIN ] OR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:50:03.457165] [INFO ] [MAIN ] OR: Wiping existing primary data before full refresh. [2025-09-16T19:50:03.457214] [INFO ] [LOCAL ] OR: Starting deletion of primary data. [2025-09-16T19:50:03.458090] [DEBUG] [LOCAL ] OR: Deleted primary data file. [2025-09-16T19:50:03.458140] [INFO ] [MAIN ] OR: Starting full primary refresh. [2025-09-16T19:50:03.579981] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-06. [2025-09-16T19:50:03.821149] [INFO ] [REMOTE ] OR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:50:04.347696] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-16T19:50:04.374906] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-07. [2025-09-16T19:50:04.531239] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-16T19:50:05.174925] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-02. [2025-09-16T19:50:05.756877] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-16T19:50:05.974914] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-08. [2025-09-16T19:50:06.781035] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-08. [2025-09-16T19:50:06.783226] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-16T19:50:06.847096] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-16T19:50:07.574895] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-09. [2025-09-16T19:50:08.383018] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-03. [2025-09-16T19:50:08.387685] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-16T19:50:08.405329] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-16T19:50:08.407189] [INFO ] [REMOTE ] OPP: Full fetch complete (12837 records). [2025-09-16T19:50:08.407257] [DEBUG] [VALIDATOR ] OPP: Validating primary data. [2025-09-16T19:50:08.765029] [DEBUG] [VALIDATOR ] OPP: All expected trading days are present. [2025-09-16T19:50:08.765105] [DEBUG] [VALIDATOR ] OPP: Primary data validation passed. [2025-09-16T19:50:08.765381] [INFO ] [MAIN ] OPP: Fetched primary data is valid. [2025-09-16T19:50:08.765420] [DEBUG] [LOCAL ] OPP: Saving primary data. [2025-09-16T19:50:08.765897] [DEBUG] [LOCAL ] OPP: Trimmed 12837 records to 8770 (keeping 150 days of data) [2025-09-16T19:50:08.819698] [DEBUG] [LOCAL ] OPP: Primary data saved (8770 records). [2025-09-16T19:50:08.819849] [INFO ] [MAIN ] OPP: Full history saved. [2025-09-16T19:50:08.819950] [INFO ] [MAIN ] Update Progress: 1602/2369 symbols completed. OPP took 19.4s. Estimated remaining: 1h 21m 26s. Rate: 9.4 symbols/min [2025-09-16T19:50:08.994116] [INFO ] [MAIN ] ORA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:50:09.015917] [DEBUG] [LOCAL ] ORA: Loaded 23615 existing records from primary storage. [2025-09-16T19:50:09.016044] [INFO ] [MAIN ] ORA: Loaded 23615 existing records. [2025-09-16T19:50:09.179108] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-06. [2025-09-16T19:50:09.199107] [WARN ] [MAIN ] ORA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:50:09.200194] [INFO ] [MAIN ] ORA: Wiping existing primary data before full refresh. [2025-09-16T19:50:09.200280] [INFO ] [LOCAL ] ORA: Starting deletion of primary data. [2025-09-16T19:50:09.201126] [DEBUG] [LOCAL ] ORA: Deleted primary data file. [2025-09-16T19:50:09.201191] [INFO ] [MAIN ] ORA: Starting full primary refresh. [2025-09-16T19:50:09.559956] [INFO ] [REMOTE ] ORA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:50:09.940743] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-16T19:50:09.974856] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-04. [2025-09-16T19:50:10.774946] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-09. [2025-09-16T19:50:10.954422] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-16T19:50:11.574965] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-02. [2025-09-16T19:50:11.745547] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-16T19:50:12.374957] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-05. [2025-09-16T19:50:12.630327] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-16T19:50:12.636625] [INFO ] [REMOTE ] OPAD: Full fetch complete (18880 records). [2025-09-16T19:50:12.636749] [DEBUG] [VALIDATOR ] OPAD: Validating primary data. [2025-09-16T19:50:13.000173] [DEBUG] [VALIDATOR ] OPAD: All expected trading days are present. [2025-09-16T19:50:13.000297] [DEBUG] [VALIDATOR ] OPAD: Primary data validation passed. [2025-09-16T19:50:13.000781] [INFO ] [MAIN ] OPAD: Fetched primary data is valid. [2025-09-16T19:50:13.000834] [DEBUG] [LOCAL ] OPAD: Saving primary data. [2025-09-16T19:50:13.001677] [DEBUG] [LOCAL ] OPAD: Trimmed 18880 records to 16833 (keeping 150 days of data) [2025-09-16T19:50:13.091143] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-16T19:50:13.124844] [DEBUG] [LOCAL ] OPAD: Primary data saved (16833 records). [2025-09-16T19:50:13.124989] [INFO ] [MAIN ] OPAD: Full history saved. [2025-09-16T19:50:13.125093] [INFO ] [MAIN ] Update Progress: 1603/2369 symbols completed. OPAD took 23.7s. Estimated remaining: 1h 21m 19s. Rate: 9.4 symbols/min [2025-09-16T19:50:13.184423] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-03. [2025-09-16T19:50:13.302949] [INFO ] [MAIN ] ORC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:50:13.339425] [DEBUG] [LOCAL ] ORC: Loaded 38686 existing records from primary storage. [2025-09-16T19:50:13.339605] [INFO ] [MAIN ] ORC: Loaded 38686 existing records. [2025-09-16T19:50:13.516609] [WARN ] [MAIN ] ORC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:50:13.516889] [INFO ] [MAIN ] ORC: Wiping existing primary data before full refresh. [2025-09-16T19:50:13.516952] [INFO ] [LOCAL ] ORC: Starting deletion of primary data. [2025-09-16T19:50:13.517885] [DEBUG] [LOCAL ] ORC: Deleted primary data file. [2025-09-16T19:50:13.517934] [INFO ] [MAIN ] ORC: Starting full primary refresh. [2025-09-16T19:50:13.876107] [INFO ] [REMOTE ] ORC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:50:13.901470] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-16T19:50:13.974850] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-02. [2025-09-16T19:50:14.433925] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-16T19:50:14.774930] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-06. [2025-09-16T19:50:15.574942] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-07. [2025-09-16T19:50:15.872991] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-16T19:50:16.320090] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-16T19:50:16.374911] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-07. [2025-09-16T19:50:17.079231] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-16T19:50:17.174938] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-08. [2025-09-16T19:50:17.974896] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-04. [2025-09-16T19:50:18.130432] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-16T19:50:18.774910] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-03. [2025-09-16T19:50:18.931843] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-16T19:50:19.502518] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-16T19:50:19.574849] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-05. [2025-09-16T19:50:20.374905] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-08. [2025-09-16T19:50:20.758425] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-16T19:50:20.994883] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-16T19:50:21.174884] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-04. [2025-09-16T19:50:21.552292] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-16T19:50:21.974900] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-09. [2025-09-16T19:50:22.774928] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-09. [2025-09-16T19:50:23.327102] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-16T19:50:23.461140] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-16T19:50:23.466683] [INFO ] [REMOTE ] OPFI: Full fetch complete (51302 records). [2025-09-16T19:50:23.466802] [DEBUG] [VALIDATOR ] OPFI: Validating primary data. [2025-09-16T19:50:23.579959] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-06. [2025-09-16T19:50:23.861434] [DEBUG] [VALIDATOR ] OPFI: All expected trading days are present. [2025-09-16T19:50:23.861534] [DEBUG] [VALIDATOR ] OPFI: Primary data validation passed. [2025-09-16T19:50:23.862363] [INFO ] [MAIN ] OPFI: Fetched primary data is valid. [2025-09-16T19:50:23.862445] [DEBUG] [LOCAL ] OPFI: Saving primary data. [2025-09-16T19:50:23.864161] [DEBUG] [LOCAL ] OPFI: Trimmed 51302 records to 34683 (keeping 150 days of data) [2025-09-16T19:50:24.093080] [DEBUG] [LOCAL ] OPFI: Primary data saved (34683 records). [2025-09-16T19:50:24.093408] [INFO ] [MAIN ] OPFI: Full history saved. [2025-09-16T19:50:24.093996] [INFO ] [MAIN ] Update Progress: 1604/2369 symbols completed. OPFI took 34.6s. Estimated remaining: 1h 21m 15s. Rate: 9.4 symbols/min [2025-09-16T19:50:24.094580] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-16T19:50:24.168337] [INFO ] [REMOTE ] OR: Full fetch complete (49866 records). [2025-09-16T19:50:24.199353] [DEBUG] [VALIDATOR ] OR: Validating primary data. [2025-09-16T19:50:24.371995] [INFO ] [MAIN ] ORCL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:50:24.372411] [DEBUG] [LOCAL ] ORCL: No existing data file found in primary storage. [2025-09-16T19:50:24.377978] [WARN ] [MAIN ] ORCL: No existing data found, performing full refresh instead. [2025-09-16T19:50:24.377848] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-05. [2025-09-16T19:50:24.417208] [INFO ] [MAIN ] ORCL: Wiping existing primary data before full refresh. [2025-09-16T19:50:24.422727] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-09-16T19:50:24.472959] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-09-16T19:50:24.497470] [INFO ] [MAIN ] ORCL: Starting full primary refresh. [2025-09-16T19:50:24.863918] [DEBUG] [VALIDATOR ] OR: All expected trading days are present. [2025-09-16T19:50:24.914717] [DEBUG] [VALIDATOR ] OR: Primary data validation passed. [2025-09-16T19:50:24.931707] [INFO ] [MAIN ] OR: Fetched primary data is valid. [2025-09-16T19:50:24.938324] [DEBUG] [LOCAL ] OR: Saving primary data. [2025-09-16T19:50:24.992847] [DEBUG] [LOCAL ] OR: Trimmed 49866 records to 33968 (keeping 150 days of data) [2025-09-16T19:50:25.106341] [INFO ] [REMOTE ] ORCL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:50:25.174944] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-02. [2025-09-16T19:50:25.265559] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-16T19:50:25.296469] [DEBUG] [LOCAL ] OR: Primary data saved (33968 records). [2025-09-16T19:50:25.296619] [INFO ] [MAIN ] OR: Full history saved. [2025-09-16T19:50:25.296751] [INFO ] [MAIN ] Update Progress: 1605/2369 symbols completed. OR took 22.2s. Estimated remaining: 1h 21m 6s. Rate: 9.4 symbols/min [2025-09-16T19:50:25.472888] [INFO ] [MAIN ] ORI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:50:25.473103] [DEBUG] [LOCAL ] ORI: No existing data file found in primary storage. [2025-09-16T19:50:25.473144] [WARN ] [MAIN ] ORI: No existing data found, performing full refresh instead. [2025-09-16T19:50:25.473313] [INFO ] [MAIN ] ORI: Wiping existing primary data before full refresh. [2025-09-16T19:50:25.473367] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-09-16T19:50:25.473426] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-09-16T19:50:25.473484] [INFO ] [MAIN ] ORI: Starting full primary refresh. [2025-09-16T19:50:25.837942] [INFO ] [REMOTE ] ORI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:50:25.974907] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-07. [2025-09-16T19:50:26.509299] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-16T19:50:26.774879] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-06. [2025-09-16T19:50:27.415984] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-16T19:50:27.574867] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-08. [2025-09-16T19:50:27.684651] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-02 (2.51 seconds). [2025-09-16T19:50:28.374902] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-02. [2025-09-16T19:50:28.507160] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-16T19:50:28.830762] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-16T19:50:29.174895] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-03. [2025-09-16T19:50:29.941397] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-16T19:50:29.974873] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-03. [2025-09-16T19:50:30.774946] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-09. [2025-09-16T19:50:31.574966] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-07. [2025-09-16T19:50:31.619321] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-16T19:50:31.812117] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-03 (2.64 seconds). [2025-09-16T19:50:32.085701] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-16T19:50:32.090765] [INFO ] [REMOTE ] ORA: Full fetch complete (35696 records). [2025-09-16T19:50:32.090921] [DEBUG] [VALIDATOR ] ORA: Validating primary data. [2025-09-16T19:50:32.381352] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-04. [2025-09-16T19:50:32.478828] [DEBUG] [VALIDATOR ] ORA: All expected trading days are present. [2025-09-16T19:50:32.478906] [DEBUG] [VALIDATOR ] ORA: Primary data validation passed. [2025-09-16T19:50:32.479606] [INFO ] [MAIN ] ORA: Fetched primary data is valid. [2025-09-16T19:50:32.479663] [DEBUG] [LOCAL ] ORA: Saving primary data. [2025-09-16T19:50:32.480658] [DEBUG] [LOCAL ] ORA: Trimmed 35696 records to 23864 (keeping 150 days of data) [2025-09-16T19:50:32.645088] [DEBUG] [LOCAL ] ORA: Primary data saved (23864 records). [2025-09-16T19:50:32.645223] [INFO ] [MAIN ] ORA: Full history saved. [2025-09-16T19:50:32.645317] [INFO ] [MAIN ] Update Progress: 1606/2369 symbols completed. ORA took 23.8s. Estimated remaining: 1h 20m 60s. Rate: 9.4 symbols/min [2025-09-16T19:50:32.821089] [INFO ] [MAIN ] ORN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:50:32.843865] [DEBUG] [LOCAL ] ORN: Loaded 22954 existing records from primary storage. [2025-09-16T19:50:32.844044] [INFO ] [MAIN ] ORN: Loaded 22954 existing records. [2025-09-16T19:50:33.022444] [WARN ] [MAIN ] ORN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:50:33.022723] [INFO ] [MAIN ] ORN: Wiping existing primary data before full refresh. [2025-09-16T19:50:33.022773] [INFO ] [LOCAL ] ORN: Starting deletion of primary data. [2025-09-16T19:50:33.023290] [DEBUG] [LOCAL ] ORN: Deleted primary data file. [2025-09-16T19:50:33.023337] [INFO ] [MAIN ] ORN: Starting full primary refresh. [2025-09-16T19:50:33.179477] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-04. [2025-09-16T19:50:33.397258] [INFO ] [REMOTE ] ORN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:50:33.697128] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-16T19:50:33.974954] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-02. [2025-09-16T19:50:34.774937] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-08. [2025-09-16T19:50:34.895076] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-09-16T19:50:34.960548] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-16T19:50:35.099618] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-16T19:50:35.574902] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-05. [2025-09-16T19:50:36.374906] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-03. [2025-09-16T19:50:36.539804] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-16T19:50:37.174932] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-09. [2025-09-16T19:50:37.677919] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-16T19:50:37.772701] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-16T19:50:37.974926] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-05. [2025-09-16T19:50:38.774897] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-06. [2025-09-16T19:50:39.039031] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-16T19:50:39.046607] [INFO ] [REMOTE ] ORC: Full fetch complete (56805 records). [2025-09-16T19:50:39.046756] [DEBUG] [VALIDATOR ] ORC: Validating primary data. [2025-09-16T19:50:39.434387] [DEBUG] [VALIDATOR ] ORC: All expected trading days are present. [2025-09-16T19:50:39.434495] [DEBUG] [VALIDATOR ] ORC: Primary data validation passed. [2025-09-16T19:50:39.435615] [INFO ] [MAIN ] ORC: Fetched primary data is valid. [2025-09-16T19:50:39.435748] [DEBUG] [LOCAL ] ORC: Saving primary data. [2025-09-16T19:50:39.437569] [DEBUG] [LOCAL ] ORC: Trimmed 56805 records to 39061 (keeping 150 days of data) [2025-09-16T19:50:39.568516] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-16T19:50:39.583203] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-04. [2025-09-16T19:50:39.724395] [DEBUG] [LOCAL ] ORC: Primary data saved (39061 records). [2025-09-16T19:50:39.724562] [INFO ] [MAIN ] ORC: Full history saved. [2025-09-16T19:50:39.725242] [INFO ] [MAIN ] Update Progress: 1607/2369 symbols completed. ORC took 26.6s. Estimated remaining: 1h 20m 54s. Rate: 9.4 symbols/min [2025-09-16T19:50:39.905914] [INFO ] [MAIN ] OSCR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:50:39.957176] [DEBUG] [LOCAL ] OSCR: Loaded 39762 existing records from primary storage. [2025-09-16T19:50:39.957379] [INFO ] [MAIN ] OSCR: Loaded 39762 existing records. [2025-09-16T19:50:40.145351] [WARN ] [MAIN ] OSCR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:50:40.145623] [INFO ] [MAIN ] OSCR: Wiping existing primary data before full refresh. [2025-09-16T19:50:40.145706] [INFO ] [LOCAL ] OSCR: Starting deletion of primary data. [2025-09-16T19:50:40.146613] [DEBUG] [LOCAL ] OSCR: Deleted primary data file. [2025-09-16T19:50:40.146683] [INFO ] [MAIN ] OSCR: Starting full primary refresh. [2025-09-16T19:50:40.380886] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-06. [2025-09-16T19:50:40.516921] [INFO ] [REMOTE ] OSCR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:50:40.888767] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-16T19:50:41.186538] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-02. [2025-09-16T19:50:41.191690] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-09-16T19:50:41.938943] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-16T19:50:41.974845] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-07. [2025-09-16T19:50:42.774931] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-07. [2025-09-16T19:50:43.022065] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-16T19:50:43.574870] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-05. [2025-09-16T19:50:43.686714] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-16T19:50:44.374914] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-03. [2025-09-16T19:50:45.006664] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-16T19:50:45.174914] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-06. [2025-09-16T19:50:45.319751] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-09-16T19:50:45.974875] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-08. [2025-09-16T19:50:46.201079] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-16T19:50:46.328300] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-16T19:50:46.774914] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-07. [2025-09-16T19:50:47.574943] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-04. [2025-09-16T19:50:48.138541] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-16T19:50:48.299126] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-16T19:50:48.374852] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-09. [2025-09-16T19:50:49.171731] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-16T19:50:49.184991] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-08. [2025-09-16T19:50:49.974946] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-05. [2025-09-16T19:50:50.675972] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-16T19:50:50.745699] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-09-16T19:50:50.752402] [INFO ] [REMOTE ] ORCL: Full fetch complete (58103 records). [2025-09-16T19:50:50.752555] [DEBUG] [VALIDATOR ] ORCL: Validating primary data. [2025-09-16T19:50:50.786242] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-09. [2025-09-16T19:50:50.958374] [WARN ] [VALIDATOR ] ORCL: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-16T19:50:50.958998] [FATAL] [MAIN ] ORCL: Fetched primary data is invalid. Refusing to save it. [2025-09-16T19:50:50.959062] [WARN ] [MAIN ] ORCL: Deleting existing primary and derivative data due to validation failure. [2025-09-16T19:50:50.959110] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-09-16T19:50:50.959177] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-09-16T19:50:50.959214] [INFO ] [LOCAL ] ORCL: Starting deletion of derivative data. [2025-09-16T19:50:50.959254] [DEBUG] [LOCAL ] ORCL: No derivative data file found to delete. [2025-09-16T19:50:50.959323] [INFO ] [MAIN ] Update Progress: 1608/2369 symbols completed. ORCL took 26.9s. Estimated remaining: 1h 20m 50s. Rate: 9.4 symbols/min [2025-09-16T19:50:51.161087] [INFO ] [MAIN ] OSK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:50:51.161293] [DEBUG] [LOCAL ] OSK: No existing data file found in primary storage. [2025-09-16T19:50:51.161331] [WARN ] [MAIN ] OSK: No existing data found, performing full refresh instead. [2025-09-16T19:50:51.161451] [INFO ] [MAIN ] OSK: Wiping existing primary data before full refresh. [2025-09-16T19:50:51.161491] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-09-16T19:50:51.161532] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-09-16T19:50:51.161564] [INFO ] [MAIN ] OSK: Starting full primary refresh. [2025-09-16T19:50:51.516860] [INFO ] [REMOTE ] OSK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:50:51.574873] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-02. [2025-09-16T19:50:52.298044] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-09-16T19:50:52.379926] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-06. [2025-09-16T19:50:52.383880] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-16T19:50:52.390392] [INFO ] [REMOTE ] ORI: Full fetch complete (52940 records). [2025-09-16T19:50:52.390548] [DEBUG] [VALIDATOR ] ORI: Validating primary data. [2025-09-16T19:50:52.583192] [WARN ] [VALIDATOR ] ORI: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-16T19:50:52.583816] [FATAL] [MAIN ] ORI: Fetched primary data is invalid. Refusing to save it. [2025-09-16T19:50:52.583869] [WARN ] [MAIN ] ORI: Deleting existing primary and derivative data due to validation failure. [2025-09-16T19:50:52.583918] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-09-16T19:50:52.583982] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-09-16T19:50:52.584032] [INFO ] [LOCAL ] ORI: Starting deletion of derivative data. [2025-09-16T19:50:52.584073] [DEBUG] [LOCAL ] ORI: No derivative data file found to delete. [2025-09-16T19:50:52.584146] [INFO ] [MAIN ] Update Progress: 1609/2369 symbols completed. ORI took 27.3s. Estimated remaining: 1h 20m 41s. Rate: 9.4 symbols/min [2025-09-16T19:50:52.752963] [INFO ] [MAIN ] OTF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:50:52.753176] [DEBUG] [LOCAL ] OTF: No existing data file found in primary storage. [2025-09-16T19:50:52.753214] [WARN ] [MAIN ] OTF: No existing data found, performing full refresh instead. [2025-09-16T19:50:52.753336] [INFO ] [MAIN ] OTF: Wiping existing primary data before full refresh. [2025-09-16T19:50:52.753394] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-09-16T19:50:52.753436] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-09-16T19:50:52.753468] [INFO ] [MAIN ] OTF: Starting full primary refresh. [2025-09-16T19:50:53.101724] [INFO ] [REMOTE ] OTF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:50:53.180733] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-02. [2025-09-16T19:50:53.185431] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-16T19:50:53.422362] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:50:53.422703] [WARN ] [REMOTE ] OTF: No data returned for month 2025-02 [2025-09-16T19:50:53.974904] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-03. [2025-09-16T19:50:54.167007] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:50:54.167345] [WARN ] [REMOTE ] OTF: No data returned for month 2025-03 [2025-09-16T19:50:54.782501] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-04. [2025-09-16T19:50:54.788203] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-09-16T19:50:55.000734] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:50:55.001056] [WARN ] [REMOTE ] OTF: No data returned for month 2025-04 [2025-09-16T19:50:55.574915] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-05. [2025-09-16T19:50:55.771277] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:50:55.771589] [WARN ] [REMOTE ] OTF: No data returned for month 2025-05 [2025-09-16T19:50:56.374931] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-06. [2025-09-16T19:50:57.126419] [INFO ] [REMOTE ] OTF: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-16T19:50:57.174912] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-03. [2025-09-16T19:50:57.974916] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-07. [2025-09-16T19:50:58.775097] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-08. [2025-09-16T19:50:58.780351] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-16T19:50:59.574905] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-04. [2025-09-16T19:51:00.082969] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-16T19:51:00.374888] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-09. [2025-09-16T19:51:00.458198] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-09-16T19:51:01.174911] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-07. [2025-09-16T19:51:01.238360] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-16T19:51:01.946321] [INFO ] [REMOTE ] OTF: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-16T19:51:01.974910] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-08. [2025-09-16T19:51:02.116621] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-16T19:51:02.120632] [INFO ] [REMOTE ] ORN: Full fetch complete (34302 records). [2025-09-16T19:51:02.120818] [DEBUG] [VALIDATOR ] ORN: Validating primary data. [2025-09-16T19:51:02.518899] [DEBUG] [VALIDATOR ] ORN: All expected trading days are present. [2025-09-16T19:51:02.519016] [DEBUG] [VALIDATOR ] ORN: Primary data validation passed. [2025-09-16T19:51:02.519699] [INFO ] [MAIN ] ORN: Fetched primary data is valid. [2025-09-16T19:51:02.519742] [DEBUG] [LOCAL ] ORN: Saving primary data. [2025-09-16T19:51:02.520517] [DEBUG] [LOCAL ] ORN: Trimmed 34302 records to 23286 (keeping 150 days of data) [2025-09-16T19:51:02.656104] [DEBUG] [LOCAL ] ORN: Primary data saved (23286 records). [2025-09-16T19:51:02.656238] [INFO ] [MAIN ] ORN: Full history saved. [2025-09-16T19:51:02.656323] [INFO ] [MAIN ] Update Progress: 1610/2369 symbols completed. ORN took 30.0s. Estimated remaining: 1h 20m 37s. Rate: 9.4 symbols/min [2025-09-16T19:51:02.779988] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-05. [2025-09-16T19:51:02.842211] [INFO ] [MAIN ] OTIS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:51:02.881579] [DEBUG] [LOCAL ] OTIS: Loaded 38917 existing records from primary storage. [2025-09-16T19:51:02.881733] [INFO ] [MAIN ] OTIS: Loaded 38917 existing records. [2025-09-16T19:51:03.057947] [INFO ] [REMOTE ] OTF: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-16T19:51:03.078558] [WARN ] [MAIN ] OTIS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:51:03.083371] [INFO ] [MAIN ] OTIS: Wiping existing primary data before full refresh. [2025-09-16T19:51:03.083444] [INFO ] [LOCAL ] OTIS: Starting deletion of primary data. [2025-09-16T19:51:03.085111] [DEBUG] [LOCAL ] OTIS: Deleted primary data file. [2025-09-16T19:51:03.085175] [INFO ] [MAIN ] OTIS: Starting full primary refresh. [2025-09-16T19:51:03.442975] [INFO ] [REMOTE ] OTIS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:51:03.574916] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-08. [2025-09-16T19:51:04.374927] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-09. [2025-09-16T19:51:04.463560] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-16T19:51:05.174897] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-02. [2025-09-16T19:51:05.596558] [INFO ] [REMOTE ] OTF: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-16T19:51:05.599990] [INFO ] [REMOTE ] OTF: Full fetch complete (6610 records). [2025-09-16T19:51:05.600074] [DEBUG] [VALIDATOR ] OTF: Validating primary data. [2025-09-16T19:51:05.782422] [WARN ] [VALIDATOR ] OTF: Validation failed - insufficient historical data. Have 66 unique days, need 150 days [2025-09-16T19:51:05.782681] [FATAL] [MAIN ] OTF: Fetched primary data is invalid. Refusing to save it. [2025-09-16T19:51:05.782734] [WARN ] [MAIN ] OTF: Deleting existing primary and derivative data due to validation failure. [2025-09-16T19:51:05.782783] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-09-16T19:51:05.782840] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-09-16T19:51:05.782877] [INFO ] [LOCAL ] OTF: Starting deletion of derivative data. [2025-09-16T19:51:05.782919] [DEBUG] [LOCAL ] OTF: No derivative data file found to delete. [2025-09-16T19:51:05.782980] [INFO ] [MAIN ] Update Progress: 1611/2369 symbols completed. OTF took 13.2s. Estimated remaining: 1h 20m 29s. Rate: 9.4 symbols/min [2025-09-16T19:51:05.958006] [INFO ] [MAIN ] OUT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:51:05.978159] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-06. [2025-09-16T19:51:05.997631] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-09-16T19:51:06.036743] [DEBUG] [LOCAL ] OUT: Loaded 35495 existing records from primary storage. [2025-09-16T19:51:06.036920] [INFO ] [MAIN ] OUT: Loaded 35495 existing records. [2025-09-16T19:51:06.216833] [WARN ] [MAIN ] OUT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:51:06.217128] [INFO ] [MAIN ] OUT: Wiping existing primary data before full refresh. [2025-09-16T19:51:06.217177] [INFO ] [LOCAL ] OUT: Starting deletion of primary data. [2025-09-16T19:51:06.218093] [DEBUG] [LOCAL ] OUT: Deleted primary data file. [2025-09-16T19:51:06.218144] [INFO ] [MAIN ] OUT: Starting full primary refresh. [2025-09-16T19:51:06.578166] [INFO ] [REMOTE ] OUT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:51:06.632370] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-16T19:51:06.774896] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-02. [2025-09-16T19:51:07.574919] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-09. [2025-09-16T19:51:07.703049] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-16T19:51:08.366782] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-16T19:51:08.375310] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-03. [2025-09-16T19:51:09.174918] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-03. [2025-09-16T19:51:09.772950] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-16T19:51:09.779369] [INFO ] [REMOTE ] OSCR: Full fetch complete (58363 records). [2025-09-16T19:51:09.779481] [DEBUG] [VALIDATOR ] OSCR: Validating primary data. [2025-09-16T19:51:09.982912] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-07. [2025-09-16T19:51:10.186188] [DEBUG] [VALIDATOR ] OSCR: All expected trading days are present. [2025-09-16T19:51:10.186353] [DEBUG] [VALIDATOR ] OSCR: Primary data validation passed. [2025-09-16T19:51:10.187366] [INFO ] [MAIN ] OSCR: Fetched primary data is valid. [2025-09-16T19:51:10.187504] [DEBUG] [LOCAL ] OSCR: Saving primary data. [2025-09-16T19:51:10.189121] [DEBUG] [LOCAL ] OSCR: Trimmed 58363 records to 40152 (keeping 150 days of data) [2025-09-16T19:51:10.335887] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-16T19:51:10.483522] [DEBUG] [LOCAL ] OSCR: Primary data saved (40152 records). [2025-09-16T19:51:10.483672] [INFO ] [MAIN ] OSCR: Full history saved. [2025-09-16T19:51:10.484680] [INFO ] [MAIN ] Update Progress: 1612/2369 symbols completed. OSCR took 30.8s. Estimated remaining: 1h 20m 22s. Rate: 9.4 symbols/min [2025-09-16T19:51:10.664259] [INFO ] [MAIN ] OVV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:51:10.703823] [DEBUG] [LOCAL ] OVV: Loaded 39498 existing records from primary storage. [2025-09-16T19:51:10.703989] [INFO ] [MAIN ] OVV: Loaded 39498 existing records. [2025-09-16T19:51:10.783193] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-04. [2025-09-16T19:51:10.883693] [WARN ] [MAIN ] OVV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:51:10.884106] [INFO ] [MAIN ] OVV: Wiping existing primary data before full refresh. [2025-09-16T19:51:10.907184] [INFO ] [LOCAL ] OVV: Starting deletion of primary data. [2025-09-16T19:51:10.911704] [DEBUG] [LOCAL ] OVV: Deleted primary data file. [2025-09-16T19:51:10.911632] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-16T19:51:10.911841] [INFO ] [MAIN ] OVV: Starting full primary refresh. [2025-09-16T19:51:11.296987] [INFO ] [REMOTE ] OVV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:51:11.575804] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-02. [2025-09-16T19:51:11.581035] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-16T19:51:12.374921] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-08. [2025-09-16T19:51:13.040725] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-16T19:51:13.174868] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-05. [2025-09-16T19:51:13.272584] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-16T19:51:13.985527] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-04. [2025-09-16T19:51:13.988213] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-16T19:51:14.774894] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-09. [2025-09-16T19:51:14.924333] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-16T19:51:15.576403] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-03. [2025-09-16T19:51:15.579531] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-16T19:51:15.983236] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-16T19:51:15.988397] [INFO ] [REMOTE ] OSK: Full fetch complete (45864 records). [2025-09-16T19:51:15.988517] [DEBUG] [VALIDATOR ] OSK: Validating primary data. [2025-09-16T19:51:16.178220] [WARN ] [VALIDATOR ] OSK: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-16T19:51:16.178789] [FATAL] [MAIN ] OSK: Fetched primary data is invalid. Refusing to save it. [2025-09-16T19:51:16.178847] [WARN ] [MAIN ] OSK: Deleting existing primary and derivative data due to validation failure. [2025-09-16T19:51:16.178896] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-09-16T19:51:16.178956] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-09-16T19:51:16.178994] [INFO ] [LOCAL ] OSK: Starting deletion of derivative data. [2025-09-16T19:51:16.179035] [DEBUG] [LOCAL ] OSK: No derivative data file found to delete. [2025-09-16T19:51:16.179100] [INFO ] [MAIN ] Update Progress: 1613/2369 symbols completed. OSK took 25.2s. Estimated remaining: 1h 20m 15s. Rate: 9.4 symbols/min [2025-09-16T19:51:16.353348] [INFO ] [MAIN ] OWL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:51:16.376415] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-05. [2025-09-16T19:51:16.394080] [DEBUG] [LOCAL ] OWL: Loaded 39522 existing records from primary storage. [2025-09-16T19:51:16.394211] [INFO ] [MAIN ] OWL: Loaded 39522 existing records. [2025-09-16T19:51:16.571264] [WARN ] [MAIN ] OWL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:51:16.571513] [INFO ] [MAIN ] OWL: Wiping existing primary data before full refresh. [2025-09-16T19:51:16.571568] [INFO ] [LOCAL ] OWL: Starting deletion of primary data. [2025-09-16T19:51:16.572424] [DEBUG] [LOCAL ] OWL: Deleted primary data file. [2025-09-16T19:51:16.572476] [INFO ] [MAIN ] OWL: Starting full primary refresh. [2025-09-16T19:51:16.923763] [INFO ] [REMOTE ] OWL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:51:17.174866] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-02. [2025-09-16T19:51:17.643385] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-16T19:51:17.974973] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-06. [2025-09-16T19:51:18.151855] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-16T19:51:18.774954] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-06. [2025-09-16T19:51:18.811528] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-16T19:51:19.475996] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-16T19:51:19.574918] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-03. [2025-09-16T19:51:20.066861] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-16T19:51:20.374912] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-04. [2025-09-16T19:51:21.174901] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-07. [2025-09-16T19:51:21.316770] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-16T19:51:21.974905] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-07. [2025-09-16T19:51:22.215818] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-16T19:51:22.774905] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-04. [2025-09-16T19:51:22.892583] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-16T19:51:23.574918] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-05. [2025-09-16T19:51:23.909348] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-16T19:51:24.202241] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-16T19:51:24.374899] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-05. [2025-09-16T19:51:25.174916] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-08. [2025-09-16T19:51:25.638205] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-16T19:51:25.974894] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-06. [2025-09-16T19:51:26.374298] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-16T19:51:26.774901] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-06. [2025-09-16T19:51:27.003065] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-16T19:51:27.574878] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-09. [2025-09-16T19:51:27.672555] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-16T19:51:28.374878] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-07. [2025-09-16T19:51:28.839204] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-16T19:51:29.174890] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-08. [2025-09-16T19:51:29.417451] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-16T19:51:29.423829] [INFO ] [REMOTE ] OTIS: Full fetch complete (57321 records). [2025-09-16T19:51:29.423947] [DEBUG] [VALIDATOR ] OTIS: Validating primary data. [2025-09-16T19:51:29.812006] [DEBUG] [VALIDATOR ] OTIS: All expected trading days are present. [2025-09-16T19:51:29.812131] [DEBUG] [VALIDATOR ] OTIS: Primary data validation passed. [2025-09-16T19:51:29.813013] [INFO ] [MAIN ] OTIS: Fetched primary data is valid. [2025-09-16T19:51:29.813144] [DEBUG] [LOCAL ] OTIS: Saving primary data. [2025-09-16T19:51:29.814858] [DEBUG] [LOCAL ] OTIS: Trimmed 57321 records to 39307 (keeping 150 days of data) [2025-09-16T19:51:29.960173] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-16T19:51:29.975691] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-07. [2025-09-16T19:51:30.091081] [DEBUG] [REMOTE ] OWL: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-09-16T19:51:30.093779] [WARN ] [REMOTE ] OWL: No data returned for month 2025-07 [2025-09-16T19:51:30.119653] [DEBUG] [LOCAL ] OTIS: Primary data saved (39307 records). [2025-09-16T19:51:30.119784] [INFO ] [MAIN ] OTIS: Full history saved. [2025-09-16T19:51:30.119907] [INFO ] [MAIN ] Update Progress: 1614/2369 symbols completed. OTIS took 27.5s. Estimated remaining: 1h 20m 12s. Rate: 9.4 symbols/min [2025-09-16T19:51:30.298880] [INFO ] [MAIN ] OWLT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:51:30.308184] [DEBUG] [LOCAL ] OWLT: Loaded 6955 existing records from primary storage. [2025-09-16T19:51:30.308313] [INFO ] [MAIN ] OWLT: Loaded 6955 existing records. [2025-09-16T19:51:30.500627] [WARN ] [MAIN ] OWLT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:51:30.500930] [INFO ] [MAIN ] OWLT: Wiping existing primary data before full refresh. [2025-09-16T19:51:30.500982] [INFO ] [LOCAL ] OWLT: Starting deletion of primary data. [2025-09-16T19:51:30.501380] [DEBUG] [LOCAL ] OWLT: Deleted primary data file. [2025-09-16T19:51:30.501428] [INFO ] [MAIN ] OWLT: Starting full primary refresh. [2025-09-16T19:51:30.781908] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-08. [2025-09-16T19:51:30.871543] [INFO ] [REMOTE ] OWLT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:51:30.904178] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-16T19:51:31.574953] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-09. [2025-09-16T19:51:32.374913] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-02. [2025-09-16T19:51:32.676939] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-16T19:51:32.705322] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-16T19:51:32.711107] [INFO ] [REMOTE ] OUT: Full fetch complete (52333 records). [2025-09-16T19:51:32.711227] [DEBUG] [VALIDATOR ] OUT: Validating primary data. [2025-09-16T19:51:33.026781] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-16T19:51:33.110023] [DEBUG] [VALIDATOR ] OUT: All expected trading days are present. [2025-09-16T19:51:33.110102] [DEBUG] [VALIDATOR ] OUT: Primary data validation passed. [2025-09-16T19:51:33.110938] [INFO ] [MAIN ] OUT: Fetched primary data is valid. [2025-09-16T19:51:33.110985] [DEBUG] [LOCAL ] OUT: Saving primary data. [2025-09-16T19:51:33.112037] [DEBUG] [LOCAL ] OUT: Trimmed 52333 records to 35820 (keeping 150 days of data) [2025-09-16T19:51:33.177830] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-09. [2025-09-16T19:51:33.338904] [DEBUG] [LOCAL ] OUT: Primary data saved (35820 records). [2025-09-16T19:51:33.339198] [INFO ] [MAIN ] OUT: Full history saved. [2025-09-16T19:51:33.339293] [INFO ] [MAIN ] Update Progress: 1615/2369 symbols completed. OUT took 27.6s. Estimated remaining: 1h 20m 4s. Rate: 9.4 symbols/min [2025-09-16T19:51:33.510933] [INFO ] [MAIN ] OXM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:51:33.534070] [DEBUG] [LOCAL ] OXM: Loaded 24204 existing records from primary storage. [2025-09-16T19:51:33.534206] [INFO ] [MAIN ] OXM: Loaded 24204 existing records. [2025-09-16T19:51:33.711936] [WARN ] [MAIN ] OXM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:51:33.712215] [INFO ] [MAIN ] OXM: Wiping existing primary data before full refresh. [2025-09-16T19:51:33.712265] [INFO ] [LOCAL ] OXM: Starting deletion of primary data. [2025-09-16T19:51:33.713147] [DEBUG] [LOCAL ] OXM: Deleted primary data file. [2025-09-16T19:51:33.713199] [INFO ] [MAIN ] OXM: Starting full primary refresh. [2025-09-16T19:51:33.980173] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-03. [2025-09-16T19:51:34.071772] [INFO ] [REMOTE ] OXM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:51:34.607962] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-16T19:51:34.774920] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-04. [2025-09-16T19:51:35.019085] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-16T19:51:35.025535] [INFO ] [REMOTE ] OWL: Full fetch complete (49838 records). [2025-09-16T19:51:35.025683] [DEBUG] [VALIDATOR ] OWL: Validating primary data. [2025-09-16T19:51:35.213952] [WARN ] [VALIDATOR ] OWL: Validation failed - insufficient historical data. Have 128 unique days, need 150 days [2025-09-16T19:51:35.214536] [FATAL] [MAIN ] OWL: Fetched primary data is invalid. Refusing to save it. [2025-09-16T19:51:35.214609] [WARN ] [MAIN ] OWL: Deleting existing primary and derivative data due to validation failure. [2025-09-16T19:51:35.214699] [INFO ] [LOCAL ] OWL: Starting deletion of primary data. [2025-09-16T19:51:35.214790] [DEBUG] [LOCAL ] OWL: No primary data file found to delete. [2025-09-16T19:51:35.214829] [INFO ] [LOCAL ] OWL: Starting deletion of derivative data. [2025-09-16T19:51:35.215232] [DEBUG] [LOCAL ] OWL: Deleted derivative data file. [2025-09-16T19:51:35.215331] [INFO ] [MAIN ] Update Progress: 1616/2369 symbols completed. OWL took 19.0s. Estimated remaining: 1h 19m 56s. Rate: 9.4 symbols/min [2025-09-16T19:51:35.385798] [INFO ] [MAIN ] OXY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:51:35.386014] [DEBUG] [LOCAL ] OXY: No existing data file found in primary storage. [2025-09-16T19:51:35.386082] [WARN ] [MAIN ] OXY: No existing data found, performing full refresh instead. [2025-09-16T19:51:35.390746] [INFO ] [MAIN ] OXY: Wiping existing primary data before full refresh. [2025-09-16T19:51:35.391389] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-09-16T19:51:35.391450] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-09-16T19:51:35.391872] [INFO ] [MAIN ] OXY: Starting full primary refresh. [2025-09-16T19:51:35.391799] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-16T19:51:35.584947] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-05. [2025-09-16T19:51:35.787480] [INFO ] [REMOTE ] OXY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:51:36.350545] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-16T19:51:36.374869] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-06. [2025-09-16T19:51:37.174892] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-08. [2025-09-16T19:51:37.298708] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-16T19:51:37.974903] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-07. [2025-09-16T19:51:38.758657] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-16T19:51:38.774841] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-08. [2025-09-16T19:51:38.971056] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-16T19:51:39.574952] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-09. [2025-09-16T19:51:39.610722] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-16T19:51:40.374939] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-02. [2025-09-16T19:51:41.174938] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-09. [2025-09-16T19:51:41.455669] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-16T19:51:41.462181] [INFO ] [REMOTE ] OVV: Full fetch complete (58153 records). [2025-09-16T19:51:41.462310] [DEBUG] [VALIDATOR ] OVV: Validating primary data. [2025-09-16T19:51:41.769289] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-16T19:51:41.802523] [INFO ] [REMOTE ] OWLT: Full fetch complete (9188 records). [2025-09-16T19:51:41.823804] [DEBUG] [VALIDATOR ] OWLT: Validating primary data. [2025-09-16T19:51:41.975922] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-02. [2025-09-16T19:51:41.976400] [DEBUG] [VALIDATOR ] OVV: All expected trading days are present. [2025-09-16T19:51:41.977844] [DEBUG] [VALIDATOR ] OVV: Primary data validation passed. [2025-09-16T19:51:42.015753] [INFO ] [MAIN ] OVV: Fetched primary data is valid. [2025-09-16T19:51:42.060805] [DEBUG] [LOCAL ] OVV: Saving primary data. [2025-09-16T19:51:42.092079] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-16T19:51:42.127324] [DEBUG] [LOCAL ] OVV: Trimmed 58153 records to 39887 (keeping 150 days of data) [2025-09-16T19:51:42.673147] [DEBUG] [VALIDATOR ] OWLT: All expected trading days are present. [2025-09-16T19:51:42.674626] [DEBUG] [VALIDATOR ] OWLT: Primary data validation passed. [2025-09-16T19:51:42.675567] [INFO ] [MAIN ] OWLT: Fetched primary data is valid. [2025-09-16T19:51:42.676063] [DEBUG] [LOCAL ] OWLT: Saving primary data. [2025-09-16T19:51:42.680316] [DEBUG] [LOCAL ] OWLT: Trimmed 9188 records to 7029 (keeping 150 days of data) [2025-09-16T19:51:42.803319] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-03. [2025-09-16T19:51:42.851904] [DEBUG] [LOCAL ] OWLT: Primary data saved (7029 records). [2025-09-16T19:51:42.859201] [INFO ] [MAIN ] OWLT: Full history saved. [2025-09-16T19:51:42.860390] [INFO ] [MAIN ] Update Progress: 1617/2369 symbols completed. OWLT took 12.7s. Estimated remaining: 1h 19m 50s. Rate: 9.4 symbols/min [2025-09-16T19:51:43.054633] [INFO ] [MAIN ] PAAS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:51:43.066436] [DEBUG] [LOCAL ] OVV: Primary data saved (39887 records). [2025-09-16T19:51:43.066659] [INFO ] [MAIN ] OVV: Full history saved. [2025-09-16T19:51:43.067494] [INFO ] [MAIN ] Update Progress: 1618/2369 symbols completed. OVV took 32.6s. Estimated remaining: 1h 19m 41s. Rate: 9.4 symbols/min [2025-09-16T19:51:43.249967] [INFO ] [MAIN ] PAC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:51:43.263031] [DEBUG] [LOCAL ] PAAS: Loaded 39585 existing records from primary storage. [2025-09-16T19:51:43.263288] [INFO ] [MAIN ] PAAS: Loaded 39585 existing records. [2025-09-16T19:51:43.372727] [DEBUG] [LOCAL ] PAC: Loaded 8394 existing records from primary storage. [2025-09-16T19:51:43.383470] [INFO ] [MAIN ] PAC: Loaded 8394 existing records. [2025-09-16T19:51:43.551042] [WARN ] [MAIN ] PAAS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:51:43.605566] [INFO ] [MAIN ] PAAS: Wiping existing primary data before full refresh. [2025-09-16T19:51:43.622837] [INFO ] [LOCAL ] PAAS: Starting deletion of primary data. [2025-09-16T19:51:43.626942] [WARN ] [MAIN ] PAC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:51:43.627082] [INFO ] [MAIN ] PAC: Wiping existing primary data before full refresh. [2025-09-16T19:51:43.627122] [INFO ] [LOCAL ] PAC: Starting deletion of primary data. [2025-09-16T19:51:43.627397] [DEBUG] [LOCAL ] PAC: Deleted primary data file. [2025-09-16T19:51:43.627441] [INFO ] [MAIN ] PAC: Starting full primary refresh. [2025-09-16T19:51:43.658638] [DEBUG] [LOCAL ] PAAS: Deleted primary data file. [2025-09-16T19:51:43.690659] [INFO ] [MAIN ] PAAS: Starting full primary refresh. [2025-09-16T19:51:44.274850] [INFO ] [REMOTE ] PAC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:51:44.290870] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-02. [2025-09-16T19:51:44.342152] [INFO ] [REMOTE ] PAAS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:51:44.364553] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-16T19:51:44.381997] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-04. [2025-09-16T19:51:44.399738] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-09-16T19:51:45.174961] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-02. [2025-09-16T19:51:45.228551] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-16T19:51:45.926065] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-16T19:51:45.974897] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-05. [2025-09-16T19:51:46.774907] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-03. [2025-09-16T19:51:47.004731] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-16T19:51:47.386720] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-16T19:51:47.403978] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-16T19:51:47.574898] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-06. [2025-09-16T19:51:48.374910] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-04. [2025-09-16T19:51:49.044079] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-16T19:51:49.174913] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-03. [2025-09-16T19:51:49.350040] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-16T19:51:49.974955] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-03. [2025-09-16T19:51:50.774909] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-05. [2025-09-16T19:51:51.035777] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-16T19:51:51.317504] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-16T19:51:51.574934] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-06. [2025-09-16T19:51:52.174683] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-16T19:51:52.374892] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-04. [2025-09-16T19:51:52.510400] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-16T19:51:53.174924] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-07. [2025-09-16T19:51:53.974941] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-04. [2025-09-16T19:51:54.109420] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-16T19:51:54.774919] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-07. [2025-09-16T19:51:55.015331] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-04 (2.64 seconds). [2025-09-16T19:51:55.574923] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-05. [2025-09-16T19:51:55.827532] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-16T19:51:55.903865] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-16T19:51:56.374903] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-05. [2025-09-16T19:51:57.174889] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-08. [2025-09-16T19:51:57.974859] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-08. [2025-09-16T19:51:58.020105] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-09-16T19:51:58.404488] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-16T19:51:58.529468] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-16T19:51:58.541425] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-16T19:51:58.774915] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-09. [2025-09-16T19:51:59.534075] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-16T19:51:59.535518] [INFO ] [REMOTE ] PAC: Full fetch complete (12785 records). [2025-09-16T19:51:59.535691] [DEBUG] [VALIDATOR ] PAC: Validating primary data. [2025-09-16T19:51:59.579991] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-09. [2025-09-16T19:51:59.898489] [DEBUG] [VALIDATOR ] PAC: All expected trading days are present. [2025-09-16T19:51:59.898613] [DEBUG] [VALIDATOR ] PAC: Primary data validation passed. [2025-09-16T19:51:59.898948] [INFO ] [MAIN ] PAC: Fetched primary data is valid. [2025-09-16T19:51:59.898997] [DEBUG] [LOCAL ] PAC: Saving primary data. [2025-09-16T19:51:59.899515] [DEBUG] [LOCAL ] PAC: Trimmed 12785 records to 8440 (keeping 150 days of data) [2025-09-16T19:51:59.953721] [DEBUG] [LOCAL ] PAC: Primary data saved (8440 records). [2025-09-16T19:51:59.953851] [INFO ] [MAIN ] PAC: Full history saved. [2025-09-16T19:51:59.953956] [INFO ] [MAIN ] Update Progress: 1619/2369 symbols completed. PAC took 16.9s. Estimated remaining: 1h 19m 39s. Rate: 9.4 symbols/min [2025-09-16T19:52:00.123470] [INFO ] [MAIN ] PACK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:52:00.145740] [DEBUG] [LOCAL ] PACK: Loaded 22763 existing records from primary storage. [2025-09-16T19:52:00.145863] [INFO ] [MAIN ] PACK: Loaded 22763 existing records. [2025-09-16T19:52:00.320154] [WARN ] [MAIN ] PACK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:52:00.320394] [INFO ] [MAIN ] PACK: Wiping existing primary data before full refresh. [2025-09-16T19:52:00.320440] [INFO ] [LOCAL ] PACK: Starting deletion of primary data. [2025-09-16T19:52:00.321016] [DEBUG] [LOCAL ] PACK: Deleted primary data file. [2025-09-16T19:52:00.321063] [INFO ] [MAIN ] PACK: Starting full primary refresh. [2025-09-16T19:52:00.383814] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-06. [2025-09-16T19:52:00.676289] [INFO ] [REMOTE ] PACK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:52:00.969506] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-16T19:52:00.974426] [INFO ] [REMOTE ] OXM: Full fetch complete (35737 records). [2025-09-16T19:52:00.974531] [DEBUG] [VALIDATOR ] OXM: Validating primary data. [2025-09-16T19:52:01.180864] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-06. [2025-09-16T19:52:01.363806] [DEBUG] [VALIDATOR ] OXM: All expected trading days are present. [2025-09-16T19:52:01.363904] [DEBUG] [VALIDATOR ] OXM: Primary data validation passed. [2025-09-16T19:52:01.364769] [INFO ] [MAIN ] OXM: Fetched primary data is valid. [2025-09-16T19:52:01.364833] [DEBUG] [LOCAL ] OXM: Saving primary data. [2025-09-16T19:52:01.365753] [DEBUG] [LOCAL ] OXM: Trimmed 35737 records to 24453 (keeping 150 days of data) [2025-09-16T19:52:01.521688] [DEBUG] [LOCAL ] OXM: Primary data saved (24453 records). [2025-09-16T19:52:01.521835] [INFO ] [MAIN ] OXM: Full history saved. [2025-09-16T19:52:01.521926] [INFO ] [MAIN ] Update Progress: 1620/2369 symbols completed. OXM took 28.2s. Estimated remaining: 1h 19m 31s. Rate: 9.4 symbols/min [2025-09-16T19:52:01.702535] [INFO ] [MAIN ] PACS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:52:01.702784] [DEBUG] [LOCAL ] PACS: No existing data file found in primary storage. [2025-09-16T19:52:01.702826] [WARN ] [MAIN ] PACS: No existing data found, performing full refresh instead. [2025-09-16T19:52:01.702950] [INFO ] [MAIN ] PACS: Wiping existing primary data before full refresh. [2025-09-16T19:52:01.702990] [INFO ] [LOCAL ] PACS: Starting deletion of primary data. [2025-09-16T19:52:01.703032] [DEBUG] [LOCAL ] PACS: No primary data file found to delete. [2025-09-16T19:52:01.703064] [INFO ] [MAIN ] PACS: Starting full primary refresh. [2025-09-16T19:52:01.980630] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-02. [2025-09-16T19:52:02.070788] [INFO ] [REMOTE ] PACS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:52:02.774923] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-02. [2025-09-16T19:52:02.977333] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-06 (2.59 seconds). [2025-09-16T19:52:03.235366] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-16T19:52:03.261631] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-16T19:52:03.574900] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-07. [2025-09-16T19:52:03.728589] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-16T19:52:04.374929] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-07. [2025-09-16T19:52:05.174903] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-03. [2025-09-16T19:52:05.599323] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-16T19:52:05.974907] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-08. [2025-09-16T19:52:06.566889] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-16T19:52:06.598194] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-16T19:52:06.774889] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-08. [2025-09-16T19:52:07.574892] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-03. [2025-09-16T19:52:07.947023] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-16T19:52:08.374911] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-09. [2025-09-16T19:52:08.632930] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-16T19:52:08.793235] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-16T19:52:09.174906] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-04. [2025-09-16T19:52:09.974870] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-04. [2025-09-16T19:52:10.327125] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-16T19:52:10.333449] [INFO ] [REMOTE ] PAAS: Full fetch complete (58250 records). [2025-09-16T19:52:10.333554] [DEBUG] [VALIDATOR ] PAAS: Validating primary data. [2025-09-16T19:52:10.726272] [DEBUG] [VALIDATOR ] PAAS: All expected trading days are present. [2025-09-16T19:52:10.726430] [DEBUG] [VALIDATOR ] PAAS: Primary data validation passed. [2025-09-16T19:52:10.727444] [INFO ] [MAIN ] PAAS: Fetched primary data is valid. [2025-09-16T19:52:10.727545] [DEBUG] [LOCAL ] PAAS: Saving primary data. [2025-09-16T19:52:10.748853] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-16T19:52:10.747889] [DEBUG] [LOCAL ] PAAS: Trimmed 58250 records to 39975 (keeping 150 days of data) [2025-09-16T19:52:10.814843] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-05. [2025-09-16T19:52:11.010339] [DEBUG] [LOCAL ] PAAS: Primary data saved (39975 records). [2025-09-16T19:52:11.010498] [INFO ] [MAIN ] PAAS: Full history saved. [2025-09-16T19:52:11.010586] [INFO ] [MAIN ] Update Progress: 1621/2369 symbols completed. PAAS took 28.1s. Estimated remaining: 1h 19m 26s. Rate: 9.4 symbols/min [2025-09-16T19:52:11.184053] [INFO ] [MAIN ] PAG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:52:11.204372] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-16T19:52:11.224211] [DEBUG] [LOCAL ] PAG: Loaded 15392 existing records from primary storage. [2025-09-16T19:52:11.224339] [INFO ] [MAIN ] PAG: Loaded 15392 existing records. [2025-09-16T19:52:11.407568] [WARN ] [MAIN ] PAG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:52:11.407889] [INFO ] [MAIN ] PAG: Wiping existing primary data before full refresh. [2025-09-16T19:52:11.407953] [INFO ] [LOCAL ] PAG: Starting deletion of primary data. [2025-09-16T19:52:11.408468] [DEBUG] [LOCAL ] PAG: Deleted primary data file. [2025-09-16T19:52:11.408518] [INFO ] [MAIN ] PAG: Starting full primary refresh. [2025-09-16T19:52:11.581973] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-05. [2025-09-16T19:52:11.763960] [INFO ] [REMOTE ] PAG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:52:12.118036] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-16T19:52:12.374916] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-06. [2025-09-16T19:52:12.720108] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-16T19:52:13.174911] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-09. [2025-09-16T19:52:13.668495] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-16T19:52:13.974894] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-06. [2025-09-16T19:52:14.774873] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-07. [2025-09-16T19:52:15.157549] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-16T19:52:15.249874] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-16T19:52:15.256256] [INFO ] [REMOTE ] OXY: Full fetch complete (58086 records). [2025-09-16T19:52:15.256364] [DEBUG] [VALIDATOR ] OXY: Validating primary data. [2025-09-16T19:52:15.445983] [WARN ] [VALIDATOR ] OXY: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-16T19:52:15.446654] [FATAL] [MAIN ] OXY: Fetched primary data is invalid. Refusing to save it. [2025-09-16T19:52:15.446721] [WARN ] [MAIN ] OXY: Deleting existing primary and derivative data due to validation failure. [2025-09-16T19:52:15.446783] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-09-16T19:52:15.446847] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-09-16T19:52:15.446909] [INFO ] [LOCAL ] OXY: Starting deletion of derivative data. [2025-09-16T19:52:15.447292] [DEBUG] [LOCAL ] OXY: No derivative data file found to delete. [2025-09-16T19:52:15.447395] [INFO ] [MAIN ] Update Progress: 1622/2369 symbols completed. OXY took 40.2s. Estimated remaining: 1h 19m 18s. Rate: 9.4 symbols/min [2025-09-16T19:52:15.586819] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-07. [2025-09-16T19:52:15.617775] [INFO ] [MAIN ] PAGS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:52:15.655527] [DEBUG] [LOCAL ] PAGS: Loaded 38961 existing records from primary storage. [2025-09-16T19:52:15.655686] [INFO ] [MAIN ] PAGS: Loaded 38961 existing records. [2025-09-16T19:52:15.839337] [WARN ] [MAIN ] PAGS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:52:15.839702] [INFO ] [MAIN ] PAGS: Wiping existing primary data before full refresh. [2025-09-16T19:52:15.839841] [INFO ] [LOCAL ] PAGS: Starting deletion of primary data. [2025-09-16T19:52:15.840837] [DEBUG] [LOCAL ] PAGS: Deleted primary data file. [2025-09-16T19:52:15.840904] [INFO ] [MAIN ] PAGS: Starting full primary refresh. [2025-09-16T19:52:15.970232] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-16T19:52:16.234477] [INFO ] [REMOTE ] PAGS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:52:16.374907] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-02. [2025-09-16T19:52:16.522847] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-16T19:52:17.122836] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-16T19:52:17.174894] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-08. [2025-09-16T19:52:17.974926] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-03. [2025-09-16T19:52:18.535234] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-16T19:52:18.774910] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-09. [2025-09-16T19:52:19.090969] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-16T19:52:19.574903] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-02. [2025-09-16T19:52:20.058575] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-16T19:52:20.065143] [INFO ] [REMOTE ] PACK: Full fetch complete (34512 records). [2025-09-16T19:52:20.065312] [DEBUG] [VALIDATOR ] PACK: Validating primary data. [2025-09-16T19:52:20.379952] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-04. [2025-09-16T19:52:20.447018] [DEBUG] [VALIDATOR ] PACK: All expected trading days are present. [2025-09-16T19:52:20.447103] [DEBUG] [VALIDATOR ] PACK: Primary data validation passed. [2025-09-16T19:52:20.447811] [INFO ] [MAIN ] PACK: Fetched primary data is valid. [2025-09-16T19:52:20.447862] [DEBUG] [LOCAL ] PACK: Saving primary data. [2025-09-16T19:52:20.449908] [DEBUG] [LOCAL ] PACK: Trimmed 34512 records to 22965 (keeping 150 days of data) [2025-09-16T19:52:20.580612] [DEBUG] [LOCAL ] PACK: Primary data saved (22965 records). [2025-09-16T19:52:20.580751] [INFO ] [MAIN ] PACK: Full history saved. [2025-09-16T19:52:20.580856] [INFO ] [MAIN ] Update Progress: 1623/2369 symbols completed. PACK took 20.6s. Estimated remaining: 1h 19m 12s. Rate: 9.4 symbols/min [2025-09-16T19:52:20.748523] [INFO ] [MAIN ] PAI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:52:20.752127] [DEBUG] [LOCAL ] PAI: Loaded 1985 existing records from primary storage. [2025-09-16T19:52:20.752201] [INFO ] [MAIN ] PAI: Loaded 1985 existing records. [2025-09-16T19:52:20.927387] [WARN ] [MAIN ] PAI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:52:20.927599] [INFO ] [MAIN ] PAI: Wiping existing primary data before full refresh. [2025-09-16T19:52:20.927668] [INFO ] [LOCAL ] PAI: Starting deletion of primary data. [2025-09-16T19:52:20.927843] [DEBUG] [LOCAL ] PAI: Deleted primary data file. [2025-09-16T19:52:20.927885] [INFO ] [MAIN ] PAI: Starting full primary refresh. [2025-09-16T19:52:21.181323] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-08. [2025-09-16T19:52:21.285863] [INFO ] [REMOTE ] PAI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:52:21.365885] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-16T19:52:21.870292] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-16T19:52:21.974924] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-03. [2025-09-16T19:52:22.169148] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-16T19:52:22.774896] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-09. [2025-09-16T19:52:23.370808] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-16T19:52:23.574909] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-05. [2025-09-16T19:52:23.895004] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-16T19:52:23.901585] [INFO ] [REMOTE ] PACS: Full fetch complete (36903 records). [2025-09-16T19:52:23.901761] [DEBUG] [VALIDATOR ] PACS: Validating primary data. [2025-09-16T19:52:24.319915] [DEBUG] [VALIDATOR ] PACS: All expected trading days are present. [2025-09-16T19:52:24.319999] [DEBUG] [VALIDATOR ] PACS: Primary data validation passed. [2025-09-16T19:52:24.320801] [INFO ] [MAIN ] PACS: Fetched primary data is valid. [2025-09-16T19:52:24.320852] [DEBUG] [LOCAL ] PACS: Saving primary data. [2025-09-16T19:52:24.321635] [DEBUG] [LOCAL ] PACS: Trimmed 36903 records to 25146 (keeping 150 days of data) [2025-09-16T19:52:24.376897] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-04. [2025-09-16T19:52:24.474716] [DEBUG] [LOCAL ] PACS: Primary data saved (25146 records). [2025-09-16T19:52:24.474844] [INFO ] [MAIN ] PACS: Full history saved. [2025-09-16T19:52:24.474926] [INFO ] [MAIN ] Update Progress: 1624/2369 symbols completed. PACS took 23.0s. Estimated remaining: 1h 19m 4s. Rate: 9.4 symbols/min [2025-09-16T19:52:24.643588] [INFO ] [MAIN ] PAII: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:52:24.643895] [DEBUG] [LOCAL ] PAII: No existing data file found in primary storage. [2025-09-16T19:52:24.643990] [WARN ] [MAIN ] PAII: No existing data found, performing full refresh instead. [2025-09-16T19:52:24.647859] [INFO ] [MAIN ] PAII: Wiping existing primary data before full refresh. [2025-09-16T19:52:24.648235] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-09-16T19:52:24.648373] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-09-16T19:52:24.648455] [INFO ] [MAIN ] PAII: Starting full primary refresh. [2025-09-16T19:52:24.939289] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-16T19:52:25.031285] [INFO ] [REMOTE ] PAII: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:52:25.174846] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-02. [2025-09-16T19:52:25.378541] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:52:25.378877] [WARN ] [REMOTE ] PAII: No data returned for month 2025-02 [2025-09-16T19:52:25.974928] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-06. [2025-09-16T19:52:26.272593] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-16T19:52:26.765153] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-16T19:52:26.774844] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-07. [2025-09-16T19:52:27.574917] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-03. [2025-09-16T19:52:27.779288] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:52:27.779604] [WARN ] [REMOTE ] PAII: No data returned for month 2025-03 [2025-09-16T19:52:27.846553] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-16T19:52:28.374892] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-04. [2025-09-16T19:52:28.581035] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:52:28.581556] [WARN ] [REMOTE ] PAII: No data returned for month 2025-04 [2025-09-16T19:52:29.174905] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-08. [2025-09-16T19:52:29.974920] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-02. [2025-09-16T19:52:30.218026] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-16T19:52:30.301911] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-16T19:52:30.774907] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-03. [2025-09-16T19:52:31.256337] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-16T19:52:31.574907] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-09. [2025-09-16T19:52:32.374925] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-05. [2025-09-16T19:52:32.581388] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:52:32.581763] [WARN ] [REMOTE ] PAII: No data returned for month 2025-05 [2025-09-16T19:52:32.775462] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-16T19:52:32.778054] [INFO ] [REMOTE ] PAG: Full fetch complete (24131 records). [2025-09-16T19:52:32.778138] [DEBUG] [VALIDATOR ] PAG: Validating primary data. [2025-09-16T19:52:33.142487] [DEBUG] [VALIDATOR ] PAG: All expected trading days are present. [2025-09-16T19:52:33.142563] [DEBUG] [VALIDATOR ] PAG: Primary data validation passed. [2025-09-16T19:52:33.143125] [INFO ] [MAIN ] PAG: Fetched primary data is valid. [2025-09-16T19:52:33.143170] [DEBUG] [LOCAL ] PAG: Saving primary data. [2025-09-16T19:52:33.143831] [DEBUG] [LOCAL ] PAG: Trimmed 24131 records to 15484 (keeping 150 days of data) [2025-09-16T19:52:33.191064] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-06. [2025-09-16T19:52:33.247173] [DEBUG] [LOCAL ] PAG: Primary data saved (15484 records). [2025-09-16T19:52:33.247340] [INFO ] [MAIN ] PAG: Full history saved. [2025-09-16T19:52:33.247468] [INFO ] [MAIN ] Update Progress: 1625/2369 symbols completed. PAG took 22.2s. Estimated remaining: 1h 18m 59s. Rate: 9.4 symbols/min [2025-09-16T19:52:33.415818] [INFO ] [MAIN ] PAM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:52:33.422946] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:52:33.423298] [WARN ] [REMOTE ] PAII: No data returned for month 2025-06 [2025-09-16T19:52:33.437039] [DEBUG] [LOCAL ] PAM: Loaded 20034 existing records from primary storage. [2025-09-16T19:52:33.437144] [INFO ] [MAIN ] PAM: Loaded 20034 existing records. [2025-09-16T19:52:33.617797] [WARN ] [MAIN ] PAM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:52:33.618074] [INFO ] [MAIN ] PAM: Wiping existing primary data before full refresh. [2025-09-16T19:52:33.618128] [INFO ] [LOCAL ] PAM: Starting deletion of primary data. [2025-09-16T19:52:33.618702] [DEBUG] [LOCAL ] PAM: Deleted primary data file. [2025-09-16T19:52:33.618754] [INFO ] [MAIN ] PAM: Starting full primary refresh. [2025-09-16T19:52:33.966518] [INFO ] [REMOTE ] PAM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:52:33.974854] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-02. [2025-09-16T19:52:34.774979] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-07. [2025-09-16T19:52:35.444073] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:52:35.444858] [WARN ] [REMOTE ] PAII: No data returned for month 2025-07 [2025-09-16T19:52:35.466369] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-16T19:52:35.574914] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-05. [2025-09-16T19:52:36.374896] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-08. [2025-09-16T19:52:36.569035] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:52:36.569352] [WARN ] [REMOTE ] PAII: No data returned for month 2025-08 [2025-09-16T19:52:37.174898] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-03. [2025-09-16T19:52:37.370686] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-16T19:52:37.974894] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-09. [2025-09-16T19:52:38.369739] [INFO ] [REMOTE ] PAII: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-16T19:52:38.372997] [INFO ] [REMOTE ] PAII: Full fetch complete (36 records). [2025-09-16T19:52:38.373086] [DEBUG] [VALIDATOR ] PAII: Validating primary data. [2025-09-16T19:52:38.372185] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-16T19:52:38.568415] [WARN ] [VALIDATOR ] PAII: Validation failed - insufficient historical data. Have 5 unique days, need 150 days [2025-09-16T19:52:38.568683] [FATAL] [MAIN ] PAII: Fetched primary data is invalid. Refusing to save it. [2025-09-16T19:52:38.568755] [WARN ] [MAIN ] PAII: Deleting existing primary and derivative data due to validation failure. [2025-09-16T19:52:38.568820] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-09-16T19:52:38.568889] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-09-16T19:52:38.568939] [INFO ] [LOCAL ] PAII: Starting deletion of derivative data. [2025-09-16T19:52:38.569017] [DEBUG] [LOCAL ] PAII: No derivative data file found to delete. [2025-09-16T19:52:38.569106] [INFO ] [MAIN ] Update Progress: 1626/2369 symbols completed. PAII took 14.1s. Estimated remaining: 1h 18m 52s. Rate: 9.4 symbols/min [2025-09-16T19:52:38.766420] [INFO ] [MAIN ] PAR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:52:38.778894] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-06. [2025-09-16T19:52:38.789997] [DEBUG] [LOCAL ] PAR: Loaded 23807 existing records from primary storage. [2025-09-16T19:52:38.790121] [INFO ] [MAIN ] PAR: Loaded 23807 existing records. [2025-09-16T19:52:38.970534] [WARN ] [MAIN ] PAR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:52:38.970837] [INFO ] [MAIN ] PAR: Wiping existing primary data before full refresh. [2025-09-16T19:52:38.970883] [INFO ] [LOCAL ] PAR: Starting deletion of primary data. [2025-09-16T19:52:38.971578] [DEBUG] [LOCAL ] PAR: Deleted primary data file. [2025-09-16T19:52:38.971628] [INFO ] [MAIN ] PAR: Starting full primary refresh. [2025-09-16T19:52:39.325049] [INFO ] [REMOTE ] PAR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:52:39.574927] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-04. [2025-09-16T19:52:40.379664] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-04. [2025-09-16T19:52:40.382539] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-16T19:52:40.412120] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-16T19:52:41.174921] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-07. [2025-09-16T19:52:41.412104] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-16T19:52:41.974917] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-02. [2025-09-16T19:52:42.774866] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-05. [2025-09-16T19:52:42.997275] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-16T19:52:43.229290] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-16T19:52:43.269731] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-16T19:52:43.574940] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-08. [2025-09-16T19:52:44.374918] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-05. [2025-09-16T19:52:45.028868] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-16T19:52:45.174870] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-09. [2025-09-16T19:52:45.494584] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-16T19:52:45.974895] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-06. [2025-09-16T19:52:46.750739] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-16T19:52:46.757069] [INFO ] [REMOTE ] PAGS: Full fetch complete (57235 records). [2025-09-16T19:52:46.757180] [DEBUG] [VALIDATOR ] PAGS: Validating primary data. [2025-09-16T19:52:46.780110] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-03. [2025-09-16T19:52:47.126629] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-16T19:52:47.163529] [DEBUG] [VALIDATOR ] PAGS: All expected trading days are present. [2025-09-16T19:52:47.163886] [DEBUG] [VALIDATOR ] PAGS: Primary data validation passed. [2025-09-16T19:52:47.164771] [INFO ] [MAIN ] PAGS: Fetched primary data is valid. [2025-09-16T19:52:47.164817] [DEBUG] [LOCAL ] PAGS: Saving primary data. [2025-09-16T19:52:47.165892] [DEBUG] [LOCAL ] PAGS: Trimmed 57235 records to 39351 (keeping 150 days of data) [2025-09-16T19:52:47.404956] [DEBUG] [LOCAL ] PAGS: Primary data saved (39351 records). [2025-09-16T19:52:47.405097] [INFO ] [MAIN ] PAGS: Full history saved. [2025-09-16T19:52:47.405178] [INFO ] [MAIN ] Update Progress: 1627/2369 symbols completed. PAGS took 32.0s. Estimated remaining: 1h 18m 47s. Rate: 9.4 symbols/min [2025-09-16T19:52:47.574044] [INFO ] [MAIN ] PARR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:52:47.574988] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-07. [2025-09-16T19:52:47.609257] [DEBUG] [LOCAL ] PARR: Loaded 35558 existing records from primary storage. [2025-09-16T19:52:47.609396] [INFO ] [MAIN ] PARR: Loaded 35558 existing records. [2025-09-16T19:52:47.784575] [WARN ] [MAIN ] PARR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:52:47.784860] [INFO ] [MAIN ] PARR: Wiping existing primary data before full refresh. [2025-09-16T19:52:47.784925] [INFO ] [LOCAL ] PARR: Starting deletion of primary data. [2025-09-16T19:52:47.785716] [DEBUG] [LOCAL ] PARR: Deleted primary data file. [2025-09-16T19:52:47.785767] [INFO ] [MAIN ] PARR: Starting full primary refresh. [2025-09-16T19:52:48.139114] [INFO ] [REMOTE ] PARR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:52:48.215880] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-16T19:52:48.374867] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-02. [2025-09-16T19:52:48.824778] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-16T19:52:49.174902] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-08. [2025-09-16T19:52:49.924881] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-16T19:52:49.974847] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-03. [2025-09-16T19:52:50.005483] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-16T19:52:50.774946] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-09. [2025-09-16T19:52:51.574941] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-04. [2025-09-16T19:52:51.630559] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-16T19:52:52.107154] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-16T19:52:52.112096] [INFO ] [REMOTE ] PAM: Full fetch complete (30092 records). [2025-09-16T19:52:52.112176] [DEBUG] [VALIDATOR ] PAM: Validating primary data. [2025-09-16T19:52:52.383940] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-04. [2025-09-16T19:52:52.480223] [DEBUG] [VALIDATOR ] PAM: All expected trading days are present. [2025-09-16T19:52:52.480297] [DEBUG] [VALIDATOR ] PAM: Primary data validation passed. [2025-09-16T19:52:52.480935] [INFO ] [MAIN ] PAM: Fetched primary data is valid. [2025-09-16T19:52:52.480981] [DEBUG] [LOCAL ] PAM: Saving primary data. [2025-09-16T19:52:52.481772] [DEBUG] [LOCAL ] PAM: Trimmed 30092 records to 20264 (keeping 150 days of data) [2025-09-16T19:52:52.617173] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-16T19:52:52.631696] [DEBUG] [LOCAL ] PAM: Primary data saved (20264 records). [2025-09-16T19:52:52.631807] [INFO ] [MAIN ] PAM: Full history saved. [2025-09-16T19:52:52.631883] [INFO ] [MAIN ] Update Progress: 1628/2369 symbols completed. PAM took 19.4s. Estimated remaining: 1h 18m 40s. Rate: 9.4 symbols/min [2025-09-16T19:52:52.800074] [INFO ] [MAIN ] PATH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:52:52.841170] [DEBUG] [LOCAL ] PATH: Loaded 39645 existing records from primary storage. [2025-09-16T19:52:52.841329] [INFO ] [MAIN ] PATH: Loaded 39645 existing records. [2025-09-16T19:52:53.018607] [WARN ] [MAIN ] PATH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:52:53.018845] [INFO ] [MAIN ] PATH: Wiping existing primary data before full refresh. [2025-09-16T19:52:53.018889] [INFO ] [LOCAL ] PATH: Starting deletion of primary data. [2025-09-16T19:52:53.019829] [DEBUG] [LOCAL ] PATH: Deleted primary data file. [2025-09-16T19:52:53.019906] [INFO ] [MAIN ] PATH: Starting full primary refresh. [2025-09-16T19:52:53.176858] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-05. [2025-09-16T19:52:53.370374] [INFO ] [REMOTE ] PATH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:52:53.974916] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-02. [2025-09-16T19:52:54.140604] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-16T19:52:54.586474] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-16T19:52:54.774907] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-06. [2025-09-16T19:52:55.574898] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-06. [2025-09-16T19:52:55.792580] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-16T19:52:55.956512] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-16T19:52:56.071494] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-16T19:52:56.374918] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-07. [2025-09-16T19:52:56.828182] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-16T19:52:57.174924] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-05. [2025-09-16T19:52:57.974925] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-03. [2025-09-16T19:52:58.779986] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-07. [2025-09-16T19:52:58.801612] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-16T19:52:59.574958] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-06. [2025-09-16T19:53:00.133457] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-16T19:53:00.374904] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-08. [2025-09-16T19:53:00.421544] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-09-16T19:53:00.934188] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-16T19:53:01.038703] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-16T19:53:01.174907] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-08. [2025-09-16T19:53:01.974911] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-04. [2025-09-16T19:53:02.545196] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-16T19:53:02.774950] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-09. [2025-09-16T19:53:03.574943] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-07. [2025-09-16T19:53:03.934570] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-16T19:53:04.268869] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-16T19:53:04.273963] [INFO ] [REMOTE ] PAR: Full fetch complete (35321 records). [2025-09-16T19:53:04.274096] [DEBUG] [VALIDATOR ] PAR: Validating primary data. [2025-09-16T19:53:04.375112] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-09. [2025-09-16T19:53:04.667491] [DEBUG] [VALIDATOR ] PAR: All expected trading days are present. [2025-09-16T19:53:04.667570] [DEBUG] [VALIDATOR ] PAR: Primary data validation passed. [2025-09-16T19:53:04.668265] [INFO ] [MAIN ] PAR: Fetched primary data is valid. [2025-09-16T19:53:04.668309] [DEBUG] [LOCAL ] PAR: Saving primary data. [2025-09-16T19:53:04.669067] [DEBUG] [LOCAL ] PAR: Trimmed 35321 records to 24137 (keeping 150 days of data) [2025-09-16T19:53:04.807753] [DEBUG] [LOCAL ] PAR: Primary data saved (24137 records). [2025-09-16T19:53:04.807881] [INFO ] [MAIN ] PAR: Full history saved. [2025-09-16T19:53:04.807964] [INFO ] [MAIN ] Update Progress: 1629/2369 symbols completed. PAR took 26.2s. Estimated remaining: 1h 18m 36s. Rate: 9.4 symbols/min [2025-09-16T19:53:04.976518] [INFO ] [MAIN ] PAXS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:53:04.992583] [DEBUG] [LOCAL ] PAXS: Loaded 15712 existing records from primary storage. [2025-09-16T19:53:04.992729] [INFO ] [MAIN ] PAXS: Loaded 15712 existing records. [2025-09-16T19:53:05.109356] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-16T19:53:05.152338] [INFO ] [REMOTE ] PAI: Full fetch complete (2980 records). [2025-09-16T19:53:05.177385] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-05. [2025-09-16T19:53:05.183777] [WARN ] [MAIN ] PAXS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:53:05.184958] [DEBUG] [VALIDATOR ] PAI: Validating primary data. [2025-09-16T19:53:05.190921] [INFO ] [MAIN ] PAXS: Wiping existing primary data before full refresh. [2025-09-16T19:53:05.206238] [INFO ] [LOCAL ] PAXS: Starting deletion of primary data. [2025-09-16T19:53:05.277304] [DEBUG] [LOCAL ] PAXS: Deleted primary data file. [2025-09-16T19:53:05.284859] [INFO ] [MAIN ] PAXS: Starting full primary refresh. [2025-09-16T19:53:05.395613] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-16T19:53:05.878124] [DEBUG] [VALIDATOR ] PAI: All expected trading days are present. [2025-09-16T19:53:05.878260] [DEBUG] [VALIDATOR ] PAI: Primary data validation passed. [2025-09-16T19:53:05.878547] [INFO ] [MAIN ] PAI: Fetched primary data is valid. [2025-09-16T19:53:05.883898] [DEBUG] [LOCAL ] PAI: Saving primary data. [2025-09-16T19:53:05.919490] [DEBUG] [LOCAL ] PAI: Trimmed 2980 records to 2013 (keeping 150 days of data) [2025-09-16T19:53:05.955883] [INFO ] [REMOTE ] PAXS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:53:05.968251] [DEBUG] [LOCAL ] PAI: Primary data saved (2013 records). [2025-09-16T19:53:05.968314] [INFO ] [MAIN ] PAI: Full history saved. [2025-09-16T19:53:05.968387] [INFO ] [MAIN ] Update Progress: 1630/2369 symbols completed. PAI took 45.4s. Estimated remaining: 1h 18m 27s. Rate: 9.4 symbols/min [2025-09-16T19:53:05.980866] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-02. [2025-09-16T19:53:06.137239] [INFO ] [MAIN ] PAY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:53:06.164905] [DEBUG] [LOCAL ] PAY: Loaded 28375 existing records from primary storage. [2025-09-16T19:53:06.165069] [INFO ] [MAIN ] PAY: Loaded 28375 existing records. [2025-09-16T19:53:06.339009] [WARN ] [MAIN ] PAY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:53:06.339201] [INFO ] [MAIN ] PAY: Wiping existing primary data before full refresh. [2025-09-16T19:53:06.339247] [INFO ] [LOCAL ] PAY: Starting deletion of primary data. [2025-09-16T19:53:06.339907] [DEBUG] [LOCAL ] PAY: Deleted primary data file. [2025-09-16T19:53:06.339955] [INFO ] [MAIN ] PAY: Starting full primary refresh. [2025-09-16T19:53:06.686589] [INFO ] [REMOTE ] PAY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:53:06.774850] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-02. [2025-09-16T19:53:07.011977] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-16T19:53:07.427537] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-09-16T19:53:07.574920] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-08. [2025-09-16T19:53:08.218991] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-16T19:53:08.374947] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-03. [2025-09-16T19:53:08.914202] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-16T19:53:09.174887] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-03. [2025-09-16T19:53:09.520351] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-16T19:53:09.974882] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-06. [2025-09-16T19:53:10.179522] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-16T19:53:10.774963] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-04. [2025-09-16T19:53:11.574907] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-09. [2025-09-16T19:53:12.179745] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-16T19:53:12.336347] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-09-16T19:53:12.374862] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-07. [2025-09-16T19:53:13.146184] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-16T19:53:13.152091] [INFO ] [REMOTE ] PARR: Full fetch complete (52636 records). [2025-09-16T19:53:13.152184] [DEBUG] [VALIDATOR ] PARR: Validating primary data. [2025-09-16T19:53:13.183583] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-05. [2025-09-16T19:53:13.527032] [DEBUG] [VALIDATOR ] PARR: All expected trading days are present. [2025-09-16T19:53:13.527109] [DEBUG] [VALIDATOR ] PARR: Primary data validation passed. [2025-09-16T19:53:13.527940] [INFO ] [MAIN ] PARR: Fetched primary data is valid. [2025-09-16T19:53:13.527985] [DEBUG] [LOCAL ] PARR: Saving primary data. [2025-09-16T19:53:13.530179] [DEBUG] [LOCAL ] PARR: Trimmed 52636 records to 35926 (keeping 150 days of data) [2025-09-16T19:53:13.740776] [DEBUG] [LOCAL ] PARR: Primary data saved (35926 records). [2025-09-16T19:53:13.740912] [INFO ] [MAIN ] PARR: Full history saved. [2025-09-16T19:53:13.740991] [INFO ] [MAIN ] Update Progress: 1631/2369 symbols completed. PARR took 26.3s. Estimated remaining: 1h 18m 22s. Rate: 9.4 symbols/min [2025-09-16T19:53:13.912978] [INFO ] [MAIN ] PAYC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:53:13.937759] [DEBUG] [LOCAL ] PAYC: Loaded 26059 existing records from primary storage. [2025-09-16T19:53:13.937884] [INFO ] [MAIN ] PAYC: Loaded 26059 existing records. [2025-09-16T19:53:13.980558] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-04. [2025-09-16T19:53:14.115582] [WARN ] [MAIN ] PAYC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:53:14.115977] [INFO ] [MAIN ] PAYC: Wiping existing primary data before full refresh. [2025-09-16T19:53:14.116116] [INFO ] [LOCAL ] PAYC: Starting deletion of primary data. [2025-09-16T19:53:14.116783] [DEBUG] [LOCAL ] PAYC: Deleted primary data file. [2025-09-16T19:53:14.116835] [INFO ] [MAIN ] PAYC: Starting full primary refresh. [2025-09-16T19:53:14.395102] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-16T19:53:14.558077] [INFO ] [REMOTE ] PAYC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:53:14.585748] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-16T19:53:14.774895] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-02. [2025-09-16T19:53:15.108637] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-16T19:53:15.574905] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-06. [2025-09-16T19:53:16.205056] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-16T19:53:16.374886] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-03. [2025-09-16T19:53:16.885905] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-16T19:53:17.174899] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-08. [2025-09-16T19:53:17.937274] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-16T19:53:17.974980] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-05. [2025-09-16T19:53:18.777933] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-04. [2025-09-16T19:53:18.780017] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-16T19:53:19.383369] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-16T19:53:19.574911] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-07. [2025-09-16T19:53:20.217966] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-16T19:53:20.374896] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-05. [2025-09-16T19:53:20.928083] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-16T19:53:21.174912] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-09. [2025-09-16T19:53:21.836597] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-16T19:53:21.974882] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-06. [2025-09-16T19:53:22.774910] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-06. [2025-09-16T19:53:23.234396] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-16T19:53:23.291826] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-16T19:53:23.298262] [INFO ] [REMOTE ] PATH: Full fetch complete (58357 records). [2025-09-16T19:53:23.298384] [DEBUG] [VALIDATOR ] PATH: Validating primary data. [2025-09-16T19:53:23.579973] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-08. [2025-09-16T19:53:23.699878] [DEBUG] [VALIDATOR ] PATH: All expected trading days are present. [2025-09-16T19:53:23.700406] [DEBUG] [VALIDATOR ] PATH: Primary data validation passed. [2025-09-16T19:53:23.700991] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-16T19:53:23.702030] [INFO ] [MAIN ] PATH: Fetched primary data is valid. [2025-09-16T19:53:23.706574] [DEBUG] [LOCAL ] PATH: Saving primary data. [2025-09-16T19:53:23.707874] [DEBUG] [LOCAL ] PATH: Trimmed 58357 records to 40034 (keeping 150 days of data) [2025-09-16T19:53:23.959520] [DEBUG] [LOCAL ] PATH: Primary data saved (40034 records). [2025-09-16T19:53:23.959885] [INFO ] [MAIN ] PATH: Full history saved. [2025-09-16T19:53:23.960038] [INFO ] [MAIN ] Update Progress: 1632/2369 symbols completed. PATH took 31.3s. Estimated remaining: 1h 18m 17s. Rate: 9.4 symbols/min [2025-09-16T19:53:24.132753] [INFO ] [MAIN ] PB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:53:24.162596] [DEBUG] [LOCAL ] PB: Loaded 30715 existing records from primary storage. [2025-09-16T19:53:24.162773] [INFO ] [MAIN ] PB: Loaded 30715 existing records. [2025-09-16T19:53:24.342156] [WARN ] [MAIN ] PB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:53:24.342424] [INFO ] [MAIN ] PB: Wiping existing primary data before full refresh. [2025-09-16T19:53:24.342470] [INFO ] [LOCAL ] PB: Starting deletion of primary data. [2025-09-16T19:53:24.343264] [DEBUG] [LOCAL ] PB: Deleted primary data file. [2025-09-16T19:53:24.343336] [INFO ] [MAIN ] PB: Starting full primary refresh. [2025-09-16T19:53:24.379955] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-07. [2025-09-16T19:53:24.709488] [INFO ] [REMOTE ] PB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:53:25.174883] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-07. [2025-09-16T19:53:25.276835] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-16T19:53:25.887950] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-16T19:53:25.974855] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-08. [2025-09-16T19:53:26.395795] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-16T19:53:26.774918] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-09. [2025-09-16T19:53:27.349890] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-16T19:53:27.574893] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-08. [2025-09-16T19:53:28.018407] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-16T19:53:28.023862] [INFO ] [REMOTE ] PAY: Full fetch complete (40870 records). [2025-09-16T19:53:28.024086] [DEBUG] [VALIDATOR ] PAY: Validating primary data. [2025-09-16T19:53:28.380415] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-02. [2025-09-16T19:53:28.557702] [DEBUG] [VALIDATOR ] PAY: All expected trading days are present. [2025-09-16T19:53:28.557810] [DEBUG] [VALIDATOR ] PAY: Primary data validation passed. [2025-09-16T19:53:28.558956] [INFO ] [MAIN ] PAY: Fetched primary data is valid. [2025-09-16T19:53:28.559058] [DEBUG] [LOCAL ] PAY: Saving primary data. [2025-09-16T19:53:28.560558] [DEBUG] [LOCAL ] PAY: Trimmed 40870 records to 28642 (keeping 150 days of data) [2025-09-16T19:53:28.576965] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-16T19:53:28.810932] [DEBUG] [LOCAL ] PAY: Primary data saved (28642 records). [2025-09-16T19:53:28.811105] [INFO ] [MAIN ] PAY: Full history saved. [2025-09-16T19:53:28.811226] [INFO ] [MAIN ] Update Progress: 1633/2369 symbols completed. PAY took 22.8s. Estimated remaining: 1h 18m 10s. Rate: 9.4 symbols/min [2025-09-16T19:53:28.985899] [INFO ] [MAIN ] PBA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:53:29.023895] [DEBUG] [LOCAL ] PBA: Loaded 36207 existing records from primary storage. [2025-09-16T19:53:29.024059] [INFO ] [MAIN ] PBA: Loaded 36207 existing records. [2025-09-16T19:53:29.180891] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-09. [2025-09-16T19:53:29.201694] [WARN ] [MAIN ] PBA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:53:29.201978] [INFO ] [MAIN ] PBA: Wiping existing primary data before full refresh. [2025-09-16T19:53:29.202046] [INFO ] [LOCAL ] PBA: Starting deletion of primary data. [2025-09-16T19:53:29.202990] [DEBUG] [LOCAL ] PBA: Deleted primary data file. [2025-09-16T19:53:29.203057] [INFO ] [MAIN ] PBA: Starting full primary refresh. [2025-09-16T19:53:29.561192] [INFO ] [REMOTE ] PBA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:53:29.583571] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-16T19:53:29.974927] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-03. [2025-09-16T19:53:30.584479] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-16T19:53:30.589109] [INFO ] [REMOTE ] PAYC: Full fetch complete (39885 records). [2025-09-16T19:53:30.589202] [DEBUG] [VALIDATOR ] PAYC: Validating primary data. [2025-09-16T19:53:30.790569] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-09. [2025-09-16T19:53:30.992797] [DEBUG] [VALIDATOR ] PAYC: All expected trading days are present. [2025-09-16T19:53:30.992876] [DEBUG] [VALIDATOR ] PAYC: Primary data validation passed. [2025-09-16T19:53:30.993742] [INFO ] [MAIN ] PAYC: Fetched primary data is valid. [2025-09-16T19:53:30.993787] [DEBUG] [LOCAL ] PAYC: Saving primary data. [2025-09-16T19:53:30.994691] [DEBUG] [LOCAL ] PAYC: Trimmed 39885 records to 26339 (keeping 150 days of data) [2025-09-16T19:53:31.164129] [DEBUG] [LOCAL ] PAYC: Primary data saved (26339 records). [2025-09-16T19:53:31.164274] [INFO ] [MAIN ] PAYC: Full history saved. [2025-09-16T19:53:31.164379] [INFO ] [MAIN ] Update Progress: 1634/2369 symbols completed. PAYC took 17.4s. Estimated remaining: 1h 18m 2s. Rate: 9.4 symbols/min [2025-09-16T19:53:31.332129] [INFO ] [MAIN ] PBF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:53:31.367734] [DEBUG] [LOCAL ] PBF: Loaded 39234 existing records from primary storage. [2025-09-16T19:53:31.367880] [INFO ] [MAIN ] PBF: Loaded 39234 existing records. [2025-09-16T19:53:31.546592] [WARN ] [MAIN ] PBF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:53:31.546996] [INFO ] [MAIN ] PBF: Wiping existing primary data before full refresh. [2025-09-16T19:53:31.547066] [INFO ] [LOCAL ] PBF: Starting deletion of primary data. [2025-09-16T19:53:31.548184] [DEBUG] [LOCAL ] PBF: Deleted primary data file. [2025-09-16T19:53:31.548237] [INFO ] [MAIN ] PBF: Starting full primary refresh. [2025-09-16T19:53:31.579511] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-02. [2025-09-16T19:53:31.732083] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-16T19:53:31.785065] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-16T19:53:31.838169] [INFO ] [REMOTE ] PAXS: Full fetch complete (22435 records). [2025-09-16T19:53:31.843494] [DEBUG] [VALIDATOR ] PAXS: Validating primary data. [2025-09-16T19:53:32.083301] [INFO ] [REMOTE ] PBF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:53:32.316585] [DEBUG] [VALIDATOR ] PAXS: All expected trading days are present. [2025-09-16T19:53:32.316680] [DEBUG] [VALIDATOR ] PAXS: Primary data validation passed. [2025-09-16T19:53:32.317230] [INFO ] [MAIN ] PAXS: Fetched primary data is valid. [2025-09-16T19:53:32.317271] [DEBUG] [LOCAL ] PAXS: Saving primary data. [2025-09-16T19:53:32.317890] [DEBUG] [LOCAL ] PAXS: Trimmed 22435 records to 15865 (keeping 150 days of data) [2025-09-16T19:53:32.389666] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-04. [2025-09-16T19:53:32.417380] [DEBUG] [LOCAL ] PAXS: Primary data saved (15865 records). [2025-09-16T19:53:32.417876] [INFO ] [MAIN ] PAXS: Full history saved. [2025-09-16T19:53:32.417975] [INFO ] [MAIN ] Update Progress: 1635/2369 symbols completed. PAXS took 27.6s. Estimated remaining: 1h 17m 53s. Rate: 9.4 symbols/min [2025-09-16T19:53:32.590285] [INFO ] [MAIN ] PBH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:53:32.616051] [DEBUG] [LOCAL ] PBH: Loaded 23652 existing records from primary storage. [2025-09-16T19:53:32.616208] [INFO ] [MAIN ] PBH: Loaded 23652 existing records. [2025-09-16T19:53:32.797030] [WARN ] [MAIN ] PBH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:53:32.797308] [INFO ] [MAIN ] PBH: Wiping existing primary data before full refresh. [2025-09-16T19:53:32.797355] [INFO ] [LOCAL ] PBH: Starting deletion of primary data. [2025-09-16T19:53:32.797909] [DEBUG] [LOCAL ] PBH: Deleted primary data file. [2025-09-16T19:53:32.797981] [INFO ] [MAIN ] PBH: Starting full primary refresh. [2025-09-16T19:53:33.152695] [INFO ] [REMOTE ] PBH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:53:33.174848] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-02. [2025-09-16T19:53:33.241299] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-16T19:53:33.786414] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-16T19:53:33.974943] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-05. [2025-09-16T19:53:34.128432] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-16T19:53:34.774920] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-02. [2025-09-16T19:53:35.466113] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-16T19:53:35.574908] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-03. [2025-09-16T19:53:35.987820] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-16T19:53:36.374919] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-03. [2025-09-16T19:53:36.727901] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-16T19:53:37.174919] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-04. [2025-09-16T19:53:37.974936] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-03. [2025-09-16T19:53:38.179461] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-16T19:53:38.468942] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-16T19:53:38.774896] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-04. [2025-09-16T19:53:39.170724] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-16T19:53:39.574977] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-04. [2025-09-16T19:53:40.374903] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-06. [2025-09-16T19:53:40.428923] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-16T19:53:41.111767] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-16T19:53:41.174909] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-05. [2025-09-16T19:53:41.822732] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-16T19:53:41.974893] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-07. [2025-09-16T19:53:42.774970] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-05. [2025-09-16T19:53:42.903203] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-16T19:53:43.574972] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-06. [2025-09-16T19:53:43.631483] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-16T19:53:44.382616] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-08. [2025-09-16T19:53:44.389524] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-16T19:53:44.867686] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-16T19:53:45.174895] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-05. [2025-09-16T19:53:45.853460] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-16T19:53:45.974878] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-09. [2025-09-16T19:53:46.520207] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-16T19:53:46.774914] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-06. [2025-09-16T19:53:47.574956] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-06. [2025-09-16T19:53:47.600153] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-16T19:53:47.609560] [INFO ] [REMOTE ] PB: Full fetch complete (44428 records). [2025-09-16T19:53:47.609795] [DEBUG] [VALIDATOR ] PB: Validating primary data. [2025-09-16T19:53:47.981930] [DEBUG] [VALIDATOR ] PB: All expected trading days are present. [2025-09-16T19:53:47.982012] [DEBUG] [VALIDATOR ] PB: Primary data validation passed. [2025-09-16T19:53:47.982819] [INFO ] [MAIN ] PB: Fetched primary data is valid. [2025-09-16T19:53:47.982878] [DEBUG] [LOCAL ] PB: Saving primary data. [2025-09-16T19:53:47.983845] [DEBUG] [LOCAL ] PB: Trimmed 44428 records to 31070 (keeping 150 days of data) [2025-09-16T19:53:48.176208] [DEBUG] [LOCAL ] PB: Primary data saved (31070 records). [2025-09-16T19:53:48.176341] [INFO ] [MAIN ] PB: Full history saved. [2025-09-16T19:53:48.176425] [INFO ] [MAIN ] Update Progress: 1636/2369 symbols completed. PB took 24.2s. Estimated remaining: 1h 17m 51s. Rate: 9.4 symbols/min [2025-09-16T19:53:48.346032] [INFO ] [MAIN ] PBI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:53:48.385826] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-07. [2025-09-16T19:53:48.388583] [DEBUG] [LOCAL ] PBI: Loaded 36793 existing records from primary storage. [2025-09-16T19:53:48.388696] [INFO ] [MAIN ] PBI: Loaded 36793 existing records. [2025-09-16T19:53:48.570421] [WARN ] [MAIN ] PBI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:53:48.570817] [INFO ] [MAIN ] PBI: Wiping existing primary data before full refresh. [2025-09-16T19:53:48.570887] [INFO ] [LOCAL ] PBI: Starting deletion of primary data. [2025-09-16T19:53:48.571908] [DEBUG] [LOCAL ] PBI: Deleted primary data file. [2025-09-16T19:53:48.571969] [INFO ] [MAIN ] PBI: Starting full primary refresh. [2025-09-16T19:53:48.835123] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-16T19:53:48.987936] [INFO ] [REMOTE ] PBI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:53:49.003270] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-16T19:53:49.174886] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-07. [2025-09-16T19:53:49.974942] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-02. [2025-09-16T19:53:50.206399] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-16T19:53:50.530086] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-16T19:53:50.774939] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-07. [2025-09-16T19:53:51.306009] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-16T19:53:51.575000] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-08. [2025-09-16T19:53:52.374912] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-03. [2025-09-16T19:53:52.615697] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-16T19:53:53.174897] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-08. [2025-09-16T19:53:53.274433] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-16T19:53:53.974912] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-09. [2025-09-16T19:53:54.114554] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-16T19:53:54.774987] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-08. [2025-09-16T19:53:55.037313] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-16T19:53:55.210407] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-16T19:53:55.217037] [INFO ] [REMOTE ] PBA: Full fetch complete (53552 records). [2025-09-16T19:53:55.217235] [DEBUG] [VALIDATOR ] PBA: Validating primary data. [2025-09-16T19:53:55.586044] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-09. [2025-09-16T19:53:55.605216] [DEBUG] [VALIDATOR ] PBA: All expected trading days are present. [2025-09-16T19:53:55.605314] [DEBUG] [VALIDATOR ] PBA: Primary data validation passed. [2025-09-16T19:53:55.606408] [INFO ] [MAIN ] PBA: Fetched primary data is valid. [2025-09-16T19:53:55.606468] [DEBUG] [LOCAL ] PBA: Saving primary data. [2025-09-16T19:53:55.607729] [DEBUG] [LOCAL ] PBA: Trimmed 53552 records to 36557 (keeping 150 days of data) [2025-09-16T19:53:55.835821] [DEBUG] [LOCAL ] PBA: Primary data saved (36557 records). [2025-09-16T19:53:55.835969] [INFO ] [MAIN ] PBA: Full history saved. [2025-09-16T19:53:55.837621] [INFO ] [MAIN ] Update Progress: 1637/2369 symbols completed. PBA took 27.0s. Estimated remaining: 1h 17m 45s. Rate: 9.4 symbols/min [2025-09-16T19:53:56.220295] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-16T19:53:56.374933] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-09. [2025-09-16T19:53:57.174955] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-04. [2025-09-16T19:53:57.283043] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-16T19:53:57.289504] [INFO ] [REMOTE ] PBF: Full fetch complete (57705 records). [2025-09-16T19:53:57.289615] [DEBUG] [VALIDATOR ] PBF: Validating primary data. [2025-09-16T19:53:57.684878] [DEBUG] [VALIDATOR ] PBF: All expected trading days are present. [2025-09-16T19:53:57.684959] [DEBUG] [VALIDATOR ] PBF: Primary data validation passed. [2025-09-16T19:53:57.685857] [INFO ] [MAIN ] PBF: Fetched primary data is valid. [2025-09-16T19:53:57.685902] [DEBUG] [LOCAL ] PBF: Saving primary data. [2025-09-16T19:53:57.687074] [DEBUG] [LOCAL ] PBF: Trimmed 57705 records to 39624 (keeping 150 days of data) [2025-09-16T19:53:57.805953] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-16T19:53:57.813200] [INFO ] [REMOTE ] PBH: Full fetch complete (33594 records). [2025-09-16T19:53:57.814627] [DEBUG] [VALIDATOR ] PBH: Validating primary data. [2025-09-16T19:53:58.302709] [DEBUG] [VALIDATOR ] PBH: All expected trading days are present. [2025-09-16T19:53:58.305534] [DEBUG] [VALIDATOR ] PBH: Primary data validation passed. [2025-09-16T19:53:58.310253] [INFO ] [MAIN ] PBH: Fetched primary data is valid. [2025-09-16T19:53:58.310885] [DEBUG] [LOCAL ] PBH: Saving primary data. [2025-09-16T19:53:58.317633] [DEBUG] [LOCAL ] PBH: Trimmed 33594 records to 23938 (keeping 150 days of data) [2025-09-16T19:53:58.436552] [DEBUG] [LOCAL ] PBF: Primary data saved (39624 records). [2025-09-16T19:53:58.439930] [INFO ] [MAIN ] PBF: Full history saved. [2025-09-16T19:53:58.442791] [INFO ] [MAIN ] Update Progress: 1638/2369 symbols completed. PBF took 27.3s. Estimated remaining: 1h 17m 37s. Rate: 9.4 symbols/min [2025-09-16T19:53:58.476806] [DEBUG] [LOCAL ] PBH: Primary data saved (23938 records). [2025-09-16T19:53:58.476920] [INFO ] [MAIN ] PBH: Full history saved. [2025-09-16T19:53:58.477002] [INFO ] [MAIN ] Update Progress: 1639/2369 symbols completed. PBH took 26.1s. Estimated remaining: 1h 17m 28s. Rate: 9.4 symbols/min [2025-09-16T19:53:58.903604] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-16T19:53:58.914744] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-05. [2025-09-16T19:54:00.606239] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-16T19:54:00.616606] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-06. [2025-09-16T19:54:02.351715] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-16T19:54:02.363028] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-07. [2025-09-16T19:54:04.201200] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-16T19:54:04.212321] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-08. [2025-09-16T19:54:05.790744] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-16T19:54:05.801439] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-09. [2025-09-16T19:54:07.186354] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-16T19:54:07.192415] [INFO ] [REMOTE ] PBI: Full fetch complete (54767 records). [2025-09-16T19:54:07.192527] [DEBUG] [VALIDATOR ] PBI: Validating primary data. [2025-09-16T19:54:07.593725] [DEBUG] [VALIDATOR ] PBI: All expected trading days are present. [2025-09-16T19:54:07.593851] [DEBUG] [VALIDATOR ] PBI: Primary data validation passed. [2025-09-16T19:54:07.595012] [INFO ] [MAIN ] PBI: Fetched primary data is valid. [2025-09-16T19:54:07.595156] [DEBUG] [LOCAL ] PBI: Saving primary data. [2025-09-16T19:54:07.596783] [DEBUG] [LOCAL ] PBI: Trimmed 54767 records to 37127 (keeping 150 days of data) [2025-09-16T19:54:07.852587] [DEBUG] [LOCAL ] PBI: Primary data saved (37127 records). [2025-09-16T19:54:07.852762] [INFO ] [MAIN ] PBI: Full history saved. [2025-09-16T19:54:07.852864] [INFO ] [MAIN ] Update Progress: 1640/2369 symbols completed. PBI took 19.7s. Estimated remaining: 1h 17m 23s. Rate: 9.4 symbols/min [2025-09-16T19:54:08.411236] [INFO ] [MAIN ] PBR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:54:08.510441] [INFO ] [MAIN ] PCG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:54:08.488273] [INFO ] [MAIN ] PBT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:54:08.572822] [INFO ] [MAIN ] PCF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:54:08.584573] [DEBUG] [LOCAL ] PCF: Loaded 6537 existing records from primary storage. [2025-09-16T19:54:08.586363] [INFO ] [MAIN ] PCF: Loaded 6537 existing records. [2025-09-16T19:54:08.605410] [DEBUG] [LOCAL ] PBT: Loaded 13303 existing records from primary storage. [2025-09-16T19:54:08.613308] [INFO ] [MAIN ] PBT: Loaded 13303 existing records. [2025-09-16T19:54:08.951170] [DEBUG] [LOCAL ] PBR: Loaded 39681 existing records from primary storage. [2025-09-16T19:54:08.945984] [DEBUG] [LOCAL ] PCG: Loaded 39679 existing records from primary storage. [2025-09-16T19:54:08.988012] [INFO ] [MAIN ] PBR: Loaded 39681 existing records. [2025-09-16T19:54:08.994990] [INFO ] [MAIN ] PCG: Loaded 39679 existing records. [2025-09-16T19:54:08.954128] [WARN ] [MAIN ] PCF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:54:09.025754] [WARN ] [MAIN ] PBT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:54:09.083404] [INFO ] [MAIN ] PBT: Wiping existing primary data before full refresh. [2025-09-16T19:54:09.078218] [INFO ] [MAIN ] PCF: Wiping existing primary data before full refresh. [2025-09-16T19:54:09.121268] [INFO ] [LOCAL ] PCF: Starting deletion of primary data. [2025-09-16T19:54:09.121432] [INFO ] [LOCAL ] PBT: Starting deletion of primary data. [2025-09-16T19:54:09.143773] [DEBUG] [LOCAL ] PCF: Deleted primary data file. [2025-09-16T19:54:09.189935] [DEBUG] [LOCAL ] PBT: Deleted primary data file. [2025-09-16T19:54:09.198939] [INFO ] [MAIN ] PCF: Starting full primary refresh. [2025-09-16T19:54:09.204163] [INFO ] [MAIN ] PBT: Starting full primary refresh. [2025-09-16T19:54:09.555497] [WARN ] [MAIN ] PCG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:54:09.560869] [WARN ] [MAIN ] PBR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:54:09.578975] [INFO ] [MAIN ] PCG: Wiping existing primary data before full refresh. [2025-09-16T19:54:09.605143] [INFO ] [MAIN ] PBR: Wiping existing primary data before full refresh. [2025-09-16T19:54:09.599923] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-09-16T19:54:09.635334] [INFO ] [LOCAL ] PBR: Starting deletion of primary data. [2025-09-16T19:54:09.708607] [DEBUG] [LOCAL ] PCG: Deleted primary data file. [2025-09-16T19:54:09.716319] [DEBUG] [LOCAL ] PBR: Deleted primary data file. [2025-09-16T19:54:09.763786] [INFO ] [MAIN ] PCG: Starting full primary refresh. [2025-09-16T19:54:09.763738] [INFO ] [MAIN ] PBR: Starting full primary refresh. [2025-09-16T19:54:10.270335] [INFO ] [REMOTE ] PBT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:54:10.296818] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-02. [2025-09-16T19:54:10.406889] [INFO ] [REMOTE ] PCF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:54:10.481126] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-02. [2025-09-16T19:54:10.733552] [INFO ] [REMOTE ] PCG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:54:10.754293] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-02. [2025-09-16T19:54:10.804455] [INFO ] [REMOTE ] PBR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:54:10.804769] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-02. [2025-09-16T19:54:11.308058] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-16T19:54:11.311388] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-03. [2025-09-16T19:54:11.459341] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-16T19:54:11.462301] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-03. [2025-09-16T19:54:12.192015] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-16T19:54:12.199407] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-04. [2025-09-16T19:54:12.319439] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-16T19:54:12.323539] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-04. [2025-09-16T19:54:12.702302] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-16T19:54:12.712540] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-03. [2025-09-16T19:54:12.858687] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-16T19:54:12.869095] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-03. [2025-09-16T19:54:12.900094] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-16T19:54:12.902733] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-05. [2025-09-16T19:54:13.363530] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-16T19:54:13.367321] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-05. [2025-09-16T19:54:13.375867] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-16T19:54:13.379091] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-06. [2025-09-16T19:54:14.213041] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-16T19:54:14.215500] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-07. [2025-09-16T19:54:14.237789] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-16T19:54:14.241762] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-06. [2025-09-16T19:54:14.616935] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-16T19:54:14.628681] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-04. [2025-09-16T19:54:14.754492] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-16T19:54:14.774847] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-04. [2025-09-16T19:54:14.956762] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-16T19:54:15.002472] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-16T19:54:15.574919] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-07. [2025-09-16T19:54:16.388304] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-08. [2025-09-16T19:54:16.394492] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-16T19:54:16.725844] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-16T19:54:16.926397] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-16T19:54:16.960877] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-16T19:54:17.174902] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-09. [2025-09-16T19:54:17.974914] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-08. [2025-09-16T19:54:18.066444] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-16T19:54:18.068689] [INFO ] [REMOTE ] PCF: Full fetch complete (10043 records). [2025-09-16T19:54:18.068762] [DEBUG] [VALIDATOR ] PCF: Validating primary data. [2025-09-16T19:54:18.449088] [DEBUG] [VALIDATOR ] PCF: All expected trading days are present. [2025-09-16T19:54:18.449185] [DEBUG] [VALIDATOR ] PCF: Primary data validation passed. [2025-09-16T19:54:18.449514] [INFO ] [MAIN ] PCF: Fetched primary data is valid. [2025-09-16T19:54:18.449577] [DEBUG] [LOCAL ] PCF: Saving primary data. [2025-09-16T19:54:18.450073] [DEBUG] [LOCAL ] PCF: Trimmed 10043 records to 6580 (keeping 150 days of data) [2025-09-16T19:54:18.489813] [DEBUG] [LOCAL ] PCF: Primary data saved (6580 records). [2025-09-16T19:54:18.489958] [INFO ] [MAIN ] PCF: Full history saved. [2025-09-16T19:54:18.490088] [INFO ] [MAIN ] Update Progress: 1641/2369 symbols completed. PCF took 10.6s. Estimated remaining: 1h 17m 18s. Rate: 9.4 symbols/min [2025-09-16T19:54:18.680516] [INFO ] [MAIN ] PCM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:54:18.687242] [DEBUG] [LOCAL ] PCM: Loaded 4893 existing records from primary storage. [2025-09-16T19:54:18.687359] [INFO ] [MAIN ] PCM: Loaded 4893 existing records. [2025-09-16T19:54:18.781560] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-05. [2025-09-16T19:54:18.872875] [WARN ] [MAIN ] PCM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:54:18.873160] [INFO ] [MAIN ] PCM: Wiping existing primary data before full refresh. [2025-09-16T19:54:18.873209] [INFO ] [LOCAL ] PCM: Starting deletion of primary data. [2025-09-16T19:54:18.873472] [DEBUG] [LOCAL ] PCM: Deleted primary data file. [2025-09-16T19:54:18.873517] [INFO ] [MAIN ] PCM: Starting full primary refresh. [2025-09-16T19:54:19.246525] [INFO ] [REMOTE ] PCM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:54:19.260941] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-16T19:54:19.574900] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-09. [2025-09-16T19:54:20.374948] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-02. [2025-09-16T19:54:20.450753] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-16T19:54:20.454775] [INFO ] [REMOTE ] PBT: Full fetch complete (18904 records). [2025-09-16T19:54:20.454933] [DEBUG] [VALIDATOR ] PBT: Validating primary data. [2025-09-16T19:54:21.026309] [DEBUG] [VALIDATOR ] PBT: All expected trading days are present. [2025-09-16T19:54:21.026577] [DEBUG] [VALIDATOR ] PBT: Primary data validation passed. [2025-09-16T19:54:21.027210] [INFO ] [MAIN ] PBT: Fetched primary data is valid. [2025-09-16T19:54:21.044953] [DEBUG] [LOCAL ] PBT: Saving primary data. [2025-09-16T19:54:21.070366] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-09-16T19:54:21.070716] [DEBUG] [LOCAL ] PBT: Trimmed 18904 records to 13404 (keeping 150 days of data) [2025-09-16T19:54:21.180627] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-06. [2025-09-16T19:54:21.183285] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-16T19:54:21.225947] [DEBUG] [LOCAL ] PBT: Primary data saved (13404 records). [2025-09-16T19:54:21.226122] [INFO ] [MAIN ] PBT: Full history saved. [2025-09-16T19:54:21.226269] [INFO ] [MAIN ] Update Progress: 1642/2369 symbols completed. PBT took 13.4s. Estimated remaining: 1h 17m 10s. Rate: 9.4 symbols/min [2025-09-16T19:54:21.419994] [INFO ] [MAIN ] PCN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:54:21.439459] [DEBUG] [LOCAL ] PCN: Loaded 18060 existing records from primary storage. [2025-09-16T19:54:21.439588] [INFO ] [MAIN ] PCN: Loaded 18060 existing records. [2025-09-16T19:54:21.624417] [WARN ] [MAIN ] PCN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:54:21.624858] [INFO ] [MAIN ] PCN: Wiping existing primary data before full refresh. [2025-09-16T19:54:21.624916] [INFO ] [LOCAL ] PCN: Starting deletion of primary data. [2025-09-16T19:54:21.625537] [DEBUG] [LOCAL ] PCN: Deleted primary data file. [2025-09-16T19:54:21.625599] [INFO ] [MAIN ] PCN: Starting full primary refresh. [2025-09-16T19:54:21.981568] [INFO ] [REMOTE ] PCN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:54:21.978524] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-03. [2025-09-16T19:54:22.608161] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-16T19:54:22.774946] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-05. [2025-09-16T19:54:23.091012] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-16T19:54:23.574913] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-04. [2025-09-16T19:54:24.201961] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-16T19:54:24.381022] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-05. [2025-09-16T19:54:24.401554] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-16T19:54:25.044141] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-16T19:54:25.174907] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-02. [2025-09-16T19:54:25.974910] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-06. [2025-09-16T19:54:26.217160] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-16T19:54:26.774918] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-06. [2025-09-16T19:54:27.493018] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-16T19:54:27.525873] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-16T19:54:27.574893] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-07. [2025-09-16T19:54:28.374902] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-07. [2025-09-16T19:54:29.174900] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-03. [2025-09-16T19:54:29.342281] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-16T19:54:29.974946] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-08. [2025-09-16T19:54:30.193549] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-16T19:54:30.572592] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-16T19:54:30.774912] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-04. [2025-09-16T19:54:31.574901] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-08. [2025-09-16T19:54:32.018450] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-16T19:54:32.019841] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-16T19:54:32.374902] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-05. [2025-09-16T19:54:33.174861] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-09. [2025-09-16T19:54:33.264198] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-16T19:54:33.292140] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-16T19:54:33.974941] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-07. [2025-09-16T19:54:34.660214] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-16T19:54:34.774931] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-09. [2025-09-16T19:54:35.019678] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-16T19:54:35.026085] [INFO ] [REMOTE ] PCG: Full fetch complete (58398 records). [2025-09-16T19:54:35.026213] [DEBUG] [VALIDATOR ] PCG: Validating primary data. [2025-09-16T19:54:35.410858] [DEBUG] [VALIDATOR ] PCG: All expected trading days are present. [2025-09-16T19:54:35.410961] [DEBUG] [VALIDATOR ] PCG: Primary data validation passed. [2025-09-16T19:54:35.411973] [INFO ] [MAIN ] PCG: Fetched primary data is valid. [2025-09-16T19:54:35.412029] [DEBUG] [LOCAL ] PCG: Saving primary data. [2025-09-16T19:54:35.413472] [DEBUG] [LOCAL ] PCG: Trimmed 58398 records to 40069 (keeping 150 days of data) [2025-09-16T19:54:35.597160] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-08. [2025-09-16T19:54:35.670041] [DEBUG] [LOCAL ] PCG: Primary data saved (40069 records). [2025-09-16T19:54:35.670170] [INFO ] [MAIN ] PCG: Full history saved. [2025-09-16T19:54:35.671053] [INFO ] [MAIN ] Update Progress: 1643/2369 symbols completed. PCG took 27.8s. Estimated remaining: 1h 17m 8s. Rate: 9.4 symbols/min [2025-09-16T19:54:35.839529] [INFO ] [MAIN ] PCOR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:54:35.880422] [DEBUG] [LOCAL ] PCOR: Loaded 35210 existing records from primary storage. [2025-09-16T19:54:35.880557] [INFO ] [MAIN ] PCOR: Loaded 35210 existing records. [2025-09-16T19:54:36.054614] [WARN ] [MAIN ] PCOR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:54:36.054879] [INFO ] [MAIN ] PCOR: Wiping existing primary data before full refresh. [2025-09-16T19:54:36.054927] [INFO ] [LOCAL ] PCOR: Starting deletion of primary data. [2025-09-16T19:54:36.055638] [DEBUG] [LOCAL ] PCOR: Deleted primary data file. [2025-09-16T19:54:36.055739] [INFO ] [MAIN ] PCOR: Starting full primary refresh. [2025-09-16T19:54:36.383797] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-06. [2025-09-16T19:54:36.410459] [INFO ] [REMOTE ] PCOR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:54:36.417883] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-16T19:54:36.813334] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-16T19:54:36.819601] [INFO ] [REMOTE ] PBR: Full fetch complete (58394 records). [2025-09-16T19:54:36.819729] [DEBUG] [VALIDATOR ] PBR: Validating primary data. [2025-09-16T19:54:37.180855] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-02. [2025-09-16T19:54:37.215531] [DEBUG] [VALIDATOR ] PBR: All expected trading days are present. [2025-09-16T19:54:37.215600] [DEBUG] [VALIDATOR ] PBR: Primary data validation passed. [2025-09-16T19:54:37.216580] [INFO ] [MAIN ] PBR: Fetched primary data is valid. [2025-09-16T19:54:37.216631] [DEBUG] [LOCAL ] PBR: Saving primary data. [2025-09-16T19:54:37.217948] [DEBUG] [LOCAL ] PBR: Trimmed 58394 records to 40068 (keeping 150 days of data) [2025-09-16T19:54:37.464192] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-16T19:54:37.494109] [DEBUG] [LOCAL ] PBR: Primary data saved (40068 records). [2025-09-16T19:54:37.494241] [INFO ] [MAIN ] PBR: Full history saved. [2025-09-16T19:54:37.494344] [INFO ] [MAIN ] Update Progress: 1644/2369 symbols completed. PBR took 29.6s. Estimated remaining: 1h 16m 59s. Rate: 9.4 symbols/min [2025-09-16T19:54:37.671252] [INFO ] [MAIN ] PCQ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:54:37.680530] [DEBUG] [LOCAL ] PCQ: Loaded 8603 existing records from primary storage. [2025-09-16T19:54:37.680661] [INFO ] [MAIN ] PCQ: Loaded 8603 existing records. [2025-09-16T19:54:37.855585] [WARN ] [MAIN ] PCQ: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:54:37.855875] [INFO ] [MAIN ] PCQ: Wiping existing primary data before full refresh. [2025-09-16T19:54:37.855938] [INFO ] [LOCAL ] PCQ: Starting deletion of primary data. [2025-09-16T19:54:37.856326] [DEBUG] [LOCAL ] PCQ: Deleted primary data file. [2025-09-16T19:54:37.856385] [INFO ] [MAIN ] PCQ: Starting full primary refresh. [2025-09-16T19:54:37.980078] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-07. [2025-09-16T19:54:38.211470] [INFO ] [REMOTE ] PCQ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:54:38.739981] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-16T19:54:38.774849] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-03. [2025-09-16T19:54:38.793444] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-16T19:54:39.574929] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-02. [2025-09-16T19:54:40.374905] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-09. [2025-09-16T19:54:40.398268] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-16T19:54:40.566985] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-16T19:54:41.138884] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-16T19:54:41.141158] [INFO ] [REMOTE ] PCM: Full fetch complete (7387 records). [2025-09-16T19:54:41.141235] [DEBUG] [VALIDATOR ] PCM: Validating primary data. [2025-09-16T19:54:41.180937] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-03. [2025-09-16T19:54:41.496634] [DEBUG] [VALIDATOR ] PCM: All expected trading days are present. [2025-09-16T19:54:41.496730] [DEBUG] [VALIDATOR ] PCM: Primary data validation passed. [2025-09-16T19:54:41.496923] [INFO ] [MAIN ] PCM: Fetched primary data is valid. [2025-09-16T19:54:41.496961] [DEBUG] [LOCAL ] PCM: Saving primary data. [2025-09-16T19:54:41.497386] [DEBUG] [LOCAL ] PCM: Trimmed 7387 records to 4972 (keeping 150 days of data) [2025-09-16T19:54:41.531382] [DEBUG] [LOCAL ] PCM: Primary data saved (4972 records). [2025-09-16T19:54:41.531602] [INFO ] [MAIN ] PCM: Full history saved. [2025-09-16T19:54:41.531776] [INFO ] [MAIN ] Update Progress: 1645/2369 symbols completed. PCM took 23.0s. Estimated remaining: 1h 16m 52s. Rate: 9.4 symbols/min [2025-09-16T19:54:41.711982] [INFO ] [MAIN ] PD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:54:41.751936] [DEBUG] [LOCAL ] PD: Loaded 35268 existing records from primary storage. [2025-09-16T19:54:41.752131] [INFO ] [MAIN ] PD: Loaded 35268 existing records. [2025-09-16T19:54:41.938466] [WARN ] [MAIN ] PD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:54:41.938760] [INFO ] [MAIN ] PD: Wiping existing primary data before full refresh. [2025-09-16T19:54:41.938820] [INFO ] [LOCAL ] PD: Starting deletion of primary data. [2025-09-16T19:54:41.939693] [DEBUG] [LOCAL ] PD: Deleted primary data file. [2025-09-16T19:54:41.939752] [INFO ] [MAIN ] PD: Starting full primary refresh. [2025-09-16T19:54:41.983478] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-08. [2025-09-16T19:54:42.142427] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-16T19:54:42.322635] [INFO ] [REMOTE ] PD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:54:42.774917] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-02. [2025-09-16T19:54:43.008092] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-16T19:54:43.574927] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-04. [2025-09-16T19:54:43.857194] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-16T19:54:44.276595] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-16T19:54:44.374917] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-05. [2025-09-16T19:54:45.140534] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-16T19:54:45.174902] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-06. [2025-09-16T19:54:45.963436] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-16T19:54:45.974839] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-07. [2025-09-16T19:54:46.703433] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-16T19:54:46.774859] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-09. [2025-09-16T19:54:47.574901] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-04. [2025-09-16T19:54:48.002331] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-16T19:54:48.006072] [INFO ] [REMOTE ] PCN: Full fetch complete (26045 records). [2025-09-16T19:54:48.006146] [DEBUG] [VALIDATOR ] PCN: Validating primary data. [2025-09-16T19:54:48.366785] [DEBUG] [VALIDATOR ] PCN: All expected trading days are present. [2025-09-16T19:54:48.366862] [DEBUG] [VALIDATOR ] PCN: Primary data validation passed. [2025-09-16T19:54:48.367363] [INFO ] [MAIN ] PCN: Fetched primary data is valid. [2025-09-16T19:54:48.367405] [DEBUG] [LOCAL ] PCN: Saving primary data. [2025-09-16T19:54:48.368170] [DEBUG] [LOCAL ] PCN: Trimmed 26045 records to 18268 (keeping 150 days of data) [2025-09-16T19:54:48.418636] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-08. [2025-09-16T19:54:48.483326] [DEBUG] [LOCAL ] PCN: Primary data saved (18268 records). [2025-09-16T19:54:48.483449] [INFO ] [MAIN ] PCN: Full history saved. [2025-09-16T19:54:48.483528] [INFO ] [MAIN ] Update Progress: 1646/2369 symbols completed. PCN took 27.3s. Estimated remaining: 1h 16m 46s. Rate: 9.4 symbols/min [2025-09-16T19:54:48.651556] [INFO ] [MAIN ] PDCC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:54:48.651748] [DEBUG] [LOCAL ] PDCC: No existing data file found in primary storage. [2025-09-16T19:54:48.651829] [WARN ] [MAIN ] PDCC: No existing data found, performing full refresh instead. [2025-09-16T19:54:48.651949] [INFO ] [MAIN ] PDCC: Wiping existing primary data before full refresh. [2025-09-16T19:54:48.651988] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-09-16T19:54:48.652028] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-09-16T19:54:48.652061] [INFO ] [MAIN ] PDCC: Starting full primary refresh. [2025-09-16T19:54:49.002357] [INFO ] [REMOTE ] PDCC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:54:49.174868] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-02. [2025-09-16T19:54:49.226274] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-16T19:54:49.268483] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-16T19:54:49.599820] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-16T19:54:49.974863] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-05. [2025-09-16T19:54:50.774886] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-03. [2025-09-16T19:54:51.188531] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-16T19:54:51.397696] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-16T19:54:51.574869] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-04. [2025-09-16T19:54:52.000056] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-16T19:54:52.374903] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-06. [2025-09-16T19:54:53.174908] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-03. [2025-09-16T19:54:53.917302] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-16T19:54:53.974857] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-07. [2025-09-16T19:54:54.787288] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-09. [2025-09-16T19:54:54.790154] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-16T19:54:55.574896] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-04. [2025-09-16T19:54:55.705231] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-16T19:54:55.736422] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-16T19:54:55.738696] [INFO ] [REMOTE ] PCQ: Full fetch complete (12963 records). [2025-09-16T19:54:55.738769] [DEBUG] [VALIDATOR ] PCQ: Validating primary data. [2025-09-16T19:54:56.110255] [DEBUG] [VALIDATOR ] PCQ: All expected trading days are present. [2025-09-16T19:54:56.110364] [DEBUG] [VALIDATOR ] PCQ: Primary data validation passed. [2025-09-16T19:54:56.110791] [INFO ] [MAIN ] PCQ: Fetched primary data is valid. [2025-09-16T19:54:56.110876] [DEBUG] [LOCAL ] PCQ: Saving primary data. [2025-09-16T19:54:56.111832] [DEBUG] [LOCAL ] PCQ: Trimmed 12963 records to 8657 (keeping 150 days of data) [2025-09-16T19:54:56.172885] [DEBUG] [LOCAL ] PCQ: Primary data saved (8657 records). [2025-09-16T19:54:56.173061] [INFO ] [MAIN ] PCQ: Full history saved. [2025-09-16T19:54:56.173177] [INFO ] [MAIN ] Update Progress: 1647/2369 symbols completed. PCQ took 18.7s. Estimated remaining: 1h 16m 40s. Rate: 9.4 symbols/min [2025-09-16T19:54:56.372852] [INFO ] [MAIN ] PDI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:54:56.374865] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-05. [2025-09-16T19:54:56.415364] [DEBUG] [LOCAL ] PDI: Loaded 36823 existing records from primary storage. [2025-09-16T19:54:56.415505] [INFO ] [MAIN ] PDI: Loaded 36823 existing records. [2025-09-16T19:54:56.595753] [WARN ] [MAIN ] PDI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:54:56.596053] [INFO ] [MAIN ] PDI: Wiping existing primary data before full refresh. [2025-09-16T19:54:56.596099] [INFO ] [LOCAL ] PDI: Starting deletion of primary data. [2025-09-16T19:54:56.596937] [DEBUG] [LOCAL ] PDI: Deleted primary data file. [2025-09-16T19:54:56.596987] [INFO ] [MAIN ] PDI: Starting full primary refresh. [2025-09-16T19:54:56.729679] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-16T19:54:56.955982] [INFO ] [REMOTE ] PDI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:54:57.180664] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-06. [2025-09-16T19:54:57.199246] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-16T19:54:57.593523] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-16T19:54:57.974891] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-05. [2025-09-16T19:54:58.774926] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-07. [2025-09-16T19:54:59.501882] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-16T19:54:59.540846] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-16T19:54:59.574943] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-06. [2025-09-16T19:55:00.374904] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-08. [2025-09-16T19:55:00.661620] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-09-16T19:55:01.174911] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-08. [2025-09-16T19:55:01.369927] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-16T19:55:01.975145] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-09. [2025-09-16T19:55:02.416878] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-16T19:55:02.417577] [INFO ] [REMOTE ] PDCC: Full fetch complete (1149 records). [2025-09-16T19:55:02.417665] [DEBUG] [VALIDATOR ] PDCC: Validating primary data. [2025-09-16T19:55:02.599102] [WARN ] [VALIDATOR ] PDCC: Validation failed - insufficient historical data. Have 147 unique days, need 150 days [2025-09-16T19:55:02.599283] [FATAL] [MAIN ] PDCC: Fetched primary data is invalid. Refusing to save it. [2025-09-16T19:55:02.599331] [WARN ] [MAIN ] PDCC: Deleting existing primary and derivative data due to validation failure. [2025-09-16T19:55:02.599375] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-09-16T19:55:02.599436] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-09-16T19:55:02.599471] [INFO ] [LOCAL ] PDCC: Starting deletion of derivative data. [2025-09-16T19:55:02.599534] [DEBUG] [LOCAL ] PDCC: No derivative data file found to delete. [2025-09-16T19:55:02.599597] [INFO ] [MAIN ] Update Progress: 1648/2369 symbols completed. PDCC took 14.1s. Estimated remaining: 1h 16m 34s. Rate: 9.4 symbols/min [2025-09-16T19:55:02.785427] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-07. [2025-09-16T19:55:02.785338] [INFO ] [MAIN ] PDM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:55:02.825675] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-16T19:55:02.857694] [DEBUG] [LOCAL ] PDM: Loaded 29063 existing records from primary storage. [2025-09-16T19:55:02.857865] [INFO ] [MAIN ] PDM: Loaded 29063 existing records. [2025-09-16T19:55:03.037697] [WARN ] [MAIN ] PDM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:55:03.037939] [INFO ] [MAIN ] PDM: Wiping existing primary data before full refresh. [2025-09-16T19:55:03.037988] [INFO ] [LOCAL ] PDM: Starting deletion of primary data. [2025-09-16T19:55:03.038697] [DEBUG] [LOCAL ] PDM: Deleted primary data file. [2025-09-16T19:55:03.038748] [INFO ] [MAIN ] PDM: Starting full primary refresh. [2025-09-16T19:55:03.402402] [INFO ] [REMOTE ] PDM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:55:03.574891] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-02. [2025-09-16T19:55:04.374873] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-02. [2025-09-16T19:55:04.481070] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-16T19:55:04.944823] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-16T19:55:05.174913] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-08. [2025-09-16T19:55:05.974896] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-09. [2025-09-16T19:55:06.167708] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-16T19:55:06.774952] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-03. [2025-09-16T19:55:06.894948] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-16T19:55:07.248300] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-16T19:55:07.253942] [INFO ] [REMOTE ] PCOR: Full fetch complete (52602 records). [2025-09-16T19:55:07.254072] [DEBUG] [VALIDATOR ] PCOR: Validating primary data. [2025-09-16T19:55:07.580016] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-03. [2025-09-16T19:55:07.692217] [DEBUG] [VALIDATOR ] PCOR: All expected trading days are present. [2025-09-16T19:55:07.692293] [DEBUG] [VALIDATOR ] PCOR: Primary data validation passed. [2025-09-16T19:55:07.693130] [INFO ] [MAIN ] PCOR: Fetched primary data is valid. [2025-09-16T19:55:07.693185] [DEBUG] [LOCAL ] PCOR: Saving primary data. [2025-09-16T19:55:07.694289] [DEBUG] [LOCAL ] PCOR: Trimmed 52602 records to 35516 (keeping 150 days of data) [2025-09-16T19:55:07.937409] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-16T19:55:07.962214] [DEBUG] [LOCAL ] PCOR: Primary data saved (35516 records). [2025-09-16T19:55:07.962333] [INFO ] [MAIN ] PCOR: Full history saved. [2025-09-16T19:55:07.962421] [INFO ] [MAIN ] Update Progress: 1649/2369 symbols completed. PCOR took 32.3s. Estimated remaining: 1h 16m 27s. Rate: 9.4 symbols/min [2025-09-16T19:55:08.134904] [INFO ] [MAIN ] PDO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:55:08.156813] [DEBUG] [LOCAL ] PDO: Loaded 22514 existing records from primary storage. [2025-09-16T19:55:08.156969] [INFO ] [MAIN ] PDO: Loaded 22514 existing records. [2025-09-16T19:55:08.335284] [WARN ] [MAIN ] PDO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:55:08.335533] [INFO ] [MAIN ] PDO: Wiping existing primary data before full refresh. [2025-09-16T19:55:08.335579] [INFO ] [LOCAL ] PDO: Starting deletion of primary data. [2025-09-16T19:55:08.336187] [DEBUG] [LOCAL ] PDO: Deleted primary data file. [2025-09-16T19:55:08.336235] [INFO ] [MAIN ] PDO: Starting full primary refresh. [2025-09-16T19:55:08.379988] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-04. [2025-09-16T19:55:08.689370] [INFO ] [REMOTE ] PDO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:55:09.174945] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-02. [2025-09-16T19:55:09.551128] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-16T19:55:09.974906] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-04. [2025-09-16T19:55:10.063470] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-16T19:55:10.136992] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-16T19:55:10.774913] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-09. [2025-09-16T19:55:11.574917] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-03. [2025-09-16T19:55:11.991934] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-16T19:55:12.374921] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-05. [2025-09-16T19:55:12.550877] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-16T19:55:12.557548] [INFO ] [REMOTE ] PD: Full fetch complete (51470 records). [2025-09-16T19:55:12.557772] [DEBUG] [VALIDATOR ] PD: Validating primary data. [2025-09-16T19:55:12.949285] [DEBUG] [VALIDATOR ] PD: All expected trading days are present. [2025-09-16T19:55:12.949406] [DEBUG] [VALIDATOR ] PD: Primary data validation passed. [2025-09-16T19:55:12.950326] [INFO ] [MAIN ] PD: Fetched primary data is valid. [2025-09-16T19:55:12.950406] [DEBUG] [LOCAL ] PD: Saving primary data. [2025-09-16T19:55:12.958555] [DEBUG] [LOCAL ] PD: Trimmed 51470 records to 35634 (keeping 150 days of data) [2025-09-16T19:55:12.973627] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-16T19:55:13.176883] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-04. [2025-09-16T19:55:13.193744] [DEBUG] [LOCAL ] PD: Primary data saved (35634 records). [2025-09-16T19:55:13.193906] [INFO ] [MAIN ] PD: Full history saved. [2025-09-16T19:55:13.194028] [INFO ] [MAIN ] Update Progress: 1650/2369 symbols completed. PD took 31.7s. Estimated remaining: 1h 16m 20s. Rate: 9.4 symbols/min [2025-09-16T19:55:13.365008] [INFO ] [MAIN ] PDS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:55:13.377289] [DEBUG] [LOCAL ] PDS: Loaded 12126 existing records from primary storage. [2025-09-16T19:55:13.377432] [INFO ] [MAIN ] PDS: Loaded 12126 existing records. [2025-09-16T19:55:13.557974] [WARN ] [MAIN ] PDS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:55:13.558450] [INFO ] [MAIN ] PDS: Wiping existing primary data before full refresh. [2025-09-16T19:55:13.558541] [INFO ] [LOCAL ] PDS: Starting deletion of primary data. [2025-09-16T19:55:13.559188] [DEBUG] [LOCAL ] PDS: Deleted primary data file. [2025-09-16T19:55:13.559280] [INFO ] [MAIN ] PDS: Starting full primary refresh. [2025-09-16T19:55:13.701744] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-16T19:55:13.977401] [INFO ] [REMOTE ] PDS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:55:13.977522] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-06. [2025-09-16T19:55:14.679310] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-16T19:55:14.774934] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-02. [2025-09-16T19:55:15.155770] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-16T19:55:15.403101] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-16T19:55:15.574906] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-03. [2025-09-16T19:55:16.374905] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-05. [2025-09-16T19:55:16.681027] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-16T19:55:17.174921] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-05. [2025-09-16T19:55:17.974934] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-07. [2025-09-16T19:55:18.425808] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-16T19:55:18.548830] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-16T19:55:18.774942] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-06. [2025-09-16T19:55:19.486115] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-16T19:55:19.574905] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-08. [2025-09-16T19:55:20.016069] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-16T19:55:20.374951] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-04. [2025-09-16T19:55:20.972601] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-16T19:55:21.174867] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-09. [2025-09-16T19:55:21.640996] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-16T19:55:21.974903] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-05. [2025-09-16T19:55:22.543593] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-16T19:55:22.548113] [INFO ] [REMOTE ] PDM: Full fetch complete (43396 records). [2025-09-16T19:55:22.548223] [DEBUG] [VALIDATOR ] PDM: Validating primary data. [2025-09-16T19:55:22.780028] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-06. [2025-09-16T19:55:22.950199] [DEBUG] [VALIDATOR ] PDM: All expected trading days are present. [2025-09-16T19:55:22.950279] [DEBUG] [VALIDATOR ] PDM: Primary data validation passed. [2025-09-16T19:55:22.951057] [INFO ] [MAIN ] PDM: Fetched primary data is valid. [2025-09-16T19:55:22.951102] [DEBUG] [LOCAL ] PDM: Saving primary data. [2025-09-16T19:55:22.952062] [DEBUG] [LOCAL ] PDM: Trimmed 43396 records to 29341 (keeping 150 days of data) [2025-09-16T19:55:23.058847] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-16T19:55:23.133315] [DEBUG] [LOCAL ] PDM: Primary data saved (29341 records). [2025-09-16T19:55:23.133468] [INFO ] [MAIN ] PDM: Full history saved. [2025-09-16T19:55:23.133555] [INFO ] [MAIN ] Update Progress: 1651/2369 symbols completed. PDM took 20.5s. Estimated remaining: 1h 16m 15s. Rate: 9.4 symbols/min [2025-09-16T19:55:23.302587] [INFO ] [MAIN ] PDT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:55:23.316894] [DEBUG] [LOCAL ] PDT: Loaded 12890 existing records from primary storage. [2025-09-16T19:55:23.317035] [INFO ] [MAIN ] PDT: Loaded 12890 existing records. [2025-09-16T19:55:23.492078] [WARN ] [MAIN ] PDT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:55:23.492342] [INFO ] [MAIN ] PDT: Wiping existing primary data before full refresh. [2025-09-16T19:55:23.492388] [INFO ] [LOCAL ] PDT: Starting deletion of primary data. [2025-09-16T19:55:23.492861] [DEBUG] [LOCAL ] PDT: Deleted primary data file. [2025-09-16T19:55:23.492910] [INFO ] [MAIN ] PDT: Starting full primary refresh. [2025-09-16T19:55:23.580035] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-06. [2025-09-16T19:55:23.850442] [INFO ] [REMOTE ] PDT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:55:24.374945] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-02. [2025-09-16T19:55:24.636808] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-16T19:55:24.661555] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-16T19:55:25.174958] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-07. [2025-09-16T19:55:25.502384] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-16T19:55:25.974951] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-07. [2025-09-16T19:55:26.774868] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-03. [2025-09-16T19:55:26.977233] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-16T19:55:27.077278] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-16T19:55:27.574913] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-08. [2025-09-16T19:55:27.832017] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-16T19:55:28.374908] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-04. [2025-09-16T19:55:28.398148] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-16T19:55:29.174923] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-09. [2025-09-16T19:55:29.353710] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-16T19:55:29.974917] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-05. [2025-09-16T19:55:30.134772] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-16T19:55:30.136915] [INFO ] [REMOTE ] PDS: Full fetch complete (20420 records). [2025-09-16T19:55:30.137011] [DEBUG] [VALIDATOR ] PDS: Validating primary data. [2025-09-16T19:55:30.494382] [DEBUG] [VALIDATOR ] PDS: All expected trading days are present. [2025-09-16T19:55:30.494464] [DEBUG] [VALIDATOR ] PDS: Primary data validation passed. [2025-09-16T19:55:30.494937] [INFO ] [MAIN ] PDS: Fetched primary data is valid. [2025-09-16T19:55:30.494982] [DEBUG] [LOCAL ] PDS: Saving primary data. [2025-09-16T19:55:30.495536] [DEBUG] [LOCAL ] PDS: Trimmed 20420 records to 12219 (keeping 150 days of data) [2025-09-16T19:55:30.568835] [DEBUG] [LOCAL ] PDS: Primary data saved (12219 records). [2025-09-16T19:55:30.568968] [INFO ] [MAIN ] PDS: Full history saved. [2025-09-16T19:55:30.569049] [INFO ] [MAIN ] Update Progress: 1652/2369 symbols completed. PDS took 17.4s. Estimated remaining: 1h 16m 9s. Rate: 9.4 symbols/min [2025-09-16T19:55:30.744913] [INFO ] [MAIN ] PDX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:55:30.756974] [DEBUG] [LOCAL ] PDX: Loaded 10423 existing records from primary storage. [2025-09-16T19:55:30.757098] [INFO ] [MAIN ] PDX: Loaded 10423 existing records. [2025-09-16T19:55:30.780016] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-07. [2025-09-16T19:55:30.935174] [WARN ] [MAIN ] PDX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:55:30.935528] [INFO ] [MAIN ] PDX: Wiping existing primary data before full refresh. [2025-09-16T19:55:30.935748] [INFO ] [LOCAL ] PDX: Starting deletion of primary data. [2025-09-16T19:55:30.941559] [DEBUG] [LOCAL ] PDX: Deleted primary data file. [2025-09-16T19:55:30.948429] [INFO ] [MAIN ] PDX: Starting full primary refresh. [2025-09-16T19:55:30.980950] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-16T19:55:31.302931] [INFO ] [REMOTE ] PDX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:55:31.574905] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-08. [2025-09-16T19:55:32.223127] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-16T19:55:32.374923] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-02. [2025-09-16T19:55:33.174907] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-06. [2025-09-16T19:55:33.334535] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-16T19:55:33.381133] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-16T19:55:33.974911] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-09. [2025-09-16T19:55:34.047762] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-16T19:55:34.774913] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-08. [2025-09-16T19:55:35.574876] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-07. [2025-09-16T19:55:35.748355] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-16T19:55:35.754789] [INFO ] [REMOTE ] PDI: Full fetch complete (54718 records). [2025-09-16T19:55:35.754930] [DEBUG] [VALIDATOR ] PDI: Validating primary data. [2025-09-16T19:55:36.138466] [DEBUG] [VALIDATOR ] PDI: All expected trading days are present. [2025-09-16T19:55:36.138571] [DEBUG] [VALIDATOR ] PDI: Primary data validation passed. [2025-09-16T19:55:36.139467] [INFO ] [MAIN ] PDI: Fetched primary data is valid. [2025-09-16T19:55:36.139538] [DEBUG] [LOCAL ] PDI: Saving primary data. [2025-09-16T19:55:36.140835] [DEBUG] [LOCAL ] PDI: Trimmed 54718 records to 37200 (keeping 150 days of data) [2025-09-16T19:55:36.265888] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-16T19:55:36.375010] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-09. [2025-09-16T19:55:36.406627] [DEBUG] [LOCAL ] PDI: Primary data saved (37200 records). [2025-09-16T19:55:36.406755] [INFO ] [MAIN ] PDI: Full history saved. [2025-09-16T19:55:36.407898] [INFO ] [MAIN ] Update Progress: 1653/2369 symbols completed. PDI took 40.2s. Estimated remaining: 1h 16m 3s. Rate: 9.4 symbols/min [2025-09-16T19:55:36.580835] [INFO ] [MAIN ] PEB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:55:36.594428] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-16T19:55:36.635483] [DEBUG] [LOCAL ] PEB: Loaded 37283 existing records from primary storage. [2025-09-16T19:55:36.635669] [INFO ] [MAIN ] PEB: Loaded 37283 existing records. [2025-09-16T19:55:36.817008] [WARN ] [MAIN ] PEB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:55:36.817296] [INFO ] [MAIN ] PEB: Wiping existing primary data before full refresh. [2025-09-16T19:55:36.817344] [INFO ] [LOCAL ] PEB: Starting deletion of primary data. [2025-09-16T19:55:36.818087] [DEBUG] [LOCAL ] PEB: Deleted primary data file. [2025-09-16T19:55:36.818138] [INFO ] [MAIN ] PEB: Starting full primary refresh. [2025-09-16T19:55:37.170882] [INFO ] [REMOTE ] PEB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:55:37.174851] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-02. [2025-09-16T19:55:37.642331] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-16T19:55:37.646585] [INFO ] [REMOTE ] PDO: Full fetch complete (34716 records). [2025-09-16T19:55:37.646727] [DEBUG] [VALIDATOR ] PDO: Validating primary data. [2025-09-16T19:55:37.980020] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-08. [2025-09-16T19:55:38.016294] [DEBUG] [VALIDATOR ] PDO: All expected trading days are present. [2025-09-16T19:55:38.016379] [DEBUG] [VALIDATOR ] PDO: Primary data validation passed. [2025-09-16T19:55:38.017158] [INFO ] [MAIN ] PDO: Fetched primary data is valid. [2025-09-16T19:55:38.017218] [DEBUG] [LOCAL ] PDO: Saving primary data. [2025-09-16T19:55:38.018180] [DEBUG] [LOCAL ] PDO: Trimmed 34716 records to 22731 (keeping 150 days of data) [2025-09-16T19:55:38.160075] [DEBUG] [LOCAL ] PDO: Primary data saved (22731 records). [2025-09-16T19:55:38.160218] [INFO ] [MAIN ] PDO: Full history saved. [2025-09-16T19:55:38.160307] [INFO ] [MAIN ] Update Progress: 1654/2369 symbols completed. PDO took 30.2s. Estimated remaining: 1h 15m 54s. Rate: 9.4 symbols/min [2025-09-16T19:55:38.331811] [INFO ] [MAIN ] PEG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:55:38.370242] [DEBUG] [LOCAL ] PEG: Loaded 39246 existing records from primary storage. [2025-09-16T19:55:38.370410] [INFO ] [MAIN ] PEG: Loaded 39246 existing records. [2025-09-16T19:55:38.546154] [WARN ] [MAIN ] PEG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:55:38.546467] [INFO ] [MAIN ] PEG: Wiping existing primary data before full refresh. [2025-09-16T19:55:38.546515] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-09-16T19:55:38.547522] [DEBUG] [LOCAL ] PEG: Deleted primary data file. [2025-09-16T19:55:38.547572] [INFO ] [MAIN ] PEG: Starting full primary refresh. [2025-09-16T19:55:38.784825] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-03. [2025-09-16T19:55:38.947568] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-16T19:55:38.977269] [INFO ] [REMOTE ] PEG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:55:39.106251] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-16T19:55:39.574898] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-03. [2025-09-16T19:55:39.752747] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-16T19:55:40.374936] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-04. [2025-09-16T19:55:41.174869] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-09. [2025-09-16T19:55:41.248047] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-16T19:55:41.462507] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-16T19:55:41.896068] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-16T19:55:41.898189] [INFO ] [REMOTE ] PDT: Full fetch complete (19188 records). [2025-09-16T19:55:41.898260] [DEBUG] [VALIDATOR ] PDT: Validating primary data. [2025-09-16T19:55:41.980017] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-05. [2025-09-16T19:55:42.262609] [DEBUG] [VALIDATOR ] PDT: All expected trading days are present. [2025-09-16T19:55:42.262702] [DEBUG] [VALIDATOR ] PDT: Primary data validation passed. [2025-09-16T19:55:42.263082] [INFO ] [MAIN ] PDT: Fetched primary data is valid. [2025-09-16T19:55:42.263130] [DEBUG] [LOCAL ] PDT: Saving primary data. [2025-09-16T19:55:42.263733] [DEBUG] [LOCAL ] PDT: Trimmed 19188 records to 12983 (keeping 150 days of data) [2025-09-16T19:55:42.345035] [DEBUG] [LOCAL ] PDT: Primary data saved (12983 records). [2025-09-16T19:55:42.345186] [INFO ] [MAIN ] PDT: Full history saved. [2025-09-16T19:55:42.345273] [INFO ] [MAIN ] Update Progress: 1655/2369 symbols completed. PDT took 19.2s. Estimated remaining: 1h 15m 47s. Rate: 9.4 symbols/min [2025-09-16T19:55:42.517624] [INFO ] [MAIN ] PEN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:55:42.540509] [DEBUG] [LOCAL ] PEN: Loaded 22345 existing records from primary storage. [2025-09-16T19:55:42.540686] [INFO ] [MAIN ] PEN: Loaded 22345 existing records. [2025-09-16T19:55:42.722933] [WARN ] [MAIN ] PEN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:55:42.723205] [INFO ] [MAIN ] PEN: Wiping existing primary data before full refresh. [2025-09-16T19:55:42.723274] [INFO ] [LOCAL ] PEN: Starting deletion of primary data. [2025-09-16T19:55:42.727358] [DEBUG] [LOCAL ] PEN: Deleted primary data file. [2025-09-16T19:55:42.727432] [INFO ] [MAIN ] PEN: Starting full primary refresh. [2025-09-16T19:55:42.781823] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-04. [2025-09-16T19:55:43.079689] [INFO ] [REMOTE ] PEN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:55:43.089109] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-16T19:55:43.574899] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-06. [2025-09-16T19:55:44.374931] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-02. [2025-09-16T19:55:44.475781] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-16T19:55:44.515860] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-16T19:55:45.174915] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-05. [2025-09-16T19:55:45.974868] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-02. [2025-09-16T19:55:46.004108] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-16T19:55:46.779958] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-03. [2025-09-16T19:55:46.794878] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-16T19:55:47.474194] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-16T19:55:47.574944] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-06. [2025-09-16T19:55:48.374913] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-03. [2025-09-16T19:55:48.589146] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-16T19:55:49.174943] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-07. [2025-09-16T19:55:49.361667] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-16T19:55:49.862570] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-16T19:55:49.974929] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-04. [2025-09-16T19:55:50.667341] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-16T19:55:50.774949] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-04. [2025-09-16T19:55:51.445263] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-16T19:55:51.574868] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-05. [2025-09-16T19:55:52.374930] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-08. [2025-09-16T19:55:52.549807] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-16T19:55:52.879761] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-16T19:55:53.123123] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-16T19:55:53.174875] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-06. [2025-09-16T19:55:53.974918] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-05. [2025-09-16T19:55:54.662877] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-16T19:55:54.774934] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-07. [2025-09-16T19:55:55.574919] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-07. [2025-09-16T19:55:55.794997] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-16T19:55:56.374904] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-09. [2025-09-16T19:55:56.645830] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-16T19:55:56.835479] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-16T19:55:57.174914] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-08. [2025-09-16T19:55:57.412002] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-16T19:55:57.417329] [INFO ] [REMOTE ] PDX: Full fetch complete (16075 records). [2025-09-16T19:55:57.417480] [DEBUG] [VALIDATOR ] PDX: Validating primary data. [2025-09-16T19:55:57.775719] [DEBUG] [VALIDATOR ] PDX: All expected trading days are present. [2025-09-16T19:55:57.775796] [DEBUG] [VALIDATOR ] PDX: Primary data validation passed. [2025-09-16T19:55:57.776193] [INFO ] [MAIN ] PDX: Fetched primary data is valid. [2025-09-16T19:55:57.776243] [DEBUG] [LOCAL ] PDX: Saving primary data. [2025-09-16T19:55:57.776760] [DEBUG] [LOCAL ] PDX: Trimmed 16075 records to 10487 (keeping 150 days of data) [2025-09-16T19:55:57.840429] [DEBUG] [LOCAL ] PDX: Primary data saved (10487 records). [2025-09-16T19:55:57.840553] [INFO ] [MAIN ] PDX: Full history saved. [2025-09-16T19:55:57.840693] [INFO ] [MAIN ] Update Progress: 1656/2369 symbols completed. PDX took 27.3s. Estimated remaining: 1h 15m 44s. Rate: 9.4 symbols/min [2025-09-16T19:55:57.980898] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-08. [2025-09-16T19:55:58.017600] [INFO ] [MAIN ] PEO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:55:58.028659] [DEBUG] [LOCAL ] PEO: Loaded 7977 existing records from primary storage. [2025-09-16T19:55:58.028828] [INFO ] [MAIN ] PEO: Loaded 7977 existing records. [2025-09-16T19:55:58.225337] [WARN ] [MAIN ] PEO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:55:58.225591] [INFO ] [MAIN ] PEO: Wiping existing primary data before full refresh. [2025-09-16T19:55:58.225637] [INFO ] [LOCAL ] PEO: Starting deletion of primary data. [2025-09-16T19:55:58.225998] [DEBUG] [LOCAL ] PEO: Deleted primary data file. [2025-09-16T19:55:58.226042] [INFO ] [MAIN ] PEO: Starting full primary refresh. [2025-09-16T19:55:58.580222] [INFO ] [REMOTE ] PEO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:55:58.604815] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-16T19:55:58.774924] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-06. [2025-09-16T19:55:59.574938] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-09. [2025-09-16T19:55:59.716036] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-16T19:56:00.374948] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-02. [2025-09-16T19:56:00.790509] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-16T19:56:00.811832] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-16T19:56:00.815760] [INFO ] [REMOTE ] PEN: Full fetch complete (34000 records). [2025-09-16T19:56:00.815920] [DEBUG] [VALIDATOR ] PEN: Validating primary data. [2025-09-16T19:56:01.178468] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-09. [2025-09-16T19:56:01.212931] [DEBUG] [VALIDATOR ] PEN: All expected trading days are present. [2025-09-16T19:56:01.213137] [DEBUG] [VALIDATOR ] PEN: Primary data validation passed. [2025-09-16T19:56:01.213937] [INFO ] [MAIN ] PEN: Fetched primary data is valid. [2025-09-16T19:56:01.214046] [DEBUG] [LOCAL ] PEN: Saving primary data. [2025-09-16T19:56:01.221495] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-16T19:56:01.225322] [DEBUG] [LOCAL ] PEN: Trimmed 34000 records to 22527 (keeping 150 days of data) [2025-09-16T19:56:01.366369] [DEBUG] [LOCAL ] PEN: Primary data saved (22527 records). [2025-09-16T19:56:01.366510] [INFO ] [MAIN ] PEN: Full history saved. [2025-09-16T19:56:01.366594] [INFO ] [MAIN ] Update Progress: 1657/2369 symbols completed. PEN took 19.0s. Estimated remaining: 1h 15m 37s. Rate: 9.4 symbols/min [2025-09-16T19:56:01.533747] [INFO ] [MAIN ] PERF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:56:01.544990] [DEBUG] [LOCAL ] PERF: Loaded 11331 existing records from primary storage. [2025-09-16T19:56:01.545097] [INFO ] [MAIN ] PERF: Loaded 11331 existing records. [2025-09-16T19:56:01.730791] [WARN ] [MAIN ] PERF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:56:01.731084] [INFO ] [MAIN ] PERF: Wiping existing primary data before full refresh. [2025-09-16T19:56:01.731143] [INFO ] [LOCAL ] PERF: Starting deletion of primary data. [2025-09-16T19:56:01.731544] [DEBUG] [LOCAL ] PERF: Deleted primary data file. [2025-09-16T19:56:01.731592] [INFO ] [MAIN ] PERF: Starting full primary refresh. [2025-09-16T19:56:01.984398] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-07. [2025-09-16T19:56:02.101248] [INFO ] [REMOTE ] PERF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:56:02.774906] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-02. [2025-09-16T19:56:02.805158] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-16T19:56:02.811247] [INFO ] [REMOTE ] PEB: Full fetch complete (55057 records). [2025-09-16T19:56:02.811371] [DEBUG] [VALIDATOR ] PEB: Validating primary data. [2025-09-16T19:56:03.196217] [DEBUG] [VALIDATOR ] PEB: All expected trading days are present. [2025-09-16T19:56:03.196304] [DEBUG] [VALIDATOR ] PEB: Primary data validation passed. [2025-09-16T19:56:03.197183] [INFO ] [MAIN ] PEB: Fetched primary data is valid. [2025-09-16T19:56:03.197230] [DEBUG] [LOCAL ] PEB: Saving primary data. [2025-09-16T19:56:03.198500] [DEBUG] [LOCAL ] PEB: Trimmed 55057 records to 37647 (keeping 150 days of data) [2025-09-16T19:56:03.438343] [DEBUG] [LOCAL ] PEB: Primary data saved (37647 records). [2025-09-16T19:56:03.438547] [INFO ] [MAIN ] PEB: Full history saved. [2025-09-16T19:56:03.439311] [INFO ] [MAIN ] Update Progress: 1658/2369 symbols completed. PEB took 27.0s. Estimated remaining: 1h 15m 29s. Rate: 9.4 symbols/min [2025-09-16T19:56:03.585935] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-03. [2025-09-16T19:56:03.618148] [INFO ] [MAIN ] PEW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:56:03.618327] [DEBUG] [LOCAL ] PEW: No existing data file found in primary storage. [2025-09-16T19:56:03.618364] [WARN ] [MAIN ] PEW: No existing data found, performing full refresh instead. [2025-09-16T19:56:03.618490] [INFO ] [MAIN ] PEW: Wiping existing primary data before full refresh. [2025-09-16T19:56:03.618536] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-09-16T19:56:03.618580] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-09-16T19:56:03.618622] [INFO ] [MAIN ] PEW: Starting full primary refresh. [2025-09-16T19:56:03.981834] [INFO ] [REMOTE ] PEW: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:56:03.994838] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-16T19:56:04.031380] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-16T19:56:04.374905] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-08. [2025-09-16T19:56:04.570759] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-16T19:56:05.174914] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-02. [2025-09-16T19:56:05.407588] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:56:05.407927] [WARN ] [REMOTE ] PEW: No data returned for month 2025-02 [2025-09-16T19:56:05.974896] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-03. [2025-09-16T19:56:06.209219] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-16T19:56:06.596884] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-16T19:56:06.774934] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-09. [2025-09-16T19:56:07.574920] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-04. [2025-09-16T19:56:08.374866] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-04. [2025-09-16T19:56:08.448232] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-16T19:56:08.454618] [INFO ] [REMOTE ] PEG: Full fetch complete (57748 records). [2025-09-16T19:56:08.454755] [DEBUG] [VALIDATOR ] PEG: Validating primary data. [2025-09-16T19:56:08.840139] [DEBUG] [VALIDATOR ] PEG: All expected trading days are present. [2025-09-16T19:56:08.840275] [DEBUG] [VALIDATOR ] PEG: Primary data validation passed. [2025-09-16T19:56:08.841261] [INFO ] [MAIN ] PEG: Fetched primary data is valid. [2025-09-16T19:56:08.841318] [DEBUG] [LOCAL ] PEG: Saving primary data. [2025-09-16T19:56:08.842698] [DEBUG] [LOCAL ] PEG: Trimmed 57748 records to 39629 (keeping 150 days of data) [2025-09-16T19:56:09.098159] [DEBUG] [LOCAL ] PEG: Primary data saved (39629 records). [2025-09-16T19:56:09.098315] [INFO ] [MAIN ] PEG: Full history saved. [2025-09-16T19:56:09.098419] [INFO ] [MAIN ] Update Progress: 1659/2369 symbols completed. PEG took 30.9s. Estimated remaining: 1h 15m 22s. Rate: 9.4 symbols/min [2025-09-16T19:56:09.188616] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-03. [2025-09-16T19:56:09.269690] [INFO ] [MAIN ] PFD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:56:09.276378] [DEBUG] [LOCAL ] PFD: Loaded 3798 existing records from primary storage. [2025-09-16T19:56:09.276480] [INFO ] [MAIN ] PFD: Loaded 3798 existing records. [2025-09-16T19:56:09.452804] [WARN ] [MAIN ] PFD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:56:09.453077] [INFO ] [MAIN ] PFD: Wiping existing primary data before full refresh. [2025-09-16T19:56:09.453125] [INFO ] [LOCAL ] PFD: Starting deletion of primary data. [2025-09-16T19:56:09.453374] [DEBUG] [LOCAL ] PFD: Deleted primary data file. [2025-09-16T19:56:09.453421] [INFO ] [MAIN ] PFD: Starting full primary refresh. [2025-09-16T19:56:09.503378] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:56:09.561053] [WARN ] [REMOTE ] PEW: No data returned for month 2025-03 [2025-09-16T19:56:09.875633] [INFO ] [REMOTE ] PFD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:56:09.974881] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-02. [2025-09-16T19:56:10.637535] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-16T19:56:10.774859] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-03. [2025-09-16T19:56:11.321352] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-16T19:56:11.574912] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-04. [2025-09-16T19:56:11.699352] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-04 (4.12 seconds). [2025-09-16T19:56:11.775564] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:56:11.775922] [WARN ] [REMOTE ] PEW: No data returned for month 2025-04 [2025-09-16T19:56:12.092871] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-04 (3.72 seconds). [2025-09-16T19:56:12.374895] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-05. [2025-09-16T19:56:12.572427] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:56:12.572782] [WARN ] [REMOTE ] PEW: No data returned for month 2025-05 [2025-09-16T19:56:13.174907] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-05. [2025-09-16T19:56:13.975549] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-05. [2025-09-16T19:56:13.976603] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-16T19:56:14.771680] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-16T19:56:14.774833] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-06. [2025-09-16T19:56:15.520734] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-16T19:56:15.574935] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-06. [2025-09-16T19:56:15.781586] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T19:56:15.782024] [WARN ] [REMOTE ] PEW: No data returned for month 2025-06 [2025-09-16T19:56:16.374895] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-04. [2025-09-16T19:56:17.004428] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-16T19:56:17.174901] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-07. [2025-09-16T19:56:17.974919] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-07. [2025-09-16T19:56:18.756857] [INFO ] [REMOTE ] PEW: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-16T19:56:18.774933] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-05. [2025-09-16T19:56:19.149761] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-16T19:56:19.364409] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-16T19:56:19.574909] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-08. [2025-09-16T19:56:20.374894] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-08. [2025-09-16T19:56:20.674477] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-16T19:56:21.174962] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-06. [2025-09-16T19:56:21.969483] [INFO ] [REMOTE ] PEW: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-16T19:56:21.977880] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-09. [2025-09-16T19:56:22.018464] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-16T19:56:22.748549] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-16T19:56:22.750417] [INFO ] [REMOTE ] PERF: Full fetch complete (16072 records). [2025-09-16T19:56:22.750488] [DEBUG] [VALIDATOR ] PERF: Validating primary data. [2025-09-16T19:56:22.779985] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-06. [2025-09-16T19:56:23.120058] [DEBUG] [VALIDATOR ] PERF: All expected trading days are present. [2025-09-16T19:56:23.120147] [DEBUG] [VALIDATOR ] PERF: Primary data validation passed. [2025-09-16T19:56:23.120538] [INFO ] [MAIN ] PERF: Fetched primary data is valid. [2025-09-16T19:56:23.120596] [DEBUG] [LOCAL ] PERF: Saving primary data. [2025-09-16T19:56:23.121225] [DEBUG] [LOCAL ] PERF: Trimmed 16072 records to 11407 (keeping 150 days of data) [2025-09-16T19:56:23.193178] [DEBUG] [LOCAL ] PERF: Primary data saved (11407 records). [2025-09-16T19:56:23.193331] [INFO ] [MAIN ] PERF: Full history saved. [2025-09-16T19:56:23.193456] [INFO ] [MAIN ] Update Progress: 1660/2369 symbols completed. PERF took 21.8s. Estimated remaining: 1h 15m 19s. Rate: 9.4 symbols/min [2025-09-16T19:56:23.367697] [INFO ] [MAIN ] PFE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:56:23.408422] [DEBUG] [LOCAL ] PFE: Loaded 39773 existing records from primary storage. [2025-09-16T19:56:23.408566] [INFO ] [MAIN ] PFE: Loaded 39773 existing records. [2025-09-16T19:56:23.511403] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-16T19:56:23.583742] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-09. [2025-09-16T19:56:23.588029] [WARN ] [MAIN ] PFE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:56:23.589030] [INFO ] [MAIN ] PFE: Wiping existing primary data before full refresh. [2025-09-16T19:56:23.589074] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-09-16T19:56:23.589927] [DEBUG] [LOCAL ] PFE: Deleted primary data file. [2025-09-16T19:56:23.589980] [INFO ] [MAIN ] PFE: Starting full primary refresh. [2025-09-16T19:56:23.954236] [INFO ] [REMOTE ] PFE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:56:24.374897] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-02. [2025-09-16T19:56:25.174912] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-07. [2025-09-16T19:56:25.523184] [INFO ] [REMOTE ] PEW: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-16T19:56:25.530599] [INFO ] [REMOTE ] PEW: Full fetch complete (14139 records). [2025-09-16T19:56:25.530828] [DEBUG] [VALIDATOR ] PEW: Validating primary data. [2025-09-16T19:56:25.816630] [WARN ] [VALIDATOR ] PEW: Validation failed - insufficient historical data. Have 44 unique days, need 150 days [2025-09-16T19:56:25.817137] [FATAL] [MAIN ] PEW: Fetched primary data is invalid. Refusing to save it. [2025-09-16T19:56:25.817233] [WARN ] [MAIN ] PEW: Deleting existing primary and derivative data due to validation failure. [2025-09-16T19:56:25.817315] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-09-16T19:56:25.817437] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-09-16T19:56:25.817496] [INFO ] [LOCAL ] PEW: Starting deletion of derivative data. [2025-09-16T19:56:25.817554] [DEBUG] [LOCAL ] PEW: No derivative data file found to delete. [2025-09-16T19:56:25.817662] [INFO ] [MAIN ] Update Progress: 1661/2369 symbols completed. PEW took 22.4s. Estimated remaining: 1h 15m 11s. Rate: 9.4 symbols/min [2025-09-16T19:56:25.947804] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-16T19:56:25.980081] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-08. [2025-09-16T19:56:26.105965] [INFO ] [MAIN ] PFGC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:56:26.168298] [DEBUG] [LOCAL ] PFGC: Loaded 34948 existing records from primary storage. [2025-09-16T19:56:26.168526] [INFO ] [MAIN ] PFGC: Loaded 34948 existing records. [2025-09-16T19:56:26.405488] [WARN ] [MAIN ] PFGC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:56:26.405838] [INFO ] [MAIN ] PFGC: Wiping existing primary data before full refresh. [2025-09-16T19:56:26.405902] [INFO ] [LOCAL ] PFGC: Starting deletion of primary data. [2025-09-16T19:56:26.406875] [DEBUG] [LOCAL ] PFGC: Deleted primary data file. [2025-09-16T19:56:26.406941] [INFO ] [MAIN ] PFGC: Starting full primary refresh. [2025-09-16T19:56:26.778040] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-07. [2025-09-16T19:56:26.815789] [INFO ] [REMOTE ] PFGC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:56:26.824789] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-16T19:56:26.879397] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-09-16T19:56:27.574986] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-09. [2025-09-16T19:56:27.576468] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-16T19:56:28.374929] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-02. [2025-09-16T19:56:28.975269] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-16T19:56:28.976981] [INFO ] [REMOTE ] PEO: Full fetch complete (11771 records). [2025-09-16T19:56:28.977048] [DEBUG] [VALIDATOR ] PEO: Validating primary data. [2025-09-16T19:56:29.181940] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-03. [2025-09-16T19:56:29.344726] [DEBUG] [VALIDATOR ] PEO: All expected trading days are present. [2025-09-16T19:56:29.344804] [DEBUG] [VALIDATOR ] PEO: Primary data validation passed. [2025-09-16T19:56:29.345131] [INFO ] [MAIN ] PEO: Fetched primary data is valid. [2025-09-16T19:56:29.345174] [DEBUG] [LOCAL ] PEO: Saving primary data. [2025-09-16T19:56:29.345623] [DEBUG] [LOCAL ] PEO: Trimmed 11771 records to 8035 (keeping 150 days of data) [2025-09-16T19:56:29.396629] [DEBUG] [LOCAL ] PEO: Primary data saved (8035 records). [2025-09-16T19:56:29.396749] [INFO ] [MAIN ] PEO: Full history saved. [2025-09-16T19:56:29.396838] [INFO ] [MAIN ] Update Progress: 1662/2369 symbols completed. PEO took 31.6s. Estimated remaining: 1h 15m 3s. Rate: 9.4 symbols/min [2025-09-16T19:56:29.567547] [INFO ] [MAIN ] PFH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:56:29.574933] [DEBUG] [LOCAL ] PFH: Loaded 5083 existing records from primary storage. [2025-09-16T19:56:29.575066] [INFO ] [MAIN ] PFH: Loaded 5083 existing records. [2025-09-16T19:56:29.752829] [WARN ] [MAIN ] PFH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:56:29.753061] [INFO ] [MAIN ] PFH: Wiping existing primary data before full refresh. [2025-09-16T19:56:29.753127] [INFO ] [LOCAL ] PFH: Starting deletion of primary data. [2025-09-16T19:56:29.753341] [DEBUG] [LOCAL ] PFH: Deleted primary data file. [2025-09-16T19:56:29.753386] [INFO ] [MAIN ] PFH: Starting full primary refresh. [2025-09-16T19:56:29.976674] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-08. [2025-09-16T19:56:30.114128] [INFO ] [REMOTE ] PFH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:56:30.140683] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-16T19:56:30.774878] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-03. [2025-09-16T19:56:30.865724] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-16T19:56:31.574904] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-02. [2025-09-16T19:56:31.859205] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-03 (2.68 seconds). [2025-09-16T19:56:32.265057] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-16T19:56:32.348094] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-16T19:56:32.374845] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-04. [2025-09-16T19:56:33.174899] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-09. [2025-09-16T19:56:33.726849] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-16T19:56:33.728108] [INFO ] [REMOTE ] PFD: Full fetch complete (5544 records). [2025-09-16T19:56:33.728175] [DEBUG] [VALIDATOR ] PFD: Validating primary data. [2025-09-16T19:56:33.979942] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-04. [2025-09-16T19:56:34.085104] [DEBUG] [VALIDATOR ] PFD: All expected trading days are present. [2025-09-16T19:56:34.085263] [DEBUG] [VALIDATOR ] PFD: Primary data validation passed. [2025-09-16T19:56:34.085431] [INFO ] [MAIN ] PFD: Fetched primary data is valid. [2025-09-16T19:56:34.085531] [DEBUG] [LOCAL ] PFD: Saving primary data. [2025-09-16T19:56:34.086056] [DEBUG] [LOCAL ] PFD: Trimmed 5544 records to 3849 (keeping 150 days of data) [2025-09-16T19:56:34.134348] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-16T19:56:34.149754] [DEBUG] [LOCAL ] PFD: Primary data saved (3849 records). [2025-09-16T19:56:34.149839] [INFO ] [MAIN ] PFD: Full history saved. [2025-09-16T19:56:34.149934] [INFO ] [MAIN ] Update Progress: 1663/2369 symbols completed. PFD took 25.1s. Estimated remaining: 1h 14m 56s. Rate: 9.4 symbols/min [2025-09-16T19:56:34.321877] [INFO ] [MAIN ] PFL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:56:34.333781] [DEBUG] [LOCAL ] PFL: Loaded 9701 existing records from primary storage. [2025-09-16T19:56:34.333905] [INFO ] [MAIN ] PFL: Loaded 9701 existing records. [2025-09-16T19:56:34.514086] [WARN ] [MAIN ] PFL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:56:34.514341] [INFO ] [MAIN ] PFL: Wiping existing primary data before full refresh. [2025-09-16T19:56:34.514392] [INFO ] [LOCAL ] PFL: Starting deletion of primary data. [2025-09-16T19:56:34.514784] [DEBUG] [LOCAL ] PFL: Deleted primary data file. [2025-09-16T19:56:34.514833] [INFO ] [MAIN ] PFL: Starting full primary refresh. [2025-09-16T19:56:34.780014] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-05. [2025-09-16T19:56:34.872636] [INFO ] [REMOTE ] PFL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:56:35.574915] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-03. [2025-09-16T19:56:36.206808] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-16T19:56:36.374933] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-02. [2025-09-16T19:56:36.578399] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-16T19:56:36.653338] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-09-16T19:56:37.174918] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-06. [2025-09-16T19:56:37.235356] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-16T19:56:37.974911] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-05. [2025-09-16T19:56:38.671884] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-16T19:56:38.774927] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-07. [2025-09-16T19:56:39.574915] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-03. [2025-09-16T19:56:40.377393] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-04. [2025-09-16T19:56:40.400656] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-16T19:56:40.458086] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-09-16T19:56:40.482525] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-16T19:56:40.836047] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-16T19:56:41.174949] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-04. [2025-09-16T19:56:41.974938] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-08. [2025-09-16T19:56:42.263228] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-16T19:56:42.774952] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-05. [2025-09-16T19:56:43.396756] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-16T19:56:43.540478] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-16T19:56:43.574864] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-06. [2025-09-16T19:56:44.272468] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-16T19:56:44.374932] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-05. [2025-09-16T19:56:45.174904] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-07. [2025-09-16T19:56:45.219570] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-16T19:56:45.671747] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-16T19:56:45.974911] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-06. [2025-09-16T19:56:46.774958] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-09. [2025-09-16T19:56:47.574910] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-08. [2025-09-16T19:56:48.245731] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-16T19:56:48.374964] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-09. [2025-09-16T19:56:48.445766] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-09-16T19:56:48.485945] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-16T19:56:48.491999] [INFO ] [REMOTE ] PFGC: Full fetch complete (51122 records). [2025-09-16T19:56:48.492158] [DEBUG] [VALIDATOR ] PFGC: Validating primary data. [2025-09-16T19:56:48.888337] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-16T19:56:48.892182] [DEBUG] [VALIDATOR ] PFGC: All expected trading days are present. [2025-09-16T19:56:48.892273] [INFO ] [REMOTE ] PFH: Full fetch complete (7656 records). [2025-09-16T19:56:48.892321] [DEBUG] [VALIDATOR ] PFGC: Primary data validation passed. [2025-09-16T19:56:48.893298] [INFO ] [MAIN ] PFGC: Fetched primary data is valid. [2025-09-16T19:56:48.893356] [DEBUG] [VALIDATOR ] PFH: Validating primary data. [2025-09-16T19:56:48.893423] [DEBUG] [LOCAL ] PFGC: Saving primary data. [2025-09-16T19:56:49.002484] [DEBUG] [LOCAL ] PFGC: Trimmed 51122 records to 35322 (keeping 150 days of data) [2025-09-16T19:56:49.175495] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-06. [2025-09-16T19:56:49.363795] [DEBUG] [VALIDATOR ] PFH: All expected trading days are present. [2025-09-16T19:56:49.364412] [DEBUG] [VALIDATOR ] PFH: Primary data validation passed. [2025-09-16T19:56:49.365776] [INFO ] [MAIN ] PFH: Fetched primary data is valid. [2025-09-16T19:56:49.366083] [DEBUG] [LOCAL ] PFH: Saving primary data. [2025-09-16T19:56:49.367957] [DEBUG] [LOCAL ] PFH: Trimmed 7656 records to 5118 (keeping 150 days of data) [2025-09-16T19:56:49.403563] [DEBUG] [LOCAL ] PFH: Primary data saved (5118 records). [2025-09-16T19:56:49.404892] [INFO ] [MAIN ] PFH: Full history saved. [2025-09-16T19:56:49.405241] [INFO ] [MAIN ] Update Progress: 1664/2369 symbols completed. PFH took 20.0s. Estimated remaining: 1h 14m 54s. Rate: 9.4 symbols/min [2025-09-16T19:56:49.586667] [INFO ] [MAIN ] PFLT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:56:49.693375] [DEBUG] [LOCAL ] PFLT: Loaded 31333 existing records from primary storage. [2025-09-16T19:56:49.694113] [INFO ] [MAIN ] PFLT: Loaded 31333 existing records. [2025-09-16T19:56:49.880411] [WARN ] [MAIN ] PFLT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:56:49.881705] [INFO ] [MAIN ] PFLT: Wiping existing primary data before full refresh. [2025-09-16T19:56:49.882251] [INFO ] [LOCAL ] PFLT: Starting deletion of primary data. [2025-09-16T19:56:49.883830] [DEBUG] [LOCAL ] PFLT: Deleted primary data file. [2025-09-16T19:56:49.884412] [INFO ] [MAIN ] PFLT: Starting full primary refresh. [2025-09-16T19:56:49.950731] [DEBUG] [LOCAL ] PFGC: Primary data saved (35322 records). [2025-09-16T19:56:49.967063] [INFO ] [MAIN ] PFGC: Full history saved. [2025-09-16T19:56:49.985341] [INFO ] [MAIN ] Update Progress: 1665/2369 symbols completed. PFGC took 24.2s. Estimated remaining: 1h 14m 45s. Rate: 9.4 symbols/min [2025-09-16T19:56:49.985176] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-07. [2025-09-16T19:56:50.339238] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-16T19:56:50.373530] [INFO ] [MAIN ] PFN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:56:50.437326] [INFO ] [REMOTE ] PFLT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:56:50.448836] [DEBUG] [LOCAL ] PFN: Loaded 15476 existing records from primary storage. [2025-09-16T19:56:50.448967] [INFO ] [MAIN ] PFN: Loaded 15476 existing records. [2025-09-16T19:56:50.632256] [WARN ] [MAIN ] PFN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:56:50.632617] [INFO ] [MAIN ] PFN: Wiping existing primary data before full refresh. [2025-09-16T19:56:50.632709] [INFO ] [LOCAL ] PFN: Starting deletion of primary data. [2025-09-16T19:56:50.633333] [DEBUG] [LOCAL ] PFN: Deleted primary data file. [2025-09-16T19:56:50.633417] [INFO ] [MAIN ] PFN: Starting full primary refresh. [2025-09-16T19:56:50.779494] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-07. [2025-09-16T19:56:50.989502] [INFO ] [REMOTE ] PFN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:56:51.574880] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-02. [2025-09-16T19:56:51.711115] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-16T19:56:52.374874] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-08. [2025-09-16T19:56:52.640669] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-16T19:56:52.836118] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-07 (2.85 seconds). [2025-09-16T19:56:53.174889] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-02. [2025-09-16T19:56:53.347888] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-16T19:56:53.974900] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-03. [2025-09-16T19:56:54.774916] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-09. [2025-09-16T19:56:54.891271] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-16T19:56:55.066477] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-16T19:56:55.574927] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-03. [2025-09-16T19:56:55.875978] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-16T19:56:55.879328] [INFO ] [REMOTE ] PFL: Full fetch complete (15147 records). [2025-09-16T19:56:55.879424] [DEBUG] [VALIDATOR ] PFL: Validating primary data. [2025-09-16T19:56:56.241912] [DEBUG] [VALIDATOR ] PFL: All expected trading days are present. [2025-09-16T19:56:56.241989] [DEBUG] [VALIDATOR ] PFL: Primary data validation passed. [2025-09-16T19:56:56.242314] [INFO ] [MAIN ] PFL: Fetched primary data is valid. [2025-09-16T19:56:56.242353] [DEBUG] [LOCAL ] PFL: Saving primary data. [2025-09-16T19:56:56.242864] [DEBUG] [LOCAL ] PFL: Trimmed 15147 records to 9789 (keeping 150 days of data) [2025-09-16T19:56:56.307789] [DEBUG] [LOCAL ] PFL: Primary data saved (9789 records). [2025-09-16T19:56:56.307984] [INFO ] [MAIN ] PFL: Full history saved. [2025-09-16T19:56:56.308085] [INFO ] [MAIN ] Update Progress: 1666/2369 symbols completed. PFL took 22.2s. Estimated remaining: 1h 14m 38s. Rate: 9.4 symbols/min [2025-09-16T19:56:56.381968] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-04. [2025-09-16T19:56:56.478368] [INFO ] [MAIN ] PFO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:56:56.485188] [DEBUG] [LOCAL ] PFO: Loaded 4455 existing records from primary storage. [2025-09-16T19:56:56.485322] [INFO ] [MAIN ] PFO: Loaded 4455 existing records. [2025-09-16T19:56:56.661065] [WARN ] [MAIN ] PFO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:56:56.661295] [INFO ] [MAIN ] PFO: Wiping existing primary data before full refresh. [2025-09-16T19:56:56.661340] [INFO ] [LOCAL ] PFO: Starting deletion of primary data. [2025-09-16T19:56:56.661561] [DEBUG] [LOCAL ] PFO: Deleted primary data file. [2025-09-16T19:56:56.661604] [INFO ] [MAIN ] PFO: Starting full primary refresh. [2025-09-16T19:56:57.020232] [INFO ] [REMOTE ] PFO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:56:57.053194] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-16T19:56:57.174874] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-08. [2025-09-16T19:56:57.651985] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-16T19:56:57.974905] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-04. [2025-09-16T19:56:58.774899] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-05. [2025-09-16T19:56:59.574875] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-02. [2025-09-16T19:56:59.779504] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-08 (2.60 seconds). [2025-09-16T19:56:59.819775] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-16T19:56:59.842857] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-16T19:56:59.962529] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-16T19:57:00.374913] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-03. [2025-09-16T19:57:01.014467] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-16T19:57:01.174961] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-04. [2025-09-16T19:57:01.790868] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-16T19:57:01.974913] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-09. [2025-09-16T19:57:02.774946] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-06. [2025-09-16T19:57:03.574916] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-05. [2025-09-16T19:57:03.976793] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-16T19:57:04.255157] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-16T19:57:04.374943] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-07. [2025-09-16T19:57:04.511831] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-09-16T19:57:04.518724] [INFO ] [REMOTE ] PFE: Full fetch complete (58493 records). [2025-09-16T19:57:04.518899] [DEBUG] [VALIDATOR ] PFE: Validating primary data. [2025-09-16T19:57:04.913879] [DEBUG] [VALIDATOR ] PFE: All expected trading days are present. [2025-09-16T19:57:04.913962] [DEBUG] [VALIDATOR ] PFE: Primary data validation passed. [2025-09-16T19:57:04.914981] [INFO ] [MAIN ] PFE: Fetched primary data is valid. [2025-09-16T19:57:04.915029] [DEBUG] [LOCAL ] PFE: Saving primary data. [2025-09-16T19:57:04.916690] [DEBUG] [LOCAL ] PFE: Trimmed 58493 records to 40163 (keeping 150 days of data) [2025-09-16T19:57:05.175997] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-05. [2025-09-16T19:57:05.181030] [DEBUG] [LOCAL ] PFE: Primary data saved (40163 records). [2025-09-16T19:57:05.181169] [INFO ] [MAIN ] PFE: Full history saved. [2025-09-16T19:57:05.181252] [INFO ] [MAIN ] Update Progress: 1667/2369 symbols completed. PFE took 42.0s. Estimated remaining: 1h 14m 33s. Rate: 9.4 symbols/min [2025-09-16T19:57:05.356425] [INFO ] [MAIN ] PFS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:57:05.381046] [DEBUG] [LOCAL ] PFS: Loaded 25329 existing records from primary storage. [2025-09-16T19:57:05.381171] [INFO ] [MAIN ] PFS: Loaded 25329 existing records. [2025-09-16T19:57:05.557551] [WARN ] [MAIN ] PFS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:57:05.557877] [INFO ] [MAIN ] PFS: Wiping existing primary data before full refresh. [2025-09-16T19:57:05.558040] [INFO ] [LOCAL ] PFS: Starting deletion of primary data. [2025-09-16T19:57:05.563869] [DEBUG] [LOCAL ] PFS: Deleted primary data file. [2025-09-16T19:57:05.572084] [INFO ] [MAIN ] PFS: Starting full primary refresh. [2025-09-16T19:57:05.642729] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-16T19:57:05.928482] [INFO ] [REMOTE ] PFS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:57:05.974879] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-02. [2025-09-16T19:57:06.774920] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-06. [2025-09-16T19:57:06.988309] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-16T19:57:07.359010] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-16T19:57:07.445758] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-16T19:57:07.574890] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-07. [2025-09-16T19:57:08.341530] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-16T19:57:08.374852] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-08. [2025-09-16T19:57:09.146193] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-16T19:57:09.174911] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-06. [2025-09-16T19:57:09.974905] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-09. [2025-09-16T19:57:10.691603] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-16T19:57:10.744849] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-16T19:57:10.746592] [INFO ] [REMOTE ] PFO: Full fetch complete (6022 records). [2025-09-16T19:57:10.746691] [DEBUG] [VALIDATOR ] PFO: Validating primary data. [2025-09-16T19:57:10.779982] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-03. [2025-09-16T19:57:11.101991] [DEBUG] [VALIDATOR ] PFO: All expected trading days are present. [2025-09-16T19:57:11.102076] [DEBUG] [VALIDATOR ] PFO: Primary data validation passed. [2025-09-16T19:57:11.102307] [INFO ] [MAIN ] PFO: Fetched primary data is valid. [2025-09-16T19:57:11.102348] [DEBUG] [LOCAL ] PFO: Saving primary data. [2025-09-16T19:57:11.102804] [DEBUG] [LOCAL ] PFO: Trimmed 6022 records to 4550 (keeping 150 days of data) [2025-09-16T19:57:11.131073] [DEBUG] [LOCAL ] PFO: Primary data saved (4550 records). [2025-09-16T19:57:11.131215] [INFO ] [MAIN ] PFO: Full history saved. [2025-09-16T19:57:11.131312] [INFO ] [MAIN ] Update Progress: 1668/2369 symbols completed. PFO took 14.8s. Estimated remaining: 1h 14m 27s. Rate: 9.4 symbols/min [2025-09-16T19:57:11.300280] [INFO ] [MAIN ] PFSI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:57:11.320482] [DEBUG] [LOCAL ] PFSI: Loaded 20742 existing records from primary storage. [2025-09-16T19:57:11.320613] [INFO ] [MAIN ] PFSI: Loaded 20742 existing records. [2025-09-16T19:57:11.508915] [WARN ] [MAIN ] PFSI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:57:11.509379] [INFO ] [MAIN ] PFSI: Wiping existing primary data before full refresh. [2025-09-16T19:57:11.509428] [INFO ] [LOCAL ] PFSI: Starting deletion of primary data. [2025-09-16T19:57:11.510038] [DEBUG] [LOCAL ] PFSI: Deleted primary data file. [2025-09-16T19:57:11.510086] [INFO ] [MAIN ] PFSI: Starting full primary refresh. [2025-09-16T19:57:11.584700] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-07. [2025-09-16T19:57:11.873140] [INFO ] [REMOTE ] PFSI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:57:12.374942] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-08. [2025-09-16T19:57:12.463606] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-16T19:57:13.174876] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-02. [2025-09-16T19:57:13.285148] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-16T19:57:13.427430] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-16T19:57:13.974875] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-04. [2025-09-16T19:57:14.011061] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-16T19:57:14.774901] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-08. [2025-09-16T19:57:15.039625] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-16T19:57:15.574911] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-09. [2025-09-16T19:57:16.333465] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-16T19:57:16.374850] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-09. [2025-09-16T19:57:16.741788] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-16T19:57:16.745157] [INFO ] [REMOTE ] PFN: Full fetch complete (23295 records). [2025-09-16T19:57:16.745246] [DEBUG] [VALIDATOR ] PFN: Validating primary data. [2025-09-16T19:57:17.114011] [DEBUG] [VALIDATOR ] PFN: All expected trading days are present. [2025-09-16T19:57:17.114133] [DEBUG] [VALIDATOR ] PFN: Primary data validation passed. [2025-09-16T19:57:17.114616] [INFO ] [MAIN ] PFN: Fetched primary data is valid. [2025-09-16T19:57:17.114673] [DEBUG] [LOCAL ] PFN: Saving primary data. [2025-09-16T19:57:17.115300] [DEBUG] [LOCAL ] PFN: Trimmed 23295 records to 15615 (keeping 150 days of data) [2025-09-16T19:57:17.181498] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-05. [2025-09-16T19:57:17.208467] [DEBUG] [LOCAL ] PFN: Primary data saved (15615 records). [2025-09-16T19:57:17.208736] [INFO ] [MAIN ] PFN: Full history saved. [2025-09-16T19:57:17.208848] [INFO ] [MAIN ] Update Progress: 1669/2369 symbols completed. PFN took 27.2s. Estimated remaining: 1h 14m 20s. Rate: 9.4 symbols/min [2025-09-16T19:57:17.377590] [INFO ] [MAIN ] PG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:57:17.419209] [DEBUG] [LOCAL ] PG: Loaded 39714 existing records from primary storage. [2025-09-16T19:57:17.419374] [INFO ] [MAIN ] PG: Loaded 39714 existing records. [2025-09-16T19:57:17.601105] [WARN ] [MAIN ] PG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:57:17.601380] [INFO ] [MAIN ] PG: Wiping existing primary data before full refresh. [2025-09-16T19:57:17.601428] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-09-16T19:57:17.602373] [DEBUG] [LOCAL ] PG: Deleted primary data file. [2025-09-16T19:57:17.602424] [INFO ] [MAIN ] PG: Starting full primary refresh. [2025-09-16T19:57:17.994739] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-03. [2025-09-16T19:57:18.049027] [INFO ] [REMOTE ] PG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:57:18.075447] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-16T19:57:18.084441] [INFO ] [REMOTE ] PFLT: Full fetch complete (47708 records). [2025-09-16T19:57:18.084712] [DEBUG] [VALIDATOR ] PFLT: Validating primary data. [2025-09-16T19:57:18.694317] [DEBUG] [VALIDATOR ] PFLT: All expected trading days are present. [2025-09-16T19:57:18.694735] [DEBUG] [VALIDATOR ] PFLT: Primary data validation passed. [2025-09-16T19:57:18.696195] [INFO ] [MAIN ] PFLT: Fetched primary data is valid. [2025-09-16T19:57:18.696285] [DEBUG] [LOCAL ] PFLT: Saving primary data. [2025-09-16T19:57:18.710957] [DEBUG] [LOCAL ] PFLT: Trimmed 47708 records to 31693 (keeping 150 days of data) [2025-09-16T19:57:18.723597] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-16T19:57:18.793552] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-02. [2025-09-16T19:57:18.949419] [DEBUG] [LOCAL ] PFLT: Primary data saved (31693 records). [2025-09-16T19:57:18.949820] [INFO ] [MAIN ] PFLT: Full history saved. [2025-09-16T19:57:18.949987] [INFO ] [MAIN ] Update Progress: 1670/2369 symbols completed. PFLT took 29.5s. Estimated remaining: 1h 14m 12s. Rate: 9.4 symbols/min [2025-09-16T19:57:19.155846] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-16T19:57:19.160276] [INFO ] [MAIN ] PGP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:57:19.173310] [DEBUG] [LOCAL ] PGP: Loaded 3996 existing records from primary storage. [2025-09-16T19:57:19.173471] [INFO ] [MAIN ] PGP: Loaded 3996 existing records. [2025-09-16T19:57:19.372409] [WARN ] [MAIN ] PGP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:57:19.372760] [INFO ] [MAIN ] PGP: Wiping existing primary data before full refresh. [2025-09-16T19:57:19.372811] [INFO ] [LOCAL ] PGP: Starting deletion of primary data. [2025-09-16T19:57:19.373183] [DEBUG] [LOCAL ] PGP: Deleted primary data file. [2025-09-16T19:57:19.373228] [INFO ] [MAIN ] PGP: Starting full primary refresh. [2025-09-16T19:57:19.586958] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-04. [2025-09-16T19:57:19.735364] [INFO ] [REMOTE ] PGP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:57:20.374941] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-06. [2025-09-16T19:57:20.842551] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-16T19:57:21.134144] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-16T19:57:21.174870] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-05. [2025-09-16T19:57:21.319081] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-16T19:57:21.974904] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-07. [2025-09-16T19:57:22.454404] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-16T19:57:22.774947] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-02. [2025-09-16T19:57:23.382443] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-16T19:57:23.455559] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-16T19:57:23.574910] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-08. [2025-09-16T19:57:24.374901] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-03. [2025-09-16T19:57:24.950607] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-16T19:57:25.174999] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-09. [2025-09-16T19:57:25.974898] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-06. [2025-09-16T19:57:26.423768] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-16T19:57:26.445465] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-16T19:57:26.449457] [INFO ] [REMOTE ] PFS: Full fetch complete (38685 records). [2025-09-16T19:57:26.449541] [DEBUG] [VALIDATOR ] PFS: Validating primary data. [2025-09-16T19:57:26.784100] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-04. [2025-09-16T19:57:26.830461] [DEBUG] [VALIDATOR ] PFS: All expected trading days are present. [2025-09-16T19:57:26.830544] [DEBUG] [VALIDATOR ] PFS: Primary data validation passed. [2025-09-16T19:57:26.831317] [INFO ] [MAIN ] PFS: Fetched primary data is valid. [2025-09-16T19:57:26.831363] [DEBUG] [LOCAL ] PFS: Saving primary data. [2025-09-16T19:57:26.832296] [DEBUG] [LOCAL ] PFS: Trimmed 38685 records to 25628 (keeping 150 days of data) [2025-09-16T19:57:26.966286] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-16T19:57:27.022376] [DEBUG] [LOCAL ] PFS: Primary data saved (25628 records). [2025-09-16T19:57:27.022566] [INFO ] [MAIN ] PFS: Full history saved. [2025-09-16T19:57:27.022697] [INFO ] [MAIN ] Update Progress: 1671/2369 symbols completed. PFS took 21.8s. Estimated remaining: 1h 14m 6s. Rate: 9.4 symbols/min [2025-09-16T19:57:27.198407] [INFO ] [MAIN ] PGR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:57:27.235351] [DEBUG] [LOCAL ] PGR: Loaded 39044 existing records from primary storage. [2025-09-16T19:57:27.235495] [INFO ] [MAIN ] PGR: Loaded 39044 existing records. [2025-09-16T19:57:27.426431] [WARN ] [MAIN ] PGR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:57:27.426723] [INFO ] [MAIN ] PGR: Wiping existing primary data before full refresh. [2025-09-16T19:57:27.426772] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-09-16T19:57:27.427785] [DEBUG] [LOCAL ] PGR: Deleted primary data file. [2025-09-16T19:57:27.427850] [INFO ] [MAIN ] PGR: Starting full primary refresh. [2025-09-16T19:57:27.581010] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-07. [2025-09-16T19:57:27.802607] [INFO ] [REMOTE ] PGR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:57:28.374909] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-03. [2025-09-16T19:57:28.954022] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-16T19:57:28.955089] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-16T19:57:29.049957] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-16T19:57:29.174907] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-04. [2025-09-16T19:57:29.923617] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-16T19:57:29.974929] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-05. [2025-09-16T19:57:30.577217] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-16T19:57:30.774898] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-06. [2025-09-16T19:57:31.395673] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-16T19:57:31.574901] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-02. [2025-09-16T19:57:32.374940] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-05. [2025-09-16T19:57:33.174872] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-07. [2025-09-16T19:57:33.220788] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-16T19:57:33.812260] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-16T19:57:33.974905] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-08. [2025-09-16T19:57:34.599437] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-16T19:57:34.627609] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-16T19:57:34.774941] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-06. [2025-09-16T19:57:35.574936] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-08. [2025-09-16T19:57:36.374875] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-03. [2025-09-16T19:57:36.889349] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-16T19:57:36.917764] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-16T19:57:37.174897] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-09. [2025-09-16T19:57:37.693872] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-16T19:57:37.695282] [INFO ] [REMOTE ] PGP: Full fetch complete (5918 records). [2025-09-16T19:57:37.695353] [DEBUG] [VALIDATOR ] PGP: Validating primary data. [2025-09-16T19:57:37.977371] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-09. [2025-09-16T19:57:38.055251] [DEBUG] [VALIDATOR ] PGP: All expected trading days are present. [2025-09-16T19:57:38.055330] [DEBUG] [VALIDATOR ] PGP: Primary data validation passed. [2025-09-16T19:57:38.055523] [INFO ] [MAIN ] PGP: Fetched primary data is valid. [2025-09-16T19:57:38.055578] [DEBUG] [LOCAL ] PGP: Saving primary data. [2025-09-16T19:57:38.055986] [DEBUG] [LOCAL ] PGP: Trimmed 5918 records to 4027 (keeping 150 days of data) [2025-09-16T19:57:38.080071] [DEBUG] [LOCAL ] PGP: Primary data saved (4027 records). [2025-09-16T19:57:38.080174] [INFO ] [MAIN ] PGP: Full history saved. [2025-09-16T19:57:38.080267] [INFO ] [MAIN ] Update Progress: 1672/2369 symbols completed. PGP took 19.1s. Estimated remaining: 1h 14m 2s. Rate: 9.4 symbols/min [2025-09-16T19:57:38.250168] [INFO ] [MAIN ] PGRE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:57:38.281996] [DEBUG] [LOCAL ] PGRE: Loaded 34520 existing records from primary storage. [2025-09-16T19:57:38.282135] [INFO ] [MAIN ] PGRE: Loaded 34520 existing records. [2025-09-16T19:57:38.465201] [WARN ] [MAIN ] PGRE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:57:38.465587] [INFO ] [MAIN ] PGRE: Wiping existing primary data before full refresh. [2025-09-16T19:57:38.465669] [INFO ] [LOCAL ] PGRE: Starting deletion of primary data. [2025-09-16T19:57:38.466468] [DEBUG] [LOCAL ] PGRE: Deleted primary data file. [2025-09-16T19:57:38.466514] [INFO ] [MAIN ] PGRE: Starting full primary refresh. [2025-09-16T19:57:38.777613] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-07. [2025-09-16T19:57:38.790816] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-09-16T19:57:38.869131] [INFO ] [REMOTE ] PGRE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:57:39.043323] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-16T19:57:39.047839] [INFO ] [REMOTE ] PFSI: Full fetch complete (30952 records). [2025-09-16T19:57:39.047992] [DEBUG] [VALIDATOR ] PFSI: Validating primary data. [2025-09-16T19:57:39.410306] [DEBUG] [VALIDATOR ] PFSI: All expected trading days are present. [2025-09-16T19:57:39.410388] [DEBUG] [VALIDATOR ] PFSI: Primary data validation passed. [2025-09-16T19:57:39.411047] [INFO ] [MAIN ] PFSI: Fetched primary data is valid. [2025-09-16T19:57:39.411091] [DEBUG] [LOCAL ] PFSI: Saving primary data. [2025-09-16T19:57:39.411862] [DEBUG] [LOCAL ] PFSI: Trimmed 30952 records to 20936 (keeping 150 days of data) [2025-09-16T19:57:39.544822] [DEBUG] [LOCAL ] PFSI: Primary data saved (20936 records). [2025-09-16T19:57:39.544957] [INFO ] [MAIN ] PFSI: Full history saved. [2025-09-16T19:57:39.545038] [INFO ] [MAIN ] Update Progress: 1673/2369 symbols completed. PFSI took 28.4s. Estimated remaining: 1h 13m 53s. Rate: 9.4 symbols/min [2025-09-16T19:57:39.580048] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-04. [2025-09-16T19:57:39.722015] [INFO ] [MAIN ] PGZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:57:39.728480] [DEBUG] [LOCAL ] PGZ: Loaded 4127 existing records from primary storage. [2025-09-16T19:57:39.728618] [INFO ] [MAIN ] PGZ: Loaded 4127 existing records. [2025-09-16T19:57:39.916064] [WARN ] [MAIN ] PGZ: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:57:39.916341] [INFO ] [MAIN ] PGZ: Wiping existing primary data before full refresh. [2025-09-16T19:57:39.916390] [INFO ] [LOCAL ] PGZ: Starting deletion of primary data. [2025-09-16T19:57:39.916695] [DEBUG] [LOCAL ] PGZ: Deleted primary data file. [2025-09-16T19:57:39.916745] [INFO ] [MAIN ] PGZ: Starting full primary refresh. [2025-09-16T19:57:40.288340] [INFO ] [REMOTE ] PGZ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:57:40.374862] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-02. [2025-09-16T19:57:40.804851] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-16T19:57:41.180016] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-02. [2025-09-16T19:57:41.195868] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-09-16T19:57:41.765866] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-16T19:57:41.974971] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-08. [2025-09-16T19:57:42.099910] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-16T19:57:42.774895] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-03. [2025-09-16T19:57:43.574917] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-03. [2025-09-16T19:57:44.034972] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-16T19:57:44.163029] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-16T19:57:44.254317] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-16T19:57:44.374868] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-04. [2025-09-16T19:57:45.174929] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-04. [2025-09-16T19:57:45.783953] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-16T19:57:45.975592] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-05. [2025-09-16T19:57:45.979335] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-16T19:57:46.774908] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-09. [2025-09-16T19:57:47.574904] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-05. [2025-09-16T19:57:47.909122] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-16T19:57:48.374923] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-06. [2025-09-16T19:57:48.663204] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-16T19:57:48.669685] [INFO ] [REMOTE ] PG: Full fetch complete (58431 records). [2025-09-16T19:57:48.669798] [DEBUG] [VALIDATOR ] PG: Validating primary data. [2025-09-16T19:57:49.050387] [DEBUG] [VALIDATOR ] PG: All expected trading days are present. [2025-09-16T19:57:49.050562] [DEBUG] [VALIDATOR ] PG: Primary data validation passed. [2025-09-16T19:57:49.051523] [INFO ] [MAIN ] PG: Fetched primary data is valid. [2025-09-16T19:57:49.051614] [DEBUG] [LOCAL ] PG: Saving primary data. [2025-09-16T19:57:49.052971] [DEBUG] [LOCAL ] PG: Trimmed 58431 records to 40104 (keeping 150 days of data) [2025-09-16T19:57:49.173111] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-16T19:57:49.183203] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-05. [2025-09-16T19:57:49.349550] [DEBUG] [LOCAL ] PG: Primary data saved (40104 records). [2025-09-16T19:57:49.349718] [INFO ] [MAIN ] PG: Full history saved. [2025-09-16T19:57:49.350512] [INFO ] [MAIN ] Update Progress: 1674/2369 symbols completed. PG took 32.1s. Estimated remaining: 1h 13m 48s. Rate: 9.4 symbols/min [2025-09-16T19:57:49.519461] [INFO ] [MAIN ] PH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:57:49.547177] [DEBUG] [LOCAL ] PH: Loaded 27509 existing records from primary storage. [2025-09-16T19:57:49.547346] [INFO ] [MAIN ] PH: Loaded 27509 existing records. [2025-09-16T19:57:49.663308] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-16T19:57:49.737378] [WARN ] [MAIN ] PH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:57:49.737748] [INFO ] [MAIN ] PH: Wiping existing primary data before full refresh. [2025-09-16T19:57:49.737850] [INFO ] [LOCAL ] PH: Starting deletion of primary data. [2025-09-16T19:57:49.738664] [DEBUG] [LOCAL ] PH: Deleted primary data file. [2025-09-16T19:57:49.738725] [INFO ] [MAIN ] PH: Starting full primary refresh. [2025-09-16T19:57:49.982510] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-06. [2025-09-16T19:57:50.141910] [INFO ] [REMOTE ] PH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:57:50.144948] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-16T19:57:50.774918] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-06. [2025-09-16T19:57:51.493672] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-16T19:57:51.498008] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-16T19:57:51.574884] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-07. [2025-09-16T19:57:52.216122] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-16T19:57:52.374931] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-02. [2025-09-16T19:57:53.174898] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-07. [2025-09-16T19:57:53.525544] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-16T19:57:53.974919] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-03. [2025-09-16T19:57:54.786326] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-07. [2025-09-16T19:57:54.791364] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-16T19:57:55.574980] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-08. [2025-09-16T19:57:55.751619] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-16T19:57:56.374891] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-04. [2025-09-16T19:57:56.858718] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-16T19:57:57.174908] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-08. [2025-09-16T19:57:57.219125] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-16T19:57:57.930779] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-16T19:57:57.974861] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-09. [2025-09-16T19:57:58.124606] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-16T19:57:58.662121] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-16T19:57:58.663480] [INFO ] [REMOTE ] PGZ: Full fetch complete (5884 records). [2025-09-16T19:57:58.663547] [DEBUG] [VALIDATOR ] PGZ: Validating primary data. [2025-09-16T19:57:58.779971] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-09. [2025-09-16T19:57:59.020954] [DEBUG] [VALIDATOR ] PGZ: All expected trading days are present. [2025-09-16T19:57:59.021034] [DEBUG] [VALIDATOR ] PGZ: Primary data validation passed. [2025-09-16T19:57:59.021223] [INFO ] [MAIN ] PGZ: Fetched primary data is valid. [2025-09-16T19:57:59.021261] [DEBUG] [LOCAL ] PGZ: Saving primary data. [2025-09-16T19:57:59.021635] [DEBUG] [LOCAL ] PGZ: Trimmed 5884 records to 4157 (keeping 150 days of data) [2025-09-16T19:57:59.047209] [DEBUG] [LOCAL ] PGZ: Primary data saved (4157 records). [2025-09-16T19:57:59.047297] [INFO ] [MAIN ] PGZ: Full history saved. [2025-09-16T19:57:59.047391] [INFO ] [MAIN ] Update Progress: 1675/2369 symbols completed. PGZ took 19.5s. Estimated remaining: 1h 13m 43s. Rate: 9.4 symbols/min [2025-09-16T19:57:59.245154] [INFO ] [MAIN ] PHD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:57:59.253262] [DEBUG] [LOCAL ] PHD: Loaded 6800 existing records from primary storage. [2025-09-16T19:57:59.253373] [INFO ] [MAIN ] PHD: Loaded 6800 existing records. [2025-09-16T19:57:59.432191] [WARN ] [MAIN ] PHD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:57:59.432458] [INFO ] [MAIN ] PHD: Wiping existing primary data before full refresh. [2025-09-16T19:57:59.432504] [INFO ] [LOCAL ] PHD: Starting deletion of primary data. [2025-09-16T19:57:59.432792] [DEBUG] [LOCAL ] PHD: Deleted primary data file. [2025-09-16T19:57:59.432838] [INFO ] [MAIN ] PHD: Starting full primary refresh. [2025-09-16T19:57:59.580605] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-05. [2025-09-16T19:57:59.800892] [INFO ] [REMOTE ] PHD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:58:00.349380] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-16T19:58:00.355520] [INFO ] [REMOTE ] PGRE: Full fetch complete (48822 records). [2025-09-16T19:58:00.355703] [DEBUG] [VALIDATOR ] PGRE: Validating primary data. [2025-09-16T19:58:00.380001] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-08. [2025-09-16T19:58:00.751868] [DEBUG] [VALIDATOR ] PGRE: All expected trading days are present. [2025-09-16T19:58:00.751947] [DEBUG] [VALIDATOR ] PGRE: Primary data validation passed. [2025-09-16T19:58:00.753014] [INFO ] [MAIN ] PGRE: Fetched primary data is valid. [2025-09-16T19:58:00.753069] [DEBUG] [LOCAL ] PGRE: Saving primary data. [2025-09-16T19:58:00.754085] [DEBUG] [LOCAL ] PGRE: Trimmed 48822 records to 34845 (keeping 150 days of data) [2025-09-16T19:58:00.953281] [DEBUG] [LOCAL ] PGRE: Primary data saved (34845 records). [2025-09-16T19:58:00.953422] [INFO ] [MAIN ] PGRE: Full history saved. [2025-09-16T19:58:00.953506] [INFO ] [MAIN ] Update Progress: 1676/2369 symbols completed. PGRE took 22.9s. Estimated remaining: 1h 13m 35s. Rate: 9.4 symbols/min [2025-09-16T19:58:01.122086] [INFO ] [MAIN ] PHG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:58:01.153975] [DEBUG] [LOCAL ] PHG: Loaded 33960 existing records from primary storage. [2025-09-16T19:58:01.154129] [INFO ] [MAIN ] PHG: Loaded 33960 existing records. [2025-09-16T19:58:01.185248] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-02. [2025-09-16T19:58:01.332773] [WARN ] [MAIN ] PHG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:58:01.333096] [INFO ] [MAIN ] PHG: Wiping existing primary data before full refresh. [2025-09-16T19:58:01.333146] [INFO ] [LOCAL ] PHG: Starting deletion of primary data. [2025-09-16T19:58:01.333845] [DEBUG] [LOCAL ] PHG: Deleted primary data file. [2025-09-16T19:58:01.333894] [INFO ] [MAIN ] PHG: Starting full primary refresh. [2025-09-16T19:58:01.516658] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-16T19:58:01.723245] [INFO ] [REMOTE ] PHG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:58:01.974906] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-02. [2025-09-16T19:58:01.992813] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-16T19:58:02.355074] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-16T19:58:02.774926] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-06. [2025-09-16T19:58:03.548567] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-16T19:58:03.574863] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-03. [2025-09-16T19:58:04.268822] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-16T19:58:04.374897] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-07. [2025-09-16T19:58:05.174951] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-09. [2025-09-16T19:58:05.326057] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-16T19:58:05.894433] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-16T19:58:05.974936] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-04. [2025-09-16T19:58:06.774920] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-08. [2025-09-16T19:58:07.072166] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-16T19:58:07.078286] [INFO ] [REMOTE ] PGR: Full fetch complete (57642 records). [2025-09-16T19:58:07.078393] [DEBUG] [VALIDATOR ] PGR: Validating primary data. [2025-09-16T19:58:07.460215] [DEBUG] [VALIDATOR ] PGR: All expected trading days are present. [2025-09-16T19:58:07.460311] [DEBUG] [VALIDATOR ] PGR: Primary data validation passed. [2025-09-16T19:58:07.461510] [INFO ] [MAIN ] PGR: Fetched primary data is valid. [2025-09-16T19:58:07.461566] [DEBUG] [LOCAL ] PGR: Saving primary data. [2025-09-16T19:58:07.462819] [DEBUG] [LOCAL ] PGR: Trimmed 57642 records to 39425 (keeping 150 days of data) [2025-09-16T19:58:07.586413] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-03. [2025-09-16T19:58:07.619949] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-16T19:58:07.763623] [DEBUG] [LOCAL ] PGR: Primary data saved (39425 records). [2025-09-16T19:58:07.763797] [INFO ] [MAIN ] PGR: Full history saved. [2025-09-16T19:58:07.765223] [INFO ] [MAIN ] Update Progress: 1677/2369 symbols completed. PGR took 40.7s. Estimated remaining: 1h 13m 29s. Rate: 9.4 symbols/min [2025-09-16T19:58:08.303293] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-16T19:58:08.347115] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-16T19:58:08.374910] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-09. [2025-09-16T19:58:09.174950] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-04. [2025-09-16T19:58:09.777544] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-16T19:58:09.781795] [INFO ] [REMOTE ] PH: Full fetch complete (42935 records). [2025-09-16T19:58:09.781897] [DEBUG] [VALIDATOR ] PH: Validating primary data. [2025-09-16T19:58:09.975358] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-05. [2025-09-16T19:58:10.090414] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-16T19:58:10.182183] [DEBUG] [VALIDATOR ] PH: All expected trading days are present. [2025-09-16T19:58:10.182277] [DEBUG] [VALIDATOR ] PH: Primary data validation passed. [2025-09-16T19:58:10.183085] [INFO ] [MAIN ] PH: Fetched primary data is valid. [2025-09-16T19:58:10.183149] [DEBUG] [LOCAL ] PH: Saving primary data. [2025-09-16T19:58:10.184373] [DEBUG] [LOCAL ] PH: Trimmed 42935 records to 27760 (keeping 150 days of data) [2025-09-16T19:58:10.368484] [DEBUG] [LOCAL ] PH: Primary data saved (27760 records). [2025-09-16T19:58:10.368659] [INFO ] [MAIN ] PH: Full history saved. [2025-09-16T19:58:10.368759] [INFO ] [MAIN ] Update Progress: 1678/2369 symbols completed. PH took 21.0s. Estimated remaining: 1h 13m 21s. Rate: 9.4 symbols/min [2025-09-16T19:58:10.774981] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-05. [2025-09-16T19:58:11.600850] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-16T19:58:11.603407] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-06. [2025-09-16T19:58:11.716517] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-16T19:58:12.362218] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-16T19:58:12.374839] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-07. [2025-09-16T19:58:13.136765] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-16T19:58:13.174949] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-08. [2025-09-16T19:58:13.856564] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-16T19:58:13.975018] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-09. [2025-09-16T19:58:14.774939] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-06. [2025-09-16T19:58:14.881607] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-16T19:58:14.883498] [INFO ] [REMOTE ] PHD: Full fetch complete (10230 records). [2025-09-16T19:58:14.883576] [DEBUG] [VALIDATOR ] PHD: Validating primary data. [2025-09-16T19:58:15.239109] [DEBUG] [VALIDATOR ] PHD: All expected trading days are present. [2025-09-16T19:58:15.239185] [DEBUG] [VALIDATOR ] PHD: Primary data validation passed. [2025-09-16T19:58:15.239415] [INFO ] [MAIN ] PHD: Fetched primary data is valid. [2025-09-16T19:58:15.239455] [DEBUG] [LOCAL ] PHD: Saving primary data. [2025-09-16T19:58:15.239905] [DEBUG] [LOCAL ] PHD: Trimmed 10230 records to 6883 (keeping 150 days of data) [2025-09-16T19:58:15.280790] [DEBUG] [LOCAL ] PHD: Primary data saved (6883 records). [2025-09-16T19:58:15.280894] [INFO ] [MAIN ] PHD: Full history saved. [2025-09-16T19:58:15.280985] [INFO ] [MAIN ] Update Progress: 1679/2369 symbols completed. PHD took 16.2s. Estimated remaining: 1h 13m 14s. Rate: 9.4 symbols/min [2025-09-16T19:58:16.183079] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-16T19:58:16.194709] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-07. [2025-09-16T19:58:17.911725] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-16T19:58:17.922702] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-08. [2025-09-16T19:58:19.469627] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-16T19:58:19.479815] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-09. [2025-09-16T19:58:20.752921] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-16T19:58:20.759702] [INFO ] [REMOTE ] PHG: Full fetch complete (50261 records). [2025-09-16T19:58:20.759824] [DEBUG] [VALIDATOR ] PHG: Validating primary data. [2025-09-16T19:58:21.146533] [DEBUG] [VALIDATOR ] PHG: All expected trading days are present. [2025-09-16T19:58:21.146615] [DEBUG] [VALIDATOR ] PHG: Primary data validation passed. [2025-09-16T19:58:21.147464] [INFO ] [MAIN ] PHG: Fetched primary data is valid. [2025-09-16T19:58:21.147521] [DEBUG] [LOCAL ] PHG: Saving primary data. [2025-09-16T19:58:21.148564] [DEBUG] [LOCAL ] PHG: Trimmed 50261 records to 34281 (keeping 150 days of data) [2025-09-16T19:58:21.357818] [DEBUG] [LOCAL ] PHG: Primary data saved (34281 records). [2025-09-16T19:58:21.357964] [INFO ] [MAIN ] PHG: Full history saved. [2025-09-16T19:58:21.358058] [INFO ] [MAIN ] Update Progress: 1680/2369 symbols completed. PHG took 20.4s. Estimated remaining: 1h 13m 8s. Rate: 9.4 symbols/min [2025-09-16T19:58:21.904576] [INFO ] [MAIN ] PHI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:58:22.062750] [INFO ] [MAIN ] PHM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:58:22.061804] [INFO ] [MAIN ] PHK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:58:22.086567] [INFO ] [MAIN ] PHIN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:58:22.098152] [DEBUG] [LOCAL ] PHI: Loaded 10763 existing records from primary storage. [2025-09-16T19:58:22.098336] [INFO ] [MAIN ] PHI: Loaded 10763 existing records. [2025-09-16T19:58:22.320682] [DEBUG] [LOCAL ] PHK: Loaded 19047 existing records from primary storage. [2025-09-16T19:58:22.324035] [DEBUG] [LOCAL ] PHIN: Loaded 23192 existing records from primary storage. [2025-09-16T19:58:22.336902] [INFO ] [MAIN ] PHIN: Loaded 23192 existing records. [2025-09-16T19:58:22.396541] [DEBUG] [LOCAL ] PHM: Loaded 38096 existing records from primary storage. [2025-09-16T19:58:22.381546] [INFO ] [MAIN ] PHK: Loaded 19047 existing records. [2025-09-16T19:58:22.381384] [WARN ] [MAIN ] PHI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:58:22.437588] [INFO ] [MAIN ] PHM: Loaded 38096 existing records. [2025-09-16T19:58:22.642911] [INFO ] [MAIN ] PHI: Wiping existing primary data before full refresh. [2025-09-16T19:58:22.755123] [INFO ] [LOCAL ] PHI: Starting deletion of primary data. [2025-09-16T19:58:22.811500] [DEBUG] [LOCAL ] PHI: Deleted primary data file. [2025-09-16T19:58:22.825215] [WARN ] [MAIN ] PHIN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:58:22.857574] [INFO ] [MAIN ] PHIN: Wiping existing primary data before full refresh. [2025-09-16T19:58:22.857452] [INFO ] [MAIN ] PHI: Starting full primary refresh. [2025-09-16T19:58:22.861312] [INFO ] [LOCAL ] PHIN: Starting deletion of primary data. [2025-09-16T19:58:22.861199] [WARN ] [MAIN ] PHK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:58:22.904605] [DEBUG] [LOCAL ] PHIN: Deleted primary data file. [2025-09-16T19:58:22.942510] [INFO ] [MAIN ] PHK: Wiping existing primary data before full refresh. [2025-09-16T19:58:22.975442] [INFO ] [MAIN ] PHIN: Starting full primary refresh. [2025-09-16T19:58:23.064822] [INFO ] [LOCAL ] PHK: Starting deletion of primary data. [2025-09-16T19:58:23.073845] [WARN ] [MAIN ] PHM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:58:23.171585] [DEBUG] [LOCAL ] PHK: Deleted primary data file. [2025-09-16T19:58:23.185959] [INFO ] [MAIN ] PHK: Starting full primary refresh. [2025-09-16T19:58:23.221571] [INFO ] [MAIN ] PHM: Wiping existing primary data before full refresh. [2025-09-16T19:58:23.255755] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-09-16T19:58:23.321070] [DEBUG] [LOCAL ] PHM: Deleted primary data file. [2025-09-16T19:58:23.370892] [INFO ] [MAIN ] PHM: Starting full primary refresh. [2025-09-16T19:58:24.110921] [INFO ] [REMOTE ] PHI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:58:24.233965] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-02. [2025-09-16T19:58:24.185720] [INFO ] [REMOTE ] PHIN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:58:24.294569] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-02. [2025-09-16T19:58:24.457043] [INFO ] [REMOTE ] PHK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:58:24.477075] [INFO ] [REMOTE ] PHM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:58:24.477539] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-02. [2025-09-16T19:58:24.478798] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-02. [2025-09-16T19:58:25.178853] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-16T19:58:25.181754] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-03. [2025-09-16T19:58:25.376899] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-16T19:58:25.383778] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-03. [2025-09-16T19:58:25.439544] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-16T19:58:25.445162] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-03. [2025-09-16T19:58:26.193852] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-16T19:58:26.215310] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-16T19:58:26.214817] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-03. [2025-09-16T19:58:26.220258] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-04. [2025-09-16T19:58:26.553871] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-16T19:58:26.562448] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-04. [2025-09-16T19:58:26.679144] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-16T19:58:26.685203] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-04. [2025-09-16T19:58:27.225803] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-16T19:58:27.229595] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-05. [2025-09-16T19:58:27.759517] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-16T19:58:27.768022] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-05. [2025-09-16T19:58:27.948736] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-16T19:58:28.074129] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-16T19:58:28.089895] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-16T19:58:28.374904] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-06. [2025-09-16T19:58:28.986614] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-16T19:58:29.040393] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-16T19:58:29.174905] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-07. [2025-09-16T19:58:29.974897] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-04. [2025-09-16T19:58:30.097317] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-16T19:58:30.774899] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-06. [2025-09-16T19:58:31.574900] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-05. [2025-09-16T19:58:31.873023] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-16T19:58:32.007291] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-16T19:58:32.374889] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-05. [2025-09-16T19:58:32.684759] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-16T19:58:33.174902] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-06. [2025-09-16T19:58:33.974940] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-08. [2025-09-16T19:58:34.164975] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-16T19:58:34.313805] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-16T19:58:34.705706] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-16T19:58:34.774909] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-09. [2025-09-16T19:58:34.886608] [DEBUG] [REMOTE ] PHI: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-09-16T19:58:34.886958] [WARN ] [REMOTE ] PHI: No data returned for month 2025-09 [2025-09-16T19:58:34.887075] [INFO ] [REMOTE ] PHI: Full fetch complete (14027 records). [2025-09-16T19:58:34.887161] [DEBUG] [VALIDATOR ] PHI: Validating primary data. [2025-09-16T19:58:34.887901] [FATAL] [VALIDATOR ] PHI: Data is stale - most recent date (2025-08-29) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T19:58:34.887987] [FATAL] [MAIN ] PHI: Fetched primary data is invalid. Refusing to save it. [2025-09-16T19:58:34.888101] [WARN ] [MAIN ] PHI: Deleting existing primary and derivative data due to validation failure. [2025-09-16T19:58:34.888187] [INFO ] [LOCAL ] PHI: Starting deletion of primary data. [2025-09-16T19:58:34.888265] [DEBUG] [LOCAL ] PHI: No primary data file found to delete. [2025-09-16T19:58:34.888302] [INFO ] [LOCAL ] PHI: Starting deletion of derivative data. [2025-09-16T19:58:34.888631] [DEBUG] [LOCAL ] PHI: Deleted derivative data file. [2025-09-16T19:58:34.888856] [INFO ] [MAIN ] Update Progress: 1681/2369 symbols completed. PHI took 13.5s. Estimated remaining: 1h 13m 4s. Rate: 9.4 symbols/min [2025-09-16T19:58:35.071146] [INFO ] [MAIN ] PHR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:58:35.099094] [DEBUG] [LOCAL ] PHR: Loaded 27259 existing records from primary storage. [2025-09-16T19:58:35.099283] [INFO ] [MAIN ] PHR: Loaded 27259 existing records. [2025-09-16T19:58:35.285170] [WARN ] [MAIN ] PHR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:58:35.285477] [INFO ] [MAIN ] PHR: Wiping existing primary data before full refresh. [2025-09-16T19:58:35.285528] [INFO ] [LOCAL ] PHR: Starting deletion of primary data. [2025-09-16T19:58:35.286218] [DEBUG] [LOCAL ] PHR: Deleted primary data file. [2025-09-16T19:58:35.286269] [INFO ] [MAIN ] PHR: Starting full primary refresh. [2025-09-16T19:58:35.578925] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-06. [2025-09-16T19:58:35.660417] [INFO ] [REMOTE ] PHR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:58:36.374942] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-02. [2025-09-16T19:58:37.179976] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-07. [2025-09-16T19:58:37.199831] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-16T19:58:37.688676] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-16T19:58:37.974948] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-07. [2025-09-16T19:58:38.357761] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-16T19:58:38.774952] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-07. [2025-09-16T19:58:39.156601] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-16T19:58:39.574963] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-03. [2025-09-16T19:58:40.374968] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-08. [2025-09-16T19:58:40.664936] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-16T19:58:40.911846] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-16T19:58:41.174878] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-04. [2025-09-16T19:58:41.265706] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-16T19:58:41.974920] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-09. [2025-09-16T19:58:42.575946] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-16T19:58:42.774910] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-08. [2025-09-16T19:58:43.150935] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-16T19:58:43.155009] [INFO ] [REMOTE ] PHK: Full fetch complete (29096 records). [2025-09-16T19:58:43.155087] [DEBUG] [VALIDATOR ] PHK: Validating primary data. [2025-09-16T19:58:43.519905] [DEBUG] [VALIDATOR ] PHK: All expected trading days are present. [2025-09-16T19:58:43.519993] [DEBUG] [VALIDATOR ] PHK: Primary data validation passed. [2025-09-16T19:58:43.520565] [INFO ] [MAIN ] PHK: Fetched primary data is valid. [2025-09-16T19:58:43.520636] [DEBUG] [LOCAL ] PHK: Saving primary data. [2025-09-16T19:58:43.521399] [DEBUG] [LOCAL ] PHK: Trimmed 29096 records to 19231 (keeping 150 days of data) [2025-09-16T19:58:43.583067] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-08. [2025-09-16T19:58:43.643897] [DEBUG] [LOCAL ] PHK: Primary data saved (19231 records). [2025-09-16T19:58:43.644065] [INFO ] [MAIN ] PHK: Full history saved. [2025-09-16T19:58:43.644155] [INFO ] [MAIN ] Update Progress: 1682/2369 symbols completed. PHK took 22.3s. Estimated remaining: 1h 12m 59s. Rate: 9.4 symbols/min [2025-09-16T19:58:43.820088] [INFO ] [MAIN ] PHT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:58:43.831921] [DEBUG] [LOCAL ] PHT: Loaded 11962 existing records from primary storage. [2025-09-16T19:58:43.832059] [INFO ] [MAIN ] PHT: Loaded 11962 existing records. [2025-09-16T19:58:44.011874] [WARN ] [MAIN ] PHT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:58:44.012166] [INFO ] [MAIN ] PHT: Wiping existing primary data before full refresh. [2025-09-16T19:58:44.012223] [INFO ] [LOCAL ] PHT: Starting deletion of primary data. [2025-09-16T19:58:44.012627] [DEBUG] [LOCAL ] PHT: Deleted primary data file. [2025-09-16T19:58:44.012703] [INFO ] [MAIN ] PHT: Starting full primary refresh. [2025-09-16T19:58:44.371226] [INFO ] [REMOTE ] PHT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:58:44.374848] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-02. [2025-09-16T19:58:44.470491] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-16T19:58:44.849186] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-16T19:58:44.861298] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-16T19:58:45.174954] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-03. [2025-09-16T19:58:45.974909] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-09. [2025-09-16T19:58:46.089539] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-16T19:58:46.774949] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-04. [2025-09-16T19:58:47.574981] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-09. [2025-09-16T19:58:47.735164] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-16T19:58:47.799907] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-16T19:58:47.806173] [INFO ] [REMOTE ] PHM: Full fetch complete (56298 records). [2025-09-16T19:58:47.806295] [DEBUG] [VALIDATOR ] PHM: Validating primary data. [2025-09-16T19:58:48.190688] [DEBUG] [VALIDATOR ] PHM: All expected trading days are present. [2025-09-16T19:58:48.190768] [DEBUG] [VALIDATOR ] PHM: Primary data validation passed. [2025-09-16T19:58:48.191622] [INFO ] [MAIN ] PHM: Fetched primary data is valid. [2025-09-16T19:58:48.191680] [DEBUG] [LOCAL ] PHM: Saving primary data. [2025-09-16T19:58:48.192758] [DEBUG] [LOCAL ] PHM: Trimmed 56298 records to 38479 (keeping 150 days of data) [2025-09-16T19:58:48.377073] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-05. [2025-09-16T19:58:48.443411] [DEBUG] [LOCAL ] PHM: Primary data saved (38479 records). [2025-09-16T19:58:48.443565] [INFO ] [MAIN ] PHM: Full history saved. [2025-09-16T19:58:48.443692] [INFO ] [MAIN ] Update Progress: 1683/2369 symbols completed. PHM took 27.1s. Estimated remaining: 1h 12m 52s. Rate: 9.4 symbols/min [2025-09-16T19:58:48.614208] [INFO ] [MAIN ] PII: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:58:48.650795] [DEBUG] [LOCAL ] PII: Loaded 36232 existing records from primary storage. [2025-09-16T19:58:48.650936] [INFO ] [MAIN ] PII: Loaded 36232 existing records. [2025-09-16T19:58:48.828087] [WARN ] [MAIN ] PII: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:58:48.828336] [INFO ] [MAIN ] PII: Wiping existing primary data before full refresh. [2025-09-16T19:58:48.828380] [INFO ] [LOCAL ] PII: Starting deletion of primary data. [2025-09-16T19:58:48.829397] [DEBUG] [LOCAL ] PII: Deleted primary data file. [2025-09-16T19:58:48.829445] [INFO ] [MAIN ] PII: Starting full primary refresh. [2025-09-16T19:58:49.200873] [INFO ] [REMOTE ] PII: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:58:49.196761] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-05. [2025-09-16T19:58:49.202183] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-16T19:58:49.208036] [INFO ] [REMOTE ] PHIN: Full fetch complete (36768 records). [2025-09-16T19:58:49.208137] [DEBUG] [VALIDATOR ] PHIN: Validating primary data. [2025-09-16T19:58:49.579127] [DEBUG] [VALIDATOR ] PHIN: All expected trading days are present. [2025-09-16T19:58:49.579222] [DEBUG] [VALIDATOR ] PHIN: Primary data validation passed. [2025-09-16T19:58:49.580095] [INFO ] [MAIN ] PHIN: Fetched primary data is valid. [2025-09-16T19:58:49.580153] [DEBUG] [LOCAL ] PHIN: Saving primary data. [2025-09-16T19:58:49.581152] [DEBUG] [LOCAL ] PHIN: Trimmed 36768 records to 23455 (keeping 150 days of data) [2025-09-16T19:58:49.698200] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-16T19:58:49.760080] [DEBUG] [LOCAL ] PHIN: Primary data saved (23455 records). [2025-09-16T19:58:49.760232] [INFO ] [MAIN ] PHIN: Full history saved. [2025-09-16T19:58:49.760325] [INFO ] [MAIN ] Update Progress: 1684/2369 symbols completed. PHIN took 28.4s. Estimated remaining: 1h 12m 43s. Rate: 9.4 symbols/min [2025-09-16T19:58:49.928439] [INFO ] [MAIN ] PIM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:58:49.933431] [DEBUG] [LOCAL ] PIM: Loaded 3724 existing records from primary storage. [2025-09-16T19:58:49.933510] [INFO ] [MAIN ] PIM: Loaded 3724 existing records. [2025-09-16T19:58:49.980072] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-02. [2025-09-16T19:58:50.145766] [WARN ] [MAIN ] PIM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:58:50.146012] [INFO ] [MAIN ] PIM: Wiping existing primary data before full refresh. [2025-09-16T19:58:50.146062] [INFO ] [LOCAL ] PIM: Starting deletion of primary data. [2025-09-16T19:58:50.146295] [DEBUG] [LOCAL ] PIM: Deleted primary data file. [2025-09-16T19:58:50.146338] [INFO ] [MAIN ] PIM: Starting full primary refresh. [2025-09-16T19:58:50.398157] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-16T19:58:50.515503] [INFO ] [REMOTE ] PIM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:58:50.774887] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-02. [2025-09-16T19:58:51.343042] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-16T19:58:51.574886] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-06. [2025-09-16T19:58:51.638377] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-16T19:58:52.374896] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-03. [2025-09-16T19:58:52.945319] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-16T19:58:53.174893] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-07. [2025-09-16T19:58:53.974912] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-03. [2025-09-16T19:58:54.124281] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-16T19:58:54.540513] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-16T19:58:54.576965] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-16T19:58:54.774933] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-08. [2025-09-16T19:58:55.574936] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-04. [2025-09-16T19:58:56.248409] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-16T19:58:56.360628] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-16T19:58:56.374844] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-05. [2025-09-16T19:58:57.010521] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-16T19:58:57.174912] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-06. [2025-09-16T19:58:57.868872] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-16T19:58:57.974947] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-04. [2025-09-16T19:58:58.774907] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-09. [2025-09-16T19:58:59.574930] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-07. [2025-09-16T19:58:59.745144] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-16T19:59:00.000058] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-16T19:59:00.005792] [INFO ] [REMOTE ] PHR: Full fetch complete (39816 records). [2025-09-16T19:59:00.005886] [DEBUG] [VALIDATOR ] PHR: Validating primary data. [2025-09-16T19:59:00.253830] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-16T19:59:00.374903] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-08. [2025-09-16T19:59:00.385787] [DEBUG] [VALIDATOR ] PHR: All expected trading days are present. [2025-09-16T19:59:00.385841] [DEBUG] [VALIDATOR ] PHR: Primary data validation passed. [2025-09-16T19:59:00.386573] [INFO ] [MAIN ] PHR: Fetched primary data is valid. [2025-09-16T19:59:00.386703] [DEBUG] [LOCAL ] PHR: Saving primary data. [2025-09-16T19:59:00.387622] [DEBUG] [LOCAL ] PHR: Trimmed 39816 records to 27627 (keeping 150 days of data) [2025-09-16T19:59:00.551984] [DEBUG] [LOCAL ] PHR: Primary data saved (27627 records). [2025-09-16T19:59:00.552120] [INFO ] [MAIN ] PHR: Full history saved. [2025-09-16T19:59:00.552204] [INFO ] [MAIN ] Update Progress: 1685/2369 symbols completed. PHR took 25.7s. Estimated remaining: 1h 12m 39s. Rate: 9.4 symbols/min [2025-09-16T19:59:00.728683] [INFO ] [MAIN ] PINE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:59:00.739780] [DEBUG] [LOCAL ] PINE: Loaded 10370 existing records from primary storage. [2025-09-16T19:59:00.739882] [INFO ] [MAIN ] PINE: Loaded 10370 existing records. [2025-09-16T19:59:00.915529] [WARN ] [MAIN ] PINE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:59:00.915819] [INFO ] [MAIN ] PINE: Wiping existing primary data before full refresh. [2025-09-16T19:59:00.915865] [INFO ] [LOCAL ] PINE: Starting deletion of primary data. [2025-09-16T19:59:00.916489] [DEBUG] [LOCAL ] PINE: Deleted primary data file. [2025-09-16T19:59:00.916538] [INFO ] [MAIN ] PINE: Starting full primary refresh. [2025-09-16T19:59:01.042589] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-16T19:59:01.180128] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-06. [2025-09-16T19:59:01.278856] [INFO ] [REMOTE ] PINE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:59:01.974933] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-09. [2025-09-16T19:59:02.199544] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-16T19:59:02.774894] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-07. [2025-09-16T19:59:02.801420] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-16T19:59:02.803166] [INFO ] [REMOTE ] PIM: Full fetch complete (5041 records). [2025-09-16T19:59:02.803233] [DEBUG] [VALIDATOR ] PIM: Validating primary data. [2025-09-16T19:59:03.153239] [DEBUG] [VALIDATOR ] PIM: All expected trading days are present. [2025-09-16T19:59:03.153317] [DEBUG] [VALIDATOR ] PIM: Primary data validation passed. [2025-09-16T19:59:03.153471] [INFO ] [MAIN ] PIM: Fetched primary data is valid. [2025-09-16T19:59:03.153511] [DEBUG] [LOCAL ] PIM: Saving primary data. [2025-09-16T19:59:03.153910] [DEBUG] [LOCAL ] PIM: Trimmed 5041 records to 3777 (keeping 150 days of data) [2025-09-16T19:59:03.176149] [DEBUG] [LOCAL ] PIM: Primary data saved (3777 records). [2025-09-16T19:59:03.176231] [INFO ] [MAIN ] PIM: Full history saved. [2025-09-16T19:59:03.176309] [INFO ] [MAIN ] Update Progress: 1686/2369 symbols completed. PIM took 13.4s. Estimated remaining: 1h 12m 31s. Rate: 9.4 symbols/min [2025-09-16T19:59:03.344384] [INFO ] [MAIN ] PINS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:59:03.381611] [DEBUG] [LOCAL ] PINS: Loaded 39653 existing records from primary storage. [2025-09-16T19:59:03.381779] [INFO ] [MAIN ] PINS: Loaded 39653 existing records. [2025-09-16T19:59:03.564184] [WARN ] [MAIN ] PINS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:59:03.564534] [INFO ] [MAIN ] PINS: Wiping existing primary data before full refresh. [2025-09-16T19:59:03.564584] [INFO ] [LOCAL ] PINS: Starting deletion of primary data. [2025-09-16T19:59:03.565525] [DEBUG] [LOCAL ] PINS: Deleted primary data file. [2025-09-16T19:59:03.565586] [INFO ] [MAIN ] PINS: Starting full primary refresh. [2025-09-16T19:59:03.580065] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-02. [2025-09-16T19:59:03.919583] [INFO ] [REMOTE ] PINS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:59:03.934855] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-16T19:59:04.302940] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-16T19:59:04.374887] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-02. [2025-09-16T19:59:05.174915] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-03. [2025-09-16T19:59:05.974910] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-05. [2025-09-16T19:59:06.154234] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-16T19:59:06.389241] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-16T19:59:06.774902] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-03. [2025-09-16T19:59:07.468997] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-16T19:59:07.574866] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-06. [2025-09-16T19:59:08.374912] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-04. [2025-09-16T19:59:08.678915] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-16T19:59:08.930377] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-16T19:59:09.002333] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-16T19:59:09.174891] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-04. [2025-09-16T19:59:09.974918] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-05. [2025-09-16T19:59:10.636225] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-16T19:59:10.774917] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-07. [2025-09-16T19:59:11.162769] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-16T19:59:11.574925] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-08. [2025-09-16T19:59:12.374950] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-06. [2025-09-16T19:59:12.509184] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-16T19:59:12.650622] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-16T19:59:13.028440] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-16T19:59:13.174906] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-09. [2025-09-16T19:59:13.974906] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-05. [2025-09-16T19:59:14.094974] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-16T19:59:14.097533] [INFO ] [REMOTE ] PHT: Full fetch complete (16092 records). [2025-09-16T19:59:14.097629] [DEBUG] [VALIDATOR ] PHT: Validating primary data. [2025-09-16T19:59:14.474056] [DEBUG] [VALIDATOR ] PHT: All expected trading days are present. [2025-09-16T19:59:14.474286] [DEBUG] [VALIDATOR ] PHT: Primary data validation passed. [2025-09-16T19:59:14.474732] [INFO ] [MAIN ] PHT: Fetched primary data is valid. [2025-09-16T19:59:14.474783] [DEBUG] [LOCAL ] PHT: Saving primary data. [2025-09-16T19:59:14.475366] [DEBUG] [LOCAL ] PHT: Trimmed 16092 records to 12100 (keeping 150 days of data) [2025-09-16T19:59:14.547854] [DEBUG] [LOCAL ] PHT: Primary data saved (12100 records). [2025-09-16T19:59:14.547992] [INFO ] [MAIN ] PHT: Full history saved. [2025-09-16T19:59:14.548087] [INFO ] [MAIN ] Update Progress: 1687/2369 symbols completed. PHT took 30.9s. Estimated remaining: 1h 12m 26s. Rate: 9.4 symbols/min [2025-09-16T19:59:14.728951] [INFO ] [MAIN ] PIPR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:59:14.741478] [DEBUG] [LOCAL ] PIPR: Loaded 10817 existing records from primary storage. [2025-09-16T19:59:14.741587] [INFO ] [MAIN ] PIPR: Loaded 10817 existing records. [2025-09-16T19:59:14.780074] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-08. [2025-09-16T19:59:14.928122] [WARN ] [MAIN ] PIPR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:59:14.928374] [INFO ] [MAIN ] PIPR: Wiping existing primary data before full refresh. [2025-09-16T19:59:14.928441] [INFO ] [LOCAL ] PIPR: Starting deletion of primary data. [2025-09-16T19:59:14.929185] [DEBUG] [LOCAL ] PIPR: Deleted primary data file. [2025-09-16T19:59:14.929257] [INFO ] [MAIN ] PIPR: Starting full primary refresh. [2025-09-16T19:59:15.286232] [INFO ] [REMOTE ] PIPR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:59:15.574865] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-02. [2025-09-16T19:59:16.002903] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-16T19:59:16.118921] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-16T19:59:16.374870] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-03. [2025-09-16T19:59:16.469293] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-16T19:59:17.163597] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-16T19:59:17.174842] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-04. [2025-09-16T19:59:17.974935] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-07. [2025-09-16T19:59:18.222286] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-16T19:59:18.664525] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-16T19:59:18.774909] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-05. [2025-09-16T19:59:19.574928] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-09. [2025-09-16T19:59:19.773795] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-16T19:59:20.374907] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-06. [2025-09-16T19:59:20.892708] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-16T19:59:20.898380] [INFO ] [REMOTE ] PII: Full fetch complete (53787 records). [2025-09-16T19:59:20.898512] [DEBUG] [VALIDATOR ] PII: Validating primary data. [2025-09-16T19:59:21.180002] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-06. [2025-09-16T19:59:21.287052] [DEBUG] [VALIDATOR ] PII: All expected trading days are present. [2025-09-16T19:59:21.287141] [DEBUG] [VALIDATOR ] PII: Primary data validation passed. [2025-09-16T19:59:21.288006] [INFO ] [MAIN ] PII: Fetched primary data is valid. [2025-09-16T19:59:21.288058] [DEBUG] [LOCAL ] PII: Saving primary data. [2025-09-16T19:59:21.289393] [DEBUG] [LOCAL ] PII: Trimmed 53787 records to 36553 (keeping 150 days of data) [2025-09-16T19:59:21.518617] [DEBUG] [LOCAL ] PII: Primary data saved (36553 records). [2025-09-16T19:59:21.518842] [INFO ] [MAIN ] PII: Full history saved. [2025-09-16T19:59:21.518955] [INFO ] [MAIN ] Update Progress: 1688/2369 symbols completed. PII took 33.1s. Estimated remaining: 1h 12m 20s. Rate: 9.4 symbols/min [2025-09-16T19:59:21.689670] [INFO ] [MAIN ] PJT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:59:21.706740] [DEBUG] [LOCAL ] PJT: Loaded 15826 existing records from primary storage. [2025-09-16T19:59:21.706866] [INFO ] [MAIN ] PJT: Loaded 15826 existing records. [2025-09-16T19:59:21.883407] [WARN ] [MAIN ] PJT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:59:21.883637] [INFO ] [MAIN ] PJT: Wiping existing primary data before full refresh. [2025-09-16T19:59:21.883703] [INFO ] [LOCAL ] PJT: Starting deletion of primary data. [2025-09-16T19:59:21.884329] [DEBUG] [LOCAL ] PJT: Deleted primary data file. [2025-09-16T19:59:21.884380] [INFO ] [MAIN ] PJT: Starting full primary refresh. [2025-09-16T19:59:21.982717] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-08. [2025-09-16T19:59:22.238545] [INFO ] [REMOTE ] PJT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:59:22.252518] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-16T19:59:22.334225] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-16T19:59:22.774965] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-07. [2025-09-16T19:59:22.976945] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-16T19:59:23.574953] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-02. [2025-09-16T19:59:24.374890] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-07. [2025-09-16T19:59:24.692582] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-16T19:59:24.717660] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-16T19:59:25.174920] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-08. [2025-09-16T19:59:25.384965] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-16T19:59:25.974903] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-08. [2025-09-16T19:59:26.774870] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-09. [2025-09-16T19:59:26.892491] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-16T19:59:27.289560] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-16T19:59:27.555711] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-16T19:59:27.557773] [INFO ] [REMOTE ] PINE: Full fetch complete (15447 records). [2025-09-16T19:59:27.557849] [DEBUG] [VALIDATOR ] PINE: Validating primary data. [2025-09-16T19:59:27.579977] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-03. [2025-09-16T19:59:27.925283] [DEBUG] [VALIDATOR ] PINE: All expected trading days are present. [2025-09-16T19:59:27.925370] [DEBUG] [VALIDATOR ] PINE: Primary data validation passed. [2025-09-16T19:59:27.925735] [INFO ] [MAIN ] PINE: Fetched primary data is valid. [2025-09-16T19:59:27.925786] [DEBUG] [LOCAL ] PINE: Saving primary data. [2025-09-16T19:59:27.926291] [DEBUG] [LOCAL ] PINE: Trimmed 15447 records to 10458 (keeping 150 days of data) [2025-09-16T19:59:27.991108] [DEBUG] [LOCAL ] PINE: Primary data saved (10458 records). [2025-09-16T19:59:27.991232] [INFO ] [MAIN ] PINE: Full history saved. [2025-09-16T19:59:27.991323] [INFO ] [MAIN ] Update Progress: 1689/2369 symbols completed. PINE took 27.4s. Estimated remaining: 1h 12m 14s. Rate: 9.4 symbols/min [2025-09-16T19:59:28.158899] [INFO ] [MAIN ] PK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:59:28.200046] [DEBUG] [LOCAL ] PK: Loaded 38953 existing records from primary storage. [2025-09-16T19:59:28.200185] [INFO ] [MAIN ] PK: Loaded 38953 existing records. [2025-09-16T19:59:28.378834] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-09. [2025-09-16T19:59:28.378994] [WARN ] [MAIN ] PK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:59:28.379242] [INFO ] [MAIN ] PK: Wiping existing primary data before full refresh. [2025-09-16T19:59:28.379293] [INFO ] [LOCAL ] PK: Starting deletion of primary data. [2025-09-16T19:59:28.380375] [DEBUG] [LOCAL ] PK: Deleted primary data file. [2025-09-16T19:59:28.380430] [INFO ] [MAIN ] PK: Starting full primary refresh. [2025-09-16T19:59:28.729550] [INFO ] [REMOTE ] PK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:59:28.922087] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-16T19:59:29.174867] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-09. [2025-09-16T19:59:29.292875] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-16T19:59:29.294910] [INFO ] [REMOTE ] PIPR: Full fetch complete (16409 records). [2025-09-16T19:59:29.294988] [DEBUG] [VALIDATOR ] PIPR: Validating primary data. [2025-09-16T19:59:29.659715] [DEBUG] [VALIDATOR ] PIPR: All expected trading days are present. [2025-09-16T19:59:29.659792] [DEBUG] [VALIDATOR ] PIPR: Primary data validation passed. [2025-09-16T19:59:29.660140] [INFO ] [MAIN ] PIPR: Fetched primary data is valid. [2025-09-16T19:59:29.660181] [DEBUG] [LOCAL ] PIPR: Saving primary data. [2025-09-16T19:59:29.660713] [DEBUG] [LOCAL ] PIPR: Trimmed 16409 records to 10931 (keeping 150 days of data) [2025-09-16T19:59:29.734286] [DEBUG] [LOCAL ] PIPR: Primary data saved (10931 records). [2025-09-16T19:59:29.734473] [INFO ] [MAIN ] PIPR: Full history saved. [2025-09-16T19:59:29.734603] [INFO ] [MAIN ] Update Progress: 1690/2369 symbols completed. PIPR took 15.2s. Estimated remaining: 1h 12m 6s. Rate: 9.4 symbols/min [2025-09-16T19:59:29.906786] [INFO ] [MAIN ] PKE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:59:29.917748] [DEBUG] [LOCAL ] PKE: Loaded 9940 existing records from primary storage. [2025-09-16T19:59:29.917862] [INFO ] [MAIN ] PKE: Loaded 9940 existing records. [2025-09-16T19:59:29.982999] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-02. [2025-09-16T19:59:30.102788] [WARN ] [MAIN ] PKE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:59:30.103070] [INFO ] [MAIN ] PKE: Wiping existing primary data before full refresh. [2025-09-16T19:59:30.103123] [INFO ] [LOCAL ] PKE: Starting deletion of primary data. [2025-09-16T19:59:30.103429] [DEBUG] [LOCAL ] PKE: Deleted primary data file. [2025-09-16T19:59:30.103474] [INFO ] [MAIN ] PKE: Starting full primary refresh. [2025-09-16T19:59:30.458770] [INFO ] [REMOTE ] PKE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:59:30.774917] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-02. [2025-09-16T19:59:31.179306] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-16T19:59:31.185796] [INFO ] [REMOTE ] PINS: Full fetch complete (58373 records). [2025-09-16T19:59:31.185915] [DEBUG] [VALIDATOR ] PINS: Validating primary data. [2025-09-16T19:59:31.575628] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-04. [2025-09-16T19:59:31.575837] [DEBUG] [VALIDATOR ] PINS: All expected trading days are present. [2025-09-16T19:59:31.576575] [DEBUG] [VALIDATOR ] PINS: Primary data validation passed. [2025-09-16T19:59:31.577514] [INFO ] [MAIN ] PINS: Fetched primary data is valid. [2025-09-16T19:59:31.577652] [DEBUG] [LOCAL ] PINS: Saving primary data. [2025-09-16T19:59:31.578894] [DEBUG] [LOCAL ] PINS: Trimmed 58373 records to 40043 (keeping 150 days of data) [2025-09-16T19:59:31.730679] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-16T19:59:31.854438] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-16T19:59:31.889390] [DEBUG] [LOCAL ] PINS: Primary data saved (40043 records). [2025-09-16T19:59:31.889519] [INFO ] [MAIN ] PINS: Full history saved. [2025-09-16T19:59:31.889608] [INFO ] [MAIN ] Update Progress: 1691/2369 symbols completed. PINS took 28.7s. Estimated remaining: 1h 11m 58s. Rate: 9.4 symbols/min [2025-09-16T19:59:32.062364] [INFO ] [MAIN ] PKG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:59:32.089769] [DEBUG] [LOCAL ] PKG: Loaded 28597 existing records from primary storage. [2025-09-16T19:59:32.089925] [INFO ] [MAIN ] PKG: Loaded 28597 existing records. [2025-09-16T19:59:32.268901] [WARN ] [MAIN ] PKG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:59:32.269160] [INFO ] [MAIN ] PKG: Wiping existing primary data before full refresh. [2025-09-16T19:59:32.269206] [INFO ] [LOCAL ] PKG: Starting deletion of primary data. [2025-09-16T19:59:32.270051] [DEBUG] [LOCAL ] PKG: Deleted primary data file. [2025-09-16T19:59:32.270102] [INFO ] [MAIN ] PKG: Starting full primary refresh. [2025-09-16T19:59:32.380038] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-03. [2025-09-16T19:59:32.648924] [INFO ] [REMOTE ] PKG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:59:32.944916] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-16T19:59:32.957182] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-16T19:59:33.174891] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-02. [2025-09-16T19:59:33.974898] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-05. [2025-09-16T19:59:34.637126] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-16T19:59:34.774923] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-03. [2025-09-16T19:59:35.222039] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-16T19:59:35.574938] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-04. [2025-09-16T19:59:36.373418] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-16T19:59:36.375888] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-06. [2025-09-16T19:59:36.443502] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-16T19:59:37.174892] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-05. [2025-09-16T19:59:37.374571] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-16T19:59:37.633850] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-16T19:59:37.974908] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-07. [2025-09-16T19:59:38.774898] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-04. [2025-09-16T19:59:39.063732] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-16T19:59:39.574975] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-06. [2025-09-16T19:59:40.374921] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-03. [2025-09-16T19:59:40.450950] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-16T19:59:40.466517] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-16T19:59:41.174909] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-05. [2025-09-16T19:59:41.974905] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-07. [2025-09-16T19:59:42.259544] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-16T19:59:42.726940] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-16T19:59:42.774863] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-06. [2025-09-16T19:59:43.030184] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-16T19:59:43.574907] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-08. [2025-09-16T19:59:44.172806] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-16T19:59:44.374928] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-07. [2025-09-16T19:59:44.615869] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-16T19:59:45.174924] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-04. [2025-09-16T19:59:45.974930] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-09. [2025-09-16T19:59:46.039875] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-16T19:59:46.774929] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-08. [2025-09-16T19:59:46.908580] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-16T19:59:46.910885] [INFO ] [REMOTE ] PKE: Full fetch complete (13165 records). [2025-09-16T19:59:46.910959] [DEBUG] [VALIDATOR ] PKE: Validating primary data. [2025-09-16T19:59:47.251043] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-16T19:59:47.327681] [DEBUG] [VALIDATOR ] PKE: All expected trading days are present. [2025-09-16T19:59:47.327765] [DEBUG] [VALIDATOR ] PKE: Primary data validation passed. [2025-09-16T19:59:47.328148] [INFO ] [MAIN ] PKE: Fetched primary data is valid. [2025-09-16T19:59:47.328190] [DEBUG] [LOCAL ] PKE: Saving primary data. [2025-09-16T19:59:47.328744] [DEBUG] [LOCAL ] PKE: Trimmed 13165 records to 10033 (keeping 150 days of data) [2025-09-16T19:59:47.388672] [DEBUG] [LOCAL ] PKE: Primary data saved (10033 records). [2025-09-16T19:59:47.388827] [INFO ] [MAIN ] PKE: Full history saved. [2025-09-16T19:59:47.388930] [INFO ] [MAIN ] Update Progress: 1692/2369 symbols completed. PKE took 17.7s. Estimated remaining: 1h 11m 55s. Rate: 9.4 symbols/min [2025-09-16T19:59:47.562836] [INFO ] [MAIN ] PKST: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:59:47.578069] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-05. [2025-09-16T19:59:47.578611] [DEBUG] [LOCAL ] PKST: Loaded 12836 existing records from primary storage. [2025-09-16T19:59:47.579714] [INFO ] [MAIN ] PKST: Loaded 12836 existing records. [2025-09-16T19:59:47.764092] [WARN ] [MAIN ] PKST: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:59:47.764373] [INFO ] [MAIN ] PKST: Wiping existing primary data before full refresh. [2025-09-16T19:59:47.764438] [INFO ] [LOCAL ] PKST: Starting deletion of primary data. [2025-09-16T19:59:47.764961] [DEBUG] [LOCAL ] PKST: Deleted primary data file. [2025-09-16T19:59:47.765011] [INFO ] [MAIN ] PKST: Starting full primary refresh. [2025-09-16T19:59:48.106717] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-16T19:59:48.138550] [INFO ] [REMOTE ] PKST: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:59:48.374922] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-02. [2025-09-16T19:59:49.154461] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-16T19:59:49.174849] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-06. [2025-09-16T19:59:49.448675] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-16T19:59:49.974905] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-03. [2025-09-16T19:59:50.774884] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-08. [2025-09-16T19:59:50.893340] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-16T19:59:51.110341] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-16T19:59:51.574961] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-09. [2025-09-16T19:59:52.238365] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-16T19:59:52.374885] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-09. [2025-09-16T19:59:52.504336] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-16T19:59:52.507370] [INFO ] [REMOTE ] PJT: Full fetch complete (24895 records). [2025-09-16T19:59:52.507484] [DEBUG] [VALIDATOR ] PJT: Validating primary data. [2025-09-16T19:59:52.903507] [DEBUG] [VALIDATOR ] PJT: All expected trading days are present. [2025-09-16T19:59:52.903597] [DEBUG] [VALIDATOR ] PJT: Primary data validation passed. [2025-09-16T19:59:52.904141] [INFO ] [MAIN ] PJT: Fetched primary data is valid. [2025-09-16T19:59:52.904188] [DEBUG] [LOCAL ] PJT: Saving primary data. [2025-09-16T19:59:52.904980] [DEBUG] [LOCAL ] PJT: Trimmed 24895 records to 15907 (keeping 150 days of data) [2025-09-16T19:59:53.006894] [DEBUG] [LOCAL ] PJT: Primary data saved (15907 records). [2025-09-16T19:59:53.007047] [INFO ] [MAIN ] PJT: Full history saved. [2025-09-16T19:59:53.007147] [INFO ] [MAIN ] Update Progress: 1693/2369 symbols completed. PJT took 31.5s. Estimated remaining: 1h 11m 48s. Rate: 9.4 symbols/min [2025-09-16T19:59:53.174017] [INFO ] [MAIN ] PKX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:59:53.174870] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-07. [2025-09-16T19:59:53.192376] [DEBUG] [LOCAL ] PKX: Loaded 16442 existing records from primary storage. [2025-09-16T19:59:53.192592] [INFO ] [MAIN ] PKX: Loaded 16442 existing records. [2025-09-16T19:59:53.370556] [WARN ] [MAIN ] PKX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:59:53.370848] [INFO ] [MAIN ] PKX: Wiping existing primary data before full refresh. [2025-09-16T19:59:53.370905] [INFO ] [LOCAL ] PKX: Starting deletion of primary data. [2025-09-16T19:59:53.371416] [DEBUG] [LOCAL ] PKX: Deleted primary data file. [2025-09-16T19:59:53.371462] [INFO ] [MAIN ] PKX: Starting full primary refresh. [2025-09-16T19:59:53.718725] [INFO ] [REMOTE ] PKX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:59:53.793115] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-16T19:59:53.798050] [INFO ] [REMOTE ] PKG: Full fetch complete (43121 records). [2025-09-16T19:59:53.798144] [DEBUG] [VALIDATOR ] PKG: Validating primary data. [2025-09-16T19:59:53.975577] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-02. [2025-09-16T19:59:54.175502] [DEBUG] [VALIDATOR ] PKG: All expected trading days are present. [2025-09-16T19:59:54.175578] [DEBUG] [VALIDATOR ] PKG: Primary data validation passed. [2025-09-16T19:59:54.176431] [INFO ] [MAIN ] PKG: Fetched primary data is valid. [2025-09-16T19:59:54.176477] [DEBUG] [LOCAL ] PKG: Saving primary data. [2025-09-16T19:59:54.177512] [DEBUG] [LOCAL ] PKG: Trimmed 43121 records to 28855 (keeping 150 days of data) [2025-09-16T19:59:54.359890] [DEBUG] [LOCAL ] PKG: Primary data saved (28855 records). [2025-09-16T19:59:54.360031] [INFO ] [MAIN ] PKG: Full history saved. [2025-09-16T19:59:54.360118] [INFO ] [MAIN ] Update Progress: 1694/2369 symbols completed. PKG took 22.5s. Estimated remaining: 1h 11m 40s. Rate: 9.4 symbols/min [2025-09-16T19:59:54.539238] [INFO ] [MAIN ] PL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T19:59:54.574895] [DEBUG] [LOCAL ] PL: Loaded 39249 existing records from primary storage. [2025-09-16T19:59:54.575057] [INFO ] [MAIN ] PL: Loaded 39249 existing records. [2025-09-16T19:59:54.751966] [WARN ] [MAIN ] PL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T19:59:54.752222] [INFO ] [MAIN ] PL: Wiping existing primary data before full refresh. [2025-09-16T19:59:54.752277] [INFO ] [LOCAL ] PL: Starting deletion of primary data. [2025-09-16T19:59:54.753058] [DEBUG] [LOCAL ] PL: Deleted primary data file. [2025-09-16T19:59:54.753109] [INFO ] [MAIN ] PL: Starting full primary refresh. [2025-09-16T19:59:54.784880] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-04. [2025-09-16T19:59:55.109857] [INFO ] [REMOTE ] PL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T19:59:55.142744] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-16T19:59:55.372920] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-16T19:59:55.574908] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-02. [2025-09-16T19:59:55.927750] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-16T19:59:56.374896] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-03. [2025-09-16T19:59:57.174906] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-05. [2025-09-16T19:59:57.544344] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-16T19:59:57.880378] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-16T19:59:57.974863] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-04. [2025-09-16T19:59:58.145825] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-16T19:59:58.774906] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-06. [2025-09-16T19:59:59.329459] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-16T19:59:59.574905] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-08. [2025-09-16T19:59:59.828916] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-16T20:00:00.374948] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-07. [2025-09-16T20:00:01.174961] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-05. [2025-09-16T20:00:01.538687] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-16T20:00:01.562740] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-16T20:00:01.975136] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-09. [2025-09-16T20:00:02.443276] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-16T20:00:02.774929] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-08. [2025-09-16T20:00:03.574905] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-06. [2025-09-16T20:00:03.660630] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-16T20:00:03.667779] [INFO ] [REMOTE ] PK: Full fetch complete (57467 records). [2025-09-16T20:00:03.668094] [DEBUG] [VALIDATOR ] PK: Validating primary data. [2025-09-16T20:00:04.102997] [DEBUG] [VALIDATOR ] PK: All expected trading days are present. [2025-09-16T20:00:04.103119] [DEBUG] [VALIDATOR ] PK: Primary data validation passed. [2025-09-16T20:00:04.104067] [INFO ] [MAIN ] PK: Fetched primary data is valid. [2025-09-16T20:00:04.104126] [DEBUG] [LOCAL ] PK: Saving primary data. [2025-09-16T20:00:04.119027] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-16T20:00:04.123923] [DEBUG] [LOCAL ] PK: Trimmed 57467 records to 39339 (keeping 150 days of data) [2025-09-16T20:00:04.375128] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-09. [2025-09-16T20:00:04.380094] [DEBUG] [LOCAL ] PK: Primary data saved (39339 records). [2025-09-16T20:00:04.380203] [INFO ] [MAIN ] PK: Full history saved. [2025-09-16T20:00:04.380322] [INFO ] [MAIN ] Update Progress: 1695/2369 symbols completed. PK took 36.4s. Estimated remaining: 1h 11m 35s. Rate: 9.4 symbols/min [2025-09-16T20:00:04.560424] [INFO ] [MAIN ] PLD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:00:04.601768] [DEBUG] [LOCAL ] PLD: Loaded 39466 existing records from primary storage. [2025-09-16T20:00:04.601914] [INFO ] [MAIN ] PLD: Loaded 39466 existing records. [2025-09-16T20:00:04.777456] [WARN ] [MAIN ] PLD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:00:04.777853] [INFO ] [MAIN ] PLD: Wiping existing primary data before full refresh. [2025-09-16T20:00:04.778036] [INFO ] [LOCAL ] PLD: Starting deletion of primary data. [2025-09-16T20:00:04.784110] [DEBUG] [LOCAL ] PLD: Deleted primary data file. [2025-09-16T20:00:04.791415] [INFO ] [MAIN ] PLD: Starting full primary refresh. [2025-09-16T20:00:04.861393] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-16T20:00:05.149685] [INFO ] [REMOTE ] PLD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:00:05.174843] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-02. [2025-09-16T20:00:05.612497] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-16T20:00:05.622139] [INFO ] [REMOTE ] PKST: Full fetch complete (21636 records). [2025-09-16T20:00:05.622359] [DEBUG] [VALIDATOR ] PKST: Validating primary data. [2025-09-16T20:00:05.981225] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-03. [2025-09-16T20:00:06.015248] [DEBUG] [VALIDATOR ] PKST: All expected trading days are present. [2025-09-16T20:00:06.015322] [DEBUG] [VALIDATOR ] PKST: Primary data validation passed. [2025-09-16T20:00:06.015815] [INFO ] [MAIN ] PKST: Fetched primary data is valid. [2025-09-16T20:00:06.015877] [DEBUG] [LOCAL ] PKST: Saving primary data. [2025-09-16T20:00:06.016663] [DEBUG] [LOCAL ] PKST: Trimmed 21636 records to 12953 (keeping 150 days of data) [2025-09-16T20:00:06.102756] [DEBUG] [LOCAL ] PKST: Primary data saved (12953 records). [2025-09-16T20:00:06.102891] [INFO ] [MAIN ] PKST: Full history saved. [2025-09-16T20:00:06.102996] [INFO ] [MAIN ] Update Progress: 1696/2369 symbols completed. PKST took 18.7s. Estimated remaining: 1h 11m 27s. Rate: 9.4 symbols/min [2025-09-16T20:00:06.277317] [INFO ] [MAIN ] PLNT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:00:06.321571] [DEBUG] [LOCAL ] PLNT: Loaded 35594 existing records from primary storage. [2025-09-16T20:00:06.321758] [INFO ] [MAIN ] PLNT: Loaded 35594 existing records. [2025-09-16T20:00:06.509470] [WARN ] [MAIN ] PLNT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:00:06.509767] [INFO ] [MAIN ] PLNT: Wiping existing primary data before full refresh. [2025-09-16T20:00:06.509821] [INFO ] [LOCAL ] PLNT: Starting deletion of primary data. [2025-09-16T20:00:06.510580] [DEBUG] [LOCAL ] PLNT: Deleted primary data file. [2025-09-16T20:00:06.510636] [INFO ] [MAIN ] PLNT: Starting full primary refresh. [2025-09-16T20:00:06.780778] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-07. [2025-09-16T20:00:06.869749] [INFO ] [REMOTE ] PLNT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:00:07.002059] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-16T20:00:07.574942] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-03. [2025-09-16T20:00:08.014549] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-16T20:00:08.251800] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-16T20:00:08.374952] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-04. [2025-09-16T20:00:09.174941] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-02. [2025-09-16T20:00:09.484049] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-16T20:00:09.974931] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-08. [2025-09-16T20:00:10.423361] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-16T20:00:10.476683] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-16T20:00:10.644128] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-16T20:00:10.774908] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-03. [2025-09-16T20:00:11.574912] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-05. [2025-09-16T20:00:12.374905] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-04. [2025-09-16T20:00:12.525816] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-16T20:00:13.174944] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-04. [2025-09-16T20:00:13.412751] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-16T20:00:13.974883] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-09. [2025-09-16T20:00:14.030198] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-16T20:00:14.517480] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-16T20:00:14.774945] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-06. [2025-09-16T20:00:15.370041] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-16T20:00:15.377593] [INFO ] [REMOTE ] PKX: Full fetch complete (28133 records). [2025-09-16T20:00:15.377864] [DEBUG] [VALIDATOR ] PKX: Validating primary data. [2025-09-16T20:00:15.581886] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-05. [2025-09-16T20:00:15.953223] [DEBUG] [VALIDATOR ] PKX: All expected trading days are present. [2025-09-16T20:00:15.953331] [DEBUG] [VALIDATOR ] PKX: Primary data validation passed. [2025-09-16T20:00:15.954704] [INFO ] [MAIN ] PKX: Fetched primary data is valid. [2025-09-16T20:00:15.954795] [DEBUG] [LOCAL ] PKX: Saving primary data. [2025-09-16T20:00:15.955859] [DEBUG] [LOCAL ] PKX: Trimmed 28133 records to 16636 (keeping 150 days of data) [2025-09-16T20:00:16.089484] [DEBUG] [LOCAL ] PKX: Primary data saved (16636 records). [2025-09-16T20:00:16.089750] [INFO ] [MAIN ] PKX: Full history saved. [2025-09-16T20:00:16.089864] [INFO ] [MAIN ] Update Progress: 1697/2369 symbols completed. PKX took 23.1s. Estimated remaining: 1h 11m 22s. Rate: 9.4 symbols/min [2025-09-16T20:00:16.281427] [INFO ] [MAIN ] PLOW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:00:16.298793] [DEBUG] [LOCAL ] PLOW: Loaded 15202 existing records from primary storage. [2025-09-16T20:00:16.298978] [INFO ] [MAIN ] PLOW: Loaded 15202 existing records. [2025-09-16T20:00:16.380031] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-05. [2025-09-16T20:00:16.484695] [WARN ] [MAIN ] PLOW: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:00:16.484930] [INFO ] [MAIN ] PLOW: Wiping existing primary data before full refresh. [2025-09-16T20:00:16.484989] [INFO ] [LOCAL ] PLOW: Starting deletion of primary data. [2025-09-16T20:00:16.485427] [DEBUG] [LOCAL ] PLOW: Deleted primary data file. [2025-09-16T20:00:16.485472] [INFO ] [MAIN ] PLOW: Starting full primary refresh. [2025-09-16T20:00:16.836680] [INFO ] [REMOTE ] PLOW: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:00:17.093458] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-09-16T20:00:17.174455] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-16T20:00:17.185333] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-02. [2025-09-16T20:00:17.974879] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-07. [2025-09-16T20:00:18.231839] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-16T20:00:18.382083] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-16T20:00:18.774904] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-06. [2025-09-16T20:00:19.574919] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-06. [2025-09-16T20:00:20.335729] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-09-16T20:00:20.374886] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-03. [2025-09-16T20:00:20.409263] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-16T20:00:21.174886] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-08. [2025-09-16T20:00:21.204991] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-16T20:00:21.468832] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-16T20:00:21.974900] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-07. [2025-09-16T20:00:22.774904] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-07. [2025-09-16T20:00:23.467039] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-09-16T20:00:23.508174] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-16T20:00:23.574865] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-08. [2025-09-16T20:00:24.374908] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-09. [2025-09-16T20:00:24.738587] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-16T20:00:25.174916] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-08. [2025-09-16T20:00:25.395730] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-16T20:00:25.974926] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-04. [2025-09-16T20:00:26.374628] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-16T20:00:26.381290] [INFO ] [REMOTE ] PL: Full fetch complete (57762 records). [2025-09-16T20:00:26.381481] [DEBUG] [VALIDATOR ] PL: Validating primary data. [2025-09-16T20:00:26.776135] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-09. [2025-09-16T20:00:26.823398] [DEBUG] [VALIDATOR ] PL: All expected trading days are present. [2025-09-16T20:00:26.823478] [DEBUG] [VALIDATOR ] PL: Primary data validation passed. [2025-09-16T20:00:26.824405] [INFO ] [MAIN ] PL: Fetched primary data is valid. [2025-09-16T20:00:26.824453] [DEBUG] [LOCAL ] PL: Saving primary data. [2025-09-16T20:00:26.825673] [DEBUG] [LOCAL ] PL: Trimmed 57762 records to 39639 (keeping 150 days of data) [2025-09-16T20:00:27.059401] [DEBUG] [LOCAL ] PL: Primary data saved (39639 records). [2025-09-16T20:00:27.059542] [INFO ] [MAIN ] PL: Full history saved. [2025-09-16T20:00:27.059663] [INFO ] [MAIN ] Update Progress: 1698/2369 symbols completed. PL took 32.7s. Estimated remaining: 1h 11m 17s. Rate: 9.4 symbols/min [2025-09-16T20:00:27.229447] [INFO ] [MAIN ] PLYM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:00:27.252662] [DEBUG] [LOCAL ] PLYM: Loaded 24381 existing records from primary storage. [2025-09-16T20:00:27.252799] [INFO ] [MAIN ] PLYM: Loaded 24381 existing records. [2025-09-16T20:00:27.429860] [WARN ] [MAIN ] PLYM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:00:27.430279] [INFO ] [MAIN ] PLYM: Wiping existing primary data before full refresh. [2025-09-16T20:00:27.430328] [INFO ] [LOCAL ] PLYM: Starting deletion of primary data. [2025-09-16T20:00:27.467562] [DEBUG] [LOCAL ] PLYM: Deleted primary data file. [2025-09-16T20:00:27.477197] [INFO ] [MAIN ] PLYM: Starting full primary refresh. [2025-09-16T20:00:27.521422] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-16T20:00:27.585750] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-05. [2025-09-16T20:00:27.838316] [INFO ] [REMOTE ] PLYM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:00:28.096974] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-16T20:00:28.102722] [INFO ] [REMOTE ] PLNT: Full fetch complete (53026 records). [2025-09-16T20:00:28.102837] [DEBUG] [VALIDATOR ] PLNT: Validating primary data. [2025-09-16T20:00:28.382718] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-02. [2025-09-16T20:00:28.483516] [DEBUG] [VALIDATOR ] PLNT: All expected trading days are present. [2025-09-16T20:00:28.483599] [DEBUG] [VALIDATOR ] PLNT: Primary data validation passed. [2025-09-16T20:00:28.484473] [INFO ] [MAIN ] PLNT: Fetched primary data is valid. [2025-09-16T20:00:28.484521] [DEBUG] [LOCAL ] PLNT: Saving primary data. [2025-09-16T20:00:28.485664] [DEBUG] [LOCAL ] PLNT: Trimmed 53026 records to 35944 (keeping 150 days of data) [2025-09-16T20:00:28.711179] [DEBUG] [LOCAL ] PLNT: Primary data saved (35944 records). [2025-09-16T20:00:28.711347] [INFO ] [MAIN ] PLNT: Full history saved. [2025-09-16T20:00:28.711430] [INFO ] [MAIN ] Update Progress: 1699/2369 symbols completed. PLNT took 22.6s. Estimated remaining: 1h 11m 9s. Rate: 9.4 symbols/min [2025-09-16T20:00:28.882093] [INFO ] [MAIN ] PM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:00:28.905819] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-16T20:00:28.951920] [DEBUG] [LOCAL ] PM: Loaded 39637 existing records from primary storage. [2025-09-16T20:00:28.952067] [INFO ] [MAIN ] PM: Loaded 39637 existing records. [2025-09-16T20:00:29.126059] [WARN ] [MAIN ] PM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:00:29.126305] [INFO ] [MAIN ] PM: Wiping existing primary data before full refresh. [2025-09-16T20:00:29.126351] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-09-16T20:00:29.127469] [DEBUG] [LOCAL ] PM: Deleted primary data file. [2025-09-16T20:00:29.127520] [INFO ] [MAIN ] PM: Starting full primary refresh. [2025-09-16T20:00:29.192893] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-06. [2025-09-16T20:00:29.486205] [INFO ] [REMOTE ] PM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:00:29.646089] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-16T20:00:29.917261] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-16T20:00:29.974884] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-03. [2025-09-16T20:00:30.203961] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-08 (5.03 seconds). [2025-09-16T20:00:30.774912] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-09. [2025-09-16T20:00:30.844934] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-16T20:00:31.574937] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-07. [2025-09-16T20:00:32.374916] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-04. [2025-09-16T20:00:32.632160] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-16T20:00:32.638676] [INFO ] [REMOTE ] PLD: Full fetch complete (58122 records). [2025-09-16T20:00:32.638836] [DEBUG] [VALIDATOR ] PLD: Validating primary data. [2025-09-16T20:00:33.016876] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-16T20:00:33.057023] [DEBUG] [VALIDATOR ] PLD: All expected trading days are present. [2025-09-16T20:00:33.057123] [DEBUG] [VALIDATOR ] PLD: Primary data validation passed. [2025-09-16T20:00:33.058082] [INFO ] [MAIN ] PLD: Fetched primary data is valid. [2025-09-16T20:00:33.058134] [DEBUG] [LOCAL ] PLD: Saving primary data. [2025-09-16T20:00:33.059574] [DEBUG] [LOCAL ] PLD: Trimmed 58122 records to 39856 (keeping 150 days of data) [2025-09-16T20:00:33.175315] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-02. [2025-09-16T20:00:33.324666] [DEBUG] [LOCAL ] PLD: Primary data saved (39856 records). [2025-09-16T20:00:33.324835] [INFO ] [MAIN ] PLD: Full history saved. [2025-09-16T20:00:33.326520] [INFO ] [MAIN ] Update Progress: 1700/2369 symbols completed. PLD took 28.9s. Estimated remaining: 1h 11m 2s. Rate: 9.4 symbols/min [2025-09-16T20:00:33.501411] [INFO ] [MAIN ] PML: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:00:33.519679] [DEBUG] [LOCAL ] PML: Loaded 15390 existing records from primary storage. [2025-09-16T20:00:33.519831] [INFO ] [MAIN ] PML: Loaded 15390 existing records. [2025-09-16T20:00:33.703702] [WARN ] [MAIN ] PML: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:00:33.704213] [INFO ] [MAIN ] PML: Wiping existing primary data before full refresh. [2025-09-16T20:00:33.704338] [INFO ] [LOCAL ] PML: Starting deletion of primary data. [2025-09-16T20:00:33.711421] [DEBUG] [LOCAL ] PML: Deleted primary data file. [2025-09-16T20:00:33.723043] [INFO ] [MAIN ] PML: Starting full primary refresh. [2025-09-16T20:00:33.730091] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-16T20:00:33.980012] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-05. [2025-09-16T20:00:34.095803] [INFO ] [REMOTE ] PML: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:00:34.774896] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-08. [2025-09-16T20:00:35.153652] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-16T20:00:35.257379] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-16T20:00:35.437505] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-16T20:00:35.574897] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-09. [2025-09-16T20:00:36.374906] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-03. [2025-09-16T20:00:36.443857] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-16T20:00:36.446794] [INFO ] [REMOTE ] PLOW: Full fetch complete (22285 records). [2025-09-16T20:00:36.446882] [DEBUG] [VALIDATOR ] PLOW: Validating primary data. [2025-09-16T20:00:36.818715] [DEBUG] [VALIDATOR ] PLOW: All expected trading days are present. [2025-09-16T20:00:36.818814] [DEBUG] [VALIDATOR ] PLOW: Primary data validation passed. [2025-09-16T20:00:36.819336] [INFO ] [MAIN ] PLOW: Fetched primary data is valid. [2025-09-16T20:00:36.819380] [DEBUG] [LOCAL ] PLOW: Saving primary data. [2025-09-16T20:00:36.820187] [DEBUG] [LOCAL ] PLOW: Trimmed 22285 records to 15306 (keeping 150 days of data) [2025-09-16T20:00:36.918028] [DEBUG] [LOCAL ] PLOW: Primary data saved (15306 records). [2025-09-16T20:00:36.918179] [INFO ] [MAIN ] PLOW: Full history saved. [2025-09-16T20:00:36.918267] [INFO ] [MAIN ] Update Progress: 1701/2369 symbols completed. PLOW took 20.8s. Estimated remaining: 1h 10m 55s. Rate: 9.4 symbols/min [2025-09-16T20:00:37.094202] [INFO ] [MAIN ] PMM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:00:37.102780] [DEBUG] [LOCAL ] PMM: Loaded 6727 existing records from primary storage. [2025-09-16T20:00:37.102923] [INFO ] [MAIN ] PMM: Loaded 6727 existing records. [2025-09-16T20:00:37.179983] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-06. [2025-09-16T20:00:37.289841] [WARN ] [MAIN ] PMM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:00:37.290116] [INFO ] [MAIN ] PMM: Wiping existing primary data before full refresh. [2025-09-16T20:00:37.290170] [INFO ] [LOCAL ] PMM: Starting deletion of primary data. [2025-09-16T20:00:37.290473] [DEBUG] [LOCAL ] PMM: Deleted primary data file. [2025-09-16T20:00:37.290537] [INFO ] [MAIN ] PMM: Starting full primary refresh. [2025-09-16T20:00:37.663242] [INFO ] [REMOTE ] PMM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:00:37.974929] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-02. [2025-09-16T20:00:38.340635] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-16T20:00:38.545955] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-16T20:00:38.595546] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-16T20:00:38.774941] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-04. [2025-09-16T20:00:39.574928] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-03. [2025-09-16T20:00:40.374956] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-02. [2025-09-16T20:00:40.460448] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-16T20:00:40.854273] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-16T20:00:41.046571] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-16T20:00:41.174947] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-07. [2025-09-16T20:00:41.974944] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-05. [2025-09-16T20:00:42.408387] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-16T20:00:42.774944] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-04. [2025-09-16T20:00:43.574903] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-03. [2025-09-16T20:00:43.743670] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-16T20:00:43.780770] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-16T20:00:44.374892] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-05. [2025-09-16T20:00:44.575891] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-16T20:00:45.174920] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-06. [2025-09-16T20:00:45.236550] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-16T20:00:45.974903] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-04. [2025-09-16T20:00:46.774944] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-06. [2025-09-16T20:00:46.991932] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-16T20:00:47.075900] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-16T20:00:47.574927] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-07. [2025-09-16T20:00:47.746969] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-16T20:00:48.374949] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-05. [2025-09-16T20:00:48.976465] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-16T20:00:49.174963] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-07. [2025-09-16T20:00:49.629917] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-16T20:00:49.974880] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-08. [2025-09-16T20:00:50.285291] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-16T20:00:50.774906] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-08. [2025-09-16T20:00:51.574916] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-06. [2025-09-16T20:00:51.906348] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-16T20:00:51.934173] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-16T20:00:52.328232] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-16T20:00:52.374922] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-09. [2025-09-16T20:00:53.174948] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-09. [2025-09-16T20:00:53.602276] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-16T20:00:53.606434] [INFO ] [REMOTE ] PML: Full fetch complete (21605 records). [2025-09-16T20:00:53.606528] [DEBUG] [VALIDATOR ] PML: Validating primary data. [2025-09-16T20:00:53.971829] [DEBUG] [VALIDATOR ] PML: All expected trading days are present. [2025-09-16T20:00:53.971911] [DEBUG] [VALIDATOR ] PML: Primary data validation passed. [2025-09-16T20:00:53.972409] [INFO ] [MAIN ] PML: Fetched primary data is valid. [2025-09-16T20:00:53.972452] [DEBUG] [LOCAL ] PML: Saving primary data. [2025-09-16T20:00:53.973127] [DEBUG] [LOCAL ] PML: Trimmed 21605 records to 15622 (keeping 150 days of data) [2025-09-16T20:00:53.974866] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-08. [2025-09-16T20:00:54.069636] [DEBUG] [LOCAL ] PML: Primary data saved (15622 records). [2025-09-16T20:00:54.069812] [INFO ] [MAIN ] PML: Full history saved. [2025-09-16T20:00:54.069904] [INFO ] [MAIN ] Update Progress: 1702/2369 symbols completed. PML took 20.7s. Estimated remaining: 1h 10m 52s. Rate: 9.4 symbols/min [2025-09-16T20:00:54.241321] [INFO ] [MAIN ] PMO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:00:54.249746] [DEBUG] [LOCAL ] PMO: Loaded 6801 existing records from primary storage. [2025-09-16T20:00:54.249876] [INFO ] [MAIN ] PMO: Loaded 6801 existing records. [2025-09-16T20:00:54.428669] [WARN ] [MAIN ] PMO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:00:54.428937] [INFO ] [MAIN ] PMO: Wiping existing primary data before full refresh. [2025-09-16T20:00:54.429020] [INFO ] [LOCAL ] PMO: Starting deletion of primary data. [2025-09-16T20:00:54.429365] [DEBUG] [LOCAL ] PMO: Deleted primary data file. [2025-09-16T20:00:54.429412] [INFO ] [MAIN ] PMO: Starting full primary refresh. [2025-09-16T20:00:54.777226] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-07. [2025-09-16T20:00:54.813859] [INFO ] [REMOTE ] PMO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:00:55.188316] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-16T20:00:55.194992] [INFO ] [REMOTE ] PM: Full fetch complete (58343 records). [2025-09-16T20:00:55.195143] [DEBUG] [VALIDATOR ] PM: Validating primary data. [2025-09-16T20:00:55.582164] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-02. [2025-09-16T20:00:55.613121] [DEBUG] [VALIDATOR ] PM: All expected trading days are present. [2025-09-16T20:00:55.613948] [DEBUG] [VALIDATOR ] PM: Primary data validation passed. [2025-09-16T20:00:55.615771] [INFO ] [MAIN ] PM: Fetched primary data is valid. [2025-09-16T20:00:55.619389] [DEBUG] [LOCAL ] PM: Saving primary data. [2025-09-16T20:00:55.619038] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-16T20:00:55.638042] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-16T20:00:55.642791] [DEBUG] [LOCAL ] PM: Trimmed 58343 records to 40027 (keeping 150 days of data) [2025-09-16T20:00:55.899155] [DEBUG] [LOCAL ] PM: Primary data saved (40027 records). [2025-09-16T20:00:55.899291] [INFO ] [MAIN ] PM: Full history saved. [2025-09-16T20:00:55.900169] [INFO ] [MAIN ] Update Progress: 1703/2369 symbols completed. PM took 27.2s. Estimated remaining: 1h 10m 44s. Rate: 9.4 symbols/min [2025-09-16T20:00:56.071213] [INFO ] [MAIN ] PMT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:00:56.109899] [DEBUG] [LOCAL ] PMT: Loaded 29148 existing records from primary storage. [2025-09-16T20:00:56.110070] [INFO ] [MAIN ] PMT: Loaded 29148 existing records. [2025-09-16T20:00:56.297688] [WARN ] [MAIN ] PMT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:00:56.297979] [INFO ] [MAIN ] PMT: Wiping existing primary data before full refresh. [2025-09-16T20:00:56.298029] [INFO ] [LOCAL ] PMT: Starting deletion of primary data. [2025-09-16T20:00:56.298883] [DEBUG] [LOCAL ] PMT: Deleted primary data file. [2025-09-16T20:00:56.298934] [INFO ] [MAIN ] PMT: Starting full primary refresh. [2025-09-16T20:00:56.378671] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-08. [2025-09-16T20:00:56.479393] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-16T20:00:56.677583] [INFO ] [REMOTE ] PMT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:00:57.174919] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-02. [2025-09-16T20:00:57.232515] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-16T20:00:57.974932] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-09. [2025-09-16T20:00:58.491493] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-16T20:00:58.536942] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-16T20:00:58.539442] [INFO ] [REMOTE ] PMM: Full fetch complete (12246 records). [2025-09-16T20:00:58.539544] [DEBUG] [VALIDATOR ] PMM: Validating primary data. [2025-09-16T20:00:58.782824] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-09. [2025-09-16T20:00:58.915031] [DEBUG] [VALIDATOR ] PMM: All expected trading days are present. [2025-09-16T20:00:58.915143] [DEBUG] [VALIDATOR ] PMM: Primary data validation passed. [2025-09-16T20:00:58.915468] [INFO ] [MAIN ] PMM: Fetched primary data is valid. [2025-09-16T20:00:58.915511] [DEBUG] [LOCAL ] PMM: Saving primary data. [2025-09-16T20:00:58.916079] [DEBUG] [LOCAL ] PMM: Trimmed 12246 records to 6847 (keeping 150 days of data) [2025-09-16T20:00:58.962678] [DEBUG] [LOCAL ] PMM: Primary data saved (6847 records). [2025-09-16T20:00:58.962983] [INFO ] [MAIN ] PMM: Full history saved. [2025-09-16T20:00:58.963094] [INFO ] [MAIN ] Update Progress: 1704/2369 symbols completed. PMM took 22.0s. Estimated remaining: 1h 10m 37s. Rate: 9.4 symbols/min [2025-09-16T20:00:59.136073] [INFO ] [MAIN ] PMTU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:00:59.136261] [DEBUG] [LOCAL ] PMTU: No existing data file found in primary storage. [2025-09-16T20:00:59.136300] [WARN ] [MAIN ] PMTU: No existing data found, performing full refresh instead. [2025-09-16T20:00:59.136452] [INFO ] [MAIN ] PMTU: Wiping existing primary data before full refresh. [2025-09-16T20:00:59.136491] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-09-16T20:00:59.136533] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-09-16T20:00:59.136565] [INFO ] [MAIN ] PMTU: Starting full primary refresh. [2025-09-16T20:00:59.491311] [INFO ] [REMOTE ] PMTU: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:00:59.574911] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-02. [2025-09-16T20:00:59.987346] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-16T20:01:00.285109] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-16T20:01:00.290277] [INFO ] [REMOTE ] PLYM: Full fetch complete (35616 records). [2025-09-16T20:01:00.290358] [DEBUG] [VALIDATOR ] PLYM: Validating primary data. [2025-09-16T20:01:00.380153] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-03. [2025-09-16T20:01:00.665677] [DEBUG] [VALIDATOR ] PLYM: All expected trading days are present. [2025-09-16T20:01:00.665754] [DEBUG] [VALIDATOR ] PLYM: Primary data validation passed. [2025-09-16T20:01:00.666487] [INFO ] [MAIN ] PLYM: Fetched primary data is valid. [2025-09-16T20:01:00.666536] [DEBUG] [LOCAL ] PLYM: Saving primary data. [2025-09-16T20:01:00.667345] [DEBUG] [LOCAL ] PLYM: Trimmed 35616 records to 24687 (keeping 150 days of data) [2025-09-16T20:01:00.781217] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-16T20:01:00.825553] [DEBUG] [LOCAL ] PLYM: Primary data saved (24687 records). [2025-09-16T20:01:00.825701] [INFO ] [MAIN ] PLYM: Full history saved. [2025-09-16T20:01:00.825805] [INFO ] [MAIN ] Update Progress: 1705/2369 symbols completed. PLYM took 33.8s. Estimated remaining: 1h 10m 28s. Rate: 9.4 symbols/min [2025-09-16T20:01:00.997057] [INFO ] [MAIN ] PMTV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:01:00.997210] [DEBUG] [LOCAL ] PMTV: No existing data file found in primary storage. [2025-09-16T20:01:00.997249] [WARN ] [MAIN ] PMTV: No existing data found, performing full refresh instead. [2025-09-16T20:01:00.997365] [INFO ] [MAIN ] PMTV: Wiping existing primary data before full refresh. [2025-09-16T20:01:00.997405] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-09-16T20:01:00.997448] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-09-16T20:01:00.997489] [INFO ] [MAIN ] PMTV: Starting full primary refresh. [2025-09-16T20:01:01.184185] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-03. [2025-09-16T20:01:01.354278] [INFO ] [REMOTE ] PMTV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:01:01.974910] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-02. [2025-09-16T20:01:02.603864] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-16T20:01:02.727409] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-16T20:01:02.774914] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-04. [2025-09-16T20:01:03.205696] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-16T20:01:03.574952] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-03. [2025-09-16T20:01:04.168009] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-16T20:01:04.374900] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-03. [2025-09-16T20:01:05.174900] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-04. [2025-09-16T20:01:05.259889] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-16T20:01:05.974912] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-04. [2025-09-16T20:01:06.774910] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-05. [2025-09-16T20:01:06.892562] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-16T20:01:06.985585] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-16T20:01:07.028074] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-09-16T20:01:07.574911] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-06. [2025-09-16T20:01:07.923293] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-16T20:01:08.374992] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-07. [2025-09-16T20:01:08.763627] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-16T20:01:09.174947] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-05. [2025-09-16T20:01:09.974930] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-08. [2025-09-16T20:01:10.671495] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-16T20:01:10.699226] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-16T20:01:10.774920] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-06. [2025-09-16T20:01:11.574910] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-09. [2025-09-16T20:01:12.152160] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-16T20:01:12.152961] [INFO ] [REMOTE ] PMTU: Full fetch complete (855 records). [2025-09-16T20:01:12.153034] [DEBUG] [VALIDATOR ] PMTU: Validating primary data. [2025-09-16T20:01:12.338881] [WARN ] [VALIDATOR ] PMTU: Validation failed - insufficient historical data. Have 143 unique days, need 150 days [2025-09-16T20:01:12.339277] [FATAL] [MAIN ] PMTU: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:01:12.339404] [WARN ] [MAIN ] PMTU: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:01:12.339466] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-09-16T20:01:12.339559] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-09-16T20:01:12.339667] [INFO ] [LOCAL ] PMTU: Starting deletion of derivative data. [2025-09-16T20:01:12.339769] [DEBUG] [LOCAL ] PMTU: No derivative data file found to delete. [2025-09-16T20:01:12.339890] [INFO ] [MAIN ] Update Progress: 1706/2369 symbols completed. PMTU took 13.4s. Estimated remaining: 1h 10m 24s. Rate: 9.4 symbols/min [2025-09-16T20:01:12.385187] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-05. [2025-09-16T20:01:12.533408] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-16T20:01:12.535978] [INFO ] [MAIN ] PMTW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:01:12.536184] [DEBUG] [LOCAL ] PMTW: No existing data file found in primary storage. [2025-09-16T20:01:12.543570] [WARN ] [MAIN ] PMTW: No existing data found, performing full refresh instead. [2025-09-16T20:01:12.544112] [INFO ] [MAIN ] PMTW: Wiping existing primary data before full refresh. [2025-09-16T20:01:12.544555] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-09-16T20:01:12.544626] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-09-16T20:01:12.544706] [INFO ] [MAIN ] PMTW: Starting full primary refresh. [2025-09-16T20:01:12.904444] [INFO ] [REMOTE ] PMTW: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:01:13.174925] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-02. [2025-09-16T20:01:13.212019] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-16T20:01:13.410839] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:01:13.411160] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-02 [2025-09-16T20:01:13.974919] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-03. [2025-09-16T20:01:14.185898] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:01:14.186202] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-03 [2025-09-16T20:01:14.774931] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-07. [2025-09-16T20:01:15.574910] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-04. [2025-09-16T20:01:16.179509] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-16T20:01:16.374901] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-04. [2025-09-16T20:01:16.476301] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-16T20:01:16.608733] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:01:16.609066] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-04 [2025-09-16T20:01:17.174930] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-08. [2025-09-16T20:01:17.974902] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-05. [2025-09-16T20:01:18.170717] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:01:18.171005] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-05 [2025-09-16T20:01:18.589548] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-16T20:01:18.774941] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-09. [2025-09-16T20:01:19.574921] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-05. [2025-09-16T20:01:20.230449] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-16T20:01:20.240288] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-16T20:01:20.240416] [INFO ] [REMOTE ] PMT: Full fetch complete (43636 records). [2025-09-16T20:01:20.241993] [DEBUG] [VALIDATOR ] PMT: Validating primary data. [2025-09-16T20:01:20.384107] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-06. [2025-09-16T20:01:20.626506] [DEBUG] [VALIDATOR ] PMT: All expected trading days are present. [2025-09-16T20:01:20.626597] [DEBUG] [VALIDATOR ] PMT: Primary data validation passed. [2025-09-16T20:01:20.627408] [INFO ] [MAIN ] PMT: Fetched primary data is valid. [2025-09-16T20:01:20.627455] [DEBUG] [LOCAL ] PMT: Saving primary data. [2025-09-16T20:01:20.628574] [DEBUG] [LOCAL ] PMT: Trimmed 43636 records to 29376 (keeping 150 days of data) [2025-09-16T20:01:20.821683] [DEBUG] [LOCAL ] PMT: Primary data saved (29376 records). [2025-09-16T20:01:20.821884] [INFO ] [MAIN ] PMT: Full history saved. [2025-09-16T20:01:20.821998] [INFO ] [MAIN ] Update Progress: 1707/2369 symbols completed. PMT took 24.9s. Estimated remaining: 1h 10m 19s. Rate: 9.4 symbols/min [2025-09-16T20:01:20.999624] [INFO ] [MAIN ] PNC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:01:21.040095] [DEBUG] [LOCAL ] PNC: Loaded 38496 existing records from primary storage. [2025-09-16T20:01:21.040274] [INFO ] [MAIN ] PNC: Loaded 38496 existing records. [2025-09-16T20:01:21.183898] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-06. [2025-09-16T20:01:21.230637] [WARN ] [MAIN ] PNC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:01:21.232335] [INFO ] [MAIN ] PNC: Wiping existing primary data before full refresh. [2025-09-16T20:01:21.239627] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-09-16T20:01:21.240586] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-16T20:01:21.243336] [DEBUG] [LOCAL ] PNC: Deleted primary data file. [2025-09-16T20:01:21.244024] [INFO ] [MAIN ] PNC: Starting full primary refresh. [2025-09-16T20:01:21.643436] [INFO ] [REMOTE ] PNC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:01:21.705300] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-16T20:01:21.974902] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-07. [2025-09-16T20:01:22.601283] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-16T20:01:22.774917] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-06. [2025-09-16T20:01:23.526002] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-16T20:01:23.574905] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-02. [2025-09-16T20:01:24.374894] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-08. [2025-09-16T20:01:25.026289] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-16T20:01:25.174928] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-07. [2025-09-16T20:01:25.517594] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-16T20:01:25.957827] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-16T20:01:25.974859] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-08. [2025-09-16T20:01:26.774894] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-03. [2025-09-16T20:01:26.800995] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-16T20:01:27.574895] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-09. [2025-09-16T20:01:28.374881] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-07. [2025-09-16T20:01:28.468343] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-16T20:01:28.469949] [INFO ] [REMOTE ] PMO: Full fetch complete (11478 records). [2025-09-16T20:01:28.470036] [DEBUG] [VALIDATOR ] PMO: Validating primary data. [2025-09-16T20:01:28.835274] [DEBUG] [VALIDATOR ] PMO: All expected trading days are present. [2025-09-16T20:01:28.835419] [DEBUG] [VALIDATOR ] PMO: Primary data validation passed. [2025-09-16T20:01:28.835763] [INFO ] [MAIN ] PMO: Fetched primary data is valid. [2025-09-16T20:01:28.835828] [DEBUG] [LOCAL ] PMO: Saving primary data. [2025-09-16T20:01:28.836492] [DEBUG] [LOCAL ] PMO: Trimmed 11478 records to 6885 (keeping 150 days of data) [2025-09-16T20:01:28.900136] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-16T20:01:28.923401] [DEBUG] [LOCAL ] PMO: Primary data saved (6885 records). [2025-09-16T20:01:28.923530] [INFO ] [MAIN ] PMO: Full history saved. [2025-09-16T20:01:28.923723] [INFO ] [MAIN ] Update Progress: 1708/2369 symbols completed. PMO took 34.9s. Estimated remaining: 1h 10m 13s. Rate: 9.4 symbols/min [2025-09-16T20:01:29.039728] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-16T20:01:29.104951] [INFO ] [MAIN ] PNI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:01:29.111844] [DEBUG] [LOCAL ] PNI: Loaded 4886 existing records from primary storage. [2025-09-16T20:01:29.111948] [INFO ] [MAIN ] PNI: Loaded 4886 existing records. [2025-09-16T20:01:29.179956] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-04. [2025-09-16T20:01:29.295712] [WARN ] [MAIN ] PNI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:01:29.295940] [INFO ] [MAIN ] PNI: Wiping existing primary data before full refresh. [2025-09-16T20:01:29.295985] [INFO ] [LOCAL ] PNI: Starting deletion of primary data. [2025-09-16T20:01:29.296259] [DEBUG] [LOCAL ] PNI: Deleted primary data file. [2025-09-16T20:01:29.296304] [INFO ] [MAIN ] PNI: Starting full primary refresh. [2025-09-16T20:01:29.646360] [INFO ] [REMOTE ] PNI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:01:29.974900] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-08. [2025-09-16T20:01:30.522796] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-16T20:01:30.774910] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-09. [2025-09-16T20:01:31.220106] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-16T20:01:31.267902] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-16T20:01:31.269226] [INFO ] [REMOTE ] PMTV: Full fetch complete (6021 records). [2025-09-16T20:01:31.269311] [DEBUG] [VALIDATOR ] PMTV: Validating primary data. [2025-09-16T20:01:31.458560] [WARN ] [VALIDATOR ] PMTV: Validation failed - insufficient historical data. Have 147 unique days, need 150 days [2025-09-16T20:01:31.458806] [FATAL] [MAIN ] PMTV: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:01:31.458858] [WARN ] [MAIN ] PMTV: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:01:31.458901] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-09-16T20:01:31.458956] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-09-16T20:01:31.458992] [INFO ] [LOCAL ] PMTV: Starting deletion of derivative data. [2025-09-16T20:01:31.459053] [DEBUG] [LOCAL ] PMTV: No derivative data file found to delete. [2025-09-16T20:01:31.459112] [INFO ] [MAIN ] Update Progress: 1709/2369 symbols completed. PMTV took 30.6s. Estimated remaining: 1h 10m 5s. Rate: 9.4 symbols/min [2025-09-16T20:01:31.579971] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-09. [2025-09-16T20:01:31.629517] [INFO ] [MAIN ] PNNT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:01:31.651005] [DEBUG] [LOCAL ] PNNT: Loaded 23767 existing records from primary storage. [2025-09-16T20:01:31.651135] [INFO ] [MAIN ] PNNT: Loaded 23767 existing records. [2025-09-16T20:01:31.832522] [WARN ] [MAIN ] PNNT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:01:31.832814] [INFO ] [MAIN ] PNNT: Wiping existing primary data before full refresh. [2025-09-16T20:01:31.832868] [INFO ] [LOCAL ] PNNT: Starting deletion of primary data. [2025-09-16T20:01:31.833514] [DEBUG] [LOCAL ] PNNT: Deleted primary data file. [2025-09-16T20:01:31.833568] [INFO ] [MAIN ] PNNT: Starting full primary refresh. [2025-09-16T20:01:32.188169] [INFO ] [REMOTE ] PNNT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:01:32.194427] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-16T20:01:32.195479] [INFO ] [REMOTE ] PMTW: Full fetch complete (3583 records). [2025-09-16T20:01:32.195549] [DEBUG] [VALIDATOR ] PMTW: Validating primary data. [2025-09-16T20:01:32.371936] [WARN ] [VALIDATOR ] PMTW: Validation failed - insufficient historical data. Have 66 unique days, need 150 days [2025-09-16T20:01:32.372142] [FATAL] [MAIN ] PMTW: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:01:32.372192] [WARN ] [MAIN ] PMTW: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:01:32.372237] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-09-16T20:01:32.372291] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-09-16T20:01:32.372337] [INFO ] [LOCAL ] PMTW: Starting deletion of derivative data. [2025-09-16T20:01:32.372381] [DEBUG] [LOCAL ] PMTW: No derivative data file found to delete. [2025-09-16T20:01:32.372450] [INFO ] [MAIN ] Update Progress: 1710/2369 symbols completed. PMTW took 20.0s. Estimated remaining: 1h 9m 57s. Rate: 9.4 symbols/min [2025-09-16T20:01:32.383207] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-05. [2025-09-16T20:01:32.545915] [INFO ] [MAIN ] PNR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:01:32.546114] [DEBUG] [LOCAL ] PNR: No existing data file found in primary storage. [2025-09-16T20:01:32.546153] [WARN ] [MAIN ] PNR: No existing data found, performing full refresh instead. [2025-09-16T20:01:32.546273] [INFO ] [MAIN ] PNR: Wiping existing primary data before full refresh. [2025-09-16T20:01:32.546312] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-09-16T20:01:32.546352] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-09-16T20:01:32.546384] [INFO ] [MAIN ] PNR: Starting full primary refresh. [2025-09-16T20:01:32.904046] [INFO ] [REMOTE ] PNR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:01:33.174900] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-02. [2025-09-16T20:01:33.974906] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-02. [2025-09-16T20:01:34.312615] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-16T20:01:34.395248] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-16T20:01:34.774944] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-06. [2025-09-16T20:01:34.820807] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-16T20:01:35.574927] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-03. [2025-09-16T20:01:36.374908] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-02. [2025-09-16T20:01:36.421950] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-16T20:01:37.174873] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-07. [2025-09-16T20:01:37.297351] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-16T20:01:37.646708] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-16T20:01:37.974951] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-03. [2025-09-16T20:01:38.583456] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-16T20:01:38.774955] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-04. [2025-09-16T20:01:39.034868] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-16T20:01:39.408057] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-16T20:01:39.574935] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-05. [2025-09-16T20:01:40.281858] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-16T20:01:40.374940] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-03. [2025-09-16T20:01:41.174935] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-08. [2025-09-16T20:01:41.832389] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-16T20:01:41.974904] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-06. [2025-09-16T20:01:42.553043] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-16T20:01:42.774931] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-07. [2025-09-16T20:01:42.891116] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-16T20:01:43.168702] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-16T20:01:43.574929] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-09. [2025-09-16T20:01:44.374947] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-08. [2025-09-16T20:01:45.174891] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-04. [2025-09-16T20:01:45.196027] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-16T20:01:45.483583] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-16T20:01:45.489766] [INFO ] [REMOTE ] PNC: Full fetch complete (56952 records). [2025-09-16T20:01:45.489869] [DEBUG] [VALIDATOR ] PNC: Validating primary data. [2025-09-16T20:01:45.874549] [DEBUG] [VALIDATOR ] PNC: All expected trading days are present. [2025-09-16T20:01:45.874694] [DEBUG] [VALIDATOR ] PNC: Primary data validation passed. [2025-09-16T20:01:45.875753] [INFO ] [MAIN ] PNC: Fetched primary data is valid. [2025-09-16T20:01:45.875822] [DEBUG] [LOCAL ] PNC: Saving primary data. [2025-09-16T20:01:45.877127] [DEBUG] [LOCAL ] PNC: Trimmed 56952 records to 38873 (keeping 150 days of data) [2025-09-16T20:01:45.978097] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-04. [2025-09-16T20:01:46.130050] [DEBUG] [LOCAL ] PNC: Primary data saved (38873 records). [2025-09-16T20:01:46.130205] [INFO ] [MAIN ] PNC: Full history saved. [2025-09-16T20:01:46.130736] [INFO ] [MAIN ] Update Progress: 1711/2369 symbols completed. PNC took 25.3s. Estimated remaining: 1h 9m 53s. Rate: 9.4 symbols/min [2025-09-16T20:01:46.303363] [INFO ] [MAIN ] PNW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:01:46.338694] [DEBUG] [LOCAL ] PNW: Loaded 33968 existing records from primary storage. [2025-09-16T20:01:46.338833] [INFO ] [MAIN ] PNW: Loaded 33968 existing records. [2025-09-16T20:01:46.515299] [WARN ] [MAIN ] PNW: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:01:46.515572] [INFO ] [MAIN ] PNW: Wiping existing primary data before full refresh. [2025-09-16T20:01:46.515620] [INFO ] [LOCAL ] PNW: Starting deletion of primary data. [2025-09-16T20:01:46.516489] [DEBUG] [LOCAL ] PNW: Deleted primary data file. [2025-09-16T20:01:46.516541] [INFO ] [MAIN ] PNW: Starting full primary refresh. [2025-09-16T20:01:46.784089] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-09. [2025-09-16T20:01:46.874884] [INFO ] [REMOTE ] PNW: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:01:47.086251] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-16T20:01:47.414986] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-16T20:01:47.574911] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-05. [2025-09-16T20:01:47.665956] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-16T20:01:47.668410] [INFO ] [REMOTE ] PNI: Full fetch complete (7194 records). [2025-09-16T20:01:47.668500] [DEBUG] [VALIDATOR ] PNI: Validating primary data. [2025-09-16T20:01:48.031088] [DEBUG] [VALIDATOR ] PNI: All expected trading days are present. [2025-09-16T20:01:48.031164] [DEBUG] [VALIDATOR ] PNI: Primary data validation passed. [2025-09-16T20:01:48.031343] [INFO ] [MAIN ] PNI: Fetched primary data is valid. [2025-09-16T20:01:48.031383] [DEBUG] [LOCAL ] PNI: Saving primary data. [2025-09-16T20:01:48.031787] [DEBUG] [LOCAL ] PNI: Trimmed 7194 records to 4914 (keeping 150 days of data) [2025-09-16T20:01:48.059767] [DEBUG] [LOCAL ] PNI: Primary data saved (4914 records). [2025-09-16T20:01:48.059849] [INFO ] [MAIN ] PNI: Full history saved. [2025-09-16T20:01:48.059934] [INFO ] [MAIN ] Update Progress: 1712/2369 symbols completed. PNI took 19.1s. Estimated remaining: 1h 9m 45s. Rate: 9.4 symbols/min [2025-09-16T20:01:48.232183] [INFO ] [MAIN ] POR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:01:48.271549] [DEBUG] [LOCAL ] POR: Loaded 34526 existing records from primary storage. [2025-09-16T20:01:48.271706] [INFO ] [MAIN ] POR: Loaded 34526 existing records. [2025-09-16T20:01:48.380052] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-02. [2025-09-16T20:01:48.449796] [WARN ] [MAIN ] POR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:01:48.450018] [INFO ] [MAIN ] POR: Wiping existing primary data before full refresh. [2025-09-16T20:01:48.450065] [INFO ] [LOCAL ] POR: Starting deletion of primary data. [2025-09-16T20:01:48.450846] [DEBUG] [LOCAL ] POR: Deleted primary data file. [2025-09-16T20:01:48.450894] [INFO ] [MAIN ] POR: Starting full primary refresh. [2025-09-16T20:01:48.800987] [INFO ] [REMOTE ] POR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:01:49.048677] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-16T20:01:49.174875] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-06. [2025-09-16T20:01:49.974868] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-02. [2025-09-16T20:01:50.045770] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-16T20:01:50.444144] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-16T20:01:50.774968] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-05. [2025-09-16T20:01:51.239188] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-16T20:01:51.574937] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-03. [2025-09-16T20:01:52.374878] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-07. [2025-09-16T20:01:52.975142] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-16T20:01:53.160944] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-16T20:01:53.174857] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-04. [2025-09-16T20:01:53.787109] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-16T20:01:53.974946] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-08. [2025-09-16T20:01:54.774960] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-06. [2025-09-16T20:01:54.827060] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-16T20:01:55.306409] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-16T20:01:55.574960] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-03. [2025-09-16T20:01:56.379996] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-05. [2025-09-16T20:01:56.404503] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-16T20:01:57.174922] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-09. [2025-09-16T20:01:57.368811] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-16T20:01:57.971988] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-16T20:01:57.980491] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-04. [2025-09-16T20:01:58.502426] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-16T20:01:58.507739] [INFO ] [REMOTE ] PNNT: Full fetch complete (35649 records). [2025-09-16T20:01:58.507837] [DEBUG] [VALIDATOR ] PNNT: Validating primary data. [2025-09-16T20:01:58.782118] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-06. [2025-09-16T20:01:58.931092] [DEBUG] [VALIDATOR ] PNNT: All expected trading days are present. [2025-09-16T20:01:58.931192] [DEBUG] [VALIDATOR ] PNNT: Primary data validation passed. [2025-09-16T20:01:58.931992] [INFO ] [MAIN ] PNNT: Fetched primary data is valid. [2025-09-16T20:01:58.932050] [DEBUG] [LOCAL ] PNNT: Saving primary data. [2025-09-16T20:01:58.933079] [DEBUG] [LOCAL ] PNNT: Trimmed 35649 records to 24027 (keeping 150 days of data) [2025-09-16T20:01:59.080470] [DEBUG] [LOCAL ] PNNT: Primary data saved (24027 records). [2025-09-16T20:01:59.080628] [INFO ] [MAIN ] PNNT: Full history saved. [2025-09-16T20:01:59.080776] [INFO ] [MAIN ] Update Progress: 1713/2369 symbols completed. PNNT took 27.6s. Estimated remaining: 1h 9m 40s. Rate: 9.4 symbols/min [2025-09-16T20:01:59.283990] [INFO ] [MAIN ] POST: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:01:59.322329] [DEBUG] [LOCAL ] POST: Loaded 28650 existing records from primary storage. [2025-09-16T20:01:59.322491] [INFO ] [MAIN ] POST: Loaded 28650 existing records. [2025-09-16T20:01:59.504752] [WARN ] [MAIN ] POST: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:01:59.505041] [INFO ] [MAIN ] POST: Wiping existing primary data before full refresh. [2025-09-16T20:01:59.505097] [INFO ] [LOCAL ] POST: Starting deletion of primary data. [2025-09-16T20:01:59.505761] [DEBUG] [LOCAL ] POST: Deleted primary data file. [2025-09-16T20:01:59.505819] [INFO ] [MAIN ] POST: Starting full primary refresh. [2025-09-16T20:01:59.580079] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-07. [2025-09-16T20:01:59.882615] [INFO ] [REMOTE ] POST: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:01:59.922603] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-16T20:02:00.374900] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-05. [2025-09-16T20:02:00.424441] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-16T20:02:01.174983] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-07. [2025-09-16T20:02:01.943144] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-09-16T20:02:01.974887] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-08. [2025-09-16T20:02:02.451255] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-16T20:02:02.774936] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-06. [2025-09-16T20:02:03.259580] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-16T20:02:03.574920] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-02. [2025-09-16T20:02:03.717078] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-16T20:02:04.158399] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-16T20:02:04.374909] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-07. [2025-09-16T20:02:04.680501] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-16T20:02:05.174959] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-08. [2025-09-16T20:02:05.974962] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-03. [2025-09-16T20:02:06.099166] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-16T20:02:06.324742] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-16T20:02:06.774917] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-08. [2025-09-16T20:02:07.150035] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-16T20:02:07.574909] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-09. [2025-09-16T20:02:08.363172] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-16T20:02:08.374866] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-09. [2025-09-16T20:02:08.829982] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-16T20:02:08.836412] [INFO ] [REMOTE ] PNR: Full fetch complete (52601 records). [2025-09-16T20:02:08.836594] [DEBUG] [VALIDATOR ] PNR: Validating primary data. [2025-09-16T20:02:09.189478] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-04. [2025-09-16T20:02:09.242338] [DEBUG] [VALIDATOR ] PNR: All expected trading days are present. [2025-09-16T20:02:09.242428] [DEBUG] [VALIDATOR ] PNR: Primary data validation passed. [2025-09-16T20:02:09.243598] [INFO ] [MAIN ] PNR: Fetched primary data is valid. [2025-09-16T20:02:09.243693] [DEBUG] [LOCAL ] PNR: Saving primary data. [2025-09-16T20:02:09.245010] [DEBUG] [LOCAL ] PNR: Trimmed 52601 records to 35430 (keeping 150 days of data) [2025-09-16T20:02:09.492758] [DEBUG] [LOCAL ] PNR: Primary data saved (35430 records). [2025-09-16T20:02:09.493127] [INFO ] [MAIN ] PNR: Full history saved. [2025-09-16T20:02:09.493248] [INFO ] [MAIN ] Update Progress: 1714/2369 symbols completed. PNR took 37.1s. Estimated remaining: 1h 9m 35s. Rate: 9.4 symbols/min [2025-09-16T20:02:09.684908] [INFO ] [MAIN ] PPG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:02:09.729330] [DEBUG] [LOCAL ] PPG: Loaded 37105 existing records from primary storage. [2025-09-16T20:02:09.729472] [INFO ] [MAIN ] PPG: Loaded 37105 existing records. [2025-09-16T20:02:09.907050] [WARN ] [MAIN ] PPG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:02:09.907346] [INFO ] [MAIN ] PPG: Wiping existing primary data before full refresh. [2025-09-16T20:02:09.907396] [INFO ] [LOCAL ] PPG: Starting deletion of primary data. [2025-09-16T20:02:09.913474] [DEBUG] [LOCAL ] PPG: Deleted primary data file. [2025-09-16T20:02:09.921236] [INFO ] [MAIN ] PPG: Starting full primary refresh. [2025-09-16T20:02:09.927311] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-16T20:02:09.985393] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-09. [2025-09-16T20:02:10.031597] [INFO ] [REMOTE ] PNW: Full fetch complete (49970 records). [2025-09-16T20:02:10.037318] [DEBUG] [VALIDATOR ] PNW: Validating primary data. [2025-09-16T20:02:10.552965] [INFO ] [REMOTE ] PPG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:02:10.670836] [DEBUG] [VALIDATOR ] PNW: All expected trading days are present. [2025-09-16T20:02:10.670923] [DEBUG] [VALIDATOR ] PNW: Primary data validation passed. [2025-09-16T20:02:10.671887] [INFO ] [MAIN ] PNW: Fetched primary data is valid. [2025-09-16T20:02:10.671935] [DEBUG] [LOCAL ] PNW: Saving primary data. [2025-09-16T20:02:10.673348] [DEBUG] [LOCAL ] PNW: Trimmed 49970 records to 34266 (keeping 150 days of data) [2025-09-16T20:02:10.776679] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-02. [2025-09-16T20:02:10.902190] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-16T20:02:10.929421] [DEBUG] [LOCAL ] PNW: Primary data saved (34266 records). [2025-09-16T20:02:10.929566] [INFO ] [MAIN ] PNW: Full history saved. [2025-09-16T20:02:10.929748] [INFO ] [MAIN ] Update Progress: 1715/2369 symbols completed. PNW took 24.8s. Estimated remaining: 1h 9m 27s. Rate: 9.4 symbols/min [2025-09-16T20:02:11.101256] [INFO ] [MAIN ] PPL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:02:11.142389] [DEBUG] [LOCAL ] PPL: Loaded 39499 existing records from primary storage. [2025-09-16T20:02:11.142554] [INFO ] [MAIN ] PPL: Loaded 39499 existing records. [2025-09-16T20:02:11.329316] [WARN ] [MAIN ] PPL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:02:11.329590] [INFO ] [MAIN ] PPL: Wiping existing primary data before full refresh. [2025-09-16T20:02:11.329661] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-09-16T20:02:11.330449] [DEBUG] [LOCAL ] PPL: Deleted primary data file. [2025-09-16T20:02:11.330495] [INFO ] [MAIN ] PPL: Starting full primary refresh. [2025-09-16T20:02:11.581268] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-05. [2025-09-16T20:02:11.686637] [INFO ] [REMOTE ] PPL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:02:11.756719] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-16T20:02:11.764463] [INFO ] [REMOTE ] POR: Full fetch complete (51233 records). [2025-09-16T20:02:11.764752] [DEBUG] [VALIDATOR ] POR: Validating primary data. [2025-09-16T20:02:12.242909] [DEBUG] [VALIDATOR ] POR: All expected trading days are present. [2025-09-16T20:02:12.243036] [DEBUG] [VALIDATOR ] POR: Primary data validation passed. [2025-09-16T20:02:12.244111] [INFO ] [MAIN ] POR: Fetched primary data is valid. [2025-09-16T20:02:12.244178] [DEBUG] [LOCAL ] POR: Saving primary data. [2025-09-16T20:02:12.245710] [DEBUG] [LOCAL ] POR: Trimmed 51233 records to 34867 (keeping 150 days of data) [2025-09-16T20:02:12.375498] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-02. [2025-09-16T20:02:12.506213] [DEBUG] [LOCAL ] POR: Primary data saved (34867 records). [2025-09-16T20:02:12.524293] [INFO ] [MAIN ] POR: Full history saved. [2025-09-16T20:02:12.524506] [INFO ] [MAIN ] Update Progress: 1716/2369 symbols completed. POR took 24.5s. Estimated remaining: 1h 9m 19s. Rate: 9.4 symbols/min [2025-09-16T20:02:12.573769] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-16T20:02:12.724823] [INFO ] [MAIN ] PPT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:02:12.742435] [DEBUG] [LOCAL ] PPT: Loaded 14642 existing records from primary storage. [2025-09-16T20:02:12.742580] [INFO ] [MAIN ] PPT: Loaded 14642 existing records. [2025-09-16T20:02:12.936758] [WARN ] [MAIN ] PPT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:02:12.937062] [INFO ] [MAIN ] PPT: Wiping existing primary data before full refresh. [2025-09-16T20:02:12.937111] [INFO ] [LOCAL ] PPT: Starting deletion of primary data. [2025-09-16T20:02:12.937537] [DEBUG] [LOCAL ] PPT: Deleted primary data file. [2025-09-16T20:02:12.937595] [INFO ] [MAIN ] PPT: Starting full primary refresh. [2025-09-16T20:02:13.181456] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-03. [2025-09-16T20:02:13.327737] [INFO ] [REMOTE ] PPT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:02:13.352866] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-16T20:02:13.974948] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-06. [2025-09-16T20:02:14.221996] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-16T20:02:14.723313] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-16T20:02:14.774908] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-02. [2025-09-16T20:02:15.336303] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-16T20:02:15.574896] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-04. [2025-09-16T20:02:15.942735] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-16T20:02:16.374943] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-03. [2025-09-16T20:02:17.174906] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-07. [2025-09-16T20:02:17.429321] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-16T20:02:17.974920] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-05. [2025-09-16T20:02:18.267754] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-16T20:02:18.696872] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-16T20:02:18.774926] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-04. [2025-09-16T20:02:19.574930] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-03. [2025-09-16T20:02:19.878499] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-16T20:02:20.374877] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-06. [2025-09-16T20:02:20.558966] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-16T20:02:20.719532] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-16T20:02:21.174900] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-04. [2025-09-16T20:02:21.974900] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-08. [2025-09-16T20:02:22.130319] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-16T20:02:22.175394] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-16T20:02:22.774900] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-05. [2025-09-16T20:02:23.459199] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-16T20:02:23.574927] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-05. [2025-09-16T20:02:23.595145] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-16T20:02:24.374899] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-06. [2025-09-16T20:02:25.174935] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-07. [2025-09-16T20:02:25.448412] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-16T20:02:25.562442] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-16T20:02:25.974912] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-06. [2025-09-16T20:02:26.710190] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-16T20:02:26.774894] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-08. [2025-09-16T20:02:27.574910] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-09. [2025-09-16T20:02:27.804464] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-16T20:02:28.374908] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-07. [2025-09-16T20:02:28.504585] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-16T20:02:28.781706] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-16T20:02:28.788305] [INFO ] [REMOTE ] POST: Full fetch complete (42294 records). [2025-09-16T20:02:28.788446] [DEBUG] [VALIDATOR ] POST: Validating primary data. [2025-09-16T20:02:29.158914] [DEBUG] [VALIDATOR ] POST: All expected trading days are present. [2025-09-16T20:02:29.159031] [DEBUG] [VALIDATOR ] POST: Primary data validation passed. [2025-09-16T20:02:29.159825] [INFO ] [MAIN ] POST: Fetched primary data is valid. [2025-09-16T20:02:29.159898] [DEBUG] [LOCAL ] POST: Saving primary data. [2025-09-16T20:02:29.160967] [DEBUG] [LOCAL ] POST: Trimmed 42294 records to 28970 (keeping 150 days of data) [2025-09-16T20:02:29.217235] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-09. [2025-09-16T20:02:29.344364] [DEBUG] [LOCAL ] POST: Primary data saved (28970 records). [2025-09-16T20:02:29.344509] [INFO ] [MAIN ] POST: Full history saved. [2025-09-16T20:02:29.344610] [INFO ] [MAIN ] Update Progress: 1717/2369 symbols completed. POST took 30.3s. Estimated remaining: 1h 9m 17s. Rate: 9.4 symbols/min [2025-09-16T20:02:29.974906] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-07. [2025-09-16T20:02:30.176128] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-16T20:02:30.774900] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-08. [2025-09-16T20:02:30.841009] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-16T20:02:30.949997] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-16T20:02:30.955940] [INFO ] [REMOTE ] PPG: Full fetch complete (55298 records). [2025-09-16T20:02:30.956048] [DEBUG] [VALIDATOR ] PPG: Validating primary data. [2025-09-16T20:02:31.335803] [DEBUG] [VALIDATOR ] PPG: All expected trading days are present. [2025-09-16T20:02:31.335886] [DEBUG] [VALIDATOR ] PPG: Primary data validation passed. [2025-09-16T20:02:31.336854] [INFO ] [MAIN ] PPG: Fetched primary data is valid. [2025-09-16T20:02:31.336901] [DEBUG] [LOCAL ] PPG: Saving primary data. [2025-09-16T20:02:31.338101] [DEBUG] [LOCAL ] PPG: Trimmed 55298 records to 37459 (keeping 150 days of data) [2025-09-16T20:02:31.574921] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-08. [2025-09-16T20:02:31.582066] [DEBUG] [LOCAL ] PPG: Primary data saved (37459 records). [2025-09-16T20:02:31.582337] [INFO ] [MAIN ] PPG: Full history saved. [2025-09-16T20:02:31.582437] [INFO ] [MAIN ] Update Progress: 1718/2369 symbols completed. PPG took 22.1s. Estimated remaining: 1h 9m 9s. Rate: 9.4 symbols/min [2025-09-16T20:02:32.417424] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-16T20:02:32.429159] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-09. [2025-09-16T20:02:32.599579] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-16T20:02:33.174906] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-09. [2025-09-16T20:02:34.229544] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-16T20:02:34.249022] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-16T20:02:34.255231] [INFO ] [REMOTE ] PPT: Full fetch complete (21838 records). [2025-09-16T20:02:34.255401] [DEBUG] [VALIDATOR ] PPT: Validating primary data. [2025-09-16T20:02:34.255635] [INFO ] [REMOTE ] PPL: Full fetch complete (58189 records). [2025-09-16T20:02:34.321856] [DEBUG] [VALIDATOR ] PPL: Validating primary data. [2025-09-16T20:02:34.953534] [DEBUG] [VALIDATOR ] PPT: All expected trading days are present. [2025-09-16T20:02:34.963905] [DEBUG] [VALIDATOR ] PPT: Primary data validation passed. [2025-09-16T20:02:34.984820] [INFO ] [MAIN ] PPT: Fetched primary data is valid. [2025-09-16T20:02:34.984913] [DEBUG] [LOCAL ] PPT: Saving primary data. [2025-09-16T20:02:35.037907] [DEBUG] [LOCAL ] PPT: Trimmed 21838 records to 14800 (keeping 150 days of data) [2025-09-16T20:02:35.038222] [DEBUG] [VALIDATOR ] PPL: All expected trading days are present. [2025-09-16T20:02:35.038350] [DEBUG] [VALIDATOR ] PPL: Primary data validation passed. [2025-09-16T20:02:35.039087] [INFO ] [MAIN ] PPL: Fetched primary data is valid. [2025-09-16T20:02:35.039215] [DEBUG] [LOCAL ] PPL: Saving primary data. [2025-09-16T20:02:35.041169] [DEBUG] [LOCAL ] PPL: Trimmed 58189 records to 39888 (keeping 150 days of data) [2025-09-16T20:02:35.362060] [DEBUG] [LOCAL ] PPT: Primary data saved (14800 records). [2025-09-16T20:02:35.366546] [INFO ] [MAIN ] PPT: Full history saved. [2025-09-16T20:02:35.366686] [INFO ] [MAIN ] Update Progress: 1719/2369 symbols completed. PPT took 22.8s. Estimated remaining: 1h 9m 1s. Rate: 9.4 symbols/min [2025-09-16T20:02:35.381097] [DEBUG] [LOCAL ] PPL: Primary data saved (39888 records). [2025-09-16T20:02:35.381212] [INFO ] [MAIN ] PPL: Full history saved. [2025-09-16T20:02:35.381297] [INFO ] [MAIN ] Update Progress: 1720/2369 symbols completed. PPL took 24.5s. Estimated remaining: 1h 8m 53s. Rate: 9.4 symbols/min [2025-09-16T20:02:35.913486] [INFO ] [MAIN ] PRA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:02:36.110045] [INFO ] [MAIN ] PRG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:02:36.111224] [INFO ] [MAIN ] PRCS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:02:36.114190] [INFO ] [MAIN ] PR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:02:36.119718] [DEBUG] [LOCAL ] PRCS: Loaded 1987 existing records from primary storage. [2025-09-16T20:02:36.119901] [INFO ] [MAIN ] PRCS: Loaded 1987 existing records. [2025-09-16T20:02:36.245155] [DEBUG] [LOCAL ] PRA: Loaded 25598 existing records from primary storage. [2025-09-16T20:02:36.261162] [INFO ] [MAIN ] PRA: Loaded 25598 existing records. [2025-09-16T20:02:36.300171] [DEBUG] [LOCAL ] PRG: Loaded 21553 existing records from primary storage. [2025-09-16T20:02:36.389037] [WARN ] [MAIN ] PRCS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:02:36.414236] [INFO ] [MAIN ] PRG: Loaded 21553 existing records. [2025-09-16T20:02:36.419716] [INFO ] [MAIN ] PRCS: Wiping existing primary data before full refresh. [2025-09-16T20:02:36.490055] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-09-16T20:02:36.593387] [DEBUG] [LOCAL ] PRCS: Deleted primary data file. [2025-09-16T20:02:36.613834] [INFO ] [MAIN ] PRCS: Starting full primary refresh. [2025-09-16T20:02:36.678486] [WARN ] [MAIN ] PRA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:02:36.698663] [DEBUG] [LOCAL ] PR: Loaded 39574 existing records from primary storage. [2025-09-16T20:02:36.704184] [INFO ] [MAIN ] PR: Loaded 39574 existing records. [2025-09-16T20:02:36.698991] [INFO ] [MAIN ] PRA: Wiping existing primary data before full refresh. [2025-09-16T20:02:36.745952] [INFO ] [LOCAL ] PRA: Starting deletion of primary data. [2025-09-16T20:02:36.820478] [DEBUG] [LOCAL ] PRA: Deleted primary data file. [2025-09-16T20:02:36.864071] [INFO ] [MAIN ] PRA: Starting full primary refresh. [2025-09-16T20:02:36.939888] [WARN ] [MAIN ] PRG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:02:37.118279] [INFO ] [MAIN ] PRG: Wiping existing primary data before full refresh. [2025-09-16T20:02:37.132353] [INFO ] [LOCAL ] PRG: Starting deletion of primary data. [2025-09-16T20:02:37.167298] [DEBUG] [LOCAL ] PRG: Deleted primary data file. [2025-09-16T20:02:37.158255] [WARN ] [MAIN ] PR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:02:37.190043] [INFO ] [MAIN ] PRG: Starting full primary refresh. [2025-09-16T20:02:37.266466] [INFO ] [MAIN ] PR: Wiping existing primary data before full refresh. [2025-09-16T20:02:37.361256] [INFO ] [LOCAL ] PR: Starting deletion of primary data. [2025-09-16T20:02:37.511148] [DEBUG] [LOCAL ] PR: Deleted primary data file. [2025-09-16T20:02:37.537279] [INFO ] [MAIN ] PR: Starting full primary refresh. [2025-09-16T20:02:37.770339] [INFO ] [REMOTE ] PRCS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:02:37.876563] [INFO ] [REMOTE ] PRA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:02:37.867624] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-02. [2025-09-16T20:02:37.918531] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-02. [2025-09-16T20:02:38.275255] [INFO ] [REMOTE ] PRG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:02:38.275715] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-02. [2025-09-16T20:02:38.365680] [INFO ] [REMOTE ] PR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:02:38.366020] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-02. [2025-09-16T20:02:38.476994] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-16T20:02:38.478446] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-03. [2025-09-16T20:02:39.044084] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-16T20:02:39.045474] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-04. [2025-09-16T20:02:39.057817] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-16T20:02:39.062421] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-03. [2025-09-16T20:02:39.644173] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-16T20:02:39.645837] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-05. [2025-09-16T20:02:39.816715] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-16T20:02:40.115463] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-16T20:02:40.163125] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-16T20:02:40.181523] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-16T20:02:40.374910] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-03. [2025-09-16T20:02:41.174929] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-04. [2025-09-16T20:02:41.826416] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-16T20:02:41.974939] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-06. [2025-09-16T20:02:42.506158] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-16T20:02:42.775067] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-04. [2025-09-16T20:02:42.778231] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-16T20:02:43.574955] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-07. [2025-09-16T20:02:43.896556] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-16T20:02:43.927191] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-16T20:02:44.374934] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-05. [2025-09-16T20:02:45.174939] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-03. [2025-09-16T20:02:45.735753] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-16T20:02:45.974922] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-06. [2025-09-16T20:02:46.774938] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-05. [2025-09-16T20:02:47.002595] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-16T20:02:47.227797] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-16T20:02:47.574953] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-08. [2025-09-16T20:02:48.064080] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-16T20:02:48.331134] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-16T20:02:48.374933] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-06. [2025-09-16T20:02:49.174911] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-07. [2025-09-16T20:02:49.706596] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-16T20:02:49.974914] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-07. [2025-09-16T20:02:50.484824] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-16T20:02:50.774905] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-08. [2025-09-16T20:02:51.444956] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-16T20:02:51.574863] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-08. [2025-09-16T20:02:51.931321] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-16T20:02:52.374920] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-09. [2025-09-16T20:02:52.559889] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-16T20:02:52.912203] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-16T20:02:52.913070] [INFO ] [REMOTE ] PRCS: Full fetch complete (3079 records). [2025-09-16T20:02:52.913163] [DEBUG] [VALIDATOR ] PRCS: Validating primary data. [2025-09-16T20:02:53.179961] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-09. [2025-09-16T20:02:53.274562] [DEBUG] [VALIDATOR ] PRCS: All expected trading days are present. [2025-09-16T20:02:53.274683] [DEBUG] [VALIDATOR ] PRCS: Primary data validation passed. [2025-09-16T20:02:53.274858] [INFO ] [MAIN ] PRCS: Fetched primary data is valid. [2025-09-16T20:02:53.274926] [DEBUG] [LOCAL ] PRCS: Saving primary data. [2025-09-16T20:02:53.275294] [DEBUG] [LOCAL ] PRCS: Trimmed 3079 records to 2004 (keeping 150 days of data) [2025-09-16T20:02:53.287915] [DEBUG] [LOCAL ] PRCS: Primary data saved (2004 records). [2025-09-16T20:02:53.287994] [INFO ] [MAIN ] PRCS: Full history saved. [2025-09-16T20:02:53.288072] [INFO ] [MAIN ] Update Progress: 1721/2369 symbols completed. PRCS took 17.9s. Estimated remaining: 1h 8m 51s. Rate: 9.4 symbols/min [2025-09-16T20:02:53.464463] [INFO ] [MAIN ] PRGO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:02:53.500517] [DEBUG] [LOCAL ] PRGO: Loaded 34043 existing records from primary storage. [2025-09-16T20:02:53.500696] [INFO ] [MAIN ] PRGO: Loaded 34043 existing records. [2025-09-16T20:02:53.683624] [WARN ] [MAIN ] PRGO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:02:53.683896] [INFO ] [MAIN ] PRGO: Wiping existing primary data before full refresh. [2025-09-16T20:02:53.683943] [INFO ] [LOCAL ] PRGO: Starting deletion of primary data. [2025-09-16T20:02:53.684859] [DEBUG] [LOCAL ] PRGO: Deleted primary data file. [2025-09-16T20:02:53.684908] [INFO ] [MAIN ] PRGO: Starting full primary refresh. [2025-09-16T20:02:53.977738] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-04. [2025-09-16T20:02:54.059538] [INFO ] [REMOTE ] PRGO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:02:54.464556] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-16T20:02:54.468690] [INFO ] [REMOTE ] PRA: Full fetch complete (36575 records). [2025-09-16T20:02:54.468855] [DEBUG] [VALIDATOR ] PRA: Validating primary data. [2025-09-16T20:02:54.775016] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-02. [2025-09-16T20:02:54.862287] [DEBUG] [VALIDATOR ] PRA: All expected trading days are present. [2025-09-16T20:02:54.862372] [DEBUG] [VALIDATOR ] PRA: Primary data validation passed. [2025-09-16T20:02:54.863169] [INFO ] [MAIN ] PRA: Fetched primary data is valid. [2025-09-16T20:02:54.863216] [DEBUG] [LOCAL ] PRA: Saving primary data. [2025-09-16T20:02:54.864345] [DEBUG] [LOCAL ] PRA: Trimmed 36575 records to 25842 (keeping 150 days of data) [2025-09-16T20:02:55.024761] [DEBUG] [LOCAL ] PRA: Primary data saved (25842 records). [2025-09-16T20:02:55.024902] [INFO ] [MAIN ] PRA: Full history saved. [2025-09-16T20:02:55.024992] [INFO ] [MAIN ] Update Progress: 1722/2369 symbols completed. PRA took 19.6s. Estimated remaining: 1h 8m 42s. Rate: 9.4 symbols/min [2025-09-16T20:02:55.206348] [INFO ] [MAIN ] PRH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:02:55.212870] [DEBUG] [LOCAL ] PRH: Loaded 3510 existing records from primary storage. [2025-09-16T20:02:55.212986] [INFO ] [MAIN ] PRH: Loaded 3510 existing records. [2025-09-16T20:02:55.407912] [WARN ] [MAIN ] PRH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:02:55.408245] [INFO ] [MAIN ] PRH: Wiping existing primary data before full refresh. [2025-09-16T20:02:55.408295] [INFO ] [LOCAL ] PRH: Starting deletion of primary data. [2025-09-16T20:02:55.408556] [DEBUG] [LOCAL ] PRH: Deleted primary data file. [2025-09-16T20:02:55.408601] [INFO ] [MAIN ] PRH: Starting full primary refresh. [2025-09-16T20:02:55.584773] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-09. [2025-09-16T20:02:55.773974] [INFO ] [REMOTE ] PRH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:02:55.976007] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-16T20:02:56.324257] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-16T20:02:56.374918] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-03. [2025-09-16T20:02:56.792257] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-16T20:02:56.796629] [INFO ] [REMOTE ] PRG: Full fetch complete (34171 records). [2025-09-16T20:02:56.796760] [DEBUG] [VALIDATOR ] PRG: Validating primary data. [2025-09-16T20:02:57.183907] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-02. [2025-09-16T20:02:57.197368] [DEBUG] [VALIDATOR ] PRG: All expected trading days are present. [2025-09-16T20:02:57.197436] [DEBUG] [VALIDATOR ] PRG: Primary data validation passed. [2025-09-16T20:02:57.198133] [INFO ] [MAIN ] PRG: Fetched primary data is valid. [2025-09-16T20:02:57.198180] [DEBUG] [LOCAL ] PRG: Saving primary data. [2025-09-16T20:02:57.199264] [DEBUG] [LOCAL ] PRG: Trimmed 34171 records to 21741 (keeping 150 days of data) [2025-09-16T20:02:57.332706] [DEBUG] [LOCAL ] PRG: Primary data saved (21741 records). [2025-09-16T20:02:57.332840] [INFO ] [MAIN ] PRG: Full history saved. [2025-09-16T20:02:57.332939] [INFO ] [MAIN ] Update Progress: 1723/2369 symbols completed. PRG took 21.9s. Estimated remaining: 1h 8m 35s. Rate: 9.4 symbols/min [2025-09-16T20:02:57.512100] [INFO ] [MAIN ] PRI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:02:57.526989] [DEBUG] [LOCAL ] PRI: Loaded 13062 existing records from primary storage. [2025-09-16T20:02:57.527114] [INFO ] [MAIN ] PRI: Loaded 13062 existing records. [2025-09-16T20:02:57.705405] [WARN ] [MAIN ] PRI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:02:57.705689] [INFO ] [MAIN ] PRI: Wiping existing primary data before full refresh. [2025-09-16T20:02:57.705739] [INFO ] [LOCAL ] PRI: Starting deletion of primary data. [2025-09-16T20:02:57.706269] [DEBUG] [LOCAL ] PRI: Deleted primary data file. [2025-09-16T20:02:57.706315] [INFO ] [MAIN ] PRI: Starting full primary refresh. [2025-09-16T20:02:57.984801] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-05. [2025-09-16T20:02:58.068893] [INFO ] [REMOTE ] PRI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:02:58.050008] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-16T20:02:58.101828] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-16T20:02:58.774906] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-04. [2025-09-16T20:02:59.574898] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-02. [2025-09-16T20:03:00.055655] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-16T20:03:00.374911] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-06. [2025-09-16T20:03:00.545953] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-16T20:03:00.650192] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-16T20:03:01.174942] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-03. [2025-09-16T20:03:01.974928] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-05. [2025-09-16T20:03:02.064619] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-16T20:03:02.201126] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-16T20:03:02.774929] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-03. [2025-09-16T20:03:03.353994] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-16T20:03:03.583201] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-04. [2025-09-16T20:03:03.588524] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-16T20:03:04.306940] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-16T20:03:04.374883] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-06. [2025-09-16T20:03:05.174931] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-07. [2025-09-16T20:03:05.953989] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-16T20:03:05.974857] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-07. [2025-09-16T20:03:06.691380] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-16T20:03:06.774952] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-05. [2025-09-16T20:03:07.196144] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-16T20:03:07.482077] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-16T20:03:07.574930] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-04. [2025-09-16T20:03:08.374930] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-08. [2025-09-16T20:03:08.784507] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-16T20:03:09.174940] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-08. [2025-09-16T20:03:09.974899] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-06. [2025-09-16T20:03:10.083153] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-16T20:03:10.637417] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-16T20:03:10.757109] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-16T20:03:10.774854] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-09. [2025-09-16T20:03:11.574910] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-07. [2025-09-16T20:03:12.351004] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-16T20:03:12.374848] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-08. [2025-09-16T20:03:12.746788] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-16T20:03:12.753319] [INFO ] [REMOTE ] PR: Full fetch complete (58286 records). [2025-09-16T20:03:12.753524] [DEBUG] [VALIDATOR ] PR: Validating primary data. [2025-09-16T20:03:13.115927] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-16T20:03:13.170950] [DEBUG] [VALIDATOR ] PR: All expected trading days are present. [2025-09-16T20:03:13.171052] [DEBUG] [VALIDATOR ] PR: Primary data validation passed. [2025-09-16T20:03:13.172118] [INFO ] [MAIN ] PR: Fetched primary data is valid. [2025-09-16T20:03:13.172170] [DEBUG] [LOCAL ] PR: Saving primary data. [2025-09-16T20:03:13.173564] [DEBUG] [LOCAL ] PR: Trimmed 58286 records to 39964 (keeping 150 days of data) [2025-09-16T20:03:13.174845] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-09. [2025-09-16T20:03:13.427328] [DEBUG] [LOCAL ] PR: Primary data saved (39964 records). [2025-09-16T20:03:13.427485] [INFO ] [MAIN ] PR: Full history saved. [2025-09-16T20:03:13.429439] [INFO ] [MAIN ] Update Progress: 1724/2369 symbols completed. PR took 38.0s. Estimated remaining: 1h 8m 32s. Rate: 9.4 symbols/min [2025-09-16T20:03:13.609231] [INFO ] [MAIN ] PRIM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:03:13.649837] [DEBUG] [LOCAL ] PRIM: Loaded 32736 existing records from primary storage. [2025-09-16T20:03:13.650003] [INFO ] [MAIN ] PRIM: Loaded 32736 existing records. [2025-09-16T20:03:13.916304] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-16T20:03:13.940356] [INFO ] [REMOTE ] PRH: Full fetch complete (5840 records). [2025-09-16T20:03:13.945853] [DEBUG] [VALIDATOR ] PRH: Validating primary data. [2025-09-16T20:03:13.951703] [WARN ] [MAIN ] PRIM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:03:13.986130] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-05. [2025-09-16T20:03:14.013813] [INFO ] [MAIN ] PRIM: Wiping existing primary data before full refresh. [2025-09-16T20:03:14.025858] [INFO ] [LOCAL ] PRIM: Starting deletion of primary data. [2025-09-16T20:03:14.070943] [DEBUG] [LOCAL ] PRIM: Deleted primary data file. [2025-09-16T20:03:14.093071] [INFO ] [MAIN ] PRIM: Starting full primary refresh. [2025-09-16T20:03:14.783717] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-09. [2025-09-16T20:03:14.904727] [DEBUG] [VALIDATOR ] PRH: All expected trading days are present. [2025-09-16T20:03:14.910557] [DEBUG] [VALIDATOR ] PRH: Primary data validation passed. [2025-09-16T20:03:14.921082] [INFO ] [MAIN ] PRH: Fetched primary data is valid. [2025-09-16T20:03:14.947270] [DEBUG] [LOCAL ] PRH: Saving primary data. [2025-09-16T20:03:14.987298] [INFO ] [REMOTE ] PRIM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:03:14.987430] [DEBUG] [LOCAL ] PRH: Trimmed 5840 records to 3527 (keeping 150 days of data) [2025-09-16T20:03:15.010308] [DEBUG] [LOCAL ] PRH: Primary data saved (3527 records). [2025-09-16T20:03:15.010464] [INFO ] [MAIN ] PRH: Full history saved. [2025-09-16T20:03:15.010557] [INFO ] [MAIN ] Update Progress: 1725/2369 symbols completed. PRH took 20.0s. Estimated remaining: 1h 8m 24s. Rate: 9.4 symbols/min [2025-09-16T20:03:15.185816] [INFO ] [MAIN ] PRKS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:03:15.197431] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-16T20:03:15.229206] [DEBUG] [LOCAL ] PRKS: Loaded 31146 existing records from primary storage. [2025-09-16T20:03:15.229350] [INFO ] [MAIN ] PRKS: Loaded 31146 existing records. [2025-09-16T20:03:15.408499] [WARN ] [MAIN ] PRKS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:03:15.408866] [INFO ] [MAIN ] PRKS: Wiping existing primary data before full refresh. [2025-09-16T20:03:15.408972] [INFO ] [LOCAL ] PRKS: Starting deletion of primary data. [2025-09-16T20:03:15.409692] [DEBUG] [LOCAL ] PRKS: Deleted primary data file. [2025-09-16T20:03:15.409758] [INFO ] [MAIN ] PRKS: Starting full primary refresh. [2025-09-16T20:03:15.582889] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-02. [2025-09-16T20:03:15.771603] [INFO ] [REMOTE ] PRKS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:03:16.374956] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-02. [2025-09-16T20:03:16.648675] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-16T20:03:16.655235] [INFO ] [REMOTE ] PRGO: Full fetch complete (51238 records). [2025-09-16T20:03:16.655342] [DEBUG] [VALIDATOR ] PRGO: Validating primary data. [2025-09-16T20:03:17.049353] [DEBUG] [VALIDATOR ] PRGO: All expected trading days are present. [2025-09-16T20:03:17.049480] [DEBUG] [VALIDATOR ] PRGO: Primary data validation passed. [2025-09-16T20:03:17.050915] [INFO ] [MAIN ] PRGO: Fetched primary data is valid. [2025-09-16T20:03:17.051007] [DEBUG] [LOCAL ] PRGO: Saving primary data. [2025-09-16T20:03:17.052925] [DEBUG] [LOCAL ] PRGO: Trimmed 51238 records to 34405 (keeping 150 days of data) [2025-09-16T20:03:17.179782] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-06. [2025-09-16T20:03:17.274578] [DEBUG] [LOCAL ] PRGO: Primary data saved (34405 records). [2025-09-16T20:03:17.274893] [INFO ] [MAIN ] PRGO: Full history saved. [2025-09-16T20:03:17.275004] [INFO ] [MAIN ] Update Progress: 1726/2369 symbols completed. PRGO took 24.0s. Estimated remaining: 1h 8m 16s. Rate: 9.4 symbols/min [2025-09-16T20:03:17.428023] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-16T20:03:17.515855] [INFO ] [MAIN ] PRLB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:03:17.548146] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-16T20:03:17.562395] [DEBUG] [LOCAL ] PRLB: Loaded 14741 existing records from primary storage. [2025-09-16T20:03:17.562563] [INFO ] [MAIN ] PRLB: Loaded 14741 existing records. [2025-09-16T20:03:17.755924] [WARN ] [MAIN ] PRLB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:03:17.756221] [INFO ] [MAIN ] PRLB: Wiping existing primary data before full refresh. [2025-09-16T20:03:17.756277] [INFO ] [LOCAL ] PRLB: Starting deletion of primary data. [2025-09-16T20:03:17.756802] [DEBUG] [LOCAL ] PRLB: Deleted primary data file. [2025-09-16T20:03:17.756853] [INFO ] [MAIN ] PRLB: Starting full primary refresh. [2025-09-16T20:03:17.980228] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-03. [2025-09-16T20:03:18.139954] [INFO ] [REMOTE ] PRLB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:03:18.152566] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-16T20:03:18.774963] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-07. [2025-09-16T20:03:19.574952] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-03. [2025-09-16T20:03:19.645194] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-16T20:03:19.858553] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-16T20:03:20.374926] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-08. [2025-09-16T20:03:21.174894] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-04. [2025-09-16T20:03:21.308446] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-16T20:03:21.331104] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-16T20:03:21.974907] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-09. [2025-09-16T20:03:22.669073] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-16T20:03:22.774930] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-02. [2025-09-16T20:03:22.942815] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-16T20:03:22.946816] [INFO ] [REMOTE ] PRI: Full fetch complete (19944 records). [2025-09-16T20:03:22.946940] [DEBUG] [VALIDATOR ] PRI: Validating primary data. [2025-09-16T20:03:23.356127] [DEBUG] [VALIDATOR ] PRI: All expected trading days are present. [2025-09-16T20:03:23.356224] [DEBUG] [VALIDATOR ] PRI: Primary data validation passed. [2025-09-16T20:03:23.356731] [INFO ] [MAIN ] PRI: Fetched primary data is valid. [2025-09-16T20:03:23.356783] [DEBUG] [LOCAL ] PRI: Saving primary data. [2025-09-16T20:03:23.357543] [DEBUG] [LOCAL ] PRI: Trimmed 19944 records to 13205 (keeping 150 days of data) [2025-09-16T20:03:23.442133] [DEBUG] [LOCAL ] PRI: Primary data saved (13205 records). [2025-09-16T20:03:23.442299] [INFO ] [MAIN ] PRI: Full history saved. [2025-09-16T20:03:23.442423] [INFO ] [MAIN ] Update Progress: 1727/2369 symbols completed. PRI took 26.1s. Estimated remaining: 1h 8m 9s. Rate: 9.4 symbols/min [2025-09-16T20:03:23.585834] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-04. [2025-09-16T20:03:23.618366] [INFO ] [MAIN ] PRM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:03:23.651532] [DEBUG] [LOCAL ] PRM: Loaded 32641 existing records from primary storage. [2025-09-16T20:03:23.651700] [INFO ] [MAIN ] PRM: Loaded 32641 existing records. [2025-09-16T20:03:23.839688] [WARN ] [MAIN ] PRM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:03:23.840003] [INFO ] [MAIN ] PRM: Wiping existing primary data before full refresh. [2025-09-16T20:03:23.840135] [INFO ] [LOCAL ] PRM: Starting deletion of primary data. [2025-09-16T20:03:23.846063] [DEBUG] [LOCAL ] PRM: Deleted primary data file. [2025-09-16T20:03:23.853270] [INFO ] [MAIN ] PRM: Starting full primary refresh. [2025-09-16T20:03:23.886171] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-16T20:03:24.224008] [INFO ] [REMOTE ] PRM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:03:24.374900] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-03. [2025-09-16T20:03:25.174903] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-02. [2025-09-16T20:03:25.256825] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-16T20:03:25.520400] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-16T20:03:25.974912] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-05. [2025-09-16T20:03:26.271133] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-16T20:03:26.774902] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-04. [2025-09-16T20:03:27.491089] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-16T20:03:27.574889] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-06. [2025-09-16T20:03:27.965087] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-16T20:03:28.374923] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-03. [2025-09-16T20:03:28.768676] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-16T20:03:29.174895] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-07. [2025-09-16T20:03:29.973297] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-16T20:03:29.982145] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-05. [2025-09-16T20:03:30.668489] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-16T20:03:30.774865] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-05. [2025-09-16T20:03:31.097605] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-16T20:03:31.574892] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-08. [2025-09-16T20:03:32.389213] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-06. [2025-09-16T20:03:32.394888] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-16T20:03:32.811136] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-16T20:03:33.071936] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-16T20:03:33.174867] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-07. [2025-09-16T20:03:33.974937] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-09. [2025-09-16T20:03:34.040473] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-16T20:03:34.774940] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-04. [2025-09-16T20:03:35.478903] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-16T20:03:35.484513] [INFO ] [REMOTE ] PRKS: Full fetch complete (46736 records). [2025-09-16T20:03:35.484670] [DEBUG] [VALIDATOR ] PRKS: Validating primary data. [2025-09-16T20:03:35.583204] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-08. [2025-09-16T20:03:35.866415] [DEBUG] [VALIDATOR ] PRKS: All expected trading days are present. [2025-09-16T20:03:35.866504] [DEBUG] [VALIDATOR ] PRKS: Primary data validation passed. [2025-09-16T20:03:35.867362] [INFO ] [MAIN ] PRKS: Fetched primary data is valid. [2025-09-16T20:03:35.867414] [DEBUG] [LOCAL ] PRKS: Saving primary data. [2025-09-16T20:03:35.868519] [DEBUG] [LOCAL ] PRKS: Trimmed 46736 records to 31477 (keeping 150 days of data) [2025-09-16T20:03:36.056109] [DEBUG] [LOCAL ] PRKS: Primary data saved (31477 records). [2025-09-16T20:03:36.056253] [INFO ] [MAIN ] PRKS: Full history saved. [2025-09-16T20:03:36.056351] [INFO ] [MAIN ] Update Progress: 1728/2369 symbols completed. PRKS took 21.0s. Estimated remaining: 1h 8m 5s. Rate: 9.4 symbols/min [2025-09-16T20:03:36.236113] [INFO ] [MAIN ] PRMB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:03:36.272049] [DEBUG] [LOCAL ] PRMB: Loaded 39285 existing records from primary storage. [2025-09-16T20:03:36.272189] [INFO ] [MAIN ] PRMB: Loaded 39285 existing records. [2025-09-16T20:03:36.377362] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-06. [2025-09-16T20:03:36.459629] [WARN ] [MAIN ] PRMB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:03:36.460074] [INFO ] [MAIN ] PRMB: Wiping existing primary data before full refresh. [2025-09-16T20:03:36.460260] [INFO ] [LOCAL ] PRMB: Starting deletion of primary data. [2025-09-16T20:03:36.461195] [DEBUG] [LOCAL ] PRMB: Deleted primary data file. [2025-09-16T20:03:36.461251] [INFO ] [MAIN ] PRMB: Starting full primary refresh. [2025-09-16T20:03:36.651047] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-16T20:03:36.880090] [INFO ] [REMOTE ] PRMB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:03:36.892536] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-16T20:03:37.174942] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-09. [2025-09-16T20:03:37.908810] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-16T20:03:37.974860] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-07. [2025-09-16T20:03:38.284731] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-16T20:03:38.287082] [INFO ] [REMOTE ] PRLB: Full fetch complete (23127 records). [2025-09-16T20:03:38.287151] [DEBUG] [VALIDATOR ] PRLB: Validating primary data. [2025-09-16T20:03:38.681410] [DEBUG] [VALIDATOR ] PRLB: All expected trading days are present. [2025-09-16T20:03:38.681503] [DEBUG] [VALIDATOR ] PRLB: Primary data validation passed. [2025-09-16T20:03:38.682358] [INFO ] [MAIN ] PRLB: Fetched primary data is valid. [2025-09-16T20:03:38.682428] [DEBUG] [LOCAL ] PRLB: Saving primary data. [2025-09-16T20:03:38.683273] [DEBUG] [LOCAL ] PRLB: Trimmed 23127 records to 14854 (keeping 150 days of data) [2025-09-16T20:03:38.776938] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-05. [2025-09-16T20:03:38.783358] [DEBUG] [LOCAL ] PRLB: Primary data saved (14854 records). [2025-09-16T20:03:38.783532] [INFO ] [MAIN ] PRLB: Full history saved. [2025-09-16T20:03:38.783683] [INFO ] [MAIN ] Update Progress: 1729/2369 symbols completed. PRLB took 21.5s. Estimated remaining: 1h 7m 58s. Rate: 9.4 symbols/min [2025-09-16T20:03:38.970751] [INFO ] [MAIN ] PRO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:03:38.999230] [DEBUG] [LOCAL ] PRO: Loaded 28610 existing records from primary storage. [2025-09-16T20:03:38.999401] [INFO ] [MAIN ] PRO: Loaded 28610 existing records. [2025-09-16T20:03:39.187432] [WARN ] [MAIN ] PRO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:03:39.187699] [INFO ] [MAIN ] PRO: Wiping existing primary data before full refresh. [2025-09-16T20:03:39.187757] [INFO ] [LOCAL ] PRO: Starting deletion of primary data. [2025-09-16T20:03:39.188514] [DEBUG] [LOCAL ] PRO: Deleted primary data file. [2025-09-16T20:03:39.188576] [INFO ] [MAIN ] PRO: Starting full primary refresh. [2025-09-16T20:03:39.561793] [INFO ] [REMOTE ] PRO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:03:39.579945] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-02. [2025-09-16T20:03:39.598283] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-16T20:03:40.322927] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-16T20:03:40.374854] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-06. [2025-09-16T20:03:41.174921] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-08. [2025-09-16T20:03:41.244755] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-16T20:03:41.788140] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-16T20:03:41.974896] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-07. [2025-09-16T20:03:42.560414] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-16T20:03:42.774901] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-09. [2025-09-16T20:03:43.195377] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-16T20:03:43.574932] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-03. [2025-09-16T20:03:44.368059] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-16T20:03:44.373388] [INFO ] [REMOTE ] PRIM: Full fetch complete (48633 records). [2025-09-16T20:03:44.373504] [DEBUG] [VALIDATOR ] PRIM: Validating primary data. [2025-09-16T20:03:44.385564] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-02. [2025-09-16T20:03:44.787339] [DEBUG] [VALIDATOR ] PRIM: All expected trading days are present. [2025-09-16T20:03:44.787423] [DEBUG] [VALIDATOR ] PRIM: Primary data validation passed. [2025-09-16T20:03:44.788256] [INFO ] [MAIN ] PRIM: Fetched primary data is valid. [2025-09-16T20:03:44.788304] [DEBUG] [LOCAL ] PRIM: Saving primary data. [2025-09-16T20:03:44.789460] [DEBUG] [LOCAL ] PRIM: Trimmed 48633 records to 33058 (keeping 150 days of data) [2025-09-16T20:03:45.001286] [DEBUG] [LOCAL ] PRIM: Primary data saved (33058 records). [2025-09-16T20:03:45.001548] [INFO ] [MAIN ] PRIM: Full history saved. [2025-09-16T20:03:45.002310] [INFO ] [MAIN ] Update Progress: 1730/2369 symbols completed. PRIM took 31.6s. Estimated remaining: 1h 7m 51s. Rate: 9.4 symbols/min [2025-09-16T20:03:45.147726] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-16T20:03:45.188058] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-08. [2025-09-16T20:03:45.220132] [INFO ] [MAIN ] PRSU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:03:45.240849] [DEBUG] [LOCAL ] PRSU: Loaded 17591 existing records from primary storage. [2025-09-16T20:03:45.240987] [INFO ] [MAIN ] PRSU: Loaded 17591 existing records. [2025-09-16T20:03:45.416474] [WARN ] [MAIN ] PRSU: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:03:45.416716] [INFO ] [MAIN ] PRSU: Wiping existing primary data before full refresh. [2025-09-16T20:03:45.416773] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-09-16T20:03:45.417345] [DEBUG] [LOCAL ] PRSU: Deleted primary data file. [2025-09-16T20:03:45.417392] [INFO ] [MAIN ] PRSU: Starting full primary refresh. [2025-09-16T20:03:45.774222] [INFO ] [REMOTE ] PRSU: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:03:45.791866] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-16T20:03:45.974875] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-02. [2025-09-16T20:03:46.774966] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-04. [2025-09-16T20:03:46.869450] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-16T20:03:47.037517] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-16T20:03:47.575005] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-03. [2025-09-16T20:03:48.378356] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-03. [2025-09-16T20:03:48.399539] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-16T20:03:48.776147] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-16T20:03:49.174945] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-04. [2025-09-16T20:03:49.545181] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-16T20:03:49.974953] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-05. [2025-09-16T20:03:50.464980] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-16T20:03:50.774983] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-09. [2025-09-16T20:03:51.574919] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-05. [2025-09-16T20:03:51.827234] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-16T20:03:52.335619] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-16T20:03:52.341302] [INFO ] [REMOTE ] PRM: Full fetch complete (48691 records). [2025-09-16T20:03:52.341419] [DEBUG] [VALIDATOR ] PRM: Validating primary data. [2025-09-16T20:03:52.384964] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-04. [2025-09-16T20:03:52.718511] [DEBUG] [VALIDATOR ] PRM: All expected trading days are present. [2025-09-16T20:03:52.718654] [DEBUG] [VALIDATOR ] PRM: Primary data validation passed. [2025-09-16T20:03:52.719457] [INFO ] [MAIN ] PRM: Fetched primary data is valid. [2025-09-16T20:03:52.719529] [DEBUG] [LOCAL ] PRM: Saving primary data. [2025-09-16T20:03:52.720951] [DEBUG] [LOCAL ] PRM: Trimmed 48691 records to 32987 (keeping 150 days of data) [2025-09-16T20:03:52.736349] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-16T20:03:52.935954] [DEBUG] [LOCAL ] PRM: Primary data saved (32987 records). [2025-09-16T20:03:52.936103] [INFO ] [MAIN ] PRM: Full history saved. [2025-09-16T20:03:52.936215] [INFO ] [MAIN ] Update Progress: 1731/2369 symbols completed. PRM took 29.5s. Estimated remaining: 1h 7m 45s. Rate: 9.4 symbols/min [2025-09-16T20:03:53.108271] [INFO ] [MAIN ] PRT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:03:53.114523] [DEBUG] [LOCAL ] PRT: Loaded 3636 existing records from primary storage. [2025-09-16T20:03:53.114611] [INFO ] [MAIN ] PRT: Loaded 3636 existing records. [2025-09-16T20:03:53.180062] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-06. [2025-09-16T20:03:53.292146] [WARN ] [MAIN ] PRT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:03:53.292373] [INFO ] [MAIN ] PRT: Wiping existing primary data before full refresh. [2025-09-16T20:03:53.292417] [INFO ] [LOCAL ] PRT: Starting deletion of primary data. [2025-09-16T20:03:53.292622] [DEBUG] [LOCAL ] PRT: Deleted primary data file. [2025-09-16T20:03:53.292705] [INFO ] [MAIN ] PRT: Starting full primary refresh. [2025-09-16T20:03:53.674446] [INFO ] [REMOTE ] PRT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:03:53.906497] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-16T20:03:53.974939] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-06. [2025-09-16T20:03:54.444675] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-16T20:03:54.774910] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-02. [2025-09-16T20:03:55.513977] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-16T20:03:55.574861] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-05. [2025-09-16T20:03:55.689564] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-16T20:03:56.374906] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-07. [2025-09-16T20:03:57.056993] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-16T20:03:57.174912] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-06. [2025-09-16T20:03:57.507510] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-16T20:03:57.974928] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-08. [2025-09-16T20:03:58.715423] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-16T20:03:58.774932] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-07. [2025-09-16T20:03:59.104344] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-16T20:03:59.574957] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-07. [2025-09-16T20:04:00.344579] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-16T20:04:00.374866] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-08. [2025-09-16T20:04:01.174973] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-09. [2025-09-16T20:04:01.557968] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-16T20:04:01.896756] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-16T20:04:01.974912] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-08. [2025-09-16T20:04:02.221895] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-16T20:04:02.224814] [INFO ] [REMOTE ] PRSU: Full fetch complete (26756 records). [2025-09-16T20:04:02.224897] [DEBUG] [VALIDATOR ] PRSU: Validating primary data. [2025-09-16T20:04:02.596900] [DEBUG] [VALIDATOR ] PRSU: All expected trading days are present. [2025-09-16T20:04:02.597004] [DEBUG] [VALIDATOR ] PRSU: Primary data validation passed. [2025-09-16T20:04:02.597571] [INFO ] [MAIN ] PRSU: Fetched primary data is valid. [2025-09-16T20:04:02.597615] [DEBUG] [LOCAL ] PRSU: Saving primary data. [2025-09-16T20:04:02.598473] [DEBUG] [LOCAL ] PRSU: Trimmed 26756 records to 17710 (keeping 150 days of data) [2025-09-16T20:04:02.709096] [DEBUG] [LOCAL ] PRSU: Primary data saved (17710 records). [2025-09-16T20:04:02.709255] [INFO ] [MAIN ] PRSU: Full history saved. [2025-09-16T20:04:02.709346] [INFO ] [MAIN ] Update Progress: 1732/2369 symbols completed. PRSU took 17.7s. Estimated remaining: 1h 7m 40s. Rate: 9.4 symbols/min [2025-09-16T20:04:02.780029] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-03. [2025-09-16T20:04:02.888034] [INFO ] [MAIN ] PRU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:04:02.930596] [DEBUG] [LOCAL ] PRU: Loaded 37815 existing records from primary storage. [2025-09-16T20:04:02.930777] [INFO ] [MAIN ] PRU: Loaded 37815 existing records. [2025-09-16T20:04:03.109286] [WARN ] [MAIN ] PRU: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:04:03.109548] [INFO ] [MAIN ] PRU: Wiping existing primary data before full refresh. [2025-09-16T20:04:03.109623] [INFO ] [LOCAL ] PRU: Starting deletion of primary data. [2025-09-16T20:04:03.110732] [DEBUG] [LOCAL ] PRU: Deleted primary data file. [2025-09-16T20:04:03.110782] [INFO ] [MAIN ] PRU: Starting full primary refresh. [2025-09-16T20:04:03.472184] [INFO ] [REMOTE ] PRU: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:04:03.568732] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-16T20:04:03.574860] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-02. [2025-09-16T20:04:03.765770] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-16T20:04:04.374919] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-09. [2025-09-16T20:04:05.174924] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-04. [2025-09-16T20:04:05.260666] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-16T20:04:05.820189] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-16T20:04:05.824875] [INFO ] [REMOTE ] PRO: Full fetch complete (39534 records). [2025-09-16T20:04:05.824972] [DEBUG] [VALIDATOR ] PRO: Validating primary data. [2025-09-16T20:04:05.950687] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-16T20:04:05.979618] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-09. [2025-09-16T20:04:06.223502] [DEBUG] [VALIDATOR ] PRO: All expected trading days are present. [2025-09-16T20:04:06.223603] [DEBUG] [VALIDATOR ] PRO: Primary data validation passed. [2025-09-16T20:04:06.224407] [INFO ] [MAIN ] PRO: Fetched primary data is valid. [2025-09-16T20:04:06.224454] [DEBUG] [LOCAL ] PRO: Saving primary data. [2025-09-16T20:04:06.225544] [DEBUG] [LOCAL ] PRO: Trimmed 39534 records to 28842 (keeping 150 days of data) [2025-09-16T20:04:06.402565] [DEBUG] [LOCAL ] PRO: Primary data saved (28842 records). [2025-09-16T20:04:06.402723] [INFO ] [MAIN ] PRO: Full history saved. [2025-09-16T20:04:06.402810] [INFO ] [MAIN ] Update Progress: 1733/2369 symbols completed. PRO took 27.6s. Estimated remaining: 1h 7m 33s. Rate: 9.4 symbols/min [2025-09-16T20:04:06.572129] [INFO ] [MAIN ] PRVS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:04:06.572360] [DEBUG] [LOCAL ] PRVS: No existing data file found in primary storage. [2025-09-16T20:04:06.572399] [WARN ] [MAIN ] PRVS: No existing data found, performing full refresh instead. [2025-09-16T20:04:06.572523] [INFO ] [MAIN ] PRVS: Wiping existing primary data before full refresh. [2025-09-16T20:04:06.572842] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-09-16T20:04:06.572892] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-09-16T20:04:06.572925] [INFO ] [MAIN ] PRVS: Starting full primary refresh. [2025-09-16T20:04:06.781684] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-05. [2025-09-16T20:04:07.069820] [INFO ] [REMOTE ] PRVS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:04:07.524243] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-16T20:04:07.574956] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-02. [2025-09-16T20:04:07.781661] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-16T20:04:07.791668] [INFO ] [REMOTE ] PRMB: Full fetch complete (57679 records). [2025-09-16T20:04:07.791887] [DEBUG] [VALIDATOR ] PRMB: Validating primary data. [2025-09-16T20:04:08.002245] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-16T20:04:08.233232] [DEBUG] [VALIDATOR ] PRMB: All expected trading days are present. [2025-09-16T20:04:08.233326] [DEBUG] [VALIDATOR ] PRMB: Primary data validation passed. [2025-09-16T20:04:08.234277] [INFO ] [MAIN ] PRMB: Fetched primary data is valid. [2025-09-16T20:04:08.234331] [DEBUG] [LOCAL ] PRMB: Saving primary data. [2025-09-16T20:04:08.235771] [DEBUG] [LOCAL ] PRMB: Trimmed 57679 records to 39667 (keeping 150 days of data) [2025-09-16T20:04:08.420742] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-03. [2025-09-16T20:04:08.489083] [DEBUG] [LOCAL ] PRMB: Primary data saved (39667 records). [2025-09-16T20:04:08.489222] [INFO ] [MAIN ] PRMB: Full history saved. [2025-09-16T20:04:08.489323] [INFO ] [MAIN ] Update Progress: 1734/2369 symbols completed. PRMB took 32.4s. Estimated remaining: 1h 7m 25s. Rate: 9.4 symbols/min [2025-09-16T20:04:08.658248] [INFO ] [MAIN ] PSA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:04:08.691699] [DEBUG] [LOCAL ] PSA: Loaded 30919 existing records from primary storage. [2025-09-16T20:04:08.691832] [INFO ] [MAIN ] PSA: Loaded 30919 existing records. [2025-09-16T20:04:08.878495] [WARN ] [MAIN ] PSA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:04:08.878796] [INFO ] [MAIN ] PSA: Wiping existing primary data before full refresh. [2025-09-16T20:04:08.878843] [INFO ] [LOCAL ] PSA: Starting deletion of primary data. [2025-09-16T20:04:08.879630] [DEBUG] [LOCAL ] PSA: Deleted primary data file. [2025-09-16T20:04:08.879707] [INFO ] [MAIN ] PSA: Starting full primary refresh. [2025-09-16T20:04:09.180017] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-06. [2025-09-16T20:04:09.243381] [INFO ] [REMOTE ] PSA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:04:09.818512] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-16T20:04:09.974915] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-07. [2025-09-16T20:04:10.144247] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-16T20:04:10.613133] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-16T20:04:10.774878] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-02. [2025-09-16T20:04:11.574906] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-08. [2025-09-16T20:04:12.087558] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-16T20:04:12.374890] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-09. [2025-09-16T20:04:12.400861] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-16T20:04:13.134731] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-16T20:04:13.136036] [INFO ] [REMOTE ] PRT: Full fetch complete (6077 records). [2025-09-16T20:04:13.136104] [DEBUG] [VALIDATOR ] PRT: Validating primary data. [2025-09-16T20:04:13.180009] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-03. [2025-09-16T20:04:13.504043] [DEBUG] [VALIDATOR ] PRT: All expected trading days are present. [2025-09-16T20:04:13.504126] [DEBUG] [VALIDATOR ] PRT: Primary data validation passed. [2025-09-16T20:04:13.504299] [INFO ] [MAIN ] PRT: Fetched primary data is valid. [2025-09-16T20:04:13.504340] [DEBUG] [LOCAL ] PRT: Saving primary data. [2025-09-16T20:04:13.504800] [DEBUG] [LOCAL ] PRT: Trimmed 6077 records to 3670 (keeping 150 days of data) [2025-09-16T20:04:13.526768] [DEBUG] [LOCAL ] PRT: Primary data saved (3670 records). [2025-09-16T20:04:13.526880] [INFO ] [MAIN ] PRT: Full history saved. [2025-09-16T20:04:13.526984] [INFO ] [MAIN ] Update Progress: 1735/2369 symbols completed. PRT took 20.6s. Estimated remaining: 1h 7m 18s. Rate: 9.4 symbols/min [2025-09-16T20:04:13.722086] [INFO ] [MAIN ] PSBD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:04:13.730305] [DEBUG] [LOCAL ] PSBD: Loaded 5148 existing records from primary storage. [2025-09-16T20:04:13.730425] [INFO ] [MAIN ] PSBD: Loaded 5148 existing records. [2025-09-16T20:04:13.906578] [WARN ] [MAIN ] PSBD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:04:13.906848] [INFO ] [MAIN ] PSBD: Wiping existing primary data before full refresh. [2025-09-16T20:04:13.906894] [INFO ] [LOCAL ] PSBD: Starting deletion of primary data. [2025-09-16T20:04:13.907172] [DEBUG] [LOCAL ] PSBD: Deleted primary data file. [2025-09-16T20:04:13.907217] [INFO ] [MAIN ] PSBD: Starting full primary refresh. [2025-09-16T20:04:13.982677] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-03. [2025-09-16T20:04:14.266368] [INFO ] [REMOTE ] PSBD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:04:14.366847] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-16T20:04:14.774885] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-04. [2025-09-16T20:04:14.887824] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-16T20:04:15.146254] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-16T20:04:15.574929] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-04. [2025-09-16T20:04:16.374902] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-04. [2025-09-16T20:04:17.174911] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-05. [2025-09-16T20:04:17.391885] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-16T20:04:17.515486] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-16T20:04:17.974895] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-05. [2025-09-16T20:04:18.232149] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-16T20:04:18.774902] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-02. [2025-09-16T20:04:19.333825] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-16T20:04:19.574916] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-05. [2025-09-16T20:04:19.863092] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-16T20:04:20.374928] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-03. [2025-09-16T20:04:21.054994] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-16T20:04:21.068888] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-16T20:04:21.174916] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-06. [2025-09-16T20:04:21.974896] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-06. [2025-09-16T20:04:22.367039] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-16T20:04:22.758907] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-16T20:04:22.774846] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-07. [2025-09-16T20:04:23.574911] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-04. [2025-09-16T20:04:24.214632] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-16T20:04:24.371685] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-16T20:04:24.380478] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-05. [2025-09-16T20:04:25.125260] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-16T20:04:25.174858] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-06. [2025-09-16T20:04:25.881434] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-16T20:04:25.974895] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-07. [2025-09-16T20:04:26.224629] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-09-16T20:04:26.774910] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-08. [2025-09-16T20:04:27.104340] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-16T20:04:27.574913] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-07. [2025-09-16T20:04:28.258806] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-16T20:04:28.374907] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-08. [2025-09-16T20:04:29.174907] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-08. [2025-09-16T20:04:29.227010] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-16T20:04:29.974919] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-09. [2025-09-16T20:04:30.709858] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-16T20:04:30.709637] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-16T20:04:30.720024] [INFO ] [REMOTE ] PSBD: Full fetch complete (7122 records). [2025-09-16T20:04:30.720373] [DEBUG] [VALIDATOR ] PSBD: Validating primary data. [2025-09-16T20:04:30.781960] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-09. [2025-09-16T20:04:31.078955] [DEBUG] [VALIDATOR ] PSBD: All expected trading days are present. [2025-09-16T20:04:31.079038] [DEBUG] [VALIDATOR ] PSBD: Primary data validation passed. [2025-09-16T20:04:31.079254] [INFO ] [MAIN ] PSBD: Fetched primary data is valid. [2025-09-16T20:04:31.079296] [DEBUG] [LOCAL ] PSBD: Saving primary data. [2025-09-16T20:04:31.079738] [DEBUG] [LOCAL ] PSBD: Trimmed 7122 records to 5191 (keeping 150 days of data) [2025-09-16T20:04:31.111709] [DEBUG] [LOCAL ] PSBD: Primary data saved (5191 records). [2025-09-16T20:04:31.111831] [INFO ] [MAIN ] PSBD: Full history saved. [2025-09-16T20:04:31.111915] [INFO ] [MAIN ] Update Progress: 1736/2369 symbols completed. PSBD took 17.6s. Estimated remaining: 1h 7m 16s. Rate: 9.4 symbols/min [2025-09-16T20:04:31.280899] [INFO ] [MAIN ] PSF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:04:31.287542] [DEBUG] [LOCAL ] PSF: Loaded 4946 existing records from primary storage. [2025-09-16T20:04:31.287679] [INFO ] [MAIN ] PSF: Loaded 4946 existing records. [2025-09-16T20:04:31.467725] [WARN ] [MAIN ] PSF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:04:31.468017] [INFO ] [MAIN ] PSF: Wiping existing primary data before full refresh. [2025-09-16T20:04:31.468103] [INFO ] [LOCAL ] PSF: Starting deletion of primary data. [2025-09-16T20:04:31.468396] [DEBUG] [LOCAL ] PSF: Deleted primary data file. [2025-09-16T20:04:31.468442] [INFO ] [MAIN ] PSF: Starting full primary refresh. [2025-09-16T20:04:31.580056] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-06. [2025-09-16T20:04:31.821399] [INFO ] [REMOTE ] PSF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:04:32.374885] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-09. [2025-09-16T20:04:32.406317] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-16T20:04:32.411557] [INFO ] [REMOTE ] PSA: Full fetch complete (45258 records). [2025-09-16T20:04:32.411692] [DEBUG] [VALIDATOR ] PSA: Validating primary data. [2025-09-16T20:04:32.795039] [DEBUG] [VALIDATOR ] PSA: All expected trading days are present. [2025-09-16T20:04:32.794905] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-16T20:04:32.796637] [INFO ] [REMOTE ] PRVS: Full fetch complete (871 records). [2025-09-16T20:04:32.795476] [DEBUG] [VALIDATOR ] PSA: Primary data validation passed. [2025-09-16T20:04:32.796869] [DEBUG] [VALIDATOR ] PRVS: Validating primary data. [2025-09-16T20:04:32.797810] [INFO ] [MAIN ] PSA: Fetched primary data is valid. [2025-09-16T20:04:32.797916] [DEBUG] [LOCAL ] PSA: Saving primary data. [2025-09-16T20:04:32.922337] [DEBUG] [LOCAL ] PSA: Trimmed 45258 records to 31255 (keeping 150 days of data) [2025-09-16T20:04:33.086593] [WARN ] [VALIDATOR ] PRVS: Validation failed - insufficient historical data. Have 143 unique days, need 150 days [2025-09-16T20:04:33.120038] [FATAL] [MAIN ] PRVS: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:04:33.122989] [WARN ] [MAIN ] PRVS: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:04:33.126896] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-09-16T20:04:33.131058] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-09-16T20:04:33.138758] [INFO ] [LOCAL ] PRVS: Starting deletion of derivative data. [2025-09-16T20:04:33.139019] [DEBUG] [LOCAL ] PRVS: No derivative data file found to delete. [2025-09-16T20:04:33.139221] [INFO ] [MAIN ] Update Progress: 1737/2369 symbols completed. PRVS took 26.7s. Estimated remaining: 1h 7m 8s. Rate: 9.4 symbols/min [2025-09-16T20:04:33.175168] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-02. [2025-09-16T20:04:33.401756] [INFO ] [MAIN ] PSFE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:04:33.423810] [DEBUG] [LOCAL ] PSA: Primary data saved (31255 records). [2025-09-16T20:04:33.424267] [INFO ] [MAIN ] PSA: Full history saved. [2025-09-16T20:04:33.424397] [INFO ] [MAIN ] Update Progress: 1738/2369 symbols completed. PSA took 24.9s. Estimated remaining: 1h 6m 59s. Rate: 9.4 symbols/min [2025-09-16T20:04:33.637746] [INFO ] [MAIN ] PSN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:04:33.648038] [DEBUG] [LOCAL ] PSFE: Loaded 22615 existing records from primary storage. [2025-09-16T20:04:33.648818] [INFO ] [MAIN ] PSFE: Loaded 22615 existing records. [2025-09-16T20:04:33.656333] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-16T20:04:33.884004] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-16T20:04:33.885521] [WARN ] [MAIN ] PSFE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:04:33.888213] [INFO ] [MAIN ] PSFE: Wiping existing primary data before full refresh. [2025-09-16T20:04:33.888335] [INFO ] [LOCAL ] PSFE: Starting deletion of primary data. [2025-09-16T20:04:33.889214] [DEBUG] [LOCAL ] PSN: Loaded 33662 existing records from primary storage. [2025-09-16T20:04:33.889303] [DEBUG] [LOCAL ] PSFE: Deleted primary data file. [2025-09-16T20:04:33.889592] [INFO ] [MAIN ] PSFE: Starting full primary refresh. [2025-09-16T20:04:33.889662] [INFO ] [MAIN ] PSN: Loaded 33662 existing records. [2025-09-16T20:04:33.986672] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-07. [2025-09-16T20:04:34.291483] [WARN ] [MAIN ] PSN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:04:34.355401] [INFO ] [MAIN ] PSN: Wiping existing primary data before full refresh. [2025-09-16T20:04:34.366442] [INFO ] [LOCAL ] PSN: Starting deletion of primary data. [2025-09-16T20:04:34.372405] [DEBUG] [LOCAL ] PSN: Deleted primary data file. [2025-09-16T20:04:34.387802] [INFO ] [MAIN ] PSN: Starting full primary refresh. [2025-09-16T20:04:34.526003] [INFO ] [REMOTE ] PSFE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:04:34.780053] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-03. [2025-09-16T20:04:34.814585] [INFO ] [REMOTE ] PSN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:04:35.446579] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-16T20:04:35.574868] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-02. [2025-09-16T20:04:35.926980] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-16T20:04:36.374924] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-08. [2025-09-16T20:04:37.174917] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-04. [2025-09-16T20:04:37.295380] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-16T20:04:37.730357] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-16T20:04:37.832846] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-16T20:04:37.974875] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-05. [2025-09-16T20:04:38.778428] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-03. [2025-09-16T20:04:38.781116] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-16T20:04:39.574950] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-06. [2025-09-16T20:04:40.240367] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-16T20:04:40.374926] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-09. [2025-09-16T20:04:40.457951] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-16T20:04:41.174953] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-04. [2025-09-16T20:04:41.974914] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-02. [2025-09-16T20:04:42.125376] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-16T20:04:42.131420] [INFO ] [REMOTE ] PRU: Full fetch complete (56090 records). [2025-09-16T20:04:42.131528] [DEBUG] [VALIDATOR ] PRU: Validating primary data. [2025-09-16T20:04:42.572861] [DEBUG] [VALIDATOR ] PRU: All expected trading days are present. [2025-09-16T20:04:42.572995] [DEBUG] [VALIDATOR ] PRU: Primary data validation passed. [2025-09-16T20:04:42.574046] [INFO ] [MAIN ] PRU: Fetched primary data is valid. [2025-09-16T20:04:42.574104] [DEBUG] [LOCAL ] PRU: Saving primary data. [2025-09-16T20:04:42.575542] [DEBUG] [LOCAL ] PRU: Trimmed 56090 records to 38205 (keeping 150 days of data) [2025-09-16T20:04:42.793520] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-07. [2025-09-16T20:04:42.857622] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-16T20:04:42.857757] [DEBUG] [LOCAL ] PRU: Primary data saved (38205 records). [2025-09-16T20:04:42.867618] [INFO ] [MAIN ] PRU: Full history saved. [2025-09-16T20:04:42.869468] [INFO ] [MAIN ] Update Progress: 1739/2369 symbols completed. PRU took 40.2s. Estimated remaining: 1h 6m 54s. Rate: 9.4 symbols/min [2025-09-16T20:04:43.039969] [INFO ] [MAIN ] PSO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:04:43.073757] [DEBUG] [LOCAL ] PSO: Loaded 26824 existing records from primary storage. [2025-09-16T20:04:43.073921] [INFO ] [MAIN ] PSO: Loaded 26824 existing records. [2025-09-16T20:04:43.251867] [WARN ] [MAIN ] PSO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:04:43.252197] [INFO ] [MAIN ] PSO: Wiping existing primary data before full refresh. [2025-09-16T20:04:43.252332] [INFO ] [LOCAL ] PSO: Starting deletion of primary data. [2025-09-16T20:04:43.259327] [DEBUG] [LOCAL ] PSO: Deleted primary data file. [2025-09-16T20:04:43.268358] [INFO ] [MAIN ] PSO: Starting full primary refresh. [2025-09-16T20:04:43.341576] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-16T20:04:43.559463] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-16T20:04:43.580032] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-05. [2025-09-16T20:04:43.643573] [INFO ] [REMOTE ] PSO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:04:44.374899] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-02. [2025-09-16T20:04:45.174864] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-08. [2025-09-16T20:04:45.269239] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-16T20:04:45.640384] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-16T20:04:45.843009] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-16T20:04:45.974872] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-03. [2025-09-16T20:04:46.774912] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-09. [2025-09-16T20:04:47.341896] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-16T20:04:47.343603] [INFO ] [REMOTE ] PSF: Full fetch complete (7230 records). [2025-09-16T20:04:47.343724] [DEBUG] [VALIDATOR ] PSF: Validating primary data. [2025-09-16T20:04:47.592095] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-16T20:04:47.584979] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-06. [2025-09-16T20:04:47.752532] [DEBUG] [VALIDATOR ] PSF: All expected trading days are present. [2025-09-16T20:04:47.752615] [DEBUG] [VALIDATOR ] PSF: Primary data validation passed. [2025-09-16T20:04:47.752839] [INFO ] [MAIN ] PSF: Fetched primary data is valid. [2025-09-16T20:04:47.752884] [DEBUG] [LOCAL ] PSF: Saving primary data. [2025-09-16T20:04:47.753372] [DEBUG] [LOCAL ] PSF: Trimmed 7230 records to 5008 (keeping 150 days of data) [2025-09-16T20:04:47.785245] [DEBUG] [LOCAL ] PSF: Primary data saved (5008 records). [2025-09-16T20:04:47.785371] [INFO ] [MAIN ] PSF: Full history saved. [2025-09-16T20:04:47.785470] [INFO ] [MAIN ] Update Progress: 1740/2369 symbols completed. PSF took 16.7s. Estimated remaining: 1h 6m 47s. Rate: 9.4 symbols/min [2025-09-16T20:04:47.959401] [INFO ] [MAIN ] PSQH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:04:47.983256] [DEBUG] [LOCAL ] PSQH: Loaded 24941 existing records from primary storage. [2025-09-16T20:04:47.983395] [INFO ] [MAIN ] PSQH: Loaded 24941 existing records. [2025-09-16T20:04:48.177578] [WARN ] [MAIN ] PSQH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:04:48.177888] [INFO ] [MAIN ] PSQH: Wiping existing primary data before full refresh. [2025-09-16T20:04:48.177967] [INFO ] [LOCAL ] PSQH: Starting deletion of primary data. [2025-09-16T20:04:48.178775] [DEBUG] [LOCAL ] PSQH: Deleted primary data file. [2025-09-16T20:04:48.178832] [INFO ] [MAIN ] PSQH: Starting full primary refresh. [2025-09-16T20:04:48.384960] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-03. [2025-09-16T20:04:48.542875] [INFO ] [REMOTE ] PSQH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:04:49.174875] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-02. [2025-09-16T20:04:49.256218] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-16T20:04:49.974888] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-07. [2025-09-16T20:04:50.022075] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-16T20:04:50.481682] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-16T20:04:50.774903] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-04. [2025-09-16T20:04:51.571432] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-16T20:04:51.580177] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-04. [2025-09-16T20:04:51.848461] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-16T20:04:52.374891] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-08. [2025-09-16T20:04:52.991108] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-16T20:04:53.174898] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-05. [2025-09-16T20:04:53.958729] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-16T20:04:53.974856] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-09. [2025-09-16T20:04:54.689498] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-16T20:04:54.774866] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-06. [2025-09-16T20:04:55.539583] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-16T20:04:55.545243] [INFO ] [REMOTE ] PSN: Full fetch complete (50816 records). [2025-09-16T20:04:55.545378] [DEBUG] [VALIDATOR ] PSN: Validating primary data. [2025-09-16T20:04:55.580149] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-03. [2025-09-16T20:04:55.935160] [DEBUG] [VALIDATOR ] PSN: All expected trading days are present. [2025-09-16T20:04:55.935250] [DEBUG] [VALIDATOR ] PSN: Primary data validation passed. [2025-09-16T20:04:55.936155] [INFO ] [MAIN ] PSN: Fetched primary data is valid. [2025-09-16T20:04:55.936211] [DEBUG] [LOCAL ] PSN: Saving primary data. [2025-09-16T20:04:55.937484] [DEBUG] [LOCAL ] PSN: Trimmed 50816 records to 33985 (keeping 150 days of data) [2025-09-16T20:04:56.137038] [DEBUG] [LOCAL ] PSN: Primary data saved (33985 records). [2025-09-16T20:04:56.137177] [INFO ] [MAIN ] PSN: Full history saved. [2025-09-16T20:04:56.137283] [INFO ] [MAIN ] Update Progress: 1741/2369 symbols completed. PSN took 22.7s. Estimated remaining: 1h 6m 41s. Rate: 9.4 symbols/min [2025-09-16T20:04:56.310466] [INFO ] [MAIN ] PSTG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:04:56.334139] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-16T20:04:56.374909] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-07. [2025-09-16T20:04:56.376606] [DEBUG] [LOCAL ] PSTG: Loaded 38902 existing records from primary storage. [2025-09-16T20:04:56.376786] [INFO ] [MAIN ] PSTG: Loaded 38902 existing records. [2025-09-16T20:04:56.551659] [WARN ] [MAIN ] PSTG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:04:56.551921] [INFO ] [MAIN ] PSTG: Wiping existing primary data before full refresh. [2025-09-16T20:04:56.552009] [INFO ] [LOCAL ] PSTG: Starting deletion of primary data. [2025-09-16T20:04:56.552850] [DEBUG] [LOCAL ] PSTG: Deleted primary data file. [2025-09-16T20:04:56.552898] [INFO ] [MAIN ] PSTG: Starting full primary refresh. [2025-09-16T20:04:56.930577] [INFO ] [REMOTE ] PSTG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:04:57.104635] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-16T20:04:57.174881] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-04. [2025-09-16T20:04:57.689143] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-16T20:04:57.974901] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-08. [2025-09-16T20:04:58.580224] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-16T20:04:58.774902] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-05. [2025-09-16T20:04:59.419409] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-16T20:04:59.575841] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-02. [2025-09-16T20:05:00.223852] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-16T20:05:00.374972] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-09. [2025-09-16T20:05:01.174889] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-05. [2025-09-16T20:05:01.617668] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-16T20:05:01.974947] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-06. [2025-09-16T20:05:02.071254] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-16T20:05:02.075900] [INFO ] [REMOTE ] PSO: Full fetch complete (40362 records). [2025-09-16T20:05:02.076118] [DEBUG] [VALIDATOR ] PSO: Validating primary data. [2025-09-16T20:05:02.503285] [DEBUG] [VALIDATOR ] PSO: All expected trading days are present. [2025-09-16T20:05:02.503414] [DEBUG] [VALIDATOR ] PSO: Primary data validation passed. [2025-09-16T20:05:02.504267] [INFO ] [MAIN ] PSO: Fetched primary data is valid. [2025-09-16T20:05:02.504330] [DEBUG] [LOCAL ] PSO: Saving primary data. [2025-09-16T20:05:02.505562] [DEBUG] [LOCAL ] PSO: Trimmed 40362 records to 27028 (keeping 150 days of data) [2025-09-16T20:05:02.607091] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-16T20:05:02.734078] [DEBUG] [LOCAL ] PSO: Primary data saved (27028 records). [2025-09-16T20:05:02.734253] [INFO ] [MAIN ] PSO: Full history saved. [2025-09-16T20:05:02.734360] [INFO ] [MAIN ] Update Progress: 1742/2369 symbols completed. PSO took 19.9s. Estimated remaining: 1h 6m 35s. Rate: 9.4 symbols/min [2025-09-16T20:05:02.780098] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-06. [2025-09-16T20:05:02.913200] [INFO ] [MAIN ] PSTL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:05:02.928238] [DEBUG] [LOCAL ] PSTL: Loaded 14762 existing records from primary storage. [2025-09-16T20:05:02.928362] [INFO ] [MAIN ] PSTL: Loaded 14762 existing records. [2025-09-16T20:05:03.106234] [WARN ] [MAIN ] PSTL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:05:03.106473] [INFO ] [MAIN ] PSTL: Wiping existing primary data before full refresh. [2025-09-16T20:05:03.106522] [INFO ] [LOCAL ] PSTL: Starting deletion of primary data. [2025-09-16T20:05:03.106956] [DEBUG] [LOCAL ] PSTL: Deleted primary data file. [2025-09-16T20:05:03.107004] [INFO ] [MAIN ] PSTL: Starting full primary refresh. [2025-09-16T20:05:03.475320] [INFO ] [REMOTE ] PSTL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:05:03.499656] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-16T20:05:03.574951] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-03. [2025-09-16T20:05:04.321337] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-16T20:05:04.374921] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-07. [2025-09-16T20:05:05.174912] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-07. [2025-09-16T20:05:05.481220] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-16T20:05:05.923144] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-16T20:05:05.974912] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-02. [2025-09-16T20:05:06.202459] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-16T20:05:06.774906] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-04. [2025-09-16T20:05:07.010277] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-16T20:05:07.574904] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-03. [2025-09-16T20:05:08.374869] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-08. [2025-09-16T20:05:08.417658] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-16T20:05:08.714195] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-16T20:05:09.174915] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-04. [2025-09-16T20:05:09.840432] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-16T20:05:09.974934] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-05. [2025-09-16T20:05:10.396741] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-16T20:05:10.774915] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-05. [2025-09-16T20:05:11.574915] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-08. [2025-09-16T20:05:11.853938] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-16T20:05:11.917461] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-16T20:05:12.374903] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-06. [2025-09-16T20:05:13.141782] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-16T20:05:13.174969] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-09. [2025-09-16T20:05:13.974908] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-06. [2025-09-16T20:05:14.095165] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-16T20:05:14.769951] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-16T20:05:14.774857] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-07. [2025-09-16T20:05:14.774979] [INFO ] [REMOTE ] PSQH: Full fetch complete (37928 records). [2025-09-16T20:05:14.775147] [DEBUG] [VALIDATOR ] PSQH: Validating primary data. [2025-09-16T20:05:15.178360] [DEBUG] [VALIDATOR ] PSQH: All expected trading days are present. [2025-09-16T20:05:15.180524] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-16T20:05:15.180629] [DEBUG] [VALIDATOR ] PSQH: Primary data validation passed. [2025-09-16T20:05:15.186169] [INFO ] [MAIN ] PSQH: Fetched primary data is valid. [2025-09-16T20:05:15.186266] [DEBUG] [LOCAL ] PSQH: Saving primary data. [2025-09-16T20:05:15.187577] [DEBUG] [LOCAL ] PSQH: Trimmed 37928 records to 25211 (keeping 150 days of data) [2025-09-16T20:05:15.332136] [DEBUG] [LOCAL ] PSQH: Primary data saved (25211 records). [2025-09-16T20:05:15.332284] [INFO ] [MAIN ] PSQH: Full history saved. [2025-09-16T20:05:15.332387] [INFO ] [MAIN ] Update Progress: 1743/2369 symbols completed. PSQH took 27.5s. Estimated remaining: 1h 6m 31s. Rate: 9.4 symbols/min [2025-09-16T20:05:15.510288] [INFO ] [MAIN ] PSX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:05:15.555112] [DEBUG] [LOCAL ] PSX: Loaded 39235 existing records from primary storage. [2025-09-16T20:05:15.555258] [INFO ] [MAIN ] PSX: Loaded 39235 existing records. [2025-09-16T20:05:15.587535] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-09. [2025-09-16T20:05:15.744069] [WARN ] [MAIN ] PSX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:05:15.744351] [INFO ] [MAIN ] PSX: Wiping existing primary data before full refresh. [2025-09-16T20:05:15.744400] [INFO ] [LOCAL ] PSX: Starting deletion of primary data. [2025-09-16T20:05:15.745418] [DEBUG] [LOCAL ] PSX: Deleted primary data file. [2025-09-16T20:05:15.745479] [INFO ] [MAIN ] PSX: Starting full primary refresh. [2025-09-16T20:05:16.107268] [INFO ] [REMOTE ] PSX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:05:16.374899] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-02. [2025-09-16T20:05:16.656732] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-16T20:05:16.807148] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-16T20:05:16.811743] [INFO ] [REMOTE ] PSFE: Full fetch complete (33797 records). [2025-09-16T20:05:16.811881] [DEBUG] [VALIDATOR ] PSFE: Validating primary data. [2025-09-16T20:05:17.180114] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-08. [2025-09-16T20:05:17.225490] [DEBUG] [VALIDATOR ] PSFE: All expected trading days are present. [2025-09-16T20:05:17.225563] [DEBUG] [VALIDATOR ] PSFE: Primary data validation passed. [2025-09-16T20:05:17.226251] [INFO ] [MAIN ] PSFE: Fetched primary data is valid. [2025-09-16T20:05:17.226390] [DEBUG] [LOCAL ] PSFE: Saving primary data. [2025-09-16T20:05:17.227415] [DEBUG] [LOCAL ] PSFE: Trimmed 33797 records to 22752 (keeping 150 days of data) [2025-09-16T20:05:17.364340] [DEBUG] [LOCAL ] PSFE: Primary data saved (22752 records). [2025-09-16T20:05:17.364478] [INFO ] [MAIN ] PSFE: Full history saved. [2025-09-16T20:05:17.364581] [INFO ] [MAIN ] Update Progress: 1744/2369 symbols completed. PSFE took 44.2s. Estimated remaining: 1h 6m 23s. Rate: 9.4 symbols/min [2025-09-16T20:05:17.534117] [INFO ] [MAIN ] PTA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:05:17.545694] [DEBUG] [LOCAL ] PTA: Loaded 10513 existing records from primary storage. [2025-09-16T20:05:17.545801] [INFO ] [MAIN ] PTA: Loaded 10513 existing records. [2025-09-16T20:05:17.726383] [WARN ] [MAIN ] PTA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:05:17.726778] [INFO ] [MAIN ] PTA: Wiping existing primary data before full refresh. [2025-09-16T20:05:17.726884] [INFO ] [LOCAL ] PTA: Starting deletion of primary data. [2025-09-16T20:05:17.727371] [DEBUG] [LOCAL ] PTA: Deleted primary data file. [2025-09-16T20:05:17.727429] [INFO ] [MAIN ] PTA: Starting full primary refresh. [2025-09-16T20:05:17.977594] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-07. [2025-09-16T20:05:18.110342] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-16T20:05:18.154250] [INFO ] [REMOTE ] PTA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:05:18.774904] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-03. [2025-09-16T20:05:19.002474] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-16T20:05:19.141143] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-16T20:05:19.574912] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-08. [2025-09-16T20:05:20.374929] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-09. [2025-09-16T20:05:20.647954] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-16T20:05:20.681692] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-16T20:05:21.174918] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-04. [2025-09-16T20:05:21.974939] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-02. [2025-09-16T20:05:22.408996] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-16T20:05:22.420691] [INFO ] [REMOTE ] PSTG: Full fetch complete (57462 records). [2025-09-16T20:05:22.420926] [DEBUG] [VALIDATOR ] PSTG: Validating primary data. [2025-09-16T20:05:22.782103] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-09. [2025-09-16T20:05:22.800494] [DEBUG] [VALIDATOR ] PSTG: All expected trading days are present. [2025-09-16T20:05:22.800551] [DEBUG] [VALIDATOR ] PSTG: Primary data validation passed. [2025-09-16T20:05:22.801524] [INFO ] [MAIN ] PSTG: Fetched primary data is valid. [2025-09-16T20:05:22.801668] [DEBUG] [LOCAL ] PSTG: Saving primary data. [2025-09-16T20:05:22.803000] [DEBUG] [LOCAL ] PSTG: Trimmed 57462 records to 39292 (keeping 150 days of data) [2025-09-16T20:05:22.913465] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-16T20:05:23.059350] [DEBUG] [LOCAL ] PSTG: Primary data saved (39292 records). [2025-09-16T20:05:23.059538] [INFO ] [MAIN ] PSTG: Full history saved. [2025-09-16T20:05:23.059784] [INFO ] [MAIN ] Update Progress: 1745/2369 symbols completed. PSTG took 26.9s. Estimated remaining: 1h 6m 16s. Rate: 9.4 symbols/min [2025-09-16T20:05:23.238134] [INFO ] [MAIN ] PTY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:05:23.271609] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-16T20:05:23.305208] [DEBUG] [LOCAL ] PTY: Loaded 27092 existing records from primary storage. [2025-09-16T20:05:23.305382] [INFO ] [MAIN ] PTY: Loaded 27092 existing records. [2025-09-16T20:05:23.482155] [WARN ] [MAIN ] PTY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:05:23.482414] [INFO ] [MAIN ] PTY: Wiping existing primary data before full refresh. [2025-09-16T20:05:23.482472] [INFO ] [LOCAL ] PTY: Starting deletion of primary data. [2025-09-16T20:05:23.483149] [DEBUG] [LOCAL ] PTY: Deleted primary data file. [2025-09-16T20:05:23.483198] [INFO ] [MAIN ] PTY: Starting full primary refresh. [2025-09-16T20:05:23.580989] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-05. [2025-09-16T20:05:23.837615] [INFO ] [REMOTE ] PTY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:05:23.892153] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-16T20:05:23.896342] [INFO ] [REMOTE ] PSTL: Full fetch complete (22621 records). [2025-09-16T20:05:23.896534] [DEBUG] [VALIDATOR ] PSTL: Validating primary data. [2025-09-16T20:05:24.304588] [DEBUG] [VALIDATOR ] PSTL: All expected trading days are present. [2025-09-16T20:05:24.304728] [DEBUG] [VALIDATOR ] PSTL: Primary data validation passed. [2025-09-16T20:05:24.305304] [INFO ] [MAIN ] PSTL: Fetched primary data is valid. [2025-09-16T20:05:24.305358] [DEBUG] [LOCAL ] PSTL: Saving primary data. [2025-09-16T20:05:24.306373] [DEBUG] [LOCAL ] PSTL: Trimmed 22621 records to 14935 (keeping 150 days of data) [2025-09-16T20:05:24.384627] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-03. [2025-09-16T20:05:24.413991] [DEBUG] [LOCAL ] PSTL: Primary data saved (14935 records). [2025-09-16T20:05:24.414135] [INFO ] [MAIN ] PSTL: Full history saved. [2025-09-16T20:05:24.414262] [INFO ] [MAIN ] Update Progress: 1746/2369 symbols completed. PSTL took 21.7s. Estimated remaining: 1h 6m 8s. Rate: 9.4 symbols/min [2025-09-16T20:05:24.583755] [INFO ] [MAIN ] PUK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:05:24.620499] [DEBUG] [LOCAL ] PUK: Loaded 32121 existing records from primary storage. [2025-09-16T20:05:24.620669] [INFO ] [MAIN ] PUK: Loaded 32121 existing records. [2025-09-16T20:05:24.799372] [WARN ] [MAIN ] PUK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:05:24.799666] [INFO ] [MAIN ] PUK: Wiping existing primary data before full refresh. [2025-09-16T20:05:24.799737] [INFO ] [LOCAL ] PUK: Starting deletion of primary data. [2025-09-16T20:05:24.800450] [DEBUG] [LOCAL ] PUK: Deleted primary data file. [2025-09-16T20:05:24.800506] [INFO ] [MAIN ] PUK: Starting full primary refresh. [2025-09-16T20:05:25.176428] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-02. [2025-09-16T20:05:25.176342] [INFO ] [REMOTE ] PUK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:05:25.472605] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-16T20:05:25.640193] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-16T20:05:25.974936] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-04. [2025-09-16T20:05:26.332487] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-16T20:05:26.774906] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-03. [2025-09-16T20:05:27.031820] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-16T20:05:27.574926] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-05. [2025-09-16T20:05:28.233084] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-16T20:05:28.249770] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-16T20:05:28.374877] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-06. [2025-09-16T20:05:29.174920] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-04. [2025-09-16T20:05:29.308677] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-16T20:05:29.974906] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-07. [2025-09-16T20:05:30.654607] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-16T20:05:30.774868] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-05. [2025-09-16T20:05:30.953739] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-16T20:05:31.574892] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-08. [2025-09-16T20:05:32.091015] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-16T20:05:32.374881] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-06. [2025-09-16T20:05:32.592247] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-16T20:05:33.174911] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-09. [2025-09-16T20:05:33.591474] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-16T20:05:33.974884] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-06. [2025-09-16T20:05:34.156111] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-16T20:05:34.158939] [INFO ] [REMOTE ] PTA: Full fetch complete (16061 records). [2025-09-16T20:05:34.159047] [DEBUG] [VALIDATOR ] PTA: Validating primary data. [2025-09-16T20:05:34.562321] [DEBUG] [VALIDATOR ] PTA: All expected trading days are present. [2025-09-16T20:05:34.562402] [DEBUG] [VALIDATOR ] PTA: Primary data validation passed. [2025-09-16T20:05:34.562794] [INFO ] [MAIN ] PTA: Fetched primary data is valid. [2025-09-16T20:05:34.562875] [DEBUG] [LOCAL ] PTA: Saving primary data. [2025-09-16T20:05:34.563464] [DEBUG] [LOCAL ] PTA: Trimmed 16061 records to 10626 (keeping 150 days of data) [2025-09-16T20:05:34.632902] [DEBUG] [LOCAL ] PTA: Primary data saved (10626 records). [2025-09-16T20:05:34.633038] [INFO ] [MAIN ] PTA: Full history saved. [2025-09-16T20:05:34.633141] [INFO ] [MAIN ] Update Progress: 1747/2369 symbols completed. PTA took 17.3s. Estimated remaining: 1h 6m 3s. Rate: 9.4 symbols/min [2025-09-16T20:05:34.780053] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-07. [2025-09-16T20:05:34.843045] [INFO ] [MAIN ] PUMP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:05:34.886728] [DEBUG] [LOCAL ] PUMP: Loaded 36293 existing records from primary storage. [2025-09-16T20:05:34.886877] [INFO ] [MAIN ] PUMP: Loaded 36293 existing records. [2025-09-16T20:05:35.062903] [WARN ] [MAIN ] PUMP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:05:35.063166] [INFO ] [MAIN ] PUMP: Wiping existing primary data before full refresh. [2025-09-16T20:05:35.063213] [INFO ] [LOCAL ] PUMP: Starting deletion of primary data. [2025-09-16T20:05:35.063976] [DEBUG] [LOCAL ] PUMP: Deleted primary data file. [2025-09-16T20:05:35.064029] [INFO ] [MAIN ] PUMP: Starting full primary refresh. [2025-09-16T20:05:35.413132] [INFO ] [REMOTE ] PUMP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:05:35.574912] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-02. [2025-09-16T20:05:35.757536] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-16T20:05:36.375103] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-02. [2025-09-16T20:05:36.382257] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-16T20:05:37.127065] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-16T20:05:37.174854] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-03. [2025-09-16T20:05:37.972037] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-16T20:05:37.979896] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-07. [2025-09-16T20:05:38.474668] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-16T20:05:38.774943] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-08. [2025-09-16T20:05:39.574881] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-03. [2025-09-16T20:05:39.907809] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-16T20:05:40.310671] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-16T20:05:40.374856] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-09. [2025-09-16T20:05:41.174889] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-04. [2025-09-16T20:05:41.255797] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-16T20:05:41.950112] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-16T20:05:41.955100] [INFO ] [REMOTE ] PTY: Full fetch complete (40447 records). [2025-09-16T20:05:41.955226] [DEBUG] [VALIDATOR ] PTY: Validating primary data. [2025-09-16T20:05:41.986271] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-04. [2025-09-16T20:05:42.344819] [DEBUG] [VALIDATOR ] PTY: All expected trading days are present. [2025-09-16T20:05:42.344906] [DEBUG] [VALIDATOR ] PTY: Primary data validation passed. [2025-09-16T20:05:42.345787] [INFO ] [MAIN ] PTY: Fetched primary data is valid. [2025-09-16T20:05:42.345837] [DEBUG] [LOCAL ] PTY: Saving primary data. [2025-09-16T20:05:42.346828] [DEBUG] [LOCAL ] PTY: Trimmed 40447 records to 27365 (keeping 150 days of data) [2025-09-16T20:05:42.522300] [DEBUG] [LOCAL ] PTY: Primary data saved (27365 records). [2025-09-16T20:05:42.522470] [INFO ] [MAIN ] PTY: Full history saved. [2025-09-16T20:05:42.522566] [INFO ] [MAIN ] Update Progress: 1748/2369 symbols completed. PTY took 19.5s. Estimated remaining: 1h 5m 57s. Rate: 9.4 symbols/min [2025-09-16T20:05:42.701525] [INFO ] [MAIN ] PVH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:05:42.739194] [DEBUG] [LOCAL ] PVH: Loaded 37355 existing records from primary storage. [2025-09-16T20:05:42.739342] [INFO ] [MAIN ] PVH: Loaded 37355 existing records. [2025-09-16T20:05:42.782335] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-08. [2025-09-16T20:05:42.925437] [WARN ] [MAIN ] PVH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:05:42.925876] [INFO ] [MAIN ] PVH: Wiping existing primary data before full refresh. [2025-09-16T20:05:42.926010] [INFO ] [LOCAL ] PVH: Starting deletion of primary data. [2025-09-16T20:05:42.937293] [DEBUG] [LOCAL ] PVH: Deleted primary data file. [2025-09-16T20:05:42.956275] [INFO ] [MAIN ] PVH: Starting full primary refresh. [2025-09-16T20:05:43.037788] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-16T20:05:43.334256] [INFO ] [REMOTE ] PVH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:05:43.574912] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-02. [2025-09-16T20:05:43.750131] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-16T20:05:44.374946] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-05. [2025-09-16T20:05:44.704832] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-16T20:05:45.115370] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-16T20:05:45.174877] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-03. [2025-09-16T20:05:45.687511] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-16T20:05:45.974909] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-06. [2025-09-16T20:05:46.589518] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-16T20:05:46.774919] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-05. [2025-09-16T20:05:47.574923] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-09. [2025-09-16T20:05:47.616003] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-16T20:05:48.374916] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-07. [2025-09-16T20:05:48.474928] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-16T20:05:49.174888] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-04. [2025-09-16T20:05:49.324569] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-16T20:05:49.330835] [INFO ] [REMOTE ] PSX: Full fetch complete (57810 records). [2025-09-16T20:05:49.330945] [DEBUG] [VALIDATOR ] PSX: Validating primary data. [2025-09-16T20:05:49.712991] [DEBUG] [VALIDATOR ] PSX: All expected trading days are present. [2025-09-16T20:05:49.713163] [DEBUG] [VALIDATOR ] PSX: Primary data validation passed. [2025-09-16T20:05:49.714212] [INFO ] [MAIN ] PSX: Fetched primary data is valid. [2025-09-16T20:05:49.714362] [DEBUG] [LOCAL ] PSX: Saving primary data. [2025-09-16T20:05:49.716006] [DEBUG] [LOCAL ] PSX: Trimmed 57810 records to 39616 (keeping 150 days of data) [2025-09-16T20:05:49.841548] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-16T20:05:49.977081] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-08. [2025-09-16T20:05:50.016666] [DEBUG] [LOCAL ] PSX: Primary data saved (39616 records). [2025-09-16T20:05:50.016833] [INFO ] [MAIN ] PSX: Full history saved. [2025-09-16T20:05:50.016956] [INFO ] [MAIN ] Update Progress: 1749/2369 symbols completed. PSX took 34.7s. Estimated remaining: 1h 5m 51s. Rate: 9.4 symbols/min [2025-09-16T20:05:50.189714] [INFO ] [MAIN ] PVL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:05:50.195736] [DEBUG] [LOCAL ] PVL: Loaded 3476 existing records from primary storage. [2025-09-16T20:05:50.195827] [INFO ] [MAIN ] PVL: Loaded 3476 existing records. [2025-09-16T20:05:50.377274] [WARN ] [MAIN ] PVL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:05:50.377563] [INFO ] [MAIN ] PVL: Wiping existing primary data before full refresh. [2025-09-16T20:05:50.377611] [INFO ] [LOCAL ] PVL: Starting deletion of primary data. [2025-09-16T20:05:50.377899] [DEBUG] [LOCAL ] PVL: Deleted primary data file. [2025-09-16T20:05:50.377945] [INFO ] [MAIN ] PVL: Starting full primary refresh. [2025-09-16T20:05:50.745010] [INFO ] [REMOTE ] PVL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:05:50.774861] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-02. [2025-09-16T20:05:51.000033] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-16T20:05:51.389483] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-16T20:05:51.574885] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-03. [2025-09-16T20:05:51.630427] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-16T20:05:52.223305] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-16T20:05:52.374879] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-09. [2025-09-16T20:05:53.174934] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-06. [2025-09-16T20:05:53.873261] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-16T20:05:53.879417] [INFO ] [REMOTE ] PUK: Full fetch complete (48791 records). [2025-09-16T20:05:53.879543] [DEBUG] [VALIDATOR ] PUK: Validating primary data. [2025-09-16T20:05:53.984690] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-05. [2025-09-16T20:05:54.343748] [DEBUG] [VALIDATOR ] PUK: All expected trading days are present. [2025-09-16T20:05:54.343856] [DEBUG] [VALIDATOR ] PUK: Primary data validation passed. [2025-09-16T20:05:54.345062] [INFO ] [MAIN ] PUK: Fetched primary data is valid. [2025-09-16T20:05:54.345139] [DEBUG] [LOCAL ] PUK: Saving primary data. [2025-09-16T20:05:54.346564] [DEBUG] [LOCAL ] PUK: Trimmed 48791 records to 32480 (keeping 150 days of data) [2025-09-16T20:05:54.612722] [DEBUG] [LOCAL ] PUK: Primary data saved (32480 records). [2025-09-16T20:05:54.612933] [INFO ] [MAIN ] PUK: Full history saved. [2025-09-16T20:05:54.614285] [INFO ] [MAIN ] Update Progress: 1750/2369 symbols completed. PUK took 30.2s. Estimated remaining: 1h 5m 44s. Rate: 9.4 symbols/min [2025-09-16T20:05:54.779728] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-04. [2025-09-16T20:05:54.899172] [INFO ] [MAIN ] PWR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:05:54.907277] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-16T20:05:54.955740] [DEBUG] [LOCAL ] PWR: Loaded 34461 existing records from primary storage. [2025-09-16T20:05:54.955932] [INFO ] [MAIN ] PWR: Loaded 34461 existing records. [2025-09-16T20:05:55.182121] [WARN ] [MAIN ] PWR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:05:55.182427] [INFO ] [MAIN ] PWR: Wiping existing primary data before full refresh. [2025-09-16T20:05:55.182476] [INFO ] [LOCAL ] PWR: Starting deletion of primary data. [2025-09-16T20:05:55.183265] [DEBUG] [LOCAL ] PWR: Deleted primary data file. [2025-09-16T20:05:55.183334] [INFO ] [MAIN ] PWR: Starting full primary refresh. [2025-09-16T20:05:55.291154] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-16T20:05:55.547481] [INFO ] [REMOTE ] PWR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:05:55.574852] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-02. [2025-09-16T20:05:55.811271] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-16T20:05:56.374937] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-06. [2025-09-16T20:05:57.111038] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-16T20:05:57.174937] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-03. [2025-09-16T20:05:57.932151] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-16T20:05:57.974883] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-07. [2025-09-16T20:05:58.774975] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-07. [2025-09-16T20:05:58.847783] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-16T20:05:59.424576] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-16T20:05:59.574877] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-08. [2025-09-16T20:06:00.288354] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-16T20:06:00.374926] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-08. [2025-09-16T20:06:01.116585] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-16T20:06:01.174847] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-05. [2025-09-16T20:06:01.832072] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-16T20:06:01.974909] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-06. [2025-09-16T20:06:02.134421] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-16T20:06:02.610853] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-16T20:06:02.774986] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-07. [2025-09-16T20:06:03.359282] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-16T20:06:03.574926] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-04. [2025-09-16T20:06:04.374915] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-08. [2025-09-16T20:06:05.028898] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-16T20:06:05.174939] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-09. [2025-09-16T20:06:05.495201] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-16T20:06:05.789464] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-16T20:06:05.790509] [INFO ] [REMOTE ] PVL: Full fetch complete (5138 records). [2025-09-16T20:06:05.790579] [DEBUG] [VALIDATOR ] PVL: Validating primary data. [2025-09-16T20:06:05.980492] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-09. [2025-09-16T20:06:06.195896] [DEBUG] [VALIDATOR ] PVL: All expected trading days are present. [2025-09-16T20:06:06.195983] [DEBUG] [VALIDATOR ] PVL: Primary data validation passed. [2025-09-16T20:06:06.196152] [INFO ] [MAIN ] PVL: Fetched primary data is valid. [2025-09-16T20:06:06.196198] [DEBUG] [LOCAL ] PVL: Saving primary data. [2025-09-16T20:06:06.196713] [DEBUG] [LOCAL ] PVL: Trimmed 5138 records to 3507 (keeping 150 days of data) [2025-09-16T20:06:06.218658] [DEBUG] [LOCAL ] PVL: Primary data saved (3507 records). [2025-09-16T20:06:06.218806] [INFO ] [MAIN ] PVL: Full history saved. [2025-09-16T20:06:06.218898] [INFO ] [MAIN ] Update Progress: 1751/2369 symbols completed. PVL took 16.2s. Estimated remaining: 1h 5m 40s. Rate: 9.4 symbols/min [2025-09-16T20:06:06.408885] [INFO ] [MAIN ] PX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:06:06.434242] [DEBUG] [LOCAL ] PX: Loaded 25752 existing records from primary storage. [2025-09-16T20:06:06.434378] [INFO ] [MAIN ] PX: Loaded 25752 existing records. [2025-09-16T20:06:06.610327] [WARN ] [MAIN ] PX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:06:06.610585] [INFO ] [MAIN ] PX: Wiping existing primary data before full refresh. [2025-09-16T20:06:06.610631] [INFO ] [LOCAL ] PX: Starting deletion of primary data. [2025-09-16T20:06:06.611338] [DEBUG] [LOCAL ] PX: Deleted primary data file. [2025-09-16T20:06:06.611387] [INFO ] [MAIN ] PX: Starting full primary refresh. [2025-09-16T20:06:06.784966] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-09. [2025-09-16T20:06:06.971609] [INFO ] [REMOTE ] PX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:06:07.574944] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-05. [2025-09-16T20:06:07.933977] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-16T20:06:07.940818] [INFO ] [REMOTE ] PVH: Full fetch complete (54284 records). [2025-09-16T20:06:07.941071] [DEBUG] [VALIDATOR ] PVH: Validating primary data. [2025-09-16T20:06:08.351928] [DEBUG] [VALIDATOR ] PVH: All expected trading days are present. [2025-09-16T20:06:08.352023] [DEBUG] [VALIDATOR ] PVH: Primary data validation passed. [2025-09-16T20:06:08.352978] [INFO ] [MAIN ] PVH: Fetched primary data is valid. [2025-09-16T20:06:08.353029] [DEBUG] [LOCAL ] PVH: Saving primary data. [2025-09-16T20:06:08.354339] [DEBUG] [LOCAL ] PVH: Trimmed 54284 records to 37679 (keeping 150 days of data) [2025-09-16T20:06:08.412303] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-02. [2025-09-16T20:06:08.606314] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-16T20:06:08.615106] [INFO ] [REMOTE ] PUMP: Full fetch complete (53825 records). [2025-09-16T20:06:08.616627] [DEBUG] [VALIDATOR ] PUMP: Validating primary data. [2025-09-16T20:06:08.624165] [DEBUG] [LOCAL ] PVH: Primary data saved (37679 records). [2025-09-16T20:06:08.676035] [INFO ] [MAIN ] PVH: Full history saved. [2025-09-16T20:06:08.702230] [INFO ] [MAIN ] Update Progress: 1752/2369 symbols completed. PVH took 26.2s. Estimated remaining: 1h 5m 32s. Rate: 9.4 symbols/min [2025-09-16T20:06:09.015568] [INFO ] [MAIN ] QBTS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:06:09.228352] [DEBUG] [VALIDATOR ] PUMP: All expected trading days are present. [2025-09-16T20:06:09.228433] [DEBUG] [VALIDATOR ] PUMP: Primary data validation passed. [2025-09-16T20:06:09.229374] [INFO ] [MAIN ] PUMP: Fetched primary data is valid. [2025-09-16T20:06:09.229433] [DEBUG] [LOCAL ] PUMP: Saving primary data. [2025-09-16T20:06:09.230591] [DEBUG] [LOCAL ] PUMP: Trimmed 53825 records to 36673 (keeping 150 days of data) [2025-09-16T20:06:09.300671] [DEBUG] [LOCAL ] QBTS: Loaded 39780 existing records from primary storage. [2025-09-16T20:06:09.326546] [INFO ] [MAIN ] QBTS: Loaded 39780 existing records. [2025-09-16T20:06:09.618051] [WARN ] [MAIN ] QBTS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:06:09.620497] [INFO ] [MAIN ] QBTS: Wiping existing primary data before full refresh. [2025-09-16T20:06:09.621355] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-09-16T20:06:09.627919] [DEBUG] [LOCAL ] QBTS: Deleted primary data file. [2025-09-16T20:06:09.630070] [INFO ] [MAIN ] QBTS: Starting full primary refresh. [2025-09-16T20:06:09.687230] [DEBUG] [LOCAL ] PUMP: Primary data saved (36673 records). [2025-09-16T20:06:09.736396] [INFO ] [MAIN ] PUMP: Full history saved. [2025-09-16T20:06:09.764470] [INFO ] [MAIN ] Update Progress: 1753/2369 symbols completed. PUMP took 35.1s. Estimated remaining: 1h 5m 24s. Rate: 9.4 symbols/min [2025-09-16T20:06:10.083216] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-09-16T20:06:10.152539] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-16T20:06:10.191816] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-03. [2025-09-16T20:06:10.192059] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-06. [2025-09-16T20:06:10.208869] [INFO ] [MAIN ] QD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:06:10.293285] [INFO ] [REMOTE ] QBTS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:06:10.306362] [DEBUG] [LOCAL ] QD: Loaded 20314 existing records from primary storage. [2025-09-16T20:06:10.306482] [INFO ] [MAIN ] QD: Loaded 20314 existing records. [2025-09-16T20:06:10.500825] [WARN ] [MAIN ] QD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:06:10.501105] [INFO ] [MAIN ] QD: Wiping existing primary data before full refresh. [2025-09-16T20:06:10.501161] [INFO ] [LOCAL ] QD: Starting deletion of primary data. [2025-09-16T20:06:10.501592] [DEBUG] [LOCAL ] QD: Deleted primary data file. [2025-09-16T20:06:10.501639] [INFO ] [MAIN ] QD: Starting full primary refresh. [2025-09-16T20:06:10.789751] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-02. [2025-09-16T20:06:10.881619] [INFO ] [REMOTE ] QD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:06:11.574953] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-02. [2025-09-16T20:06:11.629237] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-16T20:06:12.033169] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-16T20:06:12.374908] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-04. [2025-09-16T20:06:12.549609] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-16T20:06:12.900171] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-16T20:06:13.174957] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-03. [2025-09-16T20:06:13.871329] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-16T20:06:13.974902] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-07. [2025-09-16T20:06:14.774937] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-05. [2025-09-16T20:06:15.574913] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-03. [2025-09-16T20:06:15.791704] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-03 (2.62 seconds). [2025-09-16T20:06:15.833245] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-16T20:06:15.880695] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-16T20:06:16.374859] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-06. [2025-09-16T20:06:16.407534] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-16T20:06:17.174907] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-04. [2025-09-16T20:06:17.553581] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-16T20:06:17.974921] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-04. [2025-09-16T20:06:18.774912] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-08. [2025-09-16T20:06:18.975735] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-16T20:06:19.574914] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-05. [2025-09-16T20:06:19.808660] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-09-16T20:06:20.380956] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-05. [2025-09-16T20:06:20.399181] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-16T20:06:20.726421] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-16T20:06:21.174912] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-07. [2025-09-16T20:06:21.974903] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-09. [2025-09-16T20:06:22.415341] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-16T20:06:22.774904] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-08. [2025-09-16T20:06:22.980771] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-05 (2.60 seconds). [2025-09-16T20:06:23.534718] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-16T20:06:23.541628] [INFO ] [REMOTE ] PWR: Full fetch complete (52213 records). [2025-09-16T20:06:23.541815] [DEBUG] [VALIDATOR ] PWR: Validating primary data. [2025-09-16T20:06:23.579976] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-06. [2025-09-16T20:06:23.958577] [DEBUG] [VALIDATOR ] PWR: All expected trading days are present. [2025-09-16T20:06:23.958770] [DEBUG] [VALIDATOR ] PWR: Primary data validation passed. [2025-09-16T20:06:23.959731] [INFO ] [MAIN ] PWR: Fetched primary data is valid. [2025-09-16T20:06:23.959824] [DEBUG] [LOCAL ] PWR: Saving primary data. [2025-09-16T20:06:23.987249] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-16T20:06:23.987419] [DEBUG] [LOCAL ] PWR: Trimmed 52213 records to 34768 (keeping 150 days of data) [2025-09-16T20:06:24.223774] [DEBUG] [LOCAL ] PWR: Primary data saved (34768 records). [2025-09-16T20:06:24.224160] [INFO ] [MAIN ] PWR: Full history saved. [2025-09-16T20:06:24.224967] [INFO ] [MAIN ] Update Progress: 1754/2369 symbols completed. PWR took 29.6s. Estimated remaining: 1h 5m 20s. Rate: 9.4 symbols/min [2025-09-16T20:06:24.378025] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-06. [2025-09-16T20:06:24.396157] [INFO ] [MAIN ] QGEN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:06:24.435629] [DEBUG] [LOCAL ] QGEN: Loaded 36330 existing records from primary storage. [2025-09-16T20:06:24.435786] [INFO ] [MAIN ] QGEN: Loaded 36330 existing records. [2025-09-16T20:06:24.610909] [WARN ] [MAIN ] QGEN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:06:24.611159] [INFO ] [MAIN ] QGEN: Wiping existing primary data before full refresh. [2025-09-16T20:06:24.611204] [INFO ] [LOCAL ] QGEN: Starting deletion of primary data. [2025-09-16T20:06:24.612185] [DEBUG] [LOCAL ] QGEN: Deleted primary data file. [2025-09-16T20:06:24.612236] [INFO ] [MAIN ] QGEN: Starting full primary refresh. [2025-09-16T20:06:24.963373] [INFO ] [REMOTE ] QGEN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:06:25.174847] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-02. [2025-09-16T20:06:25.514523] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-16T20:06:25.974874] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-07. [2025-09-16T20:06:26.164754] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-06 (2.58 seconds). [2025-09-16T20:06:26.774902] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-07. [2025-09-16T20:06:26.826272] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-16T20:06:26.943373] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-16T20:06:27.574894] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-03. [2025-09-16T20:06:28.374893] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-09. [2025-09-16T20:06:29.174896] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-08. [2025-09-16T20:06:29.254352] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-16T20:06:29.378369] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-09-16T20:06:29.586493] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-16T20:06:29.590275] [INFO ] [REMOTE ] PX: Full fetch complete (38365 records). [2025-09-16T20:06:29.590366] [DEBUG] [VALIDATOR ] PX: Validating primary data. [2025-09-16T20:06:29.963876] [DEBUG] [VALIDATOR ] PX: All expected trading days are present. [2025-09-16T20:06:29.963978] [DEBUG] [VALIDATOR ] PX: Primary data validation passed. [2025-09-16T20:06:29.964788] [INFO ] [MAIN ] PX: Fetched primary data is valid. [2025-09-16T20:06:29.964835] [DEBUG] [LOCAL ] PX: Saving primary data. [2025-09-16T20:06:29.965780] [DEBUG] [LOCAL ] PX: Trimmed 38365 records to 25920 (keeping 150 days of data) [2025-09-16T20:06:30.021639] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-08. [2025-09-16T20:06:30.105002] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-16T20:06:30.160520] [DEBUG] [LOCAL ] PX: Primary data saved (25920 records). [2025-09-16T20:06:30.160846] [INFO ] [MAIN ] PX: Full history saved. [2025-09-16T20:06:30.160950] [INFO ] [MAIN ] Update Progress: 1755/2369 symbols completed. PX took 23.9s. Estimated remaining: 1h 5m 14s. Rate: 9.4 symbols/min [2025-09-16T20:06:30.331884] [INFO ] [MAIN ] QS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:06:30.370160] [DEBUG] [LOCAL ] QS: Loaded 39729 existing records from primary storage. [2025-09-16T20:06:30.370308] [INFO ] [MAIN ] QS: Loaded 39729 existing records. [2025-09-16T20:06:30.549719] [WARN ] [MAIN ] QS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:06:30.550005] [INFO ] [MAIN ] QS: Wiping existing primary data before full refresh. [2025-09-16T20:06:30.550050] [INFO ] [LOCAL ] QS: Starting deletion of primary data. [2025-09-16T20:06:30.551042] [DEBUG] [LOCAL ] QS: Deleted primary data file. [2025-09-16T20:06:30.551091] [INFO ] [MAIN ] QS: Starting full primary refresh. [2025-09-16T20:06:30.787880] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-04. [2025-09-16T20:06:30.907392] [INFO ] [REMOTE ] QS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:06:31.574915] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-09. [2025-09-16T20:06:32.374906] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-02. [2025-09-16T20:06:32.635852] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-16T20:06:32.739263] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-16T20:06:32.743148] [INFO ] [REMOTE ] QD: Full fetch complete (30307 records). [2025-09-16T20:06:32.743272] [DEBUG] [VALIDATOR ] QD: Validating primary data. [2025-09-16T20:06:33.181260] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-05. [2025-09-16T20:06:33.227355] [DEBUG] [VALIDATOR ] QD: All expected trading days are present. [2025-09-16T20:06:33.227184] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-08 (3.21 seconds). [2025-09-16T20:06:33.227732] [DEBUG] [VALIDATOR ] QD: Primary data validation passed. [2025-09-16T20:06:33.229411] [INFO ] [MAIN ] QD: Fetched primary data is valid. [2025-09-16T20:06:33.240362] [DEBUG] [LOCAL ] QD: Saving primary data. [2025-09-16T20:06:33.242762] [DEBUG] [LOCAL ] QD: Trimmed 30307 records to 20498 (keeping 150 days of data) [2025-09-16T20:06:33.370772] [DEBUG] [LOCAL ] QD: Primary data saved (20498 records). [2025-09-16T20:06:33.370981] [INFO ] [MAIN ] QD: Full history saved. [2025-09-16T20:06:33.371095] [INFO ] [MAIN ] Update Progress: 1756/2369 symbols completed. QD took 23.6s. Estimated remaining: 1h 5m 6s. Rate: 9.4 symbols/min [2025-09-16T20:06:33.550836] [INFO ] [MAIN ] QSR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:06:33.592141] [DEBUG] [LOCAL ] QSR: Loaded 38692 existing records from primary storage. [2025-09-16T20:06:33.592379] [INFO ] [MAIN ] QSR: Loaded 38692 existing records. [2025-09-16T20:06:33.785494] [WARN ] [MAIN ] QSR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:06:33.785860] [INFO ] [MAIN ] QSR: Wiping existing primary data before full refresh. [2025-09-16T20:06:33.785915] [INFO ] [LOCAL ] QSR: Starting deletion of primary data. [2025-09-16T20:06:33.786747] [DEBUG] [LOCAL ] QSR: Deleted primary data file. [2025-09-16T20:06:33.786799] [INFO ] [MAIN ] QSR: Starting full primary refresh. [2025-09-16T20:06:33.983338] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-09. [2025-09-16T20:06:34.172240] [INFO ] [REMOTE ] QSR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:06:34.565689] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-16T20:06:34.774897] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-03. [2025-09-16T20:06:34.847976] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-16T20:06:35.574931] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-06. [2025-09-16T20:06:36.374871] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-02. [2025-09-16T20:06:36.759972] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-09 (2.78 seconds). [2025-09-16T20:06:36.766744] [INFO ] [REMOTE ] QBTS: Full fetch complete (58423 records). [2025-09-16T20:06:36.766894] [DEBUG] [VALIDATOR ] QBTS: Validating primary data. [2025-09-16T20:06:37.163121] [DEBUG] [VALIDATOR ] QBTS: All expected trading days are present. [2025-09-16T20:06:37.163295] [DEBUG] [VALIDATOR ] QBTS: Primary data validation passed. [2025-09-16T20:06:37.164388] [INFO ] [MAIN ] QBTS: Fetched primary data is valid. [2025-09-16T20:06:37.164487] [DEBUG] [LOCAL ] QBTS: Saving primary data. [2025-09-16T20:06:37.194329] [DEBUG] [LOCAL ] QBTS: Trimmed 58423 records to 40170 (keeping 150 days of data) [2025-09-16T20:06:37.197861] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-09-16T20:06:37.268353] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-04. [2025-09-16T20:06:37.339690] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-16T20:06:37.488162] [DEBUG] [LOCAL ] QBTS: Primary data saved (40170 records). [2025-09-16T20:06:37.488306] [INFO ] [MAIN ] QBTS: Full history saved. [2025-09-16T20:06:37.488395] [INFO ] [MAIN ] Update Progress: 1757/2369 symbols completed. QBTS took 28.8s. Estimated remaining: 1h 4m 59s. Rate: 9.4 symbols/min [2025-09-16T20:06:37.979979] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-07. [2025-09-16T20:06:37.996046] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-16T20:06:38.774961] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-03. [2025-09-16T20:06:39.444834] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-16T20:06:39.574875] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-05. [2025-09-16T20:06:39.670565] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-16T20:06:40.374968] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-08. [2025-09-16T20:06:40.589703] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-16T20:06:41.174986] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-04. [2025-09-16T20:06:41.519026] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-16T20:06:41.974962] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-06. [2025-09-16T20:06:42.058528] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-16T20:06:42.774977] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-09. [2025-09-16T20:06:42.945795] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-16T20:06:43.574945] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-05. [2025-09-16T20:06:44.243778] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-09-16T20:06:44.374904] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-07. [2025-09-16T20:06:44.419233] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-16T20:06:44.425143] [INFO ] [REMOTE ] QGEN: Full fetch complete (53351 records). [2025-09-16T20:06:44.425298] [DEBUG] [VALIDATOR ] QGEN: Validating primary data. [2025-09-16T20:06:44.804082] [DEBUG] [VALIDATOR ] QGEN: All expected trading days are present. [2025-09-16T20:06:44.804169] [DEBUG] [VALIDATOR ] QGEN: Primary data validation passed. [2025-09-16T20:06:44.805039] [INFO ] [MAIN ] QGEN: Fetched primary data is valid. [2025-09-16T20:06:44.805086] [DEBUG] [LOCAL ] QGEN: Saving primary data. [2025-09-16T20:06:44.806728] [DEBUG] [LOCAL ] QGEN: Trimmed 53351 records to 36667 (keeping 150 days of data) [2025-09-16T20:06:45.034749] [DEBUG] [LOCAL ] QGEN: Primary data saved (36667 records). [2025-09-16T20:06:45.034918] [INFO ] [MAIN ] QGEN: Full history saved. [2025-09-16T20:06:45.035848] [INFO ] [MAIN ] Update Progress: 1758/2369 symbols completed. QGEN took 20.8s. Estimated remaining: 1h 4m 53s. Rate: 9.4 symbols/min [2025-09-16T20:06:45.572294] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-16T20:06:45.583490] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-06. [2025-09-16T20:06:47.088737] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-07 (2.71 seconds). [2025-09-16T20:06:47.100731] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-08. [2025-09-16T20:06:47.229504] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-16T20:06:47.240247] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-07. [2025-09-16T20:06:49.031594] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-16T20:06:49.042735] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-08. [2025-09-16T20:06:49.308074] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-16T20:06:49.319551] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-09. [2025-09-16T20:06:50.863900] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-16T20:06:50.875341] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-09. [2025-09-16T20:06:51.809169] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-09-16T20:06:51.815523] [INFO ] [REMOTE ] QS: Full fetch complete (58422 records). [2025-09-16T20:06:51.815628] [DEBUG] [VALIDATOR ] QS: Validating primary data. [2025-09-16T20:06:52.200593] [DEBUG] [VALIDATOR ] QS: All expected trading days are present. [2025-09-16T20:06:52.200699] [DEBUG] [VALIDATOR ] QS: Primary data validation passed. [2025-09-16T20:06:52.201841] [INFO ] [MAIN ] QS: Fetched primary data is valid. [2025-09-16T20:06:52.201889] [DEBUG] [LOCAL ] QS: Saving primary data. [2025-09-16T20:06:52.203143] [DEBUG] [LOCAL ] QS: Trimmed 58422 records to 40119 (keeping 150 days of data) [2025-09-16T20:06:52.438243] [DEBUG] [LOCAL ] QS: Primary data saved (40119 records). [2025-09-16T20:06:52.438376] [INFO ] [MAIN ] QS: Full history saved. [2025-09-16T20:06:52.438471] [INFO ] [MAIN ] Update Progress: 1759/2369 symbols completed. QS took 22.3s. Estimated remaining: 1h 4m 47s. Rate: 9.4 symbols/min [2025-09-16T20:06:52.637284] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-16T20:06:52.644288] [INFO ] [REMOTE ] QSR: Full fetch complete (57047 records). [2025-09-16T20:06:52.644486] [DEBUG] [VALIDATOR ] QSR: Validating primary data. [2025-09-16T20:06:53.033420] [DEBUG] [VALIDATOR ] QSR: All expected trading days are present. [2025-09-16T20:06:53.033539] [DEBUG] [VALIDATOR ] QSR: Primary data validation passed. [2025-09-16T20:06:53.035003] [INFO ] [MAIN ] QSR: Fetched primary data is valid. [2025-09-16T20:06:53.035060] [DEBUG] [LOCAL ] QSR: Saving primary data. [2025-09-16T20:06:53.036706] [DEBUG] [LOCAL ] QSR: Trimmed 57047 records to 39075 (keeping 150 days of data) [2025-09-16T20:06:53.291973] [DEBUG] [LOCAL ] QSR: Primary data saved (39075 records). [2025-09-16T20:06:53.292210] [INFO ] [MAIN ] QSR: Full history saved. [2025-09-16T20:06:53.292322] [INFO ] [MAIN ] Update Progress: 1760/2369 symbols completed. QSR took 19.9s. Estimated remaining: 1h 4m 39s. Rate: 9.4 symbols/min [2025-09-16T20:06:53.945622] [INFO ] [MAIN ] QTWO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:06:54.013770] [INFO ] [MAIN ] QUAD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:06:54.009579] [INFO ] [MAIN ] QVCD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:06:54.046046] [INFO ] [MAIN ] QVCC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:06:54.056299] [DEBUG] [LOCAL ] QVCD: Loaded 3362 existing records from primary storage. [2025-09-16T20:06:54.056550] [INFO ] [MAIN ] QVCD: Loaded 3362 existing records. [2025-09-16T20:06:54.154005] [DEBUG] [LOCAL ] QVCC: Loaded 6457 existing records from primary storage. [2025-09-16T20:06:54.197151] [INFO ] [MAIN ] QVCC: Loaded 6457 existing records. [2025-09-16T20:06:54.211734] [DEBUG] [LOCAL ] QUAD: Loaded 17585 existing records from primary storage. [2025-09-16T20:06:54.248459] [DEBUG] [LOCAL ] QTWO: Loaded 27793 existing records from primary storage. [2025-09-16T20:06:54.237511] [INFO ] [MAIN ] QUAD: Loaded 17585 existing records. [2025-09-16T20:06:54.289466] [INFO ] [MAIN ] QTWO: Loaded 27793 existing records. [2025-09-16T20:06:54.535845] [WARN ] [MAIN ] QVCD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:06:54.627559] [INFO ] [MAIN ] QVCD: Wiping existing primary data before full refresh. [2025-09-16T20:06:54.653934] [WARN ] [MAIN ] QVCC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:06:54.679240] [INFO ] [MAIN ] QVCC: Wiping existing primary data before full refresh. [2025-09-16T20:06:54.679374] [INFO ] [LOCAL ] QVCC: Starting deletion of primary data. [2025-09-16T20:06:54.689763] [INFO ] [LOCAL ] QVCD: Starting deletion of primary data. [2025-09-16T20:06:54.714682] [DEBUG] [LOCAL ] QVCC: Deleted primary data file. [2025-09-16T20:06:54.740702] [INFO ] [MAIN ] QVCC: Starting full primary refresh. [2025-09-16T20:06:54.810389] [DEBUG] [LOCAL ] QVCD: Deleted primary data file. [2025-09-16T20:06:54.864195] [WARN ] [MAIN ] QTWO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:06:54.881376] [INFO ] [MAIN ] QVCD: Starting full primary refresh. [2025-09-16T20:06:54.863928] [WARN ] [MAIN ] QUAD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:06:54.902063] [INFO ] [MAIN ] QTWO: Wiping existing primary data before full refresh. [2025-09-16T20:06:54.917631] [INFO ] [MAIN ] QUAD: Wiping existing primary data before full refresh. [2025-09-16T20:06:54.949816] [INFO ] [LOCAL ] QUAD: Starting deletion of primary data. [2025-09-16T20:06:54.928841] [INFO ] [LOCAL ] QTWO: Starting deletion of primary data. [2025-09-16T20:06:55.018703] [DEBUG] [LOCAL ] QTWO: Deleted primary data file. [2025-09-16T20:06:55.029775] [DEBUG] [LOCAL ] QUAD: Deleted primary data file. [2025-09-16T20:06:55.078885] [INFO ] [MAIN ] QUAD: Starting full primary refresh. [2025-09-16T20:06:55.079007] [INFO ] [MAIN ] QTWO: Starting full primary refresh. [2025-09-16T20:06:55.828187] [INFO ] [REMOTE ] QVCC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:06:55.895386] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-02. [2025-09-16T20:06:55.948713] [INFO ] [REMOTE ] QVCD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:06:56.010395] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-02. [2025-09-16T20:06:56.263863] [INFO ] [REMOTE ] QUAD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:06:56.295396] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-02. [2025-09-16T20:06:56.319316] [INFO ] [REMOTE ] QTWO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:06:56.320372] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-02. [2025-09-16T20:06:56.529077] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-16T20:06:56.530283] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-03. [2025-09-16T20:06:56.658193] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-16T20:06:56.659588] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-03. [2025-09-16T20:06:57.096747] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-16T20:06:57.098478] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-04. [2025-09-16T20:06:57.467262] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-16T20:06:57.470258] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-04. [2025-09-16T20:06:57.505113] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-16T20:06:57.510411] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-03. [2025-09-16T20:06:57.684373] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-16T20:06:57.686111] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-05. [2025-09-16T20:06:57.827950] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-16T20:06:57.974868] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-03. [2025-09-16T20:06:58.015168] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-16T20:06:58.097748] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-16T20:06:58.353378] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-16T20:06:58.774910] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-04. [2025-09-16T20:06:59.275083] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-16T20:06:59.574953] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-04. [2025-09-16T20:07:00.096491] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-16T20:07:00.374939] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-05. [2025-09-16T20:07:01.174882] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-06. [2025-09-16T20:07:01.239340] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-16T20:07:01.356543] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-16T20:07:01.763818] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-16T20:07:01.974905] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-06. [2025-09-16T20:07:02.774966] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-05. [2025-09-16T20:07:02.783706] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-16T20:07:03.574882] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-07. [2025-09-16T20:07:03.978719] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-16T20:07:04.293907] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-16T20:07:04.374934] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-08. [2025-09-16T20:07:05.155550] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-16T20:07:05.174861] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-05. [2025-09-16T20:07:05.974976] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-07. [2025-09-16T20:07:06.522039] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-16T20:07:06.741267] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-16T20:07:06.775029] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-09. [2025-09-16T20:07:07.574903] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-06. [2025-09-16T20:07:07.948675] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-16T20:07:07.950232] [INFO ] [REMOTE ] QVCC: Full fetch complete (9392 records). [2025-09-16T20:07:07.950304] [DEBUG] [VALIDATOR ] QVCC: Validating primary data. [2025-09-16T20:07:08.306236] [DEBUG] [VALIDATOR ] QVCC: All expected trading days are present. [2025-09-16T20:07:08.306324] [DEBUG] [VALIDATOR ] QVCC: Primary data validation passed. [2025-09-16T20:07:08.306604] [INFO ] [MAIN ] QVCC: Fetched primary data is valid. [2025-09-16T20:07:08.306663] [DEBUG] [LOCAL ] QVCC: Saving primary data. [2025-09-16T20:07:08.307126] [DEBUG] [LOCAL ] QVCC: Trimmed 9392 records to 6522 (keeping 150 days of data) [2025-09-16T20:07:08.348045] [DEBUG] [LOCAL ] QVCC: Primary data saved (6522 records). [2025-09-16T20:07:08.348204] [INFO ] [MAIN ] QVCC: Full history saved. [2025-09-16T20:07:08.348322] [INFO ] [MAIN ] Update Progress: 1761/2369 symbols completed. QVCC took 15.1s. Estimated remaining: 1h 4m 36s. Rate: 9.4 symbols/min [2025-09-16T20:07:08.383757] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-06. [2025-09-16T20:07:08.528349] [INFO ] [MAIN ] QXO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:07:08.566792] [DEBUG] [LOCAL ] QXO: Loaded 39513 existing records from primary storage. [2025-09-16T20:07:08.566965] [INFO ] [MAIN ] QXO: Loaded 39513 existing records. [2025-09-16T20:07:08.747918] [WARN ] [MAIN ] QXO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:07:08.760805] [INFO ] [MAIN ] QXO: Wiping existing primary data before full refresh. [2025-09-16T20:07:08.761541] [INFO ] [LOCAL ] QXO: Starting deletion of primary data. [2025-09-16T20:07:08.762118] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-16T20:07:08.767668] [DEBUG] [LOCAL ] QXO: Deleted primary data file. [2025-09-16T20:07:08.767774] [INFO ] [MAIN ] QXO: Starting full primary refresh. [2025-09-16T20:07:09.131306] [INFO ] [REMOTE ] QXO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:07:09.174905] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-07. [2025-09-16T20:07:09.824095] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-16T20:07:09.864406] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-16T20:07:09.974889] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-08. [2025-09-16T20:07:10.552552] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-16T20:07:10.774910] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-07. [2025-09-16T20:07:11.574894] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-02. [2025-09-16T20:07:12.285156] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-16T20:07:12.374939] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-08. [2025-09-16T20:07:13.174946] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-08. [2025-09-16T20:07:13.251903] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-16T20:07:13.638684] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-16T20:07:13.974920] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-09. [2025-09-16T20:07:14.552162] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-16T20:07:14.636017] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-16T20:07:14.637018] [INFO ] [REMOTE ] QVCD: Full fetch complete (4841 records). [2025-09-16T20:07:14.637091] [DEBUG] [VALIDATOR ] QVCD: Validating primary data. [2025-09-16T20:07:14.780041] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-09. [2025-09-16T20:07:15.025697] [DEBUG] [VALIDATOR ] QVCD: All expected trading days are present. [2025-09-16T20:07:15.025779] [DEBUG] [VALIDATOR ] QVCD: Primary data validation passed. [2025-09-16T20:07:15.025938] [INFO ] [MAIN ] QVCD: Fetched primary data is valid. [2025-09-16T20:07:15.025989] [DEBUG] [LOCAL ] QVCD: Saving primary data. [2025-09-16T20:07:15.026406] [DEBUG] [LOCAL ] QVCD: Trimmed 4841 records to 3381 (keeping 150 days of data) [2025-09-16T20:07:15.048548] [DEBUG] [LOCAL ] QVCD: Primary data saved (3381 records). [2025-09-16T20:07:15.048684] [INFO ] [MAIN ] QVCD: Full history saved. [2025-09-16T20:07:15.048804] [INFO ] [MAIN ] Update Progress: 1762/2369 symbols completed. QVCD took 21.8s. Estimated remaining: 1h 4m 29s. Rate: 9.4 symbols/min [2025-09-16T20:07:15.220844] [INFO ] [MAIN ] R: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:07:15.241711] [DEBUG] [LOCAL ] R: Loaded 20178 existing records from primary storage. [2025-09-16T20:07:15.241828] [INFO ] [MAIN ] R: Loaded 20178 existing records. [2025-09-16T20:07:15.418112] [WARN ] [MAIN ] R: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:07:15.418383] [INFO ] [MAIN ] R: Wiping existing primary data before full refresh. [2025-09-16T20:07:15.418436] [INFO ] [LOCAL ] R: Starting deletion of primary data. [2025-09-16T20:07:15.419100] [DEBUG] [LOCAL ] R: Deleted primary data file. [2025-09-16T20:07:15.419149] [INFO ] [MAIN ] R: Starting full primary refresh. [2025-09-16T20:07:15.576224] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-09. [2025-09-16T20:07:15.781901] [INFO ] [REMOTE ] R: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:07:16.374895] [INFO ] [REMOTE ] R: Fetching primary data for 2025-02. [2025-09-16T20:07:16.504405] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-16T20:07:16.509904] [INFO ] [REMOTE ] QTWO: Full fetch complete (42815 records). [2025-09-16T20:07:16.510016] [DEBUG] [VALIDATOR ] QTWO: Validating primary data. [2025-09-16T20:07:16.881075] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-16T20:07:16.899224] [DEBUG] [VALIDATOR ] QTWO: All expected trading days are present. [2025-09-16T20:07:16.899306] [DEBUG] [VALIDATOR ] QTWO: Primary data validation passed. [2025-09-16T20:07:16.900131] [INFO ] [MAIN ] QTWO: Fetched primary data is valid. [2025-09-16T20:07:16.900209] [DEBUG] [LOCAL ] QTWO: Saving primary data. [2025-09-16T20:07:16.900306] [INFO ] [REMOTE ] QUAD: Full fetch complete (26887 records). [2025-09-16T20:07:16.900529] [DEBUG] [VALIDATOR ] QUAD: Validating primary data. [2025-09-16T20:07:16.991285] [DEBUG] [LOCAL ] QTWO: Trimmed 42815 records to 28169 (keeping 150 days of data) [2025-09-16T20:07:17.186035] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-03. [2025-09-16T20:07:17.382823] [DEBUG] [VALIDATOR ] QUAD: All expected trading days are present. [2025-09-16T20:07:17.383692] [DEBUG] [VALIDATOR ] QUAD: Primary data validation passed. [2025-09-16T20:07:17.384340] [INFO ] [MAIN ] QUAD: Fetched primary data is valid. [2025-09-16T20:07:17.384668] [DEBUG] [LOCAL ] QUAD: Saving primary data. [2025-09-16T20:07:17.388501] [DEBUG] [LOCAL ] QUAD: Trimmed 26887 records to 17753 (keeping 150 days of data) [2025-09-16T20:07:17.548827] [DEBUG] [LOCAL ] QUAD: Primary data saved (17753 records). [2025-09-16T20:07:17.549537] [INFO ] [MAIN ] QUAD: Full history saved. [2025-09-16T20:07:17.550200] [INFO ] [MAIN ] Update Progress: 1763/2369 symbols completed. QUAD took 24.3s. Estimated remaining: 1h 4m 22s. Rate: 9.4 symbols/min [2025-09-16T20:07:17.731081] [INFO ] [MAIN ] RA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:07:17.733176] [DEBUG] [LOCAL ] QTWO: Primary data saved (28169 records). [2025-09-16T20:07:17.733859] [INFO ] [MAIN ] QTWO: Full history saved. [2025-09-16T20:07:17.733997] [INFO ] [MAIN ] Update Progress: 1764/2369 symbols completed. QTWO took 24.4s. Estimated remaining: 1h 4m 13s. Rate: 9.4 symbols/min [2025-09-16T20:07:17.864663] [DEBUG] [LOCAL ] RA: Loaded 15704 existing records from primary storage. [2025-09-16T20:07:17.920530] [INFO ] [MAIN ] RACE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:07:17.917289] [INFO ] [MAIN ] RA: Loaded 15704 existing records. [2025-09-16T20:07:18.054347] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-16T20:07:18.099172] [INFO ] [REMOTE ] R: Fetching primary data for 2025-03. [2025-09-16T20:07:18.126772] [WARN ] [MAIN ] RA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:07:18.133853] [INFO ] [MAIN ] RA: Wiping existing primary data before full refresh. [2025-09-16T20:07:18.133917] [INFO ] [LOCAL ] RA: Starting deletion of primary data. [2025-09-16T20:07:18.134408] [DEBUG] [LOCAL ] RACE: Loaded 22545 existing records from primary storage. [2025-09-16T20:07:18.134477] [INFO ] [MAIN ] RACE: Loaded 22545 existing records. [2025-09-16T20:07:18.140143] [DEBUG] [LOCAL ] RA: Deleted primary data file. [2025-09-16T20:07:18.179241] [INFO ] [MAIN ] RA: Starting full primary refresh. [2025-09-16T20:07:18.455489] [WARN ] [MAIN ] RACE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:07:18.533691] [INFO ] [MAIN ] RACE: Wiping existing primary data before full refresh. [2025-09-16T20:07:18.567323] [INFO ] [LOCAL ] RACE: Starting deletion of primary data. [2025-09-16T20:07:18.606207] [DEBUG] [LOCAL ] RACE: Deleted primary data file. [2025-09-16T20:07:18.616524] [INFO ] [MAIN ] RACE: Starting full primary refresh. [2025-09-16T20:07:18.790978] [INFO ] [REMOTE ] RA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:07:18.794008] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-02. [2025-09-16T20:07:19.050698] [INFO ] [REMOTE ] RACE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:07:19.083861] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-16T20:07:19.582847] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-02. [2025-09-16T20:07:19.587469] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-16T20:07:19.638695] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-16T20:07:20.374889] [INFO ] [REMOTE ] R: Fetching primary data for 2025-04. [2025-09-16T20:07:21.174946] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-03. [2025-09-16T20:07:21.201892] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-16T20:07:21.601014] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-16T20:07:21.974913] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-03. [2025-09-16T20:07:22.356375] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-16T20:07:22.774906] [INFO ] [REMOTE ] R: Fetching primary data for 2025-05. [2025-09-16T20:07:23.505380] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-16T20:07:23.574889] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-04. [2025-09-16T20:07:24.063308] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-16T20:07:24.374901] [INFO ] [REMOTE ] R: Fetching primary data for 2025-06. [2025-09-16T20:07:25.058940] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-16T20:07:25.174857] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-05. [2025-09-16T20:07:25.654781] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-16T20:07:25.974892] [INFO ] [REMOTE ] R: Fetching primary data for 2025-07. [2025-09-16T20:07:26.518699] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-16T20:07:26.774893] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-04. [2025-09-16T20:07:27.348123] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-16T20:07:27.574959] [INFO ] [REMOTE ] R: Fetching primary data for 2025-08. [2025-09-16T20:07:28.374865] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-06. [2025-09-16T20:07:28.654063] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-16T20:07:28.788854] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-16T20:07:29.174898] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-05. [2025-09-16T20:07:29.760509] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-16T20:07:29.974911] [INFO ] [REMOTE ] R: Fetching primary data for 2025-09. [2025-09-16T20:07:30.774931] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-04. [2025-09-16T20:07:31.093037] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-16T20:07:31.117882] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-16T20:07:31.121142] [INFO ] [REMOTE ] R: Full fetch complete (32533 records). [2025-09-16T20:07:31.121224] [DEBUG] [VALIDATOR ] R: Validating primary data. [2025-09-16T20:07:31.496400] [DEBUG] [VALIDATOR ] R: All expected trading days are present. [2025-09-16T20:07:31.496496] [DEBUG] [VALIDATOR ] R: Primary data validation passed. [2025-09-16T20:07:31.497331] [INFO ] [MAIN ] R: Fetched primary data is valid. [2025-09-16T20:07:31.497376] [DEBUG] [LOCAL ] R: Saving primary data. [2025-09-16T20:07:31.498344] [DEBUG] [LOCAL ] R: Trimmed 32533 records to 20314 (keeping 150 days of data) [2025-09-16T20:07:31.597500] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-07. [2025-09-16T20:07:31.638445] [DEBUG] [LOCAL ] R: Primary data saved (20314 records). [2025-09-16T20:07:31.638585] [INFO ] [MAIN ] R: Full history saved. [2025-09-16T20:07:31.638717] [INFO ] [MAIN ] Update Progress: 1765/2369 symbols completed. R took 16.6s. Estimated remaining: 1h 4m 9s. Rate: 9.4 symbols/min [2025-09-16T20:07:31.813337] [INFO ] [MAIN ] RAMP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:07:31.839408] [DEBUG] [LOCAL ] RAMP: Loaded 26853 existing records from primary storage. [2025-09-16T20:07:31.839548] [INFO ] [MAIN ] RAMP: Loaded 26853 existing records. [2025-09-16T20:07:32.015389] [WARN ] [MAIN ] RAMP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:07:32.015778] [INFO ] [MAIN ] RAMP: Wiping existing primary data before full refresh. [2025-09-16T20:07:32.015837] [INFO ] [LOCAL ] RAMP: Starting deletion of primary data. [2025-09-16T20:07:32.021855] [DEBUG] [LOCAL ] RAMP: Deleted primary data file. [2025-09-16T20:07:32.029325] [INFO ] [MAIN ] RAMP: Starting full primary refresh. [2025-09-16T20:07:32.080392] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-16T20:07:32.388664] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-06. [2025-09-16T20:07:32.392913] [INFO ] [REMOTE ] RAMP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:07:33.174887] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-05. [2025-09-16T20:07:33.208773] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-16T20:07:33.974900] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-02. [2025-09-16T20:07:34.190798] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-16T20:07:34.290070] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-16T20:07:34.774907] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-07. [2025-09-16T20:07:35.371110] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-16T20:07:35.574894] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-03. [2025-09-16T20:07:36.374950] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-06. [2025-09-16T20:07:36.842263] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-16T20:07:37.091271] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-16T20:07:37.174882] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-08. [2025-09-16T20:07:37.482399] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-16T20:07:37.974945] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-08. [2025-09-16T20:07:38.500766] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-16T20:07:38.774959] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-04. [2025-09-16T20:07:38.892780] [DEBUG] [REMOTE ] RAMP: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-09-16T20:07:38.893086] [WARN ] [REMOTE ] RAMP: No data returned for month 2025-04 [2025-09-16T20:07:39.574925] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-07. [2025-09-16T20:07:39.978840] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-16T20:07:40.374907] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-09. [2025-09-16T20:07:40.922695] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-16T20:07:41.174937] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-08. [2025-09-16T20:07:41.974954] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-05. [2025-09-16T20:07:42.252333] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-16T20:07:42.478685] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-16T20:07:42.485455] [INFO ] [REMOTE ] QXO: Full fetch complete (57470 records). [2025-09-16T20:07:42.485624] [DEBUG] [VALIDATOR ] QXO: Validating primary data. [2025-09-16T20:07:42.779923] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-09. [2025-09-16T20:07:42.872339] [DEBUG] [VALIDATOR ] QXO: All expected trading days are present. [2025-09-16T20:07:42.872425] [DEBUG] [VALIDATOR ] QXO: Primary data validation passed. [2025-09-16T20:07:42.873359] [INFO ] [MAIN ] QXO: Fetched primary data is valid. [2025-09-16T20:07:42.873424] [DEBUG] [LOCAL ] QXO: Saving primary data. [2025-09-16T20:07:42.875853] [DEBUG] [LOCAL ] QXO: Trimmed 57470 records to 39903 (keeping 150 days of data) [2025-09-16T20:07:43.121254] [DEBUG] [LOCAL ] QXO: Primary data saved (39903 records). [2025-09-16T20:07:43.121401] [INFO ] [MAIN ] QXO: Full history saved. [2025-09-16T20:07:43.121498] [INFO ] [MAIN ] Update Progress: 1766/2369 symbols completed. QXO took 34.8s. Estimated remaining: 1h 4m 5s. Rate: 9.4 symbols/min [2025-09-16T20:07:43.296794] [INFO ] [MAIN ] RBA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:07:43.356002] [DEBUG] [LOCAL ] RBA: Loaded 33785 existing records from primary storage. [2025-09-16T20:07:43.357379] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-16T20:07:43.357457] [INFO ] [MAIN ] RBA: Loaded 33785 existing records. [2025-09-16T20:07:43.542235] [WARN ] [MAIN ] RBA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:07:43.542536] [INFO ] [MAIN ] RBA: Wiping existing primary data before full refresh. [2025-09-16T20:07:43.542586] [INFO ] [LOCAL ] RBA: Starting deletion of primary data. [2025-09-16T20:07:43.543414] [DEBUG] [LOCAL ] RBA: Deleted primary data file. [2025-09-16T20:07:43.543463] [INFO ] [MAIN ] RBA: Starting full primary refresh. [2025-09-16T20:07:43.579983] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-06. [2025-09-16T20:07:43.895931] [INFO ] [REMOTE ] RBA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:07:44.222514] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-16T20:07:44.226778] [INFO ] [REMOTE ] RACE: Full fetch complete (36287 records). [2025-09-16T20:07:44.226901] [DEBUG] [VALIDATOR ] RACE: Validating primary data. [2025-09-16T20:07:44.381619] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-02. [2025-09-16T20:07:44.628556] [DEBUG] [VALIDATOR ] RACE: All expected trading days are present. [2025-09-16T20:07:44.628657] [DEBUG] [VALIDATOR ] RACE: Primary data validation passed. [2025-09-16T20:07:44.629386] [INFO ] [MAIN ] RACE: Fetched primary data is valid. [2025-09-16T20:07:44.629429] [DEBUG] [LOCAL ] RACE: Saving primary data. [2025-09-16T20:07:44.630360] [DEBUG] [LOCAL ] RACE: Trimmed 36287 records to 22749 (keeping 150 days of data) [2025-09-16T20:07:44.770248] [DEBUG] [LOCAL ] RACE: Primary data saved (22749 records). [2025-09-16T20:07:44.770385] [INFO ] [MAIN ] RACE: Full history saved. [2025-09-16T20:07:44.770472] [INFO ] [MAIN ] Update Progress: 1767/2369 symbols completed. RACE took 27.0s. Estimated remaining: 1h 3m 57s. Rate: 9.4 symbols/min [2025-09-16T20:07:44.943147] [INFO ] [MAIN ] RBC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:07:44.957743] [DEBUG] [LOCAL ] RBC: Loaded 10796 existing records from primary storage. [2025-09-16T20:07:44.957931] [INFO ] [MAIN ] RBC: Loaded 10796 existing records. [2025-09-16T20:07:45.144570] [WARN ] [MAIN ] RBC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:07:45.145088] [INFO ] [MAIN ] RBC: Wiping existing primary data before full refresh. [2025-09-16T20:07:45.145203] [INFO ] [LOCAL ] RBC: Starting deletion of primary data. [2025-09-16T20:07:45.145799] [DEBUG] [LOCAL ] RBC: Deleted primary data file. [2025-09-16T20:07:45.156803] [INFO ] [MAIN ] RBC: Starting full primary refresh. [2025-09-16T20:07:45.181031] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-09. [2025-09-16T20:07:45.180968] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-16T20:07:45.538957] [INFO ] [REMOTE ] RBC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:07:45.964549] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-16T20:07:45.974854] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-03. [2025-09-16T20:07:46.331660] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-16T20:07:46.334545] [INFO ] [REMOTE ] RA: Full fetch complete (23860 records). [2025-09-16T20:07:46.334629] [DEBUG] [VALIDATOR ] RA: Validating primary data. [2025-09-16T20:07:46.693806] [DEBUG] [VALIDATOR ] RA: All expected trading days are present. [2025-09-16T20:07:46.693883] [DEBUG] [VALIDATOR ] RA: Primary data validation passed. [2025-09-16T20:07:46.694383] [INFO ] [MAIN ] RA: Fetched primary data is valid. [2025-09-16T20:07:46.694424] [DEBUG] [LOCAL ] RA: Saving primary data. [2025-09-16T20:07:46.695076] [DEBUG] [LOCAL ] RA: Trimmed 23860 records to 15866 (keeping 150 days of data) [2025-09-16T20:07:46.775892] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-02. [2025-09-16T20:07:46.797354] [DEBUG] [LOCAL ] RA: Primary data saved (15866 records). [2025-09-16T20:07:46.797501] [INFO ] [MAIN ] RA: Full history saved. [2025-09-16T20:07:46.797602] [INFO ] [MAIN ] Update Progress: 1768/2369 symbols completed. RA took 29.2s. Estimated remaining: 1h 3m 49s. Rate: 9.4 symbols/min [2025-09-16T20:07:46.968032] [INFO ] [MAIN ] RBLX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:07:47.013296] [DEBUG] [LOCAL ] RBLX: Loaded 39693 existing records from primary storage. [2025-09-16T20:07:47.013446] [INFO ] [MAIN ] RBLX: Loaded 39693 existing records. [2025-09-16T20:07:47.199582] [WARN ] [MAIN ] RBLX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:07:47.199833] [INFO ] [MAIN ] RBLX: Wiping existing primary data before full refresh. [2025-09-16T20:07:47.199882] [INFO ] [LOCAL ] RBLX: Starting deletion of primary data. [2025-09-16T20:07:47.201078] [DEBUG] [LOCAL ] RBLX: Deleted primary data file. [2025-09-16T20:07:47.201142] [INFO ] [MAIN ] RBLX: Starting full primary refresh. [2025-09-16T20:07:47.584142] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-07. [2025-09-16T20:07:47.590948] [INFO ] [REMOTE ] RBLX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:07:47.675846] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-16T20:07:47.696879] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-16T20:07:48.374907] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-03. [2025-09-16T20:07:49.005772] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-16T20:07:49.174959] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-04. [2025-09-16T20:07:49.458243] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-16T20:07:49.974913] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-04. [2025-09-16T20:07:50.677106] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-16T20:07:50.774884] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-05. [2025-09-16T20:07:51.086496] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-16T20:07:51.574911] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-05. [2025-09-16T20:07:52.374879] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-08. [2025-09-16T20:07:52.473520] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-16T20:07:52.566905] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-16T20:07:53.174950] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-06. [2025-09-16T20:07:53.642029] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-16T20:07:53.974917] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-02. [2025-09-16T20:07:54.151449] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-16T20:07:54.774904] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-09. [2025-09-16T20:07:55.574917] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-06. [2025-09-16T20:07:56.190012] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-09-16T20:07:56.211997] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-16T20:07:56.216614] [INFO ] [REMOTE ] RAMP: Full fetch complete (34868 records). [2025-09-16T20:07:56.216787] [DEBUG] [VALIDATOR ] RAMP: Validating primary data. [2025-09-16T20:07:56.379335] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-07. [2025-09-16T20:07:56.409861] [WARN ] [VALIDATOR ] RAMP: Validation failed - insufficient historical data. Have 129 unique days, need 150 days [2025-09-16T20:07:56.411691] [FATAL] [MAIN ] RAMP: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:07:56.411760] [WARN ] [MAIN ] RAMP: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:07:56.411809] [INFO ] [LOCAL ] RAMP: Starting deletion of primary data. [2025-09-16T20:07:56.411879] [DEBUG] [LOCAL ] RAMP: No primary data file found to delete. [2025-09-16T20:07:56.411921] [INFO ] [LOCAL ] RAMP: Starting deletion of derivative data. [2025-09-16T20:07:56.412338] [DEBUG] [LOCAL ] RAMP: Deleted derivative data file. [2025-09-16T20:07:56.412450] [INFO ] [MAIN ] Update Progress: 1769/2369 symbols completed. RAMP took 24.8s. Estimated remaining: 1h 3m 44s. Rate: 9.4 symbols/min [2025-09-16T20:07:56.589474] [INFO ] [MAIN ] RBOT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:07:56.595090] [DEBUG] [LOCAL ] RBOT: Loaded 3792 existing records from primary storage. [2025-09-16T20:07:56.595209] [INFO ] [MAIN ] RBOT: Loaded 3792 existing records. [2025-09-16T20:07:56.775627] [WARN ] [MAIN ] RBOT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:07:56.775903] [INFO ] [MAIN ] RBOT: Wiping existing primary data before full refresh. [2025-09-16T20:07:56.775949] [INFO ] [LOCAL ] RBOT: Starting deletion of primary data. [2025-09-16T20:07:56.776168] [DEBUG] [LOCAL ] RBOT: Deleted primary data file. [2025-09-16T20:07:56.776210] [INFO ] [MAIN ] RBOT: Starting full primary refresh. [2025-09-16T20:07:57.135563] [INFO ] [REMOTE ] RBOT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:07:57.170898] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-16T20:07:57.172342] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-16T20:07:57.176162] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-02. [2025-09-16T20:07:57.901530] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-16T20:07:57.974941] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-08. [2025-09-16T20:07:58.775138] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-07. [2025-09-16T20:07:58.798319] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-16T20:07:59.574969] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-03. [2025-09-16T20:08:00.209912] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-16T20:08:00.322674] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-16T20:08:00.374858] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-08. [2025-09-16T20:08:01.174898] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-03. [2025-09-16T20:08:01.974924] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-04. [2025-09-16T20:08:02.020132] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-16T20:08:02.583235] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-16T20:08:02.774886] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-09. [2025-09-16T20:08:03.296716] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-16T20:08:03.574918] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-04. [2025-09-16T20:08:04.375018] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-05. [2025-09-16T20:08:04.453860] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-16T20:08:04.460151] [INFO ] [REMOTE ] RBA: Full fetch complete (50220 records). [2025-09-16T20:08:04.460393] [DEBUG] [VALIDATOR ] RBA: Validating primary data. [2025-09-16T20:08:04.856182] [DEBUG] [VALIDATOR ] RBA: All expected trading days are present. [2025-09-16T20:08:04.856278] [DEBUG] [VALIDATOR ] RBA: Primary data validation passed. [2025-09-16T20:08:04.857289] [INFO ] [MAIN ] RBA: Fetched primary data is valid. [2025-09-16T20:08:04.857339] [DEBUG] [LOCAL ] RBA: Saving primary data. [2025-09-16T20:08:04.858589] [DEBUG] [LOCAL ] RBA: Trimmed 50220 records to 34109 (keeping 150 days of data) [2025-09-16T20:08:04.984769] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-16T20:08:05.081478] [DEBUG] [LOCAL ] RBA: Primary data saved (34109 records). [2025-09-16T20:08:05.081631] [INFO ] [MAIN ] RBA: Full history saved. [2025-09-16T20:08:05.083241] [INFO ] [MAIN ] Update Progress: 1770/2369 symbols completed. RBA took 22.0s. Estimated remaining: 1h 3m 38s. Rate: 9.4 symbols/min [2025-09-16T20:08:05.180001] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-09. [2025-09-16T20:08:05.264189] [INFO ] [MAIN ] RBRK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:08:05.306030] [DEBUG] [LOCAL ] RBRK: Loaded 39250 existing records from primary storage. [2025-09-16T20:08:05.306201] [INFO ] [MAIN ] RBRK: Loaded 39250 existing records. [2025-09-16T20:08:05.495131] [WARN ] [MAIN ] RBRK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:08:05.495446] [INFO ] [MAIN ] RBRK: Wiping existing primary data before full refresh. [2025-09-16T20:08:05.495502] [INFO ] [LOCAL ] RBRK: Starting deletion of primary data. [2025-09-16T20:08:05.496691] [DEBUG] [LOCAL ] RBRK: Deleted primary data file. [2025-09-16T20:08:05.496761] [INFO ] [MAIN ] RBRK: Starting full primary refresh. [2025-09-16T20:08:05.823123] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-16T20:08:05.915664] [INFO ] [REMOTE ] RBRK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:08:05.974867] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-02. [2025-09-16T20:08:06.188979] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-16T20:08:06.191240] [INFO ] [REMOTE ] RBC: Full fetch complete (16046 records). [2025-09-16T20:08:06.191351] [DEBUG] [VALIDATOR ] RBC: Validating primary data. [2025-09-16T20:08:06.573497] [DEBUG] [VALIDATOR ] RBC: All expected trading days are present. [2025-09-16T20:08:06.573573] [DEBUG] [VALIDATOR ] RBC: Primary data validation passed. [2025-09-16T20:08:06.574046] [INFO ] [MAIN ] RBC: Fetched primary data is valid. [2025-09-16T20:08:06.574095] [DEBUG] [LOCAL ] RBC: Saving primary data. [2025-09-16T20:08:06.574597] [DEBUG] [LOCAL ] RBC: Trimmed 16046 records to 10908 (keeping 150 days of data) [2025-09-16T20:08:06.640633] [DEBUG] [LOCAL ] RBC: Primary data saved (10908 records). [2025-09-16T20:08:06.640784] [INFO ] [MAIN ] RBC: Full history saved. [2025-09-16T20:08:06.640870] [INFO ] [MAIN ] Update Progress: 1771/2369 symbols completed. RBC took 21.9s. Estimated remaining: 1h 3m 30s. Rate: 9.4 symbols/min [2025-09-16T20:08:06.780522] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-06. [2025-09-16T20:08:06.810464] [INFO ] [MAIN ] RC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:08:06.843847] [DEBUG] [LOCAL ] RC: Loaded 35705 existing records from primary storage. [2025-09-16T20:08:06.844005] [INFO ] [MAIN ] RC: Loaded 35705 existing records. [2025-09-16T20:08:07.019007] [WARN ] [MAIN ] RC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:08:07.019257] [INFO ] [MAIN ] RC: Wiping existing primary data before full refresh. [2025-09-16T20:08:07.019302] [INFO ] [LOCAL ] RC: Starting deletion of primary data. [2025-09-16T20:08:07.020042] [DEBUG] [LOCAL ] RC: Deleted primary data file. [2025-09-16T20:08:07.020093] [INFO ] [MAIN ] RC: Starting full primary refresh. [2025-09-16T20:08:07.363702] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-16T20:08:07.384990] [INFO ] [REMOTE ] RC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:08:07.574899] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-02. [2025-09-16T20:08:07.834623] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-16T20:08:08.374893] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-05. [2025-09-16T20:08:09.174927] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-07. [2025-09-16T20:08:09.274625] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-16T20:08:09.875715] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-16T20:08:09.974938] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-08. [2025-09-16T20:08:10.552775] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-16T20:08:10.774885] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-06. [2025-09-16T20:08:10.826030] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-16T20:08:11.574907] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-03. [2025-09-16T20:08:12.374937] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-09. [2025-09-16T20:08:12.946887] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-16T20:08:13.174945] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-03. [2025-09-16T20:08:13.189291] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-16T20:08:13.190877] [INFO ] [REMOTE ] RBOT: Full fetch complete (5798 records). [2025-09-16T20:08:13.190950] [DEBUG] [VALIDATOR ] RBOT: Validating primary data. [2025-09-16T20:08:13.570065] [DEBUG] [VALIDATOR ] RBOT: All expected trading days are present. [2025-09-16T20:08:13.570228] [DEBUG] [VALIDATOR ] RBOT: Primary data validation passed. [2025-09-16T20:08:13.570477] [INFO ] [MAIN ] RBOT: Fetched primary data is valid. [2025-09-16T20:08:13.570533] [DEBUG] [LOCAL ] RBOT: Saving primary data. [2025-09-16T20:08:13.571179] [DEBUG] [LOCAL ] RBOT: Trimmed 5798 records to 3831 (keeping 150 days of data) [2025-09-16T20:08:13.593335] [DEBUG] [LOCAL ] RBOT: Primary data saved (3831 records). [2025-09-16T20:08:13.593409] [INFO ] [MAIN ] RBOT: Full history saved. [2025-09-16T20:08:13.593532] [INFO ] [MAIN ] Update Progress: 1772/2369 symbols completed. RBOT took 17.2s. Estimated remaining: 1h 3m 24s. Rate: 9.4 symbols/min [2025-09-16T20:08:13.802914] [INFO ] [MAIN ] RCB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:08:13.803190] [DEBUG] [LOCAL ] RCB: No existing data file found in primary storage. [2025-09-16T20:08:13.803588] [WARN ] [MAIN ] RCB: No existing data found, performing full refresh instead. [2025-09-16T20:08:13.804034] [INFO ] [MAIN ] RCB: Wiping existing primary data before full refresh. [2025-09-16T20:08:13.804945] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-09-16T20:08:13.805005] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-09-16T20:08:13.808801] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-16T20:08:13.809070] [INFO ] [MAIN ] RCB: Starting full primary refresh. [2025-09-16T20:08:13.977624] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-07. [2025-09-16T20:08:14.176087] [INFO ] [REMOTE ] RCB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:08:14.775018] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-02. [2025-09-16T20:08:15.121997] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-16T20:08:15.383876] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-16T20:08:15.574932] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-03. [2025-09-16T20:08:16.169699] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-16T20:08:16.374969] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-04. [2025-09-16T20:08:16.517663] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-09-16T20:08:17.174905] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-08. [2025-09-16T20:08:17.803125] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-16T20:08:17.974937] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-04. [2025-09-16T20:08:18.532935] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-16T20:08:18.774942] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-05. [2025-09-16T20:08:19.378834] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-16T20:08:19.574924] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-06. [2025-09-16T20:08:19.654217] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-09-16T20:08:19.944943] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-16T20:08:20.374914] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-04. [2025-09-16T20:08:21.174953] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-07. [2025-09-16T20:08:21.525417] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-16T20:08:21.974894] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-09. [2025-09-16T20:08:22.052221] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-16T20:08:22.774909] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-05. [2025-09-16T20:08:23.574916] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-08. [2025-09-16T20:08:23.955923] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-16T20:08:24.374907] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-09. [2025-09-16T20:08:24.686709] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-16T20:08:24.752317] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-16T20:08:24.753139] [INFO ] [REMOTE ] RCB: Full fetch complete (2977 records). [2025-09-16T20:08:24.753207] [DEBUG] [VALIDATOR ] RCB: Validating primary data. [2025-09-16T20:08:24.941836] [WARN ] [VALIDATOR ] RCB: Validation failed - insufficient historical data. Have 148 unique days, need 150 days [2025-09-16T20:08:24.942196] [FATAL] [MAIN ] RCB: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:08:24.942340] [WARN ] [MAIN ] RCB: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:08:24.942416] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-09-16T20:08:24.942516] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-09-16T20:08:24.942666] [INFO ] [LOCAL ] RCB: Starting deletion of derivative data. [2025-09-16T20:08:24.942784] [DEBUG] [LOCAL ] RCB: No derivative data file found to delete. [2025-09-16T20:08:24.942983] [INFO ] [MAIN ] Update Progress: 1773/2369 symbols completed. RCB took 11.3s. Estimated remaining: 1h 3m 19s. Rate: 9.4 symbols/min [2025-09-16T20:08:25.122203] [INFO ] [MAIN ] RCD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:08:25.140985] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-09 (3.17 seconds). [2025-09-16T20:08:25.149428] [DEBUG] [LOCAL ] RCD: Loaded 2563 existing records from primary storage. [2025-09-16T20:08:25.149682] [INFO ] [MAIN ] RCD: Loaded 2563 existing records. [2025-09-16T20:08:25.180020] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-05. [2025-09-16T20:08:25.207357] [INFO ] [REMOTE ] RBLX: Full fetch complete (58402 records). [2025-09-16T20:08:25.216252] [DEBUG] [VALIDATOR ] RBLX: Validating primary data. [2025-09-16T20:08:25.462006] [WARN ] [MAIN ] RCD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:08:25.513379] [INFO ] [MAIN ] RCD: Wiping existing primary data before full refresh. [2025-09-16T20:08:25.572480] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-09-16T20:08:25.610138] [DEBUG] [LOCAL ] RCD: Deleted primary data file. [2025-09-16T20:08:25.630847] [INFO ] [MAIN ] RCD: Starting full primary refresh. [2025-09-16T20:08:25.875391] [DEBUG] [VALIDATOR ] RBLX: All expected trading days are present. [2025-09-16T20:08:25.907409] [DEBUG] [VALIDATOR ] RBLX: Primary data validation passed. [2025-09-16T20:08:25.979454] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-06. [2025-09-16T20:08:25.973442] [INFO ] [MAIN ] RBLX: Fetched primary data is valid. [2025-09-16T20:08:25.996733] [DEBUG] [LOCAL ] RBLX: Saving primary data. [2025-09-16T20:08:26.065974] [DEBUG] [LOCAL ] RBLX: Trimmed 58402 records to 40082 (keeping 150 days of data) [2025-09-16T20:08:26.086473] [INFO ] [REMOTE ] RCD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:08:26.333686] [DEBUG] [LOCAL ] RBLX: Primary data saved (40082 records). [2025-09-16T20:08:26.333819] [INFO ] [MAIN ] RBLX: Full history saved. [2025-09-16T20:08:26.335026] [INFO ] [MAIN ] Update Progress: 1774/2369 symbols completed. RBLX took 39.5s. Estimated remaining: 1h 3m 11s. Rate: 9.4 symbols/min [2025-09-16T20:08:26.508906] [INFO ] [MAIN ] RCI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:08:26.547398] [DEBUG] [LOCAL ] RCI: Loaded 35754 existing records from primary storage. [2025-09-16T20:08:26.547571] [INFO ] [MAIN ] RCI: Loaded 35754 existing records. [2025-09-16T20:08:26.726816] [WARN ] [MAIN ] RCI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:08:26.727088] [INFO ] [MAIN ] RCI: Wiping existing primary data before full refresh. [2025-09-16T20:08:26.727133] [INFO ] [LOCAL ] RCI: Starting deletion of primary data. [2025-09-16T20:08:26.727987] [DEBUG] [LOCAL ] RCI: Deleted primary data file. [2025-09-16T20:08:26.728042] [INFO ] [MAIN ] RCI: Starting full primary refresh. [2025-09-16T20:08:26.792725] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-02. [2025-09-16T20:08:27.091152] [INFO ] [REMOTE ] RCI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:08:27.275606] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-16T20:08:27.289665] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-16T20:08:27.574900] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-06. [2025-09-16T20:08:27.630812] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-16T20:08:28.374904] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-03. [2025-09-16T20:08:28.888144] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-16T20:08:29.174910] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-04. [2025-09-16T20:08:29.644735] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-16T20:08:29.688894] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-16T20:08:29.974921] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-07. [2025-09-16T20:08:30.774904] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-05. [2025-09-16T20:08:31.307121] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-16T20:08:31.586838] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-07. [2025-09-16T20:08:31.592471] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-16T20:08:32.374898] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-02. [2025-09-16T20:08:33.174881] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-08. [2025-09-16T20:08:33.677953] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-16T20:08:33.951358] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-16T20:08:33.974857] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-03. [2025-09-16T20:08:34.689479] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-16T20:08:34.774857] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-09. [2025-09-16T20:08:35.574876] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-08. [2025-09-16T20:08:35.641366] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-16T20:08:36.374909] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-06. [2025-09-16T20:08:36.559529] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-16T20:08:36.565461] [INFO ] [REMOTE ] RC: Full fetch complete (53412 records). [2025-09-16T20:08:36.565555] [DEBUG] [VALIDATOR ] RC: Validating primary data. [2025-09-16T20:08:36.984600] [DEBUG] [VALIDATOR ] RC: All expected trading days are present. [2025-09-16T20:08:36.985100] [DEBUG] [VALIDATOR ] RC: Primary data validation passed. [2025-09-16T20:08:36.986143] [INFO ] [MAIN ] RC: Fetched primary data is valid. [2025-09-16T20:08:36.986268] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-16T20:08:36.986383] [DEBUG] [LOCAL ] RC: Saving primary data. [2025-09-16T20:08:36.988990] [DEBUG] [LOCAL ] RC: Trimmed 53412 records to 36064 (keeping 150 days of data) [2025-09-16T20:08:37.181551] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-04. [2025-09-16T20:08:37.210519] [DEBUG] [LOCAL ] RC: Primary data saved (36064 records). [2025-09-16T20:08:37.210675] [INFO ] [MAIN ] RC: Full history saved. [2025-09-16T20:08:37.210777] [INFO ] [MAIN ] Update Progress: 1775/2369 symbols completed. RC took 30.6s. Estimated remaining: 1h 3m 6s. Rate: 9.4 symbols/min [2025-09-16T20:08:37.383017] [INFO ] [MAIN ] RCL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:08:37.420225] [DEBUG] [LOCAL ] RCL: Loaded 38346 existing records from primary storage. [2025-09-16T20:08:37.420398] [INFO ] [MAIN ] RCL: Loaded 38346 existing records. [2025-09-16T20:08:37.601620] [WARN ] [MAIN ] RCL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:08:37.601925] [INFO ] [MAIN ] RCL: Wiping existing primary data before full refresh. [2025-09-16T20:08:37.602049] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-09-16T20:08:37.603170] [DEBUG] [LOCAL ] RCL: Deleted primary data file. [2025-09-16T20:08:37.603221] [INFO ] [MAIN ] RCL: Starting full primary refresh. [2025-09-16T20:08:37.791310] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-16T20:08:37.976669] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-09. [2025-09-16T20:08:38.012082] [INFO ] [REMOTE ] RCL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:08:38.774914] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-02. [2025-09-16T20:08:38.902497] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-16T20:08:39.574925] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-07. [2025-09-16T20:08:40.044453] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-16T20:08:40.050712] [INFO ] [REMOTE ] RBRK: Full fetch complete (57569 records). [2025-09-16T20:08:40.050812] [DEBUG] [VALIDATOR ] RBRK: Validating primary data. [2025-09-16T20:08:40.155281] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-16T20:08:40.385222] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-05. [2025-09-16T20:08:40.443236] [DEBUG] [VALIDATOR ] RBRK: All expected trading days are present. [2025-09-16T20:08:40.443349] [DEBUG] [VALIDATOR ] RBRK: Primary data validation passed. [2025-09-16T20:08:40.444481] [INFO ] [MAIN ] RBRK: Fetched primary data is valid. [2025-09-16T20:08:40.444689] [DEBUG] [LOCAL ] RBRK: Saving primary data. [2025-09-16T20:08:40.446326] [DEBUG] [LOCAL ] RBRK: Trimmed 57569 records to 39640 (keeping 150 days of data) [2025-09-16T20:08:40.567268] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-16T20:08:40.732316] [DEBUG] [LOCAL ] RBRK: Primary data saved (39640 records). [2025-09-16T20:08:40.732481] [INFO ] [MAIN ] RBRK: Full history saved. [2025-09-16T20:08:40.732599] [INFO ] [MAIN ] Update Progress: 1776/2369 symbols completed. RBRK took 35.6s. Estimated remaining: 1h 2m 59s. Rate: 9.4 symbols/min [2025-09-16T20:08:40.903704] [INFO ] [MAIN ] RCS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:08:40.912684] [DEBUG] [LOCAL ] RCS: Loaded 8371 existing records from primary storage. [2025-09-16T20:08:40.912795] [INFO ] [MAIN ] RCS: Loaded 8371 existing records. [2025-09-16T20:08:41.086010] [WARN ] [MAIN ] RCS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:08:41.086247] [INFO ] [MAIN ] RCS: Wiping existing primary data before full refresh. [2025-09-16T20:08:41.086292] [INFO ] [LOCAL ] RCS: Starting deletion of primary data. [2025-09-16T20:08:41.086624] [DEBUG] [LOCAL ] RCS: Deleted primary data file. [2025-09-16T20:08:41.086698] [INFO ] [MAIN ] RCS: Starting full primary refresh. [2025-09-16T20:08:41.184881] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-03. [2025-09-16T20:08:41.443968] [INFO ] [REMOTE ] RCS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:08:41.974953] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-02. [2025-09-16T20:08:42.244341] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-16T20:08:42.774927] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-06. [2025-09-16T20:08:42.967208] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-16T20:08:43.354360] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-16T20:08:43.574914] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-04. [2025-09-16T20:08:44.186726] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-16T20:08:44.374923] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-03. [2025-09-16T20:08:45.173179] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-16T20:08:45.176214] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-04. [2025-09-16T20:08:45.602609] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-16T20:08:45.818141] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-16T20:08:45.974913] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-05. [2025-09-16T20:08:46.611323] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-16T20:08:46.774906] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-08. [2025-09-16T20:08:47.338032] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-16T20:08:47.574915] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-09. [2025-09-16T20:08:48.197564] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-16T20:08:48.198735] [INFO ] [REMOTE ] RCD: Full fetch complete (4507 records). [2025-09-16T20:08:48.198831] [DEBUG] [VALIDATOR ] RCD: Validating primary data. [2025-09-16T20:08:48.382029] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-06. [2025-09-16T20:08:48.577175] [DEBUG] [VALIDATOR ] RCD: All expected trading days are present. [2025-09-16T20:08:48.577252] [DEBUG] [VALIDATOR ] RCD: Primary data validation passed. [2025-09-16T20:08:48.577398] [INFO ] [MAIN ] RCD: Fetched primary data is valid. [2025-09-16T20:08:48.577448] [DEBUG] [LOCAL ] RCD: Saving primary data. [2025-09-16T20:08:48.577850] [DEBUG] [LOCAL ] RCD: Trimmed 4507 records to 2583 (keeping 150 days of data) [2025-09-16T20:08:48.593884] [DEBUG] [LOCAL ] RCD: Primary data saved (2583 records). [2025-09-16T20:08:48.593987] [INFO ] [MAIN ] RCD: Full history saved. [2025-09-16T20:08:48.594113] [INFO ] [MAIN ] Update Progress: 1777/2369 symbols completed. RCD took 23.7s. Estimated remaining: 1h 2m 53s. Rate: 9.4 symbols/min [2025-09-16T20:08:48.777829] [INFO ] [MAIN ] RCUS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:08:48.811470] [DEBUG] [LOCAL ] RCUS: Loaded 31419 existing records from primary storage. [2025-09-16T20:08:48.811636] [INFO ] [MAIN ] RCUS: Loaded 31419 existing records. [2025-09-16T20:08:48.994071] [WARN ] [MAIN ] RCUS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:08:48.994329] [INFO ] [MAIN ] RCUS: Wiping existing primary data before full refresh. [2025-09-16T20:08:48.994377] [INFO ] [LOCAL ] RCUS: Starting deletion of primary data. [2025-09-16T20:08:48.995177] [DEBUG] [LOCAL ] RCUS: Deleted primary data file. [2025-09-16T20:08:48.995241] [INFO ] [MAIN ] RCUS: Starting full primary refresh. [2025-09-16T20:08:49.180248] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-07. [2025-09-16T20:08:49.376067] [INFO ] [REMOTE ] RCUS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:08:49.385602] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-16T20:08:49.974904] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-02. [2025-09-16T20:08:50.774953] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-05. [2025-09-16T20:08:51.046993] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-16T20:08:51.186923] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-16T20:08:51.574976] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-08. [2025-09-16T20:08:52.374978] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-03. [2025-09-16T20:08:52.691796] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-16T20:08:53.174946] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-07. [2025-09-16T20:08:53.208893] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-16T20:08:53.913867] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-16T20:08:53.952399] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-16T20:08:53.974927] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-09. [2025-09-16T20:08:54.774953] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-08. [2025-09-16T20:08:55.541159] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-16T20:08:55.549431] [INFO ] [REMOTE ] RCI: Full fetch complete (52943 records). [2025-09-16T20:08:55.549749] [DEBUG] [VALIDATOR ] RCI: Validating primary data. [2025-09-16T20:08:55.583610] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-04. [2025-09-16T20:08:55.682534] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-16T20:08:55.964347] [DEBUG] [VALIDATOR ] RCI: All expected trading days are present. [2025-09-16T20:08:55.964483] [DEBUG] [VALIDATOR ] RCI: Primary data validation passed. [2025-09-16T20:08:55.965449] [INFO ] [MAIN ] RCI: Fetched primary data is valid. [2025-09-16T20:08:55.965507] [DEBUG] [LOCAL ] RCI: Saving primary data. [2025-09-16T20:08:55.966864] [DEBUG] [LOCAL ] RCI: Trimmed 52943 records to 36083 (keeping 150 days of data) [2025-09-16T20:08:56.186800] [DEBUG] [LOCAL ] RCI: Primary data saved (36083 records). [2025-09-16T20:08:56.186949] [INFO ] [MAIN ] RCI: Full history saved. [2025-09-16T20:08:56.187581] [INFO ] [MAIN ] Update Progress: 1778/2369 symbols completed. RCI took 29.9s. Estimated remaining: 1h 2m 47s. Rate: 9.4 symbols/min [2025-09-16T20:08:56.356555] [INFO ] [MAIN ] RDDT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:08:56.380365] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-09. [2025-09-16T20:08:56.398552] [DEBUG] [LOCAL ] RDDT: Loaded 39748 existing records from primary storage. [2025-09-16T20:08:56.398728] [INFO ] [MAIN ] RDDT: Loaded 39748 existing records. [2025-09-16T20:08:56.574050] [WARN ] [MAIN ] RDDT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:08:56.574300] [INFO ] [MAIN ] RDDT: Wiping existing primary data before full refresh. [2025-09-16T20:08:56.574346] [INFO ] [LOCAL ] RDDT: Starting deletion of primary data. [2025-09-16T20:08:56.575454] [DEBUG] [LOCAL ] RDDT: Deleted primary data file. [2025-09-16T20:08:56.575505] [INFO ] [MAIN ] RDDT: Starting full primary refresh. [2025-09-16T20:08:56.927972] [INFO ] [REMOTE ] RDDT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:08:57.174865] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-02. [2025-09-16T20:08:57.229151] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-16T20:08:57.270263] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-16T20:08:57.272240] [INFO ] [REMOTE ] RCS: Full fetch complete (12848 records). [2025-09-16T20:08:57.272309] [DEBUG] [VALIDATOR ] RCS: Validating primary data. [2025-09-16T20:08:57.640064] [DEBUG] [VALIDATOR ] RCS: All expected trading days are present. [2025-09-16T20:08:57.640140] [DEBUG] [VALIDATOR ] RCS: Primary data validation passed. [2025-09-16T20:08:57.640488] [INFO ] [MAIN ] RCS: Fetched primary data is valid. [2025-09-16T20:08:57.640534] [DEBUG] [LOCAL ] RCS: Saving primary data. [2025-09-16T20:08:57.641028] [DEBUG] [LOCAL ] RCS: Trimmed 12848 records to 8493 (keeping 150 days of data) [2025-09-16T20:08:57.691939] [DEBUG] [LOCAL ] RCS: Primary data saved (8493 records). [2025-09-16T20:08:57.692108] [INFO ] [MAIN ] RCS: Full history saved. [2025-09-16T20:08:57.692202] [INFO ] [MAIN ] Update Progress: 1779/2369 symbols completed. RCS took 17.0s. Estimated remaining: 1h 2m 39s. Rate: 9.4 symbols/min [2025-09-16T20:08:57.865139] [INFO ] [MAIN ] RDN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:08:57.897980] [DEBUG] [LOCAL ] RDN: Loaded 32335 existing records from primary storage. [2025-09-16T20:08:57.898135] [INFO ] [MAIN ] RDN: Loaded 32335 existing records. [2025-09-16T20:08:57.979978] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-05. [2025-09-16T20:08:58.084229] [WARN ] [MAIN ] RDN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:08:58.084504] [INFO ] [MAIN ] RDN: Wiping existing primary data before full refresh. [2025-09-16T20:08:58.084552] [INFO ] [LOCAL ] RDN: Starting deletion of primary data. [2025-09-16T20:08:58.085395] [DEBUG] [LOCAL ] RDN: Deleted primary data file. [2025-09-16T20:08:58.085446] [INFO ] [MAIN ] RDN: Starting full primary refresh. [2025-09-16T20:08:58.444696] [INFO ] [REMOTE ] RDN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:08:58.774913] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-06. [2025-09-16T20:08:59.574894] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-02. [2025-09-16T20:08:59.634501] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-09-16T20:08:59.718834] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-16T20:09:00.374918] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-03. [2025-09-16T20:09:00.509154] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-16T20:09:01.187481] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-07. [2025-09-16T20:09:01.190226] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-16T20:09:01.974938] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-06. [2025-09-16T20:09:02.774905] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-03. [2025-09-16T20:09:03.129335] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-03 (2.75 seconds). [2025-09-16T20:09:03.203103] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-16T20:09:03.511463] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-16T20:09:03.574856] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-07. [2025-09-16T20:09:04.276510] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-16T20:09:04.374972] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-08. [2025-09-16T20:09:04.946236] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-16T20:09:05.174944] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-08. [2025-09-16T20:09:05.974905] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-04. [2025-09-16T20:09:06.401055] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-16T20:09:06.774940] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-04. [2025-09-16T20:09:06.904005] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-16T20:09:07.574934] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-09. [2025-09-16T20:09:08.201248] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-16T20:09:08.374885] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-05. [2025-09-16T20:09:08.406488] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-16T20:09:09.174906] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-09. [2025-09-16T20:09:09.580426] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-16T20:09:09.586629] [INFO ] [REMOTE ] RCL: Full fetch complete (56820 records). [2025-09-16T20:09:09.586790] [DEBUG] [VALIDATOR ] RCL: Validating primary data. [2025-09-16T20:09:09.971158] [DEBUG] [VALIDATOR ] RCL: All expected trading days are present. [2025-09-16T20:09:09.971239] [DEBUG] [VALIDATOR ] RCL: Primary data validation passed. [2025-09-16T20:09:09.972152] [INFO ] [MAIN ] RCL: Fetched primary data is valid. [2025-09-16T20:09:09.972197] [DEBUG] [LOCAL ] RCL: Saving primary data. [2025-09-16T20:09:09.973468] [DEBUG] [LOCAL ] RCL: Trimmed 56820 records to 38736 (keeping 150 days of data) [2025-09-16T20:09:09.974961] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-05. [2025-09-16T20:09:10.222127] [DEBUG] [LOCAL ] RCL: Primary data saved (38736 records). [2025-09-16T20:09:10.222318] [INFO ] [MAIN ] RCL: Full history saved. [2025-09-16T20:09:10.222472] [INFO ] [MAIN ] Update Progress: 1780/2369 symbols completed. RCL took 33.0s. Estimated remaining: 1h 2m 35s. Rate: 9.4 symbols/min [2025-09-16T20:09:10.398081] [INFO ] [MAIN ] RDW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:09:10.436078] [DEBUG] [LOCAL ] RDW: Loaded 38426 existing records from primary storage. [2025-09-16T20:09:10.436274] [INFO ] [MAIN ] RDW: Loaded 38426 existing records. [2025-09-16T20:09:10.616275] [WARN ] [MAIN ] RDW: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:09:10.616569] [INFO ] [MAIN ] RDW: Wiping existing primary data before full refresh. [2025-09-16T20:09:10.616618] [INFO ] [LOCAL ] RDW: Starting deletion of primary data. [2025-09-16T20:09:10.617604] [DEBUG] [LOCAL ] RDW: Deleted primary data file. [2025-09-16T20:09:10.617706] [INFO ] [MAIN ] RDW: Starting full primary refresh. [2025-09-16T20:09:10.931221] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-16T20:09:10.985400] [INFO ] [REMOTE ] RCUS: Full fetch complete (46818 records). [2025-09-16T20:09:11.014293] [DEBUG] [VALIDATOR ] RCUS: Validating primary data. [2025-09-16T20:09:11.014200] [INFO ] [REMOTE ] RDW: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:09:11.014582] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-02. [2025-09-16T20:09:11.401241] [DEBUG] [VALIDATOR ] RCUS: All expected trading days are present. [2025-09-16T20:09:11.401445] [DEBUG] [VALIDATOR ] RCUS: Primary data validation passed. [2025-09-16T20:09:11.402600] [INFO ] [MAIN ] RCUS: Fetched primary data is valid. [2025-09-16T20:09:11.402729] [DEBUG] [LOCAL ] RCUS: Saving primary data. [2025-09-16T20:09:11.404685] [DEBUG] [LOCAL ] RCUS: Trimmed 46818 records to 31661 (keeping 150 days of data) [2025-09-16T20:09:11.580713] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-05 (3.21 seconds). [2025-09-16T20:09:11.665577] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-06. [2025-09-16T20:09:11.701227] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-16T20:09:11.719780] [DEBUG] [LOCAL ] RCUS: Primary data saved (31661 records). [2025-09-16T20:09:11.719899] [INFO ] [MAIN ] RCUS: Full history saved. [2025-09-16T20:09:11.720001] [INFO ] [MAIN ] Update Progress: 1781/2369 symbols completed. RCUS took 23.1s. Estimated remaining: 1h 2m 27s. Rate: 9.4 symbols/min [2025-09-16T20:09:11.893217] [INFO ] [MAIN ] RDY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:09:11.926107] [DEBUG] [LOCAL ] RDY: Loaded 34394 existing records from primary storage. [2025-09-16T20:09:11.926252] [INFO ] [MAIN ] RDY: Loaded 34394 existing records. [2025-09-16T20:09:12.101685] [WARN ] [MAIN ] RDY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:09:12.101942] [INFO ] [MAIN ] RDY: Wiping existing primary data before full refresh. [2025-09-16T20:09:12.102003] [INFO ] [LOCAL ] RDY: Starting deletion of primary data. [2025-09-16T20:09:12.102932] [DEBUG] [LOCAL ] RDY: Deleted primary data file. [2025-09-16T20:09:12.102982] [INFO ] [MAIN ] RDY: Starting full primary refresh. [2025-09-16T20:09:12.380468] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-06. [2025-09-16T20:09:12.459738] [INFO ] [REMOTE ] RDY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:09:13.174946] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-02. [2025-09-16T20:09:13.238293] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-09-16T20:09:13.974908] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-03. [2025-09-16T20:09:14.022408] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-16T20:09:14.142597] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-09-16T20:09:14.780856] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-07. [2025-09-16T20:09:14.798629] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-16T20:09:15.574923] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-07. [2025-09-16T20:09:16.276265] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-16T20:09:16.371366] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-16T20:09:16.380680] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-04. [2025-09-16T20:09:17.174928] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-03. [2025-09-16T20:09:17.974923] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-08. [2025-09-16T20:09:18.113989] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-09-16T20:09:18.404731] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-16T20:09:18.774934] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-08. [2025-09-16T20:09:18.881406] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-16T20:09:19.033412] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-16T20:09:19.574909] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-04. [2025-09-16T20:09:20.374905] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-05. [2025-09-16T20:09:21.174913] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-09. [2025-09-16T20:09:21.291886] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-16T20:09:21.437608] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-08 (2.66 seconds). [2025-09-16T20:09:21.974911] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-09. [2025-09-16T20:09:22.444056] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-16T20:09:22.448834] [INFO ] [REMOTE ] RDN: Full fetch complete (49448 records). [2025-09-16T20:09:22.448956] [DEBUG] [VALIDATOR ] RDN: Validating primary data. [2025-09-16T20:09:22.776344] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-05. [2025-09-16T20:09:22.878700] [DEBUG] [VALIDATOR ] RDN: All expected trading days are present. [2025-09-16T20:09:22.860478] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-09-16T20:09:22.882633] [DEBUG] [VALIDATOR ] RDN: Primary data validation passed. [2025-09-16T20:09:22.890609] [INFO ] [MAIN ] RDN: Fetched primary data is valid. [2025-09-16T20:09:22.891223] [DEBUG] [LOCAL ] RDN: Saving primary data. [2025-09-16T20:09:22.892623] [DEBUG] [LOCAL ] RDN: Trimmed 49448 records to 32603 (keeping 150 days of data) [2025-09-16T20:09:23.101040] [DEBUG] [LOCAL ] RDN: Primary data saved (32603 records). [2025-09-16T20:09:23.101193] [INFO ] [MAIN ] RDN: Full history saved. [2025-09-16T20:09:23.101319] [INFO ] [MAIN ] Update Progress: 1782/2369 symbols completed. RDN took 25.4s. Estimated remaining: 1h 2m 22s. Rate: 9.4 symbols/min [2025-09-16T20:09:23.272190] [INFO ] [MAIN ] RELX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:09:23.311869] [DEBUG] [LOCAL ] RELX: Loaded 35632 existing records from primary storage. [2025-09-16T20:09:23.312010] [INFO ] [MAIN ] RELX: Loaded 35632 existing records. [2025-09-16T20:09:23.488073] [WARN ] [MAIN ] RELX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:09:23.488322] [INFO ] [MAIN ] RELX: Wiping existing primary data before full refresh. [2025-09-16T20:09:23.488368] [INFO ] [LOCAL ] RELX: Starting deletion of primary data. [2025-09-16T20:09:23.489261] [DEBUG] [LOCAL ] RELX: Deleted primary data file. [2025-09-16T20:09:23.489321] [INFO ] [MAIN ] RELX: Starting full primary refresh. [2025-09-16T20:09:23.583260] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-06. [2025-09-16T20:09:23.860296] [INFO ] [REMOTE ] RELX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:09:24.374914] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-02. [2025-09-16T20:09:24.395658] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-09-16T20:09:24.402883] [INFO ] [REMOTE ] RDDT: Full fetch complete (58461 records). [2025-09-16T20:09:24.403007] [DEBUG] [VALIDATOR ] RDDT: Validating primary data. [2025-09-16T20:09:24.785086] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-16T20:09:24.827130] [DEBUG] [VALIDATOR ] RDDT: All expected trading days are present. [2025-09-16T20:09:24.827201] [DEBUG] [VALIDATOR ] RDDT: Primary data validation passed. [2025-09-16T20:09:24.828143] [INFO ] [MAIN ] RDDT: Fetched primary data is valid. [2025-09-16T20:09:24.828190] [DEBUG] [LOCAL ] RDDT: Saving primary data. [2025-09-16T20:09:24.829523] [DEBUG] [LOCAL ] RDDT: Trimmed 58461 records to 40138 (keeping 150 days of data) [2025-09-16T20:09:25.089917] [DEBUG] [LOCAL ] RDDT: Primary data saved (40138 records). [2025-09-16T20:09:25.090049] [INFO ] [MAIN ] RDDT: Full history saved. [2025-09-16T20:09:25.090772] [INFO ] [MAIN ] Update Progress: 1783/2369 symbols completed. RDDT took 28.9s. Estimated remaining: 1h 2m 14s. Rate: 9.4 symbols/min [2025-09-16T20:09:25.182419] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-06. [2025-09-16T20:09:25.266465] [INFO ] [MAIN ] RERE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:09:25.296016] [DEBUG] [LOCAL ] RERE: Loaded 30441 existing records from primary storage. [2025-09-16T20:09:25.296156] [INFO ] [MAIN ] RERE: Loaded 30441 existing records. [2025-09-16T20:09:25.472666] [WARN ] [MAIN ] RERE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:09:25.473000] [INFO ] [MAIN ] RERE: Wiping existing primary data before full refresh. [2025-09-16T20:09:25.473139] [INFO ] [LOCAL ] RERE: Starting deletion of primary data. [2025-09-16T20:09:25.473826] [DEBUG] [LOCAL ] RERE: Deleted primary data file. [2025-09-16T20:09:25.473893] [INFO ] [MAIN ] RERE: Starting full primary refresh. [2025-09-16T20:09:25.841599] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-09-16T20:09:25.860288] [INFO ] [REMOTE ] RERE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:09:25.968393] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-16T20:09:25.976142] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-02. [2025-09-16T20:09:26.774922] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-03. [2025-09-16T20:09:26.867077] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-16T20:09:27.464066] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-16T20:09:27.574911] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-03. [2025-09-16T20:09:28.374886] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-07. [2025-09-16T20:09:28.458821] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-16T20:09:28.565616] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-16T20:09:29.174893] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-07. [2025-09-16T20:09:29.733722] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-16T20:09:29.974902] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-04. [2025-09-16T20:09:30.774936] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-08. [2025-09-16T20:09:31.556746] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-16T20:09:31.574849] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-05. [2025-09-16T20:09:31.698588] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-09-16T20:09:31.939944] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-16T20:09:32.374897] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-08. [2025-09-16T20:09:32.998255] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-16T20:09:33.174871] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-06. [2025-09-16T20:09:33.974911] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-09. [2025-09-16T20:09:34.480256] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-16T20:09:34.519064] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-16T20:09:34.774899] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-09. [2025-09-16T20:09:35.486636] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-16T20:09:35.492695] [INFO ] [REMOTE ] RDY: Full fetch complete (51493 records). [2025-09-16T20:09:35.492815] [DEBUG] [VALIDATOR ] RDY: Validating primary data. [2025-09-16T20:09:35.580097] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-07. [2025-09-16T20:09:35.877187] [DEBUG] [VALIDATOR ] RDY: All expected trading days are present. [2025-09-16T20:09:35.877271] [DEBUG] [VALIDATOR ] RDY: Primary data validation passed. [2025-09-16T20:09:35.878298] [INFO ] [MAIN ] RDY: Fetched primary data is valid. [2025-09-16T20:09:35.878348] [DEBUG] [LOCAL ] RDY: Saving primary data. [2025-09-16T20:09:35.879571] [DEBUG] [LOCAL ] RDY: Trimmed 51493 records to 34693 (keeping 150 days of data) [2025-09-16T20:09:36.103419] [DEBUG] [LOCAL ] RDY: Primary data saved (34693 records). [2025-09-16T20:09:36.103580] [INFO ] [MAIN ] RDY: Full history saved. [2025-09-16T20:09:36.103717] [INFO ] [MAIN ] Update Progress: 1784/2369 symbols completed. RDY took 24.4s. Estimated remaining: 1h 2m 9s. Rate: 9.4 symbols/min [2025-09-16T20:09:36.318337] [INFO ] [MAIN ] RES: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:09:36.356471] [DEBUG] [LOCAL ] RES: Loaded 34685 existing records from primary storage. [2025-09-16T20:09:36.356669] [INFO ] [MAIN ] RES: Loaded 34685 existing records. [2025-09-16T20:09:36.388745] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-04. [2025-09-16T20:09:36.540218] [WARN ] [MAIN ] RES: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:09:36.540489] [INFO ] [MAIN ] RES: Wiping existing primary data before full refresh. [2025-09-16T20:09:36.540537] [INFO ] [LOCAL ] RES: Starting deletion of primary data. [2025-09-16T20:09:36.541278] [DEBUG] [LOCAL ] RES: Deleted primary data file. [2025-09-16T20:09:36.541327] [INFO ] [MAIN ] RES: Starting full primary refresh. [2025-09-16T20:09:36.896410] [INFO ] [REMOTE ] RES: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:09:36.914463] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-16T20:09:36.921871] [INFO ] [REMOTE ] RDW: Full fetch complete (56524 records). [2025-09-16T20:09:36.922039] [DEBUG] [VALIDATOR ] RDW: Validating primary data. [2025-09-16T20:09:37.183796] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-02. [2025-09-16T20:09:37.331882] [DEBUG] [VALIDATOR ] RDW: All expected trading days are present. [2025-09-16T20:09:37.331979] [DEBUG] [VALIDATOR ] RDW: Primary data validation passed. [2025-09-16T20:09:37.333016] [INFO ] [MAIN ] RDW: Fetched primary data is valid. [2025-09-16T20:09:37.333065] [DEBUG] [LOCAL ] RDW: Saving primary data. [2025-09-16T20:09:37.334553] [DEBUG] [LOCAL ] RDW: Trimmed 56524 records to 38815 (keeping 150 days of data) [2025-09-16T20:09:37.490165] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-16T20:09:37.613397] [DEBUG] [LOCAL ] RDW: Primary data saved (38815 records). [2025-09-16T20:09:37.613547] [INFO ] [MAIN ] RDW: Full history saved. [2025-09-16T20:09:37.613657] [INFO ] [MAIN ] Update Progress: 1785/2369 symbols completed. RDW took 27.4s. Estimated remaining: 1h 2m 1s. Rate: 9.4 symbols/min [2025-09-16T20:09:37.783854] [INFO ] [MAIN ] REVG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:09:37.813335] [DEBUG] [LOCAL ] REVG: Loaded 29937 existing records from primary storage. [2025-09-16T20:09:37.813496] [INFO ] [MAIN ] REVG: Loaded 29937 existing records. [2025-09-16T20:09:37.986090] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-08. [2025-09-16T20:09:37.990630] [WARN ] [MAIN ] REVG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:09:37.991539] [INFO ] [MAIN ] REVG: Wiping existing primary data before full refresh. [2025-09-16T20:09:37.991588] [INFO ] [LOCAL ] REVG: Starting deletion of primary data. [2025-09-16T20:09:37.992289] [DEBUG] [LOCAL ] REVG: Deleted primary data file. [2025-09-16T20:09:37.992340] [INFO ] [MAIN ] REVG: Starting full primary refresh. [2025-09-16T20:09:38.350243] [INFO ] [REMOTE ] REVG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:09:38.378135] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-16T20:09:38.423268] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-16T20:09:38.774915] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-05. [2025-09-16T20:09:39.574927] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-03. [2025-09-16T20:09:39.747236] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-16T20:09:40.374945] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-09. [2025-09-16T20:09:40.470340] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-16T20:09:41.174959] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-06. [2025-09-16T20:09:41.387233] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-16T20:09:41.931403] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-16T20:09:41.937193] [INFO ] [REMOTE ] RERE: Full fetch complete (44066 records). [2025-09-16T20:09:41.937324] [DEBUG] [VALIDATOR ] RERE: Validating primary data. [2025-09-16T20:09:41.984048] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-04. [2025-09-16T20:09:42.317854] [DEBUG] [VALIDATOR ] RERE: All expected trading days are present. [2025-09-16T20:09:42.317940] [DEBUG] [VALIDATOR ] RERE: Primary data validation passed. [2025-09-16T20:09:42.318751] [INFO ] [MAIN ] RERE: Fetched primary data is valid. [2025-09-16T20:09:42.318796] [DEBUG] [LOCAL ] RERE: Saving primary data. [2025-09-16T20:09:42.319873] [DEBUG] [LOCAL ] RERE: Trimmed 44066 records to 30764 (keeping 150 days of data) [2025-09-16T20:09:42.505337] [DEBUG] [LOCAL ] RERE: Primary data saved (30764 records). [2025-09-16T20:09:42.505490] [INFO ] [MAIN ] RERE: Full history saved. [2025-09-16T20:09:42.505575] [INFO ] [MAIN ] Update Progress: 1786/2369 symbols completed. RERE took 17.4s. Estimated remaining: 1h 1m 55s. Rate: 9.4 symbols/min [2025-09-16T20:09:42.677787] [INFO ] [MAIN ] REX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:09:42.688242] [DEBUG] [LOCAL ] REX: Loaded 9096 existing records from primary storage. [2025-09-16T20:09:42.688382] [INFO ] [MAIN ] REX: Loaded 9096 existing records. [2025-09-16T20:09:42.788567] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-02. [2025-09-16T20:09:42.886178] [WARN ] [MAIN ] REX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:09:42.896064] [INFO ] [MAIN ] REX: Wiping existing primary data before full refresh. [2025-09-16T20:09:42.896155] [INFO ] [LOCAL ] REX: Starting deletion of primary data. [2025-09-16T20:09:42.896774] [DEBUG] [LOCAL ] REX: Deleted primary data file. [2025-09-16T20:09:42.896835] [INFO ] [MAIN ] REX: Starting full primary refresh. [2025-09-16T20:09:42.897755] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-16T20:09:43.261792] [INFO ] [REMOTE ] REX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:09:43.574909] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-07. [2025-09-16T20:09:43.780824] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-16T20:09:43.851842] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-16T20:09:44.374957] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-05. [2025-09-16T20:09:45.021018] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-16T20:09:45.174956] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-02. [2025-09-16T20:09:45.974936] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-03. [2025-09-16T20:09:46.044333] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-16T20:09:46.105764] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-16T20:09:46.774931] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-06. [2025-09-16T20:09:47.571985] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-16T20:09:47.580421] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-03. [2025-09-16T20:09:48.373266] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-16T20:09:48.376770] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-04. [2025-09-16T20:09:48.621890] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-16T20:09:49.174909] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-07. [2025-09-16T20:09:49.937012] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-16T20:09:49.974879] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-05. [2025-09-16T20:09:50.774926] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-08. [2025-09-16T20:09:50.911791] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-16T20:09:51.277512] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-16T20:09:51.574954] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-06. [2025-09-16T20:09:52.374903] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-08. [2025-09-16T20:09:52.601832] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-16T20:09:53.047667] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-16T20:09:53.174902] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-07. [2025-09-16T20:09:53.959697] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-16T20:09:53.974849] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-09. [2025-09-16T20:09:54.592064] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-16T20:09:54.774898] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-04. [2025-09-16T20:09:55.382069] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-16T20:09:55.387632] [INFO ] [REMOTE ] RES: Full fetch complete (51602 records). [2025-09-16T20:09:55.387762] [DEBUG] [VALIDATOR ] RES: Validating primary data. [2025-09-16T20:09:55.580087] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-08. [2025-09-16T20:09:55.767130] [DEBUG] [VALIDATOR ] RES: All expected trading days are present. [2025-09-16T20:09:55.767206] [DEBUG] [VALIDATOR ] RES: Primary data validation passed. [2025-09-16T20:09:55.768079] [INFO ] [MAIN ] RES: Fetched primary data is valid. [2025-09-16T20:09:55.768123] [DEBUG] [LOCAL ] RES: Saving primary data. [2025-09-16T20:09:55.769133] [DEBUG] [LOCAL ] RES: Trimmed 51602 records to 34980 (keeping 150 days of data) [2025-09-16T20:09:55.964116] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-16T20:09:55.992022] [DEBUG] [LOCAL ] RES: Primary data saved (34980 records). [2025-09-16T20:09:55.992120] [INFO ] [MAIN ] RES: Full history saved. [2025-09-16T20:09:55.992204] [INFO ] [MAIN ] Update Progress: 1787/2369 symbols completed. RES took 19.9s. Estimated remaining: 1h 1m 51s. Rate: 9.4 symbols/min [2025-09-16T20:09:56.163971] [INFO ] [MAIN ] REXR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:09:56.200501] [DEBUG] [LOCAL ] REXR: Loaded 38408 existing records from primary storage. [2025-09-16T20:09:56.200679] [INFO ] [MAIN ] REXR: Loaded 38408 existing records. [2025-09-16T20:09:56.374227] [WARN ] [MAIN ] REXR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:09:56.374467] [INFO ] [MAIN ] REXR: Wiping existing primary data before full refresh. [2025-09-16T20:09:56.374514] [INFO ] [LOCAL ] REXR: Starting deletion of primary data. [2025-09-16T20:09:56.374853] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-05. [2025-09-16T20:09:56.375611] [DEBUG] [LOCAL ] REXR: Deleted primary data file. [2025-09-16T20:09:56.375694] [INFO ] [MAIN ] REXR: Starting full primary refresh. [2025-09-16T20:09:56.725061] [INFO ] [REMOTE ] REXR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:09:57.164057] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-16T20:09:57.182124] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-09. [2025-09-16T20:09:57.183754] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-16T20:09:57.974897] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-09. [2025-09-16T20:09:58.774899] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-06. [2025-09-16T20:09:58.878892] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-16T20:09:58.884889] [INFO ] [REMOTE ] RELX: Full fetch complete (51683 records). [2025-09-16T20:09:58.884983] [DEBUG] [VALIDATOR ] RELX: Validating primary data. [2025-09-16T20:09:59.268817] [DEBUG] [VALIDATOR ] RELX: All expected trading days are present. [2025-09-16T20:09:59.268894] [DEBUG] [VALIDATOR ] RELX: Primary data validation passed. [2025-09-16T20:09:59.269746] [INFO ] [MAIN ] RELX: Fetched primary data is valid. [2025-09-16T20:09:59.269789] [DEBUG] [LOCAL ] RELX: Saving primary data. [2025-09-16T20:09:59.270823] [DEBUG] [LOCAL ] RELX: Trimmed 51683 records to 36011 (keeping 150 days of data) [2025-09-16T20:09:59.388301] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-16T20:09:59.510495] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-16T20:09:59.517702] [INFO ] [REMOTE ] REVG: Full fetch complete (44603 records). [2025-09-16T20:09:59.518543] [DEBUG] [VALIDATOR ] REVG: Validating primary data. [2025-09-16T20:09:59.583869] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-07. [2025-09-16T20:09:59.833871] [DEBUG] [LOCAL ] RELX: Primary data saved (36011 records). [2025-09-16T20:09:59.834285] [INFO ] [MAIN ] RELX: Full history saved. [2025-09-16T20:09:59.839685] [INFO ] [MAIN ] Update Progress: 1788/2369 symbols completed. RELX took 36.7s. Estimated remaining: 1h 1m 43s. Rate: 9.4 symbols/min [2025-09-16T20:10:00.036313] [DEBUG] [VALIDATOR ] REVG: All expected trading days are present. [2025-09-16T20:10:00.046597] [DEBUG] [VALIDATOR ] REVG: Primary data validation passed. [2025-09-16T20:10:00.073373] [INFO ] [MAIN ] REVG: Fetched primary data is valid. [2025-09-16T20:10:00.091517] [INFO ] [MAIN ] REZI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:10:00.091575] [DEBUG] [LOCAL ] REVG: Saving primary data. [2025-09-16T20:10:00.093106] [DEBUG] [LOCAL ] REVG: Trimmed 44603 records to 30284 (keeping 150 days of data) [2025-09-16T20:10:00.237359] [DEBUG] [LOCAL ] REZI: Loaded 34450 existing records from primary storage. [2025-09-16T20:10:00.237505] [INFO ] [MAIN ] REZI: Loaded 34450 existing records. [2025-09-16T20:10:00.380055] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-02. [2025-09-16T20:10:00.475947] [WARN ] [MAIN ] REZI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:10:00.477406] [INFO ] [MAIN ] REZI: Wiping existing primary data before full refresh. [2025-09-16T20:10:00.477810] [INFO ] [LOCAL ] REZI: Starting deletion of primary data. [2025-09-16T20:10:00.480450] [DEBUG] [LOCAL ] REZI: Deleted primary data file. [2025-09-16T20:10:00.480910] [INFO ] [MAIN ] REZI: Starting full primary refresh. [2025-09-16T20:10:00.519148] [DEBUG] [LOCAL ] REVG: Primary data saved (30284 records). [2025-09-16T20:10:00.559264] [INFO ] [MAIN ] REVG: Full history saved. [2025-09-16T20:10:00.571511] [INFO ] [MAIN ] Update Progress: 1789/2369 symbols completed. REVG took 23.0s. Estimated remaining: 1h 1m 35s. Rate: 9.4 symbols/min [2025-09-16T20:10:00.566304] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-16T20:10:00.932238] [INFO ] [MAIN ] RF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:10:01.018373] [INFO ] [REMOTE ] REZI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:10:01.048450] [DEBUG] [LOCAL ] RF: Loaded 39593 existing records from primary storage. [2025-09-16T20:10:01.048592] [INFO ] [MAIN ] RF: Loaded 39593 existing records. [2025-09-16T20:10:01.180068] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-02. [2025-09-16T20:10:01.237453] [WARN ] [MAIN ] RF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:10:01.237753] [INFO ] [MAIN ] RF: Wiping existing primary data before full refresh. [2025-09-16T20:10:01.237819] [INFO ] [LOCAL ] RF: Starting deletion of primary data. [2025-09-16T20:10:01.238670] [DEBUG] [LOCAL ] RF: Deleted primary data file. [2025-09-16T20:10:01.238735] [INFO ] [MAIN ] RF: Starting full primary refresh. [2025-09-16T20:10:01.608730] [INFO ] [REMOTE ] RF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:10:01.975145] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-02. [2025-09-16T20:10:02.148122] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-16T20:10:02.775093] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-03. [2025-09-16T20:10:02.809736] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-16T20:10:03.574972] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-03. [2025-09-16T20:10:03.783786] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-16T20:10:04.374898] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-08. [2025-09-16T20:10:04.677968] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-16T20:10:05.092129] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-16T20:10:05.132774] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-16T20:10:05.174922] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-09. [2025-09-16T20:10:05.974912] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-04. [2025-09-16T20:10:06.298124] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-16T20:10:06.300266] [INFO ] [REMOTE ] REX: Full fetch complete (14899 records). [2025-09-16T20:10:06.300338] [DEBUG] [VALIDATOR ] REX: Validating primary data. [2025-09-16T20:10:06.669236] [DEBUG] [VALIDATOR ] REX: All expected trading days are present. [2025-09-16T20:10:06.669319] [DEBUG] [VALIDATOR ] REX: Primary data validation passed. [2025-09-16T20:10:06.669694] [INFO ] [MAIN ] REX: Fetched primary data is valid. [2025-09-16T20:10:06.669739] [DEBUG] [LOCAL ] REX: Saving primary data. [2025-09-16T20:10:06.670257] [DEBUG] [LOCAL ] REX: Trimmed 14899 records to 9297 (keeping 150 days of data) [2025-09-16T20:10:06.725431] [DEBUG] [LOCAL ] REX: Primary data saved (9297 records). [2025-09-16T20:10:06.725559] [INFO ] [MAIN ] REX: Full history saved. [2025-09-16T20:10:06.725658] [INFO ] [MAIN ] Update Progress: 1790/2369 symbols completed. REX took 24.2s. Estimated remaining: 1h 1m 29s. Rate: 9.4 symbols/min [2025-09-16T20:10:06.783862] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-03. [2025-09-16T20:10:06.912268] [INFO ] [MAIN ] RFI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:10:06.921365] [DEBUG] [LOCAL ] RFI: Loaded 7712 existing records from primary storage. [2025-09-16T20:10:06.921455] [INFO ] [MAIN ] RFI: Loaded 7712 existing records. [2025-09-16T20:10:07.101720] [WARN ] [MAIN ] RFI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:10:07.102017] [INFO ] [MAIN ] RFI: Wiping existing primary data before full refresh. [2025-09-16T20:10:07.102066] [INFO ] [LOCAL ] RFI: Starting deletion of primary data. [2025-09-16T20:10:07.102384] [DEBUG] [LOCAL ] RFI: Deleted primary data file. [2025-09-16T20:10:07.102429] [INFO ] [MAIN ] RFI: Starting full primary refresh. [2025-09-16T20:10:07.480247] [INFO ] [REMOTE ] RFI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:10:07.574913] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-04. [2025-09-16T20:10:07.727718] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-16T20:10:08.340161] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-16T20:10:08.374879] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-04. [2025-09-16T20:10:09.093271] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-16T20:10:09.174889] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-05. [2025-09-16T20:10:09.974872] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-02. [2025-09-16T20:10:10.372744] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-16T20:10:10.767229] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-16T20:10:10.774846] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-03. [2025-09-16T20:10:11.042741] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-16T20:10:11.309308] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-16T20:10:11.574906] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-04. [2025-09-16T20:10:12.374890] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-06. [2025-09-16T20:10:12.413505] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-16T20:10:13.174914] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-05. [2025-09-16T20:10:13.974913] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-05. [2025-09-16T20:10:14.020942] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-16T20:10:14.773475] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-16T20:10:14.783746] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-07. [2025-09-16T20:10:15.535400] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-16T20:10:15.574846] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-06. [2025-09-16T20:10:16.374924] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-06. [2025-09-16T20:10:16.626283] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-16T20:10:17.169672] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-16T20:10:17.178465] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-05. [2025-09-16T20:10:17.830038] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-16T20:10:17.974912] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-08. [2025-09-16T20:10:18.084730] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-16T20:10:18.774917] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-06. [2025-09-16T20:10:19.228419] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-16T20:10:19.574908] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-09. [2025-09-16T20:10:19.641338] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-16T20:10:20.374920] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-07. [2025-09-16T20:10:21.174905] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-07. [2025-09-16T20:10:21.274982] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-16T20:10:21.281576] [INFO ] [REMOTE ] REXR: Full fetch complete (56396 records). [2025-09-16T20:10:21.281718] [DEBUG] [VALIDATOR ] REXR: Validating primary data. [2025-09-16T20:10:21.677821] [DEBUG] [VALIDATOR ] REXR: All expected trading days are present. [2025-09-16T20:10:21.678046] [DEBUG] [VALIDATOR ] REXR: Primary data validation passed. [2025-09-16T20:10:21.679049] [INFO ] [MAIN ] REXR: Fetched primary data is valid. [2025-09-16T20:10:21.679678] [DEBUG] [LOCAL ] REXR: Saving primary data. [2025-09-16T20:10:21.680978] [DEBUG] [LOCAL ] REXR: Trimmed 56396 records to 38785 (keeping 150 days of data) [2025-09-16T20:10:21.921030] [DEBUG] [LOCAL ] REXR: Primary data saved (38785 records). [2025-09-16T20:10:21.921191] [INFO ] [MAIN ] REXR: Full history saved. [2025-09-16T20:10:21.921299] [INFO ] [MAIN ] Update Progress: 1791/2369 symbols completed. REXR took 25.9s. Estimated remaining: 1h 1m 25s. Rate: 9.4 symbols/min [2025-09-16T20:10:21.985104] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-07. [2025-09-16T20:10:22.100152] [INFO ] [MAIN ] RFL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:10:22.142501] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-16T20:10:22.146689] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-16T20:10:22.164783] [DEBUG] [LOCAL ] RFL: Loaded 9000 existing records from primary storage. [2025-09-16T20:10:22.165566] [INFO ] [MAIN ] RFL: Loaded 9000 existing records. [2025-09-16T20:10:22.338814] [WARN ] [MAIN ] RFL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:10:22.339110] [INFO ] [MAIN ] RFL: Wiping existing primary data before full refresh. [2025-09-16T20:10:22.339156] [INFO ] [LOCAL ] RFL: Starting deletion of primary data. [2025-09-16T20:10:22.339594] [DEBUG] [LOCAL ] RFL: Deleted primary data file. [2025-09-16T20:10:22.339639] [INFO ] [MAIN ] RFL: Starting full primary refresh. [2025-09-16T20:10:22.684584] [INFO ] [REMOTE ] RFL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:10:22.774861] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-02. [2025-09-16T20:10:23.304699] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-16T20:10:23.574891] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-08. [2025-09-16T20:10:24.056675] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-16T20:10:24.374895] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-08. [2025-09-16T20:10:25.174881] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-08. [2025-09-16T20:10:25.249335] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-16T20:10:25.789795] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-16T20:10:25.974901] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-09. [2025-09-16T20:10:25.989900] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-16T20:10:26.774907] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-09. [2025-09-16T20:10:27.574918] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-03. [2025-09-16T20:10:27.661575] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-16T20:10:27.673741] [INFO ] [REMOTE ] REZI: Full fetch complete (50520 records). [2025-09-16T20:10:27.674421] [DEBUG] [VALIDATOR ] REZI: Validating primary data. [2025-09-16T20:10:27.674672] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-16T20:10:27.720691] [INFO ] [REMOTE ] RFI: Full fetch complete (11428 records). [2025-09-16T20:10:27.747112] [DEBUG] [VALIDATOR ] RFI: Validating primary data. [2025-09-16T20:10:28.102459] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-16T20:10:28.375795] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-09. [2025-09-16T20:10:28.472393] [DEBUG] [VALIDATOR ] REZI: All expected trading days are present. [2025-09-16T20:10:28.478736] [DEBUG] [VALIDATOR ] REZI: Primary data validation passed. [2025-09-16T20:10:28.478893] [DEBUG] [VALIDATOR ] RFI: All expected trading days are present. [2025-09-16T20:10:28.479950] [INFO ] [MAIN ] REZI: Fetched primary data is valid. [2025-09-16T20:10:28.480024] [DEBUG] [VALIDATOR ] RFI: Primary data validation passed. [2025-09-16T20:10:28.480104] [DEBUG] [LOCAL ] REZI: Saving primary data. [2025-09-16T20:10:28.480341] [INFO ] [MAIN ] RFI: Fetched primary data is valid. [2025-09-16T20:10:28.480420] [DEBUG] [LOCAL ] RFI: Saving primary data. [2025-09-16T20:10:28.481845] [DEBUG] [LOCAL ] RFI: Trimmed 11428 records to 7806 (keeping 150 days of data) [2025-09-16T20:10:28.482676] [DEBUG] [LOCAL ] REZI: Trimmed 50520 records to 34828 (keeping 150 days of data) [2025-09-16T20:10:28.712874] [DEBUG] [LOCAL ] RFI: Primary data saved (7806 records). [2025-09-16T20:10:28.721252] [INFO ] [MAIN ] RFI: Full history saved. [2025-09-16T20:10:28.723721] [INFO ] [MAIN ] Update Progress: 1792/2369 symbols completed. RFI took 22.0s. Estimated remaining: 1h 1m 19s. Rate: 9.4 symbols/min [2025-09-16T20:10:28.858142] [DEBUG] [LOCAL ] REZI: Primary data saved (34828 records). [2025-09-16T20:10:28.868507] [INFO ] [MAIN ] REZI: Full history saved. [2025-09-16T20:10:28.883061] [INFO ] [MAIN ] Update Progress: 1793/2369 symbols completed. REZI took 29.0s. Estimated remaining: 1h 1m 11s. Rate: 9.4 symbols/min [2025-09-16T20:10:28.994051] [INFO ] [MAIN ] RFM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:10:29.100068] [DEBUG] [LOCAL ] RFM: Loaded 2869 existing records from primary storage. [2025-09-16T20:10:29.102513] [INFO ] [MAIN ] RFMZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:10:29.102688] [INFO ] [MAIN ] RFM: Loaded 2869 existing records. [2025-09-16T20:10:29.183735] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-04. [2025-09-16T20:10:29.260924] [DEBUG] [LOCAL ] RFMZ: Loaded 6003 existing records from primary storage. [2025-09-16T20:10:29.288291] [INFO ] [MAIN ] RFMZ: Loaded 6003 existing records. [2025-09-16T20:10:29.288218] [WARN ] [MAIN ] RFM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:10:29.392204] [INFO ] [MAIN ] RFM: Wiping existing primary data before full refresh. [2025-09-16T20:10:29.392365] [INFO ] [LOCAL ] RFM: Starting deletion of primary data. [2025-09-16T20:10:29.392691] [DEBUG] [LOCAL ] RFM: Deleted primary data file. [2025-09-16T20:10:29.403140] [INFO ] [MAIN ] RFM: Starting full primary refresh. [2025-09-16T20:10:29.554816] [WARN ] [MAIN ] RFMZ: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:10:29.576227] [INFO ] [MAIN ] RFMZ: Wiping existing primary data before full refresh. [2025-09-16T20:10:29.576535] [INFO ] [LOCAL ] RFMZ: Starting deletion of primary data. [2025-09-16T20:10:29.597478] [DEBUG] [LOCAL ] RFMZ: Deleted primary data file. [2025-09-16T20:10:29.621530] [INFO ] [MAIN ] RFMZ: Starting full primary refresh. [2025-09-16T20:10:30.080020] [INFO ] [REMOTE ] RFM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:10:30.093457] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-02. [2025-09-16T20:10:30.099481] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-16T20:10:30.199598] [INFO ] [REMOTE ] RFMZ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:10:30.233005] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-16T20:10:30.239288] [INFO ] [REMOTE ] RF: Full fetch complete (58308 records). [2025-09-16T20:10:30.239392] [DEBUG] [VALIDATOR ] RF: Validating primary data. [2025-09-16T20:10:30.636581] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-16T20:10:30.639397] [DEBUG] [VALIDATOR ] RF: All expected trading days are present. [2025-09-16T20:10:30.640687] [DEBUG] [VALIDATOR ] RF: Primary data validation passed. [2025-09-16T20:10:30.641595] [INFO ] [MAIN ] RF: Fetched primary data is valid. [2025-09-16T20:10:30.641659] [DEBUG] [LOCAL ] RF: Saving primary data. [2025-09-16T20:10:30.642814] [DEBUG] [LOCAL ] RF: Trimmed 58308 records to 39983 (keeping 150 days of data) [2025-09-16T20:10:30.823245] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-05. [2025-09-16T20:10:30.894359] [DEBUG] [LOCAL ] RF: Primary data saved (39983 records). [2025-09-16T20:10:30.894527] [INFO ] [MAIN ] RF: Full history saved. [2025-09-16T20:10:30.894614] [INFO ] [MAIN ] Update Progress: 1794/2369 symbols completed. RF took 30.3s. Estimated remaining: 1h 1m 3s. Rate: 9.4 symbols/min [2025-09-16T20:10:31.067684] [INFO ] [MAIN ] RGA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:10:31.089125] [DEBUG] [LOCAL ] RGA: Loaded 21089 existing records from primary storage. [2025-09-16T20:10:31.089283] [INFO ] [MAIN ] RGA: Loaded 21089 existing records. [2025-09-16T20:10:31.265665] [WARN ] [MAIN ] RGA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:10:31.265948] [INFO ] [MAIN ] RGA: Wiping existing primary data before full refresh. [2025-09-16T20:10:31.265995] [INFO ] [LOCAL ] RGA: Starting deletion of primary data. [2025-09-16T20:10:31.266576] [DEBUG] [LOCAL ] RGA: Deleted primary data file. [2025-09-16T20:10:31.266623] [INFO ] [MAIN ] RGA: Starting full primary refresh. [2025-09-16T20:10:31.583852] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-03. [2025-09-16T20:10:31.624579] [INFO ] [REMOTE ] RGA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:10:31.671835] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-16T20:10:32.081634] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-16T20:10:32.374889] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-02. [2025-09-16T20:10:33.174941] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-04. [2025-09-16T20:10:33.786147] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-16T20:10:33.892175] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-16T20:10:33.974922] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-05. [2025-09-16T20:10:34.509169] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-16T20:10:34.774940] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-03. [2025-09-16T20:10:35.574912] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-06. [2025-09-16T20:10:36.137108] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-16T20:10:36.305354] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-16T20:10:36.374886] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-04. [2025-09-16T20:10:37.174899] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-06. [2025-09-16T20:10:37.794111] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-16T20:10:37.974927] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-02. [2025-09-16T20:10:38.241161] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-16T20:10:38.342732] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-16T20:10:38.774932] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-07. [2025-09-16T20:10:39.533842] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-16T20:10:39.574849] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-08. [2025-09-16T20:10:40.361776] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-16T20:10:40.374838] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-09. [2025-09-16T20:10:41.174952] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-05. [2025-09-16T20:10:41.324291] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-16T20:10:41.326809] [INFO ] [REMOTE ] RFL: Full fetch complete (10562 records). [2025-09-16T20:10:41.326894] [DEBUG] [VALIDATOR ] RFL: Validating primary data. [2025-09-16T20:10:41.688768] [DEBUG] [VALIDATOR ] RFL: All expected trading days are present. [2025-09-16T20:10:41.688852] [DEBUG] [VALIDATOR ] RFL: Primary data validation passed. [2025-09-16T20:10:41.689153] [INFO ] [MAIN ] RFL: Fetched primary data is valid. [2025-09-16T20:10:41.689204] [DEBUG] [LOCAL ] RFL: Saving primary data. [2025-09-16T20:10:41.689750] [DEBUG] [LOCAL ] RFL: Trimmed 10562 records to 9143 (keeping 150 days of data) [2025-09-16T20:10:41.747384] [DEBUG] [LOCAL ] RFL: Primary data saved (9143 records). [2025-09-16T20:10:41.747573] [INFO ] [MAIN ] RFL: Full history saved. [2025-09-16T20:10:41.747694] [INFO ] [MAIN ] Update Progress: 1795/2369 symbols completed. RFL took 19.8s. Estimated remaining: 1h 0m 58s. Rate: 9.4 symbols/min [2025-09-16T20:10:41.920850] [INFO ] [MAIN ] RGR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:10:41.936369] [DEBUG] [LOCAL ] RGR: Loaded 15312 existing records from primary storage. [2025-09-16T20:10:41.936510] [INFO ] [MAIN ] RGR: Loaded 15312 existing records. [2025-09-16T20:10:41.979992] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-03. [2025-09-16T20:10:42.126036] [WARN ] [MAIN ] RGR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:10:42.126505] [INFO ] [MAIN ] RGR: Wiping existing primary data before full refresh. [2025-09-16T20:10:42.126661] [INFO ] [LOCAL ] RGR: Starting deletion of primary data. [2025-09-16T20:10:42.127273] [DEBUG] [LOCAL ] RGR: Deleted primary data file. [2025-09-16T20:10:42.127328] [INFO ] [MAIN ] RGR: Starting full primary refresh. [2025-09-16T20:10:42.413519] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-16T20:10:42.518559] [INFO ] [REMOTE ] RGR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:10:42.774919] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-02. [2025-09-16T20:10:42.791587] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-16T20:10:43.574900] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-07. [2025-09-16T20:10:43.820722] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-16T20:10:43.920192] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-16T20:10:44.374896] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-06. [2025-09-16T20:10:45.174941] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-03. [2025-09-16T20:10:45.387940] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-16T20:10:45.974961] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-08. [2025-09-16T20:10:46.199300] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-16T20:10:46.551552] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-16T20:10:46.774924] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-04. [2025-09-16T20:10:47.574910] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-09. [2025-09-16T20:10:47.674128] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-16T20:10:48.319076] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-16T20:10:48.320302] [INFO ] [REMOTE ] RFM: Full fetch complete (4233 records). [2025-09-16T20:10:48.320390] [DEBUG] [VALIDATOR ] RFM: Validating primary data. [2025-09-16T20:10:48.380971] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-07. [2025-09-16T20:10:48.702194] [DEBUG] [VALIDATOR ] RFM: All expected trading days are present. [2025-09-16T20:10:48.702291] [DEBUG] [VALIDATOR ] RFM: Primary data validation passed. [2025-09-16T20:10:48.702429] [INFO ] [MAIN ] RFM: Fetched primary data is valid. [2025-09-16T20:10:48.702477] [DEBUG] [LOCAL ] RFM: Saving primary data. [2025-09-16T20:10:48.702902] [DEBUG] [LOCAL ] RFM: Trimmed 4233 records to 2907 (keeping 150 days of data) [2025-09-16T20:10:48.721798] [DEBUG] [LOCAL ] RFM: Primary data saved (2907 records). [2025-09-16T20:10:48.721915] [INFO ] [MAIN ] RFM: Full history saved. [2025-09-16T20:10:48.722041] [INFO ] [MAIN ] Update Progress: 1796/2369 symbols completed. RFM took 20.0s. Estimated remaining: 1h 0m 52s. Rate: 9.4 symbols/min [2025-09-16T20:10:48.890743] [INFO ] [MAIN ] RGT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:10:48.894502] [DEBUG] [LOCAL ] RGT: Loaded 1962 existing records from primary storage. [2025-09-16T20:10:48.894602] [INFO ] [MAIN ] RGT: Loaded 1962 existing records. [2025-09-16T20:10:49.071937] [WARN ] [MAIN ] RGT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:10:49.072208] [INFO ] [MAIN ] RGT: Wiping existing primary data before full refresh. [2025-09-16T20:10:49.072255] [INFO ] [LOCAL ] RGT: Starting deletion of primary data. [2025-09-16T20:10:49.072454] [DEBUG] [LOCAL ] RGT: Deleted primary data file. [2025-09-16T20:10:49.072498] [INFO ] [MAIN ] RGT: Starting full primary refresh. [2025-09-16T20:10:49.180033] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-04. [2025-09-16T20:10:49.440474] [INFO ] [REMOTE ] RGT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:10:49.727336] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-16T20:10:49.798691] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-16T20:10:49.974916] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-02. [2025-09-16T20:10:50.427142] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-16T20:10:50.774943] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-05. [2025-09-16T20:10:51.574344] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-16T20:10:51.577320] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-08. [2025-09-16T20:10:52.374928] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-05. [2025-09-16T20:10:53.031682] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-16T20:10:53.174920] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-06. [2025-09-16T20:10:53.501403] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-16T20:10:53.885184] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-16T20:10:53.974922] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-06. [2025-09-16T20:10:54.774904] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-03. [2025-09-16T20:10:55.024792] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-16T20:10:55.390554] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-16T20:10:55.574906] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-04. [2025-09-16T20:10:56.124525] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-16T20:10:56.374991] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-07. [2025-09-16T20:10:57.174975] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-09. [2025-09-16T20:10:57.472104] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-16T20:10:57.974915] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-08. [2025-09-16T20:10:58.449521] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-16T20:10:58.453172] [INFO ] [REMOTE ] RGA: Full fetch complete (33650 records). [2025-09-16T20:10:58.453246] [DEBUG] [VALIDATOR ] RGA: Validating primary data. [2025-09-16T20:10:58.789869] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-07. [2025-09-16T20:10:58.836167] [DEBUG] [VALIDATOR ] RGA: All expected trading days are present. [2025-09-16T20:10:58.836258] [DEBUG] [VALIDATOR ] RGA: Primary data validation passed. [2025-09-16T20:10:58.837030] [INFO ] [MAIN ] RGA: Fetched primary data is valid. [2025-09-16T20:10:58.837080] [DEBUG] [LOCAL ] RGA: Saving primary data. [2025-09-16T20:10:58.838051] [DEBUG] [LOCAL ] RGA: Trimmed 33650 records to 21395 (keeping 150 days of data) [2025-09-16T20:10:58.973508] [DEBUG] [LOCAL ] RGA: Primary data saved (21395 records). [2025-09-16T20:10:58.973658] [INFO ] [MAIN ] RGA: Full history saved. [2025-09-16T20:10:58.973744] [INFO ] [MAIN ] Update Progress: 1797/2369 symbols completed. RGA took 28.1s. Estimated remaining: 1h 0m 47s. Rate: 9.4 symbols/min [2025-09-16T20:10:59.127695] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-16T20:10:59.574906] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-09. [2025-09-16T20:10:59.655033] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-16T20:11:00.374920] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-08. [2025-09-16T20:11:00.811073] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-16T20:11:00.814180] [INFO ] [REMOTE ] RGR: Full fetch complete (21767 records). [2025-09-16T20:11:00.814266] [DEBUG] [VALIDATOR ] RGR: Validating primary data. [2025-09-16T20:11:01.179231] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-05. [2025-09-16T20:11:01.190470] [DEBUG] [VALIDATOR ] RGR: All expected trading days are present. [2025-09-16T20:11:01.196007] [DEBUG] [VALIDATOR ] RGR: Primary data validation passed. [2025-09-16T20:11:01.197057] [INFO ] [MAIN ] RGR: Fetched primary data is valid. [2025-09-16T20:11:01.197360] [DEBUG] [LOCAL ] RGR: Saving primary data. [2025-09-16T20:11:01.197297] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-16T20:11:01.200707] [DEBUG] [LOCAL ] RGR: Trimmed 21767 records to 15556 (keeping 150 days of data) [2025-09-16T20:11:01.296295] [DEBUG] [LOCAL ] RGR: Primary data saved (15556 records). [2025-09-16T20:11:01.296440] [INFO ] [MAIN ] RGR: Full history saved. [2025-09-16T20:11:01.296533] [INFO ] [MAIN ] Update Progress: 1798/2369 symbols completed. RGR took 19.5s. Estimated remaining: 1h 0m 39s. Rate: 9.4 symbols/min [2025-09-16T20:11:01.723129] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-16T20:11:01.974905] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-09. [2025-09-16T20:11:02.773750] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-16T20:11:02.775163] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-06. [2025-09-16T20:11:02.776150] [INFO ] [REMOTE ] RFMZ: Full fetch complete (8937 records). [2025-09-16T20:11:02.777049] [DEBUG] [VALIDATOR ] RFMZ: Validating primary data. [2025-09-16T20:11:03.149788] [DEBUG] [VALIDATOR ] RFMZ: All expected trading days are present. [2025-09-16T20:11:03.149883] [DEBUG] [VALIDATOR ] RFMZ: Primary data validation passed. [2025-09-16T20:11:03.150134] [INFO ] [MAIN ] RFMZ: Fetched primary data is valid. [2025-09-16T20:11:03.150176] [DEBUG] [LOCAL ] RFMZ: Saving primary data. [2025-09-16T20:11:03.150639] [DEBUG] [LOCAL ] RFMZ: Trimmed 8937 records to 6057 (keeping 150 days of data) [2025-09-16T20:11:03.189582] [DEBUG] [LOCAL ] RFMZ: Primary data saved (6057 records). [2025-09-16T20:11:03.189776] [INFO ] [MAIN ] RFMZ: Full history saved. [2025-09-16T20:11:03.189892] [INFO ] [MAIN ] Update Progress: 1799/2369 symbols completed. RFMZ took 34.3s. Estimated remaining: 1h 0m 31s. Rate: 9.4 symbols/min [2025-09-16T20:11:03.293189] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-16T20:11:03.574931] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-07. [2025-09-16T20:11:04.165257] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-16T20:11:04.374922] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-08. [2025-09-16T20:11:04.846574] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-16T20:11:05.174938] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-09. [2025-09-16T20:11:05.683999] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-16T20:11:05.684948] [INFO ] [REMOTE ] RGT: Full fetch complete (3058 records). [2025-09-16T20:11:05.685020] [DEBUG] [VALIDATOR ] RGT: Validating primary data. [2025-09-16T20:11:06.046933] [DEBUG] [VALIDATOR ] RGT: All expected trading days are present. [2025-09-16T20:11:06.047011] [DEBUG] [VALIDATOR ] RGT: Primary data validation passed. [2025-09-16T20:11:06.047132] [INFO ] [MAIN ] RGT: Fetched primary data is valid. [2025-09-16T20:11:06.047172] [DEBUG] [LOCAL ] RGT: Saving primary data. [2025-09-16T20:11:06.047538] [DEBUG] [LOCAL ] RGT: Trimmed 3058 records to 1979 (keeping 150 days of data) [2025-09-16T20:11:06.059901] [DEBUG] [LOCAL ] RGT: Primary data saved (1979 records). [2025-09-16T20:11:06.059972] [INFO ] [MAIN ] RGT: Full history saved. [2025-09-16T20:11:06.060044] [INFO ] [MAIN ] Update Progress: 1800/2369 symbols completed. RGT took 17.3s. Estimated remaining: 1h 0m 24s. Rate: 9.4 symbols/min [2025-09-16T20:11:06.661735] [INFO ] [MAIN ] RHP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:11:06.612373] [INFO ] [MAIN ] RHI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:11:06.723371] [INFO ] [MAIN ] RH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:11:06.784195] [INFO ] [MAIN ] RIG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:11:06.825418] [DEBUG] [LOCAL ] RHP: Loaded 29562 existing records from primary storage. [2025-09-16T20:11:06.825666] [INFO ] [MAIN ] RHP: Loaded 29562 existing records. [2025-09-16T20:11:06.947620] [DEBUG] [LOCAL ] RHI: Loaded 36687 existing records from primary storage. [2025-09-16T20:11:06.963379] [INFO ] [MAIN ] RHI: Loaded 36687 existing records. [2025-09-16T20:11:07.094527] [DEBUG] [LOCAL ] RIG: Loaded 39641 existing records from primary storage. [2025-09-16T20:11:07.146523] [INFO ] [MAIN ] RIG: Loaded 39641 existing records. [2025-09-16T20:11:07.145546] [DEBUG] [LOCAL ] RH: Loaded 34838 existing records from primary storage. [2025-09-16T20:11:07.170575] [INFO ] [MAIN ] RH: Loaded 34838 existing records. [2025-09-16T20:11:07.196874] [WARN ] [MAIN ] RHP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:11:07.325552] [INFO ] [MAIN ] RHP: Wiping existing primary data before full refresh. [2025-09-16T20:11:07.366623] [INFO ] [LOCAL ] RHP: Starting deletion of primary data. [2025-09-16T20:11:07.523452] [DEBUG] [LOCAL ] RHP: Deleted primary data file. [2025-09-16T20:11:07.532490] [WARN ] [MAIN ] RHI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:11:07.617999] [WARN ] [MAIN ] RH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:11:07.617887] [INFO ] [MAIN ] RHI: Wiping existing primary data before full refresh. [2025-09-16T20:11:07.623558] [INFO ] [LOCAL ] RHI: Starting deletion of primary data. [2025-09-16T20:11:07.617735] [INFO ] [MAIN ] RHP: Starting full primary refresh. [2025-09-16T20:11:07.659294] [INFO ] [MAIN ] RH: Wiping existing primary data before full refresh. [2025-09-16T20:11:07.659383] [INFO ] [LOCAL ] RH: Starting deletion of primary data. [2025-09-16T20:11:07.702738] [DEBUG] [LOCAL ] RHI: Deleted primary data file. [2025-09-16T20:11:07.706751] [DEBUG] [LOCAL ] RH: Deleted primary data file. [2025-09-16T20:11:07.711957] [INFO ] [MAIN ] RHI: Starting full primary refresh. [2025-09-16T20:11:07.713699] [INFO ] [MAIN ] RH: Starting full primary refresh. [2025-09-16T20:11:07.759400] [WARN ] [MAIN ] RIG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:11:07.937545] [INFO ] [MAIN ] RIG: Wiping existing primary data before full refresh. [2025-09-16T20:11:07.973976] [INFO ] [LOCAL ] RIG: Starting deletion of primary data. [2025-09-16T20:11:08.068466] [DEBUG] [LOCAL ] RIG: Deleted primary data file. [2025-09-16T20:11:08.174370] [INFO ] [MAIN ] RIG: Starting full primary refresh. [2025-09-16T20:11:08.713497] [INFO ] [REMOTE ] RHI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:11:08.783931] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-02. [2025-09-16T20:11:08.961543] [INFO ] [REMOTE ] RHP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:11:08.999899] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-02. [2025-09-16T20:11:09.038042] [INFO ] [REMOTE ] RH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:11:09.049971] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-02. [2025-09-16T20:11:09.141422] [INFO ] [REMOTE ] RIG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:11:09.141731] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-02. [2025-09-16T20:11:10.531460] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-16T20:11:10.538809] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-03. [2025-09-16T20:11:10.560287] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-16T20:11:10.567761] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-03. [2025-09-16T20:11:10.628217] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-16T20:11:10.703844] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-16T20:11:10.774857] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-03. [2025-09-16T20:11:11.574962] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-03. [2025-09-16T20:11:12.222960] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-16T20:11:12.374894] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-04. [2025-09-16T20:11:12.433070] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-16T20:11:13.023017] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-09-16T20:11:13.116670] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-16T20:11:13.174886] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-04. [2025-09-16T20:11:13.974900] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-04. [2025-09-16T20:11:14.131763] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-16T20:11:14.774897] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-05. [2025-09-16T20:11:15.164636] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-16T20:11:15.574921] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-05. [2025-09-16T20:11:16.068720] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-16T20:11:16.382638] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-04. [2025-09-16T20:11:16.386142] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-16T20:11:17.174878] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-05. [2025-09-16T20:11:17.388287] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-16T20:11:17.974913] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-06. [2025-09-16T20:11:18.207898] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-16T20:11:18.774908] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-05. [2025-09-16T20:11:19.071237] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-16T20:11:19.218483] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-16T20:11:19.574905] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-07. [2025-09-16T20:11:20.069711] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-16T20:11:20.374890] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-06. [2025-09-16T20:11:20.705095] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-16T20:11:21.174910] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-08. [2025-09-16T20:11:21.710475] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-16T20:11:21.974896] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-06. [2025-09-16T20:11:22.705051] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-16T20:11:22.774894] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-06. [2025-09-16T20:11:23.559631] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-16T20:11:23.574846] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-07. [2025-09-16T20:11:24.374890] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-09. [2025-09-16T20:11:24.732054] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-16T20:11:25.174911] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-07. [2025-09-16T20:11:25.347960] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-16T20:11:25.781008] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-16T20:11:25.785853] [INFO ] [REMOTE ] RHP: Full fetch complete (45183 records). [2025-09-16T20:11:25.785991] [DEBUG] [VALIDATOR ] RHP: Validating primary data. [2025-09-16T20:11:25.980036] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-08. [2025-09-16T20:11:26.173400] [DEBUG] [VALIDATOR ] RHP: All expected trading days are present. [2025-09-16T20:11:26.173490] [DEBUG] [VALIDATOR ] RHP: Primary data validation passed. [2025-09-16T20:11:26.174500] [INFO ] [MAIN ] RHP: Fetched primary data is valid. [2025-09-16T20:11:26.174579] [DEBUG] [LOCAL ] RHP: Saving primary data. [2025-09-16T20:11:26.175767] [DEBUG] [LOCAL ] RHP: Trimmed 45183 records to 29862 (keeping 150 days of data) [2025-09-16T20:11:26.365255] [DEBUG] [LOCAL ] RHP: Primary data saved (29862 records). [2025-09-16T20:11:26.365475] [INFO ] [MAIN ] RHP: Full history saved. [2025-09-16T20:11:26.366407] [INFO ] [MAIN ] Update Progress: 1801/2369 symbols completed. RHP took 20.3s. Estimated remaining: 1h 0m 22s. Rate: 9.4 symbols/min [2025-09-16T20:11:26.545307] [INFO ] [MAIN ] RIO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:11:26.589141] [DEBUG] [LOCAL ] RIO: Loaded 39386 existing records from primary storage. [2025-09-16T20:11:26.589363] [INFO ] [MAIN ] RIO: Loaded 39386 existing records. [2025-09-16T20:11:26.772379] [WARN ] [MAIN ] RIO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:11:26.772695] [INFO ] [MAIN ] RIO: Wiping existing primary data before full refresh. [2025-09-16T20:11:26.772760] [INFO ] [LOCAL ] RIO: Starting deletion of primary data. [2025-09-16T20:11:26.773819] [DEBUG] [LOCAL ] RIO: Deleted primary data file. [2025-09-16T20:11:26.773892] [INFO ] [MAIN ] RIO: Starting full primary refresh. [2025-09-16T20:11:26.806771] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-07. [2025-09-16T20:11:27.149325] [INFO ] [REMOTE ] RIO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:11:27.184909] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-16T20:11:27.574889] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-08. [2025-09-16T20:11:27.660438] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-16T20:11:28.374889] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-09. [2025-09-16T20:11:28.714085] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-16T20:11:29.172848] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-16T20:11:29.183706] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-08. [2025-09-16T20:11:29.974893] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-02. [2025-09-16T20:11:30.064023] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-16T20:11:30.069599] [INFO ] [REMOTE ] RH: Full fetch complete (51233 records). [2025-09-16T20:11:30.069736] [DEBUG] [VALIDATOR ] RH: Validating primary data. [2025-09-16T20:11:30.454836] [DEBUG] [VALIDATOR ] RH: All expected trading days are present. [2025-09-16T20:11:30.454914] [DEBUG] [VALIDATOR ] RH: Primary data validation passed. [2025-09-16T20:11:30.455782] [INFO ] [MAIN ] RH: Fetched primary data is valid. [2025-09-16T20:11:30.455828] [DEBUG] [LOCAL ] RH: Saving primary data. [2025-09-16T20:11:30.456875] [DEBUG] [LOCAL ] RH: Trimmed 51233 records to 35174 (keeping 150 days of data) [2025-09-16T20:11:30.683440] [DEBUG] [LOCAL ] RH: Primary data saved (35174 records). [2025-09-16T20:11:30.683633] [INFO ] [MAIN ] RH: Full history saved. [2025-09-16T20:11:30.683759] [INFO ] [MAIN ] Update Progress: 1802/2369 symbols completed. RH took 24.6s. Estimated remaining: 1h 0m 15s. Rate: 9.4 symbols/min [2025-09-16T20:11:30.781078] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-09. [2025-09-16T20:11:30.855332] [INFO ] [MAIN ] RITM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:11:30.894499] [DEBUG] [LOCAL ] RITM: Loaded 38979 existing records from primary storage. [2025-09-16T20:11:30.894742] [INFO ] [MAIN ] RITM: Loaded 38979 existing records. [2025-09-16T20:11:31.099061] [WARN ] [MAIN ] RITM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:11:31.099471] [INFO ] [MAIN ] RITM: Wiping existing primary data before full refresh. [2025-09-16T20:11:31.099911] [INFO ] [LOCAL ] RITM: Starting deletion of primary data. [2025-09-16T20:11:31.100992] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-16T20:11:31.110910] [DEBUG] [LOCAL ] RITM: Deleted primary data file. [2025-09-16T20:11:31.111091] [INFO ] [MAIN ] RITM: Starting full primary refresh. [2025-09-16T20:11:31.464214] [INFO ] [REMOTE ] RITM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:11:31.574884] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-09. [2025-09-16T20:11:31.950792] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-16T20:11:32.374896] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-03. [2025-09-16T20:11:32.591169] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-16T20:11:32.598149] [INFO ] [REMOTE ] RIG: Full fetch complete (58352 records). [2025-09-16T20:11:32.598311] [DEBUG] [VALIDATOR ] RIG: Validating primary data. [2025-09-16T20:11:32.987290] [DEBUG] [VALIDATOR ] RIG: All expected trading days are present. [2025-09-16T20:11:32.987623] [DEBUG] [VALIDATOR ] RIG: Primary data validation passed. [2025-09-16T20:11:32.988887] [INFO ] [MAIN ] RIG: Fetched primary data is valid. [2025-09-16T20:11:32.988980] [DEBUG] [LOCAL ] RIG: Saving primary data. [2025-09-16T20:11:32.996352] [DEBUG] [LOCAL ] RIG: Trimmed 58352 records to 40031 (keeping 150 days of data) [2025-09-16T20:11:33.006909] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-16T20:11:33.013134] [INFO ] [REMOTE ] RHI: Full fetch complete (53436 records). [2025-09-16T20:11:33.013264] [DEBUG] [VALIDATOR ] RHI: Validating primary data. [2025-09-16T20:11:33.194566] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-02. [2025-09-16T20:11:33.543975] [DEBUG] [VALIDATOR ] RHI: All expected trading days are present. [2025-09-16T20:11:33.544459] [DEBUG] [VALIDATOR ] RHI: Primary data validation passed. [2025-09-16T20:11:33.546111] [INFO ] [MAIN ] RHI: Fetched primary data is valid. [2025-09-16T20:11:33.546506] [DEBUG] [LOCAL ] RHI: Saving primary data. [2025-09-16T20:11:33.554158] [DEBUG] [LOCAL ] RHI: Trimmed 53436 records to 37038 (keeping 150 days of data) [2025-09-16T20:11:33.846850] [DEBUG] [LOCAL ] RIG: Primary data saved (40031 records). [2025-09-16T20:11:33.854633] [INFO ] [MAIN ] RIG: Full history saved. [2025-09-16T20:11:33.854780] [INFO ] [MAIN ] Update Progress: 1803/2369 symbols completed. RIG took 27.8s. Estimated remaining: 1h 0m 7s. Rate: 9.4 symbols/min [2025-09-16T20:11:34.061094] [INFO ] [MAIN ] RIV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:11:34.074338] [DEBUG] [LOCAL ] RIV: Loaded 8646 existing records from primary storage. [2025-09-16T20:11:34.075043] [INFO ] [MAIN ] RIV: Loaded 8646 existing records. [2025-09-16T20:11:34.260451] [WARN ] [MAIN ] RIV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:11:34.264806] [INFO ] [MAIN ] RIV: Wiping existing primary data before full refresh. [2025-09-16T20:11:34.265275] [INFO ] [LOCAL ] RIV: Starting deletion of primary data. [2025-09-16T20:11:34.266739] [DEBUG] [LOCAL ] RIV: Deleted primary data file. [2025-09-16T20:11:34.267114] [INFO ] [MAIN ] RIV: Starting full primary refresh. [2025-09-16T20:11:34.373631] [DEBUG] [LOCAL ] RHI: Primary data saved (37038 records). [2025-09-16T20:11:34.379390] [INFO ] [MAIN ] RHI: Full history saved. [2025-09-16T20:11:34.384595] [INFO ] [MAIN ] Update Progress: 1804/2369 symbols completed. RHI took 28.3s. Estimated remaining: 59m 59s. Rate: 9.4 symbols/min [2025-09-16T20:11:34.760366] [INFO ] [MAIN ] RJF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:11:34.837417] [INFO ] [REMOTE ] RIV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:11:34.837889] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-02. [2025-09-16T20:11:34.886806] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-09-16T20:11:34.899550] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-04. [2025-09-16T20:11:34.912875] [DEBUG] [LOCAL ] RJF: Loaded 33970 existing records from primary storage. [2025-09-16T20:11:34.913008] [INFO ] [MAIN ] RJF: Loaded 33970 existing records. [2025-09-16T20:11:35.098573] [WARN ] [MAIN ] RJF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:11:35.099095] [INFO ] [MAIN ] RJF: Wiping existing primary data before full refresh. [2025-09-16T20:11:35.099160] [INFO ] [LOCAL ] RJF: Starting deletion of primary data. [2025-09-16T20:11:35.099934] [DEBUG] [LOCAL ] RJF: Deleted primary data file. [2025-09-16T20:11:35.099989] [INFO ] [MAIN ] RJF: Starting full primary refresh. [2025-09-16T20:11:35.286457] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-16T20:11:35.503494] [INFO ] [REMOTE ] RJF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:11:35.574870] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-02. [2025-09-16T20:11:35.657248] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-16T20:11:36.374912] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-03. [2025-09-16T20:11:37.137909] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-16T20:11:37.180015] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-03. [2025-09-16T20:11:37.191989] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-16T20:11:37.208279] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-16T20:11:37.974984] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-04. [2025-09-16T20:11:38.774896] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-03. [2025-09-16T20:11:38.875751] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-16T20:11:39.044201] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-16T20:11:39.574945] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-05. [2025-09-16T20:11:40.374912] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-05. [2025-09-16T20:11:40.565566] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-16T20:11:41.160377] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-16T20:11:41.174867] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-04. [2025-09-16T20:11:41.280537] [DEBUG] [REMOTE ] RITM: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-09-16T20:11:41.280892] [WARN ] [REMOTE ] RITM: No data returned for month 2025-04 [2025-09-16T20:11:41.704874] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-16T20:11:41.974917] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-05. [2025-09-16T20:11:42.774930] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-06. [2025-09-16T20:11:43.462983] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-16T20:11:43.540969] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-16T20:11:43.574935] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-07. [2025-09-16T20:11:44.374946] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-06. [2025-09-16T20:11:44.426912] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-16T20:11:45.174945] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-04. [2025-09-16T20:11:45.974961] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-08. [2025-09-16T20:11:46.204276] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-16T20:11:46.774926] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-06. [2025-09-16T20:11:46.877305] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-16T20:11:46.952673] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-16T20:11:47.574922] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-07. [2025-09-16T20:11:48.374937] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-09. [2025-09-16T20:11:48.812561] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-16T20:11:49.175026] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-07. [2025-09-16T20:11:49.579599] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-16T20:11:49.602760] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-16T20:11:49.607204] [INFO ] [REMOTE ] RIV: Full fetch complete (12395 records). [2025-09-16T20:11:49.607344] [DEBUG] [VALIDATOR ] RIV: Validating primary data. [2025-09-16T20:11:49.980035] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-08. [2025-09-16T20:11:50.025726] [DEBUG] [VALIDATOR ] RIV: All expected trading days are present. [2025-09-16T20:11:50.025827] [DEBUG] [VALIDATOR ] RIV: Primary data validation passed. [2025-09-16T20:11:50.026227] [INFO ] [MAIN ] RIV: Fetched primary data is valid. [2025-09-16T20:11:50.026311] [DEBUG] [LOCAL ] RIV: Saving primary data. [2025-09-16T20:11:50.027083] [DEBUG] [LOCAL ] RIV: Trimmed 12395 records to 8780 (keeping 150 days of data) [2025-09-16T20:11:50.085444] [DEBUG] [LOCAL ] RIV: Primary data saved (8780 records). [2025-09-16T20:11:50.085607] [INFO ] [MAIN ] RIV: Full history saved. [2025-09-16T20:11:50.085721] [INFO ] [MAIN ] Update Progress: 1805/2369 symbols completed. RIV took 16.2s. Estimated remaining: 59m 56s. Rate: 9.4 symbols/min [2025-09-16T20:11:50.295017] [INFO ] [MAIN ] RKT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:11:50.336621] [DEBUG] [LOCAL ] RKT: Loaded 39690 existing records from primary storage. [2025-09-16T20:11:50.336840] [INFO ] [MAIN ] RKT: Loaded 39690 existing records. [2025-09-16T20:11:50.516466] [WARN ] [MAIN ] RKT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:11:50.516752] [INFO ] [MAIN ] RKT: Wiping existing primary data before full refresh. [2025-09-16T20:11:50.516808] [INFO ] [LOCAL ] RKT: Starting deletion of primary data. [2025-09-16T20:11:50.517565] [DEBUG] [LOCAL ] RKT: Deleted primary data file. [2025-09-16T20:11:50.517611] [INFO ] [MAIN ] RKT: Starting full primary refresh. [2025-09-16T20:11:50.780078] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-05. [2025-09-16T20:11:50.887719] [INFO ] [REMOTE ] RKT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:11:51.222496] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-16T20:11:51.574990] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-08. [2025-09-16T20:11:51.942595] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-16T20:11:52.374966] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-09. [2025-09-16T20:11:52.421410] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-16T20:11:53.174953] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-02. [2025-09-16T20:11:53.589213] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-16T20:11:53.952047] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-16T20:11:53.961096] [INFO ] [REMOTE ] RITM: Full fetch complete (49276 records). [2025-09-16T20:11:53.961358] [DEBUG] [VALIDATOR ] RITM: Validating primary data. [2025-09-16T20:11:53.980124] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-09. [2025-09-16T20:11:54.180816] [WARN ] [VALIDATOR ] RITM: Validation failed - insufficient historical data. Have 129 unique days, need 150 days [2025-09-16T20:11:54.181567] [FATAL] [MAIN ] RITM: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:11:54.181663] [WARN ] [MAIN ] RITM: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:11:54.181758] [INFO ] [LOCAL ] RITM: Starting deletion of primary data. [2025-09-16T20:11:54.181842] [DEBUG] [LOCAL ] RITM: No primary data file found to delete. [2025-09-16T20:11:54.181881] [INFO ] [LOCAL ] RITM: Starting deletion of derivative data. [2025-09-16T20:11:54.182311] [DEBUG] [LOCAL ] RITM: Deleted derivative data file. [2025-09-16T20:11:54.182454] [INFO ] [MAIN ] Update Progress: 1806/2369 symbols completed. RITM took 23.5s. Estimated remaining: 59m 48s. Rate: 9.4 symbols/min [2025-09-16T20:11:54.388627] [INFO ] [MAIN ] RL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:11:54.425438] [DEBUG] [LOCAL ] RL: Loaded 29642 existing records from primary storage. [2025-09-16T20:11:54.425681] [INFO ] [MAIN ] RL: Loaded 29642 existing records. [2025-09-16T20:11:54.637358] [WARN ] [MAIN ] RL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:11:54.637731] [INFO ] [MAIN ] RL: Wiping existing primary data before full refresh. [2025-09-16T20:11:54.637838] [INFO ] [LOCAL ] RL: Starting deletion of primary data. [2025-09-16T20:11:54.638947] [DEBUG] [LOCAL ] RL: Deleted primary data file. [2025-09-16T20:11:54.639011] [INFO ] [MAIN ] RL: Starting full primary refresh. [2025-09-16T20:11:54.777236] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-06. [2025-09-16T20:11:55.033456] [INFO ] [REMOTE ] RL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:11:55.069969] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-16T20:11:55.574919] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-03. [2025-09-16T20:11:56.062424] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-16T20:11:56.070758] [INFO ] [REMOTE ] RIO: Full fetch complete (58059 records). [2025-09-16T20:11:56.071021] [DEBUG] [VALIDATOR ] RIO: Validating primary data. [2025-09-16T20:11:56.377840] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-02. [2025-09-16T20:11:56.510819] [DEBUG] [VALIDATOR ] RIO: All expected trading days are present. [2025-09-16T20:11:56.510938] [DEBUG] [VALIDATOR ] RIO: Primary data validation passed. [2025-09-16T20:11:56.511984] [INFO ] [MAIN ] RIO: Fetched primary data is valid. [2025-09-16T20:11:56.512069] [DEBUG] [LOCAL ] RIO: Saving primary data. [2025-09-16T20:11:56.513725] [DEBUG] [LOCAL ] RIO: Trimmed 58059 records to 39773 (keeping 150 days of data) [2025-09-16T20:11:56.633313] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-16T20:11:56.796778] [DEBUG] [LOCAL ] RIO: Primary data saved (39773 records). [2025-09-16T20:11:56.796936] [INFO ] [MAIN ] RIO: Full history saved. [2025-09-16T20:11:56.797023] [INFO ] [MAIN ] Update Progress: 1807/2369 symbols completed. RIO took 30.4s. Estimated remaining: 59m 41s. Rate: 9.4 symbols/min [2025-09-16T20:11:56.969978] [INFO ] [MAIN ] RLI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:11:56.992496] [DEBUG] [LOCAL ] RLI: Loaded 24791 existing records from primary storage. [2025-09-16T20:11:56.992629] [INFO ] [MAIN ] RLI: Loaded 24791 existing records. [2025-09-16T20:11:57.175145] [WARN ] [MAIN ] RLI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:11:57.175254] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-07. [2025-09-16T20:11:57.176494] [INFO ] [MAIN ] RLI: Wiping existing primary data before full refresh. [2025-09-16T20:11:57.176619] [INFO ] [LOCAL ] RLI: Starting deletion of primary data. [2025-09-16T20:11:57.177261] [DEBUG] [LOCAL ] RLI: Deleted primary data file. [2025-09-16T20:11:57.177328] [INFO ] [MAIN ] RLI: Starting full primary refresh. [2025-09-16T20:11:57.568750] [INFO ] [REMOTE ] RLI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:11:57.571245] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-16T20:11:57.969242] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-16T20:11:57.977069] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-02. [2025-09-16T20:11:58.537323] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-16T20:11:58.774922] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-04. [2025-09-16T20:11:59.299906] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-16T20:11:59.574912] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-03. [2025-09-16T20:12:00.374925] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-03. [2025-09-16T20:12:00.927957] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-16T20:12:01.174910] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-05. [2025-09-16T20:12:01.512162] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-16T20:12:01.843108] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-16T20:12:01.974933] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-08. [2025-09-16T20:12:02.774912] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-04. [2025-09-16T20:12:03.292792] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-16T20:12:03.572040] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-16T20:12:03.575401] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-06. [2025-09-16T20:12:04.374884] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-09. [2025-09-16T20:12:04.712151] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-16T20:12:05.174963] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-05. [2025-09-16T20:12:05.448720] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-16T20:12:05.939140] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-16T20:12:05.944459] [INFO ] [REMOTE ] RJF: Full fetch complete (51446 records). [2025-09-16T20:12:05.944568] [DEBUG] [VALIDATOR ] RJF: Validating primary data. [2025-09-16T20:12:05.979992] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-04. [2025-09-16T20:12:06.321994] [DEBUG] [VALIDATOR ] RJF: All expected trading days are present. [2025-09-16T20:12:06.322090] [DEBUG] [VALIDATOR ] RJF: Primary data validation passed. [2025-09-16T20:12:06.322996] [INFO ] [MAIN ] RJF: Fetched primary data is valid. [2025-09-16T20:12:06.323045] [DEBUG] [LOCAL ] RJF: Saving primary data. [2025-09-16T20:12:06.324311] [DEBUG] [LOCAL ] RJF: Trimmed 51446 records to 34319 (keeping 150 days of data) [2025-09-16T20:12:06.537198] [DEBUG] [LOCAL ] RJF: Primary data saved (34319 records). [2025-09-16T20:12:06.537335] [INFO ] [MAIN ] RJF: Full history saved. [2025-09-16T20:12:06.537421] [INFO ] [MAIN ] Update Progress: 1808/2369 symbols completed. RJF took 32.1s. Estimated remaining: 59m 36s. Rate: 9.4 symbols/min [2025-09-16T20:12:06.711415] [INFO ] [MAIN ] RLJ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:12:06.744851] [DEBUG] [LOCAL ] RLJ: Loaded 35030 existing records from primary storage. [2025-09-16T20:12:06.745010] [INFO ] [MAIN ] RLJ: Loaded 35030 existing records. [2025-09-16T20:12:06.778058] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-07. [2025-09-16T20:12:06.959124] [WARN ] [MAIN ] RLJ: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:12:06.959462] [INFO ] [MAIN ] RLJ: Wiping existing primary data before full refresh. [2025-09-16T20:12:06.959594] [INFO ] [LOCAL ] RLJ: Starting deletion of primary data. [2025-09-16T20:12:06.960250] [DEBUG] [LOCAL ] RLJ: Deleted primary data file. [2025-09-16T20:12:06.960299] [INFO ] [MAIN ] RLJ: Starting full primary refresh. [2025-09-16T20:12:07.110339] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-16T20:12:07.361563] [INFO ] [REMOTE ] RLJ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:12:07.546611] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-16T20:12:07.574899] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-02. [2025-09-16T20:12:08.374912] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-06. [2025-09-16T20:12:08.874076] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-16T20:12:09.080295] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-16T20:12:09.174920] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-08. [2025-09-16T20:12:09.664845] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-16T20:12:09.974908] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-05. [2025-09-16T20:12:10.774902] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-03. [2025-09-16T20:12:11.039331] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-16T20:12:11.489914] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-16T20:12:11.574951] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-06. [2025-09-16T20:12:12.374903] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-09. [2025-09-16T20:12:12.459062] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-16T20:12:12.732281] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-16T20:12:13.174944] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-07. [2025-09-16T20:12:13.974909] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-04. [2025-09-16T20:12:14.726206] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-16T20:12:14.774983] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-07. [2025-09-16T20:12:14.804095] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-09-16T20:12:14.810603] [INFO ] [REMOTE ] RKT: Full fetch complete (58298 records). [2025-09-16T20:12:14.810778] [DEBUG] [VALIDATOR ] RKT: Validating primary data. [2025-09-16T20:12:15.198869] [DEBUG] [VALIDATOR ] RKT: All expected trading days are present. [2025-09-16T20:12:15.198955] [DEBUG] [VALIDATOR ] RKT: Primary data validation passed. [2025-09-16T20:12:15.200005] [INFO ] [MAIN ] RKT: Fetched primary data is valid. [2025-09-16T20:12:15.200065] [DEBUG] [LOCAL ] RKT: Saving primary data. [2025-09-16T20:12:15.201291] [DEBUG] [LOCAL ] RKT: Trimmed 58298 records to 40080 (keeping 150 days of data) [2025-09-16T20:12:15.453531] [DEBUG] [LOCAL ] RKT: Primary data saved (40080 records). [2025-09-16T20:12:15.453876] [INFO ] [MAIN ] RKT: Full history saved. [2025-09-16T20:12:15.455082] [INFO ] [MAIN ] Update Progress: 1809/2369 symbols completed. RKT took 25.4s. Estimated remaining: 59m 30s. Rate: 9.4 symbols/min [2025-09-16T20:12:15.580133] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-08. [2025-09-16T20:12:15.634190] [INFO ] [MAIN ] RLTY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:12:15.645569] [DEBUG] [LOCAL ] RLTY: Loaded 7881 existing records from primary storage. [2025-09-16T20:12:15.645725] [INFO ] [MAIN ] RLTY: Loaded 7881 existing records. [2025-09-16T20:12:15.832607] [WARN ] [MAIN ] RLTY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:12:15.833125] [INFO ] [MAIN ] RLTY: Wiping existing primary data before full refresh. [2025-09-16T20:12:15.833197] [INFO ] [LOCAL ] RLTY: Starting deletion of primary data. [2025-09-16T20:12:15.833770] [DEBUG] [LOCAL ] RLTY: Deleted primary data file. [2025-09-16T20:12:15.833921] [INFO ] [MAIN ] RLTY: Starting full primary refresh. [2025-09-16T20:12:16.122705] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-16T20:12:16.240875] [INFO ] [REMOTE ] RLTY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:12:16.374922] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-02. [2025-09-16T20:12:16.563097] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-16T20:12:17.072399] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-16T20:12:17.174924] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-09. [2025-09-16T20:12:17.340314] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-16T20:12:17.974920] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-08. [2025-09-16T20:12:18.409813] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-16T20:12:18.414204] [INFO ] [REMOTE ] RLI: Full fetch complete (36048 records). [2025-09-16T20:12:18.414287] [DEBUG] [VALIDATOR ] RLI: Validating primary data. [2025-09-16T20:12:18.788832] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-03. [2025-09-16T20:12:18.803031] [DEBUG] [VALIDATOR ] RLI: All expected trading days are present. [2025-09-16T20:12:18.803123] [DEBUG] [VALIDATOR ] RLI: Primary data validation passed. [2025-09-16T20:12:18.803866] [INFO ] [MAIN ] RLI: Fetched primary data is valid. [2025-09-16T20:12:18.803911] [DEBUG] [LOCAL ] RLI: Saving primary data. [2025-09-16T20:12:18.805008] [DEBUG] [LOCAL ] RLI: Trimmed 36048 records to 25044 (keeping 150 days of data) [2025-09-16T20:12:18.966198] [DEBUG] [LOCAL ] RLI: Primary data saved (25044 records). [2025-09-16T20:12:18.966344] [INFO ] [MAIN ] RLI: Full history saved. [2025-09-16T20:12:18.966438] [INFO ] [MAIN ] Update Progress: 1810/2369 symbols completed. RLI took 22.2s. Estimated remaining: 59m 23s. Rate: 9.4 symbols/min [2025-09-16T20:12:19.153439] [INFO ] [MAIN ] RLX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:12:19.186928] [DEBUG] [LOCAL ] RLX: Loaded 35046 existing records from primary storage. [2025-09-16T20:12:19.187072] [INFO ] [MAIN ] RLX: Loaded 35046 existing records. [2025-09-16T20:12:19.371038] [WARN ] [MAIN ] RLX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:12:19.371715] [INFO ] [MAIN ] RLX: Wiping existing primary data before full refresh. [2025-09-16T20:12:19.371769] [INFO ] [LOCAL ] RLX: Starting deletion of primary data. [2025-09-16T20:12:19.372817] [DEBUG] [LOCAL ] RLX: Deleted primary data file. [2025-09-16T20:12:19.372867] [INFO ] [MAIN ] RLX: Starting full primary refresh. [2025-09-16T20:12:19.585389] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-05. [2025-09-16T20:12:19.742722] [INFO ] [REMOTE ] RLX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:12:19.745025] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-16T20:12:19.769597] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-16T20:12:20.374904] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-02. [2025-09-16T20:12:21.173994] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-16T20:12:21.183731] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-04. [2025-09-16T20:12:21.974894] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-09. [2025-09-16T20:12:21.994350] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-16T20:12:22.026843] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-16T20:12:22.774904] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-05. [2025-09-16T20:12:23.528958] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-16T20:12:23.533690] [INFO ] [REMOTE ] RL: Full fetch complete (45630 records). [2025-09-16T20:12:23.533789] [DEBUG] [VALIDATOR ] RL: Validating primary data. [2025-09-16T20:12:23.580198] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-06. [2025-09-16T20:12:23.720145] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-16T20:12:23.943070] [DEBUG] [VALIDATOR ] RL: All expected trading days are present. [2025-09-16T20:12:23.943147] [DEBUG] [VALIDATOR ] RL: Primary data validation passed. [2025-09-16T20:12:23.943987] [INFO ] [MAIN ] RL: Fetched primary data is valid. [2025-09-16T20:12:23.944034] [DEBUG] [LOCAL ] RL: Saving primary data. [2025-09-16T20:12:23.944948] [DEBUG] [LOCAL ] RL: Trimmed 45630 records to 29962 (keeping 150 days of data) [2025-09-16T20:12:24.129944] [DEBUG] [LOCAL ] RL: Primary data saved (29962 records). [2025-09-16T20:12:24.130090] [INFO ] [MAIN ] RL: Full history saved. [2025-09-16T20:12:24.130460] [INFO ] [MAIN ] Update Progress: 1811/2369 symbols completed. RL took 29.9s. Estimated remaining: 59m 16s. Rate: 9.4 symbols/min [2025-09-16T20:12:24.301582] [INFO ] [MAIN ] RM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:12:24.309002] [DEBUG] [LOCAL ] RM: Loaded 5576 existing records from primary storage. [2025-09-16T20:12:24.309140] [INFO ] [MAIN ] RM: Loaded 5576 existing records. [2025-09-16T20:12:24.380024] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-06. [2025-09-16T20:12:24.494759] [WARN ] [MAIN ] RM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:12:24.495005] [INFO ] [MAIN ] RM: Wiping existing primary data before full refresh. [2025-09-16T20:12:24.495052] [INFO ] [LOCAL ] RM: Starting deletion of primary data. [2025-09-16T20:12:24.495320] [DEBUG] [LOCAL ] RM: Deleted primary data file. [2025-09-16T20:12:24.495366] [INFO ] [MAIN ] RM: Starting full primary refresh. [2025-09-16T20:12:24.850817] [INFO ] [REMOTE ] RM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:12:24.975743] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-16T20:12:25.174922] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-02. [2025-09-16T20:12:25.278927] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-16T20:12:25.926511] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-16T20:12:25.974933] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-07. [2025-09-16T20:12:26.774910] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-03. [2025-09-16T20:12:27.390105] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-16T20:12:27.532956] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-16T20:12:27.574854] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-04. [2025-09-16T20:12:28.332222] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-16T20:12:28.374879] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-05. [2025-09-16T20:12:29.174909] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-03. [2025-09-16T20:12:29.201475] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-16T20:12:29.974928] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-06. [2025-09-16T20:12:30.527280] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-16T20:12:30.774916] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-07. [2025-09-16T20:12:31.014799] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-16T20:12:31.511953] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-16T20:12:31.574913] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-08. [2025-09-16T20:12:32.374942] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-04. [2025-09-16T20:12:32.408408] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-16T20:12:33.174927] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-09. [2025-09-16T20:12:33.974960] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-07. [2025-09-16T20:12:34.017812] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-16T20:12:34.019666] [INFO ] [REMOTE ] RLTY: Full fetch complete (12983 records). [2025-09-16T20:12:34.019758] [DEBUG] [VALIDATOR ] RLTY: Validating primary data. [2025-09-16T20:12:34.399362] [DEBUG] [VALIDATOR ] RLTY: All expected trading days are present. [2025-09-16T20:12:34.399483] [DEBUG] [VALIDATOR ] RLTY: Primary data validation passed. [2025-09-16T20:12:34.399926] [INFO ] [MAIN ] RLTY: Fetched primary data is valid. [2025-09-16T20:12:34.400036] [DEBUG] [LOCAL ] RLTY: Saving primary data. [2025-09-16T20:12:34.400886] [DEBUG] [LOCAL ] RLTY: Trimmed 12983 records to 7978 (keeping 150 days of data) [2025-09-16T20:12:34.466816] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-16T20:12:34.489807] [DEBUG] [LOCAL ] RLTY: Primary data saved (7978 records). [2025-09-16T20:12:34.489967] [INFO ] [MAIN ] RLTY: Full history saved. [2025-09-16T20:12:34.490057] [INFO ] [MAIN ] Update Progress: 1812/2369 symbols completed. RLTY took 19.0s. Estimated remaining: 59m 11s. Rate: 9.4 symbols/min [2025-09-16T20:12:34.663241] [INFO ] [MAIN ] RMAX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:12:34.679061] [DEBUG] [LOCAL ] RMAX: Loaded 16511 existing records from primary storage. [2025-09-16T20:12:34.679196] [INFO ] [MAIN ] RMAX: Loaded 16511 existing records. [2025-09-16T20:12:34.780051] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-08. [2025-09-16T20:12:34.806098] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-16T20:12:34.873445] [WARN ] [MAIN ] RMAX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:12:34.873739] [INFO ] [MAIN ] RMAX: Wiping existing primary data before full refresh. [2025-09-16T20:12:34.873795] [INFO ] [LOCAL ] RMAX: Starting deletion of primary data. [2025-09-16T20:12:34.874298] [DEBUG] [LOCAL ] RMAX: Deleted primary data file. [2025-09-16T20:12:34.874345] [INFO ] [MAIN ] RMAX: Starting full primary refresh. [2025-09-16T20:12:35.238884] [INFO ] [REMOTE ] RMAX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:12:35.574919] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-05. [2025-09-16T20:12:36.374924] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-02. [2025-09-16T20:12:36.487019] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-16T20:12:36.736839] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-16T20:12:37.153151] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-16T20:12:37.174859] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-03. [2025-09-16T20:12:37.974909] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-06. [2025-09-16T20:12:38.327212] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-16T20:12:38.774914] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-04. [2025-09-16T20:12:39.574936] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-08. [2025-09-16T20:12:39.642300] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-16T20:12:39.878069] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-16T20:12:40.299073] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-16T20:12:40.374972] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-05. [2025-09-16T20:12:41.174915] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-09. [2025-09-16T20:12:41.270063] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-16T20:12:41.941257] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-16T20:12:41.943538] [INFO ] [REMOTE ] RM: Full fetch complete (8341 records). [2025-09-16T20:12:41.943694] [DEBUG] [VALIDATOR ] RM: Validating primary data. [2025-09-16T20:12:41.980215] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-07. [2025-09-16T20:12:42.522386] [DEBUG] [VALIDATOR ] RM: All expected trading days are present. [2025-09-16T20:12:42.522537] [DEBUG] [VALIDATOR ] RM: Primary data validation passed. [2025-09-16T20:12:42.523044] [INFO ] [MAIN ] RM: Fetched primary data is valid. [2025-09-16T20:12:42.523139] [DEBUG] [LOCAL ] RM: Saving primary data. [2025-09-16T20:12:42.524253] [DEBUG] [LOCAL ] RM: Trimmed 8341 records to 5649 (keeping 150 days of data) [2025-09-16T20:12:42.581252] [DEBUG] [LOCAL ] RM: Primary data saved (5649 records). [2025-09-16T20:12:42.581463] [INFO ] [MAIN ] RM: Full history saved. [2025-09-16T20:12:42.581666] [INFO ] [MAIN ] Update Progress: 1813/2369 symbols completed. RM took 18.5s. Estimated remaining: 59m 5s. Rate: 9.4 symbols/min [2025-09-16T20:12:42.784568] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-09. [2025-09-16T20:12:42.818417] [INFO ] [MAIN ] RMD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:12:42.855483] [DEBUG] [LOCAL ] RMD: Loaded 30817 existing records from primary storage. [2025-09-16T20:12:42.855672] [INFO ] [MAIN ] RMD: Loaded 30817 existing records. [2025-09-16T20:12:43.040638] [WARN ] [MAIN ] RMD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:12:43.040934] [INFO ] [MAIN ] RMD: Wiping existing primary data before full refresh. [2025-09-16T20:12:43.040983] [INFO ] [LOCAL ] RMD: Starting deletion of primary data. [2025-09-16T20:12:43.041816] [DEBUG] [LOCAL ] RMD: Deleted primary data file. [2025-09-16T20:12:43.041870] [INFO ] [MAIN ] RMD: Starting full primary refresh. [2025-09-16T20:12:43.407110] [INFO ] [REMOTE ] RMD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:12:43.574963] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-02. [2025-09-16T20:12:43.748935] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-16T20:12:44.010582] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-16T20:12:44.016856] [INFO ] [REMOTE ] RLJ: Full fetch complete (52338 records). [2025-09-16T20:12:44.017015] [DEBUG] [VALIDATOR ] RLJ: Validating primary data. [2025-09-16T20:12:44.381397] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-06. [2025-09-16T20:12:44.399370] [DEBUG] [VALIDATOR ] RLJ: All expected trading days are present. [2025-09-16T20:12:44.399451] [DEBUG] [VALIDATOR ] RLJ: Primary data validation passed. [2025-09-16T20:12:44.400398] [INFO ] [MAIN ] RLJ: Fetched primary data is valid. [2025-09-16T20:12:44.400446] [DEBUG] [LOCAL ] RLJ: Saving primary data. [2025-09-16T20:12:44.401696] [DEBUG] [LOCAL ] RLJ: Trimmed 52338 records to 35399 (keeping 150 days of data) [2025-09-16T20:12:44.622420] [DEBUG] [LOCAL ] RLJ: Primary data saved (35399 records). [2025-09-16T20:12:44.622658] [INFO ] [MAIN ] RLJ: Full history saved. [2025-09-16T20:12:44.622773] [INFO ] [MAIN ] Update Progress: 1814/2369 symbols completed. RLJ took 38.1s. Estimated remaining: 58m 57s. Rate: 9.4 symbols/min [2025-09-16T20:12:44.796673] [INFO ] [MAIN ] RMI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:12:44.802352] [DEBUG] [LOCAL ] RMI: Loaded 3512 existing records from primary storage. [2025-09-16T20:12:44.802466] [INFO ] [MAIN ] RMI: Loaded 3512 existing records. [2025-09-16T20:12:44.981428] [WARN ] [MAIN ] RMI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:12:44.981708] [INFO ] [MAIN ] RMI: Wiping existing primary data before full refresh. [2025-09-16T20:12:44.981767] [INFO ] [LOCAL ] RMI: Starting deletion of primary data. [2025-09-16T20:12:44.982168] [DEBUG] [LOCAL ] RMI: Deleted primary data file. [2025-09-16T20:12:44.982257] [INFO ] [MAIN ] RMI: Starting full primary refresh. [2025-09-16T20:12:45.176739] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-08. [2025-09-16T20:12:45.336494] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-16T20:12:45.401971] [INFO ] [REMOTE ] RMI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:12:45.530211] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-16T20:12:45.974909] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-02. [2025-09-16T20:12:46.451320] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-16T20:12:46.774878] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-07. [2025-09-16T20:12:47.175870] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-16T20:12:47.574912] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-03. [2025-09-16T20:12:48.016143] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-16T20:12:48.022426] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-16T20:12:48.374910] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-04. [2025-09-16T20:12:48.958474] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-16T20:12:49.174959] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-05. [2025-09-16T20:12:49.756483] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-16T20:12:49.974945] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-06. [2025-09-16T20:12:50.534887] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-16T20:12:50.774944] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-03. [2025-09-16T20:12:51.574929] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-08. [2025-09-16T20:12:52.374920] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-09. [2025-09-16T20:12:52.456030] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-16T20:12:52.901869] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-16T20:12:53.174943] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-04. [2025-09-16T20:12:53.914522] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-16T20:12:53.921989] [INFO ] [REMOTE ] RLX: Full fetch complete (52257 records). [2025-09-16T20:12:53.922158] [DEBUG] [VALIDATOR ] RLX: Validating primary data. [2025-09-16T20:12:53.986399] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-09. [2025-09-16T20:12:54.314303] [DEBUG] [VALIDATOR ] RLX: All expected trading days are present. [2025-09-16T20:12:54.314524] [DEBUG] [VALIDATOR ] RLX: Primary data validation passed. [2025-09-16T20:12:54.315619] [INFO ] [MAIN ] RLX: Fetched primary data is valid. [2025-09-16T20:12:54.315748] [DEBUG] [LOCAL ] RLX: Saving primary data. [2025-09-16T20:12:54.317327] [DEBUG] [LOCAL ] RLX: Trimmed 52257 records to 35429 (keeping 150 days of data) [2025-09-16T20:12:54.543459] [DEBUG] [LOCAL ] RLX: Primary data saved (35429 records). [2025-09-16T20:12:54.543655] [INFO ] [MAIN ] RLX: Full history saved. [2025-09-16T20:12:54.543776] [INFO ] [MAIN ] Update Progress: 1815/2369 symbols completed. RLX took 35.6s. Estimated remaining: 58m 52s. Rate: 9.4 symbols/min [2025-09-16T20:12:54.718778] [INFO ] [MAIN ] RMM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:12:54.727956] [DEBUG] [LOCAL ] RMM: Loaded 7506 existing records from primary storage. [2025-09-16T20:12:54.728076] [INFO ] [MAIN ] RMM: Loaded 7506 existing records. [2025-09-16T20:12:54.784424] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-07. [2025-09-16T20:12:54.911412] [WARN ] [MAIN ] RMM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:12:54.911870] [INFO ] [MAIN ] RMM: Wiping existing primary data before full refresh. [2025-09-16T20:12:54.911954] [INFO ] [LOCAL ] RMM: Starting deletion of primary data. [2025-09-16T20:12:54.912336] [DEBUG] [LOCAL ] RMM: Deleted primary data file. [2025-09-16T20:12:54.912416] [INFO ] [MAIN ] RMM: Starting full primary refresh. [2025-09-16T20:12:55.144749] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-16T20:12:55.340107] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-16T20:12:55.328911] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-16T20:12:55.339795] [INFO ] [REMOTE ] RMM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:12:55.346116] [INFO ] [REMOTE ] RMAX: Full fetch complete (23192 records). [2025-09-16T20:12:55.346222] [DEBUG] [VALIDATOR ] RMAX: Validating primary data. [2025-09-16T20:12:55.584578] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-05. [2025-09-16T20:12:55.716666] [DEBUG] [VALIDATOR ] RMAX: All expected trading days are present. [2025-09-16T20:12:55.716749] [DEBUG] [VALIDATOR ] RMAX: Primary data validation passed. [2025-09-16T20:12:55.717282] [INFO ] [MAIN ] RMAX: Fetched primary data is valid. [2025-09-16T20:12:55.717325] [DEBUG] [LOCAL ] RMAX: Saving primary data. [2025-09-16T20:12:55.718117] [DEBUG] [LOCAL ] RMAX: Trimmed 23192 records to 16631 (keeping 150 days of data) [2025-09-16T20:12:55.814753] [DEBUG] [LOCAL ] RMAX: Primary data saved (16631 records). [2025-09-16T20:12:55.814894] [INFO ] [MAIN ] RMAX: Full history saved. [2025-09-16T20:12:55.814992] [INFO ] [MAIN ] Update Progress: 1816/2369 symbols completed. RMAX took 21.3s. Estimated remaining: 58m 44s. Rate: 9.4 symbols/min [2025-09-16T20:12:55.987508] [INFO ] [MAIN ] RMMZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:12:55.992660] [DEBUG] [LOCAL ] RMMZ: Loaded 3661 existing records from primary storage. [2025-09-16T20:12:55.992734] [INFO ] [MAIN ] RMMZ: Loaded 3661 existing records. [2025-09-16T20:12:56.166973] [WARN ] [MAIN ] RMMZ: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:12:56.167237] [INFO ] [MAIN ] RMMZ: Wiping existing primary data before full refresh. [2025-09-16T20:12:56.167291] [INFO ] [LOCAL ] RMMZ: Starting deletion of primary data. [2025-09-16T20:12:56.167528] [DEBUG] [LOCAL ] RMMZ: Deleted primary data file. [2025-09-16T20:12:56.167580] [INFO ] [MAIN ] RMMZ: Starting full primary refresh. [2025-09-16T20:12:56.379988] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-08. [2025-09-16T20:12:56.531823] [INFO ] [REMOTE ] RMMZ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:12:57.169586] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-16T20:12:57.174834] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-09. [2025-09-16T20:12:57.275439] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-16T20:12:57.921722] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-16T20:12:57.923172] [INFO ] [REMOTE ] RMI: Full fetch complete (4764 records). [2025-09-16T20:12:57.923248] [DEBUG] [VALIDATOR ] RMI: Validating primary data. [2025-09-16T20:12:57.980131] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-06. [2025-09-16T20:12:58.317707] [DEBUG] [VALIDATOR ] RMI: All expected trading days are present. [2025-09-16T20:12:58.317784] [DEBUG] [VALIDATOR ] RMI: Primary data validation passed. [2025-09-16T20:12:58.317936] [INFO ] [MAIN ] RMI: Fetched primary data is valid. [2025-09-16T20:12:58.317977] [DEBUG] [LOCAL ] RMI: Saving primary data. [2025-09-16T20:12:58.318351] [DEBUG] [LOCAL ] RMI: Trimmed 4764 records to 3529 (keeping 150 days of data) [2025-09-16T20:12:58.341413] [DEBUG] [LOCAL ] RMI: Primary data saved (3529 records). [2025-09-16T20:12:58.341480] [INFO ] [MAIN ] RMI: Full history saved. [2025-09-16T20:12:58.341560] [INFO ] [MAIN ] Update Progress: 1817/2369 symbols completed. RMI took 13.7s. Estimated remaining: 58m 37s. Rate: 9.4 symbols/min [2025-09-16T20:12:58.511939] [INFO ] [MAIN ] RMT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:12:58.531707] [DEBUG] [LOCAL ] RMT: Loaded 12619 existing records from primary storage. [2025-09-16T20:12:58.531869] [INFO ] [MAIN ] RMT: Loaded 12619 existing records. [2025-09-16T20:12:58.710959] [WARN ] [MAIN ] RMT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:12:58.711236] [INFO ] [MAIN ] RMT: Wiping existing primary data before full refresh. [2025-09-16T20:12:58.711290] [INFO ] [LOCAL ] RMT: Starting deletion of primary data. [2025-09-16T20:12:58.711716] [DEBUG] [LOCAL ] RMT: Deleted primary data file. [2025-09-16T20:12:58.711780] [INFO ] [MAIN ] RMT: Starting full primary refresh. [2025-09-16T20:12:58.780165] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-02. [2025-09-16T20:12:59.069020] [INFO ] [REMOTE ] RMT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:12:59.552161] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-16T20:12:59.554186] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-16T20:12:59.574896] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-07. [2025-09-16T20:13:00.374991] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-02. [2025-09-16T20:13:01.174942] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-03. [2025-09-16T20:13:01.349435] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-16T20:13:01.457812] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-16T20:13:01.670275] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-16T20:13:01.974923] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-04. [2025-09-16T20:13:02.769314] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-16T20:13:02.774856] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-05. [2025-09-16T20:13:03.576845] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-02. [2025-09-16T20:13:03.578772] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-16T20:13:04.101197] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-16T20:13:04.374919] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-06. [2025-09-16T20:13:05.124065] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-16T20:13:05.174927] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-03. [2025-09-16T20:13:05.974951] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-03. [2025-09-16T20:13:06.243682] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-16T20:13:06.308197] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-16T20:13:06.774899] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-07. [2025-09-16T20:13:07.574910] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-04. [2025-09-16T20:13:07.845849] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-16T20:13:08.374953] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-08. [2025-09-16T20:13:08.815572] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-16T20:13:09.174935] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-04. [2025-09-16T20:13:09.878408] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-16T20:13:09.947714] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-16T20:13:09.974849] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-09. [2025-09-16T20:13:10.774909] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-08. [2025-09-16T20:13:11.562884] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-16T20:13:11.567995] [INFO ] [REMOTE ] RMD: Full fetch complete (46286 records). [2025-09-16T20:13:11.568113] [DEBUG] [VALIDATOR ] RMD: Validating primary data. [2025-09-16T20:13:11.579964] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-05. [2025-09-16T20:13:11.687529] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-16T20:13:11.958006] [DEBUG] [VALIDATOR ] RMD: All expected trading days are present. [2025-09-16T20:13:11.958093] [DEBUG] [VALIDATOR ] RMD: Primary data validation passed. [2025-09-16T20:13:11.958962] [INFO ] [MAIN ] RMD: Fetched primary data is valid. [2025-09-16T20:13:11.959006] [DEBUG] [LOCAL ] RMD: Saving primary data. [2025-09-16T20:13:11.960029] [DEBUG] [LOCAL ] RMD: Trimmed 46286 records to 31128 (keeping 150 days of data) [2025-09-16T20:13:12.167739] [DEBUG] [LOCAL ] RMD: Primary data saved (31128 records). [2025-09-16T20:13:12.167946] [INFO ] [MAIN ] RMD: Full history saved. [2025-09-16T20:13:12.168109] [INFO ] [MAIN ] Update Progress: 1818/2369 symbols completed. RMD took 29.6s. Estimated remaining: 58m 32s. Rate: 9.4 symbols/min [2025-09-16T20:13:12.341256] [INFO ] [MAIN ] RNG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:13:12.377514] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-05. [2025-09-16T20:13:12.378214] [DEBUG] [LOCAL ] RNG: Loaded 35080 existing records from primary storage. [2025-09-16T20:13:12.378468] [INFO ] [MAIN ] RNG: Loaded 35080 existing records. [2025-09-16T20:13:12.570936] [WARN ] [MAIN ] RNG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:13:12.571221] [INFO ] [MAIN ] RNG: Wiping existing primary data before full refresh. [2025-09-16T20:13:12.571268] [INFO ] [LOCAL ] RNG: Starting deletion of primary data. [2025-09-16T20:13:12.572116] [DEBUG] [LOCAL ] RNG: Deleted primary data file. [2025-09-16T20:13:12.572169] [INFO ] [MAIN ] RNG: Starting full primary refresh. [2025-09-16T20:13:12.755288] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-16T20:13:12.963522] [INFO ] [REMOTE ] RNG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:13:13.030440] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-16T20:13:13.174905] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-06. [2025-09-16T20:13:13.974911] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-06. [2025-09-16T20:13:14.094594] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-16T20:13:14.541709] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-16T20:13:14.774899] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-07. [2025-09-16T20:13:15.411677] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-16T20:13:15.574938] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-08. [2025-09-16T20:13:16.186481] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-16T20:13:16.374935] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-09. [2025-09-16T20:13:17.003791] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-16T20:13:17.005442] [INFO ] [REMOTE ] RMMZ: Full fetch complete (5112 records). [2025-09-16T20:13:17.005543] [DEBUG] [VALIDATOR ] RMMZ: Validating primary data. [2025-09-16T20:13:17.185188] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-07. [2025-09-16T20:13:17.391370] [DEBUG] [VALIDATOR ] RMMZ: All expected trading days are present. [2025-09-16T20:13:17.391456] [DEBUG] [VALIDATOR ] RMMZ: Primary data validation passed. [2025-09-16T20:13:17.391595] [INFO ] [MAIN ] RMMZ: Fetched primary data is valid. [2025-09-16T20:13:17.391636] [DEBUG] [LOCAL ] RMMZ: Saving primary data. [2025-09-16T20:13:17.392039] [DEBUG] [LOCAL ] RMMZ: Trimmed 5112 records to 3694 (keeping 150 days of data) [2025-09-16T20:13:17.415705] [DEBUG] [LOCAL ] RMMZ: Primary data saved (3694 records). [2025-09-16T20:13:17.415777] [INFO ] [MAIN ] RMMZ: Full history saved. [2025-09-16T20:13:17.415863] [INFO ] [MAIN ] Update Progress: 1819/2369 symbols completed. RMMZ took 21.6s. Estimated remaining: 58m 26s. Rate: 9.4 symbols/min [2025-09-16T20:13:17.586804] [INFO ] [MAIN ] RNGR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:13:17.603456] [DEBUG] [LOCAL ] RNGR: Loaded 15569 existing records from primary storage. [2025-09-16T20:13:17.603564] [INFO ] [MAIN ] RNGR: Loaded 15569 existing records. [2025-09-16T20:13:17.777075] [WARN ] [MAIN ] RNGR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:13:17.777310] [INFO ] [MAIN ] RNGR: Wiping existing primary data before full refresh. [2025-09-16T20:13:17.777356] [INFO ] [LOCAL ] RNGR: Starting deletion of primary data. [2025-09-16T20:13:17.777890] [DEBUG] [LOCAL ] RNGR: Deleted primary data file. [2025-09-16T20:13:17.777939] [INFO ] [MAIN ] RNGR: Starting full primary refresh. [2025-09-16T20:13:17.980863] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-09. [2025-09-16T20:13:18.129877] [INFO ] [REMOTE ] RNGR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:13:18.303364] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-16T20:13:18.774946] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-02. [2025-09-16T20:13:18.850398] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-16T20:13:18.853197] [INFO ] [REMOTE ] RMM: Full fetch complete (10865 records). [2025-09-16T20:13:18.853287] [DEBUG] [VALIDATOR ] RMM: Validating primary data. [2025-09-16T20:13:19.215938] [DEBUG] [VALIDATOR ] RMM: All expected trading days are present. [2025-09-16T20:13:19.216055] [DEBUG] [VALIDATOR ] RMM: Primary data validation passed. [2025-09-16T20:13:19.216342] [INFO ] [MAIN ] RMM: Fetched primary data is valid. [2025-09-16T20:13:19.216385] [DEBUG] [LOCAL ] RMM: Saving primary data. [2025-09-16T20:13:19.217163] [DEBUG] [LOCAL ] RMM: Trimmed 10865 records to 7584 (keeping 150 days of data) [2025-09-16T20:13:19.265818] [DEBUG] [LOCAL ] RMM: Primary data saved (7584 records). [2025-09-16T20:13:19.265950] [INFO ] [MAIN ] RMM: Full history saved. [2025-09-16T20:13:19.266043] [INFO ] [MAIN ] Update Progress: 1820/2369 symbols completed. RMM took 24.7s. Estimated remaining: 58m 18s. Rate: 9.4 symbols/min [2025-09-16T20:13:19.439536] [INFO ] [MAIN ] RNP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:13:19.452742] [DEBUG] [LOCAL ] RNP: Loaded 11608 existing records from primary storage. [2025-09-16T20:13:19.452853] [INFO ] [MAIN ] RNP: Loaded 11608 existing records. [2025-09-16T20:13:19.595738] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-08. [2025-09-16T20:13:19.645083] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-16T20:13:19.644367] [WARN ] [MAIN ] RNP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:13:19.648607] [INFO ] [MAIN ] RNP: Wiping existing primary data before full refresh. [2025-09-16T20:13:19.649423] [INFO ] [LOCAL ] RNP: Starting deletion of primary data. [2025-09-16T20:13:19.649873] [DEBUG] [LOCAL ] RNP: Deleted primary data file. [2025-09-16T20:13:19.649925] [INFO ] [MAIN ] RNP: Starting full primary refresh. [2025-09-16T20:13:20.014931] [INFO ] [REMOTE ] RNP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:13:20.374914] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-02. [2025-09-16T20:13:20.686803] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-16T20:13:21.174906] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-09. [2025-09-16T20:13:21.322824] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-16T20:13:21.974921] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-03. [2025-09-16T20:13:22.059969] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-16T20:13:22.062479] [INFO ] [REMOTE ] RMT: Full fetch complete (19228 records). [2025-09-16T20:13:22.062596] [DEBUG] [VALIDATOR ] RMT: Validating primary data. [2025-09-16T20:13:22.460165] [DEBUG] [VALIDATOR ] RMT: All expected trading days are present. [2025-09-16T20:13:22.460263] [DEBUG] [VALIDATOR ] RMT: Primary data validation passed. [2025-09-16T20:13:22.460739] [INFO ] [MAIN ] RMT: Fetched primary data is valid. [2025-09-16T20:13:22.460796] [DEBUG] [LOCAL ] RMT: Saving primary data. [2025-09-16T20:13:22.461509] [DEBUG] [LOCAL ] RMT: Trimmed 19228 records to 12707 (keeping 150 days of data) [2025-09-16T20:13:22.549510] [DEBUG] [LOCAL ] RMT: Primary data saved (12707 records). [2025-09-16T20:13:22.549659] [INFO ] [MAIN ] RMT: Full history saved. [2025-09-16T20:13:22.549753] [INFO ] [MAIN ] Update Progress: 1821/2369 symbols completed. RMT took 24.2s. Estimated remaining: 58m 11s. Rate: 9.4 symbols/min [2025-09-16T20:13:22.731180] [INFO ] [MAIN ] RNR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:13:22.754501] [DEBUG] [LOCAL ] RNR: Loaded 25005 existing records from primary storage. [2025-09-16T20:13:22.754689] [INFO ] [MAIN ] RNR: Loaded 25005 existing records. [2025-09-16T20:13:22.779996] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-03. [2025-09-16T20:13:22.946404] [WARN ] [MAIN ] RNR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:13:22.946699] [INFO ] [MAIN ] RNR: Wiping existing primary data before full refresh. [2025-09-16T20:13:22.946750] [INFO ] [LOCAL ] RNR: Starting deletion of primary data. [2025-09-16T20:13:22.947436] [DEBUG] [LOCAL ] RNR: Deleted primary data file. [2025-09-16T20:13:22.947485] [INFO ] [MAIN ] RNR: Starting full primary refresh. [2025-09-16T20:13:23.339438] [INFO ] [REMOTE ] RNR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:13:23.340704] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-16T20:13:23.510141] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-16T20:13:23.574898] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-04. [2025-09-16T20:13:24.374898] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-02. [2025-09-16T20:13:24.573301] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-16T20:13:25.174911] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-05. [2025-09-16T20:13:25.947967] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-16T20:13:25.974849] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-03. [2025-09-16T20:13:25.997750] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-16T20:13:26.774899] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-04. [2025-09-16T20:13:27.580278] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-06. [2025-09-16T20:13:27.587532] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-16T20:13:27.868086] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-16T20:13:28.304246] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-16T20:13:28.374901] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-04. [2025-09-16T20:13:29.174898] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-07. [2025-09-16T20:13:29.983358] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-02. [2025-09-16T20:13:29.989583] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-16T20:13:30.015343] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-16T20:13:30.774907] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-05. [2025-09-16T20:13:31.574959] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-08. [2025-09-16T20:13:31.748038] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-16T20:13:32.374899] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-03. [2025-09-16T20:13:32.467527] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-16T20:13:32.489429] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-16T20:13:33.174936] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-09. [2025-09-16T20:13:33.621970] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-16T20:13:33.974874] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-05. [2025-09-16T20:13:34.206249] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-16T20:13:34.208374] [INFO ] [REMOTE ] RNP: Full fetch complete (17247 records). [2025-09-16T20:13:34.208444] [DEBUG] [VALIDATOR ] RNP: Validating primary data. [2025-09-16T20:13:34.579088] [DEBUG] [VALIDATOR ] RNP: All expected trading days are present. [2025-09-16T20:13:34.579181] [DEBUG] [VALIDATOR ] RNP: Primary data validation passed. [2025-09-16T20:13:34.579606] [INFO ] [MAIN ] RNP: Fetched primary data is valid. [2025-09-16T20:13:34.579706] [DEBUG] [LOCAL ] RNP: Saving primary data. [2025-09-16T20:13:34.580505] [DEBUG] [LOCAL ] RNP: Trimmed 17247 records to 11693 (keeping 150 days of data) [2025-09-16T20:13:34.663066] [DEBUG] [LOCAL ] RNP: Primary data saved (11693 records). [2025-09-16T20:13:34.663257] [INFO ] [MAIN ] RNP: Full history saved. [2025-09-16T20:13:34.663401] [INFO ] [MAIN ] Update Progress: 1822/2369 symbols completed. RNP took 15.4s. Estimated remaining: 58m 6s. Rate: 9.4 symbols/min [2025-09-16T20:13:34.782001] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-06. [2025-09-16T20:13:34.873847] [INFO ] [MAIN ] RNST: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:13:34.909022] [DEBUG] [LOCAL ] RNST: Loaded 26356 existing records from primary storage. [2025-09-16T20:13:34.909259] [INFO ] [MAIN ] RNST: Loaded 26356 existing records. [2025-09-16T20:13:35.213615] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-16T20:13:35.211794] [WARN ] [MAIN ] RNST: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:13:35.221427] [INFO ] [MAIN ] RNST: Wiping existing primary data before full refresh. [2025-09-16T20:13:35.222013] [INFO ] [LOCAL ] RNST: Starting deletion of primary data. [2025-09-16T20:13:35.222870] [DEBUG] [LOCAL ] RNST: Deleted primary data file. [2025-09-16T20:13:35.222944] [INFO ] [MAIN ] RNST: Starting full primary refresh. [2025-09-16T20:13:35.580446] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-04. [2025-09-16T20:13:35.706666] [INFO ] [REMOTE ] RNST: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:13:36.297937] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-16T20:13:36.374858] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-07. [2025-09-16T20:13:36.831881] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-16T20:13:37.174960] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-05. [2025-09-16T20:13:37.974915] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-02. [2025-09-16T20:13:38.068852] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-16T20:13:38.774942] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-06. [2025-09-16T20:13:39.489248] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-09-16T20:13:39.574859] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-06. [2025-09-16T20:13:39.773915] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-16T20:13:40.009800] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-16T20:13:40.374964] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-07. [2025-09-16T20:13:40.930063] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-16T20:13:41.174914] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-07. [2025-09-16T20:13:41.607730] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-16T20:13:41.974913] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-08. [2025-09-16T20:13:42.703877] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-16T20:13:42.774952] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-03. [2025-09-16T20:13:43.011740] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-16T20:13:43.574968] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-08. [2025-09-16T20:13:44.189099] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-16T20:13:44.374912] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-04. [2025-09-16T20:13:44.855949] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-16T20:13:45.174972] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-08. [2025-09-16T20:13:45.974919] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-09. [2025-09-16T20:13:46.021892] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-16T20:13:46.774905] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-09. [2025-09-16T20:13:46.870363] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-16T20:13:46.906931] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-16T20:13:46.910110] [INFO ] [REMOTE ] RNGR: Full fetch complete (21581 records). [2025-09-16T20:13:46.910190] [DEBUG] [VALIDATOR ] RNGR: Validating primary data. [2025-09-16T20:13:47.282239] [DEBUG] [VALIDATOR ] RNGR: All expected trading days are present. [2025-09-16T20:13:47.282319] [DEBUG] [VALIDATOR ] RNGR: Primary data validation passed. [2025-09-16T20:13:47.282781] [INFO ] [MAIN ] RNGR: Fetched primary data is valid. [2025-09-16T20:13:47.282824] [DEBUG] [LOCAL ] RNGR: Saving primary data. [2025-09-16T20:13:47.283424] [DEBUG] [LOCAL ] RNGR: Trimmed 21581 records to 15757 (keeping 150 days of data) [2025-09-16T20:13:47.384074] [DEBUG] [LOCAL ] RNGR: Primary data saved (15757 records). [2025-09-16T20:13:47.384226] [INFO ] [MAIN ] RNGR: Full history saved. [2025-09-16T20:13:47.384314] [INFO ] [MAIN ] Update Progress: 1823/2369 symbols completed. RNGR took 30.0s. Estimated remaining: 58m 2s. Rate: 9.4 symbols/min [2025-09-16T20:13:47.557223] [INFO ] [MAIN ] ROG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:13:47.573156] [DEBUG] [LOCAL ] ROG: Loaded 16384 existing records from primary storage. [2025-09-16T20:13:47.573289] [INFO ] [MAIN ] ROG: Loaded 16384 existing records. [2025-09-16T20:13:47.584745] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-09. [2025-09-16T20:13:47.760122] [WARN ] [MAIN ] ROG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:13:47.760380] [INFO ] [MAIN ] ROG: Wiping existing primary data before full refresh. [2025-09-16T20:13:47.760426] [INFO ] [LOCAL ] ROG: Starting deletion of primary data. [2025-09-16T20:13:47.760871] [DEBUG] [LOCAL ] ROG: Deleted primary data file. [2025-09-16T20:13:47.760918] [INFO ] [MAIN ] ROG: Starting full primary refresh. [2025-09-16T20:13:48.118995] [INFO ] [REMOTE ] ROG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:13:48.246376] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-16T20:13:48.250374] [INFO ] [REMOTE ] RNR: Full fetch complete (38219 records). [2025-09-16T20:13:48.250464] [DEBUG] [VALIDATOR ] RNR: Validating primary data. [2025-09-16T20:13:48.391017] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-02. [2025-09-16T20:13:48.621902] [DEBUG] [VALIDATOR ] RNR: All expected trading days are present. [2025-09-16T20:13:48.621978] [DEBUG] [VALIDATOR ] RNR: Primary data validation passed. [2025-09-16T20:13:48.622734] [INFO ] [MAIN ] RNR: Fetched primary data is valid. [2025-09-16T20:13:48.622778] [DEBUG] [LOCAL ] RNR: Saving primary data. [2025-09-16T20:13:48.623597] [DEBUG] [LOCAL ] RNR: Trimmed 38219 records to 25274 (keeping 150 days of data) [2025-09-16T20:13:48.787450] [DEBUG] [LOCAL ] RNR: Primary data saved (25274 records). [2025-09-16T20:13:48.787594] [INFO ] [MAIN ] RNR: Full history saved. [2025-09-16T20:13:48.787692] [INFO ] [MAIN ] Update Progress: 1824/2369 symbols completed. RNR took 26.2s. Estimated remaining: 57m 54s. Rate: 9.4 symbols/min [2025-09-16T20:13:48.958953] [INFO ] [MAIN ] ROK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:13:48.993737] [DEBUG] [LOCAL ] ROK: Loaded 32014 existing records from primary storage. [2025-09-16T20:13:48.993872] [INFO ] [MAIN ] ROK: Loaded 32014 existing records. [2025-09-16T20:13:49.172386] [WARN ] [MAIN ] ROK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:13:49.172618] [INFO ] [MAIN ] ROK: Wiping existing primary data before full refresh. [2025-09-16T20:13:49.172683] [INFO ] [LOCAL ] ROK: Starting deletion of primary data. [2025-09-16T20:13:49.173452] [DEBUG] [LOCAL ] ROK: Deleted primary data file. [2025-09-16T20:13:49.173497] [INFO ] [MAIN ] ROK: Starting full primary refresh. [2025-09-16T20:13:49.204577] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-05. [2025-09-16T20:13:49.570370] [INFO ] [REMOTE ] ROK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:13:49.587535] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-16T20:13:49.602356] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-16T20:13:49.608091] [INFO ] [REMOTE ] RNG: Full fetch complete (52560 records). [2025-09-16T20:13:49.608186] [DEBUG] [VALIDATOR ] RNG: Validating primary data. [2025-09-16T20:13:49.984000] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-02. [2025-09-16T20:13:49.986780] [DEBUG] [VALIDATOR ] RNG: All expected trading days are present. [2025-09-16T20:13:49.986980] [DEBUG] [VALIDATOR ] RNG: Primary data validation passed. [2025-09-16T20:13:49.988558] [INFO ] [MAIN ] RNG: Fetched primary data is valid. [2025-09-16T20:13:49.988632] [DEBUG] [LOCAL ] RNG: Saving primary data. [2025-09-16T20:13:49.989905] [DEBUG] [LOCAL ] RNG: Trimmed 52560 records to 35432 (keeping 150 days of data) [2025-09-16T20:13:50.200321] [DEBUG] [LOCAL ] RNG: Primary data saved (35432 records). [2025-09-16T20:13:50.200463] [INFO ] [MAIN ] RNG: Full history saved. [2025-09-16T20:13:50.200546] [INFO ] [MAIN ] Update Progress: 1825/2369 symbols completed. RNG took 38.0s. Estimated remaining: 57m 46s. Rate: 9.4 symbols/min [2025-09-16T20:13:50.378774] [INFO ] [MAIN ] ROL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:13:50.413034] [DEBUG] [LOCAL ] ROL: Loaded 36702 existing records from primary storage. [2025-09-16T20:13:50.413194] [INFO ] [MAIN ] ROL: Loaded 36702 existing records. [2025-09-16T20:13:50.589254] [WARN ] [MAIN ] ROL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:13:50.589575] [INFO ] [MAIN ] ROL: Wiping existing primary data before full refresh. [2025-09-16T20:13:50.589629] [INFO ] [LOCAL ] ROL: Starting deletion of primary data. [2025-09-16T20:13:50.590502] [DEBUG] [LOCAL ] ROL: Deleted primary data file. [2025-09-16T20:13:50.590551] [INFO ] [MAIN ] ROL: Starting full primary refresh. [2025-09-16T20:13:50.781438] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-03. [2025-09-16T20:13:50.967604] [INFO ] [REMOTE ] ROL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:13:50.971139] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-16T20:13:51.245156] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-16T20:13:51.574933] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-06. [2025-09-16T20:13:52.008508] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-16T20:13:52.374899] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-03. [2025-09-16T20:13:52.639494] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-16T20:13:53.174966] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-07. [2025-09-16T20:13:53.974962] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-04. [2025-09-16T20:13:54.215449] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-16T20:13:54.599952] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-16T20:13:54.774889] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-04. [2025-09-16T20:13:55.383831] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-16T20:13:55.574920] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-02. [2025-09-16T20:13:56.374978] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-05. [2025-09-16T20:13:56.584523] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-16T20:13:56.752300] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-16T20:13:57.174912] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-08. [2025-09-16T20:13:57.355005] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-16T20:13:57.974911] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-05. [2025-09-16T20:13:58.557457] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-16T20:13:58.774951] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-09. [2025-09-16T20:13:59.574947] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-06. [2025-09-16T20:13:59.714227] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-16T20:14:00.207926] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-16T20:14:00.212235] [INFO ] [REMOTE ] RNST: Full fetch complete (40491 records). [2025-09-16T20:14:00.212327] [DEBUG] [VALIDATOR ] RNST: Validating primary data. [2025-09-16T20:14:00.384700] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-03. [2025-09-16T20:14:00.585936] [DEBUG] [VALIDATOR ] RNST: All expected trading days are present. [2025-09-16T20:14:00.586050] [DEBUG] [VALIDATOR ] RNST: Primary data validation passed. [2025-09-16T20:14:00.586980] [INFO ] [MAIN ] RNST: Fetched primary data is valid. [2025-09-16T20:14:00.587054] [DEBUG] [LOCAL ] RNST: Saving primary data. [2025-09-16T20:14:00.588443] [DEBUG] [LOCAL ] RNST: Trimmed 40491 records to 26578 (keeping 150 days of data) [2025-09-16T20:14:00.600603] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-16T20:14:00.773876] [DEBUG] [LOCAL ] RNST: Primary data saved (26578 records). [2025-09-16T20:14:00.774201] [INFO ] [MAIN ] RNST: Full history saved. [2025-09-16T20:14:00.774299] [INFO ] [MAIN ] Update Progress: 1826/2369 symbols completed. RNST took 26.1s. Estimated remaining: 57m 41s. Rate: 9.4 symbols/min [2025-09-16T20:14:00.947139] [INFO ] [MAIN ] RPM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:14:00.977352] [DEBUG] [LOCAL ] RPM: Loaded 30551 existing records from primary storage. [2025-09-16T20:14:00.977489] [INFO ] [MAIN ] RPM: Loaded 30551 existing records. [2025-09-16T20:14:01.153542] [WARN ] [MAIN ] RPM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:14:01.153857] [INFO ] [MAIN ] RPM: Wiping existing primary data before full refresh. [2025-09-16T20:14:01.153904] [INFO ] [LOCAL ] RPM: Starting deletion of primary data. [2025-09-16T20:14:01.154929] [DEBUG] [LOCAL ] RPM: Deleted primary data file. [2025-09-16T20:14:01.154981] [INFO ] [MAIN ] RPM: Starting full primary refresh. [2025-09-16T20:14:01.185306] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-06. [2025-09-16T20:14:01.539215] [INFO ] [REMOTE ] RPM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:14:01.974890] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-02. [2025-09-16T20:14:02.229778] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-16T20:14:02.774968] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-07. [2025-09-16T20:14:02.888522] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-16T20:14:03.134580] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-16T20:14:03.574896] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-07. [2025-09-16T20:14:04.039800] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-16T20:14:04.374908] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-04. [2025-09-16T20:14:05.174897] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-08. [2025-09-16T20:14:05.276226] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-16T20:14:05.974926] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-08. [2025-09-16T20:14:06.219362] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-16T20:14:06.321525] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-16T20:14:06.774930] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-03. [2025-09-16T20:14:07.574955] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-05. [2025-09-16T20:14:07.629558] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-16T20:14:08.010308] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-16T20:14:08.374906] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-09. [2025-09-16T20:14:08.942701] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-16T20:14:09.174906] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-06. [2025-09-16T20:14:09.974909] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-04. [2025-09-16T20:14:10.003306] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-16T20:14:10.009479] [INFO ] [REMOTE ] ROK: Full fetch complete (48035 records). [2025-09-16T20:14:10.009608] [DEBUG] [VALIDATOR ] ROK: Validating primary data. [2025-09-16T20:14:10.399298] [DEBUG] [VALIDATOR ] ROK: All expected trading days are present. [2025-09-16T20:14:10.399383] [DEBUG] [VALIDATOR ] ROK: Primary data validation passed. [2025-09-16T20:14:10.400272] [INFO ] [MAIN ] ROK: Fetched primary data is valid. [2025-09-16T20:14:10.400319] [DEBUG] [LOCAL ] ROK: Saving primary data. [2025-09-16T20:14:10.401368] [DEBUG] [LOCAL ] ROK: Trimmed 48035 records to 32359 (keeping 150 days of data) [2025-09-16T20:14:10.625010] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-16T20:14:10.652656] [DEBUG] [LOCAL ] ROK: Primary data saved (32359 records). [2025-09-16T20:14:10.652810] [INFO ] [MAIN ] ROK: Full history saved. [2025-09-16T20:14:10.652900] [INFO ] [MAIN ] Update Progress: 1827/2369 symbols completed. ROK took 21.9s. Estimated remaining: 57m 35s. Rate: 9.4 symbols/min [2025-09-16T20:14:10.780062] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-07. [2025-09-16T20:14:10.827827] [INFO ] [MAIN ] RPT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:14:10.842548] [DEBUG] [LOCAL ] RPT: Loaded 14420 existing records from primary storage. [2025-09-16T20:14:10.842686] [INFO ] [MAIN ] RPT: Loaded 14420 existing records. [2025-09-16T20:14:11.015482] [WARN ] [MAIN ] RPT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:14:11.015752] [INFO ] [MAIN ] RPT: Wiping existing primary data before full refresh. [2025-09-16T20:14:11.015799] [INFO ] [LOCAL ] RPT: Starting deletion of primary data. [2025-09-16T20:14:11.016284] [DEBUG] [LOCAL ] RPT: Deleted primary data file. [2025-09-16T20:14:11.016331] [INFO ] [MAIN ] RPT: Starting full primary refresh. [2025-09-16T20:14:11.362124] [INFO ] [REMOTE ] RPT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:14:11.574958] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-09. [2025-09-16T20:14:11.706462] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-16T20:14:12.357221] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-16T20:14:12.359963] [INFO ] [REMOTE ] ROG: Full fetch complete (25237 records). [2025-09-16T20:14:12.360049] [DEBUG] [VALIDATOR ] ROG: Validating primary data. [2025-09-16T20:14:12.381997] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-05. [2025-09-16T20:14:12.746584] [DEBUG] [VALIDATOR ] ROG: All expected trading days are present. [2025-09-16T20:14:12.746730] [DEBUG] [VALIDATOR ] ROG: Primary data validation passed. [2025-09-16T20:14:12.747306] [INFO ] [MAIN ] ROG: Fetched primary data is valid. [2025-09-16T20:14:12.747383] [DEBUG] [LOCAL ] ROG: Saving primary data. [2025-09-16T20:14:12.748125] [DEBUG] [LOCAL ] ROG: Trimmed 25237 records to 16504 (keeping 150 days of data) [2025-09-16T20:14:12.862406] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-16T20:14:12.893582] [DEBUG] [LOCAL ] ROG: Primary data saved (16504 records). [2025-09-16T20:14:12.893729] [INFO ] [MAIN ] ROG: Full history saved. [2025-09-16T20:14:12.893810] [INFO ] [MAIN ] Update Progress: 1828/2369 symbols completed. ROG took 25.5s. Estimated remaining: 57m 28s. Rate: 9.4 symbols/min [2025-09-16T20:14:13.069248] [INFO ] [MAIN ] RQI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:14:13.089733] [DEBUG] [LOCAL ] RQI: Loaded 20791 existing records from primary storage. [2025-09-16T20:14:13.089891] [INFO ] [MAIN ] RQI: Loaded 20791 existing records. [2025-09-16T20:14:13.181859] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-08. [2025-09-16T20:14:13.271909] [WARN ] [MAIN ] RQI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:14:13.272139] [INFO ] [MAIN ] RQI: Wiping existing primary data before full refresh. [2025-09-16T20:14:13.272188] [INFO ] [LOCAL ] RQI: Starting deletion of primary data. [2025-09-16T20:14:13.272811] [DEBUG] [LOCAL ] RQI: Deleted primary data file. [2025-09-16T20:14:13.272868] [INFO ] [MAIN ] RQI: Starting full primary refresh. [2025-09-16T20:14:13.633145] [INFO ] [REMOTE ] RQI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:14:13.898290] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-16T20:14:13.974852] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-06. [2025-09-16T20:14:14.774899] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-02. [2025-09-16T20:14:14.870377] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-16T20:14:15.487062] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-16T20:14:15.574884] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-02. [2025-09-16T20:14:15.824482] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-16T20:14:16.374914] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-03. [2025-09-16T20:14:16.578047] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-16T20:14:17.174911] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-09. [2025-09-16T20:14:17.401090] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-16T20:14:17.974911] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-03. [2025-09-16T20:14:18.389961] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-16T20:14:18.395920] [INFO ] [REMOTE ] ROL: Full fetch complete (54743 records). [2025-09-16T20:14:18.396030] [DEBUG] [VALIDATOR ] ROL: Validating primary data. [2025-09-16T20:14:18.779418] [DEBUG] [VALIDATOR ] ROL: All expected trading days are present. [2025-09-16T20:14:18.779487] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-04. [2025-09-16T20:14:18.780505] [DEBUG] [VALIDATOR ] ROL: Primary data validation passed. [2025-09-16T20:14:18.781528] [INFO ] [MAIN ] ROL: Fetched primary data is valid. [2025-09-16T20:14:18.781683] [DEBUG] [LOCAL ] ROL: Saving primary data. [2025-09-16T20:14:18.782975] [DEBUG] [LOCAL ] ROL: Trimmed 54743 records to 37082 (keeping 150 days of data) [2025-09-16T20:14:18.928566] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-16T20:14:19.040784] [DEBUG] [LOCAL ] ROL: Primary data saved (37082 records). [2025-09-16T20:14:19.040941] [INFO ] [MAIN ] ROL: Full history saved. [2025-09-16T20:14:19.041043] [INFO ] [MAIN ] Update Progress: 1829/2369 symbols completed. ROL took 28.8s. Estimated remaining: 57m 21s. Rate: 9.4 symbols/min [2025-09-16T20:14:19.211219] [INFO ] [MAIN ] RRC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:14:19.247335] [DEBUG] [LOCAL ] RRC: Loaded 38931 existing records from primary storage. [2025-09-16T20:14:19.247475] [INFO ] [MAIN ] RRC: Loaded 38931 existing records. [2025-09-16T20:14:19.438691] [WARN ] [MAIN ] RRC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:14:19.439055] [INFO ] [MAIN ] RRC: Wiping existing primary data before full refresh. [2025-09-16T20:14:19.439134] [INFO ] [LOCAL ] RRC: Starting deletion of primary data. [2025-09-16T20:14:19.440208] [DEBUG] [LOCAL ] RRC: Deleted primary data file. [2025-09-16T20:14:19.440286] [INFO ] [MAIN ] RRC: Starting full primary refresh. [2025-09-16T20:14:19.580030] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-07. [2025-09-16T20:14:19.812315] [INFO ] [REMOTE ] RRC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:14:19.959725] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-16T20:14:20.374911] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-05. [2025-09-16T20:14:21.188604] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-04. [2025-09-16T20:14:21.195272] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-16T20:14:21.404189] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-16T20:14:21.974902] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-02. [2025-09-16T20:14:22.586386] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-16T20:14:22.774928] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-06. [2025-09-16T20:14:23.279954] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-16T20:14:23.574917] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-08. [2025-09-16T20:14:23.925565] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-16T20:14:24.374902] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-07. [2025-09-16T20:14:25.174901] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-03. [2025-09-16T20:14:25.303923] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-16T20:14:25.368509] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-16T20:14:25.974919] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-08. [2025-09-16T20:14:26.774933] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-09. [2025-09-16T20:14:26.861837] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-16T20:14:26.965841] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-16T20:14:27.574937] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-09. [2025-09-16T20:14:28.217083] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-16T20:14:28.221555] [INFO ] [REMOTE ] RPM: Full fetch complete (44401 records). [2025-09-16T20:14:28.221705] [DEBUG] [VALIDATOR ] RPM: Validating primary data. [2025-09-16T20:14:28.376720] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-05. [2025-09-16T20:14:28.604283] [DEBUG] [VALIDATOR ] RPM: All expected trading days are present. [2025-09-16T20:14:28.604377] [DEBUG] [VALIDATOR ] RPM: Primary data validation passed. [2025-09-16T20:14:28.605281] [INFO ] [MAIN ] RPM: Fetched primary data is valid. [2025-09-16T20:14:28.605330] [DEBUG] [LOCAL ] RPM: Saving primary data. [2025-09-16T20:14:28.606461] [DEBUG] [LOCAL ] RPM: Trimmed 44401 records to 30788 (keeping 150 days of data) [2025-09-16T20:14:28.731202] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-16T20:14:28.735491] [INFO ] [REMOTE ] RPT: Full fetch complete (21256 records). [2025-09-16T20:14:28.736846] [DEBUG] [VALIDATOR ] RPT: Validating primary data. [2025-09-16T20:14:29.176793] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-04. [2025-09-16T20:14:29.192271] [DEBUG] [VALIDATOR ] RPT: All expected trading days are present. [2025-09-16T20:14:29.192781] [DEBUG] [VALIDATOR ] RPT: Primary data validation passed. [2025-09-16T20:14:29.195534] [INFO ] [MAIN ] RPT: Fetched primary data is valid. [2025-09-16T20:14:29.195614] [DEBUG] [LOCAL ] RPT: Saving primary data. [2025-09-16T20:14:29.205955] [DEBUG] [LOCAL ] RPT: Trimmed 21256 records to 14514 (keeping 150 days of data) [2025-09-16T20:14:29.250394] [DEBUG] [LOCAL ] RPM: Primary data saved (30788 records). [2025-09-16T20:14:29.250684] [INFO ] [MAIN ] RPM: Full history saved. [2025-09-16T20:14:29.259838] [INFO ] [MAIN ] Update Progress: 1830/2369 symbols completed. RPM took 28.5s. Estimated remaining: 57m 16s. Rate: 9.4 symbols/min [2025-09-16T20:14:29.481403] [INFO ] [MAIN ] RRX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:14:29.495671] [DEBUG] [LOCAL ] RPT: Primary data saved (14514 records). [2025-09-16T20:14:29.496117] [INFO ] [MAIN ] RPT: Full history saved. [2025-09-16T20:14:29.496246] [INFO ] [MAIN ] Update Progress: 1831/2369 symbols completed. RPT took 18.8s. Estimated remaining: 57m 8s. Rate: 9.4 symbols/min [2025-09-16T20:14:29.730157] [INFO ] [MAIN ] RS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:14:29.745096] [DEBUG] [LOCAL ] RRX: Loaded 29859 existing records from primary storage. [2025-09-16T20:14:29.751663] [INFO ] [MAIN ] RRX: Loaded 29859 existing records. [2025-09-16T20:14:29.801010] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-16T20:14:29.966909] [DEBUG] [LOCAL ] RS: Loaded 17927 existing records from primary storage. [2025-09-16T20:14:29.967096] [WARN ] [MAIN ] RRX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:14:29.967616] [INFO ] [MAIN ] RRX: Wiping existing primary data before full refresh. [2025-09-16T20:14:29.967411] [INFO ] [MAIN ] RS: Loaded 17927 existing records. [2025-09-16T20:14:29.967777] [INFO ] [LOCAL ] RRX: Starting deletion of primary data. [2025-09-16T20:14:29.981230] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-06. [2025-09-16T20:14:30.005008] [DEBUG] [LOCAL ] RRX: Deleted primary data file. [2025-09-16T20:14:30.013381] [INFO ] [MAIN ] RRX: Starting full primary refresh. [2025-09-16T20:14:30.337127] [WARN ] [MAIN ] RS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:14:30.345028] [INFO ] [MAIN ] RS: Wiping existing primary data before full refresh. [2025-09-16T20:14:30.353144] [INFO ] [LOCAL ] RS: Starting deletion of primary data. [2025-09-16T20:14:30.441542] [DEBUG] [LOCAL ] RS: Deleted primary data file. [2025-09-16T20:14:30.463680] [INFO ] [MAIN ] RS: Starting full primary refresh. [2025-09-16T20:14:30.675252] [INFO ] [REMOTE ] RRX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:14:30.805970] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-02. [2025-09-16T20:14:30.955620] [INFO ] [REMOTE ] RS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:14:30.992288] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-16T20:14:31.197313] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-16T20:14:31.574912] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-05. [2025-09-16T20:14:32.382306] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-02. [2025-09-16T20:14:32.384978] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-16T20:14:33.174909] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-03. [2025-09-16T20:14:33.332400] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-16T20:14:33.886099] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-16T20:14:33.974892] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-06. [2025-09-16T20:14:34.740506] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-16T20:14:34.774861] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-04. [2025-09-16T20:14:35.389713] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-16T20:14:35.574910] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-07. [2025-09-16T20:14:36.374904] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-07. [2025-09-16T20:14:36.428950] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-16T20:14:36.697547] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-16T20:14:37.174955] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-08. [2025-09-16T20:14:37.974888] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-05. [2025-09-16T20:14:38.087056] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-16T20:14:38.479097] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-16T20:14:38.774948] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-03. [2025-09-16T20:14:39.364758] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-16T20:14:39.574910] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-06. [2025-09-16T20:14:40.139578] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-16T20:14:40.374977] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-09. [2025-09-16T20:14:40.975519] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-16T20:14:41.174881] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-07. [2025-09-16T20:14:41.701782] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-16T20:14:41.707443] [INFO ] [REMOTE ] RQI: Full fetch complete (31578 records). [2025-09-16T20:14:41.707547] [DEBUG] [VALIDATOR ] RQI: Validating primary data. [2025-09-16T20:14:41.984044] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-04. [2025-09-16T20:14:42.097739] [DEBUG] [VALIDATOR ] RQI: All expected trading days are present. [2025-09-16T20:14:42.097816] [DEBUG] [VALIDATOR ] RQI: Primary data validation passed. [2025-09-16T20:14:42.098461] [INFO ] [MAIN ] RQI: Fetched primary data is valid. [2025-09-16T20:14:42.098503] [DEBUG] [LOCAL ] RQI: Saving primary data. [2025-09-16T20:14:42.099501] [DEBUG] [LOCAL ] RQI: Trimmed 31578 records to 21100 (keeping 150 days of data) [2025-09-16T20:14:42.233951] [DEBUG] [LOCAL ] RQI: Primary data saved (21100 records). [2025-09-16T20:14:42.234073] [INFO ] [MAIN ] RQI: Full history saved. [2025-09-16T20:14:42.234181] [INFO ] [MAIN ] Update Progress: 1832/2369 symbols completed. RQI took 29.3s. Estimated remaining: 57m 3s. Rate: 9.4 symbols/min [2025-09-16T20:14:42.405232] [INFO ] [MAIN ] RSF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:14:42.431792] [DEBUG] [LOCAL ] RSF: Loaded 3387 existing records from primary storage. [2025-09-16T20:14:42.432354] [INFO ] [MAIN ] RSF: Loaded 3387 existing records. [2025-09-16T20:14:42.438981] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-16T20:14:42.616697] [WARN ] [MAIN ] RSF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:14:42.616924] [INFO ] [MAIN ] RSF: Wiping existing primary data before full refresh. [2025-09-16T20:14:42.616969] [INFO ] [LOCAL ] RSF: Starting deletion of primary data. [2025-09-16T20:14:42.617154] [DEBUG] [LOCAL ] RSF: Deleted primary data file. [2025-09-16T20:14:42.617195] [INFO ] [MAIN ] RSF: Starting full primary refresh. [2025-09-16T20:14:42.793049] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-08. [2025-09-16T20:14:42.974265] [INFO ] [REMOTE ] RSF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:14:43.378331] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-16T20:14:43.574937] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-02. [2025-09-16T20:14:44.066672] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-16T20:14:44.374918] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-08. [2025-09-16T20:14:44.421588] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-16T20:14:45.174944] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-09. [2025-09-16T20:14:45.974925] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-03. [2025-09-16T20:14:46.124014] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-16T20:14:46.453557] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-16T20:14:46.727368] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-16T20:14:46.733252] [INFO ] [REMOTE ] RRX: Full fetch complete (44812 records). [2025-09-16T20:14:46.733406] [DEBUG] [VALIDATOR ] RRX: Validating primary data. [2025-09-16T20:14:46.780261] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-05. [2025-09-16T20:14:47.262241] [DEBUG] [VALIDATOR ] RRX: All expected trading days are present. [2025-09-16T20:14:47.262376] [DEBUG] [VALIDATOR ] RRX: Primary data validation passed. [2025-09-16T20:14:47.264241] [INFO ] [MAIN ] RRX: Fetched primary data is valid. [2025-09-16T20:14:47.264367] [DEBUG] [LOCAL ] RRX: Saving primary data. [2025-09-16T20:14:47.266036] [DEBUG] [LOCAL ] RRX: Trimmed 44812 records to 30168 (keeping 150 days of data) [2025-09-16T20:14:47.551987] [DEBUG] [LOCAL ] RRX: Primary data saved (30168 records). [2025-09-16T20:14:47.552190] [INFO ] [MAIN ] RRX: Full history saved. [2025-09-16T20:14:47.552336] [INFO ] [MAIN ] Update Progress: 1833/2369 symbols completed. RRX took 18.3s. Estimated remaining: 56m 57s. Rate: 9.4 symbols/min [2025-09-16T20:14:47.581062] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-04. [2025-09-16T20:14:47.806603] [INFO ] [MAIN ] RSG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:14:47.851483] [DEBUG] [LOCAL ] RSG: Loaded 34830 existing records from primary storage. [2025-09-16T20:14:47.851696] [INFO ] [MAIN ] RSG: Loaded 34830 existing records. [2025-09-16T20:14:48.050062] [WARN ] [MAIN ] RSG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:14:48.050454] [INFO ] [MAIN ] RSG: Wiping existing primary data before full refresh. [2025-09-16T20:14:48.050565] [INFO ] [LOCAL ] RSG: Starting deletion of primary data. [2025-09-16T20:14:48.056701] [DEBUG] [LOCAL ] RSG: Deleted primary data file. [2025-09-16T20:14:48.064242] [INFO ] [MAIN ] RSG: Starting full primary refresh. [2025-09-16T20:14:48.107992] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-16T20:14:48.312796] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-16T20:14:48.379936] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-09. [2025-09-16T20:14:48.429126] [INFO ] [REMOTE ] RSG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:14:49.174909] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-05. [2025-09-16T20:14:49.778192] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-16T20:14:49.974931] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-02. [2025-09-16T20:14:50.047010] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-16T20:14:50.053490] [INFO ] [REMOTE ] RRC: Full fetch complete (57416 records). [2025-09-16T20:14:50.053655] [DEBUG] [VALIDATOR ] RRC: Validating primary data. [2025-09-16T20:14:50.437578] [DEBUG] [VALIDATOR ] RRC: All expected trading days are present. [2025-09-16T20:14:50.437678] [DEBUG] [VALIDATOR ] RRC: Primary data validation passed. [2025-09-16T20:14:50.438623] [INFO ] [MAIN ] RRC: Fetched primary data is valid. [2025-09-16T20:14:50.438704] [DEBUG] [LOCAL ] RRC: Saving primary data. [2025-09-16T20:14:50.440273] [DEBUG] [LOCAL ] RRC: Trimmed 57416 records to 39320 (keeping 150 days of data) [2025-09-16T20:14:50.685840] [DEBUG] [LOCAL ] RRC: Primary data saved (39320 records). [2025-09-16T20:14:50.685979] [INFO ] [MAIN ] RRC: Full history saved. [2025-09-16T20:14:50.686116] [INFO ] [MAIN ] Update Progress: 1834/2369 symbols completed. RRC took 31.6s. Estimated remaining: 56m 49s. Rate: 9.4 symbols/min [2025-09-16T20:14:50.784322] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-06. [2025-09-16T20:14:50.858549] [INFO ] [MAIN ] RSI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:14:50.896826] [DEBUG] [LOCAL ] RSI: Loaded 34276 existing records from primary storage. [2025-09-16T20:14:50.896966] [INFO ] [MAIN ] RSI: Loaded 34276 existing records. [2025-09-16T20:14:51.072814] [WARN ] [MAIN ] RSI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:14:51.073063] [INFO ] [MAIN ] RSI: Wiping existing primary data before full refresh. [2025-09-16T20:14:51.073117] [INFO ] [LOCAL ] RSI: Starting deletion of primary data. [2025-09-16T20:14:51.073720] [DEBUG] [LOCAL ] RSI: Deleted primary data file. [2025-09-16T20:14:51.073768] [INFO ] [MAIN ] RSI: Starting full primary refresh. [2025-09-16T20:14:51.423275] [INFO ] [REMOTE ] RSI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:14:51.579959] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-02. [2025-09-16T20:14:51.593502] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-16T20:14:52.097801] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-16T20:14:52.374900] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-07. [2025-09-16T20:14:53.181476] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-03. [2025-09-16T20:14:53.207336] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-16T20:14:53.675168] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-16T20:14:53.974909] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-03. [2025-09-16T20:14:54.774959] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-08. [2025-09-16T20:14:55.046076] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-16T20:14:55.579988] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-06. [2025-09-16T20:14:55.592437] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-16T20:14:55.754602] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-16T20:14:56.277388] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-16T20:14:56.374876] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-04. [2025-09-16T20:14:57.174930] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-07. [2025-09-16T20:14:57.890357] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-16T20:14:57.974919] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-08. [2025-09-16T20:14:58.430772] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-16T20:14:58.434300] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-16T20:14:58.774946] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-05. [2025-09-16T20:14:59.574914] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-09. [2025-09-16T20:15:00.325002] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-16T20:15:00.374934] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-04. [2025-09-16T20:15:00.784274] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-16T20:15:00.787180] [INFO ] [REMOTE ] RS: Full fetch complete (28683 records). [2025-09-16T20:15:00.787256] [DEBUG] [VALIDATOR ] RS: Validating primary data. [2025-09-16T20:15:01.179774] [DEBUG] [VALIDATOR ] RS: All expected trading days are present. [2025-09-16T20:15:01.179385] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-06. [2025-09-16T20:15:01.180196] [DEBUG] [VALIDATOR ] RS: Primary data validation passed. [2025-09-16T20:15:01.181525] [INFO ] [MAIN ] RS: Fetched primary data is valid. [2025-09-16T20:15:01.181577] [DEBUG] [LOCAL ] RS: Saving primary data. [2025-09-16T20:15:01.182528] [DEBUG] [LOCAL ] RS: Trimmed 28683 records to 18087 (keeping 150 days of data) [2025-09-16T20:15:01.306482] [DEBUG] [LOCAL ] RS: Primary data saved (18087 records). [2025-09-16T20:15:01.306661] [INFO ] [MAIN ] RS: Full history saved. [2025-09-16T20:15:01.306807] [INFO ] [MAIN ] Update Progress: 1835/2369 symbols completed. RS took 31.8s. Estimated remaining: 56m 44s. Rate: 9.4 symbols/min [2025-09-16T20:15:01.498462] [INFO ] [MAIN ] RSKD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:15:01.522963] [DEBUG] [LOCAL ] RSKD: Loaded 24745 existing records from primary storage. [2025-09-16T20:15:01.523125] [INFO ] [MAIN ] RSKD: Loaded 24745 existing records. [2025-09-16T20:15:01.722973] [WARN ] [MAIN ] RSKD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:15:01.723313] [INFO ] [MAIN ] RSKD: Wiping existing primary data before full refresh. [2025-09-16T20:15:01.723371] [INFO ] [LOCAL ] RSKD: Starting deletion of primary data. [2025-09-16T20:15:01.724184] [DEBUG] [LOCAL ] RSKD: Deleted primary data file. [2025-09-16T20:15:01.724238] [INFO ] [MAIN ] RSKD: Starting full primary refresh. [2025-09-16T20:15:01.988090] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-09. [2025-09-16T20:15:02.131772] [INFO ] [REMOTE ] RSKD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:15:02.163320] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-16T20:15:02.774908] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-05. [2025-09-16T20:15:02.805315] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-16T20:15:02.806410] [INFO ] [REMOTE ] RSF: Full fetch complete (4438 records). [2025-09-16T20:15:02.806481] [DEBUG] [VALIDATOR ] RSF: Validating primary data. [2025-09-16T20:15:03.185943] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-16T20:15:03.214837] [DEBUG] [VALIDATOR ] RSF: All expected trading days are present. [2025-09-16T20:15:03.214988] [DEBUG] [VALIDATOR ] RSF: Primary data validation passed. [2025-09-16T20:15:03.215131] [INFO ] [MAIN ] RSF: Fetched primary data is valid. [2025-09-16T20:15:03.215170] [DEBUG] [LOCAL ] RSF: Saving primary data. [2025-09-16T20:15:03.215852] [DEBUG] [LOCAL ] RSF: Trimmed 4438 records to 3399 (keeping 150 days of data) [2025-09-16T20:15:03.238439] [DEBUG] [LOCAL ] RSF: Primary data saved (3399 records). [2025-09-16T20:15:03.238510] [INFO ] [MAIN ] RSF: Full history saved. [2025-09-16T20:15:03.238584] [INFO ] [MAIN ] Update Progress: 1836/2369 symbols completed. RSF took 21.0s. Estimated remaining: 56m 37s. Rate: 9.4 symbols/min [2025-09-16T20:15:03.406179] [INFO ] [MAIN ] RTO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:15:03.443179] [DEBUG] [LOCAL ] RTO: Loaded 28955 existing records from primary storage. [2025-09-16T20:15:03.443363] [INFO ] [MAIN ] RTO: Loaded 28955 existing records. [2025-09-16T20:15:03.586258] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-07. [2025-09-16T20:15:03.622674] [WARN ] [MAIN ] RTO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:15:03.622862] [INFO ] [MAIN ] RTO: Wiping existing primary data before full refresh. [2025-09-16T20:15:03.622905] [INFO ] [LOCAL ] RTO: Starting deletion of primary data. [2025-09-16T20:15:03.623615] [DEBUG] [LOCAL ] RTO: Deleted primary data file. [2025-09-16T20:15:03.623680] [INFO ] [MAIN ] RTO: Starting full primary refresh. [2025-09-16T20:15:03.972153] [INFO ] [REMOTE ] RTO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:15:04.374924] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-02. [2025-09-16T20:15:04.584063] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-16T20:15:05.174930] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-06. [2025-09-16T20:15:05.410905] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-16T20:15:05.820745] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-16T20:15:05.974934] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-08. [2025-09-16T20:15:06.672346] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-16T20:15:06.774868] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-07. [2025-09-16T20:15:07.574865] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-03. [2025-09-16T20:15:07.605064] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-16T20:15:08.016956] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-16T20:15:08.374954] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-08. [2025-09-16T20:15:09.174953] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-09. [2025-09-16T20:15:09.426260] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-16T20:15:09.738381] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-16T20:15:09.974938] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-02. [2025-09-16T20:15:10.774945] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-04. [2025-09-16T20:15:10.910515] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-16T20:15:10.916358] [INFO ] [REMOTE ] RSG: Full fetch complete (51513 records). [2025-09-16T20:15:10.916508] [DEBUG] [VALIDATOR ] RSG: Validating primary data. [2025-09-16T20:15:11.292009] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-16T20:15:11.329940] [DEBUG] [VALIDATOR ] RSG: All expected trading days are present. [2025-09-16T20:15:11.330002] [DEBUG] [VALIDATOR ] RSG: Primary data validation passed. [2025-09-16T20:15:11.330895] [INFO ] [MAIN ] RSG: Fetched primary data is valid. [2025-09-16T20:15:11.330940] [DEBUG] [LOCAL ] RSG: Saving primary data. [2025-09-16T20:15:11.331935] [DEBUG] [LOCAL ] RSG: Trimmed 51513 records to 35194 (keeping 150 days of data) [2025-09-16T20:15:11.556491] [DEBUG] [LOCAL ] RSG: Primary data saved (35194 records). [2025-09-16T20:15:11.556626] [INFO ] [MAIN ] RSG: Full history saved. [2025-09-16T20:15:11.557449] [INFO ] [MAIN ] Update Progress: 1837/2369 symbols completed. RSG took 24.0s. Estimated remaining: 56m 31s. Rate: 9.4 symbols/min [2025-09-16T20:15:11.574915] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-09. [2025-09-16T20:15:12.374955] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-03. [2025-09-16T20:15:12.506602] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-16T20:15:13.141752] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-16T20:15:13.147736] [INFO ] [REMOTE ] RSI: Full fetch complete (51784 records). [2025-09-16T20:15:13.147883] [DEBUG] [VALIDATOR ] RSI: Validating primary data. [2025-09-16T20:15:13.182727] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-05. [2025-09-16T20:15:13.558741] [DEBUG] [VALIDATOR ] RSI: All expected trading days are present. [2025-09-16T20:15:13.558837] [DEBUG] [VALIDATOR ] RSI: Primary data validation passed. [2025-09-16T20:15:13.559849] [INFO ] [MAIN ] RSI: Fetched primary data is valid. [2025-09-16T20:15:13.559939] [DEBUG] [LOCAL ] RSI: Saving primary data. [2025-09-16T20:15:13.580818] [DEBUG] [LOCAL ] RSI: Trimmed 51784 records to 34601 (keeping 150 days of data) [2025-09-16T20:15:13.582987] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-16T20:15:13.797906] [DEBUG] [LOCAL ] RSI: Primary data saved (34601 records). [2025-09-16T20:15:13.798117] [INFO ] [MAIN ] RSI: Full history saved. [2025-09-16T20:15:13.798224] [INFO ] [MAIN ] Update Progress: 1838/2369 symbols completed. RSI took 23.1s. Estimated remaining: 56m 23s. Rate: 9.4 symbols/min [2025-09-16T20:15:13.974897] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-04. [2025-09-16T20:15:14.731142] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-16T20:15:14.774876] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-06. [2025-09-16T20:15:15.360429] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-16T20:15:15.574937] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-05. [2025-09-16T20:15:15.935555] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-16T20:15:16.374934] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-07. [2025-09-16T20:15:16.984070] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-16T20:15:17.174928] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-06. [2025-09-16T20:15:17.735687] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-16T20:15:17.974900] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-08. [2025-09-16T20:15:18.358938] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-16T20:15:18.774914] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-07. [2025-09-16T20:15:19.418469] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-16T20:15:19.574892] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-09. [2025-09-16T20:15:20.139059] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-16T20:15:20.374938] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-08. [2025-09-16T20:15:20.843177] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-16T20:15:20.847832] [INFO ] [REMOTE ] RTO: Full fetch complete (43959 records). [2025-09-16T20:15:20.847926] [DEBUG] [VALIDATOR ] RTO: Validating primary data. [2025-09-16T20:15:21.218191] [DEBUG] [VALIDATOR ] RTO: All expected trading days are present. [2025-09-16T20:15:21.218271] [DEBUG] [VALIDATOR ] RTO: Primary data validation passed. [2025-09-16T20:15:21.219198] [INFO ] [MAIN ] RTO: Fetched primary data is valid. [2025-09-16T20:15:21.219246] [DEBUG] [LOCAL ] RTO: Saving primary data. [2025-09-16T20:15:21.220209] [DEBUG] [LOCAL ] RTO: Trimmed 43959 records to 29228 (keeping 150 days of data) [2025-09-16T20:15:21.403632] [DEBUG] [LOCAL ] RTO: Primary data saved (29228 records). [2025-09-16T20:15:21.403782] [INFO ] [MAIN ] RTO: Full history saved. [2025-09-16T20:15:21.404793] [INFO ] [MAIN ] Update Progress: 1839/2369 symbols completed. RTO took 18.2s. Estimated remaining: 56m 17s. Rate: 9.4 symbols/min [2025-09-16T20:15:21.790838] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-16T20:15:21.798697] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-09. [2025-09-16T20:15:23.018443] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-16T20:15:23.022360] [INFO ] [REMOTE ] RSKD: Full fetch complete (36926 records). [2025-09-16T20:15:23.022440] [DEBUG] [VALIDATOR ] RSKD: Validating primary data. [2025-09-16T20:15:23.407403] [DEBUG] [VALIDATOR ] RSKD: All expected trading days are present. [2025-09-16T20:15:23.407478] [DEBUG] [VALIDATOR ] RSKD: Primary data validation passed. [2025-09-16T20:15:23.408213] [INFO ] [MAIN ] RSKD: Fetched primary data is valid. [2025-09-16T20:15:23.408258] [DEBUG] [LOCAL ] RSKD: Saving primary data. [2025-09-16T20:15:23.409064] [DEBUG] [LOCAL ] RSKD: Trimmed 36926 records to 24980 (keeping 150 days of data) [2025-09-16T20:15:23.549445] [DEBUG] [LOCAL ] RSKD: Primary data saved (24980 records). [2025-09-16T20:15:23.549580] [INFO ] [MAIN ] RSKD: Full history saved. [2025-09-16T20:15:23.549680] [INFO ] [MAIN ] Update Progress: 1840/2369 symbols completed. RSKD took 22.2s. Estimated remaining: 56m 10s. Rate: 9.4 symbols/min [2025-09-16T20:15:24.217903] [INFO ] [MAIN ] RVTY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:15:24.247133] [INFO ] [MAIN ] RVLV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:15:24.174372] [INFO ] [MAIN ] RVT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:15:24.322550] [INFO ] [MAIN ] RTX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:15:24.385433] [DEBUG] [LOCAL ] RVT: Loaded 19314 existing records from primary storage. [2025-09-16T20:15:24.387458] [INFO ] [MAIN ] RVT: Loaded 19314 existing records. [2025-09-16T20:15:24.398495] [DEBUG] [LOCAL ] RVLV: Loaded 35067 existing records from primary storage. [2025-09-16T20:15:24.421068] [INFO ] [MAIN ] RVLV: Loaded 35067 existing records. [2025-09-16T20:15:24.536190] [DEBUG] [LOCAL ] RVTY: Loaded 34959 existing records from primary storage. [2025-09-16T20:15:24.542232] [DEBUG] [LOCAL ] RTX: Loaded 39675 existing records from primary storage. [2025-09-16T20:15:24.572449] [INFO ] [MAIN ] RVTY: Loaded 34959 existing records. [2025-09-16T20:15:24.602239] [INFO ] [MAIN ] RTX: Loaded 39675 existing records. [2025-09-16T20:15:25.002113] [WARN ] [MAIN ] RVT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:15:25.096945] [INFO ] [MAIN ] RVT: Wiping existing primary data before full refresh. [2025-09-16T20:15:25.077738] [WARN ] [MAIN ] RVLV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:15:25.109398] [INFO ] [LOCAL ] RVT: Starting deletion of primary data. [2025-09-16T20:15:25.167475] [WARN ] [MAIN ] RTX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:15:25.167667] [INFO ] [MAIN ] RVLV: Wiping existing primary data before full refresh. [2025-09-16T20:15:25.182244] [INFO ] [MAIN ] RTX: Wiping existing primary data before full refresh. [2025-09-16T20:15:25.182345] [INFO ] [LOCAL ] RTX: Starting deletion of primary data. [2025-09-16T20:15:25.187107] [INFO ] [LOCAL ] RVLV: Starting deletion of primary data. [2025-09-16T20:15:25.187226] [WARN ] [MAIN ] RVTY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:15:25.182139] [DEBUG] [LOCAL ] RVT: Deleted primary data file. [2025-09-16T20:15:25.187435] [INFO ] [MAIN ] RVT: Starting full primary refresh. [2025-09-16T20:15:25.198407] [DEBUG] [LOCAL ] RTX: Deleted primary data file. [2025-09-16T20:15:25.187657] [INFO ] [MAIN ] RVTY: Wiping existing primary data before full refresh. [2025-09-16T20:15:25.207884] [DEBUG] [LOCAL ] RVLV: Deleted primary data file. [2025-09-16T20:15:25.207990] [INFO ] [MAIN ] RTX: Starting full primary refresh. [2025-09-16T20:15:25.221819] [INFO ] [LOCAL ] RVTY: Starting deletion of primary data. [2025-09-16T20:15:25.284450] [DEBUG] [LOCAL ] RVTY: Deleted primary data file. [2025-09-16T20:15:25.289718] [INFO ] [MAIN ] RVTY: Starting full primary refresh. [2025-09-16T20:15:25.275735] [INFO ] [MAIN ] RVLV: Starting full primary refresh. [2025-09-16T20:15:26.367347] [INFO ] [REMOTE ] RVT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:15:26.394919] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-02. [2025-09-16T20:15:26.570262] [INFO ] [REMOTE ] RTX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:15:26.617745] [INFO ] [REMOTE ] RVTY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:15:26.641027] [INFO ] [REMOTE ] RVLV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:15:26.606946] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-02. [2025-09-16T20:15:26.642297] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-02. [2025-09-16T20:15:26.642566] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-02. [2025-09-16T20:15:27.653614] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-16T20:15:27.659034] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-03. [2025-09-16T20:15:28.224790] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-16T20:15:28.233393] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-03. [2025-09-16T20:15:28.556573] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-16T20:15:28.565844] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-03. [2025-09-16T20:15:28.808816] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-09-16T20:15:28.819317] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-03. [2025-09-16T20:15:28.949909] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-16T20:15:28.957014] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-04. [2025-09-16T20:15:29.880071] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-16T20:15:29.889821] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-04. [2025-09-16T20:15:30.194408] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-16T20:15:30.205132] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-04. [2025-09-16T20:15:30.222929] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-16T20:15:30.774941] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-05. [2025-09-16T20:15:30.955886] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-16T20:15:31.399094] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-16T20:15:31.479486] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-16T20:15:31.574919] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-05. [2025-09-16T20:15:31.761746] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-16T20:15:32.374912] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-06. [2025-09-16T20:15:33.174912] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-04. [2025-09-16T20:15:33.277194] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-16T20:15:33.346791] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-16T20:15:33.974907] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-05. [2025-09-16T20:15:34.774863] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-06. [2025-09-16T20:15:35.290846] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-16T20:15:35.331442] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-16T20:15:35.574905] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-07. [2025-09-16T20:15:36.296614] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-16T20:15:36.374866] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-07. [2025-09-16T20:15:36.971278] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-16T20:15:37.174888] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-08. [2025-09-16T20:15:37.974916] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-06. [2025-09-16T20:15:38.008976] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-16T20:15:38.094155] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-16T20:15:38.774908] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-08. [2025-09-16T20:15:39.528190] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-16T20:15:39.574946] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-07. [2025-09-16T20:15:40.292980] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-16T20:15:40.374964] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-09. [2025-09-16T20:15:41.167957] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-16T20:15:41.177345] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-05. [2025-09-16T20:15:41.640489] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-16T20:15:41.646307] [INFO ] [REMOTE ] RVTY: Full fetch complete (51380 records). [2025-09-16T20:15:41.646470] [DEBUG] [VALIDATOR ] RVTY: Validating primary data. [2025-09-16T20:15:41.979988] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-09. [2025-09-16T20:15:42.044198] [DEBUG] [VALIDATOR ] RVTY: All expected trading days are present. [2025-09-16T20:15:42.044278] [DEBUG] [VALIDATOR ] RVTY: Primary data validation passed. [2025-09-16T20:15:42.045274] [INFO ] [MAIN ] RVTY: Fetched primary data is valid. [2025-09-16T20:15:42.045321] [DEBUG] [LOCAL ] RVTY: Saving primary data. [2025-09-16T20:15:42.046427] [DEBUG] [LOCAL ] RVTY: Trimmed 51380 records to 35314 (keeping 150 days of data) [2025-09-16T20:15:42.263009] [DEBUG] [LOCAL ] RVTY: Primary data saved (35314 records). [2025-09-16T20:15:42.263171] [INFO ] [MAIN ] RVTY: Full history saved. [2025-09-16T20:15:42.263259] [INFO ] [MAIN ] Update Progress: 1841/2369 symbols completed. RVTY took 18.7s. Estimated remaining: 56m 7s. Rate: 9.4 symbols/min [2025-09-16T20:15:42.431087] [INFO ] [MAIN ] RWT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:15:42.461447] [DEBUG] [LOCAL ] RWT: Loaded 29329 existing records from primary storage. [2025-09-16T20:15:42.461596] [INFO ] [MAIN ] RWT: Loaded 29329 existing records. [2025-09-16T20:15:42.637487] [WARN ] [MAIN ] RWT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:15:42.637813] [INFO ] [MAIN ] RWT: Wiping existing primary data before full refresh. [2025-09-16T20:15:42.637883] [INFO ] [LOCAL ] RWT: Starting deletion of primary data. [2025-09-16T20:15:42.638607] [DEBUG] [LOCAL ] RWT: Deleted primary data file. [2025-09-16T20:15:42.638696] [INFO ] [MAIN ] RWT: Starting full primary refresh. [2025-09-16T20:15:42.780635] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-08. [2025-09-16T20:15:43.019722] [INFO ] [REMOTE ] RWT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:15:43.029178] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-16T20:15:43.032765] [INFO ] [REMOTE ] RVT: Full fetch complete (29719 records). [2025-09-16T20:15:43.032904] [DEBUG] [VALIDATOR ] RVT: Validating primary data. [2025-09-16T20:15:43.368924] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-16T20:15:43.444434] [DEBUG] [VALIDATOR ] RVT: All expected trading days are present. [2025-09-16T20:15:43.444543] [DEBUG] [VALIDATOR ] RVT: Primary data validation passed. [2025-09-16T20:15:43.445230] [INFO ] [MAIN ] RVT: Fetched primary data is valid. [2025-09-16T20:15:43.445276] [DEBUG] [LOCAL ] RVT: Saving primary data. [2025-09-16T20:15:43.446013] [DEBUG] [LOCAL ] RVT: Trimmed 29719 records to 19541 (keeping 150 days of data) [2025-09-16T20:15:43.563485] [DEBUG] [LOCAL ] RVT: Primary data saved (19541 records). [2025-09-16T20:15:43.563635] [INFO ] [MAIN ] RVT: Full history saved. [2025-09-16T20:15:43.564250] [INFO ] [MAIN ] Update Progress: 1842/2369 symbols completed. RVT took 20.0s. Estimated remaining: 55m 59s. Rate: 9.4 symbols/min [2025-09-16T20:15:43.585136] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-02. [2025-09-16T20:15:43.738291] [INFO ] [MAIN ] RWTN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:15:43.738465] [DEBUG] [LOCAL ] RWTN: No existing data file found in primary storage. [2025-09-16T20:15:43.738504] [WARN ] [MAIN ] RWTN: No existing data found, performing full refresh instead. [2025-09-16T20:15:43.738622] [INFO ] [MAIN ] RWTN: Wiping existing primary data before full refresh. [2025-09-16T20:15:43.738680] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-09-16T20:15:43.738724] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-09-16T20:15:43.738756] [INFO ] [MAIN ] RWTN: Starting full primary refresh. [2025-09-16T20:15:44.096637] [INFO ] [REMOTE ] RWTN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:15:44.159437] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-16T20:15:44.374895] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-02. [2025-09-16T20:15:44.656373] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-09-16T20:15:44.705808] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-16T20:15:45.174929] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-03. [2025-09-16T20:15:45.633834] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-16T20:15:45.974933] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-04. [2025-09-16T20:15:46.430840] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-16T20:15:46.774911] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-06. [2025-09-16T20:15:47.574938] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-09. [2025-09-16T20:15:48.374939] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-03. [2025-09-16T20:15:48.782049] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-16T20:15:48.787689] [INFO ] [REMOTE ] RVLV: Full fetch complete (52273 records). [2025-09-16T20:15:48.787788] [DEBUG] [VALIDATOR ] RVLV: Validating primary data. [2025-09-16T20:15:49.177070] [DEBUG] [VALIDATOR ] RVLV: All expected trading days are present. [2025-09-16T20:15:49.177329] [DEBUG] [VALIDATOR ] RVLV: Primary data validation passed. [2025-09-16T20:15:49.178348] [INFO ] [MAIN ] RVLV: Fetched primary data is valid. [2025-09-16T20:15:49.177243] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-05. [2025-09-16T20:15:49.178563] [DEBUG] [LOCAL ] RVLV: Saving primary data. [2025-09-16T20:15:49.180875] [DEBUG] [LOCAL ] RVLV: Trimmed 52273 records to 35444 (keeping 150 days of data) [2025-09-16T20:15:49.303192] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-06 (2.53 seconds). [2025-09-16T20:15:49.436119] [DEBUG] [LOCAL ] RVLV: Primary data saved (35444 records). [2025-09-16T20:15:49.436264] [INFO ] [MAIN ] RVLV: Full history saved. [2025-09-16T20:15:49.436350] [INFO ] [MAIN ] Update Progress: 1843/2369 symbols completed. RVLV took 25.9s. Estimated remaining: 55m 52s. Rate: 9.4 symbols/min [2025-09-16T20:15:49.614797] [INFO ] [MAIN ] RWTO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:15:49.615140] [DEBUG] [LOCAL ] RWTO: No existing data file found in primary storage. [2025-09-16T20:15:49.615238] [WARN ] [MAIN ] RWTO: No existing data found, performing full refresh instead. [2025-09-16T20:15:49.615479] [INFO ] [MAIN ] RWTO: Wiping existing primary data before full refresh. [2025-09-16T20:15:49.615585] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-09-16T20:15:49.615689] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-09-16T20:15:49.615767] [INFO ] [MAIN ] RWTO: Starting full primary refresh. [2025-09-16T20:15:49.841422] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-16T20:15:49.867550] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-16T20:15:49.984929] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-04. [2025-09-16T20:15:50.013816] [INFO ] [REMOTE ] RWTO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:15:50.774945] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-06. [2025-09-16T20:15:51.111842] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-16T20:15:51.574943] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-02. [2025-09-16T20:15:51.661678] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-16T20:15:52.014953] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-16T20:15:52.374911] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-05. [2025-09-16T20:15:53.174899] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-03. [2025-09-16T20:15:53.626779] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-16T20:15:53.630984] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-16T20:15:53.974939] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-07. [2025-09-16T20:15:54.310311] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-16T20:15:54.774911] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-06. [2025-09-16T20:15:55.574918] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-07. [2025-09-16T20:15:56.245132] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-16T20:15:56.374948] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-07. [2025-09-16T20:15:57.174945] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-04. [2025-09-16T20:15:57.642210] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-16T20:15:57.705763] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-16T20:15:57.942825] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-09-16T20:15:57.974903] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-08. [2025-09-16T20:15:58.774943] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-05. [2025-09-16T20:15:59.201523] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-16T20:15:59.574925] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-08. [2025-09-16T20:16:00.121251] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-16T20:16:00.374960] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-09. [2025-09-16T20:16:01.164722] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-16T20:16:01.174853] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-09. [2025-09-16T20:16:01.974987] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-06. [2025-09-16T20:16:02.388402] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-16T20:16:02.395093] [INFO ] [REMOTE ] RTX: Full fetch complete (58391 records). [2025-09-16T20:16:02.395258] [DEBUG] [VALIDATOR ] RTX: Validating primary data. [2025-09-16T20:16:02.489295] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-16T20:16:02.775465] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-07. [2025-09-16T20:16:02.839754] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-16T20:16:02.840279] [DEBUG] [VALIDATOR ] RTX: All expected trading days are present. [2025-09-16T20:16:02.845826] [DEBUG] [VALIDATOR ] RTX: Primary data validation passed. [2025-09-16T20:16:02.847192] [INFO ] [MAIN ] RTX: Fetched primary data is valid. [2025-09-16T20:16:02.847491] [DEBUG] [LOCAL ] RTX: Saving primary data. [2025-09-16T20:16:02.847413] [INFO ] [REMOTE ] RWT: Full fetch complete (43821 records). [2025-09-16T20:16:02.847915] [DEBUG] [VALIDATOR ] RWT: Validating primary data. [2025-09-16T20:16:02.927190] [DEBUG] [LOCAL ] RTX: Trimmed 58391 records to 40065 (keeping 150 days of data) [2025-09-16T20:16:03.391928] [DEBUG] [VALIDATOR ] RWT: All expected trading days are present. [2025-09-16T20:16:03.392056] [DEBUG] [VALIDATOR ] RWT: Primary data validation passed. [2025-09-16T20:16:03.393241] [INFO ] [MAIN ] RWT: Fetched primary data is valid. [2025-09-16T20:16:03.463144] [DEBUG] [LOCAL ] RWT: Saving primary data. [2025-09-16T20:16:03.504120] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-16T20:16:03.504673] [DEBUG] [LOCAL ] RWT: Trimmed 43821 records to 29629 (keeping 150 days of data) [2025-09-16T20:16:03.596373] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-08. [2025-09-16T20:16:03.679130] [DEBUG] [LOCAL ] RTX: Primary data saved (40065 records). [2025-09-16T20:16:03.683554] [INFO ] [MAIN ] RTX: Full history saved. [2025-09-16T20:16:03.695837] [INFO ] [MAIN ] Update Progress: 1844/2369 symbols completed. RTX took 40.1s. Estimated remaining: 55m 48s. Rate: 9.4 symbols/min [2025-09-16T20:16:03.877985] [INFO ] [MAIN ] RWTP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:16:03.885278] [DEBUG] [LOCAL ] RWTP: Loaded 1986 existing records from primary storage. [2025-09-16T20:16:03.886495] [INFO ] [MAIN ] RWTP: Loaded 1986 existing records. [2025-09-16T20:16:04.008747] [DEBUG] [LOCAL ] RWT: Primary data saved (29629 records). [2025-09-16T20:16:04.019081] [INFO ] [MAIN ] RWT: Full history saved. [2025-09-16T20:16:04.033094] [INFO ] [MAIN ] Update Progress: 1845/2369 symbols completed. RWT took 21.8s. Estimated remaining: 55m 40s. Rate: 9.4 symbols/min [2025-09-16T20:16:04.122833] [WARN ] [MAIN ] RWTP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:16:04.185102] [INFO ] [MAIN ] RWTP: Wiping existing primary data before full refresh. [2025-09-16T20:16:04.185502] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-09-16T20:16:04.206690] [DEBUG] [LOCAL ] RWTP: Deleted primary data file. [2025-09-16T20:16:04.227339] [INFO ] [MAIN ] RWTP: Starting full primary refresh. [2025-09-16T20:16:04.327435] [INFO ] [MAIN ] RXO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:16:04.375989] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-08. [2025-09-16T20:16:04.393987] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-16T20:16:04.670950] [INFO ] [REMOTE ] RWTP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:16:04.672249] [DEBUG] [LOCAL ] RXO: Loaded 35301 existing records from primary storage. [2025-09-16T20:16:04.672336] [INFO ] [MAIN ] RXO: Loaded 35301 existing records. [2025-09-16T20:16:04.860450] [WARN ] [MAIN ] RXO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:16:04.860748] [INFO ] [MAIN ] RXO: Wiping existing primary data before full refresh. [2025-09-16T20:16:04.860803] [INFO ] [LOCAL ] RXO: Starting deletion of primary data. [2025-09-16T20:16:04.861628] [DEBUG] [LOCAL ] RXO: Deleted primary data file. [2025-09-16T20:16:04.861703] [INFO ] [MAIN ] RXO: Starting full primary refresh. [2025-09-16T20:16:05.116574] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-16T20:16:05.180124] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-09. [2025-09-16T20:16:05.258100] [INFO ] [REMOTE ] RXO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:16:05.709217] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-16T20:16:05.710381] [INFO ] [REMOTE ] RWTN: Full fetch complete (2259 records). [2025-09-16T20:16:05.710457] [DEBUG] [VALIDATOR ] RWTN: Validating primary data. [2025-09-16T20:16:05.893454] [WARN ] [VALIDATOR ] RWTN: Validation failed - insufficient historical data. Have 147 unique days, need 150 days [2025-09-16T20:16:05.893704] [FATAL] [MAIN ] RWTN: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:16:05.893759] [WARN ] [MAIN ] RWTN: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:16:05.893805] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-09-16T20:16:05.893867] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-09-16T20:16:05.893958] [INFO ] [LOCAL ] RWTN: Starting deletion of derivative data. [2025-09-16T20:16:05.894046] [DEBUG] [LOCAL ] RWTN: No derivative data file found to delete. [2025-09-16T20:16:05.894112] [INFO ] [MAIN ] Update Progress: 1846/2369 symbols completed. RWTN took 22.3s. Estimated remaining: 55m 33s. Rate: 9.4 symbols/min [2025-09-16T20:16:05.980063] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-02. [2025-09-16T20:16:06.088072] [INFO ] [MAIN ] RY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:16:06.130817] [DEBUG] [LOCAL ] RY: Loaded 34981 existing records from primary storage. [2025-09-16T20:16:06.130988] [INFO ] [MAIN ] RY: Loaded 34981 existing records. [2025-09-16T20:16:06.315188] [WARN ] [MAIN ] RY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:16:06.315456] [INFO ] [MAIN ] RY: Wiping existing primary data before full refresh. [2025-09-16T20:16:06.315503] [INFO ] [LOCAL ] RY: Starting deletion of primary data. [2025-09-16T20:16:06.316571] [DEBUG] [LOCAL ] RY: Deleted primary data file. [2025-09-16T20:16:06.316631] [INFO ] [MAIN ] RY: Starting full primary refresh. [2025-09-16T20:16:06.667010] [INFO ] [REMOTE ] RY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:16:06.774964] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-09. [2025-09-16T20:16:07.418236] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-16T20:16:07.419541] [INFO ] [REMOTE ] RWTO: Full fetch complete (3503 records). [2025-09-16T20:16:07.419611] [DEBUG] [VALIDATOR ] RWTO: Validating primary data. [2025-09-16T20:16:07.578735] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-02. [2025-09-16T20:16:07.609690] [WARN ] [VALIDATOR ] RWTO: Validation failed - insufficient historical data. Have 148 unique days, need 150 days [2025-09-16T20:16:07.610763] [FATAL] [MAIN ] RWTO: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:16:07.611356] [WARN ] [MAIN ] RWTO: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:16:07.611680] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-09-16T20:16:07.611876] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-09-16T20:16:07.612030] [INFO ] [LOCAL ] RWTO: Starting deletion of derivative data. [2025-09-16T20:16:07.612106] [DEBUG] [LOCAL ] RWTO: No derivative data file found to delete. [2025-09-16T20:16:07.612247] [INFO ] [MAIN ] Update Progress: 1847/2369 symbols completed. RWTO took 18.2s. Estimated remaining: 55m 25s. Rate: 9.4 symbols/min [2025-09-16T20:16:07.818982] [INFO ] [MAIN ] RYAM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:16:07.821446] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-16T20:16:07.852980] [DEBUG] [LOCAL ] RYAM: Loaded 25610 existing records from primary storage. [2025-09-16T20:16:07.853124] [INFO ] [MAIN ] RYAM: Loaded 25610 existing records. [2025-09-16T20:16:08.066633] [WARN ] [MAIN ] RYAM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:16:08.066919] [INFO ] [MAIN ] RYAM: Wiping existing primary data before full refresh. [2025-09-16T20:16:08.066968] [INFO ] [LOCAL ] RYAM: Starting deletion of primary data. [2025-09-16T20:16:08.067499] [DEBUG] [LOCAL ] RYAM: Deleted primary data file. [2025-09-16T20:16:08.067546] [INFO ] [MAIN ] RYAM: Starting full primary refresh. [2025-09-16T20:16:08.384489] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-02. [2025-09-16T20:16:08.442759] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-16T20:16:08.447005] [INFO ] [REMOTE ] RYAM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:16:09.174943] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-03. [2025-09-16T20:16:09.918821] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-16T20:16:09.974884] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-02. [2025-09-16T20:16:10.774900] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-03. [2025-09-16T20:16:10.890159] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-16T20:16:11.210125] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-16T20:16:11.259993] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-16T20:16:11.574905] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-04. [2025-09-16T20:16:12.374947] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-03. [2025-09-16T20:16:13.174904] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-04. [2025-09-16T20:16:13.357004] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-16T20:16:13.821596] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-16T20:16:13.943283] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-16T20:16:13.974933] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-05. [2025-09-16T20:16:14.525746] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-16T20:16:14.774914] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-04. [2025-09-16T20:16:15.574914] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-03. [2025-09-16T20:16:16.360034] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-16T20:16:16.374839] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-05. [2025-09-16T20:16:17.174910] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-06. [2025-09-16T20:16:17.379348] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-16T20:16:17.500282] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-16T20:16:17.942686] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-16T20:16:17.974963] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-04. [2025-09-16T20:16:18.774899] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-07. [2025-09-16T20:16:19.290120] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-16T20:16:19.574902] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-08. [2025-09-16T20:16:19.822876] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-16T20:16:20.038237] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-16T20:16:20.374907] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-05. [2025-09-16T20:16:21.174970] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-09. [2025-09-16T20:16:21.711273] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-16T20:16:21.712447] [INFO ] [REMOTE ] RWTP: Full fetch complete (3352 records). [2025-09-16T20:16:21.712519] [DEBUG] [VALIDATOR ] RWTP: Validating primary data. [2025-09-16T20:16:21.980096] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-06. [2025-09-16T20:16:22.115244] [DEBUG] [VALIDATOR ] RWTP: All expected trading days are present. [2025-09-16T20:16:22.115350] [DEBUG] [VALIDATOR ] RWTP: Primary data validation passed. [2025-09-16T20:16:22.115579] [INFO ] [MAIN ] RWTP: Fetched primary data is valid. [2025-09-16T20:16:22.115747] [DEBUG] [LOCAL ] RWTP: Saving primary data. [2025-09-16T20:16:22.116326] [DEBUG] [LOCAL ] RWTP: Trimmed 3352 records to 1997 (keeping 150 days of data) [2025-09-16T20:16:22.132370] [DEBUG] [LOCAL ] RWTP: Primary data saved (1997 records). [2025-09-16T20:16:22.132487] [INFO ] [MAIN ] RWTP: Full history saved. [2025-09-16T20:16:22.132620] [INFO ] [MAIN ] Update Progress: 1848/2369 symbols completed. RWTP took 18.4s. Estimated remaining: 55m 21s. Rate: 9.4 symbols/min [2025-09-16T20:16:22.286783] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-16T20:16:22.371958] [INFO ] [MAIN ] RYAN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:16:22.404634] [DEBUG] [LOCAL ] RYAN: Loaded 32151 existing records from primary storage. [2025-09-16T20:16:22.404839] [INFO ] [MAIN ] RYAN: Loaded 32151 existing records. [2025-09-16T20:16:22.593836] [WARN ] [MAIN ] RYAN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:16:22.594158] [INFO ] [MAIN ] RYAN: Wiping existing primary data before full refresh. [2025-09-16T20:16:22.594212] [INFO ] [LOCAL ] RYAN: Starting deletion of primary data. [2025-09-16T20:16:22.595105] [DEBUG] [LOCAL ] RYAN: Deleted primary data file. [2025-09-16T20:16:22.595162] [INFO ] [MAIN ] RYAN: Starting full primary refresh. [2025-09-16T20:16:22.775392] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-05. [2025-09-16T20:16:22.978962] [INFO ] [REMOTE ] RYAN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:16:23.479558] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-16T20:16:23.574906] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-07. [2025-09-16T20:16:24.374932] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-02. [2025-09-16T20:16:24.521297] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-16T20:16:24.582098] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-16T20:16:25.174904] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-06. [2025-09-16T20:16:25.981276] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-08. [2025-09-16T20:16:25.983001] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-16T20:16:26.774911] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-03. [2025-09-16T20:16:26.891130] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-16T20:16:27.540803] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-16T20:16:27.574900] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-09. [2025-09-16T20:16:28.089960] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-16T20:16:28.374874] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-06. [2025-09-16T20:16:28.919057] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-16T20:16:28.923894] [INFO ] [REMOTE ] RYAM: Full fetch complete (37634 records). [2025-09-16T20:16:28.924071] [DEBUG] [VALIDATOR ] RYAM: Validating primary data. [2025-09-16T20:16:29.184556] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-07. [2025-09-16T20:16:29.295320] [DEBUG] [VALIDATOR ] RYAM: All expected trading days are present. [2025-09-16T20:16:29.295399] [DEBUG] [VALIDATOR ] RYAM: Primary data validation passed. [2025-09-16T20:16:29.296173] [INFO ] [MAIN ] RYAM: Fetched primary data is valid. [2025-09-16T20:16:29.296219] [DEBUG] [LOCAL ] RYAM: Saving primary data. [2025-09-16T20:16:29.297075] [DEBUG] [LOCAL ] RYAM: Trimmed 37634 records to 25883 (keeping 150 days of data) [2025-09-16T20:16:29.441700] [DEBUG] [LOCAL ] RYAM: Primary data saved (25883 records). [2025-09-16T20:16:29.441832] [INFO ] [MAIN ] RYAM: Full history saved. [2025-09-16T20:16:29.441916] [INFO ] [MAIN ] Update Progress: 1849/2369 symbols completed. RYAM took 21.8s. Estimated remaining: 55m 15s. Rate: 9.4 symbols/min [2025-09-16T20:16:29.621532] [INFO ] [MAIN ] RYI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:16:29.638330] [DEBUG] [LOCAL ] RYI: Loaded 15971 existing records from primary storage. [2025-09-16T20:16:29.638504] [INFO ] [MAIN ] RYI: Loaded 15971 existing records. [2025-09-16T20:16:29.818164] [WARN ] [MAIN ] RYI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:16:29.818471] [INFO ] [MAIN ] RYI: Wiping existing primary data before full refresh. [2025-09-16T20:16:29.818557] [INFO ] [LOCAL ] RYI: Starting deletion of primary data. [2025-09-16T20:16:29.819176] [DEBUG] [LOCAL ] RYI: Deleted primary data file. [2025-09-16T20:16:29.819236] [INFO ] [MAIN ] RYI: Starting full primary refresh. [2025-09-16T20:16:29.979839] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-04. [2025-09-16T20:16:30.185298] [INFO ] [REMOTE ] RYI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:16:30.213313] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-16T20:16:30.774908] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-02. [2025-09-16T20:16:31.010868] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-16T20:16:31.574931] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-08. [2025-09-16T20:16:31.880923] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-16T20:16:31.915528] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-16T20:16:32.375007] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-07. [2025-09-16T20:16:33.174910] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-03. [2025-09-16T20:16:33.390711] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-16T20:16:33.837447] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-16T20:16:33.935366] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-16T20:16:33.974917] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-09. [2025-09-16T20:16:34.774934] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-08. [2025-09-16T20:16:35.526272] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-16T20:16:35.531873] [INFO ] [REMOTE ] RY: Full fetch complete (52174 records). [2025-09-16T20:16:35.531998] [DEBUG] [VALIDATOR ] RY: Validating primary data. [2025-09-16T20:16:35.580351] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-04. [2025-09-16T20:16:35.924156] [DEBUG] [VALIDATOR ] RY: All expected trading days are present. [2025-09-16T20:16:35.924255] [DEBUG] [VALIDATOR ] RY: Primary data validation passed. [2025-09-16T20:16:35.925216] [INFO ] [MAIN ] RY: Fetched primary data is valid. [2025-09-16T20:16:35.925276] [DEBUG] [LOCAL ] RY: Saving primary data. [2025-09-16T20:16:35.926527] [DEBUG] [LOCAL ] RY: Trimmed 52174 records to 35331 (keeping 150 days of data) [2025-09-16T20:16:36.150544] [DEBUG] [LOCAL ] RY: Primary data saved (35331 records). [2025-09-16T20:16:36.150707] [INFO ] [MAIN ] RY: Full history saved. [2025-09-16T20:16:36.151518] [INFO ] [MAIN ] Update Progress: 1850/2369 symbols completed. RY took 30.3s. Estimated remaining: 55m 8s. Rate: 9.4 symbols/min [2025-09-16T20:16:36.337791] [INFO ] [MAIN ] RYN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:16:36.370734] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-16T20:16:36.380186] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-05. [2025-09-16T20:16:36.410329] [DEBUG] [LOCAL ] RYN: Loaded 33478 existing records from primary storage. [2025-09-16T20:16:36.410482] [INFO ] [MAIN ] RYN: Loaded 33478 existing records. [2025-09-16T20:16:36.587364] [WARN ] [MAIN ] RYN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:16:36.587628] [INFO ] [MAIN ] RYN: Wiping existing primary data before full refresh. [2025-09-16T20:16:36.587723] [INFO ] [LOCAL ] RYN: Starting deletion of primary data. [2025-09-16T20:16:36.588609] [DEBUG] [LOCAL ] RYN: Deleted primary data file. [2025-09-16T20:16:36.588706] [INFO ] [MAIN ] RYN: Starting full primary refresh. [2025-09-16T20:16:36.942096] [INFO ] [REMOTE ] RYN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:16:36.958010] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-16T20:16:37.174919] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-09. [2025-09-16T20:16:37.974958] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-02. [2025-09-16T20:16:38.005304] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-16T20:16:38.703401] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-16T20:16:38.709249] [INFO ] [REMOTE ] RXO: Full fetch complete (51565 records). [2025-09-16T20:16:38.709356] [DEBUG] [VALIDATOR ] RXO: Validating primary data. [2025-09-16T20:16:38.784467] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-05. [2025-09-16T20:16:39.097751] [DEBUG] [VALIDATOR ] RXO: All expected trading days are present. [2025-09-16T20:16:39.097837] [DEBUG] [VALIDATOR ] RXO: Primary data validation passed. [2025-09-16T20:16:39.098734] [INFO ] [MAIN ] RXO: Fetched primary data is valid. [2025-09-16T20:16:39.098779] [DEBUG] [LOCAL ] RXO: Saving primary data. [2025-09-16T20:16:39.099839] [DEBUG] [LOCAL ] RXO: Trimmed 51565 records to 35638 (keeping 150 days of data) [2025-09-16T20:16:39.309543] [DEBUG] [LOCAL ] RXO: Primary data saved (35638 records). [2025-09-16T20:16:39.309702] [INFO ] [MAIN ] RXO: Full history saved. [2025-09-16T20:16:39.309802] [INFO ] [MAIN ] Update Progress: 1851/2369 symbols completed. RXO took 35.3s. Estimated remaining: 55m 1s. Rate: 9.4 symbols/min [2025-09-16T20:16:39.478750] [INFO ] [MAIN ] RZB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:16:39.485109] [DEBUG] [LOCAL ] RZB: Loaded 4721 existing records from primary storage. [2025-09-16T20:16:39.485211] [INFO ] [MAIN ] RZB: Loaded 4721 existing records. [2025-09-16T20:16:39.576574] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-06. [2025-09-16T20:16:39.668344] [WARN ] [MAIN ] RZB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:16:39.668775] [INFO ] [MAIN ] RZB: Wiping existing primary data before full refresh. [2025-09-16T20:16:39.668860] [INFO ] [LOCAL ] RZB: Starting deletion of primary data. [2025-09-16T20:16:39.669410] [DEBUG] [LOCAL ] RZB: Deleted primary data file. [2025-09-16T20:16:39.669601] [INFO ] [MAIN ] RZB: Starting full primary refresh. [2025-09-16T20:16:39.783029] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-16T20:16:39.961784] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-16T20:16:40.077023] [INFO ] [REMOTE ] RZB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:16:40.374903] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-03. [2025-09-16T20:16:41.144202] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-16T20:16:41.174876] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-07. [2025-09-16T20:16:41.974910] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-02. [2025-09-16T20:16:42.090822] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-16T20:16:42.498665] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-16T20:16:42.642724] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-16T20:16:42.774866] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-08. [2025-09-16T20:16:43.574927] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-04. [2025-09-16T20:16:44.376782] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-06. [2025-09-16T20:16:44.383846] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-16T20:16:45.174924] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-03. [2025-09-16T20:16:45.356471] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-16T20:16:45.487309] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-16T20:16:45.955905] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-16T20:16:45.974875] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-04. [2025-09-16T20:16:46.634723] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-16T20:16:46.774921] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-05. [2025-09-16T20:16:47.574942] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-05. [2025-09-16T20:16:48.209683] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-16T20:16:48.374943] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-09. [2025-09-16T20:16:48.470221] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-16T20:16:49.174919] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-07. [2025-09-16T20:16:49.587559] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-16T20:16:49.593821] [INFO ] [REMOTE ] RYAN: Full fetch complete (47780 records). [2025-09-16T20:16:49.594059] [DEBUG] [VALIDATOR ] RYAN: Validating primary data. [2025-09-16T20:16:49.978029] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-06. [2025-09-16T20:16:49.994323] [DEBUG] [VALIDATOR ] RYAN: All expected trading days are present. [2025-09-16T20:16:49.994394] [DEBUG] [VALIDATOR ] RYAN: Primary data validation passed. [2025-09-16T20:16:49.995389] [INFO ] [MAIN ] RYAN: Fetched primary data is valid. [2025-09-16T20:16:49.995518] [DEBUG] [LOCAL ] RYAN: Saving primary data. [2025-09-16T20:16:49.996755] [DEBUG] [LOCAL ] RYAN: Trimmed 47780 records to 32531 (keeping 150 days of data) [2025-09-16T20:16:50.206981] [DEBUG] [LOCAL ] RYAN: Primary data saved (32531 records). [2025-09-16T20:16:50.207218] [INFO ] [MAIN ] RYAN: Full history saved. [2025-09-16T20:16:50.207341] [INFO ] [MAIN ] Update Progress: 1852/2369 symbols completed. RYAN took 28.1s. Estimated remaining: 54m 56s. Rate: 9.4 symbols/min [2025-09-16T20:16:50.391878] [INFO ] [MAIN ] RZC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:16:50.399024] [DEBUG] [LOCAL ] RZC: Loaded 4930 existing records from primary storage. [2025-09-16T20:16:50.399147] [INFO ] [MAIN ] RZC: Loaded 4930 existing records. [2025-09-16T20:16:50.585871] [WARN ] [MAIN ] RZC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:16:50.586338] [INFO ] [MAIN ] RZC: Wiping existing primary data before full refresh. [2025-09-16T20:16:50.586404] [INFO ] [LOCAL ] RZC: Starting deletion of primary data. [2025-09-16T20:16:50.586790] [DEBUG] [LOCAL ] RZC: Deleted primary data file. [2025-09-16T20:16:50.586846] [INFO ] [MAIN ] RZC: Starting full primary refresh. [2025-09-16T20:16:50.726609] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-16T20:16:50.792556] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-06. [2025-09-16T20:16:50.951258] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-16T20:16:50.998436] [INFO ] [REMOTE ] RZC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:16:51.574894] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-02. [2025-09-16T20:16:52.374922] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-07. [2025-09-16T20:16:52.426326] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-16T20:16:52.460028] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-16T20:16:53.035509] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-16T20:16:53.174931] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-03. [2025-09-16T20:16:53.974916] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-08. [2025-09-16T20:16:53.997254] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-16T20:16:54.774868] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-07. [2025-09-16T20:16:54.931424] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-16T20:16:55.574899] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-08. [2025-09-16T20:16:56.201772] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-16T20:16:56.374899] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-04. [2025-09-16T20:16:56.448335] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-16T20:16:56.876343] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-16T20:16:57.174898] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-08. [2025-09-16T20:16:57.974905] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-09. [2025-09-16T20:16:58.562945] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-16T20:16:58.774879] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-09. [2025-09-16T20:16:59.016050] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-16T20:16:59.019167] [INFO ] [REMOTE ] RYI: Full fetch complete (23616 records). [2025-09-16T20:16:59.019239] [DEBUG] [VALIDATOR ] RYI: Validating primary data. [2025-09-16T20:16:59.395238] [DEBUG] [VALIDATOR ] RYI: All expected trading days are present. [2025-09-16T20:16:59.395335] [DEBUG] [VALIDATOR ] RYI: Primary data validation passed. [2025-09-16T20:16:59.395964] [INFO ] [MAIN ] RYI: Fetched primary data is valid. [2025-09-16T20:16:59.396041] [DEBUG] [LOCAL ] RYI: Saving primary data. [2025-09-16T20:16:59.397079] [DEBUG] [LOCAL ] RYI: Trimmed 23616 records to 16169 (keeping 150 days of data) [2025-09-16T20:16:59.499802] [DEBUG] [LOCAL ] RYI: Primary data saved (16169 records). [2025-09-16T20:16:59.499953] [INFO ] [MAIN ] RYI: Full history saved. [2025-09-16T20:16:59.500087] [INFO ] [MAIN ] Update Progress: 1853/2369 symbols completed. RYI took 30.1s. Estimated remaining: 54m 50s. Rate: 9.4 symbols/min [2025-09-16T20:16:59.579971] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-05. [2025-09-16T20:16:59.679038] [INFO ] [MAIN ] S: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:16:59.720841] [DEBUG] [LOCAL ] S: Loaded 39521 existing records from primary storage. [2025-09-16T20:16:59.721008] [INFO ] [MAIN ] S: Loaded 39521 existing records. [2025-09-16T20:16:59.898956] [WARN ] [MAIN ] S: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:16:59.899198] [INFO ] [MAIN ] S: Wiping existing primary data before full refresh. [2025-09-16T20:16:59.899245] [INFO ] [LOCAL ] S: Starting deletion of primary data. [2025-09-16T20:16:59.900088] [DEBUG] [LOCAL ] S: Deleted primary data file. [2025-09-16T20:16:59.900147] [INFO ] [MAIN ] S: Starting full primary refresh. [2025-09-16T20:17:00.267273] [INFO ] [REMOTE ] S: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:17:00.282469] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-16T20:17:00.288231] [INFO ] [REMOTE ] RYN: Full fetch complete (49699 records). [2025-09-16T20:17:00.288336] [DEBUG] [VALIDATOR ] RYN: Validating primary data. [2025-09-16T20:17:00.379249] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-09. [2025-09-16T20:17:00.472948] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-16T20:17:00.677680] [DEBUG] [VALIDATOR ] RYN: All expected trading days are present. [2025-09-16T20:17:00.677763] [DEBUG] [VALIDATOR ] RYN: Primary data validation passed. [2025-09-16T20:17:00.678615] [INFO ] [MAIN ] RYN: Fetched primary data is valid. [2025-09-16T20:17:00.678690] [DEBUG] [LOCAL ] RYN: Saving primary data. [2025-09-16T20:17:00.680902] [DEBUG] [LOCAL ] RYN: Trimmed 49699 records to 33847 (keeping 150 days of data) [2025-09-16T20:17:00.894701] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-16T20:17:00.898540] [INFO ] [REMOTE ] RZB: Full fetch complete (6698 records). [2025-09-16T20:17:00.898665] [DEBUG] [VALIDATOR ] RZB: Validating primary data. [2025-09-16T20:17:00.898412] [DEBUG] [LOCAL ] RYN: Primary data saved (33847 records). [2025-09-16T20:17:00.898935] [INFO ] [MAIN ] RYN: Full history saved. [2025-09-16T20:17:00.943758] [INFO ] [MAIN ] Update Progress: 1854/2369 symbols completed. RYN took 24.8s. Estimated remaining: 54m 43s. Rate: 9.4 symbols/min [2025-09-16T20:17:01.192423] [INFO ] [REMOTE ] S: Fetching primary data for 2025-02. [2025-09-16T20:17:01.378826] [INFO ] [MAIN ] SA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:17:01.515227] [DEBUG] [VALIDATOR ] RZB: All expected trading days are present. [2025-09-16T20:17:01.515310] [DEBUG] [VALIDATOR ] RZB: Primary data validation passed. [2025-09-16T20:17:01.515531] [INFO ] [MAIN ] RZB: Fetched primary data is valid. [2025-09-16T20:17:01.515570] [DEBUG] [LOCAL ] RZB: Saving primary data. [2025-09-16T20:17:01.516502] [DEBUG] [LOCAL ] RZB: Trimmed 6698 records to 4735 (keeping 150 days of data) [2025-09-16T20:17:01.526914] [DEBUG] [LOCAL ] SA: Loaded 31513 existing records from primary storage. [2025-09-16T20:17:01.527064] [INFO ] [MAIN ] SA: Loaded 31513 existing records. [2025-09-16T20:17:01.657767] [DEBUG] [LOCAL ] RZB: Primary data saved (4735 records). [2025-09-16T20:17:01.678578] [INFO ] [MAIN ] RZB: Full history saved. [2025-09-16T20:17:01.683830] [INFO ] [MAIN ] Update Progress: 1855/2369 symbols completed. RZB took 22.4s. Estimated remaining: 54m 35s. Rate: 9.4 symbols/min [2025-09-16T20:17:01.820046] [WARN ] [MAIN ] SA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:17:01.848350] [INFO ] [MAIN ] SA: Wiping existing primary data before full refresh. [2025-09-16T20:17:01.854091] [INFO ] [LOCAL ] SA: Starting deletion of primary data. [2025-09-16T20:17:01.889221] [DEBUG] [LOCAL ] SA: Deleted primary data file. [2025-09-16T20:17:01.901492] [INFO ] [MAIN ] SA: Starting full primary refresh. [2025-09-16T20:17:01.980793] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-06. [2025-09-16T20:17:01.980846] [INFO ] [MAIN ] SABA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:17:02.109059] [DEBUG] [LOCAL ] SABA: Loaded 6815 existing records from primary storage. [2025-09-16T20:17:02.144860] [INFO ] [MAIN ] SABA: Loaded 6815 existing records. [2025-09-16T20:17:02.450304] [INFO ] [REMOTE ] SA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:17:02.472034] [WARN ] [MAIN ] SABA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:17:02.472815] [INFO ] [MAIN ] SABA: Wiping existing primary data before full refresh. [2025-09-16T20:17:02.472865] [INFO ] [LOCAL ] SABA: Starting deletion of primary data. [2025-09-16T20:17:02.473094] [DEBUG] [LOCAL ] SABA: Deleted primary data file. [2025-09-16T20:17:02.473137] [INFO ] [MAIN ] SABA: Starting full primary refresh. [2025-09-16T20:17:02.789487] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-02. [2025-09-16T20:17:02.835620] [INFO ] [REMOTE ] SABA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:17:02.842750] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-16T20:17:03.211101] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-16T20:17:03.574914] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-02. [2025-09-16T20:17:04.367507] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-16T20:17:04.374832] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-03. [2025-09-16T20:17:04.527276] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-16T20:17:05.075354] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-16T20:17:05.174907] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-04. [2025-09-16T20:17:05.974905] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-03. [2025-09-16T20:17:06.055763] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-16T20:17:06.774920] [INFO ] [REMOTE ] S: Fetching primary data for 2025-03. [2025-09-16T20:17:07.574891] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-07. [2025-09-16T20:17:07.676579] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-16T20:17:08.374946] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-05. [2025-09-16T20:17:08.398318] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-16T20:17:08.871370] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-16T20:17:09.174926] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-08. [2025-09-16T20:17:09.303513] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-16T20:17:09.973143] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-16T20:17:09.975720] [INFO ] [REMOTE ] S: Fetching primary data for 2025-04. [2025-09-16T20:17:10.774904] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-06. [2025-09-16T20:17:11.574937] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-04. [2025-09-16T20:17:11.634527] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-16T20:17:12.100900] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-16T20:17:12.374906] [INFO ] [REMOTE ] S: Fetching primary data for 2025-05. [2025-09-16T20:17:13.076983] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-16T20:17:13.174873] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-05. [2025-09-16T20:17:13.974907] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-07. [2025-09-16T20:17:14.629922] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-16T20:17:14.774878] [INFO ] [REMOTE ] S: Fetching primary data for 2025-06. [2025-09-16T20:17:14.861819] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-16T20:17:14.989798] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-16T20:17:15.574898] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-06. [2025-09-16T20:17:16.374907] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-08. [2025-09-16T20:17:16.886934] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-16T20:17:16.981278] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-16T20:17:17.036559] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-16T20:17:17.174905] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-09. [2025-09-16T20:17:17.974896] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-07. [2025-09-16T20:17:18.055568] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-16T20:17:18.057682] [INFO ] [REMOTE ] SABA: Full fetch complete (10398 records). [2025-09-16T20:17:18.057750] [DEBUG] [VALIDATOR ] SABA: Validating primary data. [2025-09-16T20:17:18.420369] [DEBUG] [VALIDATOR ] SABA: All expected trading days are present. [2025-09-16T20:17:18.420444] [DEBUG] [VALIDATOR ] SABA: Primary data validation passed. [2025-09-16T20:17:18.420702] [INFO ] [MAIN ] SABA: Fetched primary data is valid. [2025-09-16T20:17:18.420744] [DEBUG] [LOCAL ] SABA: Saving primary data. [2025-09-16T20:17:18.421185] [DEBUG] [LOCAL ] SABA: Trimmed 10398 records to 6936 (keeping 150 days of data) [2025-09-16T20:17:18.464033] [DEBUG] [LOCAL ] SABA: Primary data saved (6936 records). [2025-09-16T20:17:18.464164] [INFO ] [MAIN ] SABA: Full history saved. [2025-09-16T20:17:18.464247] [INFO ] [MAIN ] Update Progress: 1856/2369 symbols completed. SABA took 16.8s. Estimated remaining: 54m 31s. Rate: 9.4 symbols/min [2025-09-16T20:17:18.639499] [INFO ] [MAIN ] SAFE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:17:18.661579] [DEBUG] [LOCAL ] SAFE: Loaded 22255 existing records from primary storage. [2025-09-16T20:17:18.661728] [INFO ] [MAIN ] SAFE: Loaded 22255 existing records. [2025-09-16T20:17:18.779964] [INFO ] [REMOTE ] S: Fetching primary data for 2025-07. [2025-09-16T20:17:18.839050] [WARN ] [MAIN ] SAFE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:17:18.839277] [INFO ] [MAIN ] SAFE: Wiping existing primary data before full refresh. [2025-09-16T20:17:18.839351] [INFO ] [LOCAL ] SAFE: Starting deletion of primary data. [2025-09-16T20:17:18.839986] [DEBUG] [LOCAL ] SAFE: Deleted primary data file. [2025-09-16T20:17:18.840049] [INFO ] [MAIN ] SAFE: Starting full primary refresh. [2025-09-16T20:17:19.190226] [INFO ] [REMOTE ] SAFE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:17:19.538376] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-16T20:17:19.574837] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-08. [2025-09-16T20:17:20.374930] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-09. [2025-09-16T20:17:20.826868] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-16T20:17:21.006801] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-16T20:17:21.008170] [INFO ] [REMOTE ] RZC: Full fetch complete (7617 records). [2025-09-16T20:17:21.008241] [DEBUG] [VALIDATOR ] RZC: Validating primary data. [2025-09-16T20:17:21.183057] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-02. [2025-09-16T20:17:21.397210] [DEBUG] [VALIDATOR ] RZC: All expected trading days are present. [2025-09-16T20:17:21.397308] [DEBUG] [VALIDATOR ] RZC: Primary data validation passed. [2025-09-16T20:17:21.397508] [INFO ] [MAIN ] RZC: Fetched primary data is valid. [2025-09-16T20:17:21.397637] [DEBUG] [LOCAL ] RZC: Saving primary data. [2025-09-16T20:17:21.398284] [DEBUG] [LOCAL ] RZC: Trimmed 7617 records to 4971 (keeping 150 days of data) [2025-09-16T20:17:21.467827] [DEBUG] [LOCAL ] RZC: Primary data saved (4971 records). [2025-09-16T20:17:21.468000] [INFO ] [MAIN ] RZC: Full history saved. [2025-09-16T20:17:21.468111] [INFO ] [MAIN ] Update Progress: 1857/2369 symbols completed. RZC took 31.3s. Estimated remaining: 54m 24s. Rate: 9.4 symbols/min [2025-09-16T20:17:21.519602] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-16T20:17:21.656056] [INFO ] [MAIN ] SAH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:17:21.673445] [DEBUG] [LOCAL ] SAH: Loaded 15553 existing records from primary storage. [2025-09-16T20:17:21.673568] [INFO ] [MAIN ] SAH: Loaded 15553 existing records. [2025-09-16T20:17:21.852886] [WARN ] [MAIN ] SAH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:17:21.853167] [INFO ] [MAIN ] SAH: Wiping existing primary data before full refresh. [2025-09-16T20:17:21.853213] [INFO ] [LOCAL ] SAH: Starting deletion of primary data. [2025-09-16T20:17:21.853773] [DEBUG] [LOCAL ] SAH: Deleted primary data file. [2025-09-16T20:17:21.853823] [INFO ] [MAIN ] SAH: Starting full primary refresh. [2025-09-16T20:17:21.979974] [INFO ] [REMOTE ] S: Fetching primary data for 2025-08. [2025-09-16T20:17:22.216639] [INFO ] [REMOTE ] SAH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:17:22.657028] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-16T20:17:22.774851] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-09. [2025-09-16T20:17:23.574903] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-02. [2025-09-16T20:17:24.271714] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-16T20:17:24.277952] [INFO ] [REMOTE ] SA: Full fetch complete (46697 records). [2025-09-16T20:17:24.278055] [DEBUG] [VALIDATOR ] SA: Validating primary data. [2025-09-16T20:17:24.376107] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-03. [2025-09-16T20:17:24.712989] [DEBUG] [VALIDATOR ] SA: All expected trading days are present. [2025-09-16T20:17:24.713523] [DEBUG] [VALIDATOR ] SA: Primary data validation passed. [2025-09-16T20:17:24.715405] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-08 (2.74 seconds). [2025-09-16T20:17:24.727205] [INFO ] [MAIN ] SA: Fetched primary data is valid. [2025-09-16T20:17:24.727814] [DEBUG] [LOCAL ] SA: Saving primary data. [2025-09-16T20:17:24.729719] [DEBUG] [LOCAL ] SA: Trimmed 46697 records to 31891 (keeping 150 days of data) [2025-09-16T20:17:24.846533] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-16T20:17:24.956882] [DEBUG] [LOCAL ] SA: Primary data saved (31891 records). [2025-09-16T20:17:24.957074] [INFO ] [MAIN ] SA: Full history saved. [2025-09-16T20:17:24.957187] [INFO ] [MAIN ] Update Progress: 1858/2369 symbols completed. SA took 24.0s. Estimated remaining: 54m 17s. Rate: 9.4 symbols/min [2025-09-16T20:17:25.137071] [INFO ] [MAIN ] SAJ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:17:25.137299] [DEBUG] [LOCAL ] SAJ: No existing data file found in primary storage. [2025-09-16T20:17:25.137339] [WARN ] [MAIN ] SAJ: No existing data found, performing full refresh instead. [2025-09-16T20:17:25.137481] [INFO ] [MAIN ] SAJ: Wiping existing primary data before full refresh. [2025-09-16T20:17:25.137546] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-09-16T20:17:25.137606] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-09-16T20:17:25.137675] [INFO ] [MAIN ] SAJ: Starting full primary refresh. [2025-09-16T20:17:25.180144] [INFO ] [REMOTE ] S: Fetching primary data for 2025-09. [2025-09-16T20:17:25.627011] [INFO ] [REMOTE ] SAJ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:17:25.651819] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-16T20:17:25.974938] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-03. [2025-09-16T20:17:26.774903] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-04. [2025-09-16T20:17:27.211209] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-16T20:17:27.255020] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-16T20:17:27.262277] [INFO ] [REMOTE ] S: Full fetch complete (58207 records). [2025-09-16T20:17:27.262399] [DEBUG] [VALIDATOR ] S: Validating primary data. [2025-09-16T20:17:27.580637] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-04. [2025-09-16T20:17:27.679865] [DEBUG] [VALIDATOR ] S: All expected trading days are present. [2025-09-16T20:17:27.679958] [DEBUG] [VALIDATOR ] S: Primary data validation passed. [2025-09-16T20:17:27.681145] [INFO ] [MAIN ] S: Fetched primary data is valid. [2025-09-16T20:17:27.681242] [DEBUG] [LOCAL ] S: Saving primary data. [2025-09-16T20:17:27.683064] [DEBUG] [LOCAL ] S: Trimmed 58207 records to 39911 (keeping 150 days of data) [2025-09-16T20:17:27.940203] [DEBUG] [LOCAL ] S: Primary data saved (39911 records). [2025-09-16T20:17:27.940357] [INFO ] [MAIN ] S: Full history saved. [2025-09-16T20:17:27.940455] [INFO ] [MAIN ] Update Progress: 1859/2369 symbols completed. S took 28.4s. Estimated remaining: 54m 10s. Rate: 9.4 symbols/min [2025-09-16T20:17:28.109724] [INFO ] [MAIN ] SAM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:17:28.126778] [DEBUG] [LOCAL ] SAM: Loaded 16106 existing records from primary storage. [2025-09-16T20:17:28.126905] [INFO ] [MAIN ] SAM: Loaded 16106 existing records. [2025-09-16T20:17:28.304639] [WARN ] [MAIN ] SAM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:17:28.304994] [INFO ] [MAIN ] SAM: Wiping existing primary data before full refresh. [2025-09-16T20:17:28.305048] [INFO ] [LOCAL ] SAM: Starting deletion of primary data. [2025-09-16T20:17:28.305629] [DEBUG] [LOCAL ] SAM: Deleted primary data file. [2025-09-16T20:17:28.305704] [INFO ] [MAIN ] SAM: Starting full primary refresh. [2025-09-16T20:17:28.379834] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-02. [2025-09-16T20:17:28.509019] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-16T20:17:28.706734] [INFO ] [REMOTE ] SAM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:17:28.882989] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-16T20:17:28.929721] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-16T20:17:29.174928] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-05. [2025-09-16T20:17:29.974898] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-05. [2025-09-16T20:17:30.330993] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-16T20:17:30.774941] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-02. [2025-09-16T20:17:31.400216] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-16T20:17:31.574952] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-03. [2025-09-16T20:17:32.160754] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-16T20:17:32.179160] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-16T20:17:32.374949] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-04. [2025-09-16T20:17:32.760430] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-16T20:17:33.174956] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-06. [2025-09-16T20:17:33.975007] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-05. [2025-09-16T20:17:34.303802] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-16T20:17:34.370346] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-16T20:17:34.774950] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-06. [2025-09-16T20:17:35.574954] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-06. [2025-09-16T20:17:35.966142] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-16T20:17:36.045873] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-16T20:17:36.374988] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-07. [2025-09-16T20:17:37.174912] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-07. [2025-09-16T20:17:37.583594] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-16T20:17:37.974930] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-08. [2025-09-16T20:17:38.432789] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-16T20:17:38.774942] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-03. [2025-09-16T20:17:39.160766] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-16T20:17:39.574905] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-08. [2025-09-16T20:17:40.018377] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-16T20:17:40.374908] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-09. [2025-09-16T20:17:40.688028] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-16T20:17:41.174923] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-04. [2025-09-16T20:17:41.315061] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-16T20:17:41.317685] [INFO ] [REMOTE ] SAH: Full fetch complete (24387 records). [2025-09-16T20:17:41.317818] [DEBUG] [VALIDATOR ] SAH: Validating primary data. [2025-09-16T20:17:41.681165] [DEBUG] [VALIDATOR ] SAH: All expected trading days are present. [2025-09-16T20:17:41.681244] [DEBUG] [VALIDATOR ] SAH: Primary data validation passed. [2025-09-16T20:17:41.681761] [INFO ] [MAIN ] SAH: Fetched primary data is valid. [2025-09-16T20:17:41.681804] [DEBUG] [LOCAL ] SAH: Saving primary data. [2025-09-16T20:17:41.682414] [DEBUG] [LOCAL ] SAH: Trimmed 24387 records to 15649 (keeping 150 days of data) [2025-09-16T20:17:41.792735] [DEBUG] [LOCAL ] SAH: Primary data saved (15649 records). [2025-09-16T20:17:41.792898] [INFO ] [MAIN ] SAH: Full history saved. [2025-09-16T20:17:41.792990] [INFO ] [MAIN ] Update Progress: 1860/2369 symbols completed. SAH took 20.3s. Estimated remaining: 54m 5s. Rate: 9.4 symbols/min [2025-09-16T20:17:41.967967] [INFO ] [MAIN ] SAN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:17:41.974947] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-07. [2025-09-16T20:17:42.011066] [DEBUG] [LOCAL ] SAN: Loaded 39127 existing records from primary storage. [2025-09-16T20:17:42.011235] [INFO ] [MAIN ] SAN: Loaded 39127 existing records. [2025-09-16T20:17:42.190816] [WARN ] [MAIN ] SAN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:17:42.191107] [INFO ] [MAIN ] SAN: Wiping existing primary data before full refresh. [2025-09-16T20:17:42.191173] [INFO ] [LOCAL ] SAN: Starting deletion of primary data. [2025-09-16T20:17:42.192276] [DEBUG] [LOCAL ] SAN: Deleted primary data file. [2025-09-16T20:17:42.192339] [INFO ] [MAIN ] SAN: Starting full primary refresh. [2025-09-16T20:17:42.466383] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-16T20:17:42.571963] [INFO ] [REMOTE ] SAN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:17:42.583928] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-16T20:17:42.774904] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-02. [2025-09-16T20:17:43.574910] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-08. [2025-09-16T20:17:43.905495] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-16T20:17:44.374906] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-09. [2025-09-16T20:17:44.478151] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-16T20:17:45.174910] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-09. [2025-09-16T20:17:45.478792] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-16T20:17:45.479480] [INFO ] [REMOTE ] SAJ: Full fetch complete (700 records). [2025-09-16T20:17:45.479547] [DEBUG] [VALIDATOR ] SAJ: Validating primary data. [2025-09-16T20:17:45.663082] [WARN ] [VALIDATOR ] SAJ: Validation failed - insufficient historical data. Have 136 unique days, need 150 days [2025-09-16T20:17:45.672237] [FATAL] [MAIN ] SAJ: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:17:45.673102] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-16T20:17:45.672782] [WARN ] [MAIN ] SAJ: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:17:45.677105] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-09-16T20:17:45.677271] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-09-16T20:17:45.677311] [INFO ] [LOCAL ] SAJ: Starting deletion of derivative data. [2025-09-16T20:17:45.677371] [INFO ] [REMOTE ] SAFE: Full fetch complete (33140 records). [2025-09-16T20:17:45.677463] [DEBUG] [LOCAL ] SAJ: No derivative data file found to delete. [2025-09-16T20:17:45.677508] [DEBUG] [VALIDATOR ] SAFE: Validating primary data. [2025-09-16T20:17:45.677720] [INFO ] [MAIN ] Update Progress: 1861/2369 symbols completed. SAJ took 20.7s. Estimated remaining: 53m 58s. Rate: 9.4 symbols/min [2025-09-16T20:17:45.980402] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-05. [2025-09-16T20:17:46.024593] [INFO ] [MAIN ] SAND: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:17:46.229963] [DEBUG] [VALIDATOR ] SAFE: All expected trading days are present. [2025-09-16T20:17:46.230048] [DEBUG] [VALIDATOR ] SAFE: Primary data validation passed. [2025-09-16T20:17:46.230728] [INFO ] [MAIN ] SAFE: Fetched primary data is valid. [2025-09-16T20:17:46.230813] [DEBUG] [LOCAL ] SAFE: Saving primary data. [2025-09-16T20:17:46.231708] [DEBUG] [LOCAL ] SAFE: Trimmed 33140 records to 22425 (keeping 150 days of data) [2025-09-16T20:17:46.303435] [DEBUG] [LOCAL ] SAND: Loaded 38135 existing records from primary storage. [2025-09-16T20:17:46.328924] [INFO ] [MAIN ] SAND: Loaded 38135 existing records. [2025-09-16T20:17:46.523809] [WARN ] [MAIN ] SAND: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:17:46.529161] [INFO ] [MAIN ] SAND: Wiping existing primary data before full refresh. [2025-09-16T20:17:46.532935] [INFO ] [LOCAL ] SAND: Starting deletion of primary data. [2025-09-16T20:17:46.537843] [DEBUG] [LOCAL ] SAND: Deleted primary data file. [2025-09-16T20:17:46.539209] [INFO ] [MAIN ] SAND: Starting full primary refresh. [2025-09-16T20:17:46.777391] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-03. [2025-09-16T20:17:46.841685] [DEBUG] [LOCAL ] SAFE: Primary data saved (22425 records). [2025-09-16T20:17:46.852162] [INFO ] [MAIN ] SAFE: Full history saved. [2025-09-16T20:17:46.852473] [INFO ] [MAIN ] Update Progress: 1862/2369 symbols completed. SAFE took 28.4s. Estimated remaining: 53m 50s. Rate: 9.4 symbols/min [2025-09-16T20:17:47.029535] [INFO ] [REMOTE ] SAND: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:17:47.097673] [INFO ] [MAIN ] SAP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:17:47.135751] [DEBUG] [LOCAL ] SAP: Loaded 36605 existing records from primary storage. [2025-09-16T20:17:47.135952] [INFO ] [MAIN ] SAP: Loaded 36605 existing records. [2025-09-16T20:17:47.260874] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-16T20:17:47.324581] [WARN ] [MAIN ] SAP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:17:47.324873] [INFO ] [MAIN ] SAP: Wiping existing primary data before full refresh. [2025-09-16T20:17:47.324920] [INFO ] [LOCAL ] SAP: Starting deletion of primary data. [2025-09-16T20:17:47.325803] [DEBUG] [LOCAL ] SAP: Deleted primary data file. [2025-09-16T20:17:47.325854] [INFO ] [MAIN ] SAP: Starting full primary refresh. [2025-09-16T20:17:47.579976] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-02. [2025-09-16T20:17:47.683975] [INFO ] [REMOTE ] SAP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:17:48.374926] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-02. [2025-09-16T20:17:49.021359] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-16T20:17:49.106429] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-16T20:17:49.174918] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-03. [2025-09-16T20:17:49.974927] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-06. [2025-09-16T20:17:50.251157] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-16T20:17:50.755724] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-16T20:17:50.774862] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-04. [2025-09-16T20:17:51.206332] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-16T20:17:51.574925] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-04. [2025-09-16T20:17:52.374949] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-03. [2025-09-16T20:17:52.721695] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-16T20:17:53.175002] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-07. [2025-09-16T20:17:53.722920] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-16T20:17:53.974911] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-05. [2025-09-16T20:17:54.257374] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-16T20:17:54.581292] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-16T20:17:54.774918] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-08. [2025-09-16T20:17:55.574869] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-04. [2025-09-16T20:17:55.821108] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-16T20:17:55.960002] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-16T20:17:56.374911] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-06. [2025-09-16T20:17:57.174934] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-05. [2025-09-16T20:17:57.748671] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-16T20:17:57.974976] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-09. [2025-09-16T20:17:58.204305] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-16T20:17:58.740481] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-16T20:17:58.774852] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-06. [2025-09-16T20:17:59.051313] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-16T20:17:59.054539] [INFO ] [REMOTE ] SAM: Full fetch complete (23905 records). [2025-09-16T20:17:59.054609] [DEBUG] [VALIDATOR ] SAM: Validating primary data. [2025-09-16T20:17:59.418805] [DEBUG] [VALIDATOR ] SAM: All expected trading days are present. [2025-09-16T20:17:59.418884] [DEBUG] [VALIDATOR ] SAM: Primary data validation passed. [2025-09-16T20:17:59.419321] [INFO ] [MAIN ] SAM: Fetched primary data is valid. [2025-09-16T20:17:59.419382] [DEBUG] [LOCAL ] SAM: Saving primary data. [2025-09-16T20:17:59.419988] [DEBUG] [LOCAL ] SAM: Trimmed 23905 records to 16309 (keeping 150 days of data) [2025-09-16T20:17:59.517597] [DEBUG] [LOCAL ] SAM: Primary data saved (16309 records). [2025-09-16T20:17:59.517744] [INFO ] [MAIN ] SAM: Full history saved. [2025-09-16T20:17:59.517825] [INFO ] [MAIN ] Update Progress: 1863/2369 symbols completed. SAM took 31.6s. Estimated remaining: 53m 46s. Rate: 9.4 symbols/min [2025-09-16T20:17:59.581013] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-07. [2025-09-16T20:17:59.688926] [INFO ] [MAIN ] SAR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:17:59.700930] [DEBUG] [LOCAL ] SAR: Loaded 12085 existing records from primary storage. [2025-09-16T20:17:59.701036] [INFO ] [MAIN ] SAR: Loaded 12085 existing records. [2025-09-16T20:17:59.877307] [WARN ] [MAIN ] SAR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:17:59.877515] [INFO ] [MAIN ] SAR: Wiping existing primary data before full refresh. [2025-09-16T20:17:59.877562] [INFO ] [LOCAL ] SAR: Starting deletion of primary data. [2025-09-16T20:17:59.877949] [DEBUG] [LOCAL ] SAR: Deleted primary data file. [2025-09-16T20:17:59.877998] [INFO ] [MAIN ] SAR: Starting full primary refresh. [2025-09-16T20:18:00.242149] [INFO ] [REMOTE ] SAR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:18:00.374842] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-02. [2025-09-16T20:18:00.525693] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-16T20:18:01.174925] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-05. [2025-09-16T20:18:01.630110] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-16T20:18:01.767409] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-16T20:18:01.974944] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-08. [2025-09-16T20:18:02.774916] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-03. [2025-09-16T20:18:03.126012] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-16T20:18:03.547918] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-16T20:18:03.574911] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-04. [2025-09-16T20:18:03.921025] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-16T20:18:04.374909] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-09. [2025-09-16T20:18:04.616584] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-16T20:18:05.174956] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-06. [2025-09-16T20:18:05.974992] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-05. [2025-09-16T20:18:06.241178] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-16T20:18:06.247553] [INFO ] [REMOTE ] SAN: Full fetch complete (57637 records). [2025-09-16T20:18:06.247704] [DEBUG] [VALIDATOR ] SAN: Validating primary data. [2025-09-16T20:18:06.645039] [DEBUG] [VALIDATOR ] SAN: All expected trading days are present. [2025-09-16T20:18:06.645168] [DEBUG] [VALIDATOR ] SAN: Primary data validation passed. [2025-09-16T20:18:06.646315] [INFO ] [MAIN ] SAN: Fetched primary data is valid. [2025-09-16T20:18:06.646378] [DEBUG] [LOCAL ] SAN: Saving primary data. [2025-09-16T20:18:06.647840] [DEBUG] [LOCAL ] SAN: Trimmed 57637 records to 39512 (keeping 150 days of data) [2025-09-16T20:18:06.816127] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-07. [2025-09-16T20:18:06.887526] [DEBUG] [LOCAL ] SAN: Primary data saved (39512 records). [2025-09-16T20:18:06.887782] [INFO ] [MAIN ] SAN: Full history saved. [2025-09-16T20:18:06.887895] [INFO ] [MAIN ] Update Progress: 1864/2369 symbols completed. SAN took 25.1s. Estimated remaining: 53m 40s. Rate: 9.4 symbols/min [2025-09-16T20:18:07.106389] [INFO ] [MAIN ] SARO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:18:07.118408] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-16T20:18:07.153049] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-16T20:18:07.184221] [DEBUG] [LOCAL ] SARO: Loaded 35494 existing records from primary storage. [2025-09-16T20:18:07.184393] [INFO ] [MAIN ] SARO: Loaded 35494 existing records. [2025-09-16T20:18:07.357355] [WARN ] [MAIN ] SARO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:18:07.357660] [INFO ] [MAIN ] SARO: Wiping existing primary data before full refresh. [2025-09-16T20:18:07.357739] [INFO ] [LOCAL ] SARO: Starting deletion of primary data. [2025-09-16T20:18:07.358530] [DEBUG] [LOCAL ] SARO: Deleted primary data file. [2025-09-16T20:18:07.358579] [INFO ] [MAIN ] SARO: Starting full primary refresh. [2025-09-16T20:18:07.585471] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-06. [2025-09-16T20:18:07.708002] [INFO ] [REMOTE ] SARO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:18:08.374898] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-07. [2025-09-16T20:18:08.641581] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-16T20:18:08.753981] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-16T20:18:09.174904] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-08. [2025-09-16T20:18:09.974907] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-07. [2025-09-16T20:18:10.390708] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-16T20:18:10.774944] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-02. [2025-09-16T20:18:11.066231] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-16T20:18:11.102251] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-16T20:18:11.574931] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-08. [2025-09-16T20:18:12.129110] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-16T20:18:12.374879] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-08. [2025-09-16T20:18:12.713567] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-16T20:18:13.174906] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-09. [2025-09-16T20:18:13.974879] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-09. [2025-09-16T20:18:14.147054] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-16T20:18:14.149780] [INFO ] [REMOTE ] SAR: Full fetch complete (18170 records). [2025-09-16T20:18:14.149850] [DEBUG] [VALIDATOR ] SAR: Validating primary data. [2025-09-16T20:18:14.533057] [DEBUG] [VALIDATOR ] SAR: All expected trading days are present. [2025-09-16T20:18:14.533198] [DEBUG] [VALIDATOR ] SAR: Primary data validation passed. [2025-09-16T20:18:14.533843] [INFO ] [MAIN ] SAR: Fetched primary data is valid. [2025-09-16T20:18:14.534018] [DEBUG] [LOCAL ] SAR: Saving primary data. [2025-09-16T20:18:14.535179] [DEBUG] [LOCAL ] SAR: Trimmed 18170 records to 12205 (keeping 150 days of data) [2025-09-16T20:18:14.616348] [DEBUG] [LOCAL ] SAR: Primary data saved (12205 records). [2025-09-16T20:18:14.616762] [INFO ] [MAIN ] SAR: Full history saved. [2025-09-16T20:18:14.616916] [INFO ] [MAIN ] Update Progress: 1865/2369 symbols completed. SAR took 15.1s. Estimated remaining: 53m 34s. Rate: 9.4 symbols/min [2025-09-16T20:18:14.777759] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-03. [2025-09-16T20:18:14.777672] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-09-16T20:18:14.834504] [INFO ] [MAIN ] SAT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:18:14.835994] [DEBUG] [LOCAL ] SAT: No existing data file found in primary storage. [2025-09-16T20:18:14.836054] [WARN ] [MAIN ] SAT: No existing data found, performing full refresh instead. [2025-09-16T20:18:14.836225] [INFO ] [MAIN ] SAT: Wiping existing primary data before full refresh. [2025-09-16T20:18:14.836281] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-09-16T20:18:14.836326] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-09-16T20:18:14.836362] [INFO ] [MAIN ] SAT: Starting full primary refresh. [2025-09-16T20:18:15.212734] [INFO ] [REMOTE ] SAT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:18:15.497508] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-16T20:18:15.503635] [INFO ] [REMOTE ] SAND: Full fetch complete (56290 records). [2025-09-16T20:18:15.503753] [DEBUG] [VALIDATOR ] SAND: Validating primary data. [2025-09-16T20:18:15.579979] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-02. [2025-09-16T20:18:15.883570] [DEBUG] [VALIDATOR ] SAND: All expected trading days are present. [2025-09-16T20:18:15.883662] [DEBUG] [VALIDATOR ] SAND: Primary data validation passed. [2025-09-16T20:18:15.884632] [INFO ] [MAIN ] SAND: Fetched primary data is valid. [2025-09-16T20:18:15.884694] [DEBUG] [LOCAL ] SAND: Saving primary data. [2025-09-16T20:18:15.885833] [DEBUG] [LOCAL ] SAND: Trimmed 56290 records to 38514 (keeping 150 days of data) [2025-09-16T20:18:16.095831] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-16T20:18:16.127335] [DEBUG] [LOCAL ] SAND: Primary data saved (38514 records). [2025-09-16T20:18:16.127450] [INFO ] [MAIN ] SAND: Full history saved. [2025-09-16T20:18:16.127547] [INFO ] [MAIN ] Update Progress: 1866/2369 symbols completed. SAND took 30.4s. Estimated remaining: 53m 26s. Rate: 9.4 symbols/min [2025-09-16T20:18:16.296720] [INFO ] [MAIN ] SAY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:18:16.296894] [DEBUG] [LOCAL ] SAY: No existing data file found in primary storage. [2025-09-16T20:18:16.296932] [WARN ] [MAIN ] SAY: No existing data found, performing full refresh instead. [2025-09-16T20:18:16.297099] [INFO ] [MAIN ] SAY: Wiping existing primary data before full refresh. [2025-09-16T20:18:16.297138] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-09-16T20:18:16.297179] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-09-16T20:18:16.297212] [INFO ] [MAIN ] SAY: Starting full primary refresh. [2025-09-16T20:18:16.380116] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-09. [2025-09-16T20:18:16.647767] [INFO ] [REMOTE ] SAY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:18:16.790688] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-16T20:18:17.174904] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-04. [2025-09-16T20:18:17.974906] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-03. [2025-09-16T20:18:18.217469] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-16T20:18:18.223568] [INFO ] [REMOTE ] SAP: Full fetch complete (54350 records). [2025-09-16T20:18:18.223698] [DEBUG] [VALIDATOR ] SAP: Validating primary data. [2025-09-16T20:18:18.495604] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-16T20:18:18.621290] [DEBUG] [VALIDATOR ] SAP: All expected trading days are present. [2025-09-16T20:18:18.621424] [DEBUG] [VALIDATOR ] SAP: Primary data validation passed. [2025-09-16T20:18:18.622560] [INFO ] [MAIN ] SAP: Fetched primary data is valid. [2025-09-16T20:18:18.622623] [DEBUG] [LOCAL ] SAP: Saving primary data. [2025-09-16T20:18:18.624019] [DEBUG] [LOCAL ] SAP: Trimmed 54350 records to 36995 (keeping 150 days of data) [2025-09-16T20:18:18.748347] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-16T20:18:18.777423] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-02. [2025-09-16T20:18:18.893708] [DEBUG] [LOCAL ] SAP: Primary data saved (36995 records). [2025-09-16T20:18:18.893856] [INFO ] [MAIN ] SAP: Full history saved. [2025-09-16T20:18:18.893957] [INFO ] [MAIN ] Update Progress: 1867/2369 symbols completed. SAP took 32.0s. Estimated remaining: 53m 19s. Rate: 9.4 symbols/min [2025-09-16T20:18:19.061136] [INFO ] [MAIN ] SAZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:18:19.061326] [DEBUG] [LOCAL ] SAZ: No existing data file found in primary storage. [2025-09-16T20:18:19.061363] [WARN ] [MAIN ] SAZ: No existing data found, performing full refresh instead. [2025-09-16T20:18:19.061480] [INFO ] [MAIN ] SAZ: Wiping existing primary data before full refresh. [2025-09-16T20:18:19.061519] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-09-16T20:18:19.061560] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-09-16T20:18:19.061592] [INFO ] [MAIN ] SAZ: Starting full primary refresh. [2025-09-16T20:18:19.221152] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-16T20:18:19.418628] [INFO ] [REMOTE ] SAZ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:18:19.574882] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-02. [2025-09-16T20:18:20.080458] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-16T20:18:20.374914] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-05. [2025-09-16T20:18:21.174900] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-04. [2025-09-16T20:18:21.696222] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-16T20:18:21.974929] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-03. [2025-09-16T20:18:22.241001] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-16T20:18:22.465385] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-16T20:18:22.774911] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-06. [2025-09-16T20:18:23.574913] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-03. [2025-09-16T20:18:24.072725] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-16T20:18:24.374917] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-04. [2025-09-16T20:18:24.467457] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-16T20:18:24.914341] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-16T20:18:25.174900] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-05. [2025-09-16T20:18:25.675833] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-16T20:18:25.974907] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-06. [2025-09-16T20:18:26.400808] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-16T20:18:26.774962] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-07. [2025-09-16T20:18:27.574931] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-04. [2025-09-16T20:18:27.980218] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-16T20:18:28.374905] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-05. [2025-09-16T20:18:28.550230] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-16T20:18:28.707435] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-16T20:18:29.174960] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-07. [2025-09-16T20:18:29.593636] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-16T20:18:29.974914] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-08. [2025-09-16T20:18:30.774905] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-05. [2025-09-16T20:18:31.293540] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-16T20:18:31.574942] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-08. [2025-09-16T20:18:31.665276] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-16T20:18:32.040204] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-16T20:18:32.374961] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-09. [2025-09-16T20:18:33.174910] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-06. [2025-09-16T20:18:33.561522] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-16T20:18:33.834392] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-16T20:18:33.840050] [INFO ] [REMOTE ] SARO: Full fetch complete (52303 records). [2025-09-16T20:18:33.840160] [DEBUG] [VALIDATOR ] SARO: Validating primary data. [2025-09-16T20:18:33.980892] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-06. [2025-09-16T20:18:34.220339] [DEBUG] [VALIDATOR ] SARO: All expected trading days are present. [2025-09-16T20:18:34.220426] [DEBUG] [VALIDATOR ] SARO: Primary data validation passed. [2025-09-16T20:18:34.221319] [INFO ] [MAIN ] SARO: Fetched primary data is valid. [2025-09-16T20:18:34.221384] [DEBUG] [LOCAL ] SARO: Saving primary data. [2025-09-16T20:18:34.222578] [DEBUG] [LOCAL ] SARO: Trimmed 52303 records to 35849 (keeping 150 days of data) [2025-09-16T20:18:34.434014] [DEBUG] [LOCAL ] SARO: Primary data saved (35849 records). [2025-09-16T20:18:34.434164] [INFO ] [MAIN ] SARO: Full history saved. [2025-09-16T20:18:34.434250] [INFO ] [MAIN ] Update Progress: 1868/2369 symbols completed. SARO took 27.5s. Estimated remaining: 53m 15s. Rate: 9.4 symbols/min [2025-09-16T20:18:34.520334] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-16T20:18:34.617791] [INFO ] [MAIN ] SB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:18:34.640552] [DEBUG] [LOCAL ] SB: Loaded 24037 existing records from primary storage. [2025-09-16T20:18:34.640751] [INFO ] [MAIN ] SB: Loaded 24037 existing records. [2025-09-16T20:18:34.784140] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-09. [2025-09-16T20:18:34.823110] [WARN ] [MAIN ] SB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:18:34.823388] [INFO ] [MAIN ] SB: Wiping existing primary data before full refresh. [2025-09-16T20:18:34.823448] [INFO ] [LOCAL ] SB: Starting deletion of primary data. [2025-09-16T20:18:34.824252] [DEBUG] [LOCAL ] SB: Deleted primary data file. [2025-09-16T20:18:34.824309] [INFO ] [MAIN ] SB: Starting full primary refresh. [2025-09-16T20:18:35.196449] [INFO ] [REMOTE ] SB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:18:35.253414] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-16T20:18:35.254262] [INFO ] [REMOTE ] SAZ: Full fetch complete (1496 records). [2025-09-16T20:18:35.254329] [DEBUG] [VALIDATOR ] SAZ: Validating primary data. [2025-09-16T20:18:35.431244] [WARN ] [VALIDATOR ] SAZ: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-16T20:18:35.431460] [FATAL] [MAIN ] SAZ: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:18:35.431511] [WARN ] [MAIN ] SAZ: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:18:35.431558] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-09-16T20:18:35.431617] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-09-16T20:18:35.431674] [INFO ] [LOCAL ] SAZ: Starting deletion of derivative data. [2025-09-16T20:18:35.431746] [DEBUG] [LOCAL ] SAZ: No derivative data file found to delete. [2025-09-16T20:18:35.431835] [INFO ] [MAIN ] Update Progress: 1869/2369 symbols completed. SAZ took 16.5s. Estimated remaining: 53m 7s. Rate: 9.4 symbols/min [2025-09-16T20:18:35.583531] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-07. [2025-09-16T20:18:35.609426] [INFO ] [MAIN ] SBDS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:18:35.609601] [DEBUG] [LOCAL ] SBDS: No existing data file found in primary storage. [2025-09-16T20:18:35.609666] [WARN ] [MAIN ] SBDS: No existing data found, performing full refresh instead. [2025-09-16T20:18:35.609788] [INFO ] [MAIN ] SBDS: Wiping existing primary data before full refresh. [2025-09-16T20:18:35.609828] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-09-16T20:18:35.609871] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-09-16T20:18:35.609906] [INFO ] [MAIN ] SBDS: Starting full primary refresh. [2025-09-16T20:18:35.981296] [INFO ] [REMOTE ] SBDS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:18:36.017345] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-16T20:18:36.374912] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-08. [2025-09-16T20:18:36.771765] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-16T20:18:37.174948] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-09. [2025-09-16T20:18:37.558144] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-16T20:18:37.559275] [INFO ] [REMOTE ] SAY: Full fetch complete (1050 records). [2025-09-16T20:18:37.559390] [DEBUG] [VALIDATOR ] SAY: Validating primary data. [2025-09-16T20:18:37.828579] [WARN ] [VALIDATOR ] SAY: Validation failed - insufficient historical data. Have 145 unique days, need 150 days [2025-09-16T20:18:37.828863] [FATAL] [MAIN ] SAY: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:18:37.828936] [WARN ] [MAIN ] SAY: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:18:37.828998] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-09-16T20:18:37.829077] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-09-16T20:18:37.829123] [INFO ] [LOCAL ] SAY: Starting deletion of derivative data. [2025-09-16T20:18:37.829165] [DEBUG] [LOCAL ] SAY: No derivative data file found to delete. [2025-09-16T20:18:37.829260] [INFO ] [MAIN ] Update Progress: 1870/2369 symbols completed. SAY took 21.7s. Estimated remaining: 52m 59s. Rate: 9.4 symbols/min [2025-09-16T20:18:37.980100] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-02. [2025-09-16T20:18:38.067889] [INFO ] [MAIN ] SBH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:18:38.113287] [DEBUG] [LOCAL ] SBH: Loaded 36343 existing records from primary storage. [2025-09-16T20:18:38.113455] [INFO ] [MAIN ] SBH: Loaded 36343 existing records. [2025-09-16T20:18:38.312534] [WARN ] [MAIN ] SBH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:18:38.312851] [INFO ] [MAIN ] SBH: Wiping existing primary data before full refresh. [2025-09-16T20:18:38.312963] [INFO ] [LOCAL ] SBH: Starting deletion of primary data. [2025-09-16T20:18:38.314028] [DEBUG] [LOCAL ] SBH: Deleted primary data file. [2025-09-16T20:18:38.314102] [INFO ] [MAIN ] SBH: Starting full primary refresh. [2025-09-16T20:18:38.363764] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:18:38.404778] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-02 [2025-09-16T20:18:38.703268] [INFO ] [REMOTE ] SBH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:18:38.774927] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-02. [2025-09-16T20:18:39.574934] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-02. [2025-09-16T20:18:40.374942] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-07. [2025-09-16T20:18:40.590057] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-16T20:18:40.747740] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-16T20:18:41.081472] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-16T20:18:41.174911] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-08. [2025-09-16T20:18:41.581518] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-16T20:18:41.974962] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-03. [2025-09-16T20:18:42.774962] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-09. [2025-09-16T20:18:43.097920] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-16T20:18:43.098693] [INFO ] [REMOTE ] SAT: Full fetch complete (1135 records). [2025-09-16T20:18:43.098774] [DEBUG] [VALIDATOR ] SAT: Validating primary data. [2025-09-16T20:18:43.287336] [WARN ] [VALIDATOR ] SAT: Validation failed - insufficient historical data. Have 147 unique days, need 150 days [2025-09-16T20:18:43.287543] [FATAL] [MAIN ] SAT: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:18:43.287594] [WARN ] [MAIN ] SAT: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:18:43.287658] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-09-16T20:18:43.287722] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-09-16T20:18:43.287774] [INFO ] [LOCAL ] SAT: Starting deletion of derivative data. [2025-09-16T20:18:43.287819] [DEBUG] [LOCAL ] SAT: No derivative data file found to delete. [2025-09-16T20:18:43.287897] [INFO ] [MAIN ] Update Progress: 1871/2369 symbols completed. SAT took 28.7s. Estimated remaining: 52m 53s. Rate: 9.4 symbols/min [2025-09-16T20:18:43.455566] [INFO ] [MAIN ] SBI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:18:43.462789] [DEBUG] [LOCAL ] SBI: Loaded 5385 existing records from primary storage. [2025-09-16T20:18:43.462895] [INFO ] [MAIN ] SBI: Loaded 5385 existing records. [2025-09-16T20:18:43.575905] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-03. [2025-09-16T20:18:43.647620] [WARN ] [MAIN ] SBI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:18:43.648614] [INFO ] [MAIN ] SBI: Wiping existing primary data before full refresh. [2025-09-16T20:18:43.648794] [INFO ] [LOCAL ] SBI: Starting deletion of primary data. [2025-09-16T20:18:43.649302] [DEBUG] [LOCAL ] SBI: Deleted primary data file. [2025-09-16T20:18:43.649422] [INFO ] [MAIN ] SBI: Starting full primary refresh. [2025-09-16T20:18:43.756832] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-16T20:18:44.032993] [INFO ] [REMOTE ] SBI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:18:44.374932] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-04. [2025-09-16T20:18:45.175011] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-03. [2025-09-16T20:18:45.425451] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:18:45.425787] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-03 [2025-09-16T20:18:45.544074] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-16T20:18:45.882500] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-16T20:18:45.974888] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-05. [2025-09-16T20:18:46.774970] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-04. [2025-09-16T20:18:47.033517] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:18:47.034136] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-04 [2025-09-16T20:18:47.431473] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-16T20:18:47.574961] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-06. [2025-09-16T20:18:48.374935] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-02. [2025-09-16T20:18:48.921002] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-16T20:18:49.134908] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-16T20:18:49.174862] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-03. [2025-09-16T20:18:49.974941] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-05. [2025-09-16T20:18:50.104133] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-16T20:18:50.208540] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:18:50.208905] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-05 [2025-09-16T20:18:50.774937] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-06. [2025-09-16T20:18:51.082959] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:18:51.083268] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-06 [2025-09-16T20:18:51.574905] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-04. [2025-09-16T20:18:52.374911] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-07. [2025-09-16T20:18:52.560584] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-16T20:18:52.823447] [INFO ] [REMOTE ] SBDS: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-16T20:18:53.174959] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-05. [2025-09-16T20:18:53.856599] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-16T20:18:53.974938] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-08. [2025-09-16T20:18:54.678071] [INFO ] [REMOTE ] SBDS: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-16T20:18:54.774912] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-06. [2025-09-16T20:18:55.574884] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-07. [2025-09-16T20:18:55.625430] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-16T20:18:56.374925] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-07. [2025-09-16T20:18:57.099853] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-16T20:18:57.130242] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-16T20:18:57.174854] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-08. [2025-09-16T20:18:57.974993] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-08. [2025-09-16T20:18:58.634132] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-16T20:18:58.774909] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-09. [2025-09-16T20:18:58.783273] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-16T20:18:59.574982] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-09. [2025-09-16T20:18:59.972742] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-16T20:18:59.976590] [INFO ] [REMOTE ] SB: Full fetch complete (37186 records). [2025-09-16T20:18:59.976711] [DEBUG] [VALIDATOR ] SB: Validating primary data. [2025-09-16T20:19:00.173868] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-16T20:19:00.254816] [INFO ] [REMOTE ] SBI: Full fetch complete (8188 records). [2025-09-16T20:19:00.276875] [DEBUG] [VALIDATOR ] SBI: Validating primary data. [2025-09-16T20:19:00.380022] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-09. [2025-09-16T20:19:00.515690] [DEBUG] [VALIDATOR ] SB: All expected trading days are present. [2025-09-16T20:19:00.533365] [DEBUG] [VALIDATOR ] SB: Primary data validation passed. [2025-09-16T20:19:00.535518] [INFO ] [MAIN ] SB: Fetched primary data is valid. [2025-09-16T20:19:00.550516] [DEBUG] [LOCAL ] SB: Saving primary data. [2025-09-16T20:19:00.658903] [DEBUG] [LOCAL ] SB: Trimmed 37186 records to 24178 (keeping 150 days of data) [2025-09-16T20:19:00.801781] [DEBUG] [VALIDATOR ] SBI: All expected trading days are present. [2025-09-16T20:19:00.828682] [DEBUG] [VALIDATOR ] SBI: Primary data validation passed. [2025-09-16T20:19:00.829444] [INFO ] [MAIN ] SBI: Fetched primary data is valid. [2025-09-16T20:19:00.833549] [DEBUG] [LOCAL ] SBI: Saving primary data. [2025-09-16T20:19:00.839292] [DEBUG] [LOCAL ] SBI: Trimmed 8188 records to 5420 (keeping 150 days of data) [2025-09-16T20:19:00.882011] [DEBUG] [LOCAL ] SBI: Primary data saved (5420 records). [2025-09-16T20:19:00.883176] [INFO ] [MAIN ] SBI: Full history saved. [2025-09-16T20:19:00.883610] [INFO ] [MAIN ] Update Progress: 1872/2369 symbols completed. SBI took 17.6s. Estimated remaining: 52m 49s. Rate: 9.4 symbols/min [2025-09-16T20:19:01.061932] [INFO ] [MAIN ] SBR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:19:01.067043] [INFO ] [REMOTE ] SBDS: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-16T20:19:01.069099] [INFO ] [REMOTE ] SBDS: Full fetch complete (896 records). [2025-09-16T20:19:01.069205] [DEBUG] [VALIDATOR ] SBDS: Validating primary data. [2025-09-16T20:19:01.153715] [DEBUG] [LOCAL ] SBR: Loaded 5227 existing records from primary storage. [2025-09-16T20:19:01.193605] [INFO ] [MAIN ] SBR: Loaded 5227 existing records. [2025-09-16T20:19:01.198049] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-04. [2025-09-16T20:19:01.371196] [WARN ] [VALIDATOR ] SBDS: Validation failed - insufficient historical data. Have 38 unique days, need 150 days [2025-09-16T20:19:01.389834] [FATAL] [MAIN ] SBDS: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:19:01.389973] [WARN ] [MAIN ] SBDS: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:19:01.390028] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-09-16T20:19:01.379027] [DEBUG] [LOCAL ] SB: Primary data saved (24178 records). [2025-09-16T20:19:01.390165] [INFO ] [MAIN ] SB: Full history saved. [2025-09-16T20:19:01.390262] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-09-16T20:19:01.390695] [INFO ] [MAIN ] Update Progress: 1873/2369 symbols completed. SB took 27.0s. Estimated remaining: 52m 41s. Rate: 9.4 symbols/min [2025-09-16T20:19:01.395964] [INFO ] [LOCAL ] SBDS: Starting deletion of derivative data. [2025-09-16T20:19:01.401185] [DEBUG] [LOCAL ] SBDS: No derivative data file found to delete. [2025-09-16T20:19:01.406548] [INFO ] [MAIN ] Update Progress: 1874/2369 symbols completed. SBDS took 26.0s. Estimated remaining: 52m 33s. Rate: 9.4 symbols/min [2025-09-16T20:19:01.498721] [WARN ] [MAIN ] SBR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:19:01.644009] [INFO ] [MAIN ] SBR: Wiping existing primary data before full refresh. [2025-09-16T20:19:01.656522] [INFO ] [LOCAL ] SBR: Starting deletion of primary data. [2025-09-16T20:19:01.678004] [DEBUG] [LOCAL ] SBR: Deleted primary data file. [2025-09-16T20:19:01.678725] [INFO ] [MAIN ] SBR: Starting full primary refresh. [2025-09-16T20:19:01.877948] [INFO ] [MAIN ] SBS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:19:01.915486] [INFO ] [MAIN ] SBSI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:19:02.081925] [DEBUG] [LOCAL ] SBSI: Loaded 10355 existing records from primary storage. [2025-09-16T20:19:02.104221] [INFO ] [MAIN ] SBSI: Loaded 10355 existing records. [2025-09-16T20:19:02.322307] [INFO ] [REMOTE ] SBR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:19:02.328038] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-02. [2025-09-16T20:19:02.317343] [DEBUG] [LOCAL ] SBS: Loaded 36305 existing records from primary storage. [2025-09-16T20:19:02.343433] [INFO ] [MAIN ] SBS: Loaded 36305 existing records. [2025-09-16T20:19:02.462506] [WARN ] [MAIN ] SBSI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:19:02.500894] [INFO ] [MAIN ] SBSI: Wiping existing primary data before full refresh. [2025-09-16T20:19:02.500989] [INFO ] [LOCAL ] SBSI: Starting deletion of primary data. [2025-09-16T20:19:02.506524] [DEBUG] [LOCAL ] SBSI: Deleted primary data file. [2025-09-16T20:19:02.516799] [INFO ] [MAIN ] SBSI: Starting full primary refresh. [2025-09-16T20:19:02.711268] [WARN ] [MAIN ] SBS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:19:02.711534] [INFO ] [MAIN ] SBS: Wiping existing primary data before full refresh. [2025-09-16T20:19:02.717104] [INFO ] [LOCAL ] SBS: Starting deletion of primary data. [2025-09-16T20:19:02.733116] [DEBUG] [LOCAL ] SBS: Deleted primary data file. [2025-09-16T20:19:02.760831] [INFO ] [MAIN ] SBS: Starting full primary refresh. [2025-09-16T20:19:03.146762] [INFO ] [REMOTE ] SBSI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:19:03.178599] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-02. [2025-09-16T20:19:03.328259] [INFO ] [REMOTE ] SBS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:19:03.370962] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-16T20:19:03.386164] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-16T20:19:03.574910] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-03. [2025-09-16T20:19:04.162007] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-16T20:19:04.374901] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-02. [2025-09-16T20:19:04.389565] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-16T20:19:05.174911] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-03. [2025-09-16T20:19:05.987164] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-05. [2025-09-16T20:19:05.990041] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-16T20:19:06.241947] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-16T20:19:06.774934] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-03. [2025-09-16T20:19:07.574901] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-04. [2025-09-16T20:19:07.849494] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-16T20:19:08.374892] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-04. [2025-09-16T20:19:08.586203] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-16T20:19:08.730574] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-16T20:19:09.174884] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-06. [2025-09-16T20:19:09.243841] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-16T20:19:09.974927] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-05. [2025-09-16T20:19:10.647995] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-16T20:19:10.774940] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-05. [2025-09-16T20:19:10.822177] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-16T20:19:11.574900] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-07. [2025-09-16T20:19:11.667594] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-16T20:19:12.374905] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-06. [2025-09-16T20:19:13.155970] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-16T20:19:13.174854] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-07. [2025-09-16T20:19:13.403844] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-16T20:19:13.938940] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-16T20:19:13.974894] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-08. [2025-09-16T20:19:14.774901] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-04. [2025-09-16T20:19:14.857070] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-16T20:19:15.574905] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-06. [2025-09-16T20:19:16.374911] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-08. [2025-09-16T20:19:16.568093] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-16T20:19:16.657955] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-16T20:19:17.174907] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-07. [2025-09-16T20:19:17.979968] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-09. [2025-09-16T20:19:17.999109] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-16T20:19:18.200071] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-16T20:19:18.740558] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-16T20:19:18.742163] [INFO ] [REMOTE ] SBR: Full fetch complete (7992 records). [2025-09-16T20:19:18.742233] [DEBUG] [VALIDATOR ] SBR: Validating primary data. [2025-09-16T20:19:18.779973] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-08. [2025-09-16T20:19:19.110847] [DEBUG] [VALIDATOR ] SBR: All expected trading days are present. [2025-09-16T20:19:19.110926] [DEBUG] [VALIDATOR ] SBR: Primary data validation passed. [2025-09-16T20:19:19.111142] [INFO ] [MAIN ] SBR: Fetched primary data is valid. [2025-09-16T20:19:19.111184] [DEBUG] [LOCAL ] SBR: Saving primary data. [2025-09-16T20:19:19.111595] [DEBUG] [LOCAL ] SBR: Trimmed 7992 records to 5269 (keeping 150 days of data) [2025-09-16T20:19:19.147416] [DEBUG] [LOCAL ] SBR: Primary data saved (5269 records). [2025-09-16T20:19:19.147541] [INFO ] [MAIN ] SBR: Full history saved. [2025-09-16T20:19:19.147671] [INFO ] [MAIN ] Update Progress: 1875/2369 symbols completed. SBR took 18.3s. Estimated remaining: 52m 30s. Rate: 9.4 symbols/min [2025-09-16T20:19:19.320185] [INFO ] [MAIN ] SBSW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:19:19.357546] [DEBUG] [LOCAL ] SBSW: Loaded 39176 existing records from primary storage. [2025-09-16T20:19:19.357741] [INFO ] [MAIN ] SBSW: Loaded 39176 existing records. [2025-09-16T20:19:19.540307] [WARN ] [MAIN ] SBSW: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:19:19.540607] [INFO ] [MAIN ] SBSW: Wiping existing primary data before full refresh. [2025-09-16T20:19:19.540683] [INFO ] [LOCAL ] SBSW: Starting deletion of primary data. [2025-09-16T20:19:19.541445] [DEBUG] [LOCAL ] SBSW: Deleted primary data file. [2025-09-16T20:19:19.541492] [INFO ] [MAIN ] SBSW: Starting full primary refresh. [2025-09-16T20:19:19.583216] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-09. [2025-09-16T20:19:19.729225] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-16T20:19:19.916585] [INFO ] [REMOTE ] SBSW: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:19:20.374904] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-05. [2025-09-16T20:19:21.174902] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-09. [2025-09-16T20:19:21.273779] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-16T20:19:21.280150] [INFO ] [REMOTE ] SBH: Full fetch complete (54328 records). [2025-09-16T20:19:21.280272] [DEBUG] [VALIDATOR ] SBH: Validating primary data. [2025-09-16T20:19:21.667418] [DEBUG] [VALIDATOR ] SBH: All expected trading days are present. [2025-09-16T20:19:21.667515] [DEBUG] [VALIDATOR ] SBH: Primary data validation passed. [2025-09-16T20:19:21.668452] [INFO ] [MAIN ] SBH: Fetched primary data is valid. [2025-09-16T20:19:21.668515] [DEBUG] [LOCAL ] SBH: Saving primary data. [2025-09-16T20:19:21.669971] [DEBUG] [LOCAL ] SBH: Trimmed 54328 records to 36732 (keeping 150 days of data) [2025-09-16T20:19:21.919040] [DEBUG] [LOCAL ] SBH: Primary data saved (36732 records). [2025-09-16T20:19:21.919199] [INFO ] [MAIN ] SBH: Full history saved. [2025-09-16T20:19:21.919324] [INFO ] [MAIN ] Update Progress: 1876/2369 symbols completed. SBH took 44.1s. Estimated remaining: 52m 23s. Rate: 9.4 symbols/min [2025-09-16T20:19:21.982241] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-02. [2025-09-16T20:19:22.096731] [INFO ] [MAIN ] SBXD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:19:22.103537] [DEBUG] [LOCAL ] SBXD: No existing data file found in primary storage. [2025-09-16T20:19:22.104313] [WARN ] [MAIN ] SBXD: No existing data found, performing full refresh instead. [2025-09-16T20:19:22.104799] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-16T20:19:22.104887] [INFO ] [MAIN ] SBXD: Wiping existing primary data before full refresh. [2025-09-16T20:19:22.107022] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-09-16T20:19:22.107522] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-09-16T20:19:22.107587] [INFO ] [MAIN ] SBXD: Starting full primary refresh. [2025-09-16T20:19:22.107713] [INFO ] [REMOTE ] SBSI: Full fetch complete (15635 records). [2025-09-16T20:19:22.113121] [DEBUG] [VALIDATOR ] SBSI: Validating primary data. [2025-09-16T20:19:22.849937] [INFO ] [REMOTE ] SBXD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:19:22.897219] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-02. [2025-09-16T20:19:22.909827] [DEBUG] [VALIDATOR ] SBSI: All expected trading days are present. [2025-09-16T20:19:22.913260] [DEBUG] [VALIDATOR ] SBSI: Primary data validation passed. [2025-09-16T20:19:22.913891] [INFO ] [MAIN ] SBSI: Fetched primary data is valid. [2025-09-16T20:19:22.913967] [DEBUG] [LOCAL ] SBSI: Saving primary data. [2025-09-16T20:19:22.917930] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-09-16T20:19:22.928805] [DEBUG] [LOCAL ] SBSI: Trimmed 15635 records to 10476 (keeping 150 days of data) [2025-09-16T20:19:23.001925] [DEBUG] [LOCAL ] SBSI: Primary data saved (10476 records). [2025-09-16T20:19:23.002126] [INFO ] [MAIN ] SBSI: Full history saved. [2025-09-16T20:19:23.002228] [INFO ] [MAIN ] Update Progress: 1877/2369 symbols completed. SBSI took 21.6s. Estimated remaining: 52m 15s. Rate: 9.4 symbols/min [2025-09-16T20:19:23.286251] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-16T20:19:23.574911] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-03. [2025-09-16T20:19:23.947314] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-16T20:19:23.953968] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-16T20:19:24.374925] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-04. [2025-09-16T20:19:24.656722] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-09-16T20:19:25.174899] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-06. [2025-09-16T20:19:25.974899] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-05. [2025-09-16T20:19:26.370232] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-16T20:19:26.774893] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-06. [2025-09-16T20:19:26.900992] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-16T20:19:27.574937] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-03. [2025-09-16T20:19:27.649930] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-16T20:19:28.374925] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-07. [2025-09-16T20:19:28.987712] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-16T20:19:29.174898] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-08. [2025-09-16T20:19:29.326738] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-16T20:19:29.692125] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-16T20:19:29.974971] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-07. [2025-09-16T20:19:30.774948] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-04. [2025-09-16T20:19:31.574949] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-09. [2025-09-16T20:19:31.767912] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-16T20:19:31.982663] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-16T20:19:31.983587] [INFO ] [REMOTE ] SBXD: Full fetch complete (2948 records). [2025-09-16T20:19:31.983701] [DEBUG] [VALIDATOR ] SBXD: Validating primary data. [2025-09-16T20:19:32.175056] [WARN ] [VALIDATOR ] SBXD: Validation failed - insufficient historical data. Have 135 unique days, need 150 days [2025-09-16T20:19:32.175308] [FATAL] [MAIN ] SBXD: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:19:32.175372] [WARN ] [MAIN ] SBXD: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:19:32.175419] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-09-16T20:19:32.175478] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-09-16T20:19:32.175515] [INFO ] [LOCAL ] SBXD: Starting deletion of derivative data. [2025-09-16T20:19:32.175586] [DEBUG] [LOCAL ] SBXD: No derivative data file found to delete. [2025-09-16T20:19:32.175708] [INFO ] [MAIN ] Update Progress: 1878/2369 symbols completed. SBXD took 10.3s. Estimated remaining: 52m 9s. Rate: 9.4 symbols/min [2025-09-16T20:19:32.374980] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-08. [2025-09-16T20:19:32.865751] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-16T20:19:33.174912] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-05. [2025-09-16T20:19:34.168387] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-16T20:19:34.178886] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-09. [2025-09-16T20:19:35.255315] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-16T20:19:35.271676] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-06. [2025-09-16T20:19:35.352236] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-16T20:19:35.359124] [INFO ] [REMOTE ] SBS: Full fetch complete (53378 records). [2025-09-16T20:19:35.359274] [DEBUG] [VALIDATOR ] SBS: Validating primary data. [2025-09-16T20:19:35.753352] [DEBUG] [VALIDATOR ] SBS: All expected trading days are present. [2025-09-16T20:19:35.753446] [DEBUG] [VALIDATOR ] SBS: Primary data validation passed. [2025-09-16T20:19:35.754433] [INFO ] [MAIN ] SBS: Fetched primary data is valid. [2025-09-16T20:19:35.754482] [DEBUG] [LOCAL ] SBS: Saving primary data. [2025-09-16T20:19:35.756068] [DEBUG] [LOCAL ] SBS: Trimmed 53378 records to 36694 (keeping 150 days of data) [2025-09-16T20:19:35.982145] [DEBUG] [LOCAL ] SBS: Primary data saved (36694 records). [2025-09-16T20:19:35.982290] [INFO ] [MAIN ] SBS: Full history saved. [2025-09-16T20:19:35.983102] [INFO ] [MAIN ] Update Progress: 1879/2369 symbols completed. SBS took 34.6s. Estimated remaining: 52m 2s. Rate: 9.4 symbols/min [2025-09-16T20:19:37.326327] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-16T20:19:37.337514] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-07. [2025-09-16T20:19:39.316979] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-16T20:19:39.328776] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-08. [2025-09-16T20:19:41.365103] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-16T20:19:41.377475] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-09. [2025-09-16T20:19:43.080478] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-16T20:19:43.086713] [INFO ] [REMOTE ] SBSW: Full fetch complete (57539 records). [2025-09-16T20:19:43.086813] [DEBUG] [VALIDATOR ] SBSW: Validating primary data. [2025-09-16T20:19:43.462125] [DEBUG] [VALIDATOR ] SBSW: All expected trading days are present. [2025-09-16T20:19:43.462207] [DEBUG] [VALIDATOR ] SBSW: Primary data validation passed. [2025-09-16T20:19:43.463168] [INFO ] [MAIN ] SBSW: Fetched primary data is valid. [2025-09-16T20:19:43.463215] [DEBUG] [LOCAL ] SBSW: Saving primary data. [2025-09-16T20:19:43.464416] [DEBUG] [LOCAL ] SBSW: Trimmed 57539 records to 39565 (keeping 150 days of data) [2025-09-16T20:19:43.707671] [DEBUG] [LOCAL ] SBSW: Primary data saved (39565 records). [2025-09-16T20:19:43.707840] [INFO ] [MAIN ] SBSW: Full history saved. [2025-09-16T20:19:43.707955] [INFO ] [MAIN ] Update Progress: 1880/2369 symbols completed. SBSW took 24.6s. Estimated remaining: 51m 56s. Rate: 9.4 symbols/min [2025-09-16T20:19:44.256814] [INFO ] [MAIN ] SCD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:19:44.348697] [INFO ] [MAIN ] SCI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:19:44.363839] [INFO ] [MAIN ] SCCO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:19:44.420818] [INFO ] [MAIN ] SCHW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:19:44.430589] [DEBUG] [LOCAL ] SCD: Loaded 10234 existing records from primary storage. [2025-09-16T20:19:44.430815] [INFO ] [MAIN ] SCD: Loaded 10234 existing records. [2025-09-16T20:19:44.666104] [DEBUG] [LOCAL ] SCI: Loaded 34407 existing records from primary storage. [2025-09-16T20:19:44.668149] [INFO ] [MAIN ] SCI: Loaded 34407 existing records. [2025-09-16T20:19:44.696026] [DEBUG] [LOCAL ] SCCO: Loaded 36022 existing records from primary storage. [2025-09-16T20:19:44.711837] [WARN ] [MAIN ] SCD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:19:44.757665] [INFO ] [MAIN ] SCCO: Loaded 36022 existing records. [2025-09-16T20:19:44.783499] [INFO ] [MAIN ] SCD: Wiping existing primary data before full refresh. [2025-09-16T20:19:44.831548] [DEBUG] [LOCAL ] SCHW: Loaded 39645 existing records from primary storage. [2025-09-16T20:19:44.846126] [INFO ] [LOCAL ] SCD: Starting deletion of primary data. [2025-09-16T20:19:44.880404] [INFO ] [MAIN ] SCHW: Loaded 39645 existing records. [2025-09-16T20:19:44.931494] [DEBUG] [LOCAL ] SCD: Deleted primary data file. [2025-09-16T20:19:45.003223] [INFO ] [MAIN ] SCD: Starting full primary refresh. [2025-09-16T20:19:45.121369] [WARN ] [MAIN ] SCI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:19:45.217866] [INFO ] [MAIN ] SCI: Wiping existing primary data before full refresh. [2025-09-16T20:19:45.250529] [INFO ] [LOCAL ] SCI: Starting deletion of primary data. [2025-09-16T20:19:45.250706] [WARN ] [MAIN ] SCCO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:19:45.367811] [INFO ] [MAIN ] SCCO: Wiping existing primary data before full refresh. [2025-09-16T20:19:45.372780] [INFO ] [LOCAL ] SCCO: Starting deletion of primary data. [2025-09-16T20:19:45.371965] [WARN ] [MAIN ] SCHW: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:19:45.378091] [DEBUG] [LOCAL ] SCI: Deleted primary data file. [2025-09-16T20:19:45.383687] [INFO ] [MAIN ] SCI: Starting full primary refresh. [2025-09-16T20:19:45.389082] [INFO ] [MAIN ] SCHW: Wiping existing primary data before full refresh. [2025-09-16T20:19:45.388989] [DEBUG] [LOCAL ] SCCO: Deleted primary data file. [2025-09-16T20:19:45.394443] [INFO ] [MAIN ] SCCO: Starting full primary refresh. [2025-09-16T20:19:45.518006] [INFO ] [LOCAL ] SCHW: Starting deletion of primary data. [2025-09-16T20:19:45.591979] [DEBUG] [LOCAL ] SCHW: Deleted primary data file. [2025-09-16T20:19:45.639473] [INFO ] [MAIN ] SCHW: Starting full primary refresh. [2025-09-16T20:19:46.184492] [INFO ] [REMOTE ] SCD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:19:46.278980] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-02. [2025-09-16T20:19:46.690680] [INFO ] [REMOTE ] SCI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:19:46.706613] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-02. [2025-09-16T20:19:46.832975] [INFO ] [REMOTE ] SCHW: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:19:46.837404] [INFO ] [REMOTE ] SCCO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:19:46.837884] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-02. [2025-09-16T20:19:46.838197] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-02. [2025-09-16T20:19:47.313907] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-16T20:19:47.316084] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-03. [2025-09-16T20:19:48.168269] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-16T20:19:48.170625] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-04. [2025-09-16T20:19:48.416729] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-16T20:19:48.426427] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-03. [2025-09-16T20:19:48.479979] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-16T20:19:48.490367] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-03. [2025-09-16T20:19:48.565744] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-16T20:19:48.575951] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-03. [2025-09-16T20:19:49.093416] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-16T20:19:49.096400] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-05. [2025-09-16T20:19:49.870943] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-16T20:19:49.881379] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-04. [2025-09-16T20:19:49.934448] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-16T20:19:49.937123] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-06. [2025-09-16T20:19:50.153734] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-16T20:19:50.164582] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-04. [2025-09-16T20:19:50.598168] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-16T20:19:50.609364] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-04. [2025-09-16T20:19:50.961575] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-16T20:19:50.965286] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-07. [2025-09-16T20:19:51.746762] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-16T20:19:51.757862] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-05. [2025-09-16T20:19:52.106166] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-16T20:19:52.117228] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-05. [2025-09-16T20:19:52.142355] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-16T20:19:52.147542] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-08. [2025-09-16T20:19:52.300978] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-16T20:19:52.374876] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-05. [2025-09-16T20:19:53.162198] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-16T20:19:53.174856] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-09. [2025-09-16T20:19:53.516878] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-16T20:19:53.892662] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-16T20:19:53.894687] [INFO ] [REMOTE ] SCD: Full fetch complete (13059 records). [2025-09-16T20:19:53.894764] [DEBUG] [VALIDATOR ] SCD: Validating primary data. [2025-09-16T20:19:53.984798] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-06. [2025-09-16T20:19:54.301596] [DEBUG] [VALIDATOR ] SCD: All expected trading days are present. [2025-09-16T20:19:54.302014] [DEBUG] [VALIDATOR ] SCD: Primary data validation passed. [2025-09-16T20:19:54.302361] [INFO ] [MAIN ] SCD: Fetched primary data is valid. [2025-09-16T20:19:54.302905] [DEBUG] [LOCAL ] SCD: Saving primary data. [2025-09-16T20:19:54.305158] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-16T20:19:54.315743] [DEBUG] [LOCAL ] SCD: Trimmed 13059 records to 10312 (keeping 150 days of data) [2025-09-16T20:19:54.384677] [DEBUG] [LOCAL ] SCD: Primary data saved (10312 records). [2025-09-16T20:19:54.384826] [INFO ] [MAIN ] SCD: Full history saved. [2025-09-16T20:19:54.384914] [INFO ] [MAIN ] Update Progress: 1881/2369 symbols completed. SCD took 10.7s. Estimated remaining: 51m 51s. Rate: 9.4 symbols/min [2025-09-16T20:19:54.586334] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-16T20:19:54.589253] [INFO ] [MAIN ] SCL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:19:54.612255] [DEBUG] [LOCAL ] SCL: Loaded 10664 existing records from primary storage. [2025-09-16T20:19:54.612453] [INFO ] [MAIN ] SCL: Loaded 10664 existing records. [2025-09-16T20:19:54.784695] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-06. [2025-09-16T20:19:54.789390] [WARN ] [MAIN ] SCL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:19:54.790585] [INFO ] [MAIN ] SCL: Wiping existing primary data before full refresh. [2025-09-16T20:19:54.790659] [INFO ] [LOCAL ] SCL: Starting deletion of primary data. [2025-09-16T20:19:54.791105] [DEBUG] [LOCAL ] SCL: Deleted primary data file. [2025-09-16T20:19:54.791150] [INFO ] [MAIN ] SCL: Starting full primary refresh. [2025-09-16T20:19:55.138074] [INFO ] [REMOTE ] SCL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:19:55.515680] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-16T20:19:55.574847] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-07. [2025-09-16T20:19:56.374900] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-06. [2025-09-16T20:19:56.755833] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-16T20:19:57.174916] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-02. [2025-09-16T20:19:57.334041] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-16T20:19:57.826775] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-16T20:19:57.974896] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-03. [2025-09-16T20:19:58.256452] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-16T20:19:58.774946] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-07. [2025-09-16T20:19:59.110332] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-16T20:19:59.574922] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-07. [2025-09-16T20:20:00.374915] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-04. [2025-09-16T20:20:01.033989] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-16T20:20:01.175101] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-08. [2025-09-16T20:20:01.545688] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-16T20:20:01.974954] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-08. [2025-09-16T20:20:02.774918] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-08. [2025-09-16T20:20:04.050124] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-04 (3.68 seconds). [2025-09-16T20:20:04.054746] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-05. [2025-09-16T20:20:04.769846] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-16T20:20:04.780260] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-09. [2025-09-16T20:20:05.181350] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-08 (3.21 seconds). [2025-09-16T20:20:05.191796] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-09. [2025-09-16T20:20:05.283778] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-16T20:20:05.333167] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-08 (4.16 seconds). [2025-09-16T20:20:05.974921] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-09. [2025-09-16T20:20:06.326285] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-16T20:20:06.331602] [INFO ] [REMOTE ] SCI: Full fetch complete (51163 records). [2025-09-16T20:20:06.331713] [DEBUG] [VALIDATOR ] SCI: Validating primary data. [2025-09-16T20:20:06.707897] [DEBUG] [VALIDATOR ] SCI: All expected trading days are present. [2025-09-16T20:20:06.707975] [DEBUG] [VALIDATOR ] SCI: Primary data validation passed. [2025-09-16T20:20:06.708847] [INFO ] [MAIN ] SCI: Fetched primary data is valid. [2025-09-16T20:20:06.708895] [DEBUG] [LOCAL ] SCI: Saving primary data. [2025-09-16T20:20:06.709944] [DEBUG] [LOCAL ] SCI: Trimmed 51163 records to 34725 (keeping 150 days of data) [2025-09-16T20:20:06.780959] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-06. [2025-09-16T20:20:06.838105] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-16T20:20:06.849613] [INFO ] [REMOTE ] SCCO: Full fetch complete (53682 records). [2025-09-16T20:20:06.853233] [DEBUG] [VALIDATOR ] SCCO: Validating primary data. [2025-09-16T20:20:07.326808] [DEBUG] [VALIDATOR ] SCCO: All expected trading days are present. [2025-09-16T20:20:07.326883] [DEBUG] [VALIDATOR ] SCCO: Primary data validation passed. [2025-09-16T20:20:07.327884] [INFO ] [MAIN ] SCCO: Fetched primary data is valid. [2025-09-16T20:20:07.327949] [DEBUG] [LOCAL ] SCCO: Saving primary data. [2025-09-16T20:20:07.333925] [DEBUG] [LOCAL ] SCCO: Trimmed 53682 records to 36392 (keeping 150 days of data) [2025-09-16T20:20:07.439402] [DEBUG] [LOCAL ] SCI: Primary data saved (34725 records). [2025-09-16T20:20:07.442758] [INFO ] [MAIN ] SCI: Full history saved. [2025-09-16T20:20:07.444703] [INFO ] [MAIN ] Update Progress: 1882/2369 symbols completed. SCI took 23.7s. Estimated remaining: 51m 46s. Rate: 9.4 symbols/min [2025-09-16T20:20:07.625034] [INFO ] [MAIN ] SCM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:20:07.647769] [DEBUG] [LOCAL ] SCM: Loaded 13544 existing records from primary storage. [2025-09-16T20:20:07.648607] [INFO ] [MAIN ] SCM: Loaded 13544 existing records. [2025-09-16T20:20:07.833512] [WARN ] [MAIN ] SCM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:20:07.833983] [INFO ] [MAIN ] SCM: Wiping existing primary data before full refresh. [2025-09-16T20:20:07.840766] [INFO ] [LOCAL ] SCM: Starting deletion of primary data. [2025-09-16T20:20:07.842705] [DEBUG] [LOCAL ] SCM: Deleted primary data file. [2025-09-16T20:20:07.843325] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-16T20:20:07.843366] [INFO ] [MAIN ] SCM: Starting full primary refresh. [2025-09-16T20:20:07.858769] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-07. [2025-09-16T20:20:08.212750] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-16T20:20:08.276955] [INFO ] [REMOTE ] SCHW: Full fetch complete (58365 records). [2025-09-16T20:20:08.315127] [DEBUG] [VALIDATOR ] SCHW: Validating primary data. [2025-09-16T20:20:08.350833] [INFO ] [REMOTE ] SCM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:20:08.384461] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-02. [2025-09-16T20:20:08.652304] [DEBUG] [LOCAL ] SCCO: Primary data saved (36392 records). [2025-09-16T20:20:08.662789] [INFO ] [MAIN ] SCCO: Full history saved. [2025-09-16T20:20:08.663136] [INFO ] [MAIN ] Update Progress: 1883/2369 symbols completed. SCCO took 25.0s. Estimated remaining: 51m 39s. Rate: 9.4 symbols/min [2025-09-16T20:20:08.896443] [DEBUG] [VALIDATOR ] SCHW: All expected trading days are present. [2025-09-16T20:20:08.908751] [DEBUG] [VALIDATOR ] SCHW: Primary data validation passed. [2025-09-16T20:20:08.910633] [INFO ] [MAIN ] SCHW: Fetched primary data is valid. [2025-09-16T20:20:08.910754] [DEBUG] [LOCAL ] SCHW: Saving primary data. [2025-09-16T20:20:08.927904] [INFO ] [MAIN ] SCS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:20:08.929348] [DEBUG] [LOCAL ] SCHW: Trimmed 58365 records to 40035 (keeping 150 days of data) [2025-09-16T20:20:08.937920] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-16T20:20:09.072790] [DEBUG] [LOCAL ] SCS: Loaded 31263 existing records from primary storage. [2025-09-16T20:20:09.079149] [INFO ] [MAIN ] SCS: Loaded 31263 existing records. [2025-09-16T20:20:09.219947] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-08. [2025-09-16T20:20:09.364307] [WARN ] [MAIN ] SCS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:20:09.365326] [INFO ] [MAIN ] SCS: Wiping existing primary data before full refresh. [2025-09-16T20:20:09.365817] [INFO ] [LOCAL ] SCS: Starting deletion of primary data. [2025-09-16T20:20:09.367168] [DEBUG] [LOCAL ] SCS: Deleted primary data file. [2025-09-16T20:20:09.367958] [INFO ] [MAIN ] SCS: Starting full primary refresh. [2025-09-16T20:20:09.682229] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-16T20:20:09.770056] [INFO ] [REMOTE ] SCS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:20:09.791960] [DEBUG] [LOCAL ] SCHW: Primary data saved (40035 records). [2025-09-16T20:20:09.792115] [INFO ] [MAIN ] SCHW: Full history saved. [2025-09-16T20:20:09.792220] [INFO ] [MAIN ] Update Progress: 1884/2369 symbols completed. SCHW took 26.1s. Estimated remaining: 51m 31s. Rate: 9.4 symbols/min [2025-09-16T20:20:09.965956] [INFO ] [MAIN ] SD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:20:09.976046] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-02. [2025-09-16T20:20:09.986243] [DEBUG] [LOCAL ] SD: Loaded 20654 existing records from primary storage. [2025-09-16T20:20:09.986340] [INFO ] [MAIN ] SD: Loaded 20654 existing records. [2025-09-16T20:20:10.161967] [WARN ] [MAIN ] SD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:20:10.162209] [INFO ] [MAIN ] SD: Wiping existing primary data before full refresh. [2025-09-16T20:20:10.162255] [INFO ] [LOCAL ] SD: Starting deletion of primary data. [2025-09-16T20:20:10.162889] [DEBUG] [LOCAL ] SD: Deleted primary data file. [2025-09-16T20:20:10.162940] [INFO ] [MAIN ] SD: Starting full primary refresh. [2025-09-16T20:20:10.512027] [INFO ] [REMOTE ] SD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:20:10.528624] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-16T20:20:10.774936] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-02. [2025-09-16T20:20:11.534467] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-16T20:20:11.574953] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-03. [2025-09-16T20:20:11.995286] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-16T20:20:12.374902] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-03. [2025-09-16T20:20:13.047899] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-16T20:20:13.174886] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-04. [2025-09-16T20:20:13.724056] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-16T20:20:13.974901] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-04. [2025-09-16T20:20:14.104924] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-16T20:20:14.774908] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-03. [2025-09-16T20:20:15.478107] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-16T20:20:15.574895] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-05. [2025-09-16T20:20:16.326141] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-16T20:20:16.374889] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-04. [2025-09-16T20:20:17.157756] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-16T20:20:17.174867] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-06. [2025-09-16T20:20:17.434195] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-16T20:20:17.974915] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-09. [2025-09-16T20:20:18.780132] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-05. [2025-09-16T20:20:18.798836] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-16T20:20:18.904107] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-16T20:20:18.906782] [INFO ] [REMOTE ] SCL: Full fetch complete (15907 records). [2025-09-16T20:20:18.906902] [DEBUG] [VALIDATOR ] SCL: Validating primary data. [2025-09-16T20:20:19.283801] [DEBUG] [VALIDATOR ] SCL: All expected trading days are present. [2025-09-16T20:20:19.283877] [DEBUG] [VALIDATOR ] SCL: Primary data validation passed. [2025-09-16T20:20:19.284308] [INFO ] [MAIN ] SCL: Fetched primary data is valid. [2025-09-16T20:20:19.284352] [DEBUG] [LOCAL ] SCL: Saving primary data. [2025-09-16T20:20:19.284893] [DEBUG] [LOCAL ] SCL: Trimmed 15907 records to 10807 (keeping 150 days of data) [2025-09-16T20:20:19.351309] [DEBUG] [LOCAL ] SCL: Primary data saved (10807 records). [2025-09-16T20:20:19.351449] [INFO ] [MAIN ] SCL: Full history saved. [2025-09-16T20:20:19.351538] [INFO ] [MAIN ] Update Progress: 1885/2369 symbols completed. SCL took 25.0s. Estimated remaining: 51m 25s. Rate: 9.4 symbols/min [2025-09-16T20:20:19.525052] [INFO ] [MAIN ] SDHC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:20:19.533402] [DEBUG] [LOCAL ] SDHC: Loaded 7184 existing records from primary storage. [2025-09-16T20:20:19.533502] [INFO ] [MAIN ] SDHC: Loaded 7184 existing records. [2025-09-16T20:20:19.580029] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-07. [2025-09-16T20:20:19.727457] [WARN ] [MAIN ] SDHC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:20:19.727877] [INFO ] [MAIN ] SDHC: Wiping existing primary data before full refresh. [2025-09-16T20:20:19.727946] [INFO ] [LOCAL ] SDHC: Starting deletion of primary data. [2025-09-16T20:20:19.728504] [DEBUG] [LOCAL ] SDHC: Deleted primary data file. [2025-09-16T20:20:19.728571] [INFO ] [MAIN ] SDHC: Starting full primary refresh. [2025-09-16T20:20:20.080354] [INFO ] [REMOTE ] SDHC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:20:20.170946] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-16T20:20:20.374904] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-06. [2025-09-16T20:20:20.890013] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-16T20:20:21.174900] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-05. [2025-09-16T20:20:21.838724] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-16T20:20:21.970003] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-16T20:20:21.974838] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-06. [2025-09-16T20:20:22.774918] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-08. [2025-09-16T20:20:23.126362] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-16T20:20:23.574945] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-07. [2025-09-16T20:20:24.380193] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-02. [2025-09-16T20:20:24.405098] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-16T20:20:24.798436] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-16T20:20:25.174925] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-08. [2025-09-16T20:20:25.409727] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-16T20:20:25.974888] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-03. [2025-09-16T20:20:26.011801] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-16T20:20:26.774895] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-09. [2025-09-16T20:20:27.026317] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-16T20:20:27.574911] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-04. [2025-09-16T20:20:27.597545] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-16T20:20:27.600329] [INFO ] [REMOTE ] SCM: Full fetch complete (21657 records). [2025-09-16T20:20:27.600403] [DEBUG] [VALIDATOR ] SCM: Validating primary data. [2025-09-16T20:20:27.979250] [DEBUG] [VALIDATOR ] SCM: All expected trading days are present. [2025-09-16T20:20:27.979376] [DEBUG] [VALIDATOR ] SCM: Primary data validation passed. [2025-09-16T20:20:27.979856] [INFO ] [MAIN ] SCM: Fetched primary data is valid. [2025-09-16T20:20:27.979902] [DEBUG] [LOCAL ] SCM: Saving primary data. [2025-09-16T20:20:27.980483] [DEBUG] [LOCAL ] SCM: Trimmed 21657 records to 13659 (keeping 150 days of data) [2025-09-16T20:20:28.064213] [DEBUG] [LOCAL ] SCM: Primary data saved (13659 records). [2025-09-16T20:20:28.064355] [INFO ] [MAIN ] SCM: Full history saved. [2025-09-16T20:20:28.064462] [INFO ] [MAIN ] Update Progress: 1886/2369 symbols completed. SCM took 20.6s. Estimated remaining: 51m 20s. Rate: 9.4 symbols/min [2025-09-16T20:20:28.248101] [INFO ] [MAIN ] SDHY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:20:28.258036] [DEBUG] [LOCAL ] SDHY: Loaded 7627 existing records from primary storage. [2025-09-16T20:20:28.258163] [INFO ] [MAIN ] SDHY: Loaded 7627 existing records. [2025-09-16T20:20:28.380031] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-09. [2025-09-16T20:20:28.452522] [WARN ] [MAIN ] SDHY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:20:28.452822] [INFO ] [MAIN ] SDHY: Wiping existing primary data before full refresh. [2025-09-16T20:20:28.452886] [INFO ] [LOCAL ] SDHY: Starting deletion of primary data. [2025-09-16T20:20:28.453299] [DEBUG] [LOCAL ] SDHY: Deleted primary data file. [2025-09-16T20:20:28.453362] [INFO ] [MAIN ] SDHY: Starting full primary refresh. [2025-09-16T20:20:28.579902] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-16T20:20:28.825166] [INFO ] [REMOTE ] SDHY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:20:29.174914] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-07. [2025-09-16T20:20:29.941343] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-16T20:20:29.947147] [INFO ] [REMOTE ] SCS: Full fetch complete (45987 records). [2025-09-16T20:20:29.947253] [DEBUG] [VALIDATOR ] SCS: Validating primary data. [2025-09-16T20:20:29.979960] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-02. [2025-09-16T20:20:30.354859] [DEBUG] [VALIDATOR ] SCS: All expected trading days are present. [2025-09-16T20:20:30.355075] [DEBUG] [VALIDATOR ] SCS: Primary data validation passed. [2025-09-16T20:20:30.356004] [INFO ] [MAIN ] SCS: Fetched primary data is valid. [2025-09-16T20:20:30.356086] [DEBUG] [LOCAL ] SCS: Saving primary data. [2025-09-16T20:20:30.357345] [DEBUG] [LOCAL ] SCS: Trimmed 45987 records to 31531 (keeping 150 days of data) [2025-09-16T20:20:30.557463] [DEBUG] [LOCAL ] SCS: Primary data saved (31531 records). [2025-09-16T20:20:30.557867] [INFO ] [MAIN ] SCS: Full history saved. [2025-09-16T20:20:30.558003] [INFO ] [MAIN ] Update Progress: 1887/2369 symbols completed. SCS took 21.9s. Estimated remaining: 51m 12s. Rate: 9.4 symbols/min [2025-09-16T20:20:30.680809] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-16T20:20:30.758972] [INFO ] [MAIN ] SDRL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:20:30.775678] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-05. [2025-09-16T20:20:30.790263] [DEBUG] [LOCAL ] SDRL: Loaded 30303 existing records from primary storage. [2025-09-16T20:20:30.790414] [INFO ] [MAIN ] SDRL: Loaded 30303 existing records. [2025-09-16T20:20:30.970157] [WARN ] [MAIN ] SDRL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:20:30.970457] [INFO ] [MAIN ] SDRL: Wiping existing primary data before full refresh. [2025-09-16T20:20:30.970525] [INFO ] [LOCAL ] SDRL: Starting deletion of primary data. [2025-09-16T20:20:30.971268] [DEBUG] [LOCAL ] SDRL: Deleted primary data file. [2025-09-16T20:20:30.971322] [INFO ] [MAIN ] SDRL: Starting full primary refresh. [2025-09-16T20:20:31.281584] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-16T20:20:31.366862] [INFO ] [REMOTE ] SDRL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:20:31.574925] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-02. [2025-09-16T20:20:31.586701] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-16T20:20:32.374911] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-03. [2025-09-16T20:20:33.174952] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-08. [2025-09-16T20:20:33.224211] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-16T20:20:33.241432] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-16T20:20:33.974953] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-03. [2025-09-16T20:20:34.459365] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-16T20:20:34.774953] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-06. [2025-09-16T20:20:35.439457] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-16T20:20:35.537416] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-16T20:20:35.574882] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-07. [2025-09-16T20:20:36.374916] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-04. [2025-09-16T20:20:36.425324] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-16T20:20:37.174915] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-09. [2025-09-16T20:20:37.974907] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-04. [2025-09-16T20:20:38.121433] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-16T20:20:38.358889] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-16T20:20:38.362199] [INFO ] [REMOTE ] SD: Full fetch complete (31284 records). [2025-09-16T20:20:38.362327] [DEBUG] [VALIDATOR ] SD: Validating primary data. [2025-09-16T20:20:38.749072] [DEBUG] [VALIDATOR ] SD: All expected trading days are present. [2025-09-16T20:20:38.749149] [DEBUG] [VALIDATOR ] SD: Primary data validation passed. [2025-09-16T20:20:38.749872] [INFO ] [MAIN ] SD: Fetched primary data is valid. [2025-09-16T20:20:38.749926] [DEBUG] [LOCAL ] SD: Saving primary data. [2025-09-16T20:20:38.750736] [DEBUG] [LOCAL ] SD: Trimmed 31284 records to 20834 (keeping 150 days of data) [2025-09-16T20:20:38.805391] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-05. [2025-09-16T20:20:38.881334] [DEBUG] [LOCAL ] SD: Primary data saved (20834 records). [2025-09-16T20:20:38.881471] [INFO ] [MAIN ] SD: Full history saved. [2025-09-16T20:20:38.881577] [INFO ] [MAIN ] Update Progress: 1888/2369 symbols completed. SD took 29.1s. Estimated remaining: 51m 6s. Rate: 9.4 symbols/min [2025-09-16T20:20:39.056298] [INFO ] [MAIN ] SE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:20:39.066349] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-16T20:20:39.107263] [DEBUG] [LOCAL ] SE: Loaded 39397 existing records from primary storage. [2025-09-16T20:20:39.107413] [INFO ] [MAIN ] SE: Loaded 39397 existing records. [2025-09-16T20:20:39.299702] [WARN ] [MAIN ] SE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:20:39.299952] [INFO ] [MAIN ] SE: Wiping existing primary data before full refresh. [2025-09-16T20:20:39.299998] [INFO ] [LOCAL ] SE: Starting deletion of primary data. [2025-09-16T20:20:39.300785] [DEBUG] [LOCAL ] SE: Deleted primary data file. [2025-09-16T20:20:39.300836] [INFO ] [MAIN ] SE: Starting full primary refresh. [2025-09-16T20:20:39.582564] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-08. [2025-09-16T20:20:39.678888] [INFO ] [REMOTE ] SE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:20:40.376160] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-05. [2025-09-16T20:20:40.380906] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-16T20:20:40.482370] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-16T20:20:41.018851] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-16T20:20:41.174909] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-02. [2025-09-16T20:20:41.974904] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-06. [2025-09-16T20:20:42.774904] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-09. [2025-09-16T20:20:43.418940] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-09-16T20:20:43.520997] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-16T20:20:43.523725] [INFO ] [REMOTE ] SDHC: Full fetch complete (11748 records). [2025-09-16T20:20:43.523824] [DEBUG] [VALIDATOR ] SDHC: Validating primary data. [2025-09-16T20:20:43.579989] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-06. [2025-09-16T20:20:43.902891] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-16T20:20:43.982919] [DEBUG] [VALIDATOR ] SDHC: All expected trading days are present. [2025-09-16T20:20:43.983006] [DEBUG] [VALIDATOR ] SDHC: Primary data validation passed. [2025-09-16T20:20:43.983323] [INFO ] [MAIN ] SDHC: Fetched primary data is valid. [2025-09-16T20:20:43.983383] [DEBUG] [LOCAL ] SDHC: Saving primary data. [2025-09-16T20:20:43.983861] [DEBUG] [LOCAL ] SDHC: Trimmed 11748 records to 7272 (keeping 150 days of data) [2025-09-16T20:20:44.027069] [DEBUG] [LOCAL ] SDHC: Primary data saved (7272 records). [2025-09-16T20:20:44.027170] [INFO ] [MAIN ] SDHC: Full history saved. [2025-09-16T20:20:44.027256] [INFO ] [MAIN ] Update Progress: 1889/2369 symbols completed. SDHC took 24.7s. Estimated remaining: 50m 60s. Rate: 9.4 symbols/min [2025-09-16T20:20:44.222967] [INFO ] [MAIN ] SEE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:20:44.255469] [DEBUG] [LOCAL ] SEE: Loaded 35145 existing records from primary storage. [2025-09-16T20:20:44.255607] [INFO ] [MAIN ] SEE: Loaded 35145 existing records. [2025-09-16T20:20:44.380013] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-07. [2025-09-16T20:20:44.439730] [WARN ] [MAIN ] SEE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:20:44.439960] [INFO ] [MAIN ] SEE: Wiping existing primary data before full refresh. [2025-09-16T20:20:44.440006] [INFO ] [LOCAL ] SEE: Starting deletion of primary data. [2025-09-16T20:20:44.440861] [DEBUG] [LOCAL ] SEE: Deleted primary data file. [2025-09-16T20:20:44.440912] [INFO ] [MAIN ] SEE: Starting full primary refresh. [2025-09-16T20:20:44.643031] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-16T20:20:44.839837] [INFO ] [REMOTE ] SEE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:20:45.174891] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-02. [2025-09-16T20:20:45.974907] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-03. [2025-09-16T20:20:46.102074] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-16T20:20:46.774956] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-08. [2025-09-16T20:20:46.939605] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-16T20:20:47.574904] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-07. [2025-09-16T20:20:48.092330] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-16T20:20:48.155204] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-16T20:20:48.374921] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-04. [2025-09-16T20:20:48.442704] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-16T20:20:49.174912] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-03. [2025-09-16T20:20:49.974947] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-08. [2025-09-16T20:20:50.660227] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-16T20:20:50.660444] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-16T20:20:50.774847] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-05. [2025-09-16T20:20:50.894510] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-16T20:20:51.574902] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-09. [2025-09-16T20:20:52.374916] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-09. [2025-09-16T20:20:53.066692] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-09-16T20:20:53.093746] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-16T20:20:53.098740] [INFO ] [REMOTE ] SDRL: Full fetch complete (46329 records). [2025-09-16T20:20:53.098835] [DEBUG] [VALIDATOR ] SDRL: Validating primary data. [2025-09-16T20:20:53.179949] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-06. [2025-09-16T20:20:53.206899] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-16T20:20:53.253212] [INFO ] [REMOTE ] SDHY: Full fetch complete (11690 records). [2025-09-16T20:20:53.291973] [DEBUG] [VALIDATOR ] SDHY: Validating primary data. [2025-09-16T20:20:53.656147] [DEBUG] [VALIDATOR ] SDRL: All expected trading days are present. [2025-09-16T20:20:53.670303] [DEBUG] [VALIDATOR ] SDRL: Primary data validation passed. [2025-09-16T20:20:53.742721] [INFO ] [MAIN ] SDRL: Fetched primary data is valid. [2025-09-16T20:20:53.754636] [DEBUG] [LOCAL ] SDRL: Saving primary data. [2025-09-16T20:20:53.808039] [DEBUG] [LOCAL ] SDRL: Trimmed 46329 records to 30554 (keeping 150 days of data) [2025-09-16T20:20:53.860833] [DEBUG] [VALIDATOR ] SDHY: All expected trading days are present. [2025-09-16T20:20:53.860933] [DEBUG] [VALIDATOR ] SDHY: Primary data validation passed. [2025-09-16T20:20:53.861076] [INFO ] [MAIN ] SDHY: Fetched primary data is valid. [2025-09-16T20:20:53.861117] [DEBUG] [LOCAL ] SDHY: Saving primary data. [2025-09-16T20:20:53.861683] [DEBUG] [LOCAL ] SDHY: Trimmed 11690 records to 7757 (keeping 150 days of data) [2025-09-16T20:20:53.980893] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-04. [2025-09-16T20:20:54.018684] [DEBUG] [LOCAL ] SDHY: Primary data saved (7757 records). [2025-09-16T20:20:54.019361] [INFO ] [MAIN ] SDHY: Full history saved. [2025-09-16T20:20:54.019991] [INFO ] [MAIN ] Update Progress: 1890/2369 symbols completed. SDHY took 26.0s. Estimated remaining: 50m 54s. Rate: 9.4 symbols/min [2025-09-16T20:20:54.259738] [INFO ] [MAIN ] SEG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:20:54.286763] [DEBUG] [LOCAL ] SDRL: Primary data saved (30554 records). [2025-09-16T20:20:54.285151] [DEBUG] [LOCAL ] SEG: Loaded 9597 existing records from primary storage. [2025-09-16T20:20:54.286930] [INFO ] [MAIN ] SEG: Loaded 9597 existing records. [2025-09-16T20:20:54.287011] [INFO ] [MAIN ] SDRL: Full history saved. [2025-09-16T20:20:54.320697] [INFO ] [MAIN ] Update Progress: 1891/2369 symbols completed. SDRL took 23.8s. Estimated remaining: 50m 46s. Rate: 9.4 symbols/min [2025-09-16T20:20:54.648494] [WARN ] [MAIN ] SEG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:20:54.678370] [INFO ] [MAIN ] SEG: Wiping existing primary data before full refresh. [2025-09-16T20:20:54.678301] [INFO ] [MAIN ] SEI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:20:54.678768] [INFO ] [LOCAL ] SEG: Starting deletion of primary data. [2025-09-16T20:20:54.679253] [DEBUG] [LOCAL ] SEG: Deleted primary data file. [2025-09-16T20:20:54.679312] [INFO ] [MAIN ] SEG: Starting full primary refresh. [2025-09-16T20:20:54.995515] [DEBUG] [LOCAL ] SEI: Loaded 36257 existing records from primary storage. [2025-09-16T20:20:55.006318] [INFO ] [MAIN ] SEI: Loaded 36257 existing records. [2025-09-16T20:20:55.165014] [INFO ] [REMOTE ] SEG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:20:55.175589] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-02. [2025-09-16T20:20:55.255055] [WARN ] [MAIN ] SEI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:20:55.255509] [INFO ] [MAIN ] SEI: Wiping existing primary data before full refresh. [2025-09-16T20:20:55.255570] [INFO ] [LOCAL ] SEI: Starting deletion of primary data. [2025-09-16T20:20:55.256505] [DEBUG] [LOCAL ] SEI: Deleted primary data file. [2025-09-16T20:20:55.256562] [INFO ] [MAIN ] SEI: Starting full primary refresh. [2025-09-16T20:20:55.657122] [INFO ] [REMOTE ] SEI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:20:55.675535] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-02. [2025-09-16T20:20:55.685988] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-09-16T20:20:55.750814] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-16T20:20:56.229415] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-16T20:20:56.374961] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-07. [2025-09-16T20:20:57.074086] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-16T20:20:57.174880] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-05. [2025-09-16T20:20:57.974896] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-03. [2025-09-16T20:20:58.706869] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-09-16T20:20:58.774855] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-08. [2025-09-16T20:20:58.911111] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-16T20:20:58.919298] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-16T20:20:59.574893] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-04. [2025-09-16T20:21:00.374924] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-03. [2025-09-16T20:21:00.633702] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-16T20:21:00.872163] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-16T20:21:01.174906] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-09. [2025-09-16T20:21:01.908713] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-16T20:21:01.914732] [INFO ] [REMOTE ] SE: Full fetch complete (57670 records). [2025-09-16T20:21:01.914874] [DEBUG] [VALIDATOR ] SE: Validating primary data. [2025-09-16T20:21:01.915634] [FATAL] [VALIDATOR ] SE: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T20:21:01.915741] [FATAL] [MAIN ] SE: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:21:01.915779] [WARN ] [MAIN ] SE: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:21:01.915826] [INFO ] [LOCAL ] SE: Starting deletion of primary data. [2025-09-16T20:21:01.915885] [DEBUG] [LOCAL ] SE: No primary data file found to delete. [2025-09-16T20:21:01.915941] [INFO ] [LOCAL ] SE: Starting deletion of derivative data. [2025-09-16T20:21:01.916287] [DEBUG] [LOCAL ] SE: Deleted derivative data file. [2025-09-16T20:21:01.916390] [INFO ] [MAIN ] Update Progress: 1892/2369 symbols completed. SE took 23.0s. Estimated remaining: 50m 40s. Rate: 9.4 symbols/min [2025-09-16T20:21:01.984256] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-05. [2025-09-16T20:21:02.100484] [INFO ] [MAIN ] SEM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:21:02.134776] [DEBUG] [LOCAL ] SEM: Loaded 32216 existing records from primary storage. [2025-09-16T20:21:02.134944] [INFO ] [MAIN ] SEM: Loaded 32216 existing records. [2025-09-16T20:21:02.320271] [WARN ] [MAIN ] SEM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:21:02.320614] [INFO ] [MAIN ] SEM: Wiping existing primary data before full refresh. [2025-09-16T20:21:02.320687] [INFO ] [LOCAL ] SEM: Starting deletion of primary data. [2025-09-16T20:21:02.321379] [DEBUG] [LOCAL ] SEM: Deleted primary data file. [2025-09-16T20:21:02.321433] [INFO ] [MAIN ] SEM: Starting full primary refresh. [2025-09-16T20:21:02.569226] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-16T20:21:02.726828] [INFO ] [REMOTE ] SEM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:21:02.774841] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-02. [2025-09-16T20:21:02.957609] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-16T20:21:03.574896] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-06. [2025-09-16T20:21:04.374873] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-04. [2025-09-16T20:21:04.434000] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-16T20:21:05.174979] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-03. [2025-09-16T20:21:05.219471] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-16T20:21:05.974909] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-07. [2025-09-16T20:21:06.013301] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-16T20:21:06.776261] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-06. [2025-09-16T20:21:06.787547] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-16T20:21:07.574941] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-05. [2025-09-16T20:21:07.723227] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-16T20:21:07.817059] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-16T20:21:08.374895] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-08. [2025-09-16T20:21:09.174899] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-04. [2025-09-16T20:21:09.415610] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-16T20:21:09.974882] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-06. [2025-09-16T20:21:10.056730] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-16T20:21:10.774880] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-07. [2025-09-16T20:21:10.856570] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-16T20:21:11.291635] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-16T20:21:11.574890] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-05. [2025-09-16T20:21:11.815967] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-16T20:21:12.374938] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-07. [2025-09-16T20:21:13.174917] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-08. [2025-09-16T20:21:13.341039] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-16T20:21:13.961239] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-16T20:21:13.974844] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-08. [2025-09-16T20:21:14.181983] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-16T20:21:14.774912] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-06. [2025-09-16T20:21:15.574960] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-09. [2025-09-16T20:21:15.986008] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-16T20:21:16.319588] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-16T20:21:16.321802] [INFO ] [REMOTE ] SEG: Full fetch complete (15699 records). [2025-09-16T20:21:16.321930] [DEBUG] [VALIDATOR ] SEG: Validating primary data. [2025-09-16T20:21:16.381465] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-09. [2025-09-16T20:21:16.555937] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-16T20:21:16.781005] [DEBUG] [VALIDATOR ] SEG: All expected trading days are present. [2025-09-16T20:21:16.781082] [DEBUG] [VALIDATOR ] SEG: Primary data validation passed. [2025-09-16T20:21:16.781429] [INFO ] [MAIN ] SEG: Fetched primary data is valid. [2025-09-16T20:21:16.781478] [DEBUG] [LOCAL ] SEG: Saving primary data. [2025-09-16T20:21:16.781984] [DEBUG] [LOCAL ] SEG: Trimmed 15699 records to 9675 (keeping 150 days of data) [2025-09-16T20:21:16.840225] [DEBUG] [LOCAL ] SEG: Primary data saved (9675 records). [2025-09-16T20:21:16.840360] [INFO ] [MAIN ] SEG: Full history saved. [2025-09-16T20:21:16.840444] [INFO ] [MAIN ] Update Progress: 1893/2369 symbols completed. SEG took 22.8s. Estimated remaining: 50m 36s. Rate: 9.4 symbols/min [2025-09-16T20:21:17.009201] [INFO ] [MAIN ] SEMR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:21:17.037610] [DEBUG] [LOCAL ] SEMR: Loaded 30594 existing records from primary storage. [2025-09-16T20:21:17.037767] [INFO ] [MAIN ] SEMR: Loaded 30594 existing records. [2025-09-16T20:21:17.179959] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-09. [2025-09-16T20:21:17.217176] [WARN ] [MAIN ] SEMR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:21:17.217363] [INFO ] [MAIN ] SEMR: Wiping existing primary data before full refresh. [2025-09-16T20:21:17.217429] [INFO ] [LOCAL ] SEMR: Starting deletion of primary data. [2025-09-16T20:21:17.218077] [DEBUG] [LOCAL ] SEMR: Deleted primary data file. [2025-09-16T20:21:17.218139] [INFO ] [MAIN ] SEMR: Starting full primary refresh. [2025-09-16T20:21:17.578280] [INFO ] [REMOTE ] SEMR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:21:17.974903] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-07. [2025-09-16T20:21:18.035631] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-16T20:21:18.041309] [INFO ] [REMOTE ] SEE: Full fetch complete (52722 records). [2025-09-16T20:21:18.041401] [DEBUG] [VALIDATOR ] SEE: Validating primary data. [2025-09-16T20:21:18.419900] [DEBUG] [VALIDATOR ] SEE: All expected trading days are present. [2025-09-16T20:21:18.419984] [DEBUG] [VALIDATOR ] SEE: Primary data validation passed. [2025-09-16T20:21:18.421199] [INFO ] [MAIN ] SEE: Fetched primary data is valid. [2025-09-16T20:21:18.421254] [DEBUG] [LOCAL ] SEE: Saving primary data. [2025-09-16T20:21:18.422395] [DEBUG] [LOCAL ] SEE: Trimmed 52722 records to 35487 (keeping 150 days of data) [2025-09-16T20:21:18.647948] [DEBUG] [LOCAL ] SEE: Primary data saved (35487 records). [2025-09-16T20:21:18.648090] [INFO ] [MAIN ] SEE: Full history saved. [2025-09-16T20:21:18.648174] [INFO ] [MAIN ] Update Progress: 1894/2369 symbols completed. SEE took 34.6s. Estimated remaining: 50m 28s. Rate: 9.4 symbols/min [2025-09-16T20:21:18.779958] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-02. [2025-09-16T20:21:18.822542] [INFO ] [MAIN ] SES: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:21:18.857707] [DEBUG] [LOCAL ] SES: Loaded 37762 existing records from primary storage. [2025-09-16T20:21:18.857864] [INFO ] [MAIN ] SES: Loaded 37762 existing records. [2025-09-16T20:21:19.039761] [WARN ] [MAIN ] SES: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:21:19.040129] [INFO ] [MAIN ] SES: Wiping existing primary data before full refresh. [2025-09-16T20:21:19.040298] [INFO ] [LOCAL ] SES: Starting deletion of primary data. [2025-09-16T20:21:19.041068] [DEBUG] [LOCAL ] SES: Deleted primary data file. [2025-09-16T20:21:19.041120] [INFO ] [MAIN ] SES: Starting full primary refresh. [2025-09-16T20:21:19.164237] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-16T20:21:19.237623] [INFO ] [REMOTE ] SEI: Full fetch complete (53428 records). [2025-09-16T20:21:19.316341] [DEBUG] [VALIDATOR ] SEI: Validating primary data. [2025-09-16T20:21:19.528298] [INFO ] [REMOTE ] SES: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:21:19.577804] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-02. [2025-09-16T20:21:19.806390] [DEBUG] [VALIDATOR ] SEI: All expected trading days are present. [2025-09-16T20:21:19.806485] [DEBUG] [VALIDATOR ] SEI: Primary data validation passed. [2025-09-16T20:21:19.807434] [INFO ] [MAIN ] SEI: Fetched primary data is valid. [2025-09-16T20:21:19.807568] [DEBUG] [LOCAL ] SEI: Saving primary data. [2025-09-16T20:21:19.808894] [DEBUG] [LOCAL ] SEI: Trimmed 53428 records to 36632 (keeping 150 days of data) [2025-09-16T20:21:19.940115] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-16T20:21:20.094964] [DEBUG] [LOCAL ] SEI: Primary data saved (36632 records). [2025-09-16T20:21:20.095164] [INFO ] [MAIN ] SEI: Full history saved. [2025-09-16T20:21:20.095277] [INFO ] [MAIN ] Update Progress: 1895/2369 symbols completed. SEI took 25.7s. Estimated remaining: 50m 21s. Rate: 9.4 symbols/min [2025-09-16T20:21:20.263581] [INFO ] [MAIN ] SF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:21:20.293674] [DEBUG] [LOCAL ] SF: Loaded 30057 existing records from primary storage. [2025-09-16T20:21:20.293816] [INFO ] [MAIN ] SF: Loaded 30057 existing records. [2025-09-16T20:21:20.383564] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-08. [2025-09-16T20:21:20.471150] [WARN ] [MAIN ] SF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:21:20.471396] [INFO ] [MAIN ] SF: Wiping existing primary data before full refresh. [2025-09-16T20:21:20.471450] [INFO ] [LOCAL ] SF: Starting deletion of primary data. [2025-09-16T20:21:20.472194] [DEBUG] [LOCAL ] SF: Deleted primary data file. [2025-09-16T20:21:20.472244] [INFO ] [MAIN ] SF: Starting full primary refresh. [2025-09-16T20:21:20.828050] [INFO ] [REMOTE ] SF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:21:21.174900] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-02. [2025-09-16T20:21:21.962826] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-16T20:21:21.974852] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-09. [2025-09-16T20:21:22.301361] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-02 (2.72 seconds). [2025-09-16T20:21:22.774931] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-03. [2025-09-16T20:21:22.803578] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-16T20:21:22.886484] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-02 (4.11 seconds). [2025-09-16T20:21:23.269266] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-16T20:21:23.274336] [INFO ] [REMOTE ] SEM: Full fetch complete (46801 records). [2025-09-16T20:21:23.274433] [DEBUG] [VALIDATOR ] SEM: Validating primary data. [2025-09-16T20:21:23.580012] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-03. [2025-09-16T20:21:23.657605] [DEBUG] [VALIDATOR ] SEM: All expected trading days are present. [2025-09-16T20:21:23.657724] [DEBUG] [VALIDATOR ] SEM: Primary data validation passed. [2025-09-16T20:21:23.658706] [INFO ] [MAIN ] SEM: Fetched primary data is valid. [2025-09-16T20:21:23.658783] [DEBUG] [LOCAL ] SEM: Saving primary data. [2025-09-16T20:21:23.661234] [DEBUG] [LOCAL ] SEM: Trimmed 46801 records to 32479 (keeping 150 days of data) [2025-09-16T20:21:23.867302] [DEBUG] [LOCAL ] SEM: Primary data saved (32479 records). [2025-09-16T20:21:23.867450] [INFO ] [MAIN ] SEM: Full history saved. [2025-09-16T20:21:23.867582] [INFO ] [MAIN ] Update Progress: 1896/2369 symbols completed. SEM took 22.0s. Estimated remaining: 50m 14s. Rate: 9.4 symbols/min [2025-09-16T20:21:24.040761] [INFO ] [MAIN ] SFB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:21:24.045916] [DEBUG] [LOCAL ] SFB: Loaded 2574 existing records from primary storage. [2025-09-16T20:21:24.046022] [INFO ] [MAIN ] SFB: Loaded 2574 existing records. [2025-09-16T20:21:24.221140] [WARN ] [MAIN ] SFB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:21:24.221399] [INFO ] [MAIN ] SFB: Wiping existing primary data before full refresh. [2025-09-16T20:21:24.221445] [INFO ] [LOCAL ] SFB: Starting deletion of primary data. [2025-09-16T20:21:24.221635] [DEBUG] [LOCAL ] SFB: Deleted primary data file. [2025-09-16T20:21:24.221755] [INFO ] [MAIN ] SFB: Starting full primary refresh. [2025-09-16T20:21:24.385355] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-03. [2025-09-16T20:21:24.585809] [INFO ] [REMOTE ] SFB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:21:25.174918] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-02. [2025-09-16T20:21:25.410196] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-16T20:21:25.479427] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-03 (2.70 seconds). [2025-09-16T20:21:25.800047] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-16T20:21:25.968260] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-16T20:21:25.976814] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-04. [2025-09-16T20:21:26.774901] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-04. [2025-09-16T20:21:27.574902] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-04. [2025-09-16T20:21:28.276024] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-16T20:21:28.374941] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-05. [2025-09-16T20:21:28.554697] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-16T20:21:28.829955] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-16T20:21:29.174904] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-05. [2025-09-16T20:21:29.974917] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-05. [2025-09-16T20:21:30.575310] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-16T20:21:30.774884] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-06. [2025-09-16T20:21:30.864285] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-09-16T20:21:31.574883] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-06. [2025-09-16T20:21:31.682528] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-16T20:21:31.948209] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-16T20:21:32.374903] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-03. [2025-09-16T20:21:33.072824] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-16T20:21:33.174901] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-04. [2025-09-16T20:21:33.840097] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-16T20:21:33.895084] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-09-16T20:21:33.974871] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-07. [2025-09-16T20:21:34.774912] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-07. [2025-09-16T20:21:35.574889] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-06. [2025-09-16T20:21:36.105336] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-16T20:21:36.144125] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-16T20:21:36.374894] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-08. [2025-09-16T20:21:37.174910] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-05. [2025-09-16T20:21:37.204167] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-16T20:21:37.895191] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-16T20:21:37.974953] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-06. [2025-09-16T20:21:38.273269] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-16T20:21:38.596822] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-16T20:21:38.774907] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-07. [2025-09-16T20:21:39.418820] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-16T20:21:39.574908] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-08. [2025-09-16T20:21:40.374918] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-08. [2025-09-16T20:21:41.125590] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-16T20:21:41.172705] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-16T20:21:41.181856] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-09. [2025-09-16T20:21:41.574563] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-16T20:21:41.575760] [INFO ] [REMOTE ] SFB: Full fetch complete (4355 records). [2025-09-16T20:21:41.575828] [DEBUG] [VALIDATOR ] SFB: Validating primary data. [2025-09-16T20:21:41.929945] [DEBUG] [VALIDATOR ] SFB: All expected trading days are present. [2025-09-16T20:21:41.930021] [DEBUG] [VALIDATOR ] SFB: Primary data validation passed. [2025-09-16T20:21:41.930151] [INFO ] [MAIN ] SFB: Fetched primary data is valid. [2025-09-16T20:21:41.930205] [DEBUG] [LOCAL ] SFB: Saving primary data. [2025-09-16T20:21:41.930671] [DEBUG] [LOCAL ] SFB: Trimmed 4355 records to 2592 (keeping 150 days of data) [2025-09-16T20:21:41.946687] [DEBUG] [LOCAL ] SFB: Primary data saved (2592 records). [2025-09-16T20:21:41.946746] [INFO ] [MAIN ] SFB: Full history saved. [2025-09-16T20:21:41.946839] [INFO ] [MAIN ] Update Progress: 1897/2369 symbols completed. SFB took 18.1s. Estimated remaining: 50m 10s. Rate: 9.4 symbols/min [2025-09-16T20:21:41.979980] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-09. [2025-09-16T20:21:42.120248] [INFO ] [MAIN ] SFBS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:21:42.137074] [DEBUG] [LOCAL ] SFBS: Loaded 15262 existing records from primary storage. [2025-09-16T20:21:42.137192] [INFO ] [MAIN ] SFBS: Loaded 15262 existing records. [2025-09-16T20:21:42.312688] [WARN ] [MAIN ] SFBS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:21:42.312943] [INFO ] [MAIN ] SFBS: Wiping existing primary data before full refresh. [2025-09-16T20:21:42.312988] [INFO ] [LOCAL ] SFBS: Starting deletion of primary data. [2025-09-16T20:21:42.313403] [DEBUG] [LOCAL ] SFBS: Deleted primary data file. [2025-09-16T20:21:42.313455] [INFO ] [MAIN ] SFBS: Starting full primary refresh. [2025-09-16T20:21:42.683758] [INFO ] [REMOTE ] SFBS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:21:42.774889] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-07. [2025-09-16T20:21:43.574901] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-09. [2025-09-16T20:21:43.863901] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-16T20:21:43.869713] [INFO ] [REMOTE ] SES: Full fetch complete (56180 records). [2025-09-16T20:21:43.869811] [DEBUG] [VALIDATOR ] SES: Validating primary data. [2025-09-16T20:21:44.257398] [DEBUG] [VALIDATOR ] SES: All expected trading days are present. [2025-09-16T20:21:44.257478] [DEBUG] [VALIDATOR ] SES: Primary data validation passed. [2025-09-16T20:21:44.258514] [INFO ] [MAIN ] SES: Fetched primary data is valid. [2025-09-16T20:21:44.258586] [DEBUG] [LOCAL ] SES: Saving primary data. [2025-09-16T20:21:44.259808] [DEBUG] [LOCAL ] SES: Trimmed 56180 records to 38115 (keeping 150 days of data) [2025-09-16T20:21:44.376760] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-02. [2025-09-16T20:21:44.496711] [DEBUG] [LOCAL ] SES: Primary data saved (38115 records). [2025-09-16T20:21:44.496926] [INFO ] [MAIN ] SES: Full history saved. [2025-09-16T20:21:44.497827] [INFO ] [MAIN ] Update Progress: 1898/2369 symbols completed. SES took 25.8s. Estimated remaining: 50m 3s. Rate: 9.4 symbols/min [2025-09-16T20:21:44.625877] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-16T20:21:44.703143] [INFO ] [MAIN ] SFL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:21:44.738057] [DEBUG] [LOCAL ] SFL: Loaded 32732 existing records from primary storage. [2025-09-16T20:21:44.738195] [INFO ] [MAIN ] SFL: Loaded 32732 existing records. [2025-09-16T20:21:44.914462] [WARN ] [MAIN ] SFL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:21:44.914797] [INFO ] [MAIN ] SFL: Wiping existing primary data before full refresh. [2025-09-16T20:21:44.914911] [INFO ] [LOCAL ] SFL: Starting deletion of primary data. [2025-09-16T20:21:44.920668] [DEBUG] [LOCAL ] SFL: Deleted primary data file. [2025-09-16T20:21:44.927952] [INFO ] [MAIN ] SFL: Starting full primary refresh. [2025-09-16T20:21:44.949380] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-16T20:21:45.036856] [INFO ] [REMOTE ] SEMR: Full fetch complete (45118 records). [2025-09-16T20:21:45.039511] [DEBUG] [VALIDATOR ] SEMR: Validating primary data. [2025-09-16T20:21:45.177793] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-08. [2025-09-16T20:21:45.610209] [INFO ] [REMOTE ] SFL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:21:45.746729] [DEBUG] [VALIDATOR ] SEMR: All expected trading days are present. [2025-09-16T20:21:45.756285] [DEBUG] [VALIDATOR ] SEMR: Primary data validation passed. [2025-09-16T20:21:45.757720] [INFO ] [MAIN ] SEMR: Fetched primary data is valid. [2025-09-16T20:21:45.758069] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-16T20:21:45.761765] [DEBUG] [LOCAL ] SEMR: Saving primary data. [2025-09-16T20:21:45.763137] [DEBUG] [LOCAL ] SEMR: Trimmed 45118 records to 30918 (keeping 150 days of data) [2025-09-16T20:21:45.950584] [DEBUG] [LOCAL ] SEMR: Primary data saved (30918 records). [2025-09-16T20:21:45.950766] [INFO ] [MAIN ] SEMR: Full history saved. [2025-09-16T20:21:45.950874] [INFO ] [MAIN ] Update Progress: 1899/2369 symbols completed. SEMR took 29.1s. Estimated remaining: 49m 55s. Rate: 9.4 symbols/min [2025-09-16T20:21:45.982513] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-03. [2025-09-16T20:21:46.129825] [INFO ] [MAIN ] SG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:21:46.184517] [DEBUG] [LOCAL ] SG: Loaded 39519 existing records from primary storage. [2025-09-16T20:21:46.184718] [INFO ] [MAIN ] SG: Loaded 39519 existing records. [2025-09-16T20:21:46.371881] [WARN ] [MAIN ] SG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:21:46.372170] [INFO ] [MAIN ] SG: Wiping existing primary data before full refresh. [2025-09-16T20:21:46.372231] [INFO ] [LOCAL ] SG: Starting deletion of primary data. [2025-09-16T20:21:46.373123] [DEBUG] [LOCAL ] SG: Deleted primary data file. [2025-09-16T20:21:46.373187] [INFO ] [MAIN ] SG: Starting full primary refresh. [2025-09-16T20:21:46.763331] [INFO ] [REMOTE ] SG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:21:46.774844] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-02. [2025-09-16T20:21:46.909083] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-16T20:21:46.966511] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-16T20:21:47.574944] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-02. [2025-09-16T20:21:48.374948] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-09. [2025-09-16T20:21:48.688986] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-16T20:21:49.062736] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-16T20:21:49.174871] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-03. [2025-09-16T20:21:49.769614] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-16T20:21:49.774505] [INFO ] [REMOTE ] SF: Full fetch complete (45373 records). [2025-09-16T20:21:49.774632] [DEBUG] [VALIDATOR ] SF: Validating primary data. [2025-09-16T20:21:49.980021] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-04. [2025-09-16T20:21:50.183963] [DEBUG] [VALIDATOR ] SF: All expected trading days are present. [2025-09-16T20:21:50.184060] [DEBUG] [VALIDATOR ] SF: Primary data validation passed. [2025-09-16T20:21:50.184945] [INFO ] [MAIN ] SF: Fetched primary data is valid. [2025-09-16T20:21:50.185003] [DEBUG] [LOCAL ] SF: Saving primary data. [2025-09-16T20:21:50.186120] [DEBUG] [LOCAL ] SF: Trimmed 45373 records to 30312 (keeping 150 days of data) [2025-09-16T20:21:50.384219] [DEBUG] [LOCAL ] SF: Primary data saved (30312 records). [2025-09-16T20:21:50.384374] [INFO ] [MAIN ] SF: Full history saved. [2025-09-16T20:21:50.384463] [INFO ] [MAIN ] Update Progress: 1900/2369 symbols completed. SF took 30.3s. Estimated remaining: 49m 49s. Rate: 9.4 symbols/min [2025-09-16T20:21:50.563774] [INFO ] [MAIN ] SGHC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:21:50.598353] [DEBUG] [LOCAL ] SGHC: Loaded 34314 existing records from primary storage. [2025-09-16T20:21:50.598541] [INFO ] [MAIN ] SGHC: Loaded 34314 existing records. [2025-09-16T20:21:50.790238] [WARN ] [MAIN ] SGHC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:21:50.790342] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-03. [2025-09-16T20:21:50.790632] [INFO ] [MAIN ] SGHC: Wiping existing primary data before full refresh. [2025-09-16T20:21:50.791401] [INFO ] [LOCAL ] SGHC: Starting deletion of primary data. [2025-09-16T20:21:50.792229] [DEBUG] [LOCAL ] SGHC: Deleted primary data file. [2025-09-16T20:21:50.792363] [INFO ] [MAIN ] SGHC: Starting full primary refresh. [2025-09-16T20:21:50.997923] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-16T20:21:51.232524] [INFO ] [REMOTE ] SGHC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:21:51.281666] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-16T20:21:51.574919] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-04. [2025-09-16T20:21:52.374904] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-02. [2025-09-16T20:21:52.563015] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-16T20:21:53.174911] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-05. [2025-09-16T20:21:53.313858] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-16T20:21:53.951682] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-16T20:21:53.974882] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-03. [2025-09-16T20:21:54.327065] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-16T20:21:54.774914] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-04. [2025-09-16T20:21:55.574906] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-06. [2025-09-16T20:21:55.627466] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-16T20:21:56.374902] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-04. [2025-09-16T20:21:56.648344] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-16T20:21:56.779552] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-16T20:21:57.174916] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-05. [2025-09-16T20:21:57.547320] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-16T20:21:57.974933] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-07. [2025-09-16T20:21:58.732395] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-16T20:21:58.774891] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-06. [2025-09-16T20:21:58.834049] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-16T20:21:59.574943] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-05. [2025-09-16T20:22:00.374941] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-05. [2025-09-16T20:22:00.479357] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-16T20:22:01.174939] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-08. [2025-09-16T20:22:01.620408] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-16T20:22:01.927058] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-16T20:22:01.982956] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-07. [2025-09-16T20:22:01.987364] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-16T20:22:02.774971] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-06. [2025-09-16T20:22:03.574930] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-06. [2025-09-16T20:22:03.728801] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-16T20:22:04.374896] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-09. [2025-09-16T20:22:04.416627] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-16T20:22:05.174919] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-07. [2025-09-16T20:22:05.272533] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-16T20:22:05.275390] [INFO ] [REMOTE ] SFBS: Full fetch complete (22996 records). [2025-09-16T20:22:05.275465] [DEBUG] [VALIDATOR ] SFBS: Validating primary data. [2025-09-16T20:22:05.550361] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-16T20:22:05.707367] [DEBUG] [VALIDATOR ] SFBS: All expected trading days are present. [2025-09-16T20:22:05.707457] [DEBUG] [VALIDATOR ] SFBS: Primary data validation passed. [2025-09-16T20:22:05.707964] [INFO ] [MAIN ] SFBS: Fetched primary data is valid. [2025-09-16T20:22:05.708009] [DEBUG] [LOCAL ] SFBS: Saving primary data. [2025-09-16T20:22:05.708838] [DEBUG] [LOCAL ] SFBS: Trimmed 22996 records to 15423 (keeping 150 days of data) [2025-09-16T20:22:05.812902] [DEBUG] [LOCAL ] SFBS: Primary data saved (15423 records). [2025-09-16T20:22:05.813060] [INFO ] [MAIN ] SFBS: Full history saved. [2025-09-16T20:22:05.813157] [INFO ] [MAIN ] Update Progress: 1901/2369 symbols completed. SFBS took 23.9s. Estimated remaining: 49m 44s. Rate: 9.4 symbols/min [2025-09-16T20:22:05.979191] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-07. [2025-09-16T20:22:05.996439] [INFO ] [MAIN ] SGI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:22:05.996926] [DEBUG] [LOCAL ] SGI: No existing data file found in primary storage. [2025-09-16T20:22:05.996990] [WARN ] [MAIN ] SGI: No existing data found, performing full refresh instead. [2025-09-16T20:22:05.997805] [INFO ] [MAIN ] SGI: Wiping existing primary data before full refresh. [2025-09-16T20:22:05.997850] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-09-16T20:22:05.997894] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-09-16T20:22:05.997927] [INFO ] [MAIN ] SGI: Starting full primary refresh. [2025-09-16T20:22:06.359800] [INFO ] [REMOTE ] SGI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:22:06.671571] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-16T20:22:06.774874] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-08. [2025-09-16T20:22:07.574918] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-02. [2025-09-16T20:22:08.333057] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-09-16T20:22:08.382911] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-08. [2025-09-16T20:22:08.402555] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-16T20:22:08.671555] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-16T20:22:09.174955] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-03. [2025-09-16T20:22:09.974888] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-08. [2025-09-16T20:22:10.440740] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-16T20:22:10.774948] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-09. [2025-09-16T20:22:10.957005] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-16T20:22:11.281078] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-16T20:22:11.574969] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-09. [2025-09-16T20:22:11.991587] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-16T20:22:11.999044] [INFO ] [REMOTE ] SGHC: Full fetch complete (49068 records). [2025-09-16T20:22:11.999264] [DEBUG] [VALIDATOR ] SGHC: Validating primary data. [2025-09-16T20:22:12.372201] [DEBUG] [VALIDATOR ] SGHC: All expected trading days are present. [2025-09-16T20:22:12.372280] [DEBUG] [VALIDATOR ] SGHC: Primary data validation passed. [2025-09-16T20:22:12.373168] [INFO ] [MAIN ] SGHC: Fetched primary data is valid. [2025-09-16T20:22:12.373212] [DEBUG] [LOCAL ] SGHC: Saving primary data. [2025-09-16T20:22:12.374288] [DEBUG] [LOCAL ] SGHC: Trimmed 49068 records to 34694 (keeping 150 days of data) [2025-09-16T20:22:12.374973] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-04. [2025-09-16T20:22:12.579876] [DEBUG] [LOCAL ] SGHC: Primary data saved (34694 records). [2025-09-16T20:22:12.580025] [INFO ] [MAIN ] SGHC: Full history saved. [2025-09-16T20:22:12.580111] [INFO ] [MAIN ] Update Progress: 1902/2369 symbols completed. SGHC took 22.2s. Estimated remaining: 49m 38s. Rate: 9.4 symbols/min [2025-09-16T20:22:12.751229] [INFO ] [MAIN ] SGU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:22:12.760686] [DEBUG] [LOCAL ] SGU: Loaded 5060 existing records from primary storage. [2025-09-16T20:22:12.760786] [INFO ] [MAIN ] SGU: Loaded 5060 existing records. [2025-09-16T20:22:12.942695] [WARN ] [MAIN ] SGU: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:22:12.942948] [INFO ] [MAIN ] SGU: Wiping existing primary data before full refresh. [2025-09-16T20:22:12.942994] [INFO ] [LOCAL ] SGU: Starting deletion of primary data. [2025-09-16T20:22:12.943279] [DEBUG] [LOCAL ] SGU: Deleted primary data file. [2025-09-16T20:22:12.943338] [INFO ] [MAIN ] SGU: Starting full primary refresh. [2025-09-16T20:22:13.180720] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-09. [2025-09-16T20:22:13.307077] [INFO ] [REMOTE ] SGU: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:22:13.395241] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-16T20:22:13.402000] [INFO ] [REMOTE ] SG: Full fetch complete (58137 records). [2025-09-16T20:22:13.402122] [DEBUG] [VALIDATOR ] SG: Validating primary data. [2025-09-16T20:22:13.821082] [DEBUG] [VALIDATOR ] SG: All expected trading days are present. [2025-09-16T20:22:13.821167] [DEBUG] [VALIDATOR ] SG: Primary data validation passed. [2025-09-16T20:22:13.822406] [INFO ] [MAIN ] SG: Fetched primary data is valid. [2025-09-16T20:22:13.822467] [DEBUG] [LOCAL ] SG: Saving primary data. [2025-09-16T20:22:13.823739] [DEBUG] [LOCAL ] SG: Trimmed 58137 records to 39909 (keeping 150 days of data) [2025-09-16T20:22:14.007504] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-02. [2025-09-16T20:22:14.084753] [DEBUG] [LOCAL ] SG: Primary data saved (39909 records). [2025-09-16T20:22:14.084904] [INFO ] [MAIN ] SG: Full history saved. [2025-09-16T20:22:14.084990] [INFO ] [MAIN ] Update Progress: 1903/2369 symbols completed. SG took 28.1s. Estimated remaining: 49m 31s. Rate: 9.4 symbols/min [2025-09-16T20:22:14.268161] [INFO ] [MAIN ] SHAK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:22:14.301313] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-16T20:22:14.344485] [DEBUG] [LOCAL ] SHAK: Loaded 36037 existing records from primary storage. [2025-09-16T20:22:14.344628] [INFO ] [MAIN ] SHAK: Loaded 36037 existing records. [2025-09-16T20:22:14.536458] [WARN ] [MAIN ] SHAK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:22:14.537114] [INFO ] [MAIN ] SHAK: Wiping existing primary data before full refresh. [2025-09-16T20:22:14.537202] [INFO ] [LOCAL ] SHAK: Starting deletion of primary data. [2025-09-16T20:22:14.543383] [DEBUG] [LOCAL ] SHAK: Deleted primary data file. [2025-09-16T20:22:14.553893] [INFO ] [MAIN ] SHAK: Starting full primary refresh. [2025-09-16T20:22:14.560706] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-16T20:22:14.674084] [INFO ] [REMOTE ] SFL: Full fetch complete (49886 records). [2025-09-16T20:22:14.674329] [DEBUG] [VALIDATOR ] SFL: Validating primary data. [2025-09-16T20:22:14.777324] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-05. [2025-09-16T20:22:15.035687] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-16T20:22:15.302894] [INFO ] [REMOTE ] SHAK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:22:15.346131] [DEBUG] [VALIDATOR ] SFL: All expected trading days are present. [2025-09-16T20:22:15.346229] [DEBUG] [VALIDATOR ] SFL: Primary data validation passed. [2025-09-16T20:22:15.347123] [INFO ] [MAIN ] SFL: Fetched primary data is valid. [2025-09-16T20:22:15.347174] [DEBUG] [LOCAL ] SFL: Saving primary data. [2025-09-16T20:22:15.348353] [DEBUG] [LOCAL ] SFL: Trimmed 49886 records to 33082 (keeping 150 days of data) [2025-09-16T20:22:15.559440] [DEBUG] [LOCAL ] SFL: Primary data saved (33082 records). [2025-09-16T20:22:15.559590] [INFO ] [MAIN ] SFL: Full history saved. [2025-09-16T20:22:15.560543] [INFO ] [MAIN ] Update Progress: 1904/2369 symbols completed. SFL took 31.1s. Estimated remaining: 49m 23s. Rate: 9.4 symbols/min [2025-09-16T20:22:15.581474] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-02. [2025-09-16T20:22:15.731369] [INFO ] [MAIN ] SHCO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:22:15.749988] [DEBUG] [LOCAL ] SHCO: Loaded 18137 existing records from primary storage. [2025-09-16T20:22:15.750139] [INFO ] [MAIN ] SHCO: Loaded 18137 existing records. [2025-09-16T20:22:15.925354] [WARN ] [MAIN ] SHCO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:22:15.925585] [INFO ] [MAIN ] SHCO: Wiping existing primary data before full refresh. [2025-09-16T20:22:15.925632] [INFO ] [LOCAL ] SHCO: Starting deletion of primary data. [2025-09-16T20:22:15.926081] [DEBUG] [LOCAL ] SHCO: Deleted primary data file. [2025-09-16T20:22:15.926130] [INFO ] [MAIN ] SHCO: Starting full primary refresh. [2025-09-16T20:22:16.283779] [INFO ] [REMOTE ] SHCO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:22:16.374891] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-02. [2025-09-16T20:22:16.612348] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-16T20:22:17.174924] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-03. [2025-09-16T20:22:17.387721] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-16T20:22:17.437832] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-16T20:22:17.977214] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-03. [2025-09-16T20:22:17.980674] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-16T20:22:18.774900] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-04. [2025-09-16T20:22:19.458184] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-16T20:22:19.574928] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-06. [2025-09-16T20:22:19.858716] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-16T20:22:20.374894] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-04. [2025-09-16T20:22:21.174897] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-03. [2025-09-16T20:22:21.220972] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-16T20:22:21.974909] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-07. [2025-09-16T20:22:22.095716] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-16T20:22:22.451941] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-16T20:22:22.774908] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-04. [2025-09-16T20:22:23.574912] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-05. [2025-09-16T20:22:23.829867] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-16T20:22:24.059557] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-16T20:22:24.100237] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-16T20:22:24.374898] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-05. [2025-09-16T20:22:25.174897] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-08. [2025-09-16T20:22:25.225425] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-16T20:22:25.974898] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-06. [2025-09-16T20:22:26.774890] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-05. [2025-09-16T20:22:27.098883] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-16T20:22:27.141392] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-16T20:22:27.574905] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-06. [2025-09-16T20:22:28.310596] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-16T20:22:28.374933] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-07. [2025-09-16T20:22:28.652895] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-16T20:22:29.174959] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-09. [2025-09-16T20:22:29.235958] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-16T20:22:29.974974] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-07. [2025-09-16T20:22:30.774940] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-08. [2025-09-16T20:22:30.797997] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-16T20:22:30.804279] [INFO ] [REMOTE ] SGI: Full fetch complete (55312 records). [2025-09-16T20:22:30.804441] [DEBUG] [VALIDATOR ] SGI: Validating primary data. [2025-09-16T20:22:31.010841] [WARN ] [VALIDATOR ] SGI: Validation failed - insufficient historical data. Have 146 unique days, need 150 days [2025-09-16T20:22:31.011761] [FATAL] [MAIN ] SGI: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:22:31.011826] [WARN ] [MAIN ] SGI: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:22:31.011879] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-09-16T20:22:31.011949] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-09-16T20:22:31.011991] [INFO ] [LOCAL ] SGI: Starting deletion of derivative data. [2025-09-16T20:22:31.012057] [DEBUG] [LOCAL ] SGI: No derivative data file found to delete. [2025-09-16T20:22:31.012146] [INFO ] [MAIN ] Update Progress: 1905/2369 symbols completed. SGI took 25.2s. Estimated remaining: 49m 19s. Rate: 9.4 symbols/min [2025-09-16T20:22:31.193638] [INFO ] [MAIN ] SHEL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:22:31.233997] [DEBUG] [LOCAL ] SHEL: Loaded 39637 existing records from primary storage. [2025-09-16T20:22:31.234185] [INFO ] [MAIN ] SHEL: Loaded 39637 existing records. [2025-09-16T20:22:31.424744] [WARN ] [MAIN ] SHEL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:22:31.425078] [INFO ] [MAIN ] SHEL: Wiping existing primary data before full refresh. [2025-09-16T20:22:31.425203] [INFO ] [LOCAL ] SHEL: Starting deletion of primary data. [2025-09-16T20:22:31.431244] [DEBUG] [LOCAL ] SHEL: Deleted primary data file. [2025-09-16T20:22:31.441481] [INFO ] [MAIN ] SHEL: Starting full primary refresh. [2025-09-16T20:22:31.448130] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-16T20:22:31.580160] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-06. [2025-09-16T20:22:31.762065] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-16T20:22:31.844376] [INFO ] [REMOTE ] SHEL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:22:32.374908] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-02. [2025-09-16T20:22:33.174920] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-08. [2025-09-16T20:22:33.385511] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-16T20:22:33.974948] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-09. [2025-09-16T20:22:34.174164] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-16T20:22:34.488711] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-16T20:22:34.490618] [INFO ] [REMOTE ] SGU: Full fetch complete (7040 records). [2025-09-16T20:22:34.490708] [DEBUG] [VALIDATOR ] SGU: Validating primary data. [2025-09-16T20:22:34.781391] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-07. [2025-09-16T20:22:34.888208] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-16T20:22:34.904589] [DEBUG] [VALIDATOR ] SGU: All expected trading days are present. [2025-09-16T20:22:34.904877] [DEBUG] [VALIDATOR ] SGU: Primary data validation passed. [2025-09-16T20:22:34.905250] [INFO ] [MAIN ] SGU: Fetched primary data is valid. [2025-09-16T20:22:34.905788] [DEBUG] [LOCAL ] SGU: Saving primary data. [2025-09-16T20:22:34.906691] [DEBUG] [LOCAL ] SGU: Trimmed 7040 records to 5112 (keeping 150 days of data) [2025-09-16T20:22:34.941519] [DEBUG] [LOCAL ] SGU: Primary data saved (5112 records). [2025-09-16T20:22:34.941760] [INFO ] [MAIN ] SGU: Full history saved. [2025-09-16T20:22:34.941880] [INFO ] [MAIN ] Update Progress: 1906/2369 symbols completed. SGU took 22.4s. Estimated remaining: 49m 12s. Rate: 9.4 symbols/min [2025-09-16T20:22:35.130130] [INFO ] [MAIN ] SHG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:22:35.148896] [DEBUG] [LOCAL ] SHG: Loaded 18956 existing records from primary storage. [2025-09-16T20:22:35.149051] [INFO ] [MAIN ] SHG: Loaded 18956 existing records. [2025-09-16T20:22:35.342447] [WARN ] [MAIN ] SHG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:22:35.343491] [INFO ] [MAIN ] SHG: Wiping existing primary data before full refresh. [2025-09-16T20:22:35.343563] [INFO ] [LOCAL ] SHG: Starting deletion of primary data. [2025-09-16T20:22:35.344519] [DEBUG] [LOCAL ] SHG: Deleted primary data file. [2025-09-16T20:22:35.344587] [INFO ] [MAIN ] SHG: Starting full primary refresh. [2025-09-16T20:22:35.581747] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-09. [2025-09-16T20:22:35.721849] [INFO ] [REMOTE ] SHG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:22:36.374916] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-03. [2025-09-16T20:22:36.577228] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-16T20:22:37.017739] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-16T20:22:37.021833] [INFO ] [REMOTE ] SHCO: Full fetch complete (28246 records). [2025-09-16T20:22:37.021908] [DEBUG] [VALIDATOR ] SHCO: Validating primary data. [2025-09-16T20:22:37.178415] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-02. [2025-09-16T20:22:37.388748] [DEBUG] [VALIDATOR ] SHCO: All expected trading days are present. [2025-09-16T20:22:37.388831] [DEBUG] [VALIDATOR ] SHCO: Primary data validation passed. [2025-09-16T20:22:37.389389] [INFO ] [MAIN ] SHCO: Fetched primary data is valid. [2025-09-16T20:22:37.389432] [DEBUG] [LOCAL ] SHCO: Saving primary data. [2025-09-16T20:22:37.390227] [DEBUG] [LOCAL ] SHCO: Trimmed 28246 records to 18339 (keeping 150 days of data) [2025-09-16T20:22:37.493713] [DEBUG] [LOCAL ] SHCO: Primary data saved (18339 records). [2025-09-16T20:22:37.493874] [INFO ] [MAIN ] SHCO: Full history saved. [2025-09-16T20:22:37.493986] [INFO ] [MAIN ] Update Progress: 1907/2369 symbols completed. SHCO took 21.9s. Estimated remaining: 49m 5s. Rate: 9.4 symbols/min [2025-09-16T20:22:37.668234] [INFO ] [MAIN ] SHO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:22:37.703124] [DEBUG] [LOCAL ] SHO: Loaded 36534 existing records from primary storage. [2025-09-16T20:22:37.703283] [INFO ] [MAIN ] SHO: Loaded 36534 existing records. [2025-09-16T20:22:37.883059] [WARN ] [MAIN ] SHO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:22:37.883309] [INFO ] [MAIN ] SHO: Wiping existing primary data before full refresh. [2025-09-16T20:22:37.883363] [INFO ] [LOCAL ] SHO: Starting deletion of primary data. [2025-09-16T20:22:37.884184] [DEBUG] [LOCAL ] SHO: Deleted primary data file. [2025-09-16T20:22:37.884235] [INFO ] [MAIN ] SHO: Starting full primary refresh. [2025-09-16T20:22:37.981624] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-08. [2025-09-16T20:22:38.262424] [INFO ] [REMOTE ] SHO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:22:38.469845] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-16T20:22:38.752347] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-16T20:22:38.774875] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-03. [2025-09-16T20:22:39.574913] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-04. [2025-09-16T20:22:39.702773] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-16T20:22:40.216145] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-16T20:22:40.374907] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-09. [2025-09-16T20:22:41.174933] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-04. [2025-09-16T20:22:41.835616] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-16T20:22:41.842029] [INFO ] [REMOTE ] SHAK: Full fetch complete (53763 records). [2025-09-16T20:22:41.842222] [DEBUG] [VALIDATOR ] SHAK: Validating primary data. [2025-09-16T20:22:41.976053] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-02. [2025-09-16T20:22:42.208037] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-09-16T20:22:42.338125] [DEBUG] [VALIDATOR ] SHAK: All expected trading days are present. [2025-09-16T20:22:42.338232] [DEBUG] [VALIDATOR ] SHAK: Primary data validation passed. [2025-09-16T20:22:42.339316] [INFO ] [MAIN ] SHAK: Fetched primary data is valid. [2025-09-16T20:22:42.339436] [DEBUG] [LOCAL ] SHAK: Saving primary data. [2025-09-16T20:22:42.340703] [DEBUG] [LOCAL ] SHAK: Trimmed 53763 records to 36372 (keeping 150 days of data) [2025-09-16T20:22:42.457980] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-16T20:22:42.602333] [DEBUG] [LOCAL ] SHAK: Primary data saved (36372 records). [2025-09-16T20:22:42.602491] [INFO ] [MAIN ] SHAK: Full history saved. [2025-09-16T20:22:42.602599] [INFO ] [MAIN ] Update Progress: 1908/2369 symbols completed. SHAK took 28.5s. Estimated remaining: 48m 58s. Rate: 9.4 symbols/min [2025-09-16T20:22:42.779460] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-05. [2025-09-16T20:22:42.781183] [INFO ] [MAIN ] SHOC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:22:42.786787] [DEBUG] [LOCAL ] SHOC: Loaded 2053 existing records from primary storage. [2025-09-16T20:22:42.787120] [INFO ] [MAIN ] SHOC: Loaded 2053 existing records. [2025-09-16T20:22:42.974046] [WARN ] [MAIN ] SHOC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:22:42.974302] [INFO ] [MAIN ] SHOC: Wiping existing primary data before full refresh. [2025-09-16T20:22:42.974347] [INFO ] [LOCAL ] SHOC: Starting deletion of primary data. [2025-09-16T20:22:42.974510] [DEBUG] [LOCAL ] SHOC: Deleted primary data file. [2025-09-16T20:22:42.974553] [INFO ] [MAIN ] SHOC: Starting full primary refresh. [2025-09-16T20:22:43.338054] [INFO ] [REMOTE ] SHOC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:22:43.579983] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-05. [2025-09-16T20:22:43.596085] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-16T20:22:44.374866] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-03. [2025-09-16T20:22:44.745743] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-16T20:22:44.772028] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-16T20:22:45.174878] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-06. [2025-09-16T20:22:45.974920] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-06. [2025-09-16T20:22:46.019060] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-16T20:22:46.775096] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-04. [2025-09-16T20:22:47.099954] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-16T20:22:47.424514] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-16T20:22:47.574885] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-07. [2025-09-16T20:22:47.687158] [DEBUG] [REMOTE ] SHEL: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-09-16T20:22:47.687541] [WARN ] [REMOTE ] SHEL: No data returned for month 2025-07 [2025-09-16T20:22:48.379977] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-07. [2025-09-16T20:22:48.399014] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-16T20:22:49.174940] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-08. [2025-09-16T20:22:49.528541] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-16T20:22:49.975171] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-08. [2025-09-16T20:22:50.774944] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-02. [2025-09-16T20:22:51.160269] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-16T20:22:51.190031] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-16T20:22:51.510789] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-16T20:22:51.574946] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-09. [2025-09-16T20:22:52.374950] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-09. [2025-09-16T20:22:53.174919] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-03. [2025-09-16T20:22:53.217547] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-16T20:22:53.223996] [INFO ] [REMOTE ] SHEL: Full fetch complete (49872 records). [2025-09-16T20:22:53.224125] [DEBUG] [VALIDATOR ] SHEL: Validating primary data. [2025-09-16T20:22:53.424820] [WARN ] [VALIDATOR ] SHEL: Validation failed - insufficient historical data. Have 128 unique days, need 150 days [2025-09-16T20:22:53.425583] [FATAL] [MAIN ] SHEL: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:22:53.425693] [WARN ] [MAIN ] SHEL: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:22:53.425773] [INFO ] [LOCAL ] SHEL: Starting deletion of primary data. [2025-09-16T20:22:53.425865] [DEBUG] [LOCAL ] SHEL: No primary data file found to delete. [2025-09-16T20:22:53.425917] [INFO ] [LOCAL ] SHEL: Starting deletion of derivative data. [2025-09-16T20:22:53.426202] [DEBUG] [LOCAL ] SHEL: Deleted derivative data file. [2025-09-16T20:22:53.426307] [INFO ] [MAIN ] Update Progress: 1909/2369 symbols completed. SHEL took 22.4s. Estimated remaining: 48m 53s. Rate: 9.4 symbols/min [2025-09-16T20:22:53.615895] [INFO ] [MAIN ] SHW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:22:53.629761] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-16T20:22:53.634487] [INFO ] [REMOTE ] SHG: Full fetch complete (31095 records). [2025-09-16T20:22:53.634765] [DEBUG] [VALIDATOR ] SHG: Validating primary data. [2025-09-16T20:22:53.957121] [DEBUG] [LOCAL ] SHW: Loaded 36988 existing records from primary storage. [2025-09-16T20:22:53.977241] [INFO ] [MAIN ] SHW: Loaded 36988 existing records. [2025-09-16T20:22:53.977149] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-05. [2025-09-16T20:22:54.215991] [DEBUG] [VALIDATOR ] SHG: All expected trading days are present. [2025-09-16T20:22:54.254002] [DEBUG] [VALIDATOR ] SHG: Primary data validation passed. [2025-09-16T20:22:54.286174] [INFO ] [MAIN ] SHG: Fetched primary data is valid. [2025-09-16T20:22:54.292681] [DEBUG] [LOCAL ] SHG: Saving primary data. [2025-09-16T20:22:54.292057] [WARN ] [MAIN ] SHW: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:22:54.293723] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-16T20:22:54.297409] [DEBUG] [LOCAL ] SHG: Trimmed 31095 records to 19184 (keeping 150 days of data) [2025-09-16T20:22:54.294718] [INFO ] [MAIN ] SHW: Wiping existing primary data before full refresh. [2025-09-16T20:22:54.298431] [INFO ] [LOCAL ] SHW: Starting deletion of primary data. [2025-09-16T20:22:54.299216] [DEBUG] [LOCAL ] SHW: Deleted primary data file. [2025-09-16T20:22:54.299274] [INFO ] [MAIN ] SHW: Starting full primary refresh. [2025-09-16T20:22:54.784086] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-04. [2025-09-16T20:22:54.789518] [INFO ] [REMOTE ] SHW: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:22:54.813278] [DEBUG] [LOCAL ] SHG: Primary data saved (19184 records). [2025-09-16T20:22:54.813443] [INFO ] [MAIN ] SHG: Full history saved. [2025-09-16T20:22:54.813534] [INFO ] [MAIN ] Update Progress: 1910/2369 symbols completed. SHG took 19.9s. Estimated remaining: 48m 45s. Rate: 9.4 symbols/min [2025-09-16T20:22:54.988615] [INFO ] [MAIN ] SI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:22:54.988808] [DEBUG] [LOCAL ] SI: No existing data file found in primary storage. [2025-09-16T20:22:54.988845] [WARN ] [MAIN ] SI: No existing data found, performing full refresh instead. [2025-09-16T20:22:54.988976] [INFO ] [MAIN ] SI: Wiping existing primary data before full refresh. [2025-09-16T20:22:54.989027] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-09-16T20:22:54.989069] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-09-16T20:22:54.989102] [INFO ] [MAIN ] SI: Starting full primary refresh. [2025-09-16T20:22:55.346699] [INFO ] [REMOTE ] SI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:22:55.573631] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-16T20:22:55.575457] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-02. [2025-09-16T20:22:55.869922] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:22:55.870456] [WARN ] [REMOTE ] SI: No data returned for month 2025-02 [2025-09-16T20:22:56.069728] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-16T20:22:56.374914] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-03. [2025-09-16T20:22:56.638955] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:22:56.639275] [WARN ] [REMOTE ] SI: No data returned for month 2025-03 [2025-09-16T20:22:57.174906] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-02. [2025-09-16T20:22:57.974916] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-05. [2025-09-16T20:22:58.522714] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-16T20:22:58.774936] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-06. [2025-09-16T20:22:58.908621] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-16T20:22:59.574935] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-03. [2025-09-16T20:23:00.374971] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-04. [2025-09-16T20:23:00.628298] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:23:00.628619] [WARN ] [REMOTE ] SI: No data returned for month 2025-04 [2025-09-16T20:23:01.169275] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-16T20:23:01.179533] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-06. [2025-09-16T20:23:01.552769] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-16T20:23:01.974950] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-05. [2025-09-16T20:23:02.224836] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:23:02.225402] [WARN ] [REMOTE ] SI: No data returned for month 2025-05 [2025-09-16T20:23:02.774954] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-06. [2025-09-16T20:23:03.574896] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-07. [2025-09-16T20:23:04.124397] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-16T20:23:04.374972] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-08. [2025-09-16T20:23:04.569403] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:23:04.569736] [WARN ] [REMOTE ] SI: No data returned for month 2025-06 [2025-09-16T20:23:05.013254] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-16T20:23:05.174945] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-07. [2025-09-16T20:23:05.725899] [INFO ] [REMOTE ] SI: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-16T20:23:05.914461] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-06 (7.14 seconds). [2025-09-16T20:23:05.974895] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-07. [2025-09-16T20:23:06.774918] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-08. [2025-09-16T20:23:07.575841] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-09. [2025-09-16T20:23:07.579769] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-16T20:23:08.028158] [INFO ] [REMOTE ] SI: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-16T20:23:08.123326] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-16T20:23:08.124463] [INFO ] [REMOTE ] SHOC: Full fetch complete (4797 records). [2025-09-16T20:23:08.124532] [DEBUG] [VALIDATOR ] SHOC: Validating primary data. [2025-09-16T20:23:08.380093] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-08. [2025-09-16T20:23:08.498615] [DEBUG] [VALIDATOR ] SHOC: All expected trading days are present. [2025-09-16T20:23:08.498721] [DEBUG] [VALIDATOR ] SHOC: Primary data validation passed. [2025-09-16T20:23:08.498896] [INFO ] [MAIN ] SHOC: Fetched primary data is valid. [2025-09-16T20:23:08.498945] [DEBUG] [LOCAL ] SHOC: Saving primary data. [2025-09-16T20:23:08.499351] [DEBUG] [LOCAL ] SHOC: Trimmed 4797 records to 2069 (keeping 150 days of data) [2025-09-16T20:23:08.512509] [DEBUG] [LOCAL ] SHOC: Primary data saved (2069 records). [2025-09-16T20:23:08.512576] [INFO ] [MAIN ] SHOC: Full history saved. [2025-09-16T20:23:08.512702] [INFO ] [MAIN ] Update Progress: 1911/2369 symbols completed. SHOC took 25.9s. Estimated remaining: 48m 40s. Rate: 9.4 symbols/min [2025-09-16T20:23:08.690460] [INFO ] [MAIN ] SID: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:23:08.725713] [DEBUG] [LOCAL ] SID: Loaded 31348 existing records from primary storage. [2025-09-16T20:23:08.725909] [INFO ] [MAIN ] SID: Loaded 31348 existing records. [2025-09-16T20:23:08.908879] [WARN ] [MAIN ] SID: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:23:08.909135] [INFO ] [MAIN ] SID: Wiping existing primary data before full refresh. [2025-09-16T20:23:08.909181] [INFO ] [LOCAL ] SID: Starting deletion of primary data. [2025-09-16T20:23:08.909839] [DEBUG] [LOCAL ] SID: Deleted primary data file. [2025-09-16T20:23:08.909890] [INFO ] [MAIN ] SID: Starting full primary refresh. [2025-09-16T20:23:09.180079] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-09. [2025-09-16T20:23:09.282167] [INFO ] [REMOTE ] SID: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:23:09.974950] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-02. [2025-09-16T20:23:10.089542] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-16T20:23:10.225287] [INFO ] [REMOTE ] SI: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-16T20:23:10.227932] [INFO ] [REMOTE ] SI: Full fetch complete (5052 records). [2025-09-16T20:23:10.228008] [DEBUG] [VALIDATOR ] SI: Validating primary data. [2025-09-16T20:23:10.421452] [WARN ] [VALIDATOR ] SI: Validation failed - insufficient historical data. Have 33 unique days, need 150 days [2025-09-16T20:23:10.421708] [FATAL] [MAIN ] SI: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:23:10.421755] [WARN ] [MAIN ] SI: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:23:10.421799] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-09-16T20:23:10.421858] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-09-16T20:23:10.421926] [INFO ] [LOCAL ] SI: Starting deletion of derivative data. [2025-09-16T20:23:10.421973] [DEBUG] [LOCAL ] SI: No derivative data file found to delete. [2025-09-16T20:23:10.422048] [INFO ] [MAIN ] Update Progress: 1912/2369 symbols completed. SI took 15.6s. Estimated remaining: 48m 33s. Rate: 9.4 symbols/min [2025-09-16T20:23:10.605000] [INFO ] [MAIN ] SIG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:23:10.638807] [DEBUG] [LOCAL ] SIG: Loaded 33768 existing records from primary storage. [2025-09-16T20:23:10.638959] [INFO ] [MAIN ] SIG: Loaded 33768 existing records. [2025-09-16T20:23:10.785802] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-04. [2025-09-16T20:23:10.824224] [WARN ] [MAIN ] SIG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:23:10.824396] [INFO ] [MAIN ] SIG: Wiping existing primary data before full refresh. [2025-09-16T20:23:10.824443] [INFO ] [LOCAL ] SIG: Starting deletion of primary data. [2025-09-16T20:23:10.825191] [DEBUG] [LOCAL ] SIG: Deleted primary data file. [2025-09-16T20:23:10.825246] [INFO ] [MAIN ] SIG: Starting full primary refresh. [2025-09-16T20:23:11.213120] [INFO ] [REMOTE ] SIG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:23:11.242337] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-16T20:23:11.574909] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-02. [2025-09-16T20:23:12.374969] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-09. [2025-09-16T20:23:12.864379] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-16T20:23:13.174899] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-05. [2025-09-16T20:23:13.454942] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-16T20:23:13.900993] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-16T20:23:13.907383] [INFO ] [REMOTE ] SHO: Full fetch complete (53878 records). [2025-09-16T20:23:13.907518] [DEBUG] [VALIDATOR ] SHO: Validating primary data. [2025-09-16T20:23:13.983672] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-03. [2025-09-16T20:23:14.306107] [DEBUG] [VALIDATOR ] SHO: All expected trading days are present. [2025-09-16T20:23:14.306204] [DEBUG] [VALIDATOR ] SHO: Primary data validation passed. [2025-09-16T20:23:14.307268] [INFO ] [MAIN ] SHO: Fetched primary data is valid. [2025-09-16T20:23:14.307330] [DEBUG] [LOCAL ] SHO: Saving primary data. [2025-09-16T20:23:14.308584] [DEBUG] [LOCAL ] SHO: Trimmed 53878 records to 36918 (keeping 150 days of data) [2025-09-16T20:23:14.557825] [DEBUG] [LOCAL ] SHO: Primary data saved (36918 records). [2025-09-16T20:23:14.558001] [INFO ] [MAIN ] SHO: Full history saved. [2025-09-16T20:23:14.558864] [INFO ] [MAIN ] Update Progress: 1913/2369 symbols completed. SHO took 37.1s. Estimated remaining: 48m 26s. Rate: 9.4 symbols/min [2025-09-16T20:23:14.757436] [INFO ] [MAIN ] SII: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:23:14.776699] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-03. [2025-09-16T20:23:14.777396] [DEBUG] [LOCAL ] SII: Loaded 16892 existing records from primary storage. [2025-09-16T20:23:14.778089] [INFO ] [MAIN ] SII: Loaded 16892 existing records. [2025-09-16T20:23:14.974489] [WARN ] [MAIN ] SII: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:23:14.974892] [INFO ] [MAIN ] SII: Wiping existing primary data before full refresh. [2025-09-16T20:23:14.974979] [INFO ] [LOCAL ] SII: Starting deletion of primary data. [2025-09-16T20:23:14.975422] [DEBUG] [LOCAL ] SII: Deleted primary data file. [2025-09-16T20:23:14.975508] [INFO ] [MAIN ] SII: Starting full primary refresh. [2025-09-16T20:23:15.341562] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-16T20:23:15.384175] [INFO ] [REMOTE ] SII: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:23:15.574898] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-06. [2025-09-16T20:23:15.697855] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-16T20:23:16.374900] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-04. [2025-09-16T20:23:16.716175] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-16T20:23:17.174909] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-04. [2025-09-16T20:23:17.419253] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-16T20:23:17.982942] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-02. [2025-09-16T20:23:17.987675] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-16T20:23:18.782673] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-07. [2025-09-16T20:23:18.784806] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-16T20:23:19.051005] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-16T20:23:19.574893] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-05. [2025-09-16T20:23:20.374890] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-05. [2025-09-16T20:23:20.750258] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-16T20:23:21.174900] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-08. [2025-09-16T20:23:21.222538] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-16T20:23:21.736854] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-16T20:23:21.974941] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-06. [2025-09-16T20:23:22.774911] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-03. [2025-09-16T20:23:23.052862] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-16T20:23:23.574879] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-06. [2025-09-16T20:23:23.666081] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-16T20:23:23.930757] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-16T20:23:24.374900] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-09. [2025-09-16T20:23:24.894938] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-16T20:23:25.174921] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-07. [2025-09-16T20:23:25.974909] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-07. [2025-09-16T20:23:26.074996] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-16T20:23:26.081521] [INFO ] [REMOTE ] SHW: Full fetch complete (54870 records). [2025-09-16T20:23:26.081666] [DEBUG] [VALIDATOR ] SHW: Validating primary data. [2025-09-16T20:23:26.478058] [DEBUG] [VALIDATOR ] SHW: All expected trading days are present. [2025-09-16T20:23:26.478162] [DEBUG] [VALIDATOR ] SHW: Primary data validation passed. [2025-09-16T20:23:26.479281] [INFO ] [MAIN ] SHW: Fetched primary data is valid. [2025-09-16T20:23:26.479448] [DEBUG] [LOCAL ] SHW: Saving primary data. [2025-09-16T20:23:26.481220] [DEBUG] [LOCAL ] SHW: Trimmed 54870 records to 37355 (keeping 150 days of data) [2025-09-16T20:23:26.614033] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-16T20:23:26.764968] [DEBUG] [LOCAL ] SHW: Primary data saved (37355 records). [2025-09-16T20:23:26.765141] [INFO ] [MAIN ] SHW: Full history saved. [2025-09-16T20:23:26.765253] [INFO ] [MAIN ] Update Progress: 1914/2369 symbols completed. SHW took 33.3s. Estimated remaining: 48m 21s. Rate: 9.4 symbols/min [2025-09-16T20:23:26.780015] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-04. [2025-09-16T20:23:26.944583] [INFO ] [MAIN ] SILA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:23:26.966186] [DEBUG] [LOCAL ] SILA: Loaded 22658 existing records from primary storage. [2025-09-16T20:23:26.966326] [INFO ] [MAIN ] SILA: Loaded 22658 existing records. [2025-09-16T20:23:27.159553] [WARN ] [MAIN ] SILA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:23:27.159861] [INFO ] [MAIN ] SILA: Wiping existing primary data before full refresh. [2025-09-16T20:23:27.159917] [INFO ] [LOCAL ] SILA: Starting deletion of primary data. [2025-09-16T20:23:27.160440] [DEBUG] [LOCAL ] SILA: Deleted primary data file. [2025-09-16T20:23:27.160501] [INFO ] [MAIN ] SILA: Starting full primary refresh. [2025-09-16T20:23:27.524359] [INFO ] [REMOTE ] SILA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:23:27.574986] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-02. [2025-09-16T20:23:27.578997] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-16T20:23:28.314266] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-16T20:23:28.374934] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-08. [2025-09-16T20:23:29.089605] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-16T20:23:29.174874] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-03. [2025-09-16T20:23:29.974924] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-08. [2025-09-16T20:23:30.011384] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-16T20:23:30.649075] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-16T20:23:30.774909] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-04. [2025-09-16T20:23:31.523579] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-16T20:23:31.574846] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-09. [2025-09-16T20:23:32.287083] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-16T20:23:32.374845] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-05. [2025-09-16T20:23:32.692838] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-16T20:23:32.697733] [INFO ] [REMOTE ] SID: Full fetch complete (45200 records). [2025-09-16T20:23:32.697871] [DEBUG] [VALIDATOR ] SID: Validating primary data. [2025-09-16T20:23:33.074238] [DEBUG] [VALIDATOR ] SID: All expected trading days are present. [2025-09-16T20:23:33.074343] [DEBUG] [VALIDATOR ] SID: Primary data validation passed. [2025-09-16T20:23:33.075232] [INFO ] [MAIN ] SID: Fetched primary data is valid. [2025-09-16T20:23:33.075307] [DEBUG] [LOCAL ] SID: Saving primary data. [2025-09-16T20:23:33.076656] [DEBUG] [LOCAL ] SID: Trimmed 45200 records to 31673 (keeping 150 days of data) [2025-09-16T20:23:33.175023] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-05. [2025-09-16T20:23:33.261650] [DEBUG] [LOCAL ] SID: Primary data saved (31673 records). [2025-09-16T20:23:33.261788] [INFO ] [MAIN ] SID: Full history saved. [2025-09-16T20:23:33.261900] [INFO ] [MAIN ] Update Progress: 1915/2369 symbols completed. SID took 24.7s. Estimated remaining: 48m 15s. Rate: 9.4 symbols/min [2025-09-16T20:23:33.445102] [INFO ] [MAIN ] SITC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:23:33.475763] [DEBUG] [LOCAL ] SITC: Loaded 30304 existing records from primary storage. [2025-09-16T20:23:33.475905] [INFO ] [MAIN ] SITC: Loaded 30304 existing records. [2025-09-16T20:23:33.663328] [WARN ] [MAIN ] SITC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:23:33.663625] [INFO ] [MAIN ] SITC: Wiping existing primary data before full refresh. [2025-09-16T20:23:33.663694] [INFO ] [LOCAL ] SITC: Starting deletion of primary data. [2025-09-16T20:23:33.664327] [DEBUG] [LOCAL ] SITC: Deleted primary data file. [2025-09-16T20:23:33.664386] [INFO ] [MAIN ] SITC: Starting full primary refresh. [2025-09-16T20:23:33.979683] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-09. [2025-09-16T20:23:34.070456] [INFO ] [REMOTE ] SITC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:23:34.098890] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-16T20:23:34.287874] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-16T20:23:34.774907] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-06. [2025-09-16T20:23:35.416130] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-16T20:23:35.422147] [INFO ] [REMOTE ] SIG: Full fetch complete (51024 records). [2025-09-16T20:23:35.422256] [DEBUG] [VALIDATOR ] SIG: Validating primary data. [2025-09-16T20:23:35.580965] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-06. [2025-09-16T20:23:35.816587] [DEBUG] [VALIDATOR ] SIG: All expected trading days are present. [2025-09-16T20:23:35.816702] [DEBUG] [VALIDATOR ] SIG: Primary data validation passed. [2025-09-16T20:23:35.817632] [INFO ] [MAIN ] SIG: Fetched primary data is valid. [2025-09-16T20:23:35.817695] [DEBUG] [LOCAL ] SIG: Saving primary data. [2025-09-16T20:23:35.818976] [DEBUG] [LOCAL ] SIG: Trimmed 51024 records to 34072 (keeping 150 days of data) [2025-09-16T20:23:36.034546] [DEBUG] [LOCAL ] SIG: Primary data saved (34072 records). [2025-09-16T20:23:36.034702] [INFO ] [MAIN ] SIG: Full history saved. [2025-09-16T20:23:36.034813] [INFO ] [MAIN ] Update Progress: 1916/2369 symbols completed. SIG took 25.6s. Estimated remaining: 48m 8s. Rate: 9.4 symbols/min [2025-09-16T20:23:36.206374] [INFO ] [MAIN ] SITE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:23:36.221141] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-16T20:23:36.248515] [DEBUG] [LOCAL ] SITE: Loaded 25540 existing records from primary storage. [2025-09-16T20:23:36.248687] [INFO ] [MAIN ] SITE: Loaded 25540 existing records. [2025-09-16T20:23:36.379980] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-02. [2025-09-16T20:23:36.431059] [WARN ] [MAIN ] SITE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:23:36.431271] [INFO ] [MAIN ] SITE: Wiping existing primary data before full refresh. [2025-09-16T20:23:36.431316] [INFO ] [LOCAL ] SITE: Starting deletion of primary data. [2025-09-16T20:23:36.431854] [DEBUG] [LOCAL ] SITE: Deleted primary data file. [2025-09-16T20:23:36.431900] [INFO ] [MAIN ] SITE: Starting full primary refresh. [2025-09-16T20:23:36.783033] [INFO ] [REMOTE ] SITE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:23:37.184685] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-02. [2025-09-16T20:23:37.186999] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-16T20:23:37.974872] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-07. [2025-09-16T20:23:37.999715] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-16T20:23:38.626818] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-16T20:23:38.774910] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-03. [2025-09-16T20:23:39.439039] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-16T20:23:39.574907] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-03. [2025-09-16T20:23:40.222896] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-16T20:23:40.374914] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-04. [2025-09-16T20:23:41.157743] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-16T20:23:41.174843] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-04. [2025-09-16T20:23:41.974947] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-07. [2025-09-16T20:23:42.044369] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-16T20:23:42.755774] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-16T20:23:42.774855] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-05. [2025-09-16T20:23:42.901077] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-16T20:23:43.574948] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-08. [2025-09-16T20:23:44.238129] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-16T20:23:44.374891] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-06. [2025-09-16T20:23:44.728525] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-16T20:23:45.174914] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-08. [2025-09-16T20:23:45.763508] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-16T20:23:45.974937] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-05. [2025-09-16T20:23:46.550188] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-16T20:23:46.774937] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-07. [2025-09-16T20:23:47.392417] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-16T20:23:47.574910] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-09. [2025-09-16T20:23:48.176131] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-16T20:23:48.374920] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-08. [2025-09-16T20:23:48.604261] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-16T20:23:48.607657] [INFO ] [REMOTE ] SILA: Full fetch complete (34271 records). [2025-09-16T20:23:48.607738] [DEBUG] [VALIDATOR ] SILA: Validating primary data. [2025-09-16T20:23:48.994425] [DEBUG] [VALIDATOR ] SILA: All expected trading days are present. [2025-09-16T20:23:48.994536] [DEBUG] [VALIDATOR ] SILA: Primary data validation passed. [2025-09-16T20:23:48.995432] [INFO ] [MAIN ] SILA: Fetched primary data is valid. [2025-09-16T20:23:48.995486] [DEBUG] [LOCAL ] SILA: Saving primary data. [2025-09-16T20:23:48.997337] [DEBUG] [LOCAL ] SILA: Trimmed 34271 records to 22844 (keeping 150 days of data) [2025-09-16T20:23:49.146102] [DEBUG] [LOCAL ] SILA: Primary data saved (22844 records). [2025-09-16T20:23:49.146246] [INFO ] [MAIN ] SILA: Full history saved. [2025-09-16T20:23:49.146380] [INFO ] [MAIN ] Update Progress: 1917/2369 symbols completed. SILA took 22.4s. Estimated remaining: 48m 3s. Rate: 9.4 symbols/min [2025-09-16T20:23:49.174940] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-09. [2025-09-16T20:23:49.913584] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-16T20:23:49.974921] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-09. [2025-09-16T20:23:50.181302] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-16T20:23:50.184466] [INFO ] [REMOTE ] SII: Full fetch complete (24229 records). [2025-09-16T20:23:50.184606] [DEBUG] [VALIDATOR ] SII: Validating primary data. [2025-09-16T20:23:50.576992] [DEBUG] [VALIDATOR ] SII: All expected trading days are present. [2025-09-16T20:23:50.577108] [DEBUG] [VALIDATOR ] SII: Primary data validation passed. [2025-09-16T20:23:50.577594] [INFO ] [MAIN ] SII: Fetched primary data is valid. [2025-09-16T20:23:50.577634] [DEBUG] [LOCAL ] SII: Saving primary data. [2025-09-16T20:23:50.578265] [DEBUG] [LOCAL ] SII: Trimmed 24229 records to 17013 (keeping 150 days of data) [2025-09-16T20:23:50.687157] [DEBUG] [LOCAL ] SII: Primary data saved (17013 records). [2025-09-16T20:23:50.687302] [INFO ] [MAIN ] SII: Full history saved. [2025-09-16T20:23:50.687388] [INFO ] [MAIN ] Update Progress: 1918/2369 symbols completed. SII took 36.1s. Estimated remaining: 47m 55s. Rate: 9.4 symbols/min [2025-09-16T20:23:50.774934] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-06. [2025-09-16T20:23:51.326593] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-16T20:23:51.332558] [INFO ] [REMOTE ] SITC: Full fetch complete (45363 records). [2025-09-16T20:23:51.332686] [DEBUG] [VALIDATOR ] SITC: Validating primary data. [2025-09-16T20:23:51.711134] [DEBUG] [VALIDATOR ] SITC: All expected trading days are present. [2025-09-16T20:23:51.711218] [DEBUG] [VALIDATOR ] SITC: Primary data validation passed. [2025-09-16T20:23:51.712078] [INFO ] [MAIN ] SITC: Fetched primary data is valid. [2025-09-16T20:23:51.712123] [DEBUG] [LOCAL ] SITC: Saving primary data. [2025-09-16T20:23:51.713151] [DEBUG] [LOCAL ] SITC: Trimmed 45363 records to 30627 (keeping 150 days of data) [2025-09-16T20:23:51.902842] [DEBUG] [LOCAL ] SITC: Primary data saved (30627 records). [2025-09-16T20:23:51.903029] [INFO ] [MAIN ] SITC: Full history saved. [2025-09-16T20:23:51.903122] [INFO ] [MAIN ] Update Progress: 1919/2369 symbols completed. SITC took 18.6s. Estimated remaining: 47m 48s. Rate: 9.4 symbols/min [2025-09-16T20:23:52.024417] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-16T20:23:52.031684] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-07. [2025-09-16T20:23:53.553589] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-16T20:23:53.562300] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-08. [2025-09-16T20:23:54.855003] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-16T20:23:54.862768] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-09. [2025-09-16T20:23:56.283909] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-16T20:23:56.288808] [INFO ] [REMOTE ] SITE: Full fetch complete (38585 records). [2025-09-16T20:23:56.288942] [DEBUG] [VALIDATOR ] SITE: Validating primary data. [2025-09-16T20:23:56.683519] [DEBUG] [VALIDATOR ] SITE: All expected trading days are present. [2025-09-16T20:23:56.683596] [DEBUG] [VALIDATOR ] SITE: Primary data validation passed. [2025-09-16T20:23:56.684428] [INFO ] [MAIN ] SITE: Fetched primary data is valid. [2025-09-16T20:23:56.684482] [DEBUG] [LOCAL ] SITE: Saving primary data. [2025-09-16T20:23:56.685322] [DEBUG] [LOCAL ] SITE: Trimmed 38585 records to 25828 (keeping 150 days of data) [2025-09-16T20:23:56.844956] [DEBUG] [LOCAL ] SITE: Primary data saved (25828 records). [2025-09-16T20:23:56.845107] [INFO ] [MAIN ] SITE: Full history saved. [2025-09-16T20:23:56.845196] [INFO ] [MAIN ] Update Progress: 1920/2369 symbols completed. SITE took 20.8s. Estimated remaining: 47m 41s. Rate: 9.4 symbols/min [2025-09-16T20:23:57.473047] [INFO ] [MAIN ] SJT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:23:57.509439] [INFO ] [MAIN ] SKIL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:23:57.601687] [INFO ] [MAIN ] SJM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:23:57.604966] [INFO ] [MAIN ] SKE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:23:57.611161] [DEBUG] [LOCAL ] SKIL: Loaded 4404 existing records from primary storage. [2025-09-16T20:23:57.611351] [INFO ] [MAIN ] SKIL: Loaded 4404 existing records. [2025-09-16T20:23:57.757429] [DEBUG] [LOCAL ] SJT: Loaded 16610 existing records from primary storage. [2025-09-16T20:23:57.831673] [WARN ] [MAIN ] SKIL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:23:57.831867] [INFO ] [MAIN ] SJT: Loaded 16610 existing records. [2025-09-16T20:23:57.861695] [INFO ] [MAIN ] SKIL: Wiping existing primary data before full refresh. [2025-09-16T20:23:57.867464] [DEBUG] [LOCAL ] SKE: Loaded 25499 existing records from primary storage. [2025-09-16T20:23:57.887376] [INFO ] [LOCAL ] SKIL: Starting deletion of primary data. [2025-09-16T20:23:57.913376] [INFO ] [MAIN ] SKE: Loaded 25499 existing records. [2025-09-16T20:23:57.965820] [DEBUG] [LOCAL ] SJM: Loaded 37109 existing records from primary storage. [2025-09-16T20:23:57.964937] [DEBUG] [LOCAL ] SKIL: Deleted primary data file. [2025-09-16T20:23:57.965964] [INFO ] [MAIN ] SJM: Loaded 37109 existing records. [2025-09-16T20:23:58.102666] [INFO ] [MAIN ] SKIL: Starting full primary refresh. [2025-09-16T20:23:58.316019] [WARN ] [MAIN ] SJT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:23:58.468679] [WARN ] [MAIN ] SKE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:23:58.515615] [INFO ] [MAIN ] SJT: Wiping existing primary data before full refresh. [2025-09-16T20:23:58.605890] [INFO ] [MAIN ] SKE: Wiping existing primary data before full refresh. [2025-09-16T20:23:58.581984] [WARN ] [MAIN ] SJM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:23:58.582053] [INFO ] [LOCAL ] SJT: Starting deletion of primary data. [2025-09-16T20:23:58.625491] [DEBUG] [LOCAL ] SJT: Deleted primary data file. [2025-09-16T20:23:58.625751] [INFO ] [LOCAL ] SKE: Starting deletion of primary data. [2025-09-16T20:23:58.630916] [INFO ] [MAIN ] SJT: Starting full primary refresh. [2025-09-16T20:23:58.625713] [INFO ] [MAIN ] SJM: Wiping existing primary data before full refresh. [2025-09-16T20:23:58.664154] [INFO ] [LOCAL ] SJM: Starting deletion of primary data. [2025-09-16T20:23:58.664188] [DEBUG] [LOCAL ] SKE: Deleted primary data file. [2025-09-16T20:23:58.732073] [DEBUG] [LOCAL ] SJM: Deleted primary data file. [2025-09-16T20:23:58.731977] [INFO ] [MAIN ] SKE: Starting full primary refresh. [2025-09-16T20:23:58.746247] [INFO ] [MAIN ] SJM: Starting full primary refresh. [2025-09-16T20:23:59.012510] [INFO ] [REMOTE ] SKIL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:23:59.054907] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-02. [2025-09-16T20:23:59.894547] [INFO ] [REMOTE ] SJM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:23:59.862497] [INFO ] [REMOTE ] SJT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:23:59.890824] [INFO ] [REMOTE ] SKE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:23:59.896092] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-02. [2025-09-16T20:23:59.895794] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-02. [2025-09-16T20:23:59.895063] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-02. [2025-09-16T20:23:59.919610] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-16T20:23:59.921604] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-03. [2025-09-16T20:24:00.900151] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-16T20:24:00.903275] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-04. [2025-09-16T20:24:01.214729] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-16T20:24:01.219700] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-03. [2025-09-16T20:24:01.408354] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-16T20:24:01.431742] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-03. [2025-09-16T20:24:01.432842] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-16T20:24:01.445432] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-03. [2025-09-16T20:24:01.453184] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-16T20:24:01.455254] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-05. [2025-09-16T20:24:02.104250] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-16T20:24:02.105994] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-06. [2025-09-16T20:24:02.302396] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-16T20:24:02.774962] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-04. [2025-09-16T20:24:02.841045] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-16T20:24:02.953318] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-16T20:24:03.338185] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-16T20:24:03.574878] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-04. [2025-09-16T20:24:03.652950] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-16T20:24:04.374909] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-05. [2025-09-16T20:24:04.803750] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-16T20:24:05.174949] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-07. [2025-09-16T20:24:05.619554] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-16T20:24:05.960846] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-16T20:24:05.974918] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-06. [2025-09-16T20:24:06.774914] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-04. [2025-09-16T20:24:07.140383] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-16T20:24:07.574891] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-07. [2025-09-16T20:24:08.374884] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-05. [2025-09-16T20:24:08.533241] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-16T20:24:08.574937] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-16T20:24:09.174903] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-05. [2025-09-16T20:24:09.718300] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-16T20:24:09.974917] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-06. [2025-09-16T20:24:10.774933] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-08. [2025-09-16T20:24:10.815618] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-16T20:24:11.458194] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-16T20:24:11.574884] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-07. [2025-09-16T20:24:11.764167] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-16T20:24:12.374913] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-08. [2025-09-16T20:24:12.991237] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-16T20:24:13.057487] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-16T20:24:13.174872] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-09. [2025-09-16T20:24:13.853812] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-16T20:24:13.855413] [INFO ] [REMOTE ] SKIL: Full fetch complete (6862 records). [2025-09-16T20:24:13.855485] [DEBUG] [VALIDATOR ] SKIL: Validating primary data. [2025-09-16T20:24:13.979965] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-06. [2025-09-16T20:24:14.231807] [DEBUG] [VALIDATOR ] SKIL: All expected trading days are present. [2025-09-16T20:24:14.231885] [DEBUG] [VALIDATOR ] SKIL: Primary data validation passed. [2025-09-16T20:24:14.232066] [INFO ] [MAIN ] SKIL: Fetched primary data is valid. [2025-09-16T20:24:14.232106] [DEBUG] [LOCAL ] SKIL: Saving primary data. [2025-09-16T20:24:14.232498] [DEBUG] [LOCAL ] SKIL: Trimmed 6862 records to 4546 (keeping 150 days of data) [2025-09-16T20:24:14.260062] [DEBUG] [LOCAL ] SKIL: Primary data saved (4546 records). [2025-09-16T20:24:14.260192] [INFO ] [MAIN ] SKIL: Full history saved. [2025-09-16T20:24:14.260279] [INFO ] [MAIN ] Update Progress: 1921/2369 symbols completed. SKIL took 17.4s. Estimated remaining: 47m 37s. Rate: 9.4 symbols/min [2025-09-16T20:24:14.446868] [INFO ] [MAIN ] SKLZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:24:14.456864] [DEBUG] [LOCAL ] SKLZ: Loaded 8497 existing records from primary storage. [2025-09-16T20:24:14.457014] [INFO ] [MAIN ] SKLZ: Loaded 8497 existing records. [2025-09-16T20:24:14.700391] [WARN ] [MAIN ] SKLZ: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:24:14.700768] [INFO ] [MAIN ] SKLZ: Wiping existing primary data before full refresh. [2025-09-16T20:24:14.700868] [INFO ] [LOCAL ] SKLZ: Starting deletion of primary data. [2025-09-16T20:24:14.701237] [DEBUG] [LOCAL ] SKLZ: Deleted primary data file. [2025-09-16T20:24:14.701315] [INFO ] [MAIN ] SKLZ: Starting full primary refresh. [2025-09-16T20:24:14.782389] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-09. [2025-09-16T20:24:15.214381] [INFO ] [REMOTE ] SKLZ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:24:15.574947] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-02. [2025-09-16T20:24:15.878867] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-16T20:24:15.881897] [INFO ] [REMOTE ] SJT: Full fetch complete (24381 records). [2025-09-16T20:24:15.881982] [DEBUG] [VALIDATOR ] SJT: Validating primary data. [2025-09-16T20:24:16.268383] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-09-16T20:24:16.304153] [DEBUG] [VALIDATOR ] SJT: All expected trading days are present. [2025-09-16T20:24:16.304589] [DEBUG] [VALIDATOR ] SJT: Primary data validation passed. [2025-09-16T20:24:16.305273] [INFO ] [MAIN ] SJT: Fetched primary data is valid. [2025-09-16T20:24:16.305321] [DEBUG] [LOCAL ] SJT: Saving primary data. [2025-09-16T20:24:16.306204] [DEBUG] [LOCAL ] SJT: Trimmed 24381 records to 16711 (keeping 150 days of data) [2025-09-16T20:24:16.376713] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-07. [2025-09-16T20:24:16.402158] [DEBUG] [LOCAL ] SJT: Primary data saved (16711 records). [2025-09-16T20:24:16.402317] [INFO ] [MAIN ] SJT: Full history saved. [2025-09-16T20:24:16.402406] [INFO ] [MAIN ] Update Progress: 1922/2369 symbols completed. SJT took 19.6s. Estimated remaining: 47m 30s. Rate: 9.4 symbols/min [2025-09-16T20:24:16.561243] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-16T20:24:16.584346] [INFO ] [MAIN ] SKM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:24:16.613677] [DEBUG] [LOCAL ] SKM: Loaded 26017 existing records from primary storage. [2025-09-16T20:24:16.613822] [INFO ] [MAIN ] SKM: Loaded 26017 existing records. [2025-09-16T20:24:16.790490] [WARN ] [MAIN ] SKM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:24:16.790746] [INFO ] [MAIN ] SKM: Wiping existing primary data before full refresh. [2025-09-16T20:24:16.790795] [INFO ] [LOCAL ] SKM: Starting deletion of primary data. [2025-09-16T20:24:16.791363] [DEBUG] [LOCAL ] SKM: Deleted primary data file. [2025-09-16T20:24:16.791415] [INFO ] [MAIN ] SKM: Starting full primary refresh. [2025-09-16T20:24:17.155342] [INFO ] [REMOTE ] SKM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:24:17.174862] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-02. [2025-09-16T20:24:17.974946] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-03. [2025-09-16T20:24:18.361275] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-16T20:24:18.512297] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-16T20:24:18.639717] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-16T20:24:18.774905] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-08. [2025-09-16T20:24:19.574939] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-04. [2025-09-16T20:24:20.374912] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-03. [2025-09-16T20:24:20.534395] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-16T20:24:20.643073] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-16T20:24:21.174907] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-09. [2025-09-16T20:24:21.603585] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-16T20:24:21.974902] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-05. [2025-09-16T20:24:22.774919] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-04. [2025-09-16T20:24:22.855937] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-16T20:24:22.862251] [INFO ] [REMOTE ] SJM: Full fetch complete (54515 records). [2025-09-16T20:24:22.862362] [DEBUG] [VALIDATOR ] SJM: Validating primary data. [2025-09-16T20:24:23.027400] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-16T20:24:23.270875] [DEBUG] [VALIDATOR ] SJM: All expected trading days are present. [2025-09-16T20:24:23.270958] [DEBUG] [VALIDATOR ] SJM: Primary data validation passed. [2025-09-16T20:24:23.271970] [INFO ] [MAIN ] SJM: Fetched primary data is valid. [2025-09-16T20:24:23.272017] [DEBUG] [LOCAL ] SJM: Saving primary data. [2025-09-16T20:24:23.273501] [DEBUG] [LOCAL ] SJM: Trimmed 54515 records to 37491 (keeping 150 days of data) [2025-09-16T20:24:23.514223] [DEBUG] [LOCAL ] SJM: Primary data saved (37491 records). [2025-09-16T20:24:23.514370] [INFO ] [MAIN ] SJM: Full history saved. [2025-09-16T20:24:23.515806] [INFO ] [MAIN ] Update Progress: 1923/2369 symbols completed. SJM took 26.7s. Estimated remaining: 47m 24s. Rate: 9.4 symbols/min [2025-09-16T20:24:23.579996] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-06. [2025-09-16T20:24:23.690827] [INFO ] [MAIN ] SKT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:24:23.724083] [DEBUG] [LOCAL ] SKT: Loaded 31192 existing records from primary storage. [2025-09-16T20:24:23.724244] [INFO ] [MAIN ] SKT: Loaded 31192 existing records. [2025-09-16T20:24:23.903236] [WARN ] [MAIN ] SKT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:24:23.903470] [INFO ] [MAIN ] SKT: Wiping existing primary data before full refresh. [2025-09-16T20:24:23.903515] [INFO ] [LOCAL ] SKT: Starting deletion of primary data. [2025-09-16T20:24:23.904323] [DEBUG] [LOCAL ] SKT: Deleted primary data file. [2025-09-16T20:24:23.904377] [INFO ] [MAIN ] SKT: Starting full primary refresh. [2025-09-16T20:24:24.297029] [INFO ] [REMOTE ] SKT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:24:24.299297] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-16T20:24:24.374866] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-05. [2025-09-16T20:24:24.501106] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-16T20:24:25.174903] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-02. [2025-09-16T20:24:25.788036] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-16T20:24:25.974930] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-06. [2025-09-16T20:24:26.703360] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-16T20:24:26.774946] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-08. [2025-09-16T20:24:27.461709] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-16T20:24:27.574927] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-07. [2025-09-16T20:24:28.141589] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-16T20:24:28.374906] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-07. [2025-09-16T20:24:29.092421] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-16T20:24:29.174888] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-08. [2025-09-16T20:24:29.441194] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-16T20:24:29.974922] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-03. [2025-09-16T20:24:30.429014] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-16T20:24:30.774958] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-08. [2025-09-16T20:24:31.285201] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-16T20:24:31.574912] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-09. [2025-09-16T20:24:31.748335] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-16T20:24:32.374873] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-09. [2025-09-16T20:24:32.737583] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-16T20:24:32.741960] [INFO ] [REMOTE ] SKM: Full fetch complete (38302 records). [2025-09-16T20:24:32.742041] [DEBUG] [VALIDATOR ] SKM: Validating primary data. [2025-09-16T20:24:33.116317] [DEBUG] [VALIDATOR ] SKM: All expected trading days are present. [2025-09-16T20:24:33.116404] [DEBUG] [VALIDATOR ] SKM: Primary data validation passed. [2025-09-16T20:24:33.117264] [INFO ] [MAIN ] SKM: Fetched primary data is valid. [2025-09-16T20:24:33.117310] [DEBUG] [LOCAL ] SKM: Saving primary data. [2025-09-16T20:24:33.118211] [DEBUG] [LOCAL ] SKM: Trimmed 38302 records to 26304 (keeping 150 days of data) [2025-09-16T20:24:33.182147] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-04. [2025-09-16T20:24:33.286352] [DEBUG] [LOCAL ] SKM: Primary data saved (26304 records). [2025-09-16T20:24:33.286586] [INFO ] [MAIN ] SKM: Full history saved. [2025-09-16T20:24:33.286730] [INFO ] [MAIN ] Update Progress: 1924/2369 symbols completed. SKM took 16.9s. Estimated remaining: 47m 18s. Rate: 9.4 symbols/min [2025-09-16T20:24:33.458900] [INFO ] [MAIN ] SKY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:24:33.472599] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-16T20:24:33.477552] [INFO ] [REMOTE ] SKE: Full fetch complete (38166 records). [2025-09-16T20:24:33.477659] [DEBUG] [VALIDATOR ] SKE: Validating primary data. [2025-09-16T20:24:33.679227] [DEBUG] [LOCAL ] SKY: Loaded 28322 existing records from primary storage. [2025-09-16T20:24:33.692340] [INFO ] [MAIN ] SKY: Loaded 28322 existing records. [2025-09-16T20:24:33.994933] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-09. [2025-09-16T20:24:34.058266] [DEBUG] [VALIDATOR ] SKE: All expected trading days are present. [2025-09-16T20:24:34.058043] [WARN ] [MAIN ] SKY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:24:34.059333] [DEBUG] [VALIDATOR ] SKE: Primary data validation passed. [2025-09-16T20:24:34.059621] [INFO ] [MAIN ] SKY: Wiping existing primary data before full refresh. [2025-09-16T20:24:34.059708] [INFO ] [LOCAL ] SKY: Starting deletion of primary data. [2025-09-16T20:24:34.060325] [DEBUG] [LOCAL ] SKY: Deleted primary data file. [2025-09-16T20:24:34.060372] [INFO ] [MAIN ] SKY: Starting full primary refresh. [2025-09-16T20:24:34.083282] [INFO ] [MAIN ] SKE: Fetched primary data is valid. [2025-09-16T20:24:34.130826] [DEBUG] [LOCAL ] SKE: Saving primary data. [2025-09-16T20:24:34.165894] [DEBUG] [LOCAL ] SKE: Trimmed 38166 records to 25861 (keeping 150 days of data) [2025-09-16T20:24:34.544196] [INFO ] [REMOTE ] SKY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:24:34.584245] [DEBUG] [LOCAL ] SKE: Primary data saved (25861 records). [2025-09-16T20:24:34.584384] [INFO ] [MAIN ] SKE: Full history saved. [2025-09-16T20:24:34.584484] [INFO ] [MAIN ] Update Progress: 1925/2369 symbols completed. SKE took 37.7s. Estimated remaining: 47m 10s. Rate: 9.4 symbols/min [2025-09-16T20:24:34.752388] [INFO ] [MAIN ] SKYH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:24:34.764916] [DEBUG] [LOCAL ] SKYH: Loaded 11393 existing records from primary storage. [2025-09-16T20:24:34.765075] [INFO ] [MAIN ] SKYH: Loaded 11393 existing records. [2025-09-16T20:24:34.780114] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-02. [2025-09-16T20:24:34.840463] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-16T20:24:34.865656] [INFO ] [REMOTE ] SKLZ: Full fetch complete (13017 records). [2025-09-16T20:24:34.876417] [DEBUG] [VALIDATOR ] SKLZ: Validating primary data. [2025-09-16T20:24:35.040919] [WARN ] [MAIN ] SKYH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:24:35.054857] [INFO ] [MAIN ] SKYH: Wiping existing primary data before full refresh. [2025-09-16T20:24:35.054948] [INFO ] [LOCAL ] SKYH: Starting deletion of primary data. [2025-09-16T20:24:35.066025] [DEBUG] [LOCAL ] SKYH: Deleted primary data file. [2025-09-16T20:24:35.076441] [INFO ] [MAIN ] SKYH: Starting full primary refresh. [2025-09-16T20:24:35.619487] [DEBUG] [VALIDATOR ] SKLZ: All expected trading days are present. [2025-09-16T20:24:35.636043] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-16T20:24:35.636138] [DEBUG] [VALIDATOR ] SKLZ: Primary data validation passed. [2025-09-16T20:24:35.648038] [INFO ] [MAIN ] SKLZ: Fetched primary data is valid. [2025-09-16T20:24:35.659533] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-05. [2025-09-16T20:24:35.659578] [DEBUG] [LOCAL ] SKLZ: Saving primary data. [2025-09-16T20:24:35.705267] [DEBUG] [LOCAL ] SKLZ: Trimmed 13017 records to 8571 (keeping 150 days of data) [2025-09-16T20:24:35.727921] [INFO ] [REMOTE ] SKYH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:24:35.776214] [DEBUG] [LOCAL ] SKLZ: Primary data saved (8571 records). [2025-09-16T20:24:35.776309] [INFO ] [MAIN ] SKLZ: Full history saved. [2025-09-16T20:24:35.776404] [INFO ] [MAIN ] Update Progress: 1926/2369 symbols completed. SKLZ took 21.5s. Estimated remaining: 47m 3s. Rate: 9.4 symbols/min [2025-09-16T20:24:35.946153] [INFO ] [MAIN ] SLB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:24:35.984458] [DEBUG] [LOCAL ] SLB: Loaded 39657 existing records from primary storage. [2025-09-16T20:24:35.984606] [INFO ] [MAIN ] SLB: Loaded 39657 existing records. [2025-09-16T20:24:36.160395] [WARN ] [MAIN ] SLB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:24:36.160660] [INFO ] [MAIN ] SLB: Wiping existing primary data before full refresh. [2025-09-16T20:24:36.160707] [INFO ] [LOCAL ] SLB: Starting deletion of primary data. [2025-09-16T20:24:36.161603] [DEBUG] [LOCAL ] SLB: Deleted primary data file. [2025-09-16T20:24:36.161670] [INFO ] [MAIN ] SLB: Starting full primary refresh. [2025-09-16T20:24:36.381972] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-02. [2025-09-16T20:24:36.554751] [INFO ] [REMOTE ] SLB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:24:36.559691] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-16T20:24:37.174891] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-03. [2025-09-16T20:24:37.188344] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-16T20:24:37.277918] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-16T20:24:37.974951] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-06. [2025-09-16T20:24:38.633814] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-16T20:24:38.774902] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-04. [2025-09-16T20:24:39.574874] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-03. [2025-09-16T20:24:39.604731] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-16T20:24:40.290938] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-16T20:24:40.374896] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-05. [2025-09-16T20:24:40.507366] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-16T20:24:41.174907] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-04. [2025-09-16T20:24:41.932551] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-16T20:24:41.974926] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-02. [2025-09-16T20:24:42.005869] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-16T20:24:42.774904] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-07. [2025-09-16T20:24:43.574890] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-06. [2025-09-16T20:24:43.972020] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-16T20:24:44.374930] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-03. [2025-09-16T20:24:44.407332] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-16T20:24:45.131009] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-16T20:24:45.174914] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-07. [2025-09-16T20:24:45.974890] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-05. [2025-09-16T20:24:46.075688] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-16T20:24:46.777789] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-08. [2025-09-16T20:24:46.780537] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-16T20:24:46.989269] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-16T20:24:47.574894] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-08. [2025-09-16T20:24:48.165313] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-16T20:24:48.374936] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-09. [2025-09-16T20:24:49.180174] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-04. [2025-09-16T20:24:49.197042] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-16T20:24:49.322215] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-16T20:24:49.327380] [INFO ] [REMOTE ] SKT: Full fetch complete (46182 records). [2025-09-16T20:24:49.327511] [DEBUG] [VALIDATOR ] SKT: Validating primary data. [2025-09-16T20:24:49.726392] [DEBUG] [VALIDATOR ] SKT: All expected trading days are present. [2025-09-16T20:24:49.726479] [DEBUG] [VALIDATOR ] SKT: Primary data validation passed. [2025-09-16T20:24:49.727328] [INFO ] [MAIN ] SKT: Fetched primary data is valid. [2025-09-16T20:24:49.727385] [DEBUG] [LOCAL ] SKT: Saving primary data. [2025-09-16T20:24:49.728380] [DEBUG] [LOCAL ] SKT: Trimmed 46182 records to 31523 (keeping 150 days of data) [2025-09-16T20:24:49.920548] [DEBUG] [LOCAL ] SKT: Primary data saved (31523 records). [2025-09-16T20:24:49.920701] [INFO ] [MAIN ] SKT: Full history saved. [2025-09-16T20:24:49.920797] [INFO ] [MAIN ] Update Progress: 1927/2369 symbols completed. SKT took 26.4s. Estimated remaining: 46m 58s. Rate: 9.4 symbols/min [2025-09-16T20:24:49.983881] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-09. [2025-09-16T20:24:50.091742] [INFO ] [MAIN ] SLF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:24:50.119189] [DEBUG] [LOCAL ] SLF: Loaded 28676 existing records from primary storage. [2025-09-16T20:24:50.119339] [INFO ] [MAIN ] SLF: Loaded 28676 existing records. [2025-09-16T20:24:50.299578] [WARN ] [MAIN ] SLF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:24:50.299881] [INFO ] [MAIN ] SLF: Wiping existing primary data before full refresh. [2025-09-16T20:24:50.299933] [INFO ] [LOCAL ] SLF: Starting deletion of primary data. [2025-09-16T20:24:50.300510] [DEBUG] [LOCAL ] SLF: Deleted primary data file. [2025-09-16T20:24:50.300554] [INFO ] [MAIN ] SLF: Starting full primary refresh. [2025-09-16T20:24:50.651638] [INFO ] [REMOTE ] SLF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:24:50.774895] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-06. [2025-09-16T20:24:51.452899] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-16T20:24:51.458104] [INFO ] [REMOTE ] SKY: Full fetch complete (40377 records). [2025-09-16T20:24:51.458187] [DEBUG] [VALIDATOR ] SKY: Validating primary data. [2025-09-16T20:24:51.576965] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-02. [2025-09-16T20:24:51.809523] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-09-16T20:24:51.929964] [DEBUG] [VALIDATOR ] SKY: All expected trading days are present. [2025-09-16T20:24:51.930078] [DEBUG] [VALIDATOR ] SKY: Primary data validation passed. [2025-09-16T20:24:51.940026] [INFO ] [MAIN ] SKY: Fetched primary data is valid. [2025-09-16T20:24:51.942289] [DEBUG] [LOCAL ] SKY: Saving primary data. [2025-09-16T20:24:51.942862] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-16T20:24:51.948366] [DEBUG] [LOCAL ] SKY: Trimmed 40377 records to 28683 (keeping 150 days of data) [2025-09-16T20:24:52.119403] [DEBUG] [LOCAL ] SKY: Primary data saved (28683 records). [2025-09-16T20:24:52.119546] [INFO ] [MAIN ] SKY: Full history saved. [2025-09-16T20:24:52.119633] [INFO ] [MAIN ] Update Progress: 1928/2369 symbols completed. SKY took 18.8s. Estimated remaining: 46m 51s. Rate: 9.4 symbols/min [2025-09-16T20:24:52.290162] [INFO ] [MAIN ] SLG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:24:52.327050] [DEBUG] [LOCAL ] SLG: Loaded 33726 existing records from primary storage. [2025-09-16T20:24:52.327186] [INFO ] [MAIN ] SLG: Loaded 33726 existing records. [2025-09-16T20:24:52.380889] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-05. [2025-09-16T20:24:52.503677] [WARN ] [MAIN ] SLG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:24:52.503914] [INFO ] [MAIN ] SLG: Wiping existing primary data before full refresh. [2025-09-16T20:24:52.503991] [INFO ] [LOCAL ] SLG: Starting deletion of primary data. [2025-09-16T20:24:52.504781] [DEBUG] [LOCAL ] SLG: Deleted primary data file. [2025-09-16T20:24:52.504831] [INFO ] [MAIN ] SLG: Starting full primary refresh. [2025-09-16T20:24:52.856180] [INFO ] [REMOTE ] SLG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:24:53.180548] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-07. [2025-09-16T20:24:53.191577] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-16T20:24:53.974857] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-03. [2025-09-16T20:24:54.199069] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-16T20:24:54.558058] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-16T20:24:54.774899] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-06. [2025-09-16T20:24:55.574879] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-08. [2025-09-16T20:24:55.652833] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-16T20:24:56.374936] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-04. [2025-09-16T20:24:56.614774] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-16T20:24:56.848734] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-16T20:24:57.174912] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-09. [2025-09-16T20:24:57.801966] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-16T20:24:57.974917] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-07. [2025-09-16T20:24:58.048939] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-16T20:24:58.051036] [INFO ] [REMOTE ] SKYH: Full fetch complete (17388 records). [2025-09-16T20:24:58.051105] [DEBUG] [VALIDATOR ] SKYH: Validating primary data. [2025-09-16T20:24:58.418929] [DEBUG] [VALIDATOR ] SKYH: All expected trading days are present. [2025-09-16T20:24:58.419007] [DEBUG] [VALIDATOR ] SKYH: Primary data validation passed. [2025-09-16T20:24:58.419361] [INFO ] [MAIN ] SKYH: Fetched primary data is valid. [2025-09-16T20:24:58.419407] [DEBUG] [LOCAL ] SKYH: Saving primary data. [2025-09-16T20:24:58.419931] [DEBUG] [LOCAL ] SKYH: Trimmed 17388 records to 11462 (keeping 150 days of data) [2025-09-16T20:24:58.484898] [DEBUG] [LOCAL ] SKYH: Primary data saved (11462 records). [2025-09-16T20:24:58.485025] [INFO ] [MAIN ] SKYH: Full history saved. [2025-09-16T20:24:58.485129] [INFO ] [MAIN ] Update Progress: 1929/2369 symbols completed. SKYH took 23.9s. Estimated remaining: 46m 45s. Rate: 9.4 symbols/min [2025-09-16T20:24:58.664581] [INFO ] [MAIN ] SLGN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:24:58.697436] [DEBUG] [LOCAL ] SLGN: Loaded 29229 existing records from primary storage. [2025-09-16T20:24:58.697584] [INFO ] [MAIN ] SLGN: Loaded 29229 existing records. [2025-09-16T20:24:58.780018] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-02. [2025-09-16T20:24:58.887051] [WARN ] [MAIN ] SLGN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:24:58.887306] [INFO ] [MAIN ] SLGN: Wiping existing primary data before full refresh. [2025-09-16T20:24:58.887355] [INFO ] [LOCAL ] SLGN: Starting deletion of primary data. [2025-09-16T20:24:58.888027] [DEBUG] [LOCAL ] SLGN: Deleted primary data file. [2025-09-16T20:24:58.888079] [INFO ] [MAIN ] SLGN: Starting full primary refresh. [2025-09-16T20:24:59.261224] [INFO ] [REMOTE ] SLGN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:24:59.574884] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-02. [2025-09-16T20:25:00.259406] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-16T20:25:00.309619] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-09-16T20:25:00.374924] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-03. [2025-09-16T20:25:00.883977] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-16T20:25:01.174922] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-08. [2025-09-16T20:25:01.683594] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-16T20:25:01.974946] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-05. [2025-09-16T20:25:02.774958] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-03. [2025-09-16T20:25:03.231385] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-16T20:25:03.397707] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-16T20:25:03.574872] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-09. [2025-09-16T20:25:04.380834] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-06. [2025-09-16T20:25:04.385931] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-16T20:25:05.174940] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-04. [2025-09-16T20:25:05.509680] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-16T20:25:05.517339] [INFO ] [REMOTE ] SLB: Full fetch complete (58377 records). [2025-09-16T20:25:05.517624] [DEBUG] [VALIDATOR ] SLB: Validating primary data. [2025-09-16T20:25:05.907863] [DEBUG] [VALIDATOR ] SLB: All expected trading days are present. [2025-09-16T20:25:05.907996] [DEBUG] [VALIDATOR ] SLB: Primary data validation passed. [2025-09-16T20:25:05.908997] [INFO ] [MAIN ] SLB: Fetched primary data is valid. [2025-09-16T20:25:05.909053] [DEBUG] [LOCAL ] SLB: Saving primary data. [2025-09-16T20:25:05.910522] [DEBUG] [LOCAL ] SLB: Trimmed 58377 records to 40047 (keeping 150 days of data) [2025-09-16T20:25:05.977185] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-04. [2025-09-16T20:25:06.032705] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-16T20:25:06.199620] [DEBUG] [LOCAL ] SLB: Primary data saved (40047 records). [2025-09-16T20:25:06.199796] [INFO ] [MAIN ] SLB: Full history saved. [2025-09-16T20:25:06.199899] [INFO ] [MAIN ] Update Progress: 1930/2369 symbols completed. SLB took 30.4s. Estimated remaining: 46m 38s. Rate: 9.4 symbols/min [2025-09-16T20:25:06.374427] [INFO ] [MAIN ] SLNZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:25:06.374662] [DEBUG] [LOCAL ] SLNZ: No existing data file found in primary storage. [2025-09-16T20:25:06.374705] [WARN ] [MAIN ] SLNZ: No existing data found, performing full refresh instead. [2025-09-16T20:25:06.374826] [INFO ] [MAIN ] SLNZ: Wiping existing primary data before full refresh. [2025-09-16T20:25:06.374870] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-09-16T20:25:06.374911] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-09-16T20:25:06.374944] [INFO ] [MAIN ] SLNZ: Starting full primary refresh. [2025-09-16T20:25:06.726977] [INFO ] [REMOTE ] SLNZ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:25:06.783763] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-02. [2025-09-16T20:25:06.788936] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-16T20:25:07.142091] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-16T20:25:07.574988] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-05. [2025-09-16T20:25:07.850681] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-16T20:25:08.374956] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-05. [2025-09-16T20:25:09.030829] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-16T20:25:09.174898] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-06. [2025-09-16T20:25:09.974902] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-07. [2025-09-16T20:25:10.007662] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-16T20:25:10.690425] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-16T20:25:10.774893] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-03. [2025-09-16T20:25:11.167464] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-16T20:25:11.574890] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-04. [2025-09-16T20:25:11.704712] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-16T20:25:11.970676] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-16T20:25:12.374952] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-08. [2025-09-16T20:25:13.174924] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-05. [2025-09-16T20:25:13.603171] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-16T20:25:13.950443] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-16T20:25:13.974846] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-09. [2025-09-16T20:25:14.774889] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-06. [2025-09-16T20:25:15.372053] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-16T20:25:15.380048] [INFO ] [REMOTE ] SLF: Full fetch complete (43206 records). [2025-09-16T20:25:15.380184] [DEBUG] [VALIDATOR ] SLF: Validating primary data. [2025-09-16T20:25:15.580421] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-07. [2025-09-16T20:25:15.755618] [DEBUG] [VALIDATOR ] SLF: All expected trading days are present. [2025-09-16T20:25:15.755711] [DEBUG] [VALIDATOR ] SLF: Primary data validation passed. [2025-09-16T20:25:15.756518] [INFO ] [MAIN ] SLF: Fetched primary data is valid. [2025-09-16T20:25:15.756559] [DEBUG] [LOCAL ] SLF: Saving primary data. [2025-09-16T20:25:15.757471] [DEBUG] [LOCAL ] SLF: Trimmed 43206 records to 28993 (keeping 150 days of data) [2025-09-16T20:25:15.934565] [DEBUG] [LOCAL ] SLF: Primary data saved (28993 records). [2025-09-16T20:25:15.934717] [INFO ] [MAIN ] SLF: Full history saved. [2025-09-16T20:25:15.934802] [INFO ] [MAIN ] Update Progress: 1931/2369 symbols completed. SLF took 26.0s. Estimated remaining: 46m 33s. Rate: 9.4 symbols/min [2025-09-16T20:25:16.103451] [INFO ] [MAIN ] SLQT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:25:16.133181] [DEBUG] [LOCAL ] SLQT: Loaded 32427 existing records from primary storage. [2025-09-16T20:25:16.133324] [INFO ] [MAIN ] SLQT: Loaded 32427 existing records. [2025-09-16T20:25:16.321799] [WARN ] [MAIN ] SLQT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:25:16.322174] [INFO ] [MAIN ] SLQT: Wiping existing primary data before full refresh. [2025-09-16T20:25:16.322346] [INFO ] [LOCAL ] SLQT: Starting deletion of primary data. [2025-09-16T20:25:16.323139] [DEBUG] [LOCAL ] SLQT: Deleted primary data file. [2025-09-16T20:25:16.323199] [INFO ] [MAIN ] SLQT: Starting full primary refresh. [2025-09-16T20:25:16.387852] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-06. [2025-09-16T20:25:16.725044] [INFO ] [REMOTE ] SLQT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:25:16.726827] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-16T20:25:16.856257] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-16T20:25:17.134754] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-16T20:25:17.174857] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-02. [2025-09-16T20:25:17.974918] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-08. [2025-09-16T20:25:18.784214] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-07. [2025-09-16T20:25:18.788854] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-16T20:25:19.339273] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-16T20:25:19.574908] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-09. [2025-09-16T20:25:20.282346] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-16T20:25:20.374885] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-08. [2025-09-16T20:25:21.115440] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-16T20:25:21.120793] [INFO ] [REMOTE ] SLGN: Full fetch complete (43790 records). [2025-09-16T20:25:21.120877] [DEBUG] [VALIDATOR ] SLGN: Validating primary data. [2025-09-16T20:25:21.184515] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-03. [2025-09-16T20:25:21.493582] [DEBUG] [VALIDATOR ] SLGN: All expected trading days are present. [2025-09-16T20:25:21.493675] [DEBUG] [VALIDATOR ] SLGN: Primary data validation passed. [2025-09-16T20:25:21.494521] [INFO ] [MAIN ] SLGN: Fetched primary data is valid. [2025-09-16T20:25:21.494565] [DEBUG] [LOCAL ] SLGN: Saving primary data. [2025-09-16T20:25:21.495469] [DEBUG] [LOCAL ] SLGN: Trimmed 43790 records to 29559 (keeping 150 days of data) [2025-09-16T20:25:21.684228] [DEBUG] [LOCAL ] SLGN: Primary data saved (29559 records). [2025-09-16T20:25:21.684387] [INFO ] [MAIN ] SLGN: Full history saved. [2025-09-16T20:25:21.684494] [INFO ] [MAIN ] Update Progress: 1932/2369 symbols completed. SLGN took 23.2s. Estimated remaining: 46m 26s. Rate: 9.4 symbols/min [2025-09-16T20:25:21.857359] [INFO ] [MAIN ] SLVM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:25:21.876552] [DEBUG] [LOCAL ] SLVM: Loaded 20291 existing records from primary storage. [2025-09-16T20:25:21.876695] [INFO ] [MAIN ] SLVM: Loaded 20291 existing records. [2025-09-16T20:25:21.976832] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-07. [2025-09-16T20:25:22.064658] [WARN ] [MAIN ] SLVM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:25:22.065165] [INFO ] [MAIN ] SLVM: Wiping existing primary data before full refresh. [2025-09-16T20:25:22.065228] [INFO ] [LOCAL ] SLVM: Starting deletion of primary data. [2025-09-16T20:25:22.065798] [DEBUG] [LOCAL ] SLVM: Deleted primary data file. [2025-09-16T20:25:22.065853] [INFO ] [MAIN ] SLVM: Starting full primary refresh. [2025-09-16T20:25:22.389545] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-16T20:25:22.467618] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-16T20:25:22.487669] [INFO ] [REMOTE ] SLVM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:25:22.615428] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-16T20:25:22.774895] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-04. [2025-09-16T20:25:23.574960] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-09. [2025-09-16T20:25:24.374941] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-02. [2025-09-16T20:25:24.454265] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-16T20:25:25.024110] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-16T20:25:25.029781] [INFO ] [REMOTE ] SLG: Full fetch complete (49227 records). [2025-09-16T20:25:25.029895] [DEBUG] [VALIDATOR ] SLG: Validating primary data. [2025-09-16T20:25:25.180770] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-05. [2025-09-16T20:25:25.421701] [DEBUG] [VALIDATOR ] SLG: All expected trading days are present. [2025-09-16T20:25:25.421883] [DEBUG] [VALIDATOR ] SLG: Primary data validation passed. [2025-09-16T20:25:25.423204] [INFO ] [MAIN ] SLG: Fetched primary data is valid. [2025-09-16T20:25:25.423417] [DEBUG] [LOCAL ] SLG: Saving primary data. [2025-09-16T20:25:25.439609] [DEBUG] [LOCAL ] SLG: Trimmed 49227 records to 34057 (keeping 150 days of data) [2025-09-16T20:25:25.444823] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-16T20:25:25.671567] [DEBUG] [LOCAL ] SLG: Primary data saved (34057 records). [2025-09-16T20:25:25.671738] [INFO ] [MAIN ] SLG: Full history saved. [2025-09-16T20:25:25.673126] [INFO ] [MAIN ] Update Progress: 1933/2369 symbols completed. SLG took 33.6s. Estimated remaining: 46m 19s. Rate: 9.4 symbols/min [2025-09-16T20:25:25.861476] [INFO ] [MAIN ] SM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:25:25.907362] [DEBUG] [LOCAL ] SM: Loaded 38476 existing records from primary storage. [2025-09-16T20:25:25.907523] [INFO ] [MAIN ] SM: Loaded 38476 existing records. [2025-09-16T20:25:25.983901] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-03. [2025-09-16T20:25:26.097697] [WARN ] [MAIN ] SM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:25:26.097950] [INFO ] [MAIN ] SM: Wiping existing primary data before full refresh. [2025-09-16T20:25:26.098003] [INFO ] [LOCAL ] SM: Starting deletion of primary data. [2025-09-16T20:25:26.098799] [DEBUG] [LOCAL ] SM: Deleted primary data file. [2025-09-16T20:25:26.098849] [INFO ] [MAIN ] SM: Starting full primary refresh. [2025-09-16T20:25:26.451474] [INFO ] [REMOTE ] SM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:25:26.774910] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-02. [2025-09-16T20:25:26.883755] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-16T20:25:27.054325] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-16T20:25:27.574917] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-04. [2025-09-16T20:25:28.374908] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-08. [2025-09-16T20:25:28.570345] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-16T20:25:28.638408] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-16T20:25:28.748187] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-16T20:25:29.174937] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-06. [2025-09-16T20:25:29.974946] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-03. [2025-09-16T20:25:30.345880] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-16T20:25:30.774913] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-09. [2025-09-16T20:25:31.097785] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-16T20:25:31.098583] [INFO ] [REMOTE ] SLNZ: Full fetch complete (803 records). [2025-09-16T20:25:31.098712] [DEBUG] [VALIDATOR ] SLNZ: Validating primary data. [2025-09-16T20:25:31.298498] [WARN ] [VALIDATOR ] SLNZ: Validation failed - insufficient historical data. Have 147 unique days, need 150 days [2025-09-16T20:25:31.298764] [FATAL] [MAIN ] SLNZ: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:25:31.298847] [WARN ] [MAIN ] SLNZ: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:25:31.298922] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-09-16T20:25:31.298993] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-09-16T20:25:31.299100] [INFO ] [LOCAL ] SLNZ: Starting deletion of derivative data. [2025-09-16T20:25:31.299153] [DEBUG] [LOCAL ] SLNZ: No derivative data file found to delete. [2025-09-16T20:25:31.299257] [INFO ] [MAIN ] Update Progress: 1934/2369 symbols completed. SLNZ took 25.1s. Estimated remaining: 46m 13s. Rate: 9.4 symbols/min [2025-09-16T20:25:31.480886] [INFO ] [MAIN ] SMA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:25:31.481126] [DEBUG] [LOCAL ] SMA: No existing data file found in primary storage. [2025-09-16T20:25:31.481176] [WARN ] [MAIN ] SMA: No existing data found, performing full refresh instead. [2025-09-16T20:25:31.481332] [INFO ] [MAIN ] SMA: Wiping existing primary data before full refresh. [2025-09-16T20:25:31.481417] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-09-16T20:25:31.481473] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-09-16T20:25:31.481514] [INFO ] [MAIN ] SMA: Starting full primary refresh. [2025-09-16T20:25:31.581033] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-05. [2025-09-16T20:25:31.850408] [INFO ] [REMOTE ] SMA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:25:31.976667] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-16T20:25:32.374909] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-02. [2025-09-16T20:25:32.656169] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:25:32.656503] [WARN ] [REMOTE ] SMA: No data returned for month 2025-02 [2025-09-16T20:25:32.835731] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-16T20:25:33.174949] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-03. [2025-09-16T20:25:33.430272] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:25:33.430586] [WARN ] [REMOTE ] SMA: No data returned for month 2025-03 [2025-09-16T20:25:33.974909] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-04. [2025-09-16T20:25:34.774908] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-07. [2025-09-16T20:25:35.440527] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-16T20:25:35.574886] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-05. [2025-09-16T20:25:36.374925] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-04. [2025-09-16T20:25:36.459866] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-16T20:25:36.912238] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-16T20:25:37.174904] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-06. [2025-09-16T20:25:37.974907] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-06. [2025-09-16T20:25:38.008177] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-16T20:25:38.596442] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-16T20:25:38.774904] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-05. [2025-09-16T20:25:39.111534] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-16T20:25:39.574909] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-08. [2025-09-16T20:25:40.374915] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-07. [2025-09-16T20:25:40.515421] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-16T20:25:41.174911] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-07. [2025-09-16T20:25:41.296810] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-16T20:25:41.668844] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-16T20:25:41.974901] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-06. [2025-09-16T20:25:42.052311] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-16T20:25:42.774943] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-08. [2025-09-16T20:25:43.235291] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-16T20:25:43.574892] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-08. [2025-09-16T20:25:44.273675] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-16T20:25:44.374897] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-07. [2025-09-16T20:25:44.561456] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-16T20:25:45.174941] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-09. [2025-09-16T20:25:45.974882] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-09. [2025-09-16T20:25:46.111325] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-16T20:25:46.115229] [INFO ] [REMOTE ] SMA: Full fetch complete (28210 records). [2025-09-16T20:25:46.115305] [DEBUG] [VALIDATOR ] SMA: Validating primary data. [2025-09-16T20:25:46.300944] [WARN ] [VALIDATOR ] SMA: Validation failed - insufficient historical data. Have 115 unique days, need 150 days [2025-09-16T20:25:46.301374] [FATAL] [MAIN ] SMA: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:25:46.301430] [WARN ] [MAIN ] SMA: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:25:46.301495] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-09-16T20:25:46.301593] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-09-16T20:25:46.301634] [INFO ] [LOCAL ] SMA: Starting deletion of derivative data. [2025-09-16T20:25:46.301708] [DEBUG] [LOCAL ] SMA: No derivative data file found to delete. [2025-09-16T20:25:46.301871] [INFO ] [MAIN ] Update Progress: 1935/2369 symbols completed. SMA took 15.0s. Estimated remaining: 46m 8s. Rate: 9.4 symbols/min [2025-09-16T20:25:46.474231] [INFO ] [MAIN ] SMBK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:25:46.507133] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-16T20:25:46.510200] [DEBUG] [LOCAL ] SMBK: Loaded 5894 existing records from primary storage. [2025-09-16T20:25:46.521018] [INFO ] [MAIN ] SMBK: Loaded 5894 existing records. [2025-09-16T20:25:46.698932] [WARN ] [MAIN ] SMBK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:25:46.699183] [INFO ] [MAIN ] SMBK: Wiping existing primary data before full refresh. [2025-09-16T20:25:46.699230] [INFO ] [LOCAL ] SMBK: Starting deletion of primary data. [2025-09-16T20:25:46.699484] [DEBUG] [LOCAL ] SMBK: Deleted primary data file. [2025-09-16T20:25:46.699528] [INFO ] [MAIN ] SMBK: Starting full primary refresh. [2025-09-16T20:25:46.779966] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-08. [2025-09-16T20:25:47.058159] [INFO ] [REMOTE ] SMBK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:25:47.535416] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-16T20:25:47.540751] [INFO ] [REMOTE ] SLQT: Full fetch complete (48808 records). [2025-09-16T20:25:47.540862] [DEBUG] [VALIDATOR ] SLQT: Validating primary data. [2025-09-16T20:25:47.579962] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-02. [2025-09-16T20:25:47.927353] [DEBUG] [VALIDATOR ] SLQT: All expected trading days are present. [2025-09-16T20:25:47.927430] [DEBUG] [VALIDATOR ] SLQT: Primary data validation passed. [2025-09-16T20:25:47.928299] [INFO ] [MAIN ] SLQT: Fetched primary data is valid. [2025-09-16T20:25:47.928344] [DEBUG] [LOCAL ] SLQT: Saving primary data. [2025-09-16T20:25:47.929385] [DEBUG] [LOCAL ] SLQT: Trimmed 48808 records to 32692 (keeping 150 days of data) [2025-09-16T20:25:48.129668] [DEBUG] [LOCAL ] SLQT: Primary data saved (32692 records). [2025-09-16T20:25:48.129814] [INFO ] [MAIN ] SLQT: Full history saved. [2025-09-16T20:25:48.129940] [INFO ] [MAIN ] Update Progress: 1936/2369 symbols completed. SLQT took 32.2s. Estimated remaining: 46m 1s. Rate: 9.4 symbols/min [2025-09-16T20:25:48.300353] [INFO ] [MAIN ] SMC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:25:48.310408] [DEBUG] [LOCAL ] SMC: Loaded 7771 existing records from primary storage. [2025-09-16T20:25:48.310540] [INFO ] [MAIN ] SMC: Loaded 7771 existing records. [2025-09-16T20:25:48.380202] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-09. [2025-09-16T20:25:48.489709] [WARN ] [MAIN ] SMC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:25:48.490027] [INFO ] [MAIN ] SMC: Wiping existing primary data before full refresh. [2025-09-16T20:25:48.490120] [INFO ] [LOCAL ] SMC: Starting deletion of primary data. [2025-09-16T20:25:48.490546] [DEBUG] [LOCAL ] SMC: Deleted primary data file. [2025-09-16T20:25:48.490702] [INFO ] [MAIN ] SMC: Starting full primary refresh. [2025-09-16T20:25:48.709531] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-16T20:25:48.865318] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-16T20:25:48.900064] [INFO ] [REMOTE ] SMC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:25:49.174907] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-03. [2025-09-16T20:25:49.376286] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-16T20:25:49.379923] [INFO ] [REMOTE ] SLVM: Full fetch complete (30757 records). [2025-09-16T20:25:49.380005] [DEBUG] [VALIDATOR ] SLVM: Validating primary data. [2025-09-16T20:25:49.747910] [DEBUG] [VALIDATOR ] SLVM: All expected trading days are present. [2025-09-16T20:25:49.748004] [DEBUG] [VALIDATOR ] SLVM: Primary data validation passed. [2025-09-16T20:25:49.748603] [INFO ] [MAIN ] SLVM: Fetched primary data is valid. [2025-09-16T20:25:49.748658] [DEBUG] [LOCAL ] SLVM: Saving primary data. [2025-09-16T20:25:49.749340] [DEBUG] [LOCAL ] SLVM: Trimmed 30757 records to 20486 (keeping 150 days of data) [2025-09-16T20:25:49.879761] [DEBUG] [LOCAL ] SLVM: Primary data saved (20486 records). [2025-09-16T20:25:49.879889] [INFO ] [MAIN ] SLVM: Full history saved. [2025-09-16T20:25:49.879979] [INFO ] [MAIN ] Update Progress: 1937/2369 symbols completed. SLVM took 28.2s. Estimated remaining: 45m 54s. Rate: 9.4 symbols/min [2025-09-16T20:25:49.979989] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-02. [2025-09-16T20:25:50.053061] [INFO ] [MAIN ] SMFG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:25:50.091415] [DEBUG] [LOCAL ] SMFG: Loaded 35393 existing records from primary storage. [2025-09-16T20:25:50.091604] [INFO ] [MAIN ] SMFG: Loaded 35393 existing records. [2025-09-16T20:25:50.211126] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-16T20:25:50.277048] [WARN ] [MAIN ] SMFG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:25:50.277248] [INFO ] [MAIN ] SMFG: Wiping existing primary data before full refresh. [2025-09-16T20:25:50.277292] [INFO ] [LOCAL ] SMFG: Starting deletion of primary data. [2025-09-16T20:25:50.278154] [DEBUG] [LOCAL ] SMFG: Deleted primary data file. [2025-09-16T20:25:50.278210] [INFO ] [MAIN ] SMFG: Starting full primary refresh. [2025-09-16T20:25:50.631750] [INFO ] [REMOTE ] SMFG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:25:50.774905] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-02. [2025-09-16T20:25:50.920456] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-16T20:25:51.574888] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-03. [2025-09-16T20:25:52.158770] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-16T20:25:52.374926] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-03. [2025-09-16T20:25:52.465784] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-16T20:25:53.174932] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-04. [2025-09-16T20:25:53.974906] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-09. [2025-09-16T20:25:54.050708] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-16T20:25:54.208976] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-16T20:25:54.774926] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-04. [2025-09-16T20:25:55.574880] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-05. [2025-09-16T20:25:55.613983] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-16T20:25:55.626705] [INFO ] [REMOTE ] SM: Full fetch complete (56940 records). [2025-09-16T20:25:55.627530] [DEBUG] [VALIDATOR ] SM: Validating primary data. [2025-09-16T20:25:55.627455] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-16T20:25:56.025436] [DEBUG] [VALIDATOR ] SM: All expected trading days are present. [2025-09-16T20:25:56.025531] [DEBUG] [VALIDATOR ] SM: Primary data validation passed. [2025-09-16T20:25:56.026590] [INFO ] [MAIN ] SM: Fetched primary data is valid. [2025-09-16T20:25:56.026637] [DEBUG] [LOCAL ] SM: Saving primary data. [2025-09-16T20:25:56.028001] [DEBUG] [LOCAL ] SM: Trimmed 56940 records to 38863 (keeping 150 days of data) [2025-09-16T20:25:56.275290] [DEBUG] [LOCAL ] SM: Primary data saved (38863 records). [2025-09-16T20:25:56.275461] [INFO ] [MAIN ] SM: Full history saved. [2025-09-16T20:25:56.276963] [INFO ] [MAIN ] Update Progress: 1938/2369 symbols completed. SM took 30.6s. Estimated remaining: 45m 47s. Rate: 9.4 symbols/min [2025-09-16T20:25:56.379977] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-04. [2025-09-16T20:25:56.458073] [INFO ] [MAIN ] SMG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:25:56.465047] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-16T20:25:56.502075] [DEBUG] [LOCAL ] SMG: Loaded 32007 existing records from primary storage. [2025-09-16T20:25:56.502211] [INFO ] [MAIN ] SMG: Loaded 32007 existing records. [2025-09-16T20:25:56.679802] [WARN ] [MAIN ] SMG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:25:56.680068] [INFO ] [MAIN ] SMG: Wiping existing primary data before full refresh. [2025-09-16T20:25:56.680114] [INFO ] [LOCAL ] SMG: Starting deletion of primary data. [2025-09-16T20:25:56.680834] [DEBUG] [LOCAL ] SMG: Deleted primary data file. [2025-09-16T20:25:56.680882] [INFO ] [MAIN ] SMG: Starting full primary refresh. [2025-09-16T20:25:57.034683] [INFO ] [REMOTE ] SMG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:25:57.174883] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-02. [2025-09-16T20:25:57.974908] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-05. [2025-09-16T20:25:58.236383] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-16T20:25:58.627251] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-16T20:25:58.774952] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-05. [2025-09-16T20:25:58.883433] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-16T20:25:59.575011] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-06. [2025-09-16T20:26:00.274886] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-16T20:26:00.374875] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-06. [2025-09-16T20:26:00.467247] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-16T20:26:01.174942] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-07. [2025-09-16T20:26:01.344828] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-16T20:26:01.974961] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-03. [2025-09-16T20:26:02.097590] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-16T20:26:02.774903] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-06. [2025-09-16T20:26:03.566120] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-16T20:26:03.575462] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-08. [2025-09-16T20:26:04.374970] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-07. [2025-09-16T20:26:04.441509] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-16T20:26:04.483143] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-16T20:26:05.174948] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-09. [2025-09-16T20:26:05.200435] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-16T20:26:05.880249] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-16T20:26:05.881623] [INFO ] [REMOTE ] SMBK: Full fetch complete (8734 records). [2025-09-16T20:26:05.881737] [DEBUG] [VALIDATOR ] SMBK: Validating primary data. [2025-09-16T20:26:05.982558] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-08. [2025-09-16T20:26:06.294168] [DEBUG] [VALIDATOR ] SMBK: All expected trading days are present. [2025-09-16T20:26:06.294254] [DEBUG] [VALIDATOR ] SMBK: Primary data validation passed. [2025-09-16T20:26:06.294587] [INFO ] [MAIN ] SMBK: Fetched primary data is valid. [2025-09-16T20:26:06.294668] [DEBUG] [LOCAL ] SMBK: Saving primary data. [2025-09-16T20:26:06.295147] [DEBUG] [LOCAL ] SMBK: Trimmed 8734 records to 5935 (keeping 150 days of data) [2025-09-16T20:26:06.335456] [DEBUG] [LOCAL ] SMBK: Primary data saved (5935 records). [2025-09-16T20:26:06.335571] [INFO ] [MAIN ] SMBK: Full history saved. [2025-09-16T20:26:06.335671] [INFO ] [MAIN ] Update Progress: 1939/2369 symbols completed. SMBK took 20.0s. Estimated remaining: 45m 42s. Rate: 9.4 symbols/min [2025-09-16T20:26:06.510095] [INFO ] [MAIN ] SMHI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:26:06.520680] [DEBUG] [LOCAL ] SMHI: Loaded 9490 existing records from primary storage. [2025-09-16T20:26:06.520819] [INFO ] [MAIN ] SMHI: Loaded 9490 existing records. [2025-09-16T20:26:06.704610] [WARN ] [MAIN ] SMHI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:26:06.704873] [INFO ] [MAIN ] SMHI: Wiping existing primary data before full refresh. [2025-09-16T20:26:06.704923] [INFO ] [LOCAL ] SMHI: Starting deletion of primary data. [2025-09-16T20:26:06.705257] [DEBUG] [LOCAL ] SMHI: Deleted primary data file. [2025-09-16T20:26:06.705309] [INFO ] [MAIN ] SMHI: Starting full primary refresh. [2025-09-16T20:26:06.783740] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-04. [2025-09-16T20:26:07.008123] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-16T20:26:07.081790] [INFO ] [REMOTE ] SMHI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:26:07.574893] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-02. [2025-09-16T20:26:08.374965] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-07. [2025-09-16T20:26:08.607913] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-16T20:26:08.629334] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-16T20:26:09.174903] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-09. [2025-09-16T20:26:09.974885] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-05. [2025-09-16T20:26:10.102474] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-16T20:26:10.104164] [INFO ] [REMOTE ] SMC: Full fetch complete (12565 records). [2025-09-16T20:26:10.104232] [DEBUG] [VALIDATOR ] SMC: Validating primary data. [2025-09-16T20:26:10.435722] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-16T20:26:10.536804] [DEBUG] [VALIDATOR ] SMC: All expected trading days are present. [2025-09-16T20:26:10.536886] [DEBUG] [VALIDATOR ] SMC: Primary data validation passed. [2025-09-16T20:26:10.537205] [INFO ] [MAIN ] SMC: Fetched primary data is valid. [2025-09-16T20:26:10.537245] [DEBUG] [LOCAL ] SMC: Saving primary data. [2025-09-16T20:26:10.538007] [DEBUG] [LOCAL ] SMC: Trimmed 12565 records to 7825 (keeping 150 days of data) [2025-09-16T20:26:10.587043] [DEBUG] [LOCAL ] SMC: Primary data saved (7825 records). [2025-09-16T20:26:10.587178] [INFO ] [MAIN ] SMC: Full history saved. [2025-09-16T20:26:10.587270] [INFO ] [MAIN ] Update Progress: 1940/2369 symbols completed. SMC took 22.5s. Estimated remaining: 45m 35s. Rate: 9.4 symbols/min [2025-09-16T20:26:10.759868] [INFO ] [MAIN ] SMP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:26:10.774741] [DEBUG] [LOCAL ] SMP: Loaded 13679 existing records from primary storage. [2025-09-16T20:26:10.774867] [INFO ] [MAIN ] SMP: Loaded 13679 existing records. [2025-09-16T20:26:10.774921] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-03. [2025-09-16T20:26:10.951666] [WARN ] [MAIN ] SMP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:26:10.951895] [INFO ] [MAIN ] SMP: Wiping existing primary data before full refresh. [2025-09-16T20:26:10.951941] [INFO ] [LOCAL ] SMP: Starting deletion of primary data. [2025-09-16T20:26:10.952341] [DEBUG] [LOCAL ] SMP: Deleted primary data file. [2025-09-16T20:26:10.952386] [INFO ] [MAIN ] SMP: Starting full primary refresh. [2025-09-16T20:26:11.301404] [INFO ] [REMOTE ] SMP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:26:11.574891] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-08. [2025-09-16T20:26:11.655373] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-16T20:26:12.049457] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-16T20:26:12.374905] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-04. [2025-09-16T20:26:13.174915] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-02. [2025-09-16T20:26:13.259398] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-16T20:26:13.543375] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-16T20:26:13.974887] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-09. [2025-09-16T20:26:14.237850] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-16T20:26:14.774900] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-06. [2025-09-16T20:26:15.525678] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-16T20:26:15.531547] [INFO ] [REMOTE ] SMFG: Full fetch complete (52163 records). [2025-09-16T20:26:15.531695] [DEBUG] [VALIDATOR ] SMFG: Validating primary data. [2025-09-16T20:26:15.580052] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-03. [2025-09-16T20:26:15.926273] [DEBUG] [VALIDATOR ] SMFG: All expected trading days are present. [2025-09-16T20:26:15.926353] [DEBUG] [VALIDATOR ] SMFG: Primary data validation passed. [2025-09-16T20:26:15.927250] [INFO ] [MAIN ] SMFG: Fetched primary data is valid. [2025-09-16T20:26:15.927296] [DEBUG] [LOCAL ] SMFG: Saving primary data. [2025-09-16T20:26:15.928428] [DEBUG] [LOCAL ] SMFG: Trimmed 52163 records to 35752 (keeping 150 days of data) [2025-09-16T20:26:16.138021] [DEBUG] [LOCAL ] SMFG: Primary data saved (35752 records). [2025-09-16T20:26:16.138158] [INFO ] [MAIN ] SMFG: Full history saved. [2025-09-16T20:26:16.138251] [INFO ] [MAIN ] Update Progress: 1941/2369 symbols completed. SMFG took 26.3s. Estimated remaining: 45m 28s. Rate: 9.4 symbols/min [2025-09-16T20:26:16.310492] [INFO ] [MAIN ] SMR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:26:16.348540] [DEBUG] [LOCAL ] SMR: Loaded 39761 existing records from primary storage. [2025-09-16T20:26:16.348707] [INFO ] [MAIN ] SMR: Loaded 39761 existing records. [2025-09-16T20:26:16.380142] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-05. [2025-09-16T20:26:16.530117] [WARN ] [MAIN ] SMR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:26:16.530418] [INFO ] [MAIN ] SMR: Wiping existing primary data before full refresh. [2025-09-16T20:26:16.530473] [INFO ] [LOCAL ] SMR: Starting deletion of primary data. [2025-09-16T20:26:16.540110] [DEBUG] [LOCAL ] SMR: Deleted primary data file. [2025-09-16T20:26:16.552732] [INFO ] [MAIN ] SMR: Starting full primary refresh. [2025-09-16T20:26:16.637548] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-16T20:26:16.915597] [INFO ] [REMOTE ] SMR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:26:16.941576] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-16T20:26:17.174891] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-07. [2025-09-16T20:26:17.464223] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-16T20:26:17.974910] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-06. [2025-09-16T20:26:18.700796] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-16T20:26:18.718293] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-16T20:26:18.774873] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-08. [2025-09-16T20:26:19.574969] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-02. [2025-09-16T20:26:20.098889] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-16T20:26:20.374960] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-04. [2025-09-16T20:26:21.174918] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-07. [2025-09-16T20:26:21.314201] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-16T20:26:21.848053] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-09-16T20:26:21.866830] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-16T20:26:21.974914] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-08. [2025-09-16T20:26:22.774913] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-05. [2025-09-16T20:26:22.855469] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-16T20:26:23.574867] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-09. [2025-09-16T20:26:23.934543] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-16T20:26:24.357575] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-16T20:26:24.359290] [INFO ] [REMOTE ] SMHI: Full fetch complete (16346 records). [2025-09-16T20:26:24.359370] [DEBUG] [VALIDATOR ] SMHI: Validating primary data. [2025-09-16T20:26:24.380372] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-09. [2025-09-16T20:26:24.724382] [DEBUG] [VALIDATOR ] SMHI: All expected trading days are present. [2025-09-16T20:26:24.724492] [DEBUG] [VALIDATOR ] SMHI: Primary data validation passed. [2025-09-16T20:26:24.724863] [INFO ] [MAIN ] SMHI: Fetched primary data is valid. [2025-09-16T20:26:24.724907] [DEBUG] [LOCAL ] SMHI: Saving primary data. [2025-09-16T20:26:24.725414] [DEBUG] [LOCAL ] SMHI: Trimmed 16346 records to 9646 (keeping 150 days of data) [2025-09-16T20:26:24.783223] [DEBUG] [LOCAL ] SMHI: Primary data saved (9646 records). [2025-09-16T20:26:24.783366] [INFO ] [MAIN ] SMHI: Full history saved. [2025-09-16T20:26:24.783457] [INFO ] [MAIN ] Update Progress: 1942/2369 symbols completed. SMHI took 18.4s. Estimated remaining: 45m 22s. Rate: 9.4 symbols/min [2025-09-16T20:26:24.964039] [INFO ] [MAIN ] SMRT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:26:25.000265] [DEBUG] [LOCAL ] SMRT: Loaded 32661 existing records from primary storage. [2025-09-16T20:26:25.000413] [INFO ] [MAIN ] SMRT: Loaded 32661 existing records. [2025-09-16T20:26:25.176932] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-06. [2025-09-16T20:26:25.177064] [WARN ] [MAIN ] SMRT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:26:25.178068] [INFO ] [MAIN ] SMRT: Wiping existing primary data before full refresh. [2025-09-16T20:26:25.178129] [INFO ] [LOCAL ] SMRT: Starting deletion of primary data. [2025-09-16T20:26:25.178739] [DEBUG] [LOCAL ] SMRT: Deleted primary data file. [2025-09-16T20:26:25.178785] [INFO ] [MAIN ] SMRT: Starting full primary refresh. [2025-09-16T20:26:25.530195] [INFO ] [REMOTE ] SMRT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:26:25.841922] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-16T20:26:25.846936] [INFO ] [REMOTE ] SMG: Full fetch complete (48392 records). [2025-09-16T20:26:25.847041] [DEBUG] [VALIDATOR ] SMG: Validating primary data. [2025-09-16T20:26:25.989430] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-03. [2025-09-16T20:26:26.228300] [DEBUG] [VALIDATOR ] SMG: All expected trading days are present. [2025-09-16T20:26:26.228409] [DEBUG] [VALIDATOR ] SMG: Primary data validation passed. [2025-09-16T20:26:26.229411] [INFO ] [MAIN ] SMG: Fetched primary data is valid. [2025-09-16T20:26:26.229481] [DEBUG] [LOCAL ] SMG: Saving primary data. [2025-09-16T20:26:26.240333] [DEBUG] [LOCAL ] SMG: Trimmed 48392 records to 32250 (keeping 150 days of data) [2025-09-16T20:26:26.240738] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-16T20:26:26.448290] [DEBUG] [LOCAL ] SMG: Primary data saved (32250 records). [2025-09-16T20:26:26.448464] [INFO ] [MAIN ] SMG: Full history saved. [2025-09-16T20:26:26.449251] [INFO ] [MAIN ] Update Progress: 1943/2369 symbols completed. SMG took 30.2s. Estimated remaining: 45m 15s. Rate: 9.4 symbols/min [2025-09-16T20:26:26.621067] [INFO ] [MAIN ] SMWB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:26:26.646024] [DEBUG] [LOCAL ] SMWB: Loaded 24632 existing records from primary storage. [2025-09-16T20:26:26.646167] [INFO ] [MAIN ] SMWB: Loaded 24632 existing records. [2025-09-16T20:26:26.791011] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-07. [2025-09-16T20:26:26.830738] [WARN ] [MAIN ] SMWB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:26:26.831009] [INFO ] [MAIN ] SMWB: Wiping existing primary data before full refresh. [2025-09-16T20:26:26.831067] [INFO ] [LOCAL ] SMWB: Starting deletion of primary data. [2025-09-16T20:26:26.831557] [DEBUG] [LOCAL ] SMWB: Deleted primary data file. [2025-09-16T20:26:26.831606] [INFO ] [MAIN ] SMWB: Starting full primary refresh. [2025-09-16T20:26:27.198548] [INFO ] [REMOTE ] SMWB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:26:27.574858] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-02. [2025-09-16T20:26:27.973501] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-16T20:26:28.374936] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-02. [2025-09-16T20:26:28.657759] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-03 (2.67 seconds). [2025-09-16T20:26:29.131200] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-16T20:26:29.174884] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-08. [2025-09-16T20:26:29.746256] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-16T20:26:29.918367] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-16T20:26:29.974873] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-09. [2025-09-16T20:26:30.769675] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-16T20:26:30.772173] [INFO ] [REMOTE ] SMP: Full fetch complete (21448 records). [2025-09-16T20:26:30.772270] [DEBUG] [VALIDATOR ] SMP: Validating primary data. [2025-09-16T20:26:30.783959] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-03. [2025-09-16T20:26:31.137916] [DEBUG] [VALIDATOR ] SMP: All expected trading days are present. [2025-09-16T20:26:31.137996] [DEBUG] [VALIDATOR ] SMP: Primary data validation passed. [2025-09-16T20:26:31.138439] [INFO ] [MAIN ] SMP: Fetched primary data is valid. [2025-09-16T20:26:31.138479] [DEBUG] [LOCAL ] SMP: Saving primary data. [2025-09-16T20:26:31.139083] [DEBUG] [LOCAL ] SMP: Trimmed 21448 records to 13817 (keeping 150 days of data) [2025-09-16T20:26:31.227317] [DEBUG] [LOCAL ] SMP: Primary data saved (13817 records). [2025-09-16T20:26:31.227476] [INFO ] [MAIN ] SMP: Full history saved. [2025-09-16T20:26:31.227564] [INFO ] [MAIN ] Update Progress: 1944/2369 symbols completed. SMP took 20.6s. Estimated remaining: 45m 8s. Rate: 9.4 symbols/min [2025-09-16T20:26:31.400876] [INFO ] [MAIN ] SN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:26:31.439062] [DEBUG] [LOCAL ] SN: Loaded 36868 existing records from primary storage. [2025-09-16T20:26:31.439212] [INFO ] [MAIN ] SN: Loaded 36868 existing records. [2025-09-16T20:26:31.584185] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-04. [2025-09-16T20:26:31.623848] [WARN ] [MAIN ] SN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:26:31.624084] [INFO ] [MAIN ] SN: Wiping existing primary data before full refresh. [2025-09-16T20:26:31.624131] [INFO ] [LOCAL ] SN: Starting deletion of primary data. [2025-09-16T20:26:31.625006] [DEBUG] [LOCAL ] SN: Deleted primary data file. [2025-09-16T20:26:31.625079] [INFO ] [MAIN ] SN: Starting full primary refresh. [2025-09-16T20:26:31.985723] [INFO ] [REMOTE ] SN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:26:32.374903] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-02. [2025-09-16T20:26:32.500316] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-16T20:26:33.174924] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-04. [2025-09-16T20:26:33.938934] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-09-16T20:26:33.974875] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-05. [2025-09-16T20:26:34.082532] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-16T20:26:34.774972] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-03. [2025-09-16T20:26:34.812167] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-16T20:26:35.574941] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-03. [2025-09-16T20:26:36.374929] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-05. [2025-09-16T20:26:36.478033] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-09-16T20:26:36.579912] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-16T20:26:36.612427] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-16T20:26:37.174937] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-04. [2025-09-16T20:26:37.632446] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-16T20:26:37.974972] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-04. [2025-09-16T20:26:38.649862] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-16T20:26:38.774885] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-05. [2025-09-16T20:26:39.483677] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-16T20:26:39.574953] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-06. [2025-09-16T20:26:40.374978] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-05. [2025-09-16T20:26:40.640723] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-16T20:26:40.859826] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-16T20:26:41.174916] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-06. [2025-09-16T20:26:41.788209] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-16T20:26:41.974956] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-06. [2025-09-16T20:26:42.774903] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-07. [2025-09-16T20:26:43.187809] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-16T20:26:43.496106] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-16T20:26:43.574880] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-06. [2025-09-16T20:26:44.374897] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-07. [2025-09-16T20:26:44.499806] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-16T20:26:44.948079] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-16T20:26:45.174915] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-07. [2025-09-16T20:26:45.974924] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-07. [2025-09-16T20:26:46.041064] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-16T20:26:46.492768] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-16T20:26:46.774910] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-08. [2025-09-16T20:26:47.574909] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-08. [2025-09-16T20:26:48.246019] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-16T20:26:48.374930] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-08. [2025-09-16T20:26:48.556300] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-09-16T20:26:48.772323] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-16T20:26:49.174941] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-08. [2025-09-16T20:26:49.974903] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-09. [2025-09-16T20:26:50.265360] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-16T20:26:50.774933] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-09. [2025-09-16T20:26:51.254296] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-16T20:26:51.258302] [INFO ] [REMOTE ] SMWB: Full fetch complete (37369 records). [2025-09-16T20:26:51.258406] [DEBUG] [VALIDATOR ] SMWB: Validating primary data. [2025-09-16T20:26:51.579981] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-09. [2025-09-16T20:26:51.638536] [DEBUG] [VALIDATOR ] SMWB: All expected trading days are present. [2025-09-16T20:26:51.638748] [DEBUG] [VALIDATOR ] SMWB: Primary data validation passed. [2025-09-16T20:26:51.639601] [INFO ] [MAIN ] SMWB: Fetched primary data is valid. [2025-09-16T20:26:51.639675] [DEBUG] [LOCAL ] SMWB: Saving primary data. [2025-09-16T20:26:51.641116] [DEBUG] [LOCAL ] SMWB: Trimmed 37369 records to 24814 (keeping 150 days of data) [2025-09-16T20:26:51.785316] [DEBUG] [LOCAL ] SMWB: Primary data saved (24814 records). [2025-09-16T20:26:51.785512] [INFO ] [MAIN ] SMWB: Full history saved. [2025-09-16T20:26:51.785631] [INFO ] [MAIN ] Update Progress: 1945/2369 symbols completed. SMWB took 25.3s. Estimated remaining: 45m 5s. Rate: 9.4 symbols/min [2025-09-16T20:26:51.941062] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-08 (2.77 seconds). [2025-09-16T20:26:52.003876] [INFO ] [MAIN ] SNA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:26:52.021998] [DEBUG] [LOCAL ] SNA: Loaded 18248 existing records from primary storage. [2025-09-16T20:26:52.022109] [INFO ] [MAIN ] SNA: Loaded 18248 existing records. [2025-09-16T20:26:52.200626] [WARN ] [MAIN ] SNA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:26:52.200918] [INFO ] [MAIN ] SNA: Wiping existing primary data before full refresh. [2025-09-16T20:26:52.200965] [INFO ] [LOCAL ] SNA: Starting deletion of primary data. [2025-09-16T20:26:52.201546] [DEBUG] [LOCAL ] SNA: Deleted primary data file. [2025-09-16T20:26:52.201597] [INFO ] [MAIN ] SNA: Starting full primary refresh. [2025-09-16T20:26:52.383130] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-09. [2025-09-16T20:26:52.442373] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-16T20:26:52.515093] [INFO ] [REMOTE ] SMRT: Full fetch complete (48205 records). [2025-09-16T20:26:52.525901] [DEBUG] [VALIDATOR ] SMRT: Validating primary data. [2025-09-16T20:26:52.637673] [INFO ] [REMOTE ] SNA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:26:52.995402] [DEBUG] [VALIDATOR ] SMRT: All expected trading days are present. [2025-09-16T20:26:52.995479] [DEBUG] [VALIDATOR ] SMRT: Primary data validation passed. [2025-09-16T20:26:52.996360] [INFO ] [MAIN ] SMRT: Fetched primary data is valid. [2025-09-16T20:26:52.996404] [DEBUG] [LOCAL ] SMRT: Saving primary data. [2025-09-16T20:26:52.997358] [DEBUG] [LOCAL ] SMRT: Trimmed 48205 records to 33024 (keeping 150 days of data) [2025-09-16T20:26:53.129945] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-16T20:26:53.141315] [INFO ] [REMOTE ] SN: Full fetch complete (54160 records). [2025-09-16T20:26:53.141469] [DEBUG] [VALIDATOR ] SN: Validating primary data. [2025-09-16T20:26:53.182787] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-02. [2025-09-16T20:26:53.622980] [DEBUG] [VALIDATOR ] SN: All expected trading days are present. [2025-09-16T20:26:53.625424] [DEBUG] [VALIDATOR ] SN: Primary data validation passed. [2025-09-16T20:26:53.627666] [DEBUG] [LOCAL ] SMRT: Primary data saved (33024 records). [2025-09-16T20:26:53.629866] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-16T20:26:53.629279] [INFO ] [MAIN ] SN: Fetched primary data is valid. [2025-09-16T20:26:53.629997] [DEBUG] [LOCAL ] SN: Saving primary data. [2025-09-16T20:26:53.635327] [INFO ] [MAIN ] SMRT: Full history saved. [2025-09-16T20:26:53.635776] [INFO ] [MAIN ] Update Progress: 1946/2369 symbols completed. SMRT took 28.9s. Estimated remaining: 44m 58s. Rate: 9.4 symbols/min [2025-09-16T20:26:53.656814] [INFO ] [REMOTE ] SMR: Full fetch complete (58087 records). [2025-09-16T20:26:53.679206] [DEBUG] [VALIDATOR ] SMR: Validating primary data. [2025-09-16T20:26:53.711996] [FATAL] [VALIDATOR ] SMR: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T20:26:53.728198] [DEBUG] [LOCAL ] SN: Trimmed 54160 records to 37194 (keeping 150 days of data) [2025-09-16T20:26:53.728259] [FATAL] [MAIN ] SMR: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:26:53.739082] [WARN ] [MAIN ] SMR: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:26:53.739184] [INFO ] [LOCAL ] SMR: Starting deletion of primary data. [2025-09-16T20:26:53.739241] [DEBUG] [LOCAL ] SMR: No primary data file found to delete. [2025-09-16T20:26:53.739282] [INFO ] [LOCAL ] SMR: Starting deletion of derivative data. [2025-09-16T20:26:53.800899] [DEBUG] [LOCAL ] SMR: Deleted derivative data file. [2025-09-16T20:26:53.839221] [INFO ] [MAIN ] Update Progress: 1947/2369 symbols completed. SMR took 37.7s. Estimated remaining: 44m 50s. Rate: 9.4 symbols/min [2025-09-16T20:26:53.900619] [INFO ] [MAIN ] SNAP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:26:54.097060] [INFO ] [MAIN ] SNDA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:26:54.122298] [DEBUG] [LOCAL ] SNAP: Loaded 39756 existing records from primary storage. [2025-09-16T20:26:54.123130] [INFO ] [MAIN ] SNAP: Loaded 39756 existing records. [2025-09-16T20:26:54.137368] [DEBUG] [LOCAL ] SNDA: Loaded 3259 existing records from primary storage. [2025-09-16T20:26:54.158164] [INFO ] [MAIN ] SNDA: Loaded 3259 existing records. [2025-09-16T20:26:54.585149] [WARN ] [MAIN ] SNDA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:26:54.589311] [WARN ] [MAIN ] SNAP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:26:54.593630] [INFO ] [MAIN ] SNDA: Wiping existing primary data before full refresh. [2025-09-16T20:26:54.594397] [INFO ] [LOCAL ] SNDA: Starting deletion of primary data. [2025-09-16T20:26:54.594037] [INFO ] [MAIN ] SNAP: Wiping existing primary data before full refresh. [2025-09-16T20:26:54.596822] [DEBUG] [LOCAL ] SNDA: Deleted primary data file. [2025-09-16T20:26:54.596791] [INFO ] [LOCAL ] SNAP: Starting deletion of primary data. [2025-09-16T20:26:54.597163] [INFO ] [MAIN ] SNDA: Starting full primary refresh. [2025-09-16T20:26:54.609488] [DEBUG] [LOCAL ] SNAP: Deleted primary data file. [2025-09-16T20:26:54.609581] [INFO ] [MAIN ] SNAP: Starting full primary refresh. [2025-09-16T20:26:55.089759] [DEBUG] [LOCAL ] SN: Primary data saved (37194 records). [2025-09-16T20:26:55.089949] [INFO ] [MAIN ] SN: Full history saved. [2025-09-16T20:26:55.151414] [INFO ] [MAIN ] Update Progress: 1948/2369 symbols completed. SN took 23.9s. Estimated remaining: 44m 42s. Rate: 9.4 symbols/min [2025-09-16T20:26:55.212598] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-16T20:26:55.281053] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-03. [2025-09-16T20:26:55.384959] [INFO ] [REMOTE ] SNDA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:26:55.446536] [INFO ] [REMOTE ] SNAP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:26:55.446902] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-02. [2025-09-16T20:26:55.541812] [INFO ] [MAIN ] SNDR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:26:55.570334] [DEBUG] [LOCAL ] SNDR: Loaded 29459 existing records from primary storage. [2025-09-16T20:26:55.570509] [INFO ] [MAIN ] SNDR: Loaded 29459 existing records. [2025-09-16T20:26:55.601899] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-02. [2025-09-16T20:26:55.747193] [WARN ] [MAIN ] SNDR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:26:55.747403] [INFO ] [MAIN ] SNDR: Wiping existing primary data before full refresh. [2025-09-16T20:26:55.747447] [INFO ] [LOCAL ] SNDR: Starting deletion of primary data. [2025-09-16T20:26:55.748186] [DEBUG] [LOCAL ] SNDR: Deleted primary data file. [2025-09-16T20:26:55.748233] [INFO ] [MAIN ] SNDR: Starting full primary refresh. [2025-09-16T20:26:56.107660] [INFO ] [REMOTE ] SNDR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:26:56.234450] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-16T20:26:56.374928] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-03. [2025-09-16T20:26:57.018267] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-16T20:26:57.166328] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-16T20:26:57.174853] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-04. [2025-09-16T20:26:57.652876] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-16T20:26:57.706836] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-16T20:26:57.974909] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-05. [2025-09-16T20:26:58.683304] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-16T20:26:58.774915] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-06. [2025-09-16T20:26:59.488973] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-16T20:26:59.574916] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-07. [2025-09-16T20:27:00.230923] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-16T20:27:00.374904] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-08. [2025-09-16T20:27:01.085669] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-16T20:27:01.174871] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-04. [2025-09-16T20:27:01.974895] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-02. [2025-09-16T20:27:02.735471] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-16T20:27:02.774887] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-05. [2025-09-16T20:27:03.532891] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-16T20:27:03.574876] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-03. [2025-09-16T20:27:04.043945] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-16T20:27:04.374901] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-06. [2025-09-16T20:27:05.055903] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-16T20:27:05.174899] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-04. [2025-09-16T20:27:05.621385] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-16T20:27:05.974898] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-07. [2025-09-16T20:27:06.774882] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-09. [2025-09-16T20:27:06.856167] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-16T20:27:07.362998] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-16T20:27:07.364322] [INFO ] [REMOTE ] SNDA: Full fetch complete (5279 records). [2025-09-16T20:27:07.364490] [DEBUG] [VALIDATOR ] SNDA: Validating primary data. [2025-09-16T20:27:07.488371] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-16T20:27:07.583398] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-08. [2025-09-16T20:27:07.751628] [DEBUG] [VALIDATOR ] SNDA: All expected trading days are present. [2025-09-16T20:27:07.751715] [DEBUG] [VALIDATOR ] SNDA: Primary data validation passed. [2025-09-16T20:27:07.751873] [INFO ] [MAIN ] SNDA: Fetched primary data is valid. [2025-09-16T20:27:07.751924] [DEBUG] [LOCAL ] SNDA: Saving primary data. [2025-09-16T20:27:07.752285] [DEBUG] [LOCAL ] SNDA: Trimmed 5279 records to 3277 (keeping 150 days of data) [2025-09-16T20:27:07.772211] [DEBUG] [LOCAL ] SNDA: Primary data saved (3277 records). [2025-09-16T20:27:07.772295] [INFO ] [MAIN ] SNDA: Full history saved. [2025-09-16T20:27:07.772399] [INFO ] [MAIN ] Update Progress: 1949/2369 symbols completed. SNDA took 13.9s. Estimated remaining: 44m 37s. Rate: 9.4 symbols/min [2025-09-16T20:27:07.940513] [INFO ] [MAIN ] SNN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:27:07.971396] [DEBUG] [LOCAL ] SNN: Loaded 32922 existing records from primary storage. [2025-09-16T20:27:07.971527] [INFO ] [MAIN ] SNN: Loaded 32922 existing records. [2025-09-16T20:27:08.150547] [WARN ] [MAIN ] SNN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:27:08.150868] [INFO ] [MAIN ] SNN: Wiping existing primary data before full refresh. [2025-09-16T20:27:08.150923] [INFO ] [LOCAL ] SNN: Starting deletion of primary data. [2025-09-16T20:27:08.151505] [DEBUG] [LOCAL ] SNN: Deleted primary data file. [2025-09-16T20:27:08.151550] [INFO ] [MAIN ] SNN: Starting full primary refresh. [2025-09-16T20:27:08.387026] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-03. [2025-09-16T20:27:08.501107] [INFO ] [REMOTE ] SNN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:27:08.827074] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-16T20:27:09.174916] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-05. [2025-09-16T20:27:09.974900] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-02. [2025-09-16T20:27:10.716236] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-16T20:27:10.774853] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-06. [2025-09-16T20:27:10.908392] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-09-16T20:27:11.117906] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-16T20:27:11.574888] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-03. [2025-09-16T20:27:12.303780] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-16T20:27:12.374955] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-04. [2025-09-16T20:27:13.174965] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-09. [2025-09-16T20:27:13.225582] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-16T20:27:13.974943] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-07. [2025-09-16T20:27:14.353754] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-16T20:27:14.358791] [INFO ] [REMOTE ] SNA: Full fetch complete (28811 records). [2025-09-16T20:27:14.358926] [DEBUG] [VALIDATOR ] SNA: Validating primary data. [2025-09-16T20:27:14.744742] [DEBUG] [VALIDATOR ] SNA: All expected trading days are present. [2025-09-16T20:27:14.744895] [DEBUG] [VALIDATOR ] SNA: Primary data validation passed. [2025-09-16T20:27:14.745521] [INFO ] [MAIN ] SNA: Fetched primary data is valid. [2025-09-16T20:27:14.745723] [DEBUG] [LOCAL ] SNA: Saving primary data. [2025-09-16T20:27:14.746789] [DEBUG] [LOCAL ] SNA: Trimmed 28811 records to 18449 (keeping 150 days of data) [2025-09-16T20:27:14.799131] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-04. [2025-09-16T20:27:14.884813] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-09-16T20:27:14.911960] [DEBUG] [LOCAL ] SNA: Primary data saved (18449 records). [2025-09-16T20:27:14.912119] [INFO ] [MAIN ] SNA: Full history saved. [2025-09-16T20:27:14.912232] [INFO ] [MAIN ] Update Progress: 1950/2369 symbols completed. SNA took 23.1s. Estimated remaining: 44m 31s. Rate: 9.4 symbols/min [2025-09-16T20:27:15.081267] [INFO ] [MAIN ] SNOW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:27:15.121524] [DEBUG] [LOCAL ] SNOW: Loaded 39579 existing records from primary storage. [2025-09-16T20:27:15.121693] [INFO ] [MAIN ] SNOW: Loaded 39579 existing records. [2025-09-16T20:27:15.297665] [WARN ] [MAIN ] SNOW: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:27:15.297919] [INFO ] [MAIN ] SNOW: Wiping existing primary data before full refresh. [2025-09-16T20:27:15.297965] [INFO ] [LOCAL ] SNOW: Starting deletion of primary data. [2025-09-16T20:27:15.298823] [DEBUG] [LOCAL ] SNOW: Deleted primary data file. [2025-09-16T20:27:15.298870] [INFO ] [MAIN ] SNOW: Starting full primary refresh. [2025-09-16T20:27:15.578221] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-05. [2025-09-16T20:27:15.669962] [INFO ] [REMOTE ] SNOW: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:27:15.698275] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-16T20:27:16.374935] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-08. [2025-09-16T20:27:16.635690] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-16T20:27:17.174913] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-05. [2025-09-16T20:27:17.675255] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-16T20:27:17.751403] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-16T20:27:17.974917] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-06. [2025-09-16T20:27:18.627348] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-16T20:27:18.774921] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-02. [2025-09-16T20:27:19.574927] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-06. [2025-09-16T20:27:19.951134] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-16T20:27:20.374954] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-07. [2025-09-16T20:27:20.816771] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-16T20:27:21.174883] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-03. [2025-09-16T20:27:21.214954] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-16T20:27:21.974908] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-07. [2025-09-16T20:27:22.774886] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-09. [2025-09-16T20:27:22.856936] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-09-16T20:27:23.065843] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-16T20:27:23.414453] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-16T20:27:23.574909] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-08. [2025-09-16T20:27:24.142964] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-16T20:27:24.148724] [INFO ] [REMOTE ] SNDR: Full fetch complete (44062 records). [2025-09-16T20:27:24.148985] [DEBUG] [VALIDATOR ] SNDR: Validating primary data. [2025-09-16T20:27:24.380549] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-08. [2025-09-16T20:27:24.528233] [DEBUG] [VALIDATOR ] SNDR: All expected trading days are present. [2025-09-16T20:27:24.528318] [DEBUG] [VALIDATOR ] SNDR: Primary data validation passed. [2025-09-16T20:27:24.529160] [INFO ] [MAIN ] SNDR: Fetched primary data is valid. [2025-09-16T20:27:24.529206] [DEBUG] [LOCAL ] SNDR: Saving primary data. [2025-09-16T20:27:24.530193] [DEBUG] [LOCAL ] SNDR: Trimmed 44062 records to 29750 (keeping 150 days of data) [2025-09-16T20:27:24.718510] [DEBUG] [LOCAL ] SNDR: Primary data saved (29750 records). [2025-09-16T20:27:24.718670] [INFO ] [MAIN ] SNDR: Full history saved. [2025-09-16T20:27:24.718772] [INFO ] [MAIN ] Update Progress: 1951/2369 symbols completed. SNDR took 29.5s. Estimated remaining: 44m 26s. Rate: 9.4 symbols/min [2025-09-16T20:27:24.890478] [INFO ] [MAIN ] SNV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:27:24.923668] [DEBUG] [LOCAL ] SNV: Loaded 35457 existing records from primary storage. [2025-09-16T20:27:24.923845] [INFO ] [MAIN ] SNV: Loaded 35457 existing records. [2025-09-16T20:27:25.104301] [WARN ] [MAIN ] SNV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:27:25.104597] [INFO ] [MAIN ] SNV: Wiping existing primary data before full refresh. [2025-09-16T20:27:25.104668] [INFO ] [LOCAL ] SNV: Starting deletion of primary data. [2025-09-16T20:27:25.105347] [DEBUG] [LOCAL ] SNV: Deleted primary data file. [2025-09-16T20:27:25.105391] [INFO ] [MAIN ] SNV: Starting full primary refresh. [2025-09-16T20:27:25.182289] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-04. [2025-09-16T20:27:25.479329] [INFO ] [REMOTE ] SNV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:27:25.509312] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-16T20:27:25.974909] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-02. [2025-09-16T20:27:26.715365] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-09-16T20:27:26.774906] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-09. [2025-09-16T20:27:27.574892] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-09. [2025-09-16T20:27:27.610807] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-16T20:27:27.652877] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-09-16T20:27:28.374946] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-03. [2025-09-16T20:27:29.054484] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-16T20:27:29.061658] [INFO ] [REMOTE ] SNAP: Full fetch complete (58475 records). [2025-09-16T20:27:29.061799] [DEBUG] [VALIDATOR ] SNAP: Validating primary data. [2025-09-16T20:27:29.180552] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-05. [2025-09-16T20:27:29.423565] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-16T20:27:29.474790] [INFO ] [REMOTE ] SNN: Full fetch complete (47962 records). [2025-09-16T20:27:29.474918] [DEBUG] [VALIDATOR ] SNAP: All expected trading days are present. [2025-09-16T20:27:29.475031] [DEBUG] [VALIDATOR ] SNN: Validating primary data. [2025-09-16T20:27:29.475069] [DEBUG] [VALIDATOR ] SNAP: Primary data validation passed. [2025-09-16T20:27:29.476089] [INFO ] [MAIN ] SNAP: Fetched primary data is valid. [2025-09-16T20:27:29.476262] [DEBUG] [LOCAL ] SNAP: Saving primary data. [2025-09-16T20:27:29.578964] [DEBUG] [LOCAL ] SNAP: Trimmed 58475 records to 40146 (keeping 150 days of data) [2025-09-16T20:27:29.974048] [DEBUG] [VALIDATOR ] SNN: All expected trading days are present. [2025-09-16T20:27:29.976795] [DEBUG] [VALIDATOR ] SNN: Primary data validation passed. [2025-09-16T20:27:29.979382] [INFO ] [MAIN ] SNN: Fetched primary data is valid. [2025-09-16T20:27:29.979470] [DEBUG] [LOCAL ] SNN: Saving primary data. [2025-09-16T20:27:29.988168] [DEBUG] [LOCAL ] SNN: Trimmed 47962 records to 33254 (keeping 150 days of data) [2025-09-16T20:27:30.328946] [DEBUG] [LOCAL ] SNN: Primary data saved (33254 records). [2025-09-16T20:27:30.330227] [INFO ] [MAIN ] SNN: Full history saved. [2025-09-16T20:27:30.337548] [INFO ] [MAIN ] Update Progress: 1952/2369 symbols completed. SNN took 22.6s. Estimated remaining: 44m 19s. Rate: 9.4 symbols/min [2025-09-16T20:27:30.458447] [DEBUG] [LOCAL ] SNAP: Primary data saved (40146 records). [2025-09-16T20:27:30.484282] [INFO ] [MAIN ] SNAP: Full history saved. [2025-09-16T20:27:30.489734] [INFO ] [MAIN ] Update Progress: 1953/2369 symbols completed. SNAP took 36.9s. Estimated remaining: 44m 11s. Rate: 9.4 symbols/min [2025-09-16T20:27:30.537602] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-16T20:27:30.579410] [INFO ] [MAIN ] SNX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:27:30.668057] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-04. [2025-09-16T20:27:30.761255] [INFO ] [MAIN ] SO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:27:30.761488] [DEBUG] [LOCAL ] SO: No existing data file found in primary storage. [2025-09-16T20:27:30.761531] [WARN ] [MAIN ] SO: No existing data found, performing full refresh instead. [2025-09-16T20:27:30.761692] [INFO ] [MAIN ] SO: Wiping existing primary data before full refresh. [2025-09-16T20:27:30.761744] [INFO ] [LOCAL ] SO: Starting deletion of primary data. [2025-09-16T20:27:30.761787] [DEBUG] [LOCAL ] SO: No primary data file found to delete. [2025-09-16T20:27:30.761820] [INFO ] [MAIN ] SO: Starting full primary refresh. [2025-09-16T20:27:30.873148] [DEBUG] [LOCAL ] SNX: Loaded 27621 existing records from primary storage. [2025-09-16T20:27:30.878951] [INFO ] [MAIN ] SNX: Loaded 27621 existing records. [2025-09-16T20:27:31.254666] [WARN ] [MAIN ] SNX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:27:31.270274] [INFO ] [MAIN ] SNX: Wiping existing primary data before full refresh. [2025-09-16T20:27:31.289414] [INFO ] [LOCAL ] SNX: Starting deletion of primary data. [2025-09-16T20:27:31.307094] [DEBUG] [LOCAL ] SNX: Deleted primary data file. [2025-09-16T20:27:31.321465] [INFO ] [MAIN ] SNX: Starting full primary refresh. [2025-09-16T20:27:31.358453] [INFO ] [REMOTE ] SO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:27:31.396738] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-02. [2025-09-16T20:27:31.686521] [INFO ] [REMOTE ] SNX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:27:31.686937] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-02. [2025-09-16T20:27:31.749050] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-05 (2.57 seconds). [2025-09-16T20:27:32.042283] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-16T20:27:32.374903] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-05. [2025-09-16T20:27:32.831305] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-16T20:27:33.174975] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-06. [2025-09-16T20:27:33.174898] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-16T20:27:33.974863] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-03. [2025-09-16T20:27:34.080877] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-16T20:27:34.774948] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-03. [2025-09-16T20:27:35.407455] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-16T20:27:35.574885] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-07. [2025-09-16T20:27:35.817831] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-16T20:27:36.374931] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-04. [2025-09-16T20:27:36.519968] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-16T20:27:37.174969] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-04. [2025-09-16T20:27:37.720195] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-16T20:27:37.974905] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-08. [2025-09-16T20:27:38.267437] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-16T20:27:38.774927] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-05. [2025-09-16T20:27:39.236194] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-16T20:27:39.574911] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-05. [2025-09-16T20:27:40.179384] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-16T20:27:40.240349] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-16T20:27:40.374966] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-09. [2025-09-16T20:27:40.689775] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-16T20:27:40.696782] [INFO ] [REMOTE ] SNOW: Full fetch complete (57860 records). [2025-09-16T20:27:40.696982] [DEBUG] [VALIDATOR ] SNOW: Validating primary data. [2025-09-16T20:27:40.697980] [FATAL] [VALIDATOR ] SNOW: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T20:27:40.698106] [FATAL] [MAIN ] SNOW: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:27:40.698179] [WARN ] [MAIN ] SNOW: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:27:40.698259] [INFO ] [LOCAL ] SNOW: Starting deletion of primary data. [2025-09-16T20:27:40.698344] [DEBUG] [LOCAL ] SNOW: No primary data file found to delete. [2025-09-16T20:27:40.698415] [INFO ] [LOCAL ] SNOW: Starting deletion of derivative data. [2025-09-16T20:27:40.698816] [DEBUG] [LOCAL ] SNOW: Deleted derivative data file. [2025-09-16T20:27:40.700344] [INFO ] [MAIN ] Update Progress: 1954/2369 symbols completed. SNOW took 25.8s. Estimated remaining: 44m 6s. Rate: 9.4 symbols/min [2025-09-16T20:27:40.884155] [INFO ] [MAIN ] SOBO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:27:40.913914] [DEBUG] [LOCAL ] SOBO: Loaded 28587 existing records from primary storage. [2025-09-16T20:27:40.914264] [INFO ] [MAIN ] SOBO: Loaded 28587 existing records. [2025-09-16T20:27:41.124812] [WARN ] [MAIN ] SOBO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:27:41.125050] [INFO ] [MAIN ] SOBO: Wiping existing primary data before full refresh. [2025-09-16T20:27:41.125094] [INFO ] [LOCAL ] SOBO: Starting deletion of primary data. [2025-09-16T20:27:41.125685] [DEBUG] [LOCAL ] SOBO: Deleted primary data file. [2025-09-16T20:27:41.125733] [INFO ] [MAIN ] SOBO: Starting full primary refresh. [2025-09-16T20:27:41.180084] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-06. [2025-09-16T20:27:41.492529] [INFO ] [REMOTE ] SOBO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:27:41.529594] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-16T20:27:41.974897] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-02. [2025-09-16T20:27:42.774910] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-06. [2025-09-16T20:27:42.802411] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-16T20:27:43.317482] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-16T20:27:43.574911] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-06. [2025-09-16T20:27:44.374937] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-03. [2025-09-16T20:27:44.520692] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-16T20:27:44.980854] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-16T20:27:45.174920] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-07. [2025-09-16T20:27:45.636336] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-16T20:27:45.974934] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-07. [2025-09-16T20:27:46.756998] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-16T20:27:46.774845] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-08. [2025-09-16T20:27:47.531909] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-16T20:27:47.574891] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-08. [2025-09-16T20:27:48.374915] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-07. [2025-09-16T20:27:48.711305] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-16T20:27:48.866871] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-16T20:27:49.174931] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-04. [2025-09-16T20:27:49.974896] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-09. [2025-09-16T20:27:50.053242] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-16T20:27:50.418848] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-16T20:27:50.774945] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-05. [2025-09-16T20:27:51.396297] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-16T20:27:51.400945] [INFO ] [REMOTE ] SNX: Full fetch complete (42558 records). [2025-09-16T20:27:51.401087] [DEBUG] [VALIDATOR ] SNX: Validating primary data. [2025-09-16T20:27:51.576584] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-09. [2025-09-16T20:27:51.787005] [DEBUG] [VALIDATOR ] SNX: All expected trading days are present. [2025-09-16T20:27:51.787094] [DEBUG] [VALIDATOR ] SNX: Primary data validation passed. [2025-09-16T20:27:51.788075] [INFO ] [MAIN ] SNX: Fetched primary data is valid. [2025-09-16T20:27:51.788162] [DEBUG] [LOCAL ] SNX: Saving primary data. [2025-09-16T20:27:51.789244] [DEBUG] [LOCAL ] SNX: Trimmed 42558 records to 27915 (keeping 150 days of data) [2025-09-16T20:27:51.982549] [DEBUG] [LOCAL ] SNX: Primary data saved (27915 records). [2025-09-16T20:27:51.982772] [INFO ] [MAIN ] SNX: Full history saved. [2025-09-16T20:27:51.983012] [INFO ] [MAIN ] Update Progress: 1955/2369 symbols completed. SNX took 21.6s. Estimated remaining: 44m 0s. Rate: 9.4 symbols/min [2025-09-16T20:27:52.187314] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-16T20:27:52.237228] [INFO ] [MAIN ] SOC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:27:52.275580] [DEBUG] [LOCAL ] SOC: Loaded 37427 existing records from primary storage. [2025-09-16T20:27:52.275746] [INFO ] [MAIN ] SOC: Loaded 37427 existing records. [2025-09-16T20:27:52.380065] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-06. [2025-09-16T20:27:52.463501] [WARN ] [MAIN ] SOC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:27:52.463904] [INFO ] [MAIN ] SOC: Wiping existing primary data before full refresh. [2025-09-16T20:27:52.464067] [INFO ] [LOCAL ] SOC: Starting deletion of primary data. [2025-09-16T20:27:52.469951] [DEBUG] [LOCAL ] SOC: Deleted primary data file. [2025-09-16T20:27:52.479604] [INFO ] [MAIN ] SOC: Starting full primary refresh. [2025-09-16T20:27:52.512592] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-16T20:27:52.588246] [INFO ] [REMOTE ] SO: Full fetch complete (57890 records). [2025-09-16T20:27:52.588784] [DEBUG] [VALIDATOR ] SO: Validating primary data. [2025-09-16T20:27:52.607044] [FATAL] [VALIDATOR ] SO: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T20:27:52.630130] [FATAL] [MAIN ] SO: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:27:52.639523] [WARN ] [MAIN ] SO: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:27:52.648438] [INFO ] [LOCAL ] SO: Starting deletion of primary data. [2025-09-16T20:27:52.649138] [DEBUG] [LOCAL ] SO: No primary data file found to delete. [2025-09-16T20:27:52.663467] [INFO ] [LOCAL ] SO: Starting deletion of derivative data. [2025-09-16T20:27:52.687203] [DEBUG] [LOCAL ] SO: No derivative data file found to delete. [2025-09-16T20:27:52.699598] [INFO ] [MAIN ] Update Progress: 1956/2369 symbols completed. SO took 22.2s. Estimated remaining: 43m 53s. Rate: 9.4 symbols/min [2025-09-16T20:27:53.041113] [INFO ] [MAIN ] SOJC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:27:53.046545] [INFO ] [REMOTE ] SOC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:27:53.051983] [DEBUG] [LOCAL ] SOJC: Loaded 3263 existing records from primary storage. [2025-09-16T20:27:53.052064] [INFO ] [MAIN ] SOJC: Loaded 3263 existing records. [2025-09-16T20:27:53.180043] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-02. [2025-09-16T20:27:53.230905] [WARN ] [MAIN ] SOJC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:27:53.231170] [INFO ] [MAIN ] SOJC: Wiping existing primary data before full refresh. [2025-09-16T20:27:53.231219] [INFO ] [LOCAL ] SOJC: Starting deletion of primary data. [2025-09-16T20:27:53.231427] [DEBUG] [LOCAL ] SOJC: Deleted primary data file. [2025-09-16T20:27:53.231473] [INFO ] [MAIN ] SOJC: Starting full primary refresh. [2025-09-16T20:27:53.609283] [INFO ] [REMOTE ] SOJC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:27:53.974906] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-02. [2025-09-16T20:27:54.055337] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-16T20:27:54.614207] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-16T20:27:54.774955] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-08. [2025-09-16T20:27:54.958300] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-16T20:27:55.574901] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-03. [2025-09-16T20:27:56.374954] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-07. [2025-09-16T20:27:56.658837] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-16T20:27:57.174935] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-09. [2025-09-16T20:27:57.349403] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-16T20:27:57.776053] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-16T20:27:57.974919] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-03. [2025-09-16T20:27:58.601124] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-16T20:27:58.608021] [INFO ] [REMOTE ] SNV: Full fetch complete (53215 records). [2025-09-16T20:27:58.608162] [DEBUG] [VALIDATOR ] SNV: Validating primary data. [2025-09-16T20:27:58.796337] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-08. [2025-09-16T20:27:58.899269] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-16T20:27:59.020707] [DEBUG] [VALIDATOR ] SNV: All expected trading days are present. [2025-09-16T20:27:59.020802] [DEBUG] [VALIDATOR ] SNV: Primary data validation passed. [2025-09-16T20:27:59.021807] [INFO ] [MAIN ] SNV: Fetched primary data is valid. [2025-09-16T20:27:59.021860] [DEBUG] [LOCAL ] SNV: Saving primary data. [2025-09-16T20:27:59.023190] [DEBUG] [LOCAL ] SNV: Trimmed 53215 records to 35827 (keeping 150 days of data) [2025-09-16T20:27:59.244682] [DEBUG] [LOCAL ] SNV: Primary data saved (35827 records). [2025-09-16T20:27:59.244827] [INFO ] [MAIN ] SNV: Full history saved. [2025-09-16T20:27:59.244941] [INFO ] [MAIN ] Update Progress: 1957/2369 symbols completed. SNV took 34.5s. Estimated remaining: 43m 47s. Rate: 9.4 symbols/min [2025-09-16T20:27:59.574939] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-04. [2025-09-16T20:28:00.216097] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-16T20:28:00.374860] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-09. [2025-09-16T20:28:01.174883] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-04. [2025-09-16T20:28:01.320410] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-16T20:28:01.799046] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-16T20:28:01.803754] [INFO ] [REMOTE ] SOBO: Full fetch complete (43605 records). [2025-09-16T20:28:01.803846] [DEBUG] [VALIDATOR ] SOBO: Validating primary data. [2025-09-16T20:28:01.976986] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-05. [2025-09-16T20:28:02.114330] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-16T20:28:02.185611] [DEBUG] [VALIDATOR ] SOBO: All expected trading days are present. [2025-09-16T20:28:02.185698] [DEBUG] [VALIDATOR ] SOBO: Primary data validation passed. [2025-09-16T20:28:02.186528] [INFO ] [MAIN ] SOBO: Fetched primary data is valid. [2025-09-16T20:28:02.186570] [DEBUG] [LOCAL ] SOBO: Saving primary data. [2025-09-16T20:28:02.187486] [DEBUG] [LOCAL ] SOBO: Trimmed 43605 records to 28826 (keeping 150 days of data) [2025-09-16T20:28:02.362326] [DEBUG] [LOCAL ] SOBO: Primary data saved (28826 records). [2025-09-16T20:28:02.362458] [INFO ] [MAIN ] SOBO: Full history saved. [2025-09-16T20:28:02.362560] [INFO ] [MAIN ] Update Progress: 1958/2369 symbols completed. SOBO took 21.7s. Estimated remaining: 43m 40s. Rate: 9.4 symbols/min [2025-09-16T20:28:02.774917] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-05. [2025-09-16T20:28:03.485093] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-16T20:28:03.574916] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-06. [2025-09-16T20:28:03.925042] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-16T20:28:04.276684] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-16T20:28:04.374912] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-07. [2025-09-16T20:28:05.113224] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-16T20:28:05.174982] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-08. [2025-09-16T20:28:05.877066] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-16T20:28:05.974964] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-09. [2025-09-16T20:28:06.575885] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-16T20:28:06.577313] [INFO ] [REMOTE ] SOJC: Full fetch complete (5545 records). [2025-09-16T20:28:06.577382] [DEBUG] [VALIDATOR ] SOJC: Validating primary data. [2025-09-16T20:28:06.795724] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-06. [2025-09-16T20:28:06.946579] [DEBUG] [VALIDATOR ] SOJC: All expected trading days are present. [2025-09-16T20:28:06.946682] [DEBUG] [VALIDATOR ] SOJC: Primary data validation passed. [2025-09-16T20:28:06.946855] [INFO ] [MAIN ] SOJC: Fetched primary data is valid. [2025-09-16T20:28:06.946895] [DEBUG] [LOCAL ] SOJC: Saving primary data. [2025-09-16T20:28:06.947272] [DEBUG] [LOCAL ] SOJC: Trimmed 5545 records to 3394 (keeping 150 days of data) [2025-09-16T20:28:06.967926] [DEBUG] [LOCAL ] SOJC: Primary data saved (3394 records). [2025-09-16T20:28:06.968021] [INFO ] [MAIN ] SOJC: Full history saved. [2025-09-16T20:28:06.968117] [INFO ] [MAIN ] Update Progress: 1959/2369 symbols completed. SOJC took 14.3s. Estimated remaining: 43m 33s. Rate: 9.4 symbols/min [2025-09-16T20:28:08.638368] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-16T20:28:08.649107] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-07. [2025-09-16T20:28:10.574276] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-16T20:28:10.585482] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-08. [2025-09-16T20:28:12.318822] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-16T20:28:12.329580] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-09. [2025-09-16T20:28:14.164548] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-16T20:28:14.171159] [INFO ] [REMOTE ] SOC: Full fetch complete (54374 records). [2025-09-16T20:28:14.171296] [DEBUG] [VALIDATOR ] SOC: Validating primary data. [2025-09-16T20:28:14.566922] [DEBUG] [VALIDATOR ] SOC: All expected trading days are present. [2025-09-16T20:28:14.567007] [DEBUG] [VALIDATOR ] SOC: Primary data validation passed. [2025-09-16T20:28:14.568038] [INFO ] [MAIN ] SOC: Fetched primary data is valid. [2025-09-16T20:28:14.568132] [DEBUG] [LOCAL ] SOC: Saving primary data. [2025-09-16T20:28:14.569329] [DEBUG] [LOCAL ] SOC: Trimmed 54374 records to 37811 (keeping 150 days of data) [2025-09-16T20:28:14.799546] [DEBUG] [LOCAL ] SOC: Primary data saved (37811 records). [2025-09-16T20:28:14.799707] [INFO ] [MAIN ] SOC: Full history saved. [2025-09-16T20:28:14.799795] [INFO ] [MAIN ] Update Progress: 1960/2369 symbols completed. SOC took 22.8s. Estimated remaining: 43m 27s. Rate: 9.4 symbols/min [2025-09-16T20:28:15.392780] [INFO ] [MAIN ] SOJE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:28:15.395614] [INFO ] [MAIN ] SOL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:28:15.469347] [INFO ] [MAIN ] SOJD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:28:15.498611] [INFO ] [MAIN ] SOJF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:28:15.508745] [DEBUG] [LOCAL ] SOL: Loaded 9596 existing records from primary storage. [2025-09-16T20:28:15.509010] [DEBUG] [LOCAL ] SOJE: Loaded 6610 existing records from primary storage. [2025-09-16T20:28:15.509264] [INFO ] [MAIN ] SOJE: Loaded 6610 existing records. [2025-09-16T20:28:15.509317] [INFO ] [MAIN ] SOL: Loaded 9596 existing records. [2025-09-16T20:28:15.708921] [DEBUG] [LOCAL ] SOJF: Loaded 5906 existing records from primary storage. [2025-09-16T20:28:15.708992] [DEBUG] [LOCAL ] SOJD: Loaded 9165 existing records from primary storage. [2025-09-16T20:28:15.730923] [INFO ] [MAIN ] SOJD: Loaded 9165 existing records. [2025-09-16T20:28:15.731008] [INFO ] [MAIN ] SOJF: Loaded 5906 existing records. [2025-09-16T20:28:16.002001] [WARN ] [MAIN ] SOL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:28:16.018837] [WARN ] [MAIN ] SOJE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:28:16.055038] [INFO ] [MAIN ] SOJE: Wiping existing primary data before full refresh. [2025-09-16T20:28:16.080063] [INFO ] [LOCAL ] SOJE: Starting deletion of primary data. [2025-09-16T20:28:16.071506] [INFO ] [MAIN ] SOL: Wiping existing primary data before full refresh. [2025-09-16T20:28:16.108706] [DEBUG] [LOCAL ] SOJE: Deleted primary data file. [2025-09-16T20:28:16.119132] [INFO ] [LOCAL ] SOL: Starting deletion of primary data. [2025-09-16T20:28:16.119083] [INFO ] [MAIN ] SOJE: Starting full primary refresh. [2025-09-16T20:28:16.186454] [DEBUG] [LOCAL ] SOL: Deleted primary data file. [2025-09-16T20:28:16.186387] [WARN ] [MAIN ] SOJF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:28:16.273336] [INFO ] [MAIN ] SOL: Starting full primary refresh. [2025-09-16T20:28:16.288831] [INFO ] [MAIN ] SOJF: Wiping existing primary data before full refresh. [2025-09-16T20:28:16.312730] [WARN ] [MAIN ] SOJD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:28:16.343672] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-09-16T20:28:16.374567] [DEBUG] [LOCAL ] SOJF: Deleted primary data file. [2025-09-16T20:28:16.418844] [INFO ] [MAIN ] SOJD: Wiping existing primary data before full refresh. [2025-09-16T20:28:16.424060] [INFO ] [MAIN ] SOJF: Starting full primary refresh. [2025-09-16T20:28:16.434374] [INFO ] [LOCAL ] SOJD: Starting deletion of primary data. [2025-09-16T20:28:16.449503] [DEBUG] [LOCAL ] SOJD: Deleted primary data file. [2025-09-16T20:28:16.473935] [INFO ] [MAIN ] SOJD: Starting full primary refresh. [2025-09-16T20:28:17.263523] [INFO ] [REMOTE ] SOJE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:28:17.323362] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-02. [2025-09-16T20:28:17.499131] [INFO ] [REMOTE ] SOL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:28:17.509881] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-02. [2025-09-16T20:28:17.593474] [INFO ] [REMOTE ] SOJF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:28:17.604120] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-02. [2025-09-16T20:28:17.670283] [INFO ] [REMOTE ] SOJD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:28:17.670554] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-02. [2025-09-16T20:28:18.343555] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-16T20:28:18.345940] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-03. [2025-09-16T20:28:18.484862] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-16T20:28:18.488192] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-03. [2025-09-16T20:28:18.494737] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-16T20:28:18.497305] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-03. [2025-09-16T20:28:18.582670] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-16T20:28:18.585828] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-03. [2025-09-16T20:28:19.253120] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-16T20:28:19.256311] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-04. [2025-09-16T20:28:19.335152] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-16T20:28:19.337901] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-04. [2025-09-16T20:28:19.414740] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-16T20:28:19.417987] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-04. [2025-09-16T20:28:19.648781] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-16T20:28:19.653071] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-04. [2025-09-16T20:28:20.079987] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-16T20:28:20.082715] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-05. [2025-09-16T20:28:20.097549] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-16T20:28:20.155544] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-16T20:28:20.369113] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-16T20:28:20.374834] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-05. [2025-09-16T20:28:20.933536] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-16T20:28:21.174946] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-05. [2025-09-16T20:28:21.303444] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-16T20:28:21.929207] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-16T20:28:21.974902] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-05. [2025-09-16T20:28:22.774900] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-06. [2025-09-16T20:28:23.023093] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-16T20:28:23.574871] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-06. [2025-09-16T20:28:23.884135] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-16T20:28:24.143328] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-16T20:28:24.374905] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-06. [2025-09-16T20:28:25.174906] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-06. [2025-09-16T20:28:25.212208] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-16T20:28:25.974910] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-07. [2025-09-16T20:28:26.104268] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-16T20:28:26.774898] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-07. [2025-09-16T20:28:26.796497] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-16T20:28:27.574885] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-07. [2025-09-16T20:28:27.649998] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-16T20:28:28.374892] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-08. [2025-09-16T20:28:28.675136] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-16T20:28:29.024385] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-16T20:28:29.174914] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-08. [2025-09-16T20:28:29.974913] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-09. [2025-09-16T20:28:30.011183] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-16T20:28:30.689471] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-16T20:28:30.691019] [INFO ] [REMOTE ] SOJF: Full fetch complete (9643 records). [2025-09-16T20:28:30.691126] [DEBUG] [VALIDATOR ] SOJF: Validating primary data. [2025-09-16T20:28:30.780039] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-07. [2025-09-16T20:28:31.066471] [DEBUG] [VALIDATOR ] SOJF: All expected trading days are present. [2025-09-16T20:28:31.066552] [DEBUG] [VALIDATOR ] SOJF: Primary data validation passed. [2025-09-16T20:28:31.066825] [INFO ] [MAIN ] SOJF: Fetched primary data is valid. [2025-09-16T20:28:31.066869] [DEBUG] [LOCAL ] SOJF: Saving primary data. [2025-09-16T20:28:31.067344] [DEBUG] [LOCAL ] SOJF: Trimmed 9643 records to 5968 (keeping 150 days of data) [2025-09-16T20:28:31.103788] [DEBUG] [LOCAL ] SOJF: Primary data saved (5968 records). [2025-09-16T20:28:31.103907] [INFO ] [MAIN ] SOJF: Full history saved. [2025-09-16T20:28:31.104005] [INFO ] [MAIN ] Update Progress: 1961/2369 symbols completed. SOJF took 16.3s. Estimated remaining: 43m 22s. Rate: 9.4 symbols/min [2025-09-16T20:28:31.275720] [INFO ] [MAIN ] SOLV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:28:31.308003] [DEBUG] [LOCAL ] SOLV: Loaded 32001 existing records from primary storage. [2025-09-16T20:28:31.308173] [INFO ] [MAIN ] SOLV: Loaded 32001 existing records. [2025-09-16T20:28:31.482894] [WARN ] [MAIN ] SOLV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:28:31.483127] [INFO ] [MAIN ] SOLV: Wiping existing primary data before full refresh. [2025-09-16T20:28:31.483170] [INFO ] [LOCAL ] SOLV: Starting deletion of primary data. [2025-09-16T20:28:31.483789] [DEBUG] [LOCAL ] SOLV: Deleted primary data file. [2025-09-16T20:28:31.483837] [INFO ] [MAIN ] SOLV: Starting full primary refresh. [2025-09-16T20:28:31.580741] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-08. [2025-09-16T20:28:31.843180] [INFO ] [REMOTE ] SOLV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:28:31.894946] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-16T20:28:32.374914] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-02. [2025-09-16T20:28:32.507418] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-16T20:28:33.174906] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-09. [2025-09-16T20:28:33.691095] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-16T20:28:33.956609] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-16T20:28:33.958376] [INFO ] [REMOTE ] SOL: Full fetch complete (14967 records). [2025-09-16T20:28:33.958442] [DEBUG] [VALIDATOR ] SOL: Validating primary data. [2025-09-16T20:28:33.980012] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-09. [2025-09-16T20:28:34.323467] [DEBUG] [VALIDATOR ] SOL: All expected trading days are present. [2025-09-16T20:28:34.323555] [DEBUG] [VALIDATOR ] SOL: Primary data validation passed. [2025-09-16T20:28:34.323934] [INFO ] [MAIN ] SOL: Fetched primary data is valid. [2025-09-16T20:28:34.323977] [DEBUG] [LOCAL ] SOL: Saving primary data. [2025-09-16T20:28:34.324439] [DEBUG] [LOCAL ] SOL: Trimmed 14967 records to 9672 (keeping 150 days of data) [2025-09-16T20:28:34.378583] [DEBUG] [LOCAL ] SOL: Primary data saved (9672 records). [2025-09-16T20:28:34.378749] [INFO ] [MAIN ] SOL: Full history saved. [2025-09-16T20:28:34.378853] [INFO ] [MAIN ] Update Progress: 1962/2369 symbols completed. SOL took 19.6s. Estimated remaining: 43m 15s. Rate: 9.4 symbols/min [2025-09-16T20:28:34.548099] [INFO ] [MAIN ] SON: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:28:34.578545] [DEBUG] [LOCAL ] SON: Loaded 31361 existing records from primary storage. [2025-09-16T20:28:34.578708] [INFO ] [MAIN ] SON: Loaded 31361 existing records. [2025-09-16T20:28:34.787904] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-08. [2025-09-16T20:28:34.793879] [WARN ] [MAIN ] SON: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:28:34.794116] [INFO ] [MAIN ] SON: Wiping existing primary data before full refresh. [2025-09-16T20:28:34.794165] [INFO ] [LOCAL ] SON: Starting deletion of primary data. [2025-09-16T20:28:34.794900] [DEBUG] [LOCAL ] SON: Deleted primary data file. [2025-09-16T20:28:34.794967] [INFO ] [MAIN ] SON: Starting full primary refresh. [2025-09-16T20:28:34.880325] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-16T20:28:34.907472] [INFO ] [REMOTE ] SOJE: Full fetch complete (10328 records). [2025-09-16T20:28:34.923487] [DEBUG] [VALIDATOR ] SOJE: Validating primary data. [2025-09-16T20:28:35.401946] [INFO ] [REMOTE ] SON: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:28:35.536386] [DEBUG] [VALIDATOR ] SOJE: All expected trading days are present. [2025-09-16T20:28:35.536463] [DEBUG] [VALIDATOR ] SOJE: Primary data validation passed. [2025-09-16T20:28:35.536707] [INFO ] [MAIN ] SOJE: Fetched primary data is valid. [2025-09-16T20:28:35.536750] [DEBUG] [LOCAL ] SOJE: Saving primary data. [2025-09-16T20:28:35.537163] [DEBUG] [LOCAL ] SOJE: Trimmed 10328 records to 6675 (keeping 150 days of data) [2025-09-16T20:28:35.577730] [DEBUG] [LOCAL ] SOJE: Primary data saved (6675 records). [2025-09-16T20:28:35.577838] [INFO ] [MAIN ] SOJE: Full history saved. [2025-09-16T20:28:35.577585] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-03. [2025-09-16T20:28:35.578729] [INFO ] [MAIN ] Update Progress: 1963/2369 symbols completed. SOJE took 20.8s. Estimated remaining: 43m 8s. Rate: 9.4 symbols/min [2025-09-16T20:28:35.754205] [INFO ] [MAIN ] SONY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:28:35.762890] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-16T20:28:35.802983] [DEBUG] [LOCAL ] SONY: Loaded 39389 existing records from primary storage. [2025-09-16T20:28:35.803133] [INFO ] [MAIN ] SONY: Loaded 39389 existing records. [2025-09-16T20:28:35.979311] [WARN ] [MAIN ] SONY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:28:35.979562] [INFO ] [MAIN ] SONY: Wiping existing primary data before full refresh. [2025-09-16T20:28:35.979610] [INFO ] [LOCAL ] SONY: Starting deletion of primary data. [2025-09-16T20:28:35.980432] [DEBUG] [LOCAL ] SONY: Deleted primary data file. [2025-09-16T20:28:35.980481] [INFO ] [MAIN ] SONY: Starting full primary refresh. [2025-09-16T20:28:36.342776] [INFO ] [REMOTE ] SONY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:28:36.374871] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-02. [2025-09-16T20:28:37.174948] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-02. [2025-09-16T20:28:37.435371] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-16T20:28:37.974962] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-04. [2025-09-16T20:28:38.143132] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-16T20:28:38.730633] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-16T20:28:38.774847] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-03. [2025-09-16T20:28:39.574899] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-03. [2025-09-16T20:28:39.762121] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-16T20:28:40.374904] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-05. [2025-09-16T20:28:40.486359] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-16T20:28:41.174881] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-09. [2025-09-16T20:28:41.657029] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-16T20:28:41.928036] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-16T20:28:41.929805] [INFO ] [REMOTE ] SOJD: Full fetch complete (14310 records). [2025-09-16T20:28:41.929887] [DEBUG] [VALIDATOR ] SOJD: Validating primary data. [2025-09-16T20:28:41.984009] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-04. [2025-09-16T20:28:42.315589] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-16T20:28:42.350123] [DEBUG] [VALIDATOR ] SOJD: All expected trading days are present. [2025-09-16T20:28:42.350486] [DEBUG] [VALIDATOR ] SOJD: Primary data validation passed. [2025-09-16T20:28:42.351119] [INFO ] [MAIN ] SOJD: Fetched primary data is valid. [2025-09-16T20:28:42.351205] [DEBUG] [LOCAL ] SOJD: Saving primary data. [2025-09-16T20:28:42.352434] [DEBUG] [LOCAL ] SOJD: Trimmed 14310 records to 9281 (keeping 150 days of data) [2025-09-16T20:28:42.412690] [DEBUG] [LOCAL ] SOJD: Primary data saved (9281 records). [2025-09-16T20:28:42.412858] [INFO ] [MAIN ] SOJD: Full history saved. [2025-09-16T20:28:42.412956] [INFO ] [MAIN ] Update Progress: 1964/2369 symbols completed. SOJD took 27.6s. Estimated remaining: 43m 2s. Rate: 9.4 symbols/min [2025-09-16T20:28:42.584186] [INFO ] [MAIN ] SOR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:28:42.588193] [DEBUG] [LOCAL ] SOR: Loaded 2158 existing records from primary storage. [2025-09-16T20:28:42.588270] [INFO ] [MAIN ] SOR: Loaded 2158 existing records. [2025-09-16T20:28:42.764057] [WARN ] [MAIN ] SOR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:28:42.764360] [INFO ] [MAIN ] SOR: Wiping existing primary data before full refresh. [2025-09-16T20:28:42.764429] [INFO ] [LOCAL ] SOR: Starting deletion of primary data. [2025-09-16T20:28:42.764752] [DEBUG] [LOCAL ] SOR: Deleted primary data file. [2025-09-16T20:28:42.764824] [INFO ] [MAIN ] SOR: Starting full primary refresh. [2025-09-16T20:28:42.780037] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-04. [2025-09-16T20:28:43.142396] [INFO ] [REMOTE ] SOR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:28:43.574974] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-06. [2025-09-16T20:28:43.728920] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-16T20:28:44.374954] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-02. [2025-09-16T20:28:44.956502] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-16T20:28:45.107109] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-16T20:28:45.141071] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-16T20:28:45.174847] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-07. [2025-09-16T20:28:45.974924] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-05. [2025-09-16T20:28:46.763993] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-16T20:28:46.774845] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-08. [2025-09-16T20:28:47.574939] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-03. [2025-09-16T20:28:47.640693] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-16T20:28:48.146417] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-16T20:28:48.374938] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-06. [2025-09-16T20:28:48.513090] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-16T20:28:49.174917] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-04. [2025-09-16T20:28:49.784406] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-16T20:28:49.974877] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-05. [2025-09-16T20:28:49.997027] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-16T20:28:50.603356] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-16T20:28:50.774864] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-07. [2025-09-16T20:28:51.574918] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-06. [2025-09-16T20:28:52.196211] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-16T20:28:52.374937] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-07. [2025-09-16T20:28:52.556044] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-16T20:28:52.846163] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-16T20:28:53.174956] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-05. [2025-09-16T20:28:53.974943] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-08. [2025-09-16T20:28:54.774870] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-09. [2025-09-16T20:28:55.335045] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-16T20:28:55.378462] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-16T20:28:55.574900] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-06. [2025-09-16T20:28:56.274730] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-16T20:28:56.280341] [INFO ] [REMOTE ] SOLV: Full fetch complete (48074 records). [2025-09-16T20:28:56.280440] [DEBUG] [VALIDATOR ] SOLV: Validating primary data. [2025-09-16T20:28:56.380717] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-08. [2025-09-16T20:28:56.656881] [DEBUG] [VALIDATOR ] SOLV: All expected trading days are present. [2025-09-16T20:28:56.656961] [DEBUG] [VALIDATOR ] SOLV: Primary data validation passed. [2025-09-16T20:28:56.657717] [INFO ] [MAIN ] SOLV: Fetched primary data is valid. [2025-09-16T20:28:56.657762] [DEBUG] [LOCAL ] SOLV: Saving primary data. [2025-09-16T20:28:56.658729] [DEBUG] [LOCAL ] SOLV: Trimmed 48074 records to 32331 (keeping 150 days of data) [2025-09-16T20:28:56.857578] [DEBUG] [LOCAL ] SOLV: Primary data saved (32331 records). [2025-09-16T20:28:56.857738] [INFO ] [MAIN ] SOLV: Full history saved. [2025-09-16T20:28:56.857845] [INFO ] [MAIN ] Update Progress: 1965/2369 symbols completed. SOLV took 25.8s. Estimated remaining: 42m 57s. Rate: 9.4 symbols/min [2025-09-16T20:28:57.029593] [INFO ] [MAIN ] SOS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:28:57.033611] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-16T20:28:57.043352] [DEBUG] [LOCAL ] SOS: Loaded 6737 existing records from primary storage. [2025-09-16T20:28:57.043452] [INFO ] [MAIN ] SOS: Loaded 6737 existing records. [2025-09-16T20:28:57.188837] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-09. [2025-09-16T20:28:57.230102] [WARN ] [MAIN ] SOS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:28:57.230422] [INFO ] [MAIN ] SOS: Wiping existing primary data before full refresh. [2025-09-16T20:28:57.230471] [INFO ] [LOCAL ] SOS: Starting deletion of primary data. [2025-09-16T20:28:57.230765] [DEBUG] [LOCAL ] SOS: Deleted primary data file. [2025-09-16T20:28:57.230814] [INFO ] [MAIN ] SOS: Starting full primary refresh. [2025-09-16T20:28:57.686741] [INFO ] [REMOTE ] SOS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:28:57.733289] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-16T20:28:57.813283] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-16T20:28:57.814877] [INFO ] [REMOTE ] SOR: Full fetch complete (3174 records). [2025-09-16T20:28:57.814975] [DEBUG] [VALIDATOR ] SOR: Validating primary data. [2025-09-16T20:28:57.980084] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-02. [2025-09-16T20:28:58.333247] [DEBUG] [VALIDATOR ] SOR: All expected trading days are present. [2025-09-16T20:28:58.333336] [DEBUG] [VALIDATOR ] SOR: Primary data validation passed. [2025-09-16T20:28:58.333479] [INFO ] [MAIN ] SOR: Fetched primary data is valid. [2025-09-16T20:28:58.333522] [DEBUG] [LOCAL ] SOR: Saving primary data. [2025-09-16T20:28:58.333977] [DEBUG] [LOCAL ] SOR: Trimmed 3174 records to 2187 (keeping 150 days of data) [2025-09-16T20:28:58.349878] [DEBUG] [LOCAL ] SOR: Primary data saved (2187 records). [2025-09-16T20:28:58.350037] [INFO ] [MAIN ] SOR: Full history saved. [2025-09-16T20:28:58.350144] [INFO ] [MAIN ] Update Progress: 1966/2369 symbols completed. SOR took 15.9s. Estimated remaining: 42m 50s. Rate: 9.4 symbols/min [2025-09-16T20:28:58.532910] [INFO ] [MAIN ] SPB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:28:58.560520] [DEBUG] [LOCAL ] SPB: Loaded 26023 existing records from primary storage. [2025-09-16T20:28:58.560723] [INFO ] [MAIN ] SPB: Loaded 26023 existing records. [2025-09-16T20:28:58.735937] [WARN ] [MAIN ] SPB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:28:58.736165] [INFO ] [MAIN ] SPB: Wiping existing primary data before full refresh. [2025-09-16T20:28:58.736214] [INFO ] [LOCAL ] SPB: Starting deletion of primary data. [2025-09-16T20:28:58.736843] [DEBUG] [LOCAL ] SPB: Deleted primary data file. [2025-09-16T20:28:58.736891] [INFO ] [MAIN ] SPB: Starting full primary refresh. [2025-09-16T20:28:58.780018] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-09. [2025-09-16T20:28:58.834511] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-16T20:28:59.099185] [INFO ] [REMOTE ] SPB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:28:59.574925] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-02. [2025-09-16T20:29:00.279929] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-16T20:29:00.285576] [INFO ] [REMOTE ] SON: Full fetch complete (46760 records). [2025-09-16T20:29:00.285734] [DEBUG] [VALIDATOR ] SON: Validating primary data. [2025-09-16T20:29:00.381696] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-07. [2025-09-16T20:29:00.682146] [DEBUG] [VALIDATOR ] SON: All expected trading days are present. [2025-09-16T20:29:00.682243] [DEBUG] [VALIDATOR ] SON: Primary data validation passed. [2025-09-16T20:29:00.683133] [INFO ] [MAIN ] SON: Fetched primary data is valid. [2025-09-16T20:29:00.683197] [DEBUG] [LOCAL ] SON: Saving primary data. [2025-09-16T20:29:00.684400] [DEBUG] [LOCAL ] SON: Trimmed 46760 records to 31708 (keeping 150 days of data) [2025-09-16T20:29:00.881352] [DEBUG] [LOCAL ] SON: Primary data saved (31708 records). [2025-09-16T20:29:00.881558] [INFO ] [MAIN ] SON: Full history saved. [2025-09-16T20:29:00.881691] [INFO ] [MAIN ] Update Progress: 1967/2369 symbols completed. SON took 26.5s. Estimated remaining: 42m 42s. Rate: 9.4 symbols/min [2025-09-16T20:29:01.073912] [INFO ] [MAIN ] SPCE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:29:01.085478] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-16T20:29:01.127079] [DEBUG] [LOCAL ] SPCE: Loaded 36680 existing records from primary storage. [2025-09-16T20:29:01.127237] [INFO ] [MAIN ] SPCE: Loaded 36680 existing records. [2025-09-16T20:29:01.185598] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-03. [2025-09-16T20:29:01.339271] [WARN ] [MAIN ] SPCE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:29:01.339593] [INFO ] [MAIN ] SPCE: Wiping existing primary data before full refresh. [2025-09-16T20:29:01.339661] [INFO ] [LOCAL ] SPCE: Starting deletion of primary data. [2025-09-16T20:29:01.340328] [DEBUG] [LOCAL ] SPCE: Deleted primary data file. [2025-09-16T20:29:01.340375] [INFO ] [MAIN ] SPCE: Starting full primary refresh. [2025-09-16T20:29:01.699886] [INFO ] [REMOTE ] SPCE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:29:01.810301] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-16T20:29:01.974915] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-03. [2025-09-16T20:29:02.742623] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-09-16T20:29:02.774873] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-08. [2025-09-16T20:29:03.444717] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-16T20:29:03.574926] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-02. [2025-09-16T20:29:04.374922] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-04. [2025-09-16T20:29:04.895580] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-16T20:29:05.174918] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-09. [2025-09-16T20:29:05.592288] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-16T20:29:05.658945] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-16T20:29:05.974957] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-05. [2025-09-16T20:29:06.699853] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-16T20:29:06.706159] [INFO ] [REMOTE ] SONY: Full fetch complete (58015 records). [2025-09-16T20:29:06.706291] [DEBUG] [VALIDATOR ] SONY: Validating primary data. [2025-09-16T20:29:06.781544] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-04. [2025-09-16T20:29:07.096344] [DEBUG] [VALIDATOR ] SONY: All expected trading days are present. [2025-09-16T20:29:07.096425] [DEBUG] [VALIDATOR ] SONY: Primary data validation passed. [2025-09-16T20:29:07.097442] [INFO ] [MAIN ] SONY: Fetched primary data is valid. [2025-09-16T20:29:07.097496] [DEBUG] [LOCAL ] SONY: Saving primary data. [2025-09-16T20:29:07.098812] [DEBUG] [LOCAL ] SONY: Trimmed 58015 records to 39777 (keeping 150 days of data) [2025-09-16T20:29:07.335222] [DEBUG] [LOCAL ] SONY: Primary data saved (39777 records). [2025-09-16T20:29:07.335347] [INFO ] [MAIN ] SONY: Full history saved. [2025-09-16T20:29:07.336825] [INFO ] [MAIN ] Update Progress: 1968/2369 symbols completed. SONY took 31.8s. Estimated remaining: 42m 36s. Rate: 9.4 symbols/min [2025-09-16T20:29:07.440131] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-16T20:29:07.509461] [INFO ] [MAIN ] SPE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:29:07.516604] [DEBUG] [LOCAL ] SPE: Loaded 4390 existing records from primary storage. [2025-09-16T20:29:07.516747] [INFO ] [MAIN ] SPE: Loaded 4390 existing records. [2025-09-16T20:29:07.579700] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-05. [2025-09-16T20:29:07.713658] [WARN ] [MAIN ] SPE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:29:07.714367] [INFO ] [MAIN ] SPE: Wiping existing primary data before full refresh. [2025-09-16T20:29:07.715281] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-16T20:29:07.714430] [INFO ] [LOCAL ] SPE: Starting deletion of primary data. [2025-09-16T20:29:07.723015] [DEBUG] [LOCAL ] SPE: Deleted primary data file. [2025-09-16T20:29:07.723067] [INFO ] [MAIN ] SPE: Starting full primary refresh. [2025-09-16T20:29:08.072823] [INFO ] [REMOTE ] SPE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:29:08.374869] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-06. [2025-09-16T20:29:08.379966] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-16T20:29:09.174899] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-02. [2025-09-16T20:29:09.913507] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-16T20:29:09.927124] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-16T20:29:09.974837] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-07. [2025-09-16T20:29:10.774925] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-03. [2025-09-16T20:29:11.547120] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-16T20:29:11.574869] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-08. [2025-09-16T20:29:12.374867] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-03. [2025-09-16T20:29:12.681170] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-16T20:29:13.034535] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-16T20:29:13.058042] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-16T20:29:13.174885] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-06. [2025-09-16T20:29:13.746342] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-16T20:29:13.974894] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-07. [2025-09-16T20:29:14.774930] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-09. [2025-09-16T20:29:15.574906] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-04. [2025-09-16T20:29:15.838401] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-16T20:29:16.088173] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-16T20:29:16.092035] [INFO ] [REMOTE ] SPB: Full fetch complete (36866 records). [2025-09-16T20:29:16.092117] [DEBUG] [VALIDATOR ] SPB: Validating primary data. [2025-09-16T20:29:16.379858] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-08. [2025-09-16T20:29:16.483453] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-16T20:29:16.488097] [DEBUG] [VALIDATOR ] SPB: All expected trading days are present. [2025-09-16T20:29:16.488503] [DEBUG] [VALIDATOR ] SPB: Primary data validation passed. [2025-09-16T20:29:16.489543] [INFO ] [MAIN ] SPB: Fetched primary data is valid. [2025-09-16T20:29:16.489611] [DEBUG] [LOCAL ] SPB: Saving primary data. [2025-09-16T20:29:16.490781] [DEBUG] [LOCAL ] SPB: Trimmed 36866 records to 26255 (keeping 150 days of data) [2025-09-16T20:29:16.653864] [DEBUG] [LOCAL ] SPB: Primary data saved (26255 records). [2025-09-16T20:29:16.654026] [INFO ] [MAIN ] SPB: Full history saved. [2025-09-16T20:29:16.654128] [INFO ] [MAIN ] Update Progress: 1969/2369 symbols completed. SPB took 18.3s. Estimated remaining: 42m 30s. Rate: 9.4 symbols/min [2025-09-16T20:29:16.835995] [INFO ] [MAIN ] SPG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:29:16.874936] [DEBUG] [LOCAL ] SPG: Loaded 37013 existing records from primary storage. [2025-09-16T20:29:16.875128] [INFO ] [MAIN ] SPG: Loaded 37013 existing records. [2025-09-16T20:29:17.067141] [WARN ] [MAIN ] SPG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:29:17.067442] [INFO ] [MAIN ] SPG: Wiping existing primary data before full refresh. [2025-09-16T20:29:17.067492] [INFO ] [LOCAL ] SPG: Starting deletion of primary data. [2025-09-16T20:29:17.068415] [DEBUG] [LOCAL ] SPG: Deleted primary data file. [2025-09-16T20:29:17.068469] [INFO ] [MAIN ] SPG: Starting full primary refresh. [2025-09-16T20:29:17.180119] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-04. [2025-09-16T20:29:17.421066] [INFO ] [REMOTE ] SPG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:29:17.518936] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-16T20:29:17.974916] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-02. [2025-09-16T20:29:18.774882] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-05. [2025-09-16T20:29:19.399102] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-16T20:29:19.429605] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-16T20:29:19.574899] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-09. [2025-09-16T20:29:19.730918] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-16T20:29:20.374898] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-03. [2025-09-16T20:29:20.502845] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-16T20:29:20.505208] [INFO ] [REMOTE ] SOS: Full fetch complete (7701 records). [2025-09-16T20:29:20.505277] [DEBUG] [VALIDATOR ] SOS: Validating primary data. [2025-09-16T20:29:20.865144] [DEBUG] [VALIDATOR ] SOS: All expected trading days are present. [2025-09-16T20:29:20.865222] [DEBUG] [VALIDATOR ] SOS: Primary data validation passed. [2025-09-16T20:29:20.865429] [INFO ] [MAIN ] SOS: Fetched primary data is valid. [2025-09-16T20:29:20.865468] [DEBUG] [LOCAL ] SOS: Saving primary data. [2025-09-16T20:29:20.865907] [DEBUG] [LOCAL ] SOS: Trimmed 7701 records to 6828 (keeping 150 days of data) [2025-09-16T20:29:20.905801] [DEBUG] [LOCAL ] SOS: Primary data saved (6828 records). [2025-09-16T20:29:20.905952] [INFO ] [MAIN ] SOS: Full history saved. [2025-09-16T20:29:20.906058] [INFO ] [MAIN ] Update Progress: 1970/2369 symbols completed. SOS took 24.0s. Estimated remaining: 42m 23s. Rate: 9.4 symbols/min [2025-09-16T20:29:21.083214] [INFO ] [MAIN ] SPGI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:29:21.118454] [DEBUG] [LOCAL ] SPGI: Loaded 32885 existing records from primary storage. [2025-09-16T20:29:21.118609] [INFO ] [MAIN ] SPGI: Loaded 32885 existing records. [2025-09-16T20:29:21.182611] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-06. [2025-09-16T20:29:21.302745] [WARN ] [MAIN ] SPGI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:29:21.302999] [INFO ] [MAIN ] SPGI: Wiping existing primary data before full refresh. [2025-09-16T20:29:21.303061] [INFO ] [LOCAL ] SPGI: Starting deletion of primary data. [2025-09-16T20:29:21.304052] [DEBUG] [LOCAL ] SPGI: Deleted primary data file. [2025-09-16T20:29:21.304120] [INFO ] [MAIN ] SPGI: Starting full primary refresh. [2025-09-16T20:29:21.695903] [INFO ] [REMOTE ] SPGI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:29:21.974919] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-02. [2025-09-16T20:29:22.051252] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-16T20:29:22.203788] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-16T20:29:22.774901] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-05. [2025-09-16T20:29:23.572720] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-16T20:29:23.583154] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-07. [2025-09-16T20:29:24.359313] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-16T20:29:24.374890] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-08. [2025-09-16T20:29:24.974347] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-16T20:29:25.064087] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-16T20:29:25.174924] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-06. [2025-09-16T20:29:25.974912] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-03. [2025-09-16T20:29:26.774905] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-09. [2025-09-16T20:29:27.413352] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-16T20:29:27.474606] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-16T20:29:27.476143] [INFO ] [REMOTE ] SPE: Full fetch complete (7139 records). [2025-09-16T20:29:27.476212] [DEBUG] [VALIDATOR ] SPE: Validating primary data. [2025-09-16T20:29:27.579936] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-07. [2025-09-16T20:29:27.856775] [DEBUG] [VALIDATOR ] SPE: All expected trading days are present. [2025-09-16T20:29:27.857009] [DEBUG] [VALIDATOR ] SPE: Primary data validation passed. [2025-09-16T20:29:27.857243] [INFO ] [MAIN ] SPE: Fetched primary data is valid. [2025-09-16T20:29:27.857297] [DEBUG] [LOCAL ] SPE: Saving primary data. [2025-09-16T20:29:27.857980] [DEBUG] [LOCAL ] SPE: Trimmed 7139 records to 4513 (keeping 150 days of data) [2025-09-16T20:29:27.886862] [DEBUG] [LOCAL ] SPE: Primary data saved (4513 records). [2025-09-16T20:29:27.886944] [INFO ] [MAIN ] SPE: Full history saved. [2025-09-16T20:29:27.887024] [INFO ] [MAIN ] Update Progress: 1971/2369 symbols completed. SPE took 20.6s. Estimated remaining: 42m 17s. Rate: 9.4 symbols/min [2025-09-16T20:29:28.066535] [INFO ] [MAIN ] SPH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:29:28.098670] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-16T20:29:28.114850] [DEBUG] [LOCAL ] SPH: Loaded 12701 existing records from primary storage. [2025-09-16T20:29:28.114991] [INFO ] [MAIN ] SPH: Loaded 12701 existing records. [2025-09-16T20:29:28.299103] [WARN ] [MAIN ] SPH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:29:28.299358] [INFO ] [MAIN ] SPH: Wiping existing primary data before full refresh. [2025-09-16T20:29:28.299414] [INFO ] [LOCAL ] SPH: Starting deletion of primary data. [2025-09-16T20:29:28.299782] [DEBUG] [LOCAL ] SPH: Deleted primary data file. [2025-09-16T20:29:28.299841] [INFO ] [MAIN ] SPH: Starting full primary refresh. [2025-09-16T20:29:28.380068] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-04. [2025-09-16T20:29:28.683050] [INFO ] [REMOTE ] SPH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:29:29.174966] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-02. [2025-09-16T20:29:29.974925] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-04. [2025-09-16T20:29:30.019262] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-09-16T20:29:30.253194] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-16T20:29:30.383266] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-16T20:29:30.774897] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-05. [2025-09-16T20:29:31.574920] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-03. [2025-09-16T20:29:31.874675] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-16T20:29:32.374875] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-05. [2025-09-16T20:29:32.401122] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-16T20:29:32.705357] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-16T20:29:33.174957] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-08. [2025-09-16T20:29:33.974916] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-06. [2025-09-16T20:29:34.157709] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-16T20:29:34.774874] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-04. [2025-09-16T20:29:34.911011] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-16T20:29:35.574910] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-06. [2025-09-16T20:29:35.838201] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-16T20:29:35.978467] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-16T20:29:36.374912] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-05. [2025-09-16T20:29:37.174904] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-09. [2025-09-16T20:29:37.418398] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-16T20:29:37.558258] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-16T20:29:37.974930] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-06. [2025-09-16T20:29:38.774914] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-07. [2025-09-16T20:29:39.018047] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-16T20:29:39.023788] [INFO ] [REMOTE ] SPCE: Full fetch complete (53950 records). [2025-09-16T20:29:39.023888] [DEBUG] [VALIDATOR ] SPCE: Validating primary data. [2025-09-16T20:29:39.384906] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-16T20:29:39.440172] [DEBUG] [VALIDATOR ] SPCE: All expected trading days are present. [2025-09-16T20:29:39.440258] [DEBUG] [VALIDATOR ] SPCE: Primary data validation passed. [2025-09-16T20:29:39.441200] [INFO ] [MAIN ] SPCE: Fetched primary data is valid. [2025-09-16T20:29:39.441247] [DEBUG] [LOCAL ] SPCE: Saving primary data. [2025-09-16T20:29:39.442460] [DEBUG] [LOCAL ] SPCE: Trimmed 53950 records to 37032 (keeping 150 days of data) [2025-09-16T20:29:39.601387] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-07. [2025-09-16T20:29:39.670900] [DEBUG] [LOCAL ] SPCE: Primary data saved (37032 records). [2025-09-16T20:29:39.671073] [INFO ] [MAIN ] SPCE: Full history saved. [2025-09-16T20:29:39.671216] [INFO ] [MAIN ] Update Progress: 1972/2369 symbols completed. SPCE took 38.8s. Estimated remaining: 42m 12s. Rate: 9.4 symbols/min [2025-09-16T20:29:39.849611] [INFO ] [MAIN ] SPHR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:29:39.875974] [DEBUG] [LOCAL ] SPHR: Loaded 28497 existing records from primary storage. [2025-09-16T20:29:39.876106] [INFO ] [MAIN ] SPHR: Loaded 28497 existing records. [2025-09-16T20:29:40.055356] [WARN ] [MAIN ] SPHR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:29:40.055615] [INFO ] [MAIN ] SPHR: Wiping existing primary data before full refresh. [2025-09-16T20:29:40.055688] [INFO ] [LOCAL ] SPHR: Starting deletion of primary data. [2025-09-16T20:29:40.056273] [DEBUG] [LOCAL ] SPHR: Deleted primary data file. [2025-09-16T20:29:40.056319] [INFO ] [MAIN ] SPHR: Starting full primary refresh. [2025-09-16T20:29:40.382108] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-07. [2025-09-16T20:29:40.425070] [INFO ] [REMOTE ] SPHR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:29:40.459086] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-16T20:29:40.658466] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-16T20:29:41.174896] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-02. [2025-09-16T20:29:41.974915] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-08. [2025-09-16T20:29:42.308546] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-16T20:29:42.719269] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-16T20:29:42.774938] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-03. [2025-09-16T20:29:43.130601] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-16T20:29:43.574956] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-08. [2025-09-16T20:29:44.374928] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-08. [2025-09-16T20:29:44.454120] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-16T20:29:44.993388] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-16T20:29:45.174890] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-09. [2025-09-16T20:29:45.974931] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-09. [2025-09-16T20:29:46.320008] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-16T20:29:46.774906] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-04. [2025-09-16T20:29:46.876080] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-16T20:29:46.878325] [INFO ] [REMOTE ] SPH: Full fetch complete (20419 records). [2025-09-16T20:29:46.878418] [DEBUG] [VALIDATOR ] SPH: Validating primary data. [2025-09-16T20:29:47.287767] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-16T20:29:47.288496] [DEBUG] [VALIDATOR ] SPH: All expected trading days are present. [2025-09-16T20:29:47.296213] [DEBUG] [VALIDATOR ] SPH: Primary data validation passed. [2025-09-16T20:29:47.296943] [INFO ] [MAIN ] SPH: Fetched primary data is valid. [2025-09-16T20:29:47.297000] [DEBUG] [LOCAL ] SPH: Saving primary data. [2025-09-16T20:29:47.297502] [INFO ] [REMOTE ] SPGI: Full fetch complete (50050 records). [2025-09-16T20:29:47.297873] [DEBUG] [VALIDATOR ] SPGI: Validating primary data. [2025-09-16T20:29:47.298119] [DEBUG] [LOCAL ] SPH: Trimmed 20419 records to 12796 (keeping 150 days of data) [2025-09-16T20:29:47.579888] [DEBUG] [LOCAL ] SPH: Primary data saved (12796 records). [2025-09-16T20:29:47.597586] [INFO ] [MAIN ] SPH: Full history saved. [2025-09-16T20:29:47.579719] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-09. [2025-09-16T20:29:47.614298] [INFO ] [MAIN ] Update Progress: 1973/2369 symbols completed. SPH took 19.7s. Estimated remaining: 42m 6s. Rate: 9.4 symbols/min [2025-09-16T20:29:47.959961] [DEBUG] [VALIDATOR ] SPGI: All expected trading days are present. [2025-09-16T20:29:47.959880] [INFO ] [MAIN ] SPIR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:29:47.960138] [DEBUG] [VALIDATOR ] SPGI: Primary data validation passed. [2025-09-16T20:29:47.961767] [INFO ] [MAIN ] SPGI: Fetched primary data is valid. [2025-09-16T20:29:47.961900] [DEBUG] [LOCAL ] SPGI: Saving primary data. [2025-09-16T20:29:47.964715] [DEBUG] [LOCAL ] SPGI: Trimmed 50050 records to 33166 (keeping 150 days of data) [2025-09-16T20:29:48.088663] [DEBUG] [LOCAL ] SPIR: Loaded 27619 existing records from primary storage. [2025-09-16T20:29:48.089436] [INFO ] [MAIN ] SPIR: Loaded 27619 existing records. [2025-09-16T20:29:48.273915] [WARN ] [MAIN ] SPIR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:29:48.275537] [INFO ] [MAIN ] SPIR: Wiping existing primary data before full refresh. [2025-09-16T20:29:48.275927] [INFO ] [LOCAL ] SPIR: Starting deletion of primary data. [2025-09-16T20:29:48.277442] [DEBUG] [LOCAL ] SPIR: Deleted primary data file. [2025-09-16T20:29:48.278025] [INFO ] [MAIN ] SPIR: Starting full primary refresh. [2025-09-16T20:29:48.658561] [INFO ] [REMOTE ] SPIR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:29:48.660292] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-02. [2025-09-16T20:29:48.757400] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-16T20:29:48.791936] [DEBUG] [LOCAL ] SPGI: Primary data saved (33166 records). [2025-09-16T20:29:48.792110] [INFO ] [MAIN ] SPGI: Full history saved. [2025-09-16T20:29:48.792291] [INFO ] [MAIN ] Update Progress: 1974/2369 symbols completed. SPGI took 27.9s. Estimated remaining: 41m 58s. Rate: 9.4 symbols/min [2025-09-16T20:29:48.970262] [INFO ] [MAIN ] SPMC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:29:48.977359] [DEBUG] [LOCAL ] SPMC: Loaded 3805 existing records from primary storage. [2025-09-16T20:29:48.977467] [INFO ] [MAIN ] SPMC: Loaded 3805 existing records. [2025-09-16T20:29:49.161016] [WARN ] [MAIN ] SPMC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:29:49.161257] [INFO ] [MAIN ] SPMC: Wiping existing primary data before full refresh. [2025-09-16T20:29:49.161304] [INFO ] [LOCAL ] SPMC: Starting deletion of primary data. [2025-09-16T20:29:49.161522] [DEBUG] [LOCAL ] SPMC: Deleted primary data file. [2025-09-16T20:29:49.161565] [INFO ] [MAIN ] SPMC: Starting full primary refresh. [2025-09-16T20:29:49.193760] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-05. [2025-09-16T20:29:49.537169] [INFO ] [REMOTE ] SPMC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:29:49.556918] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-16T20:29:49.565020] [INFO ] [REMOTE ] SPG: Full fetch complete (54484 records). [2025-09-16T20:29:49.565141] [DEBUG] [VALIDATOR ] SPG: Validating primary data. [2025-09-16T20:29:49.980322] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-02. [2025-09-16T20:29:49.993817] [DEBUG] [VALIDATOR ] SPG: All expected trading days are present. [2025-09-16T20:29:49.995518] [DEBUG] [VALIDATOR ] SPG: Primary data validation passed. [2025-09-16T20:29:49.996683] [INFO ] [MAIN ] SPG: Fetched primary data is valid. [2025-09-16T20:29:49.996871] [DEBUG] [LOCAL ] SPG: Saving primary data. [2025-09-16T20:29:49.999629] [DEBUG] [LOCAL ] SPG: Trimmed 54484 records to 37370 (keeping 150 days of data) [2025-09-16T20:29:50.249909] [DEBUG] [LOCAL ] SPG: Primary data saved (37370 records). [2025-09-16T20:29:50.250093] [INFO ] [MAIN ] SPG: Full history saved. [2025-09-16T20:29:50.250934] [INFO ] [MAIN ] Update Progress: 1975/2369 symbols completed. SPG took 33.6s. Estimated remaining: 41m 51s. Rate: 9.4 symbols/min [2025-09-16T20:29:50.427738] [INFO ] [MAIN ] SPME: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:29:50.428002] [DEBUG] [LOCAL ] SPME: No existing data file found in primary storage. [2025-09-16T20:29:50.428052] [WARN ] [MAIN ] SPME: No existing data found, performing full refresh instead. [2025-09-16T20:29:50.428392] [INFO ] [MAIN ] SPME: Wiping existing primary data before full refresh. [2025-09-16T20:29:50.428449] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-09-16T20:29:50.428591] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-09-16T20:29:50.428635] [INFO ] [MAIN ] SPME: Starting full primary refresh. [2025-09-16T20:29:50.636476] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-16T20:29:50.788793] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-03. [2025-09-16T20:29:50.826582] [INFO ] [REMOTE ] SPME: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:29:50.844119] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-16T20:29:50.947868] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-16T20:29:51.574915] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-03. [2025-09-16T20:29:52.290117] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-16T20:29:52.353349] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-16T20:29:52.374871] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-04. [2025-09-16T20:29:53.168274] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-16T20:29:53.174845] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-05. [2025-09-16T20:29:53.896815] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-16T20:29:53.974909] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-02. [2025-09-16T20:29:54.256785] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:29:54.257113] [WARN ] [REMOTE ] SPME: No data returned for month 2025-02 [2025-09-16T20:29:54.774939] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-03. [2025-09-16T20:29:55.055964] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:29:55.056278] [WARN ] [REMOTE ] SPME: No data returned for month 2025-03 [2025-09-16T20:29:55.574898] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-06. [2025-09-16T20:29:56.374916] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-04. [2025-09-16T20:29:56.937917] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-16T20:29:57.174893] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-07. [2025-09-16T20:29:57.974901] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-04. [2025-09-16T20:29:58.076961] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-16T20:29:58.250507] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:29:58.250867] [WARN ] [REMOTE ] SPME: No data returned for month 2025-04 [2025-09-16T20:29:58.729581] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-16T20:29:58.774869] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-08. [2025-09-16T20:29:59.574940] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-05. [2025-09-16T20:29:59.809766] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:29:59.810078] [WARN ] [REMOTE ] SPME: No data returned for month 2025-05 [2025-09-16T20:30:00.352956] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-16T20:30:00.374879] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-09. [2025-09-16T20:30:01.174926] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-06. [2025-09-16T20:30:01.490779] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:30:01.491290] [WARN ] [REMOTE ] SPME: No data returned for month 2025-06 [2025-09-16T20:30:01.974874] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-05. [2025-09-16T20:30:02.038695] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-16T20:30:02.044898] [INFO ] [REMOTE ] SPHR: Full fetch complete (43317 records). [2025-09-16T20:30:02.045015] [DEBUG] [VALIDATOR ] SPHR: Validating primary data. [2025-09-16T20:30:02.419327] [DEBUG] [VALIDATOR ] SPHR: All expected trading days are present. [2025-09-16T20:30:02.419410] [DEBUG] [VALIDATOR ] SPHR: Primary data validation passed. [2025-09-16T20:30:02.420283] [INFO ] [MAIN ] SPHR: Fetched primary data is valid. [2025-09-16T20:30:02.420329] [DEBUG] [LOCAL ] SPHR: Saving primary data. [2025-09-16T20:30:02.421220] [DEBUG] [LOCAL ] SPHR: Trimmed 43317 records to 28867 (keeping 150 days of data) [2025-09-16T20:30:02.600488] [DEBUG] [LOCAL ] SPHR: Primary data saved (28867 records). [2025-09-16T20:30:02.600692] [INFO ] [MAIN ] SPHR: Full history saved. [2025-09-16T20:30:02.600812] [INFO ] [MAIN ] Update Progress: 1976/2369 symbols completed. SPHR took 22.9s. Estimated remaining: 41m 46s. Rate: 9.4 symbols/min [2025-09-16T20:30:02.781044] [INFO ] [MAIN ] SPNT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:30:02.779726] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-06. [2025-09-16T20:30:02.807549] [DEBUG] [LOCAL ] SPNT: Loaded 25474 existing records from primary storage. [2025-09-16T20:30:02.807741] [INFO ] [MAIN ] SPNT: Loaded 25474 existing records. [2025-09-16T20:30:02.981988] [WARN ] [MAIN ] SPNT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:30:02.982209] [INFO ] [MAIN ] SPNT: Wiping existing primary data before full refresh. [2025-09-16T20:30:02.982271] [INFO ] [LOCAL ] SPNT: Starting deletion of primary data. [2025-09-16T20:30:02.982833] [DEBUG] [LOCAL ] SPNT: Deleted primary data file. [2025-09-16T20:30:02.982881] [INFO ] [MAIN ] SPNT: Starting full primary refresh. [2025-09-16T20:30:03.333570] [INFO ] [REMOTE ] SPNT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:30:03.505291] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-16T20:30:03.574874] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-07. [2025-09-16T20:30:03.648519] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-16T20:30:04.264082] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-16T20:30:04.374957] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-08. [2025-09-16T20:30:05.051797] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-16T20:30:05.174986] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-07. [2025-09-16T20:30:05.674122] [INFO ] [REMOTE ] SPME: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-16T20:30:05.974906] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-08. [2025-09-16T20:30:06.443793] [INFO ] [REMOTE ] SPME: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-16T20:30:06.774909] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-02. [2025-09-16T20:30:07.574919] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-09. [2025-09-16T20:30:08.147357] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-16T20:30:08.148733] [INFO ] [REMOTE ] SPMC: Full fetch complete (6465 records). [2025-09-16T20:30:08.148906] [DEBUG] [VALIDATOR ] SPMC: Validating primary data. [2025-09-16T20:30:08.327606] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-16T20:30:08.379976] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-03. [2025-09-16T20:30:08.604011] [DEBUG] [VALIDATOR ] SPMC: All expected trading days are present. [2025-09-16T20:30:08.604145] [DEBUG] [VALIDATOR ] SPMC: Primary data validation passed. [2025-09-16T20:30:08.604526] [INFO ] [MAIN ] SPMC: Fetched primary data is valid. [2025-09-16T20:30:08.604602] [DEBUG] [LOCAL ] SPMC: Saving primary data. [2025-09-16T20:30:08.605407] [DEBUG] [LOCAL ] SPMC: Trimmed 6465 records to 3849 (keeping 150 days of data) [2025-09-16T20:30:08.645283] [DEBUG] [LOCAL ] SPMC: Primary data saved (3849 records). [2025-09-16T20:30:08.645475] [INFO ] [MAIN ] SPMC: Full history saved. [2025-09-16T20:30:08.645595] [INFO ] [MAIN ] Update Progress: 1977/2369 symbols completed. SPMC took 19.9s. Estimated remaining: 41m 39s. Rate: 9.4 symbols/min [2025-09-16T20:30:08.914438] [INFO ] [MAIN ] SPOT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:30:08.970217] [DEBUG] [LOCAL ] SPOT: Loaded 37341 existing records from primary storage. [2025-09-16T20:30:08.970498] [INFO ] [MAIN ] SPOT: Loaded 37341 existing records. [2025-09-16T20:30:09.186161] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-06. [2025-09-16T20:30:09.242781] [WARN ] [MAIN ] SPOT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:30:09.243096] [INFO ] [MAIN ] SPOT: Wiping existing primary data before full refresh. [2025-09-16T20:30:09.243167] [INFO ] [LOCAL ] SPOT: Starting deletion of primary data. [2025-09-16T20:30:09.244469] [DEBUG] [LOCAL ] SPOT: Deleted primary data file. [2025-09-16T20:30:09.244546] [INFO ] [MAIN ] SPOT: Starting full primary refresh. [2025-09-16T20:30:09.675564] [INFO ] [REMOTE ] SPOT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:30:09.896694] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-16T20:30:09.974861] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-04. [2025-09-16T20:30:10.780038] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-02. [2025-09-16T20:30:10.798436] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-16T20:30:11.189932] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-16T20:30:11.574917] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-05. [2025-09-16T20:30:12.374900] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-07. [2025-09-16T20:30:12.937975] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-16T20:30:13.073496] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-16T20:30:13.174947] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-03. [2025-09-16T20:30:13.974943] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-09. [2025-09-16T20:30:14.023686] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-16T20:30:14.380041] [INFO ] [REMOTE ] SPME: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-16T20:30:14.380853] [INFO ] [REMOTE ] SPME: Full fetch complete (629 records). [2025-09-16T20:30:14.380928] [DEBUG] [VALIDATOR ] SPME: Validating primary data. [2025-09-16T20:30:14.598762] [WARN ] [VALIDATOR ] SPME: Validation failed - insufficient historical data. Have 42 unique days, need 150 days [2025-09-16T20:30:14.598968] [FATAL] [MAIN ] SPME: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:30:14.599016] [WARN ] [MAIN ] SPME: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:30:14.599054] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-09-16T20:30:14.599146] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-09-16T20:30:14.599184] [INFO ] [LOCAL ] SPME: Starting deletion of derivative data. [2025-09-16T20:30:14.599233] [DEBUG] [LOCAL ] SPME: No derivative data file found to delete. [2025-09-16T20:30:14.599293] [INFO ] [MAIN ] Update Progress: 1978/2369 symbols completed. SPME took 24.3s. Estimated remaining: 41m 33s. Rate: 9.4 symbols/min [2025-09-16T20:30:14.771947] [INFO ] [MAIN ] SPR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:30:14.774909] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-08. [2025-09-16T20:30:14.808616] [DEBUG] [LOCAL ] SPR: Loaded 29600 existing records from primary storage. [2025-09-16T20:30:14.808783] [INFO ] [MAIN ] SPR: Loaded 29600 existing records. [2025-09-16T20:30:14.984449] [WARN ] [MAIN ] SPR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:30:14.984709] [INFO ] [MAIN ] SPR: Wiping existing primary data before full refresh. [2025-09-16T20:30:14.984756] [INFO ] [LOCAL ] SPR: Starting deletion of primary data. [2025-09-16T20:30:14.985375] [DEBUG] [LOCAL ] SPR: Deleted primary data file. [2025-09-16T20:30:14.985422] [INFO ] [MAIN ] SPR: Starting full primary refresh. [2025-09-16T20:30:15.336708] [INFO ] [REMOTE ] SPR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:30:15.574881] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-02. [2025-09-16T20:30:15.714678] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-09-16T20:30:16.074764] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-16T20:30:16.374902] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-04. [2025-09-16T20:30:17.098427] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-16T20:30:17.174959] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-09. [2025-09-16T20:30:17.974940] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-03. [2025-09-16T20:30:18.539800] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-16T20:30:18.544573] [INFO ] [REMOTE ] SPIR: Full fetch complete (41356 records). [2025-09-16T20:30:18.544778] [DEBUG] [VALIDATOR ] SPIR: Validating primary data. [2025-09-16T20:30:18.787395] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-06. [2025-09-16T20:30:18.938207] [DEBUG] [VALIDATOR ] SPIR: All expected trading days are present. [2025-09-16T20:30:18.938307] [DEBUG] [VALIDATOR ] SPIR: Primary data validation passed. [2025-09-16T20:30:18.939284] [INFO ] [MAIN ] SPIR: Fetched primary data is valid. [2025-09-16T20:30:18.939339] [DEBUG] [LOCAL ] SPIR: Saving primary data. [2025-09-16T20:30:18.940565] [DEBUG] [LOCAL ] SPIR: Trimmed 41356 records to 27817 (keeping 150 days of data) [2025-09-16T20:30:19.064661] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-04 (2.69 seconds). [2025-09-16T20:30:19.159862] [DEBUG] [LOCAL ] SPIR: Primary data saved (27817 records). [2025-09-16T20:30:19.160039] [INFO ] [MAIN ] SPIR: Full history saved. [2025-09-16T20:30:19.160147] [INFO ] [MAIN ] Update Progress: 1979/2369 symbols completed. SPIR took 31.5s. Estimated remaining: 41m 26s. Rate: 9.4 symbols/min [2025-09-16T20:30:19.336040] [INFO ] [MAIN ] SPRU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:30:19.365503] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-16T20:30:19.377530] [DEBUG] [LOCAL ] SPRU: Loaded 6780 existing records from primary storage. [2025-09-16T20:30:19.377728] [INFO ] [MAIN ] SPRU: Loaded 6780 existing records. [2025-09-16T20:30:19.555738] [WARN ] [MAIN ] SPRU: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:30:19.556034] [INFO ] [MAIN ] SPRU: Wiping existing primary data before full refresh. [2025-09-16T20:30:19.556081] [INFO ] [LOCAL ] SPRU: Starting deletion of primary data. [2025-09-16T20:30:19.556332] [DEBUG] [LOCAL ] SPRU: Deleted primary data file. [2025-09-16T20:30:19.556375] [INFO ] [MAIN ] SPRU: Starting full primary refresh. [2025-09-16T20:30:19.586186] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-05. [2025-09-16T20:30:19.914136] [INFO ] [REMOTE ] SPRU: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:30:20.184997] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-16T20:30:20.374912] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-04. [2025-09-16T20:30:21.174902] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-02. [2025-09-16T20:30:21.815892] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-16T20:30:21.978408] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-03. [2025-09-16T20:30:21.984067] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-09-16T20:30:22.022925] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-16T20:30:22.737372] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-16T20:30:22.774900] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-05. [2025-09-16T20:30:23.574959] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-07. [2025-09-16T20:30:24.380012] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-04. [2025-09-16T20:30:24.404488] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-16T20:30:25.178512] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-06. [2025-09-16T20:30:25.182974] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-16T20:30:25.242299] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-16T20:30:25.974894] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-05. [2025-09-16T20:30:26.774891] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-06. [2025-09-16T20:30:26.916188] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-16T20:30:27.420771] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-16T20:30:27.574851] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-07. [2025-09-16T20:30:28.253588] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-16T20:30:28.374908] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-06. [2025-09-16T20:30:29.096685] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-16T20:30:29.174943] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-08. [2025-09-16T20:30:29.974903] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-07. [2025-09-16T20:30:30.036745] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-09-16T20:30:30.682556] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-16T20:30:30.774905] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-08. [2025-09-16T20:30:30.846473] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-16T20:30:31.574918] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-07. [2025-09-16T20:30:32.374922] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-09. [2025-09-16T20:30:33.079801] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-16T20:30:33.144861] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-16T20:30:33.174873] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-08. [2025-09-16T20:30:33.775768] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-16T20:30:33.780511] [INFO ] [REMOTE ] SPNT: Full fetch complete (37728 records). [2025-09-16T20:30:33.780599] [DEBUG] [VALIDATOR ] SPNT: Validating primary data. [2025-09-16T20:30:33.983934] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-09. [2025-09-16T20:30:34.162045] [DEBUG] [VALIDATOR ] SPNT: All expected trading days are present. [2025-09-16T20:30:34.162143] [DEBUG] [VALIDATOR ] SPNT: Primary data validation passed. [2025-09-16T20:30:34.162954] [INFO ] [MAIN ] SPNT: Fetched primary data is valid. [2025-09-16T20:30:34.163000] [DEBUG] [LOCAL ] SPNT: Saving primary data. [2025-09-16T20:30:34.164126] [DEBUG] [LOCAL ] SPNT: Trimmed 37728 records to 25754 (keeping 150 days of data) [2025-09-16T20:30:34.315329] [DEBUG] [LOCAL ] SPNT: Primary data saved (25754 records). [2025-09-16T20:30:34.315478] [INFO ] [MAIN ] SPNT: Full history saved. [2025-09-16T20:30:34.315596] [INFO ] [MAIN ] Update Progress: 1980/2369 symbols completed. SPNT took 31.7s. Estimated remaining: 41m 22s. Rate: 9.4 symbols/min [2025-09-16T20:30:34.498498] [INFO ] [MAIN ] SPXC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:30:34.523233] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-16T20:30:34.543913] [DEBUG] [LOCAL ] SPXC: Loaded 16773 existing records from primary storage. [2025-09-16T20:30:34.544065] [INFO ] [MAIN ] SPXC: Loaded 16773 existing records. [2025-09-16T20:30:34.732850] [WARN ] [MAIN ] SPXC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:30:34.733118] [INFO ] [MAIN ] SPXC: Wiping existing primary data before full refresh. [2025-09-16T20:30:34.733165] [INFO ] [LOCAL ] SPXC: Starting deletion of primary data. [2025-09-16T20:30:34.733636] [DEBUG] [LOCAL ] SPXC: Deleted primary data file. [2025-09-16T20:30:34.733716] [INFO ] [MAIN ] SPXC: Starting full primary refresh. [2025-09-16T20:30:34.780061] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-08. [2025-09-16T20:30:35.097933] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-16T20:30:35.122739] [INFO ] [REMOTE ] SPXC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:30:35.123667] [INFO ] [REMOTE ] SPOT: Full fetch complete (55326 records). [2025-09-16T20:30:35.123801] [DEBUG] [VALIDATOR ] SPOT: Validating primary data. [2025-09-16T20:30:35.124587] [FATAL] [VALIDATOR ] SPOT: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T20:30:35.124688] [FATAL] [MAIN ] SPOT: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:30:35.124726] [WARN ] [MAIN ] SPOT: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:30:35.124772] [INFO ] [LOCAL ] SPOT: Starting deletion of primary data. [2025-09-16T20:30:35.124832] [DEBUG] [LOCAL ] SPOT: No primary data file found to delete. [2025-09-16T20:30:35.124869] [INFO ] [LOCAL ] SPOT: Starting deletion of derivative data. [2025-09-16T20:30:35.125234] [DEBUG] [LOCAL ] SPOT: Deleted derivative data file. [2025-09-16T20:30:35.125317] [INFO ] [MAIN ] Update Progress: 1981/2369 symbols completed. SPOT took 26.5s. Estimated remaining: 41m 14s. Rate: 9.4 symbols/min [2025-09-16T20:30:35.296624] [INFO ] [MAIN ] SPXX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:30:35.303716] [DEBUG] [LOCAL ] SPXX: Loaded 5844 existing records from primary storage. [2025-09-16T20:30:35.303813] [INFO ] [MAIN ] SPXX: Loaded 5844 existing records. [2025-09-16T20:30:35.477272] [WARN ] [MAIN ] SPXX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:30:35.477572] [INFO ] [MAIN ] SPXX: Wiping existing primary data before full refresh. [2025-09-16T20:30:35.477620] [INFO ] [LOCAL ] SPXX: Starting deletion of primary data. [2025-09-16T20:30:35.477948] [DEBUG] [LOCAL ] SPXX: Deleted primary data file. [2025-09-16T20:30:35.477995] [INFO ] [MAIN ] SPXX: Starting full primary refresh. [2025-09-16T20:30:35.582156] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-02. [2025-09-16T20:30:35.839098] [INFO ] [REMOTE ] SPXX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:30:36.009095] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-16T20:30:36.374940] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-09. [2025-09-16T20:30:36.827789] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-16T20:30:37.143410] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-16T20:30:37.145094] [INFO ] [REMOTE ] SPRU: Full fetch complete (8595 records). [2025-09-16T20:30:37.145161] [DEBUG] [VALIDATOR ] SPRU: Validating primary data. [2025-09-16T20:30:37.180128] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-02. [2025-09-16T20:30:37.508885] [DEBUG] [VALIDATOR ] SPRU: All expected trading days are present. [2025-09-16T20:30:37.508969] [DEBUG] [VALIDATOR ] SPRU: Primary data validation passed. [2025-09-16T20:30:37.509217] [INFO ] [MAIN ] SPRU: Fetched primary data is valid. [2025-09-16T20:30:37.509259] [DEBUG] [LOCAL ] SPRU: Saving primary data. [2025-09-16T20:30:37.509784] [DEBUG] [LOCAL ] SPRU: Trimmed 8595 records to 6874 (keeping 150 days of data) [2025-09-16T20:30:37.551384] [DEBUG] [LOCAL ] SPRU: Primary data saved (6874 records). [2025-09-16T20:30:37.551554] [INFO ] [MAIN ] SPRU: Full history saved. [2025-09-16T20:30:37.551668] [INFO ] [MAIN ] Update Progress: 1982/2369 symbols completed. SPRU took 18.4s. Estimated remaining: 41m 7s. Rate: 9.4 symbols/min [2025-09-16T20:30:37.722587] [INFO ] [MAIN ] SQM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:30:37.760586] [DEBUG] [LOCAL ] SQM: Loaded 35810 existing records from primary storage. [2025-09-16T20:30:37.760763] [INFO ] [MAIN ] SQM: Loaded 35810 existing records. [2025-09-16T20:30:37.935667] [WARN ] [MAIN ] SQM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:30:37.935895] [INFO ] [MAIN ] SQM: Wiping existing primary data before full refresh. [2025-09-16T20:30:37.935942] [INFO ] [LOCAL ] SQM: Starting deletion of primary data. [2025-09-16T20:30:37.936687] [DEBUG] [LOCAL ] SQM: Deleted primary data file. [2025-09-16T20:30:37.936737] [INFO ] [MAIN ] SQM: Starting full primary refresh. [2025-09-16T20:30:37.980153] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-03. [2025-09-16T20:30:38.213157] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-16T20:30:38.319144] [INFO ] [REMOTE ] SQM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:30:38.774944] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-09. [2025-09-16T20:30:39.315226] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-16T20:30:39.574897] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-03. [2025-09-16T20:30:40.254554] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-16T20:30:40.259883] [INFO ] [REMOTE ] SPR: Full fetch complete (45057 records). [2025-09-16T20:30:40.259974] [DEBUG] [VALIDATOR ] SPR: Validating primary data. [2025-09-16T20:30:40.380084] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-02. [2025-09-16T20:30:40.622811] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-16T20:30:40.656093] [DEBUG] [VALIDATOR ] SPR: All expected trading days are present. [2025-09-16T20:30:40.656175] [DEBUG] [VALIDATOR ] SPR: Primary data validation passed. [2025-09-16T20:30:40.657085] [INFO ] [MAIN ] SPR: Fetched primary data is valid. [2025-09-16T20:30:40.657156] [DEBUG] [LOCAL ] SPR: Saving primary data. [2025-09-16T20:30:40.658172] [DEBUG] [LOCAL ] SPR: Trimmed 45057 records to 29941 (keeping 150 days of data) [2025-09-16T20:30:40.836964] [DEBUG] [LOCAL ] SPR: Primary data saved (29941 records). [2025-09-16T20:30:40.837106] [INFO ] [MAIN ] SPR: Full history saved. [2025-09-16T20:30:40.837188] [INFO ] [MAIN ] Update Progress: 1983/2369 symbols completed. SPR took 26.2s. Estimated remaining: 40m 60s. Rate: 9.4 symbols/min [2025-09-16T20:30:41.014179] [INFO ] [MAIN ] SQNS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:30:41.036863] [DEBUG] [LOCAL ] SQNS: Loaded 22962 existing records from primary storage. [2025-09-16T20:30:41.036992] [INFO ] [MAIN ] SQNS: Loaded 22962 existing records. [2025-09-16T20:30:41.180129] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-04. [2025-09-16T20:30:41.218324] [WARN ] [MAIN ] SQNS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:30:41.218590] [INFO ] [MAIN ] SQNS: Wiping existing primary data before full refresh. [2025-09-16T20:30:41.218635] [INFO ] [LOCAL ] SQNS: Starting deletion of primary data. [2025-09-16T20:30:41.219216] [DEBUG] [LOCAL ] SQNS: Deleted primary data file. [2025-09-16T20:30:41.219293] [INFO ] [MAIN ] SQNS: Starting full primary refresh. [2025-09-16T20:30:41.577739] [INFO ] [REMOTE ] SQNS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:30:41.974908] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-02. [2025-09-16T20:30:42.139567] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-16T20:30:42.166687] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-16T20:30:42.774889] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-03. [2025-09-16T20:30:42.845305] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-16T20:30:43.574915] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-05. [2025-09-16T20:30:44.374890] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-03. [2025-09-16T20:30:44.385858] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-16T20:30:44.683560] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-16T20:30:44.941187] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-16T20:30:45.174935] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-06. [2025-09-16T20:30:45.974907] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-04. [2025-09-16T20:30:46.076758] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-16T20:30:46.774948] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-04. [2025-09-16T20:30:47.574909] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-07. [2025-09-16T20:30:47.716597] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-16T20:30:47.746955] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-16T20:30:48.374903] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-05. [2025-09-16T20:30:48.486894] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-16T20:30:49.174915] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-05. [2025-09-16T20:30:49.242978] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-16T20:30:49.974903] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-04. [2025-09-16T20:30:50.774935] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-08. [2025-09-16T20:30:50.948559] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-16T20:30:51.456127] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-16T20:30:51.476625] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-16T20:30:51.574927] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-05. [2025-09-16T20:30:52.374909] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-06. [2025-09-16T20:30:52.806325] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-16T20:30:53.174920] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-09. [2025-09-16T20:30:53.923057] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-16T20:30:53.924828] [INFO ] [REMOTE ] SPXX: Full fetch complete (9887 records). [2025-09-16T20:30:53.924896] [DEBUG] [VALIDATOR ] SPXX: Validating primary data. [2025-09-16T20:30:53.980834] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-06. [2025-09-16T20:30:54.304580] [DEBUG] [VALIDATOR ] SPXX: All expected trading days are present. [2025-09-16T20:30:54.304867] [DEBUG] [VALIDATOR ] SPXX: Primary data validation passed. [2025-09-16T20:30:54.305173] [INFO ] [MAIN ] SPXX: Fetched primary data is valid. [2025-09-16T20:30:54.314091] [DEBUG] [LOCAL ] SPXX: Saving primary data. [2025-09-16T20:30:54.330672] [DEBUG] [LOCAL ] SPXX: Trimmed 9887 records to 5916 (keeping 150 days of data) [2025-09-16T20:30:54.332546] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-16T20:30:54.379494] [DEBUG] [LOCAL ] SPXX: Primary data saved (5916 records). [2025-09-16T20:30:54.379666] [INFO ] [MAIN ] SPXX: Full history saved. [2025-09-16T20:30:54.379793] [INFO ] [MAIN ] Update Progress: 1984/2369 symbols completed. SPXX took 19.3s. Estimated remaining: 40m 55s. Rate: 9.4 symbols/min [2025-09-16T20:30:54.562402] [INFO ] [MAIN ] SR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:30:54.586854] [DEBUG] [LOCAL ] SR: Loaded 24043 existing records from primary storage. [2025-09-16T20:30:54.587001] [INFO ] [MAIN ] SR: Loaded 24043 existing records. [2025-09-16T20:30:54.769832] [WARN ] [MAIN ] SR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:30:54.770130] [INFO ] [MAIN ] SR: Wiping existing primary data before full refresh. [2025-09-16T20:30:54.770179] [INFO ] [LOCAL ] SR: Starting deletion of primary data. [2025-09-16T20:30:54.770837] [DEBUG] [LOCAL ] SR: Deleted primary data file. [2025-09-16T20:30:54.770888] [INFO ] [MAIN ] SR: Starting full primary refresh. [2025-09-16T20:30:54.782367] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-07. [2025-09-16T20:30:55.131014] [INFO ] [REMOTE ] SR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:30:55.243237] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-16T20:30:55.574940] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-06. [2025-09-16T20:30:56.374918] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-02. [2025-09-16T20:30:56.438152] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-16T20:30:56.926355] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-16T20:30:57.174917] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-08. [2025-09-16T20:30:57.853719] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-16T20:30:57.974916] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-07. [2025-09-16T20:30:58.774932] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-07. [2025-09-16T20:30:59.233190] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-16T20:30:59.310682] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-16T20:30:59.574907] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-08. [2025-09-16T20:31:00.374908] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-09. [2025-09-16T20:31:01.061254] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-16T20:31:01.174942] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-09. [2025-09-16T20:31:01.180553] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-16T20:31:01.974987] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-08. [2025-09-16T20:31:02.094082] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-16T20:31:02.102212] [INFO ] [REMOTE ] SQM: Full fetch complete (52610 records). [2025-09-16T20:31:02.102408] [DEBUG] [VALIDATOR ] SQM: Validating primary data. [2025-09-16T20:31:02.517587] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-16T20:31:02.580195] [INFO ] [REMOTE ] SPXC: Full fetch complete (25739 records). [2025-09-16T20:31:02.593174] [DEBUG] [VALIDATOR ] SQM: All expected trading days are present. [2025-09-16T20:31:02.593239] [DEBUG] [VALIDATOR ] SQM: Primary data validation passed. [2025-09-16T20:31:02.593072] [DEBUG] [VALIDATOR ] SPXC: Validating primary data. [2025-09-16T20:31:02.594468] [INFO ] [MAIN ] SQM: Fetched primary data is valid. [2025-09-16T20:31:02.594604] [DEBUG] [LOCAL ] SQM: Saving primary data. [2025-09-16T20:31:02.700520] [DEBUG] [LOCAL ] SQM: Trimmed 52610 records to 36168 (keeping 150 days of data) [2025-09-16T20:31:02.775711] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-03. [2025-09-16T20:31:03.079680] [DEBUG] [VALIDATOR ] SPXC: All expected trading days are present. [2025-09-16T20:31:03.080078] [DEBUG] [VALIDATOR ] SPXC: Primary data validation passed. [2025-09-16T20:31:03.081300] [INFO ] [MAIN ] SPXC: Fetched primary data is valid. [2025-09-16T20:31:03.081364] [DEBUG] [LOCAL ] SPXC: Saving primary data. [2025-09-16T20:31:03.084021] [DEBUG] [LOCAL ] SPXC: Trimmed 25739 records to 16896 (keeping 150 days of data) [2025-09-16T20:31:03.199238] [DEBUG] [LOCAL ] SPXC: Primary data saved (16896 records). [2025-09-16T20:31:03.201010] [INFO ] [MAIN ] SPXC: Full history saved. [2025-09-16T20:31:03.201725] [INFO ] [MAIN ] Update Progress: 1985/2369 symbols completed. SPXC took 28.9s. Estimated remaining: 40m 49s. Rate: 9.4 symbols/min [2025-09-16T20:31:03.470375] [INFO ] [MAIN ] SRE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:31:03.472019] [DEBUG] [LOCAL ] SRE: No existing data file found in primary storage. [2025-09-16T20:31:03.472661] [WARN ] [MAIN ] SRE: No existing data found, performing full refresh instead. [2025-09-16T20:31:03.473431] [INFO ] [MAIN ] SRE: Wiping existing primary data before full refresh. [2025-09-16T20:31:03.473753] [INFO ] [LOCAL ] SRE: Starting deletion of primary data. [2025-09-16T20:31:03.474988] [DEBUG] [LOCAL ] SRE: No primary data file found to delete. [2025-09-16T20:31:03.475284] [INFO ] [MAIN ] SRE: Starting full primary refresh. [2025-09-16T20:31:03.860442] [INFO ] [REMOTE ] SRE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:31:03.861741] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-02. [2025-09-16T20:31:03.865715] [DEBUG] [LOCAL ] SQM: Primary data saved (36168 records). [2025-09-16T20:31:03.865799] [INFO ] [MAIN ] SQM: Full history saved. [2025-09-16T20:31:03.867128] [INFO ] [MAIN ] Update Progress: 1986/2369 symbols completed. SQM took 26.3s. Estimated remaining: 40m 42s. Rate: 9.4 symbols/min [2025-09-16T20:31:04.057258] [INFO ] [MAIN ] SREA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:31:04.121903] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-16T20:31:04.136380] [DEBUG] [LOCAL ] SREA: Loaded 7438 existing records from primary storage. [2025-09-16T20:31:04.137346] [INFO ] [MAIN ] SREA: Loaded 7438 existing records. [2025-09-16T20:31:04.326025] [WARN ] [MAIN ] SREA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:31:04.326438] [INFO ] [MAIN ] SREA: Wiping existing primary data before full refresh. [2025-09-16T20:31:04.326559] [INFO ] [LOCAL ] SREA: Starting deletion of primary data. [2025-09-16T20:31:04.326949] [DEBUG] [LOCAL ] SREA: Deleted primary data file. [2025-09-16T20:31:04.327094] [INFO ] [MAIN ] SREA: Starting full primary refresh. [2025-09-16T20:31:04.384833] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-09. [2025-09-16T20:31:04.498958] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-16T20:31:04.745916] [INFO ] [REMOTE ] SREA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:31:05.174910] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-04. [2025-09-16T20:31:05.472842] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-16T20:31:05.974914] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-03. [2025-09-16T20:31:06.137087] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-16T20:31:06.145943] [INFO ] [REMOTE ] SQNS: Full fetch complete (26151 records). [2025-09-16T20:31:06.146069] [DEBUG] [VALIDATOR ] SQNS: Validating primary data. [2025-09-16T20:31:06.515156] [DEBUG] [VALIDATOR ] SQNS: All expected trading days are present. [2025-09-16T20:31:06.515236] [DEBUG] [VALIDATOR ] SQNS: Primary data validation passed. [2025-09-16T20:31:06.515857] [INFO ] [MAIN ] SQNS: Fetched primary data is valid. [2025-09-16T20:31:06.515917] [DEBUG] [LOCAL ] SQNS: Saving primary data. [2025-09-16T20:31:06.516679] [DEBUG] [LOCAL ] SQNS: Trimmed 26151 records to 23260 (keeping 150 days of data) [2025-09-16T20:31:06.652346] [DEBUG] [LOCAL ] SQNS: Primary data saved (23260 records). [2025-09-16T20:31:06.652496] [INFO ] [MAIN ] SQNS: Full history saved. [2025-09-16T20:31:06.652596] [INFO ] [MAIN ] Update Progress: 1987/2369 symbols completed. SQNS took 25.8s. Estimated remaining: 40m 35s. Rate: 9.4 symbols/min [2025-09-16T20:31:06.783748] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-02. [2025-09-16T20:31:06.846003] [INFO ] [MAIN ] SRFM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:31:06.869181] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-16T20:31:06.898687] [DEBUG] [LOCAL ] SRFM: Loaded 28844 existing records from primary storage. [2025-09-16T20:31:06.898832] [INFO ] [MAIN ] SRFM: Loaded 28844 existing records. [2025-09-16T20:31:07.074927] [WARN ] [MAIN ] SRFM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:31:07.075188] [INFO ] [MAIN ] SRFM: Wiping existing primary data before full refresh. [2025-09-16T20:31:07.075238] [INFO ] [LOCAL ] SRFM: Starting deletion of primary data. [2025-09-16T20:31:07.075850] [DEBUG] [LOCAL ] SRFM: Deleted primary data file. [2025-09-16T20:31:07.075897] [INFO ] [MAIN ] SRFM: Starting full primary refresh. [2025-09-16T20:31:07.426776] [INFO ] [REMOTE ] SRFM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:31:07.574853] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-02. [2025-09-16T20:31:07.749130] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-16T20:31:08.023956] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-16T20:31:08.374925] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-05. [2025-09-16T20:31:08.549461] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-16T20:31:09.174907] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-03. [2025-09-16T20:31:09.837119] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-16T20:31:09.974917] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-04. [2025-09-16T20:31:10.415192] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-16T20:31:10.774904] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-03. [2025-09-16T20:31:11.574947] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-06. [2025-09-16T20:31:11.724019] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-16T20:31:11.962690] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-16T20:31:12.374914] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-04. [2025-09-16T20:31:13.007572] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-16T20:31:13.174896] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-05. [2025-09-16T20:31:13.321607] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-16T20:31:13.974895] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-07. [2025-09-16T20:31:14.774883] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-04. [2025-09-16T20:31:15.204554] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-16T20:31:15.476083] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-16T20:31:15.574898] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-08. [2025-09-16T20:31:15.658353] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-16T20:31:16.374898] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-06. [2025-09-16T20:31:17.009472] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-16T20:31:17.174891] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-09. [2025-09-16T20:31:17.855806] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-16T20:31:17.974906] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-07. [2025-09-16T20:31:18.047839] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-16T20:31:18.051808] [INFO ] [REMOTE ] SR: Full fetch complete (35177 records). [2025-09-16T20:31:18.051895] [DEBUG] [VALIDATOR ] SR: Validating primary data. [2025-09-16T20:31:18.424914] [DEBUG] [VALIDATOR ] SR: All expected trading days are present. [2025-09-16T20:31:18.424995] [DEBUG] [VALIDATOR ] SR: Primary data validation passed. [2025-09-16T20:31:18.425728] [INFO ] [MAIN ] SR: Fetched primary data is valid. [2025-09-16T20:31:18.425774] [DEBUG] [LOCAL ] SR: Saving primary data. [2025-09-16T20:31:18.426573] [DEBUG] [LOCAL ] SR: Trimmed 35177 records to 24257 (keeping 150 days of data) [2025-09-16T20:31:18.587311] [DEBUG] [LOCAL ] SR: Primary data saved (24257 records). [2025-09-16T20:31:18.587467] [INFO ] [MAIN ] SR: Full history saved. [2025-09-16T20:31:18.587568] [INFO ] [MAIN ] Update Progress: 1988/2369 symbols completed. SR took 24.2s. Estimated remaining: 40m 29s. Rate: 9.4 symbols/min [2025-09-16T20:31:18.761231] [INFO ] [MAIN ] SRG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:31:18.772208] [DEBUG] [LOCAL ] SRG: Loaded 10559 existing records from primary storage. [2025-09-16T20:31:18.772324] [INFO ] [MAIN ] SRG: Loaded 10559 existing records. [2025-09-16T20:31:18.784278] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-05. [2025-09-16T20:31:18.958231] [WARN ] [MAIN ] SRG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:31:18.958496] [INFO ] [MAIN ] SRG: Wiping existing primary data before full refresh. [2025-09-16T20:31:18.958541] [INFO ] [LOCAL ] SRG: Starting deletion of primary data. [2025-09-16T20:31:18.958878] [DEBUG] [LOCAL ] SRG: Deleted primary data file. [2025-09-16T20:31:18.958924] [INFO ] [MAIN ] SRG: Starting full primary refresh. [2025-09-16T20:31:19.344539] [INFO ] [REMOTE ] SRG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:31:19.574908] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-05. [2025-09-16T20:31:19.887453] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-16T20:31:20.007953] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-16T20:31:20.374909] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-08. [2025-09-16T20:31:20.430982] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-16T20:31:21.174899] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-06. [2025-09-16T20:31:21.979968] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-02. [2025-09-16T20:31:22.000636] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-16T20:31:22.774899] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-09. [2025-09-16T20:31:22.976025] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-16T20:31:22.993904] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-16T20:31:23.533865] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-16T20:31:23.539856] [INFO ] [REMOTE ] SRE: Full fetch complete (57694 records). [2025-09-16T20:31:23.539976] [DEBUG] [VALIDATOR ] SRE: Validating primary data. [2025-09-16T20:31:23.540599] [FATAL] [VALIDATOR ] SRE: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T20:31:23.540700] [FATAL] [MAIN ] SRE: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:31:23.540738] [WARN ] [MAIN ] SRE: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:31:23.540778] [INFO ] [LOCAL ] SRE: Starting deletion of primary data. [2025-09-16T20:31:23.540836] [DEBUG] [LOCAL ] SRE: No primary data file found to delete. [2025-09-16T20:31:23.540885] [INFO ] [LOCAL ] SRE: Starting deletion of derivative data. [2025-09-16T20:31:23.540927] [DEBUG] [LOCAL ] SRE: No derivative data file found to delete. [2025-09-16T20:31:23.540991] [INFO ] [MAIN ] Update Progress: 1989/2369 symbols completed. SRE took 20.3s. Estimated remaining: 40m 23s. Rate: 9.4 symbols/min [2025-09-16T20:31:23.580120] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-07. [2025-09-16T20:31:23.715286] [INFO ] [MAIN ] SRI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:31:23.735746] [DEBUG] [LOCAL ] SRI: Loaded 20394 existing records from primary storage. [2025-09-16T20:31:23.735897] [INFO ] [MAIN ] SRI: Loaded 20394 existing records. [2025-09-16T20:31:23.912671] [WARN ] [MAIN ] SRI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:31:23.912915] [INFO ] [MAIN ] SRI: Wiping existing primary data before full refresh. [2025-09-16T20:31:23.912961] [INFO ] [LOCAL ] SRI: Starting deletion of primary data. [2025-09-16T20:31:23.913388] [DEBUG] [LOCAL ] SRI: Deleted primary data file. [2025-09-16T20:31:23.913433] [INFO ] [MAIN ] SRI: Starting full primary refresh. [2025-09-16T20:31:24.264757] [INFO ] [REMOTE ] SRI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:31:24.374908] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-02. [2025-09-16T20:31:25.174904] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-06. [2025-09-16T20:31:25.841937] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-16T20:31:25.974905] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-03. [2025-09-16T20:31:26.038156] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-16T20:31:26.352465] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-07 (2.77 seconds). [2025-09-16T20:31:26.774894] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-08. [2025-09-16T20:31:27.454670] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-16T20:31:27.574885] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-04. [2025-09-16T20:31:28.374953] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-03. [2025-09-16T20:31:28.754075] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-16T20:31:28.989144] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-16T20:31:29.174912] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-05. [2025-09-16T20:31:29.436312] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-16T20:31:29.974960] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-09. [2025-09-16T20:31:30.258898] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-16T20:31:30.774938] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-07. [2025-09-16T20:31:31.574911] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-06. [2025-09-16T20:31:31.716609] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-16T20:31:31.948001] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-16T20:31:31.953958] [INFO ] [REMOTE ] SRFM: Full fetch complete (36771 records). [2025-09-16T20:31:31.954121] [DEBUG] [VALIDATOR ] SRFM: Validating primary data. [2025-09-16T20:31:32.348026] [DEBUG] [VALIDATOR ] SRFM: All expected trading days are present. [2025-09-16T20:31:32.348123] [DEBUG] [VALIDATOR ] SRFM: Primary data validation passed. [2025-09-16T20:31:32.349014] [INFO ] [MAIN ] SRFM: Fetched primary data is valid. [2025-09-16T20:31:32.349068] [DEBUG] [LOCAL ] SRFM: Saving primary data. [2025-09-16T20:31:32.350085] [DEBUG] [LOCAL ] SRFM: Trimmed 36771 records to 29197 (keeping 150 days of data) [2025-09-16T20:31:32.399712] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-08. [2025-09-16T20:31:32.535157] [DEBUG] [LOCAL ] SRFM: Primary data saved (29197 records). [2025-09-16T20:31:32.535401] [INFO ] [MAIN ] SRFM: Full history saved. [2025-09-16T20:31:32.535577] [INFO ] [MAIN ] Update Progress: 1990/2369 symbols completed. SRFM took 25.9s. Estimated remaining: 40m 17s. Rate: 9.4 symbols/min [2025-09-16T20:31:32.653880] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-16T20:31:32.733413] [INFO ] [MAIN ] SRL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:31:32.733583] [DEBUG] [LOCAL ] SRL: No existing data file found in primary storage. [2025-09-16T20:31:32.733621] [WARN ] [MAIN ] SRL: No existing data found, performing full refresh instead. [2025-09-16T20:31:32.733774] [INFO ] [MAIN ] SRL: Wiping existing primary data before full refresh. [2025-09-16T20:31:32.733823] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-09-16T20:31:32.733867] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-09-16T20:31:32.733901] [INFO ] [MAIN ] SRL: Starting full primary refresh. [2025-09-16T20:31:33.080694] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-16T20:31:33.124805] [INFO ] [REMOTE ] SRL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:31:33.174908] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-02. [2025-09-16T20:31:33.617317] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-16T20:31:33.974959] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-03. [2025-09-16T20:31:34.393424] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-16T20:31:34.774997] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-09. [2025-09-16T20:31:35.484402] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-16T20:31:35.486139] [INFO ] [REMOTE ] SREA: Full fetch complete (11508 records). [2025-09-16T20:31:35.486225] [DEBUG] [VALIDATOR ] SREA: Validating primary data. [2025-09-16T20:31:35.580075] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-04. [2025-09-16T20:31:35.855626] [DEBUG] [VALIDATOR ] SREA: All expected trading days are present. [2025-09-16T20:31:35.855725] [DEBUG] [VALIDATOR ] SREA: Primary data validation passed. [2025-09-16T20:31:35.855987] [INFO ] [MAIN ] SREA: Fetched primary data is valid. [2025-09-16T20:31:35.856034] [DEBUG] [LOCAL ] SREA: Saving primary data. [2025-09-16T20:31:35.856467] [DEBUG] [LOCAL ] SREA: Trimmed 11508 records to 7518 (keeping 150 days of data) [2025-09-16T20:31:35.903589] [DEBUG] [LOCAL ] SREA: Primary data saved (7518 records). [2025-09-16T20:31:35.903722] [INFO ] [MAIN ] SREA: Full history saved. [2025-09-16T20:31:35.903866] [INFO ] [MAIN ] Update Progress: 1991/2369 symbols completed. SREA took 32.0s. Estimated remaining: 40m 10s. Rate: 9.4 symbols/min [2025-09-16T20:31:36.079539] [INFO ] [MAIN ] SRV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:31:36.086780] [DEBUG] [LOCAL ] SRV: Loaded 5319 existing records from primary storage. [2025-09-16T20:31:36.086871] [INFO ] [MAIN ] SRV: Loaded 5319 existing records. [2025-09-16T20:31:36.272128] [WARN ] [MAIN ] SRV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:31:36.272427] [INFO ] [MAIN ] SRV: Wiping existing primary data before full refresh. [2025-09-16T20:31:36.272487] [INFO ] [LOCAL ] SRV: Starting deletion of primary data. [2025-09-16T20:31:36.272756] [DEBUG] [LOCAL ] SRV: Deleted primary data file. [2025-09-16T20:31:36.272816] [INFO ] [MAIN ] SRV: Starting full primary refresh. [2025-09-16T20:31:36.380102] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-07. [2025-09-16T20:31:36.641334] [INFO ] [REMOTE ] SRV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:31:36.902272] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-16T20:31:37.174941] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-02. [2025-09-16T20:31:37.755185] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-16T20:31:37.814348] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-16T20:31:37.974910] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-08. [2025-09-16T20:31:38.774947] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-04. [2025-09-16T20:31:39.282792] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-16T20:31:39.283596] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-16T20:31:39.574941] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-05. [2025-09-16T20:31:40.106467] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-16T20:31:40.374904] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-06. [2025-09-16T20:31:40.841663] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-16T20:31:41.174923] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-07. [2025-09-16T20:31:41.569180] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-16T20:31:41.974909] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-03. [2025-09-16T20:31:42.774936] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-05. [2025-09-16T20:31:42.850789] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-16T20:31:43.574967] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-09. [2025-09-16T20:31:43.833038] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-16T20:31:44.374885] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-04. [2025-09-16T20:31:44.579243] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-16T20:31:44.582476] [INFO ] [REMOTE ] SRI: Full fetch complete (30912 records). [2025-09-16T20:31:44.582597] [DEBUG] [VALIDATOR ] SRI: Validating primary data. [2025-09-16T20:31:44.998456] [DEBUG] [VALIDATOR ] SRI: All expected trading days are present. [2025-09-16T20:31:44.998544] [DEBUG] [VALIDATOR ] SRI: Primary data validation passed. [2025-09-16T20:31:44.999264] [INFO ] [MAIN ] SRI: Fetched primary data is valid. [2025-09-16T20:31:44.999319] [DEBUG] [LOCAL ] SRI: Saving primary data. [2025-09-16T20:31:45.000175] [DEBUG] [LOCAL ] SRI: Trimmed 30912 records to 20511 (keeping 150 days of data) [2025-09-16T20:31:45.129099] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-16T20:31:45.129189] [DEBUG] [LOCAL ] SRI: Primary data saved (20511 records). [2025-09-16T20:31:45.129429] [INFO ] [MAIN ] SRI: Full history saved. [2025-09-16T20:31:45.132429] [INFO ] [MAIN ] Update Progress: 1992/2369 symbols completed. SRI took 21.6s. Estimated remaining: 40m 4s. Rate: 9.4 symbols/min [2025-09-16T20:31:45.180014] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-06. [2025-09-16T20:31:45.308438] [INFO ] [MAIN ] SSB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:31:45.342738] [DEBUG] [LOCAL ] SSB: Loaded 31811 existing records from primary storage. [2025-09-16T20:31:45.342877] [INFO ] [MAIN ] SSB: Loaded 31811 existing records. [2025-09-16T20:31:45.525182] [WARN ] [MAIN ] SSB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:31:45.525433] [INFO ] [MAIN ] SSB: Wiping existing primary data before full refresh. [2025-09-16T20:31:45.525480] [INFO ] [LOCAL ] SSB: Starting deletion of primary data. [2025-09-16T20:31:45.526161] [DEBUG] [LOCAL ] SSB: Deleted primary data file. [2025-09-16T20:31:45.526209] [INFO ] [MAIN ] SSB: Starting full primary refresh. [2025-09-16T20:31:45.882341] [INFO ] [REMOTE ] SSB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:31:45.974882] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-02. [2025-09-16T20:31:46.072481] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-16T20:31:46.774946] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-07. [2025-09-16T20:31:47.568825] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-16T20:31:47.575959] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-08. [2025-09-16T20:31:47.585536] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-16T20:31:48.110140] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-16T20:31:48.374900] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-05. [2025-09-16T20:31:49.174912] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-09. [2025-09-16T20:31:49.226556] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-16T20:31:49.548879] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-16T20:31:49.549574] [INFO ] [REMOTE ] SRL: Full fetch complete (1107 records). [2025-09-16T20:31:49.549671] [DEBUG] [VALIDATOR ] SRL: Validating primary data. [2025-09-16T20:31:49.734160] [WARN ] [VALIDATOR ] SRL: Validation failed - insufficient historical data. Have 146 unique days, need 150 days [2025-09-16T20:31:49.734404] [FATAL] [MAIN ] SRL: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:31:49.734473] [WARN ] [MAIN ] SRL: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:31:49.734522] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-09-16T20:31:49.734582] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-09-16T20:31:49.734619] [INFO ] [LOCAL ] SRL: Starting deletion of derivative data. [2025-09-16T20:31:49.734689] [DEBUG] [LOCAL ] SRL: No derivative data file found to delete. [2025-09-16T20:31:49.734773] [INFO ] [MAIN ] Update Progress: 1993/2369 symbols completed. SRL took 17.2s. Estimated remaining: 39m 57s. Rate: 9.4 symbols/min [2025-09-16T20:31:49.908634] [INFO ] [MAIN ] SSD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:31:49.930149] [DEBUG] [LOCAL ] SSD: Loaded 16554 existing records from primary storage. [2025-09-16T20:31:49.930310] [INFO ] [MAIN ] SSD: Loaded 16554 existing records. [2025-09-16T20:31:49.982912] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-08. [2025-09-16T20:31:50.119573] [WARN ] [MAIN ] SSD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:31:50.119840] [INFO ] [MAIN ] SSD: Wiping existing primary data before full refresh. [2025-09-16T20:31:50.119900] [INFO ] [LOCAL ] SSD: Starting deletion of primary data. [2025-09-16T20:31:50.120397] [DEBUG] [LOCAL ] SSD: Deleted primary data file. [2025-09-16T20:31:50.120444] [INFO ] [MAIN ] SSD: Starting full primary refresh. [2025-09-16T20:31:50.486500] [INFO ] [REMOTE ] SSD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:31:50.774901] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-02. [2025-09-16T20:31:51.188585] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-16T20:31:51.574908] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-06. [2025-09-16T20:31:52.101774] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-16T20:31:52.374909] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-03. [2025-09-16T20:31:52.480202] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-16T20:31:53.174903] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-07. [2025-09-16T20:31:53.955580] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-16T20:31:53.974907] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-03. [2025-09-16T20:31:54.008842] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-16T20:31:54.774958] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-09. [2025-09-16T20:31:55.296637] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-16T20:31:55.574976] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-04. [2025-09-16T20:31:55.734897] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-16T20:31:55.739773] [INFO ] [REMOTE ] SRG: Full fetch complete (17400 records). [2025-09-16T20:31:55.739981] [DEBUG] [VALIDATOR ] SRG: Validating primary data. [2025-09-16T20:31:56.167843] [DEBUG] [VALIDATOR ] SRG: All expected trading days are present. [2025-09-16T20:31:56.167995] [DEBUG] [VALIDATOR ] SRG: Primary data validation passed. [2025-09-16T20:31:56.168380] [INFO ] [MAIN ] SRG: Fetched primary data is valid. [2025-09-16T20:31:56.168420] [DEBUG] [LOCAL ] SRG: Saving primary data. [2025-09-16T20:31:56.168942] [DEBUG] [LOCAL ] SRG: Trimmed 17400 records to 10612 (keeping 150 days of data) [2025-09-16T20:31:56.230379] [DEBUG] [LOCAL ] SRG: Primary data saved (10612 records). [2025-09-16T20:31:56.230521] [INFO ] [MAIN ] SRG: Full history saved. [2025-09-16T20:31:56.230627] [INFO ] [MAIN ] Update Progress: 1994/2369 symbols completed. SRG took 37.6s. Estimated remaining: 39m 51s. Rate: 9.4 symbols/min [2025-09-16T20:31:56.380042] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-04. [2025-09-16T20:31:56.403383] [INFO ] [MAIN ] SSL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:31:56.431691] [DEBUG] [LOCAL ] SSL: Loaded 30179 existing records from primary storage. [2025-09-16T20:31:56.431832] [INFO ] [MAIN ] SSL: Loaded 30179 existing records. [2025-09-16T20:31:56.608672] [WARN ] [MAIN ] SSL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:31:56.608888] [INFO ] [MAIN ] SSL: Wiping existing primary data before full refresh. [2025-09-16T20:31:56.608936] [INFO ] [LOCAL ] SSL: Starting deletion of primary data. [2025-09-16T20:31:56.609504] [DEBUG] [LOCAL ] SSL: Deleted primary data file. [2025-09-16T20:31:56.609552] [INFO ] [MAIN ] SSL: Starting full primary refresh. [2025-09-16T20:31:56.966879] [INFO ] [REMOTE ] SSL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:31:56.986164] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-16T20:31:57.174969] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-05. [2025-09-16T20:31:57.974915] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-08. [2025-09-16T20:31:58.187709] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-16T20:31:58.237306] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-16T20:31:58.735547] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-16T20:31:58.774909] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-09. [2025-09-16T20:31:59.441016] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-16T20:31:59.442330] [INFO ] [REMOTE ] SRV: Full fetch complete (8441 records). [2025-09-16T20:31:59.442397] [DEBUG] [VALIDATOR ] SRV: Validating primary data. [2025-09-16T20:31:59.587790] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-05. [2025-09-16T20:31:59.814516] [DEBUG] [VALIDATOR ] SRV: All expected trading days are present. [2025-09-16T20:31:59.814595] [DEBUG] [VALIDATOR ] SRV: Primary data validation passed. [2025-09-16T20:31:59.814843] [INFO ] [MAIN ] SRV: Fetched primary data is valid. [2025-09-16T20:31:59.814892] [DEBUG] [LOCAL ] SRV: Saving primary data. [2025-09-16T20:31:59.815314] [DEBUG] [LOCAL ] SRV: Trimmed 8441 records to 5351 (keeping 150 days of data) [2025-09-16T20:31:59.850158] [DEBUG] [LOCAL ] SRV: Primary data saved (5351 records). [2025-09-16T20:31:59.850297] [INFO ] [MAIN ] SRV: Full history saved. [2025-09-16T20:31:59.850387] [INFO ] [MAIN ] Update Progress: 1995/2369 symbols completed. SRV took 23.9s. Estimated remaining: 39m 44s. Rate: 9.4 symbols/min [2025-09-16T20:32:00.028865] [INFO ] [MAIN ] SST: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:32:00.039421] [DEBUG] [LOCAL ] SST: Loaded 9679 existing records from primary storage. [2025-09-16T20:32:00.039565] [INFO ] [MAIN ] SST: Loaded 9679 existing records. [2025-09-16T20:32:00.257890] [WARN ] [MAIN ] SST: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:32:00.258262] [INFO ] [MAIN ] SST: Wiping existing primary data before full refresh. [2025-09-16T20:32:00.258315] [INFO ] [LOCAL ] SST: Starting deletion of primary data. [2025-09-16T20:32:00.258665] [DEBUG] [LOCAL ] SST: Deleted primary data file. [2025-09-16T20:32:00.258714] [INFO ] [MAIN ] SST: Starting full primary refresh. [2025-09-16T20:32:00.379982] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-02. [2025-09-16T20:32:00.611420] [INFO ] [REMOTE ] SST: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:32:01.174888] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-02. [2025-09-16T20:32:01.464302] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-16T20:32:01.974888] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-06. [2025-09-16T20:32:02.035219] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-16T20:32:02.140616] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-16T20:32:02.774906] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-03. [2025-09-16T20:32:03.264905] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-16T20:32:03.574906] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-03. [2025-09-16T20:32:03.704156] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-16T20:32:04.374970] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-06. [2025-09-16T20:32:05.174949] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-04. [2025-09-16T20:32:05.306442] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-16T20:32:05.981543] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-07. [2025-09-16T20:32:05.986430] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-16T20:32:06.151820] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-16T20:32:06.774902] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-07. [2025-09-16T20:32:07.021463] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-16T20:32:07.574898] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-08. [2025-09-16T20:32:08.374898] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-05. [2025-09-16T20:32:08.501136] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-16T20:32:08.561921] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-16T20:32:09.174898] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-08. [2025-09-16T20:32:09.285120] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-16T20:32:09.974897] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-06. [2025-09-16T20:32:10.763445] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-16T20:32:10.774838] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-09. [2025-09-16T20:32:11.112264] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-16T20:32:11.574912] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-09. [2025-09-16T20:32:12.047972] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-16T20:32:12.053400] [INFO ] [REMOTE ] SSB: Full fetch complete (46242 records). [2025-09-16T20:32:12.053545] [DEBUG] [VALIDATOR ] SSB: Validating primary data. [2025-09-16T20:32:12.379996] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-04. [2025-09-16T20:32:12.441321] [DEBUG] [VALIDATOR ] SSB: All expected trading days are present. [2025-09-16T20:32:12.441409] [DEBUG] [VALIDATOR ] SSB: Primary data validation passed. [2025-09-16T20:32:12.442380] [INFO ] [MAIN ] SSB: Fetched primary data is valid. [2025-09-16T20:32:12.442481] [DEBUG] [LOCAL ] SSB: Saving primary data. [2025-09-16T20:32:12.443683] [DEBUG] [LOCAL ] SSB: Trimmed 46242 records to 32137 (keeping 150 days of data) [2025-09-16T20:32:12.646925] [DEBUG] [LOCAL ] SSB: Primary data saved (32137 records). [2025-09-16T20:32:12.647071] [INFO ] [MAIN ] SSB: Full history saved. [2025-09-16T20:32:12.647156] [INFO ] [MAIN ] Update Progress: 1996/2369 symbols completed. SSB took 27.5s. Estimated remaining: 39m 39s. Rate: 9.4 symbols/min [2025-09-16T20:32:12.826847] [INFO ] [MAIN ] SSTK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:32:12.835570] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-16T20:32:12.839268] [INFO ] [REMOTE ] SSD: Full fetch complete (24506 records). [2025-09-16T20:32:12.839355] [DEBUG] [VALIDATOR ] SSD: Validating primary data. [2025-09-16T20:32:13.008109] [DEBUG] [LOCAL ] SSTK: Loaded 17985 existing records from primary storage. [2025-09-16T20:32:13.009296] [INFO ] [MAIN ] SSTK: Loaded 17985 existing records. [2025-09-16T20:32:13.177211] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-07. [2025-09-16T20:32:13.407490] [WARN ] [MAIN ] SSTK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:32:13.417967] [INFO ] [MAIN ] SSTK: Wiping existing primary data before full refresh. [2025-09-16T20:32:13.418163] [DEBUG] [VALIDATOR ] SSD: All expected trading days are present. [2025-09-16T20:32:13.418330] [DEBUG] [VALIDATOR ] SSD: Primary data validation passed. [2025-09-16T20:32:13.418269] [INFO ] [LOCAL ] SSTK: Starting deletion of primary data. [2025-09-16T20:32:13.419053] [INFO ] [MAIN ] SSD: Fetched primary data is valid. [2025-09-16T20:32:13.419146] [DEBUG] [LOCAL ] SSD: Saving primary data. [2025-09-16T20:32:13.419598] [DEBUG] [LOCAL ] SSTK: Deleted primary data file. [2025-09-16T20:32:13.419709] [INFO ] [MAIN ] SSTK: Starting full primary refresh. [2025-09-16T20:32:13.485941] [DEBUG] [LOCAL ] SSD: Trimmed 24506 records to 16733 (keeping 150 days of data) [2025-09-16T20:32:13.785546] [DEBUG] [LOCAL ] SSD: Primary data saved (16733 records). [2025-09-16T20:32:13.796599] [INFO ] [MAIN ] SSD: Full history saved. [2025-09-16T20:32:13.808292] [INFO ] [MAIN ] Update Progress: 1997/2369 symbols completed. SSD took 24.1s. Estimated remaining: 39m 31s. Rate: 9.4 symbols/min [2025-09-16T20:32:13.898009] [INFO ] [REMOTE ] SSTK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:32:13.974885] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-02. [2025-09-16T20:32:14.264147] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-16T20:32:14.310355] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-16T20:32:14.774926] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-08. [2025-09-16T20:32:15.357586] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-16T20:32:15.574971] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-05. [2025-09-16T20:32:15.762201] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-16T20:32:16.374919] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-03. [2025-09-16T20:32:17.171788] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-16T20:32:17.179929] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-09. [2025-09-16T20:32:17.477496] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-16T20:32:17.930628] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-16T20:32:17.932069] [INFO ] [REMOTE ] SST: Full fetch complete (13673 records). [2025-09-16T20:32:17.932181] [DEBUG] [VALIDATOR ] SST: Validating primary data. [2025-09-16T20:32:17.986697] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-06. [2025-09-16T20:32:18.297358] [DEBUG] [VALIDATOR ] SST: All expected trading days are present. [2025-09-16T20:32:18.297446] [DEBUG] [VALIDATOR ] SST: Primary data validation passed. [2025-09-16T20:32:18.297771] [INFO ] [MAIN ] SST: Fetched primary data is valid. [2025-09-16T20:32:18.297814] [DEBUG] [LOCAL ] SST: Saving primary data. [2025-09-16T20:32:18.298304] [DEBUG] [LOCAL ] SST: Trimmed 13673 records to 9722 (keeping 150 days of data) [2025-09-16T20:32:18.354826] [DEBUG] [LOCAL ] SST: Primary data saved (9722 records). [2025-09-16T20:32:18.354971] [INFO ] [MAIN ] SST: Full history saved. [2025-09-16T20:32:18.355064] [INFO ] [MAIN ] Update Progress: 1998/2369 symbols completed. SST took 18.5s. Estimated remaining: 39m 25s. Rate: 9.4 symbols/min [2025-09-16T20:32:18.774963] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-04. [2025-09-16T20:32:19.617508] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-16T20:32:19.626200] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-07. [2025-09-16T20:32:20.253624] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-16T20:32:20.374933] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-05. [2025-09-16T20:32:21.101388] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-16T20:32:21.174891] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-08. [2025-09-16T20:32:21.622184] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-16T20:32:21.974941] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-06. [2025-09-16T20:32:22.502613] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-16T20:32:22.774908] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-09. [2025-09-16T20:32:23.004324] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-16T20:32:23.574925] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-07. [2025-09-16T20:32:24.363785] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-16T20:32:24.369331] [INFO ] [REMOTE ] SSL: Full fetch complete (44453 records). [2025-09-16T20:32:24.369480] [DEBUG] [VALIDATOR ] SSL: Validating primary data. [2025-09-16T20:32:24.759319] [DEBUG] [VALIDATOR ] SSL: All expected trading days are present. [2025-09-16T20:32:24.759495] [DEBUG] [VALIDATOR ] SSL: Primary data validation passed. [2025-09-16T20:32:24.760499] [INFO ] [MAIN ] SSL: Fetched primary data is valid. [2025-09-16T20:32:24.760575] [DEBUG] [LOCAL ] SSL: Saving primary data. [2025-09-16T20:32:24.777365] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-16T20:32:24.777483] [DEBUG] [LOCAL ] SSL: Trimmed 44453 records to 30474 (keeping 150 days of data) [2025-09-16T20:32:24.784453] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-08. [2025-09-16T20:32:24.961033] [DEBUG] [LOCAL ] SSL: Primary data saved (30474 records). [2025-09-16T20:32:24.961192] [INFO ] [MAIN ] SSL: Full history saved. [2025-09-16T20:32:24.961283] [INFO ] [MAIN ] Update Progress: 1999/2369 symbols completed. SSL took 28.7s. Estimated remaining: 39m 18s. Rate: 9.4 symbols/min [2025-09-16T20:32:26.053428] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-16T20:32:26.059171] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-09. [2025-09-16T20:32:27.164585] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-16T20:32:27.167729] [INFO ] [REMOTE ] SSTK: Full fetch complete (30200 records). [2025-09-16T20:32:27.167805] [DEBUG] [VALIDATOR ] SSTK: Validating primary data. [2025-09-16T20:32:27.551043] [DEBUG] [VALIDATOR ] SSTK: All expected trading days are present. [2025-09-16T20:32:27.551156] [DEBUG] [VALIDATOR ] SSTK: Primary data validation passed. [2025-09-16T20:32:27.551894] [INFO ] [MAIN ] SSTK: Fetched primary data is valid. [2025-09-16T20:32:27.551959] [DEBUG] [LOCAL ] SSTK: Saving primary data. [2025-09-16T20:32:27.553074] [DEBUG] [LOCAL ] SSTK: Trimmed 30200 records to 18124 (keeping 150 days of data) [2025-09-16T20:32:27.672958] [DEBUG] [LOCAL ] SSTK: Primary data saved (18124 records). [2025-09-16T20:32:27.673108] [INFO ] [MAIN ] SSTK: Full history saved. [2025-09-16T20:32:27.673196] [INFO ] [MAIN ] Update Progress: 2000/2369 symbols completed. SSTK took 15.0s. Estimated remaining: 39m 11s. Rate: 9.4 symbols/min [2025-09-16T20:32:28.256895] [INFO ] [MAIN ] ST: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:32:28.239367] [INFO ] [MAIN ] STC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:32:28.313295] [INFO ] [MAIN ] STAG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:32:28.380941] [INFO ] [MAIN ] STE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:32:28.393665] [DEBUG] [LOCAL ] STC: Loaded 13155 existing records from primary storage. [2025-09-16T20:32:28.393854] [INFO ] [MAIN ] STC: Loaded 13155 existing records. [2025-09-16T20:32:28.591597] [DEBUG] [LOCAL ] ST: Loaded 36544 existing records from primary storage. [2025-09-16T20:32:28.622717] [WARN ] [MAIN ] STC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:32:28.622978] [INFO ] [MAIN ] STC: Wiping existing primary data before full refresh. [2025-09-16T20:32:28.623056] [INFO ] [LOCAL ] STC: Starting deletion of primary data. [2025-09-16T20:32:28.622547] [INFO ] [MAIN ] ST: Loaded 36544 existing records. [2025-09-16T20:32:28.635222] [DEBUG] [LOCAL ] STAG: Loaded 36645 existing records from primary storage. [2025-09-16T20:32:28.653624] [DEBUG] [LOCAL ] STC: Deleted primary data file. [2025-09-16T20:32:28.679435] [INFO ] [MAIN ] STC: Starting full primary refresh. [2025-09-16T20:32:28.680361] [INFO ] [MAIN ] STAG: Loaded 36645 existing records. [2025-09-16T20:32:28.782932] [DEBUG] [LOCAL ] STE: Loaded 26012 existing records from primary storage. [2025-09-16T20:32:28.819220] [INFO ] [MAIN ] STE: Loaded 26012 existing records. [2025-09-16T20:32:29.070983] [WARN ] [MAIN ] ST: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:32:29.144032] [INFO ] [MAIN ] ST: Wiping existing primary data before full refresh. [2025-09-16T20:32:29.164731] [INFO ] [LOCAL ] ST: Starting deletion of primary data. [2025-09-16T20:32:29.247895] [DEBUG] [LOCAL ] ST: Deleted primary data file. [2025-09-16T20:32:29.232433] [WARN ] [MAIN ] STAG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:32:29.389522] [INFO ] [MAIN ] STAG: Wiping existing primary data before full refresh. [2025-09-16T20:32:29.389725] [INFO ] [LOCAL ] STAG: Starting deletion of primary data. [2025-09-16T20:32:29.371436] [INFO ] [MAIN ] ST: Starting full primary refresh. [2025-09-16T20:32:29.364543] [WARN ] [MAIN ] STE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:32:29.405953] [DEBUG] [LOCAL ] STAG: Deleted primary data file. [2025-09-16T20:32:29.421700] [INFO ] [MAIN ] STAG: Starting full primary refresh. [2025-09-16T20:32:29.421582] [INFO ] [MAIN ] STE: Wiping existing primary data before full refresh. [2025-09-16T20:32:29.496375] [INFO ] [LOCAL ] STE: Starting deletion of primary data. [2025-09-16T20:32:29.596043] [DEBUG] [LOCAL ] STE: Deleted primary data file. [2025-09-16T20:32:29.624873] [INFO ] [MAIN ] STE: Starting full primary refresh. [2025-09-16T20:32:29.842477] [INFO ] [REMOTE ] STC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:32:29.898295] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-02. [2025-09-16T20:32:30.507230] [INFO ] [REMOTE ] ST: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:32:30.529515] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-02. [2025-09-16T20:32:30.662319] [INFO ] [REMOTE ] STAG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:32:30.667576] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-02. [2025-09-16T20:32:30.667321] [INFO ] [REMOTE ] STE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:32:30.668605] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-02. [2025-09-16T20:32:31.188931] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-16T20:32:31.192837] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-03. [2025-09-16T20:32:31.907212] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-16T20:32:31.914335] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-03. [2025-09-16T20:32:32.004019] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-16T20:32:32.008796] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-04. [2025-09-16T20:32:32.132427] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-16T20:32:32.146400] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-03. [2025-09-16T20:32:32.611800] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-16T20:32:32.621368] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-03. [2025-09-16T20:32:33.177853] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-16T20:32:33.182152] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-05. [2025-09-16T20:32:33.294376] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-16T20:32:33.754608] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-16T20:32:33.975355] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-04. [2025-09-16T20:32:34.011695] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-16T20:32:34.418888] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-16T20:32:34.774931] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-04. [2025-09-16T20:32:35.574910] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-04. [2025-09-16T20:32:35.884849] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-16T20:32:36.374898] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-05. [2025-09-16T20:32:36.599803] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-16T20:32:36.759338] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-16T20:32:37.174914] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-06. [2025-09-16T20:32:37.974918] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-05. [2025-09-16T20:32:38.303511] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-16T20:32:38.342794] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-16T20:32:38.774948] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-07. [2025-09-16T20:32:39.574868] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-05. [2025-09-16T20:32:39.651957] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-16T20:32:39.908452] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-16T20:32:40.374902] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-06. [2025-09-16T20:32:40.976456] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-16T20:32:41.174909] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-06. [2025-09-16T20:32:41.974881] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-08. [2025-09-16T20:32:42.013562] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-16T20:32:42.618163] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-16T20:32:42.774868] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-06. [2025-09-16T20:32:43.177932] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-16T20:32:43.574927] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-07. [2025-09-16T20:32:44.293857] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-16T20:32:44.374957] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-07. [2025-09-16T20:32:45.174877] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-07. [2025-09-16T20:32:45.282198] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-16T20:32:45.925312] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-16T20:32:45.974858] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-08. [2025-09-16T20:32:46.774886] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-09. [2025-09-16T20:32:46.823552] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-16T20:32:47.437874] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-16T20:32:47.574925] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-08. [2025-09-16T20:32:47.589402] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-16T20:32:47.593843] [INFO ] [REMOTE ] STC: Full fetch complete (19335 records). [2025-09-16T20:32:47.596210] [DEBUG] [VALIDATOR ] STC: Validating primary data. [2025-09-16T20:32:48.163088] [DEBUG] [VALIDATOR ] STC: All expected trading days are present. [2025-09-16T20:32:48.163199] [DEBUG] [VALIDATOR ] STC: Primary data validation passed. [2025-09-16T20:32:48.163767] [INFO ] [MAIN ] STC: Fetched primary data is valid. [2025-09-16T20:32:48.163819] [DEBUG] [LOCAL ] STC: Saving primary data. [2025-09-16T20:32:48.164798] [DEBUG] [LOCAL ] STC: Trimmed 19335 records to 13235 (keeping 150 days of data) [2025-09-16T20:32:48.257454] [DEBUG] [LOCAL ] STC: Primary data saved (13235 records). [2025-09-16T20:32:48.257628] [INFO ] [MAIN ] STC: Full history saved. [2025-09-16T20:32:48.257743] [INFO ] [MAIN ] Update Progress: 2001/2369 symbols completed. STC took 20.6s. Estimated remaining: 39m 8s. Rate: 9.4 symbols/min [2025-09-16T20:32:48.380072] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-09. [2025-09-16T20:32:48.465316] [INFO ] [MAIN ] STEL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:32:48.483696] [DEBUG] [LOCAL ] STEL: Loaded 16582 existing records from primary storage. [2025-09-16T20:32:48.483873] [INFO ] [MAIN ] STEL: Loaded 16582 existing records. [2025-09-16T20:32:48.683663] [WARN ] [MAIN ] STEL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:32:48.683957] [INFO ] [MAIN ] STEL: Wiping existing primary data before full refresh. [2025-09-16T20:32:48.684008] [INFO ] [LOCAL ] STEL: Starting deletion of primary data. [2025-09-16T20:32:48.684554] [DEBUG] [LOCAL ] STEL: Deleted primary data file. [2025-09-16T20:32:48.684604] [INFO ] [MAIN ] STEL: Starting full primary refresh. [2025-09-16T20:32:49.047733] [INFO ] [REMOTE ] STEL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:32:49.174917] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-08. [2025-09-16T20:32:49.472774] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-16T20:32:49.683696] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-16T20:32:49.688062] [INFO ] [REMOTE ] STE: Full fetch complete (38166 records). [2025-09-16T20:32:49.688170] [DEBUG] [VALIDATOR ] STE: Validating primary data. [2025-09-16T20:32:49.980008] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-09. [2025-09-16T20:32:50.078684] [DEBUG] [VALIDATOR ] STE: All expected trading days are present. [2025-09-16T20:32:50.078769] [DEBUG] [VALIDATOR ] STE: Primary data validation passed. [2025-09-16T20:32:50.079610] [INFO ] [MAIN ] STE: Fetched primary data is valid. [2025-09-16T20:32:50.079681] [DEBUG] [LOCAL ] STE: Saving primary data. [2025-09-16T20:32:50.080760] [DEBUG] [LOCAL ] STE: Trimmed 38166 records to 26260 (keeping 150 days of data) [2025-09-16T20:32:50.248424] [DEBUG] [LOCAL ] STE: Primary data saved (26260 records). [2025-09-16T20:32:50.248561] [INFO ] [MAIN ] STE: Full history saved. [2025-09-16T20:32:50.248663] [INFO ] [MAIN ] Update Progress: 2002/2369 symbols completed. STE took 22.6s. Estimated remaining: 39m 0s. Rate: 9.4 symbols/min [2025-09-16T20:32:50.441796] [INFO ] [MAIN ] STEM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:32:50.469399] [DEBUG] [LOCAL ] STEM: Loaded 28138 existing records from primary storage. [2025-09-16T20:32:50.469548] [INFO ] [MAIN ] STEM: Loaded 28138 existing records. [2025-09-16T20:32:50.658836] [WARN ] [MAIN ] STEM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:32:50.659119] [INFO ] [MAIN ] STEM: Wiping existing primary data before full refresh. [2025-09-16T20:32:50.659176] [INFO ] [LOCAL ] STEM: Starting deletion of primary data. [2025-09-16T20:32:50.659848] [DEBUG] [LOCAL ] STEM: Deleted primary data file. [2025-09-16T20:32:50.659899] [INFO ] [MAIN ] STEM: Starting full primary refresh. [2025-09-16T20:32:50.780077] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-02. [2025-09-16T20:32:51.050467] [INFO ] [REMOTE ] STEM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:32:51.080625] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-16T20:32:51.390408] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-16T20:32:51.398138] [INFO ] [REMOTE ] ST: Full fetch complete (54336 records). [2025-09-16T20:32:51.398333] [DEBUG] [VALIDATOR ] ST: Validating primary data. [2025-09-16T20:32:51.584418] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-09. [2025-09-16T20:32:51.809869] [DEBUG] [VALIDATOR ] ST: All expected trading days are present. [2025-09-16T20:32:51.809963] [DEBUG] [VALIDATOR ] ST: Primary data validation passed. [2025-09-16T20:32:51.811085] [INFO ] [MAIN ] ST: Fetched primary data is valid. [2025-09-16T20:32:51.811140] [DEBUG] [LOCAL ] ST: Saving primary data. [2025-09-16T20:32:51.812446] [DEBUG] [LOCAL ] ST: Trimmed 54336 records to 36896 (keeping 150 days of data) [2025-09-16T20:32:51.931786] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-16T20:32:52.058703] [DEBUG] [LOCAL ] ST: Primary data saved (36896 records). [2025-09-16T20:32:52.058875] [INFO ] [MAIN ] ST: Full history saved. [2025-09-16T20:32:52.058978] [INFO ] [MAIN ] Update Progress: 2003/2369 symbols completed. ST took 24.4s. Estimated remaining: 38m 53s. Rate: 9.4 symbols/min [2025-09-16T20:32:52.235475] [INFO ] [MAIN ] STEW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:32:52.247499] [DEBUG] [LOCAL ] STEW: Loaded 11162 existing records from primary storage. [2025-09-16T20:32:52.247620] [INFO ] [MAIN ] STEW: Loaded 11162 existing records. [2025-09-16T20:32:52.380088] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-03. [2025-09-16T20:32:52.432582] [WARN ] [MAIN ] STEW: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:32:52.432815] [INFO ] [MAIN ] STEW: Wiping existing primary data before full refresh. [2025-09-16T20:32:52.432862] [INFO ] [LOCAL ] STEW: Starting deletion of primary data. [2025-09-16T20:32:52.433215] [DEBUG] [LOCAL ] STEW: Deleted primary data file. [2025-09-16T20:32:52.433261] [INFO ] [MAIN ] STEW: Starting full primary refresh. [2025-09-16T20:32:52.806602] [INFO ] [REMOTE ] STEW: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:32:53.175005] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-02. [2025-09-16T20:32:53.209466] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-16T20:32:53.215417] [INFO ] [REMOTE ] STAG: Full fetch complete (54260 records). [2025-09-16T20:32:53.215543] [DEBUG] [VALIDATOR ] STAG: Validating primary data. [2025-09-16T20:32:53.589565] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-16T20:32:53.712838] [DEBUG] [VALIDATOR ] STAG: All expected trading days are present. [2025-09-16T20:32:53.713018] [DEBUG] [VALIDATOR ] STAG: Primary data validation passed. [2025-09-16T20:32:53.715141] [INFO ] [MAIN ] STAG: Fetched primary data is valid. [2025-09-16T20:32:53.715324] [DEBUG] [LOCAL ] STAG: Saving primary data. [2025-09-16T20:32:53.717401] [DEBUG] [LOCAL ] STAG: Trimmed 54260 records to 36988 (keeping 150 days of data) [2025-09-16T20:32:53.843050] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-16T20:32:53.961295] [DEBUG] [LOCAL ] STAG: Primary data saved (36988 records). [2025-09-16T20:32:53.961446] [INFO ] [MAIN ] STAG: Full history saved. [2025-09-16T20:32:53.961531] [INFO ] [MAIN ] Update Progress: 2004/2369 symbols completed. STAG took 26.3s. Estimated remaining: 38m 46s. Rate: 9.4 symbols/min [2025-09-16T20:32:53.982693] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-02. [2025-09-16T20:32:54.134944] [INFO ] [MAIN ] STG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:32:54.135113] [DEBUG] [LOCAL ] STG: No existing data file found in primary storage. [2025-09-16T20:32:54.135150] [WARN ] [MAIN ] STG: No existing data found, performing full refresh instead. [2025-09-16T20:32:54.135285] [INFO ] [MAIN ] STG: Wiping existing primary data before full refresh. [2025-09-16T20:32:54.135325] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-09-16T20:32:54.135366] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-09-16T20:32:54.135399] [INFO ] [MAIN ] STG: Starting full primary refresh. [2025-09-16T20:32:54.486094] [INFO ] [REMOTE ] STG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:32:54.774928] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-04. [2025-09-16T20:32:55.574915] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-03. [2025-09-16T20:32:55.906056] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-16T20:32:56.106347] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-16T20:32:56.374954] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-03. [2025-09-16T20:32:56.774544] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-16T20:32:57.174939] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-05. [2025-09-16T20:32:57.974932] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-04. [2025-09-16T20:32:58.215812] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-16T20:32:58.371769] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-16T20:32:58.774909] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-04. [2025-09-16T20:32:58.881846] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-16T20:32:59.574936] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-05. [2025-09-16T20:33:00.374951] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-02. [2025-09-16T20:33:00.547183] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-16T20:33:00.617975] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-16T20:33:00.768828] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-16T20:33:01.174919] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-06. [2025-09-16T20:33:01.974940] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-06. [2025-09-16T20:33:02.177904] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-16T20:33:02.774868] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-07. [2025-09-16T20:33:03.077265] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-16T20:33:03.574914] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-05. [2025-09-16T20:33:04.007846] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-16T20:33:04.374943] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-07. [2025-09-16T20:33:05.079265] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-16T20:33:05.174958] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-03. [2025-09-16T20:33:05.393310] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-16T20:33:05.536722] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-16T20:33:05.974920] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-06. [2025-09-16T20:33:06.774934] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-08. [2025-09-16T20:33:07.571945] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-16T20:33:07.580809] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-04. [2025-09-16T20:33:07.647589] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-16T20:33:07.960216] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-16T20:33:08.374938] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-09. [2025-09-16T20:33:09.102838] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-16T20:33:09.104710] [INFO ] [REMOTE ] STEW: Full fetch complete (17363 records). [2025-09-16T20:33:09.104778] [DEBUG] [VALIDATOR ] STEW: Validating primary data. [2025-09-16T20:33:09.180127] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-07. [2025-09-16T20:33:09.479192] [DEBUG] [VALIDATOR ] STEW: All expected trading days are present. [2025-09-16T20:33:09.479272] [DEBUG] [VALIDATOR ] STEW: Primary data validation passed. [2025-09-16T20:33:09.479707] [INFO ] [MAIN ] STEW: Fetched primary data is valid. [2025-09-16T20:33:09.479768] [DEBUG] [LOCAL ] STEW: Saving primary data. [2025-09-16T20:33:09.480375] [DEBUG] [LOCAL ] STEW: Trimmed 17363 records to 11286 (keeping 150 days of data) [2025-09-16T20:33:09.551126] [DEBUG] [LOCAL ] STEW: Primary data saved (11286 records). [2025-09-16T20:33:09.551264] [INFO ] [MAIN ] STEW: Full history saved. [2025-09-16T20:33:09.551367] [INFO ] [MAIN ] Update Progress: 2005/2369 symbols completed. STEW took 17.5s. Estimated remaining: 38m 41s. Rate: 9.4 symbols/min [2025-09-16T20:33:09.725253] [INFO ] [MAIN ] STK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:33:09.733267] [DEBUG] [LOCAL ] STK: Loaded 6438 existing records from primary storage. [2025-09-16T20:33:09.733369] [INFO ] [MAIN ] STK: Loaded 6438 existing records. [2025-09-16T20:33:09.920245] [WARN ] [MAIN ] STK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:33:09.920540] [INFO ] [MAIN ] STK: Wiping existing primary data before full refresh. [2025-09-16T20:33:09.920588] [INFO ] [LOCAL ] STK: Starting deletion of primary data. [2025-09-16T20:33:09.920913] [DEBUG] [LOCAL ] STK: Deleted primary data file. [2025-09-16T20:33:09.920962] [INFO ] [MAIN ] STK: Starting full primary refresh. [2025-09-16T20:33:09.986006] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-05. [2025-09-16T20:33:10.280945] [INFO ] [REMOTE ] STK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:33:10.414518] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-16T20:33:10.734390] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-16T20:33:10.774862] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-08. [2025-09-16T20:33:11.574927] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-06. [2025-09-16T20:33:11.982502] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-16T20:33:12.168133] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-16T20:33:12.374917] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-09. [2025-09-16T20:33:13.174910] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-07. [2025-09-16T20:33:13.546903] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-16T20:33:13.551124] [INFO ] [REMOTE ] STEM: Full fetch complete (44827 records). [2025-09-16T20:33:13.551259] [DEBUG] [VALIDATOR ] STEM: Validating primary data. [2025-09-16T20:33:13.948400] [DEBUG] [VALIDATOR ] STEM: All expected trading days are present. [2025-09-16T20:33:13.948506] [DEBUG] [VALIDATOR ] STEM: Primary data validation passed. [2025-09-16T20:33:13.949470] [INFO ] [MAIN ] STEM: Fetched primary data is valid. [2025-09-16T20:33:13.949521] [DEBUG] [LOCAL ] STEM: Saving primary data. [2025-09-16T20:33:13.950609] [DEBUG] [LOCAL ] STEM: Trimmed 44827 records to 28350 (keeping 150 days of data) [2025-09-16T20:33:14.000817] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-08. [2025-09-16T20:33:14.047673] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-16T20:33:14.127269] [DEBUG] [LOCAL ] STEM: Primary data saved (28350 records). [2025-09-16T20:33:14.127408] [INFO ] [MAIN ] STEM: Full history saved. [2025-09-16T20:33:14.127491] [INFO ] [MAIN ] Update Progress: 2006/2369 symbols completed. STEM took 23.9s. Estimated remaining: 38m 35s. Rate: 9.4 symbols/min [2025-09-16T20:33:14.299721] [INFO ] [MAIN ] STLA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:33:14.343780] [DEBUG] [LOCAL ] STLA: Loaded 39536 existing records from primary storage. [2025-09-16T20:33:14.343948] [INFO ] [MAIN ] STLA: Loaded 39536 existing records. [2025-09-16T20:33:14.523443] [WARN ] [MAIN ] STLA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:33:14.523739] [INFO ] [MAIN ] STLA: Wiping existing primary data before full refresh. [2025-09-16T20:33:14.523800] [INFO ] [LOCAL ] STLA: Starting deletion of primary data. [2025-09-16T20:33:14.524569] [DEBUG] [LOCAL ] STLA: Deleted primary data file. [2025-09-16T20:33:14.524623] [INFO ] [MAIN ] STLA: Starting full primary refresh. [2025-09-16T20:33:14.780075] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-02. [2025-09-16T20:33:14.882784] [INFO ] [REMOTE ] STLA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:33:15.135902] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-16T20:33:15.574958] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-09. [2025-09-16T20:33:15.711591] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-16T20:33:16.374902] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-02. [2025-09-16T20:33:16.485244] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-16T20:33:16.488552] [INFO ] [REMOTE ] STEL: Full fetch complete (25508 records). [2025-09-16T20:33:16.488692] [DEBUG] [VALIDATOR ] STEL: Validating primary data. [2025-09-16T20:33:16.867401] [DEBUG] [VALIDATOR ] STEL: All expected trading days are present. [2025-09-16T20:33:16.867493] [DEBUG] [VALIDATOR ] STEL: Primary data validation passed. [2025-09-16T20:33:16.868043] [INFO ] [MAIN ] STEL: Fetched primary data is valid. [2025-09-16T20:33:16.868089] [DEBUG] [LOCAL ] STEL: Saving primary data. [2025-09-16T20:33:16.869250] [DEBUG] [LOCAL ] STEL: Trimmed 25508 records to 16712 (keeping 150 days of data) [2025-09-16T20:33:16.975398] [DEBUG] [LOCAL ] STEL: Primary data saved (16712 records). [2025-09-16T20:33:16.975555] [INFO ] [MAIN ] STEL: Full history saved. [2025-09-16T20:33:16.975660] [INFO ] [MAIN ] Update Progress: 2007/2369 symbols completed. STEL took 28.7s. Estimated remaining: 38m 28s. Rate: 9.4 symbols/min [2025-09-16T20:33:17.150036] [INFO ] [MAIN ] STM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:33:17.174966] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-03. [2025-09-16T20:33:17.189741] [DEBUG] [LOCAL ] STM: Loaded 39560 existing records from primary storage. [2025-09-16T20:33:17.189895] [INFO ] [MAIN ] STM: Loaded 39560 existing records. [2025-09-16T20:33:17.370842] [WARN ] [MAIN ] STM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:33:17.371125] [INFO ] [MAIN ] STM: Wiping existing primary data before full refresh. [2025-09-16T20:33:17.371181] [INFO ] [LOCAL ] STM: Starting deletion of primary data. [2025-09-16T20:33:17.372001] [DEBUG] [LOCAL ] STM: Deleted primary data file. [2025-09-16T20:33:17.372051] [INFO ] [MAIN ] STM: Starting full primary refresh. [2025-09-16T20:33:17.737715] [INFO ] [REMOTE ] STM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:33:17.974890] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-02. [2025-09-16T20:33:18.028451] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-16T20:33:18.549627] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-16T20:33:18.774906] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-03. [2025-09-16T20:33:19.574926] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-08. [2025-09-16T20:33:19.906507] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-16T20:33:20.025619] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-16T20:33:20.374888] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-09. [2025-09-16T20:33:20.697779] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-16T20:33:20.698570] [INFO ] [REMOTE ] STG: Full fetch complete (2073 records). [2025-09-16T20:33:20.698636] [DEBUG] [VALIDATOR ] STG: Validating primary data. [2025-09-16T20:33:20.878680] [WARN ] [VALIDATOR ] STG: Validation failed - insufficient historical data. Have 140 unique days, need 150 days [2025-09-16T20:33:20.878904] [FATAL] [MAIN ] STG: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:33:20.879115] [WARN ] [MAIN ] STG: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:33:20.879172] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-09-16T20:33:20.879274] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-09-16T20:33:20.879320] [INFO ] [LOCAL ] STG: Starting deletion of derivative data. [2025-09-16T20:33:20.879371] [DEBUG] [LOCAL ] STG: No derivative data file found to delete. [2025-09-16T20:33:20.879461] [INFO ] [MAIN ] Update Progress: 2008/2369 symbols completed. STG took 26.9s. Estimated remaining: 38m 21s. Rate: 9.4 symbols/min [2025-09-16T20:33:21.040010] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-16T20:33:21.101686] [INFO ] [MAIN ] STN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:33:21.119313] [DEBUG] [LOCAL ] STN: Loaded 16896 existing records from primary storage. [2025-09-16T20:33:21.119456] [INFO ] [MAIN ] STN: Loaded 16896 existing records. [2025-09-16T20:33:21.180957] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-04. [2025-09-16T20:33:21.300929] [WARN ] [MAIN ] STN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:33:21.301198] [INFO ] [MAIN ] STN: Wiping existing primary data before full refresh. [2025-09-16T20:33:21.301275] [INFO ] [LOCAL ] STN: Starting deletion of primary data. [2025-09-16T20:33:21.301737] [DEBUG] [LOCAL ] STN: Deleted primary data file. [2025-09-16T20:33:21.301793] [INFO ] [MAIN ] STN: Starting full primary refresh. [2025-09-16T20:33:21.651918] [INFO ] [REMOTE ] STN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:33:21.974882] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-04. [2025-09-16T20:33:22.184347] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-16T20:33:22.774908] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-03. [2025-09-16T20:33:23.574901] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-02. [2025-09-16T20:33:24.378617] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-05. [2025-09-16T20:33:24.385365] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-09-16T20:33:24.486477] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-16T20:33:24.825825] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-16T20:33:25.174900] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-04. [2025-09-16T20:33:25.220434] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-16T20:33:25.974906] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-05. [2025-09-16T20:33:26.774899] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-03. [2025-09-16T20:33:27.425630] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-16T20:33:27.574900] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-05. [2025-09-16T20:33:28.037807] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-16T20:33:28.129854] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-16T20:33:28.374933] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-04. [2025-09-16T20:33:29.174877] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-06. [2025-09-16T20:33:29.462963] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-16T20:33:29.620002] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-16T20:33:29.974916] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-06. [2025-09-16T20:33:30.774866] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-06. [2025-09-16T20:33:31.242223] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-16T20:33:31.527073] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-16T20:33:31.574877] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-07. [2025-09-16T20:33:31.628765] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-16T20:33:32.374909] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-07. [2025-09-16T20:33:33.174929] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-07. [2025-09-16T20:33:33.206635] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-16T20:33:33.720896] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-16T20:33:33.974914] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-08. [2025-09-16T20:33:34.774895] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-08. [2025-09-16T20:33:34.961993] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-16T20:33:35.272576] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-16T20:33:35.574906] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-08. [2025-09-16T20:33:36.155804] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-16T20:33:36.374877] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-09. [2025-09-16T20:33:37.174921] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-05. [2025-09-16T20:33:37.706851] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-16T20:33:37.956906] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-16T20:33:37.964043] [INFO ] [REMOTE ] STLA: Full fetch complete (58209 records). [2025-09-16T20:33:37.964179] [DEBUG] [VALIDATOR ] STLA: Validating primary data. [2025-09-16T20:33:37.979984] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-09. [2025-09-16T20:33:38.367073] [DEBUG] [VALIDATOR ] STLA: All expected trading days are present. [2025-09-16T20:33:38.367150] [DEBUG] [VALIDATOR ] STLA: Primary data validation passed. [2025-09-16T20:33:38.368076] [INFO ] [MAIN ] STLA: Fetched primary data is valid. [2025-09-16T20:33:38.368144] [DEBUG] [LOCAL ] STLA: Saving primary data. [2025-09-16T20:33:38.369353] [DEBUG] [LOCAL ] STLA: Trimmed 58209 records to 39924 (keeping 150 days of data) [2025-09-16T20:33:38.502563] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-16T20:33:38.639233] [DEBUG] [LOCAL ] STLA: Primary data saved (39924 records). [2025-09-16T20:33:38.639406] [INFO ] [MAIN ] STLA: Full history saved. [2025-09-16T20:33:38.639547] [INFO ] [MAIN ] Update Progress: 2009/2369 symbols completed. STLA took 24.5s. Estimated remaining: 38m 16s. Rate: 9.4 symbols/min [2025-09-16T20:33:38.785404] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-06. [2025-09-16T20:33:38.822836] [INFO ] [MAIN ] STNG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:33:38.823684] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-16T20:33:38.826274] [INFO ] [REMOTE ] STK: Full fetch complete (10266 records). [2025-09-16T20:33:38.826473] [DEBUG] [VALIDATOR ] STK: Validating primary data. [2025-09-16T20:33:39.140619] [DEBUG] [LOCAL ] STNG: Loaded 32291 existing records from primary storage. [2025-09-16T20:33:39.146462] [INFO ] [MAIN ] STNG: Loaded 32291 existing records. [2025-09-16T20:33:39.335080] [DEBUG] [VALIDATOR ] STK: All expected trading days are present. [2025-09-16T20:33:39.335217] [DEBUG] [VALIDATOR ] STK: Primary data validation passed. [2025-09-16T20:33:39.346264] [INFO ] [MAIN ] STK: Fetched primary data is valid. [2025-09-16T20:33:39.346348] [DEBUG] [LOCAL ] STK: Saving primary data. [2025-09-16T20:33:39.411975] [DEBUG] [LOCAL ] STK: Trimmed 10266 records to 6525 (keeping 150 days of data) [2025-09-16T20:33:39.416462] [WARN ] [MAIN ] STNG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:33:39.416952] [INFO ] [MAIN ] STNG: Wiping existing primary data before full refresh. [2025-09-16T20:33:39.417211] [INFO ] [LOCAL ] STNG: Starting deletion of primary data. [2025-09-16T20:33:39.417852] [DEBUG] [LOCAL ] STNG: Deleted primary data file. [2025-09-16T20:33:39.417916] [INFO ] [MAIN ] STNG: Starting full primary refresh. [2025-09-16T20:33:39.575290] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-09. [2025-09-16T20:33:39.819718] [DEBUG] [LOCAL ] STK: Primary data saved (6525 records). [2025-09-16T20:33:39.836175] [INFO ] [MAIN ] STK: Full history saved. [2025-09-16T20:33:39.839569] [INFO ] [MAIN ] Update Progress: 2010/2369 symbols completed. STK took 30.3s. Estimated remaining: 38m 9s. Rate: 9.4 symbols/min [2025-09-16T20:33:39.839426] [INFO ] [REMOTE ] STNG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:33:40.018554] [INFO ] [MAIN ] STRV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:33:40.032324] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-16T20:33:40.043258] [DEBUG] [LOCAL ] STRV: Loaded 7590 existing records from primary storage. [2025-09-16T20:33:40.043353] [INFO ] [MAIN ] STRV: Loaded 7590 existing records. [2025-09-16T20:33:40.219490] [WARN ] [MAIN ] STRV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:33:40.219763] [INFO ] [MAIN ] STRV: Wiping existing primary data before full refresh. [2025-09-16T20:33:40.219813] [INFO ] [LOCAL ] STRV: Starting deletion of primary data. [2025-09-16T20:33:40.220123] [DEBUG] [LOCAL ] STRV: Deleted primary data file. [2025-09-16T20:33:40.220176] [INFO ] [MAIN ] STRV: Starting full primary refresh. [2025-09-16T20:33:40.392749] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-02. [2025-09-16T20:33:40.573811] [INFO ] [REMOTE ] STRV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:33:41.174883] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-07. [2025-09-16T20:33:41.524322] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-16T20:33:41.531073] [INFO ] [REMOTE ] STM: Full fetch complete (58243 records). [2025-09-16T20:33:41.531186] [DEBUG] [VALIDATOR ] STM: Validating primary data. [2025-09-16T20:33:41.939886] [DEBUG] [VALIDATOR ] STM: All expected trading days are present. [2025-09-16T20:33:41.939964] [DEBUG] [VALIDATOR ] STM: Primary data validation passed. [2025-09-16T20:33:41.940914] [INFO ] [MAIN ] STM: Fetched primary data is valid. [2025-09-16T20:33:41.940959] [DEBUG] [LOCAL ] STM: Saving primary data. [2025-09-16T20:33:41.942169] [DEBUG] [LOCAL ] STM: Trimmed 58243 records to 39950 (keeping 150 days of data) [2025-09-16T20:33:42.005026] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-02. [2025-09-16T20:33:42.195288] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-16T20:33:42.227503] [DEBUG] [LOCAL ] STM: Primary data saved (39950 records). [2025-09-16T20:33:42.227623] [INFO ] [MAIN ] STM: Full history saved. [2025-09-16T20:33:42.227738] [INFO ] [MAIN ] Update Progress: 2011/2369 symbols completed. STM took 25.3s. Estimated remaining: 38m 2s. Rate: 9.4 symbols/min [2025-09-16T20:33:42.412307] [INFO ] [MAIN ] STT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:33:42.412593] [DEBUG] [LOCAL ] STT: No existing data file found in primary storage. [2025-09-16T20:33:42.412663] [WARN ] [MAIN ] STT: No existing data found, performing full refresh instead. [2025-09-16T20:33:42.412823] [INFO ] [MAIN ] STT: Wiping existing primary data before full refresh. [2025-09-16T20:33:42.412964] [INFO ] [LOCAL ] STT: Starting deletion of primary data. [2025-09-16T20:33:42.413040] [DEBUG] [LOCAL ] STT: No primary data file found to delete. [2025-09-16T20:33:42.413095] [INFO ] [MAIN ] STT: Starting full primary refresh. [2025-09-16T20:33:42.619267] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-16T20:33:42.799899] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-03. [2025-09-16T20:33:42.804032] [INFO ] [REMOTE ] STT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:33:42.938851] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-16T20:33:43.574934] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-03. [2025-09-16T20:33:44.374920] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-02. [2025-09-16T20:33:44.477134] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-16T20:33:44.524284] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-16T20:33:45.174941] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-04. [2025-09-16T20:33:45.974860] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-04. [2025-09-16T20:33:46.121100] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-16T20:33:46.418263] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-16T20:33:46.774884] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-03. [2025-09-16T20:33:47.575009] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-08. [2025-09-16T20:33:47.778413] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-16T20:33:48.277609] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-16T20:33:48.374896] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-05. [2025-09-16T20:33:48.944839] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-16T20:33:49.002861] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-16T20:33:49.174907] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-09. [2025-09-16T20:33:49.974887] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-04. [2025-09-16T20:33:50.138750] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-16T20:33:50.142034] [INFO ] [REMOTE ] STN: Full fetch complete (25289 records). [2025-09-16T20:33:50.142124] [DEBUG] [VALIDATOR ] STN: Validating primary data. [2025-09-16T20:33:50.520403] [DEBUG] [VALIDATOR ] STN: All expected trading days are present. [2025-09-16T20:33:50.520489] [DEBUG] [VALIDATOR ] STN: Primary data validation passed. [2025-09-16T20:33:50.521035] [INFO ] [MAIN ] STN: Fetched primary data is valid. [2025-09-16T20:33:50.521078] [DEBUG] [LOCAL ] STN: Saving primary data. [2025-09-16T20:33:50.521711] [DEBUG] [LOCAL ] STN: Trimmed 25289 records to 17015 (keeping 150 days of data) [2025-09-16T20:33:50.636551] [DEBUG] [LOCAL ] STN: Primary data saved (17015 records). [2025-09-16T20:33:50.636724] [INFO ] [MAIN ] STN: Full history saved. [2025-09-16T20:33:50.636843] [INFO ] [MAIN ] Update Progress: 2012/2369 symbols completed. STN took 29.8s. Estimated remaining: 37m 56s. Rate: 9.4 symbols/min [2025-09-16T20:33:50.780615] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-06. [2025-09-16T20:33:50.815002] [INFO ] [MAIN ] STVN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:33:50.834737] [DEBUG] [LOCAL ] STVN: Loaded 19277 existing records from primary storage. [2025-09-16T20:33:50.834881] [INFO ] [MAIN ] STVN: Loaded 19277 existing records. [2025-09-16T20:33:51.050882] [WARN ] [MAIN ] STVN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:33:51.051149] [INFO ] [MAIN ] STVN: Wiping existing primary data before full refresh. [2025-09-16T20:33:51.051197] [INFO ] [LOCAL ] STVN: Starting deletion of primary data. [2025-09-16T20:33:51.051688] [DEBUG] [LOCAL ] STVN: Deleted primary data file. [2025-09-16T20:33:51.051738] [INFO ] [MAIN ] STVN: Starting full primary refresh. [2025-09-16T20:33:51.411289] [INFO ] [REMOTE ] STVN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:33:51.574872] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-02. [2025-09-16T20:33:51.795074] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-16T20:33:51.939739] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-16T20:33:52.374945] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-07. [2025-09-16T20:33:52.735682] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-16T20:33:53.174957] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-05. [2025-09-16T20:33:53.193635] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-16T20:33:53.974916] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-03. [2025-09-16T20:33:54.640919] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-16T20:33:54.774866] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-06. [2025-09-16T20:33:55.236341] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-16T20:33:55.574969] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-05. [2025-09-16T20:33:56.374881] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-08. [2025-09-16T20:33:56.432701] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-16T20:33:57.131895] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-16T20:33:57.181001] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-09. [2025-09-16T20:33:57.186608] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-16T20:33:57.925482] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-16T20:33:57.927058] [INFO ] [REMOTE ] STRV: Full fetch complete (12754 records). [2025-09-16T20:33:57.927126] [DEBUG] [VALIDATOR ] STRV: Validating primary data. [2025-09-16T20:33:57.980022] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-04. [2025-09-16T20:33:58.290385] [DEBUG] [VALIDATOR ] STRV: All expected trading days are present. [2025-09-16T20:33:58.290476] [DEBUG] [VALIDATOR ] STRV: Primary data validation passed. [2025-09-16T20:33:58.290779] [INFO ] [MAIN ] STRV: Fetched primary data is valid. [2025-09-16T20:33:58.290823] [DEBUG] [LOCAL ] STRV: Saving primary data. [2025-09-16T20:33:58.291293] [DEBUG] [LOCAL ] STRV: Trimmed 12754 records to 7657 (keeping 150 days of data) [2025-09-16T20:33:58.339181] [DEBUG] [LOCAL ] STRV: Primary data saved (7657 records). [2025-09-16T20:33:58.339300] [INFO ] [MAIN ] STRV: Full history saved. [2025-09-16T20:33:58.339400] [INFO ] [MAIN ] Update Progress: 2013/2369 symbols completed. STRV took 18.5s. Estimated remaining: 37m 50s. Rate: 9.4 symbols/min [2025-09-16T20:33:58.508433] [INFO ] [MAIN ] STWD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:33:58.550909] [DEBUG] [LOCAL ] STWD: Loaded 38133 existing records from primary storage. [2025-09-16T20:33:58.551049] [INFO ] [MAIN ] STWD: Loaded 38133 existing records. [2025-09-16T20:33:58.727087] [WARN ] [MAIN ] STWD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:33:58.727361] [INFO ] [MAIN ] STWD: Wiping existing primary data before full refresh. [2025-09-16T20:33:58.727405] [INFO ] [LOCAL ] STWD: Starting deletion of primary data. [2025-09-16T20:33:58.728149] [DEBUG] [LOCAL ] STWD: Deleted primary data file. [2025-09-16T20:33:58.728197] [INFO ] [MAIN ] STWD: Starting full primary refresh. [2025-09-16T20:33:58.782627] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-06. [2025-09-16T20:33:59.085337] [INFO ] [REMOTE ] STWD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:33:59.282400] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-16T20:33:59.574972] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-05. [2025-09-16T20:34:00.288669] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-16T20:34:00.374951] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-07. [2025-09-16T20:34:00.631200] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-16T20:34:01.174909] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-06. [2025-09-16T20:34:01.974914] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-02. [2025-09-16T20:34:02.009611] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-16T20:34:02.447219] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-16T20:34:02.774908] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-08. [2025-09-16T20:34:03.574901] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-07. [2025-09-16T20:34:03.671813] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-16T20:34:04.374932] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-03. [2025-09-16T20:34:04.653844] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-16T20:34:04.766783] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-16T20:34:05.174903] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-08. [2025-09-16T20:34:05.974859] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-07. [2025-09-16T20:34:06.061829] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-16T20:34:06.433423] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-16T20:34:06.774911] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-09. [2025-09-16T20:34:07.390336] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-16T20:34:07.574893] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-04. [2025-09-16T20:34:07.975419] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-16T20:34:07.979498] [INFO ] [REMOTE ] STVN: Full fetch complete (28987 records). [2025-09-16T20:34:07.979595] [DEBUG] [VALIDATOR ] STVN: Validating primary data. [2025-09-16T20:34:08.353253] [DEBUG] [VALIDATOR ] STVN: All expected trading days are present. [2025-09-16T20:34:08.353338] [DEBUG] [VALIDATOR ] STVN: Primary data validation passed. [2025-09-16T20:34:08.353963] [INFO ] [MAIN ] STVN: Fetched primary data is valid. [2025-09-16T20:34:08.354016] [DEBUG] [LOCAL ] STVN: Saving primary data. [2025-09-16T20:34:08.354910] [DEBUG] [LOCAL ] STVN: Trimmed 28987 records to 19497 (keeping 150 days of data) [2025-09-16T20:34:08.404580] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-09. [2025-09-16T20:34:08.472633] [DEBUG] [LOCAL ] STVN: Primary data saved (19497 records). [2025-09-16T20:34:08.472797] [INFO ] [MAIN ] STVN: Full history saved. [2025-09-16T20:34:08.473159] [INFO ] [MAIN ] Update Progress: 2014/2369 symbols completed. STVN took 17.8s. Estimated remaining: 37m 44s. Rate: 9.4 symbols/min [2025-09-16T20:34:08.642681] [INFO ] [MAIN ] STXD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:34:08.645264] [DEBUG] [LOCAL ] STXD: Loaded 803 existing records from primary storage. [2025-09-16T20:34:08.645342] [INFO ] [MAIN ] STXD: Loaded 803 existing records. [2025-09-16T20:34:08.827041] [WARN ] [MAIN ] STXD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:34:08.827282] [INFO ] [MAIN ] STXD: Wiping existing primary data before full refresh. [2025-09-16T20:34:08.827329] [INFO ] [LOCAL ] STXD: Starting deletion of primary data. [2025-09-16T20:34:08.827535] [DEBUG] [LOCAL ] STXD: Deleted primary data file. [2025-09-16T20:34:08.827581] [INFO ] [MAIN ] STXD: Starting full primary refresh. [2025-09-16T20:34:09.179463] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-08. [2025-09-16T20:34:09.207273] [INFO ] [REMOTE ] STXD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:34:09.223977] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-16T20:34:09.230087] [INFO ] [REMOTE ] STT: Full fetch complete (55446 records). [2025-09-16T20:34:09.230288] [DEBUG] [VALIDATOR ] STT: Validating primary data. [2025-09-16T20:34:09.231041] [FATAL] [VALIDATOR ] STT: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T20:34:09.231135] [FATAL] [MAIN ] STT: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:34:09.231174] [WARN ] [MAIN ] STT: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:34:09.231211] [INFO ] [LOCAL ] STT: Starting deletion of primary data. [2025-09-16T20:34:09.231295] [DEBUG] [LOCAL ] STT: No primary data file found to delete. [2025-09-16T20:34:09.231334] [INFO ] [LOCAL ] STT: Starting deletion of derivative data. [2025-09-16T20:34:09.231384] [DEBUG] [LOCAL ] STT: No derivative data file found to delete. [2025-09-16T20:34:09.231446] [INFO ] [MAIN ] Update Progress: 2015/2369 symbols completed. STT took 27.0s. Estimated remaining: 37m 37s. Rate: 9.4 symbols/min [2025-09-16T20:34:09.412316] [INFO ] [MAIN ] STXE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:34:09.415730] [DEBUG] [LOCAL ] STXE: Loaded 1410 existing records from primary storage. [2025-09-16T20:34:09.415913] [INFO ] [MAIN ] STXE: Loaded 1410 existing records. [2025-09-16T20:34:09.618212] [WARN ] [MAIN ] STXE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:34:09.632833] [INFO ] [MAIN ] STXE: Wiping existing primary data before full refresh. [2025-09-16T20:34:09.632998] [INFO ] [LOCAL ] STXE: Starting deletion of primary data. [2025-09-16T20:34:09.635109] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-16T20:34:09.635180] [DEBUG] [LOCAL ] STXE: Deleted primary data file. [2025-09-16T20:34:09.635357] [INFO ] [MAIN ] STXE: Starting full primary refresh. [2025-09-16T20:34:09.977341] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-02. [2025-09-16T20:34:09.997139] [INFO ] [REMOTE ] STXE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:34:10.703557] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-16T20:34:10.743313] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-16T20:34:10.774851] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-09. [2025-09-16T20:34:11.574886] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-02. [2025-09-16T20:34:12.326503] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-16T20:34:12.344905] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-16T20:34:12.350433] [INFO ] [REMOTE ] STNG: Full fetch complete (48166 records). [2025-09-16T20:34:12.350553] [DEBUG] [VALIDATOR ] STNG: Validating primary data. [2025-09-16T20:34:12.382091] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-03. [2025-09-16T20:34:12.753336] [DEBUG] [VALIDATOR ] STNG: All expected trading days are present. [2025-09-16T20:34:12.753436] [DEBUG] [VALIDATOR ] STNG: Primary data validation passed. [2025-09-16T20:34:12.754374] [INFO ] [MAIN ] STNG: Fetched primary data is valid. [2025-09-16T20:34:12.754425] [DEBUG] [LOCAL ] STNG: Saving primary data. [2025-09-16T20:34:12.755608] [DEBUG] [LOCAL ] STNG: Trimmed 48166 records to 32590 (keeping 150 days of data) [2025-09-16T20:34:12.964799] [DEBUG] [LOCAL ] STNG: Primary data saved (32590 records). [2025-09-16T20:34:12.964964] [INFO ] [MAIN ] STNG: Full history saved. [2025-09-16T20:34:12.965055] [INFO ] [MAIN ] Update Progress: 2016/2369 symbols completed. STNG took 34.3s. Estimated remaining: 37m 30s. Rate: 9.4 symbols/min [2025-09-16T20:34:13.147924] [INFO ] [MAIN ] STXG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:34:13.151293] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-16T20:34:13.155425] [DEBUG] [LOCAL ] STXG: Loaded 1476 existing records from primary storage. [2025-09-16T20:34:13.155492] [INFO ] [MAIN ] STXG: Loaded 1476 existing records. [2025-09-16T20:34:13.185210] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-03. [2025-09-16T20:34:13.338511] [WARN ] [MAIN ] STXG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:34:13.338813] [INFO ] [MAIN ] STXG: Wiping existing primary data before full refresh. [2025-09-16T20:34:13.338867] [INFO ] [LOCAL ] STXG: Starting deletion of primary data. [2025-09-16T20:34:13.339070] [DEBUG] [LOCAL ] STXG: Deleted primary data file. [2025-09-16T20:34:13.339115] [INFO ] [MAIN ] STXG: Starting full primary refresh. [2025-09-16T20:34:13.702560] [INFO ] [REMOTE ] STXG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:34:13.712825] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-16T20:34:13.974904] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-02. [2025-09-16T20:34:14.666133] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-16T20:34:14.774899] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-04. [2025-09-16T20:34:15.306409] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-16T20:34:15.574906] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-04. [2025-09-16T20:34:16.129868] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-16T20:34:16.374919] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-05. [2025-09-16T20:34:17.032115] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-16T20:34:17.174911] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-05. [2025-09-16T20:34:17.974904] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-06. [2025-09-16T20:34:18.487885] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-16T20:34:18.774911] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-05. [2025-09-16T20:34:19.062128] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-16T20:34:19.274000] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-16T20:34:19.574920] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-07. [2025-09-16T20:34:20.062891] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-16T20:34:20.374959] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-08. [2025-09-16T20:34:20.910062] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-16T20:34:21.174937] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-06. [2025-09-16T20:34:21.974907] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-09. [2025-09-16T20:34:22.385909] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-16T20:34:22.386855] [INFO ] [REMOTE ] STXE: Full fetch complete (2535 records). [2025-09-16T20:34:22.386927] [DEBUG] [VALIDATOR ] STXE: Validating primary data. [2025-09-16T20:34:22.756272] [DEBUG] [VALIDATOR ] STXE: All expected trading days are present. [2025-09-16T20:34:22.756359] [DEBUG] [VALIDATOR ] STXE: Primary data validation passed. [2025-09-16T20:34:22.756464] [INFO ] [MAIN ] STXE: Fetched primary data is valid. [2025-09-16T20:34:22.756505] [DEBUG] [LOCAL ] STXE: Saving primary data. [2025-09-16T20:34:22.756880] [DEBUG] [LOCAL ] STXE: Trimmed 2535 records to 1425 (keeping 150 days of data) [2025-09-16T20:34:22.765862] [DEBUG] [LOCAL ] STXE: Primary data saved (1425 records). [2025-09-16T20:34:22.765923] [INFO ] [MAIN ] STXE: Full history saved. [2025-09-16T20:34:22.765993] [INFO ] [MAIN ] Update Progress: 2017/2369 symbols completed. STXE took 13.5s. Estimated remaining: 37m 24s. Rate: 9.4 symbols/min [2025-09-16T20:34:22.779978] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-03. [2025-09-16T20:34:22.942467] [INFO ] [MAIN ] STXK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:34:22.945220] [DEBUG] [LOCAL ] STXK: Loaded 952 existing records from primary storage. [2025-09-16T20:34:22.945292] [INFO ] [MAIN ] STXK: Loaded 952 existing records. [2025-09-16T20:34:23.126487] [WARN ] [MAIN ] STXK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:34:23.126809] [INFO ] [MAIN ] STXK: Wiping existing primary data before full refresh. [2025-09-16T20:34:23.126923] [INFO ] [LOCAL ] STXK: Starting deletion of primary data. [2025-09-16T20:34:23.127198] [DEBUG] [LOCAL ] STXK: Deleted primary data file. [2025-09-16T20:34:23.127253] [INFO ] [MAIN ] STXK: Starting full primary refresh. [2025-09-16T20:34:23.454171] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-09-16T20:34:23.539222] [INFO ] [REMOTE ] STXK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:34:23.540146] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-16T20:34:23.574851] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-07. [2025-09-16T20:34:24.374892] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-06. [2025-09-16T20:34:24.800478] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-16T20:34:25.174876] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-02. [2025-09-16T20:34:25.612317] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-16T20:34:25.796526] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-16T20:34:25.974866] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-04. [2025-09-16T20:34:26.434569] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-16T20:34:26.774886] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-05. [2025-09-16T20:34:27.356726] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-16T20:34:27.574921] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-07. [2025-09-16T20:34:28.013263] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-16T20:34:28.374913] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-08. [2025-09-16T20:34:29.174906] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-08. [2025-09-16T20:34:29.587164] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-16T20:34:29.974920] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-03. [2025-09-16T20:34:30.227003] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-16T20:34:30.417948] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-16T20:34:30.774911] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-09. [2025-09-16T20:34:31.153165] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-16T20:34:31.153912] [INFO ] [REMOTE ] STXD: Full fetch complete (1501 records). [2025-09-16T20:34:31.154008] [DEBUG] [VALIDATOR ] STXD: Validating primary data. [2025-09-16T20:34:31.511101] [DEBUG] [VALIDATOR ] STXD: All expected trading days are present. [2025-09-16T20:34:31.511187] [DEBUG] [VALIDATOR ] STXD: Primary data validation passed. [2025-09-16T20:34:31.511294] [INFO ] [MAIN ] STXD: Fetched primary data is valid. [2025-09-16T20:34:31.511335] [DEBUG] [LOCAL ] STXD: Saving primary data. [2025-09-16T20:34:31.511743] [DEBUG] [LOCAL ] STXD: Trimmed 1501 records to 811 (keeping 150 days of data) [2025-09-16T20:34:31.517470] [DEBUG] [LOCAL ] STXD: Primary data saved (811 records). [2025-09-16T20:34:31.517533] [INFO ] [MAIN ] STXD: Full history saved. [2025-09-16T20:34:31.517606] [INFO ] [MAIN ] Update Progress: 2018/2369 symbols completed. STXD took 23.0s. Estimated remaining: 37m 18s. Rate: 9.4 symbols/min [2025-09-16T20:34:31.580768] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-04. [2025-09-16T20:34:31.696730] [INFO ] [MAIN ] STXM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:34:31.696955] [DEBUG] [LOCAL ] STXM: No existing data file found in primary storage. [2025-09-16T20:34:31.696995] [WARN ] [MAIN ] STXM: No existing data found, performing full refresh instead. [2025-09-16T20:34:31.697123] [INFO ] [MAIN ] STXM: Wiping existing primary data before full refresh. [2025-09-16T20:34:31.697163] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-09-16T20:34:31.697204] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-09-16T20:34:31.697242] [INFO ] [MAIN ] STXM: Starting full primary refresh. [2025-09-16T20:34:32.059854] [INFO ] [REMOTE ] STXM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:34:32.145856] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-16T20:34:32.374896] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-05. [2025-09-16T20:34:32.892556] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-16T20:34:33.174936] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-09. [2025-09-16T20:34:33.974910] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-06. [2025-09-16T20:34:34.574209] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-16T20:34:34.774924] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-06. [2025-09-16T20:34:34.819188] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-16T20:34:34.825592] [INFO ] [REMOTE ] STWD: Full fetch complete (56380 records). [2025-09-16T20:34:34.825811] [DEBUG] [VALIDATOR ] STWD: Validating primary data. [2025-09-16T20:34:35.209550] [DEBUG] [VALIDATOR ] STWD: All expected trading days are present. [2025-09-16T20:34:35.209630] [DEBUG] [VALIDATOR ] STWD: Primary data validation passed. [2025-09-16T20:34:35.210614] [INFO ] [MAIN ] STWD: Fetched primary data is valid. [2025-09-16T20:34:35.210671] [DEBUG] [LOCAL ] STWD: Saving primary data. [2025-09-16T20:34:35.211843] [DEBUG] [LOCAL ] STWD: Trimmed 56380 records to 38509 (keeping 150 days of data) [2025-09-16T20:34:35.318747] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-16T20:34:35.465066] [DEBUG] [LOCAL ] STWD: Primary data saved (38509 records). [2025-09-16T20:34:35.465428] [INFO ] [MAIN ] STWD: Full history saved. [2025-09-16T20:34:35.465586] [INFO ] [MAIN ] Update Progress: 2019/2369 symbols completed. STWD took 37.1s. Estimated remaining: 37m 11s. Rate: 9.4 symbols/min [2025-09-16T20:34:35.580021] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-07. [2025-09-16T20:34:35.642446] [INFO ] [MAIN ] STXT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:34:35.642624] [DEBUG] [LOCAL ] STXT: No existing data file found in primary storage. [2025-09-16T20:34:35.642691] [WARN ] [MAIN ] STXT: No existing data found, performing full refresh instead. [2025-09-16T20:34:35.642813] [INFO ] [MAIN ] STXT: Wiping existing primary data before full refresh. [2025-09-16T20:34:35.642853] [INFO ] [LOCAL ] STXT: Starting deletion of primary data. [2025-09-16T20:34:35.642896] [DEBUG] [LOCAL ] STXT: No primary data file found to delete. [2025-09-16T20:34:35.642930] [INFO ] [MAIN ] STXT: Starting full primary refresh. [2025-09-16T20:34:36.002015] [INFO ] [REMOTE ] STXT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:34:36.089164] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-16T20:34:36.374908] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-02. [2025-09-16T20:34:36.971809] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-16T20:34:37.174919] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-03. [2025-09-16T20:34:37.587324] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-16T20:34:37.974901] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-07. [2025-09-16T20:34:38.480186] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-16T20:34:38.774924] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-08. [2025-09-16T20:34:39.265038] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-16T20:34:39.574915] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-02. [2025-09-16T20:34:40.215456] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-16T20:34:40.374880] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-03. [2025-09-16T20:34:40.888834] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-16T20:34:41.174941] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-08. [2025-09-16T20:34:41.648711] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-16T20:34:41.974898] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-04. [2025-09-16T20:34:42.452191] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-16T20:34:42.774907] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-05. [2025-09-16T20:34:43.195858] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-16T20:34:43.574936] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-06. [2025-09-16T20:34:44.002713] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-16T20:34:44.374937] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-09. [2025-09-16T20:34:44.759533] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-16T20:34:44.760283] [INFO ] [REMOTE ] STXK: Full fetch complete (1703 records). [2025-09-16T20:34:44.760351] [DEBUG] [VALIDATOR ] STXK: Validating primary data. [2025-09-16T20:34:45.134550] [DEBUG] [VALIDATOR ] STXK: All expected trading days are present. [2025-09-16T20:34:45.134635] [DEBUG] [VALIDATOR ] STXK: Primary data validation passed. [2025-09-16T20:34:45.134769] [INFO ] [MAIN ] STXK: Fetched primary data is valid. [2025-09-16T20:34:45.134810] [DEBUG] [LOCAL ] STXK: Saving primary data. [2025-09-16T20:34:45.135158] [DEBUG] [LOCAL ] STXK: Trimmed 1703 records to 959 (keeping 150 days of data) [2025-09-16T20:34:45.141617] [DEBUG] [LOCAL ] STXK: Primary data saved (959 records). [2025-09-16T20:34:45.141687] [INFO ] [MAIN ] STXK: Full history saved. [2025-09-16T20:34:45.141769] [INFO ] [MAIN ] Update Progress: 2020/2369 symbols completed. STXK took 22.4s. Estimated remaining: 37m 6s. Rate: 9.4 symbols/min [2025-09-16T20:34:45.180676] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-04. [2025-09-16T20:34:45.311677] [INFO ] [MAIN ] STXV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:34:45.314723] [DEBUG] [LOCAL ] STXV: Loaded 1088 existing records from primary storage. [2025-09-16T20:34:45.314802] [INFO ] [MAIN ] STXV: Loaded 1088 existing records. [2025-09-16T20:34:45.488567] [WARN ] [MAIN ] STXV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:34:45.488863] [INFO ] [MAIN ] STXV: Wiping existing primary data before full refresh. [2025-09-16T20:34:45.488921] [INFO ] [LOCAL ] STXV: Starting deletion of primary data. [2025-09-16T20:34:45.489205] [DEBUG] [LOCAL ] STXV: Deleted primary data file. [2025-09-16T20:34:45.489262] [INFO ] [MAIN ] STXV: Starting full primary refresh. [2025-09-16T20:34:45.856463] [INFO ] [REMOTE ] STXV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:34:45.857053] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-16T20:34:45.974858] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-02. [2025-09-16T20:34:46.640723] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-16T20:34:46.774937] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-05. [2025-09-16T20:34:47.341351] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-16T20:34:47.574948] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-07. [2025-09-16T20:34:47.970520] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-16T20:34:48.374918] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-09. [2025-09-16T20:34:48.846549] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-16T20:34:48.847354] [INFO ] [REMOTE ] STXG: Full fetch complete (3019 records). [2025-09-16T20:34:48.847425] [DEBUG] [VALIDATOR ] STXG: Validating primary data. [2025-09-16T20:34:49.178779] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-06. [2025-09-16T20:34:49.214309] [DEBUG] [VALIDATOR ] STXG: All expected trading days are present. [2025-09-16T20:34:49.214373] [DEBUG] [VALIDATOR ] STXG: Primary data validation passed. [2025-09-16T20:34:49.214492] [INFO ] [MAIN ] STXG: Fetched primary data is valid. [2025-09-16T20:34:49.214588] [DEBUG] [LOCAL ] STXG: Saving primary data. [2025-09-16T20:34:49.215052] [DEBUG] [LOCAL ] STXG: Trimmed 3019 records to 1492 (keeping 150 days of data) [2025-09-16T20:34:49.226031] [DEBUG] [LOCAL ] STXG: Primary data saved (1492 records). [2025-09-16T20:34:49.226092] [INFO ] [MAIN ] STXG: Full history saved. [2025-09-16T20:34:49.226170] [INFO ] [MAIN ] Update Progress: 2021/2369 symbols completed. STXG took 36.3s. Estimated remaining: 36m 59s. Rate: 9.4 symbols/min [2025-09-16T20:34:49.401985] [INFO ] [MAIN ] STZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:34:49.444099] [DEBUG] [LOCAL ] STZ: Loaded 38549 existing records from primary storage. [2025-09-16T20:34:49.444266] [INFO ] [MAIN ] STZ: Loaded 38549 existing records. [2025-09-16T20:34:49.622134] [WARN ] [MAIN ] STZ: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:34:49.622420] [INFO ] [MAIN ] STZ: Wiping existing primary data before full refresh. [2025-09-16T20:34:49.622486] [INFO ] [LOCAL ] STZ: Starting deletion of primary data. [2025-09-16T20:34:49.623513] [DEBUG] [LOCAL ] STZ: Deleted primary data file. [2025-09-16T20:34:49.623566] [INFO ] [MAIN ] STZ: Starting full primary refresh. [2025-09-16T20:34:49.851471] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-16T20:34:49.982239] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-08. [2025-09-16T20:34:49.987478] [INFO ] [REMOTE ] STZ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:34:50.410797] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-16T20:34:50.774901] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-02. [2025-09-16T20:34:51.574944] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-09. [2025-09-16T20:34:51.981037] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-16T20:34:51.982082] [INFO ] [REMOTE ] STXM: Full fetch complete (1031 records). [2025-09-16T20:34:51.982177] [DEBUG] [VALIDATOR ] STXM: Validating primary data. [2025-09-16T20:34:52.242898] [WARN ] [VALIDATOR ] STXM: Validation failed - insufficient historical data. Have 147 unique days, need 150 days [2025-09-16T20:34:52.243144] [FATAL] [MAIN ] STXM: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:34:52.243224] [WARN ] [MAIN ] STXM: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:34:52.243302] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-09-16T20:34:52.243375] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-09-16T20:34:52.243413] [INFO ] [LOCAL ] STXM: Starting deletion of derivative data. [2025-09-16T20:34:52.243452] [DEBUG] [LOCAL ] STXM: No derivative data file found to delete. [2025-09-16T20:34:52.243516] [INFO ] [MAIN ] Update Progress: 2022/2369 symbols completed. STXM took 20.7s. Estimated remaining: 36m 52s. Rate: 9.4 symbols/min [2025-09-16T20:34:52.380091] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-07. [2025-09-16T20:34:52.509131] [INFO ] [MAIN ] SU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:34:52.570851] [DEBUG] [LOCAL ] SU: Loaded 39449 existing records from primary storage. [2025-09-16T20:34:52.571080] [INFO ] [MAIN ] SU: Loaded 39449 existing records. [2025-09-16T20:34:52.836021] [WARN ] [MAIN ] SU: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:34:52.836352] [INFO ] [MAIN ] SU: Wiping existing primary data before full refresh. [2025-09-16T20:34:52.836424] [INFO ] [LOCAL ] SU: Starting deletion of primary data. [2025-09-16T20:34:52.837510] [DEBUG] [LOCAL ] SU: Deleted primary data file. [2025-09-16T20:34:52.837594] [INFO ] [MAIN ] SU: Starting full primary refresh. [2025-09-16T20:34:53.047262] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-16T20:34:53.063754] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-16T20:34:53.180165] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-03. [2025-09-16T20:34:53.332683] [INFO ] [REMOTE ] SU: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:34:53.974921] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-08. [2025-09-16T20:34:54.520609] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-16T20:34:54.774915] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-03. [2025-09-16T20:34:55.289476] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-16T20:34:55.373726] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-16T20:34:55.574910] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-04. [2025-09-16T20:34:56.374940] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-02. [2025-09-16T20:34:57.174909] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-09. [2025-09-16T20:34:57.734705] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-16T20:34:57.748564] [INFO ] [REMOTE ] STXT: Full fetch complete (2882 records). [2025-09-16T20:34:57.749133] [DEBUG] [VALIDATOR ] STXT: Validating primary data. [2025-09-16T20:34:57.752180] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-16T20:34:57.980125] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-05. [2025-09-16T20:34:58.122368] [DEBUG] [VALIDATOR ] STXT: All expected trading days are present. [2025-09-16T20:34:58.122452] [DEBUG] [VALIDATOR ] STXT: Primary data validation passed. [2025-09-16T20:34:58.122592] [INFO ] [MAIN ] STXT: Fetched primary data is valid. [2025-09-16T20:34:58.122666] [DEBUG] [LOCAL ] STXT: Saving primary data. [2025-09-16T20:34:58.123020] [DEBUG] [LOCAL ] STXT: Trimmed 2882 records to 1919 (keeping 150 days of data) [2025-09-16T20:34:58.135957] [DEBUG] [LOCAL ] STXT: Primary data saved (1919 records). [2025-09-16T20:34:58.136042] [INFO ] [MAIN ] STXT: Full history saved. [2025-09-16T20:34:58.136127] [INFO ] [MAIN ] Update Progress: 2023/2369 symbols completed. STXT took 22.7s. Estimated remaining: 36m 45s. Rate: 9.4 symbols/min [2025-09-16T20:34:58.306469] [INFO ] [MAIN ] SUI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:34:58.338884] [DEBUG] [LOCAL ] SUI: Loaded 31330 existing records from primary storage. [2025-09-16T20:34:58.339114] [INFO ] [MAIN ] SUI: Loaded 31330 existing records. [2025-09-16T20:34:58.542780] [WARN ] [MAIN ] SUI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:34:58.562104] [INFO ] [MAIN ] SUI: Wiping existing primary data before full refresh. [2025-09-16T20:34:58.562287] [INFO ] [LOCAL ] SUI: Starting deletion of primary data. [2025-09-16T20:34:58.563314] [DEBUG] [LOCAL ] SUI: Deleted primary data file. [2025-09-16T20:34:58.563410] [INFO ] [MAIN ] SUI: Starting full primary refresh. [2025-09-16T20:34:58.566797] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-16T20:34:58.781749] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-04. [2025-09-16T20:34:58.943270] [INFO ] [REMOTE ] SUI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:34:59.520817] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-16T20:34:59.575015] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-05. [2025-09-16T20:34:59.991737] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-16T20:35:00.090788] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-16T20:35:00.374973] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-06. [2025-09-16T20:35:01.175021] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-02. [2025-09-16T20:35:01.974996] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-03. [2025-09-16T20:35:02.511822] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-16T20:35:02.774997] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-07. [2025-09-16T20:35:03.039011] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-16T20:35:03.574917] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-06. [2025-09-16T20:35:03.790974] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-16T20:35:04.008167] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-16T20:35:04.374989] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-04. [2025-09-16T20:35:04.728034] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-16T20:35:05.174912] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-03. [2025-09-16T20:35:05.974933] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-08. [2025-09-16T20:35:06.242855] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-16T20:35:06.774912] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-07. [2025-09-16T20:35:06.881618] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-16T20:35:07.356452] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-16T20:35:07.574890] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-05. [2025-09-16T20:35:08.097124] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-16T20:35:08.374917] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-04. [2025-09-16T20:35:09.174899] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-09. [2025-09-16T20:35:09.645020] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-16T20:35:09.698212] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-16T20:35:09.974894] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-05. [2025-09-16T20:35:10.774918] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-08. [2025-09-16T20:35:11.266339] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-16T20:35:11.284624] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-16T20:35:11.291003] [INFO ] [REMOTE ] STZ: Full fetch complete (56914 records). [2025-09-16T20:35:11.291115] [DEBUG] [VALIDATOR ] STZ: Validating primary data. [2025-09-16T20:35:11.580193] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-09. [2025-09-16T20:35:11.713419] [DEBUG] [VALIDATOR ] STZ: All expected trading days are present. [2025-09-16T20:35:11.713590] [DEBUG] [VALIDATOR ] STZ: Primary data validation passed. [2025-09-16T20:35:11.714740] [INFO ] [MAIN ] STZ: Fetched primary data is valid. [2025-09-16T20:35:11.714898] [DEBUG] [LOCAL ] STZ: Saving primary data. [2025-09-16T20:35:11.738706] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-16T20:35:11.747573] [DEBUG] [LOCAL ] STZ: Trimmed 56914 records to 38935 (keeping 150 days of data) [2025-09-16T20:35:12.002500] [DEBUG] [LOCAL ] STZ: Primary data saved (38935 records). [2025-09-16T20:35:12.002666] [INFO ] [MAIN ] STZ: Full history saved. [2025-09-16T20:35:12.002769] [INFO ] [MAIN ] Update Progress: 2024/2369 symbols completed. STZ took 22.8s. Estimated remaining: 36m 40s. Rate: 9.4 symbols/min [2025-09-16T20:35:12.098436] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-16T20:35:12.110854] [INFO ] [REMOTE ] STXV: Full fetch complete (1955 records). [2025-09-16T20:35:12.111021] [DEBUG] [VALIDATOR ] STXV: Validating primary data. [2025-09-16T20:35:12.307885] [INFO ] [MAIN ] SUN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:35:12.381329] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-06. [2025-09-16T20:35:12.585755] [DEBUG] [VALIDATOR ] STXV: All expected trading days are present. [2025-09-16T20:35:12.586756] [DEBUG] [VALIDATOR ] STXV: Primary data validation passed. [2025-09-16T20:35:12.586905] [INFO ] [MAIN ] STXV: Fetched primary data is valid. [2025-09-16T20:35:12.586675] [DEBUG] [LOCAL ] SUN: Loaded 28207 existing records from primary storage. [2025-09-16T20:35:12.587036] [DEBUG] [LOCAL ] STXV: Saving primary data. [2025-09-16T20:35:12.587124] [INFO ] [MAIN ] SUN: Loaded 28207 existing records. [2025-09-16T20:35:12.587569] [DEBUG] [LOCAL ] STXV: Trimmed 1955 records to 1101 (keeping 150 days of data) [2025-09-16T20:35:12.700467] [DEBUG] [LOCAL ] STXV: Primary data saved (1101 records). [2025-09-16T20:35:12.700685] [INFO ] [MAIN ] STXV: Full history saved. [2025-09-16T20:35:12.706480] [INFO ] [MAIN ] Update Progress: 2025/2369 symbols completed. STXV took 27.6s. Estimated remaining: 36m 33s. Rate: 9.4 symbols/min [2025-09-16T20:35:12.884005] [WARN ] [MAIN ] SUN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:35:12.884532] [INFO ] [MAIN ] SUN: Wiping existing primary data before full refresh. [2025-09-16T20:35:12.889932] [INFO ] [LOCAL ] SUN: Starting deletion of primary data. [2025-09-16T20:35:12.905905] [DEBUG] [LOCAL ] SUN: Deleted primary data file. [2025-09-16T20:35:12.925265] [INFO ] [MAIN ] SUN: Starting full primary refresh. [2025-09-16T20:35:12.997950] [INFO ] [MAIN ] SUPV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:35:13.185959] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-06. [2025-09-16T20:35:13.323257] [DEBUG] [LOCAL ] SUPV: Loaded 34823 existing records from primary storage. [2025-09-16T20:35:13.343376] [INFO ] [MAIN ] SUPV: Loaded 34823 existing records. [2025-09-16T20:35:13.343320] [INFO ] [REMOTE ] SUN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:35:13.520719] [WARN ] [MAIN ] SUPV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:35:13.520961] [INFO ] [MAIN ] SUPV: Wiping existing primary data before full refresh. [2025-09-16T20:35:13.521006] [INFO ] [LOCAL ] SUPV: Starting deletion of primary data. [2025-09-16T20:35:13.521887] [DEBUG] [LOCAL ] SUPV: Deleted primary data file. [2025-09-16T20:35:13.521936] [INFO ] [MAIN ] SUPV: Starting full primary refresh. [2025-09-16T20:35:13.869571] [INFO ] [REMOTE ] SUPV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:35:13.974865] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-02. [2025-09-16T20:35:14.300812] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-16T20:35:14.774906] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-02. [2025-09-16T20:35:14.819470] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-16T20:35:15.574932] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-07. [2025-09-16T20:35:15.676739] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-16T20:35:16.195830] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-16T20:35:16.374984] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-03. [2025-09-16T20:35:17.174908] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-03. [2025-09-16T20:35:17.210180] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-16T20:35:17.974905] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-07. [2025-09-16T20:35:18.254543] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-16T20:35:18.774905] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-04. [2025-09-16T20:35:19.574904] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-08. [2025-09-16T20:35:20.623917] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-03 (3.45 seconds). [2025-09-16T20:35:20.633544] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-04. [2025-09-16T20:35:20.873135] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-07 (2.90 seconds). [2025-09-16T20:35:21.174916] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-08. [2025-09-16T20:35:21.206901] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-09-16T20:35:21.302408] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-16T20:35:21.912502] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-16T20:35:21.974916] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-09. [2025-09-16T20:35:22.774911] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-05. [2025-09-16T20:35:23.062177] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-16T20:35:23.231171] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-16T20:35:23.236673] [INFO ] [REMOTE ] SUI: Full fetch complete (45840 records). [2025-09-16T20:35:23.236788] [DEBUG] [VALIDATOR ] SUI: Validating primary data. [2025-09-16T20:35:23.582431] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-09. [2025-09-16T20:35:23.633276] [DEBUG] [VALIDATOR ] SUI: All expected trading days are present. [2025-09-16T20:35:23.633368] [DEBUG] [VALIDATOR ] SUI: Primary data validation passed. [2025-09-16T20:35:23.634321] [INFO ] [MAIN ] SUI: Fetched primary data is valid. [2025-09-16T20:35:23.634370] [DEBUG] [LOCAL ] SUI: Saving primary data. [2025-09-16T20:35:23.635559] [DEBUG] [LOCAL ] SUI: Trimmed 45840 records to 31654 (keeping 150 days of data) [2025-09-16T20:35:23.834567] [DEBUG] [LOCAL ] SUI: Primary data saved (31654 records). [2025-09-16T20:35:23.834739] [INFO ] [MAIN ] SUI: Full history saved. [2025-09-16T20:35:23.834844] [INFO ] [MAIN ] Update Progress: 2026/2369 symbols completed. SUI took 25.7s. Estimated remaining: 36m 27s. Rate: 9.4 symbols/min [2025-09-16T20:35:24.012203] [INFO ] [MAIN ] SUZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:35:24.043627] [DEBUG] [LOCAL ] SUZ: Loaded 33643 existing records from primary storage. [2025-09-16T20:35:24.043787] [INFO ] [MAIN ] SUZ: Loaded 33643 existing records. [2025-09-16T20:35:24.226077] [WARN ] [MAIN ] SUZ: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:35:24.226321] [INFO ] [MAIN ] SUZ: Wiping existing primary data before full refresh. [2025-09-16T20:35:24.226367] [INFO ] [LOCAL ] SUZ: Starting deletion of primary data. [2025-09-16T20:35:24.227055] [DEBUG] [LOCAL ] SUZ: Deleted primary data file. [2025-09-16T20:35:24.227107] [INFO ] [MAIN ] SUZ: Starting full primary refresh. [2025-09-16T20:35:24.380072] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-05. [2025-09-16T20:35:24.593099] [INFO ] [REMOTE ] SUZ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:35:24.625967] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-16T20:35:25.174915] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-06. [2025-09-16T20:35:25.211907] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-16T20:35:25.218804] [INFO ] [REMOTE ] SU: Full fetch complete (58138 records). [2025-09-16T20:35:25.218986] [DEBUG] [VALIDATOR ] SU: Validating primary data. [2025-09-16T20:35:25.619512] [DEBUG] [VALIDATOR ] SU: All expected trading days are present. [2025-09-16T20:35:25.619591] [DEBUG] [VALIDATOR ] SU: Primary data validation passed. [2025-09-16T20:35:25.620562] [INFO ] [MAIN ] SU: Fetched primary data is valid. [2025-09-16T20:35:25.620608] [DEBUG] [LOCAL ] SU: Saving primary data. [2025-09-16T20:35:25.621840] [DEBUG] [LOCAL ] SU: Trimmed 58138 records to 39838 (keeping 150 days of data) [2025-09-16T20:35:25.878845] [DEBUG] [LOCAL ] SU: Primary data saved (39838 records). [2025-09-16T20:35:25.879000] [INFO ] [MAIN ] SU: Full history saved. [2025-09-16T20:35:25.880148] [INFO ] [MAIN ] Update Progress: 2027/2369 symbols completed. SU took 33.6s. Estimated remaining: 36m 20s. Rate: 9.4 symbols/min [2025-09-16T20:35:25.980038] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-02. [2025-09-16T20:35:26.056678] [INFO ] [MAIN ] SVV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:35:26.086465] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-16T20:35:26.117007] [DEBUG] [LOCAL ] SVV: Loaded 28338 existing records from primary storage. [2025-09-16T20:35:26.117154] [INFO ] [MAIN ] SVV: Loaded 28338 existing records. [2025-09-16T20:35:26.294604] [WARN ] [MAIN ] SVV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:35:26.294877] [INFO ] [MAIN ] SVV: Wiping existing primary data before full refresh. [2025-09-16T20:35:26.294922] [INFO ] [LOCAL ] SVV: Starting deletion of primary data. [2025-09-16T20:35:26.295484] [DEBUG] [LOCAL ] SVV: Deleted primary data file. [2025-09-16T20:35:26.295530] [INFO ] [MAIN ] SVV: Starting full primary refresh. [2025-09-16T20:35:26.653606] [INFO ] [REMOTE ] SVV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:35:26.774916] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-02. [2025-09-16T20:35:26.842895] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-16T20:35:27.574965] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-07. [2025-09-16T20:35:27.732330] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-16T20:35:28.351813] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-16T20:35:28.374852] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-03. [2025-09-16T20:35:29.174904] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-03. [2025-09-16T20:35:29.258330] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-16T20:35:29.888987] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-16T20:35:29.974887] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-04. [2025-09-16T20:35:30.491609] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-16T20:35:30.774942] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-04. [2025-09-16T20:35:31.574880] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-06. [2025-09-16T20:35:31.612131] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-16T20:35:32.374907] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-08. [2025-09-16T20:35:33.174924] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-05. [2025-09-16T20:35:33.254399] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-09-16T20:35:33.822766] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-16T20:35:33.974911] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-05. [2025-09-16T20:35:34.774912] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-07. [2025-09-16T20:35:34.897906] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-09-16T20:35:34.932380] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-16T20:35:35.574901] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-09. [2025-09-16T20:35:35.750599] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-16T20:35:36.164471] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-16T20:35:36.374916] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-06. [2025-09-16T20:35:37.174905] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-06. [2025-09-16T20:35:37.329073] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-16T20:35:37.335297] [INFO ] [REMOTE ] SUPV: Full fetch complete (50943 records). [2025-09-16T20:35:37.335458] [DEBUG] [VALIDATOR ] SUPV: Validating primary data. [2025-09-16T20:35:37.722427] [DEBUG] [VALIDATOR ] SUPV: All expected trading days are present. [2025-09-16T20:35:37.722589] [DEBUG] [VALIDATOR ] SUPV: Primary data validation passed. [2025-09-16T20:35:37.723976] [INFO ] [MAIN ] SUPV: Fetched primary data is valid. [2025-09-16T20:35:37.724043] [DEBUG] [LOCAL ] SUPV: Saving primary data. [2025-09-16T20:35:37.733408] [DEBUG] [LOCAL ] SUPV: Trimmed 50943 records to 35144 (keeping 150 days of data) [2025-09-16T20:35:37.745526] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-16T20:35:37.962681] [DEBUG] [LOCAL ] SUPV: Primary data saved (35144 records). [2025-09-16T20:35:37.962836] [INFO ] [MAIN ] SUPV: Full history saved. [2025-09-16T20:35:37.962962] [INFO ] [MAIN ] Update Progress: 2028/2369 symbols completed. SUPV took 25.3s. Estimated remaining: 36m 15s. Rate: 9.4 symbols/min [2025-09-16T20:35:37.984402] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-07. [2025-09-16T20:35:38.137013] [INFO ] [MAIN ] SW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:35:38.171984] [DEBUG] [LOCAL ] SW: Loaded 39178 existing records from primary storage. [2025-09-16T20:35:38.172123] [INFO ] [MAIN ] SW: Loaded 39178 existing records. [2025-09-16T20:35:38.354401] [WARN ] [MAIN ] SW: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:35:38.354856] [INFO ] [MAIN ] SW: Wiping existing primary data before full refresh. [2025-09-16T20:35:38.354927] [INFO ] [LOCAL ] SW: Starting deletion of primary data. [2025-09-16T20:35:38.355780] [DEBUG] [LOCAL ] SW: Deleted primary data file. [2025-09-16T20:35:38.355840] [INFO ] [MAIN ] SW: Starting full primary refresh. [2025-09-16T20:35:38.715781] [INFO ] [REMOTE ] SW: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:35:38.776298] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-08. [2025-09-16T20:35:38.779986] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-16T20:35:39.457891] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-16T20:35:39.574942] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-08. [2025-09-16T20:35:40.374904] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-02. [2025-09-16T20:35:40.427931] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-16T20:35:41.174909] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-07. [2025-09-16T20:35:41.974918] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-09. [2025-09-16T20:35:42.221590] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-16T20:35:42.324599] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-08 (2.75 seconds). [2025-09-16T20:35:42.774877] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-09. [2025-09-16T20:35:43.072511] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-16T20:35:43.076936] [INFO ] [REMOTE ] SUN: Full fetch complete (40737 records). [2025-09-16T20:35:43.077031] [DEBUG] [VALIDATOR ] SUN: Validating primary data. [2025-09-16T20:35:43.480186] [DEBUG] [VALIDATOR ] SUN: All expected trading days are present. [2025-09-16T20:35:43.483146] [DEBUG] [VALIDATOR ] SUN: Primary data validation passed. [2025-09-16T20:35:43.484384] [INFO ] [MAIN ] SUN: Fetched primary data is valid. [2025-09-16T20:35:43.484664] [DEBUG] [LOCAL ] SUN: Saving primary data. [2025-09-16T20:35:43.487063] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-16T20:35:43.498229] [DEBUG] [LOCAL ] SUN: Trimmed 40737 records to 28477 (keeping 150 days of data) [2025-09-16T20:35:43.592367] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-08. [2025-09-16T20:35:43.679662] [DEBUG] [LOCAL ] SUN: Primary data saved (28477 records). [2025-09-16T20:35:43.679823] [INFO ] [MAIN ] SUN: Full history saved. [2025-09-16T20:35:43.679969] [INFO ] [MAIN ] Update Progress: 2029/2369 symbols completed. SUN took 31.7s. Estimated remaining: 36m 8s. Rate: 9.4 symbols/min [2025-09-16T20:35:43.856356] [INFO ] [MAIN ] SWK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:35:43.873556] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-16T20:35:43.879914] [INFO ] [REMOTE ] SVV: Full fetch complete (42470 records). [2025-09-16T20:35:43.880010] [DEBUG] [VALIDATOR ] SVV: Validating primary data. [2025-09-16T20:35:44.162837] [DEBUG] [LOCAL ] SWK: Loaded 38859 existing records from primary storage. [2025-09-16T20:35:44.183219] [INFO ] [MAIN ] SWK: Loaded 38859 existing records. [2025-09-16T20:35:44.386728] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-03. [2025-09-16T20:35:44.492321] [DEBUG] [VALIDATOR ] SVV: All expected trading days are present. [2025-09-16T20:35:44.497933] [DEBUG] [VALIDATOR ] SVV: Primary data validation passed. [2025-09-16T20:35:44.497808] [WARN ] [MAIN ] SWK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:35:44.499009] [INFO ] [MAIN ] SVV: Fetched primary data is valid. [2025-09-16T20:35:44.499132] [DEBUG] [LOCAL ] SVV: Saving primary data. [2025-09-16T20:35:44.499310] [INFO ] [MAIN ] SWK: Wiping existing primary data before full refresh. [2025-09-16T20:35:44.499482] [INFO ] [LOCAL ] SWK: Starting deletion of primary data. [2025-09-16T20:35:44.500264] [DEBUG] [LOCAL ] SWK: Deleted primary data file. [2025-09-16T20:35:44.500354] [INFO ] [MAIN ] SWK: Starting full primary refresh. [2025-09-16T20:35:44.500446] [DEBUG] [LOCAL ] SVV: Trimmed 42470 records to 28638 (keeping 150 days of data) [2025-09-16T20:35:45.161763] [INFO ] [REMOTE ] SWK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:35:45.193978] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-02. [2025-09-16T20:35:45.273891] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-16T20:35:45.311605] [DEBUG] [LOCAL ] SVV: Primary data saved (28638 records). [2025-09-16T20:35:45.311977] [INFO ] [MAIN ] SVV: Full history saved. [2025-09-16T20:35:45.312191] [INFO ] [MAIN ] Update Progress: 2030/2369 symbols completed. SVV took 19.4s. Estimated remaining: 36m 1s. Rate: 9.4 symbols/min [2025-09-16T20:35:45.600176] [INFO ] [MAIN ] SWX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:35:45.634244] [DEBUG] [LOCAL ] SWX: Loaded 23089 existing records from primary storage. [2025-09-16T20:35:45.634433] [INFO ] [MAIN ] SWX: Loaded 23089 existing records. [2025-09-16T20:35:45.897134] [WARN ] [MAIN ] SWX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:35:45.897437] [INFO ] [MAIN ] SWX: Wiping existing primary data before full refresh. [2025-09-16T20:35:45.897488] [INFO ] [LOCAL ] SWX: Starting deletion of primary data. [2025-09-16T20:35:45.898051] [DEBUG] [LOCAL ] SWX: Deleted primary data file. [2025-09-16T20:35:45.898110] [INFO ] [MAIN ] SWX: Starting full primary refresh. [2025-09-16T20:35:45.979983] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-09. [2025-09-16T20:35:46.282662] [INFO ] [REMOTE ] SWX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:35:46.547245] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-16T20:35:46.774926] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-04. [2025-09-16T20:35:46.888794] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-16T20:35:47.526760] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-16T20:35:47.532228] [INFO ] [REMOTE ] SUZ: Full fetch complete (50234 records). [2025-09-16T20:35:47.532320] [DEBUG] [VALIDATOR ] SUZ: Validating primary data. [2025-09-16T20:35:47.580138] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-02. [2025-09-16T20:35:47.917237] [DEBUG] [VALIDATOR ] SUZ: All expected trading days are present. [2025-09-16T20:35:47.917341] [DEBUG] [VALIDATOR ] SUZ: Primary data validation passed. [2025-09-16T20:35:47.918582] [INFO ] [MAIN ] SUZ: Fetched primary data is valid. [2025-09-16T20:35:47.918670] [DEBUG] [LOCAL ] SUZ: Saving primary data. [2025-09-16T20:35:47.920175] [DEBUG] [LOCAL ] SUZ: Trimmed 50234 records to 33932 (keeping 150 days of data) [2025-09-16T20:35:48.127229] [DEBUG] [LOCAL ] SUZ: Primary data saved (33932 records). [2025-09-16T20:35:48.127373] [INFO ] [MAIN ] SUZ: Full history saved. [2025-09-16T20:35:48.127478] [INFO ] [MAIN ] Update Progress: 2031/2369 symbols completed. SUZ took 24.3s. Estimated remaining: 35m 54s. Rate: 9.4 symbols/min [2025-09-16T20:35:48.317922] [INFO ] [MAIN ] SWZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:35:48.318110] [DEBUG] [LOCAL ] SWZ: No existing data file found in primary storage. [2025-09-16T20:35:48.318149] [WARN ] [MAIN ] SWZ: No existing data found, performing full refresh instead. [2025-09-16T20:35:48.318270] [INFO ] [MAIN ] SWZ: Wiping existing primary data before full refresh. [2025-09-16T20:35:48.318318] [INFO ] [LOCAL ] SWZ: Starting deletion of primary data. [2025-09-16T20:35:48.318361] [DEBUG] [LOCAL ] SWZ: No primary data file found to delete. [2025-09-16T20:35:48.318401] [INFO ] [MAIN ] SWZ: Starting full primary refresh. [2025-09-16T20:35:48.380869] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-03. [2025-09-16T20:35:48.707681] [INFO ] [REMOTE ] SWZ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:35:48.964923] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-16T20:35:49.174901] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-05. [2025-09-16T20:35:49.335302] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-16T20:35:49.974864] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-03. [2025-09-16T20:35:50.173416] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-16T20:35:50.774904] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-02. [2025-09-16T20:35:51.115965] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-16T20:35:51.320393] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-16T20:35:51.494774] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-16T20:35:51.574915] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-06. [2025-09-16T20:35:52.374947] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-03. [2025-09-16T20:35:53.144079] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-16T20:35:53.174946] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-04. [2025-09-16T20:35:53.459341] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-16T20:35:53.974930] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-07. [2025-09-16T20:35:54.774924] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-04. [2025-09-16T20:35:55.238448] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-16T20:35:55.574893] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-05. [2025-09-16T20:35:56.001353] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-16T20:35:56.196219] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-16T20:35:56.374920] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-08. [2025-09-16T20:35:57.174875] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-04. [2025-09-16T20:35:57.585889] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-16T20:35:57.919099] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-16T20:35:57.963915] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-16T20:35:57.974851] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-09. [2025-09-16T20:35:58.774897] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-05. [2025-09-16T20:35:59.460123] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-16T20:35:59.513959] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-16T20:35:59.520310] [INFO ] [REMOTE ] SW: Full fetch complete (57773 records). [2025-09-16T20:35:59.520411] [DEBUG] [VALIDATOR ] SW: Validating primary data. [2025-09-16T20:35:59.582377] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-05. [2025-09-16T20:35:59.899319] [DEBUG] [VALIDATOR ] SW: All expected trading days are present. [2025-09-16T20:35:59.899397] [DEBUG] [VALIDATOR ] SW: Primary data validation passed. [2025-09-16T20:35:59.900298] [INFO ] [MAIN ] SW: Fetched primary data is valid. [2025-09-16T20:35:59.900345] [DEBUG] [LOCAL ] SW: Saving primary data. [2025-09-16T20:35:59.901504] [DEBUG] [LOCAL ] SW: Trimmed 57773 records to 39567 (keeping 150 days of data) [2025-09-16T20:36:00.149164] [DEBUG] [LOCAL ] SW: Primary data saved (39567 records). [2025-09-16T20:36:00.149305] [INFO ] [MAIN ] SW: Full history saved. [2025-09-16T20:36:00.149398] [INFO ] [MAIN ] Update Progress: 2032/2369 symbols completed. SW took 22.2s. Estimated remaining: 35m 49s. Rate: 9.4 symbols/min [2025-09-16T20:36:00.320205] [INFO ] [MAIN ] SXC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:36:00.350170] [DEBUG] [LOCAL ] SXC: Loaded 30331 existing records from primary storage. [2025-09-16T20:36:00.350375] [INFO ] [MAIN ] SXC: Loaded 30331 existing records. [2025-09-16T20:36:00.381272] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-06. [2025-09-16T20:36:00.532191] [WARN ] [MAIN ] SXC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:36:00.532416] [INFO ] [MAIN ] SXC: Wiping existing primary data before full refresh. [2025-09-16T20:36:00.532468] [INFO ] [LOCAL ] SXC: Starting deletion of primary data. [2025-09-16T20:36:00.533261] [DEBUG] [LOCAL ] SXC: Deleted primary data file. [2025-09-16T20:36:00.533312] [INFO ] [MAIN ] SXC: Starting full primary refresh. [2025-09-16T20:36:00.885749] [INFO ] [REMOTE ] SXC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:36:01.102814] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-16T20:36:01.174869] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-02. [2025-09-16T20:36:01.214253] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-16T20:36:01.974939] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-06. [2025-09-16T20:36:02.540413] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-16T20:36:02.774947] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-06. [2025-09-16T20:36:03.574877] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-07. [2025-09-16T20:36:03.670235] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-16T20:36:03.876370] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-16T20:36:04.285137] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-16T20:36:04.374867] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-08. [2025-09-16T20:36:05.174900] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-07. [2025-09-16T20:36:05.360211] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-16T20:36:05.974904] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-03. [2025-09-16T20:36:06.774954] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-07. [2025-09-16T20:36:07.041090] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-16T20:36:07.226694] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-16T20:36:07.574929] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-09. [2025-09-16T20:36:08.166706] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-16T20:36:08.167748] [INFO ] [REMOTE ] SWZ: Full fetch complete (6551 records). [2025-09-16T20:36:08.167824] [DEBUG] [VALIDATOR ] SWZ: Validating primary data. [2025-09-16T20:36:08.379316] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-04. [2025-09-16T20:36:08.531301] [DEBUG] [VALIDATOR ] SWZ: All expected trading days are present. [2025-09-16T20:36:08.531412] [DEBUG] [VALIDATOR ] SWZ: Primary data validation passed. [2025-09-16T20:36:08.531629] [INFO ] [MAIN ] SWZ: Fetched primary data is valid. [2025-09-16T20:36:08.531769] [DEBUG] [LOCAL ] SWZ: Saving primary data. [2025-09-16T20:36:08.549687] [DEBUG] [LOCAL ] SWZ: Trimmed 6551 records to 4158 (keeping 150 days of data) [2025-09-16T20:36:08.550669] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-16T20:36:08.582069] [DEBUG] [LOCAL ] SWZ: Primary data saved (4158 records). [2025-09-16T20:36:08.582165] [INFO ] [MAIN ] SWZ: Full history saved. [2025-09-16T20:36:08.582234] [INFO ] [MAIN ] Update Progress: 2033/2369 symbols completed. SWZ took 20.5s. Estimated remaining: 35m 43s. Rate: 9.4 symbols/min [2025-09-16T20:36:08.750746] [INFO ] [MAIN ] SXI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:36:08.761766] [DEBUG] [LOCAL ] SXI: Loaded 8634 existing records from primary storage. [2025-09-16T20:36:08.761865] [INFO ] [MAIN ] SXI: Loaded 8634 existing records. [2025-09-16T20:36:08.938157] [WARN ] [MAIN ] SXI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:36:08.938435] [INFO ] [MAIN ] SXI: Wiping existing primary data before full refresh. [2025-09-16T20:36:08.938504] [INFO ] [LOCAL ] SXI: Starting deletion of primary data. [2025-09-16T20:36:08.938883] [DEBUG] [LOCAL ] SXI: Deleted primary data file. [2025-09-16T20:36:08.938929] [INFO ] [MAIN ] SXI: Starting full primary refresh. [2025-09-16T20:36:09.180067] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-08. [2025-09-16T20:36:09.296841] [INFO ] [REMOTE ] SXI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:36:09.943566] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-16T20:36:09.974915] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-02. [2025-09-16T20:36:10.774920] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-08. [2025-09-16T20:36:11.060005] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-16T20:36:11.089165] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-16T20:36:11.574911] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-09. [2025-09-16T20:36:11.707630] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-16T20:36:12.374899] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-03. [2025-09-16T20:36:13.175942] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-05. [2025-09-16T20:36:13.179844] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-16T20:36:13.186337] [INFO ] [REMOTE ] SWK: Full fetch complete (56878 records). [2025-09-16T20:36:13.186437] [DEBUG] [VALIDATOR ] SWK: Validating primary data. [2025-09-16T20:36:13.467861] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-16T20:36:13.580098] [DEBUG] [VALIDATOR ] SWK: All expected trading days are present. [2025-09-16T20:36:13.580176] [DEBUG] [VALIDATOR ] SWK: Primary data validation passed. [2025-09-16T20:36:13.581120] [INFO ] [MAIN ] SWK: Fetched primary data is valid. [2025-09-16T20:36:13.581164] [DEBUG] [LOCAL ] SWK: Saving primary data. [2025-09-16T20:36:13.582285] [DEBUG] [LOCAL ] SWK: Trimmed 56878 records to 39239 (keeping 150 days of data) [2025-09-16T20:36:13.835207] [DEBUG] [LOCAL ] SWK: Primary data saved (39239 records). [2025-09-16T20:36:13.835376] [INFO ] [MAIN ] SWK: Full history saved. [2025-09-16T20:36:13.835475] [INFO ] [MAIN ] Update Progress: 2034/2369 symbols completed. SWK took 30.2s. Estimated remaining: 35m 36s. Rate: 9.4 symbols/min [2025-09-16T20:36:13.982775] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-09. [2025-09-16T20:36:14.006000] [INFO ] [MAIN ] SXT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:36:14.028046] [DEBUG] [LOCAL ] SXT: Loaded 21746 existing records from primary storage. [2025-09-16T20:36:14.028179] [INFO ] [MAIN ] SXT: Loaded 21746 existing records. [2025-09-16T20:36:14.204930] [WARN ] [MAIN ] SXT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:36:14.205188] [INFO ] [MAIN ] SXT: Wiping existing primary data before full refresh. [2025-09-16T20:36:14.205237] [INFO ] [LOCAL ] SXT: Starting deletion of primary data. [2025-09-16T20:36:14.205794] [DEBUG] [LOCAL ] SXT: Deleted primary data file. [2025-09-16T20:36:14.205843] [INFO ] [MAIN ] SXT: Starting full primary refresh. [2025-09-16T20:36:14.577708] [INFO ] [REMOTE ] SXT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:36:14.759067] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-16T20:36:14.774850] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-02. [2025-09-16T20:36:14.811025] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-16T20:36:14.814811] [INFO ] [REMOTE ] SWX: Full fetch complete (33922 records). [2025-09-16T20:36:14.814887] [DEBUG] [VALIDATOR ] SWX: Validating primary data. [2025-09-16T20:36:15.193319] [DEBUG] [VALIDATOR ] SWX: All expected trading days are present. [2025-09-16T20:36:15.193399] [DEBUG] [VALIDATOR ] SWX: Primary data validation passed. [2025-09-16T20:36:15.194405] [INFO ] [MAIN ] SWX: Fetched primary data is valid. [2025-09-16T20:36:15.194461] [DEBUG] [LOCAL ] SWX: Saving primary data. [2025-09-16T20:36:15.195271] [DEBUG] [LOCAL ] SWX: Trimmed 33922 records to 23297 (keeping 150 days of data) [2025-09-16T20:36:15.346739] [DEBUG] [LOCAL ] SWX: Primary data saved (23297 records). [2025-09-16T20:36:15.346878] [INFO ] [MAIN ] SWX: Full history saved. [2025-09-16T20:36:15.346978] [INFO ] [MAIN ] Update Progress: 2035/2369 symbols completed. SWX took 30.0s. Estimated remaining: 35m 29s. Rate: 9.4 symbols/min [2025-09-16T20:36:15.520678] [INFO ] [MAIN ] SYF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:36:15.559666] [DEBUG] [LOCAL ] SYF: Loaded 39444 existing records from primary storage. [2025-09-16T20:36:15.559817] [INFO ] [MAIN ] SYF: Loaded 39444 existing records. [2025-09-16T20:36:15.580700] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-06. [2025-09-16T20:36:15.744232] [WARN ] [MAIN ] SYF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:36:15.744593] [INFO ] [MAIN ] SYF: Wiping existing primary data before full refresh. [2025-09-16T20:36:15.744692] [INFO ] [LOCAL ] SYF: Starting deletion of primary data. [2025-09-16T20:36:15.750598] [DEBUG] [LOCAL ] SYF: Deleted primary data file. [2025-09-16T20:36:15.756225] [INFO ] [MAIN ] SYF: Starting full primary refresh. [2025-09-16T20:36:15.762939] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-16T20:36:16.111687] [INFO ] [REMOTE ] SYF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:36:16.374899] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-03. [2025-09-16T20:36:17.174913] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-02. [2025-09-16T20:36:17.277912] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-16T20:36:17.410227] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-16T20:36:17.974899] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-07. [2025-09-16T20:36:18.774953] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-04. [2025-09-16T20:36:18.834510] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-16T20:36:19.498229] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-16T20:36:19.574864] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-08. [2025-09-16T20:36:19.743524] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-16T20:36:20.374906] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-03. [2025-09-16T20:36:21.174898] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-05. [2025-09-16T20:36:21.257170] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-16T20:36:21.778812] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-16T20:36:21.974906] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-09. [2025-09-16T20:36:22.161914] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-16T20:36:22.774902] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-04. [2025-09-16T20:36:23.250382] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-16T20:36:23.257026] [INFO ] [REMOTE ] SXC: Full fetch complete (45610 records). [2025-09-16T20:36:23.257183] [DEBUG] [VALIDATOR ] SXC: Validating primary data. [2025-09-16T20:36:23.579991] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-06. [2025-09-16T20:36:23.649347] [DEBUG] [VALIDATOR ] SXC: All expected trading days are present. [2025-09-16T20:36:23.649437] [DEBUG] [VALIDATOR ] SXC: Primary data validation passed. [2025-09-16T20:36:23.650364] [INFO ] [MAIN ] SXC: Fetched primary data is valid. [2025-09-16T20:36:23.650410] [DEBUG] [LOCAL ] SXC: Saving primary data. [2025-09-16T20:36:23.651496] [DEBUG] [LOCAL ] SXC: Trimmed 45610 records to 30644 (keeping 150 days of data) [2025-09-16T20:36:23.843764] [DEBUG] [LOCAL ] SXC: Primary data saved (30644 records). [2025-09-16T20:36:23.843911] [INFO ] [MAIN ] SXC: Full history saved. [2025-09-16T20:36:23.844013] [INFO ] [MAIN ] Update Progress: 2036/2369 symbols completed. SXC took 23.7s. Estimated remaining: 35m 23s. Rate: 9.4 symbols/min [2025-09-16T20:36:24.013713] [INFO ] [MAIN ] SYK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:36:24.013901] [DEBUG] [LOCAL ] SYK: No existing data file found in primary storage. [2025-09-16T20:36:24.013953] [WARN ] [MAIN ] SYK: No existing data found, performing full refresh instead. [2025-09-16T20:36:24.014100] [INFO ] [MAIN ] SYK: Wiping existing primary data before full refresh. [2025-09-16T20:36:24.014139] [INFO ] [LOCAL ] SYK: Starting deletion of primary data. [2025-09-16T20:36:24.014180] [DEBUG] [LOCAL ] SYK: No primary data file found to delete. [2025-09-16T20:36:24.014211] [INFO ] [MAIN ] SYK: Starting full primary refresh. [2025-09-16T20:36:24.386080] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-04. [2025-09-16T20:36:24.390517] [INFO ] [REMOTE ] SYK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:36:24.400950] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-16T20:36:24.423104] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-16T20:36:25.174902] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-02. [2025-09-16T20:36:25.974906] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-05. [2025-09-16T20:36:26.198594] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-16T20:36:26.782835] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-05. [2025-09-16T20:36:26.805914] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-16T20:36:26.936142] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-16T20:36:27.574944] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-07. [2025-09-16T20:36:28.374921] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-06. [2025-09-16T20:36:28.472878] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-16T20:36:28.721338] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-16T20:36:29.174909] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-08. [2025-09-16T20:36:29.648895] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-16T20:36:29.974957] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-03. [2025-09-16T20:36:30.162057] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-16T20:36:30.774938] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-06. [2025-09-16T20:36:31.574903] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-09. [2025-09-16T20:36:31.822093] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-16T20:36:32.374876] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-07. [2025-09-16T20:36:32.546403] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-16T20:36:32.551815] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-16T20:36:32.560293] [INFO ] [REMOTE ] SXI: Full fetch complete (12024 records). [2025-09-16T20:36:32.560375] [DEBUG] [VALIDATOR ] SXI: Validating primary data. [2025-09-16T20:36:32.931814] [DEBUG] [VALIDATOR ] SXI: All expected trading days are present. [2025-09-16T20:36:32.931895] [DEBUG] [VALIDATOR ] SXI: Primary data validation passed. [2025-09-16T20:36:32.932194] [INFO ] [MAIN ] SXI: Fetched primary data is valid. [2025-09-16T20:36:32.932235] [DEBUG] [LOCAL ] SXI: Saving primary data. [2025-09-16T20:36:32.932736] [DEBUG] [LOCAL ] SXI: Trimmed 12024 records to 8769 (keeping 150 days of data) [2025-09-16T20:36:32.989155] [DEBUG] [LOCAL ] SXI: Primary data saved (8769 records). [2025-09-16T20:36:32.989286] [INFO ] [MAIN ] SXI: Full history saved. [2025-09-16T20:36:32.989366] [INFO ] [MAIN ] Update Progress: 2037/2369 symbols completed. SXI took 24.4s. Estimated remaining: 35m 17s. Rate: 9.4 symbols/min [2025-09-16T20:36:33.174929] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-07. [2025-09-16T20:36:33.788935] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-16T20:36:33.974895] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-08. [2025-09-16T20:36:34.774972] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-04. [2025-09-16T20:36:35.094421] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-16T20:36:35.294788] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-16T20:36:35.574933] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-08. [2025-09-16T20:36:36.374947] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-09. [2025-09-16T20:36:36.797767] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-16T20:36:37.174866] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-05. [2025-09-16T20:36:37.370614] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-16T20:36:37.546742] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-16T20:36:37.550549] [INFO ] [REMOTE ] SXT: Full fetch complete (30723 records). [2025-09-16T20:36:37.550622] [DEBUG] [VALIDATOR ] SXT: Validating primary data. [2025-09-16T20:36:37.933278] [DEBUG] [VALIDATOR ] SXT: All expected trading days are present. [2025-09-16T20:36:37.933388] [DEBUG] [VALIDATOR ] SXT: Primary data validation passed. [2025-09-16T20:36:37.934136] [INFO ] [MAIN ] SXT: Fetched primary data is valid. [2025-09-16T20:36:37.934183] [DEBUG] [LOCAL ] SXT: Saving primary data. [2025-09-16T20:36:37.934981] [DEBUG] [LOCAL ] SXT: Trimmed 30723 records to 21998 (keeping 150 days of data) [2025-09-16T20:36:37.989858] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-09. [2025-09-16T20:36:38.073267] [DEBUG] [LOCAL ] SXT: Primary data saved (21998 records). [2025-09-16T20:36:38.073399] [INFO ] [MAIN ] SXT: Full history saved. [2025-09-16T20:36:38.073480] [INFO ] [MAIN ] Update Progress: 2038/2369 symbols completed. SXT took 24.2s. Estimated remaining: 35m 11s. Rate: 9.4 symbols/min [2025-09-16T20:36:38.525322] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-16T20:36:38.534958] [INFO ] [REMOTE ] SYF: Full fetch complete (57742 records). [2025-09-16T20:36:38.535168] [DEBUG] [VALIDATOR ] SYF: Validating primary data. [2025-09-16T20:36:38.536195] [FATAL] [VALIDATOR ] SYF: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T20:36:38.536364] [FATAL] [MAIN ] SYF: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:36:38.536425] [WARN ] [MAIN ] SYF: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:36:38.536488] [INFO ] [LOCAL ] SYF: Starting deletion of primary data. [2025-09-16T20:36:38.536575] [DEBUG] [LOCAL ] SYF: No primary data file found to delete. [2025-09-16T20:36:38.536665] [INFO ] [LOCAL ] SYF: Starting deletion of derivative data. [2025-09-16T20:36:38.537161] [DEBUG] [LOCAL ] SYF: Deleted derivative data file. [2025-09-16T20:36:38.538978] [INFO ] [MAIN ] Update Progress: 2039/2369 symbols completed. SYF took 23.2s. Estimated remaining: 35m 3s. Rate: 9.4 symbols/min [2025-09-16T20:36:38.704930] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-16T20:36:38.774995] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-06. [2025-09-16T20:36:40.437758] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-16T20:36:40.447732] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-07. [2025-09-16T20:36:42.218904] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-16T20:36:42.228983] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-08. [2025-09-16T20:36:44.062997] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-16T20:36:44.072580] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-09. [2025-09-16T20:36:44.764170] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-16T20:36:44.770818] [INFO ] [REMOTE ] SYK: Full fetch complete (51043 records). [2025-09-16T20:36:44.771016] [DEBUG] [VALIDATOR ] SYK: Validating primary data. [2025-09-16T20:36:44.771869] [FATAL] [VALIDATOR ] SYK: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T20:36:44.771986] [FATAL] [MAIN ] SYK: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:36:44.772045] [WARN ] [MAIN ] SYK: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:36:44.772118] [INFO ] [LOCAL ] SYK: Starting deletion of primary data. [2025-09-16T20:36:44.772205] [DEBUG] [LOCAL ] SYK: No primary data file found to delete. [2025-09-16T20:36:44.772263] [INFO ] [LOCAL ] SYK: Starting deletion of derivative data. [2025-09-16T20:36:44.772327] [DEBUG] [LOCAL ] SYK: No derivative data file found to delete. [2025-09-16T20:36:44.772443] [INFO ] [MAIN ] Update Progress: 2040/2369 symbols completed. SYK took 20.9s. Estimated remaining: 34m 57s. Rate: 9.4 symbols/min [2025-09-16T20:36:45.416883] [INFO ] [MAIN ] SYY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:36:45.455981] [DEBUG] [LOCAL ] SYY: No existing data file found in primary storage. [2025-09-16T20:36:45.481128] [INFO ] [MAIN ] TAC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:36:45.447565] [INFO ] [MAIN ] T: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:36:45.481872] [DEBUG] [LOCAL ] TAC: No existing data file found in primary storage. [2025-09-16T20:36:45.482012] [DEBUG] [LOCAL ] T: No existing data file found in primary storage. [2025-09-16T20:36:45.487296] [WARN ] [MAIN ] T: No existing data found, performing full refresh instead. [2025-09-16T20:36:45.481742] [WARN ] [MAIN ] SYY: No existing data found, performing full refresh instead. [2025-09-16T20:36:45.481960] [WARN ] [MAIN ] TAC: No existing data found, performing full refresh instead. [2025-09-16T20:36:45.538242] [INFO ] [MAIN ] T: Wiping existing primary data before full refresh. [2025-09-16T20:36:45.536578] [INFO ] [MAIN ] TAC: Wiping existing primary data before full refresh. [2025-09-16T20:36:45.538737] [INFO ] [LOCAL ] TAC: Starting deletion of primary data. [2025-09-16T20:36:45.539011] [DEBUG] [LOCAL ] TAC: No primary data file found to delete. [2025-09-16T20:36:45.538877] [INFO ] [LOCAL ] T: Starting deletion of primary data. [2025-09-16T20:36:45.538559] [INFO ] [MAIN ] SYY: Wiping existing primary data before full refresh. [2025-09-16T20:36:45.539212] [DEBUG] [LOCAL ] T: No primary data file found to delete. [2025-09-16T20:36:45.539399] [INFO ] [MAIN ] T: Starting full primary refresh. [2025-09-16T20:36:45.539318] [INFO ] [LOCAL ] SYY: Starting deletion of primary data. [2025-09-16T20:36:45.538150] [INFO ] [MAIN ] TAK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:36:45.544705] [INFO ] [MAIN ] TAC: Starting full primary refresh. [2025-09-16T20:36:45.553328] [DEBUG] [LOCAL ] SYY: No primary data file found to delete. [2025-09-16T20:36:45.621154] [INFO ] [MAIN ] SYY: Starting full primary refresh. [2025-09-16T20:36:46.298040] [DEBUG] [LOCAL ] TAK: Loaded 37207 existing records from primary storage. [2025-09-16T20:36:46.377874] [INFO ] [MAIN ] TAK: Loaded 37207 existing records. [2025-09-16T20:36:46.723011] [INFO ] [REMOTE ] T: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:36:46.770818] [INFO ] [REMOTE ] T: Fetching primary data for 2025-02. [2025-09-16T20:36:46.822829] [INFO ] [REMOTE ] TAC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:36:46.920014] [INFO ] [REMOTE ] SYY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:36:46.870447] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-02. [2025-09-16T20:36:46.950924] [WARN ] [MAIN ] TAK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:36:46.950770] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-02. [2025-09-16T20:36:46.954086] [INFO ] [MAIN ] TAK: Wiping existing primary data before full refresh. [2025-09-16T20:36:46.954178] [INFO ] [LOCAL ] TAK: Starting deletion of primary data. [2025-09-16T20:36:46.955013] [DEBUG] [LOCAL ] TAK: Deleted primary data file. [2025-09-16T20:36:46.955071] [INFO ] [MAIN ] TAK: Starting full primary refresh. [2025-09-16T20:36:47.334232] [INFO ] [REMOTE ] TAK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:36:47.334561] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-02. [2025-09-16T20:36:48.394727] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-16T20:36:48.404975] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-03. [2025-09-16T20:36:49.068399] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-09-16T20:36:49.109121] [INFO ] [REMOTE ] T: Fetching primary data for 2025-03. [2025-09-16T20:36:49.112526] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-09-16T20:36:49.122549] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-03. [2025-09-16T20:36:49.176014] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-16T20:36:49.185374] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-03. [2025-09-16T20:36:50.317138] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-16T20:36:50.328348] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-04. [2025-09-16T20:36:50.783375] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-16T20:36:50.793617] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-04. [2025-09-16T20:36:50.858988] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-16T20:36:50.869596] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-04. [2025-09-16T20:36:51.435400] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-16T20:36:51.447411] [INFO ] [REMOTE ] T: Fetching primary data for 2025-04. [2025-09-16T20:36:52.178453] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-16T20:36:52.189758] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-05. [2025-09-16T20:36:52.322603] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-16T20:36:52.374885] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-05. [2025-09-16T20:36:52.586043] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-16T20:36:53.175027] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-05. [2025-09-16T20:36:53.820317] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-16T20:36:53.974879] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-06. [2025-09-16T20:36:54.052616] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-09-16T20:36:54.185279] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-16T20:36:54.507292] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-16T20:36:54.774909] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-06. [2025-09-16T20:36:54.885442] [DEBUG] [REMOTE ] SYY: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-09-16T20:36:54.885761] [WARN ] [REMOTE ] SYY: No data returned for month 2025-06 [2025-09-16T20:36:55.548751] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-16T20:36:55.574847] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-07. [2025-09-16T20:36:56.374940] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-07. [2025-09-16T20:36:57.174907] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-06. [2025-09-16T20:36:57.268441] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-16T20:36:57.931234] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-16T20:36:57.974878] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-08. [2025-09-16T20:36:58.475769] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-16T20:36:58.774870] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-08. [2025-09-16T20:36:59.574895] [INFO ] [REMOTE ] T: Fetching primary data for 2025-05. [2025-09-16T20:36:59.799725] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-16T20:37:00.374904] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-09. [2025-09-16T20:37:00.523890] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-16T20:37:01.180198] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-09. [2025-09-16T20:37:01.192372] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-16T20:37:01.199245] [INFO ] [REMOTE ] SYY: Full fetch complete (49742 records). [2025-09-16T20:37:01.199407] [DEBUG] [VALIDATOR ] SYY: Validating primary data. [2025-09-16T20:37:01.200324] [FATAL] [VALIDATOR ] SYY: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T20:37:01.200423] [FATAL] [MAIN ] SYY: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:37:01.200471] [WARN ] [MAIN ] SYY: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:37:01.200518] [INFO ] [LOCAL ] SYY: Starting deletion of primary data. [2025-09-16T20:37:01.200590] [DEBUG] [LOCAL ] SYY: No primary data file found to delete. [2025-09-16T20:37:01.200630] [INFO ] [LOCAL ] SYY: Starting deletion of derivative data. [2025-09-16T20:37:01.200699] [DEBUG] [LOCAL ] SYY: No derivative data file found to delete. [2025-09-16T20:37:01.200766] [INFO ] [MAIN ] Update Progress: 2041/2369 symbols completed. SYY took 16.4s. Estimated remaining: 34m 52s. Rate: 9.4 symbols/min [2025-09-16T20:37:01.388374] [INFO ] [MAIN ] TAL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:37:01.436015] [DEBUG] [LOCAL ] TAL: Loaded 38239 existing records from primary storage. [2025-09-16T20:37:01.436243] [INFO ] [MAIN ] TAL: Loaded 38239 existing records. [2025-09-16T20:37:01.649147] [WARN ] [MAIN ] TAL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:37:01.649410] [INFO ] [MAIN ] TAL: Wiping existing primary data before full refresh. [2025-09-16T20:37:01.649460] [INFO ] [LOCAL ] TAL: Starting deletion of primary data. [2025-09-16T20:37:01.650355] [DEBUG] [LOCAL ] TAL: Deleted primary data file. [2025-09-16T20:37:01.650414] [INFO ] [MAIN ] TAL: Starting full primary refresh. [2025-09-16T20:37:01.985316] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-07. [2025-09-16T20:37:02.024971] [INFO ] [REMOTE ] TAL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:37:02.195483] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-05 (2.62 seconds). [2025-09-16T20:37:02.267333] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-16T20:37:02.272025] [INFO ] [REMOTE ] TAC: Full fetch complete (47201 records). [2025-09-16T20:37:02.272118] [DEBUG] [VALIDATOR ] TAC: Validating primary data. [2025-09-16T20:37:02.651193] [DEBUG] [VALIDATOR ] TAC: All expected trading days are present. [2025-09-16T20:37:02.651286] [DEBUG] [VALIDATOR ] TAC: Primary data validation passed. [2025-09-16T20:37:02.652206] [INFO ] [MAIN ] TAC: Fetched primary data is valid. [2025-09-16T20:37:02.652252] [DEBUG] [LOCAL ] TAC: Saving primary data. [2025-09-16T20:37:02.653375] [DEBUG] [LOCAL ] TAC: Trimmed 47201 records to 31268 (keeping 150 days of data) [2025-09-16T20:37:02.777523] [INFO ] [REMOTE ] T: Fetching primary data for 2025-06. [2025-09-16T20:37:02.858697] [DEBUG] [LOCAL ] TAC: Primary data saved (31268 records). [2025-09-16T20:37:02.858839] [INFO ] [MAIN ] TAC: Full history saved. [2025-09-16T20:37:02.858927] [INFO ] [MAIN ] Update Progress: 2042/2369 symbols completed. TAC took 18.1s. Estimated remaining: 34m 45s. Rate: 9.4 symbols/min [2025-09-16T20:37:03.032615] [INFO ] [MAIN ] TALO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:37:03.070815] [DEBUG] [LOCAL ] TALO: Loaded 37607 existing records from primary storage. [2025-09-16T20:37:03.070994] [INFO ] [MAIN ] TALO: Loaded 37607 existing records. [2025-09-16T20:37:03.249201] [WARN ] [MAIN ] TALO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:37:03.249439] [INFO ] [MAIN ] TALO: Wiping existing primary data before full refresh. [2025-09-16T20:37:03.249485] [INFO ] [LOCAL ] TALO: Starting deletion of primary data. [2025-09-16T20:37:03.250189] [DEBUG] [LOCAL ] TALO: Deleted primary data file. [2025-09-16T20:37:03.250237] [INFO ] [MAIN ] TALO: Starting full primary refresh. [2025-09-16T20:37:03.596762] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-02. [2025-09-16T20:37:03.615896] [INFO ] [REMOTE ] TALO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:37:03.651031] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-16T20:37:04.374948] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-08. [2025-09-16T20:37:04.752907] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-16T20:37:05.174927] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-02. [2025-09-16T20:37:05.468511] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-16T20:37:05.929471] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-16T20:37:05.974903] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-09. [2025-09-16T20:37:06.774900] [INFO ] [REMOTE ] T: Fetching primary data for 2025-07. [2025-09-16T20:37:06.821095] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-16T20:37:07.574946] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-03. [2025-09-16T20:37:07.617276] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-16T20:37:07.623488] [INFO ] [REMOTE ] TAK: Full fetch complete (54001 records). [2025-09-16T20:37:07.623635] [DEBUG] [VALIDATOR ] TAK: Validating primary data. [2025-09-16T20:37:08.007110] [DEBUG] [VALIDATOR ] TAK: All expected trading days are present. [2025-09-16T20:37:08.007208] [DEBUG] [VALIDATOR ] TAK: Primary data validation passed. [2025-09-16T20:37:08.008259] [INFO ] [MAIN ] TAK: Fetched primary data is valid. [2025-09-16T20:37:08.008320] [DEBUG] [LOCAL ] TAK: Saving primary data. [2025-09-16T20:37:08.009483] [DEBUG] [LOCAL ] TAK: Trimmed 54001 records to 37579 (keeping 150 days of data) [2025-09-16T20:37:08.237828] [DEBUG] [LOCAL ] TAK: Primary data saved (37579 records). [2025-09-16T20:37:08.237975] [INFO ] [MAIN ] TAK: Full history saved. [2025-09-16T20:37:08.238061] [INFO ] [MAIN ] Update Progress: 2043/2369 symbols completed. TAK took 23.5s. Estimated remaining: 34m 38s. Rate: 9.4 symbols/min [2025-09-16T20:37:08.384144] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-03. [2025-09-16T20:37:08.408237] [INFO ] [MAIN ] TAP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:37:08.447905] [DEBUG] [LOCAL ] TAP: Loaded 39102 existing records from primary storage. [2025-09-16T20:37:08.448070] [INFO ] [MAIN ] TAP: Loaded 39102 existing records. [2025-09-16T20:37:08.628738] [WARN ] [MAIN ] TAP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:37:08.628995] [INFO ] [MAIN ] TAP: Wiping existing primary data before full refresh. [2025-09-16T20:37:08.629041] [INFO ] [LOCAL ] TAP: Starting deletion of primary data. [2025-09-16T20:37:08.629857] [DEBUG] [LOCAL ] TAP: Deleted primary data file. [2025-09-16T20:37:08.629905] [INFO ] [MAIN ] TAP: Starting full primary refresh. [2025-09-16T20:37:08.984221] [INFO ] [REMOTE ] TAP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:37:09.023982] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-16T20:37:09.174864] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-02. [2025-09-16T20:37:09.310616] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-16T20:37:09.974930] [INFO ] [REMOTE ] T: Fetching primary data for 2025-08. [2025-09-16T20:37:10.405291] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-16T20:37:10.774913] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-04. [2025-09-16T20:37:11.372433] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-09-16T20:37:11.574954] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-04. [2025-09-16T20:37:12.306303] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-16T20:37:12.374843] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-05. [2025-09-16T20:37:12.512086] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-08 (2.54 seconds). [2025-09-16T20:37:13.174911] [INFO ] [REMOTE ] T: Fetching primary data for 2025-09. [2025-09-16T20:37:13.401364] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-16T20:37:13.940515] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-16T20:37:13.946618] [INFO ] [REMOTE ] T: Full fetch complete (58088 records). [2025-09-16T20:37:13.946850] [DEBUG] [VALIDATOR ] T: Validating primary data. [2025-09-16T20:37:13.947612] [FATAL] [VALIDATOR ] T: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T20:37:13.947714] [FATAL] [MAIN ] T: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:37:13.947761] [WARN ] [MAIN ] T: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:37:13.947806] [INFO ] [LOCAL ] T: Starting deletion of primary data. [2025-09-16T20:37:13.947865] [DEBUG] [LOCAL ] T: No primary data file found to delete. [2025-09-16T20:37:13.947903] [INFO ] [LOCAL ] T: Starting deletion of derivative data. [2025-09-16T20:37:13.947942] [DEBUG] [LOCAL ] T: No derivative data file found to delete. [2025-09-16T20:37:13.948025] [INFO ] [MAIN ] Update Progress: 2044/2369 symbols completed. T took 29.2s. Estimated remaining: 34m 32s. Rate: 9.4 symbols/min [2025-09-16T20:37:13.974909] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-05. [2025-09-16T20:37:14.128854] [INFO ] [MAIN ] TBB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:37:14.139196] [DEBUG] [LOCAL ] TBB: Loaded 8488 existing records from primary storage. [2025-09-16T20:37:14.139458] [INFO ] [MAIN ] TBB: Loaded 8488 existing records. [2025-09-16T20:37:14.343087] [WARN ] [MAIN ] TBB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:37:14.358959] [INFO ] [MAIN ] TBB: Wiping existing primary data before full refresh. [2025-09-16T20:37:14.359020] [INFO ] [LOCAL ] TBB: Starting deletion of primary data. [2025-09-16T20:37:14.359930] [DEBUG] [LOCAL ] TBB: Deleted primary data file. [2025-09-16T20:37:14.359991] [INFO ] [MAIN ] TBB: Starting full primary refresh. [2025-09-16T20:37:14.362356] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-16T20:37:14.737636] [INFO ] [REMOTE ] TBB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:37:14.774860] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-02. [2025-09-16T20:37:15.425775] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-16T20:37:15.574896] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-06. [2025-09-16T20:37:15.751288] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-16T20:37:16.374912] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-03. [2025-09-16T20:37:17.174898] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-03. [2025-09-16T20:37:17.219508] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-16T20:37:17.270564] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-16T20:37:17.974910] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-06. [2025-09-16T20:37:18.774893] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-04. [2025-09-16T20:37:19.067968] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-16T20:37:19.574888] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-04. [2025-09-16T20:37:19.667628] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-16T20:37:19.719624] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-16T20:37:20.374906] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-07. [2025-09-16T20:37:21.174880] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-05. [2025-09-16T20:37:21.622058] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-16T20:37:21.974916] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-07. [2025-09-16T20:37:22.285742] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-16T20:37:22.306377] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-16T20:37:22.774892] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-08. [2025-09-16T20:37:23.366482] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-16T20:37:23.574885] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-05. [2025-09-16T20:37:24.379974] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-08. [2025-09-16T20:37:24.397785] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-16T20:37:25.174924] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-09. [2025-09-16T20:37:25.432045] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-16T20:37:25.974974] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-06. [2025-09-16T20:37:26.098789] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-16T20:37:26.359852] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-16T20:37:26.366362] [INFO ] [REMOTE ] TAL: Full fetch complete (56867 records). [2025-09-16T20:37:26.366499] [DEBUG] [VALIDATOR ] TAL: Validating primary data. [2025-09-16T20:37:26.759263] [DEBUG] [VALIDATOR ] TAL: All expected trading days are present. [2025-09-16T20:37:26.759355] [DEBUG] [VALIDATOR ] TAL: Primary data validation passed. [2025-09-16T20:37:26.760371] [INFO ] [MAIN ] TAL: Fetched primary data is valid. [2025-09-16T20:37:26.760428] [DEBUG] [LOCAL ] TAL: Saving primary data. [2025-09-16T20:37:26.761750] [DEBUG] [LOCAL ] TAL: Trimmed 56867 records to 38618 (keeping 150 days of data) [2025-09-16T20:37:26.820285] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-09. [2025-09-16T20:37:26.881746] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-16T20:37:27.013702] [DEBUG] [LOCAL ] TAL: Primary data saved (38618 records). [2025-09-16T20:37:27.013846] [INFO ] [MAIN ] TAL: Full history saved. [2025-09-16T20:37:27.014045] [INFO ] [MAIN ] Update Progress: 2045/2369 symbols completed. TAL took 25.8s. Estimated remaining: 34m 27s. Rate: 9.4 symbols/min [2025-09-16T20:37:27.185414] [INFO ] [MAIN ] TBBB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:37:27.211016] [DEBUG] [LOCAL ] TBBB: Loaded 26022 existing records from primary storage. [2025-09-16T20:37:27.211151] [INFO ] [MAIN ] TBBB: Loaded 26022 existing records. [2025-09-16T20:37:27.390064] [WARN ] [MAIN ] TBBB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:37:27.390336] [INFO ] [MAIN ] TBBB: Wiping existing primary data before full refresh. [2025-09-16T20:37:27.390387] [INFO ] [LOCAL ] TBBB: Starting deletion of primary data. [2025-09-16T20:37:27.390924] [DEBUG] [LOCAL ] TBBB: Deleted primary data file. [2025-09-16T20:37:27.390978] [INFO ] [MAIN ] TBBB: Starting full primary refresh. [2025-09-16T20:37:27.580312] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-07. [2025-09-16T20:37:27.750755] [INFO ] [REMOTE ] TBBB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:37:28.174363] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-16T20:37:28.180338] [INFO ] [REMOTE ] TALO: Full fetch complete (55200 records). [2025-09-16T20:37:28.180445] [DEBUG] [VALIDATOR ] TALO: Validating primary data. [2025-09-16T20:37:28.380002] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-02. [2025-09-16T20:37:28.538688] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-16T20:37:28.586558] [DEBUG] [VALIDATOR ] TALO: All expected trading days are present. [2025-09-16T20:37:28.586636] [DEBUG] [VALIDATOR ] TALO: Primary data validation passed. [2025-09-16T20:37:28.587619] [INFO ] [MAIN ] TALO: Fetched primary data is valid. [2025-09-16T20:37:28.587676] [DEBUG] [LOCAL ] TALO: Saving primary data. [2025-09-16T20:37:28.588909] [DEBUG] [LOCAL ] TALO: Trimmed 55200 records to 37968 (keeping 150 days of data) [2025-09-16T20:37:28.806967] [DEBUG] [LOCAL ] TALO: Primary data saved (37968 records). [2025-09-16T20:37:28.807109] [INFO ] [MAIN ] TALO: Full history saved. [2025-09-16T20:37:28.807852] [INFO ] [MAIN ] Update Progress: 2046/2369 symbols completed. TALO took 25.9s. Estimated remaining: 34m 20s. Rate: 9.4 symbols/min [2025-09-16T20:37:28.979568] [INFO ] [MAIN ] TBI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:37:28.996990] [DEBUG] [LOCAL ] TBI: Loaded 16211 existing records from primary storage. [2025-09-16T20:37:28.997119] [INFO ] [MAIN ] TBI: Loaded 16211 existing records. [2025-09-16T20:37:29.176054] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-06. [2025-09-16T20:37:29.179278] [WARN ] [MAIN ] TBI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:37:29.180293] [INFO ] [MAIN ] TBI: Wiping existing primary data before full refresh. [2025-09-16T20:37:29.180343] [INFO ] [LOCAL ] TBI: Starting deletion of primary data. [2025-09-16T20:37:29.180770] [DEBUG] [LOCAL ] TBI: Deleted primary data file. [2025-09-16T20:37:29.180864] [INFO ] [MAIN ] TBI: Starting full primary refresh. [2025-09-16T20:37:29.560584] [INFO ] [REMOTE ] TBI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:37:29.977686] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-08. [2025-09-16T20:37:29.982408] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-16T20:37:30.529324] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-16T20:37:30.774875] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-03. [2025-09-16T20:37:30.823225] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-16T20:37:31.574901] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-07. [2025-09-16T20:37:32.067131] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-16T20:37:32.374915] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-02. [2025-09-16T20:37:33.174966] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-09. [2025-09-16T20:37:33.281725] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-16T20:37:33.492308] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-16T20:37:33.747269] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-16T20:37:33.749222] [INFO ] [REMOTE ] TBB: Full fetch complete (12528 records). [2025-09-16T20:37:33.749324] [DEBUG] [VALIDATOR ] TBB: Validating primary data. [2025-09-16T20:37:33.983635] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-04. [2025-09-16T20:37:34.114609] [DEBUG] [VALIDATOR ] TBB: All expected trading days are present. [2025-09-16T20:37:34.114711] [DEBUG] [VALIDATOR ] TBB: Primary data validation passed. [2025-09-16T20:37:34.115090] [INFO ] [MAIN ] TBB: Fetched primary data is valid. [2025-09-16T20:37:34.115131] [DEBUG] [LOCAL ] TBB: Saving primary data. [2025-09-16T20:37:34.115594] [DEBUG] [LOCAL ] TBB: Trimmed 12528 records to 8677 (keeping 150 days of data) [2025-09-16T20:37:34.167932] [DEBUG] [LOCAL ] TBB: Primary data saved (8677 records). [2025-09-16T20:37:34.168073] [INFO ] [MAIN ] TBB: Full history saved. [2025-09-16T20:37:34.168182] [INFO ] [MAIN ] Update Progress: 2047/2369 symbols completed. TBB took 20.2s. Estimated remaining: 34m 13s. Rate: 9.4 symbols/min [2025-09-16T20:37:34.346014] [INFO ] [MAIN ] TBLU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:37:34.346187] [DEBUG] [LOCAL ] TBLU: No existing data file found in primary storage. [2025-09-16T20:37:34.346228] [WARN ] [MAIN ] TBLU: No existing data found, performing full refresh instead. [2025-09-16T20:37:34.346367] [INFO ] [MAIN ] TBLU: Wiping existing primary data before full refresh. [2025-09-16T20:37:34.346416] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-09-16T20:37:34.346461] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-09-16T20:37:34.346495] [INFO ] [MAIN ] TBLU: Starting full primary refresh. [2025-09-16T20:37:34.712123] [INFO ] [REMOTE ] TBLU: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:37:34.774900] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-08. [2025-09-16T20:37:35.479086] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-16T20:37:35.574851] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-05. [2025-09-16T20:37:36.236253] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-16T20:37:36.374912] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-03. [2025-09-16T20:37:36.912060] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-16T20:37:37.174876] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-02. [2025-09-16T20:37:37.505621] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-16T20:37:37.720023] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-16T20:37:37.974934] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-09. [2025-09-16T20:37:38.774942] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-04. [2025-09-16T20:37:39.481414] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-16T20:37:39.487634] [INFO ] [REMOTE ] TAP: Full fetch complete (57460 records). [2025-09-16T20:37:39.487751] [DEBUG] [VALIDATOR ] TAP: Validating primary data. [2025-09-16T20:37:39.580070] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-06. [2025-09-16T20:37:39.880124] [DEBUG] [VALIDATOR ] TAP: All expected trading days are present. [2025-09-16T20:37:39.880219] [DEBUG] [VALIDATOR ] TAP: Primary data validation passed. [2025-09-16T20:37:39.881333] [INFO ] [MAIN ] TAP: Fetched primary data is valid. [2025-09-16T20:37:39.881396] [DEBUG] [LOCAL ] TAP: Saving primary data. [2025-09-16T20:37:39.882706] [DEBUG] [LOCAL ] TAP: Trimmed 57460 records to 39488 (keeping 150 days of data) [2025-09-16T20:37:40.005745] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-16T20:37:40.152459] [DEBUG] [LOCAL ] TAP: Primary data saved (39488 records). [2025-09-16T20:37:40.152610] [INFO ] [MAIN ] TAP: Full history saved. [2025-09-16T20:37:40.152719] [INFO ] [MAIN ] Update Progress: 2048/2369 symbols completed. TAP took 31.9s. Estimated remaining: 34m 7s. Rate: 9.4 symbols/min [2025-09-16T20:37:40.351372] [INFO ] [MAIN ] TBN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:37:40.354938] [DEBUG] [LOCAL ] TBN: Loaded 2101 existing records from primary storage. [2025-09-16T20:37:40.355010] [INFO ] [MAIN ] TBN: Loaded 2101 existing records. [2025-09-16T20:37:40.385421] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-03. [2025-09-16T20:37:40.540723] [WARN ] [MAIN ] TBN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:37:40.540993] [INFO ] [MAIN ] TBN: Wiping existing primary data before full refresh. [2025-09-16T20:37:40.541049] [INFO ] [LOCAL ] TBN: Starting deletion of primary data. [2025-09-16T20:37:40.541231] [DEBUG] [LOCAL ] TBN: Deleted primary data file. [2025-09-16T20:37:40.541275] [INFO ] [MAIN ] TBN: Starting full primary refresh. [2025-09-16T20:37:40.891129] [INFO ] [REMOTE ] TBN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:37:40.893055] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-16T20:37:40.979107] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-16T20:37:41.174936] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-07. [2025-09-16T20:37:41.974906] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-05. [2025-09-16T20:37:42.773027] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-16T20:37:42.789112] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-04. [2025-09-16T20:37:42.980554] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-16T20:37:43.178160] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-16T20:37:43.574916] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-08. [2025-09-16T20:37:44.374902] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-05. [2025-09-16T20:37:44.796156] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-16T20:37:44.939614] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-16T20:37:45.174905] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-09. [2025-09-16T20:37:45.974943] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-02. [2025-09-16T20:37:46.206959] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-16T20:37:46.211506] [INFO ] [REMOTE ] TBBB: Full fetch complete (39978 records). [2025-09-16T20:37:46.211666] [DEBUG] [VALIDATOR ] TBBB: Validating primary data. [2025-09-16T20:37:46.586749] [DEBUG] [VALIDATOR ] TBBB: All expected trading days are present. [2025-09-16T20:37:46.587348] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-16T20:37:46.587222] [DEBUG] [VALIDATOR ] TBBB: Primary data validation passed. [2025-09-16T20:37:46.588258] [INFO ] [MAIN ] TBBB: Fetched primary data is valid. [2025-09-16T20:37:46.589942] [DEBUG] [LOCAL ] TBBB: Saving primary data. [2025-09-16T20:37:46.590744] [DEBUG] [LOCAL ] TBBB: Trimmed 39978 records to 26199 (keeping 150 days of data) [2025-09-16T20:37:46.748736] [DEBUG] [LOCAL ] TBBB: Primary data saved (26199 records). [2025-09-16T20:37:46.748867] [INFO ] [MAIN ] TBBB: Full history saved. [2025-09-16T20:37:46.748963] [INFO ] [MAIN ] Update Progress: 2049/2369 symbols completed. TBBB took 19.7s. Estimated remaining: 34m 0s. Rate: 9.4 symbols/min [2025-09-16T20:37:46.780027] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-06. [2025-09-16T20:37:46.926173] [INFO ] [MAIN ] TCAI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:37:46.926385] [DEBUG] [LOCAL ] TCAI: No existing data file found in primary storage. [2025-09-16T20:37:46.926426] [WARN ] [MAIN ] TCAI: No existing data found, performing full refresh instead. [2025-09-16T20:37:46.926584] [INFO ] [MAIN ] TCAI: Wiping existing primary data before full refresh. [2025-09-16T20:37:46.926632] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-09-16T20:37:46.926696] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-09-16T20:37:46.926739] [INFO ] [MAIN ] TCAI: Starting full primary refresh. [2025-09-16T20:37:47.275166] [INFO ] [REMOTE ] TCAI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:37:47.574926] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-06. [2025-09-16T20:37:47.978906] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-16T20:37:48.007223] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-16T20:37:48.374925] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-02. [2025-09-16T20:37:48.653822] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:37:48.654172] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-02 [2025-09-16T20:37:49.174899] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-07. [2025-09-16T20:37:49.603581] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-16T20:37:49.974942] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-07. [2025-09-16T20:37:50.774948] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-08. [2025-09-16T20:37:51.155852] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-16T20:37:51.224009] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-16T20:37:51.575105] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-03. [2025-09-16T20:37:52.213228] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-16T20:37:52.374916] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-04. [2025-09-16T20:37:52.855838] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-16T20:37:53.174901] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-05. [2025-09-16T20:37:53.695715] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-16T20:37:53.974906] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-03. [2025-09-16T20:37:54.227140] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:37:54.227510] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-03 [2025-09-16T20:37:54.774927] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-04. [2025-09-16T20:37:55.044007] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:37:55.044348] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-04 [2025-09-16T20:37:55.574907] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-06. [2025-09-16T20:37:56.120527] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-16T20:37:56.374924] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-08. [2025-09-16T20:37:57.174902] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-07. [2025-09-16T20:37:57.591309] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-16T20:37:57.815980] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-16T20:37:57.974911] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-08. [2025-09-16T20:37:58.625405] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-16T20:37:58.774901] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-09. [2025-09-16T20:37:59.404787] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-16T20:37:59.406005] [INFO ] [REMOTE ] TBN: Full fetch complete (3516 records). [2025-09-16T20:37:59.406072] [DEBUG] [VALIDATOR ] TBN: Validating primary data. [2025-09-16T20:37:59.579638] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-09. [2025-09-16T20:37:59.769514] [DEBUG] [VALIDATOR ] TBN: All expected trading days are present. [2025-09-16T20:37:59.769599] [DEBUG] [VALIDATOR ] TBN: Primary data validation passed. [2025-09-16T20:37:59.769770] [INFO ] [MAIN ] TBN: Fetched primary data is valid. [2025-09-16T20:37:59.769849] [DEBUG] [LOCAL ] TBN: Saving primary data. [2025-09-16T20:37:59.770265] [DEBUG] [LOCAL ] TBN: Trimmed 3516 records to 2191 (keeping 150 days of data) [2025-09-16T20:37:59.784378] [DEBUG] [LOCAL ] TBN: Primary data saved (2191 records). [2025-09-16T20:37:59.784444] [INFO ] [MAIN ] TBN: Full history saved. [2025-09-16T20:37:59.784517] [INFO ] [MAIN ] Update Progress: 2050/2369 symbols completed. TBN took 19.6s. Estimated remaining: 33m 55s. Rate: 9.4 symbols/min [2025-09-16T20:37:59.954724] [INFO ] [MAIN ] TD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:37:59.984910] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-16T20:37:59.985745] [INFO ] [REMOTE ] TBLU: Full fetch complete (917 records). [2025-09-16T20:37:59.985818] [DEBUG] [VALIDATOR ] TBLU: Validating primary data. [2025-09-16T20:38:00.104358] [DEBUG] [LOCAL ] TD: Loaded 38508 existing records from primary storage. [2025-09-16T20:38:00.120030] [INFO ] [MAIN ] TD: Loaded 38508 existing records. [2025-09-16T20:38:00.278941] [WARN ] [VALIDATOR ] TBLU: Validation failed - insufficient historical data. Have 148 unique days, need 150 days [2025-09-16T20:38:00.290537] [FATAL] [MAIN ] TBLU: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:38:00.290638] [WARN ] [MAIN ] TBLU: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:38:00.290945] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-09-16T20:38:00.306557] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-09-16T20:38:00.316884] [INFO ] [LOCAL ] TBLU: Starting deletion of derivative data. [2025-09-16T20:38:00.368355] [DEBUG] [LOCAL ] TBLU: No derivative data file found to delete. [2025-09-16T20:38:00.368465] [WARN ] [MAIN ] TD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:38:00.368835] [INFO ] [MAIN ] TD: Wiping existing primary data before full refresh. [2025-09-16T20:38:00.368696] [INFO ] [MAIN ] Update Progress: 2051/2369 symbols completed. TBLU took 26.2s. Estimated remaining: 33m 48s. Rate: 9.4 symbols/min [2025-09-16T20:38:00.368929] [INFO ] [LOCAL ] TD: Starting deletion of primary data. [2025-09-16T20:38:00.374995] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-05. [2025-09-16T20:38:00.374942] [DEBUG] [LOCAL ] TD: Deleted primary data file. [2025-09-16T20:38:00.391918] [INFO ] [MAIN ] TD: Starting full primary refresh. [2025-09-16T20:38:00.708302] [INFO ] [MAIN ] TDC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:38:00.753092] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:38:00.789138] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-05 [2025-09-16T20:38:00.964048] [INFO ] [REMOTE ] TD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:38:00.965766] [DEBUG] [LOCAL ] TDC: Loaded 33906 existing records from primary storage. [2025-09-16T20:38:00.965845] [INFO ] [MAIN ] TDC: Loaded 33906 existing records. [2025-09-16T20:38:01.141723] [WARN ] [MAIN ] TDC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:38:01.141950] [INFO ] [MAIN ] TDC: Wiping existing primary data before full refresh. [2025-09-16T20:38:01.141996] [INFO ] [LOCAL ] TDC: Starting deletion of primary data. [2025-09-16T20:38:01.142725] [DEBUG] [LOCAL ] TDC: Deleted primary data file. [2025-09-16T20:38:01.142774] [INFO ] [MAIN ] TDC: Starting full primary refresh. [2025-09-16T20:38:01.180770] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-02. [2025-09-16T20:38:01.512942] [INFO ] [REMOTE ] TDC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:38:01.974912] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-09. [2025-09-16T20:38:02.774897] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-02. [2025-09-16T20:38:02.897237] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-16T20:38:02.899727] [INFO ] [REMOTE ] TBI: Full fetch complete (24742 records). [2025-09-16T20:38:02.899808] [DEBUG] [VALIDATOR ] TBI: Validating primary data. [2025-09-16T20:38:03.281927] [DEBUG] [VALIDATOR ] TBI: All expected trading days are present. [2025-09-16T20:38:03.282020] [DEBUG] [VALIDATOR ] TBI: Primary data validation passed. [2025-09-16T20:38:03.282691] [INFO ] [MAIN ] TBI: Fetched primary data is valid. [2025-09-16T20:38:03.282775] [DEBUG] [LOCAL ] TBI: Saving primary data. [2025-09-16T20:38:03.283715] [DEBUG] [LOCAL ] TBI: Trimmed 24742 records to 16333 (keeping 150 days of data) [2025-09-16T20:38:03.380606] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-09-16T20:38:03.415904] [DEBUG] [LOCAL ] TBI: Primary data saved (16333 records). [2025-09-16T20:38:03.416067] [INFO ] [MAIN ] TBI: Full history saved. [2025-09-16T20:38:03.416162] [INFO ] [MAIN ] Update Progress: 2052/2369 symbols completed. TBI took 34.6s. Estimated remaining: 33m 41s. Rate: 9.4 symbols/min [2025-09-16T20:38:03.577725] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-06. [2025-09-16T20:38:03.588095] [INFO ] [MAIN ] TDF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:38:03.596224] [DEBUG] [LOCAL ] TDF: Loaded 4139 existing records from primary storage. [2025-09-16T20:38:03.596381] [INFO ] [MAIN ] TDF: Loaded 4139 existing records. [2025-09-16T20:38:03.773662] [WARN ] [MAIN ] TDF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:38:03.773951] [INFO ] [MAIN ] TDF: Wiping existing primary data before full refresh. [2025-09-16T20:38:03.774026] [INFO ] [LOCAL ] TDF: Starting deletion of primary data. [2025-09-16T20:38:03.774223] [DEBUG] [LOCAL ] TDF: Deleted primary data file. [2025-09-16T20:38:03.774264] [INFO ] [MAIN ] TDF: Starting full primary refresh. [2025-09-16T20:38:03.900807] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:38:03.924704] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-06 [2025-09-16T20:38:04.139274] [INFO ] [REMOTE ] TDF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:38:04.219273] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-16T20:38:04.374902] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-03. [2025-09-16T20:38:05.174906] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-07. [2025-09-16T20:38:05.427366] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:38:05.427696] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-07 [2025-09-16T20:38:05.974905] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-03. [2025-09-16T20:38:06.140249] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-16T20:38:06.774940] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-04. [2025-09-16T20:38:07.574930] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-02. [2025-09-16T20:38:07.801048] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-16T20:38:07.975598] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-16T20:38:08.374864] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-05. [2025-09-16T20:38:08.680570] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-16T20:38:09.174911] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-08. [2025-09-16T20:38:09.974954] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-04. [2025-09-16T20:38:10.044431] [INFO ] [REMOTE ] TCAI: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-16T20:38:10.047087] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-16T20:38:10.774905] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-09. [2025-09-16T20:38:11.292887] [INFO ] [REMOTE ] TCAI: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-16T20:38:11.293909] [INFO ] [REMOTE ] TCAI: Full fetch complete (767 records). [2025-09-16T20:38:11.294010] [DEBUG] [VALIDATOR ] TCAI: Validating primary data. [2025-09-16T20:38:11.473611] [WARN ] [VALIDATOR ] TCAI: Validation failed - insufficient historical data. Have 30 unique days, need 150 days [2025-09-16T20:38:11.473856] [FATAL] [MAIN ] TCAI: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:38:11.473904] [WARN ] [MAIN ] TCAI: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:38:11.473973] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-09-16T20:38:11.474047] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-09-16T20:38:11.474112] [INFO ] [LOCAL ] TCAI: Starting deletion of derivative data. [2025-09-16T20:38:11.474173] [DEBUG] [LOCAL ] TCAI: No derivative data file found to delete. [2025-09-16T20:38:11.474243] [INFO ] [MAIN ] Update Progress: 2053/2369 symbols completed. TCAI took 24.7s. Estimated remaining: 33m 35s. Rate: 9.4 symbols/min [2025-09-16T20:38:11.577520] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-06. [2025-09-16T20:38:11.650494] [INFO ] [MAIN ] TDG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:38:11.669611] [DEBUG] [LOCAL ] TDG: Loaded 15959 existing records from primary storage. [2025-09-16T20:38:11.669782] [INFO ] [MAIN ] TDG: Loaded 15959 existing records. [2025-09-16T20:38:11.848979] [WARN ] [MAIN ] TDG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:38:11.849376] [INFO ] [MAIN ] TDG: Wiping existing primary data before full refresh. [2025-09-16T20:38:11.849437] [INFO ] [LOCAL ] TDG: Starting deletion of primary data. [2025-09-16T20:38:11.850083] [DEBUG] [LOCAL ] TDG: Deleted primary data file. [2025-09-16T20:38:11.850140] [INFO ] [MAIN ] TDG: Starting full primary refresh. [2025-09-16T20:38:12.068664] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-16T20:38:12.255749] [INFO ] [REMOTE ] TDG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:38:12.374903] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-02. [2025-09-16T20:38:13.174912] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-05. [2025-09-16T20:38:13.287798] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-16T20:38:13.517341] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-16T20:38:13.974900] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-03. [2025-09-16T20:38:14.608041] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-16T20:38:14.774900] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-07. [2025-09-16T20:38:15.266727] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-16T20:38:15.574902] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-03. [2025-09-16T20:38:16.374927] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-06. [2025-09-16T20:38:16.403829] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-16T20:38:16.447455] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-16T20:38:17.174906] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-04. [2025-09-16T20:38:17.974900] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-08. [2025-09-16T20:38:18.026948] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-16T20:38:18.545801] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-16T20:38:18.774893] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-07. [2025-09-16T20:38:19.574873] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-04. [2025-09-16T20:38:19.672987] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-16T20:38:20.286223] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-16T20:38:20.376266] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-09. [2025-09-16T20:38:20.378375] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-16T20:38:21.174916] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-05. [2025-09-16T20:38:21.900803] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-16T20:38:21.907039] [INFO ] [REMOTE ] TDC: Full fetch complete (51561 records). [2025-09-16T20:38:21.907177] [DEBUG] [VALIDATOR ] TDC: Validating primary data. [2025-09-16T20:38:21.983965] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-08. [2025-09-16T20:38:22.291865] [DEBUG] [VALIDATOR ] TDC: All expected trading days are present. [2025-09-16T20:38:22.291952] [DEBUG] [VALIDATOR ] TDC: Primary data validation passed. [2025-09-16T20:38:22.292992] [INFO ] [MAIN ] TDC: Fetched primary data is valid. [2025-09-16T20:38:22.293039] [DEBUG] [LOCAL ] TDC: Saving primary data. [2025-09-16T20:38:22.294170] [DEBUG] [LOCAL ] TDC: Trimmed 51561 records to 34252 (keeping 150 days of data) [2025-09-16T20:38:22.508462] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-16T20:38:22.529145] [DEBUG] [LOCAL ] TDC: Primary data saved (34252 records). [2025-09-16T20:38:22.529353] [INFO ] [MAIN ] TDC: Full history saved. [2025-09-16T20:38:22.529464] [INFO ] [MAIN ] Update Progress: 2054/2369 symbols completed. TDC took 22.2s. Estimated remaining: 33m 29s. Rate: 9.4 symbols/min [2025-09-16T20:38:22.700172] [INFO ] [MAIN ] TDOC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:38:22.739661] [DEBUG] [LOCAL ] TDOC: Loaded 39375 existing records from primary storage. [2025-09-16T20:38:22.739832] [INFO ] [MAIN ] TDOC: Loaded 39375 existing records. [2025-09-16T20:38:22.782481] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-06. [2025-09-16T20:38:22.919704] [WARN ] [MAIN ] TDOC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:38:22.919940] [INFO ] [MAIN ] TDOC: Wiping existing primary data before full refresh. [2025-09-16T20:38:22.919985] [INFO ] [LOCAL ] TDOC: Starting deletion of primary data. [2025-09-16T20:38:22.920807] [DEBUG] [LOCAL ] TDOC: Deleted primary data file. [2025-09-16T20:38:22.920857] [INFO ] [MAIN ] TDOC: Starting full primary refresh. [2025-09-16T20:38:23.277595] [INFO ] [REMOTE ] TDOC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:38:23.574906] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-05. [2025-09-16T20:38:23.757987] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-16T20:38:24.073165] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-16T20:38:24.261853] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-16T20:38:24.374896] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-06. [2025-09-16T20:38:25.014339] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-16T20:38:25.174895] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-07. [2025-09-16T20:38:25.885680] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-16T20:38:25.974863] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-08. [2025-09-16T20:38:26.650067] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-16T20:38:26.774863] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-09. [2025-09-16T20:38:27.461781] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-16T20:38:27.463281] [INFO ] [REMOTE ] TDF: Full fetch complete (7511 records). [2025-09-16T20:38:27.463369] [DEBUG] [VALIDATOR ] TDF: Validating primary data. [2025-09-16T20:38:27.579994] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-07. [2025-09-16T20:38:27.825275] [DEBUG] [VALIDATOR ] TDF: All expected trading days are present. [2025-09-16T20:38:27.825349] [DEBUG] [VALIDATOR ] TDF: Primary data validation passed. [2025-09-16T20:38:27.825546] [INFO ] [MAIN ] TDF: Fetched primary data is valid. [2025-09-16T20:38:27.825585] [DEBUG] [LOCAL ] TDF: Saving primary data. [2025-09-16T20:38:27.825994] [DEBUG] [LOCAL ] TDF: Trimmed 7511 records to 4186 (keeping 150 days of data) [2025-09-16T20:38:27.850923] [DEBUG] [LOCAL ] TDF: Primary data saved (4186 records). [2025-09-16T20:38:27.850998] [INFO ] [MAIN ] TDF: Full history saved. [2025-09-16T20:38:27.851095] [INFO ] [MAIN ] Update Progress: 2055/2369 symbols completed. TDF took 24.4s. Estimated remaining: 33m 22s. Rate: 9.4 symbols/min [2025-09-16T20:38:28.021173] [INFO ] [MAIN ] TDS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:38:28.058442] [DEBUG] [LOCAL ] TDS: Loaded 31466 existing records from primary storage. [2025-09-16T20:38:28.058594] [INFO ] [MAIN ] TDS: Loaded 31466 existing records. [2025-09-16T20:38:28.232813] [WARN ] [MAIN ] TDS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:38:28.233040] [INFO ] [MAIN ] TDS: Wiping existing primary data before full refresh. [2025-09-16T20:38:28.233085] [INFO ] [LOCAL ] TDS: Starting deletion of primary data. [2025-09-16T20:38:28.233866] [DEBUG] [LOCAL ] TDS: Deleted primary data file. [2025-09-16T20:38:28.233939] [INFO ] [MAIN ] TDS: Starting full primary refresh. [2025-09-16T20:38:28.391068] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-02. [2025-09-16T20:38:28.610584] [INFO ] [REMOTE ] TDS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:38:28.868942] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-16T20:38:29.174911] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-09. [2025-09-16T20:38:29.974965] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-08. [2025-09-16T20:38:30.732143] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-09-16T20:38:30.779462] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-03. [2025-09-16T20:38:30.781444] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-16T20:38:30.787846] [INFO ] [REMOTE ] TD: Full fetch complete (56862 records). [2025-09-16T20:38:30.787947] [DEBUG] [VALIDATOR ] TD: Validating primary data. [2025-09-16T20:38:31.202017] [DEBUG] [VALIDATOR ] TD: All expected trading days are present. [2025-09-16T20:38:31.202096] [DEBUG] [VALIDATOR ] TD: Primary data validation passed. [2025-09-16T20:38:31.203035] [INFO ] [MAIN ] TD: Fetched primary data is valid. [2025-09-16T20:38:31.203079] [DEBUG] [LOCAL ] TD: Saving primary data. [2025-09-16T20:38:31.204219] [DEBUG] [LOCAL ] TD: Trimmed 56862 records to 38888 (keeping 150 days of data) [2025-09-16T20:38:31.456822] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-16T20:38:31.482672] [DEBUG] [LOCAL ] TD: Primary data saved (38888 records). [2025-09-16T20:38:31.482806] [INFO ] [MAIN ] TD: Full history saved. [2025-09-16T20:38:31.482888] [INFO ] [MAIN ] Update Progress: 2056/2369 symbols completed. TD took 31.7s. Estimated remaining: 33m 16s. Rate: 9.4 symbols/min [2025-09-16T20:38:31.580037] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-09. [2025-09-16T20:38:31.656176] [INFO ] [MAIN ] TDW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:38:31.688161] [DEBUG] [LOCAL ] TDW: Loaded 32873 existing records from primary storage. [2025-09-16T20:38:31.688363] [INFO ] [MAIN ] TDW: Loaded 32873 existing records. [2025-09-16T20:38:31.869204] [WARN ] [MAIN ] TDW: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:38:31.869478] [INFO ] [MAIN ] TDW: Wiping existing primary data before full refresh. [2025-09-16T20:38:31.869527] [INFO ] [LOCAL ] TDW: Starting deletion of primary data. [2025-09-16T20:38:31.870247] [DEBUG] [LOCAL ] TDW: Deleted primary data file. [2025-09-16T20:38:31.870297] [INFO ] [MAIN ] TDW: Starting full primary refresh. [2025-09-16T20:38:32.222080] [INFO ] [REMOTE ] TDW: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:38:32.374891] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-02. [2025-09-16T20:38:32.908985] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-16T20:38:32.912656] [INFO ] [REMOTE ] TDG: Full fetch complete (24074 records). [2025-09-16T20:38:32.912735] [DEBUG] [VALIDATOR ] TDG: Validating primary data. [2025-09-16T20:38:33.175132] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-02. [2025-09-16T20:38:33.261694] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-09-16T20:38:33.332004] [DEBUG] [VALIDATOR ] TDG: All expected trading days are present. [2025-09-16T20:38:33.332107] [DEBUG] [VALIDATOR ] TDG: Primary data validation passed. [2025-09-16T20:38:33.332964] [INFO ] [MAIN ] TDG: Fetched primary data is valid. [2025-09-16T20:38:33.333056] [DEBUG] [LOCAL ] TDG: Saving primary data. [2025-09-16T20:38:33.333849] [DEBUG] [LOCAL ] TDG: Trimmed 24074 records to 16109 (keeping 150 days of data) [2025-09-16T20:38:33.439154] [DEBUG] [LOCAL ] TDG: Primary data saved (16109 records). [2025-09-16T20:38:33.439296] [INFO ] [MAIN ] TDG: Full history saved. [2025-09-16T20:38:33.439380] [INFO ] [MAIN ] Update Progress: 2057/2369 symbols completed. TDG took 22.0s. Estimated remaining: 33m 9s. Rate: 9.4 symbols/min [2025-09-16T20:38:33.609988] [INFO ] [MAIN ] TDY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:38:33.626854] [DEBUG] [LOCAL ] TDY: Loaded 16659 existing records from primary storage. [2025-09-16T20:38:33.626974] [INFO ] [MAIN ] TDY: Loaded 16659 existing records. [2025-09-16T20:38:33.801254] [WARN ] [MAIN ] TDY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:38:33.801724] [INFO ] [MAIN ] TDY: Wiping existing primary data before full refresh. [2025-09-16T20:38:33.801787] [INFO ] [LOCAL ] TDY: Starting deletion of primary data. [2025-09-16T20:38:33.802404] [DEBUG] [LOCAL ] TDY: Deleted primary data file. [2025-09-16T20:38:33.802457] [INFO ] [MAIN ] TDY: Starting full primary refresh. [2025-09-16T20:38:33.981905] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-04. [2025-09-16T20:38:34.106994] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-16T20:38:34.191586] [INFO ] [REMOTE ] TDY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:38:34.774962] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-03. [2025-09-16T20:38:34.940364] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-16T20:38:35.574968] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-03. [2025-09-16T20:38:36.221180] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-16T20:38:36.374927] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-05. [2025-09-16T20:38:36.481736] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-16T20:38:37.147462] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-16T20:38:37.174847] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-04. [2025-09-16T20:38:37.974952] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-04. [2025-09-16T20:38:38.474794] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-16T20:38:38.774944] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-02. [2025-09-16T20:38:39.574947] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-06. [2025-09-16T20:38:39.743032] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-16T20:38:39.766460] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-16T20:38:39.832763] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-04 (2.66 seconds). [2025-09-16T20:38:40.374903] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-05. [2025-09-16T20:38:41.174903] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-03. [2025-09-16T20:38:41.596131] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-16T20:38:41.923574] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-16T20:38:41.974857] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-05. [2025-09-16T20:38:42.402229] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-16T20:38:42.774989] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-07. [2025-09-16T20:38:43.553475] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-16T20:38:43.574902] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-06. [2025-09-16T20:38:44.374907] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-04. [2025-09-16T20:38:44.896788] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-16T20:38:45.057771] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-16T20:38:45.174953] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-08. [2025-09-16T20:38:45.295701] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-16T20:38:45.974936] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-07. [2025-09-16T20:38:46.774933] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-05. [2025-09-16T20:38:47.330828] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-16T20:38:47.574869] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-09. [2025-09-16T20:38:47.680661] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-16T20:38:47.799286] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-16T20:38:48.374899] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-06. [2025-09-16T20:38:49.174950] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-06. [2025-09-16T20:38:49.313569] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-16T20:38:49.319867] [INFO ] [REMOTE ] TDOC: Full fetch complete (58038 records). [2025-09-16T20:38:49.319976] [DEBUG] [VALIDATOR ] TDOC: Validating primary data. [2025-09-16T20:38:49.721877] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-16T20:38:49.736813] [DEBUG] [VALIDATOR ] TDOC: All expected trading days are present. [2025-09-16T20:38:49.741570] [DEBUG] [VALIDATOR ] TDOC: Primary data validation passed. [2025-09-16T20:38:49.742950] [INFO ] [MAIN ] TDOC: Fetched primary data is valid. [2025-09-16T20:38:49.743096] [DEBUG] [LOCAL ] TDOC: Saving primary data. [2025-09-16T20:38:49.744473] [DEBUG] [LOCAL ] TDOC: Trimmed 58038 records to 39754 (keeping 150 days of data) [2025-09-16T20:38:49.969260] [DEBUG] [LOCAL ] TDOC: Primary data saved (39754 records). [2025-09-16T20:38:49.969401] [INFO ] [MAIN ] TDOC: Full history saved. [2025-09-16T20:38:49.969499] [INFO ] [MAIN ] Update Progress: 2058/2369 symbols completed. TDOC took 27.4s. Estimated remaining: 33m 4s. Rate: 9.4 symbols/min [2025-09-16T20:38:49.981088] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-07. [2025-09-16T20:38:50.141552] [INFO ] [MAIN ] TE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:38:50.141723] [DEBUG] [LOCAL ] TE: No existing data file found in primary storage. [2025-09-16T20:38:50.141762] [WARN ] [MAIN ] TE: No existing data found, performing full refresh instead. [2025-09-16T20:38:50.141879] [INFO ] [MAIN ] TE: Wiping existing primary data before full refresh. [2025-09-16T20:38:50.141919] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-09-16T20:38:50.141997] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-09-16T20:38:50.142032] [INFO ] [MAIN ] TE: Starting full primary refresh. [2025-09-16T20:38:50.500665] [INFO ] [REMOTE ] TE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:38:50.549978] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-16T20:38:50.774904] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-08. [2025-09-16T20:38:51.441818] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-16T20:38:51.574892] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-02. [2025-09-16T20:38:51.824367] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:38:51.824687] [WARN ] [REMOTE ] TE: No data returned for month 2025-02 [2025-09-16T20:38:52.374886] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-08. [2025-09-16T20:38:52.487830] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-16T20:38:53.174886] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-09. [2025-09-16T20:38:53.509436] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-16T20:38:53.974933] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-03. [2025-09-16T20:38:54.663833] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-16T20:38:54.668944] [INFO ] [REMOTE ] TDW: Full fetch complete (50003 records). [2025-09-16T20:38:54.669065] [DEBUG] [VALIDATOR ] TDW: Validating primary data. [2025-09-16T20:38:54.779966] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-07. [2025-09-16T20:38:55.055705] [DEBUG] [VALIDATOR ] TDW: All expected trading days are present. [2025-09-16T20:38:55.055783] [DEBUG] [VALIDATOR ] TDW: Primary data validation passed. [2025-09-16T20:38:55.056677] [INFO ] [MAIN ] TDW: Fetched primary data is valid. [2025-09-16T20:38:55.056721] [DEBUG] [LOCAL ] TDW: Saving primary data. [2025-09-16T20:38:55.057730] [DEBUG] [LOCAL ] TDW: Trimmed 50003 records to 33219 (keeping 150 days of data) [2025-09-16T20:38:55.256486] [DEBUG] [LOCAL ] TDW: Primary data saved (33219 records). [2025-09-16T20:38:55.256623] [INFO ] [MAIN ] TDW: Full history saved. [2025-09-16T20:38:55.256833] [INFO ] [MAIN ] Update Progress: 2059/2369 symbols completed. TDW took 23.8s. Estimated remaining: 32m 57s. Rate: 9.4 symbols/min [2025-09-16T20:38:55.431341] [INFO ] [MAIN ] TEAF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:38:55.438810] [DEBUG] [LOCAL ] TEAF: Loaded 4988 existing records from primary storage. [2025-09-16T20:38:55.438904] [INFO ] [MAIN ] TEAF: Loaded 4988 existing records. [2025-09-16T20:38:55.586149] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-09. [2025-09-16T20:38:55.625593] [WARN ] [MAIN ] TEAF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:38:55.626177] [INFO ] [MAIN ] TEAF: Wiping existing primary data before full refresh. [2025-09-16T20:38:55.626236] [INFO ] [LOCAL ] TEAF: Starting deletion of primary data. [2025-09-16T20:38:55.626662] [DEBUG] [LOCAL ] TEAF: Deleted primary data file. [2025-09-16T20:38:55.626724] [INFO ] [MAIN ] TEAF: Starting full primary refresh. [2025-09-16T20:38:55.819597] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-16T20:38:56.033866] [INFO ] [REMOTE ] TEAF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:38:56.374870] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-02. [2025-09-16T20:38:56.576351] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-16T20:38:56.597439] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-16T20:38:56.599929] [INFO ] [REMOTE ] TDY: Full fetch complete (24709 records). [2025-09-16T20:38:56.600004] [DEBUG] [VALIDATOR ] TDY: Validating primary data. [2025-09-16T20:38:56.995189] [DEBUG] [VALIDATOR ] TDY: All expected trading days are present. [2025-09-16T20:38:56.994608] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-16T20:38:56.997034] [DEBUG] [VALIDATOR ] TDY: Primary data validation passed. [2025-09-16T20:38:56.997625] [INFO ] [MAIN ] TDY: Fetched primary data is valid. [2025-09-16T20:38:56.997696] [DEBUG] [LOCAL ] TDY: Saving primary data. [2025-09-16T20:38:56.998390] [DEBUG] [LOCAL ] TDY: Trimmed 24709 records to 16790 (keeping 150 days of data) [2025-09-16T20:38:57.101357] [DEBUG] [LOCAL ] TDY: Primary data saved (16790 records). [2025-09-16T20:38:57.101496] [INFO ] [MAIN ] TDY: Full history saved. [2025-09-16T20:38:57.101596] [INFO ] [MAIN ] Update Progress: 2060/2369 symbols completed. TDY took 23.7s. Estimated remaining: 32m 50s. Rate: 9.4 symbols/min [2025-09-16T20:38:57.180138] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-03. [2025-09-16T20:38:57.281584] [INFO ] [MAIN ] TECK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:38:57.320696] [DEBUG] [LOCAL ] TECK: Loaded 39427 existing records from primary storage. [2025-09-16T20:38:57.320837] [INFO ] [MAIN ] TECK: Loaded 39427 existing records. [2025-09-16T20:38:57.500909] [WARN ] [MAIN ] TECK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:38:57.501200] [INFO ] [MAIN ] TECK: Wiping existing primary data before full refresh. [2025-09-16T20:38:57.501251] [INFO ] [LOCAL ] TECK: Starting deletion of primary data. [2025-09-16T20:38:57.502116] [DEBUG] [LOCAL ] TECK: Deleted primary data file. [2025-09-16T20:38:57.502176] [INFO ] [MAIN ] TECK: Starting full primary refresh. [2025-09-16T20:38:57.852131] [INFO ] [REMOTE ] TECK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:38:57.974875] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-02. [2025-09-16T20:38:58.079901] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-16T20:38:58.774903] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-04. [2025-09-16T20:38:59.574950] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-04. [2025-09-16T20:38:59.668090] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-16T20:38:59.804655] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-16T20:39:00.374907] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-05. [2025-09-16T20:39:01.174901] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-08. [2025-09-16T20:39:01.294982] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-16T20:39:01.310337] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-16T20:39:01.974940] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-06. [2025-09-16T20:39:02.774895] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-03. [2025-09-16T20:39:03.574957] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-05. [2025-09-16T20:39:03.689466] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-08 (2.51 seconds). [2025-09-16T20:39:04.374911] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-09. [2025-09-16T20:39:05.075269] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-06 (3.10 seconds). [2025-09-16T20:39:05.174866] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-07. [2025-09-16T20:39:05.353559] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-09-16T20:39:05.437062] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-16T20:39:05.974896] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-06. [2025-09-16T20:39:06.059019] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-16T20:39:06.588802] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-16T20:39:06.593708] [INFO ] [REMOTE ] TDS: Full fetch complete (46838 records). [2025-09-16T20:39:06.593808] [DEBUG] [VALIDATOR ] TDS: Validating primary data. [2025-09-16T20:39:06.780130] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-08. [2025-09-16T20:39:06.972217] [DEBUG] [VALIDATOR ] TDS: All expected trading days are present. [2025-09-16T20:39:06.972295] [DEBUG] [VALIDATOR ] TDS: Primary data validation passed. [2025-09-16T20:39:06.973255] [INFO ] [MAIN ] TDS: Fetched primary data is valid. [2025-09-16T20:39:06.973316] [DEBUG] [LOCAL ] TDS: Saving primary data. [2025-09-16T20:39:06.974358] [DEBUG] [LOCAL ] TDS: Trimmed 46838 records to 31745 (keeping 150 days of data) [2025-09-16T20:39:07.181193] [DEBUG] [LOCAL ] TDS: Primary data saved (31745 records). [2025-09-16T20:39:07.181363] [INFO ] [MAIN ] TDS: Full history saved. [2025-09-16T20:39:07.182448] [INFO ] [MAIN ] Update Progress: 2061/2369 symbols completed. TDS took 39.3s. Estimated remaining: 32m 44s. Rate: 9.4 symbols/min [2025-09-16T20:39:07.351524] [INFO ] [MAIN ] TEF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:39:07.380562] [DEBUG] [LOCAL ] TEF: Loaded 26600 existing records from primary storage. [2025-09-16T20:39:07.380726] [INFO ] [MAIN ] TEF: Loaded 26600 existing records. [2025-09-16T20:39:07.555071] [WARN ] [MAIN ] TEF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:39:07.555558] [INFO ] [MAIN ] TEF: Wiping existing primary data before full refresh. [2025-09-16T20:39:07.555622] [INFO ] [LOCAL ] TEF: Starting deletion of primary data. [2025-09-16T20:39:07.556208] [DEBUG] [LOCAL ] TEF: Deleted primary data file. [2025-09-16T20:39:07.556264] [INFO ] [MAIN ] TEF: Starting full primary refresh. [2025-09-16T20:39:07.576756] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-04. [2025-09-16T20:39:07.688503] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-16T20:39:07.745374] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-16T20:39:07.965208] [INFO ] [REMOTE ] TEF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:39:08.374903] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-07. [2025-09-16T20:39:09.174948] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-09. [2025-09-16T20:39:09.336534] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-16T20:39:09.974904] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-02. [2025-09-16T20:39:10.092306] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-16T20:39:10.123454] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-16T20:39:10.124897] [INFO ] [REMOTE ] TEAF: Full fetch complete (7552 records). [2025-09-16T20:39:10.124981] [DEBUG] [VALIDATOR ] TEAF: Validating primary data. [2025-09-16T20:39:10.491414] [DEBUG] [VALIDATOR ] TEAF: All expected trading days are present. [2025-09-16T20:39:10.491492] [DEBUG] [VALIDATOR ] TEAF: Primary data validation passed. [2025-09-16T20:39:10.491698] [INFO ] [MAIN ] TEAF: Fetched primary data is valid. [2025-09-16T20:39:10.491747] [DEBUG] [LOCAL ] TEAF: Saving primary data. [2025-09-16T20:39:10.492148] [DEBUG] [LOCAL ] TEAF: Trimmed 7552 records to 5025 (keeping 150 days of data) [2025-09-16T20:39:10.522717] [DEBUG] [LOCAL ] TEAF: Primary data saved (5025 records). [2025-09-16T20:39:10.522818] [INFO ] [MAIN ] TEAF: Full history saved. [2025-09-16T20:39:10.522918] [INFO ] [MAIN ] Update Progress: 2062/2369 symbols completed. TEAF took 15.3s. Estimated remaining: 32m 37s. Rate: 9.4 symbols/min [2025-09-16T20:39:10.693392] [INFO ] [MAIN ] TEI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:39:10.708510] [DEBUG] [LOCAL ] TEI: Loaded 14972 existing records from primary storage. [2025-09-16T20:39:10.708684] [INFO ] [MAIN ] TEI: Loaded 14972 existing records. [2025-09-16T20:39:10.782816] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-08. [2025-09-16T20:39:10.890488] [WARN ] [MAIN ] TEI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:39:10.890758] [INFO ] [MAIN ] TEI: Wiping existing primary data before full refresh. [2025-09-16T20:39:10.890823] [INFO ] [LOCAL ] TEI: Starting deletion of primary data. [2025-09-16T20:39:10.891214] [DEBUG] [LOCAL ] TEI: Deleted primary data file. [2025-09-16T20:39:10.891269] [INFO ] [MAIN ] TEI: Starting full primary refresh. [2025-09-16T20:39:11.258995] [INFO ] [REMOTE ] TEI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:39:11.574892] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-02. [2025-09-16T20:39:11.866233] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-16T20:39:12.374908] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-03. [2025-09-16T20:39:13.179993] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-05. [2025-09-16T20:39:13.197255] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-09-16T20:39:13.975004] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-09. [2025-09-16T20:39:14.016555] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-02 (2.44 seconds). [2025-09-16T20:39:14.103241] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-16T20:39:14.774909] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-03. [2025-09-16T20:39:14.995628] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-16T20:39:15.574925] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-06. [2025-09-16T20:39:15.723332] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-16T20:39:15.739706] [INFO ] [REMOTE ] TE: Full fetch complete (44618 records). [2025-09-16T20:39:15.740679] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-16T20:39:15.740770] [DEBUG] [VALIDATOR ] TE: Validating primary data. [2025-09-16T20:39:15.950263] [WARN ] [VALIDATOR ] TE: Validation failed - insufficient historical data. Have 137 unique days, need 150 days [2025-09-16T20:39:15.951192] [FATAL] [MAIN ] TE: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:39:15.951266] [WARN ] [MAIN ] TE: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:39:15.951329] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-09-16T20:39:15.951414] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-09-16T20:39:15.951475] [INFO ] [LOCAL ] TE: Starting deletion of derivative data. [2025-09-16T20:39:15.951528] [DEBUG] [LOCAL ] TE: No derivative data file found to delete. [2025-09-16T20:39:15.951604] [INFO ] [MAIN ] Update Progress: 2063/2369 symbols completed. TE took 26.0s. Estimated remaining: 32m 31s. Rate: 9.4 symbols/min [2025-09-16T20:39:16.127163] [INFO ] [MAIN ] TEL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:39:16.127366] [DEBUG] [LOCAL ] TEL: No existing data file found in primary storage. [2025-09-16T20:39:16.127449] [WARN ] [MAIN ] TEL: No existing data found, performing full refresh instead. [2025-09-16T20:39:16.127573] [INFO ] [MAIN ] TEL: Wiping existing primary data before full refresh. [2025-09-16T20:39:16.127612] [INFO ] [LOCAL ] TEL: Starting deletion of primary data. [2025-09-16T20:39:16.127679] [DEBUG] [LOCAL ] TEL: No primary data file found to delete. [2025-09-16T20:39:16.127724] [INFO ] [MAIN ] TEL: Starting full primary refresh. [2025-09-16T20:39:16.380059] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-04. [2025-09-16T20:39:16.483786] [INFO ] [REMOTE ] TEL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:39:17.065783] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-16T20:39:17.174906] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-02. [2025-09-16T20:39:17.974908] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-04. [2025-09-16T20:39:18.044396] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-16T20:39:18.774869] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-05. [2025-09-16T20:39:18.857366] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-16T20:39:18.934199] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-16T20:39:19.574905] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-07. [2025-09-16T20:39:20.080475] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-16T20:39:20.374911] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-06. [2025-09-16T20:39:21.174921] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-05. [2025-09-16T20:39:21.869932] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-16T20:39:21.974890] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-07. [2025-09-16T20:39:22.029118] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-09-16T20:39:22.056980] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-16T20:39:22.774923] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-08. [2025-09-16T20:39:23.548357] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-16T20:39:23.574850] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-08. [2025-09-16T20:39:24.374911] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-06. [2025-09-16T20:39:24.638304] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-16T20:39:24.704205] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-16T20:39:25.174895] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-03. [2025-09-16T20:39:25.468510] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-16T20:39:25.974960] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-09. [2025-09-16T20:39:26.650670] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-16T20:39:26.774898] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-09. [2025-09-16T20:39:27.574901] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-07. [2025-09-16T20:39:27.726432] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-16T20:39:27.732837] [INFO ] [REMOTE ] TECK: Full fetch complete (58109 records). [2025-09-16T20:39:27.732990] [DEBUG] [VALIDATOR ] TECK: Validating primary data. [2025-09-16T20:39:28.127435] [DEBUG] [VALIDATOR ] TECK: All expected trading days are present. [2025-09-16T20:39:28.133678] [DEBUG] [VALIDATOR ] TECK: Primary data validation passed. [2025-09-16T20:39:28.134687] [INFO ] [MAIN ] TECK: Fetched primary data is valid. [2025-09-16T20:39:28.135161] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-16T20:39:28.135244] [DEBUG] [LOCAL ] TECK: Saving primary data. [2025-09-16T20:39:28.140139] [INFO ] [REMOTE ] TEF: Full fetch complete (40664 records). [2025-09-16T20:39:28.140262] [DEBUG] [VALIDATOR ] TEF: Validating primary data. [2025-09-16T20:39:28.173001] [DEBUG] [LOCAL ] TECK: Trimmed 58109 records to 39817 (keeping 150 days of data) [2025-09-16T20:39:28.416340] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-04. [2025-09-16T20:39:28.641752] [DEBUG] [VALIDATOR ] TEF: All expected trading days are present. [2025-09-16T20:39:28.646944] [DEBUG] [VALIDATOR ] TEF: Primary data validation passed. [2025-09-16T20:39:28.654506] [INFO ] [MAIN ] TEF: Fetched primary data is valid. [2025-09-16T20:39:28.655547] [DEBUG] [LOCAL ] TEF: Saving primary data. [2025-09-16T20:39:28.657754] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-16T20:39:28.663942] [DEBUG] [LOCAL ] TEF: Trimmed 40664 records to 26843 (keeping 150 days of data) [2025-09-16T20:39:28.950003] [DEBUG] [LOCAL ] TECK: Primary data saved (39817 records). [2025-09-16T20:39:28.950675] [INFO ] [MAIN ] TECK: Full history saved. [2025-09-16T20:39:28.951107] [INFO ] [MAIN ] Update Progress: 2064/2369 symbols completed. TECK took 31.8s. Estimated remaining: 32m 26s. Rate: 9.4 symbols/min [2025-09-16T20:39:29.131957] [DEBUG] [LOCAL ] TEF: Primary data saved (26843 records). [2025-09-16T20:39:29.134058] [INFO ] [MAIN ] TEN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:39:29.134239] [INFO ] [MAIN ] TEF: Full history saved. [2025-09-16T20:39:29.134602] [INFO ] [MAIN ] Update Progress: 2065/2369 symbols completed. TEF took 22.0s. Estimated remaining: 32m 18s. Rate: 9.4 symbols/min [2025-09-16T20:39:29.179979] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-08. [2025-09-16T20:39:29.353421] [DEBUG] [LOCAL ] TEN: Loaded 22238 existing records from primary storage. [2025-09-16T20:39:29.352737] [INFO ] [MAIN ] TEO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:39:29.353602] [INFO ] [MAIN ] TEN: Loaded 22238 existing records. [2025-09-16T20:39:29.517081] [DEBUG] [LOCAL ] TEO: Loaded 16169 existing records from primary storage. [2025-09-16T20:39:29.540517] [INFO ] [MAIN ] TEO: Loaded 16169 existing records. [2025-09-16T20:39:29.544847] [WARN ] [MAIN ] TEN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:39:29.624202] [INFO ] [MAIN ] TEN: Wiping existing primary data before full refresh. [2025-09-16T20:39:29.645156] [INFO ] [LOCAL ] TEN: Starting deletion of primary data. [2025-09-16T20:39:29.650857] [DEBUG] [LOCAL ] TEN: Deleted primary data file. [2025-09-16T20:39:29.661133] [INFO ] [MAIN ] TEN: Starting full primary refresh. [2025-09-16T20:39:29.829220] [WARN ] [MAIN ] TEO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:39:29.832016] [INFO ] [MAIN ] TEO: Wiping existing primary data before full refresh. [2025-09-16T20:39:29.832073] [INFO ] [LOCAL ] TEO: Starting deletion of primary data. [2025-09-16T20:39:29.843285] [DEBUG] [LOCAL ] TEO: Deleted primary data file. [2025-09-16T20:39:29.853558] [INFO ] [MAIN ] TEO: Starting full primary refresh. [2025-09-16T20:39:30.291537] [INFO ] [REMOTE ] TEN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:39:30.315561] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-02. [2025-09-16T20:39:30.495695] [INFO ] [REMOTE ] TEO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:39:30.510817] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-16T20:39:30.550051] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-16T20:39:30.774952] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-09. [2025-09-16T20:39:31.574960] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-02. [2025-09-16T20:39:31.641215] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-16T20:39:31.847486] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-16T20:39:31.850470] [INFO ] [REMOTE ] TEI: Full fetch complete (22193 records). [2025-09-16T20:39:31.850572] [DEBUG] [VALIDATOR ] TEI: Validating primary data. [2025-09-16T20:39:32.213416] [DEBUG] [VALIDATOR ] TEI: All expected trading days are present. [2025-09-16T20:39:32.213511] [DEBUG] [VALIDATOR ] TEI: Primary data validation passed. [2025-09-16T20:39:32.214019] [INFO ] [MAIN ] TEI: Fetched primary data is valid. [2025-09-16T20:39:32.214070] [DEBUG] [LOCAL ] TEI: Saving primary data. [2025-09-16T20:39:32.214731] [DEBUG] [LOCAL ] TEI: Trimmed 22193 records to 15194 (keeping 150 days of data) [2025-09-16T20:39:32.308072] [DEBUG] [LOCAL ] TEI: Primary data saved (15194 records). [2025-09-16T20:39:32.308244] [INFO ] [MAIN ] TEI: Full history saved. [2025-09-16T20:39:32.308355] [INFO ] [MAIN ] Update Progress: 2066/2369 symbols completed. TEI took 21.8s. Estimated remaining: 32m 11s. Rate: 9.4 symbols/min [2025-09-16T20:39:32.382261] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-05. [2025-09-16T20:39:32.486095] [INFO ] [MAIN ] TEVA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:39:32.500927] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-16T20:39:32.545374] [DEBUG] [LOCAL ] TEVA: Loaded 39597 existing records from primary storage. [2025-09-16T20:39:32.545546] [INFO ] [MAIN ] TEVA: Loaded 39597 existing records. [2025-09-16T20:39:32.721297] [WARN ] [MAIN ] TEVA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:39:32.721574] [INFO ] [MAIN ] TEVA: Wiping existing primary data before full refresh. [2025-09-16T20:39:32.721627] [INFO ] [LOCAL ] TEVA: Starting deletion of primary data. [2025-09-16T20:39:32.722403] [DEBUG] [LOCAL ] TEVA: Deleted primary data file. [2025-09-16T20:39:32.722451] [INFO ] [MAIN ] TEVA: Starting full primary refresh. [2025-09-16T20:39:33.070056] [INFO ] [REMOTE ] TEVA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:39:33.174899] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-02. [2025-09-16T20:39:33.974876] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-03. [2025-09-16T20:39:34.347047] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-16T20:39:34.774948] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-06. [2025-09-16T20:39:34.908105] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-16T20:39:35.472569] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-16T20:39:35.574969] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-03. [2025-09-16T20:39:36.374966] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-04. [2025-09-16T20:39:36.647613] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-16T20:39:37.174932] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-07. [2025-09-16T20:39:37.596861] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-16T20:39:37.650080] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-16T20:39:37.974954] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-03. [2025-09-16T20:39:38.774932] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-05. [2025-09-16T20:39:39.013673] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-16T20:39:39.218532] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-16T20:39:39.574916] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-04. [2025-09-16T20:39:40.041779] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-16T20:39:40.374913] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-04. [2025-09-16T20:39:41.174889] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-06. [2025-09-16T20:39:41.582544] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-16T20:39:41.659853] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-16T20:39:41.974920] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-08. [2025-09-16T20:39:42.230010] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-16T20:39:42.774905] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-05. [2025-09-16T20:39:43.430902] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-16T20:39:43.574860] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-09. [2025-09-16T20:39:44.273147] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-16T20:39:44.278577] [INFO ] [REMOTE ] TEL: Full fetch complete (55246 records). [2025-09-16T20:39:44.278735] [DEBUG] [VALIDATOR ] TEL: Validating primary data. [2025-09-16T20:39:44.279443] [FATAL] [VALIDATOR ] TEL: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T20:39:44.279524] [FATAL] [MAIN ] TEL: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:39:44.279575] [WARN ] [MAIN ] TEL: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:39:44.279666] [INFO ] [LOCAL ] TEL: Starting deletion of primary data. [2025-09-16T20:39:44.279745] [DEBUG] [LOCAL ] TEL: No primary data file found to delete. [2025-09-16T20:39:44.279795] [INFO ] [LOCAL ] TEL: Starting deletion of derivative data. [2025-09-16T20:39:44.279837] [DEBUG] [LOCAL ] TEL: No derivative data file found to delete. [2025-09-16T20:39:44.279911] [INFO ] [MAIN ] Update Progress: 2067/2369 symbols completed. TEL took 28.3s. Estimated remaining: 32m 6s. Rate: 9.4 symbols/min [2025-09-16T20:39:44.383515] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-05. [2025-09-16T20:39:44.458582] [INFO ] [MAIN ] TEX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:39:44.494809] [DEBUG] [LOCAL ] TEX: Loaded 32427 existing records from primary storage. [2025-09-16T20:39:44.494950] [INFO ] [MAIN ] TEX: Loaded 32427 existing records. [2025-09-16T20:39:44.674249] [WARN ] [MAIN ] TEX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:39:44.674578] [INFO ] [MAIN ] TEX: Wiping existing primary data before full refresh. [2025-09-16T20:39:44.674680] [INFO ] [LOCAL ] TEX: Starting deletion of primary data. [2025-09-16T20:39:44.675415] [DEBUG] [LOCAL ] TEX: Deleted primary data file. [2025-09-16T20:39:44.675469] [INFO ] [MAIN ] TEX: Starting full primary refresh. [2025-09-16T20:39:44.870473] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-16T20:39:45.078737] [INFO ] [REMOTE ] TEX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:39:45.174853] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-02. [2025-09-16T20:39:45.423821] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-16T20:39:45.974907] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-06. [2025-09-16T20:39:46.774868] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-07. [2025-09-16T20:39:46.970435] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-16T20:39:47.120226] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-16T20:39:47.574964] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-03. [2025-09-16T20:39:48.101711] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-16T20:39:48.374945] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-07. [2025-09-16T20:39:49.174899] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-08. [2025-09-16T20:39:49.265955] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-16T20:39:49.289384] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-16T20:39:49.974900] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-08. [2025-09-16T20:39:50.545503] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-16T20:39:50.774935] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-04. [2025-09-16T20:39:51.267163] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-16T20:39:51.574926] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-09. [2025-09-16T20:39:52.374877] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-09. [2025-09-16T20:39:52.508128] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-16T20:39:52.712170] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-16T20:39:52.716634] [INFO ] [REMOTE ] TEO: Full fetch complete (23653 records). [2025-09-16T20:39:52.716800] [DEBUG] [VALIDATOR ] TEO: Validating primary data. [2025-09-16T20:39:53.086017] [DEBUG] [VALIDATOR ] TEO: All expected trading days are present. [2025-09-16T20:39:53.086111] [DEBUG] [VALIDATOR ] TEO: Primary data validation passed. [2025-09-16T20:39:53.086677] [INFO ] [MAIN ] TEO: Fetched primary data is valid. [2025-09-16T20:39:53.086729] [DEBUG] [LOCAL ] TEO: Saving primary data. [2025-09-16T20:39:53.087553] [DEBUG] [LOCAL ] TEO: Trimmed 23653 records to 16345 (keeping 150 days of data) [2025-09-16T20:39:53.174901] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-06. [2025-09-16T20:39:53.185587] [DEBUG] [LOCAL ] TEO: Primary data saved (16345 records). [2025-09-16T20:39:53.186605] [INFO ] [MAIN ] TEO: Full history saved. [2025-09-16T20:39:53.186734] [INFO ] [MAIN ] Update Progress: 2068/2369 symbols completed. TEO took 24.1s. Estimated remaining: 31m 60s. Rate: 9.4 symbols/min [2025-09-16T20:39:53.357949] [INFO ] [MAIN ] TFC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:39:53.358209] [DEBUG] [LOCAL ] TFC: No existing data file found in primary storage. [2025-09-16T20:39:53.358247] [WARN ] [MAIN ] TFC: No existing data found, performing full refresh instead. [2025-09-16T20:39:53.358353] [INFO ] [MAIN ] TFC: Wiping existing primary data before full refresh. [2025-09-16T20:39:53.358393] [INFO ] [LOCAL ] TFC: Starting deletion of primary data. [2025-09-16T20:39:53.358435] [DEBUG] [LOCAL ] TFC: No primary data file found to delete. [2025-09-16T20:39:53.358468] [INFO ] [MAIN ] TFC: Starting full primary refresh. [2025-09-16T20:39:53.717782] [INFO ] [REMOTE ] TFC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:39:53.815598] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-16T20:39:53.820339] [INFO ] [REMOTE ] TEN: Full fetch complete (33644 records). [2025-09-16T20:39:53.820428] [DEBUG] [VALIDATOR ] TEN: Validating primary data. [2025-09-16T20:39:53.976309] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-05. [2025-09-16T20:39:54.190356] [DEBUG] [VALIDATOR ] TEN: All expected trading days are present. [2025-09-16T20:39:54.190436] [DEBUG] [VALIDATOR ] TEN: Primary data validation passed. [2025-09-16T20:39:54.191153] [INFO ] [MAIN ] TEN: Fetched primary data is valid. [2025-09-16T20:39:54.191200] [DEBUG] [LOCAL ] TEN: Saving primary data. [2025-09-16T20:39:54.192908] [DEBUG] [LOCAL ] TEN: Trimmed 33644 records to 22445 (keeping 150 days of data) [2025-09-16T20:39:54.336786] [DEBUG] [LOCAL ] TEN: Primary data saved (22445 records). [2025-09-16T20:39:54.336921] [INFO ] [MAIN ] TEN: Full history saved. [2025-09-16T20:39:54.337005] [INFO ] [MAIN ] Update Progress: 2069/2369 symbols completed. TEN took 25.4s. Estimated remaining: 31m 53s. Rate: 9.4 symbols/min [2025-09-16T20:39:54.507471] [INFO ] [MAIN ] TFII: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:39:54.530150] [DEBUG] [LOCAL ] TFII: Loaded 23810 existing records from primary storage. [2025-09-16T20:39:54.530291] [INFO ] [MAIN ] TFII: Loaded 23810 existing records. [2025-09-16T20:39:54.712087] [WARN ] [MAIN ] TFII: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:39:54.712370] [INFO ] [MAIN ] TFII: Wiping existing primary data before full refresh. [2025-09-16T20:39:54.712423] [INFO ] [LOCAL ] TFII: Starting deletion of primary data. [2025-09-16T20:39:54.712976] [DEBUG] [LOCAL ] TFII: Deleted primary data file. [2025-09-16T20:39:54.713031] [INFO ] [MAIN ] TFII: Starting full primary refresh. [2025-09-16T20:39:54.782325] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-02. [2025-09-16T20:39:55.069615] [INFO ] [REMOTE ] TFII: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:39:55.242114] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-16T20:39:55.574899] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-07. [2025-09-16T20:39:55.839838] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-16T20:39:56.268790] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-16T20:39:56.374860] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-03. [2025-09-16T20:39:57.174867] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-06. [2025-09-16T20:39:57.707531] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-16T20:39:57.974877] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-08. [2025-09-16T20:39:58.412123] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-16T20:39:58.775600] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-02. [2025-09-16T20:39:58.780247] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-16T20:39:59.575378] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-04. [2025-09-16T20:39:59.929754] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-16T20:39:59.964099] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-16T20:40:00.374924] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-03. [2025-09-16T20:40:01.174896] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-07. [2025-09-16T20:40:01.238995] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-16T20:40:01.974955] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-05. [2025-09-16T20:40:02.089271] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-16T20:40:02.524944] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-16T20:40:02.774959] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-08. [2025-09-16T20:40:03.574899] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-09. [2025-09-16T20:40:03.732730] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-16T20:40:04.374885] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-06. [2025-09-16T20:40:04.454848] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-16T20:40:05.174902] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-04. [2025-09-16T20:40:05.423090] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-16T20:40:05.429565] [INFO ] [REMOTE ] TEVA: Full fetch complete (58307 records). [2025-09-16T20:40:05.429705] [DEBUG] [VALIDATOR ] TEVA: Validating primary data. [2025-09-16T20:40:05.820309] [DEBUG] [VALIDATOR ] TEVA: All expected trading days are present. [2025-09-16T20:40:05.820432] [DEBUG] [VALIDATOR ] TEVA: Primary data validation passed. [2025-09-16T20:40:05.821540] [INFO ] [MAIN ] TEVA: Fetched primary data is valid. [2025-09-16T20:40:05.821588] [DEBUG] [LOCAL ] TEVA: Saving primary data. [2025-09-16T20:40:05.822961] [DEBUG] [LOCAL ] TEVA: Trimmed 58307 records to 39987 (keeping 150 days of data) [2025-09-16T20:40:06.003375] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-09. [2025-09-16T20:40:06.078405] [DEBUG] [LOCAL ] TEVA: Primary data saved (39987 records). [2025-09-16T20:40:06.078554] [INFO ] [MAIN ] TEVA: Full history saved. [2025-09-16T20:40:06.078656] [INFO ] [MAIN ] Update Progress: 2070/2369 symbols completed. TEVA took 33.8s. Estimated remaining: 31m 47s. Rate: 9.4 symbols/min [2025-09-16T20:40:06.255924] [INFO ] [MAIN ] TFIN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:40:06.273265] [DEBUG] [LOCAL ] TFIN: Loaded 17017 existing records from primary storage. [2025-09-16T20:40:06.273376] [INFO ] [MAIN ] TFIN: Loaded 17017 existing records. [2025-09-16T20:40:06.466154] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-16T20:40:06.486595] [WARN ] [MAIN ] TFIN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:40:06.497330] [INFO ] [MAIN ] TFIN: Wiping existing primary data before full refresh. [2025-09-16T20:40:06.497790] [INFO ] [LOCAL ] TFIN: Starting deletion of primary data. [2025-09-16T20:40:06.498296] [DEBUG] [LOCAL ] TFIN: Deleted primary data file. [2025-09-16T20:40:06.498354] [INFO ] [MAIN ] TFIN: Starting full primary refresh. [2025-09-16T20:40:06.780721] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-07. [2025-09-16T20:40:06.864991] [INFO ] [REMOTE ] TFIN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:40:06.891090] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-16T20:40:07.138591] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-16T20:40:07.145416] [INFO ] [REMOTE ] TEX: Full fetch complete (49084 records). [2025-09-16T20:40:07.145580] [DEBUG] [VALIDATOR ] TEX: Validating primary data. [2025-09-16T20:40:07.525176] [DEBUG] [VALIDATOR ] TEX: All expected trading days are present. [2025-09-16T20:40:07.525254] [DEBUG] [VALIDATOR ] TEX: Primary data validation passed. [2025-09-16T20:40:07.526174] [INFO ] [MAIN ] TEX: Fetched primary data is valid. [2025-09-16T20:40:07.526240] [DEBUG] [LOCAL ] TEX: Saving primary data. [2025-09-16T20:40:07.527237] [DEBUG] [LOCAL ] TEX: Trimmed 49084 records to 32728 (keeping 150 days of data) [2025-09-16T20:40:07.587633] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-02. [2025-09-16T20:40:07.742478] [DEBUG] [LOCAL ] TEX: Primary data saved (32728 records). [2025-09-16T20:40:07.742652] [INFO ] [MAIN ] TEX: Full history saved. [2025-09-16T20:40:07.742746] [INFO ] [MAIN ] Update Progress: 2071/2369 symbols completed. TEX took 23.5s. Estimated remaining: 31m 40s. Rate: 9.4 symbols/min [2025-09-16T20:40:07.917318] [INFO ] [MAIN ] TFPM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:40:07.945706] [DEBUG] [LOCAL ] TFPM: Loaded 28581 existing records from primary storage. [2025-09-16T20:40:07.945928] [INFO ] [MAIN ] TFPM: Loaded 28581 existing records. [2025-09-16T20:40:08.122203] [WARN ] [MAIN ] TFPM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:40:08.122480] [INFO ] [MAIN ] TFPM: Wiping existing primary data before full refresh. [2025-09-16T20:40:08.122525] [INFO ] [LOCAL ] TFPM: Starting deletion of primary data. [2025-09-16T20:40:08.123276] [DEBUG] [LOCAL ] TFPM: Deleted primary data file. [2025-09-16T20:40:08.123325] [INFO ] [MAIN ] TFPM: Starting full primary refresh. [2025-09-16T20:40:08.380110] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-05. [2025-09-16T20:40:08.486542] [INFO ] [REMOTE ] TFPM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:40:08.807846] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-16T20:40:08.980046] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-16T20:40:09.174931] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-02. [2025-09-16T20:40:09.600466] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-16T20:40:09.974915] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-06. [2025-09-16T20:40:10.310602] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-16T20:40:10.774896] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-03. [2025-09-16T20:40:11.305021] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-16T20:40:11.574959] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-07. [2025-09-16T20:40:11.933620] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-16T20:40:12.374899] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-03. [2025-09-16T20:40:12.802657] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-16T20:40:13.174933] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-08. [2025-09-16T20:40:13.481488] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-16T20:40:13.974916] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-04. [2025-09-16T20:40:14.667904] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-16T20:40:14.774911] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-09. [2025-09-16T20:40:15.319328] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-16T20:40:15.574869] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-04. [2025-09-16T20:40:15.954792] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-16T20:40:15.958813] [INFO ] [REMOTE ] TFII: Full fetch complete (38114 records). [2025-09-16T20:40:15.958904] [DEBUG] [VALIDATOR ] TFII: Validating primary data. [2025-09-16T20:40:16.343716] [DEBUG] [VALIDATOR ] TFII: All expected trading days are present. [2025-09-16T20:40:16.343797] [DEBUG] [VALIDATOR ] TFII: Primary data validation passed. [2025-09-16T20:40:16.344678] [INFO ] [MAIN ] TFII: Fetched primary data is valid. [2025-09-16T20:40:16.344738] [DEBUG] [LOCAL ] TFII: Saving primary data. [2025-09-16T20:40:16.345581] [DEBUG] [LOCAL ] TFII: Trimmed 38114 records to 23958 (keeping 150 days of data) [2025-09-16T20:40:16.400504] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-05. [2025-09-16T20:40:16.495772] [DEBUG] [LOCAL ] TFII: Primary data saved (23958 records). [2025-09-16T20:40:16.495908] [INFO ] [MAIN ] TFII: Full history saved. [2025-09-16T20:40:16.495995] [INFO ] [MAIN ] Update Progress: 2072/2369 symbols completed. TFII took 22.2s. Estimated remaining: 31m 34s. Rate: 9.4 symbols/min [2025-09-16T20:40:16.672864] [INFO ] [MAIN ] TFX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:40:16.699710] [DEBUG] [LOCAL ] TFX: Loaded 25923 existing records from primary storage. [2025-09-16T20:40:16.699851] [INFO ] [MAIN ] TFX: Loaded 25923 existing records. [2025-09-16T20:40:16.878116] [WARN ] [MAIN ] TFX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:40:16.878369] [INFO ] [MAIN ] TFX: Wiping existing primary data before full refresh. [2025-09-16T20:40:16.878414] [INFO ] [LOCAL ] TFX: Starting deletion of primary data. [2025-09-16T20:40:16.879030] [DEBUG] [LOCAL ] TFX: Deleted primary data file. [2025-09-16T20:40:16.879078] [INFO ] [MAIN ] TFX: Starting full primary refresh. [2025-09-16T20:40:17.181734] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-08. [2025-09-16T20:40:17.248025] [INFO ] [REMOTE ] TFX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:40:17.272517] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-16T20:40:17.297590] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-16T20:40:17.974920] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-05. [2025-09-16T20:40:18.774922] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-02. [2025-09-16T20:40:19.270382] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-16T20:40:19.574913] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-09. [2025-09-16T20:40:19.613080] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-16T20:40:20.043528] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-16T20:40:20.293331] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-16T20:40:20.299853] [INFO ] [REMOTE ] TFC: Full fetch complete (57955 records). [2025-09-16T20:40:20.299979] [DEBUG] [VALIDATOR ] TFC: Validating primary data. [2025-09-16T20:40:20.300679] [FATAL] [VALIDATOR ] TFC: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T20:40:20.300773] [FATAL] [MAIN ] TFC: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:40:20.300820] [WARN ] [MAIN ] TFC: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:40:20.300867] [INFO ] [LOCAL ] TFC: Starting deletion of primary data. [2025-09-16T20:40:20.300938] [DEBUG] [LOCAL ] TFC: No primary data file found to delete. [2025-09-16T20:40:20.301022] [INFO ] [LOCAL ] TFC: Starting deletion of derivative data. [2025-09-16T20:40:20.301112] [DEBUG] [LOCAL ] TFC: No derivative data file found to delete. [2025-09-16T20:40:20.301190] [INFO ] [MAIN ] Update Progress: 2073/2369 symbols completed. TFC took 27.1s. Estimated remaining: 31m 27s. Rate: 9.4 symbols/min [2025-09-16T20:40:20.379937] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-06. [2025-09-16T20:40:20.478565] [INFO ] [MAIN ] TG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:40:20.487200] [DEBUG] [LOCAL ] TG: Loaded 7330 existing records from primary storage. [2025-09-16T20:40:20.487335] [INFO ] [MAIN ] TG: Loaded 7330 existing records. [2025-09-16T20:40:20.664619] [WARN ] [MAIN ] TG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:40:20.664897] [INFO ] [MAIN ] TG: Wiping existing primary data before full refresh. [2025-09-16T20:40:20.664943] [INFO ] [LOCAL ] TG: Starting deletion of primary data. [2025-09-16T20:40:20.665244] [DEBUG] [LOCAL ] TG: Deleted primary data file. [2025-09-16T20:40:20.665288] [INFO ] [MAIN ] TG: Starting full primary refresh. [2025-09-16T20:40:21.016063] [INFO ] [REMOTE ] TG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:40:21.174844] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-02. [2025-09-16T20:40:21.527347] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-16T20:40:21.974916] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-03. [2025-09-16T20:40:22.051899] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-16T20:40:22.774937] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-06. [2025-09-16T20:40:23.574910] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-03. [2025-09-16T20:40:23.788008] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-16T20:40:24.371098] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-16T20:40:24.383162] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-04. [2025-09-16T20:40:24.521905] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-16T20:40:25.174910] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-04. [2025-09-16T20:40:25.844823] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-16T20:40:25.974897] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-05. [2025-09-16T20:40:26.091355] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-16T20:40:26.774887] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-05. [2025-09-16T20:40:27.335633] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-16T20:40:27.574893] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-07. [2025-09-16T20:40:27.617326] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-16T20:40:28.374983] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-06. [2025-09-16T20:40:28.587311] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-16T20:40:29.174922] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-06. [2025-09-16T20:40:29.279985] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-16T20:40:29.974912] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-08. [2025-09-16T20:40:30.607241] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-16T20:40:30.774893] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-07. [2025-09-16T20:40:31.242286] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-16T20:40:31.574911] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-07. [2025-09-16T20:40:31.604806] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-16T20:40:32.374897] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-07. [2025-09-16T20:40:33.181284] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-08. [2025-09-16T20:40:33.196262] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-16T20:40:33.481604] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-16T20:40:33.911273] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-16T20:40:33.974927] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-09. [2025-09-16T20:40:34.709387] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-16T20:40:34.711241] [INFO ] [REMOTE ] TG: Full fetch complete (10985 records). [2025-09-16T20:40:34.711310] [DEBUG] [VALIDATOR ] TG: Validating primary data. [2025-09-16T20:40:34.780038] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-09. [2025-09-16T20:40:35.077156] [DEBUG] [VALIDATOR ] TG: All expected trading days are present. [2025-09-16T20:40:35.077235] [DEBUG] [VALIDATOR ] TG: Primary data validation passed. [2025-09-16T20:40:35.077528] [INFO ] [MAIN ] TG: Fetched primary data is valid. [2025-09-16T20:40:35.077572] [DEBUG] [LOCAL ] TG: Saving primary data. [2025-09-16T20:40:35.078036] [DEBUG] [LOCAL ] TG: Trimmed 10985 records to 7400 (keeping 150 days of data) [2025-09-16T20:40:35.119568] [DEBUG] [LOCAL ] TG: Primary data saved (7400 records). [2025-09-16T20:40:35.119701] [INFO ] [MAIN ] TG: Full history saved. [2025-09-16T20:40:35.119784] [INFO ] [MAIN ] Update Progress: 2074/2369 symbols completed. TG took 14.8s. Estimated remaining: 31m 22s. Rate: 9.4 symbols/min [2025-09-16T20:40:35.290236] [INFO ] [MAIN ] TGE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:40:35.290423] [DEBUG] [LOCAL ] TGE: No existing data file found in primary storage. [2025-09-16T20:40:35.290462] [WARN ] [MAIN ] TGE: No existing data found, performing full refresh instead. [2025-09-16T20:40:35.290588] [INFO ] [MAIN ] TGE: Wiping existing primary data before full refresh. [2025-09-16T20:40:35.290628] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-09-16T20:40:35.290692] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-09-16T20:40:35.290727] [INFO ] [MAIN ] TGE: Starting full primary refresh. [2025-09-16T20:40:35.580083] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-08. [2025-09-16T20:40:35.694899] [INFO ] [REMOTE ] TGE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:40:35.892127] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-16T20:40:35.896236] [INFO ] [REMOTE ] TFIN: Full fetch complete (25292 records). [2025-09-16T20:40:35.896375] [DEBUG] [VALIDATOR ] TFIN: Validating primary data. [2025-09-16T20:40:36.282100] [DEBUG] [VALIDATOR ] TFIN: All expected trading days are present. [2025-09-16T20:40:36.282194] [DEBUG] [VALIDATOR ] TFIN: Primary data validation passed. [2025-09-16T20:40:36.282746] [INFO ] [MAIN ] TFIN: Fetched primary data is valid. [2025-09-16T20:40:36.282793] [DEBUG] [LOCAL ] TFIN: Saving primary data. [2025-09-16T20:40:36.283632] [DEBUG] [LOCAL ] TFIN: Trimmed 25292 records to 17170 (keeping 150 days of data) [2025-09-16T20:40:36.375050] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-08. [2025-09-16T20:40:36.388055] [DEBUG] [LOCAL ] TFIN: Primary data saved (17170 records). [2025-09-16T20:40:36.389539] [INFO ] [MAIN ] TFIN: Full history saved. [2025-09-16T20:40:36.389666] [INFO ] [MAIN ] Update Progress: 2075/2369 symbols completed. TFIN took 30.3s. Estimated remaining: 31m 15s. Rate: 9.4 symbols/min [2025-09-16T20:40:36.565965] [INFO ] [MAIN ] TGLS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:40:36.585486] [DEBUG] [LOCAL ] TGLS: Loaded 19996 existing records from primary storage. [2025-09-16T20:40:36.585691] [INFO ] [MAIN ] TGLS: Loaded 19996 existing records. [2025-09-16T20:40:36.773573] [WARN ] [MAIN ] TGLS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:40:36.773860] [INFO ] [MAIN ] TGLS: Wiping existing primary data before full refresh. [2025-09-16T20:40:36.773908] [INFO ] [LOCAL ] TGLS: Starting deletion of primary data. [2025-09-16T20:40:36.774487] [DEBUG] [LOCAL ] TGLS: Deleted primary data file. [2025-09-16T20:40:36.774538] [INFO ] [MAIN ] TGLS: Starting full primary refresh. [2025-09-16T20:40:37.139283] [INFO ] [REMOTE ] TGLS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:40:37.174850] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-02. [2025-09-16T20:40:37.219196] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-16T20:40:37.922952] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-16T20:40:37.974876] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-09. [2025-09-16T20:40:38.506233] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-16T20:40:38.774948] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-03. [2025-09-16T20:40:39.229697] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-16T20:40:39.234779] [INFO ] [REMOTE ] TFPM: Full fetch complete (39669 records). [2025-09-16T20:40:39.234863] [DEBUG] [VALIDATOR ] TFPM: Validating primary data. [2025-09-16T20:40:39.581371] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-09. [2025-09-16T20:40:39.621072] [DEBUG] [VALIDATOR ] TFPM: All expected trading days are present. [2025-09-16T20:40:39.621156] [DEBUG] [VALIDATOR ] TFPM: Primary data validation passed. [2025-09-16T20:40:39.622047] [INFO ] [MAIN ] TFPM: Fetched primary data is valid. [2025-09-16T20:40:39.622101] [DEBUG] [LOCAL ] TFPM: Saving primary data. [2025-09-16T20:40:39.623050] [DEBUG] [LOCAL ] TFPM: Trimmed 39669 records to 28849 (keeping 150 days of data) [2025-09-16T20:40:39.810204] [DEBUG] [LOCAL ] TFPM: Primary data saved (28849 records). [2025-09-16T20:40:39.810371] [INFO ] [MAIN ] TFPM: Full history saved. [2025-09-16T20:40:39.810478] [INFO ] [MAIN ] Update Progress: 2076/2369 symbols completed. TFPM took 32.1s. Estimated remaining: 31m 8s. Rate: 9.4 symbols/min [2025-09-16T20:40:39.987868] [INFO ] [MAIN ] TGNA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:40:40.010333] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-16T20:40:40.047208] [DEBUG] [LOCAL ] TGNA: Loaded 35556 existing records from primary storage. [2025-09-16T20:40:40.047387] [INFO ] [MAIN ] TGNA: Loaded 35556 existing records. [2025-09-16T20:40:40.230098] [WARN ] [MAIN ] TGNA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:40:40.230346] [INFO ] [MAIN ] TGNA: Wiping existing primary data before full refresh. [2025-09-16T20:40:40.230392] [INFO ] [LOCAL ] TGNA: Starting deletion of primary data. [2025-09-16T20:40:40.231127] [DEBUG] [LOCAL ] TGNA: Deleted primary data file. [2025-09-16T20:40:40.231174] [INFO ] [MAIN ] TGNA: Starting full primary refresh. [2025-09-16T20:40:40.376514] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-04. [2025-09-16T20:40:40.586490] [INFO ] [REMOTE ] TGNA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:40:40.856193] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-16T20:40:40.861042] [INFO ] [REMOTE ] TFX: Full fetch complete (41416 records). [2025-09-16T20:40:40.861145] [DEBUG] [VALIDATOR ] TFX: Validating primary data. [2025-09-16T20:40:41.180026] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-02. [2025-09-16T20:40:41.247690] [DEBUG] [VALIDATOR ] TFX: All expected trading days are present. [2025-09-16T20:40:41.247771] [DEBUG] [VALIDATOR ] TFX: Primary data validation passed. [2025-09-16T20:40:41.248742] [INFO ] [MAIN ] TFX: Fetched primary data is valid. [2025-09-16T20:40:41.248790] [DEBUG] [LOCAL ] TFX: Saving primary data. [2025-09-16T20:40:41.249852] [DEBUG] [LOCAL ] TFX: Trimmed 41416 records to 26181 (keeping 150 days of data) [2025-09-16T20:40:41.421957] [DEBUG] [LOCAL ] TFX: Primary data saved (26181 records). [2025-09-16T20:40:41.422179] [INFO ] [MAIN ] TFX: Full history saved. [2025-09-16T20:40:41.422280] [INFO ] [MAIN ] Update Progress: 2077/2369 symbols completed. TFX took 24.9s. Estimated remaining: 31m 1s. Rate: 9.4 symbols/min [2025-09-16T20:40:41.539213] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:40:41.539616] [WARN ] [REMOTE ] TGE: No data returned for month 2025-02 [2025-09-16T20:40:41.947878] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-16T20:40:41.974861] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-05. [2025-09-16T20:40:42.774898] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-02. [2025-09-16T20:40:43.218416] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-16T20:40:43.574900] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-06. [2025-09-16T20:40:44.374872] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-03. [2025-09-16T20:40:44.457932] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-16T20:40:44.655797] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:40:44.656164] [WARN ] [REMOTE ] TGE: No data returned for month 2025-03 [2025-09-16T20:40:44.837556] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-16T20:40:45.174939] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-07. [2025-09-16T20:40:45.974961] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-04. [2025-09-16T20:40:46.249477] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:40:46.249901] [WARN ] [REMOTE ] TGE: No data returned for month 2025-04 [2025-09-16T20:40:46.547126] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-16T20:40:46.774907] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-03. [2025-09-16T20:40:47.574951] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-08. [2025-09-16T20:40:48.375004] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-05. [2025-09-16T20:40:48.512304] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-16T20:40:48.660440] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:40:48.660785] [WARN ] [REMOTE ] TGE: No data returned for month 2025-05 [2025-09-16T20:40:49.018165] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-16T20:40:49.174914] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-09. [2025-09-16T20:40:49.974868] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-06. [2025-09-16T20:40:50.301074] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-16T20:40:50.304462] [INFO ] [REMOTE ] TGLS: Full fetch complete (31031 records). [2025-09-16T20:40:50.304546] [DEBUG] [VALIDATOR ] TGLS: Validating primary data. [2025-09-16T20:40:50.691317] [DEBUG] [VALIDATOR ] TGLS: All expected trading days are present. [2025-09-16T20:40:50.691416] [DEBUG] [VALIDATOR ] TGLS: Primary data validation passed. [2025-09-16T20:40:50.692138] [INFO ] [MAIN ] TGLS: Fetched primary data is valid. [2025-09-16T20:40:50.692184] [DEBUG] [LOCAL ] TGLS: Saving primary data. [2025-09-16T20:40:50.692990] [DEBUG] [LOCAL ] TGLS: Trimmed 31031 records to 20263 (keeping 150 days of data) [2025-09-16T20:40:50.790326] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-04. [2025-09-16T20:40:50.830127] [DEBUG] [LOCAL ] TGLS: Primary data saved (20263 records). [2025-09-16T20:40:50.830265] [INFO ] [MAIN ] TGLS: Full history saved. [2025-09-16T20:40:50.830346] [INFO ] [MAIN ] Update Progress: 2078/2369 symbols completed. TGLS took 14.4s. Estimated remaining: 30m 55s. Rate: 9.4 symbols/min [2025-09-16T20:40:51.452735] [INFO ] [REMOTE ] TGE: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-16T20:40:51.574921] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-07. [2025-09-16T20:40:52.477181] [INFO ] [REMOTE ] TGE: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-16T20:40:52.480174] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-08. [2025-09-16T20:40:52.658438] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-16T20:40:53.174934] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-05. [2025-09-16T20:40:53.356184] [INFO ] [REMOTE ] TGE: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-16T20:40:53.974925] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-09. [2025-09-16T20:40:54.866604] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-16T20:40:54.877005] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-06. [2025-09-16T20:40:54.902796] [INFO ] [REMOTE ] TGE: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-16T20:40:54.904749] [INFO ] [REMOTE ] TGE: Full fetch complete (7563 records). [2025-09-16T20:40:54.904818] [DEBUG] [VALIDATOR ] TGE: Validating primary data. [2025-09-16T20:40:55.081302] [WARN ] [VALIDATOR ] TGE: Validation failed - insufficient historical data. Have 71 unique days, need 150 days [2025-09-16T20:40:55.081513] [FATAL] [MAIN ] TGE: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:40:55.081563] [WARN ] [MAIN ] TGE: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:40:55.081608] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-09-16T20:40:55.081681] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-09-16T20:40:55.081720] [INFO ] [LOCAL ] TGE: Starting deletion of derivative data. [2025-09-16T20:40:55.081774] [DEBUG] [LOCAL ] TGE: No derivative data file found to delete. [2025-09-16T20:40:55.081834] [INFO ] [MAIN ] Update Progress: 2079/2369 symbols completed. TGE took 20.0s. Estimated remaining: 30m 49s. Rate: 9.4 symbols/min [2025-09-16T20:40:56.507501] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-16T20:40:56.517185] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-07. [2025-09-16T20:40:58.309328] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-16T20:40:58.319531] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-08. [2025-09-16T20:41:00.257113] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-16T20:41:00.269518] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-09. [2025-09-16T20:41:01.647805] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-16T20:41:01.653623] [INFO ] [REMOTE ] TGNA: Full fetch complete (52866 records). [2025-09-16T20:41:01.653763] [DEBUG] [VALIDATOR ] TGNA: Validating primary data. [2025-09-16T20:41:02.030662] [DEBUG] [VALIDATOR ] TGNA: All expected trading days are present. [2025-09-16T20:41:02.030745] [DEBUG] [VALIDATOR ] TGNA: Primary data validation passed. [2025-09-16T20:41:02.031680] [INFO ] [MAIN ] TGNA: Fetched primary data is valid. [2025-09-16T20:41:02.031725] [DEBUG] [LOCAL ] TGNA: Saving primary data. [2025-09-16T20:41:02.032835] [DEBUG] [LOCAL ] TGNA: Trimmed 52866 records to 35921 (keeping 150 days of data) [2025-09-16T20:41:02.259574] [DEBUG] [LOCAL ] TGNA: Primary data saved (35921 records). [2025-09-16T20:41:02.259765] [INFO ] [MAIN ] TGNA: Full history saved. [2025-09-16T20:41:02.259880] [INFO ] [MAIN ] Update Progress: 2080/2369 symbols completed. TGNA took 22.4s. Estimated remaining: 30m 42s. Rate: 9.4 symbols/min [2025-09-16T20:41:02.855368] [INFO ] [MAIN ] TGS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:41:02.946756] [INFO ] [MAIN ] THC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:41:02.944094] [INFO ] [MAIN ] TGT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:41:02.963240] [INFO ] [MAIN ] THG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:41:02.982076] [DEBUG] [LOCAL ] THG: Loaded 15468 existing records from primary storage. [2025-09-16T20:41:02.982440] [INFO ] [MAIN ] THG: Loaded 15468 existing records. [2025-09-16T20:41:03.145940] [DEBUG] [LOCAL ] THC: Loaded 35461 existing records from primary storage. [2025-09-16T20:41:03.156253] [DEBUG] [LOCAL ] TGS: Loaded 23657 existing records from primary storage. [2025-09-16T20:41:03.193676] [INFO ] [MAIN ] THC: Loaded 35461 existing records. [2025-09-16T20:41:03.193769] [INFO ] [MAIN ] TGS: Loaded 23657 existing records. [2025-09-16T20:41:03.222004] [WARN ] [MAIN ] THG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:41:03.267239] [DEBUG] [LOCAL ] TGT: Loaded 39738 existing records from primary storage. [2025-09-16T20:41:03.287414] [INFO ] [MAIN ] TGT: Loaded 39738 existing records. [2025-09-16T20:41:03.296171] [INFO ] [MAIN ] THG: Wiping existing primary data before full refresh. [2025-09-16T20:41:03.351729] [INFO ] [LOCAL ] THG: Starting deletion of primary data. [2025-09-16T20:41:03.459522] [DEBUG] [LOCAL ] THG: Deleted primary data file. [2025-09-16T20:41:03.519193] [INFO ] [MAIN ] THG: Starting full primary refresh. [2025-09-16T20:41:03.789341] [WARN ] [MAIN ] TGS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:41:03.742127] [WARN ] [MAIN ] THC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:41:03.844070] [INFO ] [MAIN ] TGS: Wiping existing primary data before full refresh. [2025-09-16T20:41:03.845465] [INFO ] [MAIN ] THC: Wiping existing primary data before full refresh. [2025-09-16T20:41:03.864536] [WARN ] [MAIN ] TGT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:41:03.869878] [INFO ] [LOCAL ] TGS: Starting deletion of primary data. [2025-09-16T20:41:03.869969] [INFO ] [LOCAL ] THC: Starting deletion of primary data. [2025-09-16T20:41:03.890712] [INFO ] [MAIN ] TGT: Wiping existing primary data before full refresh. [2025-09-16T20:41:03.922511] [INFO ] [LOCAL ] TGT: Starting deletion of primary data. [2025-09-16T20:41:03.962141] [DEBUG] [LOCAL ] THC: Deleted primary data file. [2025-09-16T20:41:03.945469] [DEBUG] [LOCAL ] TGS: Deleted primary data file. [2025-09-16T20:41:03.976653] [INFO ] [MAIN ] TGS: Starting full primary refresh. [2025-09-16T20:41:04.009547] [INFO ] [MAIN ] THC: Starting full primary refresh. [2025-09-16T20:41:03.986927] [DEBUG] [LOCAL ] TGT: Deleted primary data file. [2025-09-16T20:41:04.095713] [INFO ] [MAIN ] TGT: Starting full primary refresh. [2025-09-16T20:41:04.545488] [INFO ] [REMOTE ] THG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:41:04.581345] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-02. [2025-09-16T20:41:05.096461] [INFO ] [REMOTE ] THC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:41:05.211992] [INFO ] [REMOTE ] TGS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:41:05.193043] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-02. [2025-09-16T20:41:05.212307] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-02. [2025-09-16T20:41:05.192810] [INFO ] [REMOTE ] TGT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:41:05.213803] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-02. [2025-09-16T20:41:06.005214] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-16T20:41:06.010162] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-03. [2025-09-16T20:41:06.354118] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-16T20:41:06.360685] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-03. [2025-09-16T20:41:06.493715] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-16T20:41:06.503380] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-03. [2025-09-16T20:41:06.894005] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-16T20:41:06.899216] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-04. [2025-09-16T20:41:07.397307] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-16T20:41:07.407458] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-03. [2025-09-16T20:41:07.912894] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-16T20:41:07.919976] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-04. [2025-09-16T20:41:08.443419] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-16T20:41:08.454664] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-04. [2025-09-16T20:41:08.690305] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-16T20:41:08.696866] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-05. [2025-09-16T20:41:09.393255] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-16T20:41:09.400206] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-05. [2025-09-16T20:41:09.547065] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-16T20:41:09.558261] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-04. [2025-09-16T20:41:09.607908] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-16T20:41:09.612732] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-06. [2025-09-16T20:41:10.089007] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-16T20:41:10.099582] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-05. [2025-09-16T20:41:10.519562] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-16T20:41:10.539174] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-16T20:41:10.774944] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-07. [2025-09-16T20:41:11.574874] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-06. [2025-09-16T20:41:11.949877] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-16T20:41:12.132392] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-09-16T20:41:12.133265] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-16T20:41:12.374907] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-06. [2025-09-16T20:41:12.551882] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-16T20:41:13.174909] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-05. [2025-09-16T20:41:13.974901] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-07. [2025-09-16T20:41:14.228174] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-16T20:41:14.774885] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-07. [2025-09-16T20:41:15.257358] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-16T20:41:15.437887] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-16T20:41:15.574868] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-08. [2025-09-16T20:41:16.374918] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-06. [2025-09-16T20:41:16.629222] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-16T20:41:16.724756] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-16T20:41:17.174904] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-09. [2025-09-16T20:41:17.974885] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-08. [2025-09-16T20:41:18.170159] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-16T20:41:18.172731] [INFO ] [REMOTE ] THG: Full fetch complete (24029 records). [2025-09-16T20:41:18.172802] [DEBUG] [VALIDATOR ] THG: Validating primary data. [2025-09-16T20:41:18.532524] [DEBUG] [VALIDATOR ] THG: All expected trading days are present. [2025-09-16T20:41:18.532673] [DEBUG] [VALIDATOR ] THG: Primary data validation passed. [2025-09-16T20:41:18.533152] [INFO ] [MAIN ] THG: Fetched primary data is valid. [2025-09-16T20:41:18.533212] [DEBUG] [LOCAL ] THG: Saving primary data. [2025-09-16T20:41:18.534137] [DEBUG] [LOCAL ] THG: Trimmed 24029 records to 15613 (keeping 150 days of data) [2025-09-16T20:41:18.660818] [DEBUG] [LOCAL ] THG: Primary data saved (15613 records). [2025-09-16T20:41:18.663973] [INFO ] [MAIN ] THG: Full history saved. [2025-09-16T20:41:18.664081] [INFO ] [MAIN ] Update Progress: 2081/2369 symbols completed. THG took 16.4s. Estimated remaining: 30m 37s. Rate: 9.4 symbols/min [2025-09-16T20:41:18.697392] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-09-16T20:41:18.775892] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-07. [2025-09-16T20:41:18.852935] [INFO ] [MAIN ] THIR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:41:18.856578] [DEBUG] [LOCAL ] THIR: Loaded 1775 existing records from primary storage. [2025-09-16T20:41:18.856694] [INFO ] [MAIN ] THIR: Loaded 1775 existing records. [2025-09-16T20:41:19.034742] [WARN ] [MAIN ] THIR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:41:19.035036] [INFO ] [MAIN ] THIR: Wiping existing primary data before full refresh. [2025-09-16T20:41:19.035085] [INFO ] [LOCAL ] THIR: Starting deletion of primary data. [2025-09-16T20:41:19.035262] [DEBUG] [LOCAL ] THIR: Deleted primary data file. [2025-09-16T20:41:19.035305] [INFO ] [MAIN ] THIR: Starting full primary refresh. [2025-09-16T20:41:19.415742] [INFO ] [REMOTE ] THIR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:41:19.574878] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-02. [2025-09-16T20:41:19.657467] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-16T20:41:20.113048] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-16T20:41:20.374898] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-09. [2025-09-16T20:41:20.898166] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-16T20:41:21.174877] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-03. [2025-09-16T20:41:21.630171] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-16T20:41:21.979972] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-08. [2025-09-16T20:41:21.989664] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-16T20:41:21.995279] [INFO ] [REMOTE ] THC: Full fetch complete (52956 records). [2025-09-16T20:41:21.995369] [DEBUG] [VALIDATOR ] THC: Validating primary data. [2025-09-16T20:41:22.375505] [DEBUG] [VALIDATOR ] THC: All expected trading days are present. [2025-09-16T20:41:22.375595] [DEBUG] [VALIDATOR ] THC: Primary data validation passed. [2025-09-16T20:41:22.376653] [INFO ] [MAIN ] THC: Fetched primary data is valid. [2025-09-16T20:41:22.376731] [DEBUG] [LOCAL ] THC: Saving primary data. [2025-09-16T20:41:22.378048] [DEBUG] [LOCAL ] THC: Trimmed 52956 records to 35826 (keeping 150 days of data) [2025-09-16T20:41:22.601541] [DEBUG] [LOCAL ] THC: Primary data saved (35826 records). [2025-09-16T20:41:22.601697] [INFO ] [MAIN ] THC: Full history saved. [2025-09-16T20:41:22.602633] [INFO ] [MAIN ] Update Progress: 2082/2369 symbols completed. THC took 20.3s. Estimated remaining: 30m 31s. Rate: 9.4 symbols/min [2025-09-16T20:41:22.773668] [INFO ] [MAIN ] THLV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:41:22.774964] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-08. [2025-09-16T20:41:22.777451] [DEBUG] [LOCAL ] THLV: Loaded 1081 existing records from primary storage. [2025-09-16T20:41:22.777595] [INFO ] [MAIN ] THLV: Loaded 1081 existing records. [2025-09-16T20:41:22.953176] [WARN ] [MAIN ] THLV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:41:22.953395] [INFO ] [MAIN ] THLV: Wiping existing primary data before full refresh. [2025-09-16T20:41:22.953442] [INFO ] [LOCAL ] THLV: Starting deletion of primary data. [2025-09-16T20:41:22.953607] [DEBUG] [LOCAL ] THLV: Deleted primary data file. [2025-09-16T20:41:22.953679] [INFO ] [MAIN ] THLV: Starting full primary refresh. [2025-09-16T20:41:23.340567] [INFO ] [REMOTE ] THLV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:41:23.574863] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-02. [2025-09-16T20:41:23.978717] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-16T20:41:24.112285] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-16T20:41:24.199219] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-16T20:41:24.374866] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-03. [2025-09-16T20:41:24.910243] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-16T20:41:25.174905] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-04. [2025-09-16T20:41:25.514463] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-16T20:41:25.974893] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-04. [2025-09-16T20:41:26.403264] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-16T20:41:26.774897] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-05. [2025-09-16T20:41:27.287827] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-16T20:41:27.574911] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-06. [2025-09-16T20:41:27.954156] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-16T20:41:28.374923] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-09. [2025-09-16T20:41:29.174892] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-07. [2025-09-16T20:41:29.566050] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-16T20:41:29.654600] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-16T20:41:29.659636] [INFO ] [REMOTE ] TGS: Full fetch complete (35132 records). [2025-09-16T20:41:29.659801] [DEBUG] [VALIDATOR ] TGS: Validating primary data. [2025-09-16T20:41:29.980023] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-08. [2025-09-16T20:41:30.038178] [DEBUG] [VALIDATOR ] TGS: All expected trading days are present. [2025-09-16T20:41:30.038259] [DEBUG] [VALIDATOR ] TGS: Primary data validation passed. [2025-09-16T20:41:30.038996] [INFO ] [MAIN ] TGS: Fetched primary data is valid. [2025-09-16T20:41:30.039047] [DEBUG] [LOCAL ] TGS: Saving primary data. [2025-09-16T20:41:30.040137] [DEBUG] [LOCAL ] TGS: Trimmed 35132 records to 23951 (keeping 150 days of data) [2025-09-16T20:41:30.186261] [DEBUG] [LOCAL ] TGS: Primary data saved (23951 records). [2025-09-16T20:41:30.186398] [INFO ] [MAIN ] TGS: Full history saved. [2025-09-16T20:41:30.186504] [INFO ] [MAIN ] Update Progress: 2083/2369 symbols completed. TGS took 27.9s. Estimated remaining: 30m 24s. Rate: 9.4 symbols/min [2025-09-16T20:41:30.364833] [INFO ] [MAIN ] THO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:41:30.396358] [DEBUG] [LOCAL ] THO: Loaded 30280 existing records from primary storage. [2025-09-16T20:41:30.396502] [INFO ] [MAIN ] THO: Loaded 30280 existing records. [2025-09-16T20:41:30.577568] [WARN ] [MAIN ] THO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:41:30.577846] [INFO ] [MAIN ] THO: Wiping existing primary data before full refresh. [2025-09-16T20:41:30.577892] [INFO ] [LOCAL ] THO: Starting deletion of primary data. [2025-09-16T20:41:30.578549] [DEBUG] [LOCAL ] THO: Deleted primary data file. [2025-09-16T20:41:30.578595] [INFO ] [MAIN ] THO: Starting full primary refresh. [2025-09-16T20:41:30.676794] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-16T20:41:30.783159] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-09. [2025-09-16T20:41:30.939775] [INFO ] [REMOTE ] THO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:41:31.574930] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-02. [2025-09-16T20:41:32.374910] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-05. [2025-09-16T20:41:33.131573] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-16T20:41:33.177719] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-03. [2025-09-16T20:41:33.180533] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-09-16T20:41:33.187513] [INFO ] [REMOTE ] TGT: Full fetch complete (58458 records). [2025-09-16T20:41:33.187675] [DEBUG] [VALIDATOR ] TGT: Validating primary data. [2025-09-16T20:41:33.290062] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-16T20:41:33.572776] [DEBUG] [VALIDATOR ] TGT: All expected trading days are present. [2025-09-16T20:41:33.572894] [DEBUG] [VALIDATOR ] TGT: Primary data validation passed. [2025-09-16T20:41:33.573942] [INFO ] [MAIN ] TGT: Fetched primary data is valid. [2025-09-16T20:41:33.573991] [DEBUG] [LOCAL ] TGT: Saving primary data. [2025-09-16T20:41:33.575255] [DEBUG] [LOCAL ] TGT: Trimmed 58458 records to 40128 (keeping 150 days of data) [2025-09-16T20:41:33.828016] [DEBUG] [LOCAL ] TGT: Primary data saved (40128 records). [2025-09-16T20:41:33.828144] [INFO ] [MAIN ] TGT: Full history saved. [2025-09-16T20:41:33.828223] [INFO ] [MAIN ] Update Progress: 2084/2369 symbols completed. TGT took 31.6s. Estimated remaining: 30m 18s. Rate: 9.4 symbols/min [2025-09-16T20:41:33.974931] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-06. [2025-09-16T20:41:33.996553] [INFO ] [MAIN ] THQ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:41:34.016500] [DEBUG] [LOCAL ] THQ: Loaded 19276 existing records from primary storage. [2025-09-16T20:41:34.016623] [INFO ] [MAIN ] THQ: Loaded 19276 existing records. [2025-09-16T20:41:34.194030] [WARN ] [MAIN ] THQ: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:41:34.194281] [INFO ] [MAIN ] THQ: Wiping existing primary data before full refresh. [2025-09-16T20:41:34.194334] [INFO ] [LOCAL ] THQ: Starting deletion of primary data. [2025-09-16T20:41:34.194826] [DEBUG] [LOCAL ] THQ: Deleted primary data file. [2025-09-16T20:41:34.194905] [INFO ] [MAIN ] THQ: Starting full primary refresh. [2025-09-16T20:41:34.545287] [INFO ] [REMOTE ] THQ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:41:34.547899] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-16T20:41:34.774916] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-07. [2025-09-16T20:41:35.080119] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-16T20:41:35.189354] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-16T20:41:35.574934] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-08. [2025-09-16T20:41:35.962171] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-16T20:41:36.374951] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-09. [2025-09-16T20:41:36.914522] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-16T20:41:36.916458] [INFO ] [REMOTE ] THIR: Full fetch complete (2228 records). [2025-09-16T20:41:36.916718] [DEBUG] [VALIDATOR ] THIR: Validating primary data. [2025-09-16T20:41:37.180163] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-04. [2025-09-16T20:41:37.286227] [DEBUG] [VALIDATOR ] THIR: All expected trading days are present. [2025-09-16T20:41:37.286307] [DEBUG] [VALIDATOR ] THIR: Primary data validation passed. [2025-09-16T20:41:37.286440] [INFO ] [MAIN ] THIR: Fetched primary data is valid. [2025-09-16T20:41:37.286482] [DEBUG] [LOCAL ] THIR: Saving primary data. [2025-09-16T20:41:37.286838] [DEBUG] [LOCAL ] THIR: Trimmed 2228 records to 1806 (keeping 150 days of data) [2025-09-16T20:41:37.297807] [DEBUG] [LOCAL ] THIR: Primary data saved (1806 records). [2025-09-16T20:41:37.297864] [INFO ] [MAIN ] THIR: Full history saved. [2025-09-16T20:41:37.297962] [INFO ] [MAIN ] Update Progress: 2085/2369 symbols completed. THIR took 18.6s. Estimated remaining: 30m 11s. Rate: 9.4 symbols/min [2025-09-16T20:41:37.464208] [INFO ] [MAIN ] THR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:41:37.478894] [DEBUG] [LOCAL ] THR: Loaded 14372 existing records from primary storage. [2025-09-16T20:41:37.479007] [INFO ] [MAIN ] THR: Loaded 14372 existing records. [2025-09-16T20:41:37.652831] [WARN ] [MAIN ] THR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:41:37.653089] [INFO ] [MAIN ] THR: Wiping existing primary data before full refresh. [2025-09-16T20:41:37.653134] [INFO ] [LOCAL ] THR: Starting deletion of primary data. [2025-09-16T20:41:37.653559] [DEBUG] [LOCAL ] THR: Deleted primary data file. [2025-09-16T20:41:37.653606] [INFO ] [MAIN ] THR: Starting full primary refresh. [2025-09-16T20:41:38.000124] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-02. [2025-09-16T20:41:38.004248] [INFO ] [REMOTE ] THR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:41:38.774903] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-09. [2025-09-16T20:41:39.071055] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-16T20:41:39.258152] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-16T20:41:39.259333] [INFO ] [REMOTE ] THLV: Full fetch complete (1935 records). [2025-09-16T20:41:39.259434] [DEBUG] [VALIDATOR ] THLV: Validating primary data. [2025-09-16T20:41:39.427950] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-16T20:41:39.579970] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-05. [2025-09-16T20:41:39.629450] [DEBUG] [VALIDATOR ] THLV: All expected trading days are present. [2025-09-16T20:41:39.629524] [DEBUG] [VALIDATOR ] THLV: Primary data validation passed. [2025-09-16T20:41:39.629707] [INFO ] [MAIN ] THLV: Fetched primary data is valid. [2025-09-16T20:41:39.629781] [DEBUG] [LOCAL ] THLV: Saving primary data. [2025-09-16T20:41:39.630219] [DEBUG] [LOCAL ] THLV: Trimmed 1935 records to 1090 (keeping 150 days of data) [2025-09-16T20:41:39.637466] [DEBUG] [LOCAL ] THLV: Primary data saved (1090 records). [2025-09-16T20:41:39.637527] [INFO ] [MAIN ] THLV: Full history saved. [2025-09-16T20:41:39.637672] [INFO ] [MAIN ] Update Progress: 2086/2369 symbols completed. THLV took 17.0s. Estimated remaining: 30m 4s. Rate: 9.4 symbols/min [2025-09-16T20:41:39.806155] [INFO ] [MAIN ] THS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:41:39.834735] [DEBUG] [LOCAL ] THS: Loaded 28104 existing records from primary storage. [2025-09-16T20:41:39.834900] [INFO ] [MAIN ] THS: Loaded 28104 existing records. [2025-09-16T20:41:40.020543] [WARN ] [MAIN ] THS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:41:40.020866] [INFO ] [MAIN ] THS: Wiping existing primary data before full refresh. [2025-09-16T20:41:40.020923] [INFO ] [LOCAL ] THS: Starting deletion of primary data. [2025-09-16T20:41:40.021605] [DEBUG] [LOCAL ] THS: Deleted primary data file. [2025-09-16T20:41:40.021683] [INFO ] [MAIN ] THS: Starting full primary refresh. [2025-09-16T20:41:40.389166] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-02. [2025-09-16T20:41:40.396407] [INFO ] [REMOTE ] THS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:41:41.174961] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-02. [2025-09-16T20:41:41.319253] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-16T20:41:41.351682] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-16T20:41:41.974972] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-06. [2025-09-16T20:41:42.267454] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-16T20:41:42.774952] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-03. [2025-09-16T20:41:43.235779] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-16T20:41:43.574922] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-03. [2025-09-16T20:41:44.176247] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-16T20:41:44.374909] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-04. [2025-09-16T20:41:44.704696] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-16T20:41:45.174921] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-03. [2025-09-16T20:41:45.588954] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-16T20:41:45.974871] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-05. [2025-09-16T20:41:46.347401] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-16T20:41:46.774944] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-04. [2025-09-16T20:41:47.200265] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-16T20:41:47.574939] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-06. [2025-09-16T20:41:47.939587] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-16T20:41:48.374860] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-04. [2025-09-16T20:41:48.765306] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-16T20:41:49.174907] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-07. [2025-09-16T20:41:49.574756] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-16T20:41:49.974953] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-05. [2025-09-16T20:41:50.349984] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-16T20:41:50.774952] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-08. [2025-09-16T20:41:50.951610] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-16T20:41:51.574917] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-06. [2025-09-16T20:41:52.155490] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-16T20:41:52.374911] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-09. [2025-09-16T20:41:52.813721] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-16T20:41:53.174872] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-07. [2025-09-16T20:41:53.217898] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-16T20:41:53.221118] [INFO ] [REMOTE ] THQ: Full fetch complete (25858 records). [2025-09-16T20:41:53.221198] [DEBUG] [VALIDATOR ] THQ: Validating primary data. [2025-09-16T20:41:53.591327] [DEBUG] [VALIDATOR ] THQ: All expected trading days are present. [2025-09-16T20:41:53.591433] [DEBUG] [VALIDATOR ] THQ: Primary data validation passed. [2025-09-16T20:41:53.592006] [INFO ] [MAIN ] THQ: Fetched primary data is valid. [2025-09-16T20:41:53.592081] [DEBUG] [LOCAL ] THQ: Saving primary data. [2025-09-16T20:41:53.592969] [DEBUG] [LOCAL ] THQ: Trimmed 25858 records to 19445 (keeping 150 days of data) [2025-09-16T20:41:53.716884] [DEBUG] [LOCAL ] THQ: Primary data saved (19445 records). [2025-09-16T20:41:53.717035] [INFO ] [MAIN ] THQ: Full history saved. [2025-09-16T20:41:53.717137] [INFO ] [MAIN ] Update Progress: 2087/2369 symbols completed. THQ took 19.9s. Estimated remaining: 29m 59s. Rate: 9.4 symbols/min [2025-09-16T20:41:53.887617] [INFO ] [MAIN ] THW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:41:53.903450] [DEBUG] [LOCAL ] THW: Loaded 14788 existing records from primary storage. [2025-09-16T20:41:53.903568] [INFO ] [MAIN ] THW: Loaded 14788 existing records. [2025-09-16T20:41:53.979987] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-07. [2025-09-16T20:41:54.079750] [WARN ] [MAIN ] THW: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:41:54.079999] [INFO ] [MAIN ] THW: Wiping existing primary data before full refresh. [2025-09-16T20:41:54.080047] [INFO ] [LOCAL ] THW: Starting deletion of primary data. [2025-09-16T20:41:54.080411] [DEBUG] [LOCAL ] THW: Deleted primary data file. [2025-09-16T20:41:54.080468] [INFO ] [MAIN ] THW: Starting full primary refresh. [2025-09-16T20:41:54.408023] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-16T20:41:54.447716] [INFO ] [REMOTE ] THW: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:41:54.774881] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-08. [2025-09-16T20:41:55.528410] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-16T20:41:55.574857] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-08. [2025-09-16T20:41:55.596180] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-16T20:41:56.374900] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-05. [2025-09-16T20:41:57.093477] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-16T20:41:57.174858] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-09. [2025-09-16T20:41:57.869803] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-16T20:41:57.974900] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-06. [2025-09-16T20:41:58.136608] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-16T20:41:58.139420] [INFO ] [REMOTE ] THR: Full fetch complete (22058 records). [2025-09-16T20:41:58.139500] [DEBUG] [VALIDATOR ] THR: Validating primary data. [2025-09-16T20:41:58.497281] [DEBUG] [VALIDATOR ] THR: All expected trading days are present. [2025-09-16T20:41:58.497360] [DEBUG] [VALIDATOR ] THR: Primary data validation passed. [2025-09-16T20:41:58.497828] [INFO ] [MAIN ] THR: Fetched primary data is valid. [2025-09-16T20:41:58.497870] [DEBUG] [LOCAL ] THR: Saving primary data. [2025-09-16T20:41:58.498424] [DEBUG] [LOCAL ] THR: Trimmed 22058 records to 14544 (keeping 150 days of data) [2025-09-16T20:41:58.584906] [DEBUG] [LOCAL ] THR: Primary data saved (14544 records). [2025-09-16T20:41:58.585045] [INFO ] [MAIN ] THR: Full history saved. [2025-09-16T20:41:58.585145] [INFO ] [MAIN ] Update Progress: 2088/2369 symbols completed. THR took 21.3s. Estimated remaining: 29m 52s. Rate: 9.4 symbols/min [2025-09-16T20:41:58.758076] [INFO ] [MAIN ] TIC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:41:58.758294] [DEBUG] [LOCAL ] TIC: No existing data file found in primary storage. [2025-09-16T20:41:58.758333] [WARN ] [MAIN ] TIC: No existing data found, performing full refresh instead. [2025-09-16T20:41:58.758486] [INFO ] [MAIN ] TIC: Wiping existing primary data before full refresh. [2025-09-16T20:41:58.758530] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-09-16T20:41:58.758570] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-09-16T20:41:58.758604] [INFO ] [MAIN ] TIC: Starting full primary refresh. [2025-09-16T20:41:58.780099] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-02. [2025-09-16T20:41:59.111295] [INFO ] [REMOTE ] TIC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:41:59.456237] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-16T20:41:59.574903] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-07. [2025-09-16T20:42:00.143241] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-16T20:42:00.374952] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-03. [2025-09-16T20:42:01.155791] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-16T20:42:01.174856] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-08. [2025-09-16T20:42:01.646734] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-16T20:42:01.974905] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-04. [2025-09-16T20:42:02.774921] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-02. [2025-09-16T20:42:03.574904] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-09. [2025-09-16T20:42:04.018506] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-16T20:42:04.337514] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-08 (3.16 seconds). [2025-09-16T20:42:04.374893] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-03. [2025-09-16T20:42:04.521039] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-09-16T20:42:04.738502] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-16T20:42:04.745057] [INFO ] [REMOTE ] THO: Full fetch complete (45857 records). [2025-09-16T20:42:04.745204] [DEBUG] [VALIDATOR ] THO: Validating primary data. [2025-09-16T20:42:05.130346] [DEBUG] [VALIDATOR ] THO: All expected trading days are present. [2025-09-16T20:42:05.130427] [DEBUG] [VALIDATOR ] THO: Primary data validation passed. [2025-09-16T20:42:05.131269] [INFO ] [MAIN ] THO: Fetched primary data is valid. [2025-09-16T20:42:05.131313] [DEBUG] [LOCAL ] THO: Saving primary data. [2025-09-16T20:42:05.132264] [DEBUG] [LOCAL ] THO: Trimmed 45857 records to 30596 (keeping 150 days of data) [2025-09-16T20:42:05.193980] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-09. [2025-09-16T20:42:05.325323] [DEBUG] [LOCAL ] THO: Primary data saved (30596 records). [2025-09-16T20:42:05.325450] [INFO ] [MAIN ] THO: Full history saved. [2025-09-16T20:42:05.325564] [INFO ] [MAIN ] Update Progress: 2089/2369 symbols completed. THO took 35.1s. Estimated remaining: 29m 46s. Rate: 9.4 symbols/min [2025-09-16T20:42:05.499584] [INFO ] [MAIN ] TIMB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:42:05.509944] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-16T20:42:05.540784] [DEBUG] [LOCAL ] TIMB: Loaded 26446 existing records from primary storage. [2025-09-16T20:42:05.540928] [INFO ] [MAIN ] TIMB: Loaded 26446 existing records. [2025-09-16T20:42:05.719873] [WARN ] [MAIN ] TIMB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:42:05.720139] [INFO ] [MAIN ] TIMB: Wiping existing primary data before full refresh. [2025-09-16T20:42:05.720187] [INFO ] [LOCAL ] TIMB: Starting deletion of primary data. [2025-09-16T20:42:05.720789] [DEBUG] [LOCAL ] TIMB: Deleted primary data file. [2025-09-16T20:42:05.720846] [INFO ] [MAIN ] TIMB: Starting full primary refresh. [2025-09-16T20:42:05.982060] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-05. [2025-09-16T20:42:06.067947] [INFO ] [REMOTE ] TIMB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:42:06.463820] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-16T20:42:06.469004] [INFO ] [REMOTE ] THS: Full fetch complete (41534 records). [2025-09-16T20:42:06.469086] [DEBUG] [VALIDATOR ] THS: Validating primary data. [2025-09-16T20:42:06.780002] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-04. [2025-09-16T20:42:06.843217] [DEBUG] [VALIDATOR ] THS: All expected trading days are present. [2025-09-16T20:42:06.843289] [DEBUG] [VALIDATOR ] THS: Primary data validation passed. [2025-09-16T20:42:06.844155] [INFO ] [MAIN ] THS: Fetched primary data is valid. [2025-09-16T20:42:06.844202] [DEBUG] [LOCAL ] THS: Saving primary data. [2025-09-16T20:42:06.845408] [DEBUG] [LOCAL ] THS: Trimmed 41534 records to 28416 (keeping 150 days of data) [2025-09-16T20:42:07.022413] [DEBUG] [LOCAL ] THS: Primary data saved (28416 records). [2025-09-16T20:42:07.022547] [INFO ] [MAIN ] THS: Full history saved. [2025-09-16T20:42:07.022673] [INFO ] [MAIN ] Update Progress: 2090/2369 symbols completed. THS took 27.4s. Estimated remaining: 29m 39s. Rate: 9.4 symbols/min [2025-09-16T20:42:07.193430] [INFO ] [MAIN ] TISI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:42:07.206154] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-16T20:42:07.212415] [DEBUG] [LOCAL ] TISI: Loaded 2142 existing records from primary storage. [2025-09-16T20:42:07.212719] [INFO ] [MAIN ] TISI: Loaded 2142 existing records. [2025-09-16T20:42:07.388031] [WARN ] [MAIN ] TISI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:42:07.388245] [INFO ] [MAIN ] TISI: Wiping existing primary data before full refresh. [2025-09-16T20:42:07.388318] [INFO ] [LOCAL ] TISI: Starting deletion of primary data. [2025-09-16T20:42:07.388489] [DEBUG] [LOCAL ] TISI: Deleted primary data file. [2025-09-16T20:42:07.388531] [INFO ] [MAIN ] TISI: Starting full primary refresh. [2025-09-16T20:42:07.582119] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-06. [2025-09-16T20:42:07.789688] [INFO ] [REMOTE ] TISI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:42:07.959486] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-16T20:42:08.374913] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-05. [2025-09-16T20:42:08.764331] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-16T20:42:09.174910] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-02. [2025-09-16T20:42:09.830831] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-16T20:42:09.974903] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-07. [2025-09-16T20:42:10.774919] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-02. [2025-09-16T20:42:10.818974] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-16T20:42:11.574933] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-03. [2025-09-16T20:42:11.920171] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-16T20:42:11.977227] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-16T20:42:12.374909] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-08. [2025-09-16T20:42:13.174901] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-06. [2025-09-16T20:42:13.974882] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-03. [2025-09-16T20:42:14.222287] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-03 (2.65 seconds). [2025-09-16T20:42:14.299952] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-16T20:42:14.484506] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-16T20:42:14.774911] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-04. [2025-09-16T20:42:14.835968] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-16T20:42:15.574903] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-07. [2025-09-16T20:42:16.275520] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-16T20:42:16.374860] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-05. [2025-09-16T20:42:17.175798] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-04. [2025-09-16T20:42:17.178499] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-16T20:42:17.458464] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-16T20:42:17.974927] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-06. [2025-09-16T20:42:18.044583] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-16T20:42:18.774930] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-08. [2025-09-16T20:42:19.327966] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-16T20:42:19.574905] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-09. [2025-09-16T20:42:20.201485] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-16T20:42:20.374878] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-09. [2025-09-16T20:42:20.529037] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-16T20:42:20.531564] [INFO ] [REMOTE ] THW: Full fetch complete (20972 records). [2025-09-16T20:42:20.531671] [DEBUG] [VALIDATOR ] THW: Validating primary data. [2025-09-16T20:42:20.893529] [DEBUG] [VALIDATOR ] THW: All expected trading days are present. [2025-09-16T20:42:20.893623] [DEBUG] [VALIDATOR ] THW: Primary data validation passed. [2025-09-16T20:42:20.894105] [INFO ] [MAIN ] THW: Fetched primary data is valid. [2025-09-16T20:42:20.894153] [DEBUG] [LOCAL ] THW: Saving primary data. [2025-09-16T20:42:20.894775] [DEBUG] [LOCAL ] THW: Trimmed 20972 records to 14902 (keeping 150 days of data) [2025-09-16T20:42:20.991002] [DEBUG] [LOCAL ] THW: Primary data saved (14902 records). [2025-09-16T20:42:20.991159] [INFO ] [MAIN ] THW: Full history saved. [2025-09-16T20:42:20.991287] [INFO ] [MAIN ] Update Progress: 2091/2369 symbols completed. THW took 27.3s. Estimated remaining: 29m 33s. Rate: 9.4 symbols/min [2025-09-16T20:42:21.161318] [INFO ] [MAIN ] TIXT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:42:21.174932] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-05. [2025-09-16T20:42:21.183945] [DEBUG] [LOCAL ] TIXT: Loaded 23961 existing records from primary storage. [2025-09-16T20:42:21.184037] [INFO ] [MAIN ] TIXT: Loaded 23961 existing records. [2025-09-16T20:42:21.358695] [WARN ] [MAIN ] TIXT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:42:21.358953] [INFO ] [MAIN ] TIXT: Wiping existing primary data before full refresh. [2025-09-16T20:42:21.359002] [INFO ] [LOCAL ] TIXT: Starting deletion of primary data. [2025-09-16T20:42:21.359465] [DEBUG] [LOCAL ] TIXT: Deleted primary data file. [2025-09-16T20:42:21.359510] [INFO ] [MAIN ] TIXT: Starting full primary refresh. [2025-09-16T20:42:21.709558] [INFO ] [REMOTE ] TIXT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:42:21.974871] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-02. [2025-09-16T20:42:22.097878] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-16T20:42:22.193396] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-16T20:42:22.198900] [INFO ] [REMOTE ] TIC: Full fetch complete (36088 records). [2025-09-16T20:42:22.198988] [DEBUG] [VALIDATOR ] TIC: Validating primary data. [2025-09-16T20:42:22.382161] [WARN ] [VALIDATOR ] TIC: Validation failed - insufficient historical data. Have 144 unique days, need 150 days [2025-09-16T20:42:22.382666] [FATAL] [MAIN ] TIC: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:42:22.382717] [WARN ] [MAIN ] TIC: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:42:22.382758] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-09-16T20:42:22.382815] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-09-16T20:42:22.382860] [INFO ] [LOCAL ] TIC: Starting deletion of derivative data. [2025-09-16T20:42:22.382909] [DEBUG] [LOCAL ] TIC: No derivative data file found to delete. [2025-09-16T20:42:22.382970] [INFO ] [MAIN ] Update Progress: 2092/2369 symbols completed. TIC took 23.8s. Estimated remaining: 29m 26s. Rate: 9.4 symbols/min [2025-09-16T20:42:22.551307] [INFO ] [MAIN ] TJX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:42:22.551504] [DEBUG] [LOCAL ] TJX: No existing data file found in primary storage. [2025-09-16T20:42:22.551543] [WARN ] [MAIN ] TJX: No existing data found, performing full refresh instead. [2025-09-16T20:42:22.551680] [INFO ] [MAIN ] TJX: Wiping existing primary data before full refresh. [2025-09-16T20:42:22.551723] [INFO ] [LOCAL ] TJX: Starting deletion of primary data. [2025-09-16T20:42:22.551766] [DEBUG] [LOCAL ] TJX: No primary data file found to delete. [2025-09-16T20:42:22.551798] [INFO ] [MAIN ] TJX: Starting full primary refresh. [2025-09-16T20:42:22.780438] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-06. [2025-09-16T20:42:22.904582] [INFO ] [REMOTE ] TJX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:42:23.036317] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-16T20:42:23.389104] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-16T20:42:23.574934] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-03. [2025-09-16T20:42:24.374906] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-07. [2025-09-16T20:42:24.888503] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-16T20:42:24.890271] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-16T20:42:25.174901] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-08. [2025-09-16T20:42:25.737154] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-16T20:42:25.974896] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-02. [2025-09-16T20:42:26.774929] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-04. [2025-09-16T20:42:27.574892] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-09. [2025-09-16T20:42:28.028573] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-16T20:42:28.042522] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-16T20:42:28.043239] [INFO ] [REMOTE ] TISI: Full fetch complete (4045 records). [2025-09-16T20:42:28.043307] [DEBUG] [VALIDATOR ] TISI: Validating primary data. [2025-09-16T20:42:28.380775] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-07. [2025-09-16T20:42:28.402274] [DEBUG] [VALIDATOR ] TISI: All expected trading days are present. [2025-09-16T20:42:28.402368] [DEBUG] [VALIDATOR ] TISI: Primary data validation passed. [2025-09-16T20:42:28.402509] [INFO ] [MAIN ] TISI: Fetched primary data is valid. [2025-09-16T20:42:28.402559] [DEBUG] [LOCAL ] TISI: Saving primary data. [2025-09-16T20:42:28.403232] [DEBUG] [LOCAL ] TISI: Trimmed 4045 records to 2147 (keeping 150 days of data) [2025-09-16T20:42:28.417051] [DEBUG] [LOCAL ] TISI: Primary data saved (2147 records). [2025-09-16T20:42:28.417165] [INFO ] [MAIN ] TISI: Full history saved. [2025-09-16T20:42:28.417316] [INFO ] [MAIN ] Update Progress: 2093/2369 symbols completed. TISI took 21.4s. Estimated remaining: 29m 20s. Rate: 9.4 symbols/min [2025-09-16T20:42:28.536877] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-02 (2.56 seconds). [2025-09-16T20:42:28.635418] [INFO ] [MAIN ] TK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:42:28.666487] [DEBUG] [LOCAL ] TK: Loaded 29500 existing records from primary storage. [2025-09-16T20:42:28.666688] [INFO ] [MAIN ] TK: Loaded 29500 existing records. [2025-09-16T20:42:28.846148] [WARN ] [MAIN ] TK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:42:28.846426] [INFO ] [MAIN ] TK: Wiping existing primary data before full refresh. [2025-09-16T20:42:28.846471] [INFO ] [LOCAL ] TK: Starting deletion of primary data. [2025-09-16T20:42:28.847151] [DEBUG] [LOCAL ] TK: Deleted primary data file. [2025-09-16T20:42:28.847199] [INFO ] [MAIN ] TK: Starting full primary refresh. [2025-09-16T20:42:29.175561] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-05. [2025-09-16T20:42:29.198964] [INFO ] [REMOTE ] TK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:42:29.980023] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-02. [2025-09-16T20:42:29.992787] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-16T20:42:30.398018] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-16T20:42:30.774884] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-08. [2025-09-16T20:42:31.529197] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-16T20:42:31.574894] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-03. [2025-09-16T20:42:32.309709] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-16T20:42:32.374866] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-06. [2025-09-16T20:42:33.017808] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-16T20:42:33.174963] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-03. [2025-09-16T20:42:33.848853] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-16T20:42:33.974963] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-07. [2025-09-16T20:42:34.774918] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-04. [2025-09-16T20:42:35.297706] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-16T20:42:35.405129] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-16T20:42:35.574915] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-08. [2025-09-16T20:42:36.137675] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-16T20:42:36.374902] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-05. [2025-09-16T20:42:36.983169] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-16T20:42:37.174892] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-09. [2025-09-16T20:42:37.974981] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-04. [2025-09-16T20:42:38.000963] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-16T20:42:38.554929] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-16T20:42:38.562157] [INFO ] [REMOTE ] TIXT: Full fetch complete (33578 records). [2025-09-16T20:42:38.562348] [DEBUG] [VALIDATOR ] TIXT: Validating primary data. [2025-09-16T20:42:38.781041] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-06. [2025-09-16T20:42:38.956422] [DEBUG] [VALIDATOR ] TIXT: All expected trading days are present. [2025-09-16T20:42:38.956511] [DEBUG] [VALIDATOR ] TIXT: Primary data validation passed. [2025-09-16T20:42:38.957272] [INFO ] [MAIN ] TIXT: Fetched primary data is valid. [2025-09-16T20:42:38.957317] [DEBUG] [LOCAL ] TIXT: Saving primary data. [2025-09-16T20:42:38.958992] [DEBUG] [LOCAL ] TIXT: Trimmed 33578 records to 24290 (keeping 150 days of data) [2025-09-16T20:42:39.094365] [DEBUG] [LOCAL ] TIXT: Primary data saved (24290 records). [2025-09-16T20:42:39.094505] [INFO ] [MAIN ] TIXT: Full history saved. [2025-09-16T20:42:39.094590] [INFO ] [MAIN ] Update Progress: 2094/2369 symbols completed. TIXT took 18.1s. Estimated remaining: 29m 14s. Rate: 9.4 symbols/min [2025-09-16T20:42:39.263099] [INFO ] [MAIN ] TKC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:42:39.290221] [DEBUG] [LOCAL ] TKC: Loaded 28162 existing records from primary storage. [2025-09-16T20:42:39.290378] [INFO ] [MAIN ] TKC: Loaded 28162 existing records. [2025-09-16T20:42:39.464452] [WARN ] [MAIN ] TKC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:42:39.464725] [INFO ] [MAIN ] TKC: Wiping existing primary data before full refresh. [2025-09-16T20:42:39.464772] [INFO ] [LOCAL ] TKC: Starting deletion of primary data. [2025-09-16T20:42:39.465405] [DEBUG] [LOCAL ] TKC: Deleted primary data file. [2025-09-16T20:42:39.465452] [INFO ] [MAIN ] TKC: Starting full primary refresh. [2025-09-16T20:42:39.579969] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-09. [2025-09-16T20:42:39.823773] [INFO ] [REMOTE ] TKC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:42:40.122126] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-16T20:42:40.374938] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-05. [2025-09-16T20:42:40.438071] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-16T20:42:40.981201] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-16T20:42:40.985352] [INFO ] [REMOTE ] TIMB: Full fetch complete (40964 records). [2025-09-16T20:42:40.985483] [DEBUG] [VALIDATOR ] TIMB: Validating primary data. [2025-09-16T20:42:41.183175] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-07. [2025-09-16T20:42:41.362971] [DEBUG] [VALIDATOR ] TIMB: All expected trading days are present. [2025-09-16T20:42:41.363051] [DEBUG] [VALIDATOR ] TIMB: Primary data validation passed. [2025-09-16T20:42:41.363862] [INFO ] [MAIN ] TIMB: Fetched primary data is valid. [2025-09-16T20:42:41.363906] [DEBUG] [LOCAL ] TIMB: Saving primary data. [2025-09-16T20:42:41.364869] [DEBUG] [LOCAL ] TIMB: Trimmed 40964 records to 26686 (keeping 150 days of data) [2025-09-16T20:42:41.544491] [DEBUG] [LOCAL ] TIMB: Primary data saved (26686 records). [2025-09-16T20:42:41.544672] [INFO ] [MAIN ] TIMB: Full history saved. [2025-09-16T20:42:41.544764] [INFO ] [MAIN ] Update Progress: 2095/2369 symbols completed. TIMB took 36.2s. Estimated remaining: 29m 7s. Rate: 9.4 symbols/min [2025-09-16T20:42:41.721118] [INFO ] [MAIN ] TKO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:42:41.754706] [DEBUG] [LOCAL ] TKO: Loaded 31405 existing records from primary storage. [2025-09-16T20:42:41.754850] [INFO ] [MAIN ] TKO: Loaded 31405 existing records. [2025-09-16T20:42:41.932428] [WARN ] [MAIN ] TKO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:42:41.932691] [INFO ] [MAIN ] TKO: Wiping existing primary data before full refresh. [2025-09-16T20:42:41.932740] [INFO ] [LOCAL ] TKO: Starting deletion of primary data. [2025-09-16T20:42:41.933471] [DEBUG] [LOCAL ] TKO: Deleted primary data file. [2025-09-16T20:42:41.933518] [INFO ] [MAIN ] TKO: Starting full primary refresh. [2025-09-16T20:42:41.997047] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-02. [2025-09-16T20:42:42.299252] [INFO ] [REMOTE ] TKO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:42:42.348818] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-16T20:42:42.774873] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-02. [2025-09-16T20:42:42.823507] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-16T20:42:42.929941] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-16T20:42:43.574942] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-03. [2025-09-16T20:42:44.374937] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-06. [2025-09-16T20:42:44.648943] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-16T20:42:44.715003] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-16T20:42:45.174906] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-04. [2025-09-16T20:42:45.974938] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-03. [2025-09-16T20:42:46.310207] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-16T20:42:46.538573] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-16T20:42:46.774947] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-08. [2025-09-16T20:42:47.574898] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-07. [2025-09-16T20:42:47.961037] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-16T20:42:48.112981] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-16T20:42:48.374885] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-09. [2025-09-16T20:42:49.174873] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-05. [2025-09-16T20:42:49.644880] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-16T20:42:49.741864] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-16T20:42:49.746461] [INFO ] [REMOTE ] TK: Full fetch complete (43232 records). [2025-09-16T20:42:49.746541] [DEBUG] [VALIDATOR ] TK: Validating primary data. [2025-09-16T20:42:49.980039] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-08. [2025-09-16T20:42:50.134587] [DEBUG] [VALIDATOR ] TK: All expected trading days are present. [2025-09-16T20:42:50.134679] [DEBUG] [VALIDATOR ] TK: Primary data validation passed. [2025-09-16T20:42:50.135497] [INFO ] [MAIN ] TK: Fetched primary data is valid. [2025-09-16T20:42:50.135539] [DEBUG] [LOCAL ] TK: Saving primary data. [2025-09-16T20:42:50.136426] [DEBUG] [LOCAL ] TK: Trimmed 43232 records to 29721 (keeping 150 days of data) [2025-09-16T20:42:50.309626] [DEBUG] [LOCAL ] TK: Primary data saved (29721 records). [2025-09-16T20:42:50.309799] [INFO ] [MAIN ] TK: Full history saved. [2025-09-16T20:42:50.309886] [INFO ] [MAIN ] Update Progress: 2096/2369 symbols completed. TK took 21.9s. Estimated remaining: 29m 1s. Rate: 9.4 symbols/min [2025-09-16T20:42:50.482973] [INFO ] [MAIN ] TKR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:42:50.511969] [DEBUG] [LOCAL ] TKR: Loaded 28611 existing records from primary storage. [2025-09-16T20:42:50.512102] [INFO ] [MAIN ] TKR: Loaded 28611 existing records. [2025-09-16T20:42:50.687425] [WARN ] [MAIN ] TKR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:42:50.687694] [INFO ] [MAIN ] TKR: Wiping existing primary data before full refresh. [2025-09-16T20:42:50.687754] [INFO ] [LOCAL ] TKR: Starting deletion of primary data. [2025-09-16T20:42:50.688373] [DEBUG] [LOCAL ] TKR: Deleted primary data file. [2025-09-16T20:42:50.688418] [INFO ] [MAIN ] TKR: Starting full primary refresh. [2025-09-16T20:42:50.785873] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-04. [2025-09-16T20:42:51.049564] [INFO ] [REMOTE ] TKR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:42:51.078990] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-16T20:42:51.574947] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-02. [2025-09-16T20:42:52.211795] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-16T20:42:52.378900] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-09. [2025-09-16T20:42:52.384662] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-16T20:42:53.004784] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-16T20:42:53.158990] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-16T20:42:53.165989] [INFO ] [REMOTE ] TJX: Full fetch complete (57961 records). [2025-09-16T20:42:53.166224] [DEBUG] [VALIDATOR ] TJX: Validating primary data. [2025-09-16T20:42:53.167075] [FATAL] [VALIDATOR ] TJX: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T20:42:53.167171] [FATAL] [MAIN ] TJX: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:42:53.167209] [WARN ] [MAIN ] TJX: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:42:53.167253] [INFO ] [LOCAL ] TJX: Starting deletion of primary data. [2025-09-16T20:42:53.167328] [DEBUG] [LOCAL ] TJX: No primary data file found to delete. [2025-09-16T20:42:53.167370] [INFO ] [LOCAL ] TJX: Starting deletion of derivative data. [2025-09-16T20:42:53.167411] [DEBUG] [LOCAL ] TJX: No derivative data file found to delete. [2025-09-16T20:42:53.167482] [INFO ] [MAIN ] Update Progress: 2097/2369 symbols completed. TJX took 30.8s. Estimated remaining: 28m 54s. Rate: 9.4 symbols/min [2025-09-16T20:42:53.180120] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-06. [2025-09-16T20:42:53.343904] [INFO ] [MAIN ] TLK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:42:53.379803] [DEBUG] [LOCAL ] TLK: Loaded 28585 existing records from primary storage. [2025-09-16T20:42:53.380017] [INFO ] [MAIN ] TLK: Loaded 28585 existing records. [2025-09-16T20:42:53.586830] [WARN ] [MAIN ] TLK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:42:53.587278] [INFO ] [MAIN ] TLK: Wiping existing primary data before full refresh. [2025-09-16T20:42:53.587327] [INFO ] [LOCAL ] TLK: Starting deletion of primary data. [2025-09-16T20:42:53.588155] [DEBUG] [LOCAL ] TLK: Deleted primary data file. [2025-09-16T20:42:53.588208] [INFO ] [MAIN ] TLK: Starting full primary refresh. [2025-09-16T20:42:53.954207] [INFO ] [REMOTE ] TLK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:42:53.974913] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-05. [2025-09-16T20:42:54.769483] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-16T20:42:54.774872] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-02. [2025-09-16T20:42:55.574877] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-07. [2025-09-16T20:42:55.604480] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-16T20:42:56.153444] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-16T20:42:56.374922] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-06. [2025-09-16T20:42:57.035351] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-16T20:42:57.174913] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-08. [2025-09-16T20:42:57.974888] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-03. [2025-09-16T20:42:58.161429] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-16T20:42:58.583182] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-16T20:42:58.774973] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-03. [2025-09-16T20:42:59.360780] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-16T20:42:59.574953] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-09. [2025-09-16T20:43:00.374907] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-07. [2025-09-16T20:43:00.605365] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-16T20:43:00.917848] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-16T20:43:00.923033] [INFO ] [REMOTE ] TKC: Full fetch complete (40324 records). [2025-09-16T20:43:00.923130] [DEBUG] [VALIDATOR ] TKC: Validating primary data. [2025-09-16T20:43:01.185783] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-04. [2025-09-16T20:43:01.311772] [DEBUG] [VALIDATOR ] TKC: All expected trading days are present. [2025-09-16T20:43:01.311853] [DEBUG] [VALIDATOR ] TKC: Primary data validation passed. [2025-09-16T20:43:01.312665] [INFO ] [MAIN ] TKC: Fetched primary data is valid. [2025-09-16T20:43:01.312709] [DEBUG] [LOCAL ] TKC: Saving primary data. [2025-09-16T20:43:01.313584] [DEBUG] [LOCAL ] TKC: Trimmed 40324 records to 28470 (keeping 150 days of data) [2025-09-16T20:43:01.489460] [DEBUG] [LOCAL ] TKC: Primary data saved (28470 records). [2025-09-16T20:43:01.489838] [INFO ] [MAIN ] TKC: Full history saved. [2025-09-16T20:43:01.489987] [INFO ] [MAIN ] Update Progress: 2098/2369 symbols completed. TKC took 22.4s. Estimated remaining: 28m 48s. Rate: 9.4 symbols/min [2025-09-16T20:43:01.674759] [INFO ] [MAIN ] TLYS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:43:01.690752] [DEBUG] [LOCAL ] TLYS: Loaded 14004 existing records from primary storage. [2025-09-16T20:43:01.690914] [INFO ] [MAIN ] TLYS: Loaded 14004 existing records. [2025-09-16T20:43:01.883614] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-16T20:43:01.923573] [WARN ] [MAIN ] TLYS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:43:01.924277] [INFO ] [MAIN ] TLYS: Wiping existing primary data before full refresh. [2025-09-16T20:43:01.924339] [INFO ] [LOCAL ] TLYS: Starting deletion of primary data. [2025-09-16T20:43:01.924812] [DEBUG] [LOCAL ] TLYS: Deleted primary data file. [2025-09-16T20:43:01.924870] [INFO ] [MAIN ] TLYS: Starting full primary refresh. [2025-09-16T20:43:01.986116] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-08. [2025-09-16T20:43:02.329821] [INFO ] [REMOTE ] TLYS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:43:02.491266] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-16T20:43:02.774969] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-04. [2025-09-16T20:43:03.473078] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-16T20:43:03.574909] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-05. [2025-09-16T20:43:04.374941] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-09. [2025-09-16T20:43:04.522093] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-16T20:43:04.764298] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-16T20:43:04.769413] [INFO ] [REMOTE ] TKO: Full fetch complete (48416 records). [2025-09-16T20:43:04.769555] [DEBUG] [VALIDATOR ] TKO: Validating primary data. [2025-09-16T20:43:04.771097] [FATAL] [VALIDATOR ] TKO: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T20:43:04.771239] [FATAL] [MAIN ] TKO: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:43:04.771301] [WARN ] [MAIN ] TKO: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:43:04.771362] [INFO ] [LOCAL ] TKO: Starting deletion of primary data. [2025-09-16T20:43:04.771458] [DEBUG] [LOCAL ] TKO: No primary data file found to delete. [2025-09-16T20:43:04.771520] [INFO ] [LOCAL ] TKO: Starting deletion of derivative data. [2025-09-16T20:43:04.772214] [DEBUG] [LOCAL ] TKO: Deleted derivative data file. [2025-09-16T20:43:04.772346] [INFO ] [MAIN ] Update Progress: 2099/2369 symbols completed. TKO took 23.2s. Estimated remaining: 28m 41s. Rate: 9.4 symbols/min [2025-09-16T20:43:04.944603] [INFO ] [MAIN ] TM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:43:04.973037] [DEBUG] [LOCAL ] TM: Loaded 27228 existing records from primary storage. [2025-09-16T20:43:04.973174] [INFO ] [MAIN ] TM: Loaded 27228 existing records. [2025-09-16T20:43:05.152272] [WARN ] [MAIN ] TM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:43:05.152505] [INFO ] [MAIN ] TM: Wiping existing primary data before full refresh. [2025-09-16T20:43:05.152553] [INFO ] [LOCAL ] TM: Starting deletion of primary data. [2025-09-16T20:43:05.153131] [DEBUG] [LOCAL ] TM: Deleted primary data file. [2025-09-16T20:43:05.153180] [INFO ] [MAIN ] TM: Starting full primary refresh. [2025-09-16T20:43:05.183706] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-05. [2025-09-16T20:43:05.566693] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-16T20:43:05.570699] [INFO ] [REMOTE ] TM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:43:05.974947] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-06. [2025-09-16T20:43:06.774952] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-02. [2025-09-16T20:43:07.107517] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-16T20:43:07.266897] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-16T20:43:07.320550] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-16T20:43:07.574919] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-07. [2025-09-16T20:43:08.374933] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-02. [2025-09-16T20:43:09.082762] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-16T20:43:09.174931] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-06. [2025-09-16T20:43:09.974941] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-08. [2025-09-16T20:43:10.106039] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-16T20:43:10.310830] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-16T20:43:10.774940] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-03. [2025-09-16T20:43:11.574942] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-07. [2025-09-16T20:43:11.640340] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-16T20:43:12.374877] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-03. [2025-09-16T20:43:12.462754] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-16T20:43:12.952929] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-16T20:43:13.178024] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-04. [2025-09-16T20:43:13.182862] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-16T20:43:13.974912] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-08. [2025-09-16T20:43:14.170477] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-16T20:43:14.774889] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-05. [2025-09-16T20:43:15.335570] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-16T20:43:15.574911] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-09. [2025-09-16T20:43:15.894530] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-16T20:43:16.374914] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-04. [2025-09-16T20:43:16.614569] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-16T20:43:16.619234] [INFO ] [REMOTE ] TLK: Full fetch complete (43454 records). [2025-09-16T20:43:16.619319] [DEBUG] [VALIDATOR ] TLK: Validating primary data. [2025-09-16T20:43:16.992080] [DEBUG] [VALIDATOR ] TLK: All expected trading days are present. [2025-09-16T20:43:16.992179] [DEBUG] [VALIDATOR ] TLK: Primary data validation passed. [2025-09-16T20:43:16.993141] [INFO ] [MAIN ] TLK: Fetched primary data is valid. [2025-09-16T20:43:16.993196] [DEBUG] [LOCAL ] TLK: Saving primary data. [2025-09-16T20:43:16.994463] [DEBUG] [LOCAL ] TLK: Trimmed 43454 records to 28852 (keeping 150 days of data) [2025-09-16T20:43:17.177805] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-06. [2025-09-16T20:43:17.180348] [DEBUG] [LOCAL ] TLK: Primary data saved (28852 records). [2025-09-16T20:43:17.181523] [INFO ] [MAIN ] TLK: Full history saved. [2025-09-16T20:43:17.181669] [INFO ] [MAIN ] Update Progress: 2100/2369 symbols completed. TLK took 24.0s. Estimated remaining: 28m 36s. Rate: 9.4 symbols/min [2025-09-16T20:43:17.356591] [INFO ] [MAIN ] TME: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:43:17.396450] [DEBUG] [LOCAL ] TME: Loaded 39238 existing records from primary storage. [2025-09-16T20:43:17.396660] [INFO ] [MAIN ] TME: Loaded 39238 existing records. [2025-09-16T20:43:17.571918] [WARN ] [MAIN ] TME: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:43:17.572164] [INFO ] [MAIN ] TME: Wiping existing primary data before full refresh. [2025-09-16T20:43:17.572219] [INFO ] [LOCAL ] TME: Starting deletion of primary data. [2025-09-16T20:43:17.572965] [DEBUG] [LOCAL ] TME: Deleted primary data file. [2025-09-16T20:43:17.573015] [INFO ] [MAIN ] TME: Starting full primary refresh. [2025-09-16T20:43:17.929734] [INFO ] [REMOTE ] TME: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:43:17.974857] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-02. [2025-09-16T20:43:18.156562] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-16T20:43:18.653974] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-16T20:43:18.774856] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-07. [2025-09-16T20:43:19.574977] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-05. [2025-09-16T20:43:19.711394] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-16T20:43:19.930372] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-16T20:43:20.374909] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-09. [2025-09-16T20:43:21.175007] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-08. [2025-09-16T20:43:21.238009] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-16T20:43:21.736031] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-16T20:43:21.741332] [INFO ] [REMOTE ] TKR: Full fetch complete (43611 records). [2025-09-16T20:43:21.741421] [DEBUG] [VALIDATOR ] TKR: Validating primary data. [2025-09-16T20:43:21.976118] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-06. [2025-09-16T20:43:22.047318] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-16T20:43:22.137105] [DEBUG] [VALIDATOR ] TKR: All expected trading days are present. [2025-09-16T20:43:22.137185] [DEBUG] [VALIDATOR ] TKR: Primary data validation passed. [2025-09-16T20:43:22.138040] [INFO ] [MAIN ] TKR: Fetched primary data is valid. [2025-09-16T20:43:22.138105] [DEBUG] [LOCAL ] TKR: Saving primary data. [2025-09-16T20:43:22.139042] [DEBUG] [LOCAL ] TKR: Trimmed 43611 records to 28992 (keeping 150 days of data) [2025-09-16T20:43:22.322591] [DEBUG] [LOCAL ] TKR: Primary data saved (28992 records). [2025-09-16T20:43:22.322762] [INFO ] [MAIN ] TKR: Full history saved. [2025-09-16T20:43:22.325592] [INFO ] [MAIN ] Update Progress: 2101/2369 symbols completed. TKR took 32.0s. Estimated remaining: 28m 29s. Rate: 9.4 symbols/min [2025-09-16T20:43:22.498354] [INFO ] [MAIN ] TMHC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:43:22.533975] [DEBUG] [LOCAL ] TMHC: Loaded 33422 existing records from primary storage. [2025-09-16T20:43:22.534134] [INFO ] [MAIN ] TMHC: Loaded 33422 existing records. [2025-09-16T20:43:22.710299] [WARN ] [MAIN ] TMHC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:43:22.710555] [INFO ] [MAIN ] TMHC: Wiping existing primary data before full refresh. [2025-09-16T20:43:22.710610] [INFO ] [LOCAL ] TMHC: Starting deletion of primary data. [2025-09-16T20:43:22.711280] [DEBUG] [LOCAL ] TMHC: Deleted primary data file. [2025-09-16T20:43:22.711328] [INFO ] [MAIN ] TMHC: Starting full primary refresh. [2025-09-16T20:43:22.780109] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-03. [2025-09-16T20:43:23.068368] [INFO ] [REMOTE ] TMHC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:43:23.574925] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-02. [2025-09-16T20:43:23.831533] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-16T20:43:24.374907] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-07. [2025-09-16T20:43:24.851575] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-16T20:43:24.940429] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-16T20:43:25.174908] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-04. [2025-09-16T20:43:25.974945] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-09. [2025-09-16T20:43:26.131369] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-16T20:43:26.774939] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-08. [2025-09-16T20:43:26.850980] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-16T20:43:26.853795] [INFO ] [REMOTE ] TLYS: Full fetch complete (17946 records). [2025-09-16T20:43:26.853895] [DEBUG] [VALIDATOR ] TLYS: Validating primary data. [2025-09-16T20:43:27.275586] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-16T20:43:27.275833] [DEBUG] [VALIDATOR ] TLYS: All expected trading days are present. [2025-09-16T20:43:27.286476] [DEBUG] [VALIDATOR ] TLYS: Primary data validation passed. [2025-09-16T20:43:27.287173] [INFO ] [MAIN ] TLYS: Fetched primary data is valid. [2025-09-16T20:43:27.287237] [DEBUG] [LOCAL ] TLYS: Saving primary data. [2025-09-16T20:43:27.288823] [DEBUG] [LOCAL ] TLYS: Trimmed 17946 records to 14099 (keeping 150 days of data) [2025-09-16T20:43:27.369734] [DEBUG] [LOCAL ] TLYS: Primary data saved (14099 records). [2025-09-16T20:43:27.369886] [INFO ] [MAIN ] TLYS: Full history saved. [2025-09-16T20:43:27.369975] [INFO ] [MAIN ] Update Progress: 2102/2369 symbols completed. TLYS took 25.9s. Estimated remaining: 28m 23s. Rate: 9.4 symbols/min [2025-09-16T20:43:27.539008] [INFO ] [MAIN ] TMO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:43:27.576735] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-03. [2025-09-16T20:43:27.577605] [DEBUG] [LOCAL ] TMO: Loaded 38749 existing records from primary storage. [2025-09-16T20:43:27.578602] [INFO ] [MAIN ] TMO: Loaded 38749 existing records. [2025-09-16T20:43:27.756191] [WARN ] [MAIN ] TMO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:43:27.756425] [INFO ] [MAIN ] TMO: Wiping existing primary data before full refresh. [2025-09-16T20:43:27.756472] [INFO ] [LOCAL ] TMO: Starting deletion of primary data. [2025-09-16T20:43:27.757243] [DEBUG] [LOCAL ] TMO: Deleted primary data file. [2025-09-16T20:43:27.757291] [INFO ] [MAIN ] TMO: Starting full primary refresh. [2025-09-16T20:43:28.113846] [INFO ] [REMOTE ] TMO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:43:28.374903] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-05. [2025-09-16T20:43:28.465970] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-16T20:43:29.174956] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-02. [2025-09-16T20:43:29.279980] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-16T20:43:29.974907] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-04. [2025-09-16T20:43:30.097366] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-16T20:43:30.780461] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-06. [2025-09-16T20:43:30.785555] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-16T20:43:31.574938] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-03. [2025-09-16T20:43:31.757318] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-16T20:43:32.307152] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-16T20:43:32.374994] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-07. [2025-09-16T20:43:33.174929] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-05. [2025-09-16T20:43:33.397756] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-16T20:43:33.974958] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-04. [2025-09-16T20:43:34.406167] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-16T20:43:34.709635] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-16T20:43:34.774934] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-08. [2025-09-16T20:43:35.574881] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-09. [2025-09-16T20:43:35.613560] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-16T20:43:36.374962] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-05. [2025-09-16T20:43:36.559733] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-16T20:43:37.026180] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-16T20:43:37.032084] [INFO ] [REMOTE ] TM: Full fetch complete (39922 records). [2025-09-16T20:43:37.032257] [DEBUG] [VALIDATOR ] TM: Validating primary data. [2025-09-16T20:43:37.184310] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-06. [2025-09-16T20:43:37.409114] [DEBUG] [VALIDATOR ] TM: All expected trading days are present. [2025-09-16T20:43:37.409219] [DEBUG] [VALIDATOR ] TM: Primary data validation passed. [2025-09-16T20:43:37.410057] [INFO ] [MAIN ] TM: Fetched primary data is valid. [2025-09-16T20:43:37.410109] [DEBUG] [LOCAL ] TM: Saving primary data. [2025-09-16T20:43:37.411010] [DEBUG] [LOCAL ] TM: Trimmed 39922 records to 27414 (keeping 150 days of data) [2025-09-16T20:43:37.579782] [DEBUG] [LOCAL ] TM: Primary data saved (27414 records). [2025-09-16T20:43:37.579917] [INFO ] [MAIN ] TM: Full history saved. [2025-09-16T20:43:37.580016] [INFO ] [MAIN ] Update Progress: 2103/2369 symbols completed. TM took 32.8s. Estimated remaining: 28m 17s. Rate: 9.4 symbols/min [2025-09-16T20:43:37.751211] [INFO ] [MAIN ] TNC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:43:37.762457] [DEBUG] [LOCAL ] TNC: Loaded 10477 existing records from primary storage. [2025-09-16T20:43:37.762586] [INFO ] [MAIN ] TNC: Loaded 10477 existing records. [2025-09-16T20:43:37.939869] [WARN ] [MAIN ] TNC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:43:37.940111] [INFO ] [MAIN ] TNC: Wiping existing primary data before full refresh. [2025-09-16T20:43:37.940159] [INFO ] [LOCAL ] TNC: Starting deletion of primary data. [2025-09-16T20:43:37.940545] [DEBUG] [LOCAL ] TNC: Deleted primary data file. [2025-09-16T20:43:37.940588] [INFO ] [MAIN ] TNC: Starting full primary refresh. [2025-09-16T20:43:37.982785] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-09. [2025-09-16T20:43:38.298015] [INFO ] [REMOTE ] TNC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:43:38.478855] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-16T20:43:38.546602] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-16T20:43:38.774934] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-02. [2025-09-16T20:43:39.575023] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-07. [2025-09-16T20:43:39.848630] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-16T20:43:39.856125] [INFO ] [REMOTE ] TME: Full fetch complete (57862 records). [2025-09-16T20:43:39.856413] [DEBUG] [VALIDATOR ] TME: Validating primary data. [2025-09-16T20:43:40.172842] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-16T20:43:40.266605] [DEBUG] [VALIDATOR ] TME: All expected trading days are present. [2025-09-16T20:43:40.266713] [DEBUG] [VALIDATOR ] TME: Primary data validation passed. [2025-09-16T20:43:40.267732] [INFO ] [MAIN ] TME: Fetched primary data is valid. [2025-09-16T20:43:40.267780] [DEBUG] [LOCAL ] TME: Saving primary data. [2025-09-16T20:43:40.269003] [DEBUG] [LOCAL ] TME: Trimmed 57862 records to 39626 (keeping 150 days of data) [2025-09-16T20:43:40.374924] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-03. [2025-09-16T20:43:40.514881] [DEBUG] [LOCAL ] TME: Primary data saved (39626 records). [2025-09-16T20:43:40.515043] [INFO ] [MAIN ] TME: Full history saved. [2025-09-16T20:43:40.515154] [INFO ] [MAIN ] Update Progress: 2104/2369 symbols completed. TME took 23.3s. Estimated remaining: 28m 10s. Rate: 9.4 symbols/min [2025-09-16T20:43:40.686613] [INFO ] [MAIN ] TNET: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:43:40.706417] [DEBUG] [LOCAL ] TNET: Loaded 20980 existing records from primary storage. [2025-09-16T20:43:40.706599] [INFO ] [MAIN ] TNET: Loaded 20980 existing records. [2025-09-16T20:43:40.885764] [WARN ] [MAIN ] TNET: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:43:40.886052] [INFO ] [MAIN ] TNET: Wiping existing primary data before full refresh. [2025-09-16T20:43:40.886099] [INFO ] [LOCAL ] TNET: Starting deletion of primary data. [2025-09-16T20:43:40.886693] [DEBUG] [LOCAL ] TNET: Deleted primary data file. [2025-09-16T20:43:40.886745] [INFO ] [MAIN ] TNET: Starting full primary refresh. [2025-09-16T20:43:41.177598] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-06. [2025-09-16T20:43:41.246448] [INFO ] [REMOTE ] TNET: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:43:41.328770] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-16T20:43:41.568140] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-16T20:43:41.974930] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-04. [2025-09-16T20:43:42.774944] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-08. [2025-09-16T20:43:43.176794] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-16T20:43:43.213617] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-16T20:43:43.574940] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-05. [2025-09-16T20:43:44.208600] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-16T20:43:44.374875] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-07. [2025-09-16T20:43:44.385714] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-16T20:43:45.174946] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-09. [2025-09-16T20:43:45.974915] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-02. [2025-09-16T20:43:46.611253] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-16T20:43:46.617179] [INFO ] [REMOTE ] TMHC: Full fetch complete (49844 records). [2025-09-16T20:43:46.617350] [DEBUG] [VALIDATOR ] TMHC: Validating primary data. [2025-09-16T20:43:46.782958] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-06. [2025-09-16T20:43:46.984978] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-09-16T20:43:47.070162] [DEBUG] [VALIDATOR ] TMHC: All expected trading days are present. [2025-09-16T20:43:47.070339] [DEBUG] [VALIDATOR ] TMHC: Primary data validation passed. [2025-09-16T20:43:47.071328] [INFO ] [MAIN ] TMHC: Fetched primary data is valid. [2025-09-16T20:43:47.071381] [DEBUG] [LOCAL ] TMHC: Saving primary data. [2025-09-16T20:43:47.072883] [DEBUG] [LOCAL ] TMHC: Trimmed 49844 records to 33787 (keeping 150 days of data) [2025-09-16T20:43:47.276064] [DEBUG] [LOCAL ] TMHC: Primary data saved (33787 records). [2025-09-16T20:43:47.276220] [INFO ] [MAIN ] TMHC: Full history saved. [2025-09-16T20:43:47.277000] [INFO ] [MAIN ] Update Progress: 2105/2369 symbols completed. TMHC took 25.0s. Estimated remaining: 28m 4s. Rate: 9.4 symbols/min [2025-09-16T20:43:47.450559] [INFO ] [MAIN ] TNGY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:43:47.450889] [DEBUG] [LOCAL ] TNGY: No existing data file found in primary storage. [2025-09-16T20:43:47.451034] [WARN ] [MAIN ] TNGY: No existing data found, performing full refresh instead. [2025-09-16T20:43:47.451201] [INFO ] [MAIN ] TNGY: Wiping existing primary data before full refresh. [2025-09-16T20:43:47.451251] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-09-16T20:43:47.451373] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-09-16T20:43:47.451427] [INFO ] [MAIN ] TNGY: Starting full primary refresh. [2025-09-16T20:43:47.582412] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-08. [2025-09-16T20:43:47.606757] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-16T20:43:47.784358] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-16T20:43:47.894876] [INFO ] [REMOTE ] TNGY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:43:48.374957] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-03. [2025-09-16T20:43:49.174937] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-02. [2025-09-16T20:43:49.445027] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:43:49.445502] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-02 [2025-09-16T20:43:49.529369] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-16T20:43:49.570587] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-16T20:43:49.974924] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-03. [2025-09-16T20:43:50.232762] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:43:50.233102] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-03 [2025-09-16T20:43:50.774889] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-04. [2025-09-16T20:43:51.574940] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-09. [2025-09-16T20:43:52.121903] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-16T20:43:52.311458] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-16T20:43:52.317419] [INFO ] [REMOTE ] TMO: Full fetch complete (56527 records). [2025-09-16T20:43:52.317602] [DEBUG] [VALIDATOR ] TMO: Validating primary data. [2025-09-16T20:43:52.318403] [FATAL] [VALIDATOR ] TMO: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T20:43:52.318498] [FATAL] [MAIN ] TMO: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:43:52.318536] [WARN ] [MAIN ] TMO: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:43:52.318583] [INFO ] [LOCAL ] TMO: Starting deletion of primary data. [2025-09-16T20:43:52.318707] [DEBUG] [LOCAL ] TMO: No primary data file found to delete. [2025-09-16T20:43:52.318747] [INFO ] [LOCAL ] TMO: Starting deletion of derivative data. [2025-09-16T20:43:52.319068] [DEBUG] [LOCAL ] TMO: Deleted derivative data file. [2025-09-16T20:43:52.319165] [INFO ] [MAIN ] Update Progress: 2106/2369 symbols completed. TMO took 24.9s. Estimated remaining: 27m 57s. Rate: 9.4 symbols/min [2025-09-16T20:43:52.382780] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-04. [2025-09-16T20:43:52.498730] [INFO ] [MAIN ] TNK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:43:52.524735] [DEBUG] [LOCAL ] TNK: Loaded 26122 existing records from primary storage. [2025-09-16T20:43:52.524898] [INFO ] [MAIN ] TNK: Loaded 26122 existing records. [2025-09-16T20:43:52.698816] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:43:52.702522] [WARN ] [MAIN ] TNK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:43:52.702870] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-04 [2025-09-16T20:43:52.703377] [INFO ] [MAIN ] TNK: Wiping existing primary data before full refresh. [2025-09-16T20:43:52.703466] [INFO ] [LOCAL ] TNK: Starting deletion of primary data. [2025-09-16T20:43:52.704094] [DEBUG] [LOCAL ] TNK: Deleted primary data file. [2025-09-16T20:43:52.704144] [INFO ] [MAIN ] TNK: Starting full primary refresh. [2025-09-16T20:43:53.052204] [INFO ] [REMOTE ] TNK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:43:53.174866] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-02. [2025-09-16T20:43:53.974915] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-05. [2025-09-16T20:43:54.554450] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-16T20:43:54.774935] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-05. [2025-09-16T20:43:55.033195] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:43:55.033531] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-05 [2025-09-16T20:43:55.290300] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-16T20:43:55.574907] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-06. [2025-09-16T20:43:56.294117] [INFO ] [REMOTE ] TNGY: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-16T20:43:56.374895] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-07. [2025-09-16T20:43:57.084975] [INFO ] [REMOTE ] TNGY: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-16T20:43:57.174891] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-06. [2025-09-16T20:43:57.974929] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-03. [2025-09-16T20:43:58.153882] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-16T20:43:58.774889] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-07. [2025-09-16T20:43:59.535553] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-16T20:43:59.574868] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-04. [2025-09-16T20:43:59.681422] [DEBUG] [REMOTE ] TNK: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-09-16T20:43:59.681758] [WARN ] [REMOTE ] TNK: No data returned for month 2025-04 [2025-09-16T20:43:59.839015] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-16T20:44:00.374903] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-08. [2025-09-16T20:44:01.043387] [INFO ] [REMOTE ] TNGY: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-16T20:44:01.174906] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-08. [2025-09-16T20:44:01.974942] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-07. [2025-09-16T20:44:02.265971] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-16T20:44:02.774922] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-09. [2025-09-16T20:44:03.099112] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-16T20:44:03.574929] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-09. [2025-09-16T20:44:03.772676] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-16T20:44:03.776182] [INFO ] [REMOTE ] TNET: Full fetch complete (32586 records). [2025-09-16T20:44:03.776269] [DEBUG] [VALIDATOR ] TNET: Validating primary data. [2025-09-16T20:44:04.151804] [DEBUG] [VALIDATOR ] TNET: All expected trading days are present. [2025-09-16T20:44:04.151880] [DEBUG] [VALIDATOR ] TNET: Primary data validation passed. [2025-09-16T20:44:04.152556] [INFO ] [MAIN ] TNET: Fetched primary data is valid. [2025-09-16T20:44:04.152605] [DEBUG] [LOCAL ] TNET: Saving primary data. [2025-09-16T20:44:04.153372] [DEBUG] [LOCAL ] TNET: Trimmed 32586 records to 21161 (keeping 150 days of data) [2025-09-16T20:44:04.294408] [INFO ] [REMOTE ] TNGY: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-16T20:44:04.294840] [DEBUG] [LOCAL ] TNET: Primary data saved (21161 records). [2025-09-16T20:44:04.296433] [INFO ] [MAIN ] TNET: Full history saved. [2025-09-16T20:44:04.296327] [INFO ] [REMOTE ] TNGY: Full fetch complete (2985 records). [2025-09-16T20:44:04.296540] [DEBUG] [VALIDATOR ] TNGY: Validating primary data. [2025-09-16T20:44:04.296861] [INFO ] [MAIN ] Update Progress: 2107/2369 symbols completed. TNET took 23.8s. Estimated remaining: 27m 51s. Rate: 9.4 symbols/min [2025-09-16T20:44:04.389523] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-05. [2025-09-16T20:44:04.643672] [INFO ] [MAIN ] TNL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:44:04.654485] [WARN ] [VALIDATOR ] TNGY: Validation failed - insufficient historical data. Have 64 unique days, need 150 days [2025-09-16T20:44:04.655031] [FATAL] [MAIN ] TNGY: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:44:04.655357] [WARN ] [MAIN ] TNGY: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:44:04.655408] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-09-16T20:44:04.655459] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-09-16T20:44:04.655505] [INFO ] [LOCAL ] TNGY: Starting deletion of derivative data. [2025-09-16T20:44:04.655546] [DEBUG] [LOCAL ] TNGY: No derivative data file found to delete. [2025-09-16T20:44:04.655604] [INFO ] [MAIN ] Update Progress: 2108/2369 symbols completed. TNGY took 17.4s. Estimated remaining: 27m 44s. Rate: 9.4 symbols/min [2025-09-16T20:44:04.835274] [INFO ] [MAIN ] TOL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:44:04.835487] [DEBUG] [LOCAL ] TOL: No existing data file found in primary storage. [2025-09-16T20:44:04.835527] [WARN ] [MAIN ] TOL: No existing data found, performing full refresh instead. [2025-09-16T20:44:04.835660] [INFO ] [MAIN ] TOL: Wiping existing primary data before full refresh. [2025-09-16T20:44:04.835703] [INFO ] [LOCAL ] TOL: Starting deletion of primary data. [2025-09-16T20:44:04.835748] [DEBUG] [LOCAL ] TOL: No primary data file found to delete. [2025-09-16T20:44:04.835781] [INFO ] [MAIN ] TOL: Starting full primary refresh. [2025-09-16T20:44:04.946552] [DEBUG] [LOCAL ] TNL: Loaded 30721 existing records from primary storage. [2025-09-16T20:44:04.962224] [INFO ] [MAIN ] TNL: Loaded 30721 existing records. [2025-09-16T20:44:05.179958] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-08. [2025-09-16T20:44:05.320632] [WARN ] [MAIN ] TNL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:44:05.366778] [INFO ] [MAIN ] TNL: Wiping existing primary data before full refresh. [2025-09-16T20:44:05.383251] [INFO ] [LOCAL ] TNL: Starting deletion of primary data. [2025-09-16T20:44:05.386258] [INFO ] [REMOTE ] TOL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:44:05.387248] [DEBUG] [LOCAL ] TNL: Deleted primary data file. [2025-09-16T20:44:05.387306] [INFO ] [MAIN ] TNL: Starting full primary refresh. [2025-09-16T20:44:05.750426] [INFO ] [REMOTE ] TNL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:44:05.983441] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-02. [2025-09-16T20:44:05.988354] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-16T20:44:06.236826] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-16T20:44:06.774899] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-06. [2025-09-16T20:44:07.459453] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-16T20:44:07.574921] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-09. [2025-09-16T20:44:08.019409] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-16T20:44:08.374900] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-03. [2025-09-16T20:44:08.479967] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-16T20:44:08.482043] [INFO ] [REMOTE ] TNC: Full fetch complete (17501 records). [2025-09-16T20:44:08.482167] [DEBUG] [VALIDATOR ] TNC: Validating primary data. [2025-09-16T20:44:08.882381] [DEBUG] [VALIDATOR ] TNC: All expected trading days are present. [2025-09-16T20:44:08.882464] [DEBUG] [VALIDATOR ] TNC: Primary data validation passed. [2025-09-16T20:44:08.882968] [INFO ] [MAIN ] TNC: Fetched primary data is valid. [2025-09-16T20:44:08.883035] [DEBUG] [LOCAL ] TNC: Saving primary data. [2025-09-16T20:44:08.883674] [DEBUG] [LOCAL ] TNC: Trimmed 17501 records to 10537 (keeping 150 days of data) [2025-09-16T20:44:08.952925] [DEBUG] [LOCAL ] TNC: Primary data saved (10537 records). [2025-09-16T20:44:08.953068] [INFO ] [MAIN ] TNC: Full history saved. [2025-09-16T20:44:08.953204] [INFO ] [MAIN ] Update Progress: 2109/2369 symbols completed. TNC took 31.4s. Estimated remaining: 27m 38s. Rate: 9.4 symbols/min [2025-09-16T20:44:09.128865] [INFO ] [MAIN ] TOST: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:44:09.173343] [DEBUG] [LOCAL ] TOST: Loaded 39651 existing records from primary storage. [2025-09-16T20:44:09.173511] [INFO ] [MAIN ] TOST: Loaded 39651 existing records. [2025-09-16T20:44:09.185015] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-02. [2025-09-16T20:44:09.363989] [WARN ] [MAIN ] TOST: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:44:09.364237] [INFO ] [MAIN ] TOST: Wiping existing primary data before full refresh. [2025-09-16T20:44:09.364283] [INFO ] [LOCAL ] TOST: Starting deletion of primary data. [2025-09-16T20:44:09.364979] [DEBUG] [LOCAL ] TOST: Deleted primary data file. [2025-09-16T20:44:09.365033] [INFO ] [MAIN ] TOST: Starting full primary refresh. [2025-09-16T20:44:09.714967] [INFO ] [REMOTE ] TOST: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:44:09.974895] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-02. [2025-09-16T20:44:09.980184] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-16T20:44:10.774954] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-07. [2025-09-16T20:44:11.080752] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-16T20:44:11.567888] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-16T20:44:11.577818] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-04. [2025-09-16T20:44:12.243308] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-16T20:44:12.374915] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-03. [2025-09-16T20:44:13.174929] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-08. [2025-09-16T20:44:13.333959] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-16T20:44:13.974926] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-05. [2025-09-16T20:44:14.161729] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-16T20:44:14.650730] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-16T20:44:14.774901] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-04. [2025-09-16T20:44:15.574874] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-09. [2025-09-16T20:44:15.673899] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-16T20:44:16.374900] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-03. [2025-09-16T20:44:16.795616] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-16T20:44:16.862789] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-16T20:44:16.867319] [INFO ] [REMOTE ] TNK: Full fetch complete (32802 records). [2025-09-16T20:44:16.867405] [DEBUG] [VALIDATOR ] TNK: Validating primary data. [2025-09-16T20:44:17.054439] [WARN ] [VALIDATOR ] TNK: Validation failed - insufficient historical data. Have 129 unique days, need 150 days [2025-09-16T20:44:17.054868] [FATAL] [MAIN ] TNK: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:44:17.054940] [WARN ] [MAIN ] TNK: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:44:17.055001] [INFO ] [LOCAL ] TNK: Starting deletion of primary data. [2025-09-16T20:44:17.055071] [DEBUG] [LOCAL ] TNK: No primary data file found to delete. [2025-09-16T20:44:17.055108] [INFO ] [LOCAL ] TNK: Starting deletion of derivative data. [2025-09-16T20:44:17.055324] [DEBUG] [LOCAL ] TNK: Deleted derivative data file. [2025-09-16T20:44:17.055406] [INFO ] [MAIN ] Update Progress: 2110/2369 symbols completed. TNK took 24.7s. Estimated remaining: 27m 31s. Rate: 9.4 symbols/min [2025-09-16T20:44:17.179994] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-06. [2025-09-16T20:44:17.225481] [INFO ] [MAIN ] TPB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:44:17.246402] [DEBUG] [LOCAL ] TPB: Loaded 18881 existing records from primary storage. [2025-09-16T20:44:17.246527] [INFO ] [MAIN ] TPB: Loaded 18881 existing records. [2025-09-16T20:44:17.427934] [WARN ] [MAIN ] TPB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:44:17.428202] [INFO ] [MAIN ] TPB: Wiping existing primary data before full refresh. [2025-09-16T20:44:17.428252] [INFO ] [LOCAL ] TPB: Starting deletion of primary data. [2025-09-16T20:44:17.428787] [DEBUG] [LOCAL ] TPB: Deleted primary data file. [2025-09-16T20:44:17.428842] [INFO ] [MAIN ] TPB: Starting full primary refresh. [2025-09-16T20:44:17.803958] [INFO ] [REMOTE ] TPB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:44:17.975133] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-02. [2025-09-16T20:44:18.491710] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-16T20:44:18.775051] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-05. [2025-09-16T20:44:18.815439] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-16T20:44:18.887860] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-16T20:44:19.574909] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-07. [2025-09-16T20:44:20.374922] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-04. [2025-09-16T20:44:20.905905] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-16T20:44:21.165602] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-16T20:44:21.174951] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-08. [2025-09-16T20:44:21.974890] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-03. [2025-09-16T20:44:22.021689] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-16T20:44:22.774889] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-05. [2025-09-16T20:44:22.876985] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-16T20:44:22.928038] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-16T20:44:23.574920] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-09. [2025-09-16T20:44:24.374895] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-04. [2025-09-16T20:44:24.747140] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-16T20:44:25.090232] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-16T20:44:25.095237] [INFO ] [REMOTE ] TNL: Full fetch complete (45685 records). [2025-09-16T20:44:25.095360] [DEBUG] [VALIDATOR ] TNL: Validating primary data. [2025-09-16T20:44:25.179978] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-06. [2025-09-16T20:44:25.477383] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-16T20:44:25.505386] [DEBUG] [VALIDATOR ] TNL: All expected trading days are present. [2025-09-16T20:44:25.505513] [DEBUG] [VALIDATOR ] TNL: Primary data validation passed. [2025-09-16T20:44:25.507026] [INFO ] [MAIN ] TNL: Fetched primary data is valid. [2025-09-16T20:44:25.507083] [DEBUG] [LOCAL ] TNL: Saving primary data. [2025-09-16T20:44:25.508673] [DEBUG] [LOCAL ] TNL: Trimmed 45685 records to 30982 (keeping 150 days of data) [2025-09-16T20:44:25.713831] [DEBUG] [LOCAL ] TNL: Primary data saved (30982 records). [2025-09-16T20:44:25.714047] [INFO ] [MAIN ] TNL: Full history saved. [2025-09-16T20:44:25.714141] [INFO ] [MAIN ] Update Progress: 2111/2369 symbols completed. TNL took 21.4s. Estimated remaining: 27m 25s. Rate: 9.4 symbols/min [2025-09-16T20:44:25.885269] [INFO ] [MAIN ] TPC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:44:25.913067] [DEBUG] [LOCAL ] TPC: Loaded 29194 existing records from primary storage. [2025-09-16T20:44:25.913263] [INFO ] [MAIN ] TPC: Loaded 29194 existing records. [2025-09-16T20:44:25.984383] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-06. [2025-09-16T20:44:26.114744] [WARN ] [MAIN ] TPC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:44:26.115086] [INFO ] [MAIN ] TPC: Wiping existing primary data before full refresh. [2025-09-16T20:44:26.115146] [INFO ] [LOCAL ] TPC: Starting deletion of primary data. [2025-09-16T20:44:26.115964] [DEBUG] [LOCAL ] TPC: Deleted primary data file. [2025-09-16T20:44:26.116038] [INFO ] [MAIN ] TPC: Starting full primary refresh. [2025-09-16T20:44:26.476973] [INFO ] [REMOTE ] TPC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:44:26.774910] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-02. [2025-09-16T20:44:27.232317] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-16T20:44:27.519884] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-16T20:44:27.574919] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-07. [2025-09-16T20:44:28.188958] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-16T20:44:28.374941] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-03. [2025-09-16T20:44:29.174933] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-07. [2025-09-16T20:44:29.336976] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-16T20:44:29.678357] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-16T20:44:29.974917] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-05. [2025-09-16T20:44:30.774929] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-08. [2025-09-16T20:44:30.817760] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-16T20:44:30.851952] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-16T20:44:31.574942] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-04. [2025-09-16T20:44:32.374957] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-08. [2025-09-16T20:44:32.651440] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-16T20:44:32.726087] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-16T20:44:33.174902] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-06. [2025-09-16T20:44:33.974974] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-09. [2025-09-16T20:44:34.147208] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-16T20:44:34.395143] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-16T20:44:34.774912] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-05. [2025-09-16T20:44:35.574928] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-09. [2025-09-16T20:44:35.799661] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-16T20:44:35.805897] [INFO ] [REMOTE ] TOST: Full fetch complete (58360 records). [2025-09-16T20:44:35.805995] [DEBUG] [VALIDATOR ] TOST: Validating primary data. [2025-09-16T20:44:36.183993] [DEBUG] [VALIDATOR ] TOST: All expected trading days are present. [2025-09-16T20:44:36.184077] [DEBUG] [VALIDATOR ] TOST: Primary data validation passed. [2025-09-16T20:44:36.185053] [INFO ] [MAIN ] TOST: Fetched primary data is valid. [2025-09-16T20:44:36.185100] [DEBUG] [LOCAL ] TOST: Saving primary data. [2025-09-16T20:44:36.186333] [DEBUG] [LOCAL ] TOST: Trimmed 58360 records to 40041 (keeping 150 days of data) [2025-09-16T20:44:36.326041] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-16T20:44:36.335267] [INFO ] [REMOTE ] TOL: Full fetch complete (55342 records). [2025-09-16T20:44:36.335419] [DEBUG] [VALIDATOR ] TOL: Validating primary data. [2025-09-16T20:44:36.385692] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-07. [2025-09-16T20:44:36.336156] [FATAL] [VALIDATOR ] TOL: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T20:44:36.396195] [FATAL] [MAIN ] TOL: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:44:36.438318] [WARN ] [MAIN ] TOL: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:44:36.439319] [INFO ] [LOCAL ] TOL: Starting deletion of primary data. [2025-09-16T20:44:36.440335] [DEBUG] [LOCAL ] TOL: No primary data file found to delete. [2025-09-16T20:44:36.440747] [INFO ] [LOCAL ] TOL: Starting deletion of derivative data. [2025-09-16T20:44:36.441655] [DEBUG] [LOCAL ] TOL: No derivative data file found to delete. [2025-09-16T20:44:36.442109] [INFO ] [MAIN ] Update Progress: 2112/2369 symbols completed. TOL took 31.8s. Estimated remaining: 27m 20s. Rate: 9.4 symbols/min [2025-09-16T20:44:36.540683] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-16T20:44:36.664557] [INFO ] [MAIN ] TPH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:44:36.676364] [DEBUG] [LOCAL ] TOST: Primary data saved (40041 records). [2025-09-16T20:44:36.676514] [INFO ] [MAIN ] TOST: Full history saved. [2025-09-16T20:44:36.676616] [INFO ] [MAIN ] Update Progress: 2113/2369 symbols completed. TOST took 27.7s. Estimated remaining: 27m 12s. Rate: 9.4 symbols/min [2025-09-16T20:44:36.881178] [INFO ] [MAIN ] TPL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:44:36.881969] [DEBUG] [LOCAL ] TPH: Loaded 33185 existing records from primary storage. [2025-09-16T20:44:36.882353] [INFO ] [MAIN ] TPH: Loaded 33185 existing records. [2025-09-16T20:44:37.008917] [DEBUG] [LOCAL ] TPL: Loaded 9157 existing records from primary storage. [2025-09-16T20:44:37.019313] [INFO ] [MAIN ] TPL: Loaded 9157 existing records. [2025-09-16T20:44:37.155164] [WARN ] [MAIN ] TPH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:44:37.189754] [INFO ] [MAIN ] TPH: Wiping existing primary data before full refresh. [2025-09-16T20:44:37.186010] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-06. [2025-09-16T20:44:37.189891] [INFO ] [LOCAL ] TPH: Starting deletion of primary data. [2025-09-16T20:44:37.212619] [DEBUG] [LOCAL ] TPH: Deleted primary data file. [2025-09-16T20:44:37.272027] [INFO ] [MAIN ] TPH: Starting full primary refresh. [2025-09-16T20:44:37.271956] [WARN ] [MAIN ] TPL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:44:37.277463] [INFO ] [MAIN ] TPL: Wiping existing primary data before full refresh. [2025-09-16T20:44:37.310081] [INFO ] [LOCAL ] TPL: Starting deletion of primary data. [2025-09-16T20:44:37.372851] [DEBUG] [LOCAL ] TPL: Deleted primary data file. [2025-09-16T20:44:37.397327] [INFO ] [MAIN ] TPL: Starting full primary refresh. [2025-09-16T20:44:37.928478] [INFO ] [REMOTE ] TPH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:44:37.975872] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-02. [2025-09-16T20:44:38.050054] [INFO ] [REMOTE ] TPL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:44:38.067962] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-16T20:44:38.401257] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-16T20:44:38.774947] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-08. [2025-09-16T20:44:39.574905] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-07. [2025-09-16T20:44:39.608626] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-16T20:44:39.694581] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-16T20:44:40.374917] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-02. [2025-09-16T20:44:40.877880] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-16T20:44:41.174919] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-08. [2025-09-16T20:44:41.280383] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-16T20:44:41.974940] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-03. [2025-09-16T20:44:42.774887] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-09. [2025-09-16T20:44:42.806581] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-16T20:44:43.574947] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-03. [2025-09-16T20:44:43.590480] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-16T20:44:43.593798] [INFO ] [REMOTE ] TPB: Full fetch complete (26583 records). [2025-09-16T20:44:43.593871] [DEBUG] [VALIDATOR ] TPB: Validating primary data. [2025-09-16T20:44:43.911597] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-16T20:44:44.015210] [DEBUG] [VALIDATOR ] TPB: All expected trading days are present. [2025-09-16T20:44:44.015285] [DEBUG] [VALIDATOR ] TPB: Primary data validation passed. [2025-09-16T20:44:44.016070] [INFO ] [MAIN ] TPB: Fetched primary data is valid. [2025-09-16T20:44:44.016113] [DEBUG] [LOCAL ] TPB: Saving primary data. [2025-09-16T20:44:44.016800] [DEBUG] [LOCAL ] TPB: Trimmed 26583 records to 19048 (keeping 150 days of data) [2025-09-16T20:44:44.136706] [DEBUG] [LOCAL ] TPB: Primary data saved (19048 records). [2025-09-16T20:44:44.136844] [INFO ] [MAIN ] TPB: Full history saved. [2025-09-16T20:44:44.136928] [INFO ] [MAIN ] Update Progress: 2114/2369 symbols completed. TPB took 27.1s. Estimated remaining: 27m 6s. Rate: 9.4 symbols/min [2025-09-16T20:44:44.315898] [INFO ] [MAIN ] TPR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:44:44.354912] [DEBUG] [LOCAL ] TPR: Loaded 39482 existing records from primary storage. [2025-09-16T20:44:44.355064] [INFO ] [MAIN ] TPR: Loaded 39482 existing records. [2025-09-16T20:44:44.386416] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-04. [2025-09-16T20:44:44.535807] [WARN ] [MAIN ] TPR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:44:44.536034] [INFO ] [MAIN ] TPR: Wiping existing primary data before full refresh. [2025-09-16T20:44:44.536080] [INFO ] [LOCAL ] TPR: Starting deletion of primary data. [2025-09-16T20:44:44.536921] [DEBUG] [LOCAL ] TPR: Deleted primary data file. [2025-09-16T20:44:44.536969] [INFO ] [MAIN ] TPR: Starting full primary refresh. [2025-09-16T20:44:44.835358] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-16T20:44:44.912034] [INFO ] [REMOTE ] TPR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:44:45.174900] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-02. [2025-09-16T20:44:45.974876] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-04. [2025-09-16T20:44:46.290263] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-16T20:44:46.774900] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-09. [2025-09-16T20:44:47.131353] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-16T20:44:47.134338] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-16T20:44:47.574941] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-03. [2025-09-16T20:44:48.112543] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-16T20:44:48.117790] [INFO ] [REMOTE ] TPC: Full fetch complete (41948 records). [2025-09-16T20:44:48.117929] [DEBUG] [VALIDATOR ] TPC: Validating primary data. [2025-09-16T20:44:48.380127] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-05. [2025-09-16T20:44:48.499004] [DEBUG] [VALIDATOR ] TPC: All expected trading days are present. [2025-09-16T20:44:48.499093] [DEBUG] [VALIDATOR ] TPC: Primary data validation passed. [2025-09-16T20:44:48.500096] [INFO ] [MAIN ] TPC: Fetched primary data is valid. [2025-09-16T20:44:48.500150] [DEBUG] [LOCAL ] TPC: Saving primary data. [2025-09-16T20:44:48.501318] [DEBUG] [LOCAL ] TPC: Trimmed 41948 records to 29430 (keeping 150 days of data) [2025-09-16T20:44:48.680715] [DEBUG] [LOCAL ] TPC: Primary data saved (29430 records). [2025-09-16T20:44:48.680897] [INFO ] [MAIN ] TPC: Full history saved. [2025-09-16T20:44:48.680986] [INFO ] [MAIN ] Update Progress: 2115/2369 symbols completed. TPC took 23.0s. Estimated remaining: 26m 60s. Rate: 9.4 symbols/min [2025-09-16T20:44:48.851066] [INFO ] [MAIN ] TPVG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:44:48.871180] [DEBUG] [LOCAL ] TPVG: Loaded 18877 existing records from primary storage. [2025-09-16T20:44:48.871354] [INFO ] [MAIN ] TPVG: Loaded 18877 existing records. [2025-09-16T20:44:49.050399] [WARN ] [MAIN ] TPVG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:44:49.050680] [INFO ] [MAIN ] TPVG: Wiping existing primary data before full refresh. [2025-09-16T20:44:49.050728] [INFO ] [LOCAL ] TPVG: Starting deletion of primary data. [2025-09-16T20:44:49.051192] [DEBUG] [LOCAL ] TPVG: Deleted primary data file. [2025-09-16T20:44:49.051237] [INFO ] [MAIN ] TPVG: Starting full primary refresh. [2025-09-16T20:44:49.180070] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-05. [2025-09-16T20:44:49.418922] [INFO ] [REMOTE ] TPVG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:44:49.432176] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-16T20:44:49.472824] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-16T20:44:49.974954] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-06. [2025-09-16T20:44:50.775002] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-04. [2025-09-16T20:44:50.971291] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-16T20:44:51.023410] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-16T20:44:51.574924] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-07. [2025-09-16T20:44:52.374920] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-06. [2025-09-16T20:44:52.706303] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-16T20:44:52.747708] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-16T20:44:53.174904] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-05. [2025-09-16T20:44:53.623023] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-16T20:44:53.974955] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-08. [2025-09-16T20:44:54.774914] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-07. [2025-09-16T20:44:55.135095] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-16T20:44:55.223249] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-16T20:44:55.574933] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-02. [2025-09-16T20:44:56.374887] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-06. [2025-09-16T20:44:56.545279] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-16T20:44:56.572316] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-16T20:44:57.174917] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-08. [2025-09-16T20:44:57.974886] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-03. [2025-09-16T20:44:58.034503] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-16T20:44:58.774921] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-07. [2025-09-16T20:44:58.923269] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-16T20:44:59.103021] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-16T20:44:59.574949] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-04. [2025-09-16T20:45:00.374889] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-09. [2025-09-16T20:45:00.781613] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-16T20:45:00.868119] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-16T20:45:00.869844] [INFO ] [REMOTE ] TPL: Full fetch complete (13331 records). [2025-09-16T20:45:00.869912] [DEBUG] [VALIDATOR ] TPL: Validating primary data. [2025-09-16T20:45:00.870313] [FATAL] [VALIDATOR ] TPL: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T20:45:00.870445] [FATAL] [MAIN ] TPL: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:45:00.870488] [WARN ] [MAIN ] TPL: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:45:00.870527] [INFO ] [LOCAL ] TPL: Starting deletion of primary data. [2025-09-16T20:45:00.870583] [DEBUG] [LOCAL ] TPL: No primary data file found to delete. [2025-09-16T20:45:00.870620] [INFO ] [LOCAL ] TPL: Starting deletion of derivative data. [2025-09-16T20:45:00.871045] [DEBUG] [LOCAL ] TPL: Deleted derivative data file. [2025-09-16T20:45:00.871125] [INFO ] [MAIN ] Update Progress: 2116/2369 symbols completed. TPL took 24.2s. Estimated remaining: 26m 54s. Rate: 9.4 symbols/min [2025-09-16T20:45:01.044984] [INFO ] [MAIN ] TPYP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:45:01.066469] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-16T20:45:01.077055] [DEBUG] [LOCAL ] TPYP: Loaded 5781 existing records from primary storage. [2025-09-16T20:45:01.077194] [INFO ] [MAIN ] TPYP: Loaded 5781 existing records. [2025-09-16T20:45:01.182439] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-09. [2025-09-16T20:45:01.267544] [WARN ] [MAIN ] TPYP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:45:01.267839] [INFO ] [MAIN ] TPYP: Wiping existing primary data before full refresh. [2025-09-16T20:45:01.267887] [INFO ] [LOCAL ] TPYP: Starting deletion of primary data. [2025-09-16T20:45:01.268208] [DEBUG] [LOCAL ] TPYP: Deleted primary data file. [2025-09-16T20:45:01.268259] [INFO ] [MAIN ] TPYP: Starting full primary refresh. [2025-09-16T20:45:01.639084] [INFO ] [REMOTE ] TPYP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:45:01.974923] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-02. [2025-09-16T20:45:02.774915] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-08. [2025-09-16T20:45:03.461985] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-16T20:45:03.467692] [INFO ] [REMOTE ] TPH: Full fetch complete (49528 records). [2025-09-16T20:45:03.467853] [DEBUG] [VALIDATOR ] TPH: Validating primary data. [2025-09-16T20:45:03.580209] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-05. [2025-09-16T20:45:03.854509] [DEBUG] [VALIDATOR ] TPH: All expected trading days are present. [2025-09-16T20:45:03.854588] [DEBUG] [VALIDATOR ] TPH: Primary data validation passed. [2025-09-16T20:45:03.855491] [INFO ] [MAIN ] TPH: Fetched primary data is valid. [2025-09-16T20:45:03.855538] [DEBUG] [LOCAL ] TPH: Saving primary data. [2025-09-16T20:45:03.856629] [DEBUG] [LOCAL ] TPH: Trimmed 49528 records to 33501 (keeping 150 days of data) [2025-09-16T20:45:04.050562] [DEBUG] [LOCAL ] TPH: Primary data saved (33501 records). [2025-09-16T20:45:04.050730] [INFO ] [MAIN ] TPH: Full history saved. [2025-09-16T20:45:04.051423] [INFO ] [MAIN ] Update Progress: 2117/2369 symbols completed. TPH took 27.6s. Estimated remaining: 26m 47s. Rate: 9.4 symbols/min [2025-09-16T20:45:05.247702] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-02 (3.27 seconds). [2025-09-16T20:45:05.250429] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-03. [2025-09-16T20:45:05.887632] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-09-16T20:45:05.894015] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-06. [2025-09-16T20:45:06.097077] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-08 (3.32 seconds). [2025-09-16T20:45:06.108836] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-09. [2025-09-16T20:45:06.167066] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-16T20:45:06.774978] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-04. [2025-09-16T20:45:07.226243] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-16T20:45:07.385070] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-16T20:45:07.574993] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-07. [2025-09-16T20:45:07.788160] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-16T20:45:07.795195] [INFO ] [REMOTE ] TPR: Full fetch complete (58158 records). [2025-09-16T20:45:07.795414] [DEBUG] [VALIDATOR ] TPR: Validating primary data. [2025-09-16T20:45:08.199184] [DEBUG] [VALIDATOR ] TPR: All expected trading days are present. [2025-09-16T20:45:08.199289] [DEBUG] [VALIDATOR ] TPR: Primary data validation passed. [2025-09-16T20:45:08.200995] [INFO ] [MAIN ] TPR: Fetched primary data is valid. [2025-09-16T20:45:08.201058] [DEBUG] [LOCAL ] TPR: Saving primary data. [2025-09-16T20:45:08.202743] [DEBUG] [LOCAL ] TPR: Trimmed 58158 records to 39870 (keeping 150 days of data) [2025-09-16T20:45:08.407787] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-05. [2025-09-16T20:45:08.491684] [DEBUG] [LOCAL ] TPR: Primary data saved (39870 records). [2025-09-16T20:45:08.491936] [INFO ] [MAIN ] TPR: Full history saved. [2025-09-16T20:45:08.492107] [INFO ] [MAIN ] Update Progress: 2118/2369 symbols completed. TPR took 24.4s. Estimated remaining: 26m 40s. Rate: 9.4 symbols/min [2025-09-16T20:45:08.950215] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-16T20:45:09.166720] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-16T20:45:09.174840] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-06. [2025-09-16T20:45:09.799041] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-16T20:45:09.974940] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-07. [2025-09-16T20:45:10.774893] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-08. [2025-09-16T20:45:10.857921] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-16T20:45:11.575030] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-08. [2025-09-16T20:45:12.713523] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-16T20:45:12.720608] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-09. [2025-09-16T20:45:13.145170] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-16T20:45:13.174956] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-09. [2025-09-16T20:45:13.898370] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-16T20:45:13.900059] [INFO ] [REMOTE ] TPYP: Full fetch complete (8856 records). [2025-09-16T20:45:13.900137] [DEBUG] [VALIDATOR ] TPYP: Validating primary data. [2025-09-16T20:45:14.295402] [DEBUG] [VALIDATOR ] TPYP: All expected trading days are present. [2025-09-16T20:45:14.295514] [DEBUG] [VALIDATOR ] TPYP: Primary data validation passed. [2025-09-16T20:45:14.295941] [INFO ] [MAIN ] TPYP: Fetched primary data is valid. [2025-09-16T20:45:14.295989] [DEBUG] [LOCAL ] TPYP: Saving primary data. [2025-09-16T20:45:14.296496] [DEBUG] [LOCAL ] TPYP: Trimmed 8856 records to 5830 (keeping 150 days of data) [2025-09-16T20:45:14.334864] [DEBUG] [LOCAL ] TPYP: Primary data saved (5830 records). [2025-09-16T20:45:14.335071] [INFO ] [MAIN ] TPYP: Full history saved. [2025-09-16T20:45:14.335206] [INFO ] [MAIN ] Update Progress: 2119/2369 symbols completed. TPYP took 13.5s. Estimated remaining: 26m 34s. Rate: 9.4 symbols/min [2025-09-16T20:45:14.346385] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-16T20:45:14.350435] [INFO ] [REMOTE ] TPVG: Full fetch complete (29111 records). [2025-09-16T20:45:14.350527] [DEBUG] [VALIDATOR ] TPVG: Validating primary data. [2025-09-16T20:45:14.716147] [DEBUG] [VALIDATOR ] TPVG: All expected trading days are present. [2025-09-16T20:45:14.716232] [DEBUG] [VALIDATOR ] TPVG: Primary data validation passed. [2025-09-16T20:45:14.716857] [INFO ] [MAIN ] TPVG: Fetched primary data is valid. [2025-09-16T20:45:14.716902] [DEBUG] [LOCAL ] TPVG: Saving primary data. [2025-09-16T20:45:14.717607] [DEBUG] [LOCAL ] TPVG: Trimmed 29111 records to 19127 (keeping 150 days of data) [2025-09-16T20:45:14.829760] [DEBUG] [LOCAL ] TPVG: Primary data saved (19127 records). [2025-09-16T20:45:14.829917] [INFO ] [MAIN ] TPVG: Full history saved. [2025-09-16T20:45:14.830015] [INFO ] [MAIN ] Update Progress: 2120/2369 symbols completed. TPVG took 26.1s. Estimated remaining: 26m 27s. Rate: 9.4 symbols/min [2025-09-16T20:45:15.540949] [INFO ] [MAIN ] TRC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:45:15.575819] [INFO ] [MAIN ] TRAK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:45:15.639286] [INFO ] [MAIN ] TPZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:45:15.636370] [INFO ] [MAIN ] TR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:45:15.656944] [DEBUG] [LOCAL ] TPZ: Loaded 3245 existing records from primary storage. [2025-09-16T20:45:15.661253] [INFO ] [MAIN ] TPZ: Loaded 3245 existing records. [2025-09-16T20:45:15.744948] [DEBUG] [LOCAL ] TRAK: Loaded 6686 existing records from primary storage. [2025-09-16T20:45:15.744797] [DEBUG] [LOCAL ] TRC: Loaded 11356 existing records from primary storage. [2025-09-16T20:45:15.771145] [INFO ] [MAIN ] TRC: Loaded 11356 existing records. [2025-09-16T20:45:15.790891] [INFO ] [MAIN ] TRAK: Loaded 6686 existing records. [2025-09-16T20:45:15.777030] [DEBUG] [LOCAL ] TR: Loaded 14670 existing records from primary storage. [2025-09-16T20:45:15.857347] [INFO ] [MAIN ] TR: Loaded 14670 existing records. [2025-09-16T20:45:16.156483] [WARN ] [MAIN ] TPZ: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:45:16.331559] [INFO ] [MAIN ] TPZ: Wiping existing primary data before full refresh. [2025-09-16T20:45:16.342356] [WARN ] [MAIN ] TRAK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:45:16.402959] [INFO ] [MAIN ] TRAK: Wiping existing primary data before full refresh. [2025-09-16T20:45:16.367401] [INFO ] [LOCAL ] TPZ: Starting deletion of primary data. [2025-09-16T20:45:16.402860] [WARN ] [MAIN ] TRC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:45:16.408690] [INFO ] [LOCAL ] TRAK: Starting deletion of primary data. [2025-09-16T20:45:16.424571] [DEBUG] [LOCAL ] TPZ: Deleted primary data file. [2025-09-16T20:45:16.414136] [INFO ] [MAIN ] TRC: Wiping existing primary data before full refresh. [2025-09-16T20:45:16.429774] [DEBUG] [LOCAL ] TRAK: Deleted primary data file. [2025-09-16T20:45:16.480948] [INFO ] [LOCAL ] TRC: Starting deletion of primary data. [2025-09-16T20:45:16.462451] [INFO ] [MAIN ] TPZ: Starting full primary refresh. [2025-09-16T20:45:16.462600] [INFO ] [MAIN ] TRAK: Starting full primary refresh. [2025-09-16T20:45:16.486480] [WARN ] [MAIN ] TR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:45:16.498429] [DEBUG] [LOCAL ] TRC: Deleted primary data file. [2025-09-16T20:45:16.525321] [INFO ] [MAIN ] TR: Wiping existing primary data before full refresh. [2025-09-16T20:45:16.525481] [INFO ] [LOCAL ] TR: Starting deletion of primary data. [2025-09-16T20:45:16.550369] [INFO ] [MAIN ] TRC: Starting full primary refresh. [2025-09-16T20:45:16.577302] [DEBUG] [LOCAL ] TR: Deleted primary data file. [2025-09-16T20:45:16.695456] [INFO ] [MAIN ] TR: Starting full primary refresh. [2025-09-16T20:45:17.609136] [INFO ] [REMOTE ] TRAK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:45:17.643439] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-02. [2025-09-16T20:45:17.946836] [INFO ] [REMOTE ] TPZ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:45:17.988383] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-02. [2025-09-16T20:45:18.012068] [INFO ] [REMOTE ] TRC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:45:18.008956] [INFO ] [REMOTE ] TR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:45:18.013525] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-02. [2025-09-16T20:45:18.013766] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-02. [2025-09-16T20:45:18.650470] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-16T20:45:18.652618] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-03. [2025-09-16T20:45:18.993174] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-16T20:45:18.995263] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-03. [2025-09-16T20:45:19.028228] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-16T20:45:19.031441] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-03. [2025-09-16T20:45:19.116250] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-16T20:45:19.412063] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-16T20:45:19.519148] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-16T20:45:19.574846] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-04. [2025-09-16T20:45:20.024018] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-16T20:45:20.364320] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-16T20:45:20.374844] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-05. [2025-09-16T20:45:21.043142] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-16T20:45:21.174908] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-03. [2025-09-16T20:45:21.974886] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-04. [2025-09-16T20:45:21.988255] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-16T20:45:22.774933] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-04. [2025-09-16T20:45:23.206759] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-16T20:45:23.522974] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-16T20:45:23.574904] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-05. [2025-09-16T20:45:24.093099] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-16T20:45:24.374926] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-06. [2025-09-16T20:45:25.065593] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-16T20:45:25.174863] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-04. [2025-09-16T20:45:25.974847] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-06. [2025-09-16T20:45:26.229057] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-16T20:45:26.521070] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-16T20:45:26.774843] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-07. [2025-09-16T20:45:27.574972] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-05. [2025-09-16T20:45:27.675405] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-16T20:45:28.374935] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-08. [2025-09-16T20:45:28.785209] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-16T20:45:29.174928] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-05. [2025-09-16T20:45:29.222747] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-16T20:45:29.974947] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-06. [2025-09-16T20:45:30.074098] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-16T20:45:30.774954] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-09. [2025-09-16T20:45:31.217675] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-16T20:45:31.433387] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-16T20:45:31.435232] [INFO ] [REMOTE ] TRAK: Full fetch complete (10149 records). [2025-09-16T20:45:31.435311] [DEBUG] [VALIDATOR ] TRAK: Validating primary data. [2025-09-16T20:45:31.583933] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-07. [2025-09-16T20:45:31.809805] [DEBUG] [VALIDATOR ] TRAK: All expected trading days are present. [2025-09-16T20:45:31.809916] [DEBUG] [VALIDATOR ] TRAK: Primary data validation passed. [2025-09-16T20:45:31.810221] [INFO ] [MAIN ] TRAK: Fetched primary data is valid. [2025-09-16T20:45:31.810275] [DEBUG] [LOCAL ] TRAK: Saving primary data. [2025-09-16T20:45:31.811141] [DEBUG] [LOCAL ] TRAK: Trimmed 10149 records to 6721 (keeping 150 days of data) [2025-09-16T20:45:31.854568] [DEBUG] [LOCAL ] TRAK: Primary data saved (6721 records). [2025-09-16T20:45:31.854747] [INFO ] [MAIN ] TRAK: Full history saved. [2025-09-16T20:45:31.854859] [INFO ] [MAIN ] Update Progress: 2121/2369 symbols completed. TRAK took 17.0s. Estimated remaining: 26m 22s. Rate: 9.4 symbols/min [2025-09-16T20:45:32.027547] [INFO ] [MAIN ] TREX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:45:32.062326] [DEBUG] [LOCAL ] TREX: Loaded 36482 existing records from primary storage. [2025-09-16T20:45:32.062505] [INFO ] [MAIN ] TREX: Loaded 36482 existing records. [2025-09-16T20:45:32.239947] [WARN ] [MAIN ] TREX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:45:32.240214] [INFO ] [MAIN ] TREX: Wiping existing primary data before full refresh. [2025-09-16T20:45:32.240261] [INFO ] [LOCAL ] TREX: Starting deletion of primary data. [2025-09-16T20:45:32.240978] [DEBUG] [LOCAL ] TREX: Deleted primary data file. [2025-09-16T20:45:32.241028] [INFO ] [MAIN ] TREX: Starting full primary refresh. [2025-09-16T20:45:32.387328] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-06. [2025-09-16T20:45:32.608021] [INFO ] [REMOTE ] TREX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:45:32.826367] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-16T20:45:33.174890] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-08. [2025-09-16T20:45:33.516065] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-16T20:45:33.974896] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-07. [2025-09-16T20:45:34.264601] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-16T20:45:34.774912] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-09. [2025-09-16T20:45:34.791979] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-16T20:45:35.574915] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-08. [2025-09-16T20:45:35.788611] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-16T20:45:35.791801] [INFO ] [REMOTE ] TR: Full fetch complete (19461 records). [2025-09-16T20:45:35.791901] [DEBUG] [VALIDATOR ] TR: Validating primary data. [2025-09-16T20:45:36.163279] [DEBUG] [VALIDATOR ] TR: All expected trading days are present. [2025-09-16T20:45:36.163363] [DEBUG] [VALIDATOR ] TR: Primary data validation passed. [2025-09-16T20:45:36.163869] [INFO ] [MAIN ] TR: Fetched primary data is valid. [2025-09-16T20:45:36.163946] [DEBUG] [LOCAL ] TR: Saving primary data. [2025-09-16T20:45:36.164507] [DEBUG] [LOCAL ] TR: Trimmed 19461 records to 14855 (keeping 150 days of data) [2025-09-16T20:45:36.261917] [DEBUG] [LOCAL ] TR: Primary data saved (14855 records). [2025-09-16T20:45:36.262100] [INFO ] [MAIN ] TR: Full history saved. [2025-09-16T20:45:36.262213] [INFO ] [MAIN ] Update Progress: 2122/2369 symbols completed. TR took 21.4s. Estimated remaining: 26m 15s. Rate: 9.4 symbols/min [2025-09-16T20:45:36.380105] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-07. [2025-09-16T20:45:36.440638] [INFO ] [MAIN ] TRGP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:45:36.481082] [DEBUG] [LOCAL ] TRGP: Loaded 37440 existing records from primary storage. [2025-09-16T20:45:36.481268] [INFO ] [MAIN ] TRGP: Loaded 37440 existing records. [2025-09-16T20:45:36.657510] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-16T20:45:36.680698] [WARN ] [MAIN ] TRGP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:45:36.681164] [INFO ] [MAIN ] TRGP: Wiping existing primary data before full refresh. [2025-09-16T20:45:36.681217] [INFO ] [LOCAL ] TRGP: Starting deletion of primary data. [2025-09-16T20:45:36.682328] [DEBUG] [LOCAL ] TRGP: Deleted primary data file. [2025-09-16T20:45:36.682379] [INFO ] [MAIN ] TRGP: Starting full primary refresh. [2025-09-16T20:45:37.029608] [INFO ] [REMOTE ] TRGP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:45:37.174970] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-09. [2025-09-16T20:45:37.231929] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-16T20:45:37.974920] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-08. [2025-09-16T20:45:38.057517] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-16T20:45:38.059582] [INFO ] [REMOTE ] TRC: Full fetch complete (17055 records). [2025-09-16T20:45:38.059726] [DEBUG] [VALIDATOR ] TRC: Validating primary data. [2025-09-16T20:45:38.423481] [DEBUG] [VALIDATOR ] TRC: All expected trading days are present. [2025-09-16T20:45:38.423559] [DEBUG] [VALIDATOR ] TRC: Primary data validation passed. [2025-09-16T20:45:38.423955] [INFO ] [MAIN ] TRC: Fetched primary data is valid. [2025-09-16T20:45:38.424001] [DEBUG] [LOCAL ] TRC: Saving primary data. [2025-09-16T20:45:38.424551] [DEBUG] [LOCAL ] TRC: Trimmed 17055 records to 11443 (keeping 150 days of data) [2025-09-16T20:45:38.494204] [DEBUG] [LOCAL ] TRC: Primary data saved (11443 records). [2025-09-16T20:45:38.494381] [INFO ] [MAIN ] TRC: Full history saved. [2025-09-16T20:45:38.494488] [INFO ] [MAIN ] Update Progress: 2123/2369 symbols completed. TRC took 23.7s. Estimated remaining: 26m 8s. Rate: 9.4 symbols/min [2025-09-16T20:45:38.610267] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-16T20:45:38.684191] [INFO ] [MAIN ] TRN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:45:38.712376] [DEBUG] [LOCAL ] TRN: Loaded 27293 existing records from primary storage. [2025-09-16T20:45:38.712561] [INFO ] [MAIN ] TRN: Loaded 27293 existing records. [2025-09-16T20:45:38.779979] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-02. [2025-09-16T20:45:38.901575] [WARN ] [MAIN ] TRN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:45:38.901849] [INFO ] [MAIN ] TRN: Wiping existing primary data before full refresh. [2025-09-16T20:45:38.901899] [INFO ] [LOCAL ] TRN: Starting deletion of primary data. [2025-09-16T20:45:38.902490] [DEBUG] [LOCAL ] TRN: Deleted primary data file. [2025-09-16T20:45:38.902539] [INFO ] [MAIN ] TRN: Starting full primary refresh. [2025-09-16T20:45:39.265205] [INFO ] [REMOTE ] TRN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:45:39.574945] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-09. [2025-09-16T20:45:40.139150] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-16T20:45:40.140432] [INFO ] [REMOTE ] TPZ: Full fetch complete (6053 records). [2025-09-16T20:45:40.140505] [DEBUG] [VALIDATOR ] TPZ: Validating primary data. [2025-09-16T20:45:40.387182] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-02. [2025-09-16T20:45:40.521103] [DEBUG] [VALIDATOR ] TPZ: All expected trading days are present. [2025-09-16T20:45:40.521275] [DEBUG] [VALIDATOR ] TPZ: Primary data validation passed. [2025-09-16T20:45:40.521495] [INFO ] [MAIN ] TPZ: Fetched primary data is valid. [2025-09-16T20:45:40.521565] [DEBUG] [LOCAL ] TPZ: Saving primary data. [2025-09-16T20:45:40.522067] [DEBUG] [LOCAL ] TPZ: Trimmed 6053 records to 3290 (keeping 150 days of data) [2025-09-16T20:45:40.565933] [DEBUG] [LOCAL ] TPZ: Primary data saved (3290 records). [2025-09-16T20:45:40.566062] [INFO ] [MAIN ] TPZ: Full history saved. [2025-09-16T20:45:40.566188] [INFO ] [MAIN ] Update Progress: 2124/2369 symbols completed. TPZ took 25.7s. Estimated remaining: 26m 2s. Rate: 9.4 symbols/min [2025-09-16T20:45:40.599276] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-16T20:45:40.744874] [INFO ] [MAIN ] TRNO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:45:40.779018] [DEBUG] [LOCAL ] TRNO: Loaded 32543 existing records from primary storage. [2025-09-16T20:45:40.779178] [INFO ] [MAIN ] TRNO: Loaded 32543 existing records. [2025-09-16T20:45:40.953984] [WARN ] [MAIN ] TRNO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:45:40.954240] [INFO ] [MAIN ] TRNO: Wiping existing primary data before full refresh. [2025-09-16T20:45:40.954286] [INFO ] [LOCAL ] TRNO: Starting deletion of primary data. [2025-09-16T20:45:40.955063] [DEBUG] [LOCAL ] TRNO: Deleted primary data file. [2025-09-16T20:45:40.955112] [INFO ] [MAIN ] TRNO: Starting full primary refresh. [2025-09-16T20:45:41.180995] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-03. [2025-09-16T20:45:41.306973] [INFO ] [REMOTE ] TRNO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:45:41.974881] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-02. [2025-09-16T20:45:42.315206] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-16T20:45:42.774902] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-03. [2025-09-16T20:45:43.107682] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-16T20:45:43.373782] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-16T20:45:43.574878] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-02. [2025-09-16T20:45:44.374882] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-04. [2025-09-16T20:45:44.525548] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-16T20:45:44.925240] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-16T20:45:45.174917] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-03. [2025-09-16T20:45:45.933942] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-16T20:45:45.974845] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-05. [2025-09-16T20:45:46.606355] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-16T20:45:46.774890] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-04. [2025-09-16T20:45:47.487444] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-16T20:45:47.574908] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-03. [2025-09-16T20:45:48.374967] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-04. [2025-09-16T20:45:48.793219] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-16T20:45:49.174901] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-06. [2025-09-16T20:45:49.255459] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-16T20:45:49.945760] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-16T20:45:49.974842] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-05. [2025-09-16T20:45:50.774900] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-05. [2025-09-16T20:45:50.903867] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-16T20:45:51.497341] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-16T20:45:51.574849] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-06. [2025-09-16T20:45:52.374943] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-04. [2025-09-16T20:45:52.541055] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-16T20:45:52.607709] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-16T20:45:53.174905] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-06. [2025-09-16T20:45:53.974908] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-07. [2025-09-16T20:45:54.144471] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-16T20:45:54.774895] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-05. [2025-09-16T20:45:55.066491] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-16T20:45:55.574880] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-07. [2025-09-16T20:45:55.645331] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-16T20:45:56.267583] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-16T20:45:56.374877] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-08. [2025-09-16T20:45:57.174915] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-07. [2025-09-16T20:45:57.468699] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-16T20:45:57.892593] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-16T20:45:57.974948] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-08. [2025-09-16T20:45:58.786504] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-09. [2025-09-16T20:45:58.791948] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-16T20:45:59.574940] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-08. [2025-09-16T20:45:59.830036] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-16T20:46:00.309322] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-16T20:46:00.315819] [INFO ] [REMOTE ] TRN: Full fetch complete (40888 records). [2025-09-16T20:46:00.315989] [DEBUG] [VALIDATOR ] TRN: Validating primary data. [2025-09-16T20:46:00.384682] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-06. [2025-09-16T20:46:00.729746] [DEBUG] [VALIDATOR ] TRN: All expected trading days are present. [2025-09-16T20:46:00.729854] [DEBUG] [VALIDATOR ] TRN: Primary data validation passed. [2025-09-16T20:46:00.730804] [INFO ] [MAIN ] TRN: Fetched primary data is valid. [2025-09-16T20:46:00.730855] [DEBUG] [LOCAL ] TRN: Saving primary data. [2025-09-16T20:46:00.732061] [DEBUG] [LOCAL ] TRN: Trimmed 40888 records to 27550 (keeping 150 days of data) [2025-09-16T20:46:00.908244] [DEBUG] [LOCAL ] TRN: Primary data saved (27550 records). [2025-09-16T20:46:00.908379] [INFO ] [MAIN ] TRN: Full history saved. [2025-09-16T20:46:00.908488] [INFO ] [MAIN ] Update Progress: 2125/2369 symbols completed. TRN took 22.4s. Estimated remaining: 25m 57s. Rate: 9.4 symbols/min [2025-09-16T20:46:01.086525] [INFO ] [MAIN ] TROX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:46:01.126169] [DEBUG] [LOCAL ] TROX: Loaded 38431 existing records from primary storage. [2025-09-16T20:46:01.126354] [INFO ] [MAIN ] TROX: Loaded 38431 existing records. [2025-09-16T20:46:01.182166] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-09. [2025-09-16T20:46:01.318275] [WARN ] [MAIN ] TROX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:46:01.318725] [INFO ] [MAIN ] TROX: Wiping existing primary data before full refresh. [2025-09-16T20:46:01.318842] [INFO ] [LOCAL ] TROX: Starting deletion of primary data. [2025-09-16T20:46:01.319574] [DEBUG] [LOCAL ] TROX: Deleted primary data file. [2025-09-16T20:46:01.319775] [INFO ] [MAIN ] TROX: Starting full primary refresh. [2025-09-16T20:46:01.705130] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-16T20:46:01.714825] [INFO ] [REMOTE ] TROX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:46:01.974904] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-09. [2025-09-16T20:46:02.174849] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-16T20:46:02.574823] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-16T20:46:02.580911] [INFO ] [REMOTE ] TREX: Full fetch complete (54202 records). [2025-09-16T20:46:02.581013] [DEBUG] [VALIDATOR ] TREX: Validating primary data. [2025-09-16T20:46:02.786512] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-07. [2025-09-16T20:46:03.003335] [DEBUG] [VALIDATOR ] TREX: All expected trading days are present. [2025-09-16T20:46:03.003460] [DEBUG] [VALIDATOR ] TREX: Primary data validation passed. [2025-09-16T20:46:03.018245] [INFO ] [MAIN ] TREX: Fetched primary data is valid. [2025-09-16T20:46:03.019275] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-16T20:46:03.018805] [DEBUG] [LOCAL ] TREX: Saving primary data. [2025-09-16T20:46:03.025396] [INFO ] [REMOTE ] TRGP: Full fetch complete (55005 records). [2025-09-16T20:46:03.025582] [DEBUG] [VALIDATOR ] TRGP: Validating primary data. [2025-09-16T20:46:03.025693] [DEBUG] [LOCAL ] TREX: Trimmed 54202 records to 36864 (keeping 150 days of data) [2025-09-16T20:46:03.026510] [FATAL] [VALIDATOR ] TRGP: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T20:46:03.026773] [FATAL] [MAIN ] TRGP: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:46:03.026839] [WARN ] [MAIN ] TRGP: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:46:03.026885] [INFO ] [LOCAL ] TRGP: Starting deletion of primary data. [2025-09-16T20:46:03.026932] [DEBUG] [LOCAL ] TRGP: No primary data file found to delete. [2025-09-16T20:46:03.026968] [INFO ] [LOCAL ] TRGP: Starting deletion of derivative data. [2025-09-16T20:46:03.027283] [DEBUG] [LOCAL ] TRGP: Deleted derivative data file. [2025-09-16T20:46:03.029318] [INFO ] [MAIN ] Update Progress: 2126/2369 symbols completed. TRGP took 26.8s. Estimated remaining: 25m 50s. Rate: 9.4 symbols/min [2025-09-16T20:46:03.294099] [INFO ] [MAIN ] TRP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:46:03.435316] [DEBUG] [LOCAL ] TRP: Loaded 38418 existing records from primary storage. [2025-09-16T20:46:03.436520] [INFO ] [MAIN ] TRP: Loaded 38418 existing records. [2025-09-16T20:46:03.590127] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-02. [2025-09-16T20:46:03.634861] [WARN ] [MAIN ] TRP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:46:03.636163] [INFO ] [MAIN ] TRP: Wiping existing primary data before full refresh. [2025-09-16T20:46:03.636971] [INFO ] [LOCAL ] TRP: Starting deletion of primary data. [2025-09-16T20:46:03.638325] [DEBUG] [LOCAL ] TRP: Deleted primary data file. [2025-09-16T20:46:03.639129] [INFO ] [MAIN ] TRP: Starting full primary refresh. [2025-09-16T20:46:03.648607] [DEBUG] [LOCAL ] TREX: Primary data saved (36864 records). [2025-09-16T20:46:03.708141] [INFO ] [MAIN ] TREX: Full history saved. [2025-09-16T20:46:03.748120] [INFO ] [MAIN ] Update Progress: 2127/2369 symbols completed. TREX took 31.9s. Estimated remaining: 25m 43s. Rate: 9.4 symbols/min [2025-09-16T20:46:04.124816] [INFO ] [MAIN ] TRTX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:46:04.212093] [INFO ] [REMOTE ] TRP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:46:04.232305] [DEBUG] [LOCAL ] TRTX: Loaded 26411 existing records from primary storage. [2025-09-16T20:46:04.232589] [INFO ] [MAIN ] TRTX: Loaded 26411 existing records. [2025-09-16T20:46:04.384197] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-02. [2025-09-16T20:46:04.437958] [WARN ] [MAIN ] TRTX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:46:04.440211] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-16T20:46:04.443861] [INFO ] [MAIN ] TRTX: Wiping existing primary data before full refresh. [2025-09-16T20:46:04.450488] [INFO ] [LOCAL ] TRTX: Starting deletion of primary data. [2025-09-16T20:46:04.451381] [DEBUG] [LOCAL ] TRTX: Deleted primary data file. [2025-09-16T20:46:04.451442] [INFO ] [MAIN ] TRTX: Starting full primary refresh. [2025-09-16T20:46:04.819482] [INFO ] [REMOTE ] TRTX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:46:05.174936] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-08. [2025-09-16T20:46:05.305072] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-16T20:46:05.974996] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-02. [2025-09-16T20:46:06.365364] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-16T20:46:06.537090] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-16T20:46:06.774908] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-09. [2025-09-16T20:46:07.471604] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-16T20:46:07.574931] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-03. [2025-09-16T20:46:08.173978] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-16T20:46:08.179913] [INFO ] [REMOTE ] TRNO: Full fetch complete (47928 records). [2025-09-16T20:46:08.180042] [DEBUG] [VALIDATOR ] TRNO: Validating primary data. [2025-09-16T20:46:08.386123] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-03. [2025-09-16T20:46:08.566276] [DEBUG] [VALIDATOR ] TRNO: All expected trading days are present. [2025-09-16T20:46:08.566364] [DEBUG] [VALIDATOR ] TRNO: Primary data validation passed. [2025-09-16T20:46:08.567380] [INFO ] [MAIN ] TRNO: Fetched primary data is valid. [2025-09-16T20:46:08.567450] [DEBUG] [LOCAL ] TRNO: Saving primary data. [2025-09-16T20:46:08.568806] [DEBUG] [LOCAL ] TRNO: Trimmed 47928 records to 32854 (keeping 150 days of data) [2025-09-16T20:46:08.784848] [DEBUG] [LOCAL ] TRNO: Primary data saved (32854 records). [2025-09-16T20:46:08.785000] [INFO ] [MAIN ] TRNO: Full history saved. [2025-09-16T20:46:08.785757] [INFO ] [MAIN ] Update Progress: 2128/2369 symbols completed. TRNO took 28.2s. Estimated remaining: 25m 36s. Rate: 9.4 symbols/min [2025-09-16T20:46:08.958355] [INFO ] [MAIN ] TRU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:46:08.997131] [DEBUG] [LOCAL ] TRU: Loaded 37607 existing records from primary storage. [2025-09-16T20:46:08.997304] [INFO ] [MAIN ] TRU: Loaded 37607 existing records. [2025-09-16T20:46:09.177526] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-03. [2025-09-16T20:46:09.182300] [WARN ] [MAIN ] TRU: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:46:09.184123] [INFO ] [MAIN ] TRU: Wiping existing primary data before full refresh. [2025-09-16T20:46:09.184257] [INFO ] [LOCAL ] TRU: Starting deletion of primary data. [2025-09-16T20:46:09.185100] [DEBUG] [LOCAL ] TRU: Deleted primary data file. [2025-09-16T20:46:09.185169] [INFO ] [MAIN ] TRU: Starting full primary refresh. [2025-09-16T20:46:09.328797] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-16T20:46:09.586139] [INFO ] [REMOTE ] TRU: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:46:09.974893] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-02. [2025-09-16T20:46:10.367359] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-16T20:46:10.774870] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-04. [2025-09-16T20:46:10.939168] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-16T20:46:11.574945] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-04. [2025-09-16T20:46:11.774572] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-16T20:46:12.374925] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-04. [2025-09-16T20:46:12.568369] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-16T20:46:13.174928] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-05. [2025-09-16T20:46:13.309930] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-16T20:46:13.974917] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-03. [2025-09-16T20:46:14.007775] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-16T20:46:14.774882] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-05. [2025-09-16T20:46:15.008155] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-16T20:46:15.574905] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-06. [2025-09-16T20:46:15.828097] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-16T20:46:16.220978] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-16T20:46:16.374878] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-06. [2025-09-16T20:46:17.174890] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-04. [2025-09-16T20:46:17.380267] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-16T20:46:17.795313] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-16T20:46:17.974905] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-05. [2025-09-16T20:46:18.772606] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-16T20:46:18.782661] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-07. [2025-09-16T20:46:19.521173] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-16T20:46:19.574842] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-06. [2025-09-16T20:46:20.374883] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-05. [2025-09-16T20:46:20.613448] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-16T20:46:21.174928] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-07. [2025-09-16T20:46:21.271092] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-16T20:46:21.974910] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-07. [2025-09-16T20:46:22.267458] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-16T20:46:22.655348] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-16T20:46:22.774902] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-08. [2025-09-16T20:46:23.575014] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-06. [2025-09-16T20:46:23.657045] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-16T20:46:24.375145] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-08. [2025-09-16T20:46:24.695922] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-16T20:46:25.093165] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-16T20:46:25.174913] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-09. [2025-09-16T20:46:25.950382] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-16T20:46:25.974851] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-09. [2025-09-16T20:46:26.774891] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-07. [2025-09-16T20:46:26.814532] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-16T20:46:26.821777] [INFO ] [REMOTE ] TROX: Full fetch complete (56026 records). [2025-09-16T20:46:26.821935] [DEBUG] [VALIDATOR ] TROX: Validating primary data. [2025-09-16T20:46:27.205100] [DEBUG] [VALIDATOR ] TROX: All expected trading days are present. [2025-09-16T20:46:27.205269] [DEBUG] [VALIDATOR ] TROX: Primary data validation passed. [2025-09-16T20:46:27.206291] [INFO ] [MAIN ] TROX: Fetched primary data is valid. [2025-09-16T20:46:27.206348] [DEBUG] [LOCAL ] TROX: Saving primary data. [2025-09-16T20:46:27.207681] [DEBUG] [LOCAL ] TROX: Trimmed 56026 records to 38819 (keeping 150 days of data) [2025-09-16T20:46:27.283789] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-16T20:46:27.317397] [INFO ] [REMOTE ] TRP: Full fetch complete (56757 records). [2025-09-16T20:46:27.318459] [DEBUG] [VALIDATOR ] TRP: Validating primary data. [2025-09-16T20:46:27.582569] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-08. [2025-09-16T20:46:27.722901] [DEBUG] [VALIDATOR ] TRP: All expected trading days are present. [2025-09-16T20:46:27.723966] [DEBUG] [VALIDATOR ] TRP: Primary data validation passed. [2025-09-16T20:46:27.725425] [INFO ] [MAIN ] TRP: Fetched primary data is valid. [2025-09-16T20:46:27.725712] [DEBUG] [LOCAL ] TRP: Saving primary data. [2025-09-16T20:46:27.729849] [DEBUG] [LOCAL ] TRP: Trimmed 56757 records to 38806 (keeping 150 days of data) [2025-09-16T20:46:27.947860] [DEBUG] [LOCAL ] TROX: Primary data saved (38819 records). [2025-09-16T20:46:27.948224] [INFO ] [MAIN ] TROX: Full history saved. [2025-09-16T20:46:27.948590] [INFO ] [MAIN ] Update Progress: 2129/2369 symbols completed. TROX took 27.0s. Estimated remaining: 25m 31s. Rate: 9.4 symbols/min [2025-09-16T20:46:28.127820] [INFO ] [MAIN ] TRV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:46:28.128436] [DEBUG] [LOCAL ] TRV: No existing data file found in primary storage. [2025-09-16T20:46:28.128707] [WARN ] [MAIN ] TRV: No existing data found, performing full refresh instead. [2025-09-16T20:46:28.130320] [INFO ] [MAIN ] TRV: Wiping existing primary data before full refresh. [2025-09-16T20:46:28.130591] [INFO ] [LOCAL ] TRV: Starting deletion of primary data. [2025-09-16T20:46:28.131370] [DEBUG] [LOCAL ] TRV: No primary data file found to delete. [2025-09-16T20:46:28.131691] [INFO ] [MAIN ] TRV: Starting full primary refresh. [2025-09-16T20:46:28.589318] [INFO ] [REMOTE ] TRV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:46:28.590786] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-02. [2025-09-16T20:46:28.621427] [DEBUG] [LOCAL ] TRP: Primary data saved (38806 records). [2025-09-16T20:46:28.621619] [INFO ] [MAIN ] TRP: Full history saved. [2025-09-16T20:46:28.621754] [INFO ] [MAIN ] Update Progress: 2130/2369 symbols completed. TRP took 25.5s. Estimated remaining: 25m 24s. Rate: 9.4 symbols/min [2025-09-16T20:46:28.796546] [INFO ] [MAIN ] TS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:46:28.831048] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-16T20:46:28.872628] [DEBUG] [LOCAL ] TS: Loaded 38067 existing records from primary storage. [2025-09-16T20:46:28.872811] [INFO ] [MAIN ] TS: Loaded 38067 existing records. [2025-09-16T20:46:29.055598] [WARN ] [MAIN ] TS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:46:29.055891] [INFO ] [MAIN ] TS: Wiping existing primary data before full refresh. [2025-09-16T20:46:29.055959] [INFO ] [LOCAL ] TS: Starting deletion of primary data. [2025-09-16T20:46:29.056693] [DEBUG] [LOCAL ] TS: Deleted primary data file. [2025-09-16T20:46:29.056753] [INFO ] [MAIN ] TS: Starting full primary refresh. [2025-09-16T20:46:29.177061] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-08. [2025-09-16T20:46:29.454481] [INFO ] [REMOTE ] TS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:46:29.458028] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-16T20:46:29.974940] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-02. [2025-09-16T20:46:30.647013] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-16T20:46:30.703390] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-16T20:46:30.774899] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-09. [2025-09-16T20:46:31.342532] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-16T20:46:31.574956] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-09. [2025-09-16T20:46:32.123215] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-16T20:46:32.129467] [INFO ] [REMOTE ] TRU: Full fetch complete (55521 records). [2025-09-16T20:46:32.129571] [DEBUG] [VALIDATOR ] TRU: Validating primary data. [2025-09-16T20:46:32.382334] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-03. [2025-09-16T20:46:32.529578] [DEBUG] [VALIDATOR ] TRU: All expected trading days are present. [2025-09-16T20:46:32.529683] [DEBUG] [VALIDATOR ] TRU: Primary data validation passed. [2025-09-16T20:46:32.530614] [INFO ] [MAIN ] TRU: Fetched primary data is valid. [2025-09-16T20:46:32.530673] [DEBUG] [LOCAL ] TRU: Saving primary data. [2025-09-16T20:46:32.531916] [DEBUG] [LOCAL ] TRU: Trimmed 55521 records to 37991 (keeping 150 days of data) [2025-09-16T20:46:32.779878] [DEBUG] [LOCAL ] TRU: Primary data saved (37991 records). [2025-09-16T20:46:32.780054] [INFO ] [MAIN ] TRU: Full history saved. [2025-09-16T20:46:32.781280] [INFO ] [MAIN ] Update Progress: 2131/2369 symbols completed. TRU took 24.0s. Estimated remaining: 25m 18s. Rate: 9.4 symbols/min [2025-09-16T20:46:32.961613] [INFO ] [MAIN ] TSE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:46:32.975251] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-16T20:46:32.980517] [INFO ] [REMOTE ] TRTX: Full fetch complete (40452 records). [2025-09-16T20:46:32.980691] [DEBUG] [VALIDATOR ] TRTX: Validating primary data. [2025-09-16T20:46:33.136350] [DEBUG] [LOCAL ] TSE: Loaded 21128 existing records from primary storage. [2025-09-16T20:46:33.173264] [INFO ] [MAIN ] TSE: Loaded 21128 existing records. [2025-09-16T20:46:33.186976] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-03. [2025-09-16T20:46:33.524353] [WARN ] [MAIN ] TSE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:46:33.554329] [INFO ] [MAIN ] TSE: Wiping existing primary data before full refresh. [2025-09-16T20:46:33.554435] [INFO ] [LOCAL ] TSE: Starting deletion of primary data. [2025-09-16T20:46:33.554549] [DEBUG] [VALIDATOR ] TRTX: All expected trading days are present. [2025-09-16T20:46:33.554666] [DEBUG] [VALIDATOR ] TRTX: Primary data validation passed. [2025-09-16T20:46:33.555573] [INFO ] [MAIN ] TRTX: Fetched primary data is valid. [2025-09-16T20:46:33.555604] [DEBUG] [LOCAL ] TSE: Deleted primary data file. [2025-09-16T20:46:33.555721] [INFO ] [MAIN ] TSE: Starting full primary refresh. [2025-09-16T20:46:33.555750] [DEBUG] [LOCAL ] TRTX: Saving primary data. [2025-09-16T20:46:33.658290] [DEBUG] [LOCAL ] TRTX: Trimmed 40452 records to 26718 (keeping 150 days of data) [2025-09-16T20:46:34.011592] [INFO ] [REMOTE ] TSE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:46:34.014037] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-02. [2025-09-16T20:46:34.076554] [DEBUG] [LOCAL ] TRTX: Primary data saved (26718 records). [2025-09-16T20:46:34.076705] [INFO ] [MAIN ] TRTX: Full history saved. [2025-09-16T20:46:34.076791] [INFO ] [MAIN ] Update Progress: 2132/2369 symbols completed. TRTX took 30.3s. Estimated remaining: 25m 11s. Rate: 9.4 symbols/min [2025-09-16T20:46:34.248790] [INFO ] [MAIN ] TSI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:46:34.256583] [DEBUG] [LOCAL ] TSI: Loaded 5448 existing records from primary storage. [2025-09-16T20:46:34.256747] [INFO ] [MAIN ] TSI: Loaded 5448 existing records. [2025-09-16T20:46:34.433690] [WARN ] [MAIN ] TSI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:46:34.434169] [INFO ] [MAIN ] TSI: Wiping existing primary data before full refresh. [2025-09-16T20:46:34.434298] [INFO ] [LOCAL ] TSI: Starting deletion of primary data. [2025-09-16T20:46:34.445279] [DEBUG] [LOCAL ] TSI: Deleted primary data file. [2025-09-16T20:46:34.458977] [INFO ] [MAIN ] TSI: Starting full primary refresh. [2025-09-16T20:46:34.538637] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-16T20:46:34.779969] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-04. [2025-09-16T20:46:34.830094] [INFO ] [REMOTE ] TSI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:46:35.101719] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-16T20:46:35.113675] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-16T20:46:35.574899] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-03. [2025-09-16T20:46:36.374860] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-04. [2025-09-16T20:46:36.852833] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-16T20:46:37.004851] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-16T20:46:37.174898] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-05. [2025-09-16T20:46:37.974921] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-04. [2025-09-16T20:46:38.054088] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-16T20:46:38.774915] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-05. [2025-09-16T20:46:38.943030] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-16T20:46:39.010873] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-16T20:46:39.574934] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-05. [2025-09-16T20:46:40.374931] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-02. [2025-09-16T20:46:40.670691] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-16T20:46:40.947368] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-16T20:46:41.174911] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-06. [2025-09-16T20:46:41.696127] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-16T20:46:41.974941] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-06. [2025-09-16T20:46:42.774879] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-06. [2025-09-16T20:46:42.952998] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-16T20:46:43.328211] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-16T20:46:43.574916] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-07. [2025-09-16T20:46:44.374937] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-07. [2025-09-16T20:46:45.174905] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-03. [2025-09-16T20:46:46.194665] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-06 (3.42 seconds). [2025-09-16T20:46:46.195488] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-16T20:46:46.208041] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-04. [2025-09-16T20:46:46.774928] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-07. [2025-09-16T20:46:47.106602] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-16T20:46:47.575001] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-05. [2025-09-16T20:46:48.266609] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-16T20:46:48.374993] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-06. [2025-09-16T20:46:48.757085] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-07 (5.18 seconds). [2025-09-16T20:46:48.904988] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-16T20:46:48.937477] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-16T20:46:49.174927] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-08. [2025-09-16T20:46:49.974920] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-07. [2025-09-16T20:46:50.230291] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-07 (5.86 seconds). [2025-09-16T20:46:50.777466] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-08. [2025-09-16T20:46:50.779138] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-16T20:46:50.800337] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-16T20:46:51.574929] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-08. [2025-09-16T20:46:52.364520] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-16T20:46:52.374843] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-09. [2025-09-16T20:46:52.658230] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-16T20:46:52.888969] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-16T20:46:52.890548] [INFO ] [REMOTE ] TSI: Full fetch complete (9980 records). [2025-09-16T20:46:52.890616] [DEBUG] [VALIDATOR ] TSI: Validating primary data. [2025-09-16T20:46:53.180114] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-09. [2025-09-16T20:46:53.293084] [DEBUG] [VALIDATOR ] TSI: All expected trading days are present. [2025-09-16T20:46:53.293169] [DEBUG] [VALIDATOR ] TSI: Primary data validation passed. [2025-09-16T20:46:53.293435] [INFO ] [MAIN ] TSI: Fetched primary data is valid. [2025-09-16T20:46:53.293478] [DEBUG] [LOCAL ] TSI: Saving primary data. [2025-09-16T20:46:53.293984] [DEBUG] [LOCAL ] TSI: Trimmed 9980 records to 5465 (keeping 150 days of data) [2025-09-16T20:46:53.326039] [DEBUG] [LOCAL ] TSI: Primary data saved (5465 records). [2025-09-16T20:46:53.326177] [INFO ] [MAIN ] TSI: Full history saved. [2025-09-16T20:46:53.326278] [INFO ] [MAIN ] Update Progress: 2133/2369 symbols completed. TSI took 19.2s. Estimated remaining: 25m 6s. Rate: 9.4 symbols/min [2025-09-16T20:46:53.504792] [INFO ] [MAIN ] TSLX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:46:53.530373] [DEBUG] [LOCAL ] TSLX: Loaded 25450 existing records from primary storage. [2025-09-16T20:46:53.530518] [INFO ] [MAIN ] TSLX: Loaded 25450 existing records. [2025-09-16T20:46:53.711965] [WARN ] [MAIN ] TSLX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:46:53.712219] [INFO ] [MAIN ] TSLX: Wiping existing primary data before full refresh. [2025-09-16T20:46:53.712266] [INFO ] [LOCAL ] TSLX: Starting deletion of primary data. [2025-09-16T20:46:53.712952] [DEBUG] [LOCAL ] TSLX: Deleted primary data file. [2025-09-16T20:46:53.713004] [INFO ] [MAIN ] TSLX: Starting full primary refresh. [2025-09-16T20:46:53.980475] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-09. [2025-09-16T20:46:54.087901] [INFO ] [REMOTE ] TSLX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:46:54.774946] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-08. [2025-09-16T20:46:54.943404] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-16T20:46:54.952076] [INFO ] [REMOTE ] TS: Full fetch complete (56264 records). [2025-09-16T20:46:54.952269] [DEBUG] [VALIDATOR ] TS: Validating primary data. [2025-09-16T20:46:55.323873] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-16T20:46:55.347207] [INFO ] [REMOTE ] TSE: Full fetch complete (31627 records). [2025-09-16T20:46:55.363887] [DEBUG] [VALIDATOR ] TSE: Validating primary data. [2025-09-16T20:46:55.364324] [DEBUG] [VALIDATOR ] TS: All expected trading days are present. [2025-09-16T20:46:55.396903] [DEBUG] [VALIDATOR ] TS: Primary data validation passed. [2025-09-16T20:46:55.403498] [INFO ] [MAIN ] TS: Fetched primary data is valid. [2025-09-16T20:46:55.413764] [DEBUG] [LOCAL ] TS: Saving primary data. [2025-09-16T20:46:55.474333] [DEBUG] [LOCAL ] TS: Trimmed 56264 records to 38422 (keeping 150 days of data) [2025-09-16T20:46:55.577414] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-02. [2025-09-16T20:46:55.939492] [DEBUG] [VALIDATOR ] TSE: All expected trading days are present. [2025-09-16T20:46:55.964077] [DEBUG] [VALIDATOR ] TSE: Primary data validation passed. [2025-09-16T20:46:55.969296] [INFO ] [MAIN ] TSE: Fetched primary data is valid. [2025-09-16T20:46:55.969637] [DEBUG] [LOCAL ] TSE: Saving primary data. [2025-09-16T20:46:55.979729] [DEBUG] [LOCAL ] TSE: Trimmed 31627 records to 21302 (keeping 150 days of data) [2025-09-16T20:46:56.078049] [DEBUG] [LOCAL ] TS: Primary data saved (38422 records). [2025-09-16T20:46:56.080064] [INFO ] [MAIN ] TS: Full history saved. [2025-09-16T20:46:56.080933] [INFO ] [MAIN ] Update Progress: 2134/2369 symbols completed. TS took 27.5s. Estimated remaining: 24m 59s. Rate: 9.4 symbols/min [2025-09-16T20:46:56.267203] [INFO ] [MAIN ] TSM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:46:56.294808] [DEBUG] [LOCAL ] TSE: Primary data saved (21302 records). [2025-09-16T20:46:56.295031] [INFO ] [MAIN ] TSE: Full history saved. [2025-09-16T20:46:56.295152] [INFO ] [MAIN ] Update Progress: 2135/2369 symbols completed. TSE took 23.5s. Estimated remaining: 24m 52s. Rate: 9.4 symbols/min [2025-09-16T20:46:56.484720] [INFO ] [MAIN ] TSN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:46:56.485662] [DEBUG] [LOCAL ] TSN: No existing data file found in primary storage. [2025-09-16T20:46:56.485760] [WARN ] [MAIN ] TSN: No existing data found, performing full refresh instead. [2025-09-16T20:46:56.497565] [INFO ] [MAIN ] TSN: Wiping existing primary data before full refresh. [2025-09-16T20:46:56.497825] [INFO ] [LOCAL ] TSN: Starting deletion of primary data. [2025-09-16T20:46:56.498529] [DEBUG] [LOCAL ] TSM: Loaded 39779 existing records from primary storage. [2025-09-16T20:46:56.498785] [DEBUG] [LOCAL ] TSN: No primary data file found to delete. [2025-09-16T20:46:56.498730] [INFO ] [MAIN ] TSM: Loaded 39779 existing records. [2025-09-16T20:46:56.498978] [INFO ] [MAIN ] TSN: Starting full primary refresh. [2025-09-16T20:46:56.710785] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-16T20:46:56.852935] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-09. [2025-09-16T20:46:56.887963] [WARN ] [MAIN ] TSM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:46:56.888188] [INFO ] [MAIN ] TSM: Wiping existing primary data before full refresh. [2025-09-16T20:46:56.888261] [INFO ] [LOCAL ] TSM: Starting deletion of primary data. [2025-09-16T20:46:56.889656] [DEBUG] [LOCAL ] TSM: Deleted primary data file. [2025-09-16T20:46:56.890281] [INFO ] [MAIN ] TSM: Starting full primary refresh. [2025-09-16T20:46:57.379691] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-16T20:46:57.400474] [INFO ] [REMOTE ] TSN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:46:57.406681] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-02. [2025-09-16T20:46:57.490096] [INFO ] [REMOTE ] TSM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:46:57.510723] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-16T20:46:57.516507] [INFO ] [REMOTE ] TRV: Full fetch complete (52430 records). [2025-09-16T20:46:57.516673] [DEBUG] [VALIDATOR ] TRV: Validating primary data. [2025-09-16T20:46:57.517411] [FATAL] [VALIDATOR ] TRV: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T20:46:57.517494] [FATAL] [MAIN ] TRV: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:46:57.517532] [WARN ] [MAIN ] TRV: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:46:57.517578] [INFO ] [LOCAL ] TRV: Starting deletion of primary data. [2025-09-16T20:46:57.517685] [DEBUG] [LOCAL ] TRV: No primary data file found to delete. [2025-09-16T20:46:57.517731] [INFO ] [LOCAL ] TRV: Starting deletion of derivative data. [2025-09-16T20:46:57.517790] [DEBUG] [LOCAL ] TRV: No derivative data file found to delete. [2025-09-16T20:46:57.517861] [INFO ] [MAIN ] Update Progress: 2136/2369 symbols completed. TRV took 29.6s. Estimated remaining: 24m 45s. Rate: 9.4 symbols/min [2025-09-16T20:46:57.696483] [INFO ] [MAIN ] TSQ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:46:57.696718] [DEBUG] [LOCAL ] TSQ: No existing data file found in primary storage. [2025-09-16T20:46:57.696758] [WARN ] [MAIN ] TSQ: No existing data found, performing full refresh instead. [2025-09-16T20:46:57.696887] [INFO ] [MAIN ] TSQ: Wiping existing primary data before full refresh. [2025-09-16T20:46:57.696927] [INFO ] [LOCAL ] TSQ: Starting deletion of primary data. [2025-09-16T20:46:57.696969] [DEBUG] [LOCAL ] TSQ: No primary data file found to delete. [2025-09-16T20:46:57.697006] [INFO ] [MAIN ] TSQ: Starting full primary refresh. [2025-09-16T20:46:57.980162] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-03. [2025-09-16T20:46:58.055063] [INFO ] [REMOTE ] TSQ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:46:58.774922] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-02. [2025-09-16T20:46:59.555200] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-16T20:46:59.574847] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-04. [2025-09-16T20:46:59.775162] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-09-16T20:47:00.264114] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-16T20:47:00.374864] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-03. [2025-09-16T20:47:01.174961] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-03. [2025-09-16T20:47:01.285850] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-16T20:47:01.850504] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-16T20:47:01.974941] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-02. [2025-09-16T20:47:02.774929] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-05. [2025-09-16T20:47:02.847302] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-16T20:47:03.104064] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-16T20:47:03.574906] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-04. [2025-09-16T20:47:03.862726] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-16T20:47:04.374939] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-03. [2025-09-16T20:47:04.669614] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-16T20:47:05.174897] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-04. [2025-09-16T20:47:05.311757] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-16T20:47:05.974902] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-06. [2025-09-16T20:47:06.774951] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-04. [2025-09-16T20:47:07.041881] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-16T20:47:07.359796] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-16T20:47:07.574868] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-07. [2025-09-16T20:47:07.874520] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-16T20:47:08.374897] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-05. [2025-09-16T20:47:09.095467] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-16T20:47:09.174901] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-05. [2025-09-16T20:47:09.366971] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-16T20:47:09.974879] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-08. [2025-09-16T20:47:10.262909] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-16T20:47:10.774900] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-06. [2025-09-16T20:47:11.530905] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-16T20:47:11.574848] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-09. [2025-09-16T20:47:11.597362] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-16T20:47:12.374896] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-05. [2025-09-16T20:47:12.849856] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-16T20:47:12.853733] [INFO ] [REMOTE ] TSLX: Full fetch complete (38568 records). [2025-09-16T20:47:12.853818] [DEBUG] [VALIDATOR ] TSLX: Validating primary data. [2025-09-16T20:47:13.181496] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-07. [2025-09-16T20:47:13.231581] [DEBUG] [VALIDATOR ] TSLX: All expected trading days are present. [2025-09-16T20:47:13.231674] [DEBUG] [VALIDATOR ] TSLX: Primary data validation passed. [2025-09-16T20:47:13.232438] [INFO ] [MAIN ] TSLX: Fetched primary data is valid. [2025-09-16T20:47:13.232485] [DEBUG] [LOCAL ] TSLX: Saving primary data. [2025-09-16T20:47:13.233503] [DEBUG] [LOCAL ] TSLX: Trimmed 38568 records to 25751 (keeping 150 days of data) [2025-09-16T20:47:13.395656] [DEBUG] [LOCAL ] TSLX: Primary data saved (25751 records). [2025-09-16T20:47:13.395883] [INFO ] [MAIN ] TSLX: Full history saved. [2025-09-16T20:47:13.395987] [INFO ] [MAIN ] Update Progress: 2137/2369 symbols completed. TSLX took 20.1s. Estimated remaining: 24m 40s. Rate: 9.4 symbols/min [2025-09-16T20:47:13.566507] [INFO ] [MAIN ] TT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:47:13.603738] [DEBUG] [LOCAL ] TT: Loaded 34651 existing records from primary storage. [2025-09-16T20:47:13.603874] [INFO ] [MAIN ] TT: Loaded 34651 existing records. [2025-09-16T20:47:13.780699] [WARN ] [MAIN ] TT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:47:13.780977] [INFO ] [MAIN ] TT: Wiping existing primary data before full refresh. [2025-09-16T20:47:13.781024] [INFO ] [LOCAL ] TT: Starting deletion of primary data. [2025-09-16T20:47:13.781799] [DEBUG] [LOCAL ] TT: Deleted primary data file. [2025-09-16T20:47:13.781847] [INFO ] [MAIN ] TT: Starting full primary refresh. [2025-09-16T20:47:13.990451] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-06. [2025-09-16T20:47:14.147188] [INFO ] [REMOTE ] TT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:47:14.155681] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-16T20:47:14.774884] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-02. [2025-09-16T20:47:14.903495] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-09-16T20:47:15.038591] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-16T20:47:15.574955] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-07. [2025-09-16T20:47:16.374958] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-08. [2025-09-16T20:47:16.608876] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-16T20:47:16.858703] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-16T20:47:17.174905] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-03. [2025-09-16T20:47:17.226857] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-16T20:47:17.974901] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-08. [2025-09-16T20:47:18.683039] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-16T20:47:18.774877] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-09. [2025-09-16T20:47:19.142593] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-16T20:47:19.510288] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-16T20:47:19.516099] [INFO ] [REMOTE ] TSM: Full fetch complete (58109 records). [2025-09-16T20:47:19.516233] [DEBUG] [VALIDATOR ] TSM: Validating primary data. [2025-09-16T20:47:19.517120] [FATAL] [VALIDATOR ] TSM: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T20:47:19.517199] [FATAL] [MAIN ] TSM: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:47:19.517245] [WARN ] [MAIN ] TSM: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:47:19.517292] [INFO ] [LOCAL ] TSM: Starting deletion of primary data. [2025-09-16T20:47:19.517352] [DEBUG] [LOCAL ] TSM: No primary data file found to delete. [2025-09-16T20:47:19.517390] [INFO ] [LOCAL ] TSM: Starting deletion of derivative data. [2025-09-16T20:47:19.517706] [DEBUG] [LOCAL ] TSM: Deleted derivative data file. [2025-09-16T20:47:19.519593] [INFO ] [MAIN ] Update Progress: 2138/2369 symbols completed. TSM took 23.4s. Estimated remaining: 24m 33s. Rate: 9.4 symbols/min [2025-09-16T20:47:19.582703] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-04. [2025-09-16T20:47:19.695071] [INFO ] [MAIN ] TTAM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:47:19.716088] [DEBUG] [LOCAL ] TTAM: Loaded 20275 existing records from primary storage. [2025-09-16T20:47:19.716220] [INFO ] [MAIN ] TTAM: Loaded 20275 existing records. [2025-09-16T20:47:19.892298] [WARN ] [MAIN ] TTAM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:47:19.892526] [INFO ] [MAIN ] TTAM: Wiping existing primary data before full refresh. [2025-09-16T20:47:19.892582] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-09-16T20:47:19.893124] [DEBUG] [LOCAL ] TTAM: Deleted primary data file. [2025-09-16T20:47:19.893175] [INFO ] [MAIN ] TTAM: Starting full primary refresh. [2025-09-16T20:47:20.249851] [INFO ] [REMOTE ] TTAM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:47:20.374901] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-02. [2025-09-16T20:47:21.174909] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-09. [2025-09-16T20:47:21.377704] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-16T20:47:21.677086] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-16T20:47:21.888394] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-16T20:47:21.890112] [INFO ] [REMOTE ] TSQ: Full fetch complete (12813 records). [2025-09-16T20:47:21.890186] [DEBUG] [VALIDATOR ] TSQ: Validating primary data. [2025-09-16T20:47:21.980002] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-03. [2025-09-16T20:47:22.277520] [DEBUG] [VALIDATOR ] TSQ: All expected trading days are present. [2025-09-16T20:47:22.277605] [DEBUG] [VALIDATOR ] TSQ: Primary data validation passed. [2025-09-16T20:47:22.277938] [INFO ] [MAIN ] TSQ: Fetched primary data is valid. [2025-09-16T20:47:22.277985] [DEBUG] [LOCAL ] TSQ: Saving primary data. [2025-09-16T20:47:22.278521] [DEBUG] [LOCAL ] TSQ: Trimmed 12813 records to 9426 (keeping 150 days of data) [2025-09-16T20:47:22.335674] [DEBUG] [LOCAL ] TSQ: Primary data saved (9426 records). [2025-09-16T20:47:22.335815] [INFO ] [MAIN ] TSQ: Full history saved. [2025-09-16T20:47:22.335898] [INFO ] [MAIN ] Update Progress: 2139/2369 symbols completed. TSQ took 24.8s. Estimated remaining: 24m 27s. Rate: 9.4 symbols/min [2025-09-16T20:47:22.538232] [INFO ] [MAIN ] TTC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:47:22.572118] [DEBUG] [LOCAL ] TTC: Loaded 30907 existing records from primary storage. [2025-09-16T20:47:22.572261] [INFO ] [MAIN ] TTC: Loaded 30907 existing records. [2025-09-16T20:47:22.761218] [WARN ] [MAIN ] TTC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:47:22.761503] [INFO ] [MAIN ] TTC: Wiping existing primary data before full refresh. [2025-09-16T20:47:22.761551] [INFO ] [LOCAL ] TTC: Starting deletion of primary data. [2025-09-16T20:47:22.762392] [DEBUG] [LOCAL ] TTC: Deleted primary data file. [2025-09-16T20:47:22.762451] [INFO ] [MAIN ] TTC: Starting full primary refresh. [2025-09-16T20:47:22.783787] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-05. [2025-09-16T20:47:23.135453] [INFO ] [REMOTE ] TTC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:47:23.574896] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-02. [2025-09-16T20:47:23.663337] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-16T20:47:24.374895] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-04. [2025-09-16T20:47:25.058288] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-16T20:47:25.095251] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-09-16T20:47:25.174852] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-06. [2025-09-16T20:47:25.837916] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-16T20:47:25.974848] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-05. [2025-09-16T20:47:26.576621] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-16T20:47:26.774895] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-07. [2025-09-16T20:47:27.182591] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-16T20:47:27.574930] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-03. [2025-09-16T20:47:28.374966] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-06. [2025-09-16T20:47:28.812921] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-16T20:47:28.898142] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-16T20:47:29.174908] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-04. [2025-09-16T20:47:29.671128] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-16T20:47:29.974912] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-06. [2025-09-16T20:47:30.774866] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-07. [2025-09-16T20:47:30.939783] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-16T20:47:31.574908] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-08. [2025-09-16T20:47:32.138699] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-16T20:47:32.197285] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-16T20:47:32.374891] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-08. [2025-09-16T20:47:33.174882] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-07. [2025-09-16T20:47:33.466016] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-16T20:47:33.737233] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-16T20:47:33.974907] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-09. [2025-09-16T20:47:34.774897] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-09. [2025-09-16T20:47:35.117929] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-16T20:47:35.139384] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-16T20:47:35.142826] [INFO ] [REMOTE ] TTAM: Full fetch complete (31160 records). [2025-09-16T20:47:35.142911] [DEBUG] [VALIDATOR ] TTAM: Validating primary data. [2025-09-16T20:47:35.518818] [DEBUG] [VALIDATOR ] TTAM: All expected trading days are present. [2025-09-16T20:47:35.518913] [DEBUG] [VALIDATOR ] TTAM: Primary data validation passed. [2025-09-16T20:47:35.519544] [INFO ] [MAIN ] TTAM: Fetched primary data is valid. [2025-09-16T20:47:35.519631] [DEBUG] [LOCAL ] TTAM: Saving primary data. [2025-09-16T20:47:35.520509] [DEBUG] [LOCAL ] TTAM: Trimmed 31160 records to 20405 (keeping 150 days of data) [2025-09-16T20:47:35.580259] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-05. [2025-09-16T20:47:35.654105] [DEBUG] [LOCAL ] TTAM: Primary data saved (20405 records). [2025-09-16T20:47:35.654241] [INFO ] [MAIN ] TTAM: Full history saved. [2025-09-16T20:47:35.654323] [INFO ] [MAIN ] Update Progress: 2140/2369 symbols completed. TTAM took 16.1s. Estimated remaining: 24m 21s. Rate: 9.4 symbols/min [2025-09-16T20:47:35.824877] [INFO ] [MAIN ] TTE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:47:35.861066] [DEBUG] [LOCAL ] TTE: Loaded 37934 existing records from primary storage. [2025-09-16T20:47:35.861206] [INFO ] [MAIN ] TTE: Loaded 37934 existing records. [2025-09-16T20:47:36.042193] [WARN ] [MAIN ] TTE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:47:36.042457] [INFO ] [MAIN ] TTE: Wiping existing primary data before full refresh. [2025-09-16T20:47:36.042505] [INFO ] [LOCAL ] TTE: Starting deletion of primary data. [2025-09-16T20:47:36.043207] [DEBUG] [LOCAL ] TTE: Deleted primary data file. [2025-09-16T20:47:36.043255] [INFO ] [MAIN ] TTE: Starting full primary refresh. [2025-09-16T20:47:36.377083] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-08. [2025-09-16T20:47:36.420298] [INFO ] [REMOTE ] TTE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:47:36.438116] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-16T20:47:36.444785] [INFO ] [REMOTE ] TT: Full fetch complete (52568 records). [2025-09-16T20:47:36.444956] [DEBUG] [VALIDATOR ] TT: Validating primary data. [2025-09-16T20:47:36.833382] [DEBUG] [VALIDATOR ] TT: All expected trading days are present. [2025-09-16T20:47:36.833471] [DEBUG] [VALIDATOR ] TT: Primary data validation passed. [2025-09-16T20:47:36.834419] [INFO ] [MAIN ] TT: Fetched primary data is valid. [2025-09-16T20:47:36.834468] [DEBUG] [LOCAL ] TT: Saving primary data. [2025-09-16T20:47:36.835725] [DEBUG] [LOCAL ] TT: Trimmed 52568 records to 34994 (keeping 150 days of data) [2025-09-16T20:47:37.066555] [DEBUG] [LOCAL ] TT: Primary data saved (34994 records). [2025-09-16T20:47:37.066760] [INFO ] [MAIN ] TT: Full history saved. [2025-09-16T20:47:37.067663] [INFO ] [MAIN ] Update Progress: 2141/2369 symbols completed. TT took 23.7s. Estimated remaining: 24m 14s. Rate: 9.4 symbols/min [2025-09-16T20:47:37.178969] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-02. [2025-09-16T20:47:37.239733] [INFO ] [MAIN ] TTI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:47:37.297412] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-16T20:47:37.334200] [DEBUG] [LOCAL ] TTI: Loaded 33622 existing records from primary storage. [2025-09-16T20:47:37.334352] [INFO ] [MAIN ] TTI: Loaded 33622 existing records. [2025-09-16T20:47:37.509108] [WARN ] [MAIN ] TTI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:47:37.509381] [INFO ] [MAIN ] TTI: Wiping existing primary data before full refresh. [2025-09-16T20:47:37.509427] [INFO ] [LOCAL ] TTI: Starting deletion of primary data. [2025-09-16T20:47:37.510112] [DEBUG] [LOCAL ] TTI: Deleted primary data file. [2025-09-16T20:47:37.510162] [INFO ] [MAIN ] TTI: Starting full primary refresh. [2025-09-16T20:47:37.872417] [INFO ] [REMOTE ] TTI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:47:37.974901] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-06. [2025-09-16T20:47:38.358775] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-16T20:47:38.774920] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-09. [2025-09-16T20:47:39.163791] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-16T20:47:39.189536] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-16T20:47:39.195427] [INFO ] [REMOTE ] TSN: Full fetch complete (57057 records). [2025-09-16T20:47:39.195558] [DEBUG] [VALIDATOR ] TSN: Validating primary data. [2025-09-16T20:47:39.196272] [FATAL] [VALIDATOR ] TSN: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T20:47:39.196349] [FATAL] [MAIN ] TSN: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:47:39.196386] [WARN ] [MAIN ] TSN: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:47:39.196433] [INFO ] [LOCAL ] TSN: Starting deletion of primary data. [2025-09-16T20:47:39.196490] [DEBUG] [LOCAL ] TSN: No primary data file found to delete. [2025-09-16T20:47:39.196526] [INFO ] [LOCAL ] TSN: Starting deletion of derivative data. [2025-09-16T20:47:39.196588] [DEBUG] [LOCAL ] TSN: No derivative data file found to delete. [2025-09-16T20:47:39.196681] [INFO ] [MAIN ] Update Progress: 2142/2369 symbols completed. TSN took 42.9s. Estimated remaining: 24m 7s. Rate: 9.4 symbols/min [2025-09-16T20:47:39.368447] [INFO ] [MAIN ] TU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:47:39.407686] [DEBUG] [LOCAL ] TU: Loaded 36528 existing records from primary storage. [2025-09-16T20:47:39.407849] [INFO ] [MAIN ] TU: Loaded 36528 existing records. [2025-09-16T20:47:39.580251] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-02. [2025-09-16T20:47:39.585104] [WARN ] [MAIN ] TU: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:47:39.585353] [INFO ] [MAIN ] TU: Wiping existing primary data before full refresh. [2025-09-16T20:47:39.585398] [INFO ] [LOCAL ] TU: Starting deletion of primary data. [2025-09-16T20:47:39.586207] [DEBUG] [LOCAL ] TU: Deleted primary data file. [2025-09-16T20:47:39.586275] [INFO ] [MAIN ] TU: Starting full primary refresh. [2025-09-16T20:47:39.951099] [INFO ] [REMOTE ] TU: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:47:39.977786] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-16T20:47:40.374928] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-03. [2025-09-16T20:47:41.174943] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-07. [2025-09-16T20:47:41.232515] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-16T20:47:41.974894] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-03. [2025-09-16T20:47:42.305410] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-16T20:47:42.735741] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-16T20:47:42.774871] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-08. [2025-09-16T20:47:43.258483] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-16T20:47:43.574905] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-02. [2025-09-16T20:47:44.380139] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-04. [2025-09-16T20:47:44.394116] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-16T20:47:45.174902] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-04. [2025-09-16T20:47:45.213140] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-16T20:47:45.773354] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-16T20:47:45.974913] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-09. [2025-09-16T20:47:46.774948] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-05. [2025-09-16T20:47:47.222518] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-16T20:47:47.280018] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-16T20:47:47.286440] [INFO ] [REMOTE ] TTC: Full fetch complete (47181 records). [2025-09-16T20:47:47.286610] [DEBUG] [VALIDATOR ] TTC: Validating primary data. [2025-09-16T20:47:47.581161] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-05. [2025-09-16T20:47:47.669587] [DEBUG] [VALIDATOR ] TTC: All expected trading days are present. [2025-09-16T20:47:47.669687] [DEBUG] [VALIDATOR ] TTC: Primary data validation passed. [2025-09-16T20:47:47.670624] [INFO ] [MAIN ] TTC: Fetched primary data is valid. [2025-09-16T20:47:47.670691] [DEBUG] [LOCAL ] TTC: Saving primary data. [2025-09-16T20:47:47.671686] [DEBUG] [LOCAL ] TTC: Trimmed 47181 records to 31230 (keeping 150 days of data) [2025-09-16T20:47:47.862414] [DEBUG] [LOCAL ] TTC: Primary data saved (31230 records). [2025-09-16T20:47:47.862587] [INFO ] [MAIN ] TTC: Full history saved. [2025-09-16T20:47:47.862700] [INFO ] [MAIN ] Update Progress: 2143/2369 symbols completed. TTC took 25.5s. Estimated remaining: 24m 1s. Rate: 9.4 symbols/min [2025-09-16T20:47:48.034002] [INFO ] [MAIN ] TUYA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:47:48.065727] [DEBUG] [LOCAL ] TUYA: Loaded 33962 existing records from primary storage. [2025-09-16T20:47:48.065870] [INFO ] [MAIN ] TUYA: Loaded 33962 existing records. [2025-09-16T20:47:48.242252] [WARN ] [MAIN ] TUYA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:47:48.242503] [INFO ] [MAIN ] TUYA: Wiping existing primary data before full refresh. [2025-09-16T20:47:48.242548] [INFO ] [LOCAL ] TUYA: Starting deletion of primary data. [2025-09-16T20:47:48.243151] [DEBUG] [LOCAL ] TUYA: Deleted primary data file. [2025-09-16T20:47:48.243197] [INFO ] [MAIN ] TUYA: Starting full primary refresh. [2025-09-16T20:47:48.385031] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-03. [2025-09-16T20:47:48.604065] [INFO ] [REMOTE ] TUYA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:47:48.630975] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-16T20:47:49.174936] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-06. [2025-09-16T20:47:49.470148] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-16T20:47:49.974934] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-02. [2025-09-16T20:47:50.324104] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-16T20:47:50.774980] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-04. [2025-09-16T20:47:51.096585] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-16T20:47:51.574872] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-07. [2025-09-16T20:47:51.772578] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-16T20:47:52.374903] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-03. [2025-09-16T20:47:52.727395] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-16T20:47:53.174927] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-05. [2025-09-16T20:47:53.413083] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-16T20:47:53.974922] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-08. [2025-09-16T20:47:54.135571] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-16T20:47:54.774916] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-06. [2025-09-16T20:47:55.047876] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-16T20:47:55.262283] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-16T20:47:55.574911] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-06. [2025-09-16T20:47:56.374942] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-04. [2025-09-16T20:47:56.811303] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-16T20:47:56.848727] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-16T20:47:57.174901] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-09. [2025-09-16T20:47:57.974922] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-07. [2025-09-16T20:47:58.338595] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-16T20:47:58.720428] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-16T20:47:58.726077] [INFO ] [REMOTE ] TTI: Full fetch complete (48997 records). [2025-09-16T20:47:58.726227] [DEBUG] [VALIDATOR ] TTI: Validating primary data. [2025-09-16T20:47:58.785928] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-05. [2025-09-16T20:47:59.113591] [DEBUG] [VALIDATOR ] TTI: All expected trading days are present. [2025-09-16T20:47:59.113681] [DEBUG] [VALIDATOR ] TTI: Primary data validation passed. [2025-09-16T20:47:59.114561] [INFO ] [MAIN ] TTI: Fetched primary data is valid. [2025-09-16T20:47:59.114604] [DEBUG] [LOCAL ] TTI: Saving primary data. [2025-09-16T20:47:59.115613] [DEBUG] [LOCAL ] TTI: Trimmed 48997 records to 33942 (keeping 150 days of data) [2025-09-16T20:47:59.314192] [DEBUG] [LOCAL ] TTI: Primary data saved (33942 records). [2025-09-16T20:47:59.314353] [INFO ] [MAIN ] TTI: Full history saved. [2025-09-16T20:47:59.314476] [INFO ] [MAIN ] Update Progress: 2144/2369 symbols completed. TTI took 22.2s. Estimated remaining: 23m 55s. Rate: 9.4 symbols/min [2025-09-16T20:47:59.488545] [INFO ] [MAIN ] TV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:47:59.518676] [DEBUG] [LOCAL ] TV: Loaded 31334 existing records from primary storage. [2025-09-16T20:47:59.518869] [INFO ] [MAIN ] TV: Loaded 31334 existing records. [2025-09-16T20:47:59.582658] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-07. [2025-09-16T20:47:59.699210] [WARN ] [MAIN ] TV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:47:59.699495] [INFO ] [MAIN ] TV: Wiping existing primary data before full refresh. [2025-09-16T20:47:59.699619] [INFO ] [LOCAL ] TV: Starting deletion of primary data. [2025-09-16T20:47:59.710383] [DEBUG] [LOCAL ] TV: Deleted primary data file. [2025-09-16T20:47:59.724425] [INFO ] [MAIN ] TV: Starting full primary refresh. [2025-09-16T20:47:59.837905] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-16T20:48:00.116461] [INFO ] [REMOTE ] TV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:48:00.374873] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-02. [2025-09-16T20:48:00.723698] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-16T20:48:01.174987] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-06. [2025-09-16T20:48:01.656670] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-16T20:48:01.974918] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-08. [2025-09-16T20:48:02.510140] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-09-16T20:48:02.774912] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-08. [2025-09-16T20:48:03.574958] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-03. [2025-09-16T20:48:03.736546] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-06 (2.56 seconds). [2025-09-16T20:48:04.374950] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-07. [2025-09-16T20:48:05.273681] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-08 (3.30 seconds). [2025-09-16T20:48:05.284237] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-09. [2025-09-16T20:48:06.161962] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-16T20:48:06.171586] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-08. [2025-09-16T20:48:06.226325] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-08 (3.45 seconds). [2025-09-16T20:48:06.729155] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-03 (3.15 seconds). [2025-09-16T20:48:06.774845] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-04. [2025-09-16T20:48:07.030115] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-16T20:48:07.036877] [INFO ] [REMOTE ] TU: Full fetch complete (54452 records). [2025-09-16T20:48:07.036989] [DEBUG] [VALIDATOR ] TU: Validating primary data. [2025-09-16T20:48:07.436194] [DEBUG] [VALIDATOR ] TU: All expected trading days are present. [2025-09-16T20:48:07.436328] [DEBUG] [VALIDATOR ] TU: Primary data validation passed. [2025-09-16T20:48:07.437780] [INFO ] [MAIN ] TU: Fetched primary data is valid. [2025-09-16T20:48:07.437898] [DEBUG] [LOCAL ] TU: Saving primary data. [2025-09-16T20:48:07.440600] [DEBUG] [LOCAL ] TU: Trimmed 54452 records to 36881 (keeping 150 days of data) [2025-09-16T20:48:07.575190] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-09. [2025-09-16T20:48:07.678665] [DEBUG] [LOCAL ] TU: Primary data saved (36881 records). [2025-09-16T20:48:07.678794] [INFO ] [MAIN ] TU: Full history saved. [2025-09-16T20:48:07.679712] [INFO ] [MAIN ] Update Progress: 2145/2369 symbols completed. TU took 28.5s. Estimated remaining: 23m 49s. Rate: 9.4 symbols/min [2025-09-16T20:48:07.854925] [INFO ] [MAIN ] TVC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:48:07.860078] [DEBUG] [LOCAL ] TVC: Loaded 2398 existing records from primary storage. [2025-09-16T20:48:07.860198] [INFO ] [MAIN ] TVC: Loaded 2398 existing records. [2025-09-16T20:48:08.041774] [WARN ] [MAIN ] TVC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:48:08.042048] [INFO ] [MAIN ] TVC: Wiping existing primary data before full refresh. [2025-09-16T20:48:08.042208] [INFO ] [LOCAL ] TVC: Starting deletion of primary data. [2025-09-16T20:48:08.042570] [DEBUG] [LOCAL ] TVC: Deleted primary data file. [2025-09-16T20:48:08.042710] [INFO ] [MAIN ] TVC: Starting full primary refresh. [2025-09-16T20:48:08.303614] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-16T20:48:08.400298] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-09. [2025-09-16T20:48:08.480477] [INFO ] [REMOTE ] TVC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:48:08.532909] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-16T20:48:09.141341] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-16T20:48:09.151859] [INFO ] [REMOTE ] TTE: Full fetch complete (56177 records). [2025-09-16T20:48:09.152066] [DEBUG] [VALIDATOR ] TTE: Validating primary data. [2025-09-16T20:48:09.174992] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-02. [2025-09-16T20:48:09.662207] [DEBUG] [VALIDATOR ] TTE: All expected trading days are present. [2025-09-16T20:48:09.662326] [DEBUG] [VALIDATOR ] TTE: Primary data validation passed. [2025-09-16T20:48:09.663696] [INFO ] [MAIN ] TTE: Fetched primary data is valid. [2025-09-16T20:48:09.663785] [DEBUG] [LOCAL ] TTE: Saving primary data. [2025-09-16T20:48:09.665362] [DEBUG] [LOCAL ] TTE: Trimmed 56177 records to 38310 (keeping 150 days of data) [2025-09-16T20:48:09.918508] [DEBUG] [LOCAL ] TTE: Primary data saved (38310 records). [2025-09-16T20:48:09.918686] [INFO ] [MAIN ] TTE: Full history saved. [2025-09-16T20:48:09.918838] [INFO ] [MAIN ] Update Progress: 2146/2369 symbols completed. TTE took 34.3s. Estimated remaining: 23m 42s. Rate: 9.4 symbols/min [2025-09-16T20:48:09.985486] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-05. [2025-09-16T20:48:10.045920] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-16T20:48:10.115893] [INFO ] [MAIN ] TVE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:48:10.120843] [DEBUG] [LOCAL ] TVE: Loaded 1853 existing records from primary storage. [2025-09-16T20:48:10.121001] [INFO ] [MAIN ] TVE: Loaded 1853 existing records. [2025-09-16T20:48:10.318263] [WARN ] [MAIN ] TVE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:48:10.318874] [INFO ] [MAIN ] TVE: Wiping existing primary data before full refresh. [2025-09-16T20:48:10.318981] [INFO ] [LOCAL ] TVE: Starting deletion of primary data. [2025-09-16T20:48:10.326901] [DEBUG] [LOCAL ] TVE: Deleted primary data file. [2025-09-16T20:48:10.340878] [INFO ] [MAIN ] TVE: Starting full primary refresh. [2025-09-16T20:48:10.389147] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-16T20:48:10.455567] [INFO ] [REMOTE ] TUYA: Full fetch complete (51170 records). [2025-09-16T20:48:10.456151] [DEBUG] [VALIDATOR ] TUYA: Validating primary data. [2025-09-16T20:48:10.793086] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-03. [2025-09-16T20:48:11.013898] [INFO ] [REMOTE ] TVE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:48:11.131065] [DEBUG] [VALIDATOR ] TUYA: All expected trading days are present. [2025-09-16T20:48:11.131157] [DEBUG] [VALIDATOR ] TUYA: Primary data validation passed. [2025-09-16T20:48:11.132298] [INFO ] [MAIN ] TUYA: Fetched primary data is valid. [2025-09-16T20:48:11.132367] [DEBUG] [LOCAL ] TUYA: Saving primary data. [2025-09-16T20:48:11.133715] [DEBUG] [LOCAL ] TUYA: Trimmed 51170 records to 34277 (keeping 150 days of data) [2025-09-16T20:48:11.331980] [DEBUG] [LOCAL ] TUYA: Primary data saved (34277 records). [2025-09-16T20:48:11.332135] [INFO ] [MAIN ] TUYA: Full history saved. [2025-09-16T20:48:11.332231] [INFO ] [MAIN ] Update Progress: 2147/2369 symbols completed. TUYA took 23.5s. Estimated remaining: 23m 35s. Rate: 9.4 symbols/min [2025-09-16T20:48:11.502135] [INFO ] [MAIN ] TWI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:48:11.524426] [DEBUG] [LOCAL ] TWI: Loaded 24437 existing records from primary storage. [2025-09-16T20:48:11.524560] [INFO ] [MAIN ] TWI: Loaded 24437 existing records. [2025-09-16T20:48:11.587173] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-02. [2025-09-16T20:48:11.705308] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-16T20:48:11.719132] [WARN ] [MAIN ] TWI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:48:11.719738] [INFO ] [MAIN ] TWI: Wiping existing primary data before full refresh. [2025-09-16T20:48:11.719833] [INFO ] [LOCAL ] TWI: Starting deletion of primary data. [2025-09-16T20:48:11.720453] [DEBUG] [LOCAL ] TWI: Deleted primary data file. [2025-09-16T20:48:11.720543] [INFO ] [MAIN ] TWI: Starting full primary refresh. [2025-09-16T20:48:12.028571] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-16T20:48:12.128072] [INFO ] [REMOTE ] TWI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:48:12.282987] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-16T20:48:12.374913] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-02. [2025-09-16T20:48:13.174944] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-04. [2025-09-16T20:48:13.974905] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-06. [2025-09-16T20:48:14.182170] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-16T20:48:14.456470] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-16T20:48:14.774902] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-03. [2025-09-16T20:48:15.574870] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-05. [2025-09-16T20:48:16.199834] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-09-16T20:48:16.219841] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-16T20:48:16.374900] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-06. [2025-09-16T20:48:16.435174] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-16T20:48:17.117303] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-16T20:48:17.174868] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-07. [2025-09-16T20:48:17.727186] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-16T20:48:17.974908] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-03. [2025-09-16T20:48:18.561102] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-16T20:48:18.774910] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-04. [2025-09-16T20:48:19.326245] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-16T20:48:19.574917] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-04. [2025-09-16T20:48:20.374929] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-05. [2025-09-16T20:48:20.979803] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-16T20:48:21.180675] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-06. [2025-09-16T20:48:21.200956] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-16T20:48:21.874918] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-16T20:48:21.974890] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-07. [2025-09-16T20:48:22.774888] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-07. [2025-09-16T20:48:23.360416] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-16T20:48:23.565962] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-16T20:48:23.574924] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-08. [2025-09-16T20:48:24.374901] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-05. [2025-09-16T20:48:25.174898] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-08. [2025-09-16T20:48:25.260673] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-16T20:48:25.701194] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-16T20:48:25.974905] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-09. [2025-09-16T20:48:26.029937] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-16T20:48:26.494193] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-16T20:48:26.495250] [INFO ] [REMOTE ] TVE: Full fetch complete (3137 records). [2025-09-16T20:48:26.495333] [DEBUG] [VALIDATOR ] TVE: Validating primary data. [2025-09-16T20:48:26.780017] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-09. [2025-09-16T20:48:26.885588] [DEBUG] [VALIDATOR ] TVE: All expected trading days are present. [2025-09-16T20:48:26.885686] [DEBUG] [VALIDATOR ] TVE: Primary data validation passed. [2025-09-16T20:48:26.885802] [INFO ] [MAIN ] TVE: Fetched primary data is valid. [2025-09-16T20:48:26.885841] [DEBUG] [LOCAL ] TVE: Saving primary data. [2025-09-16T20:48:26.886193] [DEBUG] [LOCAL ] TVE: Trimmed 3137 records to 1871 (keeping 150 days of data) [2025-09-16T20:48:26.898214] [DEBUG] [LOCAL ] TVE: Primary data saved (1871 records). [2025-09-16T20:48:26.898291] [INFO ] [MAIN ] TVE: Full history saved. [2025-09-16T20:48:26.898367] [INFO ] [MAIN ] Update Progress: 2148/2369 symbols completed. TVE took 17.0s. Estimated remaining: 23m 30s. Rate: 9.4 symbols/min [2025-09-16T20:48:27.066746] [INFO ] [MAIN ] TWLO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:48:27.110073] [DEBUG] [LOCAL ] TWLO: Loaded 38952 existing records from primary storage. [2025-09-16T20:48:27.110294] [INFO ] [MAIN ] TWLO: Loaded 38952 existing records. [2025-09-16T20:48:27.294153] [WARN ] [MAIN ] TWLO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:48:27.294391] [INFO ] [MAIN ] TWLO: Wiping existing primary data before full refresh. [2025-09-16T20:48:27.294451] [INFO ] [LOCAL ] TWLO: Starting deletion of primary data. [2025-09-16T20:48:27.295285] [DEBUG] [LOCAL ] TWLO: Deleted primary data file. [2025-09-16T20:48:27.295336] [INFO ] [MAIN ] TWLO: Starting full primary refresh. [2025-09-16T20:48:27.580065] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-08. [2025-09-16T20:48:27.695269] [INFO ] [REMOTE ] TWLO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:48:28.261489] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-16T20:48:28.278975] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-16T20:48:28.286084] [INFO ] [REMOTE ] TV: Full fetch complete (46908 records). [2025-09-16T20:48:28.286197] [DEBUG] [VALIDATOR ] TV: Validating primary data. [2025-09-16T20:48:28.379974] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-02. [2025-09-16T20:48:28.661816] [DEBUG] [VALIDATOR ] TV: All expected trading days are present. [2025-09-16T20:48:28.661920] [DEBUG] [VALIDATOR ] TV: Primary data validation passed. [2025-09-16T20:48:28.662793] [INFO ] [MAIN ] TV: Fetched primary data is valid. [2025-09-16T20:48:28.662837] [DEBUG] [LOCAL ] TV: Saving primary data. [2025-09-16T20:48:28.663915] [DEBUG] [LOCAL ] TV: Trimmed 46908 records to 31597 (keeping 150 days of data) [2025-09-16T20:48:28.849589] [DEBUG] [LOCAL ] TV: Primary data saved (31597 records). [2025-09-16T20:48:28.849748] [INFO ] [MAIN ] TV: Full history saved. [2025-09-16T20:48:28.849848] [INFO ] [MAIN ] Update Progress: 2149/2369 symbols completed. TV took 29.5s. Estimated remaining: 23m 23s. Rate: 9.4 symbols/min [2025-09-16T20:48:29.020403] [INFO ] [MAIN ] TWN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:48:29.024202] [DEBUG] [LOCAL ] TWN: Loaded 2052 existing records from primary storage. [2025-09-16T20:48:29.024292] [INFO ] [MAIN ] TWN: Loaded 2052 existing records. [2025-09-16T20:48:29.180316] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-09. [2025-09-16T20:48:29.202454] [WARN ] [MAIN ] TWN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:48:29.203313] [INFO ] [MAIN ] TWN: Wiping existing primary data before full refresh. [2025-09-16T20:48:29.203361] [INFO ] [LOCAL ] TWN: Starting deletion of primary data. [2025-09-16T20:48:29.203568] [DEBUG] [LOCAL ] TWN: Deleted primary data file. [2025-09-16T20:48:29.203615] [INFO ] [MAIN ] TWN: Starting full primary refresh. [2025-09-16T20:48:29.551680] [INFO ] [REMOTE ] TWN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:48:29.822228] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-16T20:48:29.823215] [INFO ] [REMOTE ] TVC: Full fetch complete (3939 records). [2025-09-16T20:48:29.823301] [DEBUG] [VALIDATOR ] TVC: Validating primary data. [2025-09-16T20:48:29.981671] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-02. [2025-09-16T20:48:30.183358] [DEBUG] [VALIDATOR ] TVC: All expected trading days are present. [2025-09-16T20:48:30.183435] [DEBUG] [VALIDATOR ] TVC: Primary data validation passed. [2025-09-16T20:48:30.183566] [INFO ] [MAIN ] TVC: Fetched primary data is valid. [2025-09-16T20:48:30.183606] [DEBUG] [LOCAL ] TVC: Saving primary data. [2025-09-16T20:48:30.184003] [DEBUG] [LOCAL ] TVC: Trimmed 3939 records to 2406 (keeping 150 days of data) [2025-09-16T20:48:30.200144] [DEBUG] [LOCAL ] TVC: Primary data saved (2406 records). [2025-09-16T20:48:30.200243] [INFO ] [MAIN ] TVC: Full history saved. [2025-09-16T20:48:30.200324] [INFO ] [MAIN ] Update Progress: 2150/2369 symbols completed. TVC took 22.5s. Estimated remaining: 23m 16s. Rate: 9.4 symbols/min [2025-09-16T20:48:30.377751] [INFO ] [MAIN ] TWO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:48:30.420365] [DEBUG] [LOCAL ] TWO: Loaded 35614 existing records from primary storage. [2025-09-16T20:48:30.420566] [INFO ] [MAIN ] TWO: Loaded 35614 existing records. [2025-09-16T20:48:30.599940] [WARN ] [MAIN ] TWO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:48:30.600541] [INFO ] [MAIN ] TWO: Wiping existing primary data before full refresh. [2025-09-16T20:48:30.600631] [INFO ] [LOCAL ] TWO: Starting deletion of primary data. [2025-09-16T20:48:30.601348] [DEBUG] [LOCAL ] TWO: Deleted primary data file. [2025-09-16T20:48:30.601395] [INFO ] [MAIN ] TWO: Starting full primary refresh. [2025-09-16T20:48:30.779809] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-06. [2025-09-16T20:48:30.800727] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-09-16T20:48:31.012937] [INFO ] [REMOTE ] TWO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:48:31.151813] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-16T20:48:31.574912] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-03. [2025-09-16T20:48:32.143384] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-16T20:48:32.180697] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-16T20:48:32.374925] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-04. [2025-09-16T20:48:33.099958] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-16T20:48:33.174883] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-05. [2025-09-16T20:48:33.776281] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-16T20:48:33.974887] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-02. [2025-09-16T20:48:34.774921] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-03. [2025-09-16T20:48:35.574901] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-06. [2025-09-16T20:48:35.656859] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-16T20:48:36.127318] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-16T20:48:36.374881] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-07. [2025-09-16T20:48:36.435560] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-16T20:48:36.925354] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-16T20:48:37.174925] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-08. [2025-09-16T20:48:37.572034] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-16T20:48:37.974909] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-04. [2025-09-16T20:48:38.774903] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-07. [2025-09-16T20:48:39.574883] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-09. [2025-09-16T20:48:39.776789] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-16T20:48:40.170340] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-16T20:48:40.171252] [INFO ] [REMOTE ] TWN: Full fetch complete (3668 records). [2025-09-16T20:48:40.171320] [DEBUG] [VALIDATOR ] TWN: Validating primary data. [2025-09-16T20:48:40.381268] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-03. [2025-09-16T20:48:40.535086] [DEBUG] [VALIDATOR ] TWN: All expected trading days are present. [2025-09-16T20:48:40.535274] [DEBUG] [VALIDATOR ] TWN: Primary data validation passed. [2025-09-16T20:48:40.535398] [INFO ] [MAIN ] TWN: Fetched primary data is valid. [2025-09-16T20:48:40.535448] [DEBUG] [LOCAL ] TWN: Saving primary data. [2025-09-16T20:48:40.535952] [DEBUG] [LOCAL ] TWN: Trimmed 3668 records to 2061 (keeping 150 days of data) [2025-09-16T20:48:40.565182] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-16T20:48:40.575485] [DEBUG] [LOCAL ] TWN: Primary data saved (2061 records). [2025-09-16T20:48:40.575694] [INFO ] [MAIN ] TWN: Full history saved. [2025-09-16T20:48:40.575791] [INFO ] [MAIN ] Update Progress: 2151/2369 symbols completed. TWN took 11.7s. Estimated remaining: 23m 10s. Rate: 9.4 symbols/min [2025-09-16T20:48:40.758002] [INFO ] [MAIN ] TWOD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:48:40.758209] [DEBUG] [LOCAL ] TWOD: No existing data file found in primary storage. [2025-09-16T20:48:40.758251] [WARN ] [MAIN ] TWOD: No existing data found, performing full refresh instead. [2025-09-16T20:48:40.758375] [INFO ] [MAIN ] TWOD: Wiping existing primary data before full refresh. [2025-09-16T20:48:40.758482] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-09-16T20:48:40.758554] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-09-16T20:48:40.758601] [INFO ] [MAIN ] TWOD: Starting full primary refresh. [2025-09-16T20:48:41.116519] [INFO ] [REMOTE ] TWOD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:48:41.174878] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-02. [2025-09-16T20:48:41.454626] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:48:41.455024] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-02 [2025-09-16T20:48:41.974954] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-05. [2025-09-16T20:48:42.159103] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-16T20:48:42.774888] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-08. [2025-09-16T20:48:43.574908] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-03. [2025-09-16T20:48:43.949257] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:48:43.952539] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-03 [2025-09-16T20:48:43.954488] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-16T20:48:44.080308] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-16T20:48:44.374899] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-06. [2025-09-16T20:48:45.174934] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-09. [2025-09-16T20:48:45.974876] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-04. [2025-09-16T20:48:46.224599] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-16T20:48:46.367596] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:48:46.368037] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-04 [2025-09-16T20:48:46.378330] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-16T20:48:46.382568] [INFO ] [REMOTE ] TWI: Full fetch complete (38588 records). [2025-09-16T20:48:46.382751] [DEBUG] [VALIDATOR ] TWI: Validating primary data. [2025-09-16T20:48:46.761260] [DEBUG] [VALIDATOR ] TWI: All expected trading days are present. [2025-09-16T20:48:46.761341] [DEBUG] [VALIDATOR ] TWI: Primary data validation passed. [2025-09-16T20:48:46.762107] [INFO ] [MAIN ] TWI: Fetched primary data is valid. [2025-09-16T20:48:46.762151] [DEBUG] [LOCAL ] TWI: Saving primary data. [2025-09-16T20:48:46.763039] [DEBUG] [LOCAL ] TWI: Trimmed 38588 records to 24637 (keeping 150 days of data) [2025-09-16T20:48:46.813412] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-04. [2025-09-16T20:48:46.907582] [DEBUG] [LOCAL ] TWI: Primary data saved (24637 records). [2025-09-16T20:48:46.907740] [INFO ] [MAIN ] TWI: Full history saved. [2025-09-16T20:48:46.907838] [INFO ] [MAIN ] Update Progress: 2152/2369 symbols completed. TWI took 35.6s. Estimated remaining: 23m 4s. Rate: 9.4 symbols/min [2025-09-16T20:48:47.080716] [INFO ] [MAIN ] TX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:48:47.097620] [DEBUG] [LOCAL ] TX: Loaded 16935 existing records from primary storage. [2025-09-16T20:48:47.097778] [INFO ] [MAIN ] TX: Loaded 16935 existing records. [2025-09-16T20:48:47.283579] [WARN ] [MAIN ] TX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:48:47.283954] [INFO ] [MAIN ] TX: Wiping existing primary data before full refresh. [2025-09-16T20:48:47.284026] [INFO ] [LOCAL ] TX: Starting deletion of primary data. [2025-09-16T20:48:47.284456] [DEBUG] [LOCAL ] TX: Deleted primary data file. [2025-09-16T20:48:47.284505] [INFO ] [MAIN ] TX: Starting full primary refresh. [2025-09-16T20:48:47.575710] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-07. [2025-09-16T20:48:47.651838] [INFO ] [REMOTE ] TX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:48:48.374899] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-05. [2025-09-16T20:48:48.970144] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-16T20:48:49.174933] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-02. [2025-09-16T20:48:49.183519] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-16T20:48:49.590057] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-16T20:48:49.974907] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-08. [2025-09-16T20:48:50.301017] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-16T20:48:50.774940] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-05. [2025-09-16T20:48:51.574928] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-06. [2025-09-16T20:48:52.126689] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-16T20:48:52.215069] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-16T20:48:52.374881] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-09. [2025-09-16T20:48:52.538446] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-16T20:48:53.174951] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-03. [2025-09-16T20:48:53.974901] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-07. [2025-09-16T20:48:54.191723] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-16T20:48:54.198076] [INFO ] [REMOTE ] TWLO: Full fetch complete (57392 records). [2025-09-16T20:48:54.198194] [DEBUG] [VALIDATOR ] TWLO: Validating primary data. [2025-09-16T20:48:54.520064] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-16T20:48:54.610917] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-16T20:48:54.632813] [DEBUG] [VALIDATOR ] TWLO: All expected trading days are present. [2025-09-16T20:48:54.632971] [DEBUG] [VALIDATOR ] TWLO: Primary data validation passed. [2025-09-16T20:48:54.634489] [INFO ] [MAIN ] TWLO: Fetched primary data is valid. [2025-09-16T20:48:54.634542] [DEBUG] [LOCAL ] TWLO: Saving primary data. [2025-09-16T20:48:54.635596] [DEBUG] [LOCAL ] TWLO: Trimmed 57392 records to 39340 (keeping 150 days of data) [2025-09-16T20:48:54.810152] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-06. [2025-09-16T20:48:54.879620] [DEBUG] [LOCAL ] TWLO: Primary data saved (39340 records). [2025-09-16T20:48:54.879752] [INFO ] [MAIN ] TWLO: Full history saved. [2025-09-16T20:48:54.879833] [INFO ] [MAIN ] Update Progress: 2153/2369 symbols completed. TWLO took 28.0s. Estimated remaining: 22m 58s. Rate: 9.4 symbols/min [2025-09-16T20:48:55.060032] [INFO ] [MAIN ] TXNM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:48:55.089513] [DEBUG] [LOCAL ] TXNM: Loaded 32065 existing records from primary storage. [2025-09-16T20:48:55.089689] [INFO ] [MAIN ] TXNM: Loaded 32065 existing records. [2025-09-16T20:48:55.267349] [WARN ] [MAIN ] TXNM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:48:55.267639] [INFO ] [MAIN ] TXNM: Wiping existing primary data before full refresh. [2025-09-16T20:48:55.267724] [INFO ] [LOCAL ] TXNM: Starting deletion of primary data. [2025-09-16T20:48:55.268369] [DEBUG] [LOCAL ] TXNM: Deleted primary data file. [2025-09-16T20:48:55.268414] [INFO ] [MAIN ] TXNM: Starting full primary refresh. [2025-09-16T20:48:55.580002] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-08. [2025-09-16T20:48:55.641469] [INFO ] [REMOTE ] TXNM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:48:56.374875] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-02. [2025-09-16T20:48:56.546690] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-16T20:48:56.582529] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-16T20:48:57.174911] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-04. [2025-09-16T20:48:57.974922] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-09. [2025-09-16T20:48:58.110899] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-16T20:48:58.561352] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-16T20:48:58.590030] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-16T20:48:58.591467] [INFO ] [REMOTE ] TWOD: Full fetch complete (4160 records). [2025-09-16T20:48:58.591536] [DEBUG] [VALIDATOR ] TWOD: Validating primary data. [2025-09-16T20:48:58.773572] [WARN ] [VALIDATOR ] TWOD: Validation failed - insufficient historical data. Have 84 unique days, need 150 days [2025-09-16T20:48:58.773820] [FATAL] [MAIN ] TWOD: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:48:58.773870] [WARN ] [MAIN ] TWOD: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:48:58.773938] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-09-16T20:48:58.774011] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-09-16T20:48:58.774051] [INFO ] [LOCAL ] TWOD: Starting deletion of derivative data. [2025-09-16T20:48:58.774109] [DEBUG] [LOCAL ] TWOD: No derivative data file found to delete. [2025-09-16T20:48:58.774188] [INFO ] [MAIN ] Update Progress: 2154/2369 symbols completed. TWOD took 18.2s. Estimated remaining: 22m 51s. Rate: 9.4 symbols/min [2025-09-16T20:48:58.779976] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-07. [2025-09-16T20:48:58.946197] [INFO ] [MAIN ] TXO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:48:58.962889] [DEBUG] [LOCAL ] TXO: Loaded 15063 existing records from primary storage. [2025-09-16T20:48:58.963023] [INFO ] [MAIN ] TXO: Loaded 15063 existing records. [2025-09-16T20:48:59.137376] [WARN ] [MAIN ] TXO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:48:59.137631] [INFO ] [MAIN ] TXO: Wiping existing primary data before full refresh. [2025-09-16T20:48:59.137701] [INFO ] [LOCAL ] TXO: Starting deletion of primary data. [2025-09-16T20:48:59.138181] [DEBUG] [LOCAL ] TXO: Deleted primary data file. [2025-09-16T20:48:59.138229] [INFO ] [MAIN ] TXO: Starting full primary refresh. [2025-09-16T20:48:59.492523] [INFO ] [REMOTE ] TXO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:48:59.574850] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-02. [2025-09-16T20:49:00.374869] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-05. [2025-09-16T20:49:00.751551] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-16T20:49:00.774361] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-16T20:49:01.174863] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-03. [2025-09-16T20:49:01.550257] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-16T20:49:01.974909] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-03. [2025-09-16T20:49:02.159183] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-16T20:49:02.774927] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-06. [2025-09-16T20:49:03.574890] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-04. [2025-09-16T20:49:03.849172] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-16T20:49:03.999485] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-16T20:49:04.156416] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-16T20:49:04.374882] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-05. [2025-09-16T20:49:05.174874] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-04. [2025-09-16T20:49:05.568119] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-16T20:49:05.974901] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-07. [2025-09-16T20:49:06.774926] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-06. [2025-09-16T20:49:07.002074] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-16T20:49:07.303553] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-16T20:49:07.574895] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-05. [2025-09-16T20:49:08.158805] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-16T20:49:08.374891] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-08. [2025-09-16T20:49:09.174938] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-07. [2025-09-16T20:49:09.354283] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-16T20:49:09.719027] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-16T20:49:09.918357] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-16T20:49:09.974930] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-06. [2025-09-16T20:49:10.774974] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-09. [2025-09-16T20:49:11.574932] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-08. [2025-09-16T20:49:11.711129] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-16T20:49:11.833244] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-16T20:49:11.836606] [INFO ] [REMOTE ] TX: Full fetch complete (26807 records). [2025-09-16T20:49:11.836758] [DEBUG] [VALIDATOR ] TX: Validating primary data. [2025-09-16T20:49:12.211358] [DEBUG] [VALIDATOR ] TX: All expected trading days are present. [2025-09-16T20:49:12.211471] [DEBUG] [VALIDATOR ] TX: Primary data validation passed. [2025-09-16T20:49:12.212287] [INFO ] [MAIN ] TX: Fetched primary data is valid. [2025-09-16T20:49:12.212334] [DEBUG] [LOCAL ] TX: Saving primary data. [2025-09-16T20:49:12.213178] [DEBUG] [LOCAL ] TX: Trimmed 26807 records to 17035 (keeping 150 days of data) [2025-09-16T20:49:12.322049] [DEBUG] [LOCAL ] TX: Primary data saved (17035 records). [2025-09-16T20:49:12.322274] [INFO ] [MAIN ] TX: Full history saved. [2025-09-16T20:49:12.322387] [INFO ] [MAIN ] Update Progress: 2155/2369 symbols completed. TX took 25.4s. Estimated remaining: 22m 45s. Rate: 9.4 symbols/min [2025-09-16T20:49:12.386149] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-08. [2025-09-16T20:49:12.498000] [INFO ] [MAIN ] TXT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:49:12.537198] [DEBUG] [LOCAL ] TXT: Loaded 36537 existing records from primary storage. [2025-09-16T20:49:12.537438] [INFO ] [MAIN ] TXT: Loaded 36537 existing records. [2025-09-16T20:49:12.719048] [WARN ] [MAIN ] TXT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:49:12.719403] [INFO ] [MAIN ] TXT: Wiping existing primary data before full refresh. [2025-09-16T20:49:12.719452] [INFO ] [LOCAL ] TXT: Starting deletion of primary data. [2025-09-16T20:49:12.720513] [DEBUG] [LOCAL ] TXT: Deleted primary data file. [2025-09-16T20:49:12.720563] [INFO ] [MAIN ] TXT: Starting full primary refresh. [2025-09-16T20:49:13.086387] [INFO ] [REMOTE ] TXT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:49:13.174949] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-02. [2025-09-16T20:49:13.430349] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-16T20:49:13.453827] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-16T20:49:13.974914] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-09. [2025-09-16T20:49:14.774943] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-07. [2025-09-16T20:49:15.029070] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-16T20:49:15.368115] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-16T20:49:15.376357] [INFO ] [REMOTE ] TWO: Full fetch complete (51974 records). [2025-09-16T20:49:15.376513] [DEBUG] [VALIDATOR ] TWO: Validating primary data. [2025-09-16T20:49:15.580112] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-03. [2025-09-16T20:49:15.788054] [DEBUG] [VALIDATOR ] TWO: All expected trading days are present. [2025-09-16T20:49:15.788179] [DEBUG] [VALIDATOR ] TWO: Primary data validation passed. [2025-09-16T20:49:15.789088] [INFO ] [MAIN ] TWO: Fetched primary data is valid. [2025-09-16T20:49:15.789136] [DEBUG] [LOCAL ] TWO: Saving primary data. [2025-09-16T20:49:15.790218] [DEBUG] [LOCAL ] TWO: Trimmed 51974 records to 35938 (keeping 150 days of data) [2025-09-16T20:49:16.006074] [DEBUG] [LOCAL ] TWO: Primary data saved (35938 records). [2025-09-16T20:49:16.006217] [INFO ] [MAIN ] TWO: Full history saved. [2025-09-16T20:49:16.006919] [INFO ] [MAIN ] Update Progress: 2156/2369 symbols completed. TWO took 45.8s. Estimated remaining: 22m 39s. Rate: 9.4 symbols/min [2025-09-16T20:49:16.183101] [INFO ] [MAIN ] TY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:49:16.191669] [DEBUG] [LOCAL ] TY: Loaded 5431 existing records from primary storage. [2025-09-16T20:49:16.191798] [INFO ] [MAIN ] TY: Loaded 5431 existing records. [2025-09-16T20:49:16.374791] [WARN ] [MAIN ] TY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:49:16.374867] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-09. [2025-09-16T20:49:16.375916] [INFO ] [MAIN ] TY: Wiping existing primary data before full refresh. [2025-09-16T20:49:16.375984] [INFO ] [LOCAL ] TY: Starting deletion of primary data. [2025-09-16T20:49:16.376259] [DEBUG] [LOCAL ] TY: Deleted primary data file. [2025-09-16T20:49:16.376316] [INFO ] [MAIN ] TY: Starting full primary refresh. [2025-09-16T20:49:16.753855] [INFO ] [REMOTE ] TY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:49:16.779861] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-16T20:49:17.162713] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-16T20:49:17.174837] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-04. [2025-09-16T20:49:17.467118] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-16T20:49:17.469923] [INFO ] [REMOTE ] TXO: Full fetch complete (20872 records). [2025-09-16T20:49:17.470036] [DEBUG] [VALIDATOR ] TXO: Validating primary data. [2025-09-16T20:49:17.829458] [DEBUG] [VALIDATOR ] TXO: All expected trading days are present. [2025-09-16T20:49:17.829538] [DEBUG] [VALIDATOR ] TXO: Primary data validation passed. [2025-09-16T20:49:17.830042] [INFO ] [MAIN ] TXO: Fetched primary data is valid. [2025-09-16T20:49:17.830092] [DEBUG] [LOCAL ] TXO: Saving primary data. [2025-09-16T20:49:17.830740] [DEBUG] [LOCAL ] TXO: Trimmed 20872 records to 15226 (keeping 150 days of data) [2025-09-16T20:49:17.922297] [DEBUG] [LOCAL ] TXO: Primary data saved (15226 records). [2025-09-16T20:49:17.922430] [INFO ] [MAIN ] TXO: Full history saved. [2025-09-16T20:49:17.922513] [INFO ] [MAIN ] Update Progress: 2157/2369 symbols completed. TXO took 19.1s. Estimated remaining: 22m 32s. Rate: 9.4 symbols/min [2025-09-16T20:49:17.974860] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-02. [2025-09-16T20:49:18.774914] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-08. [2025-09-16T20:49:19.096521] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-16T20:49:19.114789] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-16T20:49:19.574907] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-03. [2025-09-16T20:49:20.374971] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-05. [2025-09-16T20:49:20.618076] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-16T20:49:20.624591] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-16T20:49:21.174909] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-04. [2025-09-16T20:49:21.974922] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-09. [2025-09-16T20:49:22.036273] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-16T20:49:22.211847] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-16T20:49:22.774907] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-05. [2025-09-16T20:49:23.351357] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-16T20:49:23.356202] [INFO ] [REMOTE ] TXNM: Full fetch complete (47910 records). [2025-09-16T20:49:23.356292] [DEBUG] [VALIDATOR ] TXNM: Validating primary data. [2025-09-16T20:49:23.587943] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-06. [2025-09-16T20:49:23.744786] [DEBUG] [VALIDATOR ] TXNM: All expected trading days are present. [2025-09-16T20:49:23.749786] [DEBUG] [VALIDATOR ] TXNM: Primary data validation passed. [2025-09-16T20:49:23.750980] [INFO ] [MAIN ] TXNM: Fetched primary data is valid. [2025-09-16T20:49:23.751087] [DEBUG] [LOCAL ] TXNM: Saving primary data. [2025-09-16T20:49:23.752156] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-16T20:49:23.755212] [DEBUG] [LOCAL ] TXNM: Trimmed 47910 records to 32423 (keeping 150 days of data) [2025-09-16T20:49:23.960615] [DEBUG] [LOCAL ] TXNM: Primary data saved (32423 records). [2025-09-16T20:49:23.960930] [INFO ] [MAIN ] TXNM: Full history saved. [2025-09-16T20:49:23.961029] [INFO ] [MAIN ] Update Progress: 2158/2369 symbols completed. TXNM took 29.1s. Estimated remaining: 22m 25s. Rate: 9.4 symbols/min [2025-09-16T20:49:24.374945] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-06. [2025-09-16T20:49:25.197368] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-16T20:49:25.199773] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-07. [2025-09-16T20:49:25.497134] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-16T20:49:25.886968] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-16T20:49:25.974907] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-08. [2025-09-16T20:49:26.774913] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-07. [2025-09-16T20:49:26.842424] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-16T20:49:27.574895] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-09. [2025-09-16T20:49:28.315264] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-16T20:49:28.316745] [INFO ] [REMOTE ] TY: Full fetch complete (8504 records). [2025-09-16T20:49:28.316823] [DEBUG] [VALIDATOR ] TY: Validating primary data. [2025-09-16T20:49:28.694739] [DEBUG] [VALIDATOR ] TY: All expected trading days are present. [2025-09-16T20:49:28.694829] [DEBUG] [VALIDATOR ] TY: Primary data validation passed. [2025-09-16T20:49:28.695056] [INFO ] [MAIN ] TY: Fetched primary data is valid. [2025-09-16T20:49:28.695149] [DEBUG] [LOCAL ] TY: Saving primary data. [2025-09-16T20:49:28.695662] [DEBUG] [LOCAL ] TY: Trimmed 8504 records to 5517 (keeping 150 days of data) [2025-09-16T20:49:28.732739] [DEBUG] [LOCAL ] TY: Primary data saved (5517 records). [2025-09-16T20:49:28.732925] [INFO ] [MAIN ] TY: Full history saved. [2025-09-16T20:49:28.733037] [INFO ] [MAIN ] Update Progress: 2159/2369 symbols completed. TY took 12.7s. Estimated remaining: 22m 19s. Rate: 9.4 symbols/min [2025-09-16T20:49:28.853079] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-16T20:49:28.864489] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-08. [2025-09-16T20:49:30.747153] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-16T20:49:30.757636] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-09. [2025-09-16T20:49:32.192379] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-16T20:49:32.201105] [INFO ] [REMOTE ] TXT: Full fetch complete (54226 records). [2025-09-16T20:49:32.201304] [DEBUG] [VALIDATOR ] TXT: Validating primary data. [2025-09-16T20:49:32.595282] [DEBUG] [VALIDATOR ] TXT: All expected trading days are present. [2025-09-16T20:49:32.595362] [DEBUG] [VALIDATOR ] TXT: Primary data validation passed. [2025-09-16T20:49:32.596344] [INFO ] [MAIN ] TXT: Fetched primary data is valid. [2025-09-16T20:49:32.596397] [DEBUG] [LOCAL ] TXT: Saving primary data. [2025-09-16T20:49:32.597514] [DEBUG] [LOCAL ] TXT: Trimmed 54226 records to 36917 (keeping 150 days of data) [2025-09-16T20:49:32.825401] [DEBUG] [LOCAL ] TXT: Primary data saved (36917 records). [2025-09-16T20:49:32.825545] [INFO ] [MAIN ] TXT: Full history saved. [2025-09-16T20:49:32.825661] [INFO ] [MAIN ] Update Progress: 2160/2369 symbols completed. TXT took 20.5s. Estimated remaining: 22m 12s. Rate: 9.4 symbols/min [2025-09-16T20:49:33.484482] [INFO ] [MAIN ] TYG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:49:33.481912] [INFO ] [MAIN ] U: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:49:33.488154] [INFO ] [MAIN ] UA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:49:33.564550] [INFO ] [MAIN ] TYL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:49:33.575979] [DEBUG] [LOCAL ] TYG: Loaded 10317 existing records from primary storage. [2025-09-16T20:49:33.576309] [INFO ] [MAIN ] TYG: Loaded 10317 existing records. [2025-09-16T20:49:33.751916] [DEBUG] [LOCAL ] TYL: Loaded 16329 existing records from primary storage. [2025-09-16T20:49:33.790384] [INFO ] [MAIN ] TYL: Loaded 16329 existing records. [2025-09-16T20:49:33.790249] [WARN ] [MAIN ] TYG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:49:33.852905] [INFO ] [MAIN ] TYG: Wiping existing primary data before full refresh. [2025-09-16T20:49:33.858783] [DEBUG] [LOCAL ] UA: Loaded 36851 existing records from primary storage. [2025-09-16T20:49:33.859480] [DEBUG] [LOCAL ] U: Loaded 39759 existing records from primary storage. [2025-09-16T20:49:33.859623] [INFO ] [MAIN ] U: Loaded 39759 existing records. [2025-09-16T20:49:33.858912] [INFO ] [MAIN ] UA: Loaded 36851 existing records. [2025-09-16T20:49:33.859572] [INFO ] [LOCAL ] TYG: Starting deletion of primary data. [2025-09-16T20:49:33.951302] [DEBUG] [LOCAL ] TYG: Deleted primary data file. [2025-09-16T20:49:34.002895] [INFO ] [MAIN ] TYG: Starting full primary refresh. [2025-09-16T20:49:34.246563] [WARN ] [MAIN ] TYL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:49:34.312628] [INFO ] [MAIN ] TYL: Wiping existing primary data before full refresh. [2025-09-16T20:49:34.366755] [INFO ] [LOCAL ] TYL: Starting deletion of primary data. [2025-09-16T20:49:34.408116] [DEBUG] [LOCAL ] TYL: Deleted primary data file. [2025-09-16T20:49:34.537124] [INFO ] [MAIN ] TYL: Starting full primary refresh. [2025-09-16T20:49:34.564023] [WARN ] [MAIN ] UA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:49:34.577598] [WARN ] [MAIN ] U: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:49:34.620584] [INFO ] [MAIN ] UA: Wiping existing primary data before full refresh. [2025-09-16T20:49:34.611986] [INFO ] [MAIN ] U: Wiping existing primary data before full refresh. [2025-09-16T20:49:34.702151] [INFO ] [LOCAL ] UA: Starting deletion of primary data. [2025-09-16T20:49:34.702231] [INFO ] [LOCAL ] U: Starting deletion of primary data. [2025-09-16T20:49:34.731977] [DEBUG] [LOCAL ] UA: Deleted primary data file. [2025-09-16T20:49:34.742404] [INFO ] [MAIN ] UA: Starting full primary refresh. [2025-09-16T20:49:34.745958] [DEBUG] [LOCAL ] U: Deleted primary data file. [2025-09-16T20:49:34.756390] [INFO ] [MAIN ] U: Starting full primary refresh. [2025-09-16T20:49:35.030721] [INFO ] [REMOTE ] TYG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:49:35.085299] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-02. [2025-09-16T20:49:35.721890] [INFO ] [REMOTE ] UA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:49:35.746734] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-02. [2025-09-16T20:49:35.746460] [INFO ] [REMOTE ] TYL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:49:35.762054] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-02. [2025-09-16T20:49:35.797986] [INFO ] [REMOTE ] U: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:49:35.798439] [INFO ] [REMOTE ] U: Fetching primary data for 2025-02. [2025-09-16T20:49:36.551808] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-16T20:49:36.555463] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-03. [2025-09-16T20:49:36.998242] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-16T20:49:37.002572] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-03. [2025-09-16T20:49:37.562341] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-16T20:49:37.571848] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-03. [2025-09-16T20:49:37.633034] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-16T20:49:37.636891] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-04. [2025-09-16T20:49:37.745158] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-16T20:49:37.755160] [INFO ] [REMOTE ] U: Fetching primary data for 2025-03. [2025-09-16T20:49:38.403672] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-16T20:49:38.408988] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-04. [2025-09-16T20:49:38.489788] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-16T20:49:38.495476] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-05. [2025-09-16T20:49:39.345690] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-16T20:49:39.356725] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-04. [2025-09-16T20:49:39.366064] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-16T20:49:39.574979] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-06. [2025-09-16T20:49:39.820153] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-16T20:49:40.213216] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-09-16T20:49:40.374887] [INFO ] [REMOTE ] U: Fetching primary data for 2025-04. [2025-09-16T20:49:40.509315] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-16T20:49:41.174978] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-05. [2025-09-16T20:49:41.363138] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-16T20:49:41.974909] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-05. [2025-09-16T20:49:42.438763] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-16T20:49:42.619214] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-16T20:49:42.774913] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-06. [2025-09-16T20:49:43.574883] [INFO ] [REMOTE ] U: Fetching primary data for 2025-05. [2025-09-16T20:49:43.777031] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-16T20:49:43.970163] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-16T20:49:44.374908] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-07. [2025-09-16T20:49:45.174904] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-06. [2025-09-16T20:49:45.483453] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-16T20:49:45.974883] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-07. [2025-09-16T20:49:46.083477] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-09-16T20:49:46.774905] [INFO ] [REMOTE ] U: Fetching primary data for 2025-06. [2025-09-16T20:49:46.918953] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-16T20:49:47.058484] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-16T20:49:47.574901] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-07. [2025-09-16T20:49:48.374903] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-08. [2025-09-16T20:49:49.174983] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-08. [2025-09-16T20:49:49.344154] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-16T20:49:49.492120] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-16T20:49:49.751421] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-06 (2.98 seconds). [2025-09-16T20:49:49.974910] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-09. [2025-09-16T20:49:50.310294] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-16T20:49:50.774941] [INFO ] [REMOTE ] U: Fetching primary data for 2025-07. [2025-09-16T20:49:50.855869] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-16T20:49:50.857896] [INFO ] [REMOTE ] TYG: Full fetch complete (15981 records). [2025-09-16T20:49:50.857969] [DEBUG] [VALIDATOR ] TYG: Validating primary data. [2025-09-16T20:49:51.240317] [DEBUG] [VALIDATOR ] TYG: All expected trading days are present. [2025-09-16T20:49:51.240409] [DEBUG] [VALIDATOR ] TYG: Primary data validation passed. [2025-09-16T20:49:51.240851] [INFO ] [MAIN ] TYG: Fetched primary data is valid. [2025-09-16T20:49:51.240933] [DEBUG] [LOCAL ] TYG: Saving primary data. [2025-09-16T20:49:51.241553] [DEBUG] [LOCAL ] TYG: Trimmed 15981 records to 10386 (keeping 150 days of data) [2025-09-16T20:49:51.306205] [DEBUG] [LOCAL ] TYG: Primary data saved (10386 records). [2025-09-16T20:49:51.306341] [INFO ] [MAIN ] TYG: Full history saved. [2025-09-16T20:49:51.306463] [INFO ] [MAIN ] Update Progress: 2161/2369 symbols completed. TYG took 18.5s. Estimated remaining: 22m 7s. Rate: 9.4 symbols/min [2025-09-16T20:49:51.477099] [INFO ] [MAIN ] UAA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:49:51.515971] [DEBUG] [LOCAL ] UAA: Loaded 39487 existing records from primary storage. [2025-09-16T20:49:51.516113] [INFO ] [MAIN ] UAA: Loaded 39487 existing records. [2025-09-16T20:49:51.579999] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-09. [2025-09-16T20:49:51.698053] [WARN ] [MAIN ] UAA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:49:51.698288] [INFO ] [MAIN ] UAA: Wiping existing primary data before full refresh. [2025-09-16T20:49:51.698335] [INFO ] [LOCAL ] UAA: Starting deletion of primary data. [2025-09-16T20:49:51.699122] [DEBUG] [LOCAL ] UAA: Deleted primary data file. [2025-09-16T20:49:51.699179] [INFO ] [MAIN ] UAA: Starting full primary refresh. [2025-09-16T20:49:52.060137] [INFO ] [REMOTE ] UAA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:49:52.374857] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-02. [2025-09-16T20:49:52.691766] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-16T20:49:52.694546] [INFO ] [REMOTE ] TYL: Full fetch complete (24381 records). [2025-09-16T20:49:52.694622] [DEBUG] [VALIDATOR ] TYL: Validating primary data. [2025-09-16T20:49:53.064615] [DEBUG] [VALIDATOR ] TYL: All expected trading days are present. [2025-09-16T20:49:53.064768] [DEBUG] [VALIDATOR ] TYL: Primary data validation passed. [2025-09-16T20:49:53.065284] [INFO ] [MAIN ] TYL: Fetched primary data is valid. [2025-09-16T20:49:53.065325] [DEBUG] [LOCAL ] TYL: Saving primary data. [2025-09-16T20:49:53.066068] [DEBUG] [LOCAL ] TYL: Trimmed 24381 records to 16482 (keeping 150 days of data) [2025-09-16T20:49:53.169508] [DEBUG] [LOCAL ] TYL: Primary data saved (16482 records). [2025-09-16T20:49:53.169689] [INFO ] [MAIN ] TYL: Full history saved. [2025-09-16T20:49:53.169797] [INFO ] [MAIN ] Update Progress: 2162/2369 symbols completed. TYL took 20.3s. Estimated remaining: 22m 0s. Rate: 9.4 symbols/min [2025-09-16T20:49:53.181446] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-08. [2025-09-16T20:49:53.344944] [INFO ] [MAIN ] UAN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:49:53.350867] [DEBUG] [LOCAL ] UAN: Loaded 3850 existing records from primary storage. [2025-09-16T20:49:53.350992] [INFO ] [MAIN ] UAN: Loaded 3850 existing records. [2025-09-16T20:49:53.564863] [WARN ] [MAIN ] UAN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:49:53.565177] [INFO ] [MAIN ] UAN: Wiping existing primary data before full refresh. [2025-09-16T20:49:53.565465] [INFO ] [LOCAL ] UAN: Starting deletion of primary data. [2025-09-16T20:49:53.566024] [DEBUG] [LOCAL ] UAN: Deleted primary data file. [2025-09-16T20:49:53.566087] [INFO ] [MAIN ] UAN: Starting full primary refresh. [2025-09-16T20:49:53.600208] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-07 (2.83 seconds). [2025-09-16T20:49:53.942935] [INFO ] [REMOTE ] UAN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:49:53.978442] [INFO ] [REMOTE ] U: Fetching primary data for 2025-08. [2025-09-16T20:49:53.984023] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-16T20:49:54.774875] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-03. [2025-09-16T20:49:54.951415] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-16T20:49:55.574918] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-09. [2025-09-16T20:49:56.374865] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-02. [2025-09-16T20:49:56.406463] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-09-16T20:49:56.872766] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-16T20:49:56.876049] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-16T20:49:57.174895] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-03. [2025-09-16T20:49:57.352231] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-16T20:49:57.358623] [INFO ] [REMOTE ] UA: Full fetch complete (54698 records). [2025-09-16T20:49:57.358779] [DEBUG] [VALIDATOR ] UA: Validating primary data. [2025-09-16T20:49:57.680661] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-16T20:49:57.756974] [DEBUG] [VALIDATOR ] UA: All expected trading days are present. [2025-09-16T20:49:57.757054] [DEBUG] [VALIDATOR ] UA: Primary data validation passed. [2025-09-16T20:49:57.758246] [INFO ] [MAIN ] UA: Fetched primary data is valid. [2025-09-16T20:49:57.758293] [DEBUG] [LOCAL ] UA: Saving primary data. [2025-09-16T20:49:57.759432] [DEBUG] [LOCAL ] UA: Trimmed 54698 records to 37234 (keeping 150 days of data) [2025-09-16T20:49:57.972018] [DEBUG] [LOCAL ] UA: Primary data saved (37234 records). [2025-09-16T20:49:57.972179] [INFO ] [MAIN ] UA: Full history saved. [2025-09-16T20:49:57.972281] [INFO ] [MAIN ] Update Progress: 2163/2369 symbols completed. UA took 25.1s. Estimated remaining: 21m 54s. Rate: 9.4 symbols/min [2025-09-16T20:49:57.983609] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-04. [2025-09-16T20:49:58.159403] [INFO ] [MAIN ] UBER: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:49:58.196597] [DEBUG] [LOCAL ] UBER: Loaded 39766 existing records from primary storage. [2025-09-16T20:49:58.196793] [INFO ] [MAIN ] UBER: Loaded 39766 existing records. [2025-09-16T20:49:58.375473] [WARN ] [MAIN ] UBER: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:49:58.375742] [INFO ] [MAIN ] UBER: Wiping existing primary data before full refresh. [2025-09-16T20:49:58.375795] [INFO ] [LOCAL ] UBER: Starting deletion of primary data. [2025-09-16T20:49:58.376581] [DEBUG] [LOCAL ] UBER: Deleted primary data file. [2025-09-16T20:49:58.376632] [INFO ] [MAIN ] UBER: Starting full primary refresh. [2025-09-16T20:49:58.736412] [INFO ] [REMOTE ] UBER: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:49:58.774921] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-02. [2025-09-16T20:49:58.906160] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-16T20:49:59.574905] [INFO ] [REMOTE ] U: Fetching primary data for 2025-09. [2025-09-16T20:50:00.374932] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-05. [2025-09-16T20:50:01.174933] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-04. [2025-09-16T20:50:01.217030] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-16T20:50:01.328593] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-02 (2.55 seconds). [2025-09-16T20:50:01.974935] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-03. [2025-09-16T20:50:02.004452] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-09-16T20:50:02.011478] [INFO ] [REMOTE ] U: Full fetch complete (58479 records). [2025-09-16T20:50:02.011607] [DEBUG] [VALIDATOR ] U: Validating primary data. [2025-09-16T20:50:02.409190] [DEBUG] [VALIDATOR ] U: All expected trading days are present. [2025-09-16T20:50:02.409291] [DEBUG] [VALIDATOR ] U: Primary data validation passed. [2025-09-16T20:50:02.410762] [INFO ] [MAIN ] U: Fetched primary data is valid. [2025-09-16T20:50:02.410838] [DEBUG] [LOCAL ] U: Saving primary data. [2025-09-16T20:50:02.413805] [DEBUG] [LOCAL ] U: Trimmed 58479 records to 40149 (keeping 150 days of data) [2025-09-16T20:50:02.674533] [DEBUG] [LOCAL ] U: Primary data saved (40149 records). [2025-09-16T20:50:02.674691] [INFO ] [MAIN ] U: Full history saved. [2025-09-16T20:50:02.676052] [INFO ] [MAIN ] Update Progress: 2164/2369 symbols completed. U took 29.8s. Estimated remaining: 21m 47s. Rate: 9.4 symbols/min [2025-09-16T20:50:02.779621] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-06. [2025-09-16T20:50:02.855788] [INFO ] [MAIN ] UBS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:50:02.895735] [DEBUG] [LOCAL ] UBS: Loaded 38554 existing records from primary storage. [2025-09-16T20:50:02.895911] [INFO ] [MAIN ] UBS: Loaded 38554 existing records. [2025-09-16T20:50:03.078720] [WARN ] [MAIN ] UBS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:50:03.079057] [INFO ] [MAIN ] UBS: Wiping existing primary data before full refresh. [2025-09-16T20:50:03.079112] [INFO ] [LOCAL ] UBS: Starting deletion of primary data. [2025-09-16T20:50:03.079809] [DEBUG] [LOCAL ] UBS: Deleted primary data file. [2025-09-16T20:50:03.079856] [INFO ] [MAIN ] UBS: Starting full primary refresh. [2025-09-16T20:50:03.436374] [INFO ] [REMOTE ] UBS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:50:03.474473] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-16T20:50:03.565062] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-16T20:50:03.574848] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-07. [2025-09-16T20:50:03.690242] [DEBUG] [REMOTE ] UAN: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-09-16T20:50:03.690570] [WARN ] [REMOTE ] UAN: No data returned for month 2025-07 [2025-09-16T20:50:04.253495] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-16T20:50:04.374897] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-08. [2025-09-16T20:50:05.039929] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-16T20:50:05.174914] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-02. [2025-09-16T20:50:05.974931] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-05. [2025-09-16T20:50:06.774948] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-09. [2025-09-16T20:50:07.077092] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-16T20:50:07.356668] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-16T20:50:07.357733] [INFO ] [REMOTE ] UAN: Full fetch complete (5465 records). [2025-09-16T20:50:07.357803] [DEBUG] [VALIDATOR ] UAN: Validating primary data. [2025-09-16T20:50:07.555987] [WARN ] [VALIDATOR ] UAN: Validation failed - insufficient historical data. Have 128 unique days, need 150 days [2025-09-16T20:50:07.556239] [FATAL] [MAIN ] UAN: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:50:07.556348] [WARN ] [MAIN ] UAN: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:50:07.556400] [INFO ] [LOCAL ] UAN: Starting deletion of primary data. [2025-09-16T20:50:07.556462] [DEBUG] [LOCAL ] UAN: No primary data file found to delete. [2025-09-16T20:50:07.556507] [INFO ] [LOCAL ] UAN: Starting deletion of derivative data. [2025-09-16T20:50:07.556870] [DEBUG] [LOCAL ] UAN: Deleted derivative data file. [2025-09-16T20:50:07.556974] [INFO ] [MAIN ] Update Progress: 2165/2369 symbols completed. UAN took 14.4s. Estimated remaining: 21m 41s. Rate: 9.4 symbols/min [2025-09-16T20:50:07.580053] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-04. [2025-09-16T20:50:07.734736] [INFO ] [MAIN ] UCB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:50:07.774431] [DEBUG] [LOCAL ] UCB: Loaded 27259 existing records from primary storage. [2025-09-16T20:50:07.774627] [INFO ] [MAIN ] UCB: Loaded 27259 existing records. [2025-09-16T20:50:07.963538] [WARN ] [MAIN ] UCB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:50:07.963999] [INFO ] [MAIN ] UCB: Wiping existing primary data before full refresh. [2025-09-16T20:50:07.964083] [INFO ] [LOCAL ] UCB: Starting deletion of primary data. [2025-09-16T20:50:07.964734] [DEBUG] [LOCAL ] UCB: Deleted primary data file. [2025-09-16T20:50:07.964879] [INFO ] [MAIN ] UCB: Starting full primary refresh. [2025-09-16T20:50:08.162708] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-16T20:50:08.378373] [INFO ] [REMOTE ] UCB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:50:08.378500] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-06. [2025-09-16T20:50:09.174907] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-02. [2025-09-16T20:50:09.974900] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-03. [2025-09-16T20:50:10.167332] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-09-16T20:50:10.272660] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-16T20:50:10.303044] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-16T20:50:10.774958] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-03. [2025-09-16T20:50:11.574903] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-05. [2025-09-16T20:50:11.992686] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-16T20:50:12.374975] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-04. [2025-09-16T20:50:12.633891] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-16T20:50:13.175037] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-07. [2025-09-16T20:50:13.974980] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-04. [2025-09-16T20:50:14.433556] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-16T20:50:14.481087] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-05 (2.91 seconds). [2025-09-16T20:50:14.775006] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-05. [2025-09-16T20:50:14.968250] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-16T20:50:15.574937] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-06. [2025-09-16T20:50:15.664443] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-16T20:50:16.374903] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-05. [2025-09-16T20:50:16.661255] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-16T20:50:17.174940] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-06. [2025-09-16T20:50:17.915179] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-16T20:50:17.974888] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-06. [2025-09-16T20:50:18.238190] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-06 (2.66 seconds). [2025-09-16T20:50:18.774905] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-08. [2025-09-16T20:50:19.057762] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-16T20:50:19.140335] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-16T20:50:19.574913] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-07. [2025-09-16T20:50:20.374868] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-07. [2025-09-16T20:50:20.840965] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-16T20:50:21.180060] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-07. [2025-09-16T20:50:21.192271] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-16T20:50:21.974952] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-08. [2025-09-16T20:50:22.316360] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-16T20:50:22.774910] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-09. [2025-09-16T20:50:23.560831] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-16T20:50:23.574850] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-09. [2025-09-16T20:50:23.660694] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-09-16T20:50:24.374909] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-08. [2025-09-16T20:50:24.703562] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-16T20:50:24.710511] [INFO ] [REMOTE ] UAA: Full fetch complete (58189 records). [2025-09-16T20:50:24.710622] [DEBUG] [VALIDATOR ] UAA: Validating primary data. [2025-09-16T20:50:25.136770] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-16T20:50:25.139580] [DEBUG] [VALIDATOR ] UAA: All expected trading days are present. [2025-09-16T20:50:25.143759] [DEBUG] [VALIDATOR ] UAA: Primary data validation passed. [2025-09-16T20:50:25.144977] [INFO ] [MAIN ] UAA: Fetched primary data is valid. [2025-09-16T20:50:25.145138] [DEBUG] [LOCAL ] UAA: Saving primary data. [2025-09-16T20:50:25.145092] [INFO ] [REMOTE ] UCB: Full fetch complete (41001 records). [2025-09-16T20:50:25.145327] [DEBUG] [VALIDATOR ] UCB: Validating primary data. [2025-09-16T20:50:25.177598] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-08. [2025-09-16T20:50:25.234212] [DEBUG] [LOCAL ] UAA: Trimmed 58189 records to 39875 (keeping 150 days of data) [2025-09-16T20:50:25.621891] [DEBUG] [VALIDATOR ] UCB: All expected trading days are present. [2025-09-16T20:50:25.624212] [DEBUG] [VALIDATOR ] UCB: Primary data validation passed. [2025-09-16T20:50:25.628714] [INFO ] [MAIN ] UCB: Fetched primary data is valid. [2025-09-16T20:50:25.629336] [DEBUG] [LOCAL ] UCB: Saving primary data. [2025-09-16T20:50:25.642975] [DEBUG] [LOCAL ] UCB: Trimmed 41001 records to 27510 (keeping 150 days of data) [2025-09-16T20:50:25.926476] [DEBUG] [LOCAL ] UCB: Primary data saved (27510 records). [2025-09-16T20:50:25.926903] [INFO ] [MAIN ] UCB: Full history saved. [2025-09-16T20:50:25.927224] [INFO ] [MAIN ] Update Progress: 2166/2369 symbols completed. UCB took 18.4s. Estimated remaining: 21m 35s. Rate: 9.4 symbols/min [2025-09-16T20:50:26.047712] [DEBUG] [LOCAL ] UAA: Primary data saved (39875 records). [2025-09-16T20:50:26.058048] [INFO ] [MAIN ] UAA: Full history saved. [2025-09-16T20:50:26.077394] [INFO ] [MAIN ] Update Progress: 2167/2369 symbols completed. UAA took 34.8s. Estimated remaining: 21m 29s. Rate: 9.4 symbols/min [2025-09-16T20:50:26.139092] [INFO ] [MAIN ] UDR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:50:26.284484] [INFO ] [MAIN ] UE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:50:26.309379] [DEBUG] [LOCAL ] UDR: Loaded 38309 existing records from primary storage. [2025-09-16T20:50:26.309576] [INFO ] [MAIN ] UDR: Loaded 38309 existing records. [2025-09-16T20:50:26.512635] [WARN ] [MAIN ] UDR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:50:26.517507] [DEBUG] [LOCAL ] UE: Loaded 31668 existing records from primary storage. [2025-09-16T20:50:26.513133] [INFO ] [MAIN ] UDR: Wiping existing primary data before full refresh. [2025-09-16T20:50:26.517728] [INFO ] [LOCAL ] UDR: Starting deletion of primary data. [2025-09-16T20:50:26.517872] [INFO ] [MAIN ] UE: Loaded 31668 existing records. [2025-09-16T20:50:26.554672] [DEBUG] [LOCAL ] UDR: Deleted primary data file. [2025-09-16T20:50:26.609945] [INFO ] [MAIN ] UDR: Starting full primary refresh. [2025-09-16T20:50:26.779877] [WARN ] [MAIN ] UE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:50:26.806220] [INFO ] [MAIN ] UE: Wiping existing primary data before full refresh. [2025-09-16T20:50:26.810744] [INFO ] [LOCAL ] UE: Starting deletion of primary data. [2025-09-16T20:50:26.821505] [DEBUG] [LOCAL ] UE: Deleted primary data file. [2025-09-16T20:50:26.831821] [INFO ] [MAIN ] UE: Starting full primary refresh. [2025-09-16T20:50:27.269175] [INFO ] [REMOTE ] UDR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:50:27.275062] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-02. [2025-09-16T20:50:27.315791] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-08 (2.94 seconds). [2025-09-16T20:50:27.393442] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-09. [2025-09-16T20:50:27.508664] [INFO ] [REMOTE ] UE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:50:27.547315] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-16T20:50:27.574850] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-09. [2025-09-16T20:50:28.374888] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-02. [2025-09-16T20:50:29.146005] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-16T20:50:29.174847] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-03. [2025-09-16T20:50:29.312566] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-16T20:50:29.318635] [INFO ] [REMOTE ] UBS: Full fetch complete (57021 records). [2025-09-16T20:50:29.318771] [DEBUG] [VALIDATOR ] UBS: Validating primary data. [2025-09-16T20:50:29.696809] [DEBUG] [VALIDATOR ] UBS: All expected trading days are present. [2025-09-16T20:50:29.696903] [DEBUG] [VALIDATOR ] UBS: Primary data validation passed. [2025-09-16T20:50:29.698073] [INFO ] [MAIN ] UBS: Fetched primary data is valid. [2025-09-16T20:50:29.698134] [DEBUG] [LOCAL ] UBS: Saving primary data. [2025-09-16T20:50:29.699856] [DEBUG] [LOCAL ] UBS: Trimmed 57021 records to 38933 (keeping 150 days of data) [2025-09-16T20:50:29.716959] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-09-16T20:50:29.781501] [INFO ] [REMOTE ] UBER: Full fetch complete (58486 records). [2025-09-16T20:50:29.781706] [DEBUG] [VALIDATOR ] UBER: Validating primary data. [2025-09-16T20:50:30.221895] [DEBUG] [VALIDATOR ] UBER: All expected trading days are present. [2025-09-16T20:50:30.222527] [DEBUG] [VALIDATOR ] UBER: Primary data validation passed. [2025-09-16T20:50:30.223872] [INFO ] [MAIN ] UBER: Fetched primary data is valid. [2025-09-16T20:50:30.223977] [DEBUG] [LOCAL ] UBER: Saving primary data. [2025-09-16T20:50:30.249828] [DEBUG] [LOCAL ] UBER: Trimmed 58486 records to 40156 (keeping 150 days of data) [2025-09-16T20:50:30.253987] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-16T20:50:30.263152] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-03. [2025-09-16T20:50:30.621416] [DEBUG] [LOCAL ] UBER: Primary data saved (40156 records). [2025-09-16T20:50:30.625975] [INFO ] [MAIN ] UBER: Full history saved. [2025-09-16T20:50:30.625753] [DEBUG] [LOCAL ] UBS: Primary data saved (38933 records). [2025-09-16T20:50:30.626122] [INFO ] [MAIN ] Update Progress: 2168/2369 symbols completed. UBER took 32.7s. Estimated remaining: 21m 22s. Rate: 9.4 symbols/min [2025-09-16T20:50:30.626205] [INFO ] [MAIN ] UBS: Full history saved. [2025-09-16T20:50:30.647180] [INFO ] [MAIN ] Update Progress: 2169/2369 symbols completed. UBS took 28.0s. Estimated remaining: 21m 15s. Rate: 9.4 symbols/min [2025-09-16T20:50:30.908071] [INFO ] [MAIN ] UFI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:50:30.972663] [INFO ] [MAIN ] UGI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:50:30.979423] [DEBUG] [LOCAL ] UFI: Loaded 5449 existing records from primary storage. [2025-09-16T20:50:30.979717] [INFO ] [MAIN ] UFI: Loaded 5449 existing records. [2025-09-16T20:50:31.089614] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-16T20:50:31.140859] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-04. [2025-09-16T20:50:31.208164] [WARN ] [MAIN ] UFI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:50:31.220091] [INFO ] [MAIN ] UFI: Wiping existing primary data before full refresh. [2025-09-16T20:50:31.220170] [INFO ] [LOCAL ] UFI: Starting deletion of primary data. [2025-09-16T20:50:31.220417] [DEBUG] [LOCAL ] UFI: Deleted primary data file. [2025-09-16T20:50:31.220477] [INFO ] [MAIN ] UFI: Starting full primary refresh. [2025-09-16T20:50:31.221029] [DEBUG] [LOCAL ] UGI: Loaded 37175 existing records from primary storage. [2025-09-16T20:50:31.264150] [INFO ] [MAIN ] UGI: Loaded 37175 existing records. [2025-09-16T20:50:31.604719] [WARN ] [MAIN ] UGI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:50:31.666371] [INFO ] [MAIN ] UGI: Wiping existing primary data before full refresh. [2025-09-16T20:50:31.677037] [INFO ] [LOCAL ] UGI: Starting deletion of primary data. [2025-09-16T20:50:31.682929] [DEBUG] [LOCAL ] UGI: Deleted primary data file. [2025-09-16T20:50:31.717213] [INFO ] [MAIN ] UGI: Starting full primary refresh. [2025-09-16T20:50:31.816748] [INFO ] [REMOTE ] UFI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:50:31.834097] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-02. [2025-09-16T20:50:32.132222] [INFO ] [REMOTE ] UGI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:50:32.136178] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-16T20:50:32.374892] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-02. [2025-09-16T20:50:32.758069] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-16T20:50:33.023814] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-16T20:50:33.174867] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-05. [2025-09-16T20:50:33.791568] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-16T20:50:33.974903] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-03. [2025-09-16T20:50:34.774914] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-04. [2025-09-16T20:50:34.850700] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-16T20:50:34.968416] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-16T20:50:35.574923] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-06. [2025-09-16T20:50:36.374882] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-04. [2025-09-16T20:50:36.489557] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-16T20:50:37.174883] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-05. [2025-09-16T20:50:37.204869] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-16T20:50:37.292733] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-16T20:50:37.974904] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-07. [2025-09-16T20:50:38.754358] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-16T20:50:38.774854] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-06. [2025-09-16T20:50:39.574922] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-05. [2025-09-16T20:50:39.903805] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-16T20:50:40.359219] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-16T20:50:40.374854] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-07. [2025-09-16T20:50:40.516172] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-16T20:50:41.174953] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-08. [2025-09-16T20:50:41.974956] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-03. [2025-09-16T20:50:42.059801] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-16T20:50:42.732084] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-16T20:50:42.774903] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-09. [2025-09-16T20:50:43.574951] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-08. [2025-09-16T20:50:43.836207] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-16T20:50:44.374944] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-06. [2025-09-16T20:50:44.498666] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-16T20:50:44.505112] [INFO ] [REMOTE ] UDR: Full fetch complete (56176 records). [2025-09-16T20:50:44.505236] [DEBUG] [VALIDATOR ] UDR: Validating primary data. [2025-09-16T20:50:44.897388] [DEBUG] [VALIDATOR ] UDR: All expected trading days are present. [2025-09-16T20:50:44.897467] [DEBUG] [VALIDATOR ] UDR: Primary data validation passed. [2025-09-16T20:50:44.898439] [INFO ] [MAIN ] UDR: Fetched primary data is valid. [2025-09-16T20:50:44.898485] [DEBUG] [LOCAL ] UDR: Saving primary data. [2025-09-16T20:50:44.899673] [DEBUG] [LOCAL ] UDR: Trimmed 56176 records to 38694 (keeping 150 days of data) [2025-09-16T20:50:45.132531] [DEBUG] [LOCAL ] UDR: Primary data saved (38694 records). [2025-09-16T20:50:45.132908] [INFO ] [MAIN ] UDR: Full history saved. [2025-09-16T20:50:45.133030] [INFO ] [MAIN ] Update Progress: 2170/2369 symbols completed. UDR took 19.2s. Estimated remaining: 21m 9s. Rate: 9.4 symbols/min [2025-09-16T20:50:45.139020] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-16T20:50:45.178395] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-04. [2025-09-16T20:50:45.319555] [INFO ] [MAIN ] UGP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:50:45.360418] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-16T20:50:45.395372] [DEBUG] [LOCAL ] UGP: Loaded 31451 existing records from primary storage. [2025-09-16T20:50:45.395517] [INFO ] [MAIN ] UGP: Loaded 31451 existing records. [2025-09-16T20:50:45.579872] [WARN ] [MAIN ] UGP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:50:45.580156] [INFO ] [MAIN ] UGP: Wiping existing primary data before full refresh. [2025-09-16T20:50:45.580204] [INFO ] [LOCAL ] UGP: Starting deletion of primary data. [2025-09-16T20:50:45.580930] [DEBUG] [LOCAL ] UGP: Deleted primary data file. [2025-09-16T20:50:45.580981] [INFO ] [MAIN ] UGP: Starting full primary refresh. [2025-09-16T20:50:45.947937] [INFO ] [REMOTE ] UGP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:50:45.974869] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-02. [2025-09-16T20:50:46.774910] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-09. [2025-09-16T20:50:47.091600] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-16T20:50:47.159976] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-16T20:50:47.574920] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-03. [2025-09-16T20:50:48.292494] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-16T20:50:48.297922] [INFO ] [REMOTE ] UE: Full fetch complete (46714 records). [2025-09-16T20:50:48.298041] [DEBUG] [VALIDATOR ] UE: Validating primary data. [2025-09-16T20:50:48.382751] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-05. [2025-09-16T20:50:48.690388] [DEBUG] [VALIDATOR ] UE: All expected trading days are present. [2025-09-16T20:50:48.690469] [DEBUG] [VALIDATOR ] UE: Primary data validation passed. [2025-09-16T20:50:48.691450] [INFO ] [MAIN ] UE: Fetched primary data is valid. [2025-09-16T20:50:48.691513] [DEBUG] [LOCAL ] UE: Saving primary data. [2025-09-16T20:50:48.692555] [DEBUG] [LOCAL ] UE: Trimmed 46714 records to 31985 (keeping 150 days of data) [2025-09-16T20:50:48.891502] [DEBUG] [LOCAL ] UE: Primary data saved (31985 records). [2025-09-16T20:50:48.891661] [INFO ] [MAIN ] UE: Full history saved. [2025-09-16T20:50:48.891753] [INFO ] [MAIN ] Update Progress: 2171/2369 symbols completed. UE took 22.8s. Estimated remaining: 21m 3s. Rate: 9.4 symbols/min [2025-09-16T20:50:49.064891] [INFO ] [MAIN ] UHAL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:50:49.077025] [DEBUG] [LOCAL ] UHAL: Loaded 12188 existing records from primary storage. [2025-09-16T20:50:49.077143] [INFO ] [MAIN ] UHAL: Loaded 12188 existing records. [2025-09-16T20:50:49.179910] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-07. [2025-09-16T20:50:49.259192] [WARN ] [MAIN ] UHAL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:50:49.259443] [INFO ] [MAIN ] UHAL: Wiping existing primary data before full refresh. [2025-09-16T20:50:49.259488] [INFO ] [LOCAL ] UHAL: Starting deletion of primary data. [2025-09-16T20:50:49.259867] [DEBUG] [LOCAL ] UHAL: Deleted primary data file. [2025-09-16T20:50:49.259913] [INFO ] [MAIN ] UHAL: Starting full primary refresh. [2025-09-16T20:50:49.642431] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-16T20:50:49.647186] [INFO ] [REMOTE ] UHAL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:50:49.974905] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-02. [2025-09-16T20:50:49.991062] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-16T20:50:50.249827] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-16T20:50:50.774942] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-06. [2025-09-16T20:50:51.045696] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-16T20:50:51.574921] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-03. [2025-09-16T20:50:52.374948] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-08. [2025-09-16T20:50:52.580531] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-16T20:50:52.604954] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-16T20:50:52.880415] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-16T20:50:53.174948] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-07. [2025-09-16T20:50:53.974974] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-04. [2025-09-16T20:50:54.774954] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-09. [2025-09-16T20:50:54.876719] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-16T20:50:55.349733] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-16T20:50:55.350040] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-16T20:50:55.360914] [INFO ] [REMOTE ] UFI: Full fetch complete (9130 records). [2025-09-16T20:50:55.361418] [DEBUG] [VALIDATOR ] UFI: Validating primary data. [2025-09-16T20:50:55.580041] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-04. [2025-09-16T20:50:55.731036] [DEBUG] [VALIDATOR ] UFI: All expected trading days are present. [2025-09-16T20:50:55.731110] [DEBUG] [VALIDATOR ] UFI: Primary data validation passed. [2025-09-16T20:50:55.731325] [INFO ] [MAIN ] UFI: Fetched primary data is valid. [2025-09-16T20:50:55.731363] [DEBUG] [LOCAL ] UFI: Saving primary data. [2025-09-16T20:50:55.731792] [DEBUG] [LOCAL ] UFI: Trimmed 9130 records to 5514 (keeping 150 days of data) [2025-09-16T20:50:55.765109] [DEBUG] [LOCAL ] UFI: Primary data saved (5514 records). [2025-09-16T20:50:55.765193] [INFO ] [MAIN ] UFI: Full history saved. [2025-09-16T20:50:55.765268] [INFO ] [MAIN ] Update Progress: 2172/2369 symbols completed. UFI took 25.1s. Estimated remaining: 20m 56s. Rate: 9.4 symbols/min [2025-09-16T20:50:55.936020] [INFO ] [MAIN ] UHS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:50:55.972103] [DEBUG] [LOCAL ] UHS: Loaded 29995 existing records from primary storage. [2025-09-16T20:50:55.972237] [INFO ] [MAIN ] UHS: Loaded 29995 existing records. [2025-09-16T20:50:56.148769] [WARN ] [MAIN ] UHS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:50:56.149010] [INFO ] [MAIN ] UHS: Wiping existing primary data before full refresh. [2025-09-16T20:50:56.149062] [INFO ] [LOCAL ] UHS: Starting deletion of primary data. [2025-09-16T20:50:56.149829] [DEBUG] [LOCAL ] UHS: Deleted primary data file. [2025-09-16T20:50:56.149878] [INFO ] [MAIN ] UHS: Starting full primary refresh. [2025-09-16T20:50:56.380671] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-05. [2025-09-16T20:50:56.527711] [INFO ] [REMOTE ] UHS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:50:56.786032] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-16T20:50:57.174973] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-02. [2025-09-16T20:50:57.974928] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-05. [2025-09-16T20:50:58.137378] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-16T20:50:58.774967] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-06. [2025-09-16T20:50:58.869976] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-16T20:50:59.001007] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-16T20:50:59.574924] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-06. [2025-09-16T20:51:00.240765] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-16T20:51:00.374941] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-08. [2025-09-16T20:51:00.773811] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-16T20:51:01.174961] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-07. [2025-09-16T20:51:01.974890] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-03. [2025-09-16T20:51:02.774938] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-07. [2025-09-16T20:51:03.042495] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-08 (2.67 seconds). [2025-09-16T20:51:03.574900] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-09. [2025-09-16T20:51:04.222984] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-07 (3.05 seconds). [2025-09-16T20:51:04.374917] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-08. [2025-09-16T20:51:04.884486] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-16T20:51:05.057382] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-03 (3.08 seconds). [2025-09-16T20:51:05.174914] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-04. [2025-09-16T20:51:05.473963] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-16T20:51:05.481198] [INFO ] [REMOTE ] UGI: Full fetch complete (55012 records). [2025-09-16T20:51:05.481391] [DEBUG] [VALIDATOR ] UGI: Validating primary data. [2025-09-16T20:51:06.006314] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-08. [2025-09-16T20:51:06.107304] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-16T20:51:06.196587] [DEBUG] [VALIDATOR ] UGI: All expected trading days are present. [2025-09-16T20:51:06.196744] [DEBUG] [VALIDATOR ] UGI: Primary data validation passed. [2025-09-16T20:51:06.198404] [INFO ] [MAIN ] UGI: Fetched primary data is valid. [2025-09-16T20:51:06.198490] [DEBUG] [LOCAL ] UGI: Saving primary data. [2025-09-16T20:51:06.200298] [DEBUG] [LOCAL ] UGI: Trimmed 55012 records to 37549 (keeping 150 days of data) [2025-09-16T20:51:06.522160] [DEBUG] [LOCAL ] UGI: Primary data saved (37549 records). [2025-09-16T20:51:06.522598] [INFO ] [MAIN ] UGI: Full history saved. [2025-09-16T20:51:06.522826] [INFO ] [MAIN ] Update Progress: 2173/2369 symbols completed. UGI took 35.8s. Estimated remaining: 20m 50s. Rate: 9.4 symbols/min [2025-09-16T20:51:06.713749] [INFO ] [MAIN ] UHT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:51:06.744163] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-16T20:51:06.747774] [DEBUG] [LOCAL ] UHT: Loaded 7121 existing records from primary storage. [2025-09-16T20:51:06.757920] [INFO ] [MAIN ] UHT: Loaded 7121 existing records. [2025-09-16T20:51:06.780085] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-09. [2025-09-16T20:51:06.940429] [WARN ] [MAIN ] UHT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:51:06.940822] [INFO ] [MAIN ] UHT: Wiping existing primary data before full refresh. [2025-09-16T20:51:06.940880] [INFO ] [LOCAL ] UHT: Starting deletion of primary data. [2025-09-16T20:51:06.941356] [DEBUG] [LOCAL ] UHT: Deleted primary data file. [2025-09-16T20:51:06.941409] [INFO ] [MAIN ] UHT: Starting full primary refresh. [2025-09-16T20:51:07.310232] [INFO ] [REMOTE ] UHT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:51:07.322217] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-16T20:51:07.574923] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-02. [2025-09-16T20:51:08.312472] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-16T20:51:08.319286] [INFO ] [REMOTE ] UGP: Full fetch complete (46391 records). [2025-09-16T20:51:08.319378] [DEBUG] [VALIDATOR ] UGP: Validating primary data. [2025-09-16T20:51:08.382562] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-09. [2025-09-16T20:51:08.552336] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-16T20:51:08.709781] [DEBUG] [VALIDATOR ] UGP: All expected trading days are present. [2025-09-16T20:51:08.709859] [DEBUG] [VALIDATOR ] UGP: Primary data validation passed. [2025-09-16T20:51:08.710720] [INFO ] [MAIN ] UGP: Fetched primary data is valid. [2025-09-16T20:51:08.710766] [DEBUG] [LOCAL ] UGP: Saving primary data. [2025-09-16T20:51:08.711704] [DEBUG] [LOCAL ] UGP: Trimmed 46391 records to 31714 (keeping 150 days of data) [2025-09-16T20:51:08.896040] [DEBUG] [LOCAL ] UGP: Primary data saved (31714 records). [2025-09-16T20:51:08.896177] [INFO ] [MAIN ] UGP: Full history saved. [2025-09-16T20:51:08.896260] [INFO ] [MAIN ] Update Progress: 2174/2369 symbols completed. UGP took 23.8s. Estimated remaining: 20m 44s. Rate: 9.4 symbols/min [2025-09-16T20:51:09.066670] [INFO ] [MAIN ] UI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:51:09.076607] [DEBUG] [LOCAL ] UI: Loaded 9436 existing records from primary storage. [2025-09-16T20:51:09.076718] [INFO ] [MAIN ] UI: Loaded 9436 existing records. [2025-09-16T20:51:09.178414] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-05. [2025-09-16T20:51:09.256498] [WARN ] [MAIN ] UI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:51:09.256872] [INFO ] [MAIN ] UI: Wiping existing primary data before full refresh. [2025-09-16T20:51:09.256958] [INFO ] [LOCAL ] UI: Starting deletion of primary data. [2025-09-16T20:51:09.263780] [DEBUG] [LOCAL ] UI: Deleted primary data file. [2025-09-16T20:51:09.263881] [INFO ] [MAIN ] UI: Starting full primary refresh. [2025-09-16T20:51:09.270319] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-16T20:51:09.357812] [INFO ] [REMOTE ] UHAL: Full fetch complete (17263 records). [2025-09-16T20:51:09.367822] [DEBUG] [VALIDATOR ] UHAL: Validating primary data. [2025-09-16T20:51:09.902605] [INFO ] [REMOTE ] UI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:51:09.979952] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-02. [2025-09-16T20:51:09.988985] [DEBUG] [VALIDATOR ] UHAL: All expected trading days are present. [2025-09-16T20:51:09.989044] [DEBUG] [VALIDATOR ] UHAL: Primary data validation passed. [2025-09-16T20:51:09.989427] [INFO ] [MAIN ] UHAL: Fetched primary data is valid. [2025-09-16T20:51:09.989470] [DEBUG] [LOCAL ] UHAL: Saving primary data. [2025-09-16T20:51:09.990108] [DEBUG] [LOCAL ] UHAL: Trimmed 17263 records to 12408 (keeping 150 days of data) [2025-09-16T20:51:10.064471] [DEBUG] [LOCAL ] UHAL: Primary data saved (12408 records). [2025-09-16T20:51:10.064632] [INFO ] [MAIN ] UHAL: Full history saved. [2025-09-16T20:51:10.064740] [INFO ] [MAIN ] Update Progress: 2175/2369 symbols completed. UHAL took 21.2s. Estimated remaining: 20m 37s. Rate: 9.4 symbols/min [2025-09-16T20:51:10.237259] [INFO ] [MAIN ] UIS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:51:10.262533] [DEBUG] [LOCAL ] UIS: Loaded 27492 existing records from primary storage. [2025-09-16T20:51:10.262682] [INFO ] [MAIN ] UIS: Loaded 27492 existing records. [2025-09-16T20:51:10.439361] [WARN ] [MAIN ] UIS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:51:10.439617] [INFO ] [MAIN ] UIS: Wiping existing primary data before full refresh. [2025-09-16T20:51:10.439682] [INFO ] [LOCAL ] UIS: Starting deletion of primary data. [2025-09-16T20:51:10.440176] [DEBUG] [LOCAL ] UIS: Deleted primary data file. [2025-09-16T20:51:10.440221] [INFO ] [MAIN ] UIS: Starting full primary refresh. [2025-09-16T20:51:10.792060] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-03. [2025-09-16T20:51:10.796253] [INFO ] [REMOTE ] UIS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:51:10.828955] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-16T20:51:11.078071] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-16T20:51:11.574866] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-03. [2025-09-16T20:51:11.771707] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-16T20:51:12.374903] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-04. [2025-09-16T20:51:12.397433] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-16T20:51:13.174895] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-04. [2025-09-16T20:51:13.677213] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-16T20:51:13.974916] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-06. [2025-09-16T20:51:14.774884] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-05. [2025-09-16T20:51:14.808811] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-16T20:51:15.574896] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-02. [2025-09-16T20:51:15.682447] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-16T20:51:16.090598] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-16T20:51:16.374907] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-06. [2025-09-16T20:51:16.731846] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-16T20:51:17.174908] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-03. [2025-09-16T20:51:17.262729] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-16T20:51:17.974950] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-05. [2025-09-16T20:51:18.363829] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-16T20:51:18.774868] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-07. [2025-09-16T20:51:19.060320] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-16T20:51:19.574901] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-06. [2025-09-16T20:51:20.277523] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-16T20:51:20.312051] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-16T20:51:20.374878] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-08. [2025-09-16T20:51:21.174906] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-04. [2025-09-16T20:51:21.955175] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-16T20:51:21.974849] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-09. [2025-09-16T20:51:22.707798] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-16T20:51:22.774889] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-05. [2025-09-16T20:51:23.462829] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-16T20:51:23.467956] [INFO ] [REMOTE ] UHS: Full fetch complete (45344 records). [2025-09-16T20:51:23.468098] [DEBUG] [VALIDATOR ] UHS: Validating primary data. [2025-09-16T20:51:23.580027] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-07. [2025-09-16T20:51:23.845273] [DEBUG] [VALIDATOR ] UHS: All expected trading days are present. [2025-09-16T20:51:23.845359] [DEBUG] [VALIDATOR ] UHS: Primary data validation passed. [2025-09-16T20:51:23.846252] [INFO ] [MAIN ] UHS: Fetched primary data is valid. [2025-09-16T20:51:23.846310] [DEBUG] [LOCAL ] UHS: Saving primary data. [2025-09-16T20:51:23.847383] [DEBUG] [LOCAL ] UHS: Trimmed 45344 records to 30267 (keeping 150 days of data) [2025-09-16T20:51:24.046770] [DEBUG] [LOCAL ] UHS: Primary data saved (30267 records). [2025-09-16T20:51:24.046912] [INFO ] [MAIN ] UHS: Full history saved. [2025-09-16T20:51:24.047006] [INFO ] [MAIN ] Update Progress: 2176/2369 symbols completed. UHS took 28.3s. Estimated remaining: 20m 31s. Rate: 9.4 symbols/min [2025-09-16T20:51:24.221558] [INFO ] [MAIN ] UL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:51:24.261024] [DEBUG] [LOCAL ] UL: Loaded 39105 existing records from primary storage. [2025-09-16T20:51:24.261179] [INFO ] [MAIN ] UL: Loaded 39105 existing records. [2025-09-16T20:51:24.377493] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-07. [2025-09-16T20:51:24.447249] [WARN ] [MAIN ] UL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:51:24.447609] [INFO ] [MAIN ] UL: Wiping existing primary data before full refresh. [2025-09-16T20:51:24.447725] [INFO ] [LOCAL ] UL: Starting deletion of primary data. [2025-09-16T20:51:24.448506] [DEBUG] [LOCAL ] UL: Deleted primary data file. [2025-09-16T20:51:24.448560] [INFO ] [MAIN ] UL: Starting full primary refresh. [2025-09-16T20:51:24.573030] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-16T20:51:24.841279] [INFO ] [REMOTE ] UL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:51:24.850559] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-16T20:51:25.026742] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-16T20:51:25.174892] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-08. [2025-09-16T20:51:25.974864] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-06. [2025-09-16T20:51:26.372231] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-16T20:51:26.774899] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-09. [2025-09-16T20:51:27.499755] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-16T20:51:27.574852] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-07. [2025-09-16T20:51:27.878533] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-16T20:51:27.880672] [INFO ] [REMOTE ] UI: Full fetch complete (13591 records). [2025-09-16T20:51:27.880772] [DEBUG] [VALIDATOR ] UI: Validating primary data. [2025-09-16T20:51:28.235031] [DEBUG] [VALIDATOR ] UI: All expected trading days are present. [2025-09-16T20:51:28.235107] [DEBUG] [VALIDATOR ] UI: Primary data validation passed. [2025-09-16T20:51:28.235415] [INFO ] [MAIN ] UI: Fetched primary data is valid. [2025-09-16T20:51:28.235462] [DEBUG] [LOCAL ] UI: Saving primary data. [2025-09-16T20:51:28.235965] [DEBUG] [LOCAL ] UI: Trimmed 13591 records to 9552 (keeping 150 days of data) [2025-09-16T20:51:28.295781] [DEBUG] [LOCAL ] UI: Primary data saved (9552 records). [2025-09-16T20:51:28.295901] [INFO ] [MAIN ] UI: Full history saved. [2025-09-16T20:51:28.295982] [INFO ] [MAIN ] Update Progress: 2177/2369 symbols completed. UI took 19.4s. Estimated remaining: 20m 25s. Rate: 9.4 symbols/min [2025-09-16T20:51:28.380103] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-02. [2025-09-16T20:51:28.471747] [INFO ] [MAIN ] ULS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:51:28.500249] [DEBUG] [LOCAL ] ULS: Loaded 28897 existing records from primary storage. [2025-09-16T20:51:28.500392] [INFO ] [MAIN ] ULS: Loaded 28897 existing records. [2025-09-16T20:51:28.680010] [WARN ] [MAIN ] ULS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:51:28.680273] [INFO ] [MAIN ] ULS: Wiping existing primary data before full refresh. [2025-09-16T20:51:28.680320] [INFO ] [LOCAL ] ULS: Starting deletion of primary data. [2025-09-16T20:51:28.680894] [DEBUG] [LOCAL ] ULS: Deleted primary data file. [2025-09-16T20:51:28.680942] [INFO ] [MAIN ] ULS: Starting full primary refresh. [2025-09-16T20:51:29.031698] [INFO ] [REMOTE ] ULS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:51:29.052277] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-16T20:51:29.174877] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-08. [2025-09-16T20:51:29.974919] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-08. [2025-09-16T20:51:30.289366] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-16T20:51:30.774945] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-02. [2025-09-16T20:51:30.858871] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-16T20:51:30.927320] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-16T20:51:31.574927] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-03. [2025-09-16T20:51:32.300217] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-16T20:51:32.374892] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-03. [2025-09-16T20:51:33.174872] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-09. [2025-09-16T20:51:33.267486] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-16T20:51:33.540706] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-16T20:51:33.820674] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-16T20:51:33.822516] [INFO ] [REMOTE ] UHT: Full fetch complete (10747 records). [2025-09-16T20:51:33.822615] [DEBUG] [VALIDATOR ] UHT: Validating primary data. [2025-09-16T20:51:33.984064] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-04. [2025-09-16T20:51:34.185886] [DEBUG] [VALIDATOR ] UHT: All expected trading days are present. [2025-09-16T20:51:34.185968] [DEBUG] [VALIDATOR ] UHT: Primary data validation passed. [2025-09-16T20:51:34.186240] [INFO ] [MAIN ] UHT: Fetched primary data is valid. [2025-09-16T20:51:34.186291] [DEBUG] [LOCAL ] UHT: Saving primary data. [2025-09-16T20:51:34.186778] [DEBUG] [LOCAL ] UHT: Trimmed 10747 records to 7210 (keeping 150 days of data) [2025-09-16T20:51:34.232154] [DEBUG] [LOCAL ] UHT: Primary data saved (7210 records). [2025-09-16T20:51:34.232303] [INFO ] [MAIN ] UHT: Full history saved. [2025-09-16T20:51:34.232412] [INFO ] [MAIN ] Update Progress: 2178/2369 symbols completed. UHT took 27.7s. Estimated remaining: 20m 18s. Rate: 9.4 symbols/min [2025-09-16T20:51:34.402438] [INFO ] [MAIN ] UMC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:51:34.439066] [DEBUG] [LOCAL ] UMC: Loaded 38802 existing records from primary storage. [2025-09-16T20:51:34.439214] [INFO ] [MAIN ] UMC: Loaded 38802 existing records. [2025-09-16T20:51:34.625916] [WARN ] [MAIN ] UMC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:51:34.626175] [INFO ] [MAIN ] UMC: Wiping existing primary data before full refresh. [2025-09-16T20:51:34.626243] [INFO ] [LOCAL ] UMC: Starting deletion of primary data. [2025-09-16T20:51:34.626987] [DEBUG] [LOCAL ] UMC: Deleted primary data file. [2025-09-16T20:51:34.627036] [INFO ] [MAIN ] UMC: Starting full primary refresh. [2025-09-16T20:51:34.783192] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-09. [2025-09-16T20:51:34.984168] [INFO ] [REMOTE ] UMC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:51:35.574914] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-04. [2025-09-16T20:51:35.842733] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-16T20:51:36.366513] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-16T20:51:36.371029] [INFO ] [REMOTE ] UIS: Full fetch complete (40443 records). [2025-09-16T20:51:36.371214] [DEBUG] [VALIDATOR ] UIS: Validating primary data. [2025-09-16T20:51:36.383088] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-05. [2025-09-16T20:51:36.748232] [DEBUG] [VALIDATOR ] UIS: All expected trading days are present. [2025-09-16T20:51:36.748320] [DEBUG] [VALIDATOR ] UIS: Primary data validation passed. [2025-09-16T20:51:36.749133] [INFO ] [MAIN ] UIS: Fetched primary data is valid. [2025-09-16T20:51:36.749177] [DEBUG] [LOCAL ] UIS: Saving primary data. [2025-09-16T20:51:36.750108] [DEBUG] [LOCAL ] UIS: Trimmed 40443 records to 27701 (keeping 150 days of data) [2025-09-16T20:51:36.907137] [DEBUG] [LOCAL ] UIS: Primary data saved (27701 records). [2025-09-16T20:51:36.907289] [INFO ] [MAIN ] UIS: Full history saved. [2025-09-16T20:51:36.907379] [INFO ] [MAIN ] Update Progress: 2179/2369 symbols completed. UIS took 26.8s. Estimated remaining: 20m 11s. Rate: 9.4 symbols/min [2025-09-16T20:51:37.079752] [INFO ] [MAIN ] UMH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:51:37.103431] [DEBUG] [LOCAL ] UMH: Loaded 24105 existing records from primary storage. [2025-09-16T20:51:37.103598] [INFO ] [MAIN ] UMH: Loaded 24105 existing records. [2025-09-16T20:51:37.180931] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-02. [2025-09-16T20:51:37.287907] [WARN ] [MAIN ] UMH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:51:37.288323] [INFO ] [MAIN ] UMH: Wiping existing primary data before full refresh. [2025-09-16T20:51:37.288390] [INFO ] [LOCAL ] UMH: Starting deletion of primary data. [2025-09-16T20:51:37.289071] [DEBUG] [LOCAL ] UMH: Deleted primary data file. [2025-09-16T20:51:37.289131] [INFO ] [MAIN ] UMH: Starting full primary refresh. [2025-09-16T20:51:37.623370] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-16T20:51:37.698080] [INFO ] [REMOTE ] UMH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:51:37.974939] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-02. [2025-09-16T20:51:38.538022] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-16T20:51:38.774903] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-05. [2025-09-16T20:51:39.034527] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-16T20:51:39.197063] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-16T20:51:39.574926] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-03. [2025-09-16T20:51:40.374916] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-06. [2025-09-16T20:51:40.424686] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-16T20:51:41.026080] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-16T20:51:41.174884] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-04. [2025-09-16T20:51:41.974903] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-06. [2025-09-16T20:51:42.283572] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-16T20:51:42.586609] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-16T20:51:42.774903] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-05. [2025-09-16T20:51:43.280194] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-16T20:51:43.574923] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-07. [2025-09-16T20:51:44.332413] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-16T20:51:44.374898] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-06. [2025-09-16T20:51:45.174939] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-07. [2025-09-16T20:51:45.205446] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-16T20:51:45.846420] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-16T20:51:45.974907] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-03. [2025-09-16T20:51:46.774893] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-08. [2025-09-16T20:51:47.209248] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-16T20:51:47.574912] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-07. [2025-09-16T20:51:47.953302] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-16T20:51:48.374913] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-04. [2025-09-16T20:51:48.418484] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-16T20:51:49.095418] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-16T20:51:49.174876] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-08. [2025-09-16T20:51:49.974993] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-08. [2025-09-16T20:51:50.312599] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-16T20:51:50.736524] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-16T20:51:50.774863] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-09. [2025-09-16T20:51:51.574917] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-05. [2025-09-16T20:51:51.647452] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-16T20:51:52.175727] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-16T20:51:52.180371] [INFO ] [REMOTE ] UMH: Full fetch complete (35038 records). [2025-09-16T20:51:52.180453] [DEBUG] [VALIDATOR ] UMH: Validating primary data. [2025-09-16T20:51:52.383289] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-09. [2025-09-16T20:51:52.566400] [DEBUG] [VALIDATOR ] UMH: All expected trading days are present. [2025-09-16T20:51:52.566489] [DEBUG] [VALIDATOR ] UMH: Primary data validation passed. [2025-09-16T20:51:52.567308] [INFO ] [MAIN ] UMH: Fetched primary data is valid. [2025-09-16T20:51:52.567353] [DEBUG] [LOCAL ] UMH: Saving primary data. [2025-09-16T20:51:52.568226] [DEBUG] [LOCAL ] UMH: Trimmed 35038 records to 24358 (keeping 150 days of data) [2025-09-16T20:51:52.714749] [DEBUG] [LOCAL ] UMH: Primary data saved (24358 records). [2025-09-16T20:51:52.714886] [INFO ] [MAIN ] UMH: Full history saved. [2025-09-16T20:51:52.714993] [INFO ] [MAIN ] Update Progress: 2180/2369 symbols completed. UMH took 15.8s. Estimated remaining: 20m 6s. Rate: 9.4 symbols/min [2025-09-16T20:51:52.882591] [INFO ] [MAIN ] UNF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:51:52.891930] [DEBUG] [LOCAL ] UNF: Loaded 7875 existing records from primary storage. [2025-09-16T20:51:52.892037] [INFO ] [MAIN ] UNF: Loaded 7875 existing records. [2025-09-16T20:51:53.104321] [WARN ] [MAIN ] UNF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:51:53.104559] [INFO ] [MAIN ] UNF: Wiping existing primary data before full refresh. [2025-09-16T20:51:53.104607] [INFO ] [LOCAL ] UNF: Starting deletion of primary data. [2025-09-16T20:51:53.104962] [DEBUG] [LOCAL ] UNF: Deleted primary data file. [2025-09-16T20:51:53.105007] [INFO ] [MAIN ] UNF: Starting full primary refresh. [2025-09-16T20:51:53.179998] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-09. [2025-09-16T20:51:53.456386] [INFO ] [REMOTE ] UNF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:51:53.523811] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-16T20:51:53.843768] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-16T20:51:53.850673] [INFO ] [REMOTE ] ULS: Full fetch complete (42552 records). [2025-09-16T20:51:53.850800] [DEBUG] [VALIDATOR ] ULS: Validating primary data. [2025-09-16T20:51:53.980089] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-06. [2025-09-16T20:51:54.257310] [DEBUG] [VALIDATOR ] ULS: All expected trading days are present. [2025-09-16T20:51:54.257404] [DEBUG] [VALIDATOR ] ULS: Primary data validation passed. [2025-09-16T20:51:54.258599] [INFO ] [MAIN ] ULS: Fetched primary data is valid. [2025-09-16T20:51:54.258660] [DEBUG] [LOCAL ] ULS: Saving primary data. [2025-09-16T20:51:54.259738] [DEBUG] [LOCAL ] ULS: Trimmed 42552 records to 29182 (keeping 150 days of data) [2025-09-16T20:51:54.446084] [DEBUG] [LOCAL ] ULS: Primary data saved (29182 records). [2025-09-16T20:51:54.446220] [INFO ] [MAIN ] ULS: Full history saved. [2025-09-16T20:51:54.446321] [INFO ] [MAIN ] Update Progress: 2181/2369 symbols completed. ULS took 26.2s. Estimated remaining: 19m 59s. Rate: 9.4 symbols/min [2025-09-16T20:51:54.628691] [INFO ] [MAIN ] UNFI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:51:54.659546] [DEBUG] [LOCAL ] UNFI: Loaded 31136 existing records from primary storage. [2025-09-16T20:51:54.659699] [INFO ] [MAIN ] UNFI: Loaded 31136 existing records. [2025-09-16T20:51:54.780019] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-02. [2025-09-16T20:51:54.844124] [WARN ] [MAIN ] UNFI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:51:54.845255] [INFO ] [MAIN ] UNFI: Wiping existing primary data before full refresh. [2025-09-16T20:51:54.845311] [INFO ] [LOCAL ] UNFI: Starting deletion of primary data. [2025-09-16T20:51:54.845987] [DEBUG] [LOCAL ] UNFI: Deleted primary data file. [2025-09-16T20:51:54.846036] [INFO ] [MAIN ] UNFI: Starting full primary refresh. [2025-09-16T20:51:55.199981] [INFO ] [REMOTE ] UNFI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:51:55.216958] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-16T20:51:55.224486] [INFO ] [REMOTE ] UL: Full fetch complete (57732 records). [2025-09-16T20:51:55.224686] [DEBUG] [VALIDATOR ] UL: Validating primary data. [2025-09-16T20:51:55.575225] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-02. [2025-09-16T20:51:55.617866] [DEBUG] [VALIDATOR ] UL: All expected trading days are present. [2025-09-16T20:51:55.617977] [DEBUG] [VALIDATOR ] UL: Primary data validation passed. [2025-09-16T20:51:55.619173] [INFO ] [MAIN ] UL: Fetched primary data is valid. [2025-09-16T20:51:55.619405] [DEBUG] [LOCAL ] UL: Saving primary data. [2025-09-16T20:51:55.621032] [DEBUG] [LOCAL ] UL: Trimmed 57732 records to 39494 (keeping 150 days of data) [2025-09-16T20:51:55.746941] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-16T20:51:55.889171] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-16T20:51:55.920667] [DEBUG] [LOCAL ] UL: Primary data saved (39494 records). [2025-09-16T20:51:55.920873] [INFO ] [MAIN ] UL: Full history saved. [2025-09-16T20:51:55.920977] [INFO ] [MAIN ] Update Progress: 2182/2369 symbols completed. UL took 31.9s. Estimated remaining: 19m 52s. Rate: 9.4 symbols/min [2025-09-16T20:51:56.098211] [INFO ] [MAIN ] UNH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:51:56.141087] [DEBUG] [LOCAL ] UNH: Loaded 39779 existing records from primary storage. [2025-09-16T20:51:56.141251] [INFO ] [MAIN ] UNH: Loaded 39779 existing records. [2025-09-16T20:51:56.314753] [WARN ] [MAIN ] UNH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:51:56.314991] [INFO ] [MAIN ] UNH: Wiping existing primary data before full refresh. [2025-09-16T20:51:56.315038] [INFO ] [LOCAL ] UNH: Starting deletion of primary data. [2025-09-16T20:51:56.315984] [DEBUG] [LOCAL ] UNH: Deleted primary data file. [2025-09-16T20:51:56.316033] [INFO ] [MAIN ] UNH: Starting full primary refresh. [2025-09-16T20:51:56.380103] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-07. [2025-09-16T20:51:56.673143] [INFO ] [REMOTE ] UNH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:51:57.128401] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-16T20:51:57.174850] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-03. [2025-09-16T20:51:57.975045] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-02. [2025-09-16T20:51:58.035013] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-16T20:51:58.781040] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-08. [2025-09-16T20:51:58.793097] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-16T20:51:59.574904] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-04. [2025-09-16T20:52:00.012717] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-16T20:52:00.276873] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-16T20:52:00.374904] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-09. [2025-09-16T20:52:01.174958] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-03. [2025-09-16T20:52:01.206945] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-16T20:52:01.974953] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-05. [2025-09-16T20:52:02.278503] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-16T20:52:02.284579] [INFO ] [REMOTE ] UMC: Full fetch complete (57368 records). [2025-09-16T20:52:02.284743] [DEBUG] [VALIDATOR ] UMC: Validating primary data. [2025-09-16T20:52:02.664113] [DEBUG] [VALIDATOR ] UMC: All expected trading days are present. [2025-09-16T20:52:02.664195] [DEBUG] [VALIDATOR ] UMC: Primary data validation passed. [2025-09-16T20:52:02.665157] [INFO ] [MAIN ] UMC: Fetched primary data is valid. [2025-09-16T20:52:02.665225] [DEBUG] [LOCAL ] UMC: Saving primary data. [2025-09-16T20:52:02.666569] [DEBUG] [LOCAL ] UMC: Trimmed 57368 records to 39172 (keeping 150 days of data) [2025-09-16T20:52:02.774971] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-03. [2025-09-16T20:52:02.903040] [DEBUG] [LOCAL ] UMC: Primary data saved (39172 records). [2025-09-16T20:52:02.903180] [INFO ] [MAIN ] UMC: Full history saved. [2025-09-16T20:52:02.904080] [INFO ] [MAIN ] Update Progress: 2183/2369 symbols completed. UMC took 28.7s. Estimated remaining: 19m 46s. Rate: 9.4 symbols/min [2025-09-16T20:52:03.082664] [INFO ] [MAIN ] UNM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:52:03.124055] [DEBUG] [LOCAL ] UNM: Loaded 35596 existing records from primary storage. [2025-09-16T20:52:03.124205] [INFO ] [MAIN ] UNM: Loaded 35596 existing records. [2025-09-16T20:52:03.305659] [WARN ] [MAIN ] UNM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:52:03.306218] [INFO ] [MAIN ] UNM: Wiping existing primary data before full refresh. [2025-09-16T20:52:03.306382] [INFO ] [LOCAL ] UNM: Starting deletion of primary data. [2025-09-16T20:52:03.307360] [DEBUG] [LOCAL ] UNM: Deleted primary data file. [2025-09-16T20:52:03.307425] [INFO ] [MAIN ] UNM: Starting full primary refresh. [2025-09-16T20:52:03.437985] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-16T20:52:03.579968] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-06. [2025-09-16T20:52:03.707703] [INFO ] [REMOTE ] UNM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:52:03.753014] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-09-16T20:52:03.780575] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-16T20:52:04.374954] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-04. [2025-09-16T20:52:05.174868] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-02. [2025-09-16T20:52:05.414824] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-16T20:52:05.569791] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-16T20:52:05.974928] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-05. [2025-09-16T20:52:06.774935] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-07. [2025-09-16T20:52:06.860916] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-16T20:52:06.935817] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-16T20:52:07.574894] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-03. [2025-09-16T20:52:08.374960] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-04. [2025-09-16T20:52:08.619631] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-16T20:52:09.088293] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-16T20:52:09.174914] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-08. [2025-09-16T20:52:09.974908] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-06. [2025-09-16T20:52:10.774913] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-04. [2025-09-16T20:52:10.812595] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-16T20:52:10.931065] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-04 (2.56 seconds). [2025-09-16T20:52:10.960750] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-16T20:52:11.574902] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-05. [2025-09-16T20:52:12.374912] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-09. [2025-09-16T20:52:12.656828] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-16T20:52:13.174968] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-05. [2025-09-16T20:52:13.583483] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-16T20:52:13.589063] [INFO ] [REMOTE ] UNFI: Full fetch complete (45105 records). [2025-09-16T20:52:13.589217] [DEBUG] [VALIDATOR ] UNFI: Validating primary data. [2025-09-16T20:52:13.979994] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-07. [2025-09-16T20:52:13.991667] [DEBUG] [VALIDATOR ] UNFI: All expected trading days are present. [2025-09-16T20:52:13.992903] [DEBUG] [VALIDATOR ] UNFI: Primary data validation passed. [2025-09-16T20:52:13.994741] [INFO ] [MAIN ] UNFI: Fetched primary data is valid. [2025-09-16T20:52:13.994933] [DEBUG] [LOCAL ] UNFI: Saving primary data. [2025-09-16T20:52:13.996394] [DEBUG] [LOCAL ] UNFI: Trimmed 45105 records to 31439 (keeping 150 days of data) [2025-09-16T20:52:14.205869] [DEBUG] [LOCAL ] UNFI: Primary data saved (31439 records). [2025-09-16T20:52:14.206102] [INFO ] [MAIN ] UNFI: Full history saved. [2025-09-16T20:52:14.206249] [INFO ] [MAIN ] Update Progress: 2184/2369 symbols completed. UNFI took 19.8s. Estimated remaining: 19m 40s. Rate: 9.4 symbols/min [2025-09-16T20:52:14.387477] [INFO ] [MAIN ] UNMA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:52:14.393356] [DEBUG] [LOCAL ] UNMA: Loaded 2590 existing records from primary storage. [2025-09-16T20:52:14.393521] [INFO ] [MAIN ] UNMA: Loaded 2590 existing records. [2025-09-16T20:52:14.590836] [WARN ] [MAIN ] UNMA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:52:14.591521] [INFO ] [MAIN ] UNMA: Wiping existing primary data before full refresh. [2025-09-16T20:52:14.591631] [INFO ] [LOCAL ] UNMA: Starting deletion of primary data. [2025-09-16T20:52:14.592007] [DEBUG] [LOCAL ] UNMA: Deleted primary data file. [2025-09-16T20:52:14.592261] [INFO ] [MAIN ] UNMA: Starting full primary refresh. [2025-09-16T20:52:14.938266] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-05 (3.36 seconds). [2025-09-16T20:52:15.018059] [INFO ] [REMOTE ] UNMA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:52:15.018976] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-02. [2025-09-16T20:52:15.087074] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-16T20:52:15.167362] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-16T20:52:15.471862] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-16T20:52:15.574909] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-03. [2025-09-16T20:52:16.259714] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-16T20:52:16.374901] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-06. [2025-09-16T20:52:17.174922] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-08. [2025-09-16T20:52:17.974906] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-04. [2025-09-16T20:52:18.054530] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-16T20:52:18.136276] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-16T20:52:18.521407] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-16T20:52:18.774904] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-07. [2025-09-16T20:52:19.574893] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-06. [2025-09-16T20:52:20.361449] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-16T20:52:20.374857] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-08. [2025-09-16T20:52:21.174896] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-09. [2025-09-16T20:52:21.926465] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-16T20:52:21.928187] [INFO ] [REMOTE ] UNF: Full fetch complete (12556 records). [2025-09-16T20:52:21.928268] [DEBUG] [VALIDATOR ] UNF: Validating primary data. [2025-09-16T20:52:21.976594] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-05. [2025-09-16T20:52:22.321559] [DEBUG] [VALIDATOR ] UNF: All expected trading days are present. [2025-09-16T20:52:22.321832] [DEBUG] [VALIDATOR ] UNF: Primary data validation passed. [2025-09-16T20:52:22.322172] [INFO ] [MAIN ] UNF: Fetched primary data is valid. [2025-09-16T20:52:22.350823] [DEBUG] [LOCAL ] UNF: Saving primary data. [2025-09-16T20:52:22.354754] [DEBUG] [LOCAL ] UNF: Trimmed 12556 records to 7936 (keeping 150 days of data) [2025-09-16T20:52:22.356888] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-06 (2.78 seconds). [2025-09-16T20:52:22.439225] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-16T20:52:22.458330] [DEBUG] [LOCAL ] UNF: Primary data saved (7936 records). [2025-09-16T20:52:22.458436] [INFO ] [MAIN ] UNF: Full history saved. [2025-09-16T20:52:22.458535] [INFO ] [MAIN ] Update Progress: 2185/2369 symbols completed. UNF took 29.7s. Estimated remaining: 19m 34s. Rate: 9.4 symbols/min [2025-09-16T20:52:22.628895] [INFO ] [MAIN ] UNP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:52:22.629104] [DEBUG] [LOCAL ] UNP: No existing data file found in primary storage. [2025-09-16T20:52:22.629144] [WARN ] [MAIN ] UNP: No existing data found, performing full refresh instead. [2025-09-16T20:52:22.629263] [INFO ] [MAIN ] UNP: Wiping existing primary data before full refresh. [2025-09-16T20:52:22.629311] [INFO ] [LOCAL ] UNP: Starting deletion of primary data. [2025-09-16T20:52:22.629354] [DEBUG] [LOCAL ] UNP: No primary data file found to delete. [2025-09-16T20:52:22.629386] [INFO ] [MAIN ] UNP: Starting full primary refresh. [2025-09-16T20:52:22.733271] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-16T20:52:22.778516] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-06. [2025-09-16T20:52:22.992131] [INFO ] [REMOTE ] UNP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:52:23.495833] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-16T20:52:23.574888] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-02. [2025-09-16T20:52:24.374895] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-07. [2025-09-16T20:52:25.040899] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-16T20:52:25.174898] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-08. [2025-09-16T20:52:25.496106] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-16T20:52:25.819680] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-16T20:52:25.974888] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-09. [2025-09-16T20:52:26.561113] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-16T20:52:26.563208] [INFO ] [REMOTE ] UNMA: Full fetch complete (4050 records). [2025-09-16T20:52:26.563450] [DEBUG] [VALIDATOR ] UNMA: Validating primary data. [2025-09-16T20:52:26.780054] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-09. [2025-09-16T20:52:26.921389] [DEBUG] [VALIDATOR ] UNMA: All expected trading days are present. [2025-09-16T20:52:26.921493] [DEBUG] [VALIDATOR ] UNMA: Primary data validation passed. [2025-09-16T20:52:26.921655] [INFO ] [MAIN ] UNMA: Fetched primary data is valid. [2025-09-16T20:52:26.921700] [DEBUG] [LOCAL ] UNMA: Saving primary data. [2025-09-16T20:52:26.922065] [DEBUG] [LOCAL ] UNMA: Trimmed 4050 records to 2628 (keeping 150 days of data) [2025-09-16T20:52:26.939086] [DEBUG] [LOCAL ] UNMA: Primary data saved (2628 records). [2025-09-16T20:52:26.939149] [INFO ] [MAIN ] UNMA: Full history saved. [2025-09-16T20:52:26.939224] [INFO ] [MAIN ] Update Progress: 2186/2369 symbols completed. UNMA took 12.7s. Estimated remaining: 19m 27s. Rate: 9.4 symbols/min [2025-09-16T20:52:27.106740] [INFO ] [MAIN ] UP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:52:27.139422] [DEBUG] [LOCAL ] UP: Loaded 31666 existing records from primary storage. [2025-09-16T20:52:27.139655] [INFO ] [MAIN ] UP: Loaded 31666 existing records. [2025-09-16T20:52:27.318019] [WARN ] [MAIN ] UP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:52:27.318260] [INFO ] [MAIN ] UP: Wiping existing primary data before full refresh. [2025-09-16T20:52:27.318350] [INFO ] [LOCAL ] UP: Starting deletion of primary data. [2025-09-16T20:52:27.319081] [DEBUG] [LOCAL ] UP: Deleted primary data file. [2025-09-16T20:52:27.319135] [INFO ] [MAIN ] UP: Starting full primary refresh. [2025-09-16T20:52:27.585007] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-03. [2025-09-16T20:52:27.678057] [INFO ] [REMOTE ] UP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:52:28.385039] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-07. [2025-09-16T20:52:28.387282] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-16T20:52:28.393770] [INFO ] [REMOTE ] UNM: Full fetch complete (53015 records). [2025-09-16T20:52:28.393924] [DEBUG] [VALIDATOR ] UNM: Validating primary data. [2025-09-16T20:52:28.775230] [DEBUG] [VALIDATOR ] UNM: All expected trading days are present. [2025-09-16T20:52:28.775308] [DEBUG] [VALIDATOR ] UNM: Primary data validation passed. [2025-09-16T20:52:28.776241] [INFO ] [MAIN ] UNM: Fetched primary data is valid. [2025-09-16T20:52:28.776288] [DEBUG] [LOCAL ] UNM: Saving primary data. [2025-09-16T20:52:28.777337] [DEBUG] [LOCAL ] UNM: Trimmed 53015 records to 35962 (keeping 150 days of data) [2025-09-16T20:52:28.998223] [DEBUG] [LOCAL ] UNM: Primary data saved (35962 records). [2025-09-16T20:52:28.998387] [INFO ] [MAIN ] UNM: Full history saved. [2025-09-16T20:52:28.999311] [INFO ] [MAIN ] Update Progress: 2187/2369 symbols completed. UNM took 26.1s. Estimated remaining: 19m 21s. Rate: 9.4 symbols/min [2025-09-16T20:52:29.172148] [INFO ] [MAIN ] UPS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:52:29.172320] [DEBUG] [LOCAL ] UPS: No existing data file found in primary storage. [2025-09-16T20:52:29.172357] [WARN ] [MAIN ] UPS: No existing data found, performing full refresh instead. [2025-09-16T20:52:29.172478] [INFO ] [MAIN ] UPS: Wiping existing primary data before full refresh. [2025-09-16T20:52:29.172516] [INFO ] [LOCAL ] UPS: Starting deletion of primary data. [2025-09-16T20:52:29.172558] [DEBUG] [LOCAL ] UPS: No primary data file found to delete. [2025-09-16T20:52:29.172591] [INFO ] [MAIN ] UPS: Starting full primary refresh. [2025-09-16T20:52:29.203616] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-02. [2025-09-16T20:52:29.528754] [INFO ] [REMOTE ] UPS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:52:29.563819] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-16T20:52:29.974940] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-02. [2025-09-16T20:52:30.736675] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-16T20:52:30.774840] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-03. [2025-09-16T20:52:31.394664] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-07 (3.01 seconds). [2025-09-16T20:52:31.574898] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-08. [2025-09-16T20:52:32.273833] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-09-16T20:52:32.374900] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-04. [2025-09-16T20:52:32.549163] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-16T20:52:33.174909] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-03. [2025-09-16T20:52:33.974881] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-04. [2025-09-16T20:52:34.278142] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-16T20:52:34.450220] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-08 (2.88 seconds). [2025-09-16T20:52:34.774923] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-05. [2025-09-16T20:52:35.447981] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-16T20:52:35.574869] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-04. [2025-09-16T20:52:35.602413] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-16T20:52:36.374926] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-05. [2025-09-16T20:52:36.853202] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-16T20:52:37.174916] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-06. [2025-09-16T20:52:37.985669] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-09. [2025-09-16T20:52:37.991396] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-09-16T20:52:38.435530] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-16T20:52:38.774915] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-05. [2025-09-16T20:52:39.119322] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-16T20:52:39.574912] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-07. [2025-09-16T20:52:40.374907] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-06. [2025-09-16T20:52:40.396143] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-09-16T20:52:40.402762] [INFO ] [REMOTE ] UNH: Full fetch complete (58467 records). [2025-09-16T20:52:40.402904] [DEBUG] [VALIDATOR ] UNH: Validating primary data. [2025-09-16T20:52:40.796289] [DEBUG] [VALIDATOR ] UNH: All expected trading days are present. [2025-09-16T20:52:40.796368] [DEBUG] [VALIDATOR ] UNH: Primary data validation passed. [2025-09-16T20:52:40.797328] [INFO ] [MAIN ] UNH: Fetched primary data is valid. [2025-09-16T20:52:40.797373] [DEBUG] [LOCAL ] UNH: Saving primary data. [2025-09-16T20:52:40.798522] [DEBUG] [LOCAL ] UNH: Trimmed 58467 records to 40169 (keeping 150 days of data) [2025-09-16T20:52:41.080961] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-09-16T20:52:41.108794] [DEBUG] [LOCAL ] UNH: Primary data saved (40169 records). [2025-09-16T20:52:41.108931] [INFO ] [MAIN ] UNH: Full history saved. [2025-09-16T20:52:41.109015] [INFO ] [MAIN ] Update Progress: 2188/2369 symbols completed. UNH took 45.2s. Estimated remaining: 19m 15s. Rate: 9.4 symbols/min [2025-09-16T20:52:41.181732] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-06. [2025-09-16T20:52:41.297521] [INFO ] [MAIN ] URI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:52:41.322898] [DEBUG] [LOCAL ] URI: Loaded 25723 existing records from primary storage. [2025-09-16T20:52:41.323037] [INFO ] [MAIN ] URI: Loaded 25723 existing records. [2025-09-16T20:52:41.502000] [WARN ] [MAIN ] URI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:52:41.502419] [INFO ] [MAIN ] URI: Wiping existing primary data before full refresh. [2025-09-16T20:52:41.502581] [INFO ] [LOCAL ] URI: Starting deletion of primary data. [2025-09-16T20:52:41.503348] [DEBUG] [LOCAL ] URI: Deleted primary data file. [2025-09-16T20:52:41.503399] [INFO ] [MAIN ] URI: Starting full primary refresh. [2025-09-16T20:52:41.729139] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-16T20:52:41.909559] [INFO ] [REMOTE ] URI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:52:41.931996] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-16T20:52:41.974854] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-07. [2025-09-16T20:52:42.774950] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-08. [2025-09-16T20:52:43.372355] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-16T20:52:43.574876] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-07. [2025-09-16T20:52:43.638411] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-16T20:52:44.374917] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-08. [2025-09-16T20:52:44.781330] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-16T20:52:45.174913] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-09. [2025-09-16T20:52:45.687191] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-16T20:52:45.692968] [INFO ] [REMOTE ] UNP: Full fetch complete (57427 records). [2025-09-16T20:52:45.693072] [DEBUG] [VALIDATOR ] UNP: Validating primary data. [2025-09-16T20:52:45.693781] [FATAL] [VALIDATOR ] UNP: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T20:52:45.693859] [FATAL] [MAIN ] UNP: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:52:45.696848] [WARN ] [MAIN ] UNP: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:52:45.696965] [INFO ] [LOCAL ] UNP: Starting deletion of primary data. [2025-09-16T20:52:45.697064] [DEBUG] [LOCAL ] UNP: No primary data file found to delete. [2025-09-16T20:52:45.697119] [INFO ] [LOCAL ] UNP: Starting deletion of derivative data. [2025-09-16T20:52:45.697230] [DEBUG] [LOCAL ] UNP: No derivative data file found to delete. [2025-09-16T20:52:45.697334] [INFO ] [MAIN ] Update Progress: 2189/2369 symbols completed. UNP took 23.2s. Estimated remaining: 19m 8s. Rate: 9.4 symbols/min [2025-09-16T20:52:45.868659] [INFO ] [MAIN ] USA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:52:45.901776] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-09-16T20:52:45.943381] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-16T20:52:45.961078] [DEBUG] [LOCAL ] USA: Loaded 25825 existing records from primary storage. [2025-09-16T20:52:45.961212] [INFO ] [MAIN ] USA: Loaded 25825 existing records. [2025-09-16T20:52:45.981235] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-02. [2025-09-16T20:52:46.136789] [WARN ] [MAIN ] USA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:52:46.136998] [INFO ] [MAIN ] USA: Wiping existing primary data before full refresh. [2025-09-16T20:52:46.137045] [INFO ] [LOCAL ] USA: Starting deletion of primary data. [2025-09-16T20:52:46.137702] [DEBUG] [LOCAL ] USA: Deleted primary data file. [2025-09-16T20:52:46.137754] [INFO ] [MAIN ] USA: Starting full primary refresh. [2025-09-16T20:52:46.494319] [INFO ] [REMOTE ] USA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:52:46.774883] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-02. [2025-09-16T20:52:47.574904] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-08. [2025-09-16T20:52:47.687258] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-16T20:52:48.264189] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-16T20:52:48.374901] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-03. [2025-09-16T20:52:49.174912] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-03. [2025-09-16T20:52:49.974898] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-09. [2025-09-16T20:52:50.021952] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-09-16T20:52:50.054093] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-16T20:52:50.569002] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-16T20:52:50.774918] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-09. [2025-09-16T20:52:51.574877] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-04. [2025-09-16T20:52:51.609790] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-16T20:52:51.615669] [INFO ] [REMOTE ] UPS: Full fetch complete (57996 records). [2025-09-16T20:52:51.615779] [DEBUG] [VALIDATOR ] UPS: Validating primary data. [2025-09-16T20:52:51.616411] [FATAL] [VALIDATOR ] UPS: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T20:52:51.616490] [FATAL] [MAIN ] UPS: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:52:51.616527] [WARN ] [MAIN ] UPS: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:52:51.616565] [INFO ] [LOCAL ] UPS: Starting deletion of primary data. [2025-09-16T20:52:51.616623] [DEBUG] [LOCAL ] UPS: No primary data file found to delete. [2025-09-16T20:52:51.616683] [INFO ] [LOCAL ] UPS: Starting deletion of derivative data. [2025-09-16T20:52:51.616726] [DEBUG] [LOCAL ] UPS: No derivative data file found to delete. [2025-09-16T20:52:51.616781] [INFO ] [MAIN ] Update Progress: 2190/2369 symbols completed. UPS took 22.6s. Estimated remaining: 19m 2s. Rate: 9.4 symbols/min [2025-09-16T20:52:51.798618] [INFO ] [MAIN ] USAC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:52:51.821827] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-16T20:52:51.828601] [INFO ] [REMOTE ] UP: Full fetch complete (45953 records). [2025-09-16T20:52:51.828768] [DEBUG] [VALIDATOR ] UP: Validating primary data. [2025-09-16T20:52:51.946263] [DEBUG] [LOCAL ] USAC: Loaded 15589 existing records from primary storage. [2025-09-16T20:52:51.951889] [INFO ] [MAIN ] USAC: Loaded 15589 existing records. [2025-09-16T20:52:52.354788] [WARN ] [MAIN ] USAC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:52:52.384719] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-04. [2025-09-16T20:52:52.398744] [INFO ] [MAIN ] USAC: Wiping existing primary data before full refresh. [2025-09-16T20:52:52.430971] [INFO ] [LOCAL ] USAC: Starting deletion of primary data. [2025-09-16T20:52:52.432113] [DEBUG] [VALIDATOR ] UP: All expected trading days are present. [2025-09-16T20:52:52.432163] [DEBUG] [VALIDATOR ] UP: Primary data validation passed. [2025-09-16T20:52:52.433057] [INFO ] [MAIN ] UP: Fetched primary data is valid. [2025-09-16T20:52:52.433117] [DEBUG] [LOCAL ] USAC: Deleted primary data file. [2025-09-16T20:52:52.433172] [DEBUG] [LOCAL ] UP: Saving primary data. [2025-09-16T20:52:52.433319] [INFO ] [MAIN ] USAC: Starting full primary refresh. [2025-09-16T20:52:52.525947] [DEBUG] [LOCAL ] UP: Trimmed 45953 records to 32050 (keeping 150 days of data) [2025-09-16T20:52:52.883512] [INFO ] [REMOTE ] USAC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:52:52.977477] [DEBUG] [LOCAL ] UP: Primary data saved (32050 records). [2025-09-16T20:52:52.977614] [INFO ] [MAIN ] UP: Full history saved. [2025-09-16T20:52:52.977717] [INFO ] [MAIN ] Update Progress: 2191/2369 symbols completed. UP took 26.0s. Estimated remaining: 18m 55s. Rate: 9.4 symbols/min [2025-09-16T20:52:53.151587] [INFO ] [MAIN ] USB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:52:53.151816] [DEBUG] [LOCAL ] USB: No existing data file found in primary storage. [2025-09-16T20:52:53.151857] [WARN ] [MAIN ] USB: No existing data found, performing full refresh instead. [2025-09-16T20:52:53.151978] [INFO ] [MAIN ] USB: Wiping existing primary data before full refresh. [2025-09-16T20:52:53.152020] [INFO ] [LOCAL ] USB: Starting deletion of primary data. [2025-09-16T20:52:53.152063] [DEBUG] [LOCAL ] USB: No primary data file found to delete. [2025-09-16T20:52:53.152127] [INFO ] [MAIN ] USB: Starting full primary refresh. [2025-09-16T20:52:53.185161] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-02. [2025-09-16T20:52:53.517156] [INFO ] [REMOTE ] USB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:52:53.547748] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-16T20:52:53.974904] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-02. [2025-09-16T20:52:54.095297] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-16T20:52:54.741760] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-16T20:52:54.774946] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-05. [2025-09-16T20:52:55.574955] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-03. [2025-09-16T20:52:55.978900] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-16T20:52:56.340121] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-16T20:52:56.374876] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-06. [2025-09-16T20:52:56.982770] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-16T20:52:57.174933] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-05. [2025-09-16T20:52:57.756119] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-16T20:52:57.974913] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-03. [2025-09-16T20:52:58.774886] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-04. [2025-09-16T20:52:58.845147] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-16T20:52:59.574926] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-06. [2025-09-16T20:52:59.880974] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-16T20:53:00.374913] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-07. [2025-09-16T20:53:00.561510] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-09-16T20:53:00.777470] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-16T20:53:01.174963] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-05. [2025-09-16T20:53:01.974891] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-07. [2025-09-16T20:53:02.345234] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-16T20:53:02.689965] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-16T20:53:02.774908] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-04. [2025-09-16T20:53:03.574895] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-06. [2025-09-16T20:53:03.613668] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-16T20:53:04.374943] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-08. [2025-09-16T20:53:04.884608] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-16T20:53:05.138750] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-16T20:53:05.174916] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-07. [2025-09-16T20:53:05.719082] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-16T20:53:05.974884] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-09. [2025-09-16T20:53:06.269921] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-16T20:53:06.774924] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-08. [2025-09-16T20:53:07.479025] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-16T20:53:07.483403] [INFO ] [REMOTE ] URI: Full fetch complete (40263 records). [2025-09-16T20:53:07.483538] [DEBUG] [VALIDATOR ] URI: Validating primary data. [2025-09-16T20:53:07.584075] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-08. [2025-09-16T20:53:07.879932] [DEBUG] [VALIDATOR ] URI: All expected trading days are present. [2025-09-16T20:53:07.880011] [DEBUG] [VALIDATOR ] URI: Primary data validation passed. [2025-09-16T20:53:07.880801] [INFO ] [MAIN ] URI: Fetched primary data is valid. [2025-09-16T20:53:07.880844] [DEBUG] [LOCAL ] URI: Saving primary data. [2025-09-16T20:53:07.881660] [DEBUG] [LOCAL ] URI: Trimmed 40263 records to 25957 (keeping 150 days of data) [2025-09-16T20:53:08.043382] [DEBUG] [LOCAL ] URI: Primary data saved (25957 records). [2025-09-16T20:53:08.043518] [INFO ] [MAIN ] URI: Full history saved. [2025-09-16T20:53:08.043600] [INFO ] [MAIN ] Update Progress: 2192/2369 symbols completed. URI took 26.9s. Estimated remaining: 18m 49s. Rate: 9.4 symbols/min [2025-09-16T20:53:08.220055] [INFO ] [MAIN ] USFD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:53:08.241996] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-16T20:53:08.279488] [DEBUG] [LOCAL ] USFD: Loaded 37822 existing records from primary storage. [2025-09-16T20:53:08.279620] [INFO ] [MAIN ] USFD: Loaded 37822 existing records. [2025-09-16T20:53:08.380109] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-05. [2025-09-16T20:53:08.461051] [WARN ] [MAIN ] USFD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:53:08.461247] [INFO ] [MAIN ] USFD: Wiping existing primary data before full refresh. [2025-09-16T20:53:08.461293] [INFO ] [LOCAL ] USFD: Starting deletion of primary data. [2025-09-16T20:53:08.462048] [DEBUG] [LOCAL ] USFD: Deleted primary data file. [2025-09-16T20:53:08.462096] [INFO ] [MAIN ] USFD: Starting full primary refresh. [2025-09-16T20:53:08.808093] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-16T20:53:08.830783] [INFO ] [REMOTE ] USFD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:53:09.174959] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-02. [2025-09-16T20:53:09.974967] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-09. [2025-09-16T20:53:10.442202] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-16T20:53:10.774868] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-09. [2025-09-16T20:53:11.091514] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-16T20:53:11.096520] [INFO ] [REMOTE ] USAC: Full fetch complete (25374 records). [2025-09-16T20:53:11.096744] [DEBUG] [VALIDATOR ] USAC: Validating primary data. [2025-09-16T20:53:11.488151] [DEBUG] [VALIDATOR ] USAC: All expected trading days are present. [2025-09-16T20:53:11.488235] [DEBUG] [VALIDATOR ] USAC: Primary data validation passed. [2025-09-16T20:53:11.488869] [INFO ] [MAIN ] USAC: Fetched primary data is valid. [2025-09-16T20:53:11.488923] [DEBUG] [LOCAL ] USAC: Saving primary data. [2025-09-16T20:53:11.489609] [DEBUG] [LOCAL ] USAC: Trimmed 25374 records to 15856 (keeping 150 days of data) [2025-09-16T20:53:11.575019] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-06. [2025-09-16T20:53:11.589149] [DEBUG] [LOCAL ] USAC: Primary data saved (15856 records). [2025-09-16T20:53:11.589403] [INFO ] [MAIN ] USAC: Full history saved. [2025-09-16T20:53:11.589506] [INFO ] [MAIN ] Update Progress: 2193/2369 symbols completed. USAC took 20.0s. Estimated remaining: 18m 43s. Rate: 9.4 symbols/min [2025-09-16T20:53:11.727192] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-02 (2.55 seconds). [2025-09-16T20:53:11.809716] [INFO ] [MAIN ] USNA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:53:11.823059] [DEBUG] [LOCAL ] USNA: Loaded 12749 existing records from primary storage. [2025-09-16T20:53:11.823184] [INFO ] [MAIN ] USNA: Loaded 12749 existing records. [2025-09-16T20:53:12.002691] [WARN ] [MAIN ] USNA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:53:12.002974] [INFO ] [MAIN ] USNA: Wiping existing primary data before full refresh. [2025-09-16T20:53:12.003036] [INFO ] [LOCAL ] USNA: Starting deletion of primary data. [2025-09-16T20:53:12.003441] [DEBUG] [LOCAL ] USNA: Deleted primary data file. [2025-09-16T20:53:12.003499] [INFO ] [MAIN ] USNA: Starting full primary refresh. [2025-09-16T20:53:12.371030] [INFO ] [REMOTE ] USNA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:53:12.376306] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-03. [2025-09-16T20:53:12.384186] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-16T20:53:12.389047] [INFO ] [REMOTE ] USA: Full fetch complete (38900 records). [2025-09-16T20:53:12.389132] [DEBUG] [VALIDATOR ] USA: Validating primary data. [2025-09-16T20:53:12.782363] [DEBUG] [VALIDATOR ] USA: All expected trading days are present. [2025-09-16T20:53:12.782441] [DEBUG] [VALIDATOR ] USA: Primary data validation passed. [2025-09-16T20:53:12.783216] [INFO ] [MAIN ] USA: Fetched primary data is valid. [2025-09-16T20:53:12.783258] [DEBUG] [LOCAL ] USA: Saving primary data. [2025-09-16T20:53:12.784180] [DEBUG] [LOCAL ] USA: Trimmed 38900 records to 26152 (keeping 150 days of data) [2025-09-16T20:53:12.946358] [DEBUG] [LOCAL ] USA: Primary data saved (26152 records). [2025-09-16T20:53:12.946566] [INFO ] [MAIN ] USA: Full history saved. [2025-09-16T20:53:12.946675] [INFO ] [MAIN ] Update Progress: 2194/2369 symbols completed. USA took 27.2s. Estimated remaining: 18m 36s. Rate: 9.4 symbols/min [2025-09-16T20:53:13.116728] [INFO ] [MAIN ] USPH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:53:13.129088] [DEBUG] [LOCAL ] USPH: Loaded 12417 existing records from primary storage. [2025-09-16T20:53:13.129200] [INFO ] [MAIN ] USPH: Loaded 12417 existing records. [2025-09-16T20:53:13.193558] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-02. [2025-09-16T20:53:13.311736] [WARN ] [MAIN ] USPH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:53:13.312040] [INFO ] [MAIN ] USPH: Wiping existing primary data before full refresh. [2025-09-16T20:53:13.312087] [INFO ] [LOCAL ] USPH: Starting deletion of primary data. [2025-09-16T20:53:13.312605] [DEBUG] [LOCAL ] USPH: Deleted primary data file. [2025-09-16T20:53:13.312684] [INFO ] [MAIN ] USPH: Starting full primary refresh. [2025-09-16T20:53:13.671209] [INFO ] [REMOTE ] USPH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:53:13.702435] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-16T20:53:13.974860] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-02. [2025-09-16T20:53:14.257101] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-16T20:53:14.310838] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-16T20:53:14.774887] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-03. [2025-09-16T20:53:14.994874] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-16T20:53:15.574870] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-03. [2025-09-16T20:53:15.963391] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-16T20:53:16.374897] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-04. [2025-09-16T20:53:16.691465] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-16T20:53:17.174926] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-07. [2025-09-16T20:53:17.485526] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-16T20:53:17.974901] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-04. [2025-09-16T20:53:18.774901] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-05. [2025-09-16T20:53:19.468435] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-16T20:53:19.574866] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-08. [2025-09-16T20:53:19.675779] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-16T20:53:19.901856] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-16T20:53:20.374901] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-06. [2025-09-16T20:53:21.174883] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-04. [2025-09-16T20:53:21.583035] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-16T20:53:21.604983] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-16T20:53:21.974870] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-07. [2025-09-16T20:53:22.266069] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-16T20:53:22.774890] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-05. [2025-09-16T20:53:22.830374] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-16T20:53:23.574878] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-05. [2025-09-16T20:53:23.894713] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-16T20:53:24.374912] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-06. [2025-09-16T20:53:25.174907] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-09. [2025-09-16T20:53:25.384767] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-16T20:53:25.417341] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-16T20:53:25.951968] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-16T20:53:25.958073] [INFO ] [REMOTE ] USB: Full fetch complete (57977 records). [2025-09-16T20:53:25.958190] [DEBUG] [VALIDATOR ] USB: Validating primary data. [2025-09-16T20:53:25.959145] [FATAL] [VALIDATOR ] USB: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T20:53:25.959230] [FATAL] [MAIN ] USB: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:53:25.959267] [WARN ] [MAIN ] USB: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:53:25.959304] [INFO ] [LOCAL ] USB: Starting deletion of primary data. [2025-09-16T20:53:25.959361] [DEBUG] [LOCAL ] USB: No primary data file found to delete. [2025-09-16T20:53:25.959396] [INFO ] [LOCAL ] USB: Starting deletion of derivative data. [2025-09-16T20:53:25.959438] [DEBUG] [LOCAL ] USB: No derivative data file found to delete. [2025-09-16T20:53:25.959517] [INFO ] [MAIN ] Update Progress: 2195/2369 symbols completed. USB took 33.0s. Estimated remaining: 18m 30s. Rate: 9.4 symbols/min [2025-09-16T20:53:25.981029] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-07. [2025-09-16T20:53:26.138728] [INFO ] [MAIN ] UTF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:53:26.159322] [DEBUG] [LOCAL ] UTF: Loaded 19793 existing records from primary storage. [2025-09-16T20:53:26.159473] [INFO ] [MAIN ] UTF: Loaded 19793 existing records. [2025-09-16T20:53:26.338284] [WARN ] [MAIN ] UTF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:53:26.338605] [INFO ] [MAIN ] UTF: Wiping existing primary data before full refresh. [2025-09-16T20:53:26.338677] [INFO ] [LOCAL ] UTF: Starting deletion of primary data. [2025-09-16T20:53:26.339181] [DEBUG] [LOCAL ] UTF: Deleted primary data file. [2025-09-16T20:53:26.339227] [INFO ] [MAIN ] UTF: Starting full primary refresh. [2025-09-16T20:53:26.707855] [INFO ] [REMOTE ] UTF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:53:26.774909] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-02. [2025-09-16T20:53:27.153720] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-16T20:53:27.574867] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-08. [2025-09-16T20:53:28.147736] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-16T20:53:28.374905] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-03. [2025-09-16T20:53:28.573502] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-16T20:53:29.174922] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-06. [2025-09-16T20:53:29.711413] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-16T20:53:29.974906] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-08. [2025-09-16T20:53:30.774846] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-04. [2025-09-16T20:53:30.996482] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-16T20:53:31.036566] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-16T20:53:31.574925] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-09. [2025-09-16T20:53:32.162013] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-16T20:53:32.164212] [INFO ] [REMOTE ] USNA: Full fetch complete (20530 records). [2025-09-16T20:53:32.164281] [DEBUG] [VALIDATOR ] USNA: Validating primary data. [2025-09-16T20:53:32.378171] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-07. [2025-09-16T20:53:32.545283] [DEBUG] [VALIDATOR ] USNA: All expected trading days are present. [2025-09-16T20:53:32.547439] [DEBUG] [VALIDATOR ] USNA: Primary data validation passed. [2025-09-16T20:53:32.548082] [INFO ] [MAIN ] USNA: Fetched primary data is valid. [2025-09-16T20:53:32.548477] [DEBUG] [LOCAL ] USNA: Saving primary data. [2025-09-16T20:53:32.549304] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-16T20:53:32.556829] [DEBUG] [LOCAL ] USNA: Trimmed 20530 records to 12855 (keeping 150 days of data) [2025-09-16T20:53:32.632626] [DEBUG] [LOCAL ] USNA: Primary data saved (12855 records). [2025-09-16T20:53:32.632787] [INFO ] [MAIN ] USNA: Full history saved. [2025-09-16T20:53:32.632889] [INFO ] [MAIN ] Update Progress: 2196/2369 symbols completed. USNA took 21.0s. Estimated remaining: 18m 24s. Rate: 9.4 symbols/min [2025-09-16T20:53:32.812326] [INFO ] [MAIN ] UTI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:53:32.839929] [DEBUG] [LOCAL ] UTI: Loaded 29753 existing records from primary storage. [2025-09-16T20:53:32.840071] [INFO ] [MAIN ] UTI: Loaded 29753 existing records. [2025-09-16T20:53:33.014367] [WARN ] [MAIN ] UTI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:53:33.014690] [INFO ] [MAIN ] UTI: Wiping existing primary data before full refresh. [2025-09-16T20:53:33.014766] [INFO ] [LOCAL ] UTI: Starting deletion of primary data. [2025-09-16T20:53:33.015433] [DEBUG] [LOCAL ] UTI: Deleted primary data file. [2025-09-16T20:53:33.015493] [INFO ] [MAIN ] UTI: Starting full primary refresh. [2025-09-16T20:53:33.185491] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-09. [2025-09-16T20:53:33.367541] [INFO ] [REMOTE ] UTI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:53:33.974880] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-05. [2025-09-16T20:53:34.185865] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-16T20:53:34.188113] [INFO ] [REMOTE ] USPH: Full fetch complete (17787 records). [2025-09-16T20:53:34.188193] [DEBUG] [VALIDATOR ] USPH: Validating primary data. [2025-09-16T20:53:34.590121] [DEBUG] [VALIDATOR ] USPH: All expected trading days are present. [2025-09-16T20:53:34.591943] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-16T20:53:34.602696] [DEBUG] [VALIDATOR ] USPH: Primary data validation passed. [2025-09-16T20:53:34.603303] [INFO ] [MAIN ] USPH: Fetched primary data is valid. [2025-09-16T20:53:34.603466] [DEBUG] [LOCAL ] USPH: Saving primary data. [2025-09-16T20:53:34.604737] [DEBUG] [LOCAL ] USPH: Trimmed 17787 records to 12501 (keeping 150 days of data) [2025-09-16T20:53:34.697448] [DEBUG] [LOCAL ] USPH: Primary data saved (12501 records). [2025-09-16T20:53:34.697611] [INFO ] [MAIN ] USPH: Full history saved. [2025-09-16T20:53:34.697731] [INFO ] [MAIN ] Update Progress: 2197/2369 symbols completed. USPH took 21.8s. Estimated remaining: 18m 17s. Rate: 9.4 symbols/min [2025-09-16T20:53:34.774877] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-08. [2025-09-16T20:53:35.377159] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-16T20:53:35.574913] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-06. [2025-09-16T20:53:36.374942] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-02. [2025-09-16T20:53:36.549409] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-16T20:53:36.813168] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-16T20:53:37.174968] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-09. [2025-09-16T20:53:37.974912] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-07. [2025-09-16T20:53:38.005069] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-16T20:53:38.774949] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-03. [2025-09-16T20:53:38.937914] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-16T20:53:38.944378] [INFO ] [REMOTE ] USFD: Full fetch complete (55938 records). [2025-09-16T20:53:38.944517] [DEBUG] [VALIDATOR ] USFD: Validating primary data. [2025-09-16T20:53:39.327730] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-16T20:53:39.371912] [DEBUG] [VALIDATOR ] USFD: All expected trading days are present. [2025-09-16T20:53:39.372434] [DEBUG] [VALIDATOR ] USFD: Primary data validation passed. [2025-09-16T20:53:39.373632] [INFO ] [MAIN ] USFD: Fetched primary data is valid. [2025-09-16T20:53:39.373699] [DEBUG] [LOCAL ] USFD: Saving primary data. [2025-09-16T20:53:39.375134] [DEBUG] [LOCAL ] USFD: Trimmed 55938 records to 38200 (keeping 150 days of data) [2025-09-16T20:53:39.584046] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-08. [2025-09-16T20:53:39.621231] [DEBUG] [LOCAL ] USFD: Primary data saved (38200 records). [2025-09-16T20:53:39.621403] [INFO ] [MAIN ] USFD: Full history saved. [2025-09-16T20:53:39.621529] [INFO ] [MAIN ] Update Progress: 2198/2369 symbols completed. USFD took 31.6s. Estimated remaining: 18m 10s. Rate: 9.4 symbols/min [2025-09-16T20:53:40.386753] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-16T20:53:40.395803] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-04. [2025-09-16T20:53:40.872202] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-16T20:53:41.174944] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-09. [2025-09-16T20:53:42.175513] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-16T20:53:42.184680] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-05. [2025-09-16T20:53:42.217149] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-16T20:53:42.220989] [INFO ] [REMOTE ] UTF: Full fetch complete (30396 records). [2025-09-16T20:53:42.221089] [DEBUG] [VALIDATOR ] UTF: Validating primary data. [2025-09-16T20:53:42.587487] [DEBUG] [VALIDATOR ] UTF: All expected trading days are present. [2025-09-16T20:53:42.587569] [DEBUG] [VALIDATOR ] UTF: Primary data validation passed. [2025-09-16T20:53:42.588194] [INFO ] [MAIN ] UTF: Fetched primary data is valid. [2025-09-16T20:53:42.588247] [DEBUG] [LOCAL ] UTF: Saving primary data. [2025-09-16T20:53:42.588991] [DEBUG] [LOCAL ] UTF: Trimmed 30396 records to 20137 (keeping 150 days of data) [2025-09-16T20:53:42.712696] [DEBUG] [LOCAL ] UTF: Primary data saved (20137 records). [2025-09-16T20:53:42.712823] [INFO ] [MAIN ] UTF: Full history saved. [2025-09-16T20:53:42.712905] [INFO ] [MAIN ] Update Progress: 2199/2369 symbols completed. UTF took 16.8s. Estimated remaining: 18m 4s. Rate: 9.4 symbols/min [2025-09-16T20:53:44.082590] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-16T20:53:44.092838] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-06. [2025-09-16T20:53:45.651341] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-16T20:53:45.659684] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-07. [2025-09-16T20:53:47.152201] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-16T20:53:47.160197] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-08. [2025-09-16T20:53:48.870750] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-16T20:53:48.879839] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-09. [2025-09-16T20:53:50.050364] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-16T20:53:50.055039] [INFO ] [REMOTE ] UTI: Full fetch complete (44460 records). [2025-09-16T20:53:50.055169] [DEBUG] [VALIDATOR ] UTI: Validating primary data. [2025-09-16T20:53:50.437269] [DEBUG] [VALIDATOR ] UTI: All expected trading days are present. [2025-09-16T20:53:50.437347] [DEBUG] [VALIDATOR ] UTI: Primary data validation passed. [2025-09-16T20:53:50.438232] [INFO ] [MAIN ] UTI: Fetched primary data is valid. [2025-09-16T20:53:50.438284] [DEBUG] [LOCAL ] UTI: Saving primary data. [2025-09-16T20:53:50.439391] [DEBUG] [LOCAL ] UTI: Trimmed 44460 records to 30039 (keeping 150 days of data) [2025-09-16T20:53:50.619953] [DEBUG] [LOCAL ] UTI: Primary data saved (30039 records). [2025-09-16T20:53:50.620097] [INFO ] [MAIN ] UTI: Full history saved. [2025-09-16T20:53:50.620213] [INFO ] [MAIN ] Update Progress: 2200/2369 symbols completed. UTI took 18.0s. Estimated remaining: 17m 58s. Rate: 9.4 symbols/min [2025-09-16T20:53:51.208892] [INFO ] [MAIN ] UTL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:53:51.227133] [INFO ] [MAIN ] UVE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:53:51.283079] [INFO ] [MAIN ] UVV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:53:51.328273] [INFO ] [MAIN ] UTZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:53:51.341388] [DEBUG] [LOCAL ] UTL: Loaded 8429 existing records from primary storage. [2025-09-16T20:53:51.341666] [INFO ] [MAIN ] UTL: Loaded 8429 existing records. [2025-09-16T20:53:51.466247] [DEBUG] [LOCAL ] UVV: Loaded 17329 existing records from primary storage. [2025-09-16T20:53:51.472724] [INFO ] [MAIN ] UVV: Loaded 17329 existing records. [2025-09-16T20:53:51.478757] [DEBUG] [LOCAL ] UVE: Loaded 16792 existing records from primary storage. [2025-09-16T20:53:51.557547] [INFO ] [MAIN ] UVE: Loaded 16792 existing records. [2025-09-16T20:53:51.645732] [WARN ] [MAIN ] UTL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:53:51.670570] [INFO ] [MAIN ] UTL: Wiping existing primary data before full refresh. [2025-09-16T20:53:51.671073] [DEBUG] [LOCAL ] UTZ: Loaded 32830 existing records from primary storage. [2025-09-16T20:53:51.676347] [INFO ] [MAIN ] UTZ: Loaded 32830 existing records. [2025-09-16T20:53:51.676396] [INFO ] [LOCAL ] UTL: Starting deletion of primary data. [2025-09-16T20:53:51.721806] [DEBUG] [LOCAL ] UTL: Deleted primary data file. [2025-09-16T20:53:51.790398] [INFO ] [MAIN ] UTL: Starting full primary refresh. [2025-09-16T20:53:52.076171] [WARN ] [MAIN ] UVV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:53:52.121769] [INFO ] [MAIN ] UVV: Wiping existing primary data before full refresh. [2025-09-16T20:53:52.134337] [WARN ] [MAIN ] UVE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:53:52.177001] [INFO ] [LOCAL ] UVV: Starting deletion of primary data. [2025-09-16T20:53:52.229201] [WARN ] [MAIN ] UTZ: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:53:52.229067] [INFO ] [MAIN ] UVE: Wiping existing primary data before full refresh. [2025-09-16T20:53:52.239703] [INFO ] [LOCAL ] UVE: Starting deletion of primary data. [2025-09-16T20:53:52.255392] [DEBUG] [LOCAL ] UVE: Deleted primary data file. [2025-09-16T20:53:52.269825] [INFO ] [MAIN ] UTZ: Wiping existing primary data before full refresh. [2025-09-16T20:53:52.269931] [INFO ] [LOCAL ] UTZ: Starting deletion of primary data. [2025-09-16T20:53:52.250019] [DEBUG] [LOCAL ] UVV: Deleted primary data file. [2025-09-16T20:53:52.270065] [INFO ] [MAIN ] UVV: Starting full primary refresh. [2025-09-16T20:53:52.287803] [INFO ] [MAIN ] UVE: Starting full primary refresh. [2025-09-16T20:53:52.312574] [DEBUG] [LOCAL ] UTZ: Deleted primary data file. [2025-09-16T20:53:52.400955] [INFO ] [MAIN ] UTZ: Starting full primary refresh. [2025-09-16T20:53:52.983107] [INFO ] [REMOTE ] UTL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:53:53.029884] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-02. [2025-09-16T20:53:53.501067] [INFO ] [REMOTE ] UVE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:53:53.511155] [INFO ] [REMOTE ] UVV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:53:53.550008] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-02. [2025-09-16T20:53:53.532332] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-02. [2025-09-16T20:53:53.586409] [INFO ] [REMOTE ] UTZ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:53:53.587020] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-02. [2025-09-16T20:53:54.125014] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-16T20:53:54.127382] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-03. [2025-09-16T20:53:54.327403] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-16T20:53:54.330764] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-03. [2025-09-16T20:53:54.733288] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-16T20:53:54.737543] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-03. [2025-09-16T20:53:54.801006] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-16T20:53:54.803275] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-04. [2025-09-16T20:53:54.896559] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-16T20:53:54.905090] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-03. [2025-09-16T20:53:55.500902] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-16T20:53:55.504996] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-04. [2025-09-16T20:53:55.731145] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-16T20:53:55.733789] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-05. [2025-09-16T20:53:55.760184] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-16T20:53:55.764591] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-04. [2025-09-16T20:53:56.522688] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-16T20:53:56.528050] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-05. [2025-09-16T20:53:56.552962] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-16T20:53:56.562625] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-04. [2025-09-16T20:53:56.577029] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-16T20:53:56.987804] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-16T20:53:57.174939] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-05. [2025-09-16T20:53:57.842976] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-16T20:53:57.974938] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-06. [2025-09-16T20:53:58.246524] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-16T20:53:58.475138] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-16T20:53:58.774921] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-06. [2025-09-16T20:53:58.903819] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-16T20:53:59.574937] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-06. [2025-09-16T20:54:00.005606] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-16T20:54:00.374918] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-07. [2025-09-16T20:54:00.424348] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-16T20:54:01.174933] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-07. [2025-09-16T20:54:01.974983] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-07. [2025-09-16T20:54:02.086469] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-16T20:54:02.464622] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-16T20:54:02.774985] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-05. [2025-09-16T20:54:03.574908] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-08. [2025-09-16T20:54:04.029842] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-16T20:54:04.374915] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-08. [2025-09-16T20:54:04.754481] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-16T20:54:05.174908] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-09. [2025-09-16T20:54:05.226217] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-09-16T20:54:05.335959] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-16T20:54:05.974908] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-06. [2025-09-16T20:54:06.147602] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-16T20:54:06.150114] [INFO ] [REMOTE ] UVE: Full fetch complete (23698 records). [2025-09-16T20:54:06.150189] [DEBUG] [VALIDATOR ] UVE: Validating primary data. [2025-09-16T20:54:06.522773] [DEBUG] [VALIDATOR ] UVE: All expected trading days are present. [2025-09-16T20:54:06.522882] [DEBUG] [VALIDATOR ] UVE: Primary data validation passed. [2025-09-16T20:54:06.523391] [INFO ] [MAIN ] UVE: Fetched primary data is valid. [2025-09-16T20:54:06.523433] [DEBUG] [LOCAL ] UVE: Saving primary data. [2025-09-16T20:54:06.524181] [DEBUG] [LOCAL ] UVE: Trimmed 23698 records to 16896 (keeping 150 days of data) [2025-09-16T20:54:06.632715] [DEBUG] [LOCAL ] UVE: Primary data saved (16896 records). [2025-09-16T20:54:06.632880] [INFO ] [MAIN ] UVE: Full history saved. [2025-09-16T20:54:06.632988] [INFO ] [MAIN ] Update Progress: 2201/2369 symbols completed. UVE took 16.0s. Estimated remaining: 17m 52s. Rate: 9.4 symbols/min [2025-09-16T20:54:06.777704] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-08. [2025-09-16T20:54:06.808238] [INFO ] [MAIN ] UWMC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:54:06.808418] [DEBUG] [LOCAL ] UWMC: No existing data file found in primary storage. [2025-09-16T20:54:06.808459] [WARN ] [MAIN ] UWMC: No existing data found, performing full refresh instead. [2025-09-16T20:54:06.808589] [INFO ] [MAIN ] UWMC: Wiping existing primary data before full refresh. [2025-09-16T20:54:06.808633] [INFO ] [LOCAL ] UWMC: Starting deletion of primary data. [2025-09-16T20:54:06.808697] [DEBUG] [LOCAL ] UWMC: No primary data file found to delete. [2025-09-16T20:54:06.808731] [INFO ] [MAIN ] UWMC: Starting full primary refresh. [2025-09-16T20:54:07.166368] [INFO ] [REMOTE ] UWMC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:54:07.537669] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-16T20:54:07.574862] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-07. [2025-09-16T20:54:07.650960] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-16T20:54:08.374912] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-09. [2025-09-16T20:54:09.174892] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-09. [2025-09-16T20:54:09.228745] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-16T20:54:09.419256] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-16T20:54:09.422092] [INFO ] [REMOTE ] UVV: Full fetch complete (23462 records). [2025-09-16T20:54:09.422169] [DEBUG] [VALIDATOR ] UVV: Validating primary data. [2025-09-16T20:54:09.792993] [DEBUG] [VALIDATOR ] UVV: All expected trading days are present. [2025-09-16T20:54:09.793086] [DEBUG] [VALIDATOR ] UVV: Primary data validation passed. [2025-09-16T20:54:09.793807] [INFO ] [MAIN ] UVV: Fetched primary data is valid. [2025-09-16T20:54:09.793861] [DEBUG] [LOCAL ] UVV: Saving primary data. [2025-09-16T20:54:09.794895] [DEBUG] [LOCAL ] UVV: Trimmed 23462 records to 17480 (keeping 150 days of data) [2025-09-16T20:54:09.903411] [DEBUG] [LOCAL ] UVV: Primary data saved (17480 records). [2025-09-16T20:54:09.903579] [INFO ] [MAIN ] UVV: Full history saved. [2025-09-16T20:54:09.904564] [INFO ] [MAIN ] Update Progress: 2202/2369 symbols completed. UVV took 19.3s. Estimated remaining: 17m 45s. Rate: 9.4 symbols/min [2025-09-16T20:54:09.985109] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-02. [2025-09-16T20:54:10.063845] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-16T20:54:10.087824] [INFO ] [MAIN ] UZD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:54:10.088619] [INFO ] [REMOTE ] UTL: Full fetch complete (11613 records). [2025-09-16T20:54:10.088722] [DEBUG] [VALIDATOR ] UTL: Validating primary data. [2025-09-16T20:54:10.198118] [DEBUG] [LOCAL ] UZD: Loaded 4690 existing records from primary storage. [2025-09-16T20:54:10.208672] [INFO ] [MAIN ] UZD: Loaded 4690 existing records. [2025-09-16T20:54:10.570325] [WARN ] [MAIN ] UZD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:54:10.632329] [INFO ] [MAIN ] UZD: Wiping existing primary data before full refresh. [2025-09-16T20:54:10.638802] [INFO ] [LOCAL ] UZD: Starting deletion of primary data. [2025-09-16T20:54:10.638867] [DEBUG] [VALIDATOR ] UTL: All expected trading days are present. [2025-09-16T20:54:10.639027] [DEBUG] [VALIDATOR ] UTL: Primary data validation passed. [2025-09-16T20:54:10.639321] [INFO ] [MAIN ] UTL: Fetched primary data is valid. [2025-09-16T20:54:10.639362] [DEBUG] [LOCAL ] UZD: Deleted primary data file. [2025-09-16T20:54:10.639433] [INFO ] [MAIN ] UZD: Starting full primary refresh. [2025-09-16T20:54:10.639466] [DEBUG] [LOCAL ] UTL: Saving primary data. [2025-09-16T20:54:10.741514] [DEBUG] [LOCAL ] UTL: Trimmed 11613 records to 8545 (keeping 150 days of data) [2025-09-16T20:54:10.814946] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-08. [2025-09-16T20:54:11.055105] [INFO ] [REMOTE ] UZD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:54:11.058086] [DEBUG] [LOCAL ] UTL: Primary data saved (8545 records). [2025-09-16T20:54:11.058161] [INFO ] [MAIN ] UTL: Full history saved. [2025-09-16T20:54:11.058236] [INFO ] [MAIN ] Update Progress: 2203/2369 symbols completed. UTL took 20.4s. Estimated remaining: 17m 39s. Rate: 9.4 symbols/min [2025-09-16T20:54:11.226024] [INFO ] [MAIN ] UZE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:54:11.233414] [DEBUG] [LOCAL ] UZE: Loaded 5598 existing records from primary storage. [2025-09-16T20:54:11.233543] [INFO ] [MAIN ] UZE: Loaded 5598 existing records. [2025-09-16T20:54:11.409886] [WARN ] [MAIN ] UZE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:54:11.410140] [INFO ] [MAIN ] UZE: Wiping existing primary data before full refresh. [2025-09-16T20:54:11.410186] [INFO ] [LOCAL ] UZE: Starting deletion of primary data. [2025-09-16T20:54:11.410435] [DEBUG] [LOCAL ] UZE: Deleted primary data file. [2025-09-16T20:54:11.410480] [INFO ] [MAIN ] UZE: Starting full primary refresh. [2025-09-16T20:54:11.587222] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-02. [2025-09-16T20:54:11.773944] [INFO ] [REMOTE ] UZE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:54:11.801889] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-16T20:54:12.374937] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-02. [2025-09-16T20:54:13.174899] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-03. [2025-09-16T20:54:13.227015] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-16T20:54:13.645787] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-16T20:54:13.685107] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-08 (2.87 seconds). [2025-09-16T20:54:13.974863] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-03. [2025-09-16T20:54:14.774861] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-09. [2025-09-16T20:54:14.785539] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-16T20:54:15.253084] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-16T20:54:15.574909] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-04. [2025-09-16T20:54:15.897436] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-16T20:54:15.902383] [INFO ] [REMOTE ] UTZ: Full fetch complete (48777 records). [2025-09-16T20:54:15.902481] [DEBUG] [VALIDATOR ] UTZ: Validating primary data. [2025-09-16T20:54:16.281095] [DEBUG] [VALIDATOR ] UTZ: All expected trading days are present. [2025-09-16T20:54:16.281177] [DEBUG] [VALIDATOR ] UTZ: Primary data validation passed. [2025-09-16T20:54:16.282092] [INFO ] [MAIN ] UTZ: Fetched primary data is valid. [2025-09-16T20:54:16.282136] [DEBUG] [LOCAL ] UTZ: Saving primary data. [2025-09-16T20:54:16.283184] [DEBUG] [LOCAL ] UTZ: Trimmed 48777 records to 33183 (keeping 150 days of data) [2025-09-16T20:54:16.375311] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-03. [2025-09-16T20:54:16.479266] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-16T20:54:16.504465] [DEBUG] [LOCAL ] UTZ: Primary data saved (33183 records). [2025-09-16T20:54:16.504617] [INFO ] [MAIN ] UTZ: Full history saved. [2025-09-16T20:54:16.504739] [INFO ] [MAIN ] Update Progress: 2204/2369 symbols completed. UTZ took 25.9s. Estimated remaining: 17m 32s. Rate: 9.4 symbols/min [2025-09-16T20:54:16.678722] [INFO ] [MAIN ] UZF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:54:16.685191] [DEBUG] [LOCAL ] UZF: Loaded 4671 existing records from primary storage. [2025-09-16T20:54:16.685292] [INFO ] [MAIN ] UZF: Loaded 4671 existing records. [2025-09-16T20:54:16.862466] [WARN ] [MAIN ] UZF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:54:16.862742] [INFO ] [MAIN ] UZF: Wiping existing primary data before full refresh. [2025-09-16T20:54:16.862798] [INFO ] [LOCAL ] UZF: Starting deletion of primary data. [2025-09-16T20:54:16.863027] [DEBUG] [LOCAL ] UZF: Deleted primary data file. [2025-09-16T20:54:16.863070] [INFO ] [MAIN ] UZF: Starting full primary refresh. [2025-09-16T20:54:17.185383] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-05. [2025-09-16T20:54:17.223621] [INFO ] [REMOTE ] UZF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:54:17.229873] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-16T20:54:17.934753] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-16T20:54:17.974856] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-06. [2025-09-16T20:54:18.676854] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-16T20:54:18.774907] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-02. [2025-09-16T20:54:19.415863] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-16T20:54:19.574901] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-03. [2025-09-16T20:54:20.374914] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-04. [2025-09-16T20:54:20.402858] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-16T20:54:21.158810] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-16T20:54:21.174848] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-05. [2025-09-16T20:54:21.868240] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-16T20:54:21.974870] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-07. [2025-09-16T20:54:22.774957] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-04. [2025-09-16T20:54:22.774889] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-16T20:54:23.574914] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-08. [2025-09-16T20:54:24.374912] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-06. [2025-09-16T20:54:24.561486] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-16T20:54:24.758866] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-16T20:54:25.122861] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-16T20:54:25.174884] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-07. [2025-09-16T20:54:25.574699] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-16T20:54:25.974905] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-09. [2025-09-16T20:54:26.774914] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-04. [2025-09-16T20:54:26.827802] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-16T20:54:26.829223] [INFO ] [REMOTE ] UZE: Full fetch complete (7827 records). [2025-09-16T20:54:26.829306] [DEBUG] [VALIDATOR ] UZE: Validating primary data. [2025-09-16T20:54:27.207890] [DEBUG] [VALIDATOR ] UZE: All expected trading days are present. [2025-09-16T20:54:27.207983] [DEBUG] [VALIDATOR ] UZE: Primary data validation passed. [2025-09-16T20:54:27.208277] [INFO ] [MAIN ] UZE: Fetched primary data is valid. [2025-09-16T20:54:27.208346] [DEBUG] [LOCAL ] UZE: Saving primary data. [2025-09-16T20:54:27.208805] [DEBUG] [LOCAL ] UZE: Trimmed 7827 records to 5629 (keeping 150 days of data) [2025-09-16T20:54:27.243667] [DEBUG] [LOCAL ] UZE: Primary data saved (5629 records). [2025-09-16T20:54:27.243747] [INFO ] [MAIN ] UZE: Full history saved. [2025-09-16T20:54:27.243870] [INFO ] [MAIN ] Update Progress: 2205/2369 symbols completed. UZE took 16.2s. Estimated remaining: 17m 26s. Rate: 9.4 symbols/min [2025-09-16T20:54:27.414267] [INFO ] [MAIN ] V: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:54:27.461609] [DEBUG] [LOCAL ] V: Loaded 39724 existing records from primary storage. [2025-09-16T20:54:27.461788] [INFO ] [MAIN ] V: Loaded 39724 existing records. [2025-09-16T20:54:27.580107] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-08. [2025-09-16T20:54:27.648847] [WARN ] [MAIN ] V: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:54:27.649679] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-16T20:54:27.649979] [INFO ] [MAIN ] V: Wiping existing primary data before full refresh. [2025-09-16T20:54:27.652353] [INFO ] [LOCAL ] V: Starting deletion of primary data. [2025-09-16T20:54:27.653422] [DEBUG] [LOCAL ] V: Deleted primary data file. [2025-09-16T20:54:27.653482] [INFO ] [MAIN ] V: Starting full primary refresh. [2025-09-16T20:54:28.010307] [INFO ] [REMOTE ] V: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:54:28.374898] [INFO ] [REMOTE ] V: Fetching primary data for 2025-02. [2025-09-16T20:54:28.573570] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-16T20:54:29.174899] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-09. [2025-09-16T20:54:29.833745] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-16T20:54:29.834971] [INFO ] [REMOTE ] UZD: Full fetch complete (6975 records). [2025-09-16T20:54:29.835046] [DEBUG] [VALIDATOR ] UZD: Validating primary data. [2025-09-16T20:54:29.980147] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-05. [2025-09-16T20:54:30.247869] [DEBUG] [VALIDATOR ] UZD: All expected trading days are present. [2025-09-16T20:54:30.247968] [DEBUG] [VALIDATOR ] UZD: Primary data validation passed. [2025-09-16T20:54:30.248172] [INFO ] [MAIN ] UZD: Fetched primary data is valid. [2025-09-16T20:54:30.248213] [DEBUG] [LOCAL ] UZD: Saving primary data. [2025-09-16T20:54:30.248626] [DEBUG] [LOCAL ] UZD: Trimmed 6975 records to 4704 (keeping 150 days of data) [2025-09-16T20:54:30.279130] [DEBUG] [LOCAL ] UZD: Primary data saved (4704 records). [2025-09-16T20:54:30.279260] [INFO ] [MAIN ] UZD: Full history saved. [2025-09-16T20:54:30.279360] [INFO ] [MAIN ] Update Progress: 2206/2369 symbols completed. UZD took 20.4s. Estimated remaining: 17m 19s. Rate: 9.4 symbols/min [2025-09-16T20:54:30.458100] [INFO ] [MAIN ] VAC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:54:30.485611] [DEBUG] [LOCAL ] VAC: Loaded 25141 existing records from primary storage. [2025-09-16T20:54:30.485796] [INFO ] [MAIN ] VAC: Loaded 25141 existing records. [2025-09-16T20:54:30.674519] [WARN ] [MAIN ] VAC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:54:30.679132] [INFO ] [MAIN ] VAC: Wiping existing primary data before full refresh. [2025-09-16T20:54:30.679221] [INFO ] [LOCAL ] VAC: Starting deletion of primary data. [2025-09-16T20:54:30.679362] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-16T20:54:30.681149] [DEBUG] [LOCAL ] VAC: Deleted primary data file. [2025-09-16T20:54:30.681459] [INFO ] [MAIN ] VAC: Starting full primary refresh. [2025-09-16T20:54:30.782140] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-06. [2025-09-16T20:54:30.960693] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-02 (2.59 seconds). [2025-09-16T20:54:31.079249] [INFO ] [REMOTE ] VAC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:54:31.486300] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-16T20:54:31.574887] [INFO ] [REMOTE ] V: Fetching primary data for 2025-03. [2025-09-16T20:54:32.374940] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-05. [2025-09-16T20:54:33.174973] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-02. [2025-09-16T20:54:33.724077] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-16T20:54:33.974936] [INFO ] [REMOTE ] V: Fetching primary data for 2025-04. [2025-09-16T20:54:34.295903] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-16T20:54:34.694406] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-16T20:54:34.774866] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-03. [2025-09-16T20:54:35.574944] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-07. [2025-09-16T20:54:36.123282] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-16T20:54:36.142573] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-16T20:54:36.286512] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-16T20:54:36.374865] [INFO ] [REMOTE ] V: Fetching primary data for 2025-05. [2025-09-16T20:54:37.174955] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-08. [2025-09-16T20:54:37.974910] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-04. [2025-09-16T20:54:38.035766] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-16T20:54:38.395190] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-16T20:54:38.774947] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-06. [2025-09-16T20:54:39.528027] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-16T20:54:39.574861] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-05. [2025-09-16T20:54:40.275211] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-16T20:54:40.374857] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-07. [2025-09-16T20:54:41.112317] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-16T20:54:41.174883] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-06. [2025-09-16T20:54:41.974927] [INFO ] [REMOTE ] V: Fetching primary data for 2025-06. [2025-09-16T20:54:42.040558] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-16T20:54:42.278620] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-16T20:54:42.774906] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-08. [2025-09-16T20:54:43.574904] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-07. [2025-09-16T20:54:44.374923] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-09. [2025-09-16T20:54:44.425778] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-06 (2.45 seconds). [2025-09-16T20:54:44.827662] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-16T20:54:45.044084] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-16T20:54:45.045456] [INFO ] [REMOTE ] UZF: Full fetch complete (6866 records). [2025-09-16T20:54:45.045531] [DEBUG] [VALIDATOR ] UZF: Validating primary data. [2025-09-16T20:54:45.190452] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-09. [2025-09-16T20:54:45.333468] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-16T20:54:45.494933] [DEBUG] [VALIDATOR ] UZF: All expected trading days are present. [2025-09-16T20:54:45.495052] [DEBUG] [VALIDATOR ] UZF: Primary data validation passed. [2025-09-16T20:54:45.495332] [INFO ] [MAIN ] UZF: Fetched primary data is valid. [2025-09-16T20:54:45.495384] [DEBUG] [LOCAL ] UZF: Saving primary data. [2025-09-16T20:54:45.495913] [DEBUG] [LOCAL ] UZF: Trimmed 6866 records to 4680 (keeping 150 days of data) [2025-09-16T20:54:45.528871] [DEBUG] [LOCAL ] UZF: Primary data saved (4680 records). [2025-09-16T20:54:45.529035] [INFO ] [MAIN ] UZF: Full history saved. [2025-09-16T20:54:45.529183] [INFO ] [MAIN ] Update Progress: 2207/2369 symbols completed. UZF took 29.0s. Estimated remaining: 17m 14s. Rate: 9.4 symbols/min [2025-09-16T20:54:45.731927] [INFO ] [MAIN ] VAL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:54:45.784505] [DEBUG] [LOCAL ] VAL: Loaded 37087 existing records from primary storage. [2025-09-16T20:54:45.784814] [INFO ] [MAIN ] VAL: Loaded 37087 existing records. [2025-09-16T20:54:45.968791] [WARN ] [MAIN ] VAL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:54:45.969166] [INFO ] [MAIN ] VAL: Wiping existing primary data before full refresh. [2025-09-16T20:54:45.969230] [INFO ] [LOCAL ] VAL: Starting deletion of primary data. [2025-09-16T20:54:45.970099] [DEBUG] [LOCAL ] VAL: Deleted primary data file. [2025-09-16T20:54:45.970156] [INFO ] [MAIN ] VAL: Starting full primary refresh. [2025-09-16T20:54:45.982547] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-08. [2025-09-16T20:54:46.346518] [INFO ] [REMOTE ] VAL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:54:46.774934] [INFO ] [REMOTE ] V: Fetching primary data for 2025-07. [2025-09-16T20:54:47.090600] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-16T20:54:47.096890] [INFO ] [REMOTE ] UWMC: Full fetch complete (57094 records). [2025-09-16T20:54:47.096999] [DEBUG] [VALIDATOR ] UWMC: Validating primary data. [2025-09-16T20:54:47.505482] [DEBUG] [VALIDATOR ] UWMC: All expected trading days are present. [2025-09-16T20:54:47.505786] [DEBUG] [VALIDATOR ] UWMC: Primary data validation passed. [2025-09-16T20:54:47.507339] [INFO ] [MAIN ] UWMC: Fetched primary data is valid. [2025-09-16T20:54:47.508457] [DEBUG] [LOCAL ] UWMC: Saving primary data. [2025-09-16T20:54:47.508329] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-16T20:54:47.517042] [DEBUG] [LOCAL ] UWMC: Trimmed 57094 records to 39396 (keeping 150 days of data) [2025-09-16T20:54:47.580504] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-09. [2025-09-16T20:54:47.753094] [DEBUG] [LOCAL ] UWMC: Primary data saved (39396 records). [2025-09-16T20:54:47.753264] [INFO ] [MAIN ] UWMC: Full history saved. [2025-09-16T20:54:47.753353] [INFO ] [MAIN ] Update Progress: 2208/2369 symbols completed. UWMC took 41.1s. Estimated remaining: 17m 7s. Rate: 9.4 symbols/min [2025-09-16T20:54:47.924266] [INFO ] [MAIN ] VALE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:54:47.962488] [DEBUG] [LOCAL ] VALE: Loaded 39655 existing records from primary storage. [2025-09-16T20:54:47.962697] [INFO ] [MAIN ] VALE: Loaded 39655 existing records. [2025-09-16T20:54:48.143481] [WARN ] [MAIN ] VALE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:54:48.143718] [INFO ] [MAIN ] VALE: Wiping existing primary data before full refresh. [2025-09-16T20:54:48.143765] [INFO ] [LOCAL ] VALE: Starting deletion of primary data. [2025-09-16T20:54:48.144759] [DEBUG] [LOCAL ] VALE: Deleted primary data file. [2025-09-16T20:54:48.144811] [INFO ] [MAIN ] VALE: Starting full primary refresh. [2025-09-16T20:54:48.388131] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-02. [2025-09-16T20:54:48.505899] [INFO ] [REMOTE ] VALE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:54:48.884395] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-16T20:54:48.888473] [INFO ] [REMOTE ] VAC: Full fetch complete (38117 records). [2025-09-16T20:54:48.888615] [DEBUG] [VALIDATOR ] VAC: Validating primary data. [2025-09-16T20:54:49.183596] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-02. [2025-09-16T20:54:49.275121] [DEBUG] [VALIDATOR ] VAC: All expected trading days are present. [2025-09-16T20:54:49.275204] [DEBUG] [VALIDATOR ] VAC: Primary data validation passed. [2025-09-16T20:54:49.275994] [INFO ] [MAIN ] VAC: Fetched primary data is valid. [2025-09-16T20:54:49.276039] [DEBUG] [LOCAL ] VAC: Saving primary data. [2025-09-16T20:54:49.276877] [DEBUG] [LOCAL ] VAC: Trimmed 38117 records to 25381 (keeping 150 days of data) [2025-09-16T20:54:49.407258] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-09-16T20:54:49.483925] [DEBUG] [LOCAL ] VAC: Primary data saved (25381 records). [2025-09-16T20:54:49.484078] [INFO ] [MAIN ] VAC: Full history saved. [2025-09-16T20:54:49.484172] [INFO ] [MAIN ] Update Progress: 2209/2369 symbols completed. VAC took 19.2s. Estimated remaining: 17m 0s. Rate: 9.4 symbols/min [2025-09-16T20:54:49.655060] [INFO ] [MAIN ] VATE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:54:49.659881] [DEBUG] [LOCAL ] VATE: Loaded 3662 existing records from primary storage. [2025-09-16T20:54:49.659961] [INFO ] [MAIN ] VATE: Loaded 3662 existing records. [2025-09-16T20:54:49.840695] [WARN ] [MAIN ] VATE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:54:49.840983] [INFO ] [MAIN ] VATE: Wiping existing primary data before full refresh. [2025-09-16T20:54:49.841031] [INFO ] [LOCAL ] VATE: Starting deletion of primary data. [2025-09-16T20:54:49.841254] [DEBUG] [LOCAL ] VATE: Deleted primary data file. [2025-09-16T20:54:49.841299] [INFO ] [MAIN ] VATE: Starting full primary refresh. [2025-09-16T20:54:49.980858] [INFO ] [REMOTE ] V: Fetching primary data for 2025-08. [2025-09-16T20:54:50.195947] [INFO ] [REMOTE ] VATE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:54:50.223959] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-16T20:54:50.774958] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-02. [2025-09-16T20:54:51.113743] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-16T20:54:51.574907] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-03. [2025-09-16T20:54:51.720698] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-16T20:54:51.966986] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-16T20:54:52.374912] [INFO ] [REMOTE ] V: Fetching primary data for 2025-09. [2025-09-16T20:54:53.174903] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-03. [2025-09-16T20:54:53.758422] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-16T20:54:53.974913] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-04. [2025-09-16T20:54:54.069663] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-16T20:54:54.266243] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-16T20:54:54.272712] [INFO ] [REMOTE ] V: Full fetch complete (58442 records). [2025-09-16T20:54:54.272863] [DEBUG] [VALIDATOR ] V: Validating primary data. [2025-09-16T20:54:54.776034] [DEBUG] [VALIDATOR ] V: All expected trading days are present. [2025-09-16T20:54:54.775918] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-03. [2025-09-16T20:54:54.776216] [DEBUG] [VALIDATOR ] V: Primary data validation passed. [2025-09-16T20:54:54.778050] [INFO ] [MAIN ] V: Fetched primary data is valid. [2025-09-16T20:54:54.779250] [DEBUG] [LOCAL ] V: Saving primary data. [2025-09-16T20:54:54.782473] [DEBUG] [LOCAL ] V: Trimmed 58442 records to 40114 (keeping 150 days of data) [2025-09-16T20:54:55.094292] [DEBUG] [LOCAL ] V: Primary data saved (40114 records). [2025-09-16T20:54:55.094471] [INFO ] [MAIN ] V: Full history saved. [2025-09-16T20:54:55.095910] [INFO ] [MAIN ] Update Progress: 2210/2369 symbols completed. V took 27.9s. Estimated remaining: 16m 54s. Rate: 9.4 symbols/min [2025-09-16T20:54:55.378110] [INFO ] [MAIN ] VBF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:54:55.389670] [DEBUG] [LOCAL ] VBF: Loaded 5005 existing records from primary storage. [2025-09-16T20:54:55.389849] [INFO ] [MAIN ] VBF: Loaded 5005 existing records. [2025-09-16T20:54:55.580002] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-04. [2025-09-16T20:54:55.646626] [WARN ] [MAIN ] VBF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:54:55.646953] [INFO ] [MAIN ] VBF: Wiping existing primary data before full refresh. [2025-09-16T20:54:55.647019] [INFO ] [LOCAL ] VBF: Starting deletion of primary data. [2025-09-16T20:54:55.647335] [DEBUG] [LOCAL ] VBF: Deleted primary data file. [2025-09-16T20:54:55.647384] [INFO ] [MAIN ] VBF: Starting full primary refresh. [2025-09-16T20:54:56.016586] [INFO ] [REMOTE ] VBF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:54:56.159969] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-16T20:54:56.374869] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-02. [2025-09-16T20:54:56.404157] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-16T20:54:56.445156] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-16T20:54:57.174897] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-04. [2025-09-16T20:54:57.629865] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-16T20:54:57.974896] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-03. [2025-09-16T20:54:58.774901] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-05. [2025-09-16T20:54:58.833026] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-16T20:54:59.020034] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-16T20:54:59.574979] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-04. [2025-09-16T20:55:00.293239] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-16T20:55:00.374904] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-05. [2025-09-16T20:55:01.036482] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-16T20:55:01.062113] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-16T20:55:01.174884] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-06. [2025-09-16T20:55:01.974949] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-06. [2025-09-16T20:55:02.774967] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-05. [2025-09-16T20:55:02.818302] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-16T20:55:03.317244] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-16T20:55:03.574908] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-05. [2025-09-16T20:55:04.235785] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-16T20:55:04.323081] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-16T20:55:04.374902] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-06. [2025-09-16T20:55:05.174933] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-07. [2025-09-16T20:55:05.207449] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-16T20:55:05.974636] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-16T20:55:05.976521] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-07. [2025-09-16T20:55:06.774900] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-07. [2025-09-16T20:55:07.262783] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-16T20:55:07.574903] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-08. [2025-09-16T20:55:08.261249] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-16T20:55:08.261480] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-16T20:55:08.374926] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-09. [2025-09-16T20:55:08.985768] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-16T20:55:08.987182] [INFO ] [REMOTE ] VATE: Full fetch complete (6814 records). [2025-09-16T20:55:08.987255] [DEBUG] [VALIDATOR ] VATE: Validating primary data. [2025-09-16T20:55:09.182407] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-08. [2025-09-16T20:55:09.355144] [DEBUG] [VALIDATOR ] VATE: All expected trading days are present. [2025-09-16T20:55:09.355225] [DEBUG] [VALIDATOR ] VATE: Primary data validation passed. [2025-09-16T20:55:09.355444] [INFO ] [MAIN ] VATE: Fetched primary data is valid. [2025-09-16T20:55:09.355515] [DEBUG] [LOCAL ] VATE: Saving primary data. [2025-09-16T20:55:09.355949] [DEBUG] [LOCAL ] VATE: Trimmed 6814 records to 3713 (keeping 150 days of data) [2025-09-16T20:55:09.376613] [DEBUG] [LOCAL ] VATE: Primary data saved (3713 records). [2025-09-16T20:55:09.376749] [INFO ] [MAIN ] VATE: Full history saved. [2025-09-16T20:55:09.376834] [INFO ] [MAIN ] Update Progress: 2211/2369 symbols completed. VATE took 19.9s. Estimated remaining: 16m 48s. Rate: 9.4 symbols/min [2025-09-16T20:55:09.555940] [INFO ] [MAIN ] VCV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:55:09.566440] [DEBUG] [LOCAL ] VCV: Loaded 10167 existing records from primary storage. [2025-09-16T20:55:09.566554] [INFO ] [MAIN ] VCV: Loaded 10167 existing records. [2025-09-16T20:55:09.751221] [WARN ] [MAIN ] VCV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:55:09.751470] [INFO ] [MAIN ] VCV: Wiping existing primary data before full refresh. [2025-09-16T20:55:09.751518] [INFO ] [LOCAL ] VCV: Starting deletion of primary data. [2025-09-16T20:55:09.751903] [DEBUG] [LOCAL ] VCV: Deleted primary data file. [2025-09-16T20:55:09.751952] [INFO ] [MAIN ] VCV: Starting full primary refresh. [2025-09-16T20:55:09.980422] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-06. [2025-09-16T20:55:10.122047] [INFO ] [REMOTE ] VCV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:55:10.774905] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-02. [2025-09-16T20:55:11.388678] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-16T20:55:11.574901] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-09. [2025-09-16T20:55:11.608213] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-16T20:55:11.901562] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-16T20:55:12.374914] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-07. [2025-09-16T20:55:13.174876] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-08. [2025-09-16T20:55:13.549581] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-16T20:55:13.556076] [INFO ] [REMOTE ] VALE: Full fetch complete (58375 records). [2025-09-16T20:55:13.556255] [DEBUG] [VALIDATOR ] VALE: Validating primary data. [2025-09-16T20:55:13.910531] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-16T20:55:13.979541] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-03. [2025-09-16T20:55:13.979781] [DEBUG] [VALIDATOR ] VALE: All expected trading days are present. [2025-09-16T20:55:13.980620] [DEBUG] [VALIDATOR ] VALE: Primary data validation passed. [2025-09-16T20:55:13.981670] [INFO ] [MAIN ] VALE: Fetched primary data is valid. [2025-09-16T20:55:13.981798] [DEBUG] [LOCAL ] VALE: Saving primary data. [2025-09-16T20:55:13.983131] [DEBUG] [LOCAL ] VALE: Trimmed 58375 records to 40045 (keeping 150 days of data) [2025-09-16T20:55:14.270030] [DEBUG] [LOCAL ] VALE: Primary data saved (40045 records). [2025-09-16T20:55:14.270167] [INFO ] [MAIN ] VALE: Full history saved. [2025-09-16T20:55:14.270440] [INFO ] [MAIN ] Update Progress: 2212/2369 symbols completed. VALE took 26.5s. Estimated remaining: 16m 42s. Rate: 9.4 symbols/min [2025-09-16T20:55:14.272286] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-16T20:55:14.454997] [INFO ] [MAIN ] VEEV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:55:14.491165] [DEBUG] [LOCAL ] VEEV: Loaded 34937 existing records from primary storage. [2025-09-16T20:55:14.491334] [INFO ] [MAIN ] VEEV: Loaded 34937 existing records. [2025-09-16T20:55:14.671208] [WARN ] [MAIN ] VEEV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:55:14.671451] [INFO ] [MAIN ] VEEV: Wiping existing primary data before full refresh. [2025-09-16T20:55:14.671499] [INFO ] [LOCAL ] VEEV: Starting deletion of primary data. [2025-09-16T20:55:14.672258] [DEBUG] [LOCAL ] VEEV: Deleted primary data file. [2025-09-16T20:55:14.672321] [INFO ] [MAIN ] VEEV: Starting full primary refresh. [2025-09-16T20:55:14.779982] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-09. [2025-09-16T20:55:15.030784] [INFO ] [REMOTE ] VEEV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:55:15.038433] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-16T20:55:15.574916] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-08. [2025-09-16T20:55:15.608526] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-16T20:55:15.609943] [INFO ] [REMOTE ] VBF: Full fetch complete (8082 records). [2025-09-16T20:55:15.610012] [DEBUG] [VALIDATOR ] VBF: Validating primary data. [2025-09-16T20:55:15.974091] [DEBUG] [VALIDATOR ] VBF: All expected trading days are present. [2025-09-16T20:55:15.974169] [DEBUG] [VALIDATOR ] VBF: Primary data validation passed. [2025-09-16T20:55:15.974373] [INFO ] [MAIN ] VBF: Fetched primary data is valid. [2025-09-16T20:55:15.974414] [DEBUG] [LOCAL ] VBF: Saving primary data. [2025-09-16T20:55:15.974877] [DEBUG] [LOCAL ] VBF: Trimmed 8082 records to 5071 (keeping 150 days of data) [2025-09-16T20:55:16.007275] [DEBUG] [LOCAL ] VBF: Primary data saved (5071 records). [2025-09-16T20:55:16.007428] [INFO ] [MAIN ] VBF: Full history saved. [2025-09-16T20:55:16.007541] [INFO ] [MAIN ] Update Progress: 2213/2369 symbols completed. VBF took 20.9s. Estimated remaining: 16m 35s. Rate: 9.4 symbols/min [2025-09-16T20:55:16.181973] [INFO ] [MAIN ] VEL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:55:16.192131] [DEBUG] [LOCAL ] VEL: Loaded 8877 existing records from primary storage. [2025-09-16T20:55:16.192247] [INFO ] [MAIN ] VEL: Loaded 8877 existing records. [2025-09-16T20:55:16.365908] [WARN ] [MAIN ] VEL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:55:16.366143] [INFO ] [MAIN ] VEL: Wiping existing primary data before full refresh. [2025-09-16T20:55:16.366191] [INFO ] [LOCAL ] VEL: Starting deletion of primary data. [2025-09-16T20:55:16.366490] [DEBUG] [LOCAL ] VEL: Deleted primary data file. [2025-09-16T20:55:16.366533] [INFO ] [MAIN ] VEL: Starting full primary refresh. [2025-09-16T20:55:16.379963] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-04. [2025-09-16T20:55:16.718384] [INFO ] [REMOTE ] VEL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:55:17.174885] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-02. [2025-09-16T20:55:17.298987] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-16T20:55:17.545789] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-16T20:55:17.796671] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-16T20:55:17.974942] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-02. [2025-09-16T20:55:18.774903] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-05. [2025-09-16T20:55:19.574924] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-03. [2025-09-16T20:55:19.653793] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-16T20:55:19.748202] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-16T20:55:20.379967] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-06. [2025-09-16T20:55:20.386245] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-16T20:55:21.174899] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-04. [2025-09-16T20:55:21.424508] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-16T20:55:21.974926] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-09. [2025-09-16T20:55:22.223696] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-16T20:55:22.774910] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-05. [2025-09-16T20:55:23.574937] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-03. [2025-09-16T20:55:23.647953] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-16T20:55:23.654311] [INFO ] [REMOTE ] VAL: Full fetch complete (55160 records). [2025-09-16T20:55:23.654468] [DEBUG] [VALIDATOR ] VAL: Validating primary data. [2025-09-16T20:55:23.959385] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-16T20:55:24.068031] [DEBUG] [VALIDATOR ] VAL: All expected trading days are present. [2025-09-16T20:55:24.068126] [DEBUG] [VALIDATOR ] VAL: Primary data validation passed. [2025-09-16T20:55:24.069133] [INFO ] [MAIN ] VAL: Fetched primary data is valid. [2025-09-16T20:55:24.069193] [DEBUG] [LOCAL ] VAL: Saving primary data. [2025-09-16T20:55:24.070508] [DEBUG] [LOCAL ] VAL: Trimmed 55160 records to 37419 (keeping 150 days of data) [2025-09-16T20:55:24.298281] [DEBUG] [LOCAL ] VAL: Primary data saved (37419 records). [2025-09-16T20:55:24.298669] [INFO ] [MAIN ] VAL: Full history saved. [2025-09-16T20:55:24.298761] [INFO ] [MAIN ] Update Progress: 2214/2369 symbols completed. VAL took 38.8s. Estimated remaining: 16m 29s. Rate: 9.4 symbols/min [2025-09-16T20:55:24.380052] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-07. [2025-09-16T20:55:24.470261] [INFO ] [MAIN ] VET: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:55:24.500623] [DEBUG] [LOCAL ] VET: Loaded 32083 existing records from primary storage. [2025-09-16T20:55:24.500804] [INFO ] [MAIN ] VET: Loaded 32083 existing records. [2025-09-16T20:55:24.679142] [WARN ] [MAIN ] VET: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:55:24.679402] [INFO ] [MAIN ] VET: Wiping existing primary data before full refresh. [2025-09-16T20:55:24.679449] [INFO ] [LOCAL ] VET: Starting deletion of primary data. [2025-09-16T20:55:24.680186] [DEBUG] [LOCAL ] VET: Deleted primary data file. [2025-09-16T20:55:24.680234] [INFO ] [MAIN ] VET: Starting full primary refresh. [2025-09-16T20:55:25.049198] [INFO ] [REMOTE ] VET: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:55:25.132373] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-16T20:55:25.173930] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-16T20:55:25.183064] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-08. [2025-09-16T20:55:25.974895] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-04. [2025-09-16T20:55:26.133721] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-16T20:55:26.774898] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-09. [2025-09-16T20:55:27.394115] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-16T20:55:27.396354] [INFO ] [REMOTE ] VCV: Full fetch complete (14254 records). [2025-09-16T20:55:27.396443] [DEBUG] [VALIDATOR ] VCV: Validating primary data. [2025-09-16T20:55:27.580496] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-06. [2025-09-16T20:55:27.767998] [DEBUG] [VALIDATOR ] VCV: All expected trading days are present. [2025-09-16T20:55:27.768191] [DEBUG] [VALIDATOR ] VCV: Primary data validation passed. [2025-09-16T20:55:27.768621] [INFO ] [MAIN ] VCV: Fetched primary data is valid. [2025-09-16T20:55:27.768734] [DEBUG] [LOCAL ] VCV: Saving primary data. [2025-09-16T20:55:27.769427] [DEBUG] [LOCAL ] VCV: Trimmed 14254 records to 10243 (keeping 150 days of data) [2025-09-16T20:55:27.847376] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-16T20:55:27.875214] [DEBUG] [LOCAL ] VCV: Primary data saved (10243 records). [2025-09-16T20:55:27.875343] [INFO ] [MAIN ] VCV: Full history saved. [2025-09-16T20:55:27.875428] [INFO ] [MAIN ] Update Progress: 2215/2369 symbols completed. VCV took 18.5s. Estimated remaining: 16m 22s. Rate: 9.4 symbols/min [2025-09-16T20:55:28.053260] [INFO ] [MAIN ] VFC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:55:28.099006] [DEBUG] [LOCAL ] VFC: Loaded 39580 existing records from primary storage. [2025-09-16T20:55:28.099249] [INFO ] [MAIN ] VFC: Loaded 39580 existing records. [2025-09-16T20:55:28.278609] [WARN ] [MAIN ] VFC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:55:28.278874] [INFO ] [MAIN ] VFC: Wiping existing primary data before full refresh. [2025-09-16T20:55:28.278919] [INFO ] [LOCAL ] VFC: Starting deletion of primary data. [2025-09-16T20:55:28.279788] [DEBUG] [LOCAL ] VFC: Deleted primary data file. [2025-09-16T20:55:28.279835] [INFO ] [MAIN ] VFC: Starting full primary refresh. [2025-09-16T20:55:28.379973] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-05. [2025-09-16T20:55:28.639549] [INFO ] [REMOTE ] VFC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:55:28.677098] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-16T20:55:29.174910] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-02. [2025-09-16T20:55:29.974893] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-07. [2025-09-16T20:55:30.124725] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-16T20:55:30.345839] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-16T20:55:30.774892] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-02. [2025-09-16T20:55:30.829510] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-16T20:55:31.574895] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-08. [2025-09-16T20:55:32.374890] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-06. [2025-09-16T20:55:32.494197] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-16T20:55:32.547908] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-16T20:55:33.174907] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-03. [2025-09-16T20:55:33.974961] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-03. [2025-09-16T20:55:34.182225] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-16T20:55:34.774871] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-07. [2025-09-16T20:55:35.215808] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-16T20:55:35.324051] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-16T20:55:35.574893] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-04. [2025-09-16T20:55:36.374901] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-04. [2025-09-16T20:55:36.617078] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-16T20:55:37.174921] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-09. [2025-09-16T20:55:37.257399] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-16T20:55:37.974928] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-05. [2025-09-16T20:55:38.036143] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-16T20:55:38.038051] [INFO ] [REMOTE ] VEL: Full fetch complete (13573 records). [2025-09-16T20:55:38.038125] [DEBUG] [VALIDATOR ] VEL: Validating primary data. [2025-09-16T20:55:38.285104] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-16T20:55:38.448632] [DEBUG] [VALIDATOR ] VEL: All expected trading days are present. [2025-09-16T20:55:38.448732] [DEBUG] [VALIDATOR ] VEL: Primary data validation passed. [2025-09-16T20:55:38.449084] [INFO ] [MAIN ] VEL: Fetched primary data is valid. [2025-09-16T20:55:38.449192] [DEBUG] [LOCAL ] VEL: Saving primary data. [2025-09-16T20:55:38.449780] [DEBUG] [LOCAL ] VEL: Trimmed 13573 records to 8936 (keeping 150 days of data) [2025-09-16T20:55:38.505962] [DEBUG] [LOCAL ] VEL: Primary data saved (8936 records). [2025-09-16T20:55:38.506126] [INFO ] [MAIN ] VEL: Full history saved. [2025-09-16T20:55:38.506223] [INFO ] [MAIN ] Update Progress: 2216/2369 symbols completed. VEL took 22.5s. Estimated remaining: 16m 16s. Rate: 9.4 symbols/min [2025-09-16T20:55:38.679126] [INFO ] [MAIN ] VG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:55:38.719204] [DEBUG] [LOCAL ] VG: Loaded 39436 existing records from primary storage. [2025-09-16T20:55:38.719371] [INFO ] [MAIN ] VG: Loaded 39436 existing records. [2025-09-16T20:55:38.786112] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-05. [2025-09-16T20:55:38.905631] [WARN ] [MAIN ] VG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:55:38.905941] [INFO ] [MAIN ] VG: Wiping existing primary data before full refresh. [2025-09-16T20:55:38.905988] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-09-16T20:55:38.906889] [DEBUG] [LOCAL ] VG: Deleted primary data file. [2025-09-16T20:55:38.906938] [INFO ] [MAIN ] VG: Starting full primary refresh. [2025-09-16T20:55:39.259311] [INFO ] [REMOTE ] VG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:55:39.574865] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-08. [2025-09-16T20:55:39.830433] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-16T20:55:40.374899] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-06. [2025-09-16T20:55:40.597686] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-16T20:55:41.174902] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-02. [2025-09-16T20:55:41.398540] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-16T20:55:41.974912] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-06. [2025-09-16T20:55:42.440383] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-16T20:55:42.774948] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-09. [2025-09-16T20:55:43.161104] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-16T20:55:43.574928] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-03. [2025-09-16T20:55:44.195292] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-09-16T20:55:44.374900] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-07. [2025-09-16T20:55:44.401523] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-16T20:55:44.407358] [INFO ] [REMOTE ] VEEV: Full fetch complete (51596 records). [2025-09-16T20:55:44.407484] [DEBUG] [VALIDATOR ] VEEV: Validating primary data. [2025-09-16T20:55:44.793894] [DEBUG] [VALIDATOR ] VEEV: All expected trading days are present. [2025-09-16T20:55:44.793981] [DEBUG] [VALIDATOR ] VEEV: Primary data validation passed. [2025-09-16T20:55:44.795071] [INFO ] [MAIN ] VEEV: Fetched primary data is valid. [2025-09-16T20:55:44.795162] [DEBUG] [LOCAL ] VEEV: Saving primary data. [2025-09-16T20:55:44.796247] [DEBUG] [LOCAL ] VEEV: Trimmed 51596 records to 35243 (keeping 150 days of data) [2025-09-16T20:55:45.011876] [DEBUG] [LOCAL ] VEEV: Primary data saved (35243 records). [2025-09-16T20:55:45.012020] [INFO ] [MAIN ] VEEV: Full history saved. [2025-09-16T20:55:45.012124] [INFO ] [MAIN ] Update Progress: 2217/2369 symbols completed. VEEV took 30.7s. Estimated remaining: 16m 10s. Rate: 9.4 symbols/min [2025-09-16T20:55:45.187277] [INFO ] [MAIN ] VGI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:55:45.184935] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-07. [2025-09-16T20:55:45.193875] [DEBUG] [LOCAL ] VGI: Loaded 3870 existing records from primary storage. [2025-09-16T20:55:45.194009] [INFO ] [MAIN ] VGI: Loaded 3870 existing records. [2025-09-16T20:55:45.373253] [WARN ] [MAIN ] VGI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:55:45.373482] [INFO ] [MAIN ] VGI: Wiping existing primary data before full refresh. [2025-09-16T20:55:45.373526] [INFO ] [LOCAL ] VGI: Starting deletion of primary data. [2025-09-16T20:55:45.373766] [DEBUG] [LOCAL ] VGI: Deleted primary data file. [2025-09-16T20:55:45.373812] [INFO ] [MAIN ] VGI: Starting full primary refresh. [2025-09-16T20:55:45.742536] [INFO ] [REMOTE ] VGI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:55:45.776165] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-16T20:55:45.945824] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-16T20:55:45.974852] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-08. [2025-09-16T20:55:46.774913] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-04. [2025-09-16T20:55:47.309425] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-16T20:55:47.371099] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-16T20:55:47.574908] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-02. [2025-09-16T20:55:48.323461] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-16T20:55:48.374977] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-09. [2025-09-16T20:55:48.736519] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-16T20:55:49.174939] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-05. [2025-09-16T20:55:49.565150] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-16T20:55:49.570443] [INFO ] [REMOTE ] VET: Full fetch complete (48205 records). [2025-09-16T20:55:49.570599] [DEBUG] [VALIDATOR ] VET: Validating primary data. [2025-09-16T20:55:49.953312] [DEBUG] [VALIDATOR ] VET: All expected trading days are present. [2025-09-16T20:55:49.953400] [DEBUG] [VALIDATOR ] VET: Primary data validation passed. [2025-09-16T20:55:49.954335] [INFO ] [MAIN ] VET: Fetched primary data is valid. [2025-09-16T20:55:49.954390] [DEBUG] [LOCAL ] VET: Saving primary data. [2025-09-16T20:55:49.955468] [DEBUG] [LOCAL ] VET: Trimmed 48205 records to 32383 (keeping 150 days of data) [2025-09-16T20:55:50.007222] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-03. [2025-09-16T20:55:50.152787] [DEBUG] [LOCAL ] VET: Primary data saved (32383 records). [2025-09-16T20:55:50.152977] [INFO ] [MAIN ] VET: Full history saved. [2025-09-16T20:55:50.153097] [INFO ] [MAIN ] Update Progress: 2218/2369 symbols completed. VET took 25.9s. Estimated remaining: 16m 3s. Rate: 9.4 symbols/min [2025-09-16T20:55:50.332697] [INFO ] [MAIN ] VGM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:55:50.346988] [DEBUG] [LOCAL ] VGM: Loaded 14302 existing records from primary storage. [2025-09-16T20:55:50.347137] [INFO ] [MAIN ] VGM: Loaded 14302 existing records. [2025-09-16T20:55:50.523421] [WARN ] [MAIN ] VGM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:55:50.523676] [INFO ] [MAIN ] VGM: Wiping existing primary data before full refresh. [2025-09-16T20:55:50.523723] [INFO ] [LOCAL ] VGM: Starting deletion of primary data. [2025-09-16T20:55:50.524148] [DEBUG] [LOCAL ] VGM: Deleted primary data file. [2025-09-16T20:55:50.524209] [INFO ] [MAIN ] VGM: Starting full primary refresh. [2025-09-16T20:55:50.701148] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-16T20:55:50.782160] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-08. [2025-09-16T20:55:50.890057] [INFO ] [REMOTE ] VGM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:55:51.255683] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-16T20:55:51.574912] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-06. [2025-09-16T20:55:52.374923] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-02. [2025-09-16T20:55:52.806399] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-16T20:55:53.174948] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-09. [2025-09-16T20:55:53.360722] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-16T20:55:53.447003] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-16T20:55:53.974908] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-04. [2025-09-16T20:55:54.714680] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-16T20:55:54.732190] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-16T20:55:54.738398] [INFO ] [REMOTE ] VFC: Full fetch complete (58274 records). [2025-09-16T20:55:54.738491] [DEBUG] [VALIDATOR ] VFC: Validating primary data. [2025-09-16T20:55:54.780082] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-03. [2025-09-16T20:55:55.124764] [DEBUG] [VALIDATOR ] VFC: All expected trading days are present. [2025-09-16T20:55:55.124855] [DEBUG] [VALIDATOR ] VFC: Primary data validation passed. [2025-09-16T20:55:55.125976] [INFO ] [MAIN ] VFC: Fetched primary data is valid. [2025-09-16T20:55:55.126033] [DEBUG] [LOCAL ] VFC: Saving primary data. [2025-09-16T20:55:55.127476] [DEBUG] [LOCAL ] VFC: Trimmed 58274 records to 39970 (keeping 150 days of data) [2025-09-16T20:55:55.372724] [DEBUG] [LOCAL ] VFC: Primary data saved (39970 records). [2025-09-16T20:55:55.372866] [INFO ] [MAIN ] VFC: Full history saved. [2025-09-16T20:55:55.373775] [INFO ] [MAIN ] Update Progress: 2219/2369 symbols completed. VFC took 27.5s. Estimated remaining: 15m 57s. Rate: 9.4 symbols/min [2025-09-16T20:55:55.546065] [INFO ] [MAIN ] VHC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:55:55.546239] [DEBUG] [LOCAL ] VHC: No existing data file found in primary storage. [2025-09-16T20:55:55.546277] [WARN ] [MAIN ] VHC: No existing data found, performing full refresh instead. [2025-09-16T20:55:55.546404] [INFO ] [MAIN ] VHC: Wiping existing primary data before full refresh. [2025-09-16T20:55:55.546444] [INFO ] [LOCAL ] VHC: Starting deletion of primary data. [2025-09-16T20:55:55.546487] [DEBUG] [LOCAL ] VHC: No primary data file found to delete. [2025-09-16T20:55:55.546520] [INFO ] [MAIN ] VHC: Starting full primary refresh. [2025-09-16T20:55:55.580063] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-05. [2025-09-16T20:55:55.904460] [INFO ] [REMOTE ] VHC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:55:55.913172] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-16T20:55:56.299629] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-16T20:55:56.374891] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-06. [2025-09-16T20:55:57.021613] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-16T20:55:57.174862] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-02. [2025-09-16T20:55:57.605477] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-16T20:55:57.974940] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-07. [2025-09-16T20:55:58.774899] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-03. [2025-09-16T20:55:59.304475] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-16T20:55:59.574918] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-04. [2025-09-16T20:56:00.162591] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-16T20:56:00.194876] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-16T20:56:00.374904] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-05. [2025-09-16T20:56:00.913566] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-16T20:56:01.174908] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-08. [2025-09-16T20:56:01.974943] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-04. [2025-09-16T20:56:02.774881] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-06. [2025-09-16T20:56:03.126828] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-16T20:56:03.149520] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-16T20:56:03.456065] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-16T20:56:03.574914] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-05. [2025-09-16T20:56:04.374877] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-09. [2025-09-16T20:56:04.762776] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-16T20:56:05.174924] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-07. [2025-09-16T20:56:05.930455] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-16T20:56:05.941245] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-16T20:56:05.941075] [INFO ] [REMOTE ] VG: Full fetch complete (58085 records). [2025-09-16T20:56:05.942998] [DEBUG] [VALIDATOR ] VG: Validating primary data. [2025-09-16T20:56:05.979959] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-08. [2025-09-16T20:56:06.352838] [DEBUG] [VALIDATOR ] VG: All expected trading days are present. [2025-09-16T20:56:06.352936] [DEBUG] [VALIDATOR ] VG: Primary data validation passed. [2025-09-16T20:56:06.354129] [INFO ] [MAIN ] VG: Fetched primary data is valid. [2025-09-16T20:56:06.354186] [DEBUG] [LOCAL ] VG: Saving primary data. [2025-09-16T20:56:06.355555] [DEBUG] [LOCAL ] VG: Trimmed 58085 records to 39825 (keeping 150 days of data) [2025-09-16T20:56:06.608915] [DEBUG] [LOCAL ] VG: Primary data saved (39825 records). [2025-09-16T20:56:06.609071] [INFO ] [MAIN ] VG: Full history saved. [2025-09-16T20:56:06.609193] [INFO ] [MAIN ] Update Progress: 2220/2369 symbols completed. VG took 28.1s. Estimated remaining: 15m 51s. Rate: 9.4 symbols/min [2025-09-16T20:56:06.777374] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-07. [2025-09-16T20:56:06.807871] [INFO ] [MAIN ] VHI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:56:06.813447] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-16T20:56:06.818306] [DEBUG] [LOCAL ] VHI: Loaded 1997 existing records from primary storage. [2025-09-16T20:56:06.818394] [INFO ] [MAIN ] VHI: Loaded 1997 existing records. [2025-09-16T20:56:07.001440] [WARN ] [MAIN ] VHI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:56:07.001760] [INFO ] [MAIN ] VHI: Wiping existing primary data before full refresh. [2025-09-16T20:56:07.001833] [INFO ] [LOCAL ] VHI: Starting deletion of primary data. [2025-09-16T20:56:07.002079] [DEBUG] [LOCAL ] VHI: Deleted primary data file. [2025-09-16T20:56:07.002144] [INFO ] [MAIN ] VHI: Starting full primary refresh. [2025-09-16T20:56:07.376384] [INFO ] [REMOTE ] VHI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:56:07.518864] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-16T20:56:07.574884] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-02. [2025-09-16T20:56:07.681504] [DEBUG] [REMOTE ] VHI: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-09-16T20:56:07.682072] [WARN ] [REMOTE ] VHI: No data returned for month 2025-02 [2025-09-16T20:56:08.374897] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-08. [2025-09-16T20:56:08.836032] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-16T20:56:09.174917] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-06. [2025-09-16T20:56:09.974927] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-03. [2025-09-16T20:56:10.312158] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-16T20:56:10.549330] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-16T20:56:10.774910] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-04. [2025-09-16T20:56:11.253235] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-16T20:56:11.574908] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-09. [2025-09-16T20:56:12.076924] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-16T20:56:12.077924] [INFO ] [REMOTE ] VHC: Full fetch complete (2548 records). [2025-09-16T20:56:12.078006] [DEBUG] [VALIDATOR ] VHC: Validating primary data. [2025-09-16T20:56:12.272697] [WARN ] [VALIDATOR ] VHC: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-16T20:56:12.272935] [FATAL] [MAIN ] VHC: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:56:12.272984] [WARN ] [MAIN ] VHC: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:56:12.273046] [INFO ] [LOCAL ] VHC: Starting deletion of primary data. [2025-09-16T20:56:12.273105] [DEBUG] [LOCAL ] VHC: No primary data file found to delete. [2025-09-16T20:56:12.273148] [INFO ] [LOCAL ] VHC: Starting deletion of derivative data. [2025-09-16T20:56:12.273198] [DEBUG] [LOCAL ] VHC: No derivative data file found to delete. [2025-09-16T20:56:12.273275] [INFO ] [MAIN ] Update Progress: 2221/2369 symbols completed. VHC took 16.9s. Estimated remaining: 15m 44s. Rate: 9.4 symbols/min [2025-09-16T20:56:12.375707] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-07. [2025-09-16T20:56:12.451750] [INFO ] [MAIN ] VIA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:56:12.451944] [DEBUG] [LOCAL ] VIA: No existing data file found in primary storage. [2025-09-16T20:56:12.451985] [WARN ] [MAIN ] VIA: No existing data found, performing full refresh instead. [2025-09-16T20:56:12.452112] [INFO ] [MAIN ] VIA: Wiping existing primary data before full refresh. [2025-09-16T20:56:12.452154] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-09-16T20:56:12.452208] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-09-16T20:56:12.452275] [INFO ] [MAIN ] VIA: Starting full primary refresh. [2025-09-16T20:56:12.816812] [INFO ] [REMOTE ] VIA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:56:13.174909] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-02. [2025-09-16T20:56:13.472627] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:56:13.473051] [WARN ] [REMOTE ] VIA: No data returned for month 2025-02 [2025-09-16T20:56:13.604935] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-16T20:56:13.974902] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-08. [2025-09-16T20:56:14.774877] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-05. [2025-09-16T20:56:15.080569] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-16T20:56:15.350032] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-16T20:56:15.574895] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-06. [2025-09-16T20:56:16.222685] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-16T20:56:16.374859] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-07. [2025-09-16T20:56:16.911897] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-16T20:56:17.174874] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-09. [2025-09-16T20:56:17.974862] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-08. [2025-09-16T20:56:18.295509] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-16T20:56:18.298534] [INFO ] [REMOTE ] VGM: Full fetch complete (19686 records). [2025-09-16T20:56:18.298606] [DEBUG] [VALIDATOR ] VGM: Validating primary data. [2025-09-16T20:56:18.579843] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-16T20:56:18.664279] [DEBUG] [VALIDATOR ] VGM: All expected trading days are present. [2025-09-16T20:56:18.664358] [DEBUG] [VALIDATOR ] VGM: Primary data validation passed. [2025-09-16T20:56:18.664870] [INFO ] [MAIN ] VGM: Fetched primary data is valid. [2025-09-16T20:56:18.664925] [DEBUG] [LOCAL ] VGM: Saving primary data. [2025-09-16T20:56:18.665466] [DEBUG] [LOCAL ] VGM: Trimmed 19686 records to 14407 (keeping 150 days of data) [2025-09-16T20:56:18.758756] [DEBUG] [LOCAL ] VGM: Primary data saved (14407 records). [2025-09-16T20:56:18.758913] [INFO ] [MAIN ] VGM: Full history saved. [2025-09-16T20:56:18.759012] [INFO ] [MAIN ] Update Progress: 2222/2369 symbols completed. VGM took 28.6s. Estimated remaining: 15m 38s. Rate: 9.4 symbols/min [2025-09-16T20:56:18.780009] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-03. [2025-09-16T20:56:18.935689] [INFO ] [MAIN ] VICI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:56:18.935862] [DEBUG] [LOCAL ] VICI: No existing data file found in primary storage. [2025-09-16T20:56:18.935902] [WARN ] [MAIN ] VICI: No existing data found, performing full refresh instead. [2025-09-16T20:56:18.936062] [INFO ] [MAIN ] VICI: Wiping existing primary data before full refresh. [2025-09-16T20:56:18.936125] [INFO ] [LOCAL ] VICI: Starting deletion of primary data. [2025-09-16T20:56:18.936175] [DEBUG] [LOCAL ] VICI: No primary data file found to delete. [2025-09-16T20:56:18.936210] [INFO ] [MAIN ] VICI: Starting full primary refresh. [2025-09-16T20:56:19.125304] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:56:19.165322] [WARN ] [REMOTE ] VIA: No data returned for month 2025-03 [2025-09-16T20:56:19.305637] [INFO ] [REMOTE ] VICI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:56:19.574904] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-09. [2025-09-16T20:56:20.308503] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-16T20:56:20.310349] [INFO ] [REMOTE ] VGI: Full fetch complete (5610 records). [2025-09-16T20:56:20.310420] [DEBUG] [VALIDATOR ] VGI: Validating primary data. [2025-09-16T20:56:20.380106] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-09. [2025-09-16T20:56:20.663451] [DEBUG] [VALIDATOR ] VGI: All expected trading days are present. [2025-09-16T20:56:20.663525] [DEBUG] [VALIDATOR ] VGI: Primary data validation passed. [2025-09-16T20:56:20.663716] [INFO ] [MAIN ] VGI: Fetched primary data is valid. [2025-09-16T20:56:20.663759] [DEBUG] [LOCAL ] VGI: Saving primary data. [2025-09-16T20:56:20.664140] [DEBUG] [LOCAL ] VGI: Trimmed 5610 records to 3918 (keeping 150 days of data) [2025-09-16T20:56:20.688426] [DEBUG] [LOCAL ] VGI: Primary data saved (3918 records). [2025-09-16T20:56:20.688508] [INFO ] [MAIN ] VGI: Full history saved. [2025-09-16T20:56:20.688587] [INFO ] [MAIN ] Update Progress: 2223/2369 symbols completed. VGI took 35.7s. Estimated remaining: 15m 31s. Rate: 9.4 symbols/min [2025-09-16T20:56:20.864743] [INFO ] [MAIN ] VIK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:56:20.905109] [DEBUG] [LOCAL ] VIK: Loaded 38758 existing records from primary storage. [2025-09-16T20:56:20.905247] [INFO ] [MAIN ] VIK: Loaded 38758 existing records. [2025-09-16T20:56:20.982256] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-16T20:56:21.007010] [INFO ] [REMOTE ] VHI: Full fetch complete (2962 records). [2025-09-16T20:56:21.009326] [DEBUG] [VALIDATOR ] VHI: Validating primary data. [2025-09-16T20:56:21.180029] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-02. [2025-09-16T20:56:21.210519] [WARN ] [MAIN ] VIK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:56:21.258452] [INFO ] [MAIN ] VIK: Wiping existing primary data before full refresh. [2025-09-16T20:56:21.264355] [WARN ] [VALIDATOR ] VHI: Validation failed - insufficient historical data. Have 137 unique days, need 150 days [2025-09-16T20:56:21.264494] [INFO ] [LOCAL ] VIK: Starting deletion of primary data. [2025-09-16T20:56:21.264660] [FATAL] [MAIN ] VHI: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:56:21.264772] [WARN ] [MAIN ] VHI: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:56:21.264838] [INFO ] [LOCAL ] VHI: Starting deletion of primary data. [2025-09-16T20:56:21.264900] [DEBUG] [LOCAL ] VHI: No primary data file found to delete. [2025-09-16T20:56:21.264939] [INFO ] [LOCAL ] VHI: Starting deletion of derivative data. [2025-09-16T20:56:21.265265] [DEBUG] [LOCAL ] VHI: Deleted derivative data file. [2025-09-16T20:56:21.265353] [INFO ] [MAIN ] Update Progress: 2224/2369 symbols completed. VHI took 14.7s. Estimated remaining: 15m 24s. Rate: 9.4 symbols/min [2025-09-16T20:56:21.265537] [DEBUG] [LOCAL ] VIK: Deleted primary data file. [2025-09-16T20:56:21.278333] [INFO ] [MAIN ] VIK: Starting full primary refresh. [2025-09-16T20:56:21.607131] [INFO ] [MAIN ] VIPS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:56:21.787587] [INFO ] [REMOTE ] VIK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:56:21.813815] [DEBUG] [LOCAL ] VIPS: Loaded 37673 existing records from primary storage. [2025-09-16T20:56:21.813955] [INFO ] [MAIN ] VIPS: Loaded 37673 existing records. [2025-09-16T20:56:21.975360] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-04. [2025-09-16T20:56:21.997526] [WARN ] [MAIN ] VIPS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:56:21.997745] [INFO ] [MAIN ] VIPS: Wiping existing primary data before full refresh. [2025-09-16T20:56:21.997825] [INFO ] [LOCAL ] VIPS: Starting deletion of primary data. [2025-09-16T20:56:21.998597] [DEBUG] [LOCAL ] VIPS: Deleted primary data file. [2025-09-16T20:56:21.998701] [INFO ] [MAIN ] VIPS: Starting full primary refresh. [2025-09-16T20:56:22.329334] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:56:22.338253] [WARN ] [REMOTE ] VIA: No data returned for month 2025-04 [2025-09-16T20:56:22.357807] [INFO ] [REMOTE ] VIPS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:56:22.774882] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-02. [2025-09-16T20:56:23.229260] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-16T20:56:23.574904] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-02. [2025-09-16T20:56:24.305862] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-16T20:56:24.374843] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-03. [2025-09-16T20:56:25.174905] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-03. [2025-09-16T20:56:25.351759] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-16T20:56:25.974897] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-05. [2025-09-16T20:56:26.264771] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:56:26.268086] [WARN ] [REMOTE ] VIA: No data returned for month 2025-05 [2025-09-16T20:56:26.269957] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-16T20:56:26.774860] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-06. [2025-09-16T20:56:27.082153] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:56:27.082479] [WARN ] [REMOTE ] VIA: No data returned for month 2025-06 [2025-09-16T20:56:27.336023] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-16T20:56:27.574903] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-04. [2025-09-16T20:56:28.374896] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-03. [2025-09-16T20:56:29.174891] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-04. [2025-09-16T20:56:29.539347] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-16T20:56:29.974908] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-05. [2025-09-16T20:56:30.159165] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-16T20:56:30.774900] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-04. [2025-09-16T20:56:31.000507] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-16T20:56:31.574906] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-05. [2025-09-16T20:56:31.805596] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-16T20:56:32.374926] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-06. [2025-09-16T20:56:32.692833] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-16T20:56:33.174910] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-05. [2025-09-16T20:56:33.309086] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-16T20:56:33.974944] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-06. [2025-09-16T20:56:34.410389] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-16T20:56:34.757150] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-16T20:56:34.774874] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-06. [2025-09-16T20:56:35.569737] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-16T20:56:35.580152] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-07. [2025-09-16T20:56:35.876454] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:56:35.876835] [WARN ] [REMOTE ] VIA: No data returned for month 2025-07 [2025-09-16T20:56:36.128445] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-16T20:56:36.374911] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-07. [2025-09-16T20:56:37.174932] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-07. [2025-09-16T20:56:37.974889] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-08. [2025-09-16T20:56:38.201399] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-16T20:56:38.245364] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:56:38.245687] [WARN ] [REMOTE ] VIA: No data returned for month 2025-08 [2025-09-16T20:56:38.774894] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-09. [2025-09-16T20:56:39.052774] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-16T20:56:39.455810] [INFO ] [REMOTE ] VIA: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-16T20:56:39.457392] [INFO ] [REMOTE ] VIA: Full fetch complete (811 records). [2025-09-16T20:56:39.457456] [DEBUG] [VALIDATOR ] VIA: Validating primary data. [2025-09-16T20:56:39.580056] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-08. [2025-09-16T20:56:39.636189] [WARN ] [VALIDATOR ] VIA: Validation failed - insufficient historical data. Have 3 unique days, need 150 days [2025-09-16T20:56:39.636520] [FATAL] [MAIN ] VIA: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:56:39.636577] [WARN ] [MAIN ] VIA: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:56:39.636619] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-09-16T20:56:39.636731] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-09-16T20:56:39.636794] [INFO ] [LOCAL ] VIA: Starting deletion of derivative data. [2025-09-16T20:56:39.636845] [DEBUG] [LOCAL ] VIA: No derivative data file found to delete. [2025-09-16T20:56:39.636907] [INFO ] [MAIN ] Update Progress: 2225/2369 symbols completed. VIA took 27.4s. Estimated remaining: 15m 19s. Rate: 9.4 symbols/min [2025-09-16T20:56:39.811459] [INFO ] [MAIN ] VIRT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:56:39.860670] [DEBUG] [LOCAL ] VIRT: Loaded 34304 existing records from primary storage. [2025-09-16T20:56:39.860833] [INFO ] [MAIN ] VIRT: Loaded 34304 existing records. [2025-09-16T20:56:40.041437] [WARN ] [MAIN ] VIRT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:56:40.041705] [INFO ] [MAIN ] VIRT: Wiping existing primary data before full refresh. [2025-09-16T20:56:40.041763] [INFO ] [LOCAL ] VIRT: Starting deletion of primary data. [2025-09-16T20:56:40.042506] [DEBUG] [LOCAL ] VIRT: Deleted primary data file. [2025-09-16T20:56:40.042553] [INFO ] [MAIN ] VIRT: Starting full primary refresh. [2025-09-16T20:56:40.382574] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-08. [2025-09-16T20:56:40.410832] [INFO ] [REMOTE ] VIRT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:56:41.174906] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-02. [2025-09-16T20:56:41.226623] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-16T20:56:41.974880] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-09. [2025-09-16T20:56:42.754419] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-16T20:56:42.774864] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-03. [2025-09-16T20:56:42.960942] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-08 (2.58 seconds). [2025-09-16T20:56:43.574913] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-07. [2025-09-16T20:56:43.609454] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-16T20:56:43.615702] [INFO ] [REMOTE ] VIPS: Full fetch complete (56048 records). [2025-09-16T20:56:43.615809] [DEBUG] [VALIDATOR ] VIPS: Validating primary data. [2025-09-16T20:56:44.002828] [DEBUG] [VALIDATOR ] VIPS: All expected trading days are present. [2025-09-16T20:56:44.002906] [DEBUG] [VALIDATOR ] VIPS: Primary data validation passed. [2025-09-16T20:56:44.003861] [INFO ] [MAIN ] VIPS: Fetched primary data is valid. [2025-09-16T20:56:44.003927] [DEBUG] [LOCAL ] VIPS: Saving primary data. [2025-09-16T20:56:44.005088] [DEBUG] [LOCAL ] VIPS: Trimmed 56048 records to 38049 (keeping 150 days of data) [2025-09-16T20:56:44.244186] [DEBUG] [LOCAL ] VIPS: Primary data saved (38049 records). [2025-09-16T20:56:44.244496] [INFO ] [MAIN ] VIPS: Full history saved. [2025-09-16T20:56:44.244659] [INFO ] [MAIN ] Update Progress: 2226/2369 symbols completed. VIPS took 23.0s. Estimated remaining: 15m 12s. Rate: 9.4 symbols/min [2025-09-16T20:56:44.377571] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-09. [2025-09-16T20:56:44.458907] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-16T20:56:44.460630] [INFO ] [MAIN ] VIST: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:56:44.508338] [DEBUG] [LOCAL ] VIST: Loaded 33693 existing records from primary storage. [2025-09-16T20:56:44.508484] [INFO ] [MAIN ] VIST: Loaded 33693 existing records. [2025-09-16T20:56:44.686320] [WARN ] [MAIN ] VIST: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:56:44.686597] [INFO ] [MAIN ] VIST: Wiping existing primary data before full refresh. [2025-09-16T20:56:44.686679] [INFO ] [LOCAL ] VIST: Starting deletion of primary data. [2025-09-16T20:56:44.687354] [DEBUG] [LOCAL ] VIST: Deleted primary data file. [2025-09-16T20:56:44.687403] [INFO ] [MAIN ] VIST: Starting full primary refresh. [2025-09-16T20:56:45.041921] [INFO ] [REMOTE ] VIST: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:56:45.174926] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-02. [2025-09-16T20:56:45.501075] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-16T20:56:45.974946] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-08. [2025-09-16T20:56:46.161207] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-16T20:56:46.167252] [INFO ] [REMOTE ] VIK: Full fetch complete (57016 records). [2025-09-16T20:56:46.167375] [DEBUG] [VALIDATOR ] VIK: Validating primary data. [2025-09-16T20:56:46.560590] [DEBUG] [VALIDATOR ] VIK: All expected trading days are present. [2025-09-16T20:56:46.560712] [DEBUG] [VALIDATOR ] VIK: Primary data validation passed. [2025-09-16T20:56:46.561723] [INFO ] [MAIN ] VIK: Fetched primary data is valid. [2025-09-16T20:56:46.561771] [DEBUG] [LOCAL ] VIK: Saving primary data. [2025-09-16T20:56:46.563078] [DEBUG] [LOCAL ] VIK: Trimmed 57016 records to 39118 (keeping 150 days of data) [2025-09-16T20:56:46.776907] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-04. [2025-09-16T20:56:46.819858] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-16T20:56:46.836302] [DEBUG] [LOCAL ] VIK: Primary data saved (39118 records). [2025-09-16T20:56:46.836464] [INFO ] [MAIN ] VIK: Full history saved. [2025-09-16T20:56:46.836553] [INFO ] [MAIN ] Update Progress: 2227/2369 symbols completed. VIK took 26.1s. Estimated remaining: 15m 6s. Rate: 9.4 symbols/min [2025-09-16T20:56:47.004051] [INFO ] [MAIN ] VIV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:56:47.036677] [DEBUG] [LOCAL ] VIV: Loaded 33492 existing records from primary storage. [2025-09-16T20:56:47.036893] [INFO ] [MAIN ] VIV: Loaded 33492 existing records. [2025-09-16T20:56:47.211780] [WARN ] [MAIN ] VIV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:56:47.212052] [INFO ] [MAIN ] VIV: Wiping existing primary data before full refresh. [2025-09-16T20:56:47.212098] [INFO ] [LOCAL ] VIV: Starting deletion of primary data. [2025-09-16T20:56:47.212790] [DEBUG] [LOCAL ] VIV: Deleted primary data file. [2025-09-16T20:56:47.212838] [INFO ] [MAIN ] VIV: Starting full primary refresh. [2025-09-16T20:56:47.561545] [INFO ] [REMOTE ] VIV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:56:47.574844] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-02. [2025-09-16T20:56:47.618419] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-16T20:56:48.374912] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-03. [2025-09-16T20:56:48.511630] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-16T20:56:48.906399] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-16T20:56:49.174910] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-05. [2025-09-16T20:56:49.902103] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-16T20:56:49.974914] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-04. [2025-09-16T20:56:50.774880] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-03. [2025-09-16T20:56:50.865241] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-16T20:56:51.584443] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-06. [2025-09-16T20:56:51.604554] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-16T20:56:52.374931] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-05. [2025-09-16T20:56:52.420907] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-16T20:56:53.079811] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-16T20:56:53.174868] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-07. [2025-09-16T20:56:53.812321] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-16T20:56:53.974896] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-06. [2025-09-16T20:56:54.774940] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-04. [2025-09-16T20:56:54.927158] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-16T20:56:55.580381] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-09. [2025-09-16T20:56:55.596222] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-16T20:56:56.374935] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-07. [2025-09-16T20:56:56.587029] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-16T20:56:57.174917] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-05. [2025-09-16T20:56:57.339392] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-16T20:56:57.346261] [INFO ] [REMOTE ] VICI: Full fetch complete (58324 records). [2025-09-16T20:56:57.346398] [DEBUG] [VALIDATOR ] VICI: Validating primary data. [2025-09-16T20:56:57.751460] [DEBUG] [VALIDATOR ] VICI: All expected trading days are present. [2025-09-16T20:56:57.751578] [DEBUG] [VALIDATOR ] VICI: Primary data validation passed. [2025-09-16T20:56:57.752779] [INFO ] [MAIN ] VICI: Fetched primary data is valid. [2025-09-16T20:56:57.752863] [DEBUG] [LOCAL ] VICI: Saving primary data. [2025-09-16T20:56:57.754389] [DEBUG] [LOCAL ] VICI: Trimmed 58324 records to 40006 (keeping 150 days of data) [2025-09-16T20:56:57.871289] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-16T20:56:57.974866] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-08. [2025-09-16T20:56:58.035369] [DEBUG] [LOCAL ] VICI: Primary data saved (40006 records). [2025-09-16T20:56:58.035506] [INFO ] [MAIN ] VICI: Full history saved. [2025-09-16T20:56:58.035588] [INFO ] [MAIN ] Update Progress: 2228/2369 symbols completed. VICI took 39.3s. Estimated remaining: 14m 60s. Rate: 9.4 symbols/min [2025-09-16T20:56:58.205425] [INFO ] [MAIN ] VKQ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:56:58.219446] [DEBUG] [LOCAL ] VKQ: Loaded 13311 existing records from primary storage. [2025-09-16T20:56:58.219571] [INFO ] [MAIN ] VKQ: Loaded 13311 existing records. [2025-09-16T20:56:58.398162] [WARN ] [MAIN ] VKQ: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:56:58.398394] [INFO ] [MAIN ] VKQ: Wiping existing primary data before full refresh. [2025-09-16T20:56:58.398440] [INFO ] [LOCAL ] VKQ: Starting deletion of primary data. [2025-09-16T20:56:58.398875] [DEBUG] [LOCAL ] VKQ: Deleted primary data file. [2025-09-16T20:56:58.398922] [INFO ] [MAIN ] VKQ: Starting full primary refresh. [2025-09-16T20:56:58.750146] [INFO ] [REMOTE ] VKQ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:56:58.776306] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-08. [2025-09-16T20:56:58.779126] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-16T20:56:59.574925] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-02. [2025-09-16T20:56:59.643790] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-16T20:57:00.375001] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-09. [2025-09-16T20:57:00.489837] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-16T20:57:00.520178] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-16T20:57:01.174902] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-09. [2025-09-16T20:57:01.974888] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-06. [2025-09-16T20:57:02.053832] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-16T20:57:02.060000] [INFO ] [REMOTE ] VIST: Full fetch complete (50169 records). [2025-09-16T20:57:02.060150] [DEBUG] [VALIDATOR ] VIST: Validating primary data. [2025-09-16T20:57:02.441345] [DEBUG] [VALIDATOR ] VIST: All expected trading days are present. [2025-09-16T20:57:02.441423] [DEBUG] [VALIDATOR ] VIST: Primary data validation passed. [2025-09-16T20:57:02.442320] [INFO ] [MAIN ] VIST: Fetched primary data is valid. [2025-09-16T20:57:02.442365] [DEBUG] [LOCAL ] VIST: Saving primary data. [2025-09-16T20:57:02.443374] [DEBUG] [LOCAL ] VIST: Trimmed 50169 records to 34025 (keeping 150 days of data) [2025-09-16T20:57:02.648554] [DEBUG] [LOCAL ] VIST: Primary data saved (34025 records). [2025-09-16T20:57:02.648714] [INFO ] [MAIN ] VIST: Full history saved. [2025-09-16T20:57:02.648799] [INFO ] [MAIN ] Update Progress: 2229/2369 symbols completed. VIST took 18.4s. Estimated remaining: 14m 53s. Rate: 9.4 symbols/min [2025-09-16T20:57:02.790384] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-03. [2025-09-16T20:57:02.820687] [INFO ] [MAIN ] VLN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:57:02.840821] [DEBUG] [LOCAL ] VLN: Loaded 21776 existing records from primary storage. [2025-09-16T20:57:02.840961] [INFO ] [MAIN ] VLN: Loaded 21776 existing records. [2025-09-16T20:57:03.017897] [WARN ] [MAIN ] VLN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:57:03.018241] [INFO ] [MAIN ] VLN: Wiping existing primary data before full refresh. [2025-09-16T20:57:03.018349] [INFO ] [LOCAL ] VLN: Starting deletion of primary data. [2025-09-16T20:57:03.018857] [DEBUG] [LOCAL ] VLN: Deleted primary data file. [2025-09-16T20:57:03.018948] [INFO ] [MAIN ] VLN: Starting full primary refresh. [2025-09-16T20:57:03.145534] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-16T20:57:03.198217] [INFO ] [REMOTE ] VIRT: Full fetch complete (51169 records). [2025-09-16T20:57:03.199496] [DEBUG] [VALIDATOR ] VIRT: Validating primary data. [2025-09-16T20:57:03.586670] [INFO ] [REMOTE ] VLN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:57:03.654338] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-02. [2025-09-16T20:57:03.789255] [DEBUG] [VALIDATOR ] VIRT: All expected trading days are present. [2025-09-16T20:57:03.789336] [DEBUG] [VALIDATOR ] VIRT: Primary data validation passed. [2025-09-16T20:57:03.790183] [INFO ] [MAIN ] VIRT: Fetched primary data is valid. [2025-09-16T20:57:03.790227] [DEBUG] [LOCAL ] VIRT: Saving primary data. [2025-09-16T20:57:03.791243] [DEBUG] [LOCAL ] VIRT: Trimmed 51169 records to 34659 (keeping 150 days of data) [2025-09-16T20:57:04.003357] [DEBUG] [LOCAL ] VIRT: Primary data saved (34659 records). [2025-09-16T20:57:04.003495] [INFO ] [MAIN ] VIRT: Full history saved. [2025-09-16T20:57:04.004612] [INFO ] [MAIN ] Update Progress: 2230/2369 symbols completed. VIRT took 24.4s. Estimated remaining: 14m 46s. Rate: 9.4 symbols/min [2025-09-16T20:57:04.175397] [INFO ] [MAIN ] VLO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:57:04.215495] [DEBUG] [LOCAL ] VLO: Loaded 39197 existing records from primary storage. [2025-09-16T20:57:04.215668] [INFO ] [MAIN ] VLO: Loaded 39197 existing records. [2025-09-16T20:57:04.396205] [WARN ] [MAIN ] VLO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:57:04.396448] [INFO ] [MAIN ] VLO: Wiping existing primary data before full refresh. [2025-09-16T20:57:04.396493] [INFO ] [LOCAL ] VLO: Starting deletion of primary data. [2025-09-16T20:57:04.397426] [DEBUG] [LOCAL ] VLO: Deleted primary data file. [2025-09-16T20:57:04.397476] [INFO ] [MAIN ] VLO: Starting full primary refresh. [2025-09-16T20:57:04.754025] [INFO ] [REMOTE ] VLO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:57:04.763977] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-02. [2025-09-16T20:57:04.765763] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-16T20:57:04.795805] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-06 (2.82 seconds). [2025-09-16T20:57:05.174876] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-07. [2025-09-16T20:57:05.360587] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-16T20:57:05.974894] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-04. [2025-09-16T20:57:06.433174] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-16T20:57:06.774904] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-03. [2025-09-16T20:57:06.920166] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-16T20:57:07.168314] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-16T20:57:07.574923] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-05. [2025-09-16T20:57:07.876010] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-16T20:57:08.374922] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-08. [2025-09-16T20:57:08.607348] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-16T20:57:09.174901] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-04. [2025-09-16T20:57:09.974928] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-03. [2025-09-16T20:57:10.064153] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-16T20:57:10.227203] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-16T20:57:10.774973] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-06. [2025-09-16T20:57:11.574898] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-09. [2025-09-16T20:57:11.858049] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-16T20:57:11.936235] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-16T20:57:12.374912] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-04. [2025-09-16T20:57:13.174923] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-05. [2025-09-16T20:57:13.192619] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-16T20:57:13.197610] [INFO ] [REMOTE ] VIV: Full fetch complete (49238 records). [2025-09-16T20:57:13.197721] [DEBUG] [VALIDATOR ] VIV: Validating primary data. [2025-09-16T20:57:13.571089] [DEBUG] [VALIDATOR ] VIV: All expected trading days are present. [2025-09-16T20:57:13.571181] [DEBUG] [VALIDATOR ] VIV: Primary data validation passed. [2025-09-16T20:57:13.572100] [INFO ] [MAIN ] VIV: Fetched primary data is valid. [2025-09-16T20:57:13.572146] [DEBUG] [LOCAL ] VIV: Saving primary data. [2025-09-16T20:57:13.573187] [DEBUG] [LOCAL ] VIV: Trimmed 49238 records to 33811 (keeping 150 days of data) [2025-09-16T20:57:13.784410] [DEBUG] [LOCAL ] VIV: Primary data saved (33811 records). [2025-09-16T20:57:13.784554] [INFO ] [MAIN ] VIV: Full history saved. [2025-09-16T20:57:13.784670] [INFO ] [MAIN ] Update Progress: 2231/2369 symbols completed. VIV took 26.9s. Estimated remaining: 14m 40s. Rate: 9.4 symbols/min [2025-09-16T20:57:13.951971] [INFO ] [MAIN ] VLRS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:57:13.980219] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-07. [2025-09-16T20:57:13.981594] [DEBUG] [LOCAL ] VLRS: Loaded 29317 existing records from primary storage. [2025-09-16T20:57:13.982410] [INFO ] [MAIN ] VLRS: Loaded 29317 existing records. [2025-09-16T20:57:14.185009] [WARN ] [MAIN ] VLRS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:57:14.185262] [INFO ] [MAIN ] VLRS: Wiping existing primary data before full refresh. [2025-09-16T20:57:14.185307] [INFO ] [LOCAL ] VLRS: Starting deletion of primary data. [2025-09-16T20:57:14.185952] [DEBUG] [LOCAL ] VLRS: Deleted primary data file. [2025-09-16T20:57:14.186002] [INFO ] [MAIN ] VLRS: Starting full primary refresh. [2025-09-16T20:57:14.538610] [INFO ] [REMOTE ] VLRS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:57:14.552602] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-16T20:57:14.774864] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-02. [2025-09-16T20:57:14.810488] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-16T20:57:15.172792] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-16T20:57:15.574905] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-05. [2025-09-16T20:57:16.325196] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-16T20:57:16.374854] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-03. [2025-09-16T20:57:17.179955] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-06. [2025-09-16T20:57:17.197144] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-16T20:57:17.669951] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-16T20:57:17.974922] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-06. [2025-09-16T20:57:18.441872] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-16T20:57:18.774923] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-04. [2025-09-16T20:57:19.574923] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-08. [2025-09-16T20:57:19.859259] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-16T20:57:20.374911] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-07. [2025-09-16T20:57:20.533845] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-16T20:57:20.584121] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-16T20:57:21.174898] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-05. [2025-09-16T20:57:21.619015] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-16T20:57:21.974928] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-07. [2025-09-16T20:57:22.774924] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-09. [2025-09-16T20:57:22.938121] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-16T20:57:23.575062] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-08. [2025-09-16T20:57:24.002205] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-16T20:57:24.031986] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-16T20:57:24.041602] [INFO ] [REMOTE ] VKQ: Full fetch complete (18753 records). [2025-09-16T20:57:24.041892] [DEBUG] [VALIDATOR ] VKQ: Validating primary data. [2025-09-16T20:57:24.375763] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-06. [2025-09-16T20:57:24.400459] [DEBUG] [VALIDATOR ] VKQ: All expected trading days are present. [2025-09-16T20:57:24.401622] [DEBUG] [VALIDATOR ] VKQ: Primary data validation passed. [2025-09-16T20:57:24.402160] [INFO ] [MAIN ] VKQ: Fetched primary data is valid. [2025-09-16T20:57:24.402207] [DEBUG] [LOCAL ] VKQ: Saving primary data. [2025-09-16T20:57:24.402792] [DEBUG] [LOCAL ] VKQ: Trimmed 18753 records to 13433 (keeping 150 days of data) [2025-09-16T20:57:24.484437] [DEBUG] [LOCAL ] VKQ: Primary data saved (13433 records). [2025-09-16T20:57:24.484598] [INFO ] [MAIN ] VKQ: Full history saved. [2025-09-16T20:57:24.484728] [INFO ] [MAIN ] Update Progress: 2232/2369 symbols completed. VKQ took 26.4s. Estimated remaining: 14m 34s. Rate: 9.4 symbols/min [2025-09-16T20:57:24.655048] [INFO ] [MAIN ] VLT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:57:24.659520] [DEBUG] [LOCAL ] VLT: Loaded 3151 existing records from primary storage. [2025-09-16T20:57:24.659610] [INFO ] [MAIN ] VLT: Loaded 3151 existing records. [2025-09-16T20:57:24.837686] [WARN ] [MAIN ] VLT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:57:24.837965] [INFO ] [MAIN ] VLT: Wiping existing primary data before full refresh. [2025-09-16T20:57:24.838015] [INFO ] [LOCAL ] VLT: Starting deletion of primary data. [2025-09-16T20:57:24.838289] [DEBUG] [LOCAL ] VLT: Deleted primary data file. [2025-09-16T20:57:24.838332] [INFO ] [MAIN ] VLT: Starting full primary refresh. [2025-09-16T20:57:25.176674] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-08. [2025-09-16T20:57:25.196576] [INFO ] [REMOTE ] VLT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:57:25.219652] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-16T20:57:25.574269] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-16T20:57:25.974934] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-02. [2025-09-16T20:57:26.774938] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-09. [2025-09-16T20:57:27.111616] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-16T20:57:27.128637] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-16T20:57:27.574923] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-03. [2025-09-16T20:57:28.117128] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-16T20:57:28.121207] [INFO ] [REMOTE ] VLN: Full fetch complete (30422 records). [2025-09-16T20:57:28.121300] [DEBUG] [VALIDATOR ] VLN: Validating primary data. [2025-09-16T20:57:28.377324] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-07. [2025-09-16T20:57:28.429971] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-16T20:57:28.494315] [DEBUG] [VALIDATOR ] VLN: All expected trading days are present. [2025-09-16T20:57:28.494388] [DEBUG] [VALIDATOR ] VLN: Primary data validation passed. [2025-09-16T20:57:28.495015] [INFO ] [MAIN ] VLN: Fetched primary data is valid. [2025-09-16T20:57:28.495060] [DEBUG] [LOCAL ] VLN: Saving primary data. [2025-09-16T20:57:28.495813] [DEBUG] [LOCAL ] VLN: Trimmed 30422 records to 22121 (keeping 150 days of data) [2025-09-16T20:57:28.619552] [DEBUG] [LOCAL ] VLN: Primary data saved (22121 records). [2025-09-16T20:57:28.619702] [INFO ] [MAIN ] VLN: Full history saved. [2025-09-16T20:57:28.619795] [INFO ] [MAIN ] Update Progress: 2233/2369 symbols completed. VLN took 26.0s. Estimated remaining: 14m 28s. Rate: 9.4 symbols/min [2025-09-16T20:57:28.797929] [INFO ] [MAIN ] VLTO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:57:28.831084] [DEBUG] [LOCAL ] VLTO: Loaded 33611 existing records from primary storage. [2025-09-16T20:57:28.831248] [INFO ] [MAIN ] VLTO: Loaded 33611 existing records. [2025-09-16T20:57:29.008542] [WARN ] [MAIN ] VLTO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:57:29.008850] [INFO ] [MAIN ] VLTO: Wiping existing primary data before full refresh. [2025-09-16T20:57:29.008898] [INFO ] [LOCAL ] VLTO: Starting deletion of primary data. [2025-09-16T20:57:29.009600] [DEBUG] [LOCAL ] VLTO: Deleted primary data file. [2025-09-16T20:57:29.009672] [INFO ] [MAIN ] VLTO: Starting full primary refresh. [2025-09-16T20:57:29.181520] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-09. [2025-09-16T20:57:29.365467] [INFO ] [REMOTE ] VLTO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:57:29.974914] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-02. [2025-09-16T20:57:30.039218] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-16T20:57:30.774907] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-08. [2025-09-16T20:57:30.868952] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-16T20:57:30.875472] [INFO ] [REMOTE ] VLO: Full fetch complete (57727 records). [2025-09-16T20:57:30.875563] [DEBUG] [VALIDATOR ] VLO: Validating primary data. [2025-09-16T20:57:31.250788] [DEBUG] [VALIDATOR ] VLO: All expected trading days are present. [2025-09-16T20:57:31.250867] [DEBUG] [VALIDATOR ] VLO: Primary data validation passed. [2025-09-16T20:57:31.251758] [INFO ] [MAIN ] VLO: Fetched primary data is valid. [2025-09-16T20:57:31.251801] [DEBUG] [LOCAL ] VLO: Saving primary data. [2025-09-16T20:57:31.252930] [DEBUG] [LOCAL ] VLO: Trimmed 57727 records to 39583 (keeping 150 days of data) [2025-09-16T20:57:31.503100] [DEBUG] [LOCAL ] VLO: Primary data saved (39583 records). [2025-09-16T20:57:31.503256] [INFO ] [MAIN ] VLO: Full history saved. [2025-09-16T20:57:31.504019] [INFO ] [MAIN ] Update Progress: 2234/2369 symbols completed. VLO took 27.5s. Estimated remaining: 14m 21s. Rate: 9.4 symbols/min [2025-09-16T20:57:31.579555] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-04. [2025-09-16T20:57:31.677506] [INFO ] [MAIN ] VMC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:57:31.706523] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-16T20:57:31.742670] [DEBUG] [LOCAL ] VMC: Loaded 31598 existing records from primary storage. [2025-09-16T20:57:31.742832] [INFO ] [MAIN ] VMC: Loaded 31598 existing records. [2025-09-16T20:57:31.916686] [WARN ] [MAIN ] VMC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:57:31.916910] [INFO ] [MAIN ] VMC: Wiping existing primary data before full refresh. [2025-09-16T20:57:31.916957] [INFO ] [LOCAL ] VMC: Starting deletion of primary data. [2025-09-16T20:57:31.917668] [DEBUG] [LOCAL ] VMC: Deleted primary data file. [2025-09-16T20:57:31.917738] [INFO ] [MAIN ] VMC: Starting full primary refresh. [2025-09-16T20:57:32.272136] [INFO ] [REMOTE ] VMC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:57:32.278691] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-16T20:57:32.299956] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-16T20:57:32.374870] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-09. [2025-09-16T20:57:33.174889] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-03. [2025-09-16T20:57:33.622590] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-16T20:57:33.626882] [INFO ] [REMOTE ] VLRS: Full fetch complete (44801 records). [2025-09-16T20:57:33.626986] [DEBUG] [VALIDATOR ] VLRS: Validating primary data. [2025-09-16T20:57:33.982067] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-05. [2025-09-16T20:57:33.998557] [DEBUG] [VALIDATOR ] VLRS: All expected trading days are present. [2025-09-16T20:57:33.998627] [DEBUG] [VALIDATOR ] VLRS: Primary data validation passed. [2025-09-16T20:57:33.999513] [INFO ] [MAIN ] VLRS: Fetched primary data is valid. [2025-09-16T20:57:33.999555] [DEBUG] [LOCAL ] VLRS: Saving primary data. [2025-09-16T20:57:34.000713] [DEBUG] [LOCAL ] VLRS: Trimmed 44801 records to 29529 (keeping 150 days of data) [2025-09-16T20:57:34.170754] [DEBUG] [LOCAL ] VLRS: Primary data saved (29529 records). [2025-09-16T20:57:34.170911] [INFO ] [MAIN ] VLRS: Full history saved. [2025-09-16T20:57:34.171001] [INFO ] [MAIN ] Update Progress: 2235/2369 symbols completed. VLRS took 20.4s. Estimated remaining: 14m 14s. Rate: 9.4 symbols/min [2025-09-16T20:57:34.346224] [INFO ] [MAIN ] VMI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:57:34.357763] [DEBUG] [LOCAL ] VMI: Loaded 11216 existing records from primary storage. [2025-09-16T20:57:34.357873] [INFO ] [MAIN ] VMI: Loaded 11216 existing records. [2025-09-16T20:57:34.534959] [WARN ] [MAIN ] VMI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:57:34.535215] [INFO ] [MAIN ] VMI: Wiping existing primary data before full refresh. [2025-09-16T20:57:34.535261] [INFO ] [LOCAL ] VMI: Starting deletion of primary data. [2025-09-16T20:57:34.535731] [DEBUG] [LOCAL ] VMI: Deleted primary data file. [2025-09-16T20:57:34.535789] [INFO ] [MAIN ] VMI: Starting full primary refresh. [2025-09-16T20:57:34.728866] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-16T20:57:34.781673] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-02. [2025-09-16T20:57:34.899192] [INFO ] [REMOTE ] VMI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:57:34.953229] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-16T20:57:35.574910] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-06. [2025-09-16T20:57:36.263380] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-16T20:57:36.374872] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-07. [2025-09-16T20:57:36.562597] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-16T20:57:36.895143] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-16T20:57:37.174915] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-04. [2025-09-16T20:57:37.974888] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-08. [2025-09-16T20:57:38.617452] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-16T20:57:38.774904] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-09. [2025-09-16T20:57:39.031147] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-16T20:57:39.348808] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-16T20:57:39.350075] [INFO ] [REMOTE ] VLT: Full fetch complete (5116 records). [2025-09-16T20:57:39.350143] [DEBUG] [VALIDATOR ] VLT: Validating primary data. [2025-09-16T20:57:39.585072] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-02. [2025-09-16T20:57:39.709631] [DEBUG] [VALIDATOR ] VLT: All expected trading days are present. [2025-09-16T20:57:39.709721] [DEBUG] [VALIDATOR ] VLT: Primary data validation passed. [2025-09-16T20:57:39.709863] [INFO ] [MAIN ] VLT: Fetched primary data is valid. [2025-09-16T20:57:39.709903] [DEBUG] [LOCAL ] VLT: Saving primary data. [2025-09-16T20:57:39.710287] [DEBUG] [LOCAL ] VLT: Trimmed 5116 records to 3187 (keeping 150 days of data) [2025-09-16T20:57:39.729630] [DEBUG] [LOCAL ] VLT: Primary data saved (3187 records). [2025-09-16T20:57:39.729706] [INFO ] [MAIN ] VLT: Full history saved. [2025-09-16T20:57:39.729775] [INFO ] [MAIN ] Update Progress: 2236/2369 symbols completed. VLT took 15.2s. Estimated remaining: 14m 8s. Rate: 9.4 symbols/min [2025-09-16T20:57:39.900980] [INFO ] [MAIN ] VMO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:57:39.917432] [DEBUG] [LOCAL ] VMO: Loaded 15153 existing records from primary storage. [2025-09-16T20:57:39.917576] [INFO ] [MAIN ] VMO: Loaded 15153 existing records. [2025-09-16T20:57:40.095080] [WARN ] [MAIN ] VMO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:57:40.095336] [INFO ] [MAIN ] VMO: Wiping existing primary data before full refresh. [2025-09-16T20:57:40.095383] [INFO ] [LOCAL ] VMO: Starting deletion of primary data. [2025-09-16T20:57:40.095800] [DEBUG] [LOCAL ] VMO: Deleted primary data file. [2025-09-16T20:57:40.095847] [INFO ] [MAIN ] VMO: Starting full primary refresh. [2025-09-16T20:57:40.380046] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-03. [2025-09-16T20:57:40.459086] [INFO ] [REMOTE ] VMO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:57:40.619364] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-16T20:57:41.174898] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-03. [2025-09-16T20:57:41.974879] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-05. [2025-09-16T20:57:42.110896] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-16T20:57:42.421151] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-16T20:57:42.774921] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-04. [2025-09-16T20:57:43.574950] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-02. [2025-09-16T20:57:43.853764] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-16T20:57:44.301795] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-16T20:57:44.374901] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-05. [2025-09-16T20:57:44.428929] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-16T20:57:45.174932] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-03. [2025-09-16T20:57:45.974953] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-06. [2025-09-16T20:57:46.127129] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-16T20:57:46.174208] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-16T20:57:46.774941] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-04. [2025-09-16T20:57:47.575279] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-06. [2025-09-16T20:57:47.613315] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-16T20:57:47.774040] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-16T20:57:48.374958] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-05. [2025-09-16T20:57:49.168205] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-16T20:57:49.176586] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-07. [2025-09-16T20:57:49.302471] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-16T20:57:49.974898] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-07. [2025-09-16T20:57:50.774905] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-06. [2025-09-16T20:57:50.954859] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-16T20:57:51.210381] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-16T20:57:51.574908] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-04. [2025-09-16T20:57:51.993342] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-16T20:57:52.375137] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-08. [2025-09-16T20:57:52.567955] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-16T20:57:53.175058] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-07. [2025-09-16T20:57:53.974878] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-08. [2025-09-16T20:57:54.043956] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-16T20:57:54.280198] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-16T20:57:54.774912] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-09. [2025-09-16T20:57:55.574901] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-08. [2025-09-16T20:57:55.689163] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-16T20:57:55.830499] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-16T20:57:55.835350] [INFO ] [REMOTE ] VMC: Full fetch complete (48105 records). [2025-09-16T20:57:55.835473] [DEBUG] [VALIDATOR ] VMC: Validating primary data. [2025-09-16T20:57:56.222294] [DEBUG] [VALIDATOR ] VMC: All expected trading days are present. [2025-09-16T20:57:56.222385] [DEBUG] [VALIDATOR ] VMC: Primary data validation passed. [2025-09-16T20:57:56.223422] [INFO ] [MAIN ] VMC: Fetched primary data is valid. [2025-09-16T20:57:56.223515] [DEBUG] [LOCAL ] VMC: Saving primary data. [2025-09-16T20:57:56.224869] [DEBUG] [LOCAL ] VMC: Trimmed 48105 records to 31862 (keeping 150 days of data) [2025-09-16T20:57:56.385449] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-05. [2025-09-16T20:57:56.429553] [DEBUG] [LOCAL ] VMC: Primary data saved (31862 records). [2025-09-16T20:57:56.429680] [INFO ] [MAIN ] VMC: Full history saved. [2025-09-16T20:57:56.430357] [INFO ] [MAIN ] Update Progress: 2237/2369 symbols completed. VMC took 24.9s. Estimated remaining: 14m 2s. Rate: 9.4 symbols/min [2025-09-16T20:57:56.575273] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-16T20:57:57.174887] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-09. [2025-09-16T20:57:57.504340] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-16T20:57:57.974902] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-06. [2025-09-16T20:57:58.724253] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-16T20:57:58.730033] [INFO ] [REMOTE ] VLTO: Full fetch complete (50134 records). [2025-09-16T20:57:58.730134] [DEBUG] [VALIDATOR ] VLTO: Validating primary data. [2025-09-16T20:57:58.794320] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-09. [2025-09-16T20:57:59.112964] [DEBUG] [VALIDATOR ] VLTO: All expected trading days are present. [2025-09-16T20:57:59.113091] [DEBUG] [VALIDATOR ] VLTO: Primary data validation passed. [2025-09-16T20:57:59.114086] [INFO ] [MAIN ] VLTO: Fetched primary data is valid. [2025-09-16T20:57:59.114255] [DEBUG] [LOCAL ] VLTO: Saving primary data. [2025-09-16T20:57:59.130110] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-16T20:57:59.135488] [DEBUG] [LOCAL ] VLTO: Trimmed 50134 records to 33945 (keeping 150 days of data) [2025-09-16T20:57:59.348925] [DEBUG] [LOCAL ] VLTO: Primary data saved (33945 records). [2025-09-16T20:57:59.349089] [INFO ] [MAIN ] VLTO: Full history saved. [2025-09-16T20:57:59.349194] [INFO ] [MAIN ] Update Progress: 2238/2369 symbols completed. VLTO took 30.7s. Estimated remaining: 13m 56s. Rate: 9.4 symbols/min [2025-09-16T20:57:59.574896] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-07. [2025-09-16T20:57:59.659910] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-16T20:57:59.662297] [INFO ] [REMOTE ] VMI: Full fetch complete (16862 records). [2025-09-16T20:57:59.662367] [DEBUG] [VALIDATOR ] VMI: Validating primary data. [2025-09-16T20:58:00.024182] [DEBUG] [VALIDATOR ] VMI: All expected trading days are present. [2025-09-16T20:58:00.024260] [DEBUG] [VALIDATOR ] VMI: Primary data validation passed. [2025-09-16T20:58:00.024700] [INFO ] [MAIN ] VMI: Fetched primary data is valid. [2025-09-16T20:58:00.024758] [DEBUG] [LOCAL ] VMI: Saving primary data. [2025-09-16T20:58:00.025279] [DEBUG] [LOCAL ] VMI: Trimmed 16862 records to 11308 (keeping 150 days of data) [2025-09-16T20:58:00.094408] [DEBUG] [LOCAL ] VMI: Primary data saved (11308 records). [2025-09-16T20:58:00.094538] [INFO ] [MAIN ] VMI: Full history saved. [2025-09-16T20:58:00.094617] [INFO ] [MAIN ] Update Progress: 2239/2369 symbols completed. VMI took 25.9s. Estimated remaining: 13m 49s. Rate: 9.4 symbols/min [2025-09-16T20:58:00.784703] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-16T20:58:00.789704] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-08. [2025-09-16T20:58:01.963755] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-16T20:58:01.968052] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-09. [2025-09-16T20:58:02.919704] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-16T20:58:02.923844] [INFO ] [REMOTE ] VMO: Full fetch complete (23077 records). [2025-09-16T20:58:02.923949] [DEBUG] [VALIDATOR ] VMO: Validating primary data. [2025-09-16T20:58:03.322385] [DEBUG] [VALIDATOR ] VMO: All expected trading days are present. [2025-09-16T20:58:03.322507] [DEBUG] [VALIDATOR ] VMO: Primary data validation passed. [2025-09-16T20:58:03.323246] [INFO ] [MAIN ] VMO: Fetched primary data is valid. [2025-09-16T20:58:03.323306] [DEBUG] [LOCAL ] VMO: Saving primary data. [2025-09-16T20:58:03.324328] [DEBUG] [LOCAL ] VMO: Trimmed 23077 records to 15362 (keeping 150 days of data) [2025-09-16T20:58:03.419455] [DEBUG] [LOCAL ] VMO: Primary data saved (15362 records). [2025-09-16T20:58:03.419688] [INFO ] [MAIN ] VMO: Full history saved. [2025-09-16T20:58:03.419785] [INFO ] [MAIN ] Update Progress: 2240/2369 symbols completed. VMO took 23.7s. Estimated remaining: 13m 42s. Rate: 9.4 symbols/min [2025-09-16T20:58:04.088586] [INFO ] [MAIN ] VNCE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:58:04.136887] [INFO ] [MAIN ] VNO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:58:04.108859] [INFO ] [MAIN ] VNT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:58:04.164583] [INFO ] [MAIN ] VOC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:58:04.173080] [DEBUG] [LOCAL ] VNCE: Loaded 4684 existing records from primary storage. [2025-09-16T20:58:04.173231] [INFO ] [MAIN ] VNCE: Loaded 4684 existing records. [2025-09-16T20:58:04.271050] [DEBUG] [LOCAL ] VOC: Loaded 6877 existing records from primary storage. [2025-09-16T20:58:04.296572] [INFO ] [MAIN ] VOC: Loaded 6877 existing records. [2025-09-16T20:58:04.451821] [DEBUG] [LOCAL ] VNO: Loaded 36228 existing records from primary storage. [2025-09-16T20:58:04.516605] [INFO ] [MAIN ] VNO: Loaded 36228 existing records. [2025-09-16T20:58:04.516468] [WARN ] [MAIN ] VNCE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:58:04.517399] [DEBUG] [LOCAL ] VNT: Loaded 32232 existing records from primary storage. [2025-09-16T20:58:04.547350] [INFO ] [MAIN ] VNT: Loaded 32232 existing records. [2025-09-16T20:58:04.553356] [INFO ] [MAIN ] VNCE: Wiping existing primary data before full refresh. [2025-09-16T20:58:04.663821] [INFO ] [LOCAL ] VNCE: Starting deletion of primary data. [2025-09-16T20:58:04.738548] [DEBUG] [LOCAL ] VNCE: Deleted primary data file. [2025-09-16T20:58:04.796783] [INFO ] [MAIN ] VNCE: Starting full primary refresh. [2025-09-16T20:58:04.796695] [WARN ] [MAIN ] VOC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:58:04.833594] [INFO ] [MAIN ] VOC: Wiping existing primary data before full refresh. [2025-09-16T20:58:04.870794] [INFO ] [LOCAL ] VOC: Starting deletion of primary data. [2025-09-16T20:58:04.887783] [DEBUG] [LOCAL ] VOC: Deleted primary data file. [2025-09-16T20:58:04.887896] [INFO ] [MAIN ] VOC: Starting full primary refresh. [2025-09-16T20:58:05.043161] [WARN ] [MAIN ] VNT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:58:05.088749] [WARN ] [MAIN ] VNO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:58:05.174743] [INFO ] [MAIN ] VNT: Wiping existing primary data before full refresh. [2025-09-16T20:58:05.196925] [INFO ] [LOCAL ] VNT: Starting deletion of primary data. [2025-09-16T20:58:05.207386] [INFO ] [MAIN ] VNO: Wiping existing primary data before full refresh. [2025-09-16T20:58:05.237804] [INFO ] [LOCAL ] VNO: Starting deletion of primary data. [2025-09-16T20:58:05.272873] [DEBUG] [LOCAL ] VNT: Deleted primary data file. [2025-09-16T20:58:05.296073] [INFO ] [MAIN ] VNT: Starting full primary refresh. [2025-09-16T20:58:05.339787] [DEBUG] [LOCAL ] VNO: Deleted primary data file. [2025-09-16T20:58:05.465759] [INFO ] [MAIN ] VNO: Starting full primary refresh. [2025-09-16T20:58:06.023065] [INFO ] [REMOTE ] VNCE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:58:06.159740] [INFO ] [REMOTE ] VOC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:58:06.193802] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-02. [2025-09-16T20:58:06.179769] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-02. [2025-09-16T20:58:06.477355] [INFO ] [REMOTE ] VNT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:58:06.481065] [INFO ] [REMOTE ] VNO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:58:06.481603] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-02. [2025-09-16T20:58:06.481397] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-02. [2025-09-16T20:58:07.110052] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-16T20:58:07.112637] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-03. [2025-09-16T20:58:07.226958] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-16T20:58:07.229808] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-03. [2025-09-16T20:58:07.742278] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-16T20:58:07.744548] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-04. [2025-09-16T20:58:07.831082] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-16T20:58:07.832812] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-04. [2025-09-16T20:58:08.093582] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-16T20:58:08.181902] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-16T20:58:08.374927] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-03. [2025-09-16T20:58:08.570830] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-16T20:58:08.658284] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-16T20:58:09.174935] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-03. [2025-09-16T20:58:09.852005] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-16T20:58:09.974944] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-05. [2025-09-16T20:58:10.467278] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-16T20:58:10.774921] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-04. [2025-09-16T20:58:10.883379] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-16T20:58:11.574934] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-05. [2025-09-16T20:58:12.260710] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-16T20:58:12.304060] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-16T20:58:12.374883] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-05. [2025-09-16T20:58:13.174914] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-06. [2025-09-16T20:58:13.840147] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-16T20:58:13.974876] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-04. [2025-09-16T20:58:14.036752] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-16T20:58:14.774901] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-07. [2025-09-16T20:58:15.574916] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-06. [2025-09-16T20:58:15.957594] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-16T20:58:15.985928] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-16T20:58:16.374898] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-08. [2025-09-16T20:58:17.174933] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-05. [2025-09-16T20:58:17.974903] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-06. [2025-09-16T20:58:18.030139] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-16T20:58:18.206060] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-06 (2.63 seconds). [2025-09-16T20:58:18.489668] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-16T20:58:18.774906] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-09. [2025-09-16T20:58:18.848004] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-16T20:58:19.549992] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-16T20:58:19.551500] [INFO ] [REMOTE ] VOC: Full fetch complete (9987 records). [2025-09-16T20:58:19.551593] [DEBUG] [VALIDATOR ] VOC: Validating primary data. [2025-09-16T20:58:19.581835] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-07. [2025-09-16T20:58:19.918307] [DEBUG] [VALIDATOR ] VOC: All expected trading days are present. [2025-09-16T20:58:19.918396] [DEBUG] [VALIDATOR ] VOC: Primary data validation passed. [2025-09-16T20:58:19.918683] [INFO ] [MAIN ] VOC: Fetched primary data is valid. [2025-09-16T20:58:19.918728] [DEBUG] [LOCAL ] VOC: Saving primary data. [2025-09-16T20:58:19.919255] [DEBUG] [LOCAL ] VOC: Trimmed 9987 records to 6945 (keeping 150 days of data) [2025-09-16T20:58:19.961010] [DEBUG] [LOCAL ] VOC: Primary data saved (6945 records). [2025-09-16T20:58:19.961169] [INFO ] [MAIN ] VOC: Full history saved. [2025-09-16T20:58:19.961308] [INFO ] [MAIN ] Update Progress: 2241/2369 symbols completed. VOC took 16.5s. Estimated remaining: 13m 37s. Rate: 9.4 symbols/min [2025-09-16T20:58:20.137327] [INFO ] [MAIN ] VOYA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:58:20.170168] [DEBUG] [LOCAL ] VOYA: Loaded 30954 existing records from primary storage. [2025-09-16T20:58:20.170318] [INFO ] [MAIN ] VOYA: Loaded 30954 existing records. [2025-09-16T20:58:20.356960] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-16T20:58:20.362213] [WARN ] [MAIN ] VOYA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:58:20.364831] [INFO ] [MAIN ] VOYA: Wiping existing primary data before full refresh. [2025-09-16T20:58:20.364915] [INFO ] [LOCAL ] VOYA: Starting deletion of primary data. [2025-09-16T20:58:20.365560] [DEBUG] [LOCAL ] VOYA: Deleted primary data file. [2025-09-16T20:58:20.365616] [INFO ] [MAIN ] VOYA: Starting full primary refresh. [2025-09-16T20:58:20.379989] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-08. [2025-09-16T20:58:20.722626] [INFO ] [REMOTE ] VOYA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:58:21.010779] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-16T20:58:21.174904] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-02. [2025-09-16T20:58:21.974910] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-07. [2025-09-16T20:58:22.713348] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-16T20:58:22.774862] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-03. [2025-09-16T20:58:23.574953] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-06. [2025-09-16T20:58:23.811021] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-16T20:58:24.374918] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-09. [2025-09-16T20:58:24.566190] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-16T20:58:24.952468] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-16T20:58:25.174921] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-04. [2025-09-16T20:58:25.498969] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-16T20:58:25.501485] [INFO ] [REMOTE ] VNCE: Full fetch complete (6796 records). [2025-09-16T20:58:25.501556] [DEBUG] [VALIDATOR ] VNCE: Validating primary data. [2025-09-16T20:58:25.867689] [DEBUG] [VALIDATOR ] VNCE: All expected trading days are present. [2025-09-16T20:58:25.867785] [DEBUG] [VALIDATOR ] VNCE: Primary data validation passed. [2025-09-16T20:58:25.867970] [INFO ] [MAIN ] VNCE: Fetched primary data is valid. [2025-09-16T20:58:25.868019] [DEBUG] [LOCAL ] VNCE: Saving primary data. [2025-09-16T20:58:25.868628] [DEBUG] [LOCAL ] VNCE: Trimmed 6796 records to 4887 (keeping 150 days of data) [2025-09-16T20:58:25.898649] [DEBUG] [LOCAL ] VNCE: Primary data saved (4887 records). [2025-09-16T20:58:25.898790] [INFO ] [MAIN ] VNCE: Full history saved. [2025-09-16T20:58:25.898910] [INFO ] [MAIN ] Update Progress: 2242/2369 symbols completed. VNCE took 22.5s. Estimated remaining: 13m 30s. Rate: 9.4 symbols/min [2025-09-16T20:58:25.980225] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-07. [2025-09-16T20:58:26.075122] [INFO ] [MAIN ] VOYG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:58:26.075309] [DEBUG] [LOCAL ] VOYG: No existing data file found in primary storage. [2025-09-16T20:58:26.075347] [WARN ] [MAIN ] VOYG: No existing data found, performing full refresh instead. [2025-09-16T20:58:26.075469] [INFO ] [MAIN ] VOYG: Wiping existing primary data before full refresh. [2025-09-16T20:58:26.075509] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-09-16T20:58:26.075553] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-09-16T20:58:26.075588] [INFO ] [MAIN ] VOYG: Starting full primary refresh. [2025-09-16T20:58:26.428553] [INFO ] [REMOTE ] VOYG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:58:26.774941] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-08. [2025-09-16T20:58:26.806751] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-16T20:58:27.574919] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-02. [2025-09-16T20:58:28.025159] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:58:28.025529] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-02 [2025-09-16T20:58:28.051478] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-16T20:58:28.374908] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-08. [2025-09-16T20:58:29.174916] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-05. [2025-09-16T20:58:29.304351] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-09-16T20:58:29.974910] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-09. [2025-09-16T20:58:30.780028] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-03. [2025-09-16T20:58:30.799356] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-09-16T20:58:30.888119] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-16T20:58:31.067182] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:58:31.067616] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-03 [2025-09-16T20:58:31.518121] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-16T20:58:31.524284] [INFO ] [REMOTE ] VNO: Full fetch complete (53298 records). [2025-09-16T20:58:31.524451] [DEBUG] [VALIDATOR ] VNO: Validating primary data. [2025-09-16T20:58:31.580033] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-09. [2025-09-16T20:58:31.919629] [DEBUG] [VALIDATOR ] VNO: All expected trading days are present. [2025-09-16T20:58:31.919782] [DEBUG] [VALIDATOR ] VNO: Primary data validation passed. [2025-09-16T20:58:31.920969] [INFO ] [MAIN ] VNO: Fetched primary data is valid. [2025-09-16T20:58:31.921054] [DEBUG] [LOCAL ] VNO: Saving primary data. [2025-09-16T20:58:31.923133] [DEBUG] [LOCAL ] VNO: Trimmed 53298 records to 36612 (keeping 150 days of data) [2025-09-16T20:58:32.148659] [DEBUG] [LOCAL ] VNO: Primary data saved (36612 records). [2025-09-16T20:58:32.148847] [INFO ] [MAIN ] VNO: Full history saved. [2025-09-16T20:58:32.148993] [INFO ] [MAIN ] Update Progress: 2243/2369 symbols completed. VNO took 28.7s. Estimated remaining: 13m 24s. Rate: 9.4 symbols/min [2025-09-16T20:58:32.319175] [INFO ] [MAIN ] VPG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:58:32.333044] [DEBUG] [LOCAL ] VPG: Loaded 12585 existing records from primary storage. [2025-09-16T20:58:32.333172] [INFO ] [MAIN ] VPG: Loaded 12585 existing records. [2025-09-16T20:58:32.380040] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-04. [2025-09-16T20:58:32.515612] [WARN ] [MAIN ] VPG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:58:32.515900] [INFO ] [MAIN ] VPG: Wiping existing primary data before full refresh. [2025-09-16T20:58:32.515948] [INFO ] [LOCAL ] VPG: Starting deletion of primary data. [2025-09-16T20:58:32.516329] [DEBUG] [LOCAL ] VPG: Deleted primary data file. [2025-09-16T20:58:32.516392] [INFO ] [MAIN ] VPG: Starting full primary refresh. [2025-09-16T20:58:32.745071] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:58:32.791019] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-04 [2025-09-16T20:58:32.880211] [INFO ] [REMOTE ] VPG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:58:32.895905] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-16T20:58:32.902734] [INFO ] [REMOTE ] VNT: Full fetch complete (48613 records). [2025-09-16T20:58:32.902894] [DEBUG] [VALIDATOR ] VNT: Validating primary data. [2025-09-16T20:58:33.179964] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-06. [2025-09-16T20:58:33.294068] [DEBUG] [VALIDATOR ] VNT: All expected trading days are present. [2025-09-16T20:58:33.294173] [DEBUG] [VALIDATOR ] VNT: Primary data validation passed. [2025-09-16T20:58:33.295082] [INFO ] [MAIN ] VNT: Fetched primary data is valid. [2025-09-16T20:58:33.295130] [DEBUG] [LOCAL ] VNT: Saving primary data. [2025-09-16T20:58:33.296286] [DEBUG] [LOCAL ] VNT: Trimmed 48613 records to 32549 (keeping 150 days of data) [2025-09-16T20:58:33.502843] [DEBUG] [LOCAL ] VNT: Primary data saved (32549 records). [2025-09-16T20:58:33.502986] [INFO ] [MAIN ] VNT: Full history saved. [2025-09-16T20:58:33.503075] [INFO ] [MAIN ] Update Progress: 2244/2369 symbols completed. VNT took 30.1s. Estimated remaining: 13m 17s. Rate: 9.4 symbols/min [2025-09-16T20:58:33.682364] [INFO ] [MAIN ] VPV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:58:33.687792] [DEBUG] [LOCAL ] VPV: Loaded 3618 existing records from primary storage. [2025-09-16T20:58:33.687909] [INFO ] [MAIN ] VPV: Loaded 3618 existing records. [2025-09-16T20:58:33.866130] [WARN ] [MAIN ] VPV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:58:33.866372] [INFO ] [MAIN ] VPV: Wiping existing primary data before full refresh. [2025-09-16T20:58:33.866428] [INFO ] [LOCAL ] VPV: Starting deletion of primary data. [2025-09-16T20:58:33.866707] [DEBUG] [LOCAL ] VPV: Deleted primary data file. [2025-09-16T20:58:33.866756] [INFO ] [MAIN ] VPV: Starting full primary refresh. [2025-09-16T20:58:33.980023] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-02. [2025-09-16T20:58:34.218051] [INFO ] [REMOTE ] VPV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:58:34.777431] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-02. [2025-09-16T20:58:34.779682] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-16T20:58:34.796433] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-16T20:58:35.574872] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-03. [2025-09-16T20:58:35.926772] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-16T20:58:36.369817] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-16T20:58:36.374838] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-04. [2025-09-16T20:58:37.174944] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-07. [2025-09-16T20:58:37.670476] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-16T20:58:37.974901] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-03. [2025-09-16T20:58:38.636807] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-16T20:58:38.668093] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-16T20:58:38.774967] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-05. [2025-09-16T20:58:39.574937] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-04. [2025-09-16T20:58:39.844271] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-16T20:58:40.374887] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-08. [2025-09-16T20:58:40.630517] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-16T20:58:41.174951] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-06. [2025-09-16T20:58:41.974907] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-05. [2025-09-16T20:58:42.077802] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-16T20:58:42.213972] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-16T20:58:42.241923] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-16T20:58:42.242274] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-05 [2025-09-16T20:58:42.774901] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-06. [2025-09-16T20:58:43.574955] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-07. [2025-09-16T20:58:44.374951] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-09. [2025-09-16T20:58:44.492163] [INFO ] [REMOTE ] VOYG: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-16T20:58:44.612887] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-16T20:58:45.174962] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-07. [2025-09-16T20:58:45.633198] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-16T20:58:45.641838] [INFO ] [REMOTE ] VOYA: Full fetch complete (46655 records). [2025-09-16T20:58:45.642110] [DEBUG] [VALIDATOR ] VOYA: Validating primary data. [2025-09-16T20:58:45.980078] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-05. [2025-09-16T20:58:46.151001] [DEBUG] [VALIDATOR ] VOYA: All expected trading days are present. [2025-09-16T20:58:46.151142] [DEBUG] [VALIDATOR ] VOYA: Primary data validation passed. [2025-09-16T20:58:46.152424] [INFO ] [MAIN ] VOYA: Fetched primary data is valid. [2025-09-16T20:58:46.152486] [DEBUG] [LOCAL ] VOYA: Saving primary data. [2025-09-16T20:58:46.153808] [DEBUG] [LOCAL ] VOYA: Trimmed 46655 records to 31278 (keeping 150 days of data) [2025-09-16T20:58:46.361062] [DEBUG] [LOCAL ] VOYA: Primary data saved (31278 records). [2025-09-16T20:58:46.361221] [INFO ] [MAIN ] VOYA: Full history saved. [2025-09-16T20:58:46.361349] [INFO ] [MAIN ] Update Progress: 2245/2369 symbols completed. VOYA took 26.4s. Estimated remaining: 13m 11s. Rate: 9.4 symbols/min [2025-09-16T20:58:46.537561] [INFO ] [MAIN ] VRE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:58:46.565704] [DEBUG] [LOCAL ] VRE: Loaded 25581 existing records from primary storage. [2025-09-16T20:58:46.565848] [INFO ] [MAIN ] VRE: Loaded 25581 existing records. [2025-09-16T20:58:46.750811] [WARN ] [MAIN ] VRE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:58:46.751142] [INFO ] [MAIN ] VRE: Wiping existing primary data before full refresh. [2025-09-16T20:58:46.751191] [INFO ] [LOCAL ] VRE: Starting deletion of primary data. [2025-09-16T20:58:46.752020] [DEBUG] [LOCAL ] VRE: Deleted primary data file. [2025-09-16T20:58:46.752073] [INFO ] [MAIN ] VRE: Starting full primary refresh. [2025-09-16T20:58:46.788631] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-08. [2025-09-16T20:58:46.846069] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-16T20:58:47.130440] [INFO ] [REMOTE ] VRE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:58:47.177940] [INFO ] [REMOTE ] VOYG: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-16T20:58:47.574849] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-08. [2025-09-16T20:58:47.706301] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-16T20:58:48.374918] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-09. [2025-09-16T20:58:49.174941] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-02. [2025-09-16T20:58:49.189143] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-16T20:58:49.191244] [INFO ] [REMOTE ] VPG: Full fetch complete (18434 records). [2025-09-16T20:58:49.191325] [DEBUG] [VALIDATOR ] VPG: Validating primary data. [2025-09-16T20:58:49.589850] [DEBUG] [VALIDATOR ] VPG: All expected trading days are present. [2025-09-16T20:58:49.590100] [DEBUG] [VALIDATOR ] VPG: Primary data validation passed. [2025-09-16T20:58:49.590626] [INFO ] [MAIN ] VPG: Fetched primary data is valid. [2025-09-16T20:58:49.590730] [DEBUG] [LOCAL ] VPG: Saving primary data. [2025-09-16T20:58:49.591818] [DEBUG] [LOCAL ] VPG: Trimmed 18434 records to 12703 (keeping 150 days of data) [2025-09-16T20:58:49.668679] [DEBUG] [LOCAL ] VPG: Primary data saved (12703 records). [2025-09-16T20:58:49.668823] [INFO ] [MAIN ] VPG: Full history saved. [2025-09-16T20:58:49.668910] [INFO ] [MAIN ] Update Progress: 2246/2369 symbols completed. VPG took 17.5s. Estimated remaining: 13m 5s. Rate: 9.4 symbols/min [2025-09-16T20:58:49.845175] [INFO ] [MAIN ] VRT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:58:49.874895] [INFO ] [REMOTE ] VOYG: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-16T20:58:49.924439] [DEBUG] [LOCAL ] VRT: Loaded 39714 existing records from primary storage. [2025-09-16T20:58:49.924658] [INFO ] [MAIN ] VRT: Loaded 39714 existing records. [2025-09-16T20:58:49.980002] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-06. [2025-09-16T20:58:50.113095] [WARN ] [MAIN ] VRT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:58:50.113331] [INFO ] [MAIN ] VRT: Wiping existing primary data before full refresh. [2025-09-16T20:58:50.113376] [INFO ] [LOCAL ] VRT: Starting deletion of primary data. [2025-09-16T20:58:50.114345] [DEBUG] [LOCAL ] VRT: Deleted primary data file. [2025-09-16T20:58:50.114405] [INFO ] [MAIN ] VRT: Starting full primary refresh. [2025-09-16T20:58:50.479481] [INFO ] [REMOTE ] VRT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:58:50.532536] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-16T20:58:50.566454] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-16T20:58:50.774929] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-02. [2025-09-16T20:58:51.574890] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-07. [2025-09-16T20:58:52.265436] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-16T20:58:52.374898] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-08. [2025-09-16T20:58:53.038246] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-16T20:58:53.174929] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-03. [2025-09-16T20:58:53.274322] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-09-16T20:58:53.974905] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-09. [2025-09-16T20:58:54.288949] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-16T20:58:54.774920] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-09. [2025-09-16T20:58:55.498808] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-16T20:58:55.500191] [INFO ] [REMOTE ] VPV: Full fetch complete (6023 records). [2025-09-16T20:58:55.500265] [DEBUG] [VALIDATOR ] VPV: Validating primary data. [2025-09-16T20:58:55.579986] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-04. [2025-09-16T20:58:55.864881] [INFO ] [REMOTE ] VOYG: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-16T20:58:55.891466] [DEBUG] [VALIDATOR ] VPV: All expected trading days are present. [2025-09-16T20:58:55.891664] [DEBUG] [VALIDATOR ] VPV: Primary data validation passed. [2025-09-16T20:58:55.891592] [INFO ] [REMOTE ] VOYG: Full fetch complete (22009 records). [2025-09-16T20:58:55.891989] [INFO ] [MAIN ] VPV: Fetched primary data is valid. [2025-09-16T20:58:55.892133] [DEBUG] [LOCAL ] VPV: Saving primary data. [2025-09-16T20:58:55.892078] [DEBUG] [VALIDATOR ] VOYG: Validating primary data. [2025-09-16T20:58:55.924480] [DEBUG] [LOCAL ] VPV: Trimmed 6023 records to 3663 (keeping 150 days of data) [2025-09-16T20:58:56.075951] [DEBUG] [LOCAL ] VPV: Primary data saved (3663 records). [2025-09-16T20:58:56.101146] [INFO ] [MAIN ] VPV: Full history saved. [2025-09-16T20:58:56.101410] [INFO ] [MAIN ] Update Progress: 2247/2369 symbols completed. VPV took 22.6s. Estimated remaining: 12m 58s. Rate: 9.4 symbols/min [2025-09-16T20:58:56.101235] [WARN ] [VALIDATOR ] VOYG: Validation failed - insufficient historical data. Have 67 unique days, need 150 days [2025-09-16T20:58:56.134792] [FATAL] [MAIN ] VOYG: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:58:56.168228] [WARN ] [MAIN ] VOYG: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:58:56.179905] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-09-16T20:58:56.196531] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-09-16T20:58:56.207514] [INFO ] [LOCAL ] VOYG: Starting deletion of derivative data. [2025-09-16T20:58:56.207661] [DEBUG] [LOCAL ] VOYG: No derivative data file found to delete. [2025-09-16T20:58:56.207978] [INFO ] [MAIN ] Update Progress: 2248/2369 symbols completed. VOYG took 30.3s. Estimated remaining: 12m 51s. Rate: 9.4 symbols/min [2025-09-16T20:58:56.386101] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-03. [2025-09-16T20:58:56.389939] [INFO ] [MAIN ] VRTS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:58:56.465398] [INFO ] [MAIN ] VSCO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:58:56.475665] [DEBUG] [LOCAL ] VRTS: Loaded 7327 existing records from primary storage. [2025-09-16T20:58:56.475837] [INFO ] [MAIN ] VRTS: Loaded 7327 existing records. [2025-09-16T20:58:56.672665] [WARN ] [MAIN ] VRTS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:58:56.672924] [INFO ] [MAIN ] VRTS: Wiping existing primary data before full refresh. [2025-09-16T20:58:56.672970] [INFO ] [LOCAL ] VRTS: Starting deletion of primary data. [2025-09-16T20:58:56.673309] [DEBUG] [LOCAL ] VRTS: Deleted primary data file. [2025-09-16T20:58:56.673356] [INFO ] [MAIN ] VRTS: Starting full primary refresh. [2025-09-16T20:58:56.807154] [DEBUG] [LOCAL ] VSCO: Loaded 38920 existing records from primary storage. [2025-09-16T20:58:56.840820] [INFO ] [MAIN ] VSCO: Loaded 38920 existing records. [2025-09-16T20:58:57.254529] [INFO ] [REMOTE ] VRTS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:58:57.254776] [WARN ] [MAIN ] VSCO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:58:57.255397] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-02. [2025-09-16T20:58:57.255491] [INFO ] [MAIN ] VSCO: Wiping existing primary data before full refresh. [2025-09-16T20:58:57.256364] [INFO ] [LOCAL ] VSCO: Starting deletion of primary data. [2025-09-16T20:58:57.257393] [DEBUG] [LOCAL ] VSCO: Deleted primary data file. [2025-09-16T20:58:57.257454] [INFO ] [MAIN ] VSCO: Starting full primary refresh. [2025-09-16T20:58:57.387606] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-16T20:58:57.643660] [INFO ] [REMOTE ] VSCO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:58:57.974904] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-05. [2025-09-16T20:58:58.007453] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-16T20:58:58.602624] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-16T20:58:58.774858] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-04. [2025-09-16T20:58:59.427711] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-16T20:58:59.574950] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-03. [2025-09-16T20:59:00.374948] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-02. [2025-09-16T20:59:00.387795] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-16T20:59:01.045200] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-16T20:59:01.174862] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-05. [2025-09-16T20:59:01.974998] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-06. [2025-09-16T20:59:02.196319] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-16T20:59:02.774953] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-04. [2025-09-16T20:59:03.487242] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-16T20:59:03.525819] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-16T20:59:03.574849] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-07. [2025-09-16T20:59:03.616984] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-09-16T20:59:04.374900] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-05. [2025-09-16T20:59:05.082687] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-16T20:59:05.174890] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-03. [2025-09-16T20:59:05.257046] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-16T20:59:05.974936] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-06. [2025-09-16T20:59:06.774913] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-06. [2025-09-16T20:59:07.223803] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-16T20:59:07.574992] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-08. [2025-09-16T20:59:07.859525] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-16T20:59:08.263484] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-09-16T20:59:08.374851] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-07. [2025-09-16T20:59:08.984822] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-16T20:59:09.174908] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-04. [2025-09-16T20:59:09.974911] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-07. [2025-09-16T20:59:10.774877] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-09. [2025-09-16T20:59:10.908386] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-09-16T20:59:11.022622] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-16T20:59:11.095921] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-16T20:59:11.574915] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-08. [2025-09-16T20:59:12.164387] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-16T20:59:12.170091] [INFO ] [REMOTE ] VRE: Full fetch complete (37262 records). [2025-09-16T20:59:12.170257] [DEBUG] [VALIDATOR ] VRE: Validating primary data. [2025-09-16T20:59:12.380089] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-08. [2025-09-16T20:59:12.565154] [DEBUG] [VALIDATOR ] VRE: All expected trading days are present. [2025-09-16T20:59:12.565252] [DEBUG] [VALIDATOR ] VRE: Primary data validation passed. [2025-09-16T20:59:12.566133] [INFO ] [MAIN ] VRE: Fetched primary data is valid. [2025-09-16T20:59:12.566180] [DEBUG] [LOCAL ] VRE: Saving primary data. [2025-09-16T20:59:12.567294] [DEBUG] [LOCAL ] VRE: Trimmed 37262 records to 25937 (keeping 150 days of data) [2025-09-16T20:59:12.729770] [DEBUG] [LOCAL ] VRE: Primary data saved (25937 records). [2025-09-16T20:59:12.729918] [INFO ] [MAIN ] VRE: Full history saved. [2025-09-16T20:59:12.730029] [INFO ] [MAIN ] Update Progress: 2249/2369 symbols completed. VRE took 26.4s. Estimated remaining: 12m 46s. Rate: 9.4 symbols/min [2025-09-16T20:59:12.910793] [INFO ] [MAIN ] VSH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:59:12.946879] [DEBUG] [LOCAL ] VSH: Loaded 35598 existing records from primary storage. [2025-09-16T20:59:12.947050] [INFO ] [MAIN ] VSH: Loaded 35598 existing records. [2025-09-16T20:59:13.166952] [WARN ] [MAIN ] VSH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:59:13.167358] [INFO ] [MAIN ] VSH: Wiping existing primary data before full refresh. [2025-09-16T20:59:13.167461] [INFO ] [LOCAL ] VSH: Starting deletion of primary data. [2025-09-16T20:59:13.173472] [DEBUG] [LOCAL ] VSH: Deleted primary data file. [2025-09-16T20:59:13.174054] [INFO ] [MAIN ] VSH: Starting full primary refresh. [2025-09-16T20:59:13.179457] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-05. [2025-09-16T20:59:13.174282] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-16T20:59:13.540102] [INFO ] [REMOTE ] VSH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:59:13.872937] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-16T20:59:13.974905] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-09. [2025-09-16T20:59:14.674420] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-16T20:59:14.675866] [INFO ] [REMOTE ] VRTS: Full fetch complete (9512 records). [2025-09-16T20:59:14.675934] [DEBUG] [VALIDATOR ] VRTS: Validating primary data. [2025-09-16T20:59:14.780176] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-09. [2025-09-16T20:59:15.067380] [DEBUG] [VALIDATOR ] VRTS: All expected trading days are present. [2025-09-16T20:59:15.067542] [DEBUG] [VALIDATOR ] VRTS: Primary data validation passed. [2025-09-16T20:59:15.067800] [INFO ] [MAIN ] VRTS: Fetched primary data is valid. [2025-09-16T20:59:15.067854] [DEBUG] [LOCAL ] VRTS: Saving primary data. [2025-09-16T20:59:15.068395] [DEBUG] [LOCAL ] VRTS: Trimmed 9512 records to 7362 (keeping 150 days of data) [2025-09-16T20:59:15.141364] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-16T20:59:15.162778] [DEBUG] [LOCAL ] VRTS: Primary data saved (7362 records). [2025-09-16T20:59:15.162892] [INFO ] [MAIN ] VRTS: Full history saved. [2025-09-16T20:59:15.162981] [INFO ] [MAIN ] Update Progress: 2250/2369 symbols completed. VRTS took 19.1s. Estimated remaining: 12m 39s. Rate: 9.4 symbols/min [2025-09-16T20:59:15.335825] [INFO ] [MAIN ] VST: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:59:15.378479] [DEBUG] [LOCAL ] VST: Loaded 39685 existing records from primary storage. [2025-09-16T20:59:15.378619] [INFO ] [MAIN ] VST: Loaded 39685 existing records. [2025-09-16T20:59:15.554457] [WARN ] [MAIN ] VST: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:59:15.555378] [INFO ] [MAIN ] VST: Wiping existing primary data before full refresh. [2025-09-16T20:59:15.555479] [INFO ] [LOCAL ] VST: Starting deletion of primary data. [2025-09-16T20:59:15.556391] [DEBUG] [LOCAL ] VST: Deleted primary data file. [2025-09-16T20:59:15.556505] [INFO ] [MAIN ] VST: Starting full primary refresh. [2025-09-16T20:59:15.579967] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-02. [2025-09-16T20:59:15.668139] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-16T20:59:15.693825] [INFO ] [REMOTE ] VRT: Full fetch complete (58043 records). [2025-09-16T20:59:15.709331] [DEBUG] [VALIDATOR ] VRT: Validating primary data. [2025-09-16T20:59:15.731199] [FATAL] [VALIDATOR ] VRT: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T20:59:15.749144] [FATAL] [MAIN ] VRT: Fetched primary data is invalid. Refusing to save it. [2025-09-16T20:59:15.764592] [WARN ] [MAIN ] VRT: Deleting existing primary and derivative data due to validation failure. [2025-09-16T20:59:15.801946] [INFO ] [LOCAL ] VRT: Starting deletion of primary data. [2025-09-16T20:59:15.814503] [DEBUG] [LOCAL ] VRT: No primary data file found to delete. [2025-09-16T20:59:15.827871] [INFO ] [LOCAL ] VRT: Starting deletion of derivative data. [2025-09-16T20:59:15.865698] [DEBUG] [LOCAL ] VRT: Deleted derivative data file. [2025-09-16T20:59:15.877148] [INFO ] [MAIN ] Update Progress: 2251/2369 symbols completed. VRT took 26.2s. Estimated remaining: 12m 32s. Rate: 9.4 symbols/min [2025-09-16T20:59:16.100269] [INFO ] [REMOTE ] VST: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:59:16.152919] [INFO ] [MAIN ] VSTS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:59:16.192243] [DEBUG] [LOCAL ] VSTS: Loaded 36017 existing records from primary storage. [2025-09-16T20:59:16.192387] [INFO ] [MAIN ] VSTS: Loaded 36017 existing records. [2025-09-16T20:59:16.371341] [WARN ] [MAIN ] VSTS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:59:16.371665] [INFO ] [MAIN ] VSTS: Wiping existing primary data before full refresh. [2025-09-16T20:59:16.371751] [INFO ] [LOCAL ] VSTS: Starting deletion of primary data. [2025-09-16T20:59:16.372448] [DEBUG] [LOCAL ] VSTS: Deleted primary data file. [2025-09-16T20:59:16.372501] [INFO ] [MAIN ] VSTS: Starting full primary refresh. [2025-09-16T20:59:16.384504] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-02. [2025-09-16T20:59:16.741421] [INFO ] [REMOTE ] VSTS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:59:17.130181] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-16T20:59:17.174864] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-02. [2025-09-16T20:59:17.974894] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-06. [2025-09-16T20:59:18.774964] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-03. [2025-09-16T20:59:18.776523] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-16T20:59:19.159805] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-02 (2.78 seconds). [2025-09-16T20:59:19.472265] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-16T20:59:19.574848] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-07. [2025-09-16T20:59:20.374933] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-03. [2025-09-16T20:59:20.648111] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-16T20:59:21.174915] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-04. [2025-09-16T20:59:21.281731] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-16T20:59:21.974932] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-03. [2025-09-16T20:59:22.117199] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-16T20:59:22.774866] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-04. [2025-09-16T20:59:22.823197] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-16T20:59:23.574950] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-05. [2025-09-16T20:59:24.374962] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-08. [2025-09-16T20:59:24.543283] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-16T20:59:24.673469] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-03 (2.70 seconds). [2025-09-16T20:59:24.861332] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-16T20:59:25.174906] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-04. [2025-09-16T20:59:25.974914] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-05. [2025-09-16T20:59:26.281994] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-16T20:59:26.774901] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-09. [2025-09-16T20:59:27.574930] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-06. [2025-09-16T20:59:27.727499] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-16T20:59:27.831999] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-04 (2.66 seconds). [2025-09-16T20:59:28.010074] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-16T20:59:28.017241] [INFO ] [REMOTE ] VSCO: Full fetch complete (57448 records). [2025-09-16T20:59:28.017390] [DEBUG] [VALIDATOR ] VSCO: Validating primary data. [2025-09-16T20:59:28.385813] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-06. [2025-09-16T20:59:28.405426] [DEBUG] [VALIDATOR ] VSCO: All expected trading days are present. [2025-09-16T20:59:28.405521] [DEBUG] [VALIDATOR ] VSCO: Primary data validation passed. [2025-09-16T20:59:28.406502] [INFO ] [MAIN ] VSCO: Fetched primary data is valid. [2025-09-16T20:59:28.406549] [DEBUG] [LOCAL ] VSCO: Saving primary data. [2025-09-16T20:59:28.407800] [DEBUG] [LOCAL ] VSCO: Trimmed 57448 records to 39303 (keeping 150 days of data) [2025-09-16T20:59:28.656678] [DEBUG] [LOCAL ] VSCO: Primary data saved (39303 records). [2025-09-16T20:59:28.656853] [INFO ] [MAIN ] VSCO: Full history saved. [2025-09-16T20:59:28.658237] [INFO ] [MAIN ] Update Progress: 2252/2369 symbols completed. VSCO took 32.4s. Estimated remaining: 12m 26s. Rate: 9.4 symbols/min [2025-09-16T20:59:28.837033] [INFO ] [MAIN ] VTEX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:59:28.872338] [DEBUG] [LOCAL ] VTEX: Loaded 31992 existing records from primary storage. [2025-09-16T20:59:28.872576] [INFO ] [MAIN ] VTEX: Loaded 31992 existing records. [2025-09-16T20:59:29.076875] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-16T20:59:29.080921] [WARN ] [MAIN ] VTEX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:59:29.090715] [INFO ] [MAIN ] VTEX: Wiping existing primary data before full refresh. [2025-09-16T20:59:29.090772] [INFO ] [LOCAL ] VTEX: Starting deletion of primary data. [2025-09-16T20:59:29.091415] [DEBUG] [LOCAL ] VTEX: Deleted primary data file. [2025-09-16T20:59:29.091469] [INFO ] [MAIN ] VTEX: Starting full primary refresh. [2025-09-16T20:59:29.182130] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-07. [2025-09-16T20:59:29.449830] [INFO ] [REMOTE ] VTEX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:59:29.974914] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-02. [2025-09-16T20:59:30.106546] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-16T20:59:30.646581] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-16T20:59:30.774888] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-07. [2025-09-16T20:59:31.535797] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-16T20:59:31.574846] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-03. [2025-09-16T20:59:32.374936] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-05. [2025-09-16T20:59:32.500831] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-16T20:59:32.696046] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-16T20:59:33.174893] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-04. [2025-09-16T20:59:33.974900] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-08. [2025-09-16T20:59:34.692498] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-16T20:59:34.774866] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-05. [2025-09-16T20:59:34.855966] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-09-16T20:59:35.292407] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-16T20:59:35.574909] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-08. [2025-09-16T20:59:36.110284] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-16T20:59:36.374958] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-09. [2025-09-16T20:59:37.148693] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-16T20:59:37.174849] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-09. [2025-09-16T20:59:37.790474] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-16T20:59:37.796054] [INFO ] [REMOTE ] VSH: Full fetch complete (53273 records). [2025-09-16T20:59:37.796167] [DEBUG] [VALIDATOR ] VSH: Validating primary data. [2025-09-16T20:59:37.986455] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-06. [2025-09-16T20:59:38.251395] [DEBUG] [VALIDATOR ] VSH: All expected trading days are present. [2025-09-16T20:59:38.251521] [DEBUG] [VALIDATOR ] VSH: Primary data validation passed. [2025-09-16T20:59:38.253020] [INFO ] [MAIN ] VSH: Fetched primary data is valid. [2025-09-16T20:59:38.253097] [DEBUG] [LOCAL ] VSH: Saving primary data. [2025-09-16T20:59:38.254950] [DEBUG] [LOCAL ] VSH: Trimmed 53273 records to 35897 (keeping 150 days of data) [2025-09-16T20:59:38.607784] [DEBUG] [LOCAL ] VSH: Primary data saved (35897 records). [2025-09-16T20:59:38.607992] [INFO ] [MAIN ] VSH: Full history saved. [2025-09-16T20:59:38.608121] [INFO ] [MAIN ] Update Progress: 2253/2369 symbols completed. VSH took 25.9s. Estimated remaining: 12m 20s. Rate: 9.4 symbols/min [2025-09-16T20:59:38.777215] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-06. [2025-09-16T20:59:38.868390] [INFO ] [MAIN ] VTLE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:59:38.894061] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-16T20:59:38.901110] [INFO ] [REMOTE ] VSTS: Full fetch complete (52665 records). [2025-09-16T20:59:38.901352] [DEBUG] [VALIDATOR ] VSTS: Validating primary data. [2025-09-16T20:59:39.114189] [DEBUG] [LOCAL ] VTLE: Loaded 35762 existing records from primary storage. [2025-09-16T20:59:39.130292] [INFO ] [MAIN ] VTLE: Loaded 35762 existing records. [2025-09-16T20:59:39.555638] [WARN ] [MAIN ] VTLE: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:59:39.571606] [INFO ] [MAIN ] VTLE: Wiping existing primary data before full refresh. [2025-09-16T20:59:39.592101] [INFO ] [LOCAL ] VTLE: Starting deletion of primary data. [2025-09-16T20:59:39.605044] [DEBUG] [VALIDATOR ] VSTS: All expected trading days are present. [2025-09-16T20:59:39.605104] [DEBUG] [VALIDATOR ] VSTS: Primary data validation passed. [2025-09-16T20:59:39.606112] [INFO ] [MAIN ] VSTS: Fetched primary data is valid. [2025-09-16T20:59:39.606145] [DEBUG] [LOCAL ] VTLE: Deleted primary data file. [2025-09-16T20:59:39.606244] [INFO ] [MAIN ] VTLE: Starting full primary refresh. [2025-09-16T20:59:39.606272] [DEBUG] [LOCAL ] VSTS: Saving primary data. [2025-09-16T20:59:39.725224] [DEBUG] [LOCAL ] VSTS: Trimmed 52665 records to 36350 (keeping 150 days of data) [2025-09-16T20:59:40.079741] [INFO ] [REMOTE ] VTLE: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:59:40.082046] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-02. [2025-09-16T20:59:40.184743] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-16T20:59:40.241780] [DEBUG] [LOCAL ] VSTS: Primary data saved (36350 records). [2025-09-16T20:59:40.241972] [INFO ] [MAIN ] VSTS: Full history saved. [2025-09-16T20:59:40.242077] [INFO ] [MAIN ] Update Progress: 2254/2369 symbols completed. VSTS took 24.4s. Estimated remaining: 12m 14s. Rate: 9.4 symbols/min [2025-09-16T20:59:40.384536] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-07. [2025-09-16T20:59:40.417468] [INFO ] [MAIN ] VTMX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:59:40.431948] [DEBUG] [LOCAL ] VTMX: Loaded 12979 existing records from primary storage. [2025-09-16T20:59:40.432161] [INFO ] [MAIN ] VTMX: Loaded 12979 existing records. [2025-09-16T20:59:40.609167] [WARN ] [MAIN ] VTMX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:59:40.609482] [INFO ] [MAIN ] VTMX: Wiping existing primary data before full refresh. [2025-09-16T20:59:40.609583] [INFO ] [LOCAL ] VTMX: Starting deletion of primary data. [2025-09-16T20:59:40.610005] [DEBUG] [LOCAL ] VTMX: Deleted primary data file. [2025-09-16T20:59:40.610227] [INFO ] [MAIN ] VTMX: Starting full primary refresh. [2025-09-16T20:59:40.744750] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-06 (2.76 seconds). [2025-09-16T20:59:41.027065] [INFO ] [REMOTE ] VTMX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:59:41.174882] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-02. [2025-09-16T20:59:41.667928] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-16T20:59:41.945571] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-16T20:59:41.974858] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-08. [2025-09-16T20:59:42.318454] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-16T20:59:42.774930] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-03. [2025-09-16T20:59:43.370311] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-16T20:59:43.574921] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-07. [2025-09-16T20:59:44.374913] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-03. [2025-09-16T20:59:44.629366] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-16T20:59:45.174913] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-04. [2025-09-16T20:59:45.430415] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-16T20:59:45.974941] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-04. [2025-09-16T20:59:46.115226] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-09-16T20:59:46.774927] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-09. [2025-09-16T20:59:47.043426] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-16T20:59:47.112735] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-16T20:59:47.574904] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-05. [2025-09-16T20:59:48.222180] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-16T20:59:48.227844] [INFO ] [REMOTE ] VTEX: Full fetch complete (46867 records). [2025-09-16T20:59:48.227981] [DEBUG] [VALIDATOR ] VTEX: Validating primary data. [2025-09-16T20:59:48.379140] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-08. [2025-09-16T20:59:48.541147] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-16T20:59:48.638784] [DEBUG] [VALIDATOR ] VTEX: All expected trading days are present. [2025-09-16T20:59:48.638892] [DEBUG] [VALIDATOR ] VTEX: Primary data validation passed. [2025-09-16T20:59:48.639935] [INFO ] [MAIN ] VTEX: Fetched primary data is valid. [2025-09-16T20:59:48.640015] [DEBUG] [LOCAL ] VTEX: Saving primary data. [2025-09-16T20:59:48.641818] [DEBUG] [LOCAL ] VTEX: Trimmed 46867 records to 32273 (keeping 150 days of data) [2025-09-16T20:59:48.832075] [DEBUG] [LOCAL ] VTEX: Primary data saved (32273 records). [2025-09-16T20:59:48.832229] [INFO ] [MAIN ] VTEX: Full history saved. [2025-09-16T20:59:48.833070] [INFO ] [MAIN ] Update Progress: 2255/2369 symbols completed. VTEX took 20.2s. Estimated remaining: 12m 7s. Rate: 9.4 symbols/min [2025-09-16T20:59:49.006966] [INFO ] [MAIN ] VTN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:59:49.015027] [DEBUG] [LOCAL ] VTN: Loaded 5048 existing records from primary storage. [2025-09-16T20:59:49.015158] [INFO ] [MAIN ] VTN: Loaded 5048 existing records. [2025-09-16T20:59:49.174896] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-06. [2025-09-16T20:59:49.194077] [WARN ] [MAIN ] VTN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:59:49.194327] [INFO ] [MAIN ] VTN: Wiping existing primary data before full refresh. [2025-09-16T20:59:49.194377] [INFO ] [LOCAL ] VTN: Starting deletion of primary data. [2025-09-16T20:59:49.194586] [DEBUG] [LOCAL ] VTN: Deleted primary data file. [2025-09-16T20:59:49.194630] [INFO ] [MAIN ] VTN: Starting full primary refresh. [2025-09-16T20:59:49.550382] [INFO ] [REMOTE ] VTN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:59:49.974916] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-02. [2025-09-16T20:59:50.385232] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-16T20:59:50.774911] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-07. [2025-09-16T20:59:51.041495] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-16T20:59:51.043043] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-08 (2.66 seconds). [2025-09-16T20:59:51.510183] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-16T20:59:51.574864] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-08. [2025-09-16T20:59:52.291969] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-16T20:59:52.374914] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-09. [2025-09-16T20:59:53.174933] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-03. [2025-09-16T20:59:53.185523] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-16T20:59:53.187404] [INFO ] [REMOTE ] VTMX: Full fetch complete (18986 records). [2025-09-16T20:59:53.187494] [DEBUG] [VALIDATOR ] VTMX: Validating primary data. [2025-09-16T20:59:53.562322] [DEBUG] [VALIDATOR ] VTMX: All expected trading days are present. [2025-09-16T20:59:53.562409] [DEBUG] [VALIDATOR ] VTMX: Primary data validation passed. [2025-09-16T20:59:53.562888] [INFO ] [MAIN ] VTMX: Fetched primary data is valid. [2025-09-16T20:59:53.562942] [DEBUG] [LOCAL ] VTMX: Saving primary data. [2025-09-16T20:59:53.563669] [DEBUG] [LOCAL ] VTMX: Trimmed 18986 records to 13067 (keeping 150 days of data) [2025-09-16T20:59:53.647632] [DEBUG] [LOCAL ] VTMX: Primary data saved (13067 records). [2025-09-16T20:59:53.647833] [INFO ] [MAIN ] VTMX: Full history saved. [2025-09-16T20:59:53.647954] [INFO ] [MAIN ] Update Progress: 2256/2369 symbols completed. VTMX took 13.4s. Estimated remaining: 12m 1s. Rate: 9.4 symbols/min [2025-09-16T20:59:53.832311] [INFO ] [MAIN ] VTOL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T20:59:53.847754] [DEBUG] [LOCAL ] VTOL: Loaded 14584 existing records from primary storage. [2025-09-16T20:59:53.847888] [INFO ] [MAIN ] VTOL: Loaded 14584 existing records. [2025-09-16T20:59:53.976449] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-05. [2025-09-16T20:59:54.040814] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-16T20:59:54.049526] [WARN ] [MAIN ] VTOL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T20:59:54.050738] [INFO ] [MAIN ] VTOL: Wiping existing primary data before full refresh. [2025-09-16T20:59:54.050798] [INFO ] [LOCAL ] VTOL: Starting deletion of primary data. [2025-09-16T20:59:54.051198] [DEBUG] [LOCAL ] VTOL: Deleted primary data file. [2025-09-16T20:59:54.051244] [INFO ] [MAIN ] VTOL: Starting full primary refresh. [2025-09-16T20:59:54.409983] [INFO ] [REMOTE ] VTOL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T20:59:54.774923] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-04. [2025-09-16T20:59:55.429010] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-16T20:59:55.574895] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-05. [2025-09-16T20:59:55.798726] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-16T20:59:56.261117] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-16T20:59:56.374922] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-06. [2025-09-16T20:59:57.174893] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-02. [2025-09-16T20:59:57.974945] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-06. [2025-09-16T20:59:58.164881] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-16T20:59:58.213325] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-16T20:59:58.597065] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-16T20:59:58.774868] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-07. [2025-09-16T20:59:59.574907] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-03. [2025-09-16T20:59:59.605098] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-16T21:00:00.374955] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-08. [2025-09-16T21:00:00.741072] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-16T21:00:01.174904] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-09. [2025-09-16T21:00:01.344366] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-16T21:00:01.974933] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-09. [2025-09-16T21:00:02.358250] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-16T21:00:02.364788] [INFO ] [REMOTE ] VST: Full fetch complete (58013 records). [2025-09-16T21:00:02.364987] [DEBUG] [VALIDATOR ] VST: Validating primary data. [2025-09-16T21:00:02.366019] [FATAL] [VALIDATOR ] VST: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T21:00:02.366132] [FATAL] [MAIN ] VST: Fetched primary data is invalid. Refusing to save it. [2025-09-16T21:00:02.366177] [WARN ] [MAIN ] VST: Deleting existing primary and derivative data due to validation failure. [2025-09-16T21:00:02.366226] [INFO ] [LOCAL ] VST: Starting deletion of primary data. [2025-09-16T21:00:02.366288] [DEBUG] [LOCAL ] VST: No primary data file found to delete. [2025-09-16T21:00:02.366338] [INFO ] [LOCAL ] VST: Starting deletion of derivative data. [2025-09-16T21:00:02.366667] [DEBUG] [LOCAL ] VST: Deleted derivative data file. [2025-09-16T21:00:02.368165] [INFO ] [MAIN ] Update Progress: 2257/2369 symbols completed. VST took 47.2s. Estimated remaining: 11m 55s. Rate: 9.4 symbols/min [2025-09-16T21:00:02.551912] [INFO ] [MAIN ] VTR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:00:02.596302] [DEBUG] [LOCAL ] VTR: Loaded 38933 existing records from primary storage. [2025-09-16T21:00:02.596460] [INFO ] [MAIN ] VTR: Loaded 38933 existing records. [2025-09-16T21:00:02.781701] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-04. [2025-09-16T21:00:02.787939] [WARN ] [MAIN ] VTR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:00:02.789271] [INFO ] [MAIN ] VTR: Wiping existing primary data before full refresh. [2025-09-16T21:00:02.789341] [INFO ] [LOCAL ] VTR: Starting deletion of primary data. [2025-09-16T21:00:02.790483] [DEBUG] [LOCAL ] VTR: Deleted primary data file. [2025-09-16T21:00:02.790545] [INFO ] [MAIN ] VTR: Starting full primary refresh. [2025-09-16T21:00:03.173259] [INFO ] [REMOTE ] VTR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:00:03.574961] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-07. [2025-09-16T21:00:04.374954] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-02. [2025-09-16T21:00:04.711870] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-09 (2.74 seconds). [2025-09-16T21:00:04.713621] [INFO ] [REMOTE ] VTN: Full fetch complete (7705 records). [2025-09-16T21:00:04.713743] [DEBUG] [VALIDATOR ] VTN: Validating primary data. [2025-09-16T21:00:05.091194] [DEBUG] [VALIDATOR ] VTN: All expected trading days are present. [2025-09-16T21:00:05.091276] [DEBUG] [VALIDATOR ] VTN: Primary data validation passed. [2025-09-16T21:00:05.091481] [INFO ] [MAIN ] VTN: Fetched primary data is valid. [2025-09-16T21:00:05.091522] [DEBUG] [LOCAL ] VTN: Saving primary data. [2025-09-16T21:00:05.091977] [DEBUG] [LOCAL ] VTN: Trimmed 7705 records to 5082 (keeping 150 days of data) [2025-09-16T21:00:05.128910] [DEBUG] [LOCAL ] VTN: Primary data saved (5082 records). [2025-09-16T21:00:05.129077] [INFO ] [MAIN ] VTN: Full history saved. [2025-09-16T21:00:05.129187] [INFO ] [MAIN ] Update Progress: 2258/2369 symbols completed. VTN took 16.3s. Estimated remaining: 11m 48s. Rate: 9.4 symbols/min [2025-09-16T21:00:05.309349] [INFO ] [MAIN ] VTS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:00:05.334154] [DEBUG] [LOCAL ] VTS: Loaded 21587 existing records from primary storage. [2025-09-16T21:00:05.334342] [INFO ] [MAIN ] VTS: Loaded 21587 existing records. [2025-09-16T21:00:05.512303] [WARN ] [MAIN ] VTS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:00:05.512574] [INFO ] [MAIN ] VTS: Wiping existing primary data before full refresh. [2025-09-16T21:00:05.512625] [INFO ] [LOCAL ] VTS: Starting deletion of primary data. [2025-09-16T21:00:05.513331] [DEBUG] [LOCAL ] VTS: Deleted primary data file. [2025-09-16T21:00:05.513379] [INFO ] [MAIN ] VTS: Starting full primary refresh. [2025-09-16T21:00:05.883230] [INFO ] [REMOTE ] VTS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:00:05.883580] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-02. [2025-09-16T21:00:06.102765] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-04 (3.32 seconds). [2025-09-16T21:00:06.108139] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-05. [2025-09-16T21:00:06.882003] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-07 (3.31 seconds). [2025-09-16T21:00:06.892784] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-08. [2025-09-16T21:00:07.239175] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-16T21:00:07.340288] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-02 (2.97 seconds). [2025-09-16T21:00:07.381198] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-16T21:00:07.574904] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-06. [2025-09-16T21:00:08.374923] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-03. [2025-09-16T21:00:08.793512] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-16T21:00:08.851952] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-16T21:00:09.174946] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-09. [2025-09-16T21:00:09.974936] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-03. [2025-09-16T21:00:10.270695] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-16T21:00:10.525297] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-16T21:00:10.530785] [INFO ] [REMOTE ] VTLE: Full fetch complete (52671 records). [2025-09-16T21:00:10.530886] [DEBUG] [VALIDATOR ] VTLE: Validating primary data. [2025-09-16T21:00:10.782551] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-04. [2025-09-16T21:00:10.914487] [DEBUG] [VALIDATOR ] VTLE: All expected trading days are present. [2025-09-16T21:00:10.914577] [DEBUG] [VALIDATOR ] VTLE: Primary data validation passed. [2025-09-16T21:00:10.915598] [INFO ] [MAIN ] VTLE: Fetched primary data is valid. [2025-09-16T21:00:10.915668] [DEBUG] [LOCAL ] VTLE: Saving primary data. [2025-09-16T21:00:10.916881] [DEBUG] [LOCAL ] VTLE: Trimmed 52671 records to 36084 (keeping 150 days of data) [2025-09-16T21:00:11.152881] [DEBUG] [LOCAL ] VTLE: Primary data saved (36084 records). [2025-09-16T21:00:11.153073] [INFO ] [MAIN ] VTLE: Full history saved. [2025-09-16T21:00:11.153222] [INFO ] [MAIN ] Update Progress: 2259/2369 symbols completed. VTLE took 32.5s. Estimated remaining: 11m 42s. Rate: 9.4 symbols/min [2025-09-16T21:00:11.328821] [INFO ] [MAIN ] VVR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:00:11.349940] [DEBUG] [LOCAL ] VVR: Loaded 21357 existing records from primary storage. [2025-09-16T21:00:11.350091] [INFO ] [MAIN ] VVR: Loaded 21357 existing records. [2025-09-16T21:00:11.573140] [WARN ] [MAIN ] VVR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:00:11.573628] [INFO ] [MAIN ] VVR: Wiping existing primary data before full refresh. [2025-09-16T21:00:11.573711] [INFO ] [LOCAL ] VVR: Starting deletion of primary data. [2025-09-16T21:00:11.574561] [DEBUG] [LOCAL ] VVR: Deleted primary data file. [2025-09-16T21:00:11.574679] [INFO ] [MAIN ] VVR: Starting full primary refresh. [2025-09-16T21:00:11.588860] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-07. [2025-09-16T21:00:11.680076] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-16T21:00:11.970962] [INFO ] [REMOTE ] VVR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:00:12.374940] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-02. [2025-09-16T21:00:12.715298] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-16T21:00:12.756075] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-16T21:00:13.174907] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-08. [2025-09-16T21:00:13.979993] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-04. [2025-09-16T21:00:13.990582] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-16T21:00:14.495177] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-16T21:00:14.774895] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-03. [2025-09-16T21:00:15.574900] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-05. [2025-09-16T21:00:16.060059] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-16T21:00:16.374871] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-09. [2025-09-16T21:00:16.833114] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-16T21:00:17.174903] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-05. [2025-09-16T21:00:17.345871] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-16T21:00:17.348535] [INFO ] [REMOTE ] VTOL: Full fetch complete (21236 records). [2025-09-16T21:00:17.348626] [DEBUG] [VALIDATOR ] VTOL: Validating primary data. [2025-09-16T21:00:17.742129] [DEBUG] [VALIDATOR ] VTOL: All expected trading days are present. [2025-09-16T21:00:17.742230] [DEBUG] [VALIDATOR ] VTOL: Primary data validation passed. [2025-09-16T21:00:17.742787] [INFO ] [MAIN ] VTOL: Fetched primary data is valid. [2025-09-16T21:00:17.742836] [DEBUG] [LOCAL ] VTOL: Saving primary data. [2025-09-16T21:00:17.743468] [DEBUG] [LOCAL ] VTOL: Trimmed 21236 records to 14677 (keeping 150 days of data) [2025-09-16T21:00:17.838782] [DEBUG] [LOCAL ] VTOL: Primary data saved (14677 records). [2025-09-16T21:00:17.839024] [INFO ] [MAIN ] VTOL: Full history saved. [2025-09-16T21:00:17.839189] [INFO ] [MAIN ] Update Progress: 2260/2369 symbols completed. VTOL took 24.2s. Estimated remaining: 11m 35s. Rate: 9.4 symbols/min [2025-09-16T21:00:17.992470] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-04. [2025-09-16T21:00:18.016927] [INFO ] [MAIN ] VVV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:00:18.050807] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-09-16T21:00:18.092426] [DEBUG] [LOCAL ] VVV: Loaded 37152 existing records from primary storage. [2025-09-16T21:00:18.092570] [INFO ] [MAIN ] VVV: Loaded 37152 existing records. [2025-09-16T21:00:18.269704] [WARN ] [MAIN ] VVV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:00:18.269971] [INFO ] [MAIN ] VVV: Wiping existing primary data before full refresh. [2025-09-16T21:00:18.270028] [INFO ] [LOCAL ] VVV: Starting deletion of primary data. [2025-09-16T21:00:18.270735] [DEBUG] [LOCAL ] VVV: Deleted primary data file. [2025-09-16T21:00:18.270785] [INFO ] [MAIN ] VVV: Starting full primary refresh. [2025-09-16T21:00:18.658659] [INFO ] [REMOTE ] VVV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:00:18.660391] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-16T21:00:18.774872] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-06. [2025-09-16T21:00:19.445964] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-16T21:00:19.574932] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-05. [2025-09-16T21:00:20.238082] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-16T21:00:20.374913] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-07. [2025-09-16T21:00:20.496397] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-16T21:00:21.174904] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-02. [2025-09-16T21:00:21.696043] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-16T21:00:21.974902] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-08. [2025-09-16T21:00:22.774906] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-06. [2025-09-16T21:00:22.835741] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-16T21:00:22.972676] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-16T21:00:23.574901] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-03. [2025-09-16T21:00:24.236826] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-16T21:00:24.374902] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-09. [2025-09-16T21:00:25.174897] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-07. [2025-09-16T21:00:25.352405] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-16T21:00:25.723141] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-16T21:00:25.727514] [INFO ] [REMOTE ] VTS: Full fetch complete (31972 records). [2025-09-16T21:00:25.727610] [DEBUG] [VALIDATOR ] VTS: Validating primary data. [2025-09-16T21:00:25.983240] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-04. [2025-09-16T21:00:26.119518] [DEBUG] [VALIDATOR ] VTS: All expected trading days are present. [2025-09-16T21:00:26.119610] [DEBUG] [VALIDATOR ] VTS: Primary data validation passed. [2025-09-16T21:00:26.120386] [INFO ] [MAIN ] VTS: Fetched primary data is valid. [2025-09-16T21:00:26.120458] [DEBUG] [LOCAL ] VTS: Saving primary data. [2025-09-16T21:00:26.121968] [DEBUG] [LOCAL ] VTS: Trimmed 31972 records to 21848 (keeping 150 days of data) [2025-09-16T21:00:26.264750] [DEBUG] [LOCAL ] VTS: Primary data saved (21848 records). [2025-09-16T21:00:26.264879] [INFO ] [MAIN ] VTS: Full history saved. [2025-09-16T21:00:26.265008] [INFO ] [MAIN ] Update Progress: 2261/2369 symbols completed. VTS took 21.1s. Estimated remaining: 11m 29s. Rate: 9.4 symbols/min [2025-09-16T21:00:26.435393] [INFO ] [MAIN ] VVX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:00:26.456213] [DEBUG] [LOCAL ] VVX: Loaded 17093 existing records from primary storage. [2025-09-16T21:00:26.456337] [INFO ] [MAIN ] VVX: Loaded 17093 existing records. [2025-09-16T21:00:26.631720] [WARN ] [MAIN ] VVX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:00:26.631963] [INFO ] [MAIN ] VVX: Wiping existing primary data before full refresh. [2025-09-16T21:00:26.632009] [INFO ] [LOCAL ] VVX: Starting deletion of primary data. [2025-09-16T21:00:26.632492] [DEBUG] [LOCAL ] VVX: Deleted primary data file. [2025-09-16T21:00:26.632554] [INFO ] [MAIN ] VVX: Starting full primary refresh. [2025-09-16T21:00:26.782629] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-06. [2025-09-16T21:00:27.004842] [INFO ] [REMOTE ] VVX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:00:27.574932] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-02. [2025-09-16T21:00:27.632166] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-09-16T21:00:28.011508] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-16T21:00:28.249410] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-16T21:00:28.374897] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-07. [2025-09-16T21:00:28.462632] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-16T21:00:29.174899] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-08. [2025-09-16T21:00:29.361415] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-16T21:00:29.974910] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-05. [2025-09-16T21:00:30.774905] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-08. [2025-09-16T21:00:31.019146] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-16T21:00:31.574913] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-03. [2025-09-16T21:00:31.798589] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-16T21:00:31.855881] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-16T21:00:32.374908] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-06. [2025-09-16T21:00:32.514132] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-16T21:00:33.174918] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-09. [2025-09-16T21:00:33.974861] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-04. [2025-09-16T21:00:34.079579] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-16T21:00:34.699279] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-16T21:00:34.705615] [INFO ] [REMOTE ] VTR: Full fetch complete (57461 records). [2025-09-16T21:00:34.705759] [DEBUG] [VALIDATOR ] VTR: Validating primary data. [2025-09-16T21:00:34.774966] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-09. [2025-09-16T21:00:35.045210] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-16T21:00:35.120551] [DEBUG] [VALIDATOR ] VTR: All expected trading days are present. [2025-09-16T21:00:35.120632] [DEBUG] [VALIDATOR ] VTR: Primary data validation passed. [2025-09-16T21:00:35.121650] [INFO ] [MAIN ] VTR: Fetched primary data is valid. [2025-09-16T21:00:35.121712] [DEBUG] [LOCAL ] VTR: Saving primary data. [2025-09-16T21:00:35.123079] [DEBUG] [LOCAL ] VTR: Trimmed 57461 records to 39315 (keeping 150 days of data) [2025-09-16T21:00:35.365173] [DEBUG] [LOCAL ] VTR: Primary data saved (39315 records). [2025-09-16T21:00:35.365318] [INFO ] [MAIN ] VTR: Full history saved. [2025-09-16T21:00:35.365423] [INFO ] [MAIN ] Update Progress: 2262/2369 symbols completed. VTR took 33.0s. Estimated remaining: 11m 23s. Rate: 9.4 symbols/min [2025-09-16T21:00:35.535239] [INFO ] [MAIN ] VYX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:00:35.571550] [DEBUG] [LOCAL ] VYX: Loaded 35924 existing records from primary storage. [2025-09-16T21:00:35.571706] [INFO ] [MAIN ] VYX: Loaded 35924 existing records. [2025-09-16T21:00:35.582905] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-07. [2025-09-16T21:00:35.752140] [WARN ] [MAIN ] VYX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:00:35.752378] [INFO ] [MAIN ] VYX: Wiping existing primary data before full refresh. [2025-09-16T21:00:35.752427] [INFO ] [LOCAL ] VYX: Starting deletion of primary data. [2025-09-16T21:00:35.753191] [DEBUG] [LOCAL ] VYX: Deleted primary data file. [2025-09-16T21:00:35.753239] [INFO ] [MAIN ] VYX: Starting full primary refresh. [2025-09-16T21:00:36.102176] [INFO ] [REMOTE ] VYX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:00:36.149594] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-16T21:00:36.154238] [INFO ] [REMOTE ] VVR: Full fetch complete (33303 records). [2025-09-16T21:00:36.154323] [DEBUG] [VALIDATOR ] VVR: Validating primary data. [2025-09-16T21:00:36.379995] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-02. [2025-09-16T21:00:36.541405] [DEBUG] [VALIDATOR ] VVR: All expected trading days are present. [2025-09-16T21:00:36.541487] [DEBUG] [VALIDATOR ] VVR: Primary data validation passed. [2025-09-16T21:00:36.542264] [INFO ] [MAIN ] VVR: Fetched primary data is valid. [2025-09-16T21:00:36.542310] [DEBUG] [LOCAL ] VVR: Saving primary data. [2025-09-16T21:00:36.543069] [DEBUG] [LOCAL ] VVR: Trimmed 33303 records to 21685 (keeping 150 days of data) [2025-09-16T21:00:36.681810] [DEBUG] [LOCAL ] VVR: Primary data saved (21685 records). [2025-09-16T21:00:36.681947] [INFO ] [MAIN ] VVR: Full history saved. [2025-09-16T21:00:36.682041] [INFO ] [MAIN ] Update Progress: 2263/2369 symbols completed. VVR took 25.5s. Estimated remaining: 11m 16s. Rate: 9.4 symbols/min [2025-09-16T21:00:36.854419] [INFO ] [MAIN ] VZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:00:36.854628] [DEBUG] [LOCAL ] VZ: No existing data file found in primary storage. [2025-09-16T21:00:36.854687] [WARN ] [MAIN ] VZ: No existing data found, performing full refresh instead. [2025-09-16T21:00:36.854808] [INFO ] [MAIN ] VZ: Wiping existing primary data before full refresh. [2025-09-16T21:00:36.854858] [INFO ] [LOCAL ] VZ: Starting deletion of primary data. [2025-09-16T21:00:36.854923] [DEBUG] [LOCAL ] VZ: No primary data file found to delete. [2025-09-16T21:00:36.854957] [INFO ] [MAIN ] VZ: Starting full primary refresh. [2025-09-16T21:00:37.180377] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-05. [2025-09-16T21:00:37.217912] [INFO ] [REMOTE ] VZ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:00:37.515952] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-16T21:00:37.658929] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-16T21:00:37.974901] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-08. [2025-09-16T21:00:38.534403] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-16T21:00:38.774950] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-02. [2025-09-16T21:00:39.478848] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-16T21:00:39.574879] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-09. [2025-09-16T21:00:40.374901] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-06. [2025-09-16T21:00:41.142452] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-16T21:00:41.148700] [INFO ] [REMOTE ] VVV: Full fetch complete (54421 records). [2025-09-16T21:00:41.148799] [DEBUG] [VALIDATOR ] VVV: Validating primary data. [2025-09-16T21:00:41.180956] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-03. [2025-09-16T21:00:41.394882] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-02 (2.62 seconds). [2025-09-16T21:00:41.609710] [DEBUG] [VALIDATOR ] VVV: All expected trading days are present. [2025-09-16T21:00:41.610789] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-16T21:00:41.610873] [DEBUG] [VALIDATOR ] VVV: Primary data validation passed. [2025-09-16T21:00:41.616791] [INFO ] [MAIN ] VVV: Fetched primary data is valid. [2025-09-16T21:00:41.616876] [DEBUG] [LOCAL ] VVV: Saving primary data. [2025-09-16T21:00:41.619966] [DEBUG] [LOCAL ] VVV: Trimmed 54421 records to 37484 (keeping 150 days of data) [2025-09-16T21:00:41.847220] [DEBUG] [LOCAL ] VVV: Primary data saved (37484 records). [2025-09-16T21:00:41.847371] [INFO ] [MAIN ] VVV: Full history saved. [2025-09-16T21:00:41.847477] [INFO ] [MAIN ] Update Progress: 2264/2369 symbols completed. VVV took 24.0s. Estimated remaining: 11m 10s. Rate: 9.4 symbols/min [2025-09-16T21:00:41.988498] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-07. [2025-09-16T21:00:42.021463] [INFO ] [MAIN ] W: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:00:42.063136] [DEBUG] [LOCAL ] W: Loaded 39527 existing records from primary storage. [2025-09-16T21:00:42.063323] [INFO ] [MAIN ] W: Loaded 39527 existing records. [2025-09-16T21:00:42.245766] [WARN ] [MAIN ] W: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:00:42.246116] [INFO ] [MAIN ] W: Wiping existing primary data before full refresh. [2025-09-16T21:00:42.246164] [INFO ] [LOCAL ] W: Starting deletion of primary data. [2025-09-16T21:00:42.247272] [DEBUG] [LOCAL ] W: Deleted primary data file. [2025-09-16T21:00:42.247330] [INFO ] [MAIN ] W: Starting full primary refresh. [2025-09-16T21:00:42.613910] [INFO ] [REMOTE ] W: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:00:42.774915] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-03. [2025-09-16T21:00:43.196020] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-16T21:00:43.238975] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-16T21:00:43.574938] [INFO ] [REMOTE ] W: Fetching primary data for 2025-02. [2025-09-16T21:00:44.375156] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-04. [2025-09-16T21:00:44.860555] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-16T21:00:45.174961] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-08. [2025-09-16T21:00:45.597286] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-16T21:00:45.901040] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-16T21:00:45.974861] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-05. [2025-09-16T21:00:46.779985] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-04. [2025-09-16T21:00:46.790780] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-16T21:00:47.468279] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-16T21:00:47.574866] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-06. [2025-09-16T21:00:48.374920] [INFO ] [REMOTE ] W: Fetching primary data for 2025-03. [2025-09-16T21:00:49.174979] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-09. [2025-09-16T21:00:49.266996] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-16T21:00:49.445561] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-09-16T21:00:49.974910] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-07. [2025-09-16T21:00:50.424519] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-16T21:00:50.428106] [INFO ] [REMOTE ] VVX: Full fetch complete (25524 records). [2025-09-16T21:00:50.428211] [DEBUG] [VALIDATOR ] VVX: Validating primary data. [2025-09-16T21:00:50.780146] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-05. [2025-09-16T21:00:50.868164] [DEBUG] [VALIDATOR ] VVX: All expected trading days are present. [2025-09-16T21:00:50.868302] [DEBUG] [VALIDATOR ] VVX: Primary data validation passed. [2025-09-16T21:00:50.869434] [INFO ] [MAIN ] VVX: Fetched primary data is valid. [2025-09-16T21:00:50.869522] [DEBUG] [LOCAL ] VVX: Saving primary data. [2025-09-16T21:00:50.871458] [DEBUG] [LOCAL ] VVX: Trimmed 25524 records to 17316 (keeping 150 days of data) [2025-09-16T21:00:51.037971] [DEBUG] [LOCAL ] VVX: Primary data saved (17316 records). [2025-09-16T21:00:51.038197] [INFO ] [MAIN ] VVX: Full history saved. [2025-09-16T21:00:51.038518] [INFO ] [MAIN ] Update Progress: 2265/2369 symbols completed. VVX took 24.8s. Estimated remaining: 11m 3s. Rate: 9.4 symbols/min [2025-09-16T21:00:51.259974] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-03 (2.89 seconds). [2025-09-16T21:00:51.385678] [INFO ] [MAIN ] WAB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:00:51.441351] [DEBUG] [LOCAL ] WAB: Loaded 32190 existing records from primary storage. [2025-09-16T21:00:51.441576] [INFO ] [MAIN ] WAB: Loaded 32190 existing records. [2025-09-16T21:00:51.580247] [INFO ] [REMOTE ] W: Fetching primary data for 2025-04. [2025-09-16T21:00:51.727593] [WARN ] [MAIN ] WAB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:00:51.727874] [INFO ] [MAIN ] WAB: Wiping existing primary data before full refresh. [2025-09-16T21:00:51.727925] [INFO ] [LOCAL ] WAB: Starting deletion of primary data. [2025-09-16T21:00:51.728909] [DEBUG] [LOCAL ] WAB: Deleted primary data file. [2025-09-16T21:00:51.728992] [INFO ] [MAIN ] WAB: Starting full primary refresh. [2025-09-16T21:00:52.120366] [INFO ] [REMOTE ] WAB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:00:52.374978] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-02. [2025-09-16T21:00:52.459840] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-09-16T21:00:53.174945] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-08. [2025-09-16T21:00:53.539742] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-16T21:00:53.907111] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-05 (3.13 seconds). [2025-09-16T21:00:53.974898] [INFO ] [REMOTE ] W: Fetching primary data for 2025-05. [2025-09-16T21:00:54.049605] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-16T21:00:54.642233] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-16T21:00:54.774990] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-03. [2025-09-16T21:00:55.574926] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-09. [2025-09-16T21:00:55.854953] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-16T21:00:56.374923] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-06. [2025-09-16T21:00:56.529357] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-16T21:00:56.889153] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-16T21:00:56.895552] [INFO ] [REMOTE ] VYX: Full fetch complete (53403 records). [2025-09-16T21:00:56.895720] [DEBUG] [VALIDATOR ] VYX: Validating primary data. [2025-09-16T21:00:57.180153] [INFO ] [REMOTE ] W: Fetching primary data for 2025-06. [2025-09-16T21:00:57.326342] [DEBUG] [VALIDATOR ] VYX: All expected trading days are present. [2025-09-16T21:00:57.326431] [DEBUG] [VALIDATOR ] VYX: Primary data validation passed. [2025-09-16T21:00:57.327458] [INFO ] [MAIN ] VYX: Fetched primary data is valid. [2025-09-16T21:00:57.327502] [DEBUG] [LOCAL ] VYX: Saving primary data. [2025-09-16T21:00:57.329763] [DEBUG] [LOCAL ] VYX: Trimmed 53403 records to 36254 (keeping 150 days of data) [2025-09-16T21:00:57.543297] [DEBUG] [LOCAL ] VYX: Primary data saved (36254 records). [2025-09-16T21:00:57.543434] [INFO ] [MAIN ] VYX: Full history saved. [2025-09-16T21:00:57.543519] [INFO ] [MAIN ] Update Progress: 2266/2369 symbols completed. VYX took 22.2s. Estimated remaining: 10m 57s. Rate: 9.4 symbols/min [2025-09-16T21:00:57.713956] [INFO ] [MAIN ] WAL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:00:57.744434] [DEBUG] [LOCAL ] WAL: Loaded 32797 existing records from primary storage. [2025-09-16T21:00:57.744569] [INFO ] [MAIN ] WAL: Loaded 32797 existing records. [2025-09-16T21:00:57.922532] [WARN ] [MAIN ] WAL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:00:57.922792] [INFO ] [MAIN ] WAL: Wiping existing primary data before full refresh. [2025-09-16T21:00:57.922843] [INFO ] [LOCAL ] WAL: Starting deletion of primary data. [2025-09-16T21:00:57.923573] [DEBUG] [LOCAL ] WAL: Deleted primary data file. [2025-09-16T21:00:57.923618] [INFO ] [MAIN ] WAL: Starting full primary refresh. [2025-09-16T21:00:57.987702] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-04. [2025-09-16T21:00:58.281517] [INFO ] [REMOTE ] WAL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:00:58.774967] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-02. [2025-09-16T21:00:58.844061] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-09-16T21:00:58.929256] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-16T21:00:59.574924] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-07. [2025-09-16T21:01:00.026727] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-16T21:01:00.304225] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-16T21:01:00.374921] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-05. [2025-09-16T21:01:01.174936] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-03. [2025-09-16T21:01:01.974994] [INFO ] [REMOTE ] W: Fetching primary data for 2025-07. [2025-09-16T21:01:02.254755] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-07 (2.68 seconds). [2025-09-16T21:01:02.339356] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-16T21:01:02.774901] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-06. [2025-09-16T21:01:03.360764] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-16T21:01:03.574889] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-04. [2025-09-16T21:01:04.165415] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-16T21:01:04.204312] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-16T21:01:04.374922] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-07. [2025-09-16T21:01:05.150198] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-16T21:01:05.174857] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-05. [2025-09-16T21:01:05.974906] [INFO ] [REMOTE ] W: Fetching primary data for 2025-08. [2025-09-16T21:01:06.366332] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-16T21:01:06.776207] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-08. [2025-09-16T21:01:06.778620] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-16T21:01:07.574919] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-08. [2025-09-16T21:01:08.146627] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-16T21:01:08.373138] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-16T21:01:08.381830] [INFO ] [REMOTE ] W: Fetching primary data for 2025-09. [2025-09-16T21:01:09.174926] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-09. [2025-09-16T21:01:09.952992] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-16T21:01:09.959495] [INFO ] [REMOTE ] W: Full fetch complete (58201 records). [2025-09-16T21:01:09.959675] [DEBUG] [VALIDATOR ] W: Validating primary data. [2025-09-16T21:01:09.992009] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-06. [2025-09-16T21:01:10.193169] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-09-16T21:01:10.407484] [DEBUG] [VALIDATOR ] W: All expected trading days are present. [2025-09-16T21:01:10.407574] [DEBUG] [VALIDATOR ] W: Primary data validation passed. [2025-09-16T21:01:10.408827] [INFO ] [MAIN ] W: Fetched primary data is valid. [2025-09-16T21:01:10.408884] [DEBUG] [LOCAL ] W: Saving primary data. [2025-09-16T21:01:10.410213] [DEBUG] [LOCAL ] W: Trimmed 58201 records to 39909 (keeping 150 days of data) [2025-09-16T21:01:10.651000] [DEBUG] [LOCAL ] W: Primary data saved (39909 records). [2025-09-16T21:01:10.651152] [INFO ] [MAIN ] W: Full history saved. [2025-09-16T21:01:10.651243] [INFO ] [MAIN ] Update Progress: 2267/2369 symbols completed. W took 28.8s. Estimated remaining: 10m 51s. Rate: 9.4 symbols/min [2025-09-16T21:01:10.776508] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-09. [2025-09-16T21:01:10.837562] [INFO ] [MAIN ] WAT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:01:10.855251] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-16T21:01:10.860872] [INFO ] [REMOTE ] WAB: Full fetch complete (48702 records). [2025-09-16T21:01:10.860980] [DEBUG] [VALIDATOR ] WAB: Validating primary data. [2025-09-16T21:01:11.132436] [DEBUG] [LOCAL ] WAT: Loaded 25964 existing records from primary storage. [2025-09-16T21:01:11.162396] [INFO ] [MAIN ] WAT: Loaded 25964 existing records. [2025-09-16T21:01:11.413758] [DEBUG] [VALIDATOR ] WAB: All expected trading days are present. [2025-09-16T21:01:11.446065] [DEBUG] [VALIDATOR ] WAB: Primary data validation passed. [2025-09-16T21:01:11.450525] [WARN ] [MAIN ] WAT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:01:11.451537] [INFO ] [MAIN ] WAB: Fetched primary data is valid. [2025-09-16T21:01:11.451680] [DEBUG] [LOCAL ] WAB: Saving primary data. [2025-09-16T21:01:11.451833] [INFO ] [MAIN ] WAT: Wiping existing primary data before full refresh. [2025-09-16T21:01:11.451976] [INFO ] [LOCAL ] WAT: Starting deletion of primary data. [2025-09-16T21:01:11.452637] [DEBUG] [LOCAL ] WAT: Deleted primary data file. [2025-09-16T21:01:11.452719] [INFO ] [MAIN ] WAT: Starting full primary refresh. [2025-09-16T21:01:11.484340] [DEBUG] [LOCAL ] WAB: Trimmed 48702 records to 32519 (keeping 150 days of data) [2025-09-16T21:01:11.960449] [INFO ] [REMOTE ] WAT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:01:11.962114] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-02. [2025-09-16T21:01:11.981269] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-16T21:01:11.990575] [INFO ] [REMOTE ] VZ: Full fetch complete (58081 records). [2025-09-16T21:01:11.991262] [DEBUG] [VALIDATOR ] VZ: Validating primary data. [2025-09-16T21:01:11.992677] [FATAL] [VALIDATOR ] VZ: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T21:01:11.993840] [FATAL] [MAIN ] VZ: Fetched primary data is invalid. Refusing to save it. [2025-09-16T21:01:11.996559] [WARN ] [MAIN ] VZ: Deleting existing primary and derivative data due to validation failure. [2025-09-16T21:01:12.037544] [INFO ] [LOCAL ] VZ: Starting deletion of primary data. [2025-09-16T21:01:12.057838] [DEBUG] [LOCAL ] VZ: No primary data file found to delete. [2025-09-16T21:01:12.076919] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-16T21:01:12.075568] [INFO ] [LOCAL ] VZ: Starting deletion of derivative data. [2025-09-16T21:01:12.087630] [DEBUG] [LOCAL ] VZ: No derivative data file found to delete. [2025-09-16T21:01:12.091417] [INFO ] [MAIN ] Update Progress: 2268/2369 symbols completed. VZ took 35.4s. Estimated remaining: 10m 44s. Rate: 9.4 symbols/min [2025-09-16T21:01:12.283671] [DEBUG] [LOCAL ] WAB: Primary data saved (32519 records). [2025-09-16T21:01:12.283573] [INFO ] [MAIN ] WBS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:01:12.283785] [INFO ] [MAIN ] WAB: Full history saved. [2025-09-16T21:01:12.283931] [INFO ] [MAIN ] Update Progress: 2269/2369 symbols completed. WAB took 21.2s. Estimated remaining: 10m 38s. Rate: 9.4 symbols/min [2025-09-16T21:01:12.380040] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-07. [2025-09-16T21:01:12.476761] [INFO ] [MAIN ] WBX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:01:12.495065] [DEBUG] [LOCAL ] WBX: Loaded 7468 existing records from primary storage. [2025-09-16T21:01:12.495306] [INFO ] [MAIN ] WBX: Loaded 7468 existing records. [2025-09-16T21:01:12.610401] [DEBUG] [LOCAL ] WBS: Loaded 35768 existing records from primary storage. [2025-09-16T21:01:12.616298] [INFO ] [MAIN ] WBS: Loaded 35768 existing records. [2025-09-16T21:01:12.817485] [WARN ] [MAIN ] WBX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:01:12.855667] [INFO ] [MAIN ] WBX: Wiping existing primary data before full refresh. [2025-09-16T21:01:12.856307] [INFO ] [LOCAL ] WBX: Starting deletion of primary data. [2025-09-16T21:01:12.873226] [DEBUG] [LOCAL ] WBX: Deleted primary data file. [2025-09-16T21:01:12.876280] [INFO ] [MAIN ] WBX: Starting full primary refresh. [2025-09-16T21:01:12.876393] [WARN ] [MAIN ] WBS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:01:12.943153] [INFO ] [MAIN ] WBS: Wiping existing primary data before full refresh. [2025-09-16T21:01:12.971414] [INFO ] [LOCAL ] WBS: Starting deletion of primary data. [2025-09-16T21:01:12.987838] [DEBUG] [LOCAL ] WBS: Deleted primary data file. [2025-09-16T21:01:12.998114] [INFO ] [MAIN ] WBS: Starting full primary refresh. [2025-09-16T21:01:13.535104] [INFO ] [REMOTE ] WBX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:01:13.560335] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-02. [2025-09-16T21:01:13.640322] [INFO ] [REMOTE ] WBS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:01:13.667037] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-16T21:01:13.974887] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-03. [2025-09-16T21:01:14.369778] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-16T21:01:14.531319] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-16T21:01:14.774900] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-02. [2025-09-16T21:01:15.334422] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-16T21:01:15.574904] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-03. [2025-09-16T21:01:16.105155] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-16T21:01:16.374899] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-04. [2025-09-16T21:01:16.995931] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-16T21:01:17.174910] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-04. [2025-09-16T21:01:17.645289] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-16T21:01:17.974946] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-03. [2025-09-16T21:01:18.284901] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-16T21:01:18.774902] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-05. [2025-09-16T21:01:19.574896] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-08. [2025-09-16T21:01:19.736150] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-16T21:01:20.326058] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-16T21:01:20.374920] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-04. [2025-09-16T21:01:21.084328] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-16T21:01:21.174902] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-09. [2025-09-16T21:01:21.974895] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-05. [2025-09-16T21:01:22.182445] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-16T21:01:22.373177] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-16T21:01:22.378945] [INFO ] [REMOTE ] WAL: Full fetch complete (49582 records). [2025-09-16T21:01:22.379057] [DEBUG] [VALIDATOR ] WAL: Validating primary data. [2025-09-16T21:01:22.764301] [DEBUG] [VALIDATOR ] WAL: All expected trading days are present. [2025-09-16T21:01:22.764447] [DEBUG] [VALIDATOR ] WAL: Primary data validation passed. [2025-09-16T21:01:22.765572] [INFO ] [MAIN ] WAL: Fetched primary data is valid. [2025-09-16T21:01:22.765764] [DEBUG] [LOCAL ] WAL: Saving primary data. [2025-09-16T21:01:22.776836] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-06. [2025-09-16T21:01:22.777059] [DEBUG] [LOCAL ] WAL: Trimmed 49582 records to 33162 (keeping 150 days of data) [2025-09-16T21:01:22.778272] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-16T21:01:22.986437] [DEBUG] [LOCAL ] WAL: Primary data saved (33162 records). [2025-09-16T21:01:22.986584] [INFO ] [MAIN ] WAL: Full history saved. [2025-09-16T21:01:22.986684] [INFO ] [MAIN ] Update Progress: 2270/2369 symbols completed. WAL took 25.4s. Estimated remaining: 10m 32s. Rate: 9.4 symbols/min [2025-09-16T21:01:23.168326] [INFO ] [MAIN ] WCC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:01:23.196314] [DEBUG] [LOCAL ] WCC: Loaded 28803 existing records from primary storage. [2025-09-16T21:01:23.196448] [INFO ] [MAIN ] WCC: Loaded 28803 existing records. [2025-09-16T21:01:23.381328] [WARN ] [MAIN ] WCC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:01:23.381583] [INFO ] [MAIN ] WCC: Wiping existing primary data before full refresh. [2025-09-16T21:01:23.381629] [INFO ] [LOCAL ] WCC: Starting deletion of primary data. [2025-09-16T21:01:23.382325] [DEBUG] [LOCAL ] WCC: Deleted primary data file. [2025-09-16T21:01:23.382374] [INFO ] [MAIN ] WCC: Starting full primary refresh. [2025-09-16T21:01:23.580223] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-05. [2025-09-16T21:01:23.753770] [INFO ] [REMOTE ] WCC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:01:24.241890] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-16T21:01:24.374889] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-07. [2025-09-16T21:01:25.174901] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-06. [2025-09-16T21:01:25.560806] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-16T21:01:25.636487] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-16T21:01:25.974870] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-06. [2025-09-16T21:01:26.357535] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-16T21:01:26.774904] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-07. [2025-09-16T21:01:27.267939] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-16T21:01:27.421061] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-16T21:01:27.574900] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-08. [2025-09-16T21:01:28.273834] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-16T21:01:28.374923] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-07. [2025-09-16T21:01:29.174899] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-02. [2025-09-16T21:01:29.974890] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-08. [2025-09-16T21:01:30.176605] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-16T21:01:30.439317] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-16T21:01:30.774894] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-08. [2025-09-16T21:01:31.520855] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-16T21:01:31.574880] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-09. [2025-09-16T21:01:32.374905] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-09. [2025-09-16T21:01:32.495556] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-16T21:01:32.642590] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-16T21:01:32.647009] [INFO ] [REMOTE ] WAT: Full fetch complete (38248 records). [2025-09-16T21:01:32.647088] [DEBUG] [VALIDATOR ] WAT: Validating primary data. [2025-09-16T21:01:32.998977] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-16T21:01:33.009980] [INFO ] [REMOTE ] WBX: Full fetch complete (15761 records). [2025-09-16T21:01:33.019224] [DEBUG] [VALIDATOR ] WBX: Validating primary data. [2025-09-16T21:01:33.031808] [DEBUG] [VALIDATOR ] WAT: All expected trading days are present. [2025-09-16T21:01:33.065616] [DEBUG] [VALIDATOR ] WAT: Primary data validation passed. [2025-09-16T21:01:33.101067] [INFO ] [MAIN ] WAT: Fetched primary data is valid. [2025-09-16T21:01:33.107006] [DEBUG] [LOCAL ] WAT: Saving primary data. [2025-09-16T21:01:33.145288] [DEBUG] [LOCAL ] WAT: Trimmed 38248 records to 26221 (keeping 150 days of data) [2025-09-16T21:01:33.179932] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-09. [2025-09-16T21:01:33.534206] [DEBUG] [VALIDATOR ] WBX: All expected trading days are present. [2025-09-16T21:01:33.538756] [DEBUG] [VALIDATOR ] WBX: Primary data validation passed. [2025-09-16T21:01:33.539242] [INFO ] [MAIN ] WBX: Fetched primary data is valid. [2025-09-16T21:01:33.555035] [DEBUG] [LOCAL ] WBX: Saving primary data. [2025-09-16T21:01:33.566331] [DEBUG] [LOCAL ] WBX: Trimmed 15761 records to 7488 (keeping 150 days of data) [2025-09-16T21:01:33.576610] [DEBUG] [LOCAL ] WAT: Primary data saved (26221 records). [2025-09-16T21:01:33.576975] [INFO ] [MAIN ] WAT: Full history saved. [2025-09-16T21:01:33.577081] [INFO ] [MAIN ] Update Progress: 2271/2369 symbols completed. WAT took 22.9s. Estimated remaining: 10m 25s. Rate: 9.4 symbols/min [2025-09-16T21:01:33.724731] [DEBUG] [LOCAL ] WBX: Primary data saved (7488 records). [2025-09-16T21:01:33.735344] [INFO ] [MAIN ] WBX: Full history saved. [2025-09-16T21:01:33.740558] [INFO ] [MAIN ] Update Progress: 2272/2369 symbols completed. WBX took 21.5s. Estimated remaining: 10m 19s. Rate: 9.4 symbols/min [2025-09-16T21:01:33.857231] [INFO ] [MAIN ] WCN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:01:33.981050] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-03. [2025-09-16T21:01:33.983381] [INFO ] [MAIN ] WD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:01:34.008839] [DEBUG] [LOCAL ] WD: Loaded 17039 existing records from primary storage. [2025-09-16T21:01:34.008976] [INFO ] [MAIN ] WD: Loaded 17039 existing records. [2025-09-16T21:01:34.126350] [DEBUG] [LOCAL ] WCN: Loaded 35252 existing records from primary storage. [2025-09-16T21:01:34.142257] [INFO ] [MAIN ] WCN: Loaded 35252 existing records. [2025-09-16T21:01:34.297953] [WARN ] [MAIN ] WD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:01:34.309756] [INFO ] [MAIN ] WD: Wiping existing primary data before full refresh. [2025-09-16T21:01:34.315113] [INFO ] [LOCAL ] WD: Starting deletion of primary data. [2025-09-16T21:01:34.336059] [DEBUG] [LOCAL ] WD: Deleted primary data file. [2025-09-16T21:01:34.358235] [INFO ] [MAIN ] WD: Starting full primary refresh. [2025-09-16T21:01:34.427485] [WARN ] [MAIN ] WCN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:01:34.475217] [INFO ] [MAIN ] WCN: Wiping existing primary data before full refresh. [2025-09-16T21:01:34.483592] [INFO ] [LOCAL ] WCN: Starting deletion of primary data. [2025-09-16T21:01:34.492306] [DEBUG] [LOCAL ] WCN: Deleted primary data file. [2025-09-16T21:01:34.507654] [INFO ] [MAIN ] WCN: Starting full primary refresh. [2025-09-16T21:01:34.948026] [INFO ] [REMOTE ] WD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:01:35.018634] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-02. [2025-09-16T21:01:35.096728] [INFO ] [REMOTE ] WCN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:01:35.112011] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-16T21:01:35.117941] [INFO ] [REMOTE ] WBS: Full fetch complete (52562 records). [2025-09-16T21:01:35.118034] [DEBUG] [VALIDATOR ] WBS: Validating primary data. [2025-09-16T21:01:35.505198] [DEBUG] [VALIDATOR ] WBS: All expected trading days are present. [2025-09-16T21:01:35.505338] [DEBUG] [VALIDATOR ] WBS: Primary data validation passed. [2025-09-16T21:01:35.506457] [INFO ] [MAIN ] WBS: Fetched primary data is valid. [2025-09-16T21:01:35.506676] [DEBUG] [LOCAL ] WBS: Saving primary data. [2025-09-16T21:01:35.508395] [DEBUG] [LOCAL ] WBS: Trimmed 52562 records to 36149 (keeping 150 days of data) [2025-09-16T21:01:35.601555] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-02. [2025-09-16T21:01:35.649201] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-16T21:01:35.766850] [DEBUG] [LOCAL ] WBS: Primary data saved (36149 records). [2025-09-16T21:01:35.766997] [INFO ] [MAIN ] WBS: Full history saved. [2025-09-16T21:01:35.767084] [INFO ] [MAIN ] Update Progress: 2273/2369 symbols completed. WBS took 23.7s. Estimated remaining: 10m 12s. Rate: 9.4 symbols/min [2025-09-16T21:01:35.937232] [INFO ] [MAIN ] WDH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:01:35.954027] [DEBUG] [LOCAL ] WDH: Loaded 12003 existing records from primary storage. [2025-09-16T21:01:35.954157] [INFO ] [MAIN ] WDH: Loaded 12003 existing records. [2025-09-16T21:01:36.138561] [WARN ] [MAIN ] WDH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:01:36.138849] [INFO ] [MAIN ] WDH: Wiping existing primary data before full refresh. [2025-09-16T21:01:36.138899] [INFO ] [LOCAL ] WDH: Starting deletion of primary data. [2025-09-16T21:01:36.139246] [DEBUG] [LOCAL ] WDH: Deleted primary data file. [2025-09-16T21:01:36.139299] [INFO ] [MAIN ] WDH: Starting full primary refresh. [2025-09-16T21:01:36.397237] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-04. [2025-09-16T21:01:36.516066] [INFO ] [REMOTE ] WDH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:01:36.559495] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-16T21:01:37.084113] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-16T21:01:37.174919] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-03. [2025-09-16T21:01:37.974890] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-03. [2025-09-16T21:01:38.256084] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-16T21:01:38.494261] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-16T21:01:38.774963] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-04. [2025-09-16T21:01:39.574950] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-02. [2025-09-16T21:01:39.962969] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-16T21:01:40.120713] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-16T21:01:40.374958] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-05. [2025-09-16T21:01:40.480580] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-16T21:01:41.174933] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-04. [2025-09-16T21:01:41.681038] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-16T21:01:41.974916] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-03. [2025-09-16T21:01:42.774879] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-06. [2025-09-16T21:01:43.064627] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-16T21:01:43.302380] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-16T21:01:43.574968] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-05. [2025-09-16T21:01:44.374920] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-04. [2025-09-16T21:01:44.441320] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-16T21:01:45.175031] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-07. [2025-09-16T21:01:45.385346] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-16T21:01:45.462532] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-16T21:01:45.974952] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-06. [2025-09-16T21:01:46.732402] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-16T21:01:46.774874] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-08. [2025-09-16T21:01:47.574982] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-05. [2025-09-16T21:01:47.839619] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-16T21:01:48.374879] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-07. [2025-09-16T21:01:48.463608] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-16T21:01:49.174926] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-09. [2025-09-16T21:01:49.308216] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-16T21:01:49.974514] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-16T21:01:49.984600] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-05. [2025-09-16T21:01:50.605610] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-16T21:01:50.610334] [INFO ] [REMOTE ] WCC: Full fetch complete (43818 records). [2025-09-16T21:01:50.610448] [DEBUG] [VALIDATOR ] WCC: Validating primary data. [2025-09-16T21:01:50.774066] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-16T21:01:50.775680] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-08. [2025-09-16T21:01:50.996861] [DEBUG] [VALIDATOR ] WCC: All expected trading days are present. [2025-09-16T21:01:50.996973] [DEBUG] [VALIDATOR ] WCC: Primary data validation passed. [2025-09-16T21:01:50.998068] [INFO ] [MAIN ] WCC: Fetched primary data is valid. [2025-09-16T21:01:50.998157] [DEBUG] [LOCAL ] WCC: Saving primary data. [2025-09-16T21:01:50.999450] [DEBUG] [LOCAL ] WCC: Trimmed 43818 records to 29047 (keeping 150 days of data) [2025-09-16T21:01:51.195229] [DEBUG] [LOCAL ] WCC: Primary data saved (29047 records). [2025-09-16T21:01:51.195419] [INFO ] [MAIN ] WCC: Full history saved. [2025-09-16T21:01:51.195570] [INFO ] [MAIN ] Update Progress: 2274/2369 symbols completed. WCC took 28.2s. Estimated remaining: 10m 6s. Rate: 9.4 symbols/min [2025-09-16T21:01:51.369798] [INFO ] [MAIN ] WDI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:01:51.385756] [DEBUG] [LOCAL ] WDI: Loaded 15260 existing records from primary storage. [2025-09-16T21:01:51.385915] [INFO ] [MAIN ] WDI: Loaded 15260 existing records. [2025-09-16T21:01:51.569066] [WARN ] [MAIN ] WDI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:01:51.569296] [INFO ] [MAIN ] WDI: Wiping existing primary data before full refresh. [2025-09-16T21:01:51.569343] [INFO ] [LOCAL ] WDI: Starting deletion of primary data. [2025-09-16T21:01:51.569774] [DEBUG] [LOCAL ] WDI: Deleted primary data file. [2025-09-16T21:01:51.569828] [INFO ] [MAIN ] WDI: Starting full primary refresh. [2025-09-16T21:01:51.580912] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-06. [2025-09-16T21:01:51.933637] [INFO ] [REMOTE ] WDI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:01:52.374914] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-06. [2025-09-16T21:01:52.652496] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-16T21:01:52.827514] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-16T21:01:53.174915] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-09. [2025-09-16T21:01:53.331893] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-16T21:01:53.974915] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-07. [2025-09-16T21:01:54.660470] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-16T21:01:54.666781] [INFO ] [REMOTE ] WCN: Full fetch complete (52269 records). [2025-09-16T21:01:54.666957] [DEBUG] [VALIDATOR ] WCN: Validating primary data. [2025-09-16T21:01:54.780078] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-07. [2025-09-16T21:01:55.090095] [DEBUG] [VALIDATOR ] WCN: All expected trading days are present. [2025-09-16T21:01:55.090212] [DEBUG] [VALIDATOR ] WCN: Primary data validation passed. [2025-09-16T21:01:55.091348] [INFO ] [MAIN ] WCN: Fetched primary data is valid. [2025-09-16T21:01:55.091428] [DEBUG] [LOCAL ] WCN: Saving primary data. [2025-09-16T21:01:55.092891] [DEBUG] [LOCAL ] WCN: Trimmed 52269 records to 35591 (keeping 150 days of data) [2025-09-16T21:01:55.314077] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-16T21:01:55.343903] [DEBUG] [LOCAL ] WCN: Primary data saved (35591 records). [2025-09-16T21:01:55.344066] [INFO ] [MAIN ] WCN: Full history saved. [2025-09-16T21:01:55.344921] [INFO ] [MAIN ] Update Progress: 2275/2369 symbols completed. WCN took 21.8s. Estimated remaining: 9m 60s. Rate: 9.4 symbols/min [2025-09-16T21:01:55.527667] [INFO ] [MAIN ] WDS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:01:55.561782] [DEBUG] [LOCAL ] WDS: Loaded 31271 existing records from primary storage. [2025-09-16T21:01:55.561923] [INFO ] [MAIN ] WDS: Loaded 31271 existing records. [2025-09-16T21:01:55.584676] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-08. [2025-09-16T21:01:55.747270] [WARN ] [MAIN ] WDS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:01:55.747511] [INFO ] [MAIN ] WDS: Wiping existing primary data before full refresh. [2025-09-16T21:01:55.747559] [INFO ] [LOCAL ] WDS: Starting deletion of primary data. [2025-09-16T21:01:55.748256] [DEBUG] [LOCAL ] WDS: Deleted primary data file. [2025-09-16T21:01:55.748307] [INFO ] [MAIN ] WDS: Starting full primary refresh. [2025-09-16T21:01:56.106497] [INFO ] [REMOTE ] WDS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:01:56.123314] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-16T21:01:56.374926] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-02. [2025-09-16T21:01:56.780842] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-16T21:01:57.174930] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-09. [2025-09-16T21:01:57.974893] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-08. [2025-09-16T21:01:58.147591] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-16T21:01:58.201105] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-16T21:01:58.205237] [INFO ] [REMOTE ] WDH: Full fetch complete (17153 records). [2025-09-16T21:01:58.205333] [DEBUG] [VALIDATOR ] WDH: Validating primary data. [2025-09-16T21:01:58.571586] [DEBUG] [VALIDATOR ] WDH: All expected trading days are present. [2025-09-16T21:01:58.571725] [DEBUG] [VALIDATOR ] WDH: Primary data validation passed. [2025-09-16T21:01:58.572080] [INFO ] [MAIN ] WDH: Fetched primary data is valid. [2025-09-16T21:01:58.572121] [DEBUG] [LOCAL ] WDH: Saving primary data. [2025-09-16T21:01:58.572687] [DEBUG] [LOCAL ] WDH: Trimmed 17153 records to 12206 (keeping 150 days of data) [2025-09-16T21:01:58.642861] [DEBUG] [LOCAL ] WDH: Primary data saved (12206 records). [2025-09-16T21:01:58.643004] [INFO ] [MAIN ] WDH: Full history saved. [2025-09-16T21:01:58.643115] [INFO ] [MAIN ] Update Progress: 2276/2369 symbols completed. WDH took 22.9s. Estimated remaining: 9m 53s. Rate: 9.4 symbols/min [2025-09-16T21:01:58.788179] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-02. [2025-09-16T21:01:58.824347] [INFO ] [MAIN ] WEA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:01:58.832237] [DEBUG] [LOCAL ] WEA: Loaded 6116 existing records from primary storage. [2025-09-16T21:01:58.832356] [INFO ] [MAIN ] WEA: Loaded 6116 existing records. [2025-09-16T21:01:59.013185] [WARN ] [MAIN ] WEA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:01:59.013624] [INFO ] [MAIN ] WEA: Wiping existing primary data before full refresh. [2025-09-16T21:01:59.013811] [INFO ] [LOCAL ] WEA: Starting deletion of primary data. [2025-09-16T21:01:59.014136] [DEBUG] [LOCAL ] WEA: Deleted primary data file. [2025-09-16T21:01:59.014188] [INFO ] [MAIN ] WEA: Starting full primary refresh. [2025-09-16T21:01:59.138721] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-16T21:01:59.415692] [INFO ] [REMOTE ] WEA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:01:59.574905] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-03. [2025-09-16T21:01:59.958858] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-16T21:02:00.374916] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-03. [2025-09-16T21:02:01.174894] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-09. [2025-09-16T21:02:01.542077] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-16T21:02:01.600544] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-16T21:02:01.935840] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-16T21:02:01.938867] [INFO ] [REMOTE ] WD: Full fetch complete (25770 records). [2025-09-16T21:02:01.938943] [DEBUG] [VALIDATOR ] WD: Validating primary data. [2025-09-16T21:02:01.979980] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-04. [2025-09-16T21:02:02.309918] [DEBUG] [VALIDATOR ] WD: All expected trading days are present. [2025-09-16T21:02:02.309997] [DEBUG] [VALIDATOR ] WD: Primary data validation passed. [2025-09-16T21:02:02.310508] [INFO ] [MAIN ] WD: Fetched primary data is valid. [2025-09-16T21:02:02.310548] [DEBUG] [LOCAL ] WD: Saving primary data. [2025-09-16T21:02:02.311247] [DEBUG] [LOCAL ] WD: Trimmed 25770 records to 17197 (keeping 150 days of data) [2025-09-16T21:02:02.419357] [DEBUG] [LOCAL ] WD: Primary data saved (17197 records). [2025-09-16T21:02:02.419514] [INFO ] [MAIN ] WD: Full history saved. [2025-09-16T21:02:02.419601] [INFO ] [MAIN ] Update Progress: 2277/2369 symbols completed. WD took 28.7s. Estimated remaining: 9m 47s. Rate: 9.4 symbols/min [2025-09-16T21:02:02.774910] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-02. [2025-09-16T21:02:03.294795] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-16T21:02:03.474934] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-16T21:02:03.574925] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-05. [2025-09-16T21:02:04.374922] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-03. [2025-09-16T21:02:04.851220] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-16T21:02:05.156066] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-16T21:02:05.174845] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-04. [2025-09-16T21:02:05.974940] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-06. [2025-09-16T21:02:05.995054] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-16T21:02:06.774948] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-05. [2025-09-16T21:02:07.262564] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-16T21:02:07.518017] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-16T21:02:07.574896] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-06. [2025-09-16T21:02:08.187723] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-16T21:02:08.374920] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-04. [2025-09-16T21:02:09.174934] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-07. [2025-09-16T21:02:09.974915] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-07. [2025-09-16T21:02:10.170143] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-16T21:02:10.357688] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-16T21:02:10.774915] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-05. [2025-09-16T21:02:10.917052] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-16T21:02:11.574923] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-08. [2025-09-16T21:02:12.374921] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-08. [2025-09-16T21:02:12.629546] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-16T21:02:13.174947] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-06. [2025-09-16T21:02:13.286320] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-16T21:02:13.628937] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-16T21:02:13.974905] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-09. [2025-09-16T21:02:14.659497] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-16T21:02:14.774876] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-07. [2025-09-16T21:02:14.986945] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-16T21:02:14.989626] [INFO ] [REMOTE ] WDI: Full fetch complete (22976 records). [2025-09-16T21:02:14.989730] [DEBUG] [VALIDATOR ] WDI: Validating primary data. [2025-09-16T21:02:15.359237] [DEBUG] [VALIDATOR ] WDI: All expected trading days are present. [2025-09-16T21:02:15.359313] [DEBUG] [VALIDATOR ] WDI: Primary data validation passed. [2025-09-16T21:02:15.359787] [INFO ] [MAIN ] WDI: Fetched primary data is valid. [2025-09-16T21:02:15.359833] [DEBUG] [LOCAL ] WDI: Saving primary data. [2025-09-16T21:02:15.360461] [DEBUG] [LOCAL ] WDI: Trimmed 22976 records to 15400 (keeping 150 days of data) [2025-09-16T21:02:15.460017] [DEBUG] [LOCAL ] WDI: Primary data saved (15400 records). [2025-09-16T21:02:15.460171] [INFO ] [MAIN ] WDI: Full history saved. [2025-09-16T21:02:15.460286] [INFO ] [MAIN ] Update Progress: 2278/2369 symbols completed. WDI took 24.3s. Estimated remaining: 9m 41s. Rate: 9.4 symbols/min [2025-09-16T21:02:15.574922] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-09. [2025-09-16T21:02:16.318980] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-16T21:02:16.320750] [INFO ] [REMOTE ] WEA: Full fetch complete (7808 records). [2025-09-16T21:02:16.320829] [DEBUG] [VALIDATOR ] WEA: Validating primary data. [2025-09-16T21:02:16.689306] [DEBUG] [VALIDATOR ] WEA: All expected trading days are present. [2025-09-16T21:02:16.689545] [DEBUG] [VALIDATOR ] WEA: Primary data validation passed. [2025-09-16T21:02:16.689796] [INFO ] [MAIN ] WEA: Fetched primary data is valid. [2025-09-16T21:02:16.689852] [DEBUG] [LOCAL ] WEA: Saving primary data. [2025-09-16T21:02:16.713007] [DEBUG] [LOCAL ] WEA: Trimmed 7808 records to 6181 (keeping 150 days of data) [2025-09-16T21:02:16.730995] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-16T21:02:16.762377] [DEBUG] [LOCAL ] WEA: Primary data saved (6181 records). [2025-09-16T21:02:16.762750] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-08. [2025-09-16T21:02:16.762971] [INFO ] [MAIN ] WEA: Full history saved. [2025-09-16T21:02:16.763865] [INFO ] [MAIN ] Update Progress: 2279/2369 symbols completed. WEA took 18.1s. Estimated remaining: 9m 34s. Rate: 9.4 symbols/min [2025-09-16T21:02:18.433772] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-16T21:02:18.443093] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-09. [2025-09-16T21:02:19.829251] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-16T21:02:19.834286] [INFO ] [REMOTE ] WDS: Full fetch complete (47838 records). [2025-09-16T21:02:19.834379] [DEBUG] [VALIDATOR ] WDS: Validating primary data. [2025-09-16T21:02:20.213533] [DEBUG] [VALIDATOR ] WDS: All expected trading days are present. [2025-09-16T21:02:20.213623] [DEBUG] [VALIDATOR ] WDS: Primary data validation passed. [2025-09-16T21:02:20.214563] [INFO ] [MAIN ] WDS: Fetched primary data is valid. [2025-09-16T21:02:20.214610] [DEBUG] [LOCAL ] WDS: Saving primary data. [2025-09-16T21:02:20.215785] [DEBUG] [LOCAL ] WDS: Trimmed 47838 records to 31569 (keeping 150 days of data) [2025-09-16T21:02:20.426856] [DEBUG] [LOCAL ] WDS: Primary data saved (31569 records). [2025-09-16T21:02:20.427078] [INFO ] [MAIN ] WDS: Full history saved. [2025-09-16T21:02:20.427433] [INFO ] [MAIN ] Update Progress: 2280/2369 symbols completed. WDS took 25.1s. Estimated remaining: 9m 27s. Rate: 9.4 symbols/min [2025-09-16T21:02:21.075875] [INFO ] [MAIN ] WEC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:02:21.212951] [INFO ] [MAIN ] WES: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:02:21.219306] [INFO ] [MAIN ] WELL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:02:21.217896] [INFO ] [MAIN ] WEAV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:02:21.259685] [DEBUG] [LOCAL ] WEAV: Loaded 30769 existing records from primary storage. [2025-09-16T21:02:21.269449] [INFO ] [MAIN ] WEAV: Loaded 30769 existing records. [2025-09-16T21:02:21.414723] [DEBUG] [LOCAL ] WELL: Loaded 38502 existing records from primary storage. [2025-09-16T21:02:21.432009] [DEBUG] [LOCAL ] WES: Loaded 35411 existing records from primary storage. [2025-09-16T21:02:21.471692] [INFO ] [MAIN ] WELL: Loaded 38502 existing records. [2025-09-16T21:02:21.471565] [INFO ] [MAIN ] WES: Loaded 35411 existing records. [2025-09-16T21:02:21.505687] [DEBUG] [LOCAL ] WEC: Loaded 38536 existing records from primary storage. [2025-09-16T21:02:21.541562] [WARN ] [MAIN ] WEAV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:02:21.575918] [INFO ] [MAIN ] WEC: Loaded 38536 existing records. [2025-09-16T21:02:21.584910] [INFO ] [MAIN ] WEAV: Wiping existing primary data before full refresh. [2025-09-16T21:02:21.661729] [INFO ] [LOCAL ] WEAV: Starting deletion of primary data. [2025-09-16T21:02:21.709469] [DEBUG] [LOCAL ] WEAV: Deleted primary data file. [2025-09-16T21:02:21.802701] [INFO ] [MAIN ] WEAV: Starting full primary refresh. [2025-09-16T21:02:22.090601] [WARN ] [MAIN ] WELL: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:02:22.177813] [WARN ] [MAIN ] WES: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:02:22.196592] [INFO ] [MAIN ] WES: Wiping existing primary data before full refresh. [2025-09-16T21:02:22.190505] [WARN ] [MAIN ] WEC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:02:22.196500] [INFO ] [MAIN ] WELL: Wiping existing primary data before full refresh. [2025-09-16T21:02:22.208996] [INFO ] [LOCAL ] WES: Starting deletion of primary data. [2025-09-16T21:02:22.209233] [INFO ] [LOCAL ] WELL: Starting deletion of primary data. [2025-09-16T21:02:22.214796] [INFO ] [MAIN ] WEC: Wiping existing primary data before full refresh. [2025-09-16T21:02:22.230486] [INFO ] [LOCAL ] WEC: Starting deletion of primary data. [2025-09-16T21:02:22.270987] [DEBUG] [LOCAL ] WELL: Deleted primary data file. [2025-09-16T21:02:22.271073] [DEBUG] [LOCAL ] WES: Deleted primary data file. [2025-09-16T21:02:22.290088] [INFO ] [MAIN ] WELL: Starting full primary refresh. [2025-09-16T21:02:22.297479] [INFO ] [MAIN ] WES: Starting full primary refresh. [2025-09-16T21:02:22.285618] [DEBUG] [LOCAL ] WEC: Deleted primary data file. [2025-09-16T21:02:22.369312] [INFO ] [MAIN ] WEC: Starting full primary refresh. [2025-09-16T21:02:22.847816] [INFO ] [REMOTE ] WEAV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:02:22.884443] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-02. [2025-09-16T21:02:23.514504] [INFO ] [REMOTE ] WES: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:02:23.544183] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-02. [2025-09-16T21:02:23.593709] [INFO ] [REMOTE ] WEC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:02:23.608812] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-02. [2025-09-16T21:02:23.661181] [INFO ] [REMOTE ] WELL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:02:23.662464] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-02. [2025-09-16T21:02:24.440632] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-16T21:02:24.449604] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-03. [2025-09-16T21:02:25.434808] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-16T21:02:25.444365] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-03. [2025-09-16T21:02:25.541390] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-16T21:02:25.551526] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-03. [2025-09-16T21:02:25.590462] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-16T21:02:25.600633] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-03. [2025-09-16T21:02:26.237151] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-16T21:02:26.246778] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-04. [2025-09-16T21:02:26.899062] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-16T21:02:26.909292] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-04. [2025-09-16T21:02:27.482098] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-16T21:02:27.491601] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-05. [2025-09-16T21:02:27.522471] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-16T21:02:27.533853] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-04. [2025-09-16T21:02:27.622462] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-16T21:02:27.633475] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-04. [2025-09-16T21:02:28.379907] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-16T21:02:28.390052] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-05. [2025-09-16T21:02:28.697145] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-16T21:02:29.093499] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-16T21:02:29.174853] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-06. [2025-09-16T21:02:29.616572] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-16T21:02:29.974954] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-05. [2025-09-16T21:02:30.124888] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-16T21:02:30.767463] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-16T21:02:30.775254] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-05. [2025-09-16T21:02:31.574909] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-07. [2025-09-16T21:02:31.763688] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-16T21:02:32.374884] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-06. [2025-09-16T21:02:32.778057] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-16T21:02:33.174898] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-06. [2025-09-16T21:02:33.252545] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-16T21:02:33.930793] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-16T21:02:33.974865] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-08. [2025-09-16T21:02:34.774886] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-06. [2025-09-16T21:02:35.142485] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-16T21:02:35.361451] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-16T21:02:35.574896] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-09. [2025-09-16T21:02:36.263849] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-16T21:02:36.374907] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-07. [2025-09-16T21:02:36.967538] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-16T21:02:36.974079] [INFO ] [REMOTE ] WEAV: Full fetch complete (46102 records). [2025-09-16T21:02:36.974303] [DEBUG] [VALIDATOR ] WEAV: Validating primary data. [2025-09-16T21:02:37.180020] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-07. [2025-09-16T21:02:37.471218] [DEBUG] [VALIDATOR ] WEAV: All expected trading days are present. [2025-09-16T21:02:37.471317] [DEBUG] [VALIDATOR ] WEAV: Primary data validation passed. [2025-09-16T21:02:37.472343] [INFO ] [MAIN ] WEAV: Fetched primary data is valid. [2025-09-16T21:02:37.472393] [DEBUG] [LOCAL ] WEAV: Saving primary data. [2025-09-16T21:02:37.473613] [DEBUG] [LOCAL ] WEAV: Trimmed 46102 records to 31145 (keeping 150 days of data) [2025-09-16T21:02:37.662552] [DEBUG] [LOCAL ] WEAV: Primary data saved (31145 records). [2025-09-16T21:02:37.662713] [INFO ] [MAIN ] WEAV: Full history saved. [2025-09-16T21:02:37.662813] [INFO ] [MAIN ] Update Progress: 2281/2369 symbols completed. WEAV took 17.2s. Estimated remaining: 9m 22s. Rate: 9.4 symbols/min [2025-09-16T21:02:37.831403] [INFO ] [MAIN ] WEX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:02:37.855578] [DEBUG] [LOCAL ] WEX: Loaded 24119 existing records from primary storage. [2025-09-16T21:02:37.855743] [INFO ] [MAIN ] WEX: Loaded 24119 existing records. [2025-09-16T21:02:37.979938] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-07. [2025-09-16T21:02:38.035874] [WARN ] [MAIN ] WEX: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:02:38.036101] [INFO ] [MAIN ] WEX: Wiping existing primary data before full refresh. [2025-09-16T21:02:38.036147] [INFO ] [LOCAL ] WEX: Starting deletion of primary data. [2025-09-16T21:02:38.036669] [DEBUG] [LOCAL ] WEX: Deleted primary data file. [2025-09-16T21:02:38.036716] [INFO ] [MAIN ] WEX: Starting full primary refresh. [2025-09-16T21:02:38.388621] [INFO ] [REMOTE ] WEX: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:02:38.423447] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-16T21:02:38.691809] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-16T21:02:38.774854] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-08. [2025-09-16T21:02:39.574874] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-08. [2025-09-16T21:02:40.060782] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-16T21:02:40.374915] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-02. [2025-09-16T21:02:40.583494] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-16T21:02:41.174872] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-09. [2025-09-16T21:02:41.419631] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-16T21:02:41.974887] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-08. [2025-09-16T21:02:42.129449] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-16T21:02:42.716931] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-16T21:02:42.722713] [INFO ] [REMOTE ] WES: Full fetch complete (52341 records). [2025-09-16T21:02:42.722830] [DEBUG] [VALIDATOR ] WES: Validating primary data. [2025-09-16T21:02:42.783107] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-03. [2025-09-16T21:02:43.108623] [DEBUG] [VALIDATOR ] WES: All expected trading days are present. [2025-09-16T21:02:43.108735] [DEBUG] [VALIDATOR ] WES: Primary data validation passed. [2025-09-16T21:02:43.109686] [INFO ] [MAIN ] WES: Fetched primary data is valid. [2025-09-16T21:02:43.109734] [DEBUG] [LOCAL ] WES: Saving primary data. [2025-09-16T21:02:43.111068] [DEBUG] [LOCAL ] WES: Trimmed 52341 records to 35771 (keeping 150 days of data) [2025-09-16T21:02:43.339737] [DEBUG] [LOCAL ] WES: Primary data saved (35771 records). [2025-09-16T21:02:43.339879] [INFO ] [MAIN ] WES: Full history saved. [2025-09-16T21:02:43.339977] [INFO ] [MAIN ] Update Progress: 2282/2369 symbols completed. WES took 22.9s. Estimated remaining: 9m 15s. Rate: 9.4 symbols/min [2025-09-16T21:02:43.509171] [INFO ] [MAIN ] WF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:02:43.518070] [DEBUG] [LOCAL ] WF: Loaded 7987 existing records from primary storage. [2025-09-16T21:02:43.518178] [INFO ] [MAIN ] WF: Loaded 7987 existing records. [2025-09-16T21:02:43.585284] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-09. [2025-09-16T21:02:43.701751] [WARN ] [MAIN ] WF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:02:43.702039] [INFO ] [MAIN ] WF: Wiping existing primary data before full refresh. [2025-09-16T21:02:43.702146] [INFO ] [LOCAL ] WF: Starting deletion of primary data. [2025-09-16T21:02:43.702534] [DEBUG] [LOCAL ] WF: Deleted primary data file. [2025-09-16T21:02:43.702662] [INFO ] [MAIN ] WF: Starting full primary refresh. [2025-09-16T21:02:44.087422] [INFO ] [REMOTE ] WF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:02:44.088895] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-16T21:02:44.374967] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-09. [2025-09-16T21:02:44.607758] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-16T21:02:45.174950] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-04. [2025-09-16T21:02:45.361579] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-16T21:02:45.368875] [INFO ] [REMOTE ] WEC: Full fetch complete (56835 records). [2025-09-16T21:02:45.369051] [DEBUG] [VALIDATOR ] WEC: Validating primary data. [2025-09-16T21:02:45.762154] [DEBUG] [VALIDATOR ] WEC: All expected trading days are present. [2025-09-16T21:02:45.762231] [DEBUG] [VALIDATOR ] WEC: Primary data validation passed. [2025-09-16T21:02:45.763213] [INFO ] [MAIN ] WEC: Fetched primary data is valid. [2025-09-16T21:02:45.763264] [DEBUG] [LOCAL ] WEC: Saving primary data. [2025-09-16T21:02:45.764387] [DEBUG] [LOCAL ] WEC: Trimmed 56835 records to 38901 (keeping 150 days of data) [2025-09-16T21:02:45.982736] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-02. [2025-09-16T21:02:46.016968] [DEBUG] [LOCAL ] WEC: Primary data saved (38901 records). [2025-09-16T21:02:46.017132] [INFO ] [MAIN ] WEC: Full history saved. [2025-09-16T21:02:46.017227] [INFO ] [MAIN ] Update Progress: 2283/2369 symbols completed. WEC took 25.6s. Estimated remaining: 9m 9s. Rate: 9.4 symbols/min [2025-09-16T21:02:46.187426] [INFO ] [MAIN ] WFC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:02:46.187614] [DEBUG] [LOCAL ] WFC: No existing data file found in primary storage. [2025-09-16T21:02:46.187733] [WARN ] [MAIN ] WFC: No existing data found, performing full refresh instead. [2025-09-16T21:02:46.187853] [INFO ] [MAIN ] WFC: Wiping existing primary data before full refresh. [2025-09-16T21:02:46.187893] [INFO ] [LOCAL ] WFC: Starting deletion of primary data. [2025-09-16T21:02:46.187937] [DEBUG] [LOCAL ] WFC: No primary data file found to delete. [2025-09-16T21:02:46.187968] [INFO ] [MAIN ] WFC: Starting full primary refresh. [2025-09-16T21:02:46.309165] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-16T21:02:46.355634] [INFO ] [REMOTE ] WELL: Full fetch complete (56965 records). [2025-09-16T21:02:46.376847] [DEBUG] [VALIDATOR ] WELL: Validating primary data. [2025-09-16T21:02:46.754689] [INFO ] [REMOTE ] WFC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:02:46.775505] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-02. [2025-09-16T21:02:46.989918] [DEBUG] [VALIDATOR ] WELL: All expected trading days are present. [2025-09-16T21:02:46.990179] [DEBUG] [VALIDATOR ] WELL: Primary data validation passed. [2025-09-16T21:02:46.991311] [INFO ] [MAIN ] WELL: Fetched primary data is valid. [2025-09-16T21:02:46.991424] [DEBUG] [LOCAL ] WELL: Saving primary data. [2025-09-16T21:02:46.999682] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-16T21:02:47.003457] [DEBUG] [LOCAL ] WELL: Trimmed 56965 records to 38889 (keeping 150 days of data) [2025-09-16T21:02:47.029858] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-16T21:02:47.289416] [DEBUG] [LOCAL ] WELL: Primary data saved (38889 records). [2025-09-16T21:02:47.289574] [INFO ] [MAIN ] WELL: Full history saved. [2025-09-16T21:02:47.289694] [INFO ] [MAIN ] Update Progress: 2284/2369 symbols completed. WELL took 26.9s. Estimated remaining: 9m 2s. Rate: 9.4 symbols/min [2025-09-16T21:02:47.461421] [INFO ] [MAIN ] WFG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:02:47.479305] [DEBUG] [LOCAL ] WFG: Loaded 17796 existing records from primary storage. [2025-09-16T21:02:47.479428] [INFO ] [MAIN ] WFG: Loaded 17796 existing records. [2025-09-16T21:02:47.580089] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-05. [2025-09-16T21:02:47.662700] [WARN ] [MAIN ] WFG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:02:47.663127] [INFO ] [MAIN ] WFG: Wiping existing primary data before full refresh. [2025-09-16T21:02:47.663175] [INFO ] [LOCAL ] WFG: Starting deletion of primary data. [2025-09-16T21:02:47.663681] [DEBUG] [LOCAL ] WFG: Deleted primary data file. [2025-09-16T21:02:47.663730] [INFO ] [MAIN ] WFG: Starting full primary refresh. [2025-09-16T21:02:48.032992] [INFO ] [REMOTE ] WFG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:02:48.374937] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-03. [2025-09-16T21:02:48.779393] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-16T21:02:49.175082] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-03. [2025-09-16T21:02:49.218978] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-16T21:02:49.302409] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-16T21:02:49.974935] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-02. [2025-09-16T21:02:50.774923] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-04. [2025-09-16T21:02:51.406060] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-16T21:02:51.432813] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-16T21:02:51.527472] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-16T21:02:51.574880] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-05. [2025-09-16T21:02:52.374897] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-04. [2025-09-16T21:02:52.447570] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-16T21:02:53.174911] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-03. [2025-09-16T21:02:53.974886] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-06. [2025-09-16T21:02:54.574321] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-16T21:02:54.636148] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-16T21:02:54.774915] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-06. [2025-09-16T21:02:55.430246] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-16T21:02:55.574900] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-04. [2025-09-16T21:02:55.674922] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-16T21:02:56.374959] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-05. [2025-09-16T21:02:57.008778] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-16T21:02:57.174863] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-05. [2025-09-16T21:02:57.974924] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-07. [2025-09-16T21:02:58.431629] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-16T21:02:58.514750] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-16T21:02:58.774916] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-06. [2025-09-16T21:02:59.076384] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-16T21:02:59.574900] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-06. [2025-09-16T21:03:00.374908] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-08. [2025-09-16T21:03:00.888756] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-16T21:03:01.074735] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-09-16T21:03:01.174952] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-07. [2025-09-16T21:03:01.229155] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-16T21:03:01.974942] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-09. [2025-09-16T21:03:02.774914] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-07. [2025-09-16T21:03:03.022289] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-16T21:03:03.574936] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-08. [2025-09-16T21:03:04.180774] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-16T21:03:04.182454] [INFO ] [REMOTE ] WF: Full fetch complete (12247 records). [2025-09-16T21:03:04.182525] [DEBUG] [VALIDATOR ] WF: Validating primary data. [2025-09-16T21:03:04.399093] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-07. [2025-09-16T21:03:04.551547] [DEBUG] [VALIDATOR ] WF: All expected trading days are present. [2025-09-16T21:03:04.551629] [DEBUG] [VALIDATOR ] WF: Primary data validation passed. [2025-09-16T21:03:04.551952] [INFO ] [MAIN ] WF: Fetched primary data is valid. [2025-09-16T21:03:04.551992] [DEBUG] [LOCAL ] WF: Saving primary data. [2025-09-16T21:03:04.552452] [DEBUG] [LOCAL ] WF: Trimmed 12247 records to 8075 (keeping 150 days of data) [2025-09-16T21:03:04.602417] [DEBUG] [LOCAL ] WF: Primary data saved (8075 records). [2025-09-16T21:03:04.602557] [INFO ] [MAIN ] WF: Full history saved. [2025-09-16T21:03:04.602667] [INFO ] [MAIN ] Update Progress: 2285/2369 symbols completed. WF took 21.3s. Estimated remaining: 8m 56s. Rate: 9.4 symbols/min [2025-09-16T21:03:04.777233] [INFO ] [MAIN ] WGO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:03:04.809538] [DEBUG] [LOCAL ] WGO: Loaded 27817 existing records from primary storage. [2025-09-16T21:03:04.809710] [INFO ] [MAIN ] WGO: Loaded 27817 existing records. [2025-09-16T21:03:04.988460] [WARN ] [MAIN ] WGO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:03:04.988733] [INFO ] [MAIN ] WGO: Wiping existing primary data before full refresh. [2025-09-16T21:03:04.988781] [INFO ] [LOCAL ] WGO: Starting deletion of primary data. [2025-09-16T21:03:04.989496] [DEBUG] [LOCAL ] WGO: Deleted primary data file. [2025-09-16T21:03:04.989543] [INFO ] [MAIN ] WGO: Starting full primary refresh. [2025-09-16T21:03:05.345552] [INFO ] [REMOTE ] WGO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:03:05.345904] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-02. [2025-09-16T21:03:06.214602] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-09-16T21:03:06.220394] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-09. [2025-09-16T21:03:06.503594] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-16T21:03:06.774926] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-08. [2025-09-16T21:03:06.941955] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-16T21:03:07.376835] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-16T21:03:07.380328] [INFO ] [REMOTE ] WFG: Full fetch complete (27418 records). [2025-09-16T21:03:07.380431] [DEBUG] [VALIDATOR ] WFG: Validating primary data. [2025-09-16T21:03:07.596463] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-03. [2025-09-16T21:03:07.776749] [DEBUG] [VALIDATOR ] WFG: All expected trading days are present. [2025-09-16T21:03:07.776863] [DEBUG] [VALIDATOR ] WFG: Primary data validation passed. [2025-09-16T21:03:07.777447] [INFO ] [MAIN ] WFG: Fetched primary data is valid. [2025-09-16T21:03:07.777489] [DEBUG] [LOCAL ] WFG: Saving primary data. [2025-09-16T21:03:07.778347] [DEBUG] [LOCAL ] WFG: Trimmed 27418 records to 18005 (keeping 150 days of data) [2025-09-16T21:03:07.890721] [DEBUG] [LOCAL ] WFG: Primary data saved (18005 records). [2025-09-16T21:03:07.890876] [INFO ] [MAIN ] WFG: Full history saved. [2025-09-16T21:03:07.890964] [INFO ] [MAIN ] Update Progress: 2286/2369 symbols completed. WFG took 20.6s. Estimated remaining: 8m 50s. Rate: 9.4 symbols/min [2025-09-16T21:03:08.063245] [INFO ] [MAIN ] WH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:03:08.096290] [DEBUG] [LOCAL ] WH: Loaded 33730 existing records from primary storage. [2025-09-16T21:03:08.096451] [INFO ] [MAIN ] WH: Loaded 33730 existing records. [2025-09-16T21:03:08.278446] [WARN ] [MAIN ] WH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:03:08.278851] [INFO ] [MAIN ] WH: Wiping existing primary data before full refresh. [2025-09-16T21:03:08.278937] [INFO ] [LOCAL ] WH: Starting deletion of primary data. [2025-09-16T21:03:08.285581] [DEBUG] [LOCAL ] WH: Deleted primary data file. [2025-09-16T21:03:08.294509] [INFO ] [MAIN ] WH: Starting full primary refresh. [2025-09-16T21:03:08.344128] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-16T21:03:08.409119] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-09. [2025-09-16T21:03:08.667956] [INFO ] [REMOTE ] WH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:03:09.174957] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-02. [2025-09-16T21:03:09.511957] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-16T21:03:09.813295] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-16T21:03:09.817075] [INFO ] [REMOTE ] WEX: Full fetch complete (39153 records). [2025-09-16T21:03:09.817164] [DEBUG] [VALIDATOR ] WEX: Validating primary data. [2025-09-16T21:03:09.983746] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-04. [2025-09-16T21:03:10.205896] [DEBUG] [VALIDATOR ] WEX: All expected trading days are present. [2025-09-16T21:03:10.205982] [DEBUG] [VALIDATOR ] WEX: Primary data validation passed. [2025-09-16T21:03:10.206783] [INFO ] [MAIN ] WEX: Fetched primary data is valid. [2025-09-16T21:03:10.206829] [DEBUG] [LOCAL ] WEX: Saving primary data. [2025-09-16T21:03:10.207865] [DEBUG] [LOCAL ] WEX: Trimmed 39153 records to 24346 (keeping 150 days of data) [2025-09-16T21:03:10.361532] [DEBUG] [LOCAL ] WEX: Primary data saved (24346 records). [2025-09-16T21:03:10.361705] [INFO ] [MAIN ] WEX: Full history saved. [2025-09-16T21:03:10.361802] [INFO ] [MAIN ] Update Progress: 2287/2369 symbols completed. WEX took 32.7s. Estimated remaining: 8m 43s. Rate: 9.4 symbols/min [2025-09-16T21:03:10.535385] [INFO ] [MAIN ] WHD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:03:10.570168] [DEBUG] [LOCAL ] WHD: Loaded 29039 existing records from primary storage. [2025-09-16T21:03:10.570502] [INFO ] [MAIN ] WHD: Loaded 29039 existing records. [2025-09-16T21:03:10.720484] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-07 (7.95 seconds). [2025-09-16T21:03:10.793172] [WARN ] [MAIN ] WHD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:03:10.794463] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-08. [2025-09-16T21:03:10.794627] [INFO ] [MAIN ] WHD: Wiping existing primary data before full refresh. [2025-09-16T21:03:10.795827] [INFO ] [LOCAL ] WHD: Starting deletion of primary data. [2025-09-16T21:03:10.796637] [DEBUG] [LOCAL ] WHD: Deleted primary data file. [2025-09-16T21:03:10.796739] [INFO ] [MAIN ] WHD: Starting full primary refresh. [2025-09-16T21:03:10.938675] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-16T21:03:11.221998] [INFO ] [REMOTE ] WHD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:03:11.574933] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-02. [2025-09-16T21:03:11.622342] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-16T21:03:11.781531] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-16T21:03:12.374903] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-09. [2025-09-16T21:03:13.174908] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-03. [2025-09-16T21:03:13.974863] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-05. [2025-09-16T21:03:14.051567] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-09-16T21:03:14.468711] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-16T21:03:14.475134] [INFO ] [REMOTE ] WFC: Full fetch complete (58038 records). [2025-09-16T21:03:14.475289] [DEBUG] [VALIDATOR ] WFC: Validating primary data. [2025-09-16T21:03:14.476073] [FATAL] [VALIDATOR ] WFC: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T21:03:14.476170] [FATAL] [MAIN ] WFC: Fetched primary data is invalid. Refusing to save it. [2025-09-16T21:03:14.476216] [WARN ] [MAIN ] WFC: Deleting existing primary and derivative data due to validation failure. [2025-09-16T21:03:14.476256] [INFO ] [LOCAL ] WFC: Starting deletion of primary data. [2025-09-16T21:03:14.476315] [DEBUG] [LOCAL ] WFC: No primary data file found to delete. [2025-09-16T21:03:14.476351] [INFO ] [LOCAL ] WFC: Starting deletion of derivative data. [2025-09-16T21:03:14.476405] [DEBUG] [LOCAL ] WFC: No derivative data file found to delete. [2025-09-16T21:03:14.476478] [INFO ] [MAIN ] Update Progress: 2288/2369 symbols completed. WFC took 28.5s. Estimated remaining: 8m 37s. Rate: 9.4 symbols/min [2025-09-16T21:03:14.651033] [INFO ] [MAIN ] WHG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:03:14.655189] [DEBUG] [LOCAL ] WHG: Loaded 2589 existing records from primary storage. [2025-09-16T21:03:14.655278] [INFO ] [MAIN ] WHG: Loaded 2589 existing records. [2025-09-16T21:03:14.779987] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-03. [2025-09-16T21:03:14.836431] [WARN ] [MAIN ] WHG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:03:14.836635] [INFO ] [MAIN ] WHG: Wiping existing primary data before full refresh. [2025-09-16T21:03:14.836699] [INFO ] [LOCAL ] WHG: Starting deletion of primary data. [2025-09-16T21:03:14.836881] [DEBUG] [LOCAL ] WHG: Deleted primary data file. [2025-09-16T21:03:14.836923] [INFO ] [MAIN ] WHG: Starting full primary refresh. [2025-09-16T21:03:15.217027] [INFO ] [REMOTE ] WHG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:03:15.245919] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-16T21:03:15.482948] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-16T21:03:15.574877] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-06. [2025-09-16T21:03:16.374942] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-04. [2025-09-16T21:03:16.582029] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-16T21:03:17.174961] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-02. [2025-09-16T21:03:17.247692] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-16T21:03:17.729031] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-16T21:03:17.878992] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-16T21:03:17.974907] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-05. [2025-09-16T21:03:18.774938] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-03. [2025-09-16T21:03:19.325847] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-16T21:03:19.574906] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-04. [2025-09-16T21:03:19.727157] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-16T21:03:20.374895] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-06. [2025-09-16T21:03:21.174888] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-04. [2025-09-16T21:03:21.345432] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-16T21:03:21.641546] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-16T21:03:21.907479] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-16T21:03:21.974868] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-07. [2025-09-16T21:03:22.774910] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-05. [2025-09-16T21:03:23.429880] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-16T21:03:23.558161] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-16T21:03:23.574842] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-08. [2025-09-16T21:03:24.374925] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-05. [2025-09-16T21:03:25.140308] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-16T21:03:25.174870] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-09. [2025-09-16T21:03:25.974926] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-07. [2025-09-16T21:03:26.092924] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-16T21:03:26.556525] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-16T21:03:26.561140] [INFO ] [REMOTE ] WGO: Full fetch complete (42985 records). [2025-09-16T21:03:26.561232] [DEBUG] [VALIDATOR ] WGO: Validating primary data. [2025-09-16T21:03:26.783467] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-06. [2025-09-16T21:03:26.942945] [DEBUG] [VALIDATOR ] WGO: All expected trading days are present. [2025-09-16T21:03:26.943029] [DEBUG] [VALIDATOR ] WGO: Primary data validation passed. [2025-09-16T21:03:26.943960] [INFO ] [MAIN ] WGO: Fetched primary data is valid. [2025-09-16T21:03:26.944017] [DEBUG] [LOCAL ] WGO: Saving primary data. [2025-09-16T21:03:26.944974] [DEBUG] [LOCAL ] WGO: Trimmed 42985 records to 28067 (keeping 150 days of data) [2025-09-16T21:03:27.121246] [DEBUG] [LOCAL ] WGO: Primary data saved (28067 records). [2025-09-16T21:03:27.121393] [INFO ] [MAIN ] WGO: Full history saved. [2025-09-16T21:03:27.121483] [INFO ] [MAIN ] Update Progress: 2289/2369 symbols completed. WGO took 22.5s. Estimated remaining: 8m 30s. Rate: 9.4 symbols/min [2025-09-16T21:03:27.294442] [INFO ] [MAIN ] WHR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:03:27.328994] [DEBUG] [LOCAL ] WHR: Loaded 35926 existing records from primary storage. [2025-09-16T21:03:27.329136] [INFO ] [MAIN ] WHR: Loaded 35926 existing records. [2025-09-16T21:03:27.506530] [WARN ] [MAIN ] WHR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:03:27.506802] [INFO ] [MAIN ] WHR: Wiping existing primary data before full refresh. [2025-09-16T21:03:27.506849] [INFO ] [LOCAL ] WHR: Starting deletion of primary data. [2025-09-16T21:03:27.507617] [DEBUG] [LOCAL ] WHR: Deleted primary data file. [2025-09-16T21:03:27.507688] [INFO ] [MAIN ] WHR: Starting full primary refresh. [2025-09-16T21:03:27.583139] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-06. [2025-09-16T21:03:27.883412] [INFO ] [REMOTE ] WHR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:03:27.879615] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-16T21:03:27.917103] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-16T21:03:28.374905] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-08. [2025-09-16T21:03:28.935434] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-16T21:03:29.175056] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-02. [2025-09-16T21:03:29.978398] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-07. [2025-09-16T21:03:29.981040] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-16T21:03:30.774961] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-07. [2025-09-16T21:03:30.909281] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-16T21:03:31.542544] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-16T21:03:31.574402] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-16T21:03:31.582575] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-08. [2025-09-16T21:03:32.106082] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-16T21:03:32.374904] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-09. [2025-09-16T21:03:32.843171] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-16T21:03:32.844070] [INFO ] [REMOTE ] WHG: Full fetch complete (3731 records). [2025-09-16T21:03:32.844220] [DEBUG] [VALIDATOR ] WHG: Validating primary data. [2025-09-16T21:03:33.179163] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-09. [2025-09-16T21:03:33.214846] [DEBUG] [VALIDATOR ] WHG: All expected trading days are present. [2025-09-16T21:03:33.215035] [DEBUG] [VALIDATOR ] WHG: Primary data validation passed. [2025-09-16T21:03:33.215171] [INFO ] [MAIN ] WHG: Fetched primary data is valid. [2025-09-16T21:03:33.215209] [DEBUG] [LOCAL ] WHG: Saving primary data. [2025-09-16T21:03:33.215617] [DEBUG] [LOCAL ] WHG: Trimmed 3731 records to 2596 (keeping 150 days of data) [2025-09-16T21:03:33.232662] [DEBUG] [LOCAL ] WHG: Primary data saved (2596 records). [2025-09-16T21:03:33.232732] [INFO ] [MAIN ] WHG: Full history saved. [2025-09-16T21:03:33.232823] [INFO ] [MAIN ] Update Progress: 2290/2369 symbols completed. WHG took 18.8s. Estimated remaining: 8m 24s. Rate: 9.4 symbols/min [2025-09-16T21:03:33.407184] [INFO ] [MAIN ] WIA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:03:33.412455] [DEBUG] [LOCAL ] WIA: Loaded 3584 existing records from primary storage. [2025-09-16T21:03:33.412554] [INFO ] [MAIN ] WIA: Loaded 3584 existing records. [2025-09-16T21:03:33.591412] [WARN ] [MAIN ] WIA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:03:33.591672] [INFO ] [MAIN ] WIA: Wiping existing primary data before full refresh. [2025-09-16T21:03:33.591720] [INFO ] [LOCAL ] WIA: Starting deletion of primary data. [2025-09-16T21:03:33.591969] [DEBUG] [LOCAL ] WIA: Deleted primary data file. [2025-09-16T21:03:33.592013] [INFO ] [MAIN ] WIA: Starting full primary refresh. [2025-09-16T21:03:33.963088] [INFO ] [REMOTE ] WIA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:03:33.974844] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-02. [2025-09-16T21:03:34.648988] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-16T21:03:34.756327] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-16T21:03:34.761972] [INFO ] [REMOTE ] WH: Full fetch complete (50073 records). [2025-09-16T21:03:34.762093] [DEBUG] [VALIDATOR ] WH: Validating primary data. [2025-09-16T21:03:34.783010] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-08. [2025-09-16T21:03:35.167520] [DEBUG] [VALIDATOR ] WH: All expected trading days are present. [2025-09-16T21:03:35.167770] [DEBUG] [VALIDATOR ] WH: Primary data validation passed. [2025-09-16T21:03:35.168730] [INFO ] [MAIN ] WH: Fetched primary data is valid. [2025-09-16T21:03:35.168777] [DEBUG] [LOCAL ] WH: Saving primary data. [2025-09-16T21:03:35.170006] [DEBUG] [LOCAL ] WH: Trimmed 50073 records to 34050 (keeping 150 days of data) [2025-09-16T21:03:35.389802] [DEBUG] [LOCAL ] WH: Primary data saved (34050 records). [2025-09-16T21:03:35.389950] [INFO ] [MAIN ] WH: Full history saved. [2025-09-16T21:03:35.390035] [INFO ] [MAIN ] Update Progress: 2291/2369 symbols completed. WH took 27.5s. Estimated remaining: 8m 17s. Rate: 9.4 symbols/min [2025-09-16T21:03:35.560300] [INFO ] [MAIN ] WINN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:03:35.570333] [DEBUG] [LOCAL ] WINN: Loaded 7978 existing records from primary storage. [2025-09-16T21:03:35.570453] [INFO ] [MAIN ] WINN: Loaded 7978 existing records. [2025-09-16T21:03:35.581580] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-03. [2025-09-16T21:03:35.753527] [WARN ] [MAIN ] WINN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:03:35.753857] [INFO ] [MAIN ] WINN: Wiping existing primary data before full refresh. [2025-09-16T21:03:35.753932] [INFO ] [LOCAL ] WINN: Starting deletion of primary data. [2025-09-16T21:03:35.754408] [DEBUG] [LOCAL ] WINN: Deleted primary data file. [2025-09-16T21:03:35.754456] [INFO ] [MAIN ] WINN: Starting full primary refresh. [2025-09-16T21:03:36.110134] [INFO ] [REMOTE ] WINN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:03:36.318894] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-16T21:03:36.374875] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-09. [2025-09-16T21:03:37.174904] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-03. [2025-09-16T21:03:37.427894] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-16T21:03:37.704488] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-16T21:03:37.720033] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-16T21:03:37.724812] [INFO ] [REMOTE ] WHD: Full fetch complete (44034 records). [2025-09-16T21:03:37.724892] [DEBUG] [VALIDATOR ] WHD: Validating primary data. [2025-09-16T21:03:37.979997] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-02. [2025-09-16T21:03:38.100345] [DEBUG] [VALIDATOR ] WHD: All expected trading days are present. [2025-09-16T21:03:38.100417] [DEBUG] [VALIDATOR ] WHD: Primary data validation passed. [2025-09-16T21:03:38.101298] [INFO ] [MAIN ] WHD: Fetched primary data is valid. [2025-09-16T21:03:38.101342] [DEBUG] [LOCAL ] WHD: Saving primary data. [2025-09-16T21:03:38.102244] [DEBUG] [LOCAL ] WHD: Trimmed 44034 records to 29279 (keeping 150 days of data) [2025-09-16T21:03:38.282701] [DEBUG] [LOCAL ] WHD: Primary data saved (29279 records). [2025-09-16T21:03:38.282831] [INFO ] [MAIN ] WHD: Full history saved. [2025-09-16T21:03:38.283961] [INFO ] [MAIN ] Update Progress: 2292/2369 symbols completed. WHD took 27.9s. Estimated remaining: 8m 11s. Rate: 9.4 symbols/min [2025-09-16T21:03:38.453071] [INFO ] [MAIN ] WIT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:03:38.491875] [DEBUG] [LOCAL ] WIT: Loaded 38645 existing records from primary storage. [2025-09-16T21:03:38.492015] [INFO ] [MAIN ] WIT: Loaded 38645 existing records. [2025-09-16T21:03:38.676904] [WARN ] [MAIN ] WIT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:03:38.677149] [INFO ] [MAIN ] WIT: Wiping existing primary data before full refresh. [2025-09-16T21:03:38.677196] [INFO ] [LOCAL ] WIT: Starting deletion of primary data. [2025-09-16T21:03:38.677978] [DEBUG] [LOCAL ] WIT: Deleted primary data file. [2025-09-16T21:03:38.678033] [INFO ] [MAIN ] WIT: Starting full primary refresh. [2025-09-16T21:03:38.780015] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-04. [2025-09-16T21:03:39.038963] [INFO ] [REMOTE ] WIT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:03:39.048796] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-16T21:03:39.516985] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-16T21:03:39.574957] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-05. [2025-09-16T21:03:40.213361] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-16T21:03:40.374944] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-02. [2025-09-16T21:03:41.174924] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-06. [2025-09-16T21:03:41.845623] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-16T21:03:41.974917] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-07. [2025-09-16T21:03:42.087820] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-16T21:03:42.725656] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-16T21:03:42.774862] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-08. [2025-09-16T21:03:43.512816] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-16T21:03:43.574914] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-09. [2025-09-16T21:03:44.374926] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-03. [2025-09-16T21:03:44.557828] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-16T21:03:44.559235] [INFO ] [REMOTE ] WIA: Full fetch complete (5270 records). [2025-09-16T21:03:44.559304] [DEBUG] [VALIDATOR ] WIA: Validating primary data. [2025-09-16T21:03:44.912488] [DEBUG] [VALIDATOR ] WIA: All expected trading days are present. [2025-09-16T21:03:44.912562] [DEBUG] [VALIDATOR ] WIA: Primary data validation passed. [2025-09-16T21:03:44.912718] [INFO ] [MAIN ] WIA: Fetched primary data is valid. [2025-09-16T21:03:44.912769] [DEBUG] [LOCAL ] WIA: Saving primary data. [2025-09-16T21:03:44.913142] [DEBUG] [LOCAL ] WIA: Trimmed 5270 records to 3615 (keeping 150 days of data) [2025-09-16T21:03:44.934810] [DEBUG] [LOCAL ] WIA: Primary data saved (3615 records). [2025-09-16T21:03:44.934876] [INFO ] [MAIN ] WIA: Full history saved. [2025-09-16T21:03:44.934956] [INFO ] [MAIN ] Update Progress: 2293/2369 symbols completed. WIA took 11.7s. Estimated remaining: 8m 5s. Rate: 9.4 symbols/min [2025-09-16T21:03:45.108892] [INFO ] [MAIN ] WIW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:03:45.124406] [DEBUG] [LOCAL ] WIW: Loaded 15323 existing records from primary storage. [2025-09-16T21:03:45.124530] [INFO ] [MAIN ] WIW: Loaded 15323 existing records. [2025-09-16T21:03:45.187146] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-04. [2025-09-16T21:03:45.306569] [WARN ] [MAIN ] WIW: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:03:45.307014] [INFO ] [MAIN ] WIW: Wiping existing primary data before full refresh. [2025-09-16T21:03:45.307166] [INFO ] [LOCAL ] WIW: Starting deletion of primary data. [2025-09-16T21:03:45.314034] [DEBUG] [LOCAL ] WIW: Deleted primary data file. [2025-09-16T21:03:45.315499] [INFO ] [MAIN ] WIW: Starting full primary refresh. [2025-09-16T21:03:45.348094] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-16T21:03:45.672969] [INFO ] [REMOTE ] WIW: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:03:45.974883] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-03. [2025-09-16T21:03:46.774896] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-02. [2025-09-16T21:03:47.381566] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-16T21:03:47.512195] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-16T21:03:47.574975] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-04. [2025-09-16T21:03:47.611148] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-16T21:03:48.374956] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-03. [2025-09-16T21:03:49.174931] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-05. [2025-09-16T21:03:49.557591] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-16T21:03:49.585131] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-16T21:03:49.974891] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-05. [2025-09-16T21:03:50.774941] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-04. [2025-09-16T21:03:51.100010] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-16T21:03:51.574993] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-04. [2025-09-16T21:03:51.789486] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-16T21:03:51.863476] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-16T21:03:52.263401] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-16T21:03:52.374957] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-05. [2025-09-16T21:03:53.174956] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-05. [2025-09-16T21:03:53.267883] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-16T21:03:53.974939] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-06. [2025-09-16T21:03:54.126979] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-16T21:03:54.774912] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-06. [2025-09-16T21:03:55.530555] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-16T21:03:55.574908] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-07. [2025-09-16T21:03:55.862958] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-16T21:03:56.374956] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-06. [2025-09-16T21:03:57.174956] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-07. [2025-09-16T21:03:57.566059] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-16T21:03:57.974893] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-08. [2025-09-16T21:03:58.038850] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-16T21:03:58.243768] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-16T21:03:58.774910] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-08. [2025-09-16T21:03:59.574934] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-06. [2025-09-16T21:03:59.827308] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-16T21:04:00.374895] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-09. [2025-09-16T21:04:00.454105] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-16T21:04:01.174897] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-07. [2025-09-16T21:04:01.974896] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-07. [2025-09-16T21:04:02.137056] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-16T21:04:02.143321] [INFO ] [REMOTE ] WIT: Full fetch complete (56749 records). [2025-09-16T21:04:02.143448] [DEBUG] [VALIDATOR ] WIT: Validating primary data. [2025-09-16T21:04:02.530361] [DEBUG] [VALIDATOR ] WIT: All expected trading days are present. [2025-09-16T21:04:02.530465] [DEBUG] [VALIDATOR ] WIT: Primary data validation passed. [2025-09-16T21:04:02.531444] [INFO ] [MAIN ] WIT: Fetched primary data is valid. [2025-09-16T21:04:02.531504] [DEBUG] [LOCAL ] WIT: Saving primary data. [2025-09-16T21:04:02.532960] [DEBUG] [LOCAL ] WIT: Trimmed 56749 records to 39032 (keeping 150 days of data) [2025-09-16T21:04:02.762065] [DEBUG] [LOCAL ] WIT: Primary data saved (39032 records). [2025-09-16T21:04:02.762208] [INFO ] [MAIN ] WIT: Full history saved. [2025-09-16T21:04:02.762907] [INFO ] [MAIN ] Update Progress: 2294/2369 symbols completed. WIT took 24.5s. Estimated remaining: 7m 59s. Rate: 9.4 symbols/min [2025-09-16T21:04:02.938082] [INFO ] [MAIN ] WK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:04:02.945344] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-16T21:04:02.948779] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-08. [2025-09-16T21:04:02.973507] [DEBUG] [LOCAL ] WK: Loaded 26500 existing records from primary storage. [2025-09-16T21:04:02.973662] [INFO ] [MAIN ] WK: Loaded 26500 existing records. [2025-09-16T21:04:03.152811] [WARN ] [MAIN ] WK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:04:03.153104] [INFO ] [MAIN ] WK: Wiping existing primary data before full refresh. [2025-09-16T21:04:03.153172] [INFO ] [LOCAL ] WK: Starting deletion of primary data. [2025-09-16T21:04:03.153758] [DEBUG] [LOCAL ] WK: Deleted primary data file. [2025-09-16T21:04:03.153813] [INFO ] [MAIN ] WK: Starting full primary refresh. [2025-09-16T21:04:03.508049] [INFO ] [REMOTE ] WK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:04:03.521865] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-08 (4.75 seconds). [2025-09-16T21:04:03.557666] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-16T21:04:03.574848] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-08. [2025-09-16T21:04:03.980522] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-16T21:04:04.374905] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-09. [2025-09-16T21:04:05.174880] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-09. [2025-09-16T21:04:05.325091] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-16T21:04:05.329045] [INFO ] [REMOTE ] WIW: Full fetch complete (22411 records). [2025-09-16T21:04:05.329144] [DEBUG] [VALIDATOR ] WIW: Validating primary data. [2025-09-16T21:04:05.449985] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-16T21:04:05.743926] [DEBUG] [VALIDATOR ] WIW: All expected trading days are present. [2025-09-16T21:04:05.744007] [DEBUG] [VALIDATOR ] WIW: Primary data validation passed. [2025-09-16T21:04:05.744478] [INFO ] [MAIN ] WIW: Fetched primary data is valid. [2025-09-16T21:04:05.744518] [DEBUG] [LOCAL ] WIW: Saving primary data. [2025-09-16T21:04:05.745145] [DEBUG] [LOCAL ] WIW: Trimmed 22411 records to 15447 (keeping 150 days of data) [2025-09-16T21:04:05.840041] [DEBUG] [LOCAL ] WIW: Primary data saved (15447 records). [2025-09-16T21:04:05.840194] [INFO ] [MAIN ] WIW: Full history saved. [2025-09-16T21:04:05.840282] [INFO ] [MAIN ] Update Progress: 2295/2369 symbols completed. WIW took 20.9s. Estimated remaining: 7m 52s. Rate: 9.4 symbols/min [2025-09-16T21:04:05.967127] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-16T21:04:05.977501] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-09. [2025-09-16T21:04:06.018294] [INFO ] [REMOTE ] WINN: Full fetch complete (13102 records). [2025-09-16T21:04:06.021096] [INFO ] [MAIN ] WKC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:04:06.021564] [DEBUG] [VALIDATOR ] WINN: Validating primary data. [2025-09-16T21:04:06.311388] [DEBUG] [LOCAL ] WKC: Loaded 25611 existing records from primary storage. [2025-09-16T21:04:06.321835] [INFO ] [MAIN ] WKC: Loaded 25611 existing records. [2025-09-16T21:04:06.531923] [DEBUG] [VALIDATOR ] WINN: All expected trading days are present. [2025-09-16T21:04:06.554607] [DEBUG] [VALIDATOR ] WINN: Primary data validation passed. [2025-09-16T21:04:06.563293] [INFO ] [MAIN ] WINN: Fetched primary data is valid. [2025-09-16T21:04:06.582107] [DEBUG] [LOCAL ] WINN: Saving primary data. [2025-09-16T21:04:06.582218] [WARN ] [MAIN ] WKC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:04:06.582703] [INFO ] [MAIN ] WKC: Wiping existing primary data before full refresh. [2025-09-16T21:04:06.582858] [INFO ] [LOCAL ] WKC: Starting deletion of primary data. [2025-09-16T21:04:06.583165] [DEBUG] [LOCAL ] WINN: Trimmed 13102 records to 8042 (keeping 150 days of data) [2025-09-16T21:04:06.583792] [DEBUG] [LOCAL ] WKC: Deleted primary data file. [2025-09-16T21:04:06.583892] [INFO ] [MAIN ] WKC: Starting full primary refresh. [2025-09-16T21:04:06.778775] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-02. [2025-09-16T21:04:06.923933] [DEBUG] [LOCAL ] WINN: Primary data saved (8042 records). [2025-09-16T21:04:06.939326] [INFO ] [MAIN ] WINN: Full history saved. [2025-09-16T21:04:06.967597] [INFO ] [MAIN ] Update Progress: 2296/2369 symbols completed. WINN took 31.6s. Estimated remaining: 7m 46s. Rate: 9.4 symbols/min [2025-09-16T21:04:06.994656] [INFO ] [REMOTE ] WKC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:04:07.168581] [INFO ] [MAIN ] WLK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:04:07.201597] [DEBUG] [LOCAL ] WLK: Loaded 34071 existing records from primary storage. [2025-09-16T21:04:07.201757] [INFO ] [MAIN ] WLK: Loaded 34071 existing records. [2025-09-16T21:04:07.381545] [WARN ] [MAIN ] WLK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:04:07.381830] [INFO ] [MAIN ] WLK: Wiping existing primary data before full refresh. [2025-09-16T21:04:07.381886] [INFO ] [LOCAL ] WLK: Starting deletion of primary data. [2025-09-16T21:04:07.382626] [DEBUG] [LOCAL ] WLK: Deleted primary data file. [2025-09-16T21:04:07.382705] [INFO ] [MAIN ] WLK: Starting full primary refresh. [2025-09-16T21:04:07.595238] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-02. [2025-09-16T21:04:07.747778] [INFO ] [REMOTE ] WLK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:04:07.762330] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-16T21:04:07.768030] [INFO ] [REMOTE ] WHR: Full fetch complete (52091 records). [2025-09-16T21:04:07.768126] [DEBUG] [VALIDATOR ] WHR: Validating primary data. [2025-09-16T21:04:08.144539] [DEBUG] [VALIDATOR ] WHR: All expected trading days are present. [2025-09-16T21:04:08.144622] [DEBUG] [VALIDATOR ] WHR: Primary data validation passed. [2025-09-16T21:04:08.145564] [INFO ] [MAIN ] WHR: Fetched primary data is valid. [2025-09-16T21:04:08.145613] [DEBUG] [LOCAL ] WHR: Saving primary data. [2025-09-16T21:04:08.146834] [DEBUG] [LOCAL ] WHR: Trimmed 52091 records to 36249 (keeping 150 days of data) [2025-09-16T21:04:08.378526] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-16T21:04:08.377044] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-02. [2025-09-16T21:04:08.414785] [DEBUG] [LOCAL ] WHR: Primary data saved (36249 records). [2025-09-16T21:04:08.414929] [INFO ] [MAIN ] WHR: Full history saved. [2025-09-16T21:04:08.415035] [INFO ] [MAIN ] Update Progress: 2297/2369 symbols completed. WHR took 41.3s. Estimated remaining: 7m 39s. Rate: 9.4 symbols/min [2025-09-16T21:04:08.585668] [INFO ] [MAIN ] WLKP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:04:08.592125] [DEBUG] [LOCAL ] WLKP: Loaded 4933 existing records from primary storage. [2025-09-16T21:04:08.592245] [INFO ] [MAIN ] WLKP: Loaded 4933 existing records. [2025-09-16T21:04:08.770149] [WARN ] [MAIN ] WLKP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:04:08.770442] [INFO ] [MAIN ] WLKP: Wiping existing primary data before full refresh. [2025-09-16T21:04:08.770577] [INFO ] [LOCAL ] WLKP: Starting deletion of primary data. [2025-09-16T21:04:08.770914] [DEBUG] [LOCAL ] WLKP: Deleted primary data file. [2025-09-16T21:04:08.770983] [INFO ] [MAIN ] WLKP: Starting full primary refresh. [2025-09-16T21:04:09.143185] [INFO ] [REMOTE ] WLKP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:04:09.161985] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-16T21:04:09.174854] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-02. [2025-09-16T21:04:09.662754] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-16T21:04:09.954059] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-16T21:04:09.974851] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-03. [2025-09-16T21:04:10.705121] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-16T21:04:10.774949] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-03. [2025-09-16T21:04:11.574940] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-03. [2025-09-16T21:04:12.409091] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-04. [2025-09-16T21:04:12.424657] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-16T21:04:12.926707] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-16T21:04:13.174925] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-03. [2025-09-16T21:04:13.270696] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-16T21:04:13.974902] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-04. [2025-09-16T21:04:14.781113] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-05. [2025-09-16T21:04:14.785886] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-16T21:04:15.215479] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-16T21:04:15.383156] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-16T21:04:15.574909] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-04. [2025-09-16T21:04:16.374953] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-06. [2025-09-16T21:04:17.038205] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-16T21:04:17.174883] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-04. [2025-09-16T21:04:17.363490] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-16T21:04:17.974905] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-07. [2025-09-16T21:04:18.485555] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-16T21:04:18.765463] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-16T21:04:18.774841] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-05. [2025-09-16T21:04:19.574918] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-05. [2025-09-16T21:04:20.319765] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-16T21:04:20.374865] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-06. [2025-09-16T21:04:21.174919] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-08. [2025-09-16T21:04:21.472530] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-16T21:04:21.727183] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-16T21:04:21.935178] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-16T21:04:21.974913] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-05. [2025-09-16T21:04:22.774912] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-07. [2025-09-16T21:04:23.462235] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-16T21:04:23.574875] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-06. [2025-09-16T21:04:24.007477] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-16T21:04:24.374919] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-08. [2025-09-16T21:04:24.574578] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-16T21:04:25.174905] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-09. [2025-09-16T21:04:25.651743] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-16T21:04:25.903002] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-16T21:04:25.904498] [INFO ] [REMOTE ] WLKP: Full fetch complete (7121 records). [2025-09-16T21:04:25.904571] [DEBUG] [VALIDATOR ] WLKP: Validating primary data. [2025-09-16T21:04:25.980163] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-06. [2025-09-16T21:04:26.280607] [DEBUG] [VALIDATOR ] WLKP: All expected trading days are present. [2025-09-16T21:04:26.280724] [DEBUG] [VALIDATOR ] WLKP: Primary data validation passed. [2025-09-16T21:04:26.280945] [INFO ] [MAIN ] WLKP: Fetched primary data is valid. [2025-09-16T21:04:26.281021] [DEBUG] [LOCAL ] WLKP: Saving primary data. [2025-09-16T21:04:26.281606] [DEBUG] [LOCAL ] WLKP: Trimmed 7121 records to 4973 (keeping 150 days of data) [2025-09-16T21:04:26.313630] [DEBUG] [LOCAL ] WLKP: Primary data saved (4973 records). [2025-09-16T21:04:26.313777] [INFO ] [MAIN ] WLKP: Full history saved. [2025-09-16T21:04:26.313926] [INFO ] [MAIN ] Update Progress: 2298/2369 symbols completed. WLKP took 17.9s. Estimated remaining: 7m 33s. Rate: 9.4 symbols/min [2025-09-16T21:04:26.490160] [INFO ] [MAIN ] WLTG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:04:26.493246] [DEBUG] [LOCAL ] WLTG: Loaded 885 existing records from primary storage. [2025-09-16T21:04:26.493317] [INFO ] [MAIN ] WLTG: Loaded 885 existing records. [2025-09-16T21:04:26.669365] [WARN ] [MAIN ] WLTG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:04:26.669694] [INFO ] [MAIN ] WLTG: Wiping existing primary data before full refresh. [2025-09-16T21:04:26.669759] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-09-16T21:04:26.669914] [DEBUG] [LOCAL ] WLTG: Deleted primary data file. [2025-09-16T21:04:26.669976] [INFO ] [MAIN ] WLTG: Starting full primary refresh. [2025-09-16T21:04:26.779967] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-07. [2025-09-16T21:04:27.027913] [INFO ] [REMOTE ] WLTG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:04:27.574916] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-09. [2025-09-16T21:04:27.677470] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-16T21:04:28.374897] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-02. [2025-09-16T21:04:28.689752] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-16T21:04:28.742984] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-16T21:04:28.762839] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-16T21:04:28.768011] [INFO ] [REMOTE ] WK: Full fetch complete (39721 records). [2025-09-16T21:04:28.768148] [DEBUG] [VALIDATOR ] WK: Validating primary data. [2025-09-16T21:04:29.140054] [DEBUG] [VALIDATOR ] WK: All expected trading days are present. [2025-09-16T21:04:29.140148] [DEBUG] [VALIDATOR ] WK: Primary data validation passed. [2025-09-16T21:04:29.140944] [INFO ] [MAIN ] WK: Fetched primary data is valid. [2025-09-16T21:04:29.140997] [DEBUG] [LOCAL ] WK: Saving primary data. [2025-09-16T21:04:29.142300] [DEBUG] [LOCAL ] WK: Trimmed 39721 records to 26749 (keeping 150 days of data) [2025-09-16T21:04:29.200414] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-03. [2025-09-16T21:04:29.313628] [DEBUG] [LOCAL ] WK: Primary data saved (26749 records). [2025-09-16T21:04:29.313791] [INFO ] [MAIN ] WK: Full history saved. [2025-09-16T21:04:29.313949] [INFO ] [MAIN ] Update Progress: 2299/2369 symbols completed. WK took 26.6s. Estimated remaining: 7m 27s. Rate: 9.4 symbols/min [2025-09-16T21:04:29.482352] [INFO ] [MAIN ] WLY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:04:29.502759] [DEBUG] [LOCAL ] WLY: Loaded 22301 existing records from primary storage. [2025-09-16T21:04:29.502868] [INFO ] [MAIN ] WLY: Loaded 22301 existing records. [2025-09-16T21:04:29.679358] [WARN ] [MAIN ] WLY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:04:29.681712] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-16T21:04:29.682809] [INFO ] [MAIN ] WLY: Wiping existing primary data before full refresh. [2025-09-16T21:04:29.682861] [INFO ] [LOCAL ] WLY: Starting deletion of primary data. [2025-09-16T21:04:29.683318] [DEBUG] [LOCAL ] WLY: Deleted primary data file. [2025-09-16T21:04:29.683362] [INFO ] [MAIN ] WLY: Starting full primary refresh. [2025-09-16T21:04:29.979981] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-04. [2025-09-16T21:04:30.031994] [INFO ] [REMOTE ] WLY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:04:30.414548] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-16T21:04:30.774937] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-08. [2025-09-16T21:04:31.574900] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-05. [2025-09-16T21:04:32.042161] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-16T21:04:32.127330] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-16T21:04:32.374873] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-06. [2025-09-16T21:04:32.788848] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-16T21:04:33.174889] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-09. [2025-09-16T21:04:33.974931] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-07. [2025-09-16T21:04:34.454444] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-16T21:04:34.459744] [INFO ] [REMOTE ] WKC: Full fetch complete (38719 records). [2025-09-16T21:04:34.459847] [DEBUG] [VALIDATOR ] WKC: Validating primary data. [2025-09-16T21:04:34.566457] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-16T21:04:34.780085] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-02. [2025-09-16T21:04:34.853226] [DEBUG] [VALIDATOR ] WKC: All expected trading days are present. [2025-09-16T21:04:34.853318] [DEBUG] [VALIDATOR ] WKC: Primary data validation passed. [2025-09-16T21:04:34.854190] [INFO ] [MAIN ] WKC: Fetched primary data is valid. [2025-09-16T21:04:34.854239] [DEBUG] [LOCAL ] WKC: Saving primary data. [2025-09-16T21:04:34.855147] [DEBUG] [LOCAL ] WKC: Trimmed 38719 records to 25862 (keeping 150 days of data) [2025-09-16T21:04:35.018146] [DEBUG] [LOCAL ] WKC: Primary data saved (25862 records). [2025-09-16T21:04:35.018284] [INFO ] [MAIN ] WKC: Full history saved. [2025-09-16T21:04:35.018395] [INFO ] [MAIN ] Update Progress: 2300/2369 symbols completed. WKC took 29.2s. Estimated remaining: 7m 20s. Rate: 9.4 symbols/min [2025-09-16T21:04:35.191010] [INFO ] [MAIN ] WM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:04:35.191191] [DEBUG] [LOCAL ] WM: No existing data file found in primary storage. [2025-09-16T21:04:35.191229] [WARN ] [MAIN ] WM: No existing data found, performing full refresh instead. [2025-09-16T21:04:35.191345] [INFO ] [MAIN ] WM: Wiping existing primary data before full refresh. [2025-09-16T21:04:35.191383] [INFO ] [LOCAL ] WM: Starting deletion of primary data. [2025-09-16T21:04:35.191425] [DEBUG] [LOCAL ] WM: No primary data file found to delete. [2025-09-16T21:04:35.191456] [INFO ] [MAIN ] WM: Starting full primary refresh. [2025-09-16T21:04:35.547562] [INFO ] [REMOTE ] WM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:04:35.574852] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-07. [2025-09-16T21:04:36.166018] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-16T21:04:36.374926] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-08. [2025-09-16T21:04:36.950346] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-16T21:04:37.174874] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-09. [2025-09-16T21:04:37.273218] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-16T21:04:37.539739] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-16T21:04:37.540488] [INFO ] [REMOTE ] WLTG: Full fetch complete (1302 records). [2025-09-16T21:04:37.540555] [DEBUG] [VALIDATOR ] WLTG: Validating primary data. [2025-09-16T21:04:37.891948] [DEBUG] [VALIDATOR ] WLTG: All expected trading days are present. [2025-09-16T21:04:37.892024] [DEBUG] [VALIDATOR ] WLTG: Primary data validation passed. [2025-09-16T21:04:37.892098] [INFO ] [MAIN ] WLTG: Fetched primary data is valid. [2025-09-16T21:04:37.892136] [DEBUG] [LOCAL ] WLTG: Saving primary data. [2025-09-16T21:04:37.892454] [DEBUG] [LOCAL ] WLTG: Trimmed 1302 records to 892 (keeping 150 days of data) [2025-09-16T21:04:37.898654] [DEBUG] [LOCAL ] WLTG: Primary data saved (892 records). [2025-09-16T21:04:37.898716] [INFO ] [MAIN ] WLTG: Full history saved. [2025-09-16T21:04:37.898781] [INFO ] [MAIN ] Update Progress: 2301/2369 symbols completed. WLTG took 11.6s. Estimated remaining: 7m 14s. Rate: 9.4 symbols/min [2025-09-16T21:04:37.979954] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-02. [2025-09-16T21:04:38.074580] [INFO ] [MAIN ] WMB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:04:38.074814] [DEBUG] [LOCAL ] WMB: No existing data file found in primary storage. [2025-09-16T21:04:38.074855] [WARN ] [MAIN ] WMB: No existing data found, performing full refresh instead. [2025-09-16T21:04:38.074974] [INFO ] [MAIN ] WMB: Wiping existing primary data before full refresh. [2025-09-16T21:04:38.075020] [INFO ] [LOCAL ] WMB: Starting deletion of primary data. [2025-09-16T21:04:38.075063] [DEBUG] [LOCAL ] WMB: No primary data file found to delete. [2025-09-16T21:04:38.075096] [INFO ] [MAIN ] WMB: Starting full primary refresh. [2025-09-16T21:04:38.423458] [INFO ] [REMOTE ] WMB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:04:38.774930] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-02. [2025-09-16T21:04:39.574878] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-08. [2025-09-16T21:04:39.834540] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-16T21:04:40.374970] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-03. [2025-09-16T21:04:40.600318] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-16T21:04:41.062367] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-16T21:04:41.174940] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-03. [2025-09-16T21:04:41.787832] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-16T21:04:41.974873] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-04. [2025-09-16T21:04:42.774879] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-09. [2025-09-16T21:04:43.129090] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-16T21:04:43.474559] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-16T21:04:43.574875] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-05. [2025-09-16T21:04:44.250126] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-16T21:04:44.256162] [INFO ] [REMOTE ] WLK: Full fetch complete (48951 records). [2025-09-16T21:04:44.256267] [DEBUG] [VALIDATOR ] WLK: Validating primary data. [2025-09-16T21:04:44.380058] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-03. [2025-09-16T21:04:44.639906] [DEBUG] [VALIDATOR ] WLK: All expected trading days are present. [2025-09-16T21:04:44.639981] [DEBUG] [VALIDATOR ] WLK: Primary data validation passed. [2025-09-16T21:04:44.640889] [INFO ] [MAIN ] WLK: Fetched primary data is valid. [2025-09-16T21:04:44.640932] [DEBUG] [LOCAL ] WLK: Saving primary data. [2025-09-16T21:04:44.641940] [DEBUG] [LOCAL ] WLK: Trimmed 48951 records to 34384 (keeping 150 days of data) [2025-09-16T21:04:44.868261] [DEBUG] [LOCAL ] WLK: Primary data saved (34384 records). [2025-09-16T21:04:44.868404] [INFO ] [MAIN ] WLK: Full history saved. [2025-09-16T21:04:44.868489] [INFO ] [MAIN ] Update Progress: 2302/2369 symbols completed. WLK took 37.9s. Estimated remaining: 7m 7s. Rate: 9.4 symbols/min [2025-09-16T21:04:45.042486] [INFO ] [MAIN ] WMK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:04:45.061852] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-16T21:04:45.077110] [DEBUG] [LOCAL ] WMK: Loaded 10738 existing records from primary storage. [2025-09-16T21:04:45.077234] [INFO ] [MAIN ] WMK: Loaded 10738 existing records. [2025-09-16T21:04:45.177209] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-06. [2025-09-16T21:04:45.255325] [WARN ] [MAIN ] WMK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:04:45.255689] [INFO ] [MAIN ] WMK: Wiping existing primary data before full refresh. [2025-09-16T21:04:45.255748] [INFO ] [LOCAL ] WMK: Starting deletion of primary data. [2025-09-16T21:04:45.256207] [DEBUG] [LOCAL ] WMK: Deleted primary data file. [2025-09-16T21:04:45.256263] [INFO ] [MAIN ] WMK: Starting full primary refresh. [2025-09-16T21:04:45.642274] [INFO ] [REMOTE ] WMK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:04:45.974872] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-04. [2025-09-16T21:04:46.396216] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-16T21:04:46.724609] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-16T21:04:46.774846] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-07. [2025-09-16T21:04:47.574928] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-02. [2025-09-16T21:04:47.986896] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-16T21:04:48.194541] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-16T21:04:48.374928] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-05. [2025-09-16T21:04:48.420549] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-16T21:04:49.174894] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-08. [2025-09-16T21:04:49.974883] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-04. [2025-09-16T21:04:50.311893] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-16T21:04:50.378221] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-16T21:04:50.774950] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-03. [2025-09-16T21:04:51.574913] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-06. [2025-09-16T21:04:51.848250] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-16T21:04:51.980440] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-16T21:04:52.374902] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-05. [2025-09-16T21:04:53.174861] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-09. [2025-09-16T21:04:53.285773] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-16T21:04:53.974869] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-07. [2025-09-16T21:04:54.086566] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-16T21:04:54.090506] [INFO ] [REMOTE ] WLY: Full fetch complete (32870 records). [2025-09-16T21:04:54.090580] [DEBUG] [VALIDATOR ] WLY: Validating primary data. [2025-09-16T21:04:54.465808] [DEBUG] [VALIDATOR ] WLY: All expected trading days are present. [2025-09-16T21:04:54.465900] [DEBUG] [VALIDATOR ] WLY: Primary data validation passed. [2025-09-16T21:04:54.466602] [INFO ] [MAIN ] WLY: Fetched primary data is valid. [2025-09-16T21:04:54.466673] [DEBUG] [LOCAL ] WLY: Saving primary data. [2025-09-16T21:04:54.467631] [DEBUG] [LOCAL ] WLY: Trimmed 32870 records to 22463 (keeping 150 days of data) [2025-09-16T21:04:54.586456] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-16T21:04:54.643531] [DEBUG] [LOCAL ] WLY: Primary data saved (22463 records). [2025-09-16T21:04:54.643679] [INFO ] [MAIN ] WLY: Full history saved. [2025-09-16T21:04:54.643762] [INFO ] [MAIN ] Update Progress: 2303/2369 symbols completed. WLY took 25.3s. Estimated remaining: 7m 1s. Rate: 9.4 symbols/min [2025-09-16T21:04:54.783087] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-06. [2025-09-16T21:04:54.812979] [INFO ] [MAIN ] WMS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:04:54.841740] [DEBUG] [LOCAL ] WMS: Loaded 29380 existing records from primary storage. [2025-09-16T21:04:54.841894] [INFO ] [MAIN ] WMS: Loaded 29380 existing records. [2025-09-16T21:04:55.021493] [WARN ] [MAIN ] WMS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:04:55.021778] [INFO ] [MAIN ] WMS: Wiping existing primary data before full refresh. [2025-09-16T21:04:55.021831] [INFO ] [LOCAL ] WMS: Starting deletion of primary data. [2025-09-16T21:04:55.022524] [DEBUG] [LOCAL ] WMS: Deleted primary data file. [2025-09-16T21:04:55.022572] [INFO ] [MAIN ] WMS: Starting full primary refresh. [2025-09-16T21:04:55.378914] [INFO ] [REMOTE ] WMS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:04:55.574917] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-02. [2025-09-16T21:04:55.693989] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-16T21:04:56.374928] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-08. [2025-09-16T21:04:56.745001] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-16T21:04:56.854890] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-16T21:04:57.174905] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-07. [2025-09-16T21:04:57.980409] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-03. [2025-09-16T21:04:57.987226] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-16T21:04:58.774898] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-04. [2025-09-16T21:04:59.213781] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-16T21:04:59.574875] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-09. [2025-09-16T21:04:59.599396] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-16T21:04:59.938621] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-16T21:05:00.380210] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-08. [2025-09-16T21:05:00.384038] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-16T21:05:00.390009] [INFO ] [REMOTE ] WMB: Full fetch complete (57961 records). [2025-09-16T21:05:00.390099] [DEBUG] [VALIDATOR ] WMB: Validating primary data. [2025-09-16T21:05:00.391256] [FATAL] [VALIDATOR ] WMB: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T21:05:00.391336] [FATAL] [MAIN ] WMB: Fetched primary data is invalid. Refusing to save it. [2025-09-16T21:05:00.391387] [WARN ] [MAIN ] WMB: Deleting existing primary and derivative data due to validation failure. [2025-09-16T21:05:00.391435] [INFO ] [LOCAL ] WMB: Starting deletion of primary data. [2025-09-16T21:05:00.391493] [DEBUG] [LOCAL ] WMB: No primary data file found to delete. [2025-09-16T21:05:00.391530] [INFO ] [LOCAL ] WMB: Starting deletion of derivative data. [2025-09-16T21:05:00.391580] [DEBUG] [LOCAL ] WMB: No derivative data file found to delete. [2025-09-16T21:05:00.391658] [INFO ] [MAIN ] Update Progress: 2304/2369 symbols completed. WMB took 22.5s. Estimated remaining: 6m 55s. Rate: 9.4 symbols/min [2025-09-16T21:05:00.571968] [INFO ] [MAIN ] WMT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:05:00.572169] [DEBUG] [LOCAL ] WMT: No existing data file found in primary storage. [2025-09-16T21:05:00.572207] [WARN ] [MAIN ] WMT: No existing data found, performing full refresh instead. [2025-09-16T21:05:00.572333] [INFO ] [MAIN ] WMT: Wiping existing primary data before full refresh. [2025-09-16T21:05:00.572372] [INFO ] [LOCAL ] WMT: Starting deletion of primary data. [2025-09-16T21:05:00.572414] [DEBUG] [LOCAL ] WMT: No primary data file found to delete. [2025-09-16T21:05:00.572526] [INFO ] [MAIN ] WMT: Starting full primary refresh. [2025-09-16T21:05:00.922348] [INFO ] [REMOTE ] WMT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:05:01.174938] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-04. [2025-09-16T21:05:01.974856] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-05. [2025-09-16T21:05:02.493972] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-16T21:05:02.590342] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-16T21:05:02.774865] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-05. [2025-09-16T21:05:03.183510] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-16T21:05:03.574906] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-09. [2025-09-16T21:05:04.374902] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-02. [2025-09-16T21:05:04.412301] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-16T21:05:04.417927] [INFO ] [REMOTE ] WM: Full fetch complete (55072 records). [2025-09-16T21:05:04.418029] [DEBUG] [VALIDATOR ] WM: Validating primary data. [2025-09-16T21:05:04.418600] [FATAL] [VALIDATOR ] WM: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T21:05:04.418708] [FATAL] [MAIN ] WM: Fetched primary data is invalid. Refusing to save it. [2025-09-16T21:05:04.418750] [WARN ] [MAIN ] WM: Deleting existing primary and derivative data due to validation failure. [2025-09-16T21:05:04.418796] [INFO ] [LOCAL ] WM: Starting deletion of primary data. [2025-09-16T21:05:04.418854] [DEBUG] [LOCAL ] WM: No primary data file found to delete. [2025-09-16T21:05:04.418890] [INFO ] [LOCAL ] WM: Starting deletion of derivative data. [2025-09-16T21:05:04.418949] [DEBUG] [LOCAL ] WM: No derivative data file found to delete. [2025-09-16T21:05:04.419008] [INFO ] [MAIN ] Update Progress: 2305/2369 symbols completed. WM took 29.4s. Estimated remaining: 6m 48s. Rate: 9.4 symbols/min [2025-09-16T21:05:04.591689] [INFO ] [MAIN ] WNC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:05:04.615003] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-16T21:05:04.645935] [DEBUG] [LOCAL ] WNC: Loaded 28633 existing records from primary storage. [2025-09-16T21:05:04.646069] [INFO ] [MAIN ] WNC: Loaded 28633 existing records. [2025-09-16T21:05:04.819358] [WARN ] [MAIN ] WNC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:05:04.819601] [INFO ] [MAIN ] WNC: Wiping existing primary data before full refresh. [2025-09-16T21:05:04.819672] [INFO ] [LOCAL ] WNC: Starting deletion of primary data. [2025-09-16T21:05:04.820365] [DEBUG] [LOCAL ] WNC: Deleted primary data file. [2025-09-16T21:05:04.820412] [INFO ] [MAIN ] WNC: Starting full primary refresh. [2025-09-16T21:05:05.170245] [INFO ] [REMOTE ] WNC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:05:05.174848] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-02. [2025-09-16T21:05:05.974945] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-06. [2025-09-16T21:05:06.383407] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-16T21:05:06.769329] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-09-16T21:05:06.778904] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-06. [2025-09-16T21:05:07.567545] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-16T21:05:07.575511] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-03. [2025-09-16T21:05:07.716703] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-16T21:05:08.374906] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-07. [2025-09-16T21:05:09.174965] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-03. [2025-09-16T21:05:09.974952] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-07. [2025-09-16T21:05:10.246755] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-16T21:05:10.533027] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-03 (2.96 seconds). [2025-09-16T21:05:10.775327] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-08. [2025-09-16T21:05:10.782522] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-16T21:05:10.934559] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-16T21:05:11.574960] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-04. [2025-09-16T21:05:12.374918] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-08. [2025-09-16T21:05:12.625520] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-16T21:05:13.174915] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-09. [2025-09-16T21:05:13.307074] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-16T21:05:13.413418] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-16T21:05:13.974985] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-09. [2025-09-16T21:05:14.527968] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-16T21:05:14.533293] [INFO ] [REMOTE ] WMS: Full fetch complete (42920 records). [2025-09-16T21:05:14.533404] [DEBUG] [VALIDATOR ] WMS: Validating primary data. [2025-09-16T21:05:14.786988] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-05. [2025-09-16T21:05:14.926409] [DEBUG] [VALIDATOR ] WMS: All expected trading days are present. [2025-09-16T21:05:14.933568] [DEBUG] [VALIDATOR ] WMS: Primary data validation passed. [2025-09-16T21:05:14.934836] [INFO ] [MAIN ] WMS: Fetched primary data is valid. [2025-09-16T21:05:14.935320] [DEBUG] [LOCAL ] WMS: Saving primary data. [2025-09-16T21:05:14.935223] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-16T21:05:14.938669] [INFO ] [REMOTE ] WMK: Full fetch complete (15501 records). [2025-09-16T21:05:14.938980] [DEBUG] [VALIDATOR ] WMK: Validating primary data. [2025-09-16T21:05:14.939401] [DEBUG] [LOCAL ] WMS: Trimmed 42920 records to 29675 (keeping 150 days of data) [2025-09-16T21:05:15.431033] [DEBUG] [VALIDATOR ] WMK: All expected trading days are present. [2025-09-16T21:05:15.432980] [DEBUG] [VALIDATOR ] WMK: Primary data validation passed. [2025-09-16T21:05:15.435464] [INFO ] [MAIN ] WMK: Fetched primary data is valid. [2025-09-16T21:05:15.437344] [DEBUG] [LOCAL ] WMK: Saving primary data. [2025-09-16T21:05:15.445785] [DEBUG] [LOCAL ] WMK: Trimmed 15501 records to 10884 (keeping 150 days of data) [2025-09-16T21:05:15.575788] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-04. [2025-09-16T21:05:15.580179] [DEBUG] [LOCAL ] WMS: Primary data saved (29675 records). [2025-09-16T21:05:15.581330] [INFO ] [MAIN ] WMS: Full history saved. [2025-09-16T21:05:15.582790] [INFO ] [MAIN ] Update Progress: 2306/2369 symbols completed. WMS took 20.9s. Estimated remaining: 6m 42s. Rate: 9.4 symbols/min [2025-09-16T21:05:15.582663] [DEBUG] [LOCAL ] WMK: Primary data saved (10884 records). [2025-09-16T21:05:15.582881] [INFO ] [MAIN ] WMK: Full history saved. [2025-09-16T21:05:15.626226] [INFO ] [MAIN ] Update Progress: 2307/2369 symbols completed. WMK took 30.8s. Estimated remaining: 6m 35s. Rate: 9.4 symbols/min [2025-09-16T21:05:15.906187] [INFO ] [MAIN ] WOLF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:05:15.923664] [INFO ] [MAIN ] WNS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:05:15.960039] [DEBUG] [LOCAL ] WNS: Loaded 29830 existing records from primary storage. [2025-09-16T21:05:15.960186] [INFO ] [MAIN ] WNS: Loaded 29830 existing records. [2025-09-16T21:05:16.094259] [DEBUG] [LOCAL ] WOLF: Loaded 39499 existing records from primary storage. [2025-09-16T21:05:16.104616] [INFO ] [MAIN ] WOLF: Loaded 39499 existing records. [2025-09-16T21:05:16.239266] [WARN ] [MAIN ] WNS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:05:16.261535] [INFO ] [MAIN ] WNS: Wiping existing primary data before full refresh. [2025-09-16T21:05:16.262048] [INFO ] [LOCAL ] WNS: Starting deletion of primary data. [2025-09-16T21:05:16.267611] [DEBUG] [LOCAL ] WNS: Deleted primary data file. [2025-09-16T21:05:16.278506] [INFO ] [MAIN ] WNS: Starting full primary refresh. [2025-09-16T21:05:16.371784] [WARN ] [MAIN ] WOLF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:05:16.428283] [INFO ] [MAIN ] WOLF: Wiping existing primary data before full refresh. [2025-09-16T21:05:16.428410] [INFO ] [LOCAL ] WOLF: Starting deletion of primary data. [2025-09-16T21:05:16.442259] [DEBUG] [LOCAL ] WOLF: Deleted primary data file. [2025-09-16T21:05:16.445745] [INFO ] [MAIN ] WOLF: Starting full primary refresh. [2025-09-16T21:05:16.881962] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-16T21:05:17.038638] [INFO ] [REMOTE ] WNS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:05:17.056599] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-02. [2025-09-16T21:05:17.134484] [INFO ] [REMOTE ] WOLF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:05:17.174850] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-02. [2025-09-16T21:05:17.974929] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-06. [2025-09-16T21:05:18.372938] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-04 (2.80 seconds). [2025-09-16T21:05:18.400448] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-16T21:05:18.774934] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-03. [2025-09-16T21:05:19.181466] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-16T21:05:19.502939] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-16T21:05:19.574859] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-07. [2025-09-16T21:05:20.256330] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-16T21:05:20.374911] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-05. [2025-09-16T21:05:21.174900] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-04. [2025-09-16T21:05:21.238266] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-16T21:05:21.974905] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-03. [2025-09-16T21:05:22.782003] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-08. [2025-09-16T21:05:22.787541] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-09-16T21:05:22.864123] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-16T21:05:23.574943] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-05. [2025-09-16T21:05:24.039667] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-16T21:05:24.123091] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-16T21:05:24.374929] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-06. [2025-09-16T21:05:24.776109] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-16T21:05:25.174905] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-06. [2025-09-16T21:05:25.974922] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-09. [2025-09-16T21:05:26.647360] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-16T21:05:26.673567] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-09-16T21:05:26.759792] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-16T21:05:26.763606] [INFO ] [REMOTE ] WNC: Full fetch complete (44491 records). [2025-09-16T21:05:26.763721] [DEBUG] [VALIDATOR ] WNC: Validating primary data. [2025-09-16T21:05:26.784789] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-07. [2025-09-16T21:05:27.145692] [DEBUG] [VALIDATOR ] WNC: All expected trading days are present. [2025-09-16T21:05:27.145779] [DEBUG] [VALIDATOR ] WNC: Primary data validation passed. [2025-09-16T21:05:27.146668] [INFO ] [MAIN ] WNC: Fetched primary data is valid. [2025-09-16T21:05:27.146758] [DEBUG] [LOCAL ] WNC: Saving primary data. [2025-09-16T21:05:27.147796] [DEBUG] [LOCAL ] WNC: Trimmed 44491 records to 28820 (keeping 150 days of data) [2025-09-16T21:05:27.326674] [DEBUG] [LOCAL ] WNC: Primary data saved (28820 records). [2025-09-16T21:05:27.326828] [INFO ] [MAIN ] WNC: Full history saved. [2025-09-16T21:05:27.326921] [INFO ] [MAIN ] Update Progress: 2308/2369 symbols completed. WNC took 22.9s. Estimated remaining: 6m 29s. Rate: 9.4 symbols/min [2025-09-16T21:05:27.507459] [INFO ] [MAIN ] WOR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:05:27.523701] [DEBUG] [LOCAL ] WOR: Loaded 16653 existing records from primary storage. [2025-09-16T21:05:27.523826] [INFO ] [MAIN ] WOR: Loaded 16653 existing records. [2025-09-16T21:05:27.588450] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-07. [2025-09-16T21:05:27.713178] [WARN ] [MAIN ] WOR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:05:27.713423] [INFO ] [MAIN ] WOR: Wiping existing primary data before full refresh. [2025-09-16T21:05:27.713473] [INFO ] [LOCAL ] WOR: Starting deletion of primary data. [2025-09-16T21:05:27.713994] [DEBUG] [LOCAL ] WOR: Deleted primary data file. [2025-09-16T21:05:27.714047] [INFO ] [MAIN ] WOR: Starting full primary refresh. [2025-09-16T21:05:28.072092] [INFO ] [REMOTE ] WOR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:05:28.374897] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-02. [2025-09-16T21:05:29.174872] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-04. [2025-09-16T21:05:29.250398] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-09-16T21:05:29.340264] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-16T21:05:29.370006] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-16T21:05:29.974919] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-03. [2025-09-16T21:05:30.774916] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-08. [2025-09-16T21:05:31.302412] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-16T21:05:31.428630] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-16T21:05:31.574878] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-04. [2025-09-16T21:05:31.782842] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-16T21:05:32.374899] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-08. [2025-09-16T21:05:33.019102] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-16T21:05:33.174895] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-09. [2025-09-16T21:05:33.904503] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-16T21:05:33.910631] [INFO ] [REMOTE ] WMT: Full fetch complete (58090 records). [2025-09-16T21:05:33.910834] [DEBUG] [VALIDATOR ] WMT: Validating primary data. [2025-09-16T21:05:33.911629] [FATAL] [VALIDATOR ] WMT: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T21:05:33.911780] [FATAL] [MAIN ] WMT: Fetched primary data is invalid. Refusing to save it. [2025-09-16T21:05:33.911828] [WARN ] [MAIN ] WMT: Deleting existing primary and derivative data due to validation failure. [2025-09-16T21:05:33.911883] [INFO ] [LOCAL ] WMT: Starting deletion of primary data. [2025-09-16T21:05:33.911975] [DEBUG] [LOCAL ] WMT: No primary data file found to delete. [2025-09-16T21:05:33.912028] [INFO ] [LOCAL ] WMT: Starting deletion of derivative data. [2025-09-16T21:05:33.912086] [DEBUG] [LOCAL ] WMT: No derivative data file found to delete. [2025-09-16T21:05:33.912181] [INFO ] [MAIN ] Update Progress: 2309/2369 symbols completed. WMT took 33.5s. Estimated remaining: 6m 23s. Rate: 9.4 symbols/min [2025-09-16T21:05:33.989409] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-05. [2025-09-16T21:05:34.172317] [INFO ] [MAIN ] WOW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:05:34.226215] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-16T21:05:34.272513] [DEBUG] [LOCAL ] WOW: Loaded 21693 existing records from primary storage. [2025-09-16T21:05:34.272775] [INFO ] [MAIN ] WOW: Loaded 21693 existing records. [2025-09-16T21:05:34.545807] [WARN ] [MAIN ] WOW: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:05:34.546317] [INFO ] [MAIN ] WOW: Wiping existing primary data before full refresh. [2025-09-16T21:05:34.546385] [INFO ] [LOCAL ] WOW: Starting deletion of primary data. [2025-09-16T21:05:34.547120] [DEBUG] [LOCAL ] WOW: Deleted primary data file. [2025-09-16T21:05:34.547192] [INFO ] [MAIN ] WOW: Starting full primary refresh. [2025-09-16T21:05:34.782433] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-09. [2025-09-16T21:05:35.058152] [INFO ] [REMOTE ] WOW: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:05:35.374075] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-16T21:05:35.574904] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-06. [2025-09-16T21:05:36.107069] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-16T21:05:36.112235] [INFO ] [REMOTE ] WNS: Full fetch complete (42308 records). [2025-09-16T21:05:36.112399] [DEBUG] [VALIDATOR ] WNS: Validating primary data. [2025-09-16T21:05:36.380761] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-02. [2025-09-16T21:05:36.516619] [DEBUG] [VALIDATOR ] WNS: All expected trading days are present. [2025-09-16T21:05:36.516742] [DEBUG] [VALIDATOR ] WNS: Primary data validation passed. [2025-09-16T21:05:36.517808] [INFO ] [MAIN ] WNS: Fetched primary data is valid. [2025-09-16T21:05:36.517864] [DEBUG] [LOCAL ] WNS: Saving primary data. [2025-09-16T21:05:36.519087] [DEBUG] [LOCAL ] WNS: Trimmed 42308 records to 30095 (keeping 150 days of data) [2025-09-16T21:05:36.712010] [DEBUG] [LOCAL ] WNS: Primary data saved (30095 records). [2025-09-16T21:05:36.712394] [INFO ] [MAIN ] WNS: Full history saved. [2025-09-16T21:05:36.712566] [INFO ] [MAIN ] Update Progress: 2310/2369 symbols completed. WNS took 21.1s. Estimated remaining: 6m 16s. Rate: 9.4 symbols/min [2025-09-16T21:05:36.889328] [INFO ] [MAIN ] WPC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:05:36.904781] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-16T21:05:36.945318] [DEBUG] [LOCAL ] WPC: Loaded 35651 existing records from primary storage. [2025-09-16T21:05:36.945477] [INFO ] [MAIN ] WPC: Loaded 35651 existing records. [2025-09-16T21:05:37.140866] [WARN ] [MAIN ] WPC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:05:37.141137] [INFO ] [MAIN ] WPC: Wiping existing primary data before full refresh. [2025-09-16T21:05:37.141189] [INFO ] [LOCAL ] WPC: Starting deletion of primary data. [2025-09-16T21:05:37.141972] [DEBUG] [LOCAL ] WPC: Deleted primary data file. [2025-09-16T21:05:37.142030] [INFO ] [MAIN ] WPC: Starting full primary refresh. [2025-09-16T21:05:37.181260] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-07. [2025-09-16T21:05:37.514477] [INFO ] [REMOTE ] WPC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:05:37.531350] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-16T21:05:37.974919] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-03. [2025-09-16T21:05:38.603246] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-16T21:05:38.774882] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-08. [2025-09-16T21:05:39.376886] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-16T21:05:39.574869] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-04. [2025-09-16T21:05:39.895101] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-16T21:05:40.374908] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-09. [2025-09-16T21:05:40.966131] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-16T21:05:41.174901] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-05. [2025-09-16T21:05:41.434297] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-16T21:05:41.437872] [INFO ] [REMOTE ] WOR: Full fetch complete (27129 records). [2025-09-16T21:05:41.437953] [DEBUG] [VALIDATOR ] WOR: Validating primary data. [2025-09-16T21:05:41.826904] [DEBUG] [VALIDATOR ] WOR: All expected trading days are present. [2025-09-16T21:05:41.826993] [DEBUG] [VALIDATOR ] WOR: Primary data validation passed. [2025-09-16T21:05:41.827552] [INFO ] [MAIN ] WOR: Fetched primary data is valid. [2025-09-16T21:05:41.827595] [DEBUG] [LOCAL ] WOR: Saving primary data. [2025-09-16T21:05:41.828422] [DEBUG] [LOCAL ] WOR: Trimmed 27129 records to 16781 (keeping 150 days of data) [2025-09-16T21:05:41.939554] [DEBUG] [LOCAL ] WOR: Primary data saved (16781 records). [2025-09-16T21:05:41.939738] [INFO ] [MAIN ] WOR: Full history saved. [2025-09-16T21:05:41.939825] [INFO ] [MAIN ] Update Progress: 2311/2369 symbols completed. WOR took 14.6s. Estimated remaining: 6m 10s. Rate: 9.4 symbols/min [2025-09-16T21:05:41.983125] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-05. [2025-09-16T21:05:42.114337] [INFO ] [MAIN ] WPM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:05:42.132139] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-16T21:05:42.173487] [DEBUG] [LOCAL ] WPM: Loaded 38840 existing records from primary storage. [2025-09-16T21:05:42.173658] [INFO ] [MAIN ] WPM: Loaded 38840 existing records. [2025-09-16T21:05:42.359109] [WARN ] [MAIN ] WPM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:05:42.359471] [INFO ] [MAIN ] WPM: Wiping existing primary data before full refresh. [2025-09-16T21:05:42.359537] [INFO ] [LOCAL ] WPM: Starting deletion of primary data. [2025-09-16T21:05:42.360730] [DEBUG] [LOCAL ] WPM: Deleted primary data file. [2025-09-16T21:05:42.360820] [INFO ] [MAIN ] WPM: Starting full primary refresh. [2025-09-16T21:05:42.761634] [INFO ] [REMOTE ] WPM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:05:42.774873] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-02. [2025-09-16T21:05:43.574925] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-02. [2025-09-16T21:05:44.374951] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-06. [2025-09-16T21:05:44.564313] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-16T21:05:44.638121] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-05 (2.65 seconds). [2025-09-16T21:05:45.080459] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-16T21:05:45.174856] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-03. [2025-09-16T21:05:45.589108] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-16T21:05:45.974874] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-03. [2025-09-16T21:05:46.774901] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-06. [2025-09-16T21:05:47.010478] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-16T21:05:47.574951] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-07. [2025-09-16T21:05:47.871346] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-16T21:05:48.374917] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-04. [2025-09-16T21:05:48.798530] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-16T21:05:48.900244] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-16T21:05:49.174900] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-04. [2025-09-16T21:05:49.974917] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-07. [2025-09-16T21:05:50.657991] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-16T21:05:50.774972] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-05. [2025-09-16T21:05:51.039707] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-16T21:05:51.574902] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-08. [2025-09-16T21:05:52.374933] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-05. [2025-09-16T21:05:52.451854] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-09-16T21:05:52.635444] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-16T21:05:52.787207] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-16T21:05:53.174901] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-09. [2025-09-16T21:05:53.974937] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-08. [2025-09-16T21:05:54.329854] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-16T21:05:54.350858] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-16T21:05:54.355425] [INFO ] [REMOTE ] WOW: Full fetch complete (31765 records). [2025-09-16T21:05:54.355517] [DEBUG] [VALIDATOR ] WOW: Validating primary data. [2025-09-16T21:05:54.733033] [DEBUG] [VALIDATOR ] WOW: All expected trading days are present. [2025-09-16T21:05:54.733147] [DEBUG] [VALIDATOR ] WOW: Primary data validation passed. [2025-09-16T21:05:54.734062] [INFO ] [MAIN ] WOW: Fetched primary data is valid. [2025-09-16T21:05:54.734130] [DEBUG] [LOCAL ] WOW: Saving primary data. [2025-09-16T21:05:54.735258] [DEBUG] [LOCAL ] WOW: Trimmed 31765 records to 21995 (keeping 150 days of data) [2025-09-16T21:05:54.789061] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-06. [2025-09-16T21:05:54.868626] [DEBUG] [LOCAL ] WOW: Primary data saved (21995 records). [2025-09-16T21:05:54.868770] [INFO ] [MAIN ] WOW: Full history saved. [2025-09-16T21:05:54.868874] [INFO ] [MAIN ] Update Progress: 2312/2369 symbols completed. WOW took 21.0s. Estimated remaining: 6m 4s. Rate: 9.4 symbols/min [2025-09-16T21:05:55.044381] [INFO ] [MAIN ] WPP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:05:55.067678] [DEBUG] [LOCAL ] WPP: Loaded 24616 existing records from primary storage. [2025-09-16T21:05:55.067828] [INFO ] [MAIN ] WPP: Loaded 24616 existing records. [2025-09-16T21:05:55.254531] [WARN ] [MAIN ] WPP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:05:55.254808] [INFO ] [MAIN ] WPP: Wiping existing primary data before full refresh. [2025-09-16T21:05:55.254855] [INFO ] [LOCAL ] WPP: Starting deletion of primary data. [2025-09-16T21:05:55.255399] [DEBUG] [LOCAL ] WPP: Deleted primary data file. [2025-09-16T21:05:55.255449] [INFO ] [MAIN ] WPP: Starting full primary refresh. [2025-09-16T21:05:55.580015] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-06. [2025-09-16T21:05:55.632402] [INFO ] [REMOTE ] WPP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:05:55.984722] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-16T21:05:56.374901] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-02. [2025-09-16T21:05:56.923116] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-16T21:05:57.174921] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-07. [2025-09-16T21:05:57.416152] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-16T21:05:57.608796] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-16T21:05:57.974898] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-07. [2025-09-16T21:05:58.774901] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-03. [2025-09-16T21:05:59.021539] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-16T21:05:59.574921] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-09. [2025-09-16T21:05:59.717431] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-16T21:06:00.374922] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-08. [2025-09-16T21:06:00.420010] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-16T21:06:01.174873] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-04. [2025-09-16T21:06:01.541000] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-16T21:06:01.547483] [INFO ] [REMOTE ] WOLF: Full fetch complete (58210 records). [2025-09-16T21:06:01.547674] [DEBUG] [VALIDATOR ] WOLF: Validating primary data. [2025-09-16T21:06:01.938292] [DEBUG] [VALIDATOR ] WOLF: All expected trading days are present. [2025-09-16T21:06:01.938375] [DEBUG] [VALIDATOR ] WOLF: Primary data validation passed. [2025-09-16T21:06:01.939352] [INFO ] [MAIN ] WOLF: Fetched primary data is valid. [2025-09-16T21:06:01.939399] [DEBUG] [LOCAL ] WOLF: Saving primary data. [2025-09-16T21:06:01.940940] [DEBUG] [LOCAL ] WOLF: Trimmed 58210 records to 39889 (keeping 150 days of data) [2025-09-16T21:06:01.993965] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-08. [2025-09-16T21:06:02.179060] [DEBUG] [LOCAL ] WOLF: Primary data saved (39889 records). [2025-09-16T21:06:02.179197] [INFO ] [MAIN ] WOLF: Full history saved. [2025-09-16T21:06:02.179279] [INFO ] [MAIN ] Update Progress: 2313/2369 symbols completed. WOLF took 46.5s. Estimated remaining: 5m 57s. Rate: 9.4 symbols/min [2025-09-16T21:06:02.351394] [INFO ] [MAIN ] WRB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:06:02.391145] [DEBUG] [LOCAL ] WRB: Loaded 37168 existing records from primary storage. [2025-09-16T21:06:02.391302] [INFO ] [MAIN ] WRB: Loaded 37168 existing records. [2025-09-16T21:06:02.594771] [WARN ] [MAIN ] WRB: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:06:02.596767] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-16T21:06:02.606436] [INFO ] [MAIN ] WRB: Wiping existing primary data before full refresh. [2025-09-16T21:06:02.606810] [INFO ] [LOCAL ] WRB: Starting deletion of primary data. [2025-09-16T21:06:02.607861] [DEBUG] [LOCAL ] WRB: Deleted primary data file. [2025-09-16T21:06:02.607924] [INFO ] [MAIN ] WRB: Starting full primary refresh. [2025-09-16T21:06:02.780992] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-09. [2025-09-16T21:06:02.972127] [INFO ] [REMOTE ] WRB: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:06:03.363625] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-16T21:06:03.574935] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-05. [2025-09-16T21:06:04.374987] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-02. [2025-09-16T21:06:05.336529] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-09 (2.56 seconds). [2025-09-16T21:06:05.342310] [INFO ] [REMOTE ] WPC: Full fetch complete (53267 records). [2025-09-16T21:06:05.342419] [DEBUG] [VALIDATOR ] WPC: Validating primary data. [2025-09-16T21:06:05.743164] [DEBUG] [VALIDATOR ] WPC: All expected trading days are present. [2025-09-16T21:06:05.743925] [DEBUG] [VALIDATOR ] WPC: Primary data validation passed. [2025-09-16T21:06:05.745779] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-16T21:06:05.745041] [INFO ] [MAIN ] WPC: Fetched primary data is valid. [2025-09-16T21:06:05.745930] [DEBUG] [LOCAL ] WPC: Saving primary data. [2025-09-16T21:06:05.752962] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-06. [2025-09-16T21:06:05.754432] [DEBUG] [LOCAL ] WPC: Trimmed 53267 records to 36004 (keeping 150 days of data) [2025-09-16T21:06:05.880608] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-08 (3.89 seconds). [2025-09-16T21:06:05.995511] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-09. [2025-09-16T21:06:06.021354] [DEBUG] [LOCAL ] WPC: Primary data saved (36004 records). [2025-09-16T21:06:06.021520] [INFO ] [MAIN ] WPC: Full history saved. [2025-09-16T21:06:06.022753] [INFO ] [MAIN ] Update Progress: 2314/2369 symbols completed. WPC took 29.3s. Estimated remaining: 5m 51s. Rate: 9.4 symbols/min [2025-09-16T21:06:06.210703] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-16T21:06:06.228041] [INFO ] [MAIN ] WRBY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:06:06.276915] [DEBUG] [LOCAL ] WRBY: Loaded 37252 existing records from primary storage. [2025-09-16T21:06:06.277054] [INFO ] [MAIN ] WRBY: Loaded 37252 existing records. [2025-09-16T21:06:06.455690] [WARN ] [MAIN ] WRBY: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:06:06.455913] [INFO ] [MAIN ] WRBY: Wiping existing primary data before full refresh. [2025-09-16T21:06:06.455957] [INFO ] [LOCAL ] WRBY: Starting deletion of primary data. [2025-09-16T21:06:06.456621] [DEBUG] [LOCAL ] WRBY: Deleted primary data file. [2025-09-16T21:06:06.456698] [INFO ] [MAIN ] WRBY: Starting full primary refresh. [2025-09-16T21:06:06.780089] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-03. [2025-09-16T21:06:06.817092] [INFO ] [REMOTE ] WRBY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:06:07.291067] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-16T21:06:07.574902] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-02. [2025-09-16T21:06:07.692445] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-16T21:06:07.698803] [INFO ] [REMOTE ] WPM: Full fetch complete (57313 records). [2025-09-16T21:06:07.698928] [DEBUG] [VALIDATOR ] WPM: Validating primary data. [2025-09-16T21:06:08.123399] [DEBUG] [VALIDATOR ] WPM: All expected trading days are present. [2025-09-16T21:06:08.123504] [DEBUG] [VALIDATOR ] WPM: Primary data validation passed. [2025-09-16T21:06:08.124617] [INFO ] [MAIN ] WPM: Fetched primary data is valid. [2025-09-16T21:06:08.124679] [DEBUG] [LOCAL ] WPM: Saving primary data. [2025-09-16T21:06:08.125900] [DEBUG] [LOCAL ] WPM: Trimmed 57313 records to 39229 (keeping 150 days of data) [2025-09-16T21:06:08.371955] [DEBUG] [LOCAL ] WPM: Primary data saved (39229 records). [2025-09-16T21:06:08.372097] [INFO ] [MAIN ] WPM: Full history saved. [2025-09-16T21:06:08.372182] [INFO ] [MAIN ] Update Progress: 2315/2369 symbols completed. WPM took 26.4s. Estimated remaining: 5m 44s. Rate: 9.4 symbols/min [2025-09-16T21:06:08.404158] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-07. [2025-09-16T21:06:08.552532] [INFO ] [MAIN ] WS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:06:08.599937] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-16T21:06:08.621388] [DEBUG] [LOCAL ] WS: Loaded 16722 existing records from primary storage. [2025-09-16T21:06:08.621853] [INFO ] [MAIN ] WS: Loaded 16722 existing records. [2025-09-16T21:06:08.806492] [WARN ] [MAIN ] WS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:06:08.806797] [INFO ] [MAIN ] WS: Wiping existing primary data before full refresh. [2025-09-16T21:06:08.806850] [INFO ] [LOCAL ] WS: Starting deletion of primary data. [2025-09-16T21:06:08.807272] [DEBUG] [LOCAL ] WS: Deleted primary data file. [2025-09-16T21:06:08.807321] [INFO ] [MAIN ] WS: Starting full primary refresh. [2025-09-16T21:06:09.172435] [INFO ] [REMOTE ] WS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:06:09.174844] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-02. [2025-09-16T21:06:09.211781] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-16T21:06:09.793205] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-16T21:06:09.972864] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-16T21:06:09.977872] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-08. [2025-09-16T21:06:10.774901] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-03. [2025-09-16T21:06:11.574907] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-04. [2025-09-16T21:06:11.612018] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-16T21:06:12.374906] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-09. [2025-09-16T21:06:12.718973] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-16T21:06:13.174914] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-03. [2025-09-16T21:06:13.960665] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-16T21:06:13.964904] [INFO ] [REMOTE ] WPP: Full fetch complete (35526 records). [2025-09-16T21:06:13.965003] [DEBUG] [VALIDATOR ] WPP: Validating primary data. [2025-09-16T21:06:13.998433] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-04. [2025-09-16T21:06:14.356710] [DEBUG] [VALIDATOR ] WPP: All expected trading days are present. [2025-09-16T21:06:14.356936] [DEBUG] [VALIDATOR ] WPP: Primary data validation passed. [2025-09-16T21:06:14.358036] [INFO ] [MAIN ] WPP: Fetched primary data is valid. [2025-09-16T21:06:14.358114] [DEBUG] [LOCAL ] WPP: Saving primary data. [2025-09-16T21:06:14.359350] [DEBUG] [LOCAL ] WPP: Trimmed 35526 records to 24838 (keeping 150 days of data) [2025-09-16T21:06:14.492405] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-04 (2.92 seconds). [2025-09-16T21:06:14.553257] [DEBUG] [LOCAL ] WPP: Primary data saved (24838 records). [2025-09-16T21:06:14.553394] [INFO ] [MAIN ] WPP: Full history saved. [2025-09-16T21:06:14.553480] [INFO ] [MAIN ] Update Progress: 2316/2369 symbols completed. WPP took 19.7s. Estimated remaining: 5m 38s. Rate: 9.4 symbols/min [2025-09-16T21:06:14.733800] [INFO ] [MAIN ] WSM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:06:14.771845] [DEBUG] [LOCAL ] WSM: Loaded 36548 existing records from primary storage. [2025-09-16T21:06:14.772009] [INFO ] [MAIN ] WSM: Loaded 36548 existing records. [2025-09-16T21:06:14.803499] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-05. [2025-09-16T21:06:14.952537] [WARN ] [MAIN ] WSM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:06:14.952915] [INFO ] [MAIN ] WSM: Wiping existing primary data before full refresh. [2025-09-16T21:06:14.953002] [INFO ] [LOCAL ] WSM: Starting deletion of primary data. [2025-09-16T21:06:14.960382] [DEBUG] [LOCAL ] WSM: Deleted primary data file. [2025-09-16T21:06:14.971568] [INFO ] [MAIN ] WSM: Starting full primary refresh. [2025-09-16T21:06:14.978188] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-16T21:06:15.339583] [INFO ] [REMOTE ] WSM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:06:15.574903] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-04. [2025-09-16T21:06:15.861357] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-16T21:06:16.374897] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-05. [2025-09-16T21:06:16.793898] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-16T21:06:16.886765] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-16T21:06:17.174913] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-05. [2025-09-16T21:06:17.979996] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-02. [2025-09-16T21:06:17.994571] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-16T21:06:18.132934] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-16T21:06:18.774900] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-06. [2025-09-16T21:06:19.574949] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-06. [2025-09-16T21:06:19.710247] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-16T21:06:20.374908] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-03. [2025-09-16T21:06:20.437465] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-16T21:06:20.657635] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-16T21:06:21.174903] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-07. [2025-09-16T21:06:21.974868] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-07. [2025-09-16T21:06:22.545291] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-16T21:06:22.774900] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-06. [2025-09-16T21:06:23.057824] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-16T21:06:23.195480] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-16T21:06:23.574901] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-08. [2025-09-16T21:06:24.374869] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-08. [2025-09-16T21:06:24.511497] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-16T21:06:24.732365] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-16T21:06:25.174893] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-04. [2025-09-16T21:06:25.974899] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-07. [2025-09-16T21:06:26.034279] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-16T21:06:26.774985] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-09. [2025-09-16T21:06:27.018091] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-16T21:06:27.574882] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-05. [2025-09-16T21:06:27.684017] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-16T21:06:27.687798] [INFO ] [REMOTE ] WS: Full fetch complete (26292 records). [2025-09-16T21:06:27.687876] [DEBUG] [VALIDATOR ] WS: Validating primary data. [2025-09-16T21:06:28.074323] [DEBUG] [VALIDATOR ] WS: All expected trading days are present. [2025-09-16T21:06:28.074493] [DEBUG] [VALIDATOR ] WS: Primary data validation passed. [2025-09-16T21:06:28.075138] [INFO ] [MAIN ] WS: Fetched primary data is valid. [2025-09-16T21:06:28.075199] [DEBUG] [LOCAL ] WS: Saving primary data. [2025-09-16T21:06:28.089301] [DEBUG] [LOCAL ] WS: Trimmed 26292 records to 16884 (keeping 150 days of data) [2025-09-16T21:06:28.108984] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-16T21:06:28.228715] [DEBUG] [LOCAL ] WS: Primary data saved (16884 records). [2025-09-16T21:06:28.228877] [INFO ] [MAIN ] WS: Full history saved. [2025-09-16T21:06:28.228981] [INFO ] [MAIN ] Update Progress: 2317/2369 symbols completed. WS took 19.9s. Estimated remaining: 5m 32s. Rate: 9.4 symbols/min [2025-09-16T21:06:28.374913] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-09. [2025-09-16T21:06:29.174937] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-08. [2025-09-16T21:06:29.509175] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-16T21:06:29.628960] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-16T21:06:29.635266] [INFO ] [REMOTE ] WRB: Full fetch complete (54997 records). [2025-09-16T21:06:29.635395] [DEBUG] [VALIDATOR ] WRB: Validating primary data. [2025-09-16T21:06:29.984047] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-06. [2025-09-16T21:06:30.018564] [DEBUG] [VALIDATOR ] WRB: All expected trading days are present. [2025-09-16T21:06:30.018633] [DEBUG] [VALIDATOR ] WRB: Primary data validation passed. [2025-09-16T21:06:30.019603] [INFO ] [MAIN ] WRB: Fetched primary data is valid. [2025-09-16T21:06:30.019668] [DEBUG] [LOCAL ] WRB: Saving primary data. [2025-09-16T21:06:30.022301] [DEBUG] [LOCAL ] WRB: Trimmed 54997 records to 37551 (keeping 150 days of data) [2025-09-16T21:06:30.253413] [DEBUG] [LOCAL ] WRB: Primary data saved (37551 records). [2025-09-16T21:06:30.253553] [INFO ] [MAIN ] WRB: Full history saved. [2025-09-16T21:06:30.253669] [INFO ] [MAIN ] Update Progress: 2318/2369 symbols completed. WRB took 28.1s. Estimated remaining: 5m 25s. Rate: 9.4 symbols/min [2025-09-16T21:06:30.857441] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-16T21:06:30.868136] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-09. [2025-09-16T21:06:31.581788] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-16T21:06:31.592668] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-07. [2025-09-16T21:06:32.469164] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-16T21:06:32.475326] [INFO ] [REMOTE ] WRBY: Full fetch complete (55297 records). [2025-09-16T21:06:32.475422] [DEBUG] [VALIDATOR ] WRBY: Validating primary data. [2025-09-16T21:06:32.857934] [DEBUG] [VALIDATOR ] WRBY: All expected trading days are present. [2025-09-16T21:06:32.858036] [DEBUG] [VALIDATOR ] WRBY: Primary data validation passed. [2025-09-16T21:06:32.859082] [INFO ] [MAIN ] WRBY: Fetched primary data is valid. [2025-09-16T21:06:32.859152] [DEBUG] [LOCAL ] WRBY: Saving primary data. [2025-09-16T21:06:32.861374] [DEBUG] [LOCAL ] WRBY: Trimmed 55297 records to 37611 (keeping 150 days of data) [2025-09-16T21:06:33.088199] [DEBUG] [LOCAL ] WRBY: Primary data saved (37611 records). [2025-09-16T21:06:33.088341] [INFO ] [MAIN ] WRBY: Full history saved. [2025-09-16T21:06:33.089022] [INFO ] [MAIN ] Update Progress: 2319/2369 symbols completed. WRBY took 27.1s. Estimated remaining: 5m 19s. Rate: 9.4 symbols/min [2025-09-16T21:06:33.356349] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-16T21:06:33.367795] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-08. [2025-09-16T21:06:35.193225] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-16T21:06:35.204123] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-09. [2025-09-16T21:06:36.841381] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-16T21:06:36.847218] [INFO ] [REMOTE ] WSM: Full fetch complete (54381 records). [2025-09-16T21:06:36.847329] [DEBUG] [VALIDATOR ] WSM: Validating primary data. [2025-09-16T21:06:37.245388] [DEBUG] [VALIDATOR ] WSM: All expected trading days are present. [2025-09-16T21:06:37.245472] [DEBUG] [VALIDATOR ] WSM: Primary data validation passed. [2025-09-16T21:06:37.246544] [INFO ] [MAIN ] WSM: Fetched primary data is valid. [2025-09-16T21:06:37.246590] [DEBUG] [LOCAL ] WSM: Saving primary data. [2025-09-16T21:06:37.250413] [DEBUG] [LOCAL ] WSM: Trimmed 54381 records to 36902 (keeping 150 days of data) [2025-09-16T21:06:37.482876] [DEBUG] [LOCAL ] WSM: Primary data saved (36902 records). [2025-09-16T21:06:37.483013] [INFO ] [MAIN ] WSM: Full history saved. [2025-09-16T21:06:37.483719] [INFO ] [MAIN ] Update Progress: 2320/2369 symbols completed. WSM took 22.9s. Estimated remaining: 5m 12s. Rate: 9.4 symbols/min [2025-09-16T21:06:38.061146] [INFO ] [MAIN ] WSR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:06:38.084159] [INFO ] [MAIN ] WST: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:06:38.175725] [INFO ] [MAIN ] WSO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:06:38.197747] [INFO ] [MAIN ] WT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:06:38.214048] [DEBUG] [LOCAL ] WSR: Loaded 16664 existing records from primary storage. [2025-09-16T21:06:38.214288] [INFO ] [MAIN ] WSR: Loaded 16664 existing records. [2025-09-16T21:06:38.393981] [DEBUG] [LOCAL ] WSO: Loaded 18371 existing records from primary storage. [2025-09-16T21:06:38.430045] [WARN ] [MAIN ] WSR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:06:38.431959] [INFO ] [MAIN ] WSR: Wiping existing primary data before full refresh. [2025-09-16T21:06:38.431835] [DEBUG] [LOCAL ] WST: Loaded 26781 existing records from primary storage. [2025-09-16T21:06:38.430135] [INFO ] [MAIN ] WSO: Loaded 18371 existing records. [2025-09-16T21:06:38.432141] [INFO ] [LOCAL ] WSR: Starting deletion of primary data. [2025-09-16T21:06:38.437614] [INFO ] [MAIN ] WST: Loaded 26781 existing records. [2025-09-16T21:06:38.473568] [DEBUG] [LOCAL ] WSR: Deleted primary data file. [2025-09-16T21:06:38.519424] [INFO ] [MAIN ] WSR: Starting full primary refresh. [2025-09-16T21:06:38.548035] [DEBUG] [LOCAL ] WT: Loaded 34911 existing records from primary storage. [2025-09-16T21:06:38.611919] [INFO ] [MAIN ] WT: Loaded 34911 existing records. [2025-09-16T21:06:38.986478] [WARN ] [MAIN ] WSO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:06:39.044770] [WARN ] [MAIN ] WST: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:06:39.050899] [INFO ] [MAIN ] WST: Wiping existing primary data before full refresh. [2025-09-16T21:06:39.051047] [INFO ] [MAIN ] WSO: Wiping existing primary data before full refresh. [2025-09-16T21:06:39.071744] [INFO ] [LOCAL ] WSO: Starting deletion of primary data. [2025-09-16T21:06:39.071804] [INFO ] [LOCAL ] WST: Starting deletion of primary data. [2025-09-16T21:06:39.195526] [DEBUG] [LOCAL ] WSO: Deleted primary data file. [2025-09-16T21:06:39.227271] [DEBUG] [LOCAL ] WST: Deleted primary data file. [2025-09-16T21:06:39.249115] [INFO ] [MAIN ] WSO: Starting full primary refresh. [2025-09-16T21:06:39.239723] [INFO ] [MAIN ] WST: Starting full primary refresh. [2025-09-16T21:06:39.350386] [WARN ] [MAIN ] WT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:06:39.468839] [INFO ] [MAIN ] WT: Wiping existing primary data before full refresh. [2025-09-16T21:06:39.502457] [INFO ] [LOCAL ] WT: Starting deletion of primary data. [2025-09-16T21:06:39.578926] [DEBUG] [LOCAL ] WT: Deleted primary data file. [2025-09-16T21:06:39.653550] [INFO ] [MAIN ] WT: Starting full primary refresh. [2025-09-16T21:06:39.658151] [INFO ] [REMOTE ] WSR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:06:39.739846] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-02. [2025-09-16T21:06:40.157753] [INFO ] [REMOTE ] WSO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:06:40.197848] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-02. [2025-09-16T21:06:40.448976] [INFO ] [REMOTE ] WST: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:06:40.453051] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-02. [2025-09-16T21:06:40.537406] [INFO ] [REMOTE ] WT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:06:40.538028] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-02. [2025-09-16T21:06:40.977752] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-16T21:06:40.982010] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-03. [2025-09-16T21:06:41.524570] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-16T21:06:41.529710] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-03. [2025-09-16T21:06:41.896564] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-16T21:06:41.905360] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-03. [2025-09-16T21:06:42.153249] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-16T21:06:42.161571] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-03. [2025-09-16T21:06:42.178433] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-16T21:06:42.184025] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-04. [2025-09-16T21:06:42.879109] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-16T21:06:42.885036] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-04. [2025-09-16T21:06:43.371561] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-16T21:06:43.377284] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-05. [2025-09-16T21:06:43.604523] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-16T21:06:43.614680] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-04. [2025-09-16T21:06:43.937945] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-16T21:06:43.947330] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-04. [2025-09-16T21:06:44.183076] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-16T21:06:44.374929] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-05. [2025-09-16T21:06:44.436428] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-16T21:06:44.926760] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-16T21:06:45.174946] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-05. [2025-09-16T21:06:45.773785] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-16T21:06:45.819966] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-16T21:06:45.974937] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-05. [2025-09-16T21:06:46.733290] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-16T21:06:46.774869] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-06. [2025-09-16T21:06:47.478400] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-16T21:06:47.574852] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-06. [2025-09-16T21:06:48.086859] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-16T21:06:48.374937] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-06. [2025-09-16T21:06:49.023263] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-16T21:06:49.174956] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-07. [2025-09-16T21:06:49.254727] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-16T21:06:49.974952] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-06. [2025-09-16T21:06:50.754617] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-16T21:06:50.774854] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-07. [2025-09-16T21:06:50.975669] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-16T21:06:51.574870] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-07. [2025-09-16T21:06:51.664093] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-16T21:06:52.374918] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-08. [2025-09-16T21:06:53.174912] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-07. [2025-09-16T21:06:53.387398] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-16T21:06:53.688555] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-16T21:06:53.974910] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-09. [2025-09-16T21:06:54.482854] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-16T21:06:54.774885] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-08. [2025-09-16T21:06:55.127267] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-16T21:06:55.131431] [INFO ] [REMOTE ] WST: Full fetch complete (42273 records). [2025-09-16T21:06:55.131553] [DEBUG] [VALIDATOR ] WST: Validating primary data. [2025-09-16T21:06:55.551864] [DEBUG] [VALIDATOR ] WST: All expected trading days are present. [2025-09-16T21:06:55.551950] [DEBUG] [VALIDATOR ] WST: Primary data validation passed. [2025-09-16T21:06:55.552825] [INFO ] [MAIN ] WST: Fetched primary data is valid. [2025-09-16T21:06:55.552903] [DEBUG] [LOCAL ] WST: Saving primary data. [2025-09-16T21:06:55.553944] [DEBUG] [LOCAL ] WST: Trimmed 42273 records to 27018 (keeping 150 days of data) [2025-09-16T21:06:55.617337] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-08. [2025-09-16T21:06:55.736616] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-16T21:06:55.752685] [DEBUG] [LOCAL ] WST: Primary data saved (27018 records). [2025-09-16T21:06:55.752773] [INFO ] [MAIN ] WST: Full history saved. [2025-09-16T21:06:55.752846] [INFO ] [MAIN ] Update Progress: 2321/2369 symbols completed. WST took 18.2s. Estimated remaining: 5m 6s. Rate: 9.4 symbols/min [2025-09-16T21:06:55.922140] [INFO ] [MAIN ] WTI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:06:55.956198] [DEBUG] [LOCAL ] WTI: Loaded 32570 existing records from primary storage. [2025-09-16T21:06:55.956384] [INFO ] [MAIN ] WTI: Loaded 32570 existing records. [2025-09-16T21:06:56.130723] [WARN ] [MAIN ] WTI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:06:56.130936] [INFO ] [MAIN ] WTI: Wiping existing primary data before full refresh. [2025-09-16T21:06:56.130982] [INFO ] [LOCAL ] WTI: Starting deletion of primary data. [2025-09-16T21:06:56.131781] [DEBUG] [LOCAL ] WTI: Deleted primary data file. [2025-09-16T21:06:56.131831] [INFO ] [MAIN ] WTI: Starting full primary refresh. [2025-09-16T21:06:56.381488] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-08. [2025-09-16T21:06:56.484441] [INFO ] [REMOTE ] WTI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:06:57.174945] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-09. [2025-09-16T21:06:57.340178] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-16T21:06:57.550321] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-16T21:06:57.974940] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-09. [2025-09-16T21:06:58.083371] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-16T21:06:58.087633] [INFO ] [REMOTE ] WSO: Full fetch complete (26983 records). [2025-09-16T21:06:58.087814] [DEBUG] [VALIDATOR ] WSO: Validating primary data. [2025-09-16T21:06:58.473268] [DEBUG] [VALIDATOR ] WSO: All expected trading days are present. [2025-09-16T21:06:58.473375] [DEBUG] [VALIDATOR ] WSO: Primary data validation passed. [2025-09-16T21:06:58.474272] [INFO ] [MAIN ] WSO: Fetched primary data is valid. [2025-09-16T21:06:58.474326] [DEBUG] [LOCAL ] WSO: Saving primary data. [2025-09-16T21:06:58.475240] [DEBUG] [LOCAL ] WSO: Trimmed 26983 records to 18610 (keeping 150 days of data) [2025-09-16T21:06:58.604245] [DEBUG] [LOCAL ] WSO: Primary data saved (18610 records). [2025-09-16T21:06:58.604464] [INFO ] [MAIN ] WSO: Full history saved. [2025-09-16T21:06:58.604586] [INFO ] [MAIN ] Update Progress: 2322/2369 symbols completed. WSO took 21.1s. Estimated remaining: 4m 60s. Rate: 9.4 symbols/min [2025-09-16T21:06:58.780313] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-02. [2025-09-16T21:06:58.783224] [INFO ] [MAIN ] WTM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:06:58.784216] [DEBUG] [LOCAL ] WTM: No existing data file found in primary storage. [2025-09-16T21:06:58.784263] [WARN ] [MAIN ] WTM: No existing data found, performing full refresh instead. [2025-09-16T21:06:58.784395] [INFO ] [MAIN ] WTM: Wiping existing primary data before full refresh. [2025-09-16T21:06:58.784445] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-09-16T21:06:58.784488] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-09-16T21:06:58.784524] [INFO ] [MAIN ] WTM: Starting full primary refresh. [2025-09-16T21:06:59.152429] [INFO ] [REMOTE ] WTM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:06:59.574976] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-02. [2025-09-16T21:06:59.655257] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-16T21:06:59.664888] [INFO ] [REMOTE ] WT: Full fetch complete (51546 records). [2025-09-16T21:06:59.665162] [DEBUG] [VALIDATOR ] WT: Validating primary data. [2025-09-16T21:07:00.077396] [DEBUG] [VALIDATOR ] WT: All expected trading days are present. [2025-09-16T21:07:00.077516] [DEBUG] [VALIDATOR ] WT: Primary data validation passed. [2025-09-16T21:07:00.079175] [INFO ] [MAIN ] WT: Fetched primary data is valid. [2025-09-16T21:07:00.079229] [DEBUG] [LOCAL ] WT: Saving primary data. [2025-09-16T21:07:00.080799] [DEBUG] [LOCAL ] WT: Trimmed 51546 records to 35275 (keeping 150 days of data) [2025-09-16T21:07:00.154151] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-16T21:07:00.327011] [DEBUG] [LOCAL ] WT: Primary data saved (35275 records). [2025-09-16T21:07:00.327222] [INFO ] [MAIN ] WT: Full history saved. [2025-09-16T21:07:00.329086] [INFO ] [MAIN ] Update Progress: 2323/2369 symbols completed. WT took 22.8s. Estimated remaining: 4m 53s. Rate: 9.4 symbols/min [2025-09-16T21:07:00.384732] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-09. [2025-09-16T21:07:00.515263] [INFO ] [MAIN ] WTRG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:07:00.540436] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-16T21:07:00.585083] [DEBUG] [LOCAL ] WTRG: Loaded 37524 existing records from primary storage. [2025-09-16T21:07:00.585292] [INFO ] [MAIN ] WTRG: Loaded 37524 existing records. [2025-09-16T21:07:00.762132] [WARN ] [MAIN ] WTRG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:07:00.762495] [INFO ] [MAIN ] WTRG: Wiping existing primary data before full refresh. [2025-09-16T21:07:00.762544] [INFO ] [LOCAL ] WTRG: Starting deletion of primary data. [2025-09-16T21:07:00.763437] [DEBUG] [LOCAL ] WTRG: Deleted primary data file. [2025-09-16T21:07:00.763487] [INFO ] [MAIN ] WTRG: Starting full primary refresh. [2025-09-16T21:07:01.139037] [INFO ] [REMOTE ] WTRG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:07:01.174908] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-02. [2025-09-16T21:07:01.479108] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-16T21:07:01.481793] [INFO ] [REMOTE ] WSR: Full fetch complete (25129 records). [2025-09-16T21:07:01.481861] [DEBUG] [VALIDATOR ] WSR: Validating primary data. [2025-09-16T21:07:01.864987] [DEBUG] [VALIDATOR ] WSR: All expected trading days are present. [2025-09-16T21:07:01.865074] [DEBUG] [VALIDATOR ] WSR: Primary data validation passed. [2025-09-16T21:07:01.865602] [INFO ] [MAIN ] WSR: Fetched primary data is valid. [2025-09-16T21:07:01.865663] [DEBUG] [LOCAL ] WSR: Saving primary data. [2025-09-16T21:07:01.866460] [DEBUG] [LOCAL ] WSR: Trimmed 25129 records to 16799 (keeping 150 days of data) [2025-09-16T21:07:01.975166] [DEBUG] [LOCAL ] WSR: Primary data saved (16799 records). [2025-09-16T21:07:01.975324] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-03. [2025-09-16T21:07:01.975688] [INFO ] [MAIN ] WSR: Full history saved. [2025-09-16T21:07:01.975965] [INFO ] [MAIN ] Update Progress: 2324/2369 symbols completed. WSR took 24.5s. Estimated remaining: 4m 47s. Rate: 9.4 symbols/min [2025-09-16T21:07:02.150009] [INFO ] [MAIN ] WTS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:07:02.164771] [DEBUG] [LOCAL ] WTS: Loaded 13393 existing records from primary storage. [2025-09-16T21:07:02.164937] [INFO ] [MAIN ] WTS: Loaded 13393 existing records. [2025-09-16T21:07:02.340061] [WARN ] [MAIN ] WTS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:07:02.340354] [INFO ] [MAIN ] WTS: Wiping existing primary data before full refresh. [2025-09-16T21:07:02.340400] [INFO ] [LOCAL ] WTS: Starting deletion of primary data. [2025-09-16T21:07:02.340869] [DEBUG] [LOCAL ] WTS: Deleted primary data file. [2025-09-16T21:07:02.340918] [INFO ] [MAIN ] WTS: Starting full primary refresh. [2025-09-16T21:07:02.590460] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-16T21:07:02.707465] [INFO ] [REMOTE ] WTS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:07:02.767454] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-16T21:07:02.776781] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-03. [2025-09-16T21:07:03.574989] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-04. [2025-09-16T21:07:04.100991] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-16T21:07:04.171001] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-16T21:07:04.374984] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-03. [2025-09-16T21:07:05.174931] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-02. [2025-09-16T21:07:05.974876] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-04. [2025-09-16T21:07:06.302599] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-16T21:07:06.325543] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-16T21:07:06.774894] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-03. [2025-09-16T21:07:07.574948] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-05. [2025-09-16T21:07:07.733002] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-16T21:07:08.007558] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-16T21:07:08.016133] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-16T21:07:08.374948] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-06. [2025-09-16T21:07:08.914397] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-16T21:07:09.174913] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-04. [2025-09-16T21:07:09.974907] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-05. [2025-09-16T21:07:10.526234] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-16T21:07:10.774893] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-04. [2025-09-16T21:07:11.574889] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-07. [2025-09-16T21:07:11.849962] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-16T21:07:12.108328] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-16T21:07:12.374912] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-05. [2025-09-16T21:07:12.627013] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-16T21:07:13.174859] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-08. [2025-09-16T21:07:13.576285] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-16T21:07:13.974905] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-06. [2025-09-16T21:07:14.019722] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-16T21:07:14.774906] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-06. [2025-09-16T21:07:15.574886] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-09. [2025-09-16T21:07:15.637187] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-16T21:07:16.111190] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-16T21:07:16.124446] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-16T21:07:16.125726] [INFO ] [REMOTE ] WTM: Full fetch complete (1744 records). [2025-09-16T21:07:16.125807] [DEBUG] [VALIDATOR ] WTM: Validating primary data. [2025-09-16T21:07:16.318731] [WARN ] [VALIDATOR ] WTM: Validation failed - insufficient historical data. Have 149 unique days, need 150 days [2025-09-16T21:07:16.318917] [FATAL] [MAIN ] WTM: Fetched primary data is invalid. Refusing to save it. [2025-09-16T21:07:16.318967] [WARN ] [MAIN ] WTM: Deleting existing primary and derivative data due to validation failure. [2025-09-16T21:07:16.319020] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-09-16T21:07:16.319105] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-09-16T21:07:16.319149] [INFO ] [LOCAL ] WTM: Starting deletion of derivative data. [2025-09-16T21:07:16.319207] [DEBUG] [LOCAL ] WTM: No derivative data file found to delete. [2025-09-16T21:07:16.319270] [INFO ] [MAIN ] Update Progress: 2325/2369 symbols completed. WTM took 17.7s. Estimated remaining: 4m 41s. Rate: 9.4 symbols/min [2025-09-16T21:07:16.380052] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-05. [2025-09-16T21:07:16.512742] [INFO ] [MAIN ] WTTR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:07:16.545162] [DEBUG] [LOCAL ] WTTR: Loaded 32214 existing records from primary storage. [2025-09-16T21:07:16.545333] [INFO ] [MAIN ] WTTR: Loaded 32214 existing records. [2025-09-16T21:07:16.733754] [WARN ] [MAIN ] WTTR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:07:16.734029] [INFO ] [MAIN ] WTTR: Wiping existing primary data before full refresh. [2025-09-16T21:07:16.734089] [INFO ] [LOCAL ] WTTR: Starting deletion of primary data. [2025-09-16T21:07:16.734732] [DEBUG] [LOCAL ] WTTR: Deleted primary data file. [2025-09-16T21:07:16.734785] [INFO ] [MAIN ] WTTR: Starting full primary refresh. [2025-09-16T21:07:17.109918] [INFO ] [REMOTE ] WTTR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:07:17.174868] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-02. [2025-09-16T21:07:17.890827] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-16T21:07:17.974905] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-06. [2025-09-16T21:07:18.482442] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-16T21:07:18.774920] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-07. [2025-09-16T21:07:19.420775] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-16T21:07:19.574951] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-07. [2025-09-16T21:07:20.246319] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-16T21:07:20.374915] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-03. [2025-09-16T21:07:20.791349] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-16T21:07:21.174914] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-08. [2025-09-16T21:07:21.974896] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-08. [2025-09-16T21:07:22.241434] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-16T21:07:22.772683] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-16T21:07:22.775858] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-04. [2025-09-16T21:07:23.155073] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-16T21:07:23.574905] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-09. [2025-09-16T21:07:24.374995] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-09. [2025-09-16T21:07:24.662322] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-16T21:07:25.014245] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-16T21:07:25.019026] [INFO ] [REMOTE ] WTI: Full fetch complete (47085 records). [2025-09-16T21:07:25.019120] [DEBUG] [VALIDATOR ] WTI: Validating primary data. [2025-09-16T21:07:25.180344] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-07. [2025-09-16T21:07:25.425765] [DEBUG] [VALIDATOR ] WTI: All expected trading days are present. [2025-09-16T21:07:25.425936] [DEBUG] [VALIDATOR ] WTI: Primary data validation passed. [2025-09-16T21:07:25.433494] [INFO ] [MAIN ] WTI: Fetched primary data is valid. [2025-09-16T21:07:25.434353] [DEBUG] [LOCAL ] WTI: Saving primary data. [2025-09-16T21:07:25.434940] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-16T21:07:25.438218] [INFO ] [REMOTE ] WTS: Full fetch complete (20411 records). [2025-09-16T21:07:25.438483] [DEBUG] [VALIDATOR ] WTS: Validating primary data. [2025-09-16T21:07:25.438774] [DEBUG] [LOCAL ] WTI: Trimmed 47085 records to 32866 (keeping 150 days of data) [2025-09-16T21:07:25.994540] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-05. [2025-09-16T21:07:26.053075] [DEBUG] [VALIDATOR ] WTS: All expected trading days are present. [2025-09-16T21:07:26.054688] [DEBUG] [VALIDATOR ] WTS: Primary data validation passed. [2025-09-16T21:07:26.056087] [DEBUG] [LOCAL ] WTI: Primary data saved (32866 records). [2025-09-16T21:07:26.056967] [INFO ] [MAIN ] WTS: Fetched primary data is valid. [2025-09-16T21:07:26.057156] [DEBUG] [LOCAL ] WTS: Saving primary data. [2025-09-16T21:07:26.057094] [INFO ] [MAIN ] WTI: Full history saved. [2025-09-16T21:07:26.058890] [INFO ] [MAIN ] Update Progress: 2326/2369 symbols completed. WTI took 30.3s. Estimated remaining: 4m 34s. Rate: 9.4 symbols/min [2025-09-16T21:07:26.129789] [DEBUG] [LOCAL ] WTS: Trimmed 20411 records to 13467 (keeping 150 days of data) [2025-09-16T21:07:26.304479] [INFO ] [MAIN ] WU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:07:26.327695] [DEBUG] [LOCAL ] WTS: Primary data saved (13467 records). [2025-09-16T21:07:26.327922] [INFO ] [MAIN ] WTS: Full history saved. [2025-09-16T21:07:26.328054] [INFO ] [MAIN ] Update Progress: 2327/2369 symbols completed. WTS took 24.4s. Estimated remaining: 4m 28s. Rate: 9.4 symbols/min [2025-09-16T21:07:26.534344] [INFO ] [MAIN ] WWW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:07:26.547511] [DEBUG] [LOCAL ] WU: Loaded 39483 existing records from primary storage. [2025-09-16T21:07:26.547816] [INFO ] [MAIN ] WU: Loaded 39483 existing records. [2025-09-16T21:07:26.740336] [WARN ] [MAIN ] WU: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:07:26.740603] [INFO ] [MAIN ] WU: Wiping existing primary data before full refresh. [2025-09-16T21:07:26.740675] [INFO ] [LOCAL ] WU: Starting deletion of primary data. [2025-09-16T21:07:26.741425] [DEBUG] [LOCAL ] WU: Deleted primary data file. [2025-09-16T21:07:26.741480] [INFO ] [MAIN ] WU: Starting full primary refresh. [2025-09-16T21:07:26.875911] [DEBUG] [LOCAL ] WWW: Loaded 36204 existing records from primary storage. [2025-09-16T21:07:26.896982] [INFO ] [MAIN ] WWW: Loaded 36204 existing records. [2025-09-16T21:07:27.284584] [WARN ] [MAIN ] WWW: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:07:27.343710] [INFO ] [REMOTE ] WU: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:07:27.344799] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-02. [2025-09-16T21:07:27.345880] [INFO ] [MAIN ] WWW: Wiping existing primary data before full refresh. [2025-09-16T21:07:27.346173] [INFO ] [LOCAL ] WWW: Starting deletion of primary data. [2025-09-16T21:07:27.347494] [DEBUG] [LOCAL ] WWW: Deleted primary data file. [2025-09-16T21:07:27.347573] [INFO ] [MAIN ] WWW: Starting full primary refresh. [2025-09-16T21:07:27.511144] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-09-16T21:07:27.587701] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-08. [2025-09-16T21:07:27.773485] [INFO ] [REMOTE ] WWW: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:07:27.799372] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-16T21:07:28.374936] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-02. [2025-09-16T21:07:28.943761] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-16T21:07:29.174912] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-03. [2025-09-16T21:07:29.407941] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-16T21:07:29.580244] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-16T21:07:29.974908] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-03. [2025-09-16T21:07:30.774902] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-06. [2025-09-16T21:07:31.094052] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-16T21:07:31.587597] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-04. [2025-09-16T21:07:31.622696] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-16T21:07:32.068812] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-16T21:07:32.374902] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-04. [2025-09-16T21:07:33.174857] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-07. [2025-09-16T21:07:33.368126] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-16T21:07:33.974942] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-05. [2025-09-16T21:07:34.030224] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-16T21:07:34.766050] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-16T21:07:34.774867] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-05. [2025-09-16T21:07:35.574990] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-08. [2025-09-16T21:07:35.606037] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-16T21:07:36.171298] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-16T21:07:36.374883] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-06. [2025-09-16T21:07:37.099835] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-16T21:07:37.174858] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-09. [2025-09-16T21:07:37.922339] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-16T21:07:37.974885] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-06. [2025-09-16T21:07:38.361955] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-16T21:07:38.367426] [INFO ] [REMOTE ] WTTR: Full fetch complete (49163 records). [2025-09-16T21:07:38.367526] [DEBUG] [VALIDATOR ] WTTR: Validating primary data. [2025-09-16T21:07:38.743662] [DEBUG] [VALIDATOR ] WTTR: All expected trading days are present. [2025-09-16T21:07:38.743814] [DEBUG] [VALIDATOR ] WTTR: Primary data validation passed. [2025-09-16T21:07:38.744871] [INFO ] [MAIN ] WTTR: Fetched primary data is valid. [2025-09-16T21:07:38.744925] [DEBUG] [LOCAL ] WTTR: Saving primary data. [2025-09-16T21:07:38.745971] [DEBUG] [LOCAL ] WTTR: Trimmed 49163 records to 32517 (keeping 150 days of data) [2025-09-16T21:07:38.801000] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-07. [2025-09-16T21:07:38.941541] [DEBUG] [LOCAL ] WTTR: Primary data saved (32517 records). [2025-09-16T21:07:38.941695] [INFO ] [MAIN ] WTTR: Full history saved. [2025-09-16T21:07:38.941782] [INFO ] [MAIN ] Update Progress: 2328/2369 symbols completed. WTTR took 22.6s. Estimated remaining: 4m 22s. Rate: 9.4 symbols/min [2025-09-16T21:07:39.111035] [INFO ] [MAIN ] WY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:07:39.111223] [DEBUG] [LOCAL ] WY: No existing data file found in primary storage. [2025-09-16T21:07:39.111260] [WARN ] [MAIN ] WY: No existing data found, performing full refresh instead. [2025-09-16T21:07:39.111381] [INFO ] [MAIN ] WY: Wiping existing primary data before full refresh. [2025-09-16T21:07:39.111423] [INFO ] [LOCAL ] WY: Starting deletion of primary data. [2025-09-16T21:07:39.111464] [DEBUG] [LOCAL ] WY: No primary data file found to delete. [2025-09-16T21:07:39.111505] [INFO ] [MAIN ] WY: Starting full primary refresh. [2025-09-16T21:07:39.465617] [INFO ] [REMOTE ] WY: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:07:39.574853] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-02. [2025-09-16T21:07:39.876826] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-16T21:07:40.374968] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-09. [2025-09-16T21:07:40.563471] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-16T21:07:41.174955] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-07. [2025-09-16T21:07:41.361336] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-16T21:07:41.740270] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-16T21:07:41.746718] [INFO ] [REMOTE ] WTRG: Full fetch complete (55397 records). [2025-09-16T21:07:41.746848] [DEBUG] [VALIDATOR ] WTRG: Validating primary data. [2025-09-16T21:07:41.982386] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-03. [2025-09-16T21:07:42.130814] [DEBUG] [VALIDATOR ] WTRG: All expected trading days are present. [2025-09-16T21:07:42.130890] [DEBUG] [VALIDATOR ] WTRG: Primary data validation passed. [2025-09-16T21:07:42.131845] [INFO ] [MAIN ] WTRG: Fetched primary data is valid. [2025-09-16T21:07:42.131890] [DEBUG] [LOCAL ] WTRG: Saving primary data. [2025-09-16T21:07:42.132980] [DEBUG] [LOCAL ] WTRG: Trimmed 55397 records to 37901 (keeping 150 days of data) [2025-09-16T21:07:42.369956] [DEBUG] [LOCAL ] WTRG: Primary data saved (37901 records). [2025-09-16T21:07:42.370228] [INFO ] [MAIN ] WTRG: Full history saved. [2025-09-16T21:07:42.370322] [INFO ] [MAIN ] Update Progress: 2329/2369 symbols completed. WTRG took 42.0s. Estimated remaining: 4m 15s. Rate: 9.4 symbols/min [2025-09-16T21:07:42.543103] [INFO ] [MAIN ] XFLT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:07:42.564163] [DEBUG] [LOCAL ] XFLT: Loaded 21402 existing records from primary storage. [2025-09-16T21:07:42.564309] [INFO ] [MAIN ] XFLT: Loaded 21402 existing records. [2025-09-16T21:07:42.744671] [WARN ] [MAIN ] XFLT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:07:42.744956] [INFO ] [MAIN ] XFLT: Wiping existing primary data before full refresh. [2025-09-16T21:07:42.745004] [INFO ] [LOCAL ] XFLT: Starting deletion of primary data. [2025-09-16T21:07:42.745796] [DEBUG] [LOCAL ] XFLT: Deleted primary data file. [2025-09-16T21:07:42.745845] [INFO ] [MAIN ] XFLT: Starting full primary refresh. [2025-09-16T21:07:42.788499] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-08. [2025-09-16T21:07:43.110184] [INFO ] [REMOTE ] XFLT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:07:43.161255] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-16T21:07:43.586733] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-02. [2025-09-16T21:07:43.592499] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-16T21:07:44.374907] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-04. [2025-09-16T21:07:44.551426] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-16T21:07:44.860326] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-16T21:07:45.174927] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-09. [2025-09-16T21:07:45.974906] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-03. [2025-09-16T21:07:46.223337] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-16T21:07:46.703001] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-16T21:07:46.709964] [INFO ] [REMOTE ] WWW: Full fetch complete (53474 records). [2025-09-16T21:07:46.710116] [DEBUG] [VALIDATOR ] WWW: Validating primary data. [2025-09-16T21:07:46.786160] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-05. [2025-09-16T21:07:47.105140] [DEBUG] [VALIDATOR ] WWW: All expected trading days are present. [2025-09-16T21:07:47.105217] [DEBUG] [VALIDATOR ] WWW: Primary data validation passed. [2025-09-16T21:07:47.106144] [INFO ] [MAIN ] WWW: Fetched primary data is valid. [2025-09-16T21:07:47.106187] [DEBUG] [LOCAL ] WWW: Saving primary data. [2025-09-16T21:07:47.107221] [DEBUG] [LOCAL ] WWW: Trimmed 53474 records to 36583 (keeping 150 days of data) [2025-09-16T21:07:47.331270] [DEBUG] [LOCAL ] WWW: Primary data saved (36583 records). [2025-09-16T21:07:47.331431] [INFO ] [MAIN ] WWW: Full history saved. [2025-09-16T21:07:47.331538] [INFO ] [MAIN ] Update Progress: 2330/2369 symbols completed. WWW took 21.0s. Estimated remaining: 4m 9s. Rate: 9.4 symbols/min [2025-09-16T21:07:47.545617] [INFO ] [MAIN ] XHR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:07:47.565032] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-16T21:07:47.574852] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-04. [2025-09-16T21:07:47.602274] [DEBUG] [LOCAL ] XHR: Loaded 32506 existing records from primary storage. [2025-09-16T21:07:47.602406] [INFO ] [MAIN ] XHR: Loaded 32506 existing records. [2025-09-16T21:07:47.778814] [WARN ] [MAIN ] XHR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:07:47.779077] [INFO ] [MAIN ] XHR: Wiping existing primary data before full refresh. [2025-09-16T21:07:47.779123] [INFO ] [LOCAL ] XHR: Starting deletion of primary data. [2025-09-16T21:07:47.779928] [DEBUG] [LOCAL ] XHR: Deleted primary data file. [2025-09-16T21:07:47.779983] [INFO ] [MAIN ] XHR: Starting full primary refresh. [2025-09-16T21:07:48.133896] [INFO ] [REMOTE ] XHR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:07:48.374901] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-02. [2025-09-16T21:07:48.796708] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-16T21:07:49.064138] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-16T21:07:49.174919] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-05. [2025-09-16T21:07:49.894180] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-16T21:07:49.974848] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-03. [2025-09-16T21:07:50.384973] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-16T21:07:50.774918] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-08. [2025-09-16T21:07:51.294000] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-16T21:07:51.574942] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-06. [2025-09-16T21:07:52.374902] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-06. [2025-09-16T21:07:52.752722] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-16T21:07:52.929441] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-16T21:07:53.174927] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-04. [2025-09-16T21:07:53.974905] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-07. [2025-09-16T21:07:54.261211] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-16T21:07:54.630633] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-16T21:07:54.774901] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-05. [2025-09-16T21:07:55.032455] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-16T21:07:55.574915] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-08. [2025-09-16T21:07:56.321427] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-16T21:07:56.374861] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-06. [2025-09-16T21:07:57.024703] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-16T21:07:57.174902] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-09. [2025-09-16T21:07:57.651764] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-16T21:07:57.974933] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-07. [2025-09-16T21:07:58.774933] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-09. [2025-09-16T21:07:58.976820] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-16T21:07:58.985533] [INFO ] [REMOTE ] WU: Full fetch complete (58099 records). [2025-09-16T21:07:58.985687] [DEBUG] [VALIDATOR ] WU: Validating primary data. [2025-09-16T21:07:59.378145] [DEBUG] [VALIDATOR ] WU: All expected trading days are present. [2025-09-16T21:07:59.378231] [DEBUG] [VALIDATOR ] WU: Primary data validation passed. [2025-09-16T21:07:59.379354] [INFO ] [MAIN ] WU: Fetched primary data is valid. [2025-09-16T21:07:59.379430] [DEBUG] [LOCAL ] WU: Saving primary data. [2025-09-16T21:07:59.380711] [DEBUG] [LOCAL ] WU: Trimmed 58099 records to 39873 (keeping 150 days of data) [2025-09-16T21:07:59.594560] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-07. [2025-09-16T21:07:59.630802] [DEBUG] [LOCAL ] WU: Primary data saved (39873 records). [2025-09-16T21:07:59.630980] [INFO ] [MAIN ] WU: Full history saved. [2025-09-16T21:07:59.631867] [INFO ] [MAIN ] Update Progress: 2331/2369 symbols completed. WU took 33.6s. Estimated remaining: 4m 3s. Rate: 9.4 symbols/min [2025-09-16T21:07:59.814302] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-16T21:07:59.856248] [INFO ] [MAIN ] XIFR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:07:59.892182] [DEBUG] [LOCAL ] XIFR: Loaded 32769 existing records from primary storage. [2025-09-16T21:07:59.892331] [INFO ] [MAIN ] XIFR: Loaded 32769 existing records. [2025-09-16T21:08:00.069169] [WARN ] [MAIN ] XIFR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:08:00.083090] [INFO ] [MAIN ] XIFR: Wiping existing primary data before full refresh. [2025-09-16T21:08:00.083889] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-09-16T21:08:00.084534] [DEBUG] [LOCAL ] XIFR: Deleted primary data file. [2025-09-16T21:08:00.084465] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-16T21:08:00.084737] [INFO ] [MAIN ] XIFR: Starting full primary refresh. [2025-09-16T21:08:00.153084] [INFO ] [REMOTE ] XFLT: Full fetch complete (32456 records). [2025-09-16T21:08:00.180058] [DEBUG] [VALIDATOR ] XFLT: Validating primary data. [2025-09-16T21:08:00.377918] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-08. [2025-09-16T21:08:00.790846] [INFO ] [REMOTE ] XIFR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:08:00.854394] [DEBUG] [VALIDATOR ] XFLT: All expected trading days are present. [2025-09-16T21:08:00.854485] [DEBUG] [VALIDATOR ] XFLT: Primary data validation passed. [2025-09-16T21:08:00.855190] [INFO ] [MAIN ] XFLT: Fetched primary data is valid. [2025-09-16T21:08:00.855246] [DEBUG] [LOCAL ] XFLT: Saving primary data. [2025-09-16T21:08:00.856180] [DEBUG] [LOCAL ] XFLT: Trimmed 32456 records to 21740 (keeping 150 days of data) [2025-09-16T21:08:00.988905] [DEBUG] [LOCAL ] XFLT: Primary data saved (21740 records). [2025-09-16T21:08:00.989050] [INFO ] [MAIN ] XFLT: Full history saved. [2025-09-16T21:08:00.989141] [INFO ] [MAIN ] Update Progress: 2332/2369 symbols completed. XFLT took 18.6s. Estimated remaining: 3m 56s. Rate: 9.4 symbols/min [2025-09-16T21:08:01.160984] [INFO ] [MAIN ] XOM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:08:01.161201] [DEBUG] [LOCAL ] XOM: No existing data file found in primary storage. [2025-09-16T21:08:01.161246] [WARN ] [MAIN ] XOM: No existing data found, performing full refresh instead. [2025-09-16T21:08:01.161545] [INFO ] [MAIN ] XOM: Wiping existing primary data before full refresh. [2025-09-16T21:08:01.161594] [INFO ] [LOCAL ] XOM: Starting deletion of primary data. [2025-09-16T21:08:01.161736] [DEBUG] [LOCAL ] XOM: No primary data file found to delete. [2025-09-16T21:08:01.161800] [INFO ] [MAIN ] XOM: Starting full primary refresh. [2025-09-16T21:08:01.182499] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-02. [2025-09-16T21:08:01.432387] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-16T21:08:01.560317] [INFO ] [REMOTE ] XOM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:08:01.974914] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-02. [2025-09-16T21:08:02.546933] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-16T21:08:02.774925] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-09. [2025-09-16T21:08:03.023633] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-16T21:08:03.511759] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-16T21:08:03.518425] [INFO ] [REMOTE ] WY: Full fetch complete (57324 records). [2025-09-16T21:08:03.518601] [DEBUG] [VALIDATOR ] WY: Validating primary data. [2025-09-16T21:08:03.519445] [FATAL] [VALIDATOR ] WY: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T21:08:03.519539] [FATAL] [MAIN ] WY: Fetched primary data is invalid. Refusing to save it. [2025-09-16T21:08:03.519580] [WARN ] [MAIN ] WY: Deleting existing primary and derivative data due to validation failure. [2025-09-16T21:08:03.519621] [INFO ] [LOCAL ] WY: Starting deletion of primary data. [2025-09-16T21:08:03.519727] [DEBUG] [LOCAL ] WY: No primary data file found to delete. [2025-09-16T21:08:03.519814] [INFO ] [LOCAL ] WY: Starting deletion of derivative data. [2025-09-16T21:08:03.519895] [DEBUG] [LOCAL ] WY: No derivative data file found to delete. [2025-09-16T21:08:03.519972] [INFO ] [MAIN ] Update Progress: 2333/2369 symbols completed. WY took 24.6s. Estimated remaining: 3m 50s. Rate: 9.4 symbols/min [2025-09-16T21:08:03.584269] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-08. [2025-09-16T21:08:03.703326] [INFO ] [MAIN ] XPER: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:08:03.722840] [DEBUG] [LOCAL ] XPER: Loaded 21716 existing records from primary storage. [2025-09-16T21:08:03.722961] [INFO ] [MAIN ] XPER: Loaded 21716 existing records. [2025-09-16T21:08:03.897073] [WARN ] [MAIN ] XPER: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:08:03.897314] [INFO ] [MAIN ] XPER: Wiping existing primary data before full refresh. [2025-09-16T21:08:03.897359] [INFO ] [LOCAL ] XPER: Starting deletion of primary data. [2025-09-16T21:08:03.897899] [DEBUG] [LOCAL ] XPER: Deleted primary data file. [2025-09-16T21:08:03.897953] [INFO ] [MAIN ] XPER: Starting full primary refresh. [2025-09-16T21:08:04.253180] [INFO ] [REMOTE ] XPER: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:08:04.282812] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-09-16T21:08:04.374860] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-03. [2025-09-16T21:08:05.031036] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-16T21:08:05.174885] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-09. [2025-09-16T21:08:05.974920] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-02. [2025-09-16T21:08:06.306961] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-16T21:08:06.312138] [INFO ] [REMOTE ] XHR: Full fetch complete (48114 records). [2025-09-16T21:08:06.312252] [DEBUG] [VALIDATOR ] XHR: Validating primary data. [2025-09-16T21:08:06.697259] [DEBUG] [VALIDATOR ] XHR: All expected trading days are present. [2025-09-16T21:08:06.697347] [DEBUG] [VALIDATOR ] XHR: Primary data validation passed. [2025-09-16T21:08:06.698311] [INFO ] [MAIN ] XHR: Fetched primary data is valid. [2025-09-16T21:08:06.698454] [DEBUG] [LOCAL ] XHR: Saving primary data. [2025-09-16T21:08:06.699620] [DEBUG] [LOCAL ] XHR: Trimmed 48114 records to 32834 (keeping 150 days of data) [2025-09-16T21:08:06.781481] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-03. [2025-09-16T21:08:06.836818] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-09-16T21:08:06.949044] [DEBUG] [LOCAL ] XHR: Primary data saved (32834 records). [2025-09-16T21:08:06.949217] [INFO ] [MAIN ] XHR: Full history saved. [2025-09-16T21:08:06.949322] [INFO ] [MAIN ] Update Progress: 2334/2369 symbols completed. XHR took 19.6s. Estimated remaining: 3m 43s. Rate: 9.4 symbols/min [2025-09-16T21:08:07.117120] [INFO ] [MAIN ] XPEV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:08:07.155558] [DEBUG] [LOCAL ] XPEV: Loaded 39608 existing records from primary storage. [2025-09-16T21:08:07.155731] [INFO ] [MAIN ] XPEV: Loaded 39608 existing records. [2025-09-16T21:08:07.332952] [WARN ] [MAIN ] XPEV: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:08:07.333236] [INFO ] [MAIN ] XPEV: Wiping existing primary data before full refresh. [2025-09-16T21:08:07.333297] [INFO ] [LOCAL ] XPEV: Starting deletion of primary data. [2025-09-16T21:08:07.339613] [DEBUG] [LOCAL ] XPEV: Deleted primary data file. [2025-09-16T21:08:07.350148] [INFO ] [MAIN ] XPEV: Starting full primary refresh. [2025-09-16T21:08:07.382523] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-16T21:08:07.585327] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-03. [2025-09-16T21:08:07.711516] [INFO ] [REMOTE ] XPEV: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:08:08.308811] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-16T21:08:08.374896] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-04. [2025-09-16T21:08:08.527808] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-16T21:08:09.174925] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-02. [2025-09-16T21:08:09.974918] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-04. [2025-09-16T21:08:10.044153] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-16T21:08:10.774939] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-04. [2025-09-16T21:08:11.371467] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-16T21:08:11.494413] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-09-16T21:08:11.574945] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-05. [2025-09-16T21:08:12.374908] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-03. [2025-09-16T21:08:12.877594] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-16T21:08:13.174946] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-05. [2025-09-16T21:08:13.545250] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-04 (2.77 seconds). [2025-09-16T21:08:13.974901] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-05. [2025-09-16T21:08:14.755128] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-09-16T21:08:14.774853] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-04. [2025-09-16T21:08:14.806256] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-16T21:08:15.574915] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-06. [2025-09-16T21:08:16.374910] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-06. [2025-09-16T21:08:16.470861] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-09-16T21:08:17.153768] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-16T21:08:17.174862] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-07. [2025-09-16T21:08:17.258600] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-09-16T21:08:17.633559] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-16T21:08:17.974947] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-07. [2025-09-16T21:08:18.688592] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-16T21:08:18.774877] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-08. [2025-09-16T21:08:19.032127] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-16T21:08:19.574902] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-08. [2025-09-16T21:08:20.374896] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-06. [2025-09-16T21:08:20.476189] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-16T21:08:20.986399] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-16T21:08:21.174889] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-09. [2025-09-16T21:08:21.974903] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-09. [2025-09-16T21:08:22.591813] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-16T21:08:22.597343] [INFO ] [REMOTE ] XIFR: Full fetch complete (50265 records). [2025-09-16T21:08:22.597502] [DEBUG] [VALIDATOR ] XIFR: Validating primary data. [2025-09-16T21:08:22.782566] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-05. [2025-09-16T21:08:23.010670] [DEBUG] [VALIDATOR ] XIFR: All expected trading days are present. [2025-09-16T21:08:23.010833] [DEBUG] [VALIDATOR ] XIFR: Primary data validation passed. [2025-09-16T21:08:23.011782] [INFO ] [MAIN ] XIFR: Fetched primary data is valid. [2025-09-16T21:08:23.011838] [DEBUG] [LOCAL ] XIFR: Saving primary data. [2025-09-16T21:08:23.013087] [DEBUG] [LOCAL ] XIFR: Trimmed 50265 records to 33036 (keeping 150 days of data) [2025-09-16T21:08:23.130587] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-06 (2.76 seconds). [2025-09-16T21:08:23.257337] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-16T21:08:23.265676] [DEBUG] [LOCAL ] XIFR: Primary data saved (33036 records). [2025-09-16T21:08:23.263265] [INFO ] [REMOTE ] XPER: Full fetch complete (32454 records). [2025-09-16T21:08:23.265858] [DEBUG] [VALIDATOR ] XPER: Validating primary data. [2025-09-16T21:08:23.265912] [INFO ] [MAIN ] XIFR: Full history saved. [2025-09-16T21:08:23.266849] [INFO ] [MAIN ] Update Progress: 2335/2369 symbols completed. XIFR took 23.6s. Estimated remaining: 3m 37s. Rate: 9.4 symbols/min [2025-09-16T21:08:23.598669] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-07. [2025-09-16T21:08:23.601521] [INFO ] [MAIN ] XPO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:08:23.643735] [DEBUG] [LOCAL ] XPO: No existing data file found in primary storage. [2025-09-16T21:08:23.669294] [WARN ] [MAIN ] XPO: No existing data found, performing full refresh instead. [2025-09-16T21:08:23.739351] [INFO ] [MAIN ] XPO: Wiping existing primary data before full refresh. [2025-09-16T21:08:23.739490] [INFO ] [LOCAL ] XPO: Starting deletion of primary data. [2025-09-16T21:08:23.750286] [DEBUG] [LOCAL ] XPO: No primary data file found to delete. [2025-09-16T21:08:23.781079] [INFO ] [MAIN ] XPO: Starting full primary refresh. [2025-09-16T21:08:23.906683] [DEBUG] [VALIDATOR ] XPER: All expected trading days are present. [2025-09-16T21:08:23.928748] [DEBUG] [VALIDATOR ] XPER: Primary data validation passed. [2025-09-16T21:08:23.929754] [INFO ] [MAIN ] XPER: Fetched primary data is valid. [2025-09-16T21:08:23.935137] [DEBUG] [LOCAL ] XPER: Saving primary data. [2025-09-16T21:08:23.986429] [DEBUG] [LOCAL ] XPER: Trimmed 32454 records to 21940 (keeping 150 days of data) [2025-09-16T21:08:24.273520] [INFO ] [REMOTE ] XPO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:08:24.313772] [DEBUG] [LOCAL ] XPER: Primary data saved (21940 records). [2025-09-16T21:08:24.313919] [INFO ] [MAIN ] XPER: Full history saved. [2025-09-16T21:08:24.314019] [INFO ] [MAIN ] Update Progress: 2336/2369 symbols completed. XPER took 20.8s. Estimated remaining: 3m 31s. Rate: 9.4 symbols/min [2025-09-16T21:08:24.383552] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-02. [2025-09-16T21:08:24.486324] [INFO ] [MAIN ] XPOF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:08:24.513224] [DEBUG] [LOCAL ] XPOF: Loaded 28011 existing records from primary storage. [2025-09-16T21:08:24.513369] [INFO ] [MAIN ] XPOF: Loaded 28011 existing records. [2025-09-16T21:08:24.702070] [WARN ] [MAIN ] XPOF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:08:24.702380] [INFO ] [MAIN ] XPOF: Wiping existing primary data before full refresh. [2025-09-16T21:08:24.702430] [INFO ] [LOCAL ] XPOF: Starting deletion of primary data. [2025-09-16T21:08:24.702986] [DEBUG] [LOCAL ] XPOF: Deleted primary data file. [2025-09-16T21:08:24.703039] [INFO ] [MAIN ] XPOF: Starting full primary refresh. [2025-09-16T21:08:25.067417] [INFO ] [REMOTE ] XPOF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:08:25.174883] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-02. [2025-09-16T21:08:25.360529] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-05 (2.58 seconds). [2025-09-16T21:08:25.974902] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-06. [2025-09-16T21:08:26.214407] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-09-16T21:08:26.361998] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-16T21:08:26.525899] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-16T21:08:26.774901] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-03. [2025-09-16T21:08:27.574909] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-08. [2025-09-16T21:08:28.054609] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-16T21:08:28.374886] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-07. [2025-09-16T21:08:28.449205] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-16T21:08:28.586886] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-16T21:08:29.174908] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-09. [2025-09-16T21:08:29.939072] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-16T21:08:29.944940] [INFO ] [REMOTE ] XOM: Full fetch complete (58083 records). [2025-09-16T21:08:29.945075] [DEBUG] [VALIDATOR ] XOM: Validating primary data. [2025-09-16T21:08:29.945838] [FATAL] [VALIDATOR ] XOM: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T21:08:29.945918] [FATAL] [MAIN ] XOM: Fetched primary data is invalid. Refusing to save it. [2025-09-16T21:08:29.945978] [WARN ] [MAIN ] XOM: Deleting existing primary and derivative data due to validation failure. [2025-09-16T21:08:29.946041] [INFO ] [LOCAL ] XOM: Starting deletion of primary data. [2025-09-16T21:08:29.946102] [DEBUG] [LOCAL ] XOM: No primary data file found to delete. [2025-09-16T21:08:29.946150] [INFO ] [LOCAL ] XOM: Starting deletion of derivative data. [2025-09-16T21:08:29.946209] [DEBUG] [LOCAL ] XOM: No derivative data file found to delete. [2025-09-16T21:08:29.946295] [INFO ] [MAIN ] Update Progress: 2337/2369 symbols completed. XOM took 29.0s. Estimated remaining: 3m 24s. Rate: 9.4 symbols/min [2025-09-16T21:08:29.979974] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-03. [2025-09-16T21:08:30.125552] [INFO ] [MAIN ] XPRO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:08:30.162383] [DEBUG] [LOCAL ] XPRO: Loaded 33658 existing records from primary storage. [2025-09-16T21:08:30.163190] [INFO ] [MAIN ] XPRO: Loaded 33658 existing records. [2025-09-16T21:08:30.347120] [WARN ] [MAIN ] XPRO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:08:30.347833] [INFO ] [MAIN ] XPRO: Wiping existing primary data before full refresh. [2025-09-16T21:08:30.347990] [INFO ] [LOCAL ] XPRO: Starting deletion of primary data. [2025-09-16T21:08:30.348882] [DEBUG] [LOCAL ] XPRO: Deleted primary data file. [2025-09-16T21:08:30.348954] [INFO ] [MAIN ] XPRO: Starting full primary refresh. [2025-09-16T21:08:30.779255] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-16T21:08:30.785607] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-04. [2025-09-16T21:08:30.977713] [INFO ] [REMOTE ] XPRO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:08:31.574908] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-08. [2025-09-16T21:08:31.936245] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-16T21:08:32.255457] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-16T21:08:32.374913] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-02. [2025-09-16T21:08:33.174896] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-04. [2025-09-16T21:08:33.977670] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-05. [2025-09-16T21:08:34.010377] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-16T21:08:34.136392] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-08 (2.56 seconds). [2025-09-16T21:08:34.555576] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-16T21:08:34.774912] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-03. [2025-09-16T21:08:35.574908] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-05. [2025-09-16T21:08:35.865960] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-16T21:08:36.374894] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-06. [2025-09-16T21:08:36.489684] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-16T21:08:36.714384] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-16T21:08:37.174904] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-06. [2025-09-16T21:08:37.598997] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-16T21:08:37.974892] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-09. [2025-09-16T21:08:38.615766] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-16T21:08:38.774907] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-07. [2025-09-16T21:08:39.574949] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-04. [2025-09-16T21:08:40.374959] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-07. [2025-09-16T21:08:40.472528] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-09-16T21:08:40.479121] [INFO ] [REMOTE ] XPEV: Full fetch complete (58323 records). [2025-09-16T21:08:40.479253] [DEBUG] [VALIDATOR ] XPEV: Validating primary data. [2025-09-16T21:08:40.892871] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-16T21:08:40.916953] [DEBUG] [VALIDATOR ] XPEV: All expected trading days are present. [2025-09-16T21:08:40.917256] [DEBUG] [VALIDATOR ] XPEV: Primary data validation passed. [2025-09-16T21:08:40.918729] [INFO ] [MAIN ] XPEV: Fetched primary data is valid. [2025-09-16T21:08:40.919146] [DEBUG] [LOCAL ] XPEV: Saving primary data. [2025-09-16T21:08:40.920757] [DEBUG] [LOCAL ] XPEV: Trimmed 58323 records to 39998 (keeping 150 days of data) [2025-09-16T21:08:41.059684] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-16T21:08:41.182684] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-08. [2025-09-16T21:08:41.236773] [DEBUG] [LOCAL ] XPEV: Primary data saved (39998 records). [2025-09-16T21:08:41.236942] [INFO ] [MAIN ] XPEV: Full history saved. [2025-09-16T21:08:41.237050] [INFO ] [MAIN ] Update Progress: 2338/2369 symbols completed. XPEV took 34.3s. Estimated remaining: 3m 18s. Rate: 9.4 symbols/min [2025-09-16T21:08:41.411937] [INFO ] [MAIN ] XYF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:08:41.433500] [DEBUG] [LOCAL ] XYF: Loaded 21687 existing records from primary storage. [2025-09-16T21:08:41.433664] [INFO ] [MAIN ] XYF: Loaded 21687 existing records. [2025-09-16T21:08:41.618165] [WARN ] [MAIN ] XYF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:08:41.618567] [INFO ] [MAIN ] XYF: Wiping existing primary data before full refresh. [2025-09-16T21:08:41.618688] [INFO ] [LOCAL ] XYF: Starting deletion of primary data. [2025-09-16T21:08:41.619263] [DEBUG] [LOCAL ] XYF: Deleted primary data file. [2025-09-16T21:08:41.619312] [INFO ] [MAIN ] XYF: Starting full primary refresh. [2025-09-16T21:08:41.785249] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-16T21:08:41.980042] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-05. [2025-09-16T21:08:42.014317] [INFO ] [REMOTE ] XYF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:08:42.774958] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-08. [2025-09-16T21:08:42.978911] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-16T21:08:43.485092] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-16T21:08:43.574904] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-09. [2025-09-16T21:08:44.341174] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-16T21:08:44.346401] [INFO ] [REMOTE ] XPO: Full fetch complete (52185 records). [2025-09-16T21:08:44.346528] [DEBUG] [VALIDATOR ] XPO: Validating primary data. [2025-09-16T21:08:44.347196] [FATAL] [VALIDATOR ] XPO: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T21:08:44.347275] [FATAL] [MAIN ] XPO: Fetched primary data is invalid. Refusing to save it. [2025-09-16T21:08:44.347313] [WARN ] [MAIN ] XPO: Deleting existing primary and derivative data due to validation failure. [2025-09-16T21:08:44.347367] [INFO ] [LOCAL ] XPO: Starting deletion of primary data. [2025-09-16T21:08:44.347434] [DEBUG] [LOCAL ] XPO: No primary data file found to delete. [2025-09-16T21:08:44.347477] [INFO ] [LOCAL ] XPO: Starting deletion of derivative data. [2025-09-16T21:08:44.347528] [DEBUG] [LOCAL ] XPO: No derivative data file found to delete. [2025-09-16T21:08:44.347596] [INFO ] [MAIN ] Update Progress: 2339/2369 symbols completed. XPO took 21.1s. Estimated remaining: 3m 11s. Rate: 9.4 symbols/min [2025-09-16T21:08:44.379638] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-02. [2025-09-16T21:08:44.528030] [INFO ] [MAIN ] XYL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:08:44.528381] [DEBUG] [LOCAL ] XYL: No existing data file found in primary storage. [2025-09-16T21:08:44.528430] [WARN ] [MAIN ] XYL: No existing data found, performing full refresh instead. [2025-09-16T21:08:44.528609] [INFO ] [MAIN ] XYL: Wiping existing primary data before full refresh. [2025-09-16T21:08:44.528697] [INFO ] [LOCAL ] XYL: Starting deletion of primary data. [2025-09-16T21:08:44.528743] [DEBUG] [LOCAL ] XYL: No primary data file found to delete. [2025-09-16T21:08:44.528830] [INFO ] [MAIN ] XYL: Starting full primary refresh. [2025-09-16T21:08:44.696745] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-16T21:08:44.924956] [INFO ] [REMOTE ] XYL: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:08:45.174862] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-02. [2025-09-16T21:08:45.348968] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-16T21:08:45.974942] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-09. [2025-09-16T21:08:46.774914] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-03. [2025-09-16T21:08:46.926012] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-16T21:08:47.345945] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-16T21:08:47.350343] [INFO ] [REMOTE ] XPOF: Full fetch complete (41760 records). [2025-09-16T21:08:47.350463] [DEBUG] [VALIDATOR ] XPOF: Validating primary data. [2025-09-16T21:08:47.577625] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-03. [2025-09-16T21:08:47.739244] [DEBUG] [VALIDATOR ] XPOF: All expected trading days are present. [2025-09-16T21:08:47.739331] [DEBUG] [VALIDATOR ] XPOF: Primary data validation passed. [2025-09-16T21:08:47.740157] [INFO ] [MAIN ] XPOF: Fetched primary data is valid. [2025-09-16T21:08:47.740203] [DEBUG] [LOCAL ] XPOF: Saving primary data. [2025-09-16T21:08:47.741170] [DEBUG] [LOCAL ] XPOF: Trimmed 41760 records to 28233 (keeping 150 days of data) [2025-09-16T21:08:47.904345] [DEBUG] [LOCAL ] XPOF: Primary data saved (28233 records). [2025-09-16T21:08:47.904486] [INFO ] [MAIN ] XPOF: Full history saved. [2025-09-16T21:08:47.904581] [INFO ] [MAIN ] Update Progress: 2340/2369 symbols completed. XPOF took 23.6s. Estimated remaining: 3m 5s. Rate: 9.4 symbols/min [2025-09-16T21:08:48.074746] [INFO ] [MAIN ] XYZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:08:48.088252] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-16T21:08:48.127901] [DEBUG] [LOCAL ] XYZ: Loaded 39714 existing records from primary storage. [2025-09-16T21:08:48.128040] [INFO ] [MAIN ] XYZ: Loaded 39714 existing records. [2025-09-16T21:08:48.302570] [WARN ] [MAIN ] XYZ: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:08:48.302858] [INFO ] [MAIN ] XYZ: Wiping existing primary data before full refresh. [2025-09-16T21:08:48.302905] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-09-16T21:08:48.303752] [DEBUG] [LOCAL ] XYZ: Deleted primary data file. [2025-09-16T21:08:48.303802] [INFO ] [MAIN ] XYZ: Starting full primary refresh. [2025-09-16T21:08:48.380037] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-06. [2025-09-16T21:08:48.655831] [INFO ] [REMOTE ] XYZ: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:08:49.174983] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-04. [2025-09-16T21:08:49.480725] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-16T21:08:49.669770] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-16T21:08:49.975000] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-07. [2025-09-16T21:08:50.465265] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-16T21:08:50.774876] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-04. [2025-09-16T21:08:51.441005] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-16T21:08:51.574864] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-08. [2025-09-16T21:08:52.374904] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-02. [2025-09-16T21:08:52.773306] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-16T21:08:53.174912] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-05. [2025-09-16T21:08:53.269493] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-16T21:08:53.974909] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-05. [2025-09-16T21:08:54.111376] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-16T21:08:54.516077] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-16T21:08:54.774911] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-06. [2025-09-16T21:08:55.574904] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-03. [2025-09-16T21:08:55.604760] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-16T21:08:56.292035] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-16T21:08:56.374854] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-06. [2025-09-16T21:08:57.174899] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-09. [2025-09-16T21:08:57.974876] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-07. [2025-09-16T21:08:58.046929] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-09-16T21:08:58.167442] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-16T21:08:58.223275] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-16T21:08:58.230178] [INFO ] [REMOTE ] XPRO: Full fetch complete (49926 records). [2025-09-16T21:08:58.230323] [DEBUG] [VALIDATOR ] XPRO: Validating primary data. [2025-09-16T21:08:58.632152] [DEBUG] [VALIDATOR ] XPRO: All expected trading days are present. [2025-09-16T21:08:58.632233] [DEBUG] [VALIDATOR ] XPRO: Primary data validation passed. [2025-09-16T21:08:58.633174] [INFO ] [MAIN ] XPRO: Fetched primary data is valid. [2025-09-16T21:08:58.633220] [DEBUG] [LOCAL ] XPRO: Saving primary data. [2025-09-16T21:08:58.634851] [DEBUG] [LOCAL ] XPRO: Trimmed 49926 records to 34015 (keeping 150 days of data) [2025-09-16T21:08:58.793083] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-07. [2025-09-16T21:08:58.842996] [DEBUG] [LOCAL ] XPRO: Primary data saved (34015 records). [2025-09-16T21:08:58.843121] [INFO ] [MAIN ] XPRO: Full history saved. [2025-09-16T21:08:58.843220] [INFO ] [MAIN ] Update Progress: 2341/2369 symbols completed. XPRO took 28.9s. Estimated remaining: 2m 59s. Rate: 9.4 symbols/min [2025-09-16T21:08:59.011907] [INFO ] [MAIN ] YALA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:08:59.039998] [DEBUG] [LOCAL ] YALA: Loaded 28375 existing records from primary storage. [2025-09-16T21:08:59.040141] [INFO ] [MAIN ] YALA: Loaded 28375 existing records. [2025-09-16T21:08:59.218795] [WARN ] [MAIN ] YALA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:08:59.219030] [INFO ] [MAIN ] YALA: Wiping existing primary data before full refresh. [2025-09-16T21:08:59.219078] [INFO ] [LOCAL ] YALA: Starting deletion of primary data. [2025-09-16T21:08:59.219713] [DEBUG] [LOCAL ] YALA: Deleted primary data file. [2025-09-16T21:08:59.219776] [INFO ] [MAIN ] YALA: Starting full primary refresh. [2025-09-16T21:08:59.575058] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-04. [2025-09-16T21:08:59.605374] [INFO ] [REMOTE ] YALA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:08:59.626837] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-16T21:09:00.374916] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-08. [2025-09-16T21:09:00.639828] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-16T21:09:01.174952] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-08. [2025-09-16T21:09:01.975010] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-02. [2025-09-16T21:09:02.035251] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-16T21:09:02.553879] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-04 (2.98 seconds). [2025-09-16T21:09:02.774927] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-05. [2025-09-16T21:09:03.574915] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-09. [2025-09-16T21:09:03.696927] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-09-16T21:09:04.374912] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-09. [2025-09-16T21:09:04.958480] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-16T21:09:04.963907] [INFO ] [REMOTE ] XYL: Full fetch complete (52111 records). [2025-09-16T21:09:04.964020] [DEBUG] [VALIDATOR ] XYL: Validating primary data. [2025-09-16T21:09:04.964798] [FATAL] [VALIDATOR ] XYL: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T21:09:04.964883] [FATAL] [MAIN ] XYL: Fetched primary data is invalid. Refusing to save it. [2025-09-16T21:09:04.964921] [WARN ] [MAIN ] XYL: Deleting existing primary and derivative data due to validation failure. [2025-09-16T21:09:04.964961] [INFO ] [LOCAL ] XYL: Starting deletion of primary data. [2025-09-16T21:09:04.965022] [DEBUG] [LOCAL ] XYL: No primary data file found to delete. [2025-09-16T21:09:04.965060] [INFO ] [LOCAL ] XYL: Starting deletion of derivative data. [2025-09-16T21:09:04.965102] [DEBUG] [LOCAL ] XYL: No derivative data file found to delete. [2025-09-16T21:09:04.965163] [INFO ] [MAIN ] Update Progress: 2342/2369 symbols completed. XYL took 20.6s. Estimated remaining: 2m 52s. Rate: 9.4 symbols/min [2025-09-16T21:09:05.139851] [INFO ] [MAIN ] YELP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:09:05.182380] [DEBUG] [LOCAL ] YELP: Loaded 33170 existing records from primary storage. [2025-09-16T21:09:05.182522] [INFO ] [MAIN ] YELP: Loaded 33170 existing records. [2025-09-16T21:09:05.362496] [WARN ] [MAIN ] YELP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:09:05.362896] [INFO ] [MAIN ] YELP: Wiping existing primary data before full refresh. [2025-09-16T21:09:05.362974] [INFO ] [LOCAL ] YELP: Starting deletion of primary data. [2025-09-16T21:09:05.375269] [DEBUG] [LOCAL ] YELP: Deleted primary data file. [2025-09-16T21:09:05.376045] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-02 (3.40 seconds). [2025-09-16T21:09:05.376295] [INFO ] [MAIN ] YELP: Starting full primary refresh. [2025-09-16T21:09:05.386180] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-03. [2025-09-16T21:09:05.588757] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-16T21:09:05.656912] [INFO ] [REMOTE ] XYF: Full fetch complete (28841 records). [2025-09-16T21:09:05.684828] [DEBUG] [VALIDATOR ] XYF: Validating primary data. [2025-09-16T21:09:05.850177] [INFO ] [REMOTE ] YELP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:09:05.999225] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-02. [2025-09-16T21:09:06.084423] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-05 (3.31 seconds). [2025-09-16T21:09:06.191988] [DEBUG] [VALIDATOR ] XYF: All expected trading days are present. [2025-09-16T21:09:06.192069] [DEBUG] [VALIDATOR ] XYF: Primary data validation passed. [2025-09-16T21:09:06.192735] [INFO ] [MAIN ] XYF: Fetched primary data is valid. [2025-09-16T21:09:06.192780] [DEBUG] [LOCAL ] XYF: Saving primary data. [2025-09-16T21:09:06.193505] [DEBUG] [LOCAL ] XYF: Trimmed 28841 records to 21809 (keeping 150 days of data) [2025-09-16T21:09:06.323059] [DEBUG] [LOCAL ] XYF: Primary data saved (21809 records). [2025-09-16T21:09:06.323203] [INFO ] [MAIN ] XYF: Full history saved. [2025-09-16T21:09:06.323292] [INFO ] [MAIN ] Update Progress: 2343/2369 symbols completed. XYF took 25.1s. Estimated remaining: 2m 46s. Rate: 9.4 symbols/min [2025-09-16T21:09:06.493260] [INFO ] [MAIN ] YETI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:09:06.529417] [DEBUG] [LOCAL ] YETI: Loaded 39025 existing records from primary storage. [2025-09-16T21:09:06.529564] [INFO ] [MAIN ] YETI: Loaded 39025 existing records. [2025-09-16T21:09:06.715860] [WARN ] [MAIN ] YETI: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:09:06.716120] [INFO ] [MAIN ] YETI: Wiping existing primary data before full refresh. [2025-09-16T21:09:06.716217] [INFO ] [LOCAL ] YETI: Starting deletion of primary data. [2025-09-16T21:09:06.717124] [DEBUG] [LOCAL ] YETI: Deleted primary data file. [2025-09-16T21:09:06.717196] [INFO ] [MAIN ] YETI: Starting full primary refresh. [2025-09-16T21:09:06.784097] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-06. [2025-09-16T21:09:07.094758] [INFO ] [REMOTE ] YETI: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:09:07.113059] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-16T21:09:07.574886] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-04. [2025-09-16T21:09:07.638668] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-16T21:09:08.374934] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-02. [2025-09-16T21:09:09.015324] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-16T21:09:09.174913] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-07. [2025-09-16T21:09:09.320891] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-16T21:09:09.974913] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-05. [2025-09-16T21:09:10.167292] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-16T21:09:10.774901] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-03. [2025-09-16T21:09:11.426813] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-16T21:09:11.574863] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-03. [2025-09-16T21:09:11.695665] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-09-16T21:09:12.374914] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-06. [2025-09-16T21:09:13.174929] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-08. [2025-09-16T21:09:13.358500] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-09-16T21:09:13.901305] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-16T21:09:13.974860] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-04. [2025-09-16T21:09:14.138252] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-16T21:09:14.774912] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-07. [2025-09-16T21:09:15.580000] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-04. [2025-09-16T21:09:15.595789] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-09-16T21:09:15.768512] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-16T21:09:16.230904] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-16T21:09:16.374869] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-08. [2025-09-16T21:09:17.103846] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-16T21:09:17.174873] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-05. [2025-09-16T21:09:17.972817] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-16T21:09:17.980400] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-05. [2025-09-16T21:09:18.774906] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-09. [2025-09-16T21:09:19.035911] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-16T21:09:19.401550] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-16T21:09:19.575109] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-06. [2025-09-16T21:09:19.972668] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-16T21:09:19.977286] [INFO ] [REMOTE ] YALA: Full fetch complete (39157 records). [2025-09-16T21:09:19.977392] [DEBUG] [VALIDATOR ] YALA: Validating primary data. [2025-09-16T21:09:20.352468] [DEBUG] [VALIDATOR ] YALA: All expected trading days are present. [2025-09-16T21:09:20.352542] [DEBUG] [VALIDATOR ] YALA: Primary data validation passed. [2025-09-16T21:09:20.353310] [INFO ] [MAIN ] YALA: Fetched primary data is valid. [2025-09-16T21:09:20.353354] [DEBUG] [LOCAL ] YALA: Saving primary data. [2025-09-16T21:09:20.354273] [DEBUG] [LOCAL ] YALA: Trimmed 39157 records to 28536 (keeping 150 days of data) [2025-09-16T21:09:20.399699] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-06. [2025-09-16T21:09:20.519135] [DEBUG] [LOCAL ] YALA: Primary data saved (28536 records). [2025-09-16T21:09:20.519280] [INFO ] [MAIN ] YALA: Full history saved. [2025-09-16T21:09:20.519368] [INFO ] [MAIN ] Update Progress: 2344/2369 symbols completed. YALA took 21.7s. Estimated remaining: 2m 40s. Rate: 9.4 symbols/min [2025-09-16T21:09:20.698383] [INFO ] [MAIN ] YEXT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:09:20.728374] [DEBUG] [LOCAL ] YEXT: Loaded 31323 existing records from primary storage. [2025-09-16T21:09:20.728557] [INFO ] [MAIN ] YEXT: Loaded 31323 existing records. [2025-09-16T21:09:20.905974] [WARN ] [MAIN ] YEXT: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:09:20.906432] [INFO ] [MAIN ] YEXT: Wiping existing primary data before full refresh. [2025-09-16T21:09:20.906478] [INFO ] [LOCAL ] YEXT: Starting deletion of primary data. [2025-09-16T21:09:20.907410] [DEBUG] [LOCAL ] YEXT: Deleted primary data file. [2025-09-16T21:09:20.907460] [INFO ] [MAIN ] YEXT: Starting full primary refresh. [2025-09-16T21:09:21.175440] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-09. [2025-09-16T21:09:21.264591] [INFO ] [REMOTE ] YEXT: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:09:21.292574] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-16T21:09:21.926218] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-16T21:09:21.974888] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-07. [2025-09-16T21:09:22.774974] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-02. [2025-09-16T21:09:23.575053] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-07. [2025-09-16T21:09:23.642939] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-09-16T21:09:23.653042] [INFO ] [REMOTE ] XYZ: Full fetch complete (58431 records). [2025-09-16T21:09:23.653258] [DEBUG] [VALIDATOR ] XYZ: Validating primary data. [2025-09-16T21:09:24.119983] [DEBUG] [VALIDATOR ] XYZ: All expected trading days are present. [2025-09-16T21:09:24.120127] [DEBUG] [VALIDATOR ] XYZ: Primary data validation passed. [2025-09-16T21:09:24.121167] [INFO ] [MAIN ] XYZ: Fetched primary data is valid. [2025-09-16T21:09:24.121229] [DEBUG] [LOCAL ] XYZ: Saving primary data. [2025-09-16T21:09:24.122538] [DEBUG] [LOCAL ] XYZ: Trimmed 58431 records to 40104 (keeping 150 days of data) [2025-09-16T21:09:24.254637] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-16T21:09:24.392278] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-08. [2025-09-16T21:09:24.458665] [DEBUG] [LOCAL ] XYZ: Primary data saved (40104 records). [2025-09-16T21:09:24.459192] [INFO ] [MAIN ] XYZ: Full history saved. [2025-09-16T21:09:24.460168] [INFO ] [MAIN ] Update Progress: 2345/2369 symbols completed. XYZ took 36.6s. Estimated remaining: 2m 33s. Rate: 9.4 symbols/min [2025-09-16T21:09:24.460028] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-16T21:09:24.658289] [INFO ] [MAIN ] YMM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:09:24.699677] [DEBUG] [LOCAL ] YMM: Loaded 38810 existing records from primary storage. [2025-09-16T21:09:24.699861] [INFO ] [MAIN ] YMM: Loaded 38810 existing records. [2025-09-16T21:09:24.940753] [WARN ] [MAIN ] YMM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:09:24.941103] [INFO ] [MAIN ] YMM: Wiping existing primary data before full refresh. [2025-09-16T21:09:24.941213] [INFO ] [LOCAL ] YMM: Starting deletion of primary data. [2025-09-16T21:09:24.942074] [DEBUG] [LOCAL ] YMM: Deleted primary data file. [2025-09-16T21:09:24.942135] [INFO ] [MAIN ] YMM: Starting full primary refresh. [2025-09-16T21:09:25.121338] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-16T21:09:25.175588] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-03. [2025-09-16T21:09:25.372805] [INFO ] [REMOTE ] YMM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:09:25.974908] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-08. [2025-09-16T21:09:26.322553] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-16T21:09:26.463579] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-16T21:09:26.774908] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-04. [2025-09-16T21:09:27.574933] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-02. [2025-09-16T21:09:27.692783] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-16T21:09:28.265698] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-16T21:09:28.374879] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-09. [2025-09-16T21:09:28.991678] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-16T21:09:29.174891] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-09. [2025-09-16T21:09:29.717372] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-16T21:09:29.722814] [INFO ] [REMOTE ] YELP: Full fetch complete (49132 records). [2025-09-16T21:09:29.722897] [DEBUG] [VALIDATOR ] YELP: Validating primary data. [2025-09-16T21:09:29.982326] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-05. [2025-09-16T21:09:30.095124] [DEBUG] [VALIDATOR ] YELP: All expected trading days are present. [2025-09-16T21:09:30.095207] [DEBUG] [VALIDATOR ] YELP: Primary data validation passed. [2025-09-16T21:09:30.096148] [INFO ] [MAIN ] YELP: Fetched primary data is valid. [2025-09-16T21:09:30.096193] [DEBUG] [LOCAL ] YELP: Saving primary data. [2025-09-16T21:09:30.097206] [DEBUG] [LOCAL ] YELP: Trimmed 49132 records to 33499 (keeping 150 days of data) [2025-09-16T21:09:30.294909] [DEBUG] [LOCAL ] YELP: Primary data saved (33499 records). [2025-09-16T21:09:30.295039] [INFO ] [MAIN ] YELP: Full history saved. [2025-09-16T21:09:30.295961] [INFO ] [MAIN ] Update Progress: 2346/2369 symbols completed. YELP took 25.3s. Estimated remaining: 2m 27s. Rate: 9.4 symbols/min [2025-09-16T21:09:30.470244] [INFO ] [MAIN ] YOU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:09:30.509817] [DEBUG] [LOCAL ] YOU: Loaded 36560 existing records from primary storage. [2025-09-16T21:09:30.510052] [INFO ] [MAIN ] YOU: Loaded 36560 existing records. [2025-09-16T21:09:30.687370] [WARN ] [MAIN ] YOU: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:09:30.687760] [INFO ] [MAIN ] YOU: Wiping existing primary data before full refresh. [2025-09-16T21:09:30.687857] [INFO ] [LOCAL ] YOU: Starting deletion of primary data. [2025-09-16T21:09:30.694077] [DEBUG] [LOCAL ] YOU: Deleted primary data file. [2025-09-16T21:09:30.705527] [INFO ] [MAIN ] YOU: Starting full primary refresh. [2025-09-16T21:09:30.777274] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-03. [2025-09-16T21:09:30.790072] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-16T21:09:30.820169] [INFO ] [REMOTE ] YETI: Full fetch complete (57053 records). [2025-09-16T21:09:30.820688] [DEBUG] [VALIDATOR ] YETI: Validating primary data. [2025-09-16T21:09:31.344448] [INFO ] [REMOTE ] YOU: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:09:31.488172] [DEBUG] [VALIDATOR ] YETI: All expected trading days are present. [2025-09-16T21:09:31.488280] [DEBUG] [VALIDATOR ] YETI: Primary data validation passed. [2025-09-16T21:09:31.489480] [INFO ] [MAIN ] YETI: Fetched primary data is valid. [2025-09-16T21:09:31.489622] [DEBUG] [LOCAL ] YETI: Saving primary data. [2025-09-16T21:09:31.512719] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-16T21:09:31.512847] [DEBUG] [LOCAL ] YETI: Trimmed 57053 records to 39396 (keeping 150 days of data) [2025-09-16T21:09:31.581074] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-02. [2025-09-16T21:09:31.762277] [DEBUG] [LOCAL ] YETI: Primary data saved (39396 records). [2025-09-16T21:09:31.762452] [INFO ] [MAIN ] YETI: Full history saved. [2025-09-16T21:09:31.762566] [INFO ] [MAIN ] Update Progress: 2347/2369 symbols completed. YETI took 25.4s. Estimated remaining: 2m 20s. Rate: 9.4 symbols/min [2025-09-16T21:09:31.939126] [INFO ] [MAIN ] YPF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:09:31.974630] [DEBUG] [LOCAL ] YPF: Loaded 37011 existing records from primary storage. [2025-09-16T21:09:31.974795] [INFO ] [MAIN ] YPF: Loaded 37011 existing records. [2025-09-16T21:09:32.159714] [WARN ] [MAIN ] YPF: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:09:32.159990] [INFO ] [MAIN ] YPF: Wiping existing primary data before full refresh. [2025-09-16T21:09:32.160047] [INFO ] [LOCAL ] YPF: Starting deletion of primary data. [2025-09-16T21:09:32.160881] [DEBUG] [LOCAL ] YPF: Deleted primary data file. [2025-09-16T21:09:32.160950] [INFO ] [MAIN ] YPF: Starting full primary refresh. [2025-09-16T21:09:32.381424] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-06. [2025-09-16T21:09:32.540265] [INFO ] [REMOTE ] YPF: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:09:32.598381] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-16T21:09:33.174910] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-04. [2025-09-16T21:09:33.268380] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-16T21:09:33.967037] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-16T21:09:33.976065] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-02. [2025-09-16T21:09:34.774904] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-07. [2025-09-16T21:09:35.051603] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-16T21:09:35.574896] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-05. [2025-09-16T21:09:35.831722] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-16T21:09:36.301532] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-16T21:09:36.374898] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-08. [2025-09-16T21:09:37.088621] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-16T21:09:37.174898] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-03. [2025-09-16T21:09:37.974940] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-06. [2025-09-16T21:09:38.076452] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-16T21:09:38.774902] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-09. [2025-09-16T21:09:39.153083] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-16T21:09:39.574892] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-04. [2025-09-16T21:09:39.758079] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-16T21:09:40.046137] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-16T21:09:40.051681] [INFO ] [REMOTE ] YEXT: Full fetch complete (47023 records). [2025-09-16T21:09:40.051813] [DEBUG] [VALIDATOR ] YEXT: Validating primary data. [2025-09-16T21:09:40.383748] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-07. [2025-09-16T21:09:40.431112] [DEBUG] [VALIDATOR ] YEXT: All expected trading days are present. [2025-09-16T21:09:40.431219] [DEBUG] [VALIDATOR ] YEXT: Primary data validation passed. [2025-09-16T21:09:40.432136] [INFO ] [MAIN ] YEXT: Fetched primary data is valid. [2025-09-16T21:09:40.432192] [DEBUG] [LOCAL ] YEXT: Saving primary data. [2025-09-16T21:09:40.433234] [DEBUG] [LOCAL ] YEXT: Trimmed 47023 records to 31636 (keeping 150 days of data) [2025-09-16T21:09:40.617481] [DEBUG] [LOCAL ] YEXT: Primary data saved (31636 records). [2025-09-16T21:09:40.617620] [INFO ] [MAIN ] YEXT: Full history saved. [2025-09-16T21:09:40.617724] [INFO ] [MAIN ] Update Progress: 2348/2369 symbols completed. YEXT took 20.1s. Estimated remaining: 2m 14s. Rate: 9.4 symbols/min [2025-09-16T21:09:40.793633] [INFO ] [MAIN ] YRD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:09:40.802451] [DEBUG] [LOCAL ] YRD: Loaded 7931 existing records from primary storage. [2025-09-16T21:09:40.802575] [INFO ] [MAIN ] YRD: Loaded 7931 existing records. [2025-09-16T21:09:40.981329] [WARN ] [MAIN ] YRD: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:09:40.981573] [INFO ] [MAIN ] YRD: Wiping existing primary data before full refresh. [2025-09-16T21:09:40.981620] [INFO ] [LOCAL ] YRD: Starting deletion of primary data. [2025-09-16T21:09:40.981884] [DEBUG] [LOCAL ] YRD: Deleted primary data file. [2025-09-16T21:09:40.981931] [INFO ] [MAIN ] YRD: Starting full primary refresh. [2025-09-16T21:09:41.186314] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-03. [2025-09-16T21:09:41.334118] [INFO ] [REMOTE ] YRD: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:09:41.401728] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-16T21:09:41.857448] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-16T21:09:41.974946] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-08. [2025-09-16T21:09:42.774952] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-02. [2025-09-16T21:09:43.054843] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-16T21:09:43.574913] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-04. [2025-09-16T21:09:43.791327] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-16T21:09:43.874880] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-16T21:09:44.374915] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-03. [2025-09-16T21:09:45.085543] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-16T21:09:45.174896] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-05. [2025-09-16T21:09:45.450726] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-16T21:09:45.974942] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-05. [2025-09-16T21:09:46.662688] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-16T21:09:46.774950] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-04. [2025-09-16T21:09:47.574913] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-06. [2025-09-16T21:09:47.814673] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-16T21:09:48.374957] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-09. [2025-09-16T21:09:48.573568] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-05 (2.60 seconds). [2025-09-16T21:09:48.966250] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-16T21:09:49.174917] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-07. [2025-09-16T21:09:49.799165] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-16T21:09:49.805632] [INFO ] [REMOTE ] YMM: Full fetch complete (57378 records). [2025-09-16T21:09:49.805802] [DEBUG] [VALIDATOR ] YMM: Validating primary data. [2025-09-16T21:09:49.988215] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-05. [2025-09-16T21:09:50.202055] [DEBUG] [VALIDATOR ] YMM: All expected trading days are present. [2025-09-16T21:09:50.202144] [DEBUG] [VALIDATOR ] YMM: Primary data validation passed. [2025-09-16T21:09:50.203151] [INFO ] [MAIN ] YMM: Fetched primary data is valid. [2025-09-16T21:09:50.203212] [DEBUG] [LOCAL ] YMM: Saving primary data. [2025-09-16T21:09:50.204566] [DEBUG] [LOCAL ] YMM: Trimmed 57378 records to 39200 (keeping 150 days of data) [2025-09-16T21:09:50.447977] [DEBUG] [LOCAL ] YMM: Primary data saved (39200 records). [2025-09-16T21:09:50.448157] [INFO ] [MAIN ] YMM: Full history saved. [2025-09-16T21:09:50.448295] [INFO ] [MAIN ] Update Progress: 2349/2369 symbols completed. YMM took 26.0s. Estimated remaining: 2m 8s. Rate: 9.4 symbols/min [2025-09-16T21:09:50.620262] [INFO ] [MAIN ] YSG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:09:50.638281] [DEBUG] [LOCAL ] YSG: Loaded 19604 existing records from primary storage. [2025-09-16T21:09:50.638410] [INFO ] [MAIN ] YSG: Loaded 19604 existing records. [2025-09-16T21:09:50.790245] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-06. [2025-09-16T21:09:50.818666] [WARN ] [MAIN ] YSG: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:09:50.819005] [INFO ] [MAIN ] YSG: Wiping existing primary data before full refresh. [2025-09-16T21:09:50.819134] [INFO ] [LOCAL ] YSG: Starting deletion of primary data. [2025-09-16T21:09:50.819694] [DEBUG] [LOCAL ] YSG: Deleted primary data file. [2025-09-16T21:09:50.819748] [INFO ] [MAIN ] YSG: Starting full primary refresh. [2025-09-16T21:09:51.012508] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-16T21:09:51.150390] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-16T21:09:51.236367] [INFO ] [REMOTE ] YSG: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:09:51.574909] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-08. [2025-09-16T21:09:52.374912] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-02. [2025-09-16T21:09:52.468883] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-16T21:09:52.983666] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-16T21:09:53.174906] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-09. [2025-09-16T21:09:53.278313] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-16T21:09:53.974954] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-07. [2025-09-16T21:09:54.716052] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-16T21:09:54.722279] [INFO ] [REMOTE ] YPF: Full fetch complete (54893 records). [2025-09-16T21:09:54.722384] [DEBUG] [VALIDATOR ] YPF: Validating primary data. [2025-09-16T21:09:54.785385] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-06. [2025-09-16T21:09:55.103732] [DEBUG] [VALIDATOR ] YPF: All expected trading days are present. [2025-09-16T21:09:55.103819] [DEBUG] [VALIDATOR ] YPF: Primary data validation passed. [2025-09-16T21:09:55.104897] [INFO ] [MAIN ] YPF: Fetched primary data is valid. [2025-09-16T21:09:55.104944] [DEBUG] [LOCAL ] YPF: Saving primary data. [2025-09-16T21:09:55.106179] [DEBUG] [LOCAL ] YPF: Trimmed 54893 records to 37391 (keeping 150 days of data) [2025-09-16T21:09:55.330137] [DEBUG] [LOCAL ] YPF: Primary data saved (37391 records). [2025-09-16T21:09:55.330276] [INFO ] [MAIN ] YPF: Full history saved. [2025-09-16T21:09:55.330378] [INFO ] [MAIN ] Update Progress: 2350/2369 symbols completed. YPF took 23.6s. Estimated remaining: 2m 1s. Rate: 9.4 symbols/min [2025-09-16T21:09:55.508980] [INFO ] [MAIN ] YUM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:09:55.509135] [DEBUG] [LOCAL ] YUM: No existing data file found in primary storage. [2025-09-16T21:09:55.509174] [WARN ] [MAIN ] YUM: No existing data found, performing full refresh instead. [2025-09-16T21:09:55.509298] [INFO ] [MAIN ] YUM: Wiping existing primary data before full refresh. [2025-09-16T21:09:55.509338] [INFO ] [LOCAL ] YUM: Starting deletion of primary data. [2025-09-16T21:09:55.509380] [DEBUG] [LOCAL ] YUM: No primary data file found to delete. [2025-09-16T21:09:55.509414] [INFO ] [MAIN ] YUM: Starting full primary refresh. [2025-09-16T21:09:55.582111] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-03. [2025-09-16T21:09:55.879124] [INFO ] [REMOTE ] YUM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:09:55.887503] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-16T21:09:55.918886] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-16T21:09:56.374913] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-07. [2025-09-16T21:09:56.728018] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-16T21:09:56.996293] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-16T21:09:57.174910] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-08. [2025-09-16T21:09:57.974896] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-02. [2025-09-16T21:09:58.774919] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-08. [2025-09-16T21:09:58.934897] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-16T21:09:59.574884] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-04. [2025-09-16T21:09:59.662610] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-16T21:09:59.878050] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-16T21:10:00.280319] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-16T21:10:00.374900] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-05. [2025-09-16T21:10:01.174897] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-09. [2025-09-16T21:10:01.325547] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-16T21:10:01.975016] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-03. [2025-09-16T21:10:01.977793] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-16T21:10:01.980009] [INFO ] [REMOTE ] YRD: Full fetch complete (14407 records). [2025-09-16T21:10:01.980113] [DEBUG] [VALIDATOR ] YRD: Validating primary data. [2025-09-16T21:10:02.382718] [DEBUG] [VALIDATOR ] YRD: All expected trading days are present. [2025-09-16T21:10:02.382859] [DEBUG] [VALIDATOR ] YRD: Primary data validation passed. [2025-09-16T21:10:02.383315] [INFO ] [MAIN ] YRD: Fetched primary data is valid. [2025-09-16T21:10:02.383365] [DEBUG] [LOCAL ] YRD: Saving primary data. [2025-09-16T21:10:02.384089] [DEBUG] [LOCAL ] YRD: Trimmed 14407 records to 7983 (keeping 150 days of data) [2025-09-16T21:10:02.432369] [DEBUG] [LOCAL ] YRD: Primary data saved (7983 records). [2025-09-16T21:10:02.432530] [INFO ] [MAIN ] YRD: Full history saved. [2025-09-16T21:10:02.432660] [INFO ] [MAIN ] Update Progress: 2351/2369 symbols completed. YRD took 21.8s. Estimated remaining: 1m 55s. Rate: 9.4 symbols/min [2025-09-16T21:10:02.604229] [INFO ] [MAIN ] YUMC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:10:02.643038] [DEBUG] [LOCAL ] YUMC: Loaded 38787 existing records from primary storage. [2025-09-16T21:10:02.643212] [INFO ] [MAIN ] YUMC: Loaded 38787 existing records. [2025-09-16T21:10:02.785122] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-09. [2025-09-16T21:10:02.822486] [WARN ] [MAIN ] YUMC: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:10:02.822714] [INFO ] [MAIN ] YUMC: Wiping existing primary data before full refresh. [2025-09-16T21:10:02.822762] [INFO ] [LOCAL ] YUMC: Starting deletion of primary data. [2025-09-16T21:10:02.823610] [DEBUG] [LOCAL ] YUMC: Deleted primary data file. [2025-09-16T21:10:02.823680] [INFO ] [MAIN ] YUMC: Starting full primary refresh. [2025-09-16T21:10:03.185971] [INFO ] [REMOTE ] YUMC: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:10:03.574877] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-02. [2025-09-16T21:10:03.815958] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-16T21:10:04.374912] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-06. [2025-09-16T21:10:04.514553] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-16T21:10:04.521133] [INFO ] [REMOTE ] YOU: Full fetch complete (54421 records). [2025-09-16T21:10:04.521268] [DEBUG] [VALIDATOR ] YOU: Validating primary data. [2025-09-16T21:10:04.899493] [DEBUG] [VALIDATOR ] YOU: All expected trading days are present. [2025-09-16T21:10:04.899574] [DEBUG] [VALIDATOR ] YOU: Primary data validation passed. [2025-09-16T21:10:04.900534] [INFO ] [MAIN ] YOU: Fetched primary data is valid. [2025-09-16T21:10:04.900581] [DEBUG] [LOCAL ] YOU: Saving primary data. [2025-09-16T21:10:04.901670] [DEBUG] [LOCAL ] YOU: Trimmed 54421 records to 36926 (keeping 150 days of data) [2025-09-16T21:10:05.136347] [DEBUG] [LOCAL ] YOU: Primary data saved (36926 records). [2025-09-16T21:10:05.136543] [INFO ] [MAIN ] YOU: Full history saved. [2025-09-16T21:10:05.137304] [INFO ] [MAIN ] Update Progress: 2352/2369 symbols completed. YOU took 34.8s. Estimated remaining: 1m 48s. Rate: 9.4 symbols/min [2025-09-16T21:10:05.180749] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-04. [2025-09-16T21:10:05.309538] [INFO ] [MAIN ] ZBH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:10:05.348159] [DEBUG] [LOCAL ] ZBH: Loaded 37687 existing records from primary storage. [2025-09-16T21:10:05.348321] [INFO ] [MAIN ] ZBH: Loaded 37687 existing records. [2025-09-16T21:10:05.525989] [WARN ] [MAIN ] ZBH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:10:05.526292] [INFO ] [MAIN ] ZBH: Wiping existing primary data before full refresh. [2025-09-16T21:10:05.526383] [INFO ] [LOCAL ] ZBH: Starting deletion of primary data. [2025-09-16T21:10:05.537270] [DEBUG] [LOCAL ] ZBH: Deleted primary data file. [2025-09-16T21:10:05.550907] [INFO ] [MAIN ] ZBH: Starting full primary refresh. [2025-09-16T21:10:05.625934] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-16T21:10:05.928062] [INFO ] [REMOTE ] ZBH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:10:05.982786] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-03. [2025-09-16T21:10:05.986682] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-16T21:10:06.774921] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-02. [2025-09-16T21:10:07.225202] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-16T21:10:07.574906] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-05. [2025-09-16T21:10:08.059839] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-16T21:10:08.374919] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-07. [2025-09-16T21:10:08.629632] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-16T21:10:09.103893] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-16T21:10:09.174896] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-06. [2025-09-16T21:10:09.704139] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-16T21:10:09.974928] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-08. [2025-09-16T21:10:10.774959] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-03. [2025-09-16T21:10:11.143419] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-16T21:10:11.312746] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-16T21:10:11.574917] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-09. [2025-09-16T21:10:12.374940] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-04. [2025-09-16T21:10:12.560367] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-16T21:10:12.835730] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-16T21:10:12.839275] [INFO ] [REMOTE ] YSG: Full fetch complete (25640 records). [2025-09-16T21:10:12.839379] [DEBUG] [VALIDATOR ] YSG: Validating primary data. [2025-09-16T21:10:13.181148] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-04. [2025-09-16T21:10:13.209118] [DEBUG] [VALIDATOR ] YSG: All expected trading days are present. [2025-09-16T21:10:13.209182] [DEBUG] [VALIDATOR ] YSG: Primary data validation passed. [2025-09-16T21:10:13.209845] [INFO ] [MAIN ] YSG: Fetched primary data is valid. [2025-09-16T21:10:13.210044] [DEBUG] [LOCAL ] YSG: Saving primary data. [2025-09-16T21:10:13.210795] [DEBUG] [LOCAL ] YSG: Trimmed 25640 records to 19736 (keeping 150 days of data) [2025-09-16T21:10:13.328545] [DEBUG] [LOCAL ] YSG: Primary data saved (19736 records). [2025-09-16T21:10:13.328710] [INFO ] [MAIN ] YSG: Full history saved. [2025-09-16T21:10:13.328873] [INFO ] [MAIN ] Update Progress: 2353/2369 symbols completed. YSG took 22.9s. Estimated remaining: 1m 42s. Rate: 9.4 symbols/min [2025-09-16T21:10:13.497613] [INFO ] [MAIN ] ZEPP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:10:13.512844] [DEBUG] [LOCAL ] ZEPP: Loaded 14555 existing records from primary storage. [2025-09-16T21:10:13.512953] [INFO ] [MAIN ] ZEPP: Loaded 14555 existing records. [2025-09-16T21:10:13.691263] [WARN ] [MAIN ] ZEPP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:10:13.691501] [INFO ] [MAIN ] ZEPP: Wiping existing primary data before full refresh. [2025-09-16T21:10:13.691553] [INFO ] [LOCAL ] ZEPP: Starting deletion of primary data. [2025-09-16T21:10:13.691978] [DEBUG] [LOCAL ] ZEPP: Deleted primary data file. [2025-09-16T21:10:13.692060] [INFO ] [MAIN ] ZEPP: Starting full primary refresh. [2025-09-16T21:10:13.975608] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-07. [2025-09-16T21:10:14.054339] [INFO ] [REMOTE ] ZEPP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:10:14.166710] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-16T21:10:14.774888] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-05. [2025-09-16T21:10:15.142455] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-16T21:10:15.574946] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-02. [2025-09-16T21:10:15.995783] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-16T21:10:16.073425] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-16T21:10:16.352585] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-16T21:10:16.374969] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-03. [2025-09-16T21:10:17.080321] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-16T21:10:17.174914] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-05. [2025-09-16T21:10:17.974940] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-04. [2025-09-16T21:10:18.609766] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-16T21:10:18.774889] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-08. [2025-09-16T21:10:18.807733] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-16T21:10:19.574902] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-06. [2025-09-16T21:10:20.374949] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-06. [2025-09-16T21:10:20.867148] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-16T21:10:21.174908] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-09. [2025-09-16T21:10:21.361624] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-16T21:10:21.873814] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-16T21:10:21.879807] [INFO ] [REMOTE ] YUM: Full fetch complete (55463 records). [2025-09-16T21:10:21.879996] [DEBUG] [VALIDATOR ] YUM: Validating primary data. [2025-09-16T21:10:21.880712] [FATAL] [VALIDATOR ] YUM: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T21:10:21.880894] [FATAL] [MAIN ] YUM: Fetched primary data is invalid. Refusing to save it. [2025-09-16T21:10:21.880940] [WARN ] [MAIN ] YUM: Deleting existing primary and derivative data due to validation failure. [2025-09-16T21:10:21.881060] [INFO ] [LOCAL ] YUM: Starting deletion of primary data. [2025-09-16T21:10:21.881305] [DEBUG] [LOCAL ] YUM: No primary data file found to delete. [2025-09-16T21:10:21.881348] [INFO ] [LOCAL ] YUM: Starting deletion of derivative data. [2025-09-16T21:10:21.881387] [DEBUG] [LOCAL ] YUM: No derivative data file found to delete. [2025-09-16T21:10:21.907505] [INFO ] [MAIN ] Update Progress: 2354/2369 symbols completed. YUM took 26.6s. Estimated remaining: 1m 36s. Rate: 9.4 symbols/min [2025-09-16T21:10:21.961821] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-16T21:10:21.980435] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-05. [2025-09-16T21:10:22.101775] [INFO ] [MAIN ] ZETA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:10:22.144052] [DEBUG] [LOCAL ] ZETA: Loaded 39592 existing records from primary storage. [2025-09-16T21:10:22.144199] [INFO ] [MAIN ] ZETA: Loaded 39592 existing records. [2025-09-16T21:10:22.319365] [WARN ] [MAIN ] ZETA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:10:22.319696] [INFO ] [MAIN ] ZETA: Wiping existing primary data before full refresh. [2025-09-16T21:10:22.319747] [INFO ] [LOCAL ] ZETA: Starting deletion of primary data. [2025-09-16T21:10:22.320525] [DEBUG] [LOCAL ] ZETA: Deleted primary data file. [2025-09-16T21:10:22.320572] [INFO ] [MAIN ] ZETA: Starting full primary refresh. [2025-09-16T21:10:22.691346] [INFO ] [REMOTE ] ZETA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:10:22.726504] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-16T21:10:22.774858] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-02. [2025-09-16T21:10:23.574900] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-07. [2025-09-16T21:10:24.374921] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-06. [2025-09-16T21:10:24.940604] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-16T21:10:25.093351] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-09-16T21:10:25.157484] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-16T21:10:25.174912] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-07. [2025-09-16T21:10:25.974903] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-07. [2025-09-16T21:10:26.751873] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-16T21:10:26.774934] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-08. [2025-09-16T21:10:27.548421] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-16T21:10:27.574845] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-08. [2025-09-16T21:10:28.374918] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-08. [2025-09-16T21:10:28.475806] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-16T21:10:29.174904] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-03. [2025-09-16T21:10:29.517375] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-16T21:10:29.684711] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-16T21:10:29.974897] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-09. [2025-09-16T21:10:30.774887] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-09. [2025-09-16T21:10:30.971907] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-16T21:10:31.574912] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-09. [2025-09-16T21:10:31.776011] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-16T21:10:31.782768] [INFO ] [REMOTE ] YUMC: Full fetch complete (57371 records). [2025-09-16T21:10:31.782882] [DEBUG] [VALIDATOR ] YUMC: Validating primary data. [2025-09-16T21:10:32.194616] [DEBUG] [VALIDATOR ] YUMC: All expected trading days are present. [2025-09-16T21:10:32.194496] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-16T21:10:32.194852] [DEBUG] [VALIDATOR ] YUMC: Primary data validation passed. [2025-09-16T21:10:32.201764] [INFO ] [MAIN ] YUMC: Fetched primary data is valid. [2025-09-16T21:10:32.201965] [DEBUG] [LOCAL ] YUMC: Saving primary data. [2025-09-16T21:10:32.202255] [INFO ] [REMOTE ] ZBH: Full fetch complete (55714 records). [2025-09-16T21:10:32.202423] [DEBUG] [VALIDATOR ] ZBH: Validating primary data. [2025-09-16T21:10:32.313718] [DEBUG] [LOCAL ] YUMC: Trimmed 57371 records to 39174 (keeping 150 days of data) [2025-09-16T21:10:32.381992] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-04. [2025-09-16T21:10:32.731748] [DEBUG] [VALIDATOR ] ZBH: All expected trading days are present. [2025-09-16T21:10:32.738351] [DEBUG] [VALIDATOR ] ZBH: Primary data validation passed. [2025-09-16T21:10:32.739624] [INFO ] [MAIN ] ZBH: Fetched primary data is valid. [2025-09-16T21:10:32.798484] [DEBUG] [LOCAL ] ZBH: Saving primary data. [2025-09-16T21:10:32.828323] [DEBUG] [LOCAL ] ZBH: Trimmed 55714 records to 38056 (keeping 150 days of data) [2025-09-16T21:10:33.076321] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-16T21:10:33.083467] [INFO ] [REMOTE ] ZEPP: Full fetch complete (16197 records). [2025-09-16T21:10:33.084705] [DEBUG] [VALIDATOR ] ZEPP: Validating primary data. [2025-09-16T21:10:33.135486] [DEBUG] [LOCAL ] YUMC: Primary data saved (39174 records). [2025-09-16T21:10:33.146084] [INFO ] [MAIN ] YUMC: Full history saved. [2025-09-16T21:10:33.168014] [INFO ] [MAIN ] Update Progress: 2355/2369 symbols completed. YUMC took 30.7s. Estimated remaining: 1m 29s. Rate: 9.4 symbols/min [2025-09-16T21:10:33.574095] [INFO ] [MAIN ] ZGN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:10:33.596314] [DEBUG] [LOCAL ] ZBH: Primary data saved (38056 records). [2025-09-16T21:10:33.596517] [INFO ] [MAIN ] ZBH: Full history saved. [2025-09-16T21:10:33.598160] [INFO ] [MAIN ] Update Progress: 2356/2369 symbols completed. ZBH took 28.5s. Estimated remaining: 1m 23s. Rate: 9.4 symbols/min [2025-09-16T21:10:33.777509] [DEBUG] [VALIDATOR ] ZEPP: All expected trading days are present. [2025-09-16T21:10:33.789081] [DEBUG] [VALIDATOR ] ZEPP: Primary data validation passed. [2025-09-16T21:10:33.789591] [INFO ] [MAIN ] ZEPP: Fetched primary data is valid. [2025-09-16T21:10:33.789746] [DEBUG] [LOCAL ] ZEPP: Saving primary data. [2025-09-16T21:10:33.826114] [DEBUG] [LOCAL ] ZEPP: Trimmed 16197 records to 14833 (keeping 150 days of data) [2025-09-16T21:10:33.872716] [INFO ] [MAIN ] ZH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:10:33.920305] [DEBUG] [LOCAL ] ZGN: Loaded 30033 existing records from primary storage. [2025-09-16T21:10:33.947817] [INFO ] [MAIN ] ZGN: Loaded 30033 existing records. [2025-09-16T21:10:34.052837] [DEBUG] [LOCAL ] ZH: Loaded 17838 existing records from primary storage. [2025-09-16T21:10:34.066703] [INFO ] [MAIN ] ZH: Loaded 17838 existing records. [2025-09-16T21:10:34.265936] [WARN ] [MAIN ] ZGN: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:10:34.279169] [INFO ] [MAIN ] ZGN: Wiping existing primary data before full refresh. [2025-09-16T21:10:34.291993] [INFO ] [LOCAL ] ZGN: Starting deletion of primary data. [2025-09-16T21:10:34.352104] [DEBUG] [LOCAL ] ZGN: Deleted primary data file. [2025-09-16T21:10:34.357576] [INFO ] [MAIN ] ZGN: Starting full primary refresh. [2025-09-16T21:10:34.356468] [WARN ] [MAIN ] ZH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:10:34.379491] [INFO ] [MAIN ] ZH: Wiping existing primary data before full refresh. [2025-09-16T21:10:34.396518] [INFO ] [LOCAL ] ZH: Starting deletion of primary data. [2025-09-16T21:10:34.439730] [DEBUG] [LOCAL ] ZEPP: Primary data saved (14833 records). [2025-09-16T21:10:34.444944] [DEBUG] [LOCAL ] ZH: Deleted primary data file. [2025-09-16T21:10:34.463557] [INFO ] [MAIN ] ZEPP: Full history saved. [2025-09-16T21:10:34.467657] [INFO ] [MAIN ] ZH: Starting full primary refresh. [2025-09-16T21:10:34.467859] [INFO ] [MAIN ] Update Progress: 2357/2369 symbols completed. ZEPP took 21.1s. Estimated remaining: 1m 17s. Rate: 9.4 symbols/min [2025-09-16T21:10:34.984592] [INFO ] [REMOTE ] ZGN: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:10:35.016637] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-02. [2025-09-16T21:10:35.112700] [INFO ] [REMOTE ] ZH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:10:35.113153] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-02. [2025-09-16T21:10:35.146743] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-04 (2.76 seconds). [2025-09-16T21:10:35.158734] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-05. [2025-09-16T21:10:36.534521] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-16T21:10:36.541572] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-03. [2025-09-16T21:10:36.791621] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-16T21:10:36.799835] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-03. [2025-09-16T21:10:37.208876] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-16T21:10:37.220321] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-06. [2025-09-16T21:10:37.949104] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-16T21:10:37.974902] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-04. [2025-09-16T21:10:38.024977] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-16T21:10:38.774936] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-04. [2025-09-16T21:10:39.229292] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-16T21:10:39.575805] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-16T21:10:39.574962] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-07. [2025-09-16T21:10:39.752366] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-16T21:10:40.374910] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-05. [2025-09-16T21:10:41.174958] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-05. [2025-09-16T21:10:41.957675] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-16T21:10:41.975019] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-08. [2025-09-16T21:10:41.982167] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-16T21:10:42.027231] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-16T21:10:42.774911] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-06. [2025-09-16T21:10:43.574934] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-06. [2025-09-16T21:10:44.262265] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-09-16T21:10:44.324754] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-16T21:10:44.374871] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-07. [2025-09-16T21:10:44.732896] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-16T21:10:45.174898] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-07. [2025-09-16T21:10:45.974904] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-09. [2025-09-16T21:10:46.115508] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-16T21:10:46.188246] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-16T21:10:46.678207] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-16T21:10:46.684865] [INFO ] [REMOTE ] ZETA: Full fetch complete (57884 records). [2025-09-16T21:10:46.685073] [DEBUG] [VALIDATOR ] ZETA: Validating primary data. [2025-09-16T21:10:46.685868] [FATAL] [VALIDATOR ] ZETA: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T21:10:46.685949] [FATAL] [MAIN ] ZETA: Fetched primary data is invalid. Refusing to save it. [2025-09-16T21:10:46.685988] [WARN ] [MAIN ] ZETA: Deleting existing primary and derivative data due to validation failure. [2025-09-16T21:10:46.686073] [INFO ] [LOCAL ] ZETA: Starting deletion of primary data. [2025-09-16T21:10:46.686151] [DEBUG] [LOCAL ] ZETA: No primary data file found to delete. [2025-09-16T21:10:46.686202] [INFO ] [LOCAL ] ZETA: Starting deletion of derivative data. [2025-09-16T21:10:46.686607] [DEBUG] [LOCAL ] ZETA: Deleted derivative data file. [2025-09-16T21:10:46.686748] [INFO ] [MAIN ] Update Progress: 2358/2369 symbols completed. ZETA took 24.8s. Estimated remaining: 1m 10s. Rate: 9.4 symbols/min [2025-09-16T21:10:46.774951] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-08. [2025-09-16T21:10:47.574930] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-08. [2025-09-16T21:10:47.965454] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-16T21:10:48.375015] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-09. [2025-09-16T21:10:49.145967] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-16T21:10:49.174908] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-09. [2025-09-16T21:10:49.573839] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-16T21:10:49.578137] [INFO ] [REMOTE ] ZH: Full fetch complete (31454 records). [2025-09-16T21:10:49.578310] [DEBUG] [VALIDATOR ] ZH: Validating primary data. [2025-09-16T21:10:49.963969] [DEBUG] [VALIDATOR ] ZH: All expected trading days are present. [2025-09-16T21:10:49.964079] [DEBUG] [VALIDATOR ] ZH: Primary data validation passed. [2025-09-16T21:10:49.965016] [INFO ] [MAIN ] ZH: Fetched primary data is valid. [2025-09-16T21:10:49.965067] [DEBUG] [LOCAL ] ZH: Saving primary data. [2025-09-16T21:10:49.966181] [DEBUG] [LOCAL ] ZH: Trimmed 31454 records to 17989 (keeping 150 days of data) [2025-09-16T21:10:50.078124] [DEBUG] [LOCAL ] ZH: Primary data saved (17989 records). [2025-09-16T21:10:50.078351] [INFO ] [MAIN ] ZH: Full history saved. [2025-09-16T21:10:50.078482] [INFO ] [MAIN ] Update Progress: 2359/2369 symbols completed. ZH took 16.5s. Estimated remaining: 1m 4s. Rate: 9.4 symbols/min [2025-09-16T21:10:50.578373] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-16T21:10:50.583601] [INFO ] [REMOTE ] ZGN: Full fetch complete (44081 records). [2025-09-16T21:10:50.583793] [DEBUG] [VALIDATOR ] ZGN: Validating primary data. [2025-09-16T21:10:50.956465] [DEBUG] [VALIDATOR ] ZGN: All expected trading days are present. [2025-09-16T21:10:50.956593] [DEBUG] [VALIDATOR ] ZGN: Primary data validation passed. [2025-09-16T21:10:50.957656] [INFO ] [MAIN ] ZGN: Fetched primary data is valid. [2025-09-16T21:10:50.957724] [DEBUG] [LOCAL ] ZGN: Saving primary data. [2025-09-16T21:10:50.959030] [DEBUG] [LOCAL ] ZGN: Trimmed 44081 records to 30276 (keeping 150 days of data) [2025-09-16T21:10:51.139555] [DEBUG] [LOCAL ] ZGN: Primary data saved (30276 records). [2025-09-16T21:10:51.139726] [INFO ] [MAIN ] ZGN: Full history saved. [2025-09-16T21:10:51.139815] [INFO ] [MAIN ] Update Progress: 2360/2369 symbols completed. ZGN took 18.0s. Estimated remaining: 57.4s. Rate: 9.4 symbols/min [2025-09-16T21:10:51.885153] [INFO ] [MAIN ] ZK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:10:51.889441] [INFO ] [MAIN ] ZKH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:10:51.892841] [INFO ] [MAIN ] ZIP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:10:51.842451] [INFO ] [MAIN ] ZIM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:10:51.902969] [DEBUG] [LOCAL ] ZKH: Loaded 5780 existing records from primary storage. [2025-09-16T21:10:51.903249] [INFO ] [MAIN ] ZKH: Loaded 5780 existing records. [2025-09-16T21:10:52.085566] [DEBUG] [LOCAL ] ZK: Loaded 28129 existing records from primary storage. [2025-09-16T21:10:52.114377] [DEBUG] [LOCAL ] ZIP: Loaded 32069 existing records from primary storage. [2025-09-16T21:10:52.122259] [INFO ] [MAIN ] ZK: Loaded 28129 existing records. [2025-09-16T21:10:52.152718] [WARN ] [MAIN ] ZKH: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:10:52.129677] [INFO ] [MAIN ] ZIP: Loaded 32069 existing records. [2025-09-16T21:10:52.192363] [INFO ] [MAIN ] ZKH: Wiping existing primary data before full refresh. [2025-09-16T21:10:52.245884] [INFO ] [LOCAL ] ZKH: Starting deletion of primary data. [2025-09-16T21:10:52.305680] [DEBUG] [LOCAL ] ZKH: Deleted primary data file. [2025-09-16T21:10:52.321551] [INFO ] [MAIN ] ZKH: Starting full primary refresh. [2025-09-16T21:10:52.332384] [DEBUG] [LOCAL ] ZIM: Loaded 39530 existing records from primary storage. [2025-09-16T21:10:52.421483] [INFO ] [MAIN ] ZIM: Loaded 39530 existing records. [2025-09-16T21:10:52.568368] [WARN ] [MAIN ] ZIP: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:10:52.623221] [INFO ] [MAIN ] ZIP: Wiping existing primary data before full refresh. [2025-09-16T21:10:52.667769] [INFO ] [LOCAL ] ZIP: Starting deletion of primary data. [2025-09-16T21:10:52.744056] [DEBUG] [LOCAL ] ZIP: Deleted primary data file. [2025-09-16T21:10:52.728368] [WARN ] [MAIN ] ZK: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:10:52.775738] [INFO ] [MAIN ] ZK: Wiping existing primary data before full refresh. [2025-09-16T21:10:52.780912] [INFO ] [MAIN ] ZIP: Starting full primary refresh. [2025-09-16T21:10:52.786155] [INFO ] [LOCAL ] ZK: Starting deletion of primary data. [2025-09-16T21:10:52.951086] [DEBUG] [LOCAL ] ZK: Deleted primary data file. [2025-09-16T21:10:52.989196] [WARN ] [MAIN ] ZIM: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:10:52.989085] [INFO ] [MAIN ] ZK: Starting full primary refresh. [2025-09-16T21:10:53.127682] [INFO ] [MAIN ] ZIM: Wiping existing primary data before full refresh. [2025-09-16T21:10:53.217028] [INFO ] [LOCAL ] ZIM: Starting deletion of primary data. [2025-09-16T21:10:53.270038] [DEBUG] [LOCAL ] ZIM: Deleted primary data file. [2025-09-16T21:10:53.357280] [INFO ] [MAIN ] ZIM: Starting full primary refresh. [2025-09-16T21:10:53.551737] [INFO ] [REMOTE ] ZKH: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:10:53.640837] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-02. [2025-09-16T21:10:53.871207] [INFO ] [REMOTE ] ZIP: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:10:53.893394] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-02. [2025-09-16T21:10:54.026581] [INFO ] [REMOTE ] ZK: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:10:54.051830] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-02. [2025-09-16T21:10:54.223270] [INFO ] [REMOTE ] ZIM: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:10:54.223584] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-02. [2025-09-16T21:10:54.774741] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-16T21:10:54.777774] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-03. [2025-09-16T21:10:55.053731] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-16T21:10:55.060604] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-03. [2025-09-16T21:10:55.427777] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-16T21:10:55.436208] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-03. [2025-09-16T21:10:55.476155] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-16T21:10:55.574890] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-04. [2025-09-16T21:10:56.278671] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-16T21:10:56.278845] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-16T21:10:56.374906] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-03. [2025-09-16T21:10:56.787571] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-16T21:10:57.001173] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-16T21:10:57.174921] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-04. [2025-09-16T21:10:57.974918] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-05. [2025-09-16T21:10:58.632775] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-16T21:10:58.774970] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-06. [2025-09-16T21:10:58.848256] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-16T21:10:58.926760] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-09-16T21:10:59.432732] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-16T21:10:59.574945] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-04. [2025-09-16T21:11:00.374926] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-04. [2025-09-16T21:11:01.174922] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-05. [2025-09-16T21:11:01.459082] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-16T21:11:01.974920] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-05. [2025-09-16T21:11:02.465934] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-16T21:11:02.774966] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-07. [2025-09-16T21:11:02.840775] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-16T21:11:03.399256] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-16T21:11:03.574919] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-06. [2025-09-16T21:11:03.811522] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-16T21:11:04.374939] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-06. [2025-09-16T21:11:04.899441] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-16T21:11:05.174907] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-08. [2025-09-16T21:11:05.964214] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-16T21:11:05.974842] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-07. [2025-09-16T21:11:06.013502] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-16T21:11:06.774906] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-09. [2025-09-16T21:11:07.497853] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-16T21:11:07.499276] [INFO ] [REMOTE ] ZKH: Full fetch complete (9250 records). [2025-09-16T21:11:07.499361] [DEBUG] [VALIDATOR ] ZKH: Validating primary data. [2025-09-16T21:11:07.580015] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-05. [2025-09-16T21:11:07.862823] [DEBUG] [VALIDATOR ] ZKH: All expected trading days are present. [2025-09-16T21:11:07.862986] [DEBUG] [VALIDATOR ] ZKH: Primary data validation passed. [2025-09-16T21:11:07.863320] [INFO ] [MAIN ] ZKH: Fetched primary data is valid. [2025-09-16T21:11:07.871336] [DEBUG] [LOCAL ] ZKH: Saving primary data. [2025-09-16T21:11:07.886771] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-16T21:11:07.885753] [DEBUG] [LOCAL ] ZKH: Trimmed 9250 records to 5809 (keeping 150 days of data) [2025-09-16T21:11:07.926101] [DEBUG] [LOCAL ] ZKH: Primary data saved (5809 records). [2025-09-16T21:11:07.926213] [INFO ] [MAIN ] ZKH: Full history saved. [2025-09-16T21:11:07.926296] [INFO ] [MAIN ] Update Progress: 2361/2369 symbols completed. ZKH took 16.8s. Estimated remaining: 51.0s. Rate: 9.4 symbols/min [2025-09-16T21:11:08.094986] [INFO ] [MAIN ] ZTO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:11:08.132736] [DEBUG] [LOCAL ] ZTO: Loaded 36526 existing records from primary storage. [2025-09-16T21:11:08.132873] [INFO ] [MAIN ] ZTO: Loaded 36526 existing records. [2025-09-16T21:11:08.310974] [WARN ] [MAIN ] ZTO: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:11:08.311238] [INFO ] [MAIN ] ZTO: Wiping existing primary data before full refresh. [2025-09-16T21:11:08.311285] [INFO ] [LOCAL ] ZTO: Starting deletion of primary data. [2025-09-16T21:11:08.312007] [DEBUG] [LOCAL ] ZTO: Deleted primary data file. [2025-09-16T21:11:08.312058] [INFO ] [MAIN ] ZTO: Starting full primary refresh. [2025-09-16T21:11:08.380001] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-08. [2025-09-16T21:11:08.762525] [INFO ] [REMOTE ] ZTO: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:11:09.176822] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-07. [2025-09-16T21:11:09.974949] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-02. [2025-09-16T21:11:10.170208] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-05 (2.59 seconds). [2025-09-16T21:11:10.265967] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-16T21:11:10.320064] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-16T21:11:10.774940] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-06. [2025-09-16T21:11:11.574912] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-08. [2025-09-16T21:11:11.789425] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-16T21:11:12.374904] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-03. [2025-09-16T21:11:13.092045] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-09-16T21:11:13.180762] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-09. [2025-09-16T21:11:13.185701] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-16T21:11:13.986814] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-07. [2025-09-16T21:11:14.007749] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-16T21:11:14.586946] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-16T21:11:14.591957] [INFO ] [REMOTE ] ZIP: Full fetch complete (47513 records). [2025-09-16T21:11:14.592058] [DEBUG] [VALIDATOR ] ZIP: Validating primary data. [2025-09-16T21:11:14.779994] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-09. [2025-09-16T21:11:14.965598] [DEBUG] [VALIDATOR ] ZIP: All expected trading days are present. [2025-09-16T21:11:14.965694] [DEBUG] [VALIDATOR ] ZIP: Primary data validation passed. [2025-09-16T21:11:14.966577] [INFO ] [MAIN ] ZIP: Fetched primary data is valid. [2025-09-16T21:11:14.966617] [DEBUG] [LOCAL ] ZIP: Saving primary data. [2025-09-16T21:11:14.967665] [DEBUG] [LOCAL ] ZIP: Trimmed 47513 records to 32337 (keeping 150 days of data) [2025-09-16T21:11:15.147210] [DEBUG] [LOCAL ] ZIP: Primary data saved (32337 records). [2025-09-16T21:11:15.147349] [INFO ] [MAIN ] ZIP: Full history saved. [2025-09-16T21:11:15.147435] [INFO ] [MAIN ] Update Progress: 2362/2369 symbols completed. ZIP took 24.0s. Estimated remaining: 44.7s. Rate: 9.4 symbols/min [2025-09-16T21:11:15.321401] [INFO ] [MAIN ] ZTR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:11:15.333956] [DEBUG] [LOCAL ] ZTR: Loaded 12151 existing records from primary storage. [2025-09-16T21:11:15.334081] [INFO ] [MAIN ] ZTR: Loaded 12151 existing records. [2025-09-16T21:11:15.509964] [WARN ] [MAIN ] ZTR: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:11:15.510246] [INFO ] [MAIN ] ZTR: Wiping existing primary data before full refresh. [2025-09-16T21:11:15.510291] [INFO ] [LOCAL ] ZTR: Starting deletion of primary data. [2025-09-16T21:11:15.510823] [DEBUG] [LOCAL ] ZTR: Deleted primary data file. [2025-09-16T21:11:15.510883] [INFO ] [MAIN ] ZTR: Starting full primary refresh. [2025-09-16T21:11:15.579947] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-04. [2025-09-16T21:11:15.869440] [INFO ] [REMOTE ] ZTR: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:11:16.061468] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-16T21:11:16.374904] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-08. [2025-09-16T21:11:16.404138] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-16T21:11:16.409580] [INFO ] [REMOTE ] ZK: Full fetch complete (43613 records). [2025-09-16T21:11:16.409715] [DEBUG] [VALIDATOR ] ZK: Validating primary data. [2025-09-16T21:11:16.781481] [DEBUG] [VALIDATOR ] ZK: All expected trading days are present. [2025-09-16T21:11:16.781560] [DEBUG] [VALIDATOR ] ZK: Primary data validation passed. [2025-09-16T21:11:16.782417] [INFO ] [MAIN ] ZK: Fetched primary data is valid. [2025-09-16T21:11:16.782461] [DEBUG] [LOCAL ] ZK: Saving primary data. [2025-09-16T21:11:16.783394] [DEBUG] [LOCAL ] ZK: Trimmed 43613 records to 28414 (keeping 150 days of data) [2025-09-16T21:11:16.950197] [DEBUG] [LOCAL ] ZK: Primary data saved (28414 records). [2025-09-16T21:11:16.950333] [INFO ] [MAIN ] ZK: Full history saved. [2025-09-16T21:11:16.950415] [INFO ] [MAIN ] Update Progress: 2363/2369 symbols completed. ZK took 25.8s. Estimated remaining: 38.3s. Rate: 9.4 symbols/min [2025-09-16T21:11:17.126017] [INFO ] [MAIN ] ZTS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:11:17.126229] [DEBUG] [LOCAL ] ZTS: No existing data file found in primary storage. [2025-09-16T21:11:17.126268] [WARN ] [MAIN ] ZTS: No existing data found, performing full refresh instead. [2025-09-16T21:11:17.126392] [INFO ] [MAIN ] ZTS: Wiping existing primary data before full refresh. [2025-09-16T21:11:17.126431] [INFO ] [LOCAL ] ZTS: Starting deletion of primary data. [2025-09-16T21:11:17.126472] [DEBUG] [LOCAL ] ZTS: No primary data file found to delete. [2025-09-16T21:11:17.126508] [INFO ] [MAIN ] ZTS: Starting full primary refresh. [2025-09-16T21:11:17.180122] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-02. [2025-09-16T21:11:17.495409] [INFO ] [REMOTE ] ZTS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:11:17.527327] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-16T21:11:17.974932] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-05. [2025-09-16T21:11:18.464997] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-16T21:11:18.744604] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-16T21:11:18.774857] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-09. [2025-09-16T21:11:19.310974] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-16T21:11:19.574901] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-06. [2025-09-16T21:11:20.374915] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-02. [2025-09-16T21:11:20.822347] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-16T21:11:20.829997] [INFO ] [REMOTE ] ZIM: Full fetch complete (58214 records). [2025-09-16T21:11:20.830169] [DEBUG] [VALIDATOR ] ZIM: Validating primary data. [2025-09-16T21:11:21.180462] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-03. [2025-09-16T21:11:21.225745] [DEBUG] [VALIDATOR ] ZIM: All expected trading days are present. [2025-09-16T21:11:21.226026] [DEBUG] [VALIDATOR ] ZIM: Primary data validation passed. [2025-09-16T21:11:21.227191] [INFO ] [MAIN ] ZIM: Fetched primary data is valid. [2025-09-16T21:11:21.236659] [DEBUG] [LOCAL ] ZIM: Saving primary data. [2025-09-16T21:11:21.254264] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-16T21:11:21.264697] [DEBUG] [LOCAL ] ZIM: Trimmed 58214 records to 39916 (keeping 150 days of data) [2025-09-16T21:11:21.517295] [DEBUG] [LOCAL ] ZIM: Primary data saved (39916 records). [2025-09-16T21:11:21.517460] [INFO ] [MAIN ] ZIM: Full history saved. [2025-09-16T21:11:21.519340] [INFO ] [MAIN ] Update Progress: 2364/2369 symbols completed. ZIM took 30.4s. Estimated remaining: 31.9s. Rate: 9.4 symbols/min [2025-09-16T21:11:21.698624] [INFO ] [MAIN ] ZVIA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:11:21.726586] [DEBUG] [LOCAL ] ZVIA: Loaded 26800 existing records from primary storage. [2025-09-16T21:11:21.726748] [INFO ] [MAIN ] ZVIA: Loaded 26800 existing records. [2025-09-16T21:11:21.909746] [WARN ] [MAIN ] ZVIA: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:11:21.910103] [INFO ] [MAIN ] ZVIA: Wiping existing primary data before full refresh. [2025-09-16T21:11:21.910207] [INFO ] [LOCAL ] ZVIA: Starting deletion of primary data. [2025-09-16T21:11:21.910817] [DEBUG] [LOCAL ] ZVIA: Deleted primary data file. [2025-09-16T21:11:21.910869] [INFO ] [MAIN ] ZVIA: Starting full primary refresh. [2025-09-16T21:11:21.977027] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-07. [2025-09-16T21:11:22.314459] [INFO ] [REMOTE ] ZVIA: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:11:22.317441] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-16T21:11:22.479513] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-16T21:11:22.774924] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-02. [2025-09-16T21:11:23.574936] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-04. [2025-09-16T21:11:23.862361] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-16T21:11:23.950346] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-16T21:11:24.374919] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-03. [2025-09-16T21:11:24.573927] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-16T21:11:25.174914] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-05. [2025-09-16T21:11:25.974895] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-03. [2025-09-16T21:11:26.354444] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-16T21:11:26.374549] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-16T21:11:26.774915] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-06. [2025-09-16T21:11:27.512636] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-16T21:11:27.574939] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-08. [2025-09-16T21:11:27.839173] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-16T21:11:28.374906] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-07. [2025-09-16T21:11:29.174872] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-04. [2025-09-16T21:11:29.455074] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-16T21:11:29.494338] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-16T21:11:29.974909] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-08. [2025-09-16T21:11:30.774917] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-09. [2025-09-16T21:11:30.850459] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-16T21:11:31.223448] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-16T21:11:31.574914] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-05. [2025-09-16T21:11:32.162244] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-16T21:11:32.167966] [INFO ] [REMOTE ] ZTO: Full fetch complete (54734 records). [2025-09-16T21:11:32.168070] [DEBUG] [VALIDATOR ] ZTO: Validating primary data. [2025-09-16T21:11:32.384511] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-09. [2025-09-16T21:11:32.561615] [DEBUG] [VALIDATOR ] ZTO: All expected trading days are present. [2025-09-16T21:11:32.561712] [DEBUG] [VALIDATOR ] ZTO: Primary data validation passed. [2025-09-16T21:11:32.562725] [INFO ] [MAIN ] ZTO: Fetched primary data is valid. [2025-09-16T21:11:32.562771] [DEBUG] [LOCAL ] ZTO: Saving primary data. [2025-09-16T21:11:32.563954] [DEBUG] [LOCAL ] ZTO: Trimmed 54734 records to 36806 (keeping 150 days of data) [2025-09-16T21:11:32.781756] [DEBUG] [LOCAL ] ZTO: Primary data saved (36806 records). [2025-09-16T21:11:32.781911] [INFO ] [MAIN ] ZTO: Full history saved. [2025-09-16T21:11:32.781999] [INFO ] [MAIN ] Update Progress: 2365/2369 symbols completed. ZTO took 24.9s. Estimated remaining: 25.5s. Rate: 9.4 symbols/min [2025-09-16T21:11:32.953073] [INFO ] [MAIN ] ZWS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-16T21:11:32.982414] [DEBUG] [LOCAL ] ZWS: Loaded 30695 existing records from primary storage. [2025-09-16T21:11:32.982554] [INFO ] [MAIN ] ZWS: Loaded 30695 existing records. [2025-09-16T21:11:33.163224] [WARN ] [MAIN ] ZWS: Insufficient historical data. Have data from 2025-04-21, but need from 2025-02-11 for 150 day retention. Performing full refresh. [2025-09-16T21:11:33.163437] [INFO ] [MAIN ] ZWS: Wiping existing primary data before full refresh. [2025-09-16T21:11:33.163482] [INFO ] [LOCAL ] ZWS: Starting deletion of primary data. [2025-09-16T21:11:33.164298] [DEBUG] [LOCAL ] ZWS: Deleted primary data file. [2025-09-16T21:11:33.164355] [INFO ] [MAIN ] ZWS: Starting full primary refresh. [2025-09-16T21:11:33.187678] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-04. [2025-09-16T21:11:33.543119] [INFO ] [REMOTE ] ZWS: Fetching primary data covering 150 trading days from 2025-02-11 to 2025-09-16 (requires 8 months of data pull). [2025-09-16T21:11:33.544221] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-16T21:11:33.546850] [INFO ] [REMOTE ] ZTR: Full fetch complete (18996 records). [2025-09-16T21:11:33.546936] [DEBUG] [VALIDATOR ] ZTR: Validating primary data. [2025-09-16T21:11:33.761959] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-16T21:11:33.982918] [DEBUG] [VALIDATOR ] ZTR: All expected trading days are present. [2025-09-16T21:11:33.982351] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-02. [2025-09-16T21:11:33.983050] [DEBUG] [VALIDATOR ] ZTR: Primary data validation passed. [2025-09-16T21:11:33.984297] [INFO ] [MAIN ] ZTR: Fetched primary data is valid. [2025-09-16T21:11:33.984372] [DEBUG] [LOCAL ] ZTR: Saving primary data. [2025-09-16T21:11:33.985133] [DEBUG] [LOCAL ] ZTR: Trimmed 18996 records to 12251 (keeping 150 days of data) [2025-09-16T21:11:34.060211] [DEBUG] [LOCAL ] ZTR: Primary data saved (12251 records). [2025-09-16T21:11:34.060338] [INFO ] [MAIN ] ZTR: Full history saved. [2025-09-16T21:11:34.060421] [INFO ] [MAIN ] Update Progress: 2366/2369 symbols completed. ZTR took 18.9s. Estimated remaining: 19.1s. Rate: 9.4 symbols/min [2025-09-16T21:11:34.416379] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-16T21:11:34.774932] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-06. [2025-09-16T21:11:35.574873] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-05. [2025-09-16T21:11:35.665289] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-16T21:11:36.374890] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-03. [2025-09-16T21:11:36.417150] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-16T21:11:36.798186] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-16T21:11:37.174912] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-06. [2025-09-16T21:11:37.974903] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-07. [2025-09-16T21:11:38.060586] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-16T21:11:38.568400] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-16T21:11:38.774889] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-07. [2025-09-16T21:11:39.574897] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-04. [2025-09-16T21:11:39.997919] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-16T21:11:40.215655] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-16T21:11:40.374868] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-08. [2025-09-16T21:11:41.174909] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-08. [2025-09-16T21:11:41.388208] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-16T21:11:41.887757] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-16T21:11:41.974851] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-09. [2025-09-16T21:11:42.136467] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-16T21:11:42.774899] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-05. [2025-09-16T21:11:43.216060] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-16T21:11:43.220749] [INFO ] [REMOTE ] ZVIA: Full fetch complete (38587 records). [2025-09-16T21:11:43.220886] [DEBUG] [VALIDATOR ] ZVIA: Validating primary data. [2025-09-16T21:11:43.581838] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-09. [2025-09-16T21:11:43.596127] [DEBUG] [VALIDATOR ] ZVIA: All expected trading days are present. [2025-09-16T21:11:43.596183] [DEBUG] [VALIDATOR ] ZVIA: Primary data validation passed. [2025-09-16T21:11:43.596967] [INFO ] [MAIN ] ZVIA: Fetched primary data is valid. [2025-09-16T21:11:43.597084] [DEBUG] [LOCAL ] ZVIA: Saving primary data. [2025-09-16T21:11:43.598025] [DEBUG] [LOCAL ] ZVIA: Trimmed 38587 records to 27081 (keeping 150 days of data) [2025-09-16T21:11:43.754358] [DEBUG] [LOCAL ] ZVIA: Primary data saved (27081 records). [2025-09-16T21:11:43.754490] [INFO ] [MAIN ] ZVIA: Full history saved. [2025-09-16T21:11:43.754573] [INFO ] [MAIN ] Update Progress: 2367/2369 symbols completed. ZVIA took 22.2s. Estimated remaining: 12.8s. Rate: 9.4 symbols/min [2025-09-16T21:11:44.131895] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-16T21:11:44.137628] [INFO ] [REMOTE ] ZTS: Full fetch complete (57279 records). [2025-09-16T21:11:44.137754] [DEBUG] [VALIDATOR ] ZTS: Validating primary data. [2025-09-16T21:11:44.138399] [FATAL] [VALIDATOR ] ZTS: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-16T21:11:44.138507] [FATAL] [MAIN ] ZTS: Fetched primary data is invalid. Refusing to save it. [2025-09-16T21:11:44.138546] [WARN ] [MAIN ] ZTS: Deleting existing primary and derivative data due to validation failure. [2025-09-16T21:11:44.138590] [INFO ] [LOCAL ] ZTS: Starting deletion of primary data. [2025-09-16T21:11:44.138667] [DEBUG] [LOCAL ] ZTS: No primary data file found to delete. [2025-09-16T21:11:44.138706] [INFO ] [LOCAL ] ZTS: Starting deletion of derivative data. [2025-09-16T21:11:44.138746] [DEBUG] [LOCAL ] ZTS: No derivative data file found to delete. [2025-09-16T21:11:44.138807] [INFO ] [MAIN ] Update Progress: 2368/2369 symbols completed. ZTS took 27.2s. Estimated remaining: 6.4s. Rate: 9.4 symbols/min [2025-09-16T21:11:44.426326] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-16T21:11:44.434919] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-06. [2025-09-16T21:11:45.810815] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-16T21:11:45.818333] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-07. [2025-09-16T21:11:47.417699] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-16T21:11:47.427604] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-08. [2025-09-16T21:11:48.812544] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-16T21:11:48.821771] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-09. [2025-09-16T21:11:50.400375] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-16T21:11:50.405811] [INFO ] [REMOTE ] ZWS: Full fetch complete (46562 records). [2025-09-16T21:11:50.405906] [DEBUG] [VALIDATOR ] ZWS: Validating primary data. [2025-09-16T21:11:50.782191] [DEBUG] [VALIDATOR ] ZWS: All expected trading days are present. [2025-09-16T21:11:50.782271] [DEBUG] [VALIDATOR ] ZWS: Primary data validation passed. [2025-09-16T21:11:50.783173] [INFO ] [MAIN ] ZWS: Fetched primary data is valid. [2025-09-16T21:11:50.783217] [DEBUG] [LOCAL ] ZWS: Saving primary data. [2025-09-16T21:11:50.784200] [DEBUG] [LOCAL ] ZWS: Trimmed 46562 records to 31021 (keeping 150 days of data) [2025-09-16T21:11:50.971510] [DEBUG] [LOCAL ] ZWS: Primary data saved (31021 records). [2025-09-16T21:11:50.971665] [INFO ] [MAIN ] ZWS: Full history saved. [2025-09-16T21:11:50.971763] [INFO ] [MAIN ] Update Progress: 2369/2369 symbols completed. ZWS took 18.2s. Estimated remaining: 0.0s. Rate: 9.4 symbols/min [2025-09-16T21:11:50.973081] [INFO ] [MAIN ] Parallel update completed in 4h 11m 48s [2025-09-16T21:11:50.973183] [WARN ] [MAIN ] Failed symbols (343): AAM, AAMI, AAUC, ACEL, ACP, AD, AEE, AEM, AESI, AFGB... [2025-09-16T21:11:50.973241] [INFO ] [MAIN ] Update success rate: 85.5% (2026/2369 symbols) [2025-09-16T21:11:51.597171] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Primary Update Completed (2026/2369 @ 85.52%)' [2025-09-16T21:11:51.598089] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-09-16T21:11:51.598313] [INFO ] [STATE ] Last completion updated: 2025-09-16T21:11:51.598150 [2025-09-16T21:11:51.598520] [WARN ] [STATE ] State set to: RUNNING [2025-09-16T21:11:51.598578] [INFO ] [MAIN ] Running derivative generation in parallel mode [2025-09-16T21:11:51.598706] [INFO ] [MAIN ] Wiping all existing derivative data before regeneration. [2025-09-16T21:11:51.598750] [INFO ] [LOCAL ] Starting deletion of all local derivative data. [2025-09-16T21:11:51.600218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CINT.csv [2025-09-16T21:11:51.600423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMC.csv [2025-09-16T21:11:51.600656] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLOW.csv [2025-09-16T21:11:51.600867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTN.csv [2025-09-16T21:11:51.601066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBR.csv [2025-09-16T21:11:51.601289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTI.csv [2025-09-16T21:11:51.601463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TX.csv [2025-09-16T21:11:51.601693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTZ.csv [2025-09-16T21:11:51.601858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSF.csv [2025-09-16T21:11:51.602019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTZ.csv [2025-09-16T21:11:51.602216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERO.csv [2025-09-16T21:11:51.602392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPP.csv [2025-09-16T21:11:51.602549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OBDC.csv [2025-09-16T21:11:51.602792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLL.csv [2025-09-16T21:11:51.603002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HII.csv [2025-09-16T21:11:51.603144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MX.csv [2025-09-16T21:11:51.603295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSI.csv [2025-09-16T21:11:51.603488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGD.csv [2025-09-16T21:11:51.603654] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDST.csv [2025-09-16T21:11:51.603818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEN.csv [2025-09-16T21:11:51.604012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXYZ.csv [2025-09-16T21:11:51.604214] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPFD.csv [2025-09-16T21:11:51.604375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMX.csv [2025-09-16T21:11:51.604542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BV.csv [2025-09-16T21:11:51.604674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYN.csv [2025-09-16T21:11:51.604820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHE.csv [2025-09-16T21:11:51.605019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACV.csv [2025-09-16T21:11:51.605152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZC.csv [2025-09-16T21:11:51.605313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NABL.csv [2025-09-16T21:11:51.605458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SII.csv [2025-09-16T21:11:51.605611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCV.csv [2025-09-16T21:11:51.605814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BALY.csv [2025-09-16T21:11:51.605999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNK.csv [2025-09-16T21:11:51.606161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADM.csv [2025-09-16T21:11:51.606370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIN.csv [2025-09-16T21:11:51.606527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNX.csv [2025-09-16T21:11:51.606707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TREX.csv [2025-09-16T21:11:51.606849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTST.csv [2025-09-16T21:11:51.606978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKM.csv [2025-09-16T21:11:51.607115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCF.csv [2025-09-16T21:11:51.607230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITC.csv [2025-09-16T21:11:51.607368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLGN.csv [2025-09-16T21:11:51.607515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MRK.csv [2025-09-16T21:11:51.607729] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGI.csv [2025-09-16T21:11:51.607921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEPU.csv [2025-09-16T21:11:51.608069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPX.csv [2025-09-16T21:11:51.608197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTB.csv [2025-09-16T21:11:51.608376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEN.csv [2025-09-16T21:11:51.608518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMS.csv [2025-09-16T21:11:51.608747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSV.csv [2025-09-16T21:11:51.608957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VKQ.csv [2025-09-16T21:11:51.609095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNNE.csv [2025-09-16T21:11:51.609253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVX.csv [2025-09-16T21:11:51.609391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLNK.csv [2025-09-16T21:11:51.609541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINV.csv [2025-09-16T21:11:51.609679] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/S.csv [2025-09-16T21:11:51.609814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JELD.csv [2025-09-16T21:11:51.610002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JKS.csv [2025-09-16T21:11:51.610129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCA.csv [2025-09-16T21:11:51.610283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAT.csv [2025-09-16T21:11:51.610429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QUAD.csv [2025-09-16T21:11:51.610538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUR.csv [2025-09-16T21:11:51.610706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNB.csv [2025-09-16T21:11:51.610847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRMB.csv [2025-09-16T21:11:51.611014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPI.csv [2025-09-16T21:11:51.611162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAZ.csv [2025-09-16T21:11:51.611309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YPF.csv [2025-09-16T21:11:51.611443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTL.csv [2025-09-16T21:11:51.611567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UFI.csv [2025-09-16T21:11:51.611833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFC.csv [2025-09-16T21:11:51.612014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEO.csv [2025-09-16T21:11:51.612162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTHY.csv [2025-09-16T21:11:51.612321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPHR.csv [2025-09-16T21:11:51.612466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNW.csv [2025-09-16T21:11:51.612620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BP.csv [2025-09-16T21:11:51.612780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRC.csv [2025-09-16T21:11:51.612904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BB.csv [2025-09-16T21:11:51.613044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVS.csv [2025-09-16T21:11:51.613172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNST.csv [2025-09-16T21:11:51.613294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OSCR.csv [2025-09-16T21:11:51.613423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVGS.csv [2025-09-16T21:11:51.613568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMF.csv [2025-09-16T21:11:51.613721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALL.csv [2025-09-16T21:11:51.613870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVB.csv [2025-09-16T21:11:51.613995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OR.csv [2025-09-16T21:11:51.614118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIPR.csv [2025-09-16T21:11:51.614246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMR.csv [2025-09-16T21:11:51.614379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLCO.csv [2025-09-16T21:11:51.614597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BR.csv [2025-09-16T21:11:51.614754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGLS.csv [2025-09-16T21:11:51.614888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TD.csv [2025-09-16T21:11:51.615034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAG.csv [2025-09-16T21:11:51.615181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMU.csv [2025-09-16T21:11:51.615345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUMN.csv [2025-09-16T21:11:51.615479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMA.csv [2025-09-16T21:11:51.615579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPFI.csv [2025-09-16T21:11:51.615720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGR.csv [2025-09-16T21:11:51.615847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHF.csv [2025-09-16T21:11:51.615966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBX.csv [2025-09-16T21:11:51.616122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPB.csv [2025-09-16T21:11:51.616284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DECK.csv [2025-09-16T21:11:51.616419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTY.csv [2025-09-16T21:11:51.616561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPG.csv [2025-09-16T21:11:51.616740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUZ.csv [2025-09-16T21:11:51.616888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRX.csv [2025-09-16T21:11:51.617029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIPO.csv [2025-09-16T21:11:51.617159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/H.csv [2025-09-16T21:11:51.617273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNQ.csv [2025-09-16T21:11:51.617386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAY.csv [2025-09-16T21:11:51.617512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEQ.csv [2025-09-16T21:11:51.617703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSM.csv [2025-09-16T21:11:51.617845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIT.csv [2025-09-16T21:11:51.617966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTRG.csv [2025-09-16T21:11:51.618081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGP.csv [2025-09-16T21:11:51.618198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPOR.csv [2025-09-16T21:11:51.618317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVTR.csv [2025-09-16T21:11:51.618427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRH.csv [2025-09-16T21:11:51.618548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFN.csv [2025-09-16T21:11:51.618706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAE.csv [2025-09-16T21:11:51.618851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYB.csv [2025-09-16T21:11:51.618988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNF.csv [2025-09-16T21:11:51.619110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOR.csv [2025-09-16T21:11:51.619278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IMAX.csv [2025-09-16T21:11:51.619469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PG.csv [2025-09-16T21:11:51.619592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZN.csv [2025-09-16T21:11:51.619834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WS.csv [2025-09-16T21:11:51.619957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIM.csv [2025-09-16T21:11:51.620072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCN.csv [2025-09-16T21:11:51.620198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNY.csv [2025-09-16T21:11:51.620313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLO.csv [2025-09-16T21:11:51.620443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGVT.csv [2025-09-16T21:11:51.620563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPR.csv [2025-09-16T21:11:51.620740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTL.csv [2025-09-16T21:11:51.620880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KWR.csv [2025-09-16T21:11:51.621041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AORT.csv [2025-09-16T21:11:51.621184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWNB.csv [2025-09-16T21:11:51.621321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAN.csv [2025-09-16T21:11:51.621433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGN.csv [2025-09-16T21:11:51.621553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAPL.csv [2025-09-16T21:11:51.621696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGT.csv [2025-09-16T21:11:51.621832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMY.csv [2025-09-16T21:11:51.621966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLO.csv [2025-09-16T21:11:51.622097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YSG.csv [2025-09-16T21:11:51.622222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSL.csv [2025-09-16T21:11:51.622448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NREF.csv [2025-09-16T21:11:51.622606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFG.csv [2025-09-16T21:11:51.622796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNT.csv [2025-09-16T21:11:51.622927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIM.csv [2025-09-16T21:11:51.623058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAI.csv [2025-09-16T21:11:51.623178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRB.csv [2025-09-16T21:11:51.623312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTH.csv [2025-09-16T21:11:51.623429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCN.csv [2025-09-16T21:11:51.623587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDT.csv [2025-09-16T21:11:51.623711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFSI.csv [2025-09-16T21:11:51.623829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXU.csv [2025-09-16T21:11:51.623971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMEZ.csv [2025-09-16T21:11:51.624101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHAL.csv [2025-09-16T21:11:51.624241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOB.csv [2025-09-16T21:11:51.624372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EEA.csv [2025-09-16T21:11:51.624503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPER.csv [2025-09-16T21:11:51.624616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPH.csv [2025-09-16T21:11:51.624763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WST.csv [2025-09-16T21:11:51.624922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPK.csv [2025-09-16T21:11:51.625050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GL.csv [2025-09-16T21:11:51.625174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRS.csv [2025-09-16T21:11:51.625311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FR.csv [2025-09-16T21:11:51.625424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIM.csv [2025-09-16T21:11:51.625545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTR.csv [2025-09-16T21:11:51.625679] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MD.csv [2025-09-16T21:11:51.625792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFJ.csv [2025-09-16T21:11:51.625933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHI.csv [2025-09-16T21:11:51.626063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRG.csv [2025-09-16T21:11:51.626163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHW.csv [2025-09-16T21:11:51.626294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACM.csv [2025-09-16T21:11:51.626407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKE.csv [2025-09-16T21:11:51.626514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPA.csv [2025-09-16T21:11:51.626677] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTR.csv [2025-09-16T21:11:51.626798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBZ.csv [2025-09-16T21:11:51.626905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPMC.csv [2025-09-16T21:11:51.627044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIO.csv [2025-09-16T21:11:51.627164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWA.csv [2025-09-16T21:11:51.627273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYE.csv [2025-09-16T21:11:51.627404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRI.csv [2025-09-16T21:11:51.627545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNY.csv [2025-09-16T21:11:51.627944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGG.csv [2025-09-16T21:11:51.628118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARR.csv [2025-09-16T21:11:51.628261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYT.csv [2025-09-16T21:11:51.628409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUT.csv [2025-09-16T21:11:51.628530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBTM.csv [2025-09-16T21:11:51.628658] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSD.csv [2025-09-16T21:11:51.628765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHC.csv [2025-09-16T21:11:51.628863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLB.csv [2025-09-16T21:11:51.628969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MRP.csv [2025-09-16T21:11:51.629101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXC.csv [2025-09-16T21:11:51.629242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNA.csv [2025-09-16T21:11:51.629362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFG.csv [2025-09-16T21:11:51.629464] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NU.csv [2025-09-16T21:11:51.629568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXNM.csv [2025-09-16T21:11:51.629692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGI.csv [2025-09-16T21:11:51.629817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ULS.csv [2025-09-16T21:11:51.629947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNI.csv [2025-09-16T21:11:51.630080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFS.csv [2025-09-16T21:11:51.630218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BC.csv [2025-09-16T21:11:51.630338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSD.csv [2025-09-16T21:11:51.630437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSG.csv [2025-09-16T21:11:51.630551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYL.csv [2025-09-16T21:11:51.630718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIMB.csv [2025-09-16T21:11:51.630874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EE.csv [2025-09-16T21:11:51.631013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPS.csv [2025-09-16T21:11:51.631139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRK.csv [2025-09-16T21:11:51.631282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAC.csv [2025-09-16T21:11:51.631407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVEO.csv [2025-09-16T21:11:51.631532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HI.csv [2025-09-16T21:11:51.631672] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSCI.csv [2025-09-16T21:11:51.631788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNG.csv [2025-09-16T21:11:51.631919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLNG.csv [2025-09-16T21:11:51.632022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRD.csv [2025-09-16T21:11:51.632133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNN.csv [2025-09-16T21:11:51.632275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABEV.csv [2025-09-16T21:11:51.632496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAC.csv [2025-09-16T21:11:51.632612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRBR.csv [2025-09-16T21:11:51.632728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONTO.csv [2025-09-16T21:11:51.632849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SF.csv [2025-09-16T21:11:51.632972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMI.csv [2025-09-16T21:11:51.633082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHN.csv [2025-09-16T21:11:51.633189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGZ.csv [2025-09-16T21:11:51.633311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAN.csv [2025-09-16T21:11:51.633427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMBT.csv [2025-09-16T21:11:51.633545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QD.csv [2025-09-16T21:11:51.633693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHG.csv [2025-09-16T21:11:51.633808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRDY.csv [2025-09-16T21:11:51.633943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AX.csv [2025-09-16T21:11:51.634107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHK.csv [2025-09-16T21:11:51.634224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRC.csv [2025-09-16T21:11:51.634349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAM.csv [2025-09-16T21:11:51.634480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHE.csv [2025-09-16T21:11:51.634603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBER.csv [2025-09-16T21:11:51.634747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEO.csv [2025-09-16T21:11:51.634872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RXO.csv [2025-09-16T21:11:51.634988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AJG.csv [2025-09-16T21:11:51.635109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTN.csv [2025-09-16T21:11:51.635248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFB.csv [2025-09-16T21:11:51.635356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBU.csv [2025-09-16T21:11:51.635464] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHY.csv [2025-09-16T21:11:51.635574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITGR.csv [2025-09-16T21:11:51.635953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRV.csv [2025-09-16T21:11:51.636087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MRC.csv [2025-09-16T21:11:51.636208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOR.csv [2025-09-16T21:11:51.636307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGL.csv [2025-09-16T21:11:51.636436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWT.csv [2025-09-16T21:11:51.636553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUS.csv [2025-09-16T21:11:51.636766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFZ.csv [2025-09-16T21:11:51.636893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLK.csv [2025-09-16T21:11:51.636997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WD.csv [2025-09-16T21:11:51.637116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BVN.csv [2025-09-16T21:11:51.637231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEAV.csv [2025-09-16T21:11:51.637331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHN.csv [2025-09-16T21:11:51.637452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WK.csv [2025-09-16T21:11:51.637603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHWY.csv [2025-09-16T21:11:51.637722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSL.csv [2025-09-16T21:11:51.637827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMR.csv [2025-09-16T21:11:51.637942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLY.csv [2025-09-16T21:11:51.638040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGF.csv [2025-09-16T21:11:51.638149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCG.csv [2025-09-16T21:11:51.638277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRBK.csv [2025-09-16T21:11:51.638388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOLV.csv [2025-09-16T21:11:51.638514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIXT.csv [2025-09-16T21:11:51.638667] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBRK.csv [2025-09-16T21:11:51.638792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOG.csv [2025-09-16T21:11:51.638901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COMP.csv [2025-09-16T21:11:51.639036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXC.csv [2025-09-16T21:11:51.639148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUN.csv [2025-09-16T21:11:51.639255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHI.csv [2025-09-16T21:11:51.639365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEG.csv [2025-09-16T21:11:51.639471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMT.csv [2025-09-16T21:11:51.639590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LC.csv [2025-09-16T21:11:51.639717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ES.csv [2025-09-16T21:11:51.639832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYTR.csv [2025-09-16T21:11:51.640010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHG.csv [2025-09-16T21:11:51.640121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OKE.csv [2025-09-16T21:11:51.640227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HESM.csv [2025-09-16T21:11:51.640341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XHR.csv [2025-09-16T21:11:51.640450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XIFR.csv [2025-09-16T21:11:51.640586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TROX.csv [2025-09-16T21:11:51.640716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDV.csv [2025-09-16T21:11:51.640843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BILL.csv [2025-09-16T21:11:51.640938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFD.csv [2025-09-16T21:11:51.641051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRBY.csv [2025-09-16T21:11:51.641178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REZI.csv [2025-09-16T21:11:51.641298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STC.csv [2025-09-16T21:11:51.641402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQI.csv [2025-09-16T21:11:51.641503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCI.csv [2025-09-16T21:11:51.641622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCX.csv [2025-09-16T21:11:51.641764] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOC.csv [2025-09-16T21:11:51.641865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIC.csv [2025-09-16T21:11:51.641972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPC.csv [2025-09-16T21:11:51.642078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALUR.csv [2025-09-16T21:11:51.642219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRI.csv [2025-09-16T21:11:51.642330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INR.csv [2025-09-16T21:11:51.642449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEE.csv [2025-09-16T21:11:51.642554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHK.csv [2025-09-16T21:11:51.642678] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIMN.csv [2025-09-16T21:11:51.642794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLD.csv [2025-09-16T21:11:51.642890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKE.csv [2025-09-16T21:11:51.642996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLXR.csv [2025-09-16T21:11:51.643113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPM.csv [2025-09-16T21:11:51.643223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTS.csv [2025-09-16T21:11:51.643326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDI.csv [2025-09-16T21:11:51.643430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APTV.csv [2025-09-16T21:11:51.643550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLI.csv [2025-09-16T21:11:51.643847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QSR.csv [2025-09-16T21:11:51.643966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSV.csv [2025-09-16T21:11:51.644093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAA.csv [2025-09-16T21:11:51.644200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THS.csv [2025-09-16T21:11:51.644316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDIV.csv [2025-09-16T21:11:51.644424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BALL.csv [2025-09-16T21:11:51.644561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IR.csv [2025-09-16T21:11:51.644693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODV.csv [2025-09-16T21:11:51.644827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVLG.csv [2025-09-16T21:11:51.644950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMI.csv [2025-09-16T21:11:51.645058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNF.csv [2025-09-16T21:11:51.645160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CW.csv [2025-09-16T21:11:51.645252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYI.csv [2025-09-16T21:11:51.645359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PACK.csv [2025-09-16T21:11:51.645465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COP.csv [2025-09-16T21:11:51.645601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMT.csv [2025-09-16T21:11:51.645739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLYM.csv [2025-09-16T21:11:51.645866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DINO.csv [2025-09-16T21:11:51.645987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAC.csv [2025-09-16T21:11:51.646102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMG.csv [2025-09-16T21:11:51.646236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AU.csv [2025-09-16T21:11:51.646349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AKR.csv [2025-09-16T21:11:51.646457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPG.csv [2025-09-16T21:11:51.646552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMM.csv [2025-09-16T21:11:51.646680] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHF.csv [2025-09-16T21:11:51.646771] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPH.csv [2025-09-16T21:11:51.646901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADT.csv [2025-09-16T21:11:51.646997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIT.csv [2025-09-16T21:11:51.647115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTS.csv [2025-09-16T21:11:51.647219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBF.csv [2025-09-16T21:11:51.647319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARCO.csv [2025-09-16T21:11:51.647841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNC.csv [2025-09-16T21:11:51.647988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHC.csv [2025-09-16T21:11:51.648089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SG.csv [2025-09-16T21:11:51.648198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPT.csv [2025-09-16T21:11:51.648296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THLV.csv [2025-09-16T21:11:51.648409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDDT.csv [2025-09-16T21:11:51.648535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MA.csv [2025-09-16T21:11:51.648632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADC.csv [2025-09-16T21:11:51.648752] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIRT.csv [2025-09-16T21:11:51.648848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAR.csv [2025-09-16T21:11:51.648954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIG.csv [2025-09-16T21:11:51.649065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTG.csv [2025-09-16T21:11:51.649177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BW.csv [2025-09-16T21:11:51.649279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRA.csv [2025-09-16T21:11:51.649383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MODG.csv [2025-09-16T21:11:51.649491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AQNB.csv [2025-09-16T21:11:51.649593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STK.csv [2025-09-16T21:11:51.649725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABR.csv [2025-09-16T21:11:51.649833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATR.csv [2025-09-16T21:11:51.649931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFXT.csv [2025-09-16T21:11:51.650028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CF.csv [2025-09-16T21:11:51.650130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTBB.csv [2025-09-16T21:11:51.650242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GROV.csv [2025-09-16T21:11:51.650350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLX.csv [2025-09-16T21:11:51.650467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRGY.csv [2025-09-16T21:11:51.650566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLVT.csv [2025-09-16T21:11:51.650707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HHH.csv [2025-09-16T21:11:51.650825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTO.csv [2025-09-16T21:11:51.650953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEA.csv [2025-09-16T21:11:51.651049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OXM.csv [2025-09-16T21:11:51.651156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRAK.csv [2025-09-16T21:11:51.651277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPG.csv [2025-09-16T21:11:51.651400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIG.csv [2025-09-16T21:11:51.651510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDC.csv [2025-09-16T21:11:51.651619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVV.csv [2025-09-16T21:11:51.651751] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPC.csv [2025-09-16T21:11:51.651862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRSU.csv [2025-09-16T21:11:51.651960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IH.csv [2025-09-16T21:11:51.652093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECL.csv [2025-09-16T21:11:51.652190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTH.csv [2025-09-16T21:11:51.652300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUM.csv [2025-09-16T21:11:51.652405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTVA.csv [2025-09-16T21:11:51.652531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSTS.csv [2025-09-16T21:11:51.652661] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESS.csv [2025-09-16T21:11:51.652776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FICO.csv [2025-09-16T21:11:51.652889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USA.csv [2025-09-16T21:11:51.652994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNC.csv [2025-09-16T21:11:51.653140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSB.csv [2025-09-16T21:11:51.653235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KF.csv [2025-09-16T21:11:51.653334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DVA.csv [2025-09-16T21:11:51.653426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPRU.csv [2025-09-16T21:11:51.653530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFN.csv [2025-09-16T21:11:51.653635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPB.csv [2025-09-16T21:11:51.653778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKKT.csv [2025-09-16T21:11:51.653915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHGG.csv [2025-09-16T21:11:51.654030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIS.csv [2025-09-16T21:11:51.654122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHOC.csv [2025-09-16T21:11:51.654221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBGS.csv [2025-09-16T21:11:51.654327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKV.csv [2025-09-16T21:11:51.654427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KLC.csv [2025-09-16T21:11:51.654527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLQT.csv [2025-09-16T21:11:51.654679] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVRR.csv [2025-09-16T21:11:51.654800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMB.csv [2025-09-16T21:11:51.654931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASBA.csv [2025-09-16T21:11:51.655038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVNA.csv [2025-09-16T21:11:51.655134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGR.csv [2025-09-16T21:11:51.655233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBXG.csv [2025-09-16T21:11:51.655452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BZH.csv [2025-09-16T21:11:51.655572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACA.csv [2025-09-16T21:11:51.655804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRA.csv [2025-09-16T21:11:51.655920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPP.csv [2025-09-16T21:11:51.656043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGR.csv [2025-09-16T21:11:51.656156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEI.csv [2025-09-16T21:11:51.656261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KB.csv [2025-09-16T21:11:51.656367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGL.csv [2025-09-16T21:11:51.656472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEFC.csv [2025-09-16T21:11:51.656595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUI.csv [2025-09-16T21:11:51.656706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAI.csv [2025-09-16T21:11:51.656802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CULP.csv [2025-09-16T21:11:51.656912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNT.csv [2025-09-16T21:11:51.657040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETV.csv [2025-09-16T21:11:51.657145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURV.csv [2025-09-16T21:11:51.657266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDW.csv [2025-09-16T21:11:51.657377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COLD.csv [2025-09-16T21:11:51.657526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYH.csv [2025-09-16T21:11:51.657676] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BJ.csv [2025-09-16T21:11:51.657787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THW.csv [2025-09-16T21:11:51.657887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAGS.csv [2025-09-16T21:11:51.657992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNO.csv [2025-09-16T21:11:51.658102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COUR.csv [2025-09-16T21:11:51.658212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CP.csv [2025-09-16T21:11:51.658327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCK.csv [2025-09-16T21:11:51.658428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVT.csv [2025-09-16T21:11:51.658541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHR.csv [2025-09-16T21:11:51.658670] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDN.csv [2025-09-16T21:11:51.658788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPRO.csv [2025-09-16T21:11:51.658884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSA.csv [2025-09-16T21:11:51.658995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHC.csv [2025-09-16T21:11:51.659133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTU.csv [2025-09-16T21:11:51.659234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLTO.csv [2025-09-16T21:11:51.659340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEI.csv [2025-09-16T21:11:51.659448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBM.csv [2025-09-16T21:11:51.659545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXR.csv [2025-09-16T21:11:51.659673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LION.csv [2025-09-16T21:11:51.659793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXC.csv [2025-09-16T21:11:51.659898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVX.csv [2025-09-16T21:11:51.660012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGR.csv [2025-09-16T21:11:51.660325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEM.csv [2025-09-16T21:11:51.660425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWP.csv [2025-09-16T21:11:51.660528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLTY.csv [2025-09-16T21:11:51.660628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBAN.csv [2025-09-16T21:11:51.660750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RHI.csv [2025-09-16T21:11:51.660848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HXL.csv [2025-09-16T21:11:51.660964] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLOC.csv [2025-09-16T21:11:51.661069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHT.csv [2025-09-16T21:11:51.661173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AQN.csv [2025-09-16T21:11:51.661278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROG.csv [2025-09-16T21:11:51.661382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VALE.csv [2025-09-16T21:11:51.661487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRM.csv [2025-09-16T21:11:51.661593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CION.csv [2025-09-16T21:11:51.661716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMS.csv [2025-09-16T21:11:51.661830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWR.csv [2025-09-16T21:11:51.661926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFC.csv [2025-09-16T21:11:51.662028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRT.csv [2025-09-16T21:11:51.662146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GENI.csv [2025-09-16T21:11:51.662268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VFC.csv [2025-09-16T21:11:51.662377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMFG.csv [2025-09-16T21:11:51.662481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECC.csv [2025-09-16T21:11:51.662565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGTY.csv [2025-09-16T21:11:51.662690] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DCI.csv [2025-09-16T21:11:51.662798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NJR.csv [2025-09-16T21:11:51.662921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CR.csv [2025-09-16T21:11:51.663044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFI.csv [2025-09-16T21:11:51.663151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OC.csv [2025-09-16T21:11:51.663254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SM.csv [2025-09-16T21:11:51.663349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHD.csv [2025-09-16T21:11:51.663442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGG.csv [2025-09-16T21:11:51.663539] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APO.csv [2025-09-16T21:11:51.663717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDT.csv [2025-09-16T21:11:51.663828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTM.csv [2025-09-16T21:11:51.663953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHH.csv [2025-09-16T21:11:51.664051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYI.csv [2025-09-16T21:11:51.664150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBDC.csv [2025-09-16T21:11:51.664246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOAH.csv [2025-09-16T21:11:51.664342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPR.csv [2025-09-16T21:11:51.664448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARI.csv [2025-09-16T21:11:51.664563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOS.csv [2025-09-16T21:11:51.664681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GETY.csv [2025-09-16T21:11:51.664788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKH.csv [2025-09-16T21:11:51.664884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRH.csv [2025-09-16T21:11:51.664981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HKD.csv [2025-09-16T21:11:51.665082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAB.csv [2025-09-16T21:11:51.665196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REVG.csv [2025-09-16T21:11:51.665301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SIG.csv [2025-09-16T21:11:51.665398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITUB.csv [2025-09-16T21:11:51.665496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNS.csv [2025-09-16T21:11:51.665592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SILA.csv [2025-09-16T21:11:51.665707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIW.csv [2025-09-16T21:11:51.665820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NX.csv [2025-09-16T21:11:51.665930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGRE.csv [2025-09-16T21:11:51.666113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNC.csv [2025-09-16T21:11:51.666222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCDL.csv [2025-09-16T21:11:51.666328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBE.csv [2025-09-16T21:11:51.666445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRND.csv [2025-09-16T21:11:51.666546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNX.csv [2025-09-16T21:11:51.666669] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBX.csv [2025-09-16T21:11:51.666773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACCO.csv [2025-09-16T21:11:51.666879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTEX.csv [2025-09-16T21:11:51.666979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AL.csv [2025-09-16T21:11:51.667081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEX.csv [2025-09-16T21:11:51.667179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NC.csv [2025-09-16T21:11:51.667281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNL.csv [2025-09-16T21:11:51.667377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VATE.csv [2025-09-16T21:11:51.667473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFS.csv [2025-09-16T21:11:51.667593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDS.csv [2025-09-16T21:11:51.667705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWK.csv [2025-09-16T21:11:51.667827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNP.csv [2025-09-16T21:11:51.667941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYZ.csv [2025-09-16T21:11:51.668031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRI.csv [2025-09-16T21:11:51.668138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOI.csv [2025-09-16T21:11:51.668239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSB.csv [2025-09-16T21:11:51.668340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FG.csv [2025-09-16T21:11:51.668438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKT.csv [2025-09-16T21:11:51.668543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVE.csv [2025-09-16T21:11:51.668696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNR.csv [2025-09-16T21:11:51.668800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUV.csv [2025-09-16T21:11:51.668903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RL.csv [2025-09-16T21:11:51.669002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXT.csv [2025-09-16T21:11:51.669103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLE.csv [2025-09-16T21:11:51.669196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LW.csv [2025-09-16T21:11:51.669390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/J.csv [2025-09-16T21:11:51.669506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAE.csv [2025-09-16T21:11:51.669606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONON.csv [2025-09-16T21:11:51.669724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFY.csv [2025-09-16T21:11:51.669827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLYS.csv [2025-09-16T21:11:51.669936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBRE.csv [2025-09-16T21:11:51.670038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWO.csv [2025-09-16T21:11:51.670132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFB.csv [2025-09-16T21:11:51.670237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSA.csv [2025-09-16T21:11:51.670340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDY.csv [2025-09-16T21:11:51.670445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLG.csv [2025-09-16T21:11:51.670533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIA.csv [2025-09-16T21:11:51.670621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNGR.csv [2025-09-16T21:11:51.670733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNET.csv [2025-09-16T21:11:51.670861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEM.csv [2025-09-16T21:11:51.670973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNL.csv [2025-09-16T21:11:51.671077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBND.csv [2025-09-16T21:11:51.671165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTB.csv [2025-09-16T21:11:51.671269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBI.csv [2025-09-16T21:11:51.671398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDJ.csv [2025-09-16T21:11:51.671499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SONY.csv [2025-09-16T21:11:51.671598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOC.csv [2025-09-16T21:11:51.671832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPL.csv [2025-09-16T21:11:51.671940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAC.csv [2025-09-16T21:11:51.672036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PD.csv [2025-09-16T21:11:51.672135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JXN.csv [2025-09-16T21:11:51.672239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOT.csv [2025-09-16T21:11:51.672343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDI.csv [2025-09-16T21:11:51.672448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABM.csv [2025-09-16T21:11:51.672564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCUS.csv [2025-09-16T21:11:51.672803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNRC.csv [2025-09-16T21:11:51.672922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIY.csv [2025-09-16T21:11:51.673093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIA.csv [2025-09-16T21:11:51.673184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITP.csv [2025-09-16T21:11:51.673281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNR.csv [2025-09-16T21:11:51.673386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DG.csv [2025-09-16T21:11:51.673487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MANU.csv [2025-09-16T21:11:51.673591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHD.csv [2025-09-16T21:11:51.673707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXE.csv [2025-09-16T21:11:51.673801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIPS.csv [2025-09-16T21:11:51.673902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOL.csv [2025-09-16T21:11:51.673997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRCS.csv [2025-09-16T21:11:51.674096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPO.csv [2025-09-16T21:11:51.674201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GD.csv [2025-09-16T21:11:51.674306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPYP.csv [2025-09-16T21:11:51.674421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRGV.csv [2025-09-16T21:11:51.674521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTF.csv [2025-09-16T21:11:51.674616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVRI.csv [2025-09-16T21:11:51.674737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RERE.csv [2025-09-16T21:11:51.674854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMO.csv [2025-09-16T21:11:51.674960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STNG.csv [2025-09-16T21:11:51.675066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHT.csv [2025-09-16T21:11:51.675162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPAC.csv [2025-09-16T21:11:51.675259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VYX.csv [2025-09-16T21:11:51.675367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETO.csv [2025-09-16T21:11:51.675461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCO.csv [2025-09-16T21:11:51.675560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUK.csv [2025-09-16T21:11:51.675676] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUCK.csv [2025-09-16T21:11:51.675862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVS.csv [2025-09-16T21:11:51.675967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JFR.csv [2025-09-16T21:11:51.676059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RELX.csv [2025-09-16T21:11:51.676154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IEX.csv [2025-09-16T21:11:51.676254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MET.csv [2025-09-16T21:11:51.676357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OLN.csv [2025-09-16T21:11:51.676458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBS.csv [2025-09-16T21:11:51.676566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAI.csv [2025-09-16T21:11:51.676679] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQNS.csv [2025-09-16T21:11:51.676789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETN.csv [2025-09-16T21:11:51.676901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVYO.csv [2025-09-16T21:11:51.676986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVR.csv [2025-09-16T21:11:51.677077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMI.csv [2025-09-16T21:11:51.677189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECVT.csv [2025-09-16T21:11:51.677300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VET.csv [2025-09-16T21:11:51.677404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBS.csv [2025-09-16T21:11:51.677506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTV.csv [2025-09-16T21:11:51.677608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STM.csv [2025-09-16T21:11:51.677726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CII.csv [2025-09-16T21:11:51.677828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDI.csv [2025-09-16T21:11:51.677924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOCL.csv [2025-09-16T21:11:51.678012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBC.csv [2025-09-16T21:11:51.678112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSE.csv [2025-09-16T21:11:51.678212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIT.csv [2025-09-16T21:11:51.678330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAL.csv [2025-09-16T21:11:51.678456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHH.csv [2025-09-16T21:11:51.678550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXC.csv [2025-09-16T21:11:51.678669] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DUKB.csv [2025-09-16T21:11:51.678787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ED.csv [2025-09-16T21:11:51.678887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JGH.csv [2025-09-16T21:11:51.678993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMT.csv [2025-09-16T21:11:51.679152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RWT.csv [2025-09-16T21:11:51.679255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QGEN.csv [2025-09-16T21:11:51.679350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MC.csv [2025-09-16T21:11:51.679449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBTA.csv [2025-09-16T21:11:51.679571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APH.csv [2025-09-16T21:11:51.679732] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NI.csv [2025-09-16T21:11:51.679837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWI.csv [2025-09-16T21:11:51.679934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAO.csv [2025-09-16T21:11:51.680031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RWTP.csv [2025-09-16T21:11:51.680136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFY.csv [2025-09-16T21:11:51.680238] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEEV.csv [2025-09-16T21:11:51.680336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WES.csv [2025-09-16T21:11:51.680436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRS.csv [2025-09-16T21:11:51.680528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIPR.csv [2025-09-16T21:11:51.680626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMHI.csv [2025-09-16T21:11:51.680870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDD.csv [2025-09-16T21:11:51.680976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YETI.csv [2025-09-16T21:11:51.681087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/U.csv [2025-09-16T21:11:51.681185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KR.csv [2025-09-16T21:11:51.681304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCE.csv [2025-09-16T21:11:51.681407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBRT.csv [2025-09-16T21:11:51.681525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALEX.csv [2025-09-16T21:11:51.681634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOW.csv [2025-09-16T21:11:51.681749] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEN.csv [2025-09-16T21:11:51.681839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAA.csv [2025-09-16T21:11:51.682070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXRT.csv [2025-09-16T21:11:51.682159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKD.csv [2025-09-16T21:11:51.682254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUA.csv [2025-09-16T21:11:51.682352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JNJ.csv [2025-09-16T21:11:51.682447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGY.csv [2025-09-16T21:11:51.682546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LH.csv [2025-09-16T21:11:51.682662] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGR.csv [2025-09-16T21:11:51.682770] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGS.csv [2025-09-16T21:11:51.682891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOOT.csv [2025-09-16T21:11:51.682987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNA.csv [2025-09-16T21:11:51.683089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSTM.csv [2025-09-16T21:11:51.683200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PUMP.csv [2025-09-16T21:11:51.683299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPH.csv [2025-09-16T21:11:51.683403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLX.csv [2025-09-16T21:11:51.683502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAC.csv [2025-09-16T21:11:51.683596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVO.csv [2025-09-16T21:11:51.683702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAG.csv [2025-09-16T21:11:51.683805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AP.csv [2025-09-16T21:11:51.683913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDP.csv [2025-09-16T21:11:51.684010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAN.csv [2025-09-16T21:11:51.684123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMN.csv [2025-09-16T21:11:51.684227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZH.csv [2025-09-16T21:11:51.684356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMAI.csv [2025-09-16T21:11:51.684460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLF.csv [2025-09-16T21:11:51.684552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SD.csv [2025-09-16T21:11:51.684658] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKLZ.csv [2025-09-16T21:11:51.684760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINS.csv [2025-09-16T21:11:51.684846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LANV.csv [2025-09-16T21:11:51.684936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALX.csv [2025-09-16T21:11:51.685056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBN.csv [2025-09-16T21:11:51.685151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFA.csv [2025-09-16T21:11:51.685258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDO.csv [2025-09-16T21:11:51.685359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYN.csv [2025-09-16T21:11:51.685467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKR.csv [2025-09-16T21:11:51.685558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURB.csv [2025-09-16T21:11:51.685693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HP.csv [2025-09-16T21:11:51.685787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCQ.csv [2025-09-16T21:11:51.685882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPR.csv [2025-09-16T21:11:51.685981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVT.csv [2025-09-16T21:11:51.686061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPJ.csv [2025-09-16T21:11:51.686151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRIM.csv [2025-09-16T21:11:51.686260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIC.csv [2025-09-16T21:11:51.686369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBH.csv [2025-09-16T21:11:51.686461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGP.csv [2025-09-16T21:11:51.686565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAM.csv [2025-09-16T21:11:51.686684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHC.csv [2025-09-16T21:11:51.686820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTI.csv [2025-09-16T21:11:51.686927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOLE.csv [2025-09-16T21:11:51.687029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHD.csv [2025-09-16T21:11:51.687134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMCM.csv [2025-09-16T21:11:51.687243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMO.csv [2025-09-16T21:11:51.687444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WWW.csv [2025-09-16T21:11:51.687548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AI.csv [2025-09-16T21:11:51.687761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIO.csv [2025-09-16T21:11:51.687869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHM.csv [2025-09-16T21:11:51.687984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USFD.csv [2025-09-16T21:11:51.688090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOV.csv [2025-09-16T21:11:51.688193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVO.csv [2025-09-16T21:11:51.688286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDP.csv [2025-09-16T21:11:51.688407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSDL.csv [2025-09-16T21:11:51.688502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIGS.csv [2025-09-16T21:11:51.688595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTW.csv [2025-09-16T21:11:51.688705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MG.csv [2025-09-16T21:11:51.688804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODC.csv [2025-09-16T21:11:51.688903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOBY.csv [2025-09-16T21:11:51.689004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKR.csv [2025-09-16T21:11:51.689090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONL.csv [2025-09-16T21:11:51.689176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRI.csv [2025-09-16T21:11:51.689268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSL.csv [2025-09-16T21:11:51.689382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGSF.csv [2025-09-16T21:11:51.689479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/M.csv [2025-09-16T21:11:51.689602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGX.csv [2025-09-16T21:11:51.689716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIST.csv [2025-09-16T21:11:51.689823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMAX.csv [2025-09-16T21:11:51.689922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDC.csv [2025-09-16T21:11:51.690027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STE.csv [2025-09-16T21:11:51.690117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUPV.csv [2025-09-16T21:11:51.690204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAF.csv [2025-09-16T21:11:51.690416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAP.csv [2025-09-16T21:11:51.690521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AYI.csv [2025-09-16T21:11:51.690614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LU.csv [2025-09-16T21:11:51.690758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPQ.csv [2025-09-16T21:11:51.690861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALV.csv [2025-09-16T21:11:51.690969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAXS.csv [2025-09-16T21:11:51.691068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMT.csv [2025-09-16T21:11:51.691162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEF.csv [2025-09-16T21:11:51.691274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVL.csv [2025-09-16T21:11:51.691374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBP.csv [2025-09-16T21:11:51.691468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGD.csv [2025-09-16T21:11:51.691563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LITB.csv [2025-09-16T21:11:51.691677] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUN.csv [2025-09-16T21:11:51.691786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSKD.csv [2025-09-16T21:11:51.691883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UL.csv [2025-09-16T21:11:51.692004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXG.csv [2025-09-16T21:11:51.692110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATV.csv [2025-09-16T21:11:51.692212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOUR.csv [2025-09-16T21:11:51.692307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAZ.csv [2025-09-16T21:11:51.692414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AB.csv [2025-09-16T21:11:51.692513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBI.csv [2025-09-16T21:11:51.692610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLS.csv [2025-09-16T21:11:51.692731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DQ.csv [2025-09-16T21:11:51.692841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMG.csv [2025-09-16T21:11:51.692933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHG.csv [2025-09-16T21:11:51.693026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPNG.csv [2025-09-16T21:11:51.693116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NDMO.csv [2025-09-16T21:11:51.693216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COOK.csv [2025-09-16T21:11:51.693316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUMC.csv [2025-09-16T21:11:51.693399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSBD.csv [2025-09-16T21:11:51.693497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOC.csv [2025-09-16T21:11:51.693589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSC.csv [2025-09-16T21:11:51.693700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGHC.csv [2025-09-16T21:11:51.693796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DX.csv [2025-09-16T21:11:51.693901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTW.csv [2025-09-16T21:11:51.694003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMK.csv [2025-09-16T21:11:51.694090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SID.csv [2025-09-16T21:11:51.694184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFPM.csv [2025-09-16T21:11:51.694280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDF.csv [2025-09-16T21:11:51.694492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPIR.csv [2025-09-16T21:11:51.694585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOF.csv [2025-09-16T21:11:51.694706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GYLD.csv [2025-09-16T21:11:51.694806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NYT.csv [2025-09-16T21:11:51.694901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMM.csv [2025-09-16T21:11:51.695009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMP.csv [2025-09-16T21:11:51.695100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DPG.csv [2025-09-16T21:11:51.695191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMO.csv [2025-09-16T21:11:51.695288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HE.csv [2025-09-16T21:11:51.695398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBW.csv [2025-09-16T21:11:51.695498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VG.csv [2025-09-16T21:11:51.695580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMO.csv [2025-09-16T21:11:51.695802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTRN.csv [2025-09-16T21:11:51.695905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WKC.csv [2025-09-16T21:11:51.696004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOS.csv [2025-09-16T21:11:51.696099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOF.csv [2025-09-16T21:11:51.696200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETR.csv [2025-09-16T21:11:51.696295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMT.csv [2025-09-16T21:11:51.696393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAL.csv [2025-09-16T21:11:51.696517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZVIA.csv [2025-09-16T21:11:51.696619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEVA.csv [2025-09-16T21:11:51.696733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOMD.csv [2025-09-16T21:11:51.696831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVS.csv [2025-09-16T21:11:51.696933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CL.csv [2025-09-16T21:11:51.697029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNF.csv [2025-09-16T21:11:51.697120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRW.csv [2025-09-16T21:11:51.697213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SST.csv [2025-09-16T21:11:51.697308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNCE.csv [2025-09-16T21:11:51.697406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNS.csv [2025-09-16T21:11:51.697500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUZ.csv [2025-09-16T21:11:51.697592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGV.csv [2025-09-16T21:11:51.697704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WT.csv [2025-09-16T21:11:51.697812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBI.csv [2025-09-16T21:11:51.697903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECCU.csv [2025-09-16T21:11:51.697992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELAN.csv [2025-09-16T21:11:51.698085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCAT.csv [2025-09-16T21:11:51.698178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMS.csv [2025-09-16T21:11:51.698295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AACT.csv [2025-09-16T21:11:51.698402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOP.csv [2025-09-16T21:11:51.698700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CX.csv [2025-09-16T21:11:51.698804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KO.csv [2025-09-16T21:11:51.698898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRB.csv [2025-09-16T21:11:51.698992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTB.csv [2025-09-16T21:11:51.699102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RH.csv [2025-09-16T21:11:51.699200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNNT.csv [2025-09-16T21:11:51.699304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSN.csv [2025-09-16T21:11:51.699407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXT.csv [2025-09-16T21:11:51.699526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTES.csv [2025-09-16T21:11:51.699633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPRK.csv [2025-09-16T21:11:51.699744] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVF.csv [2025-09-16T21:11:51.699869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMN.csv [2025-09-16T21:11:51.699967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OTIS.csv [2025-09-16T21:11:51.700059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCO.csv [2025-09-16T21:11:51.700149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRC.csv [2025-09-16T21:11:51.700239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRN.csv [2025-09-16T21:11:51.700334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DK.csv [2025-09-16T21:11:51.700435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BURL.csv [2025-09-16T21:11:51.700535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTD.csv [2025-09-16T21:11:51.700630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LLY.csv [2025-09-16T21:11:51.700739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMA.csv [2025-09-16T21:11:51.700828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CALX.csv [2025-09-16T21:11:51.700921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DVN.csv [2025-09-16T21:11:51.701017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIW.csv [2025-09-16T21:11:51.701114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCO.csv [2025-09-16T21:11:51.701208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SREA.csv [2025-09-16T21:11:51.701307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDG.csv [2025-09-16T21:11:51.701404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBR.csv [2025-09-16T21:11:51.701500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEA.csv [2025-09-16T21:11:51.701590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSR.csv [2025-09-16T21:11:51.701714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATEN.csv [2025-09-16T21:11:51.701807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STLA.csv [2025-09-16T21:11:51.701904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMC.csv [2025-09-16T21:11:51.701995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXV.csv [2025-09-16T21:11:51.702090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLOB.csv [2025-09-16T21:11:51.702185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMG.csv [2025-09-16T21:11:51.702307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YMM.csv [2025-09-16T21:11:51.702400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YALA.csv [2025-09-16T21:11:51.702495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IP.csv [2025-09-16T21:11:51.702593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNO.csv [2025-09-16T21:11:51.702711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEXA.csv [2025-09-16T21:11:51.702815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMHC.csv [2025-09-16T21:11:51.702920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPC.csv [2025-09-16T21:11:51.703022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/K.csv [2025-09-16T21:11:51.703123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HDB.csv [2025-09-16T21:11:51.703224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAFE.csv [2025-09-16T21:11:51.703324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QTWO.csv [2025-09-16T21:11:51.703425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOK.csv [2025-09-16T21:11:51.703518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPCE.csv [2025-09-16T21:11:51.703617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOAR.csv [2025-09-16T21:11:51.703837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPF.csv [2025-09-16T21:11:51.703974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFX.csv [2025-09-16T21:11:51.704066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLIO.csv [2025-09-16T21:11:51.704159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDR.csv [2025-09-16T21:11:51.704257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RTO.csv [2025-09-16T21:11:51.704351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTO.csv [2025-09-16T21:11:51.704447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOA.csv [2025-09-16T21:11:51.704696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLS.csv [2025-09-16T21:11:51.704799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TM.csv [2025-09-16T21:11:51.704895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERJ.csv [2025-09-16T21:11:51.704982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNC.csv [2025-09-16T21:11:51.705067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPLX.csv [2025-09-16T21:11:51.705158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PX.csv [2025-09-16T21:11:51.705248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MED.csv [2025-09-16T21:11:51.705341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPE.csv [2025-09-16T21:11:51.705433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIK.csv [2025-09-16T21:11:51.705529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGR.csv [2025-09-16T21:11:51.705613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPF.csv [2025-09-16T21:11:51.705722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSI.csv [2025-09-16T21:11:51.705804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIMO.csv [2025-09-16T21:11:51.705901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDU.csv [2025-09-16T21:11:51.705997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTMX.csv [2025-09-16T21:11:51.706096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBM.csv [2025-09-16T21:11:51.706190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECG.csv [2025-09-16T21:11:51.706280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFT.csv [2025-09-16T21:11:51.706381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CANG.csv [2025-09-16T21:11:51.706479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTI.csv [2025-09-16T21:11:51.706575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UIS.csv [2025-09-16T21:11:51.706697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RC.csv [2025-09-16T21:11:51.706811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LII.csv [2025-09-16T21:11:51.706909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVH.csv [2025-09-16T21:11:51.707032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPRT.csv [2025-09-16T21:11:51.707129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCI.csv [2025-09-16T21:11:51.707226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIO.csv [2025-09-16T21:11:51.707314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOTE.csv [2025-09-16T21:11:51.707404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SABA.csv [2025-09-16T21:11:51.707508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSH.csv [2025-09-16T21:11:51.707604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCOR.csv [2025-09-16T21:11:51.707726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVK.csv [2025-09-16T21:11:51.707824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHLD.csv [2025-09-16T21:11:51.707920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDD.csv [2025-09-16T21:11:51.708038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESE.csv [2025-09-16T21:11:51.708133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GF.csv [2025-09-16T21:11:51.708228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSI.csv [2025-09-16T21:11:51.708330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEN.csv [2025-09-16T21:11:51.708420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGV.csv [2025-09-16T21:11:51.708515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGC.csv [2025-09-16T21:11:51.708723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FT.csv [2025-09-16T21:11:51.708824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQY.csv [2025-09-16T21:11:51.708929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNMA.csv [2025-09-16T21:11:51.709028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSAC.csv [2025-09-16T21:11:51.709137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIP.csv [2025-09-16T21:11:51.709234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EB.csv [2025-09-16T21:11:51.709327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKIL.csv [2025-09-16T21:11:51.709418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSM.csv [2025-09-16T21:11:51.709512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIV.csv [2025-09-16T21:11:51.709611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTOL.csv [2025-09-16T21:11:51.709728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXL.csv [2025-09-16T21:11:51.709826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLI.csv [2025-09-16T21:11:51.709924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUC.csv [2025-09-16T21:11:51.710020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEE.csv [2025-09-16T21:11:51.710106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWRE.csv [2025-09-16T21:11:51.710188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFL.csv [2025-09-16T21:11:51.710282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WINN.csv [2025-09-16T21:11:51.710378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UE.csv [2025-09-16T21:11:51.710468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBAB.csv [2025-09-16T21:11:51.710558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEB.csv [2025-09-16T21:11:51.710701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIV.csv [2025-09-16T21:11:51.710797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEL.csv [2025-09-16T21:11:51.710902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QS.csv [2025-09-16T21:11:51.711007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHI.csv [2025-09-16T21:11:51.711097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGM.csv [2025-09-16T21:11:51.711181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTD.csv [2025-09-16T21:11:51.711278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOLF.csv [2025-09-16T21:11:51.711369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNN.csv [2025-09-16T21:11:51.711475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVST.csv [2025-09-16T21:11:51.711566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LCII.csv [2025-09-16T21:11:51.711765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOS.csv [2025-09-16T21:11:51.711871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNOP.csv [2025-09-16T21:11:51.711988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIM.csv [2025-09-16T21:11:51.712123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBC.csv [2025-09-16T21:11:51.712220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLF.csv [2025-09-16T21:11:51.712315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAIN.csv [2025-09-16T21:11:51.712418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAK.csv [2025-09-16T21:11:51.712518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLG.csv [2025-09-16T21:11:51.712620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEAF.csv [2025-09-16T21:11:51.712767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSM.csv [2025-09-16T21:11:51.712872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVR.csv [2025-09-16T21:11:51.712965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EME.csv [2025-09-16T21:11:51.713062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WH.csv [2025-09-16T21:11:51.713164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPV.csv [2025-09-16T21:11:51.713263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGNA.csv [2025-09-16T21:11:51.713354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CC.csv [2025-09-16T21:11:51.713519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAM.csv [2025-09-16T21:11:51.713613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COTY.csv [2025-09-16T21:11:51.713735] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMWB.csv [2025-09-16T21:11:51.713829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBF.csv [2025-09-16T21:11:51.713943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOUS.csv [2025-09-16T21:11:51.714038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRO.csv [2025-09-16T21:11:51.714131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOG.csv [2025-09-16T21:11:51.714251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHIN.csv [2025-09-16T21:11:51.714350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPRI.csv [2025-09-16T21:11:51.714448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPL.csv [2025-09-16T21:11:51.714541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDN.csv [2025-09-16T21:11:51.714626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOTU.csv [2025-09-16T21:11:51.714750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAD.csv [2025-09-16T21:11:51.714852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYD.csv [2025-09-16T21:11:51.714952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOX.csv [2025-09-16T21:11:51.715050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEW.csv [2025-09-16T21:11:51.715141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOF.csv [2025-09-16T21:11:51.715227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMC.csv [2025-09-16T21:11:51.715321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THR.csv [2025-09-16T21:11:51.715420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NE.csv [2025-09-16T21:11:51.715509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHR.csv [2025-09-16T21:11:51.715602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSX.csv [2025-09-16T21:11:51.715721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSTG.csv [2025-09-16T21:11:51.715824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCM.csv [2025-09-16T21:11:51.715936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AM.csv [2025-09-16T21:11:51.716031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASA.csv [2025-09-16T21:11:51.716185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNSO.csv [2025-09-16T21:11:51.716279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLI.csv [2025-09-16T21:11:51.716379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARW.csv [2025-09-16T21:11:51.716479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHM.csv [2025-09-16T21:11:51.716582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EW.csv [2025-09-16T21:11:51.716712] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPWR.csv [2025-09-16T21:11:51.716808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FGN.csv [2025-09-16T21:11:51.716912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTO.csv [2025-09-16T21:11:51.717011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PH.csv [2025-09-16T21:11:51.717100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APOS.csv [2025-09-16T21:11:51.717192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DD.csv [2025-09-16T21:11:51.717277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWEN.csv [2025-09-16T21:11:51.717378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWLO.csv [2025-09-16T21:11:51.717480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRNO.csv [2025-09-16T21:11:51.717566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSO.csv [2025-09-16T21:11:51.717670] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBT.csv [2025-09-16T21:11:51.717772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UDR.csv [2025-09-16T21:11:51.717871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTGC.csv [2025-09-16T21:11:51.717969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAAP.csv [2025-09-16T21:11:51.718061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSL.csv [2025-09-16T21:11:51.718154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPY.csv [2025-09-16T21:11:51.718247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ISD.csv [2025-09-16T21:11:51.718343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THG.csv [2025-09-16T21:11:51.718438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AROC.csv [2025-09-16T21:11:51.718675] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNK.csv [2025-09-16T21:11:51.718778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOV.csv [2025-09-16T21:11:51.718892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYI.csv [2025-09-16T21:11:51.718988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FE.csv [2025-09-16T21:11:51.719076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXK.csv [2025-09-16T21:11:51.719170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDY.csv [2025-09-16T21:11:51.719271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFF.csv [2025-09-16T21:11:51.719366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGM.csv [2025-09-16T21:11:51.719454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTI.csv [2025-09-16T21:11:51.719553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMP.csv [2025-09-16T21:11:51.719757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRG.csv [2025-09-16T21:11:51.719864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCS.csv [2025-09-16T21:11:51.719950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCS.csv [2025-09-16T21:11:51.720038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAM.csv [2025-09-16T21:11:51.720121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCC.csv [2025-09-16T21:11:51.720225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNT.csv [2025-09-16T21:11:51.720318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSI.csv [2025-09-16T21:11:51.720403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COF.csv [2025-09-16T21:11:51.720501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIV.csv [2025-09-16T21:11:51.720600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNH.csv [2025-09-16T21:11:51.720714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXM.csv [2025-09-16T21:11:51.720810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGT.csv [2025-09-16T21:11:51.720905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJM.csv [2025-09-16T21:11:51.721000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SN.csv [2025-09-16T21:11:51.721094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PERF.csv [2025-09-16T21:11:51.721185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DV.csv [2025-09-16T21:11:51.721270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BG.csv [2025-09-16T21:11:51.721371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGC.csv [2025-09-16T21:11:51.721485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPCT.csv [2025-09-16T21:11:51.721585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHAK.csv [2025-09-16T21:11:51.721712] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALSN.csv [2025-09-16T21:11:51.721815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNC.csv [2025-09-16T21:11:51.721933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESI.csv [2025-09-16T21:11:51.722032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCJ.csv [2025-09-16T21:11:51.722127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TG.csv [2025-09-16T21:11:51.722227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSM.csv [2025-09-16T21:11:51.722312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDH.csv [2025-09-16T21:11:51.722398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBNA.csv [2025-09-16T21:11:51.722492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REXR.csv [2025-09-16T21:11:51.722577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RKT.csv [2025-09-16T21:11:51.722691] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/G.csv [2025-09-16T21:11:51.722798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRT.csv [2025-09-16T21:11:51.722884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VCV.csv [2025-09-16T21:11:51.722992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOE.csv [2025-09-16T21:11:51.723078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRNT.csv [2025-09-16T21:11:51.723165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETW.csv [2025-09-16T21:11:51.723267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSW.csv [2025-09-16T21:11:51.723375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATS.csv [2025-09-16T21:11:51.723474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGY.csv [2025-09-16T21:11:51.723662] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEL.csv [2025-09-16T21:11:51.723763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KT.csv [2025-09-16T21:11:51.723857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GS.csv [2025-09-16T21:11:51.723980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARS.csv [2025-09-16T21:11:51.724080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEO.csv [2025-09-16T21:11:51.724194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPG.csv [2025-09-16T21:11:51.724292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPC.csv [2025-09-16T21:11:51.724383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LFT.csv [2025-09-16T21:11:51.724481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPI.csv [2025-09-16T21:11:51.724578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPJA.csv [2025-09-16T21:11:51.724798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKU.csv [2025-09-16T21:11:51.724901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIIN.csv [2025-09-16T21:11:51.724997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAC.csv [2025-09-16T21:11:51.725095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTE.csv [2025-09-16T21:11:51.725192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TK.csv [2025-09-16T21:11:51.725287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQH.csv [2025-09-16T21:11:51.725390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEO.csv [2025-09-16T21:11:51.725485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RHP.csv [2025-09-16T21:11:51.725580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLD.csv [2025-09-16T21:11:51.725694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBH.csv [2025-09-16T21:11:51.725800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USAC.csv [2025-09-16T21:11:51.725883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYM.csv [2025-09-16T21:11:51.725966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLT.csv [2025-09-16T21:11:51.726056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDT.csv [2025-09-16T21:11:51.726168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDO.csv [2025-09-16T21:11:51.726274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLY.csv [2025-09-16T21:11:51.726374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBR.csv [2025-09-16T21:11:51.726628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOG.csv [2025-09-16T21:11:51.726760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZKH.csv [2025-09-16T21:11:51.726866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RQI.csv [2025-09-16T21:11:51.726969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSG.csv [2025-09-16T21:11:51.727063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OBK.csv [2025-09-16T21:11:51.727158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HZO.csv [2025-09-16T21:11:51.727252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STRV.csv [2025-09-16T21:11:51.727357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLX.csv [2025-09-16T21:11:51.727446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THQ.csv [2025-09-16T21:11:51.727538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCU.csv [2025-09-16T21:11:51.727634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWH.csv [2025-09-16T21:11:51.727757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMD.csv [2025-09-16T21:11:51.727847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEGI.csv [2025-09-16T21:11:51.727940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CE.csv [2025-09-16T21:11:51.728035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMND.csv [2025-09-16T21:11:51.728132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNN.csv [2025-09-16T21:11:51.728225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHI.csv [2025-09-16T21:11:51.728316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMG.csv [2025-09-16T21:11:51.728414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PML.csv [2025-09-16T21:11:51.728506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIG.csv [2025-09-16T21:11:51.728599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OUT.csv [2025-09-16T21:11:51.728710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUE.csv [2025-09-16T21:11:51.728807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCCO.csv [2025-09-16T21:11:51.728922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPK.csv [2025-09-16T21:11:51.729021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEX.csv [2025-09-16T21:11:51.729125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASB.csv [2025-09-16T21:11:51.729234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PTA.csv [2025-09-16T21:11:51.729331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMC.csv [2025-09-16T21:11:51.729420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGA.csv [2025-09-16T21:11:51.729514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SES.csv [2025-09-16T21:11:51.729611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGS.csv [2025-09-16T21:11:51.729717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFL.csv [2025-09-16T21:11:51.729819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWX.csv [2025-09-16T21:11:51.729913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEE.csv [2025-09-16T21:11:51.729994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXE.csv [2025-09-16T21:11:51.730089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCL.csv [2025-09-16T21:11:51.730180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEP.csv [2025-09-16T21:11:51.730275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDOS.csv [2025-09-16T21:11:51.730359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFMZ.csv [2025-09-16T21:11:51.730453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EC.csv [2025-09-16T21:11:51.730550] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPX.csv [2025-09-16T21:11:51.730679] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOBO.csv [2025-09-16T21:11:51.730773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/POR.csv [2025-09-16T21:11:51.730857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEC.csv [2025-09-16T21:11:51.730959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CI.csv [2025-09-16T21:11:51.731047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOYA.csv [2025-09-16T21:11:51.731137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEU.csv [2025-09-16T21:11:51.731229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXP.csv [2025-09-16T21:11:51.731314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFG.csv [2025-09-16T21:11:51.731404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMX.csv [2025-09-16T21:11:51.731500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRO.csv [2025-09-16T21:11:51.731594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZK.csv [2025-09-16T21:11:51.731810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNFI.csv [2025-09-16T21:11:51.732016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NET.csv [2025-09-16T21:11:51.732110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRC.csv [2025-09-16T21:11:51.732216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBWI.csv [2025-09-16T21:11:51.732310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TR.csv [2025-09-16T21:11:51.732409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RM.csv [2025-09-16T21:11:51.732500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGER.csv [2025-09-16T21:11:51.732596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NSC.csv [2025-09-16T21:11:51.732706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEL.csv [2025-09-16T21:11:51.732804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKT.csv [2025-09-16T21:11:51.732911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ING.csv [2025-09-16T21:11:51.733025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARMK.csv [2025-09-16T21:11:51.733117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPE.csv [2025-09-16T21:11:51.733210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFE.csv [2025-09-16T21:11:51.733297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGU.csv [2025-09-16T21:11:51.733391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTUS.csv [2025-09-16T21:11:51.733475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEG.csv [2025-09-16T21:11:51.733561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWLT.csv [2025-09-16T21:11:51.733669] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARE.csv [2025-09-16T21:11:51.733769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMX.csv [2025-09-16T21:11:51.733875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTTR.csv [2025-09-16T21:11:51.733976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRTS.csv [2025-09-16T21:11:51.734068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAN.csv [2025-09-16T21:11:51.734187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOW.csv [2025-09-16T21:11:51.734281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFRC.csv [2025-09-16T21:11:51.734369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTR.csv [2025-09-16T21:11:51.734459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSF.csv [2025-09-16T21:11:51.734577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GME.csv [2025-09-16T21:11:51.734700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCC.csv [2025-09-16T21:11:51.734821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLNT.csv [2025-09-16T21:11:51.734931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGB.csv [2025-09-16T21:11:51.735026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UCB.csv [2025-09-16T21:11:51.735114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLT.csv [2025-09-16T21:11:51.735200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRE.csv [2025-09-16T21:11:51.735298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMI.csv [2025-09-16T21:11:51.735500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USPH.csv [2025-09-16T21:11:51.735594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTC.csv [2025-09-16T21:11:51.735716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCL.csv [2025-09-16T21:11:51.735820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DKS.csv [2025-09-16T21:11:51.735908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUI.csv [2025-09-16T21:11:51.735995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFH.csv [2025-09-16T21:11:51.736091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRT.csv [2025-09-16T21:11:51.736206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVTY.csv [2025-09-16T21:11:51.736300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHD.csv [2025-09-16T21:11:51.736393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KD.csv [2025-09-16T21:11:51.736500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNJ.csv [2025-09-16T21:11:51.736597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPGI.csv [2025-09-16T21:11:51.736712] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIR.csv [2025-09-16T21:11:51.736808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NATL.csv [2025-09-16T21:11:51.736892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSW.csv [2025-09-16T21:11:51.736975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOW.csv [2025-09-16T21:11:51.737065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITE.csv [2025-09-16T21:11:51.737150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AG.csv [2025-09-16T21:11:51.737237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAH.csv [2025-09-16T21:11:51.737319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIF.csv [2025-09-16T21:11:51.737416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRG.csv [2025-09-16T21:11:51.737512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEO.csv [2025-09-16T21:11:51.737609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIO.csv [2025-09-16T21:11:51.737719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KN.csv [2025-09-16T21:11:51.737823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COHR.csv [2025-09-16T21:11:51.737915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCT.csv [2025-09-16T21:11:51.738008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RRC.csv [2025-09-16T21:11:51.738104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJC.csv [2025-09-16T21:11:51.738198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEC.csv [2025-09-16T21:11:51.738287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PARR.csv [2025-09-16T21:11:51.738387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HD.csv [2025-09-16T21:11:51.738475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAN.csv [2025-09-16T21:11:51.738564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WGO.csv [2025-09-16T21:11:51.738682] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARR.csv [2025-09-16T21:11:51.738781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHX.csv [2025-09-16T21:11:51.738891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GKOS.csv [2025-09-16T21:11:51.738988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCD.csv [2025-09-16T21:11:51.739072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKE.csv [2025-09-16T21:11:51.739156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSD.csv [2025-09-16T21:11:51.739322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMD.csv [2025-09-16T21:11:51.739419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICL.csv [2025-09-16T21:11:51.739510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSR.csv [2025-09-16T21:11:51.739616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DB.csv [2025-09-16T21:11:51.739807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQT.csv [2025-09-16T21:11:51.739920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTR.csv [2025-09-16T21:11:51.740015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGM.csv [2025-09-16T21:11:51.740104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCO.csv [2025-09-16T21:11:51.740199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLW.csv [2025-09-16T21:11:51.740293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQT.csv [2025-09-16T21:11:51.740386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALE.csv [2025-09-16T21:11:51.740473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOD.csv [2025-09-16T21:11:51.740556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBI.csv [2025-09-16T21:11:51.740673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIE.csv [2025-09-16T21:11:51.740769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPS.csv [2025-09-16T21:11:51.740867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LB.csv [2025-09-16T21:11:51.740961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNSL.csv [2025-09-16T21:11:51.741057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STVN.csv [2025-09-16T21:11:51.741152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAL.csv [2025-09-16T21:11:51.741242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROK.csv [2025-09-16T21:11:51.741328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LND.csv [2025-09-16T21:11:51.741429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMTG.csv [2025-09-16T21:11:51.741522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JILL.csv [2025-09-16T21:11:51.741611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRU.csv [2025-09-16T21:11:51.741723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SB.csv [2025-09-16T21:11:51.741825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RF.csv [2025-09-16T21:11:51.741920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JMIA.csv [2025-09-16T21:11:51.742015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMC.csv [2025-09-16T21:11:51.742100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONIT.csv [2025-09-16T21:11:51.742199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGS.csv [2025-09-16T21:11:51.742325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TU.csv [2025-09-16T21:11:51.742516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIO.csv [2025-09-16T21:11:51.742612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBD.csv [2025-09-16T21:11:51.742726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGI.csv [2025-09-16T21:11:51.742821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NWG.csv [2025-09-16T21:11:51.742917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RJF.csv [2025-09-16T21:11:51.743013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMY.csv [2025-09-16T21:11:51.743113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TV.csv [2025-09-16T21:11:51.743205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBB.csv [2025-09-16T21:11:51.743349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCH.csv [2025-09-16T21:11:51.743439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCD.csv [2025-09-16T21:11:51.743548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDA.csv [2025-09-16T21:11:51.743661] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCK.csv [2025-09-16T21:11:51.743761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAH.csv [2025-09-16T21:11:51.743857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HL.csv [2025-09-16T21:11:51.743980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FND.csv [2025-09-16T21:11:51.744072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TISI.csv [2025-09-16T21:11:51.744170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRFM.csv [2025-09-16T21:11:51.744274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCN.csv [2025-09-16T21:11:51.744371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKST.csv [2025-09-16T21:11:51.744471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMH.csv [2025-09-16T21:11:51.744574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNTK.csv [2025-09-16T21:11:51.744718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATI.csv [2025-09-16T21:11:51.744814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPC.csv [2025-09-16T21:11:51.744908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNM.csv [2025-09-16T21:11:51.745008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDA.csv [2025-09-16T21:11:51.745102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNI.csv [2025-09-16T21:11:51.745195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETD.csv [2025-09-16T21:11:51.745289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHK.csv [2025-09-16T21:11:51.745383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEI.csv [2025-09-16T21:11:51.745471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMS.csv [2025-09-16T21:11:51.745566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TALO.csv [2025-09-16T21:11:51.745674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMT.csv [2025-09-16T21:11:51.745910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDLR.csv [2025-09-16T21:11:51.746017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADCT.csv [2025-09-16T21:11:51.746111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKC.csv [2025-09-16T21:11:51.746202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKYH.csv [2025-09-16T21:11:51.746286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MXF.csv [2025-09-16T21:11:51.746393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIHL.csv [2025-09-16T21:11:51.746490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DKL.csv [2025-09-16T21:11:51.746579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVT.csv [2025-09-16T21:11:51.746701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHR.csv [2025-09-16T21:11:51.746799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDF.csv [2025-09-16T21:11:51.746895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIP.csv [2025-09-16T21:11:51.746987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAAS.csv [2025-09-16T21:11:51.747079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHCO.csv [2025-09-16T21:11:51.747168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HY.csv [2025-09-16T21:11:51.747260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSGS.csv [2025-09-16T21:11:51.747355] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOST.csv [2025-09-16T21:11:51.747440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOND.csv [2025-09-16T21:11:51.747549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPG.csv [2025-09-16T21:11:51.747761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AON.csv [2025-09-16T21:11:51.747862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NLOP.csv [2025-09-16T21:11:51.747953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPI.csv [2025-09-16T21:11:51.748039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDW.csv [2025-09-16T21:11:51.748145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RPT.csv [2025-09-16T21:11:51.748247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KSS.csv [2025-09-16T21:11:51.748337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEF.csv [2025-09-16T21:11:51.748441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEC.csv [2025-09-16T21:11:51.748530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NQP.csv [2025-09-16T21:11:51.748631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNV.csv [2025-09-16T21:11:51.748738] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRE.csv [2025-09-16T21:11:51.748823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBA.csv [2025-09-16T21:11:51.748913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LBRT.csv [2025-09-16T21:11:51.749016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGT.csv [2025-09-16T21:11:51.749112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAK.csv [2025-09-16T21:11:51.749209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMI.csv [2025-09-16T21:11:51.749304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDX.csv [2025-09-16T21:11:51.749406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FI.csv [2025-09-16T21:11:51.749493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAO.csv [2025-09-16T21:11:51.749580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YOU.csv [2025-09-16T21:11:51.749699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHAB.csv [2025-09-16T21:11:51.749797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONTF.csv [2025-09-16T21:11:51.749900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAR.csv [2025-09-16T21:11:51.749981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KORE.csv [2025-09-16T21:11:51.750077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBS.csv [2025-09-16T21:11:51.750194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVV.csv [2025-09-16T21:11:51.750290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSFE.csv [2025-09-16T21:11:51.750487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEN.csv [2025-09-16T21:11:51.750578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YEXT.csv [2025-09-16T21:11:51.750723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HNI.csv [2025-09-16T21:11:51.750820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMI.csv [2025-09-16T21:11:51.750933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHCT.csv [2025-09-16T21:11:51.751024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTB.csv [2025-09-16T21:11:51.751113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIF.csv [2025-09-16T21:11:51.751213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUB.csv [2025-09-16T21:11:51.751321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACVA.csv [2025-09-16T21:11:51.751413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAN.csv [2025-09-16T21:11:51.751505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMMZ.csv [2025-09-16T21:11:51.751601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINE.csv [2025-09-16T21:11:51.751719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GXO.csv [2025-09-16T21:11:51.751808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXD.csv [2025-09-16T21:11:51.751912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BA.csv [2025-09-16T21:11:51.752005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLN.csv [2025-09-16T21:11:51.752099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQM.csv [2025-09-16T21:11:51.752192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIX.csv [2025-09-16T21:11:51.752288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINS.csv [2025-09-16T21:11:51.752373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLNG.csv [2025-09-16T21:11:51.752464] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PII.csv [2025-09-16T21:11:51.752556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFL.csv [2025-09-16T21:11:51.752673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOS.csv [2025-09-16T21:11:51.752767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNX.csv [2025-09-16T21:11:51.752859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSLY.csv [2025-09-16T21:11:51.752945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWW.csv [2025-09-16T21:11:51.753040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVG.csv [2025-09-16T21:11:51.753133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNA.csv [2025-09-16T21:11:51.753225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XFLT.csv [2025-09-16T21:11:51.753322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DUK.csv [2025-09-16T21:11:51.753412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIB.csv [2025-09-16T21:11:51.753512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTH.csv [2025-09-16T21:11:51.753615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAL.csv [2025-09-16T21:11:51.753842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USNA.csv [2025-09-16T21:11:51.753959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNP.csv [2025-09-16T21:11:51.754059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FET.csv [2025-09-16T21:11:51.754171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMN.csv [2025-09-16T21:11:51.754279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMCR.csv [2025-09-16T21:11:51.754379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADX.csv [2025-09-16T21:11:51.754486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFG.csv [2025-09-16T21:11:51.754570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THIR.csv [2025-09-16T21:11:51.754683] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPAD.csv [2025-09-16T21:11:51.754780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSHP.csv [2025-09-16T21:11:51.754870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRP.csv [2025-09-16T21:11:51.754960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYG.csv [2025-09-16T21:11:51.755044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOH.csv [2025-09-16T21:11:51.755139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKL.csv [2025-09-16T21:11:51.755226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDT.csv [2025-09-16T21:11:51.755320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/W.csv [2025-09-16T21:11:51.755435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WU.csv [2025-09-16T21:11:51.755529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NSP.csv [2025-09-16T21:11:51.755615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXT.csv [2025-09-16T21:11:51.755832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLH.csv [2025-09-16T21:11:51.755931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMP.csv [2025-09-16T21:11:51.756018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLJ.csv [2025-09-16T21:11:51.756107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASC.csv [2025-09-16T21:11:51.756200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTCM.csv [2025-09-16T21:11:51.756293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTS.csv [2025-09-16T21:11:51.756383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBB.csv [2025-09-16T21:11:51.756478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TUYA.csv [2025-09-16T21:11:51.756572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PUK.csv [2025-09-16T21:11:51.756680] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSBR.csv [2025-09-16T21:11:51.756781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSGE.csv [2025-09-16T21:11:51.756875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCI.csv [2025-09-16T21:11:51.756961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAR.csv [2025-09-16T21:11:51.757050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGLB.csv [2025-09-16T21:11:51.757143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMC.csv [2025-09-16T21:11:51.757385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAP.csv [2025-09-16T21:11:51.757481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFAM.csv [2025-09-16T21:11:51.757573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGE.csv [2025-09-16T21:11:51.757682] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/F.csv [2025-09-16T21:11:51.757773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSQH.csv [2025-09-16T21:11:51.757859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVE.csv [2025-09-16T21:11:51.757966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EEX.csv [2025-09-16T21:11:51.758080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRTG.csv [2025-09-16T21:11:51.758176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEYS.csv [2025-09-16T21:11:51.758275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRI.csv [2025-09-16T21:11:51.758373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXI.csv [2025-09-16T21:11:51.758461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OKLO.csv [2025-09-16T21:11:51.758553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOH.csv [2025-09-16T21:11:51.758665] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBT.csv [2025-09-16T21:11:51.758759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PM.csv [2025-09-16T21:11:51.758844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSK.csv [2025-09-16T21:11:51.758955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNT.csv [2025-09-16T21:11:51.759054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HWM.csv [2025-09-16T21:11:51.759148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSY.csv [2025-09-16T21:11:51.759239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PTY.csv [2025-09-16T21:11:51.759320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSA.csv [2025-09-16T21:11:51.759410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSI.csv [2025-09-16T21:11:51.759503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ST.csv [2025-09-16T21:11:51.759612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALG.csv [2025-09-16T21:11:51.759731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWG.csv [2025-09-16T21:11:51.759819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPI.csv [2025-09-16T21:11:51.759916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRT.csv [2025-09-16T21:11:51.760014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOW.csv [2025-09-16T21:11:51.760102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/V.csv [2025-09-16T21:11:51.760195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTDR.csv [2025-09-16T21:11:51.760280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHY.csv [2025-09-16T21:11:51.760379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBI.csv [2025-09-16T21:11:51.760465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TY.csv [2025-09-16T21:11:51.760554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOMB.csv [2025-09-16T21:11:51.760672] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEA.csv [2025-09-16T21:11:51.760765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTAM.csv [2025-09-16T21:11:51.760857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLW.csv [2025-09-16T21:11:51.760944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KYN.csv [2025-09-16T21:11:51.761038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCS.csv [2025-09-16T21:11:51.761128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPI.csv [2025-09-16T21:11:51.761221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYV.csv [2025-09-16T21:11:51.761313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXX.csv [2025-09-16T21:11:51.761408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMCO.csv [2025-09-16T21:11:51.761526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPEV.csv [2025-09-16T21:11:51.761634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YRD.csv [2025-09-16T21:11:51.761752] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESRT.csv [2025-09-16T21:11:51.761853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KW.csv [2025-09-16T21:11:51.761937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMM.csv [2025-09-16T21:11:51.762036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENB.csv [2025-09-16T21:11:51.762229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITW.csv [2025-09-16T21:11:51.762314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SVV.csv [2025-09-16T21:11:51.762403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLF.csv [2025-09-16T21:11:51.762491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTX.csv [2025-09-16T21:11:51.762581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLB.csv [2025-09-16T21:11:51.762700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSM.csv [2025-09-16T21:11:51.762806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANF.csv [2025-09-16T21:11:51.762890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCHW.csv [2025-09-16T21:11:51.762980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGM.csv [2025-09-16T21:11:51.763108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANET.csv [2025-09-16T21:11:51.763197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THC.csv [2025-09-16T21:11:51.763306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUXX.csv [2025-09-16T21:11:51.763398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLN.csv [2025-09-16T21:11:51.763487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBS.csv [2025-09-16T21:11:51.763569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZEPP.csv [2025-09-16T21:11:51.763777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIA.csv [2025-09-16T21:11:51.763894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNM.csv [2025-09-16T21:11:51.763981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PK.csv [2025-09-16T21:11:51.764074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLRS.csv [2025-09-16T21:11:51.764159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPKI.csv [2025-09-16T21:11:51.764243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IT.csv [2025-09-16T21:11:51.764339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBRG.csv [2025-09-16T21:11:51.764439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTC.csv [2025-09-16T21:11:51.764533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVE.csv [2025-09-16T21:11:51.764626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCI.csv [2025-09-16T21:11:51.764744] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CATO.csv [2025-09-16T21:11:51.764881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGX.csv [2025-09-16T21:11:51.764976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IX.csv [2025-09-16T21:11:51.765096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/L.csv [2025-09-16T21:11:51.765185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGY.csv [2025-09-16T21:11:51.765373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSX.csv [2025-09-16T21:11:51.765472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYD.csv [2025-09-16T21:11:51.765561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDS.csv [2025-09-16T21:11:51.765676] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MO.csv [2025-09-16T21:11:51.765782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AR.csv [2025-09-16T21:11:51.765896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCL.csv [2025-09-16T21:11:51.765988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBR.csv [2025-09-16T21:11:51.766080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPAY.csv [2025-09-16T21:11:51.766198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEG.csv [2025-09-16T21:11:51.766319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIEN.csv [2025-09-16T21:11:51.766415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBD.csv [2025-09-16T21:11:51.766503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RTX.csv [2025-09-16T21:11:51.766600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AER.csv [2025-09-16T21:11:51.766719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SU.csv [2025-09-16T21:11:51.766828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWI.csv [2025-09-16T21:11:51.766923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMC.csv [2025-09-16T21:11:51.767014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMU.csv [2025-09-16T21:11:51.767101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGH.csv [2025-09-16T21:11:51.767195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEF.csv [2025-09-16T21:11:51.767286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNS.csv [2025-09-16T21:11:51.767381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAYC.csv [2025-09-16T21:11:51.767474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNR.csv [2025-09-16T21:11:51.767565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMRE.csv [2025-09-16T21:11:51.767779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLR.csv [2025-09-16T21:11:51.767877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GM.csv [2025-09-16T21:11:51.767963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCI.csv [2025-09-16T21:11:51.768049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFL.csv [2025-09-16T21:11:51.768135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKY.csv [2025-09-16T21:11:51.768227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXG.csv [2025-09-16T21:11:51.768319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIO.csv [2025-09-16T21:11:51.768411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MP.csv [2025-09-16T21:11:51.768512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGP.csv [2025-09-16T21:11:51.768761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORA.csv [2025-09-16T21:11:51.768851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLUT.csv [2025-09-16T21:11:51.768947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUFG.csv [2025-09-16T21:11:51.769040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEO.csv [2025-09-16T21:11:51.769128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLVM.csv [2025-09-16T21:11:51.769218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPT.csv [2025-09-16T21:11:51.769318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZE.csv [2025-09-16T21:11:51.769448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXH.csv [2025-09-16T21:11:51.769543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIS.csv [2025-09-16T21:11:51.769653] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRP.csv [2025-09-16T21:11:51.769748] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEA.csv [2025-09-16T21:11:51.769862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAS.csv [2025-09-16T21:11:51.769959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSP.csv [2025-09-16T21:11:51.770062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEP.csv [2025-09-16T21:11:51.770149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSIF.csv [2025-09-16T21:11:51.770240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUVB.csv [2025-09-16T21:11:51.770339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTS.csv [2025-09-16T21:11:51.770432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCI.csv [2025-09-16T21:11:51.770519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PWR.csv [2025-09-16T21:11:51.770601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBTG.csv [2025-09-16T21:11:51.770711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWN.csv [2025-09-16T21:11:51.770805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGAU.csv [2025-09-16T21:11:51.770895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SR.csv [2025-09-16T21:11:51.771001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNH.csv [2025-09-16T21:11:51.771093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHS.csv [2025-09-16T21:11:51.771185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLK.csv [2025-09-16T21:11:51.771302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPOF.csv [2025-09-16T21:11:51.771396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDT.csv [2025-09-16T21:11:51.771492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTLS.csv [2025-09-16T21:11:51.771593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYD.csv [2025-09-16T21:11:51.771705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PL.csv [2025-09-16T21:11:51.771797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDS.csv [2025-09-16T21:11:51.771891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSCO.csv [2025-09-16T21:11:51.771986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NZF.csv [2025-09-16T21:11:51.772074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAR.csv [2025-09-16T21:11:51.772159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKSY.csv [2025-09-16T21:11:51.772254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GES.csv [2025-09-16T21:11:51.772379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAX.csv [2025-09-16T21:11:51.772475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OLP.csv [2025-09-16T21:11:51.772562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLP.csv [2025-09-16T21:11:51.772678] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTB.csv [2025-09-16T21:11:51.772781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INN.csv [2025-09-16T21:11:51.772877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHR.csv [2025-09-16T21:11:51.772972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCZ.csv [2025-09-16T21:11:51.773069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCA.csv [2025-09-16T21:11:51.773158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXC.csv [2025-09-16T21:11:51.773421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSK.csv [2025-09-16T21:11:51.773514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CQP.csv [2025-09-16T21:11:51.773602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STWD.csv [2025-09-16T21:11:51.773730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGRO.csv [2025-09-16T21:11:51.773832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDRE.csv [2025-09-16T21:11:51.773954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LSPD.csv [2025-09-16T21:11:51.774050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LGI.csv [2025-09-16T21:11:51.774138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIM.csv [2025-09-16T21:11:51.774230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEMR.csv [2025-09-16T21:11:51.774325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOE.csv [2025-09-16T21:11:51.774412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSTL.csv [2025-09-16T21:11:51.774504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFR.csv [2025-09-16T21:11:51.774594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NSA.csv [2025-09-16T21:11:51.774705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/URI.csv [2025-09-16T21:11:51.774805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHP.csv [2025-09-16T21:11:51.774891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGI.csv [2025-09-16T21:11:51.774988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBN.csv [2025-09-16T21:11:51.775099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZWS.csv [2025-09-16T21:11:51.775192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAD.csv [2025-09-16T21:11:51.775285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RS.csv [2025-09-16T21:11:51.775384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBIN.csv [2025-09-16T21:11:51.775471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLLY.csv [2025-09-16T21:11:51.775555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFL.csv [2025-09-16T21:11:51.775837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBA.csv [2025-09-16T21:11:51.775951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABG.csv [2025-09-16T21:11:51.776039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YELP.csv [2025-09-16T21:11:51.776123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UI.csv [2025-09-16T21:11:51.776206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTR.csv [2025-09-16T21:11:51.776306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITT.csv [2025-09-16T21:11:51.776411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EG.csv [2025-09-16T21:11:51.776506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PATH.csv [2025-09-16T21:11:51.776594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQL.csv [2025-09-16T21:11:51.776703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPA.csv [2025-09-16T21:11:51.776802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJE.csv [2025-09-16T21:11:51.776901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGCO.csv [2025-09-16T21:11:51.776993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXP.csv [2025-09-16T21:11:51.777082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFIN.csv [2025-09-16T21:11:51.777416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUYA.csv [2025-09-16T21:11:51.777524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATX.csv [2025-09-16T21:11:51.777622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PB.csv [2025-09-16T21:11:51.777742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRTX.csv [2025-09-16T21:11:51.777843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWSN.csv [2025-09-16T21:11:51.777972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBR.csv [2025-09-16T21:11:51.778061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPK.csv [2025-09-16T21:11:51.778153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMY.csv [2025-09-16T21:11:51.778249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AN.csv [2025-09-16T21:11:51.778362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEG.csv [2025-09-16T21:11:51.778460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZD.csv [2025-09-16T21:11:51.778556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LADR.csv [2025-09-16T21:11:51.778668] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBS.csv [2025-09-16T21:11:51.778767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMRT.csv [2025-09-16T21:11:51.778860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APG.csv [2025-09-16T21:11:51.778955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESTC.csv [2025-09-16T21:11:51.779045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OVV.csv [2025-09-16T21:11:51.779130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLM.csv [2025-09-16T21:11:51.779215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARLO.csv [2025-09-16T21:11:51.779308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNAP.csv [2025-09-16T21:11:51.779390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHS.csv [2025-09-16T21:11:51.779480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCR.csv [2025-09-16T21:11:51.779591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSAN.csv [2025-09-16T21:11:51.779709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXE.csv [2025-09-16T21:11:51.779805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCRD.csv [2025-09-16T21:11:51.779935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHT.csv [2025-09-16T21:11:51.780030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIG.csv [2025-09-16T21:11:51.780115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGO.csv [2025-09-16T21:11:51.780218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RA.csv [2025-09-16T21:11:51.780317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DT.csv [2025-09-16T21:11:51.780414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSBC.csv [2025-09-16T21:11:51.780513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAW.csv [2025-09-16T21:11:51.780611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SW.csv [2025-09-16T21:11:51.780734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELF.csv [2025-09-16T21:11:51.780836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KLG.csv [2025-09-16T21:11:51.780945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRS.csv [2025-09-16T21:11:51.781038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TME.csv [2025-09-16T21:11:51.781129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYG.csv [2025-09-16T21:11:51.781224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AES.csv [2025-09-16T21:11:51.781316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAI.csv [2025-09-16T21:11:51.781411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXPD.csv [2025-09-16T21:11:51.781500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBI.csv [2025-09-16T21:11:51.781591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UA.csv [2025-09-16T21:11:51.781711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTOS.csv [2025-09-16T21:11:51.781811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDE.csv [2025-09-16T21:11:51.781904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NKX.csv [2025-09-16T21:11:51.781998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOW.csv [2025-09-16T21:11:51.782084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUW.csv [2025-09-16T21:11:51.782173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPX.csv [2025-09-16T21:11:51.782264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFS.csv [2025-09-16T21:11:51.782352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFBS.csv [2025-09-16T21:11:51.782451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXP.csv [2025-09-16T21:11:51.782547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSL.csv [2025-09-16T21:11:51.782677] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFK.csv [2025-09-16T21:11:51.782780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRG.csv [2025-09-16T21:11:51.783027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HVT.csv [2025-09-16T21:11:51.783129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRE.csv [2025-09-16T21:11:51.783219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THO.csv [2025-09-16T21:11:51.783312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAP.csv [2025-09-16T21:11:51.783408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGVC.csv [2025-09-16T21:11:51.783503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFLT.csv [2025-09-16T21:11:51.783582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEUE.csv [2025-09-16T21:11:51.783778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQBK.csv [2025-09-16T21:11:51.783874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLB.csv [2025-09-16T21:11:51.783983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCD.csv [2025-09-16T21:11:51.784077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLE.csv [2025-09-16T21:11:51.784167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMH.csv [2025-09-16T21:11:51.784265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROL.csv [2025-09-16T21:11:51.784362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBL.csv [2025-09-16T21:11:51.784463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCS.csv [2025-09-16T21:11:51.784552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUN.csv [2025-09-16T21:11:51.784669] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BN.csv [2025-09-16T21:11:51.784764] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAE.csv [2025-09-16T21:11:51.784859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHO.csv [2025-09-16T21:11:51.784957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOMR.csv [2025-09-16T21:11:51.785055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMBK.csv [2025-09-16T21:11:51.785145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAGN.csv [2025-09-16T21:11:51.785229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPH.csv [2025-09-16T21:11:51.785310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVC.csv [2025-09-16T21:11:51.785406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFGC.csv [2025-09-16T21:11:51.785500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMN.csv [2025-09-16T21:11:51.785604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSO.csv [2025-09-16T21:11:51.785712] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STZ.csv [2025-09-16T21:11:51.785795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIO.csv [2025-09-16T21:11:51.785883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FGSN.csv [2025-09-16T21:11:51.785979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVX.csv [2025-09-16T21:11:51.786069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDE.csv [2025-09-16T21:11:51.786156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDS.csv [2025-09-16T21:11:51.786256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASIX.csv [2025-09-16T21:11:51.786503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOR.csv [2025-09-16T21:11:51.786622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOD.csv [2025-09-16T21:11:51.786743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPC.csv [2025-09-16T21:11:51.786841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYF.csv [2025-09-16T21:11:51.786924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBI.csv [2025-09-16T21:11:51.787016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TECK.csv [2025-09-16T21:11:51.787097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCB.csv [2025-09-16T21:11:51.787220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFM.csv [2025-09-16T21:11:51.787314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKC.csv [2025-09-16T21:11:51.787415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLX.csv [2025-09-16T21:11:51.787502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVZ.csv [2025-09-16T21:11:51.787588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/R.csv [2025-09-16T21:11:51.787689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMC.csv [2025-09-16T21:11:51.787792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDX.csv [2025-09-16T21:11:51.787883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCN.csv [2025-09-16T21:11:51.787977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LHX.csv [2025-09-16T21:11:51.788064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDC.csv [2025-09-16T21:11:51.788149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WF.csv [2025-09-16T21:11:51.788240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUV.csv [2025-09-16T21:11:51.788336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTN.csv [2025-09-16T21:11:51.788426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWXT.csv [2025-09-16T21:11:51.788535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RPM.csv [2025-09-16T21:11:51.788663] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANRO.csv [2025-09-16T21:11:51.788755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPVG.csv [2025-09-16T21:11:51.788850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNE.csv [2025-09-16T21:11:51.788934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPV.csv [2025-09-16T21:11:51.789027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SARO.csv [2025-09-16T21:11:51.789120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NWN.csv [2025-09-16T21:11:51.789212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIG.csv [2025-09-16T21:11:51.789305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVF.csv [2025-09-16T21:11:51.789412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLND.csv [2025-09-16T21:11:51.789510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QBTS.csv [2025-09-16T21:11:51.789604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNF.csv [2025-09-16T21:11:51.789720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLR.csv [2025-09-16T21:11:51.789808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NHI.csv [2025-09-16T21:11:51.789888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPZ.csv [2025-09-16T21:11:51.789970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRLL.csv [2025-09-16T21:11:51.790052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEM.csv [2025-09-16T21:11:51.790271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBN.csv [2025-09-16T21:11:51.790371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCF.csv [2025-09-16T21:11:51.790476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBLX.csv [2025-09-16T21:11:51.790575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UP.csv [2025-09-16T21:11:51.790697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLS.csv [2025-09-16T21:11:51.790824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACHR.csv [2025-09-16T21:11:51.790918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STAG.csv [2025-09-16T21:11:51.791018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCIF.csv [2025-09-16T21:11:51.791111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KODK.csv [2025-09-16T21:11:51.791223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALB.csv [2025-09-16T21:11:51.791325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLDT.csv [2025-09-16T21:11:51.791431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARES.csv [2025-09-16T21:11:51.791535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PJT.csv [2025-09-16T21:11:51.791625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NLY.csv [2025-09-16T21:11:51.791887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VBF.csv [2025-09-16T21:11:51.791980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RY.csv [2025-09-16T21:11:51.792068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDRL.csv [2025-09-16T21:11:51.792164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BX.csv [2025-09-16T21:11:51.792252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MWA.csv [2025-09-16T21:11:51.792350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GVA.csv [2025-09-16T21:11:51.792446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBP.csv [2025-09-16T21:11:51.792538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJF.csv [2025-09-16T21:11:51.792633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OFG.csv [2025-09-16T21:11:51.792747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIRK.csv [2025-09-16T21:11:51.792837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MS.csv [2025-09-16T21:11:51.792929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMM.csv [2025-09-16T21:11:51.793016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOMA.csv [2025-09-16T21:11:51.793114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNP.csv [2025-09-16T21:11:51.793205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNS.csv [2025-09-16T21:11:51.793299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECO.csv [2025-09-16T21:11:51.793519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBI.csv [2025-09-16T21:11:51.793616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRB.csv [2025-09-16T21:11:51.793728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRI.csv [2025-09-16T21:11:51.793822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBOT.csv [2025-09-16T21:11:51.793930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAB.csv [2025-09-16T21:11:51.794026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALC.csv [2025-09-16T21:11:51.794124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMRC.csv [2025-09-16T21:11:51.794210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQH.csv [2025-09-16T21:11:51.794295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNMD.csv [2025-09-16T21:11:51.794379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QXO.csv [2025-09-16T21:11:51.794491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DY.csv [2025-09-16T21:11:51.794590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMA.csv [2025-09-16T21:11:51.794696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HFRO.csv [2025-09-16T21:11:51.794794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBB.csv [2025-09-16T21:11:51.794887] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALIT.csv [2025-09-16T21:11:51.794976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRM.csv [2025-09-16T21:11:51.795059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AME.csv [2025-09-16T21:11:51.795144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZB.csv [2025-09-16T21:11:51.795237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKRS.csv [2025-09-16T21:11:51.795329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXN.csv [2025-09-16T21:11:51.795417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJD.csv [2025-09-16T21:11:51.795503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDM.csv [2025-09-16T21:11:51.795585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLTG.csv [2025-09-16T21:11:51.795688] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRC.csv [2025-09-16T21:11:51.795786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGA.csv [2025-09-16T21:11:51.795875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRA.csv [2025-09-16T21:11:51.795967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASG.csv [2025-09-16T21:11:51.796062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OII.csv [2025-09-16T21:11:51.796144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OCFT.csv [2025-09-16T21:11:51.796230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGB.csv [2025-09-16T21:11:51.796313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTM.csv [2025-09-16T21:11:51.796563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BANC.csv [2025-09-16T21:11:51.796671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSTK.csv [2025-09-16T21:11:51.796768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CADE.csv [2025-09-16T21:11:51.796855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECAT.csv [2025-09-16T21:11:51.796940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMED.csv [2025-09-16T21:11:51.797036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EL.csv [2025-09-16T21:11:51.797130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBVA.csv [2025-09-16T21:11:51.797232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJT.csv [2025-09-16T21:11:51.797320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEI.csv [2025-09-16T21:11:51.797409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXDT.csv [2025-09-16T21:11:51.797496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEKE.csv [2025-09-16T21:11:51.797584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGS.csv [2025-09-16T21:11:51.797697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUSA.csv [2025-09-16T21:11:51.797787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OHI.csv [2025-09-16T21:11:51.797875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTLE.csv [2025-09-16T21:11:51.797972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDC.csv [2025-09-16T21:11:51.798058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRUC.csv [2025-09-16T21:11:51.798145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIL.csv [2025-09-16T21:11:51.798235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHVN.csv [2025-09-16T21:11:51.798334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHS.csv [2025-09-16T21:11:51.798430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSX.csv [2025-09-16T21:11:51.798521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTE.csv [2025-09-16T21:11:51.798617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAG.csv [2025-09-16T21:11:51.798733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHG.csv [2025-09-16T21:11:51.798818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVH.csv [2025-09-16T21:11:51.798915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABCB.csv [2025-09-16T21:11:51.799002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFS.csv [2025-09-16T21:11:51.799146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APD.csv [2025-09-16T21:11:51.799241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOV.csv [2025-09-16T21:11:51.799333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BORR.csv [2025-09-16T21:11:51.799419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IONQ.csv [2025-09-16T21:11:51.799503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBBB.csv [2025-09-16T21:11:51.799593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEQ.csv [2025-09-16T21:11:51.799834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZF.csv [2025-09-16T21:11:51.799935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPH.csv [2025-09-16T21:11:51.800024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REX.csv [2025-09-16T21:11:51.800107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFII.csv [2025-09-16T21:11:51.800191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHO.csv [2025-09-16T21:11:51.800276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIM.csv [2025-09-16T21:11:51.800360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZB.csv [2025-09-16T21:11:51.800453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXFR.csv [2025-09-16T21:11:51.800775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBL.csv [2025-09-16T21:11:51.800879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCSF.csv [2025-09-16T21:11:51.800971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFG.csv [2025-09-16T21:11:51.801058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOC.csv [2025-09-16T21:11:51.801147] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSLX.csv [2025-09-16T21:11:51.801255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUNA.csv [2025-09-16T21:11:51.801352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVG.csv [2025-09-16T21:11:51.801438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHG.csv [2025-09-16T21:11:51.801518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFO.csv [2025-09-16T21:11:51.801628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVR.csv [2025-09-16T21:11:51.801734] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPD.csv [2025-09-16T21:11:51.801825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANVS.csv [2025-09-16T21:11:51.801930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUBO.csv [2025-09-16T21:11:51.802025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IOT.csv [2025-09-16T21:11:51.802111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXJ.csv [2025-09-16T21:11:51.802201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLW.csv [2025-09-16T21:11:51.802291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBH.csv [2025-09-16T21:11:51.802385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHPT.csv [2025-09-16T21:11:51.802474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORN.csv [2025-09-16T21:11:51.802563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGS.csv [2025-09-16T21:11:51.802780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOF.csv [2025-09-16T21:11:51.802882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORC.csv [2025-09-16T21:11:51.802973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAL.csv [2025-09-16T21:11:51.803066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHI.csv [2025-09-16T21:11:51.803160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIS.csv [2025-09-16T21:11:51.803247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUX.csv [2025-09-16T21:11:51.803334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TS.csv [2025-09-16T21:11:51.803425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVT.csv [2025-09-16T21:11:51.803518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICE.csv [2025-09-16T21:11:51.803609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPNT.csv [2025-09-16T21:11:51.803721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CODI.csv [2025-09-16T21:11:51.803811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRLB.csv [2025-09-16T21:11:51.803917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKG.csv [2025-09-16T21:11:51.804005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZM.csv [2025-09-16T21:11:51.804101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAT.csv [2025-09-16T21:11:51.804190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAFN.csv [2025-09-16T21:11:51.804285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMZ.csv [2025-09-16T21:11:51.804384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAND.csv [2025-09-16T21:11:51.804483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRH.csv [2025-09-16T21:11:51.804602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABT.csv [2025-09-16T21:11:51.804703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBG.csv [2025-09-16T21:11:51.804791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRMN.csv [2025-09-16T21:11:51.804886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIB.csv [2025-09-16T21:11:51.805016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCLH.csv [2025-09-16T21:11:51.805118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPB.csv [2025-09-16T21:11:51.805206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JQC.csv [2025-09-16T21:11:51.805305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDDY.csv [2025-09-16T21:11:51.805391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCY.csv [2025-09-16T21:11:51.805484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMT.csv [2025-09-16T21:11:51.805574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFM.csv [2025-09-16T21:11:51.805690] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFA.csv [2025-09-16T21:11:51.805782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RACE.csv [2025-09-16T21:11:51.805878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAM.csv [2025-09-16T21:11:51.805970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIN.csv [2025-09-16T21:11:51.806062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIX.csv [2025-09-16T21:11:51.806163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABBV.csv [2025-09-16T21:11:51.806252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFX.csv [2025-09-16T21:11:51.806343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMS.csv [2025-09-16T21:11:51.806813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFI.csv [2025-09-16T21:11:51.806909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDO.csv [2025-09-16T21:11:51.807000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCM.csv [2025-09-16T21:11:51.807094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDOC.csv [2025-09-16T21:11:51.807183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKX.csv [2025-09-16T21:11:51.807267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDU.csv [2025-09-16T21:11:51.807358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXSL.csv [2025-09-16T21:11:51.807444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPM.csv [2025-09-16T21:11:51.807557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZGN.csv [2025-09-16T21:11:51.807668] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/POST.csv [2025-09-16T21:11:51.807770] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIR.csv [2025-09-16T21:11:51.807871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAVA.csv [2025-09-16T21:11:51.807958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLC.csv [2025-09-16T21:11:51.808043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NINE.csv [2025-09-16T21:11:51.808128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEVI.csv [2025-09-16T21:11:51.808218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAT.csv [2025-09-16T21:11:51.808304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBUC.csv [2025-09-16T21:11:51.808407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BABA.csv [2025-09-16T21:11:51.808494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGZ.csv [2025-09-16T21:11:51.808585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTF.csv [2025-09-16T21:11:51.808690] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMT.csv [2025-09-16T21:11:51.808786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZBH.csv [2025-09-16T21:11:51.808912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STN.csv [2025-09-16T21:11:51.809023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUG.csv [2025-09-16T21:11:51.809140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGT.csv [2025-09-16T21:11:51.809231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTD.csv [2025-09-16T21:11:51.809325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OI.csv [2025-09-16T21:11:51.809423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDV.csv [2025-09-16T21:11:51.809521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPI.csv [2025-09-16T21:11:51.809609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WELL.csv [2025-09-16T21:11:51.809717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVLV.csv [2025-09-16T21:11:51.809806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVT.csv [2025-09-16T21:11:51.809893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TT.csv [2025-09-16T21:11:51.809978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PR.csv [2025-09-16T21:11:51.810073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAR.csv [2025-09-16T21:11:51.810169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MT.csv [2025-09-16T21:11:51.810257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCC.csv [2025-09-16T21:11:51.810340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIS.csv [2025-09-16T21:11:51.810425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RES.csv [2025-09-16T21:11:51.810542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KREF.csv [2025-09-16T21:11:51.810638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUJ.csv [2025-09-16T21:11:51.810936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRGO.csv [2025-09-16T21:11:51.811218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRO.csv [2025-09-16T21:11:51.811335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHT.csv [2025-09-16T21:11:51.811622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMI.csv [2025-09-16T21:11:51.811728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPMT.csv [2025-09-16T21:11:51.811823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SON.csv [2025-09-16T21:11:51.811912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPF.csv [2025-09-16T21:11:51.812005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAP.csv [2025-09-16T21:11:51.812091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLKP.csv [2025-09-16T21:11:51.812175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCD.csv [2025-09-16T21:11:51.812257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRP.csv [2025-09-16T21:11:51.812351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTC.csv [2025-09-16T21:11:51.812438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMD.csv [2025-09-16T21:11:51.812557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APLE.csv [2025-09-16T21:11:51.812697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVUE.csv [2025-09-16T21:11:51.812794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWK.csv [2025-09-16T21:11:51.812888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXR.csv [2025-09-16T21:11:51.812973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRKS.csv [2025-09-16T21:11:51.813061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTDD.csv [2025-09-16T21:11:51.813159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SA.csv [2025-09-16T21:11:51.813275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNL.csv [2025-09-16T21:11:51.813363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXO.csv [2025-09-16T21:11:51.813446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RRX.csv [2025-09-16T21:11:51.813529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRU.csv [2025-09-16T21:11:51.813623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIMS.csv [2025-09-16T21:11:51.813751] [INFO ] [LOCAL ] Deleted 1918 derivative data files. [2025-09-16T21:11:51.813797] [INFO ] [LOCAL ] Scanning primary storage for available symbols. [2025-09-16T21:11:51.815814] [INFO ] [LOCAL ] Found 2026 symbols with primary data. [2025-09-16T21:11:51.816009] [INFO ] [MAIN ] Starting parallel derivative generation with 3 worker threads for 2026 symbols [2025-09-16T21:11:51.816520] [INFO ] [MAIN ] A: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:11:51.816853] [INFO ] [MAIN ] AA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:11:51.817617] [INFO ] [MAIN ] AACT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:11:51.827955] [DEBUG] [LOCAL ] AACT: Loaded 8064 existing records from primary storage. [2025-09-16T21:11:51.828110] [INFO ] [MAIN ] AACT: Loaded 8064 primary data records. [2025-09-16T21:11:52.185964] [DEBUG] [LOCAL ] AA: Loaded 39972 existing records from primary storage. [2025-09-16T21:11:52.187169] [DEBUG] [LOCAL ] A: Loaded 37747 existing records from primary storage. [2025-09-16T21:11:52.187599] [INFO ] [MAIN ] A: Loaded 37747 primary data records. [2025-09-16T21:11:52.187527] [INFO ] [MAIN ] AA: Loaded 39972 primary data records. [2025-09-16T21:11:52.749390] [DEBUG] [MAIN ] AACT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:11:52.750816] [INFO ] [MAIN ] AACT: Generated 1339 derivative records from 8064 primary records. [2025-09-16T21:11:52.751295] [DEBUG] [LOCAL ] AACT: Saving derivative data. [2025-09-16T21:11:52.764992] [DEBUG] [LOCAL ] AACT: Derivative data saved (1339 records). [2025-09-16T21:11:52.765716] [INFO ] [MAIN ] AACT: Successfully saved derivative data. [2025-09-16T21:11:52.767016] [INFO ] [MAIN ] Derivative Progress: 1/2026 symbols completed. AACT took 0.9s. Estimated remaining: 32m 6s. Rate: 63.1 symbols/min [2025-09-16T21:11:52.767609] [INFO ] [MAIN ] AAP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:11:52.782371] [DEBUG] [MAIN ] A: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:11:52.783592] [INFO ] [MAIN ] A: Generated 1339 derivative records from 37747 primary records. [2025-09-16T21:11:52.784255] [DEBUG] [LOCAL ] A: Saving derivative data. [2025-09-16T21:11:52.803069] [DEBUG] [MAIN ] AA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:11:52.804560] [INFO ] [MAIN ] AA: Generated 1339 derivative records from 39972 primary records. [2025-09-16T21:11:52.805309] [DEBUG] [LOCAL ] AA: Saving derivative data. [2025-09-16T21:11:52.827819] [DEBUG] [LOCAL ] A: Derivative data saved (1339 records). [2025-09-16T21:11:52.830245] [DEBUG] [LOCAL ] AA: Derivative data saved (1339 records). [2025-09-16T21:11:52.829123] [INFO ] [MAIN ] A: Successfully saved derivative data. [2025-09-16T21:11:52.830453] [INFO ] [MAIN ] AA: Successfully saved derivative data. [2025-09-16T21:11:52.832529] [INFO ] [MAIN ] Derivative Progress: 2/2026 symbols completed. A took 1.0s. Estimated remaining: 17m 9s. Rate: 118.0 symbols/min [2025-09-16T21:11:52.835386] [INFO ] [MAIN ] Derivative Progress: 3/2026 symbols completed. AA took 1.0s. Estimated remaining: 11m 27s. Rate: 176.6 symbols/min [2025-09-16T21:11:52.835717] [INFO ] [MAIN ] AB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:11:52.835629] [INFO ] [MAIN ] AAT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:11:52.850186] [DEBUG] [LOCAL ] AAP: Loaded 38811 existing records from primary storage. [2025-09-16T21:11:52.850431] [INFO ] [MAIN ] AAP: Loaded 38811 primary data records. [2025-09-16T21:11:52.988238] [DEBUG] [LOCAL ] AB: Loaded 17872 existing records from primary storage. [2025-09-16T21:11:53.053294] [DEBUG] [LOCAL ] AAT: Loaded 22530 existing records from primary storage. [2025-09-16T21:11:53.050519] [INFO ] [MAIN ] AB: Loaded 17872 primary data records. [2025-09-16T21:11:53.053498] [INFO ] [MAIN ] AAT: Loaded 22530 primary data records. [2025-09-16T21:11:53.681021] [DEBUG] [MAIN ] AAP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:11:53.681889] [INFO ] [MAIN ] AAP: Generated 1339 derivative records from 38811 primary records. [2025-09-16T21:11:53.682919] [DEBUG] [LOCAL ] AAP: Saving derivative data. [2025-09-16T21:11:53.695876] [DEBUG] [LOCAL ] AAP: Derivative data saved (1339 records). [2025-09-16T21:11:53.696186] [INFO ] [MAIN ] AAP: Successfully saved derivative data. [2025-09-16T21:11:53.697545] [INFO ] [MAIN ] Derivative Progress: 4/2026 symbols completed. AAP took 0.9s. Estimated remaining: 15m 51s. Rate: 127.5 symbols/min [2025-09-16T21:11:53.697920] [INFO ] [MAIN ] ABBV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:11:53.721662] [DEBUG] [MAIN ] AAT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:11:53.722089] [DEBUG] [MAIN ] AB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:11:53.722635] [INFO ] [MAIN ] AAT: Generated 1339 derivative records from 22530 primary records. [2025-09-16T21:11:53.723166] [INFO ] [MAIN ] AB: Generated 1339 derivative records from 17872 primary records. [2025-09-16T21:11:53.723281] [DEBUG] [LOCAL ] AAT: Saving derivative data. [2025-09-16T21:11:53.723350] [DEBUG] [LOCAL ] AB: Saving derivative data. [2025-09-16T21:11:53.755421] [DEBUG] [LOCAL ] AB: Derivative data saved (1339 records). [2025-09-16T21:11:53.755871] [INFO ] [MAIN ] AB: Successfully saved derivative data. [2025-09-16T21:11:53.757557] [INFO ] [MAIN ] Derivative Progress: 5/2026 symbols completed. AB took 0.9s. Estimated remaining: 13m 5s. Rate: 154.5 symbols/min [2025-09-16T21:11:53.756306] [DEBUG] [LOCAL ] AAT: Derivative data saved (1339 records). [2025-09-16T21:11:53.757890] [INFO ] [MAIN ] ABCB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:11:53.757746] [INFO ] [MAIN ] AAT: Successfully saved derivative data. [2025-09-16T21:11:53.759909] [INFO ] [MAIN ] Derivative Progress: 6/2026 symbols completed. AAT took 0.9s. Estimated remaining: 10m 54s. Rate: 185.2 symbols/min [2025-09-16T21:11:53.760367] [INFO ] [MAIN ] ABEV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:11:53.775197] [DEBUG] [LOCAL ] ABBV: Loaded 40044 existing records from primary storage. [2025-09-16T21:11:53.775406] [INFO ] [MAIN ] ABBV: Loaded 40044 primary data records. [2025-09-16T21:11:53.917205] [DEBUG] [LOCAL ] ABCB: Loaded 21813 existing records from primary storage. [2025-09-16T21:11:53.922571] [INFO ] [MAIN ] ABCB: Loaded 21813 primary data records. [2025-09-16T21:11:54.174112] [DEBUG] [LOCAL ] ABEV: Loaded 39678 existing records from primary storage. [2025-09-16T21:11:54.189898] [INFO ] [MAIN ] ABEV: Loaded 39678 primary data records. [2025-09-16T21:11:54.660065] [DEBUG] [MAIN ] ABBV: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:11:54.661228] [INFO ] [MAIN ] ABBV: Generated 1339 derivative records from 40044 primary records. [2025-09-16T21:11:54.661946] [DEBUG] [LOCAL ] ABBV: Saving derivative data. [2025-09-16T21:11:54.686341] [DEBUG] [MAIN ] ABCB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:11:54.687054] [DEBUG] [LOCAL ] ABBV: Derivative data saved (1339 records). [2025-09-16T21:11:54.687698] [INFO ] [MAIN ] ABCB: Generated 1339 derivative records from 21813 primary records. [2025-09-16T21:11:54.687756] [INFO ] [MAIN ] ABBV: Successfully saved derivative data. [2025-09-16T21:11:54.687954] [DEBUG] [LOCAL ] ABCB: Saving derivative data. [2025-09-16T21:11:54.689919] [INFO ] [MAIN ] Derivative Progress: 7/2026 symbols completed. ABBV took 1.0s. Estimated remaining: 13m 49s. Rate: 146.1 symbols/min [2025-09-16T21:11:54.699042] [INFO ] [MAIN ] ABG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:11:54.703280] [DEBUG] [LOCAL ] ABCB: Derivative data saved (1339 records). [2025-09-16T21:11:54.703701] [INFO ] [MAIN ] ABCB: Successfully saved derivative data. [2025-09-16T21:11:54.714073] [INFO ] [MAIN ] Derivative Progress: 8/2026 symbols completed. ABCB took 1.0s. Estimated remaining: 12m 11s. Rate: 165.6 symbols/min [2025-09-16T21:11:54.714255] [INFO ] [MAIN ] ABM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:11:54.715173] [DEBUG] [MAIN ] ABEV: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:11:54.716174] [INFO ] [MAIN ] ABEV: Generated 1339 derivative records from 39678 primary records. [2025-09-16T21:11:54.716304] [DEBUG] [LOCAL ] ABEV: Saving derivative data. [2025-09-16T21:11:54.732341] [DEBUG] [LOCAL ] ABEV: Derivative data saved (1339 records). [2025-09-16T21:11:54.732448] [INFO ] [MAIN ] ABEV: Successfully saved derivative data. [2025-09-16T21:11:54.734360] [INFO ] [MAIN ] Derivative Progress: 9/2026 symbols completed. ABEV took 1.0s. Estimated remaining: 10m 54s. Rate: 185.0 symbols/min [2025-09-16T21:11:54.739710] [INFO ] [MAIN ] ABR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:11:54.744615] [DEBUG] [LOCAL ] ABG: Loaded 12960 existing records from primary storage. [2025-09-16T21:11:54.744915] [INFO ] [MAIN ] ABG: Loaded 12960 primary data records. [2025-09-16T21:11:54.862303] [DEBUG] [LOCAL ] ABM: Loaded 23397 existing records from primary storage. [2025-09-16T21:11:54.868379] [INFO ] [MAIN ] ABM: Loaded 23397 primary data records. [2025-09-16T21:11:55.219498] [DEBUG] [LOCAL ] ABR: Loaded 38749 existing records from primary storage. [2025-09-16T21:11:55.241930] [INFO ] [MAIN ] ABR: Loaded 38749 primary data records. [2025-09-16T21:11:55.627985] [DEBUG] [MAIN ] ABG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:11:55.628967] [INFO ] [MAIN ] ABG: Generated 1339 derivative records from 12960 primary records. [2025-09-16T21:11:55.629200] [DEBUG] [LOCAL ] ABG: Saving derivative data. [2025-09-16T21:11:55.659860] [DEBUG] [LOCAL ] ABG: Derivative data saved (1339 records). [2025-09-16T21:11:55.660636] [DEBUG] [MAIN ] ABM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:11:55.661558] [INFO ] [MAIN ] ABG: Successfully saved derivative data. [2025-09-16T21:11:55.661479] [INFO ] [MAIN ] ABM: Generated 1339 derivative records from 23397 primary records. [2025-09-16T21:11:55.663259] [INFO ] [MAIN ] Derivative Progress: 10/2026 symbols completed. ABG took 1.0s. Estimated remaining: 12m 56s. Rate: 156.0 symbols/min [2025-09-16T21:11:55.663698] [INFO ] [MAIN ] ABT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:11:55.663628] [DEBUG] [LOCAL ] ABM: Saving derivative data. [2025-09-16T21:11:55.680928] [DEBUG] [LOCAL ] ABM: Derivative data saved (1339 records). [2025-09-16T21:11:55.681052] [INFO ] [MAIN ] ABM: Successfully saved derivative data. [2025-09-16T21:11:55.682670] [INFO ] [MAIN ] Derivative Progress: 11/2026 symbols completed. ABM took 1.0s. Estimated remaining: 11m 48s. Rate: 170.7 symbols/min [2025-09-16T21:11:55.691807] [INFO ] [MAIN ] ACA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:11:55.693088] [DEBUG] [MAIN ] ABR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:11:55.694064] [INFO ] [MAIN ] ABR: Generated 1339 derivative records from 38749 primary records. [2025-09-16T21:11:55.694298] [DEBUG] [LOCAL ] ABR: Saving derivative data. [2025-09-16T21:11:55.721201] [DEBUG] [LOCAL ] ABR: Derivative data saved (1339 records). [2025-09-16T21:11:55.721387] [INFO ] [MAIN ] ABR: Successfully saved derivative data. [2025-09-16T21:11:55.723466] [INFO ] [MAIN ] Derivative Progress: 12/2026 symbols completed. ABR took 1.0s. Estimated remaining: 10m 56s. Rate: 184.3 symbols/min [2025-09-16T21:11:55.723804] [INFO ] [MAIN ] ACCO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:11:55.731803] [DEBUG] [LOCAL ] ACA: Loaded 16738 existing records from primary storage. [2025-09-16T21:11:55.731942] [INFO ] [MAIN ] ACA: Loaded 16738 primary data records. [2025-09-16T21:11:55.843660] [DEBUG] [LOCAL ] ABT: Loaded 39983 existing records from primary storage. [2025-09-16T21:11:55.863205] [INFO ] [MAIN ] ABT: Loaded 39983 primary data records. [2025-09-16T21:11:56.060210] [DEBUG] [LOCAL ] ACCO: Loaded 27598 existing records from primary storage. [2025-09-16T21:11:56.170062] [INFO ] [MAIN ] ACCO: Loaded 27598 primary data records. [2025-09-16T21:11:56.649685] [DEBUG] [MAIN ] ACA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:11:56.650486] [INFO ] [MAIN ] ACA: Generated 1339 derivative records from 16738 primary records. [2025-09-16T21:11:56.650606] [DEBUG] [LOCAL ] ACA: Saving derivative data. [2025-09-16T21:11:56.669754] [DEBUG] [MAIN ] ABT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:11:56.671631] [INFO ] [MAIN ] ABT: Generated 1339 derivative records from 39983 primary records. [2025-09-16T21:11:56.671811] [DEBUG] [LOCAL ] ABT: Saving derivative data. [2025-09-16T21:11:56.686401] [DEBUG] [LOCAL ] ABT: Derivative data saved (1339 records). [2025-09-16T21:11:56.686569] [INFO ] [MAIN ] ABT: Successfully saved derivative data. [2025-09-16T21:11:56.688066] [INFO ] [MAIN ] Derivative Progress: 13/2026 symbols completed. ABT took 1.0s. Estimated remaining: 12m 34s. Rate: 160.1 symbols/min [2025-09-16T21:11:56.685678] [DEBUG] [LOCAL ] ACA: Derivative data saved (1339 records). [2025-09-16T21:11:56.688307] [INFO ] [MAIN ] ACA: Successfully saved derivative data. [2025-09-16T21:11:56.689860] [INFO ] [MAIN ] Derivative Progress: 14/2026 symbols completed. ACA took 1.0s. Estimated remaining: 11m 40s. Rate: 172.3 symbols/min [2025-09-16T21:11:56.701742] [DEBUG] [MAIN ] ACCO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:11:56.702264] [INFO ] [MAIN ] ACCO: Generated 1339 derivative records from 27598 primary records. [2025-09-16T21:11:56.702323] [DEBUG] [LOCAL ] ACCO: Saving derivative data. [2025-09-16T21:11:56.714346] [DEBUG] [LOCAL ] ACCO: Derivative data saved (1339 records). [2025-09-16T21:11:56.714405] [INFO ] [MAIN ] ACCO: Successfully saved derivative data. [2025-09-16T21:11:56.716285] [INFO ] [MAIN ] Derivative Progress: 15/2026 symbols completed. ACCO took 1.0s. Estimated remaining: 10m 57s. Rate: 183.7 symbols/min [2025-09-16T21:11:56.716762] [INFO ] [MAIN ] ACI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:11:56.716709] [INFO ] [MAIN ] ACM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:11:56.716961] [INFO ] [MAIN ] ACHR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:11:56.780079] [DEBUG] [LOCAL ] ACM: Loaded 31522 existing records from primary storage. [2025-09-16T21:11:56.792437] [INFO ] [MAIN ] ACM: Loaded 31522 primary data records. [2025-09-16T21:11:56.798450] [DEBUG] [LOCAL ] ACI: Loaded 39673 existing records from primary storage. [2025-09-16T21:11:56.828258] [DEBUG] [LOCAL ] ACHR: Loaded 40168 existing records from primary storage. [2025-09-16T21:11:56.833550] [INFO ] [MAIN ] ACHR: Loaded 40168 primary data records. [2025-09-16T21:11:56.811732] [INFO ] [MAIN ] ACI: Loaded 39673 primary data records. [2025-09-16T21:11:57.646141] [DEBUG] [MAIN ] ACM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:11:57.645900] [DEBUG] [MAIN ] ACI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:11:57.647078] [INFO ] [MAIN ] ACI: Generated 1339 derivative records from 39673 primary records. [2025-09-16T21:11:57.649518] [INFO ] [MAIN ] ACM: Generated 1339 derivative records from 31522 primary records. [2025-09-16T21:11:57.649420] [DEBUG] [LOCAL ] ACI: Saving derivative data. [2025-09-16T21:11:57.650157] [DEBUG] [LOCAL ] ACM: Saving derivative data. [2025-09-16T21:11:57.681187] [DEBUG] [MAIN ] ACHR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:11:57.683036] [INFO ] [MAIN ] ACHR: Generated 1339 derivative records from 40168 primary records. [2025-09-16T21:11:57.683964] [DEBUG] [LOCAL ] ACHR: Saving derivative data. [2025-09-16T21:11:57.686725] [DEBUG] [LOCAL ] ACM: Derivative data saved (1339 records). [2025-09-16T21:11:57.685717] [DEBUG] [LOCAL ] ACI: Derivative data saved (1339 records). [2025-09-16T21:11:57.687066] [INFO ] [MAIN ] ACI: Successfully saved derivative data. [2025-09-16T21:11:57.689129] [INFO ] [MAIN ] Derivative Progress: 16/2026 symbols completed. ACI took 1.0s. Estimated remaining: 12m 18s. Rate: 163.5 symbols/min [2025-09-16T21:11:57.694854] [INFO ] [MAIN ] ACM: Successfully saved derivative data. [2025-09-16T21:11:57.695141] [INFO ] [MAIN ] ACN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:11:57.701267] [INFO ] [MAIN ] Derivative Progress: 17/2026 symbols completed. ACM took 1.0s. Estimated remaining: 11m 36s. Rate: 173.3 symbols/min [2025-09-16T21:11:57.702241] [INFO ] [MAIN ] ACR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:11:57.705623] [DEBUG] [LOCAL ] ACHR: Derivative data saved (1339 records). [2025-09-16T21:11:57.705777] [INFO ] [MAIN ] ACHR: Successfully saved derivative data. [2025-09-16T21:11:57.707261] [INFO ] [MAIN ] Derivative Progress: 18/2026 symbols completed. ACHR took 1.0s. Estimated remaining: 10m 57s. Rate: 183.3 symbols/min [2025-09-16T21:11:57.708939] [INFO ] [MAIN ] ACRE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:11:57.712437] [DEBUG] [LOCAL ] ACR: Loaded 4172 existing records from primary storage. [2025-09-16T21:11:57.712677] [INFO ] [MAIN ] ACR: Loaded 4172 primary data records. [2025-09-16T21:11:57.911396] [DEBUG] [LOCAL ] ACRE: Loaded 24288 existing records from primary storage. [2025-09-16T21:11:57.921244] [INFO ] [MAIN ] ACRE: Loaded 24288 primary data records. [2025-09-16T21:11:58.096956] [DEBUG] [LOCAL ] ACN: Loaded 39800 existing records from primary storage. [2025-09-16T21:11:58.125187] [INFO ] [MAIN ] ACN: Loaded 39800 primary data records. [2025-09-16T21:11:58.586559] [DEBUG] [MAIN ] ACR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:11:58.588676] [INFO ] [MAIN ] ACR: Generated 1339 derivative records from 4172 primary records. [2025-09-16T21:11:58.588991] [DEBUG] [LOCAL ] ACR: Saving derivative data. [2025-09-16T21:11:58.602200] [DEBUG] [LOCAL ] ACR: Derivative data saved (1339 records). [2025-09-16T21:11:58.602746] [INFO ] [MAIN ] ACR: Successfully saved derivative data. [2025-09-16T21:11:58.604367] [INFO ] [MAIN ] Derivative Progress: 19/2026 symbols completed. ACR took 0.9s. Estimated remaining: 11m 57s. Rate: 167.9 symbols/min [2025-09-16T21:11:58.605203] [INFO ] [MAIN ] ACV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:11:58.620377] [DEBUG] [MAIN ] ACRE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:11:58.621120] [INFO ] [MAIN ] ACRE: Generated 1339 derivative records from 24288 primary records. [2025-09-16T21:11:58.621540] [DEBUG] [LOCAL ] ACRE: Saving derivative data. [2025-09-16T21:11:58.625026] [DEBUG] [LOCAL ] ACV: Loaded 4619 existing records from primary storage. [2025-09-16T21:11:58.625385] [INFO ] [MAIN ] ACV: Loaded 4619 primary data records. [2025-09-16T21:11:58.717252] [DEBUG] [MAIN ] ACN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:11:58.725088] [INFO ] [MAIN ] ACN: Generated 1339 derivative records from 39800 primary records. [2025-09-16T21:11:58.735591] [DEBUG] [LOCAL ] ACN: Saving derivative data. [2025-09-16T21:11:58.754493] [DEBUG] [LOCAL ] ACRE: Derivative data saved (1339 records). [2025-09-16T21:11:58.754830] [INFO ] [MAIN ] ACRE: Successfully saved derivative data. [2025-09-16T21:11:58.756772] [INFO ] [MAIN ] Derivative Progress: 20/2026 symbols completed. ACRE took 1.0s. Estimated remaining: 11m 36s. Rate: 172.9 symbols/min [2025-09-16T21:11:58.811482] [INFO ] [MAIN ] ACVA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:11:58.963177] [DEBUG] [LOCAL ] ACN: Derivative data saved (1339 records). [2025-09-16T21:11:58.963349] [INFO ] [MAIN ] ACN: Successfully saved derivative data. [2025-09-16T21:11:58.965973] [INFO ] [MAIN ] Derivative Progress: 21/2026 symbols completed. ACN took 1.3s. Estimated remaining: 11m 23s. Rate: 176.2 symbols/min [2025-09-16T21:11:58.966360] [INFO ] [MAIN ] ADC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:11:58.995612] [DEBUG] [MAIN ] ACV: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:11:58.996331] [INFO ] [MAIN ] ACV: Generated 1339 derivative records from 4619 primary records. [2025-09-16T21:11:58.996497] [DEBUG] [LOCAL ] ACV: Saving derivative data. [2025-09-16T21:11:59.009170] [DEBUG] [LOCAL ] ACV: Derivative data saved (1339 records). [2025-09-16T21:11:59.009325] [INFO ] [MAIN ] ACV: Successfully saved derivative data. [2025-09-16T21:11:59.011314] [INFO ] [MAIN ] Derivative Progress: 22/2026 symbols completed. ACV took 0.4s. Estimated remaining: 10m 55s. Rate: 183.4 symbols/min [2025-09-16T21:11:59.011832] [INFO ] [MAIN ] ADCT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:11:59.031127] [DEBUG] [LOCAL ] ACVA: Loaded 36184 existing records from primary storage. [2025-09-16T21:11:59.031600] [INFO ] [MAIN ] ACVA: Loaded 36184 primary data records. [2025-09-16T21:11:59.163082] [DEBUG] [LOCAL ] ADC: Loaded 34611 existing records from primary storage. [2025-09-16T21:11:59.179287] [INFO ] [MAIN ] ADC: Loaded 34611 primary data records. [2025-09-16T21:11:59.286231] [DEBUG] [LOCAL ] ADCT: Loaded 25885 existing records from primary storage. [2025-09-16T21:11:59.401451] [INFO ] [MAIN ] ADCT: Loaded 25885 primary data records. [2025-09-16T21:11:59.911469] [DEBUG] [MAIN ] ACVA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:11:59.912451] [INFO ] [MAIN ] ACVA: Generated 1339 derivative records from 36184 primary records. [2025-09-16T21:11:59.912745] [DEBUG] [LOCAL ] ACVA: Saving derivative data. [2025-09-16T21:11:59.926045] [DEBUG] [LOCAL ] ACVA: Derivative data saved (1339 records). [2025-09-16T21:11:59.926876] [INFO ] [MAIN ] ACVA: Successfully saved derivative data. [2025-09-16T21:11:59.928485] [INFO ] [MAIN ] Derivative Progress: 23/2026 symbols completed. ACVA took 1.2s. Estimated remaining: 11m 47s. Rate: 170.1 symbols/min [2025-09-16T21:11:59.929038] [INFO ] [MAIN ] ADM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:11:59.943298] [DEBUG] [MAIN ] ADC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:11:59.944158] [INFO ] [MAIN ] ADC: Generated 1339 derivative records from 34611 primary records. [2025-09-16T21:11:59.944270] [DEBUG] [LOCAL ] ADC: Saving derivative data. [2025-09-16T21:11:59.978858] [DEBUG] [LOCAL ] ADC: Derivative data saved (1339 records). [2025-09-16T21:11:59.979386] [DEBUG] [MAIN ] ADCT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:11:59.979480] [INFO ] [MAIN ] ADC: Successfully saved derivative data. [2025-09-16T21:11:59.981272] [INFO ] [MAIN ] Derivative Progress: 24/2026 symbols completed. ADC took 1.0s. Estimated remaining: 11m 21s. Rate: 176.4 symbols/min [2025-09-16T21:11:59.982072] [INFO ] [MAIN ] ADCT: Generated 1339 derivative records from 25885 primary records. [2025-09-16T21:11:59.982942] [INFO ] [MAIN ] ADNT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:11:59.983072] [DEBUG] [LOCAL ] ADCT: Saving derivative data. [2025-09-16T21:12:00.005670] [DEBUG] [LOCAL ] ADM: Loaded 39782 existing records from primary storage. [2025-09-16T21:12:00.006836] [INFO ] [MAIN ] ADM: Loaded 39782 primary data records. [2025-09-16T21:12:00.090506] [DEBUG] [LOCAL ] ADCT: Derivative data saved (1339 records). [2025-09-16T21:12:00.120231] [INFO ] [MAIN ] ADCT: Successfully saved derivative data. [2025-09-16T21:12:00.122194] [INFO ] [MAIN ] Derivative Progress: 25/2026 symbols completed. ADCT took 1.1s. Estimated remaining: 11m 5s. Rate: 180.6 symbols/min [2025-09-16T21:12:00.171062] [INFO ] [MAIN ] ADT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:00.289425] [DEBUG] [LOCAL ] ADNT: Loaded 35081 existing records from primary storage. [2025-09-16T21:12:00.289754] [INFO ] [MAIN ] ADNT: Loaded 35081 primary data records. [2025-09-16T21:12:00.600077] [DEBUG] [LOCAL ] ADT: Loaded 39870 existing records from primary storage. [2025-09-16T21:12:00.601308] [INFO ] [MAIN ] ADT: Loaded 39870 primary data records. [2025-09-16T21:12:00.709856] [DEBUG] [MAIN ] ADM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:00.721524] [INFO ] [MAIN ] ADM: Generated 1339 derivative records from 39782 primary records. [2025-09-16T21:12:00.727142] [DEBUG] [LOCAL ] ADM: Saving derivative data. [2025-09-16T21:12:00.808749] [DEBUG] [LOCAL ] ADM: Derivative data saved (1339 records). [2025-09-16T21:12:00.929266] [INFO ] [MAIN ] ADM: Successfully saved derivative data. [2025-09-16T21:12:00.941316] [INFO ] [MAIN ] Derivative Progress: 26/2026 symbols completed. ADM took 1.0s. Estimated remaining: 11m 42s. Rate: 171.0 symbols/min [2025-09-16T21:12:00.941866] [INFO ] [MAIN ] ADX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:00.956692] [DEBUG] [MAIN ] ADNT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:00.957999] [INFO ] [MAIN ] ADNT: Generated 1339 derivative records from 35081 primary records. [2025-09-16T21:12:00.958385] [DEBUG] [LOCAL ] ADNT: Saving derivative data. [2025-09-16T21:12:00.979054] [DEBUG] [LOCAL ] ADNT: Derivative data saved (1339 records). [2025-09-16T21:12:00.979245] [INFO ] [MAIN ] ADNT: Successfully saved derivative data. [2025-09-16T21:12:00.980907] [INFO ] [MAIN ] Derivative Progress: 27/2026 symbols completed. ADNT took 1.0s. Estimated remaining: 11m 19s. Rate: 176.8 symbols/min [2025-09-16T21:12:00.981348] [INFO ] [MAIN ] AEFC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:00.989978] [DEBUG] [LOCAL ] ADX: Loaded 20576 existing records from primary storage. [2025-09-16T21:12:00.993044] [INFO ] [MAIN ] ADX: Loaded 20576 primary data records. [2025-09-16T21:12:01.087929] [DEBUG] [LOCAL ] AEFC: Loaded 5914 existing records from primary storage. [2025-09-16T21:12:01.110366] [DEBUG] [MAIN ] ADT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:01.110198] [INFO ] [MAIN ] AEFC: Loaded 5914 primary data records. [2025-09-16T21:12:01.116547] [INFO ] [MAIN ] ADT: Generated 1339 derivative records from 39870 primary records. [2025-09-16T21:12:01.167991] [DEBUG] [LOCAL ] ADT: Saving derivative data. [2025-09-16T21:12:01.436100] [DEBUG] [LOCAL ] ADT: Derivative data saved (1339 records). [2025-09-16T21:12:01.473535] [INFO ] [MAIN ] ADT: Successfully saved derivative data. [2025-09-16T21:12:01.480364] [INFO ] [MAIN ] Derivative Progress: 28/2026 symbols completed. ADT took 1.3s. Estimated remaining: 11m 30s. Rate: 173.8 symbols/min [2025-09-16T21:12:01.618750] [DEBUG] [MAIN ] ADX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:01.619759] [INFO ] [MAIN ] ADX: Generated 1339 derivative records from 20576 primary records. [2025-09-16T21:12:01.620062] [DEBUG] [LOCAL ] ADX: Saving derivative data. [2025-09-16T21:12:01.633332] [DEBUG] [LOCAL ] ADX: Derivative data saved (1339 records). [2025-09-16T21:12:01.633444] [INFO ] [MAIN ] ADX: Successfully saved derivative data. [2025-09-16T21:12:01.635391] [INFO ] [MAIN ] Derivative Progress: 29/2026 symbols completed. ADX took 0.7s. Estimated remaining: 11m 16s. Rate: 177.2 symbols/min [2025-09-16T21:12:01.647544] [DEBUG] [MAIN ] AEFC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:01.648335] [INFO ] [MAIN ] AEFC: Generated 1339 derivative records from 5914 primary records. [2025-09-16T21:12:01.648397] [DEBUG] [LOCAL ] AEFC: Saving derivative data. [2025-09-16T21:12:01.660315] [DEBUG] [LOCAL ] AEFC: Derivative data saved (1339 records). [2025-09-16T21:12:01.660382] [INFO ] [MAIN ] AEFC: Successfully saved derivative data. [2025-09-16T21:12:01.662402] [INFO ] [MAIN ] Derivative Progress: 30/2026 symbols completed. AEFC took 0.7s. Estimated remaining: 10m 55s. Rate: 182.8 symbols/min [2025-09-16T21:12:01.663395] [INFO ] [MAIN ] AER: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:01.663302] [INFO ] [MAIN ] AEG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:01.664468] [INFO ] [MAIN ] AEO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:01.744167] [DEBUG] [LOCAL ] AEG: Loaded 37046 existing records from primary storage. [2025-09-16T21:12:01.746361] [INFO ] [MAIN ] AEG: Loaded 37046 primary data records. [2025-09-16T21:12:01.747459] [DEBUG] [LOCAL ] AEO: Loaded 39921 existing records from primary storage. [2025-09-16T21:12:01.757615] [INFO ] [MAIN ] AEO: Loaded 39921 primary data records. [2025-09-16T21:12:01.844165] [DEBUG] [LOCAL ] AER: Loaded 35913 existing records from primary storage. [2025-09-16T21:12:01.875968] [INFO ] [MAIN ] AER: Loaded 35913 primary data records. [2025-09-16T21:12:02.628196] [DEBUG] [MAIN ] AEG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:02.641943] [INFO ] [MAIN ] AEG: Generated 1339 derivative records from 37046 primary records. [2025-09-16T21:12:02.643661] [DEBUG] [LOCAL ] AEG: Saving derivative data. [2025-09-16T21:12:02.643458] [DEBUG] [MAIN ] AEO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:02.645886] [INFO ] [MAIN ] AEO: Generated 1339 derivative records from 39921 primary records. [2025-09-16T21:12:02.646965] [DEBUG] [LOCAL ] AEO: Saving derivative data. [2025-09-16T21:12:02.677716] [DEBUG] [LOCAL ] AEG: Derivative data saved (1339 records). [2025-09-16T21:12:02.681251] [DEBUG] [LOCAL ] AEO: Derivative data saved (1339 records). [2025-09-16T21:12:02.681331] [INFO ] [MAIN ] AEG: Successfully saved derivative data. [2025-09-16T21:12:02.683204] [INFO ] [MAIN ] AEO: Successfully saved derivative data. [2025-09-16T21:12:02.683127] [INFO ] [MAIN ] Derivative Progress: 31/2026 symbols completed. AEG took 1.0s. Estimated remaining: 11m 39s. Rate: 171.2 symbols/min [2025-09-16T21:12:02.681634] [DEBUG] [MAIN ] AER: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:02.685178] [INFO ] [MAIN ] AES: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:02.685898] [INFO ] [MAIN ] AER: Generated 1339 derivative records from 35913 primary records. [2025-09-16T21:12:02.686102] [INFO ] [MAIN ] Derivative Progress: 32/2026 symbols completed. AEO took 1.0s. Estimated remaining: 11m 17s. Rate: 176.6 symbols/min [2025-09-16T21:12:02.686458] [INFO ] [MAIN ] AFB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:02.686506] [DEBUG] [LOCAL ] AER: Saving derivative data. [2025-09-16T21:12:02.700016] [DEBUG] [LOCAL ] AER: Derivative data saved (1339 records). [2025-09-16T21:12:02.702337] [INFO ] [MAIN ] AER: Successfully saved derivative data. [2025-09-16T21:12:02.704111] [INFO ] [MAIN ] Derivative Progress: 33/2026 symbols completed. AER took 1.0s. Estimated remaining: 10m 58s. Rate: 181.8 symbols/min [2025-09-16T21:12:02.704422] [INFO ] [MAIN ] AFG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:02.710084] [DEBUG] [LOCAL ] AFB: Loaded 7923 existing records from primary storage. [2025-09-16T21:12:02.710241] [INFO ] [MAIN ] AFB: Loaded 7923 primary data records. [2025-09-16T21:12:02.932748] [DEBUG] [LOCAL ] AFG: Loaded 23723 existing records from primary storage. [2025-09-16T21:12:02.932988] [INFO ] [MAIN ] AFG: Loaded 23723 primary data records. [2025-09-16T21:12:03.007000] [DEBUG] [LOCAL ] AES: Loaded 40025 existing records from primary storage. [2025-09-16T21:12:03.018192] [INFO ] [MAIN ] AES: Loaded 40025 primary data records. [2025-09-16T21:12:03.626388] [DEBUG] [MAIN ] AFB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:03.627495] [INFO ] [MAIN ] AFB: Generated 1339 derivative records from 7923 primary records. [2025-09-16T21:12:03.628020] [DEBUG] [LOCAL ] AFB: Saving derivative data. [2025-09-16T21:12:03.643529] [DEBUG] [LOCAL ] AFB: Derivative data saved (1339 records). [2025-09-16T21:12:03.644432] [INFO ] [MAIN ] AFB: Successfully saved derivative data. [2025-09-16T21:12:03.646278] [INFO ] [MAIN ] Derivative Progress: 34/2026 symbols completed. AFB took 1.0s. Estimated remaining: 11m 33s. Rate: 172.4 symbols/min [2025-09-16T21:12:03.646735] [INFO ] [MAIN ] AFGC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:03.660029] [DEBUG] [LOCAL ] AFGC: Loaded 2047 existing records from primary storage. [2025-09-16T21:12:03.660220] [INFO ] [MAIN ] AFGC: Loaded 2047 primary data records. [2025-09-16T21:12:03.660541] [DEBUG] [MAIN ] AFG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:03.693836] [INFO ] [MAIN ] AFG: Generated 1339 derivative records from 23723 primary records. [2025-09-16T21:12:03.718570] [DEBUG] [LOCAL ] AFG: Saving derivative data. [2025-09-16T21:12:03.784796] [DEBUG] [LOCAL ] AFG: Derivative data saved (1339 records). [2025-09-16T21:12:03.787943] [INFO ] [MAIN ] AFG: Successfully saved derivative data. [2025-09-16T21:12:03.788362] [DEBUG] [MAIN ] AES: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:03.790136] [INFO ] [MAIN ] Derivative Progress: 35/2026 symbols completed. AFG took 1.1s. Estimated remaining: 11m 21s. Rate: 175.4 symbols/min [2025-09-16T21:12:03.790930] [INFO ] [MAIN ] AES: Generated 1339 derivative records from 40025 primary records. [2025-09-16T21:12:03.791160] [INFO ] [MAIN ] AFGD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:03.791210] [DEBUG] [LOCAL ] AES: Saving derivative data. [2025-09-16T21:12:03.880083] [DEBUG] [LOCAL ] AES: Derivative data saved (1339 records). [2025-09-16T21:12:03.879092] [DEBUG] [LOCAL ] AFGD: Loaded 1344 existing records from primary storage. [2025-09-16T21:12:03.882719] [INFO ] [MAIN ] AFGD: Loaded 1344 primary data records. [2025-09-16T21:12:03.880206] [INFO ] [MAIN ] AES: Successfully saved derivative data. [2025-09-16T21:12:03.885359] [INFO ] [MAIN ] Derivative Progress: 36/2026 symbols completed. AES took 1.2s. Estimated remaining: 11m 7s. Rate: 179.0 symbols/min [2025-09-16T21:12:03.968823] [INFO ] [MAIN ] AFL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:04.265419] [DEBUG] [MAIN ] AFGC: Filtered 5181 bins outside market hours, 5780 incomplete bins [2025-09-16T21:12:04.277154] [INFO ] [MAIN ] AFGC: Generated 1338 derivative records from 2047 primary records. [2025-09-16T21:12:04.277533] [DEBUG] [LOCAL ] AFGC: Saving derivative data. [2025-09-16T21:12:04.278178] [DEBUG] [LOCAL ] AFL: Loaded 39605 existing records from primary storage. [2025-09-16T21:12:04.278610] [INFO ] [MAIN ] AFL: Loaded 39605 primary data records. [2025-09-16T21:12:04.396679] [DEBUG] [LOCAL ] AFGC: Derivative data saved (1338 records). [2025-09-16T21:12:04.422896] [INFO ] [MAIN ] AFGC: Successfully saved derivative data. [2025-09-16T21:12:04.457426] [DEBUG] [MAIN ] AFGD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:04.486826] [INFO ] [MAIN ] AFGD: Generated 1339 derivative records from 1344 primary records. [2025-09-16T21:12:04.488453] [INFO ] [MAIN ] Derivative Progress: 37/2026 symbols completed. AFGC took 0.8s. Estimated remaining: 11m 21s. Rate: 175.2 symbols/min [2025-09-16T21:12:04.488582] [DEBUG] [LOCAL ] AFGD: Saving derivative data. [2025-09-16T21:12:04.488791] [INFO ] [MAIN ] AG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:04.585530] [DEBUG] [LOCAL ] AFGD: Derivative data saved (1339 records). [2025-09-16T21:12:04.586004] [INFO ] [MAIN ] AFGD: Successfully saved derivative data. [2025-09-16T21:12:04.587780] [INFO ] [MAIN ] Derivative Progress: 38/2026 symbols completed. AFGD took 0.8s. Estimated remaining: 11m 8s. Rate: 178.5 symbols/min [2025-09-16T21:12:04.588302] [INFO ] [MAIN ] AGCO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:04.605064] [DEBUG] [MAIN ] AFL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:04.605799] [INFO ] [MAIN ] AFL: Generated 1339 derivative records from 39605 primary records. [2025-09-16T21:12:04.605911] [DEBUG] [LOCAL ] AFL: Saving derivative data. [2025-09-16T21:12:04.618398] [DEBUG] [LOCAL ] AFL: Derivative data saved (1339 records). [2025-09-16T21:12:04.618475] [INFO ] [MAIN ] AFL: Successfully saved derivative data. [2025-09-16T21:12:04.620184] [INFO ] [MAIN ] Derivative Progress: 39/2026 symbols completed. AFL took 0.7s. Estimated remaining: 10m 52s. Rate: 182.8 symbols/min [2025-09-16T21:12:04.629263] [INFO ] [MAIN ] AGD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:04.655517] [DEBUG] [LOCAL ] AG: Loaded 39996 existing records from primary storage. [2025-09-16T21:12:04.669688] [INFO ] [MAIN ] AG: Loaded 39996 primary data records. [2025-09-16T21:12:04.670067] [DEBUG] [LOCAL ] AGD: Loaded 13784 existing records from primary storage. [2025-09-16T21:12:04.670184] [INFO ] [MAIN ] AGD: Loaded 13784 primary data records. [2025-09-16T21:12:04.701416] [DEBUG] [LOCAL ] AGCO: Loaded 31416 existing records from primary storage. [2025-09-16T21:12:04.754176] [INFO ] [MAIN ] AGCO: Loaded 31416 primary data records. [2025-09-16T21:12:05.542716] [DEBUG] [MAIN ] AG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:05.555224] [INFO ] [MAIN ] AG: Generated 1339 derivative records from 39996 primary records. [2025-09-16T21:12:05.555502] [DEBUG] [LOCAL ] AG: Saving derivative data. [2025-09-16T21:12:05.555840] [DEBUG] [MAIN ] AGD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:05.566114] [INFO ] [MAIN ] AGD: Generated 1339 derivative records from 13784 primary records. [2025-09-16T21:12:05.566584] [DEBUG] [MAIN ] AGCO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:05.575051] [DEBUG] [LOCAL ] AGD: Saving derivative data. [2025-09-16T21:12:05.575847] [INFO ] [MAIN ] AGCO: Generated 1339 derivative records from 31416 primary records. [2025-09-16T21:12:05.576941] [DEBUG] [LOCAL ] AGCO: Saving derivative data. [2025-09-16T21:12:05.588605] [DEBUG] [LOCAL ] AG: Derivative data saved (1339 records). [2025-09-16T21:12:05.595030] [INFO ] [MAIN ] AG: Successfully saved derivative data. [2025-09-16T21:12:05.600340] [INFO ] [MAIN ] Derivative Progress: 40/2026 symbols completed. AG took 1.1s. Estimated remaining: 11m 24s. Rate: 174.1 symbols/min [2025-09-16T21:12:05.602198] [DEBUG] [LOCAL ] AGD: Derivative data saved (1339 records). [2025-09-16T21:12:05.601895] [INFO ] [MAIN ] AGI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:05.602889] [INFO ] [MAIN ] AGD: Successfully saved derivative data. [2025-09-16T21:12:05.605693] [INFO ] [MAIN ] Derivative Progress: 41/2026 symbols completed. AGD took 1.0s. Estimated remaining: 11m 8s. Rate: 178.4 symbols/min [2025-09-16T21:12:05.608541] [INFO ] [MAIN ] AGL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:05.608325] [DEBUG] [LOCAL ] AGCO: Derivative data saved (1339 records). [2025-09-16T21:12:05.608958] [INFO ] [MAIN ] AGCO: Successfully saved derivative data. [2025-09-16T21:12:05.611080] [INFO ] [MAIN ] Derivative Progress: 42/2026 symbols completed. AGCO took 1.0s. Estimated remaining: 10m 52s. Rate: 182.7 symbols/min [2025-09-16T21:12:05.611572] [INFO ] [MAIN ] AGM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:05.624372] [DEBUG] [LOCAL ] AGM: Loaded 8023 existing records from primary storage. [2025-09-16T21:12:05.624907] [INFO ] [MAIN ] AGM: Loaded 8023 primary data records. [2025-09-16T21:12:05.785117] [DEBUG] [LOCAL ] AGL: Loaded 39074 existing records from primary storage. [2025-09-16T21:12:05.845168] [DEBUG] [LOCAL ] AGI: Loaded 39794 existing records from primary storage. [2025-09-16T21:12:05.845340] [INFO ] [MAIN ] AGI: Loaded 39794 primary data records. [2025-09-16T21:12:05.842238] [INFO ] [MAIN ] AGL: Loaded 39074 primary data records. [2025-09-16T21:12:06.483627] [DEBUG] [MAIN ] AGM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:06.485346] [INFO ] [MAIN ] AGM: Generated 1339 derivative records from 8023 primary records. [2025-09-16T21:12:06.485752] [DEBUG] [LOCAL ] AGM: Saving derivative data. [2025-09-16T21:12:06.507935] [DEBUG] [LOCAL ] AGM: Derivative data saved (1339 records). [2025-09-16T21:12:06.508184] [INFO ] [MAIN ] AGM: Successfully saved derivative data. [2025-09-16T21:12:06.510210] [INFO ] [MAIN ] Derivative Progress: 43/2026 symbols completed. AGM took 0.9s. Estimated remaining: 11m 18s. Rate: 175.6 symbols/min [2025-09-16T21:12:06.520708] [DEBUG] [MAIN ] AGI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:06.522598] [INFO ] [MAIN ] AGI: Generated 1339 derivative records from 39794 primary records. [2025-09-16T21:12:06.522784] [DEBUG] [LOCAL ] AGI: Saving derivative data. [2025-09-16T21:12:06.539299] [DEBUG] [MAIN ] AGL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:06.542256] [INFO ] [MAIN ] AGL: Generated 1339 derivative records from 39074 primary records. [2025-09-16T21:12:06.543418] [DEBUG] [LOCAL ] AGL: Saving derivative data. [2025-09-16T21:12:06.545280] [DEBUG] [LOCAL ] AGI: Derivative data saved (1339 records). [2025-09-16T21:12:06.545483] [INFO ] [MAIN ] AGI: Successfully saved derivative data. [2025-09-16T21:12:06.553042] [INFO ] [MAIN ] Derivative Progress: 44/2026 symbols completed. AGI took 1.0s. Estimated remaining: 11m 4s. Rate: 179.1 symbols/min [2025-09-16T21:12:06.558070] [DEBUG] [LOCAL ] AGL: Derivative data saved (1339 records). [2025-09-16T21:12:06.558132] [INFO ] [MAIN ] AGL: Successfully saved derivative data. [2025-09-16T21:12:06.559512] [INFO ] [MAIN ] Derivative Progress: 45/2026 symbols completed. AGL took 1.0s. Estimated remaining: 10m 49s. Rate: 183.1 symbols/min [2025-09-16T21:12:06.559938] [INFO ] [MAIN ] AGRO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:06.560067] [INFO ] [MAIN ] AGX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:06.560596] [INFO ] [MAIN ] AGO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:06.603530] [DEBUG] [LOCAL ] AGX: Loaded 24652 existing records from primary storage. [2025-09-16T21:12:06.611046] [DEBUG] [LOCAL ] AGRO: Loaded 24149 existing records from primary storage. [2025-09-16T21:12:06.610214] [INFO ] [MAIN ] AGX: Loaded 24652 primary data records. [2025-09-16T21:12:06.611539] [DEBUG] [LOCAL ] AGO: Loaded 20430 existing records from primary storage. [2025-09-16T21:12:06.611215] [INFO ] [MAIN ] AGRO: Loaded 24149 primary data records. [2025-09-16T21:12:06.636200] [INFO ] [MAIN ] AGO: Loaded 20430 primary data records. [2025-09-16T21:12:07.437702] [DEBUG] [MAIN ] AGX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:07.438534] [INFO ] [MAIN ] AGX: Generated 1339 derivative records from 24652 primary records. [2025-09-16T21:12:07.438982] [DEBUG] [LOCAL ] AGX: Saving derivative data. [2025-09-16T21:12:07.456384] [DEBUG] [LOCAL ] AGX: Derivative data saved (1339 records). [2025-09-16T21:12:07.477612] [INFO ] [MAIN ] AGX: Successfully saved derivative data. [2025-09-16T21:12:07.479790] [INFO ] [MAIN ] Derivative Progress: 46/2026 symbols completed. AGX took 0.9s. Estimated remaining: 11m 14s. Rate: 176.2 symbols/min [2025-09-16T21:12:07.478310] [DEBUG] [MAIN ] AGRO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:07.477893] [DEBUG] [MAIN ] AGO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:07.480855] [INFO ] [MAIN ] AHH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:07.480795] [INFO ] [MAIN ] AGO: Generated 1339 derivative records from 20430 primary records. [2025-09-16T21:12:07.481529] [INFO ] [MAIN ] AGRO: Generated 1339 derivative records from 24149 primary records. [2025-09-16T21:12:07.481931] [DEBUG] [LOCAL ] AGRO: Saving derivative data. [2025-09-16T21:12:07.481968] [DEBUG] [LOCAL ] AGO: Saving derivative data. [2025-09-16T21:12:07.509978] [DEBUG] [LOCAL ] AGO: Derivative data saved (1339 records). [2025-09-16T21:12:07.511147] [INFO ] [MAIN ] AGO: Successfully saved derivative data. [2025-09-16T21:12:07.511433] [DEBUG] [LOCAL ] AGRO: Derivative data saved (1339 records). [2025-09-16T21:12:07.513010] [INFO ] [MAIN ] Derivative Progress: 47/2026 symbols completed. AGO took 1.0s. Estimated remaining: 11m 1s. Rate: 179.7 symbols/min [2025-09-16T21:12:07.513353] [INFO ] [MAIN ] AHR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:07.513467] [INFO ] [MAIN ] AGRO: Successfully saved derivative data. [2025-09-16T21:12:07.515709] [INFO ] [MAIN ] Derivative Progress: 48/2026 symbols completed. AGRO took 1.0s. Estimated remaining: 10m 47s. Rate: 183.4 symbols/min [2025-09-16T21:12:07.516004] [INFO ] [MAIN ] AHT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:07.530421] [DEBUG] [LOCAL ] AHT: Loaded 4639 existing records from primary storage. [2025-09-16T21:12:07.530595] [INFO ] [MAIN ] AHT: Loaded 4639 primary data records. [2025-09-16T21:12:07.665691] [DEBUG] [LOCAL ] AHH: Loaded 29751 existing records from primary storage. [2025-09-16T21:12:07.681963] [INFO ] [MAIN ] AHH: Loaded 29751 primary data records. [2025-09-16T21:12:07.949246] [DEBUG] [LOCAL ] AHR: Loaded 36730 existing records from primary storage. [2025-09-16T21:12:07.962759] [INFO ] [MAIN ] AHR: Loaded 36730 primary data records. [2025-09-16T21:12:08.430880] [DEBUG] [MAIN ] AHT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:08.432075] [INFO ] [MAIN ] AHT: Generated 1339 derivative records from 4639 primary records. [2025-09-16T21:12:08.432277] [DEBUG] [LOCAL ] AHT: Saving derivative data. [2025-09-16T21:12:08.446739] [DEBUG] [LOCAL ] AHT: Derivative data saved (1339 records). [2025-09-16T21:12:08.446901] [INFO ] [MAIN ] AHT: Successfully saved derivative data. [2025-09-16T21:12:08.448805] [INFO ] [MAIN ] Derivative Progress: 49/2026 symbols completed. AHT took 0.9s. Estimated remaining: 11m 11s. Rate: 176.8 symbols/min [2025-09-16T21:12:08.458796] [INFO ] [MAIN ] AI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:08.459016] [DEBUG] [MAIN ] AHH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:08.459818] [INFO ] [MAIN ] AHH: Generated 1339 derivative records from 29751 primary records. [2025-09-16T21:12:08.460123] [DEBUG] [LOCAL ] AHH: Saving derivative data. [2025-09-16T21:12:08.477276] [DEBUG] [LOCAL ] AHH: Derivative data saved (1339 records). [2025-09-16T21:12:08.477502] [INFO ] [MAIN ] AHH: Successfully saved derivative data. [2025-09-16T21:12:08.488610] [INFO ] [MAIN ] Derivative Progress: 50/2026 symbols completed. AHH took 1.0s. Estimated remaining: 10m 59s. Rate: 179.9 symbols/min [2025-09-16T21:12:08.491181] [INFO ] [MAIN ] AIG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:08.491698] [DEBUG] [MAIN ] AHR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:08.492711] [INFO ] [MAIN ] AHR: Generated 1339 derivative records from 36730 primary records. [2025-09-16T21:12:08.492894] [DEBUG] [LOCAL ] AHR: Saving derivative data. [2025-09-16T21:12:08.516267] [DEBUG] [LOCAL ] AHR: Derivative data saved (1339 records). [2025-09-16T21:12:08.516424] [INFO ] [MAIN ] AHR: Successfully saved derivative data. [2025-09-16T21:12:08.518234] [INFO ] [MAIN ] Derivative Progress: 51/2026 symbols completed. AHR took 1.0s. Estimated remaining: 10m 47s. Rate: 183.2 symbols/min [2025-09-16T21:12:08.518534] [INFO ] [MAIN ] AIN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:08.537483] [DEBUG] [LOCAL ] AI: Loaded 40117 existing records from primary storage. [2025-09-16T21:12:08.537851] [INFO ] [MAIN ] AI: Loaded 40117 primary data records. [2025-09-16T21:12:08.694253] [DEBUG] [LOCAL ] AIN: Loaded 18026 existing records from primary storage. [2025-09-16T21:12:08.730487] [INFO ] [MAIN ] AIN: Loaded 18026 primary data records. [2025-09-16T21:12:08.728227] [DEBUG] [LOCAL ] AIG: Loaded 39844 existing records from primary storage. [2025-09-16T21:12:08.870671] [INFO ] [MAIN ] AIG: Loaded 39844 primary data records. [2025-09-16T21:12:09.379298] [DEBUG] [MAIN ] AI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:09.380782] [INFO ] [MAIN ] AI: Generated 1339 derivative records from 40117 primary records. [2025-09-16T21:12:09.381602] [DEBUG] [LOCAL ] AI: Saving derivative data. [2025-09-16T21:12:09.394586] [DEBUG] [LOCAL ] AI: Derivative data saved (1339 records). [2025-09-16T21:12:09.394956] [INFO ] [MAIN ] AI: Successfully saved derivative data. [2025-09-16T21:12:09.396404] [INFO ] [MAIN ] Derivative Progress: 52/2026 symbols completed. AI took 0.9s. Estimated remaining: 11m 7s. Rate: 177.5 symbols/min [2025-09-16T21:12:09.396659] [INFO ] [MAIN ] AIO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:09.410143] [DEBUG] [MAIN ] AIG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:09.411437] [INFO ] [MAIN ] AIG: Generated 1339 derivative records from 39844 primary records. [2025-09-16T21:12:09.414855] [DEBUG] [LOCAL ] AIG: Saving derivative data. [2025-09-16T21:12:09.441419] [DEBUG] [MAIN ] AIN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:09.444212] [DEBUG] [LOCAL ] AIO: Loaded 9228 existing records from primary storage. [2025-09-16T21:12:09.445161] [INFO ] [MAIN ] AIN: Generated 1339 derivative records from 18026 primary records. [2025-09-16T21:12:09.445224] [INFO ] [MAIN ] AIO: Loaded 9228 primary data records. [2025-09-16T21:12:09.445664] [DEBUG] [LOCAL ] AIN: Saving derivative data. [2025-09-16T21:12:09.499151] [DEBUG] [LOCAL ] AIG: Derivative data saved (1339 records). [2025-09-16T21:12:09.520546] [INFO ] [MAIN ] AIG: Successfully saved derivative data. [2025-09-16T21:12:09.530568] [INFO ] [MAIN ] Derivative Progress: 53/2026 symbols completed. AIG took 1.0s. Estimated remaining: 10m 59s. Rate: 179.5 symbols/min [2025-09-16T21:12:09.538212] [INFO ] [MAIN ] AIR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:09.563811] [DEBUG] [LOCAL ] AIN: Derivative data saved (1339 records). [2025-09-16T21:12:09.578372] [INFO ] [MAIN ] AIN: Successfully saved derivative data. [2025-09-16T21:12:09.585383] [INFO ] [MAIN ] Derivative Progress: 54/2026 symbols completed. AIN took 1.1s. Estimated remaining: 10m 49s. Rate: 182.3 symbols/min [2025-09-16T21:12:09.629382] [INFO ] [MAIN ] AIT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:09.747113] [DEBUG] [LOCAL ] AIR: Loaded 19453 existing records from primary storage. [2025-09-16T21:12:09.747825] [INFO ] [MAIN ] AIR: Loaded 19453 primary data records. [2025-09-16T21:12:09.874891] [DEBUG] [LOCAL ] AIT: Loaded 20432 existing records from primary storage. [2025-09-16T21:12:09.886862] [INFO ] [MAIN ] AIT: Loaded 20432 primary data records. [2025-09-16T21:12:10.270664] [DEBUG] [MAIN ] AIO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:10.361666] [INFO ] [MAIN ] AIO: Generated 1339 derivative records from 9228 primary records. [2025-09-16T21:12:10.362237] [DEBUG] [LOCAL ] AIO: Saving derivative data. [2025-09-16T21:12:10.380385] [DEBUG] [LOCAL ] AIO: Derivative data saved (1339 records). [2025-09-16T21:12:10.380663] [INFO ] [MAIN ] AIO: Successfully saved derivative data. [2025-09-16T21:12:10.382358] [INFO ] [MAIN ] Derivative Progress: 55/2026 symbols completed. AIO took 1.0s. Estimated remaining: 11m 5s. Rate: 177.7 symbols/min [2025-09-16T21:12:10.382660] [INFO ] [MAIN ] AIV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:10.397181] [DEBUG] [MAIN ] AIR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:10.397909] [INFO ] [MAIN ] AIR: Generated 1339 derivative records from 19453 primary records. [2025-09-16T21:12:10.398132] [DEBUG] [LOCAL ] AIR: Saving derivative data. [2025-09-16T21:12:10.432560] [DEBUG] [LOCAL ] AIR: Derivative data saved (1339 records). [2025-09-16T21:12:10.432994] [INFO ] [MAIN ] AIR: Successfully saved derivative data. [2025-09-16T21:12:10.434855] [INFO ] [MAIN ] Derivative Progress: 56/2026 symbols completed. AIR took 0.9s. Estimated remaining: 10m 55s. Rate: 180.5 symbols/min [2025-09-16T21:12:10.432851] [DEBUG] [MAIN ] AIT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:10.435666] [INFO ] [MAIN ] AIT: Generated 1339 derivative records from 20432 primary records. [2025-09-16T21:12:10.436433] [DEBUG] [LOCAL ] AIT: Saving derivative data. [2025-09-16T21:12:10.436312] [INFO ] [MAIN ] AIZN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:10.456897] [DEBUG] [LOCAL ] AIV: Loaded 29849 existing records from primary storage. [2025-09-16T21:12:10.457279] [INFO ] [MAIN ] AIV: Loaded 29849 primary data records. [2025-09-16T21:12:10.462214] [DEBUG] [LOCAL ] AIZN: Loaded 2643 existing records from primary storage. [2025-09-16T21:12:10.462267] [DEBUG] [LOCAL ] AIT: Derivative data saved (1339 records). [2025-09-16T21:12:10.467657] [INFO ] [MAIN ] AIZN: Loaded 2643 primary data records. [2025-09-16T21:12:10.467739] [INFO ] [MAIN ] AIT: Successfully saved derivative data. [2025-09-16T21:12:10.507349] [INFO ] [MAIN ] Derivative Progress: 57/2026 symbols completed. AIT took 0.9s. Estimated remaining: 10m 46s. Rate: 183.0 symbols/min [2025-09-16T21:12:10.564080] [INFO ] [MAIN ] AJG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:11.022272] [DEBUG] [LOCAL ] AJG: Loaded 34554 existing records from primary storage. [2025-09-16T21:12:11.022597] [INFO ] [MAIN ] AJG: Loaded 34554 primary data records. [2025-09-16T21:12:11.214687] [DEBUG] [MAIN ] AIZN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:11.305500] [INFO ] [MAIN ] AIZN: Generated 1339 derivative records from 2643 primary records. [2025-09-16T21:12:11.307437] [DEBUG] [LOCAL ] AIZN: Saving derivative data. [2025-09-16T21:12:11.327969] [DEBUG] [MAIN ] AIV: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:11.329287] [INFO ] [MAIN ] AIV: Generated 1339 derivative records from 29849 primary records. [2025-09-16T21:12:11.329538] [DEBUG] [LOCAL ] AIV: Saving derivative data. [2025-09-16T21:12:11.341575] [DEBUG] [LOCAL ] AIZN: Derivative data saved (1339 records). [2025-09-16T21:12:11.343507] [INFO ] [MAIN ] AIZN: Successfully saved derivative data. [2025-09-16T21:12:11.345658] [INFO ] [MAIN ] Derivative Progress: 58/2026 symbols completed. AIZN took 0.9s. Estimated remaining: 11m 3s. Rate: 178.2 symbols/min [2025-09-16T21:12:11.347160] [DEBUG] [LOCAL ] AIV: Derivative data saved (1339 records). [2025-09-16T21:12:11.347223] [INFO ] [MAIN ] AIV: Successfully saved derivative data. [2025-09-16T21:12:11.349003] [INFO ] [MAIN ] Derivative Progress: 59/2026 symbols completed. AIV took 1.0s. Estimated remaining: 10m 51s. Rate: 181.2 symbols/min [2025-09-16T21:12:11.362096] [DEBUG] [MAIN ] AJG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:11.362656] [INFO ] [MAIN ] AJG: Generated 1339 derivative records from 34554 primary records. [2025-09-16T21:12:11.362719] [DEBUG] [LOCAL ] AJG: Saving derivative data. [2025-09-16T21:12:11.374377] [DEBUG] [LOCAL ] AJG: Derivative data saved (1339 records). [2025-09-16T21:12:11.374440] [INFO ] [MAIN ] AJG: Successfully saved derivative data. [2025-09-16T21:12:11.375931] [INFO ] [MAIN ] Derivative Progress: 60/2026 symbols completed. AJG took 0.8s. Estimated remaining: 10m 41s. Rate: 184.0 symbols/min [2025-09-16T21:12:11.376470] [INFO ] [MAIN ] ALB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:11.376335] [INFO ] [MAIN ] AKR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:11.376583] [INFO ] [MAIN ] AL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:11.426835] [DEBUG] [LOCAL ] AL: Loaded 32517 existing records from primary storage. [2025-09-16T21:12:11.427016] [INFO ] [MAIN ] AL: Loaded 32517 primary data records. [2025-09-16T21:12:11.549091] [DEBUG] [LOCAL ] AKR: Loaded 34176 existing records from primary storage. [2025-09-16T21:12:11.549593] [DEBUG] [LOCAL ] ALB: Loaded 39803 existing records from primary storage. [2025-09-16T21:12:11.549827] [INFO ] [MAIN ] AKR: Loaded 34176 primary data records. [2025-09-16T21:12:11.549775] [INFO ] [MAIN ] ALB: Loaded 39803 primary data records. [2025-09-16T21:12:12.311769] [DEBUG] [MAIN ] AL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:12.312996] [INFO ] [MAIN ] AL: Generated 1339 derivative records from 32517 primary records. [2025-09-16T21:12:12.313338] [DEBUG] [LOCAL ] AL: Saving derivative data. [2025-09-16T21:12:12.325973] [DEBUG] [LOCAL ] AL: Derivative data saved (1339 records). [2025-09-16T21:12:12.326164] [INFO ] [MAIN ] AL: Successfully saved derivative data. [2025-09-16T21:12:12.327773] [INFO ] [MAIN ] Derivative Progress: 61/2026 symbols completed. AL took 1.0s. Estimated remaining: 11m 1s. Rate: 178.4 symbols/min [2025-09-16T21:12:12.330246] [INFO ] [MAIN ] ALC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:12.348757] [DEBUG] [MAIN ] ALB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:12.353215] [INFO ] [MAIN ] ALB: Generated 1339 derivative records from 39803 primary records. [2025-09-16T21:12:12.353531] [DEBUG] [MAIN ] AKR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:12.353689] [DEBUG] [LOCAL ] ALB: Saving derivative data. [2025-09-16T21:12:12.354322] [INFO ] [MAIN ] AKR: Generated 1339 derivative records from 34176 primary records. [2025-09-16T21:12:12.355169] [DEBUG] [LOCAL ] AKR: Saving derivative data. [2025-09-16T21:12:12.387403] [DEBUG] [LOCAL ] AKR: Derivative data saved (1339 records). [2025-09-16T21:12:12.388099] [INFO ] [MAIN ] AKR: Successfully saved derivative data. [2025-09-16T21:12:12.388535] [DEBUG] [LOCAL ] ALB: Derivative data saved (1339 records). [2025-09-16T21:12:12.392542] [INFO ] [MAIN ] Derivative Progress: 62/2026 symbols completed. AKR took 1.0s. Estimated remaining: 10m 52s. Rate: 180.8 symbols/min [2025-09-16T21:12:12.392974] [INFO ] [MAIN ] ALE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:12.392801] [INFO ] [MAIN ] ALB: Successfully saved derivative data. [2025-09-16T21:12:12.396206] [INFO ] [MAIN ] Derivative Progress: 63/2026 symbols completed. ALB took 1.0s. Estimated remaining: 10m 41s. Rate: 183.7 symbols/min [2025-09-16T21:12:12.396538] [INFO ] [MAIN ] ALEX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:12.409429] [DEBUG] [LOCAL ] ALC: Loaded 37854 existing records from primary storage. [2025-09-16T21:12:12.409637] [INFO ] [MAIN ] ALC: Loaded 37854 primary data records. [2025-09-16T21:12:12.610901] [DEBUG] [LOCAL ] ALEX: Loaded 22072 existing records from primary storage. [2025-09-16T21:12:12.689294] [DEBUG] [LOCAL ] ALE: Loaded 22661 existing records from primary storage. [2025-09-16T21:12:12.700209] [INFO ] [MAIN ] ALEX: Loaded 22072 primary data records. [2025-09-16T21:12:12.700456] [INFO ] [MAIN ] ALE: Loaded 22661 primary data records. [2025-09-16T21:12:13.256871] [DEBUG] [MAIN ] ALC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:13.258026] [INFO ] [MAIN ] ALC: Generated 1339 derivative records from 37854 primary records. [2025-09-16T21:12:13.258137] [DEBUG] [LOCAL ] ALC: Saving derivative data. [2025-09-16T21:12:13.271790] [DEBUG] [LOCAL ] ALC: Derivative data saved (1339 records). [2025-09-16T21:12:13.272233] [INFO ] [MAIN ] ALC: Successfully saved derivative data. [2025-09-16T21:12:13.273698] [INFO ] [MAIN ] Derivative Progress: 64/2026 symbols completed. ALC took 0.9s. Estimated remaining: 10m 58s. Rate: 179.0 symbols/min [2025-09-16T21:12:13.274504] [INFO ] [MAIN ] ALG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:13.296748] [DEBUG] [LOCAL ] ALG: Loaded 7360 existing records from primary storage. [2025-09-16T21:12:13.293070] [DEBUG] [MAIN ] ALEX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:13.297001] [INFO ] [MAIN ] ALG: Loaded 7360 primary data records. [2025-09-16T21:12:13.297735] [INFO ] [MAIN ] ALEX: Generated 1339 derivative records from 22072 primary records. [2025-09-16T21:12:13.343824] [DEBUG] [LOCAL ] ALEX: Saving derivative data. [2025-09-16T21:12:13.351141] [DEBUG] [MAIN ] ALE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:13.385362] [INFO ] [MAIN ] ALE: Generated 1339 derivative records from 22661 primary records. [2025-09-16T21:12:13.385860] [DEBUG] [LOCAL ] ALE: Saving derivative data. [2025-09-16T21:12:13.461010] [DEBUG] [LOCAL ] ALE: Derivative data saved (1339 records). [2025-09-16T21:12:13.476228] [DEBUG] [LOCAL ] ALEX: Derivative data saved (1339 records). [2025-09-16T21:12:13.476284] [INFO ] [MAIN ] ALE: Successfully saved derivative data. [2025-09-16T21:12:13.483951] [INFO ] [MAIN ] ALEX: Successfully saved derivative data. [2025-09-16T21:12:13.508247] [INFO ] [MAIN ] Derivative Progress: 65/2026 symbols completed. ALE took 1.1s. Estimated remaining: 10m 54s. Rate: 179.8 symbols/min [2025-09-16T21:12:13.513392] [INFO ] [MAIN ] ALIT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:13.513319] [INFO ] [MAIN ] Derivative Progress: 66/2026 symbols completed. ALEX took 1.1s. Estimated remaining: 10m 44s. Rate: 182.5 symbols/min [2025-09-16T21:12:13.513731] [INFO ] [MAIN ] ALL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:13.622828] [DEBUG] [MAIN ] ALG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:13.632735] [INFO ] [MAIN ] ALG: Generated 1339 derivative records from 7360 primary records. [2025-09-16T21:12:13.632931] [DEBUG] [LOCAL ] ALG: Saving derivative data. [2025-09-16T21:12:13.669777] [DEBUG] [LOCAL ] ALIT: Loaded 39226 existing records from primary storage. [2025-09-16T21:12:13.670487] [DEBUG] [LOCAL ] ALG: Derivative data saved (1339 records). [2025-09-16T21:12:13.670633] [INFO ] [MAIN ] ALIT: Loaded 39226 primary data records. [2025-09-16T21:12:13.670731] [INFO ] [MAIN ] ALG: Successfully saved derivative data. [2025-09-16T21:12:13.672728] [INFO ] [MAIN ] Derivative Progress: 67/2026 symbols completed. ALG took 0.4s. Estimated remaining: 10m 39s. Rate: 183.9 symbols/min [2025-09-16T21:12:13.673258] [INFO ] [MAIN ] ALLE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:13.755636] [DEBUG] [LOCAL ] ALL: Loaded 37086 existing records from primary storage. [2025-09-16T21:12:13.768035] [INFO ] [MAIN ] ALL: Loaded 37086 primary data records. [2025-09-16T21:12:14.151693] [DEBUG] [LOCAL ] ALLE: Loaded 33163 existing records from primary storage. [2025-09-16T21:12:14.172529] [INFO ] [MAIN ] ALLE: Loaded 33163 primary data records. [2025-09-16T21:12:14.617312] [DEBUG] [MAIN ] ALIT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:14.618995] [INFO ] [MAIN ] ALIT: Generated 1339 derivative records from 39226 primary records. [2025-09-16T21:12:14.619512] [DEBUG] [LOCAL ] ALIT: Saving derivative data. [2025-09-16T21:12:14.634757] [DEBUG] [LOCAL ] ALIT: Derivative data saved (1339 records). [2025-09-16T21:12:14.637491] [INFO ] [MAIN ] ALIT: Successfully saved derivative data. [2025-09-16T21:12:14.639057] [INFO ] [MAIN ] Derivative Progress: 68/2026 symbols completed. ALIT took 1.1s. Estimated remaining: 10m 57s. Rate: 178.8 symbols/min [2025-09-16T21:12:14.639279] [INFO ] [MAIN ] ALLY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:14.650750] [DEBUG] [MAIN ] ALL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:14.651438] [INFO ] [MAIN ] ALL: Generated 1339 derivative records from 37086 primary records. [2025-09-16T21:12:14.651809] [DEBUG] [LOCAL ] ALL: Saving derivative data. [2025-09-16T21:12:14.664938] [DEBUG] [LOCAL ] ALL: Derivative data saved (1339 records). [2025-09-16T21:12:14.665268] [INFO ] [MAIN ] ALL: Successfully saved derivative data. [2025-09-16T21:12:14.666709] [INFO ] [MAIN ] Derivative Progress: 69/2026 symbols completed. ALL took 1.2s. Estimated remaining: 10m 48s. Rate: 181.2 symbols/min [2025-09-16T21:12:14.667083] [INFO ] [MAIN ] ALSN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:14.679490] [DEBUG] [MAIN ] ALLE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:14.680162] [INFO ] [MAIN ] ALLE: Generated 1339 derivative records from 33163 primary records. [2025-09-16T21:12:14.680264] [DEBUG] [LOCAL ] ALLE: Saving derivative data. [2025-09-16T21:12:14.701847] [DEBUG] [LOCAL ] ALLE: Derivative data saved (1339 records). [2025-09-16T21:12:14.702089] [INFO ] [MAIN ] ALLE: Successfully saved derivative data. [2025-09-16T21:12:14.703759] [INFO ] [MAIN ] Derivative Progress: 70/2026 symbols completed. ALLE took 1.0s. Estimated remaining: 10m 40s. Rate: 183.5 symbols/min [2025-09-16T21:12:14.704045] [INFO ] [MAIN ] ALTG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:14.726532] [DEBUG] [LOCAL ] ALLY: Loaded 39603 existing records from primary storage. [2025-09-16T21:12:14.731455] [INFO ] [MAIN ] ALLY: Loaded 39603 primary data records. [2025-09-16T21:12:14.829000] [DEBUG] [LOCAL ] ALTG: Loaded 17512 existing records from primary storage. [2025-09-16T21:12:14.839964] [INFO ] [MAIN ] ALTG: Loaded 17512 primary data records. [2025-09-16T21:12:14.847988] [DEBUG] [LOCAL ] ALSN: Loaded 31728 existing records from primary storage. [2025-09-16T21:12:14.856799] [INFO ] [MAIN ] ALSN: Loaded 31728 primary data records. [2025-09-16T21:12:15.582131] [DEBUG] [MAIN ] ALLY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:15.582917] [INFO ] [MAIN ] ALLY: Generated 1339 derivative records from 39603 primary records. [2025-09-16T21:12:15.583254] [DEBUG] [LOCAL ] ALLY: Saving derivative data. [2025-09-16T21:12:15.598347] [DEBUG] [LOCAL ] ALLY: Derivative data saved (1339 records). [2025-09-16T21:12:15.598627] [INFO ] [MAIN ] ALLY: Successfully saved derivative data. [2025-09-16T21:12:15.601395] [INFO ] [MAIN ] Derivative Progress: 71/2026 symbols completed. ALLY took 1.0s. Estimated remaining: 10m 55s. Rate: 179.1 symbols/min [2025-09-16T21:12:15.602295] [INFO ] [MAIN ] ALUR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:15.612424] [DEBUG] [MAIN ] ALSN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:15.613085] [INFO ] [MAIN ] ALSN: Generated 1339 derivative records from 31728 primary records. [2025-09-16T21:12:15.613318] [DEBUG] [LOCAL ] ALSN: Saving derivative data. [2025-09-16T21:12:15.623092] [DEBUG] [MAIN ] ALTG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:15.624339] [INFO ] [MAIN ] ALTG: Generated 1339 derivative records from 17512 primary records. [2025-09-16T21:12:15.624485] [DEBUG] [LOCAL ] ALTG: Saving derivative data. [2025-09-16T21:12:15.651701] [DEBUG] [LOCAL ] ALUR: Loaded 7366 existing records from primary storage. [2025-09-16T21:12:15.653183] [INFO ] [MAIN ] ALUR: Loaded 7366 primary data records. [2025-09-16T21:12:15.653005] [DEBUG] [LOCAL ] ALTG: Derivative data saved (1339 records). [2025-09-16T21:12:15.651988] [DEBUG] [LOCAL ] ALSN: Derivative data saved (1339 records). [2025-09-16T21:12:15.653480] [INFO ] [MAIN ] ALTG: Successfully saved derivative data. [2025-09-16T21:12:15.655188] [INFO ] [MAIN ] Derivative Progress: 72/2026 symbols completed. ALTG took 1.0s. Estimated remaining: 10m 47s. Rate: 181.2 symbols/min [2025-09-16T21:12:15.653595] [INFO ] [MAIN ] ALSN: Successfully saved derivative data. [2025-09-16T21:12:15.677968] [INFO ] [MAIN ] Derivative Progress: 73/2026 symbols completed. ALSN took 1.0s. Estimated remaining: 10m 38s. Rate: 183.6 symbols/min [2025-09-16T21:12:15.701482] [INFO ] [MAIN ] ALV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:15.939262] [DEBUG] [LOCAL ] ALV: Loaded 31077 existing records from primary storage. [2025-09-16T21:12:15.939524] [INFO ] [MAIN ] ALV: Loaded 31077 primary data records. [2025-09-16T21:12:16.129465] [DEBUG] [MAIN ] ALUR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:16.213507] [INFO ] [MAIN ] ALUR: Generated 1339 derivative records from 7366 primary records. [2025-09-16T21:12:16.213676] [DEBUG] [LOCAL ] ALUR: Saving derivative data. [2025-09-16T21:12:16.226761] [DEBUG] [LOCAL ] ALUR: Derivative data saved (1339 records). [2025-09-16T21:12:16.227946] [INFO ] [MAIN ] ALUR: Successfully saved derivative data. [2025-09-16T21:12:16.229687] [INFO ] [MAIN ] Derivative Progress: 74/2026 symbols completed. ALUR took 0.6s. Estimated remaining: 10m 44s. Rate: 181.9 symbols/min [2025-09-16T21:12:16.245525] [DEBUG] [MAIN ] ALV: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:16.246099] [INFO ] [MAIN ] ALV: Generated 1339 derivative records from 31077 primary records. [2025-09-16T21:12:16.246162] [DEBUG] [LOCAL ] ALV: Saving derivative data. [2025-09-16T21:12:16.257684] [DEBUG] [LOCAL ] ALV: Derivative data saved (1339 records). [2025-09-16T21:12:16.257740] [INFO ] [MAIN ] ALV: Successfully saved derivative data. [2025-09-16T21:12:16.259680] [INFO ] [MAIN ] Derivative Progress: 75/2026 symbols completed. ALV took 0.6s. Estimated remaining: 10m 36s. Rate: 184.1 symbols/min [2025-09-16T21:12:16.260188] [INFO ] [MAIN ] ALX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:16.260763] [INFO ] [MAIN ] AMBP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:16.260579] [INFO ] [MAIN ] AM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:16.268044] [DEBUG] [LOCAL ] ALX: Loaded 5247 existing records from primary storage. [2025-09-16T21:12:16.268184] [INFO ] [MAIN ] ALX: Loaded 5247 primary data records. [2025-09-16T21:12:16.549408] [DEBUG] [LOCAL ] AMBP: Loaded 33802 existing records from primary storage. [2025-09-16T21:12:16.560165] [INFO ] [MAIN ] AMBP: Loaded 33802 primary data records. [2025-09-16T21:12:16.682345] [DEBUG] [LOCAL ] AM: Loaded 38636 existing records from primary storage. [2025-09-16T21:12:16.682980] [INFO ] [MAIN ] AM: Loaded 38636 primary data records. [2025-09-16T21:12:17.176313] [DEBUG] [MAIN ] ALX: Filtered 5181 bins outside market hours, 5780 incomplete bins [2025-09-16T21:12:17.177613] [INFO ] [MAIN ] ALX: Generated 1338 derivative records from 5247 primary records. [2025-09-16T21:12:17.178310] [DEBUG] [LOCAL ] ALX: Saving derivative data. [2025-09-16T21:12:17.189971] [DEBUG] [LOCAL ] ALX: Derivative data saved (1338 records). [2025-09-16T21:12:17.190169] [INFO ] [MAIN ] ALX: Successfully saved derivative data. [2025-09-16T21:12:17.192000] [INFO ] [MAIN ] Derivative Progress: 76/2026 symbols completed. ALX took 0.9s. Estimated remaining: 10m 51s. Rate: 179.7 symbols/min [2025-09-16T21:12:17.193532] [INFO ] [MAIN ] AMC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:17.208699] [DEBUG] [MAIN ] AMBP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:17.209604] [INFO ] [MAIN ] AMBP: Generated 1339 derivative records from 33802 primary records. [2025-09-16T21:12:17.209842] [DEBUG] [LOCAL ] AMBP: Saving derivative data. [2025-09-16T21:12:17.243024] [DEBUG] [MAIN ] AM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:17.243837] [DEBUG] [LOCAL ] AMBP: Derivative data saved (1339 records). [2025-09-16T21:12:17.244674] [INFO ] [MAIN ] AM: Generated 1339 derivative records from 38636 primary records. [2025-09-16T21:12:17.244865] [INFO ] [MAIN ] AMBP: Successfully saved derivative data. [2025-09-16T21:12:17.244816] [DEBUG] [LOCAL ] AM: Saving derivative data. [2025-09-16T21:12:17.246441] [INFO ] [MAIN ] Derivative Progress: 77/2026 symbols completed. AMBP took 1.0s. Estimated remaining: 10m 44s. Rate: 181.7 symbols/min [2025-09-16T21:12:17.247537] [INFO ] [MAIN ] AMCR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:17.272481] [DEBUG] [LOCAL ] AMC: Loaded 40123 existing records from primary storage. [2025-09-16T21:12:17.274046] [INFO ] [MAIN ] AMC: Loaded 40123 primary data records. [2025-09-16T21:12:17.274431] [DEBUG] [LOCAL ] AM: Derivative data saved (1339 records). [2025-09-16T21:12:17.329328] [INFO ] [MAIN ] AM: Successfully saved derivative data. [2025-09-16T21:12:17.368066] [INFO ] [MAIN ] Derivative Progress: 78/2026 symbols completed. AM took 1.1s. Estimated remaining: 10m 38s. Rate: 183.2 symbols/min [2025-09-16T21:12:17.379088] [INFO ] [MAIN ] AME: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:17.558784] [DEBUG] [LOCAL ] AMCR: Loaded 40022 existing records from primary storage. [2025-09-16T21:12:17.559498] [INFO ] [MAIN ] AMCR: Loaded 40022 primary data records. [2025-09-16T21:12:17.764766] [DEBUG] [LOCAL ] AME: Loaded 36016 existing records from primary storage. [2025-09-16T21:12:17.841275] [INFO ] [MAIN ] AME: Loaded 36016 primary data records. [2025-09-16T21:12:18.042231] [DEBUG] [MAIN ] AMC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:18.045278] [INFO ] [MAIN ] AMC: Generated 1339 derivative records from 40123 primary records. [2025-09-16T21:12:18.045546] [DEBUG] [LOCAL ] AMC: Saving derivative data. [2025-09-16T21:12:18.151206] [DEBUG] [LOCAL ] AMC: Derivative data saved (1339 records). [2025-09-16T21:12:18.152403] [INFO ] [MAIN ] AMC: Successfully saved derivative data. [2025-09-16T21:12:18.154493] [INFO ] [MAIN ] Derivative Progress: 79/2026 symbols completed. AMC took 1.0s. Estimated remaining: 10m 49s. Rate: 180.0 symbols/min [2025-09-16T21:12:18.154891] [INFO ] [MAIN ] AMG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:18.165791] [DEBUG] [MAIN ] AMCR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:18.166581] [INFO ] [MAIN ] AMCR: Generated 1339 derivative records from 40022 primary records. [2025-09-16T21:12:18.166775] [DEBUG] [LOCAL ] AMCR: Saving derivative data. [2025-09-16T21:12:18.183503] [DEBUG] [LOCAL ] AMCR: Derivative data saved (1339 records). [2025-09-16T21:12:18.184368] [INFO ] [MAIN ] AMCR: Successfully saved derivative data. [2025-09-16T21:12:18.192676] [DEBUG] [LOCAL ] AMG: Loaded 14556 existing records from primary storage. [2025-09-16T21:12:18.187388] [INFO ] [MAIN ] Derivative Progress: 80/2026 symbols completed. AMCR took 0.9s. Estimated remaining: 10m 41s. Rate: 182.0 symbols/min [2025-09-16T21:12:18.192868] [INFO ] [MAIN ] AMG: Loaded 14556 primary data records. [2025-09-16T21:12:18.193143] [INFO ] [MAIN ] AMH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:18.266275] [DEBUG] [MAIN ] AME: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:18.283976] [INFO ] [MAIN ] AME: Generated 1339 derivative records from 36016 primary records. [2025-09-16T21:12:18.295053] [DEBUG] [LOCAL ] AME: Saving derivative data. [2025-09-16T21:12:18.483522] [DEBUG] [LOCAL ] AME: Derivative data saved (1339 records). [2025-09-16T21:12:18.483715] [INFO ] [MAIN ] AME: Successfully saved derivative data. [2025-09-16T21:12:18.486194] [INFO ] [MAIN ] Derivative Progress: 81/2026 symbols completed. AME took 1.1s. Estimated remaining: 10m 40s. Rate: 182.2 symbols/min [2025-09-16T21:12:18.486521] [INFO ] [MAIN ] AMN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:18.501268] [DEBUG] [LOCAL ] AMH: Loaded 38458 existing records from primary storage. [2025-09-16T21:12:18.501673] [INFO ] [MAIN ] AMH: Loaded 38458 primary data records. [2025-09-16T21:12:18.787365] [DEBUG] [LOCAL ] AMN: Loaded 31354 existing records from primary storage. [2025-09-16T21:12:18.788340] [INFO ] [MAIN ] AMN: Loaded 31354 primary data records. [2025-09-16T21:12:18.864260] [DEBUG] [MAIN ] AMG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:18.882067] [INFO ] [MAIN ] AMG: Generated 1339 derivative records from 14556 primary records. [2025-09-16T21:12:18.901048] [DEBUG] [LOCAL ] AMG: Saving derivative data. [2025-09-16T21:12:19.119073] [DEBUG] [LOCAL ] AMG: Derivative data saved (1339 records). [2025-09-16T21:12:19.119333] [INFO ] [MAIN ] AMG: Successfully saved derivative data. [2025-09-16T21:12:19.120937] [INFO ] [MAIN ] Derivative Progress: 82/2026 symbols completed. AMG took 1.0s. Estimated remaining: 10m 47s. Rate: 180.2 symbols/min [2025-09-16T21:12:19.121414] [INFO ] [MAIN ] AMP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:19.136873] [DEBUG] [MAIN ] AMH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:19.137561] [INFO ] [MAIN ] AMH: Generated 1339 derivative records from 38458 primary records. [2025-09-16T21:12:19.137685] [DEBUG] [LOCAL ] AMH: Saving derivative data. [2025-09-16T21:12:19.151059] [DEBUG] [LOCAL ] AMH: Derivative data saved (1339 records). [2025-09-16T21:12:19.156267] [INFO ] [MAIN ] AMH: Successfully saved derivative data. [2025-09-16T21:12:19.158001] [INFO ] [MAIN ] Derivative Progress: 83/2026 symbols completed. AMH took 1.0s. Estimated remaining: 10m 40s. Rate: 182.1 symbols/min [2025-09-16T21:12:19.158476] [INFO ] [MAIN ] AMPX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:19.179529] [DEBUG] [LOCAL ] AMP: Loaded 23302 existing records from primary storage. [2025-09-16T21:12:19.179866] [DEBUG] [MAIN ] AMN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:19.180000] [INFO ] [MAIN ] AMP: Loaded 23302 primary data records. [2025-09-16T21:12:19.180633] [INFO ] [MAIN ] AMN: Generated 1339 derivative records from 31354 primary records. [2025-09-16T21:12:19.201084] [DEBUG] [LOCAL ] AMN: Saving derivative data. [2025-09-16T21:12:19.354010] [DEBUG] [LOCAL ] AMN: Derivative data saved (1339 records). [2025-09-16T21:12:19.380839] [INFO ] [MAIN ] AMN: Successfully saved derivative data. [2025-09-16T21:12:19.397138] [INFO ] [MAIN ] Derivative Progress: 84/2026 symbols completed. AMN took 0.9s. Estimated remaining: 10m 38s. Rate: 182.7 symbols/min [2025-09-16T21:12:19.481665] [DEBUG] [LOCAL ] AMPX: Loaded 39038 existing records from primary storage. [2025-09-16T21:12:19.481915] [INFO ] [MAIN ] AMPX: Loaded 39038 primary data records. [2025-09-16T21:12:19.481755] [INFO ] [MAIN ] AMPY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:19.775153] [DEBUG] [LOCAL ] AMPY: Loaded 27915 existing records from primary storage. [2025-09-16T21:12:19.775686] [INFO ] [MAIN ] AMPY: Loaded 27915 primary data records. [2025-09-16T21:12:19.822149] [DEBUG] [MAIN ] AMP: Filtered 5181 bins outside market hours, 5780 incomplete bins [2025-09-16T21:12:19.862665] [INFO ] [MAIN ] AMP: Generated 1338 derivative records from 23302 primary records. [2025-09-16T21:12:19.889625] [DEBUG] [LOCAL ] AMP: Saving derivative data. [2025-09-16T21:12:20.062780] [DEBUG] [LOCAL ] AMP: Derivative data saved (1338 records). [2025-09-16T21:12:20.063071] [INFO ] [MAIN ] AMP: Successfully saved derivative data. [2025-09-16T21:12:20.064623] [INFO ] [MAIN ] Derivative Progress: 85/2026 symbols completed. AMP took 0.9s. Estimated remaining: 10m 45s. Rate: 180.5 symbols/min [2025-09-16T21:12:20.065128] [INFO ] [MAIN ] AMR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:20.080139] [DEBUG] [MAIN ] AMPX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:20.080857] [INFO ] [MAIN ] AMPX: Generated 1339 derivative records from 39038 primary records. [2025-09-16T21:12:20.081014] [DEBUG] [LOCAL ] AMPX: Saving derivative data. [2025-09-16T21:12:20.100169] [DEBUG] [LOCAL ] AMPX: Derivative data saved (1339 records). [2025-09-16T21:12:20.100281] [INFO ] [MAIN ] AMPX: Successfully saved derivative data. [2025-09-16T21:12:20.101856] [INFO ] [MAIN ] Derivative Progress: 86/2026 symbols completed. AMPX took 0.9s. Estimated remaining: 10m 38s. Rate: 182.4 symbols/min [2025-09-16T21:12:20.102280] [INFO ] [MAIN ] AMRC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:20.112187] [DEBUG] [LOCAL ] AMR: Loaded 21471 existing records from primary storage. [2025-09-16T21:12:20.112422] [INFO ] [MAIN ] AMR: Loaded 21471 primary data records. [2025-09-16T21:12:20.142993] [DEBUG] [MAIN ] AMPY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:20.177977] [INFO ] [MAIN ] AMPY: Generated 1339 derivative records from 27915 primary records. [2025-09-16T21:12:20.198544] [DEBUG] [LOCAL ] AMPY: Saving derivative data. [2025-09-16T21:12:20.328183] [DEBUG] [LOCAL ] AMRC: Loaded 27742 existing records from primary storage. [2025-09-16T21:12:20.328825] [INFO ] [MAIN ] AMRC: Loaded 27742 primary data records. [2025-09-16T21:12:20.449884] [DEBUG] [LOCAL ] AMPY: Derivative data saved (1339 records). [2025-09-16T21:12:20.476601] [INFO ] [MAIN ] AMPY: Successfully saved derivative data. [2025-09-16T21:12:20.512456] [INFO ] [MAIN ] Derivative Progress: 87/2026 symbols completed. AMPY took 1.0s. Estimated remaining: 10m 40s. Rate: 181.9 symbols/min [2025-09-16T21:12:20.531841] [INFO ] [MAIN ] AMT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:20.815460] [DEBUG] [MAIN ] AMR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:20.816616] [INFO ] [MAIN ] AMR: Generated 1339 derivative records from 21471 primary records. [2025-09-16T21:12:20.815940] [DEBUG] [MAIN ] AMRC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:20.818263] [INFO ] [MAIN ] AMRC: Generated 1339 derivative records from 27742 primary records. [2025-09-16T21:12:20.817367] [DEBUG] [LOCAL ] AMR: Saving derivative data. [2025-09-16T21:12:20.818517] [DEBUG] [LOCAL ] AMRC: Saving derivative data. [2025-09-16T21:12:20.854605] [DEBUG] [LOCAL ] AMT: Loaded 38959 existing records from primary storage. [2025-09-16T21:12:20.855632] [INFO ] [MAIN ] AMT: Loaded 38959 primary data records. [2025-09-16T21:12:20.945759] [DEBUG] [LOCAL ] AMR: Derivative data saved (1339 records). [2025-09-16T21:12:20.954978] [DEBUG] [LOCAL ] AMRC: Derivative data saved (1339 records). [2025-09-16T21:12:20.975983] [INFO ] [MAIN ] AMRC: Successfully saved derivative data. [2025-09-16T21:12:20.983292] [INFO ] [MAIN ] Derivative Progress: 88/2026 symbols completed. AMRC took 0.9s. Estimated remaining: 10m 42s. Rate: 181.0 symbols/min [2025-09-16T21:12:20.975794] [INFO ] [MAIN ] AMR: Successfully saved derivative data. [2025-09-16T21:12:20.991171] [INFO ] [MAIN ] Derivative Progress: 89/2026 symbols completed. AMR took 0.9s. Estimated remaining: 10m 35s. Rate: 183.0 symbols/min [2025-09-16T21:12:21.314009] [DEBUG] [MAIN ] AMT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:21.315033] [INFO ] [MAIN ] AMT: Generated 1339 derivative records from 38959 primary records. [2025-09-16T21:12:21.315123] [DEBUG] [LOCAL ] AMT: Saving derivative data. [2025-09-16T21:12:21.334738] [DEBUG] [LOCAL ] AMT: Derivative data saved (1339 records). [2025-09-16T21:12:21.334933] [INFO ] [MAIN ] AMT: Successfully saved derivative data. [2025-09-16T21:12:21.337384] [INFO ] [MAIN ] Derivative Progress: 90/2026 symbols completed. AMT took 0.8s. Estimated remaining: 10m 35s. Rate: 182.9 symbols/min [2025-09-16T21:12:21.338415] [INFO ] [MAIN ] AMTM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:21.338731] [INFO ] [MAIN ] AMTD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:21.338554] [INFO ] [MAIN ] AMTB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:21.347109] [DEBUG] [LOCAL ] AMTD: Loaded 2906 existing records from primary storage. [2025-09-16T21:12:21.347386] [INFO ] [MAIN ] AMTD: Loaded 2906 primary data records. [2025-09-16T21:12:21.444807] [DEBUG] [LOCAL ] AMTB: Loaded 15340 existing records from primary storage. [2025-09-16T21:12:21.472123] [INFO ] [MAIN ] AMTB: Loaded 15340 primary data records. [2025-09-16T21:12:21.706538] [DEBUG] [LOCAL ] AMTM: Loaded 37550 existing records from primary storage. [2025-09-16T21:12:21.757911] [INFO ] [MAIN ] AMTM: Loaded 37550 primary data records. [2025-09-16T21:12:22.384242] [DEBUG] [MAIN ] AMTB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:22.385198] [INFO ] [MAIN ] AMTB: Generated 1339 derivative records from 15340 primary records. [2025-09-16T21:12:22.385448] [DEBUG] [LOCAL ] AMTB: Saving derivative data. [2025-09-16T21:12:22.396401] [DEBUG] [MAIN ] AMTD: Filtered 5181 bins outside market hours, 5780 incomplete bins [2025-09-16T21:12:22.406485] [INFO ] [MAIN ] AMTD: Generated 1338 derivative records from 2906 primary records. [2025-09-16T21:12:22.407372] [DEBUG] [LOCAL ] AMTD: Saving derivative data. [2025-09-16T21:12:22.418762] [DEBUG] [LOCAL ] AMTB: Derivative data saved (1339 records). [2025-09-16T21:12:22.420740] [INFO ] [MAIN ] AMTB: Successfully saved derivative data. [2025-09-16T21:12:22.422440] [INFO ] [MAIN ] Derivative Progress: 91/2026 symbols completed. AMTB took 1.1s. Estimated remaining: 10m 51s. Rate: 178.4 symbols/min [2025-09-16T21:12:22.424935] [INFO ] [MAIN ] AMX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:22.424201] [DEBUG] [LOCAL ] AMTD: Derivative data saved (1338 records). [2025-09-16T21:12:22.425183] [INFO ] [MAIN ] AMTD: Successfully saved derivative data. [2025-09-16T21:12:22.427084] [INFO ] [MAIN ] Derivative Progress: 92/2026 symbols completed. AMTD took 1.1s. Estimated remaining: 10m 44s. Rate: 180.3 symbols/min [2025-09-16T21:12:22.427722] [INFO ] [MAIN ] AN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:22.438150] [DEBUG] [MAIN ] AMTM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:22.439104] [INFO ] [MAIN ] AMTM: Generated 1339 derivative records from 37550 primary records. [2025-09-16T21:12:22.439365] [DEBUG] [LOCAL ] AMTM: Saving derivative data. [2025-09-16T21:12:22.455119] [DEBUG] [LOCAL ] AMTM: Derivative data saved (1339 records). [2025-09-16T21:12:22.455425] [INFO ] [MAIN ] AMTM: Successfully saved derivative data. [2025-09-16T21:12:22.457636] [INFO ] [MAIN ] Derivative Progress: 93/2026 symbols completed. AMTM took 1.1s. Estimated remaining: 10m 37s. Rate: 182.1 symbols/min [2025-09-16T21:12:22.463410] [INFO ] [MAIN ] ANET: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:22.485015] [DEBUG] [LOCAL ] AN: Loaded 23233 existing records from primary storage. [2025-09-16T21:12:22.494461] [INFO ] [MAIN ] AN: Loaded 23233 primary data records. [2025-09-16T21:12:22.507612] [DEBUG] [LOCAL ] AMX: Loaded 36405 existing records from primary storage. [2025-09-16T21:12:22.539550] [INFO ] [MAIN ] AMX: Loaded 36405 primary data records. [2025-09-16T21:12:22.848879] [DEBUG] [LOCAL ] ANET: Loaded 40116 existing records from primary storage. [2025-09-16T21:12:22.959676] [INFO ] [MAIN ] ANET: Loaded 40116 primary data records. [2025-09-16T21:12:23.337600] [DEBUG] [MAIN ] AN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:23.338459] [INFO ] [MAIN ] AN: Generated 1339 derivative records from 23233 primary records. [2025-09-16T21:12:23.347953] [DEBUG] [LOCAL ] AN: Saving derivative data. [2025-09-16T21:12:23.349671] [DEBUG] [MAIN ] AMX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:23.350679] [INFO ] [MAIN ] AMX: Generated 1339 derivative records from 36405 primary records. [2025-09-16T21:12:23.356453] [DEBUG] [LOCAL ] AMX: Saving derivative data. [2025-09-16T21:12:23.362779] [DEBUG] [LOCAL ] AN: Derivative data saved (1339 records). [2025-09-16T21:12:23.362985] [INFO ] [MAIN ] AN: Successfully saved derivative data. [2025-09-16T21:12:23.364781] [INFO ] [MAIN ] Derivative Progress: 94/2026 symbols completed. AN took 0.9s. Estimated remaining: 10m 48s. Rate: 178.8 symbols/min [2025-09-16T21:12:23.365144] [INFO ] [MAIN ] ANF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:23.381089] [DEBUG] [LOCAL ] AMX: Derivative data saved (1339 records). [2025-09-16T21:12:23.381349] [INFO ] [MAIN ] AMX: Successfully saved derivative data. [2025-09-16T21:12:23.392138] [INFO ] [MAIN ] Derivative Progress: 95/2026 symbols completed. AMX took 1.0s. Estimated remaining: 10m 42s. Rate: 180.5 symbols/min [2025-09-16T21:12:23.393249] [INFO ] [MAIN ] ANRO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:23.393076] [DEBUG] [MAIN ] ANET: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:23.394473] [INFO ] [MAIN ] ANET: Generated 1339 derivative records from 40116 primary records. [2025-09-16T21:12:23.396144] [DEBUG] [LOCAL ] ANET: Saving derivative data. [2025-09-16T21:12:23.418457] [DEBUG] [LOCAL ] ANET: Derivative data saved (1339 records). [2025-09-16T21:12:23.418731] [INFO ] [MAIN ] ANET: Successfully saved derivative data. [2025-09-16T21:12:23.420675] [INFO ] [MAIN ] Derivative Progress: 96/2026 symbols completed. ANET took 1.0s. Estimated remaining: 10m 35s. Rate: 182.3 symbols/min [2025-09-16T21:12:23.424186] [INFO ] [MAIN ] ANVS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:23.431967] [DEBUG] [LOCAL ] ANRO: Loaded 13497 existing records from primary storage. [2025-09-16T21:12:23.442229] [INFO ] [MAIN ] ANRO: Loaded 13497 primary data records. [2025-09-16T21:12:23.466200] [DEBUG] [LOCAL ] ANF: Loaded 38799 existing records from primary storage. [2025-09-16T21:12:23.481410] [INFO ] [MAIN ] ANF: Loaded 38799 primary data records. [2025-09-16T21:12:23.590893] [DEBUG] [LOCAL ] ANVS: Loaded 17667 existing records from primary storage. [2025-09-16T21:12:23.635031] [INFO ] [MAIN ] ANVS: Loaded 17667 primary data records. [2025-09-16T21:12:24.300865] [DEBUG] [MAIN ] ANF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:24.307086] [INFO ] [MAIN ] ANF: Generated 1339 derivative records from 38799 primary records. [2025-09-16T21:12:24.311008] [DEBUG] [MAIN ] ANRO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:24.311067] [DEBUG] [LOCAL ] ANF: Saving derivative data. [2025-09-16T21:12:24.311659] [INFO ] [MAIN ] ANRO: Generated 1339 derivative records from 13497 primary records. [2025-09-16T21:12:24.312966] [DEBUG] [LOCAL ] ANRO: Saving derivative data. [2025-09-16T21:12:24.331765] [DEBUG] [LOCAL ] ANF: Derivative data saved (1339 records). [2025-09-16T21:12:24.335013] [INFO ] [MAIN ] ANF: Successfully saved derivative data. [2025-09-16T21:12:24.346360] [INFO ] [MAIN ] Derivative Progress: 97/2026 symbols completed. ANF took 1.0s. Estimated remaining: 10m 47s. Rate: 178.9 symbols/min [2025-09-16T21:12:24.347825] [INFO ] [MAIN ] AOD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:24.349665] [DEBUG] [LOCAL ] ANRO: Derivative data saved (1339 records). [2025-09-16T21:12:24.348269] [DEBUG] [MAIN ] ANVS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:24.350315] [INFO ] [MAIN ] ANVS: Generated 1339 derivative records from 17667 primary records. [2025-09-16T21:12:24.350368] [INFO ] [MAIN ] ANRO: Successfully saved derivative data. [2025-09-16T21:12:24.350724] [DEBUG] [LOCAL ] ANVS: Saving derivative data. [2025-09-16T21:12:24.352326] [INFO ] [MAIN ] Derivative Progress: 98/2026 symbols completed. ANRO took 1.0s. Estimated remaining: 10m 40s. Rate: 180.7 symbols/min [2025-09-16T21:12:24.353280] [INFO ] [MAIN ] AOMR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:24.365543] [DEBUG] [LOCAL ] ANVS: Derivative data saved (1339 records). [2025-09-16T21:12:24.365677] [INFO ] [MAIN ] ANVS: Successfully saved derivative data. [2025-09-16T21:12:24.367708] [INFO ] [MAIN ] Derivative Progress: 99/2026 symbols completed. ANVS took 0.9s. Estimated remaining: 10m 34s. Rate: 182.5 symbols/min [2025-09-16T21:12:24.368029] [INFO ] [MAIN ] AON: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:24.383073] [DEBUG] [LOCAL ] AOMR: Loaded 12747 existing records from primary storage. [2025-09-16T21:12:24.383227] [INFO ] [MAIN ] AOMR: Loaded 12747 primary data records. [2025-09-16T21:12:24.499808] [DEBUG] [LOCAL ] AOD: Loaded 22340 existing records from primary storage. [2025-09-16T21:12:24.500285] [INFO ] [MAIN ] AOD: Loaded 22340 primary data records. [2025-09-16T21:12:24.786243] [DEBUG] [LOCAL ] AON: Loaded 33740 existing records from primary storage. [2025-09-16T21:12:24.792129] [INFO ] [MAIN ] AON: Loaded 33740 primary data records. [2025-09-16T21:12:25.230347] [DEBUG] [MAIN ] AOMR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:25.231303] [INFO ] [MAIN ] AOMR: Generated 1339 derivative records from 12747 primary records. [2025-09-16T21:12:25.232259] [DEBUG] [LOCAL ] AOMR: Saving derivative data. [2025-09-16T21:12:25.246812] [DEBUG] [LOCAL ] AOMR: Derivative data saved (1339 records). [2025-09-16T21:12:25.247329] [INFO ] [MAIN ] AOMR: Successfully saved derivative data. [2025-09-16T21:12:25.258436] [INFO ] [MAIN ] Derivative Progress: 100/2026 symbols completed. AOMR took 0.9s. Estimated remaining: 10m 44s. Rate: 179.4 symbols/min [2025-09-16T21:12:25.258886] [DEBUG] [MAIN ] AOD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:25.259107] [INFO ] [MAIN ] AORT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:25.260067] [INFO ] [MAIN ] AOD: Generated 1339 derivative records from 22340 primary records. [2025-09-16T21:12:25.260464] [DEBUG] [LOCAL ] AOD: Saving derivative data. [2025-09-16T21:12:25.284476] [DEBUG] [LOCAL ] AOD: Derivative data saved (1339 records). [2025-09-16T21:12:25.284777] [DEBUG] [MAIN ] AON: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:25.285166] [INFO ] [MAIN ] AOD: Successfully saved derivative data. [2025-09-16T21:12:25.288021] [INFO ] [MAIN ] AON: Generated 1339 derivative records from 33740 primary records. [2025-09-16T21:12:25.287202] [INFO ] [MAIN ] Derivative Progress: 101/2026 symbols completed. AOD took 0.9s. Estimated remaining: 10m 38s. Rate: 181.1 symbols/min [2025-09-16T21:12:25.288333] [INFO ] [MAIN ] AOS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:25.288500] [DEBUG] [LOCAL ] AON: Saving derivative data. [2025-09-16T21:12:25.314512] [DEBUG] [LOCAL ] AON: Derivative data saved (1339 records). [2025-09-16T21:12:25.315152] [DEBUG] [LOCAL ] AORT: Loaded 21726 existing records from primary storage. [2025-09-16T21:12:25.315343] [INFO ] [MAIN ] AON: Successfully saved derivative data. [2025-09-16T21:12:25.315452] [INFO ] [MAIN ] AORT: Loaded 21726 primary data records. [2025-09-16T21:12:25.317983] [INFO ] [MAIN ] Derivative Progress: 102/2026 symbols completed. AON took 1.0s. Estimated remaining: 10m 32s. Rate: 182.7 symbols/min [2025-09-16T21:12:25.347701] [INFO ] [MAIN ] AP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:25.470028] [DEBUG] [LOCAL ] AP: Loaded 5815 existing records from primary storage. [2025-09-16T21:12:25.470757] [INFO ] [MAIN ] AP: Loaded 5815 primary data records. [2025-09-16T21:12:25.613702] [DEBUG] [LOCAL ] AOS: Loaded 36605 existing records from primary storage. [2025-09-16T21:12:25.630826] [INFO ] [MAIN ] AOS: Loaded 36605 primary data records. [2025-09-16T21:12:26.268447] [DEBUG] [MAIN ] AORT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:26.269713] [INFO ] [MAIN ] AORT: Generated 1339 derivative records from 21726 primary records. [2025-09-16T21:12:26.269990] [DEBUG] [LOCAL ] AORT: Saving derivative data. [2025-09-16T21:12:26.284780] [DEBUG] [LOCAL ] AORT: Derivative data saved (1339 records). [2025-09-16T21:12:26.284998] [INFO ] [MAIN ] AORT: Successfully saved derivative data. [2025-09-16T21:12:26.286725] [INFO ] [MAIN ] Derivative Progress: 103/2026 symbols completed. AORT took 1.0s. Estimated remaining: 10m 44s. Rate: 179.3 symbols/min [2025-09-16T21:12:26.303976] [DEBUG] [MAIN ] AP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:26.305699] [INFO ] [MAIN ] AP: Generated 1339 derivative records from 5815 primary records. [2025-09-16T21:12:26.305958] [DEBUG] [LOCAL ] AP: Saving derivative data. [2025-09-16T21:12:26.324681] [DEBUG] [MAIN ] AOS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:26.330026] [INFO ] [MAIN ] AOS: Generated 1339 derivative records from 36605 primary records. [2025-09-16T21:12:26.330798] [DEBUG] [LOCAL ] AOS: Saving derivative data. [2025-09-16T21:12:26.334525] [DEBUG] [LOCAL ] AP: Derivative data saved (1339 records). [2025-09-16T21:12:26.334775] [INFO ] [MAIN ] AP: Successfully saved derivative data. [2025-09-16T21:12:26.337722] [INFO ] [MAIN ] Derivative Progress: 104/2026 symbols completed. AP took 1.0s. Estimated remaining: 10m 38s. Rate: 180.8 symbols/min [2025-09-16T21:12:26.349714] [DEBUG] [LOCAL ] AOS: Derivative data saved (1339 records). [2025-09-16T21:12:26.349835] [INFO ] [MAIN ] AOS: Successfully saved derivative data. [2025-09-16T21:12:26.352263] [INFO ] [MAIN ] Derivative Progress: 105/2026 symbols completed. AOS took 1.1s. Estimated remaining: 10m 32s. Rate: 182.4 symbols/min [2025-09-16T21:12:26.352963] [INFO ] [MAIN ] APH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:26.352893] [INFO ] [MAIN ] APD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:26.353217] [INFO ] [MAIN ] APG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:26.411102] [DEBUG] [LOCAL ] APD: Loaded 33341 existing records from primary storage. [2025-09-16T21:12:26.411402] [INFO ] [MAIN ] APD: Loaded 33341 primary data records. [2025-09-16T21:12:26.555045] [DEBUG] [LOCAL ] APG: Loaded 37860 existing records from primary storage. [2025-09-16T21:12:26.555721] [DEBUG] [LOCAL ] APH: Loaded 40041 existing records from primary storage. [2025-09-16T21:12:26.556243] [INFO ] [MAIN ] APH: Loaded 40041 primary data records. [2025-09-16T21:12:26.556160] [INFO ] [MAIN ] APG: Loaded 37860 primary data records. [2025-09-16T21:12:27.288051] [DEBUG] [MAIN ] APD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:27.290687] [INFO ] [MAIN ] APD: Generated 1339 derivative records from 33341 primary records. [2025-09-16T21:12:27.291136] [DEBUG] [LOCAL ] APD: Saving derivative data. [2025-09-16T21:12:27.308846] [DEBUG] [MAIN ] APH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:27.321750] [INFO ] [MAIN ] APH: Generated 1339 derivative records from 40041 primary records. [2025-09-16T21:12:27.322082] [DEBUG] [LOCAL ] APH: Saving derivative data. [2025-09-16T21:12:27.329935] [DEBUG] [MAIN ] APG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:27.337068] [DEBUG] [LOCAL ] APH: Derivative data saved (1339 records). [2025-09-16T21:12:27.337833] [INFO ] [MAIN ] APG: Generated 1339 derivative records from 37860 primary records. [2025-09-16T21:12:27.336859] [DEBUG] [LOCAL ] APD: Derivative data saved (1339 records). [2025-09-16T21:12:27.337916] [INFO ] [MAIN ] APH: Successfully saved derivative data. [2025-09-16T21:12:27.338027] [INFO ] [MAIN ] APD: Successfully saved derivative data. [2025-09-16T21:12:27.340354] [INFO ] [MAIN ] Derivative Progress: 106/2026 symbols completed. APH took 1.0s. Estimated remaining: 10m 43s. Rate: 179.0 symbols/min [2025-09-16T21:12:27.338146] [DEBUG] [LOCAL ] APG: Saving derivative data. [2025-09-16T21:12:27.341961] [INFO ] [MAIN ] APLE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:27.342061] [INFO ] [MAIN ] Derivative Progress: 107/2026 symbols completed. APD took 1.0s. Estimated remaining: 10m 37s. Rate: 180.7 symbols/min [2025-09-16T21:12:27.343047] [INFO ] [MAIN ] APO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:27.356931] [DEBUG] [LOCAL ] APG: Derivative data saved (1339 records). [2025-09-16T21:12:27.357068] [INFO ] [MAIN ] APG: Successfully saved derivative data. [2025-09-16T21:12:27.358961] [INFO ] [MAIN ] Derivative Progress: 108/2026 symbols completed. APG took 1.0s. Estimated remaining: 10m 31s. Rate: 182.3 symbols/min [2025-09-16T21:12:27.359304] [INFO ] [MAIN ] APOS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:27.365868] [DEBUG] [LOCAL ] APOS: Loaded 5235 existing records from primary storage. [2025-09-16T21:12:27.365982] [INFO ] [MAIN ] APOS: Loaded 5235 primary data records. [2025-09-16T21:12:27.667492] [DEBUG] [LOCAL ] APLE: Loaded 38699 existing records from primary storage. [2025-09-16T21:12:27.668743] [DEBUG] [LOCAL ] APO: Loaded 39757 existing records from primary storage. [2025-09-16T21:12:27.668956] [INFO ] [MAIN ] APO: Loaded 39757 primary data records. [2025-09-16T21:12:27.668993] [INFO ] [MAIN ] APLE: Loaded 38699 primary data records. [2025-09-16T21:12:28.215942] [DEBUG] [MAIN ] APOS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:28.216839] [INFO ] [MAIN ] APOS: Generated 1339 derivative records from 5235 primary records. [2025-09-16T21:12:28.217059] [DEBUG] [LOCAL ] APOS: Saving derivative data. [2025-09-16T21:12:28.229517] [DEBUG] [LOCAL ] APOS: Derivative data saved (1339 records). [2025-09-16T21:12:28.229914] [INFO ] [MAIN ] APOS: Successfully saved derivative data. [2025-09-16T21:12:28.232382] [INFO ] [MAIN ] Derivative Progress: 109/2026 symbols completed. APOS took 0.9s. Estimated remaining: 10m 40s. Rate: 179.6 symbols/min [2025-09-16T21:12:28.232689] [INFO ] [MAIN ] APTV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:28.254902] [DEBUG] [MAIN ] APO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:28.258789] [DEBUG] [MAIN ] APLE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:28.259350] [INFO ] [MAIN ] APO: Generated 1339 derivative records from 39757 primary records. [2025-09-16T21:12:28.259908] [INFO ] [MAIN ] APLE: Generated 1339 derivative records from 38699 primary records. [2025-09-16T21:12:28.260024] [DEBUG] [LOCAL ] APO: Saving derivative data. [2025-09-16T21:12:28.260603] [DEBUG] [LOCAL ] APLE: Saving derivative data. [2025-09-16T21:12:28.286142] [DEBUG] [LOCAL ] APLE: Derivative data saved (1339 records). [2025-09-16T21:12:28.288728] [INFO ] [MAIN ] APLE: Successfully saved derivative data. [2025-09-16T21:12:28.288565] [DEBUG] [LOCAL ] APO: Derivative data saved (1339 records). [2025-09-16T21:12:28.290369] [INFO ] [MAIN ] Derivative Progress: 110/2026 symbols completed. APLE took 0.9s. Estimated remaining: 10m 35s. Rate: 180.9 symbols/min [2025-09-16T21:12:28.290683] [INFO ] [MAIN ] AQN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:28.290521] [INFO ] [MAIN ] APO: Successfully saved derivative data. [2025-09-16T21:12:28.292634] [INFO ] [MAIN ] Derivative Progress: 111/2026 symbols completed. APO took 0.9s. Estimated remaining: 10m 29s. Rate: 182.6 symbols/min [2025-09-16T21:12:28.301900] [INFO ] [MAIN ] AQNB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:28.306920] [DEBUG] [LOCAL ] AQNB: Loaded 2917 existing records from primary storage. [2025-09-16T21:12:28.307052] [INFO ] [MAIN ] AQNB: Loaded 2917 primary data records. [2025-09-16T21:12:28.422965] [DEBUG] [LOCAL ] APTV: Loaded 38716 existing records from primary storage. [2025-09-16T21:12:28.458381] [INFO ] [MAIN ] APTV: Loaded 38716 primary data records. [2025-09-16T21:12:28.735534] [DEBUG] [LOCAL ] AQN: Loaded 38517 existing records from primary storage. [2025-09-16T21:12:28.741489] [INFO ] [MAIN ] AQN: Loaded 38517 primary data records. [2025-09-16T21:12:29.177428] [DEBUG] [MAIN ] AQNB: Filtered 5181 bins outside market hours, 5780 incomplete bins [2025-09-16T21:12:29.178819] [INFO ] [MAIN ] AQNB: Generated 1338 derivative records from 2917 primary records. [2025-09-16T21:12:29.179134] [DEBUG] [LOCAL ] AQNB: Saving derivative data. [2025-09-16T21:12:29.191660] [DEBUG] [LOCAL ] AQNB: Derivative data saved (1338 records). [2025-09-16T21:12:29.192542] [INFO ] [MAIN ] AQNB: Successfully saved derivative data. [2025-09-16T21:12:29.194213] [INFO ] [MAIN ] Derivative Progress: 112/2026 symbols completed. AQNB took 0.9s. Estimated remaining: 10m 39s. Rate: 179.8 symbols/min [2025-09-16T21:12:29.195028] [INFO ] [MAIN ] AR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:29.205934] [DEBUG] [MAIN ] APTV: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:29.206546] [INFO ] [MAIN ] APTV: Generated 1339 derivative records from 38716 primary records. [2025-09-16T21:12:29.206774] [DEBUG] [LOCAL ] APTV: Saving derivative data. [2025-09-16T21:12:29.221324] [DEBUG] [LOCAL ] APTV: Derivative data saved (1339 records). [2025-09-16T21:12:29.227101] [INFO ] [MAIN ] APTV: Successfully saved derivative data. [2025-09-16T21:12:29.233678] [INFO ] [MAIN ] Derivative Progress: 113/2026 symbols completed. APTV took 1.0s. Estimated remaining: 10m 33s. Rate: 181.2 symbols/min [2025-09-16T21:12:29.230855] [DEBUG] [MAIN ] AQN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:29.234795] [INFO ] [MAIN ] ARCO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:29.234612] [INFO ] [MAIN ] AQN: Generated 1339 derivative records from 38517 primary records. [2025-09-16T21:12:29.234918] [DEBUG] [LOCAL ] AQN: Saving derivative data. [2025-09-16T21:12:29.256797] [DEBUG] [LOCAL ] AQN: Derivative data saved (1339 records). [2025-09-16T21:12:29.256935] [INFO ] [MAIN ] AQN: Successfully saved derivative data. [2025-09-16T21:12:29.258855] [INFO ] [MAIN ] Derivative Progress: 114/2026 symbols completed. AQN took 1.0s. Estimated remaining: 10m 28s. Rate: 182.7 symbols/min [2025-09-16T21:12:29.259071] [INFO ] [MAIN ] ARDC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:29.276542] [DEBUG] [LOCAL ] AR: Loaded 39952 existing records from primary storage. [2025-09-16T21:12:29.279552] [INFO ] [MAIN ] AR: Loaded 39952 primary data records. [2025-09-16T21:12:29.361636] [DEBUG] [LOCAL ] ARDC: Loaded 10395 existing records from primary storage. [2025-09-16T21:12:29.373373] [INFO ] [MAIN ] ARDC: Loaded 10395 primary data records. [2025-09-16T21:12:29.487486] [DEBUG] [LOCAL ] ARCO: Loaded 33170 existing records from primary storage. [2025-09-16T21:12:29.547938] [INFO ] [MAIN ] ARCO: Loaded 33170 primary data records. [2025-09-16T21:12:30.155485] [DEBUG] [MAIN ] ARDC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:30.156856] [INFO ] [MAIN ] ARDC: Generated 1339 derivative records from 10395 primary records. [2025-09-16T21:12:30.156089] [DEBUG] [MAIN ] AR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:30.157112] [DEBUG] [LOCAL ] ARDC: Saving derivative data. [2025-09-16T21:12:30.157634] [INFO ] [MAIN ] AR: Generated 1339 derivative records from 39952 primary records. [2025-09-16T21:12:30.158969] [DEBUG] [LOCAL ] AR: Saving derivative data. [2025-09-16T21:12:30.182781] [DEBUG] [LOCAL ] ARDC: Derivative data saved (1339 records). [2025-09-16T21:12:30.182559] [DEBUG] [LOCAL ] AR: Derivative data saved (1339 records). [2025-09-16T21:12:30.183144] [INFO ] [MAIN ] AR: Successfully saved derivative data. [2025-09-16T21:12:30.183091] [INFO ] [MAIN ] ARDC: Successfully saved derivative data. [2025-09-16T21:12:30.186119] [INFO ] [MAIN ] Derivative Progress: 115/2026 symbols completed. ARDC took 0.9s. Estimated remaining: 10m 38s. Rate: 179.8 symbols/min [2025-09-16T21:12:30.188801] [INFO ] [MAIN ] ARDT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:30.189585] [INFO ] [MAIN ] Derivative Progress: 116/2026 symbols completed. AR took 1.0s. Estimated remaining: 10m 32s. Rate: 181.4 symbols/min [2025-09-16T21:12:30.190347] [INFO ] [MAIN ] ARE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:30.201201] [DEBUG] [MAIN ] ARCO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:30.202065] [INFO ] [MAIN ] ARCO: Generated 1339 derivative records from 33170 primary records. [2025-09-16T21:12:30.202210] [DEBUG] [LOCAL ] ARCO: Saving derivative data. [2025-09-16T21:12:30.216350] [DEBUG] [LOCAL ] ARCO: Derivative data saved (1339 records). [2025-09-16T21:12:30.221040] [INFO ] [MAIN ] ARCO: Successfully saved derivative data. [2025-09-16T21:12:30.223475] [INFO ] [MAIN ] Derivative Progress: 117/2026 symbols completed. ARCO took 1.0s. Estimated remaining: 10m 27s. Rate: 182.8 symbols/min [2025-09-16T21:12:30.223951] [INFO ] [MAIN ] ARES: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:30.242950] [DEBUG] [LOCAL ] ARDT: Loaded 20016 existing records from primary storage. [2025-09-16T21:12:30.243260] [INFO ] [MAIN ] ARDT: Loaded 20016 primary data records. [2025-09-16T21:12:30.373760] [DEBUG] [LOCAL ] ARE: Loaded 37881 existing records from primary storage. [2025-09-16T21:12:30.374438] [INFO ] [MAIN ] ARE: Loaded 37881 primary data records. [2025-09-16T21:12:30.657226] [DEBUG] [LOCAL ] ARES: Loaded 36531 existing records from primary storage. [2025-09-16T21:12:30.674190] [INFO ] [MAIN ] ARES: Loaded 36531 primary data records. [2025-09-16T21:12:31.159966] [DEBUG] [MAIN ] ARDT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:31.161512] [INFO ] [MAIN ] ARDT: Generated 1339 derivative records from 20016 primary records. [2025-09-16T21:12:31.161623] [DEBUG] [LOCAL ] ARDT: Saving derivative data. [2025-09-16T21:12:31.176296] [DEBUG] [LOCAL ] ARDT: Derivative data saved (1339 records). [2025-09-16T21:12:31.177058] [INFO ] [MAIN ] ARDT: Successfully saved derivative data. [2025-09-16T21:12:31.178957] [INFO ] [MAIN ] Derivative Progress: 118/2026 symbols completed. ARDT took 1.0s. Estimated remaining: 10m 36s. Rate: 179.9 symbols/min [2025-09-16T21:12:31.193029] [DEBUG] [MAIN ] ARE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:31.194042] [INFO ] [MAIN ] ARE: Generated 1339 derivative records from 37881 primary records. [2025-09-16T21:12:31.194230] [DEBUG] [LOCAL ] ARE: Saving derivative data. [2025-09-16T21:12:31.207549] [DEBUG] [LOCAL ] ARE: Derivative data saved (1339 records). [2025-09-16T21:12:31.207780] [INFO ] [MAIN ] ARE: Successfully saved derivative data. [2025-09-16T21:12:31.209798] [INFO ] [MAIN ] Derivative Progress: 119/2026 symbols completed. ARE took 1.0s. Estimated remaining: 10m 31s. Rate: 181.2 symbols/min [2025-09-16T21:12:31.222152] [DEBUG] [MAIN ] ARES: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:31.222884] [INFO ] [MAIN ] ARES: Generated 1339 derivative records from 36531 primary records. [2025-09-16T21:12:31.222965] [DEBUG] [LOCAL ] ARES: Saving derivative data. [2025-09-16T21:12:31.236026] [DEBUG] [LOCAL ] ARES: Derivative data saved (1339 records). [2025-09-16T21:12:31.236117] [INFO ] [MAIN ] ARES: Successfully saved derivative data. [2025-09-16T21:12:31.238754] [INFO ] [MAIN ] Derivative Progress: 120/2026 symbols completed. ARES took 1.0s. Estimated remaining: 10m 26s. Rate: 182.6 symbols/min [2025-09-16T21:12:31.239436] [INFO ] [MAIN ] ARMK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:31.239625] [INFO ] [MAIN ] ARLO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:31.239300] [INFO ] [MAIN ] ARI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:31.286174] [DEBUG] [LOCAL ] ARI: Loaded 32069 existing records from primary storage. [2025-09-16T21:12:31.286413] [INFO ] [MAIN ] ARI: Loaded 32069 primary data records. [2025-09-16T21:12:31.361221] [DEBUG] [LOCAL ] ARLO: Loaded 32647 existing records from primary storage. [2025-09-16T21:12:31.387752] [INFO ] [MAIN ] ARLO: Loaded 32647 primary data records. [2025-09-16T21:12:31.443200] [DEBUG] [LOCAL ] ARMK: Loaded 37405 existing records from primary storage. [2025-09-16T21:12:31.455754] [INFO ] [MAIN ] ARMK: Loaded 37405 primary data records. [2025-09-16T21:12:32.133126] [DEBUG] [MAIN ] ARI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:32.134891] [INFO ] [MAIN ] ARI: Generated 1339 derivative records from 32069 primary records. [2025-09-16T21:12:32.135386] [DEBUG] [LOCAL ] ARI: Saving derivative data. [2025-09-16T21:12:32.150382] [DEBUG] [LOCAL ] ARI: Derivative data saved (1339 records). [2025-09-16T21:12:32.150554] [INFO ] [MAIN ] ARI: Successfully saved derivative data. [2025-09-16T21:12:32.152068] [INFO ] [MAIN ] Derivative Progress: 121/2026 symbols completed. ARI took 0.9s. Estimated remaining: 10m 35s. Rate: 180.0 symbols/min [2025-09-16T21:12:32.152932] [INFO ] [MAIN ] AROC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:32.163115] [DEBUG] [MAIN ] ARLO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:32.163864] [INFO ] [MAIN ] ARLO: Generated 1339 derivative records from 32647 primary records. [2025-09-16T21:12:32.163965] [DEBUG] [LOCAL ] ARLO: Saving derivative data. [2025-09-16T21:12:32.178080] [DEBUG] [LOCAL ] ARLO: Derivative data saved (1339 records). [2025-09-16T21:12:32.187526] [INFO ] [MAIN ] ARLO: Successfully saved derivative data. [2025-09-16T21:12:32.187762] [DEBUG] [MAIN ] ARMK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:32.189861] [INFO ] [MAIN ] Derivative Progress: 122/2026 symbols completed. ARLO took 1.0s. Estimated remaining: 10m 30s. Rate: 181.3 symbols/min [2025-09-16T21:12:32.190080] [INFO ] [MAIN ] ARR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:32.190789] [INFO ] [MAIN ] ARMK: Generated 1339 derivative records from 37405 primary records. [2025-09-16T21:12:32.190969] [DEBUG] [LOCAL ] ARMK: Saving derivative data. [2025-09-16T21:12:32.204661] [DEBUG] [LOCAL ] ARMK: Derivative data saved (1339 records). [2025-09-16T21:12:32.204832] [INFO ] [MAIN ] ARMK: Successfully saved derivative data. [2025-09-16T21:12:32.206935] [INFO ] [MAIN ] Derivative Progress: 123/2026 symbols completed. ARMK took 1.0s. Estimated remaining: 10m 25s. Rate: 182.7 symbols/min [2025-09-16T21:12:32.207311] [INFO ] [MAIN ] ARW: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:32.230784] [DEBUG] [LOCAL ] AROC: Loaded 36147 existing records from primary storage. [2025-09-16T21:12:32.230923] [INFO ] [MAIN ] AROC: Loaded 36147 primary data records. [2025-09-16T21:12:32.429361] [DEBUG] [LOCAL ] ARR: Loaded 38691 existing records from primary storage. [2025-09-16T21:12:32.434205] [INFO ] [MAIN ] ARR: Loaded 38691 primary data records. [2025-09-16T21:12:32.584368] [DEBUG] [LOCAL ] ARW: Loaded 23944 existing records from primary storage. [2025-09-16T21:12:32.605018] [INFO ] [MAIN ] ARW: Loaded 23944 primary data records. [2025-09-16T21:12:33.119455] [DEBUG] [MAIN ] AROC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:33.120344] [INFO ] [MAIN ] AROC: Generated 1339 derivative records from 36147 primary records. [2025-09-16T21:12:33.120708] [DEBUG] [LOCAL ] AROC: Saving derivative data. [2025-09-16T21:12:33.135039] [DEBUG] [LOCAL ] AROC: Derivative data saved (1339 records). [2025-09-16T21:12:33.135548] [INFO ] [MAIN ] AROC: Successfully saved derivative data. [2025-09-16T21:12:33.137339] [INFO ] [MAIN ] Derivative Progress: 124/2026 symbols completed. AROC took 1.0s. Estimated remaining: 10m 34s. Rate: 180.1 symbols/min [2025-09-16T21:12:33.137714] [INFO ] [MAIN ] ASA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:33.161806] [DEBUG] [MAIN ] ARR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:33.164634] [DEBUG] [MAIN ] ARW: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:33.165957] [INFO ] [MAIN ] ARW: Generated 1339 derivative records from 23944 primary records. [2025-09-16T21:12:33.165385] [INFO ] [MAIN ] ARR: Generated 1339 derivative records from 38691 primary records. [2025-09-16T21:12:33.166111] [DEBUG] [LOCAL ] ARW: Saving derivative data. [2025-09-16T21:12:33.166190] [DEBUG] [LOCAL ] ARR: Saving derivative data. [2025-09-16T21:12:33.191673] [DEBUG] [LOCAL ] ASA: Loaded 10444 existing records from primary storage. [2025-09-16T21:12:33.192715] [INFO ] [MAIN ] ASA: Loaded 10444 primary data records. [2025-09-16T21:12:33.191998] [DEBUG] [LOCAL ] ARW: Derivative data saved (1339 records). [2025-09-16T21:12:33.193862] [INFO ] [MAIN ] ARW: Successfully saved derivative data. [2025-09-16T21:12:33.196119] [INFO ] [MAIN ] Derivative Progress: 125/2026 symbols completed. ARW took 1.0s. Estimated remaining: 10m 29s. Rate: 181.2 symbols/min [2025-09-16T21:12:33.207768] [INFO ] [MAIN ] ASB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:33.228481] [DEBUG] [LOCAL ] ARR: Derivative data saved (1339 records). [2025-09-16T21:12:33.240555] [INFO ] [MAIN ] ARR: Successfully saved derivative data. [2025-09-16T21:12:33.255705] [INFO ] [MAIN ] Derivative Progress: 126/2026 symbols completed. ARR took 1.1s. Estimated remaining: 10m 25s. Rate: 182.4 symbols/min [2025-09-16T21:12:33.276885] [INFO ] [MAIN ] ASBA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:33.392501] [DEBUG] [LOCAL ] ASBA: Loaded 2522 existing records from primary storage. [2025-09-16T21:12:33.476771] [INFO ] [MAIN ] ASBA: Loaded 2522 primary data records. [2025-09-16T21:12:33.603507] [DEBUG] [LOCAL ] ASB: Loaded 36535 existing records from primary storage. [2025-09-16T21:12:33.664042] [INFO ] [MAIN ] ASB: Loaded 36535 primary data records. [2025-09-16T21:12:34.032889] [DEBUG] [MAIN ] ASA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:34.034488] [INFO ] [MAIN ] ASA: Generated 1339 derivative records from 10444 primary records. [2025-09-16T21:12:34.035055] [DEBUG] [LOCAL ] ASA: Saving derivative data. [2025-09-16T21:12:34.047789] [DEBUG] [LOCAL ] ASA: Derivative data saved (1339 records). [2025-09-16T21:12:34.048024] [INFO ] [MAIN ] ASA: Successfully saved derivative data. [2025-09-16T21:12:34.051682] [INFO ] [MAIN ] Derivative Progress: 127/2026 symbols completed. ASA took 0.9s. Estimated remaining: 10m 32s. Rate: 180.4 symbols/min [2025-09-16T21:12:34.052839] [INFO ] [MAIN ] ASC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:34.062923] [DEBUG] [MAIN ] ASBA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:34.063754] [INFO ] [MAIN ] ASBA: Generated 1339 derivative records from 2522 primary records. [2025-09-16T21:12:34.064007] [DEBUG] [LOCAL ] ASBA: Saving derivative data. [2025-09-16T21:12:34.077267] [DEBUG] [LOCAL ] ASBA: Derivative data saved (1339 records). [2025-09-16T21:12:34.077382] [INFO ] [MAIN ] ASBA: Successfully saved derivative data. [2025-09-16T21:12:34.079318] [INFO ] [MAIN ] Derivative Progress: 128/2026 symbols completed. ASBA took 0.8s. Estimated remaining: 10m 27s. Rate: 181.7 symbols/min [2025-09-16T21:12:34.079548] [INFO ] [MAIN ] ASG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:34.089503] [DEBUG] [MAIN ] ASB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:34.090114] [INFO ] [MAIN ] ASB: Generated 1339 derivative records from 36535 primary records. [2025-09-16T21:12:34.097224] [DEBUG] [LOCAL ] ASB: Saving derivative data. [2025-09-16T21:12:34.109800] [DEBUG] [LOCAL ] ASB: Derivative data saved (1339 records). [2025-09-16T21:12:34.109934] [INFO ] [MAIN ] ASB: Successfully saved derivative data. [2025-09-16T21:12:34.119298] [INFO ] [MAIN ] Derivative Progress: 129/2026 symbols completed. ASB took 0.9s. Estimated remaining: 10m 22s. Rate: 183.0 symbols/min [2025-09-16T21:12:34.123542] [INFO ] [MAIN ] ASGI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:34.124296] [DEBUG] [LOCAL ] ASC: Loaded 27759 existing records from primary storage. [2025-09-16T21:12:34.124483] [INFO ] [MAIN ] ASC: Loaded 27759 primary data records. [2025-09-16T21:12:34.215722] [DEBUG] [LOCAL ] ASG: Loaded 14378 existing records from primary storage. [2025-09-16T21:12:34.235513] [INFO ] [MAIN ] ASG: Loaded 14378 primary data records. [2025-09-16T21:12:34.386366] [DEBUG] [LOCAL ] ASGI: Loaded 16802 existing records from primary storage. [2025-09-16T21:12:34.418993] [INFO ] [MAIN ] ASGI: Loaded 16802 primary data records. [2025-09-16T21:12:34.947142] [DEBUG] [MAIN ] ASC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:34.948272] [INFO ] [MAIN ] ASC: Generated 1339 derivative records from 27759 primary records. [2025-09-16T21:12:34.950827] [DEBUG] [LOCAL ] ASC: Saving derivative data. [2025-09-16T21:12:34.973662] [DEBUG] [MAIN ] ASG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:34.979409] [INFO ] [MAIN ] ASG: Generated 1339 derivative records from 14378 primary records. [2025-09-16T21:12:34.978354] [DEBUG] [LOCAL ] ASC: Derivative data saved (1339 records). [2025-09-16T21:12:34.979581] [DEBUG] [LOCAL ] ASG: Saving derivative data. [2025-09-16T21:12:34.980229] [INFO ] [MAIN ] ASC: Successfully saved derivative data. [2025-09-16T21:12:34.981699] [INFO ] [MAIN ] Derivative Progress: 130/2026 symbols completed. ASC took 0.9s. Estimated remaining: 10m 30s. Rate: 180.7 symbols/min [2025-09-16T21:12:34.982368] [INFO ] [MAIN ] ASIX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:35.005582] [DEBUG] [LOCAL ] ASG: Derivative data saved (1339 records). [2025-09-16T21:12:35.006078] [DEBUG] [MAIN ] ASGI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:35.006232] [INFO ] [MAIN ] ASG: Successfully saved derivative data. [2025-09-16T21:12:35.009206] [INFO ] [MAIN ] Derivative Progress: 131/2026 symbols completed. ASG took 0.9s. Estimated remaining: 10m 25s. Rate: 182.0 symbols/min [2025-09-16T21:12:35.006967] [INFO ] [MAIN ] ASGI: Generated 1339 derivative records from 16802 primary records. [2025-09-16T21:12:35.009534] [DEBUG] [LOCAL ] ASGI: Saving derivative data. [2025-09-16T21:12:35.009688] [INFO ] [MAIN ] ASPN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:35.026897] [DEBUG] [LOCAL ] ASGI: Derivative data saved (1339 records). [2025-09-16T21:12:35.026985] [INFO ] [MAIN ] ASGI: Successfully saved derivative data. [2025-09-16T21:12:35.028982] [INFO ] [MAIN ] Derivative Progress: 132/2026 symbols completed. ASGI took 0.9s. Estimated remaining: 10m 20s. Rate: 183.3 symbols/min [2025-09-16T21:12:35.029259] [INFO ] [MAIN ] ASR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:35.036546] [DEBUG] [LOCAL ] ASIX: Loaded 17000 existing records from primary storage. [2025-09-16T21:12:35.036690] [INFO ] [MAIN ] ASIX: Loaded 17000 primary data records. [2025-09-16T21:12:35.124109] [DEBUG] [LOCAL ] ASR: Loaded 7108 existing records from primary storage. [2025-09-16T21:12:35.140417] [INFO ] [MAIN ] ASR: Loaded 7108 primary data records. [2025-09-16T21:12:35.318556] [DEBUG] [LOCAL ] ASPN: Loaded 36948 existing records from primary storage. [2025-09-16T21:12:35.356622] [INFO ] [MAIN ] ASPN: Loaded 36948 primary data records. [2025-09-16T21:12:35.906548] [DEBUG] [MAIN ] ASR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:35.907504] [INFO ] [MAIN ] ASR: Generated 1339 derivative records from 7108 primary records. [2025-09-16T21:12:35.917852] [DEBUG] [MAIN ] ASIX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:35.917935] [DEBUG] [LOCAL ] ASR: Saving derivative data. [2025-09-16T21:12:35.920080] [INFO ] [MAIN ] ASIX: Generated 1339 derivative records from 17000 primary records. [2025-09-16T21:12:35.920302] [DEBUG] [LOCAL ] ASIX: Saving derivative data. [2025-09-16T21:12:35.942917] [DEBUG] [LOCAL ] ASR: Derivative data saved (1339 records). [2025-09-16T21:12:35.943397] [INFO ] [MAIN ] ASR: Successfully saved derivative data. [2025-09-16T21:12:35.945585] [INFO ] [MAIN ] Derivative Progress: 133/2026 symbols completed. ASR took 0.9s. Estimated remaining: 10m 28s. Rate: 180.8 symbols/min [2025-09-16T21:12:35.949711] [DEBUG] [LOCAL ] ASIX: Derivative data saved (1339 records). [2025-09-16T21:12:35.950929] [INFO ] [MAIN ] ASIX: Successfully saved derivative data. [2025-09-16T21:12:35.952507] [INFO ] [MAIN ] Derivative Progress: 134/2026 symbols completed. ASIX took 1.0s. Estimated remaining: 10m 23s. Rate: 182.2 symbols/min [2025-09-16T21:12:35.962140] [DEBUG] [MAIN ] ASPN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:35.962723] [INFO ] [MAIN ] ASPN: Generated 1339 derivative records from 36948 primary records. [2025-09-16T21:12:35.962784] [DEBUG] [LOCAL ] ASPN: Saving derivative data. [2025-09-16T21:12:35.974047] [DEBUG] [LOCAL ] ASPN: Derivative data saved (1339 records). [2025-09-16T21:12:35.974104] [INFO ] [MAIN ] ASPN: Successfully saved derivative data. [2025-09-16T21:12:35.975989] [INFO ] [MAIN ] Derivative Progress: 135/2026 symbols completed. ASPN took 1.0s. Estimated remaining: 10m 19s. Rate: 183.4 symbols/min [2025-09-16T21:12:35.976556] [INFO ] [MAIN ] ATHS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:35.976482] [INFO ] [MAIN ] ATEN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:35.976386] [INFO ] [MAIN ] ASX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:35.984479] [DEBUG] [LOCAL ] ATHS: Loaded 4952 existing records from primary storage. [2025-09-16T21:12:35.984689] [INFO ] [MAIN ] ATHS: Loaded 4952 primary data records. [2025-09-16T21:12:36.205204] [DEBUG] [LOCAL ] ATEN: Loaded 28678 existing records from primary storage. [2025-09-16T21:12:36.288871] [DEBUG] [LOCAL ] ASX: Loaded 39389 existing records from primary storage. [2025-09-16T21:12:36.289339] [INFO ] [MAIN ] ATEN: Loaded 28678 primary data records. [2025-09-16T21:12:36.289407] [INFO ] [MAIN ] ASX: Loaded 39389 primary data records. [2025-09-16T21:12:36.852516] [DEBUG] [MAIN ] ATHS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:36.853825] [INFO ] [MAIN ] ATHS: Generated 1339 derivative records from 4952 primary records. [2025-09-16T21:12:36.854922] [DEBUG] [LOCAL ] ATHS: Saving derivative data. [2025-09-16T21:12:36.870308] [DEBUG] [LOCAL ] ATHS: Derivative data saved (1339 records). [2025-09-16T21:12:36.870614] [INFO ] [MAIN ] ATHS: Successfully saved derivative data. [2025-09-16T21:12:36.872426] [INFO ] [MAIN ] Derivative Progress: 136/2026 symbols completed. ATHS took 0.9s. Estimated remaining: 10m 26s. Rate: 181.1 symbols/min [2025-09-16T21:12:36.872790] [INFO ] [MAIN ] ATI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:36.885890] [DEBUG] [MAIN ] ATEN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:36.886684] [INFO ] [MAIN ] ATEN: Generated 1339 derivative records from 28678 primary records. [2025-09-16T21:12:36.887431] [DEBUG] [LOCAL ] ATEN: Saving derivative data. [2025-09-16T21:12:36.910154] [DEBUG] [MAIN ] ASX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:36.911529] [INFO ] [MAIN ] ASX: Generated 1339 derivative records from 39389 primary records. [2025-09-16T21:12:36.910948] [DEBUG] [LOCAL ] ATEN: Derivative data saved (1339 records). [2025-09-16T21:12:36.911680] [DEBUG] [LOCAL ] ASX: Saving derivative data. [2025-09-16T21:12:36.911720] [INFO ] [MAIN ] ATEN: Successfully saved derivative data. [2025-09-16T21:12:36.914159] [INFO ] [MAIN ] Derivative Progress: 137/2026 symbols completed. ATEN took 0.9s. Estimated remaining: 10m 22s. Rate: 182.3 symbols/min [2025-09-16T21:12:36.923590] [INFO ] [MAIN ] ATMU: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:36.936140] [DEBUG] [LOCAL ] ASX: Derivative data saved (1339 records). [2025-09-16T21:12:36.936758] [INFO ] [MAIN ] ASX: Successfully saved derivative data. [2025-09-16T21:12:36.938763] [INFO ] [MAIN ] Derivative Progress: 138/2026 symbols completed. ASX took 1.0s. Estimated remaining: 10m 17s. Rate: 183.5 symbols/min [2025-09-16T21:12:36.939047] [INFO ] [MAIN ] ATR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:36.951361] [DEBUG] [LOCAL ] ATI: Loaded 38648 existing records from primary storage. [2025-09-16T21:12:36.951671] [INFO ] [MAIN ] ATI: Loaded 38648 primary data records. [2025-09-16T21:12:37.158545] [DEBUG] [LOCAL ] ATMU: Loaded 28708 existing records from primary storage. [2025-09-16T21:12:37.241133] [DEBUG] [LOCAL ] ATR: Loaded 23182 existing records from primary storage. [2025-09-16T21:12:37.241481] [INFO ] [MAIN ] ATR: Loaded 23182 primary data records. [2025-09-16T21:12:37.241396] [INFO ] [MAIN ] ATMU: Loaded 28708 primary data records. [2025-09-16T21:12:37.836777] [DEBUG] [MAIN ] ATI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:37.837941] [INFO ] [MAIN ] ATI: Generated 1339 derivative records from 38648 primary records. [2025-09-16T21:12:37.838927] [DEBUG] [LOCAL ] ATI: Saving derivative data. [2025-09-16T21:12:37.853593] [DEBUG] [LOCAL ] ATI: Derivative data saved (1339 records). [2025-09-16T21:12:37.853727] [INFO ] [MAIN ] ATI: Successfully saved derivative data. [2025-09-16T21:12:37.855656] [INFO ] [MAIN ] Derivative Progress: 139/2026 symbols completed. ATI took 1.0s. Estimated remaining: 10m 25s. Rate: 181.1 symbols/min [2025-09-16T21:12:37.856764] [INFO ] [MAIN ] ATS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:37.886715] [DEBUG] [MAIN ] ATMU: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:37.886495] [DEBUG] [MAIN ] ATR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:37.888235] [INFO ] [MAIN ] ATMU: Generated 1339 derivative records from 28708 primary records. [2025-09-16T21:12:37.887578] [INFO ] [MAIN ] ATR: Generated 1339 derivative records from 23182 primary records. [2025-09-16T21:12:37.888418] [DEBUG] [LOCAL ] ATMU: Saving derivative data. [2025-09-16T21:12:37.888470] [DEBUG] [LOCAL ] ATR: Saving derivative data. [2025-09-16T21:12:37.894129] [DEBUG] [LOCAL ] ATS: Loaded 13086 existing records from primary storage. [2025-09-16T21:12:37.895482] [INFO ] [MAIN ] ATS: Loaded 13086 primary data records. [2025-09-16T21:12:37.986774] [DEBUG] [LOCAL ] ATMU: Derivative data saved (1339 records). [2025-09-16T21:12:37.987726] [DEBUG] [LOCAL ] ATR: Derivative data saved (1339 records). [2025-09-16T21:12:37.999517] [INFO ] [MAIN ] ATR: Successfully saved derivative data. [2025-09-16T21:12:37.994269] [INFO ] [MAIN ] ATMU: Successfully saved derivative data. [2025-09-16T21:12:38.001516] [INFO ] [MAIN ] Derivative Progress: 140/2026 symbols completed. ATR took 1.1s. Estimated remaining: 10m 22s. Rate: 181.9 symbols/min [2025-09-16T21:12:38.016688] [INFO ] [MAIN ] AU: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:38.016801] [INFO ] [MAIN ] Derivative Progress: 141/2026 symbols completed. ATMU took 1.1s. Estimated remaining: 10m 18s. Rate: 183.1 symbols/min [2025-09-16T21:12:38.028970] [INFO ] [MAIN ] AUB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:38.229907] [DEBUG] [MAIN ] ATS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:38.230528] [INFO ] [MAIN ] ATS: Generated 1339 derivative records from 13086 primary records. [2025-09-16T21:12:38.230600] [DEBUG] [LOCAL ] ATS: Saving derivative data. [2025-09-16T21:12:38.243169] [DEBUG] [LOCAL ] ATS: Derivative data saved (1339 records). [2025-09-16T21:12:38.243686] [INFO ] [MAIN ] ATS: Successfully saved derivative data. [2025-09-16T21:12:38.245329] [INFO ] [MAIN ] Derivative Progress: 142/2026 symbols completed. ATS took 0.4s. Estimated remaining: 10m 16s. Rate: 183.5 symbols/min [2025-09-16T21:12:38.255925] [INFO ] [MAIN ] AUNA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:38.267683] [DEBUG] [LOCAL ] AU: Loaded 39477 existing records from primary storage. [2025-09-16T21:12:38.268543] [DEBUG] [LOCAL ] AUB: Loaded 33888 existing records from primary storage. [2025-09-16T21:12:38.267987] [INFO ] [MAIN ] AU: Loaded 39477 primary data records. [2025-09-16T21:12:38.269709] [INFO ] [MAIN ] AUB: Loaded 33888 primary data records. [2025-09-16T21:12:38.329880] [DEBUG] [LOCAL ] AUNA: Loaded 3645 existing records from primary storage. [2025-09-16T21:12:38.352162] [INFO ] [MAIN ] AUNA: Loaded 3645 primary data records. [2025-09-16T21:12:39.097212] [DEBUG] [MAIN ] AUB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:39.107089] [INFO ] [MAIN ] AUB: Generated 1339 derivative records from 33888 primary records. [2025-09-16T21:12:39.107612] [DEBUG] [LOCAL ] AUB: Saving derivative data. [2025-09-16T21:12:39.107502] [DEBUG] [MAIN ] AUNA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:39.117945] [INFO ] [MAIN ] AUNA: Generated 1339 derivative records from 3645 primary records. [2025-09-16T21:12:39.118137] [DEBUG] [MAIN ] AU: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:39.126405] [DEBUG] [LOCAL ] AUNA: Saving derivative data. [2025-09-16T21:12:39.127303] [INFO ] [MAIN ] AU: Generated 1339 derivative records from 39477 primary records. [2025-09-16T21:12:39.128398] [DEBUG] [LOCAL ] AU: Saving derivative data. [2025-09-16T21:12:39.148269] [DEBUG] [LOCAL ] AUB: Derivative data saved (1339 records). [2025-09-16T21:12:39.149177] [INFO ] [MAIN ] AUB: Successfully saved derivative data. [2025-09-16T21:12:39.151352] [INFO ] [MAIN ] Derivative Progress: 143/2026 symbols completed. AUB took 1.1s. Estimated remaining: 10m 23s. Rate: 181.3 symbols/min [2025-09-16T21:12:39.151730] [INFO ] [MAIN ] AVB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:39.153587] [DEBUG] [LOCAL ] AUNA: Derivative data saved (1339 records). [2025-09-16T21:12:39.153689] [INFO ] [MAIN ] AUNA: Successfully saved derivative data. [2025-09-16T21:12:39.155699] [INFO ] [MAIN ] Derivative Progress: 144/2026 symbols completed. AUNA took 0.9s. Estimated remaining: 10m 19s. Rate: 182.5 symbols/min [2025-09-16T21:12:39.153755] [DEBUG] [LOCAL ] AU: Derivative data saved (1339 records). [2025-09-16T21:12:39.156197] [INFO ] [MAIN ] AVK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:39.156269] [INFO ] [MAIN ] AU: Successfully saved derivative data. [2025-09-16T21:12:39.158050] [INFO ] [MAIN ] Derivative Progress: 145/2026 symbols completed. AU took 1.1s. Estimated remaining: 10m 14s. Rate: 183.8 symbols/min [2025-09-16T21:12:39.158366] [INFO ] [MAIN ] AVNS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:39.178932] [DEBUG] [LOCAL ] AVK: Loaded 13450 existing records from primary storage. [2025-09-16T21:12:39.185713] [INFO ] [MAIN ] AVK: Loaded 13450 primary data records. [2025-09-16T21:12:39.306348] [DEBUG] [LOCAL ] AVB: Loaded 31165 existing records from primary storage. [2025-09-16T21:12:39.306270] [DEBUG] [LOCAL ] AVNS: Loaded 25002 existing records from primary storage. [2025-09-16T21:12:39.322165] [INFO ] [MAIN ] AVNS: Loaded 25002 primary data records. [2025-09-16T21:12:39.317030] [INFO ] [MAIN ] AVB: Loaded 31165 primary data records. [2025-09-16T21:12:40.045911] [DEBUG] [MAIN ] AVK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:40.046940] [INFO ] [MAIN ] AVK: Generated 1339 derivative records from 13450 primary records. [2025-09-16T21:12:40.047317] [DEBUG] [LOCAL ] AVK: Saving derivative data. [2025-09-16T21:12:40.070690] [DEBUG] [LOCAL ] AVK: Derivative data saved (1339 records). [2025-09-16T21:12:40.071858] [INFO ] [MAIN ] AVK: Successfully saved derivative data. [2025-09-16T21:12:40.071790] [DEBUG] [MAIN ] AVNS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:40.073924] [INFO ] [MAIN ] Derivative Progress: 146/2026 symbols completed. AVK took 0.9s. Estimated remaining: 10m 21s. Rate: 181.5 symbols/min [2025-09-16T21:12:40.074602] [INFO ] [MAIN ] AVNS: Generated 1339 derivative records from 25002 primary records. [2025-09-16T21:12:40.075319] [INFO ] [MAIN ] AVNT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:40.075572] [DEBUG] [LOCAL ] AVNS: Saving derivative data. [2025-09-16T21:12:40.092468] [DEBUG] [MAIN ] AVB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:40.096808] [INFO ] [MAIN ] AVB: Generated 1339 derivative records from 31165 primary records. [2025-09-16T21:12:40.097301] [DEBUG] [LOCAL ] AVB: Saving derivative data. [2025-09-16T21:12:40.108318] [DEBUG] [LOCAL ] AVNS: Derivative data saved (1339 records). [2025-09-16T21:12:40.109779] [INFO ] [MAIN ] AVNS: Successfully saved derivative data. [2025-09-16T21:12:40.112663] [INFO ] [MAIN ] Derivative Progress: 147/2026 symbols completed. AVNS took 1.0s. Estimated remaining: 10m 17s. Rate: 182.6 symbols/min [2025-09-16T21:12:40.114003] [INFO ] [MAIN ] AVTR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:40.114096] [DEBUG] [LOCAL ] AVB: Derivative data saved (1339 records). [2025-09-16T21:12:40.114200] [INFO ] [MAIN ] AVB: Successfully saved derivative data. [2025-09-16T21:12:40.116552] [INFO ] [MAIN ] Derivative Progress: 148/2026 symbols completed. AVB took 1.0s. Estimated remaining: 10m 13s. Rate: 183.8 symbols/min [2025-09-16T21:12:40.137247] [DEBUG] [LOCAL ] AVNT: Loaded 28832 existing records from primary storage. [2025-09-16T21:12:40.137374] [INFO ] [MAIN ] AVNT: Loaded 28832 primary data records. [2025-09-16T21:12:40.424126] [DEBUG] [LOCAL ] AVTR: Loaded 39944 existing records from primary storage. [2025-09-16T21:12:40.424327] [INFO ] [MAIN ] AVTR: Loaded 39944 primary data records. [2025-09-16T21:12:40.701459] [DEBUG] [MAIN ] AVNT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:40.702201] [INFO ] [MAIN ] AVNT: Generated 1339 derivative records from 28832 primary records. [2025-09-16T21:12:40.702916] [DEBUG] [LOCAL ] AVNT: Saving derivative data. [2025-09-16T21:12:40.715891] [DEBUG] [LOCAL ] AVNT: Derivative data saved (1339 records). [2025-09-16T21:12:40.716011] [INFO ] [MAIN ] AVNT: Successfully saved derivative data. [2025-09-16T21:12:40.717597] [INFO ] [MAIN ] Derivative Progress: 149/2026 symbols completed. AVNT took 0.6s. Estimated remaining: 10m 16s. Rate: 182.8 symbols/min [2025-09-16T21:12:40.730202] [DEBUG] [MAIN ] AVTR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:40.730758] [INFO ] [MAIN ] AVTR: Generated 1339 derivative records from 39944 primary records. [2025-09-16T21:12:40.730818] [DEBUG] [LOCAL ] AVTR: Saving derivative data. [2025-09-16T21:12:40.742496] [DEBUG] [LOCAL ] AVTR: Derivative data saved (1339 records). [2025-09-16T21:12:40.742553] [INFO ] [MAIN ] AVTR: Successfully saved derivative data. [2025-09-16T21:12:40.745098] [INFO ] [MAIN ] Derivative Progress: 150/2026 symbols completed. AVTR took 0.6s. Estimated remaining: 10m 12s. Rate: 183.9 symbols/min [2025-09-16T21:12:40.745694] [INFO ] [MAIN ] AWI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:40.745550] [INFO ] [MAIN ] AVY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:40.746035] [INFO ] [MAIN ] AWF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:40.780429] [DEBUG] [LOCAL ] AWF: Loaded 17033 existing records from primary storage. [2025-09-16T21:12:40.781023] [INFO ] [MAIN ] AWF: Loaded 17033 primary data records. [2025-09-16T21:12:40.792659] [DEBUG] [LOCAL ] AWI: Loaded 19097 existing records from primary storage. [2025-09-16T21:12:40.792816] [INFO ] [MAIN ] AWI: Loaded 19097 primary data records. [2025-09-16T21:12:40.997839] [DEBUG] [LOCAL ] AVY: Loaded 27220 existing records from primary storage. [2025-09-16T21:12:41.028959] [INFO ] [MAIN ] AVY: Loaded 27220 primary data records. [2025-09-16T21:12:41.598900] [DEBUG] [MAIN ] AWF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:41.608462] [INFO ] [MAIN ] AWF: Generated 1339 derivative records from 17033 primary records. [2025-09-16T21:12:41.608830] [DEBUG] [LOCAL ] AWF: Saving derivative data. [2025-09-16T21:12:41.608676] [DEBUG] [MAIN ] AWI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:41.609505] [INFO ] [MAIN ] AWI: Generated 1339 derivative records from 19097 primary records. [2025-09-16T21:12:41.610216] [DEBUG] [LOCAL ] AWI: Saving derivative data. [2025-09-16T21:12:41.643122] [DEBUG] [MAIN ] AVY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:41.643910] [DEBUG] [LOCAL ] AWF: Derivative data saved (1339 records). [2025-09-16T21:12:41.644199] [INFO ] [MAIN ] AWF: Successfully saved derivative data. [2025-09-16T21:12:41.644950] [INFO ] [MAIN ] AVY: Generated 1339 derivative records from 27220 primary records. [2025-09-16T21:12:41.646561] [DEBUG] [LOCAL ] AWI: Derivative data saved (1339 records). [2025-09-16T21:12:41.646661] [DEBUG] [LOCAL ] AVY: Saving derivative data. [2025-09-16T21:12:41.646715] [INFO ] [MAIN ] AWI: Successfully saved derivative data. [2025-09-16T21:12:41.646502] [INFO ] [MAIN ] Derivative Progress: 151/2026 symbols completed. AWF took 0.9s. Estimated remaining: 10m 19s. Rate: 181.8 symbols/min [2025-09-16T21:12:41.649109] [INFO ] [MAIN ] Derivative Progress: 152/2026 symbols completed. AWI took 0.9s. Estimated remaining: 10m 14s. Rate: 183.0 symbols/min [2025-09-16T21:12:41.655826] [INFO ] [MAIN ] AWK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:41.655884] [INFO ] [MAIN ] AWP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:41.662118] [DEBUG] [LOCAL ] AVY: Derivative data saved (1339 records). [2025-09-16T21:12:41.662288] [INFO ] [MAIN ] AVY: Successfully saved derivative data. [2025-09-16T21:12:41.664308] [INFO ] [MAIN ] Derivative Progress: 153/2026 symbols completed. AVY took 0.9s. Estimated remaining: 10m 10s. Rate: 184.2 symbols/min [2025-09-16T21:12:41.664511] [INFO ] [MAIN ] AWR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:41.680305] [DEBUG] [LOCAL ] AWP: Loaded 16751 existing records from primary storage. [2025-09-16T21:12:41.683774] [INFO ] [MAIN ] AWP: Loaded 16751 primary data records. [2025-09-16T21:12:41.799938] [DEBUG] [LOCAL ] AWR: Loaded 16266 existing records from primary storage. [2025-09-16T21:12:41.800947] [INFO ] [MAIN ] AWR: Loaded 16266 primary data records. [2025-09-16T21:12:41.853072] [DEBUG] [LOCAL ] AWK: Loaded 35976 existing records from primary storage. [2025-09-16T21:12:41.924001] [INFO ] [MAIN ] AWK: Loaded 35976 primary data records. [2025-09-16T21:12:42.543516] [DEBUG] [MAIN ] AWP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:42.545251] [INFO ] [MAIN ] AWP: Generated 1339 derivative records from 16751 primary records. [2025-09-16T21:12:42.545612] [DEBUG] [LOCAL ] AWP: Saving derivative data. [2025-09-16T21:12:42.565995] [DEBUG] [MAIN ] AWR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:42.567810] [DEBUG] [LOCAL ] AWP: Derivative data saved (1339 records). [2025-09-16T21:12:42.568396] [INFO ] [MAIN ] AWR: Generated 1339 derivative records from 16266 primary records. [2025-09-16T21:12:42.568577] [INFO ] [MAIN ] AWP: Successfully saved derivative data. [2025-09-16T21:12:42.570254] [INFO ] [MAIN ] Derivative Progress: 154/2026 symbols completed. AWP took 0.9s. Estimated remaining: 10m 17s. Rate: 182.1 symbols/min [2025-09-16T21:12:42.570949] [DEBUG] [LOCAL ] AWR: Saving derivative data. [2025-09-16T21:12:42.572939] [INFO ] [MAIN ] AX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:42.594343] [DEBUG] [MAIN ] AWK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:42.595510] [INFO ] [MAIN ] AWK: Generated 1339 derivative records from 35976 primary records. [2025-09-16T21:12:42.595570] [DEBUG] [LOCAL ] AWR: Derivative data saved (1339 records). [2025-09-16T21:12:42.595844] [DEBUG] [LOCAL ] AWK: Saving derivative data. [2025-09-16T21:12:42.595801] [INFO ] [MAIN ] AWR: Successfully saved derivative data. [2025-09-16T21:12:42.598230] [INFO ] [MAIN ] Derivative Progress: 155/2026 symbols completed. AWR took 0.9s. Estimated remaining: 10m 13s. Rate: 183.1 symbols/min [2025-09-16T21:12:42.604308] [INFO ] [MAIN ] AXL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:42.615504] [DEBUG] [LOCAL ] AWK: Derivative data saved (1339 records). [2025-09-16T21:12:42.615620] [INFO ] [MAIN ] AWK: Successfully saved derivative data. [2025-09-16T21:12:42.617564] [INFO ] [MAIN ] Derivative Progress: 156/2026 symbols completed. AWK took 1.0s. Estimated remaining: 10m 9s. Rate: 184.2 symbols/min [2025-09-16T21:12:42.617833] [INFO ] [MAIN ] AXP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:42.625968] [DEBUG] [LOCAL ] AX: Loaded 20338 existing records from primary storage. [2025-09-16T21:12:42.626194] [INFO ] [MAIN ] AX: Loaded 20338 primary data records. [2025-09-16T21:12:42.918738] [DEBUG] [LOCAL ] AXL: Loaded 37509 existing records from primary storage. [2025-09-16T21:12:42.930012] [INFO ] [MAIN ] AXL: Loaded 37509 primary data records. [2025-09-16T21:12:42.941791] [DEBUG] [LOCAL ] AXP: Loaded 39661 existing records from primary storage. [2025-09-16T21:12:42.967417] [INFO ] [MAIN ] AXP: Loaded 39661 primary data records. [2025-09-16T21:12:43.494241] [DEBUG] [MAIN ] AX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:43.496204] [INFO ] [MAIN ] AX: Generated 1339 derivative records from 20338 primary records. [2025-09-16T21:12:43.496480] [DEBUG] [LOCAL ] AX: Saving derivative data. [2025-09-16T21:12:43.512029] [DEBUG] [LOCAL ] AX: Derivative data saved (1339 records). [2025-09-16T21:12:43.512262] [INFO ] [MAIN ] AX: Successfully saved derivative data. [2025-09-16T21:12:43.514440] [INFO ] [MAIN ] Derivative Progress: 157/2026 symbols completed. AX took 0.9s. Estimated remaining: 10m 15s. Rate: 182.2 symbols/min [2025-09-16T21:12:43.515148] [INFO ] [MAIN ] AXR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:43.522701] [DEBUG] [LOCAL ] AXR: Loaded 2150 existing records from primary storage. [2025-09-16T21:12:43.523000] [INFO ] [MAIN ] AXR: Loaded 2150 primary data records. [2025-09-16T21:12:43.540442] [DEBUG] [MAIN ] AXL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:43.557692] [INFO ] [MAIN ] AXL: Generated 1339 derivative records from 37509 primary records. [2025-09-16T21:12:43.583136] [DEBUG] [LOCAL ] AXL: Saving derivative data. [2025-09-16T21:12:43.646069] [DEBUG] [MAIN ] AXP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:43.658352] [INFO ] [MAIN ] AXP: Generated 1339 derivative records from 39661 primary records. [2025-09-16T21:12:43.669599] [DEBUG] [LOCAL ] AXP: Saving derivative data. [2025-09-16T21:12:43.718696] [DEBUG] [LOCAL ] AXL: Derivative data saved (1339 records). [2025-09-16T21:12:43.739088] [INFO ] [MAIN ] AXL: Successfully saved derivative data. [2025-09-16T21:12:43.750320] [INFO ] [MAIN ] Derivative Progress: 158/2026 symbols completed. AXL took 1.1s. Estimated remaining: 10m 14s. Rate: 182.5 symbols/min [2025-09-16T21:12:43.752876] [INFO ] [MAIN ] AYI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:43.778245] [DEBUG] [LOCAL ] AXP: Derivative data saved (1339 records). [2025-09-16T21:12:43.876229] [INFO ] [MAIN ] AXP: Successfully saved derivative data. [2025-09-16T21:12:43.879339] [INFO ] [MAIN ] Derivative Progress: 159/2026 symbols completed. AXP took 1.3s. Estimated remaining: 10m 11s. Rate: 183.2 symbols/min [2025-09-16T21:12:43.879905] [INFO ] [MAIN ] BA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:43.898072] [DEBUG] [LOCAL ] AYI: Loaded 17656 existing records from primary storage. [2025-09-16T21:12:43.898413] [INFO ] [MAIN ] AYI: Loaded 17656 primary data records. [2025-09-16T21:12:44.184307] [DEBUG] [MAIN ] AXR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:44.197083] [INFO ] [MAIN ] AXR: Generated 1339 derivative records from 2150 primary records. [2025-09-16T21:12:44.196210] [DEBUG] [LOCAL ] BA: Loaded 40141 existing records from primary storage. [2025-09-16T21:12:44.197289] [DEBUG] [LOCAL ] AXR: Saving derivative data. [2025-09-16T21:12:44.197458] [INFO ] [MAIN ] BA: Loaded 40141 primary data records. [2025-09-16T21:12:44.278195] [DEBUG] [LOCAL ] AXR: Derivative data saved (1339 records). [2025-09-16T21:12:44.315447] [INFO ] [MAIN ] AXR: Successfully saved derivative data. [2025-09-16T21:12:44.320433] [INFO ] [MAIN ] Derivative Progress: 160/2026 symbols completed. AXR took 0.8s. Estimated remaining: 10m 12s. Rate: 182.8 symbols/min [2025-09-16T21:12:44.320768] [INFO ] [MAIN ] BABA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:44.513859] [DEBUG] [MAIN ] AYI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:44.515238] [INFO ] [MAIN ] AYI: Generated 1339 derivative records from 17656 primary records. [2025-09-16T21:12:44.515452] [DEBUG] [LOCAL ] AYI: Saving derivative data. [2025-09-16T21:12:44.540881] [DEBUG] [LOCAL ] AYI: Derivative data saved (1339 records). [2025-09-16T21:12:44.541723] [DEBUG] [LOCAL ] BABA: Loaded 40170 existing records from primary storage. [2025-09-16T21:12:44.541840] [INFO ] [MAIN ] BABA: Loaded 40170 primary data records. [2025-09-16T21:12:44.541882] [INFO ] [MAIN ] AYI: Successfully saved derivative data. [2025-09-16T21:12:44.543691] [INFO ] [MAIN ] Derivative Progress: 161/2026 symbols completed. AYI took 0.8s. Estimated remaining: 10m 11s. Rate: 183.2 symbols/min [2025-09-16T21:12:44.564625] [INFO ] [MAIN ] BAC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:44.824888] [DEBUG] [MAIN ] BA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:44.825723] [INFO ] [MAIN ] BA: Generated 1339 derivative records from 40141 primary records. [2025-09-16T21:12:44.825958] [DEBUG] [LOCAL ] BA: Saving derivative data. [2025-09-16T21:12:44.851246] [DEBUG] [LOCAL ] BA: Derivative data saved (1339 records). [2025-09-16T21:12:44.851411] [INFO ] [MAIN ] BA: Successfully saved derivative data. [2025-09-16T21:12:44.853029] [INFO ] [MAIN ] Derivative Progress: 162/2026 symbols completed. BA took 1.0s. Estimated remaining: 10m 10s. Rate: 183.3 symbols/min [2025-09-16T21:12:44.853874] [DEBUG] [LOCAL ] BAC: Loaded 40158 existing records from primary storage. [2025-09-16T21:12:44.854028] [INFO ] [MAIN ] BAC: Loaded 40158 primary data records. [2025-09-16T21:12:44.859869] [INFO ] [MAIN ] BAK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:45.141728] [DEBUG] [LOCAL ] BAK: Loaded 29020 existing records from primary storage. [2025-09-16T21:12:45.147975] [INFO ] [MAIN ] BAK: Loaded 29020 primary data records. [2025-09-16T21:12:45.152366] [DEBUG] [MAIN ] BABA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:45.189299] [INFO ] [MAIN ] BABA: Generated 1339 derivative records from 40170 primary records. [2025-09-16T21:12:45.217237] [DEBUG] [LOCAL ] BABA: Saving derivative data. [2025-09-16T21:12:45.294978] [DEBUG] [LOCAL ] BABA: Derivative data saved (1339 records). [2025-09-16T21:12:45.313487] [INFO ] [MAIN ] BABA: Successfully saved derivative data. [2025-09-16T21:12:45.349113] [INFO ] [MAIN ] Derivative Progress: 163/2026 symbols completed. BABA took 1.0s. Estimated remaining: 10m 12s. Rate: 182.7 symbols/min [2025-09-16T21:12:45.448415] [DEBUG] [MAIN ] BAC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:45.449138] [INFO ] [MAIN ] BAC: Generated 1339 derivative records from 40158 primary records. [2025-09-16T21:12:45.449440] [DEBUG] [LOCAL ] BAC: Saving derivative data. [2025-09-16T21:12:45.462637] [DEBUG] [LOCAL ] BAC: Derivative data saved (1339 records). [2025-09-16T21:12:45.462746] [INFO ] [MAIN ] BAC: Successfully saved derivative data. [2025-09-16T21:12:45.465281] [INFO ] [MAIN ] Derivative Progress: 164/2026 symbols completed. BAC took 0.9s. Estimated remaining: 10m 9s. Rate: 183.4 symbols/min [2025-09-16T21:12:45.477941] [DEBUG] [MAIN ] BAK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:45.478459] [INFO ] [MAIN ] BAK: Generated 1339 derivative records from 29020 primary records. [2025-09-16T21:12:45.478518] [DEBUG] [LOCAL ] BAK: Saving derivative data. [2025-09-16T21:12:45.490007] [DEBUG] [LOCAL ] BAK: Derivative data saved (1339 records). [2025-09-16T21:12:45.490064] [INFO ] [MAIN ] BAK: Successfully saved derivative data. [2025-09-16T21:12:45.491619] [INFO ] [MAIN ] Derivative Progress: 165/2026 symbols completed. BAK took 0.6s. Estimated remaining: 10m 5s. Rate: 184.4 symbols/min [2025-09-16T21:12:45.492212] [INFO ] [MAIN ] BAM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:45.492134] [INFO ] [MAIN ] BALL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:45.492167] [INFO ] [MAIN ] BALY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:45.503737] [DEBUG] [LOCAL ] BALY: Loaded 7203 existing records from primary storage. [2025-09-16T21:12:45.503936] [INFO ] [MAIN ] BALY: Loaded 7203 primary data records. [2025-09-16T21:12:45.824382] [DEBUG] [LOCAL ] BAM: Loaded 38634 existing records from primary storage. [2025-09-16T21:12:45.825928] [INFO ] [MAIN ] BAM: Loaded 38634 primary data records. [2025-09-16T21:12:45.838048] [DEBUG] [LOCAL ] BALL: Loaded 38534 existing records from primary storage. [2025-09-16T21:12:45.863982] [INFO ] [MAIN ] BALL: Loaded 38534 primary data records. [2025-09-16T21:12:46.426004] [DEBUG] [MAIN ] BALY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:46.428163] [INFO ] [MAIN ] BALY: Generated 1339 derivative records from 7203 primary records. [2025-09-16T21:12:46.428931] [DEBUG] [LOCAL ] BALY: Saving derivative data. [2025-09-16T21:12:46.441514] [DEBUG] [LOCAL ] BALY: Derivative data saved (1339 records). [2025-09-16T21:12:46.441706] [INFO ] [MAIN ] BALY: Successfully saved derivative data. [2025-09-16T21:12:46.443991] [INFO ] [MAIN ] Derivative Progress: 166/2026 symbols completed. BALY took 1.0s. Estimated remaining: 10m 12s. Rate: 182.3 symbols/min [2025-09-16T21:12:46.444952] [INFO ] [MAIN ] BANC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:46.459049] [DEBUG] [MAIN ] BALL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:46.459847] [INFO ] [MAIN ] BALL: Generated 1339 derivative records from 38534 primary records. [2025-09-16T21:12:46.461241] [DEBUG] [LOCAL ] BALL: Saving derivative data. [2025-09-16T21:12:46.481316] [DEBUG] [MAIN ] BAM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:46.483774] [INFO ] [MAIN ] BAM: Generated 1339 derivative records from 38634 primary records. [2025-09-16T21:12:46.484138] [DEBUG] [LOCAL ] BAM: Saving derivative data. [2025-09-16T21:12:46.484386] [DEBUG] [LOCAL ] BALL: Derivative data saved (1339 records). [2025-09-16T21:12:46.494149] [INFO ] [MAIN ] BALL: Successfully saved derivative data. [2025-09-16T21:12:46.503240] [INFO ] [MAIN ] Derivative Progress: 167/2026 symbols completed. BALL took 1.0s. Estimated remaining: 10m 9s. Rate: 183.2 symbols/min [2025-09-16T21:12:46.506295] [INFO ] [MAIN ] BAP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:46.510218] [DEBUG] [LOCAL ] BAM: Derivative data saved (1339 records). [2025-09-16T21:12:46.521311] [INFO ] [MAIN ] BAM: Successfully saved derivative data. [2025-09-16T21:12:46.523501] [INFO ] [MAIN ] Derivative Progress: 168/2026 symbols completed. BAM took 1.0s. Estimated remaining: 10m 5s. Rate: 184.3 symbols/min [2025-09-16T21:12:46.523793] [INFO ] [MAIN ] BARK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:46.524536] [DEBUG] [LOCAL ] BANC: Loaded 37899 existing records from primary storage. [2025-09-16T21:12:46.525001] [INFO ] [MAIN ] BANC: Loaded 37899 primary data records. [2025-09-16T21:12:46.641331] [DEBUG] [LOCAL ] BAP: Loaded 19126 existing records from primary storage. [2025-09-16T21:12:46.668968] [INFO ] [MAIN ] BAP: Loaded 19126 primary data records. [2025-09-16T21:12:46.899343] [DEBUG] [LOCAL ] BARK: Loaded 28629 existing records from primary storage. [2025-09-16T21:12:46.924217] [INFO ] [MAIN ] BARK: Loaded 28629 primary data records. [2025-09-16T21:12:47.386983] [DEBUG] [MAIN ] BANC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:47.389357] [INFO ] [MAIN ] BANC: Generated 1339 derivative records from 37899 primary records. [2025-09-16T21:12:47.389811] [DEBUG] [LOCAL ] BANC: Saving derivative data. [2025-09-16T21:12:47.403513] [DEBUG] [LOCAL ] BANC: Derivative data saved (1339 records). [2025-09-16T21:12:47.405228] [INFO ] [MAIN ] BANC: Successfully saved derivative data. [2025-09-16T21:12:47.407073] [INFO ] [MAIN ] Derivative Progress: 169/2026 symbols completed. BANC took 1.0s. Estimated remaining: 10m 11s. Rate: 182.4 symbols/min [2025-09-16T21:12:47.407408] [INFO ] [MAIN ] BAX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:47.418633] [DEBUG] [MAIN ] BAP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:47.419462] [INFO ] [MAIN ] BAP: Generated 1339 derivative records from 19126 primary records. [2025-09-16T21:12:47.419754] [DEBUG] [LOCAL ] BAP: Saving derivative data. [2025-09-16T21:12:47.436483] [DEBUG] [LOCAL ] BAP: Derivative data saved (1339 records). [2025-09-16T21:12:47.442873] [INFO ] [MAIN ] BAP: Successfully saved derivative data. [2025-09-16T21:12:47.448324] [INFO ] [MAIN ] Derivative Progress: 170/2026 symbols completed. BAP took 0.9s. Estimated remaining: 10m 7s. Rate: 183.3 symbols/min [2025-09-16T21:12:47.448823] [DEBUG] [MAIN ] BARK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:47.449117] [INFO ] [MAIN ] BB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:47.449950] [INFO ] [MAIN ] BARK: Generated 1339 derivative records from 28629 primary records. [2025-09-16T21:12:47.450052] [DEBUG] [LOCAL ] BARK: Saving derivative data. [2025-09-16T21:12:47.472254] [DEBUG] [LOCAL ] BARK: Derivative data saved (1339 records). [2025-09-16T21:12:47.472490] [INFO ] [MAIN ] BARK: Successfully saved derivative data. [2025-09-16T21:12:47.474418] [INFO ] [MAIN ] Derivative Progress: 171/2026 symbols completed. BARK took 1.0s. Estimated remaining: 10m 4s. Rate: 184.3 symbols/min [2025-09-16T21:12:47.474667] [INFO ] [MAIN ] BBAI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:47.490693] [DEBUG] [LOCAL ] BAX: Loaded 39905 existing records from primary storage. [2025-09-16T21:12:47.490881] [INFO ] [MAIN ] BAX: Loaded 39905 primary data records. [2025-09-16T21:12:47.704791] [DEBUG] [LOCAL ] BB: Loaded 39362 existing records from primary storage. [2025-09-16T21:12:47.715578] [INFO ] [MAIN ] BB: Loaded 39362 primary data records. [2025-09-16T21:12:47.809689] [DEBUG] [LOCAL ] BBAI: Loaded 40170 existing records from primary storage. [2025-09-16T21:12:47.853361] [INFO ] [MAIN ] BBAI: Loaded 40170 primary data records. [2025-09-16T21:12:48.391592] [DEBUG] [MAIN ] BAX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:48.392977] [INFO ] [MAIN ] BAX: Generated 1339 derivative records from 39905 primary records. [2025-09-16T21:12:48.393509] [DEBUG] [LOCAL ] BAX: Saving derivative data. [2025-09-16T21:12:48.420743] [DEBUG] [LOCAL ] BAX: Derivative data saved (1339 records). [2025-09-16T21:12:48.421977] [INFO ] [MAIN ] BAX: Successfully saved derivative data. [2025-09-16T21:12:48.424380] [INFO ] [MAIN ] Derivative Progress: 172/2026 symbols completed. BAX took 1.0s. Estimated remaining: 10m 10s. Rate: 182.3 symbols/min [2025-09-16T21:12:48.421916] [DEBUG] [MAIN ] BBAI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:48.425215] [INFO ] [MAIN ] BBAI: Generated 1339 derivative records from 40170 primary records. [2025-09-16T21:12:48.425389] [DEBUG] [LOCAL ] BBAI: Saving derivative data. [2025-09-16T21:12:48.434978] [INFO ] [MAIN ] BBAR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:48.435961] [DEBUG] [MAIN ] BB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:48.437396] [INFO ] [MAIN ] BB: Generated 1339 derivative records from 39362 primary records. [2025-09-16T21:12:48.437873] [DEBUG] [LOCAL ] BB: Saving derivative data. [2025-09-16T21:12:48.465143] [DEBUG] [LOCAL ] BBAI: Derivative data saved (1339 records). [2025-09-16T21:12:48.465957] [INFO ] [MAIN ] BBAI: Successfully saved derivative data. [2025-09-16T21:12:48.468213] [INFO ] [MAIN ] Derivative Progress: 173/2026 symbols completed. BBAI took 1.0s. Estimated remaining: 10m 7s. Rate: 183.2 symbols/min [2025-09-16T21:12:48.468489] [INFO ] [MAIN ] BBD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:48.466254] [DEBUG] [LOCAL ] BB: Derivative data saved (1339 records). [2025-09-16T21:12:48.468971] [INFO ] [MAIN ] BB: Successfully saved derivative data. [2025-09-16T21:12:48.470932] [INFO ] [MAIN ] Derivative Progress: 174/2026 symbols completed. BB took 1.0s. Estimated remaining: 10m 3s. Rate: 184.3 symbols/min [2025-09-16T21:12:48.479573] [INFO ] [MAIN ] BBDC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:48.498213] [DEBUG] [LOCAL ] BBAR: Loaded 30859 existing records from primary storage. [2025-09-16T21:12:48.498403] [INFO ] [MAIN ] BBAR: Loaded 30859 primary data records. [2025-09-16T21:12:48.677770] [DEBUG] [LOCAL ] BBD: Loaded 39702 existing records from primary storage. [2025-09-16T21:12:48.677186] [DEBUG] [LOCAL ] BBDC: Loaded 23506 existing records from primary storage. [2025-09-16T21:12:48.707413] [INFO ] [MAIN ] BBDC: Loaded 23506 primary data records. [2025-09-16T21:12:48.707332] [INFO ] [MAIN ] BBD: Loaded 39702 primary data records. [2025-09-16T21:12:49.348414] [DEBUG] [MAIN ] BBAR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:49.349224] [INFO ] [MAIN ] BBAR: Generated 1339 derivative records from 30859 primary records. [2025-09-16T21:12:49.350073] [DEBUG] [LOCAL ] BBAR: Saving derivative data. [2025-09-16T21:12:49.363795] [DEBUG] [LOCAL ] BBAR: Derivative data saved (1339 records). [2025-09-16T21:12:49.364077] [INFO ] [MAIN ] BBAR: Successfully saved derivative data. [2025-09-16T21:12:49.365755] [INFO ] [MAIN ] Derivative Progress: 175/2026 symbols completed. BBAR took 0.9s. Estimated remaining: 10m 9s. Rate: 182.5 symbols/min [2025-09-16T21:12:49.366275] [INFO ] [MAIN ] BBDO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:49.373850] [DEBUG] [LOCAL ] BBDO: Loaded 3607 existing records from primary storage. [2025-09-16T21:12:49.384675] [DEBUG] [MAIN ] BBD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:49.385337] [INFO ] [MAIN ] BBD: Generated 1339 derivative records from 39702 primary records. [2025-09-16T21:12:49.384764] [INFO ] [MAIN ] BBDO: Loaded 3607 primary data records. [2025-09-16T21:12:49.422152] [DEBUG] [LOCAL ] BBD: Saving derivative data. [2025-09-16T21:12:49.449974] [DEBUG] [MAIN ] BBDC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:49.476516] [INFO ] [MAIN ] BBDC: Generated 1339 derivative records from 23506 primary records. [2025-09-16T21:12:49.500746] [DEBUG] [LOCAL ] BBDC: Saving derivative data. [2025-09-16T21:12:49.599602] [DEBUG] [LOCAL ] BBDC: Derivative data saved (1339 records). [2025-09-16T21:12:49.599887] [DEBUG] [LOCAL ] BBD: Derivative data saved (1339 records). [2025-09-16T21:12:49.685708] [INFO ] [MAIN ] BBDC: Successfully saved derivative data. [2025-09-16T21:12:49.688284] [INFO ] [MAIN ] Derivative Progress: 176/2026 symbols completed. BBDC took 1.2s. Estimated remaining: 10m 8s. Rate: 182.5 symbols/min [2025-09-16T21:12:49.685987] [INFO ] [MAIN ] BBD: Successfully saved derivative data. [2025-09-16T21:12:49.688558] [INFO ] [MAIN ] BBN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:49.690201] [INFO ] [MAIN ] Derivative Progress: 177/2026 symbols completed. BBD took 1.2s. Estimated remaining: 10m 5s. Rate: 183.5 symbols/min [2025-09-16T21:12:49.690582] [INFO ] [MAIN ] BBU: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:49.697458] [DEBUG] [LOCAL ] BBU: Loaded 3205 existing records from primary storage. [2025-09-16T21:12:49.697672] [INFO ] [MAIN ] BBU: Loaded 3205 primary data records. [2025-09-16T21:12:49.811894] [DEBUG] [LOCAL ] BBN: Loaded 13520 existing records from primary storage. [2025-09-16T21:12:49.822664] [INFO ] [MAIN ] BBN: Loaded 13520 primary data records. [2025-09-16T21:12:50.141122] [DEBUG] [MAIN ] BBDO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:50.245991] [INFO ] [MAIN ] BBDO: Generated 1339 derivative records from 3607 primary records. [2025-09-16T21:12:50.246699] [DEBUG] [LOCAL ] BBDO: Saving derivative data. [2025-09-16T21:12:50.263557] [DEBUG] [LOCAL ] BBDO: Derivative data saved (1339 records). [2025-09-16T21:12:50.264030] [INFO ] [MAIN ] BBDO: Successfully saved derivative data. [2025-09-16T21:12:50.265818] [INFO ] [MAIN ] Derivative Progress: 178/2026 symbols completed. BBDO took 0.9s. Estimated remaining: 10m 7s. Rate: 182.7 symbols/min [2025-09-16T21:12:50.279181] [DEBUG] [MAIN ] BBU: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:50.279855] [INFO ] [MAIN ] BBU: Generated 1339 derivative records from 3205 primary records. [2025-09-16T21:12:50.280042] [DEBUG] [LOCAL ] BBU: Saving derivative data. [2025-09-16T21:12:50.292616] [DEBUG] [LOCAL ] BBU: Derivative data saved (1339 records). [2025-09-16T21:12:50.292814] [INFO ] [MAIN ] BBU: Successfully saved derivative data. [2025-09-16T21:12:50.294624] [INFO ] [MAIN ] Derivative Progress: 179/2026 symbols completed. BBU took 0.6s. Estimated remaining: 10m 3s. Rate: 183.7 symbols/min [2025-09-16T21:12:50.304191] [DEBUG] [MAIN ] BBN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:50.304798] [INFO ] [MAIN ] BBN: Generated 1339 derivative records from 13520 primary records. [2025-09-16T21:12:50.304862] [DEBUG] [LOCAL ] BBN: Saving derivative data. [2025-09-16T21:12:50.316259] [DEBUG] [LOCAL ] BBN: Derivative data saved (1339 records). [2025-09-16T21:12:50.316315] [INFO ] [MAIN ] BBN: Successfully saved derivative data. [2025-09-16T21:12:50.318195] [INFO ] [MAIN ] Derivative Progress: 180/2026 symbols completed. BBN took 0.6s. Estimated remaining: 9m 60s. Rate: 184.6 symbols/min [2025-09-16T21:12:50.318673] [INFO ] [MAIN ] BBVA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:50.318774] [INFO ] [MAIN ] BBUC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:50.319041] [INFO ] [MAIN ] BBW: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:50.336811] [DEBUG] [LOCAL ] BBUC: Loaded 9313 existing records from primary storage. [2025-09-16T21:12:50.337031] [INFO ] [MAIN ] BBUC: Loaded 9313 primary data records. [2025-09-16T21:12:50.414693] [DEBUG] [LOCAL ] BBW: Loaded 18907 existing records from primary storage. [2025-09-16T21:12:50.456600] [INFO ] [MAIN ] BBW: Loaded 18907 primary data records. [2025-09-16T21:12:50.644095] [DEBUG] [LOCAL ] BBVA: Loaded 36371 existing records from primary storage. [2025-09-16T21:12:50.768471] [INFO ] [MAIN ] BBVA: Loaded 36371 primary data records. [2025-09-16T21:12:51.230318] [DEBUG] [MAIN ] BBUC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:51.233289] [INFO ] [MAIN ] BBUC: Generated 1339 derivative records from 9313 primary records. [2025-09-16T21:12:51.233925] [DEBUG] [LOCAL ] BBUC: Saving derivative data. [2025-09-16T21:12:51.250495] [DEBUG] [MAIN ] BBW: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:51.254955] [INFO ] [MAIN ] BBW: Generated 1339 derivative records from 18907 primary records. [2025-09-16T21:12:51.255250] [DEBUG] [LOCAL ] BBW: Saving derivative data. [2025-09-16T21:12:51.258241] [DEBUG] [LOCAL ] BBUC: Derivative data saved (1339 records). [2025-09-16T21:12:51.259157] [INFO ] [MAIN ] BBUC: Successfully saved derivative data. [2025-09-16T21:12:51.266320] [INFO ] [MAIN ] Derivative Progress: 181/2026 symbols completed. BBUC took 0.9s. Estimated remaining: 10m 6s. Rate: 182.7 symbols/min [2025-09-16T21:12:51.269289] [INFO ] [MAIN ] BBWI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:51.275630] [DEBUG] [LOCAL ] BBW: Derivative data saved (1339 records). [2025-09-16T21:12:51.285305] [DEBUG] [MAIN ] BBVA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:51.285088] [INFO ] [MAIN ] BBW: Successfully saved derivative data. [2025-09-16T21:12:51.287720] [INFO ] [MAIN ] Derivative Progress: 182/2026 symbols completed. BBW took 1.0s. Estimated remaining: 10m 3s. Rate: 183.6 symbols/min [2025-09-16T21:12:51.287986] [INFO ] [MAIN ] BBY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:51.285973] [INFO ] [MAIN ] BBVA: Generated 1339 derivative records from 36371 primary records. [2025-09-16T21:12:51.288142] [DEBUG] [LOCAL ] BBVA: Saving derivative data. [2025-09-16T21:12:51.302952] [DEBUG] [LOCAL ] BBVA: Derivative data saved (1339 records). [2025-09-16T21:12:51.303084] [INFO ] [MAIN ] BBVA: Successfully saved derivative data. [2025-09-16T21:12:51.305130] [INFO ] [MAIN ] Derivative Progress: 183/2026 symbols completed. BBVA took 1.0s. Estimated remaining: 9m 59s. Rate: 184.6 symbols/min [2025-09-16T21:12:51.305397] [INFO ] [MAIN ] BC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:51.342086] [DEBUG] [LOCAL ] BBWI: Loaded 39941 existing records from primary storage. [2025-09-16T21:12:51.342255] [INFO ] [MAIN ] BBWI: Loaded 39941 primary data records. [2025-09-16T21:12:51.475186] [DEBUG] [LOCAL ] BBY: Loaded 39860 existing records from primary storage. [2025-09-16T21:12:51.480897] [INFO ] [MAIN ] BBY: Loaded 39860 primary data records. [2025-09-16T21:12:51.590738] [DEBUG] [LOCAL ] BC: Loaded 32937 existing records from primary storage. [2025-09-16T21:12:51.638429] [INFO ] [MAIN ] BC: Loaded 32937 primary data records. [2025-09-16T21:12:52.223756] [DEBUG] [MAIN ] BBWI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:52.224976] [INFO ] [MAIN ] BBWI: Generated 1339 derivative records from 39941 primary records. [2025-09-16T21:12:52.225513] [DEBUG] [LOCAL ] BBWI: Saving derivative data. [2025-09-16T21:12:52.251063] [DEBUG] [LOCAL ] BBWI: Derivative data saved (1339 records). [2025-09-16T21:12:52.251872] [DEBUG] [MAIN ] BBY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:52.251960] [INFO ] [MAIN ] BBWI: Successfully saved derivative data. [2025-09-16T21:12:52.256039] [INFO ] [MAIN ] Derivative Progress: 184/2026 symbols completed. BBWI took 1.0s. Estimated remaining: 10m 5s. Rate: 182.7 symbols/min [2025-09-16T21:12:52.253248] [INFO ] [MAIN ] BBY: Generated 1339 derivative records from 39860 primary records. [2025-09-16T21:12:52.256318] [DEBUG] [LOCAL ] BBY: Saving derivative data. [2025-09-16T21:12:52.257459] [INFO ] [MAIN ] BCAT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:52.277131] [DEBUG] [MAIN ] BC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:52.279537] [INFO ] [MAIN ] BC: Generated 1339 derivative records from 32937 primary records. [2025-09-16T21:12:52.280464] [DEBUG] [LOCAL ] BBY: Derivative data saved (1339 records). [2025-09-16T21:12:52.280590] [DEBUG] [LOCAL ] BC: Saving derivative data. [2025-09-16T21:12:52.280692] [INFO ] [MAIN ] BBY: Successfully saved derivative data. [2025-09-16T21:12:52.282557] [INFO ] [MAIN ] Derivative Progress: 185/2026 symbols completed. BBY took 1.0s. Estimated remaining: 10m 2s. Rate: 183.6 symbols/min [2025-09-16T21:12:52.282884] [INFO ] [MAIN ] BCH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:52.296040] [DEBUG] [LOCAL ] BC: Derivative data saved (1339 records). [2025-09-16T21:12:52.302856] [INFO ] [MAIN ] BC: Successfully saved derivative data. [2025-09-16T21:12:52.304850] [INFO ] [MAIN ] Derivative Progress: 186/2026 symbols completed. BC took 1.0s. Estimated remaining: 9m 58s. Rate: 184.5 symbols/min [2025-09-16T21:12:52.305244] [INFO ] [MAIN ] BCO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:52.316520] [DEBUG] [LOCAL ] BCAT: Loaded 25335 existing records from primary storage. [2025-09-16T21:12:52.320935] [INFO ] [MAIN ] BCAT: Loaded 25335 primary data records. [2025-09-16T21:12:52.435230] [DEBUG] [LOCAL ] BCH: Loaded 21687 existing records from primary storage. [2025-09-16T21:12:52.446309] [INFO ] [MAIN ] BCH: Loaded 21687 primary data records. [2025-09-16T21:12:52.467565] [DEBUG] [LOCAL ] BCO: Loaded 19242 existing records from primary storage. [2025-09-16T21:12:52.529628] [INFO ] [MAIN ] BCO: Loaded 19242 primary data records. [2025-09-16T21:12:53.218314] [DEBUG] [MAIN ] BCAT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:53.219417] [INFO ] [MAIN ] BCAT: Generated 1339 derivative records from 25335 primary records. [2025-09-16T21:12:53.219670] [DEBUG] [LOCAL ] BCAT: Saving derivative data. [2025-09-16T21:12:53.236415] [DEBUG] [LOCAL ] BCAT: Derivative data saved (1339 records). [2025-09-16T21:12:53.236674] [INFO ] [MAIN ] BCAT: Successfully saved derivative data. [2025-09-16T21:12:53.244476] [INFO ] [MAIN ] Derivative Progress: 187/2026 symbols completed. BCAT took 1.0s. Estimated remaining: 10m 4s. Rate: 182.7 symbols/min [2025-09-16T21:12:53.248753] [INFO ] [MAIN ] BCSF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:53.249472] [DEBUG] [MAIN ] BCH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:53.250747] [INFO ] [MAIN ] BCH: Generated 1339 derivative records from 21687 primary records. [2025-09-16T21:12:53.250852] [DEBUG] [LOCAL ] BCH: Saving derivative data. [2025-09-16T21:12:53.274989] [DEBUG] [MAIN ] BCO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:53.276797] [INFO ] [MAIN ] BCO: Generated 1339 derivative records from 19242 primary records. [2025-09-16T21:12:53.276124] [DEBUG] [LOCAL ] BCH: Derivative data saved (1339 records). [2025-09-16T21:12:53.276982] [DEBUG] [LOCAL ] BCO: Saving derivative data. [2025-09-16T21:12:53.277675] [INFO ] [MAIN ] BCH: Successfully saved derivative data. [2025-09-16T21:12:53.279865] [INFO ] [MAIN ] Derivative Progress: 188/2026 symbols completed. BCH took 1.0s. Estimated remaining: 10m 1s. Rate: 183.5 symbols/min [2025-09-16T21:12:53.286722] [INFO ] [MAIN ] BCX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:53.296875] [DEBUG] [LOCAL ] BCO: Derivative data saved (1339 records). [2025-09-16T21:12:53.296963] [INFO ] [MAIN ] BCO: Successfully saved derivative data. [2025-09-16T21:12:53.299065] [INFO ] [MAIN ] Derivative Progress: 189/2026 symbols completed. BCO took 1.0s. Estimated remaining: 9m 58s. Rate: 184.4 symbols/min [2025-09-16T21:12:53.300905] [INFO ] [MAIN ] BDC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:53.308934] [DEBUG] [LOCAL ] BCSF: Loaded 19518 existing records from primary storage. [2025-09-16T21:12:53.309168] [INFO ] [MAIN ] BCSF: Loaded 19518 primary data records. [2025-09-16T21:12:53.428838] [DEBUG] [LOCAL ] BCX: Loaded 15406 existing records from primary storage. [2025-09-16T21:12:53.432661] [INFO ] [MAIN ] BCX: Loaded 15406 primary data records. [2025-09-16T21:12:53.568044] [DEBUG] [LOCAL ] BDC: Loaded 17786 existing records from primary storage. [2025-09-16T21:12:53.600636] [INFO ] [MAIN ] BDC: Loaded 17786 primary data records. [2025-09-16T21:12:54.209433] [DEBUG] [MAIN ] BCSF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:54.210317] [INFO ] [MAIN ] BCSF: Generated 1339 derivative records from 19518 primary records. [2025-09-16T21:12:54.210533] [DEBUG] [LOCAL ] BCSF: Saving derivative data. [2025-09-16T21:12:54.225721] [DEBUG] [LOCAL ] BCSF: Derivative data saved (1339 records). [2025-09-16T21:12:54.225993] [INFO ] [MAIN ] BCSF: Successfully saved derivative data. [2025-09-16T21:12:54.233637] [INFO ] [MAIN ] Derivative Progress: 190/2026 symbols completed. BCSF took 1.0s. Estimated remaining: 10m 3s. Rate: 182.6 symbols/min [2025-09-16T21:12:54.237987] [INFO ] [MAIN ] BDJ: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:54.237751] [DEBUG] [MAIN ] BCX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:54.239632] [INFO ] [MAIN ] BCX: Generated 1339 derivative records from 15406 primary records. [2025-09-16T21:12:54.240480] [DEBUG] [LOCAL ] BCX: Saving derivative data. [2025-09-16T21:12:54.260067] [DEBUG] [MAIN ] BDC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:54.263083] [INFO ] [MAIN ] BDC: Generated 1339 derivative records from 17786 primary records. [2025-09-16T21:12:54.263547] [DEBUG] [LOCAL ] BCX: Derivative data saved (1339 records). [2025-09-16T21:12:54.263716] [DEBUG] [LOCAL ] BDC: Saving derivative data. [2025-09-16T21:12:54.263686] [INFO ] [MAIN ] BCX: Successfully saved derivative data. [2025-09-16T21:12:54.266198] [INFO ] [MAIN ] Derivative Progress: 191/2026 symbols completed. BCX took 1.0s. Estimated remaining: 9m 60s. Rate: 183.5 symbols/min [2025-09-16T21:12:54.266398] [INFO ] [MAIN ] BEKE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:54.284332] [DEBUG] [LOCAL ] BDC: Derivative data saved (1339 records). [2025-09-16T21:12:54.284883] [INFO ] [MAIN ] BDC: Successfully saved derivative data. [2025-09-16T21:12:54.287050] [INFO ] [MAIN ] Derivative Progress: 192/2026 symbols completed. BDC took 1.0s. Estimated remaining: 9m 57s. Rate: 184.4 symbols/min [2025-09-16T21:12:54.294691] [INFO ] [MAIN ] BEN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:54.295133] [DEBUG] [LOCAL ] BDJ: Loaded 21383 existing records from primary storage. [2025-09-16T21:12:54.295581] [INFO ] [MAIN ] BDJ: Loaded 21383 primary data records. [2025-09-16T21:12:54.590741] [DEBUG] [LOCAL ] BEKE: Loaded 39625 existing records from primary storage. [2025-09-16T21:12:54.601766] [INFO ] [MAIN ] BEKE: Loaded 39625 primary data records. [2025-09-16T21:12:54.623771] [DEBUG] [LOCAL ] BEN: Loaded 39572 existing records from primary storage. [2025-09-16T21:12:54.646047] [INFO ] [MAIN ] BEN: Loaded 39572 primary data records. [2025-09-16T21:12:55.204030] [DEBUG] [MAIN ] BDJ: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:55.205900] [INFO ] [MAIN ] BDJ: Generated 1339 derivative records from 21383 primary records. [2025-09-16T21:12:55.206164] [DEBUG] [LOCAL ] BDJ: Saving derivative data. [2025-09-16T21:12:55.220905] [DEBUG] [LOCAL ] BDJ: Derivative data saved (1339 records). [2025-09-16T21:12:55.221075] [INFO ] [MAIN ] BDJ: Successfully saved derivative data. [2025-09-16T21:12:55.223208] [INFO ] [MAIN ] Derivative Progress: 193/2026 symbols completed. BDJ took 1.0s. Estimated remaining: 10m 2s. Rate: 182.6 symbols/min [2025-09-16T21:12:55.237873] [DEBUG] [MAIN ] BEKE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:55.238756] [INFO ] [MAIN ] BEKE: Generated 1339 derivative records from 39625 primary records. [2025-09-16T21:12:55.238981] [DEBUG] [LOCAL ] BEKE: Saving derivative data. [2025-09-16T21:12:55.248965] [DEBUG] [MAIN ] BEN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:55.249821] [INFO ] [MAIN ] BEN: Generated 1339 derivative records from 39572 primary records. [2025-09-16T21:12:55.255616] [DEBUG] [LOCAL ] BEN: Saving derivative data. [2025-09-16T21:12:55.273233] [DEBUG] [LOCAL ] BEKE: Derivative data saved (1339 records). [2025-09-16T21:12:55.274347] [DEBUG] [LOCAL ] BEN: Derivative data saved (1339 records). [2025-09-16T21:12:55.274555] [INFO ] [MAIN ] BEN: Successfully saved derivative data. [2025-09-16T21:12:55.274496] [INFO ] [MAIN ] BEKE: Successfully saved derivative data. [2025-09-16T21:12:55.276654] [INFO ] [MAIN ] Derivative Progress: 194/2026 symbols completed. BEN took 1.0s. Estimated remaining: 9m 59s. Rate: 183.4 symbols/min [2025-09-16T21:12:55.278970] [INFO ] [MAIN ] Derivative Progress: 195/2026 symbols completed. BEKE took 1.0s. Estimated remaining: 9m 56s. Rate: 184.4 symbols/min [2025-09-16T21:12:55.279564] [INFO ] [MAIN ] BEPC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:55.279619] [INFO ] [MAIN ] BEPH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:55.279417] [INFO ] [MAIN ] BEP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:55.288519] [DEBUG] [LOCAL ] BEPH: Loaded 3492 existing records from primary storage. [2025-09-16T21:12:55.288772] [INFO ] [MAIN ] BEPH: Loaded 3492 primary data records. [2025-09-16T21:12:55.431869] [DEBUG] [LOCAL ] BEP: Loaded 27781 existing records from primary storage. [2025-09-16T21:12:55.462613] [INFO ] [MAIN ] BEP: Loaded 27781 primary data records. [2025-09-16T21:12:55.618938] [DEBUG] [LOCAL ] BEPC: Loaded 34009 existing records from primary storage. [2025-09-16T21:12:55.695961] [INFO ] [MAIN ] BEPC: Loaded 34009 primary data records. [2025-09-16T21:12:56.156561] [DEBUG] [MAIN ] BEPH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:56.158089] [INFO ] [MAIN ] BEPH: Generated 1339 derivative records from 3492 primary records. [2025-09-16T21:12:56.158688] [DEBUG] [LOCAL ] BEPH: Saving derivative data. [2025-09-16T21:12:56.172675] [DEBUG] [LOCAL ] BEPH: Derivative data saved (1339 records). [2025-09-16T21:12:56.173081] [INFO ] [MAIN ] BEPH: Successfully saved derivative data. [2025-09-16T21:12:56.174969] [INFO ] [MAIN ] Derivative Progress: 196/2026 symbols completed. BEPH took 0.9s. Estimated remaining: 10m 1s. Rate: 182.7 symbols/min [2025-09-16T21:12:56.175562] [INFO ] [MAIN ] BEPI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:56.190288] [DEBUG] [MAIN ] BEP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:56.191516] [INFO ] [MAIN ] BEP: Generated 1339 derivative records from 27781 primary records. [2025-09-16T21:12:56.191786] [DEBUG] [LOCAL ] BEP: Saving derivative data. [2025-09-16T21:12:56.206122] [DEBUG] [LOCAL ] BEPI: Loaded 2679 existing records from primary storage. [2025-09-16T21:12:56.209000] [DEBUG] [LOCAL ] BEP: Derivative data saved (1339 records). [2025-09-16T21:12:56.209103] [INFO ] [MAIN ] BEPI: Loaded 2679 primary data records. [2025-09-16T21:12:56.229973] [INFO ] [MAIN ] BEP: Successfully saved derivative data. [2025-09-16T21:12:56.275447] [DEBUG] [MAIN ] BEPC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:56.291536] [INFO ] [MAIN ] Derivative Progress: 197/2026 symbols completed. BEP took 1.0s. Estimated remaining: 9m 59s. Rate: 183.3 symbols/min [2025-09-16T21:12:56.292404] [INFO ] [MAIN ] BEPC: Generated 1339 derivative records from 34009 primary records. [2025-09-16T21:12:56.309922] [DEBUG] [LOCAL ] BEPC: Saving derivative data. [2025-09-16T21:12:56.327537] [INFO ] [MAIN ] BFAM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:56.393252] [DEBUG] [LOCAL ] BEPC: Derivative data saved (1339 records). [2025-09-16T21:12:56.465003] [INFO ] [MAIN ] BEPC: Successfully saved derivative data. [2025-09-16T21:12:56.507578] [INFO ] [MAIN ] Derivative Progress: 198/2026 symbols completed. BEPC took 1.2s. Estimated remaining: 9m 57s. Rate: 183.6 symbols/min [2025-09-16T21:12:56.509113] [INFO ] [MAIN ] BFK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:56.536719] [DEBUG] [LOCAL ] BFK: Loaded 9721 existing records from primary storage. [2025-09-16T21:12:56.537662] [INFO ] [MAIN ] BFK: Loaded 9721 primary data records. [2025-09-16T21:12:56.537428] [DEBUG] [LOCAL ] BFAM: Loaded 24751 existing records from primary storage. [2025-09-16T21:12:56.569070] [INFO ] [MAIN ] BFAM: Loaded 24751 primary data records. [2025-09-16T21:12:56.828007] [DEBUG] [MAIN ] BEPI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:56.890139] [INFO ] [MAIN ] BEPI: Generated 1339 derivative records from 2679 primary records. [2025-09-16T21:12:57.002622] [DEBUG] [LOCAL ] BEPI: Saving derivative data. [2025-09-16T21:12:57.101842] [DEBUG] [LOCAL ] BEPI: Derivative data saved (1339 records). [2025-09-16T21:12:57.103161] [INFO ] [MAIN ] BEPI: Successfully saved derivative data. [2025-09-16T21:12:57.105385] [INFO ] [MAIN ] Derivative Progress: 199/2026 symbols completed. BEPI took 0.9s. Estimated remaining: 9m 59s. Rate: 182.9 symbols/min [2025-09-16T21:12:57.106321] [INFO ] [MAIN ] BFS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:57.120182] [DEBUG] [LOCAL ] BFS: Loaded 6786 existing records from primary storage. [2025-09-16T21:12:57.123943] [INFO ] [MAIN ] BFS: Loaded 6786 primary data records. [2025-09-16T21:12:57.179914] [DEBUG] [MAIN ] BFK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:57.207300] [INFO ] [MAIN ] BFK: Generated 1339 derivative records from 9721 primary records. [2025-09-16T21:12:57.213485] [DEBUG] [LOCAL ] BFK: Saving derivative data. [2025-09-16T21:12:57.224618] [DEBUG] [MAIN ] BFAM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:57.259567] [INFO ] [MAIN ] BFAM: Generated 1339 derivative records from 24751 primary records. [2025-09-16T21:12:57.262068] [DEBUG] [LOCAL ] BFAM: Saving derivative data. [2025-09-16T21:12:57.326438] [DEBUG] [LOCAL ] BFAM: Derivative data saved (1339 records). [2025-09-16T21:12:57.350273] [INFO ] [MAIN ] BFAM: Successfully saved derivative data. [2025-09-16T21:12:57.355763] [INFO ] [MAIN ] Derivative Progress: 200/2026 symbols completed. BFAM took 1.0s. Estimated remaining: 9m 58s. Rate: 183.1 symbols/min [2025-09-16T21:12:57.454304] [DEBUG] [LOCAL ] BFK: Derivative data saved (1339 records). [2025-09-16T21:12:57.478482] [INFO ] [MAIN ] BFK: Successfully saved derivative data. [2025-09-16T21:12:57.481231] [INFO ] [MAIN ] Derivative Progress: 201/2026 symbols completed. BFK took 1.0s. Estimated remaining: 9m 56s. Rate: 183.7 symbols/min [2025-09-16T21:12:57.481525] [INFO ] [MAIN ] BFZ: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:57.481658] [INFO ] [MAIN ] BG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:57.493958] [DEBUG] [LOCAL ] BFZ: Loaded 8443 existing records from primary storage. [2025-09-16T21:12:57.494300] [INFO ] [MAIN ] BFZ: Loaded 8443 primary data records. [2025-09-16T21:12:57.671491] [DEBUG] [MAIN ] BFS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:57.701782] [INFO ] [MAIN ] BFS: Generated 1339 derivative records from 6786 primary records. [2025-09-16T21:12:57.779262] [DEBUG] [LOCAL ] BG: Loaded 37699 existing records from primary storage. [2025-09-16T21:12:57.707394] [DEBUG] [LOCAL ] BFS: Saving derivative data. [2025-09-16T21:12:57.790184] [INFO ] [MAIN ] BG: Loaded 37699 primary data records. [2025-09-16T21:12:57.896972] [DEBUG] [LOCAL ] BFS: Derivative data saved (1339 records). [2025-09-16T21:12:57.907523] [INFO ] [MAIN ] BFS: Successfully saved derivative data. [2025-09-16T21:12:57.909295] [INFO ] [MAIN ] Derivative Progress: 202/2026 symbols completed. BFS took 0.8s. Estimated remaining: 9m 57s. Rate: 183.4 symbols/min [2025-09-16T21:12:57.910291] [INFO ] [MAIN ] BGB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:58.088342] [DEBUG] [LOCAL ] BGB: Loaded 12351 existing records from primary storage. [2025-09-16T21:12:58.089722] [INFO ] [MAIN ] BGB: Loaded 12351 primary data records. [2025-09-16T21:12:58.173833] [DEBUG] [MAIN ] BFZ: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:58.192839] [INFO ] [MAIN ] BFZ: Generated 1339 derivative records from 8443 primary records. [2025-09-16T21:12:58.209363] [DEBUG] [LOCAL ] BFZ: Saving derivative data. [2025-09-16T21:12:58.294518] [DEBUG] [LOCAL ] BFZ: Derivative data saved (1339 records). [2025-09-16T21:12:58.297147] [INFO ] [MAIN ] BFZ: Successfully saved derivative data. [2025-09-16T21:12:58.299421] [INFO ] [MAIN ] Derivative Progress: 203/2026 symbols completed. BFZ took 0.8s. Estimated remaining: 9m 57s. Rate: 183.2 symbols/min [2025-09-16T21:12:58.382463] [INFO ] [MAIN ] BGH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:58.398786] [DEBUG] [MAIN ] BG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:58.399715] [INFO ] [MAIN ] BG: Generated 1339 derivative records from 37699 primary records. [2025-09-16T21:12:58.399909] [DEBUG] [LOCAL ] BG: Saving derivative data. [2025-09-16T21:12:58.419682] [DEBUG] [LOCAL ] BGH: Loaded 12163 existing records from primary storage. [2025-09-16T21:12:58.420329] [INFO ] [MAIN ] BGH: Loaded 12163 primary data records. [2025-09-16T21:12:58.457711] [DEBUG] [LOCAL ] BG: Derivative data saved (1339 records). [2025-09-16T21:12:58.476575] [INFO ] [MAIN ] BG: Successfully saved derivative data. [2025-09-16T21:12:58.503581] [INFO ] [MAIN ] Derivative Progress: 204/2026 symbols completed. BG took 1.0s. Estimated remaining: 9m 56s. Rate: 183.5 symbols/min [2025-09-16T21:12:58.525484] [INFO ] [MAIN ] BGR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:58.613820] [DEBUG] [MAIN ] BGB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:58.614756] [INFO ] [MAIN ] BGB: Generated 1339 derivative records from 12351 primary records. [2025-09-16T21:12:58.687953] [DEBUG] [LOCAL ] BGB: Saving derivative data. [2025-09-16T21:12:58.704018] [DEBUG] [LOCAL ] BGR: Loaded 9713 existing records from primary storage. [2025-09-16T21:12:58.704323] [INFO ] [MAIN ] BGR: Loaded 9713 primary data records. [2025-09-16T21:12:58.820131] [DEBUG] [LOCAL ] BGB: Derivative data saved (1339 records). [2025-09-16T21:12:58.823882] [INFO ] [MAIN ] BGB: Successfully saved derivative data. [2025-09-16T21:12:58.832003] [INFO ] [MAIN ] Derivative Progress: 205/2026 symbols completed. BGB took 0.9s. Estimated remaining: 9m 55s. Rate: 183.5 symbols/min [2025-09-16T21:12:58.868770] [INFO ] [MAIN ] BGS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:59.009147] [DEBUG] [MAIN ] BGH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:59.009942] [INFO ] [MAIN ] BGH: Generated 1339 derivative records from 12163 primary records. [2025-09-16T21:12:59.010894] [DEBUG] [LOCAL ] BGH: Saving derivative data. [2025-09-16T21:12:59.032948] [DEBUG] [LOCAL ] BGH: Derivative data saved (1339 records). [2025-09-16T21:12:59.033222] [INFO ] [MAIN ] BGH: Successfully saved derivative data. [2025-09-16T21:12:59.034920] [INFO ] [MAIN ] Derivative Progress: 206/2026 symbols completed. BGH took 0.7s. Estimated remaining: 9m 54s. Rate: 183.9 symbols/min [2025-09-16T21:12:59.035454] [INFO ] [MAIN ] BGSF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:59.054089] [DEBUG] [LOCAL ] BGSF: Loaded 4813 existing records from primary storage. [2025-09-16T21:12:59.054378] [DEBUG] [MAIN ] BGR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:59.059477] [INFO ] [MAIN ] BGR: Generated 1339 derivative records from 9713 primary records. [2025-09-16T21:12:59.059589] [INFO ] [MAIN ] BGSF: Loaded 4813 primary data records. [2025-09-16T21:12:59.069628] [DEBUG] [LOCAL ] BGR: Saving derivative data. [2025-09-16T21:12:59.127673] [DEBUG] [LOCAL ] BGS: Loaded 37704 existing records from primary storage. [2025-09-16T21:12:59.153592] [INFO ] [MAIN ] BGS: Loaded 37704 primary data records. [2025-09-16T21:12:59.322101] [DEBUG] [LOCAL ] BGR: Derivative data saved (1339 records). [2025-09-16T21:12:59.369761] [INFO ] [MAIN ] BGR: Successfully saved derivative data. [2025-09-16T21:12:59.371811] [INFO ] [MAIN ] Derivative Progress: 207/2026 symbols completed. BGR took 0.8s. Estimated remaining: 9m 54s. Rate: 183.8 symbols/min [2025-09-16T21:12:59.447460] [INFO ] [MAIN ] BGT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:12:59.670852] [DEBUG] [LOCAL ] BGT: Loaded 12384 existing records from primary storage. [2025-09-16T21:12:59.671185] [INFO ] [MAIN ] BGT: Loaded 12384 primary data records. [2025-09-16T21:12:59.962272] [DEBUG] [MAIN ] BGSF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:59.963294] [INFO ] [MAIN ] BGSF: Generated 1339 derivative records from 4813 primary records. [2025-09-16T21:12:59.964220] [DEBUG] [LOCAL ] BGSF: Saving derivative data. [2025-09-16T21:12:59.984918] [DEBUG] [LOCAL ] BGSF: Derivative data saved (1339 records). [2025-09-16T21:12:59.988707] [INFO ] [MAIN ] BGSF: Successfully saved derivative data. [2025-09-16T21:12:59.988938] [DEBUG] [MAIN ] BGS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:12:59.990828] [INFO ] [MAIN ] Derivative Progress: 208/2026 symbols completed. BGSF took 1.0s. Estimated remaining: 9m 56s. Rate: 183.1 symbols/min [2025-09-16T21:12:59.991908] [INFO ] [MAIN ] BGS: Generated 1339 derivative records from 37704 primary records. [2025-09-16T21:12:59.992853] [DEBUG] [LOCAL ] BGS: Saving derivative data. [2025-09-16T21:13:00.007036] [DEBUG] [LOCAL ] BGS: Derivative data saved (1339 records). [2025-09-16T21:13:00.007314] [INFO ] [MAIN ] BGS: Successfully saved derivative data. [2025-09-16T21:13:00.009974] [INFO ] [MAIN ] Derivative Progress: 209/2026 symbols completed. BGS took 1.1s. Estimated remaining: 9m 53s. Rate: 183.9 symbols/min [2025-09-16T21:13:00.020894] [DEBUG] [MAIN ] BGT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:00.021432] [INFO ] [MAIN ] BGT: Generated 1339 derivative records from 12384 primary records. [2025-09-16T21:13:00.021494] [DEBUG] [LOCAL ] BGT: Saving derivative data. [2025-09-16T21:13:00.033115] [DEBUG] [LOCAL ] BGT: Derivative data saved (1339 records). [2025-09-16T21:13:00.033185] [INFO ] [MAIN ] BGT: Successfully saved derivative data. [2025-09-16T21:13:00.035165] [INFO ] [MAIN ] Derivative Progress: 210/2026 symbols completed. BGT took 0.6s. Estimated remaining: 9m 50s. Rate: 184.7 symbols/min [2025-09-16T21:13:00.035585] [INFO ] [MAIN ] BGX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:00.035783] [INFO ] [MAIN ] BGY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:00.036342] [INFO ] [MAIN ] BH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:00.047028] [DEBUG] [LOCAL ] BGX: Loaded 7749 existing records from primary storage. [2025-09-16T21:13:00.047231] [INFO ] [MAIN ] BGX: Loaded 7749 primary data records. [2025-09-16T21:13:00.170958] [DEBUG] [LOCAL ] BGY: Loaded 16395 existing records from primary storage. [2025-09-16T21:13:00.176717] [DEBUG] [LOCAL ] BH: Loaded 13261 existing records from primary storage. [2025-09-16T21:13:00.192192] [INFO ] [MAIN ] BH: Loaded 13261 primary data records. [2025-09-16T21:13:00.192264] [INFO ] [MAIN ] BGY: Loaded 16395 primary data records. [2025-09-16T21:13:00.899975] [DEBUG] [MAIN ] BGX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:00.901611] [INFO ] [MAIN ] BGX: Generated 1339 derivative records from 7749 primary records. [2025-09-16T21:13:00.902752] [DEBUG] [LOCAL ] BGX: Saving derivative data. [2025-09-16T21:13:00.923680] [DEBUG] [MAIN ] BH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:00.925781] [INFO ] [MAIN ] BH: Generated 1339 derivative records from 13261 primary records. [2025-09-16T21:13:00.926941] [DEBUG] [LOCAL ] BH: Saving derivative data. [2025-09-16T21:13:00.928126] [DEBUG] [LOCAL ] BGX: Derivative data saved (1339 records). [2025-09-16T21:13:00.933655] [INFO ] [MAIN ] BGX: Successfully saved derivative data. [2025-09-16T21:13:00.938125] [INFO ] [MAIN ] Derivative Progress: 211/2026 symbols completed. BGX took 0.9s. Estimated remaining: 9m 55s. Rate: 183.2 symbols/min [2025-09-16T21:13:00.949122] [INFO ] [MAIN ] BHC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:00.950267] [DEBUG] [MAIN ] BGY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:00.951751] [INFO ] [MAIN ] BGY: Generated 1339 derivative records from 16395 primary records. [2025-09-16T21:13:00.952558] [DEBUG] [LOCAL ] BGY: Saving derivative data. [2025-09-16T21:13:00.952517] [DEBUG] [LOCAL ] BH: Derivative data saved (1339 records). [2025-09-16T21:13:00.953230] [INFO ] [MAIN ] BH: Successfully saved derivative data. [2025-09-16T21:13:00.963131] [INFO ] [MAIN ] Derivative Progress: 212/2026 symbols completed. BH took 0.9s. Estimated remaining: 9m 52s. Rate: 184.0 symbols/min [2025-09-16T21:13:00.963685] [INFO ] [MAIN ] BHE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:00.967194] [DEBUG] [LOCAL ] BGY: Derivative data saved (1339 records). [2025-09-16T21:13:00.967279] [INFO ] [MAIN ] BGY: Successfully saved derivative data. [2025-09-16T21:13:00.969299] [INFO ] [MAIN ] Derivative Progress: 213/2026 symbols completed. BGY took 0.9s. Estimated remaining: 9m 49s. Rate: 184.8 symbols/min [2025-09-16T21:13:00.969580] [INFO ] [MAIN ] BHK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:00.998560] [DEBUG] [LOCAL ] BHE: Loaded 17617 existing records from primary storage. [2025-09-16T21:13:00.998825] [INFO ] [MAIN ] BHE: Loaded 17617 primary data records. [2025-09-16T21:13:01.121154] [DEBUG] [LOCAL ] BHK: Loaded 18457 existing records from primary storage. [2025-09-16T21:13:01.121358] [INFO ] [MAIN ] BHK: Loaded 18457 primary data records. [2025-09-16T21:13:01.121963] [DEBUG] [LOCAL ] BHC: Loaded 34553 existing records from primary storage. [2025-09-16T21:13:01.122288] [INFO ] [MAIN ] BHC: Loaded 34553 primary data records. [2025-09-16T21:13:01.882677] [DEBUG] [MAIN ] BHE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:01.883470] [INFO ] [MAIN ] BHE: Generated 1339 derivative records from 17617 primary records. [2025-09-16T21:13:01.883968] [DEBUG] [LOCAL ] BHE: Saving derivative data. [2025-09-16T21:13:01.899536] [DEBUG] [LOCAL ] BHE: Derivative data saved (1339 records). [2025-09-16T21:13:01.899824] [INFO ] [MAIN ] BHE: Successfully saved derivative data. [2025-09-16T21:13:01.901562] [INFO ] [MAIN ] Derivative Progress: 214/2026 symbols completed. BHE took 0.9s. Estimated remaining: 9m 53s. Rate: 183.2 symbols/min [2025-09-16T21:13:01.913162] [INFO ] [MAIN ] BHP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:01.913574] [DEBUG] [MAIN ] BHK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:01.924103] [INFO ] [MAIN ] BHK: Generated 1339 derivative records from 18457 primary records. [2025-09-16T21:13:01.924398] [DEBUG] [MAIN ] BHC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:01.924915] [DEBUG] [LOCAL ] BHK: Saving derivative data. [2025-09-16T21:13:01.925045] [INFO ] [MAIN ] BHC: Generated 1339 derivative records from 34553 primary records. [2025-09-16T21:13:01.925745] [DEBUG] [LOCAL ] BHC: Saving derivative data. [2025-09-16T21:13:01.948494] [DEBUG] [LOCAL ] BHC: Derivative data saved (1339 records). [2025-09-16T21:13:01.952346] [INFO ] [MAIN ] BHC: Successfully saved derivative data. [2025-09-16T21:13:01.952840] [DEBUG] [LOCAL ] BHK: Derivative data saved (1339 records). [2025-09-16T21:13:01.955198] [INFO ] [MAIN ] BHK: Successfully saved derivative data. [2025-09-16T21:13:01.955110] [INFO ] [MAIN ] Derivative Progress: 215/2026 symbols completed. BHC took 1.0s. Estimated remaining: 9m 51s. Rate: 183.9 symbols/min [2025-09-16T21:13:01.957366] [INFO ] [MAIN ] BHR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:01.957671] [INFO ] [MAIN ] Derivative Progress: 216/2026 symbols completed. BHK took 1.0s. Estimated remaining: 9m 48s. Rate: 184.8 symbols/min [2025-09-16T21:13:01.958337] [INFO ] [MAIN ] BHVN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:01.985313] [DEBUG] [LOCAL ] BHR: Loaded 15316 existing records from primary storage. [2025-09-16T21:13:01.985592] [INFO ] [MAIN ] BHR: Loaded 15316 primary data records. [2025-09-16T21:13:02.062947] [DEBUG] [LOCAL ] BHP: Loaded 39761 existing records from primary storage. [2025-09-16T21:13:02.100595] [INFO ] [MAIN ] BHP: Loaded 39761 primary data records. [2025-09-16T21:13:02.392544] [DEBUG] [LOCAL ] BHVN: Loaded 37493 existing records from primary storage. [2025-09-16T21:13:02.398332] [INFO ] [MAIN ] BHVN: Loaded 37493 primary data records. [2025-09-16T21:13:02.832192] [DEBUG] [MAIN ] BHR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:02.833106] [INFO ] [MAIN ] BHR: Generated 1339 derivative records from 15316 primary records. [2025-09-16T21:13:02.833288] [DEBUG] [LOCAL ] BHR: Saving derivative data. [2025-09-16T21:13:02.857781] [DEBUG] [LOCAL ] BHR: Derivative data saved (1339 records). [2025-09-16T21:13:02.858135] [DEBUG] [MAIN ] BHP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:02.858969] [INFO ] [MAIN ] BHP: Generated 1339 derivative records from 39761 primary records. [2025-09-16T21:13:02.859048] [DEBUG] [LOCAL ] BHP: Saving derivative data. [2025-09-16T21:13:02.858191] [INFO ] [MAIN ] BHR: Successfully saved derivative data. [2025-09-16T21:13:02.861690] [INFO ] [MAIN ] Derivative Progress: 217/2026 symbols completed. BHR took 0.9s. Estimated remaining: 9m 52s. Rate: 183.3 symbols/min [2025-09-16T21:13:02.861938] [INFO ] [MAIN ] BILL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:02.884496] [DEBUG] [MAIN ] BHVN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:02.885888] [DEBUG] [LOCAL ] BHP: Derivative data saved (1339 records). [2025-09-16T21:13:02.886051] [INFO ] [MAIN ] BHP: Successfully saved derivative data. [2025-09-16T21:13:02.886805] [INFO ] [MAIN ] BHVN: Generated 1339 derivative records from 37493 primary records. [2025-09-16T21:13:02.888794] [DEBUG] [LOCAL ] BHVN: Saving derivative data. [2025-09-16T21:13:02.888699] [INFO ] [MAIN ] Derivative Progress: 218/2026 symbols completed. BHP took 1.0s. Estimated remaining: 9m 49s. Rate: 184.0 symbols/min [2025-09-16T21:13:02.889791] [INFO ] [MAIN ] BIO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:02.903460] [DEBUG] [LOCAL ] BHVN: Derivative data saved (1339 records). [2025-09-16T21:13:02.903595] [INFO ] [MAIN ] BHVN: Successfully saved derivative data. [2025-09-16T21:13:02.905502] [INFO ] [MAIN ] Derivative Progress: 219/2026 symbols completed. BHVN took 0.9s. Estimated remaining: 9m 47s. Rate: 184.8 symbols/min [2025-09-16T21:13:02.905867] [INFO ] [MAIN ] BIP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:02.929533] [DEBUG] [LOCAL ] BIO: Loaded 18405 existing records from primary storage. [2025-09-16T21:13:02.930285] [INFO ] [MAIN ] BIO: Loaded 18405 primary data records. [2025-09-16T21:13:03.005849] [DEBUG] [LOCAL ] BILL: Loaded 39007 existing records from primary storage. [2025-09-16T21:13:03.022748] [INFO ] [MAIN ] BILL: Loaded 39007 primary data records. [2025-09-16T21:13:03.202931] [DEBUG] [LOCAL ] BIP: Loaded 28099 existing records from primary storage. [2025-09-16T21:13:03.239304] [INFO ] [MAIN ] BIP: Loaded 28099 primary data records. [2025-09-16T21:13:03.786160] [DEBUG] [MAIN ] BIO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:03.788012] [INFO ] [MAIN ] BIO: Generated 1339 derivative records from 18405 primary records. [2025-09-16T21:13:03.788919] [DEBUG] [LOCAL ] BIO: Saving derivative data. [2025-09-16T21:13:03.810073] [DEBUG] [MAIN ] BILL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:03.811141] [INFO ] [MAIN ] BILL: Generated 1339 derivative records from 39007 primary records. [2025-09-16T21:13:03.811707] [DEBUG] [LOCAL ] BILL: Saving derivative data. [2025-09-16T21:13:03.824105] [DEBUG] [LOCAL ] BIO: Derivative data saved (1339 records). [2025-09-16T21:13:03.824491] [INFO ] [MAIN ] BIO: Successfully saved derivative data. [2025-09-16T21:13:03.827207] [INFO ] [MAIN ] Derivative Progress: 220/2026 symbols completed. BIO took 0.9s. Estimated remaining: 9m 51s. Rate: 183.3 symbols/min [2025-09-16T21:13:03.827978] [INFO ] [MAIN ] BIPC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:03.829267] [DEBUG] [LOCAL ] BILL: Derivative data saved (1339 records). [2025-09-16T21:13:03.830077] [INFO ] [MAIN ] BILL: Successfully saved derivative data. [2025-09-16T21:13:03.832288] [INFO ] [MAIN ] Derivative Progress: 221/2026 symbols completed. BILL took 1.0s. Estimated remaining: 9m 48s. Rate: 184.1 symbols/min [2025-09-16T21:13:03.833349] [INFO ] [MAIN ] BIPH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:03.844950] [DEBUG] [MAIN ] BIP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:03.845863] [INFO ] [MAIN ] BIP: Generated 1339 derivative records from 28099 primary records. [2025-09-16T21:13:03.847912] [DEBUG] [LOCAL ] BIPH: Loaded 1585 existing records from primary storage. [2025-09-16T21:13:03.848036] [DEBUG] [LOCAL ] BIP: Saving derivative data. [2025-09-16T21:13:03.848171] [INFO ] [MAIN ] BIPH: Loaded 1585 primary data records. [2025-09-16T21:13:03.980367] [DEBUG] [LOCAL ] BIP: Derivative data saved (1339 records). [2025-09-16T21:13:03.980524] [INFO ] [MAIN ] BIP: Successfully saved derivative data. [2025-09-16T21:13:04.009539] [INFO ] [MAIN ] Derivative Progress: 222/2026 symbols completed. BIP took 1.1s. Estimated remaining: 9m 47s. Rate: 184.5 symbols/min [2025-09-16T21:13:04.010288] [DEBUG] [LOCAL ] BIPC: Loaded 30211 existing records from primary storage. [2025-09-16T21:13:04.025238] [INFO ] [MAIN ] BIPI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:04.025352] [INFO ] [MAIN ] BIPC: Loaded 30211 primary data records. [2025-09-16T21:13:04.100478] [DEBUG] [LOCAL ] BIPI: Loaded 2076 existing records from primary storage. [2025-09-16T21:13:04.146100] [INFO ] [MAIN ] BIPI: Loaded 2076 primary data records. [2025-09-16T21:13:04.745375] [DEBUG] [MAIN ] BIPH: Filtered 5181 bins outside market hours, 5780 incomplete bins [2025-09-16T21:13:04.747516] [INFO ] [MAIN ] BIPH: Generated 1338 derivative records from 1585 primary records. [2025-09-16T21:13:04.747799] [DEBUG] [LOCAL ] BIPH: Saving derivative data. [2025-09-16T21:13:04.769920] [DEBUG] [LOCAL ] BIPH: Derivative data saved (1338 records). [2025-09-16T21:13:04.770852] [INFO ] [MAIN ] BIPH: Successfully saved derivative data. [2025-09-16T21:13:04.770241] [DEBUG] [MAIN ] BIPC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:04.772719] [INFO ] [MAIN ] Derivative Progress: 223/2026 symbols completed. BIPH took 0.9s. Estimated remaining: 9m 50s. Rate: 183.4 symbols/min [2025-09-16T21:13:04.773464] [INFO ] [MAIN ] BIPC: Generated 1339 derivative records from 30211 primary records. [2025-09-16T21:13:04.773854] [DEBUG] [LOCAL ] BIPC: Saving derivative data. [2025-09-16T21:13:04.783548] [DEBUG] [MAIN ] BIPI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:04.789582] [INFO ] [MAIN ] BIPI: Generated 1339 derivative records from 2076 primary records. [2025-09-16T21:13:04.792616] [DEBUG] [LOCAL ] BIPI: Saving derivative data. [2025-09-16T21:13:04.805575] [DEBUG] [LOCAL ] BIPI: Derivative data saved (1339 records). [2025-09-16T21:13:04.806057] [INFO ] [MAIN ] BIPI: Successfully saved derivative data. [2025-09-16T21:13:04.806367] [DEBUG] [LOCAL ] BIPC: Derivative data saved (1339 records). [2025-09-16T21:13:04.808476] [INFO ] [MAIN ] Derivative Progress: 224/2026 symbols completed. BIPI took 0.8s. Estimated remaining: 9m 47s. Rate: 184.1 symbols/min [2025-09-16T21:13:04.806467] [INFO ] [MAIN ] BIPC: Successfully saved derivative data. [2025-09-16T21:13:04.810735] [INFO ] [MAIN ] Derivative Progress: 225/2026 symbols completed. BIPC took 1.0s. Estimated remaining: 9m 44s. Rate: 184.9 symbols/min [2025-09-16T21:13:04.811223] [INFO ] [MAIN ] BIRK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:04.811326] [INFO ] [MAIN ] BIT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:04.811136] [INFO ] [MAIN ] BIPJ: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:04.816782] [DEBUG] [LOCAL ] BIPJ: Loaded 2171 existing records from primary storage. [2025-09-16T21:13:04.817014] [INFO ] [MAIN ] BIPJ: Loaded 2171 primary data records. [2025-09-16T21:13:04.956792] [DEBUG] [LOCAL ] BIT: Loaded 16575 existing records from primary storage. [2025-09-16T21:13:05.023009] [INFO ] [MAIN ] BIT: Loaded 16575 primary data records. [2025-09-16T21:13:05.180814] [DEBUG] [LOCAL ] BIRK: Loaded 37975 existing records from primary storage. [2025-09-16T21:13:05.208834] [INFO ] [MAIN ] BIRK: Loaded 37975 primary data records. [2025-09-16T21:13:05.650687] [DEBUG] [MAIN ] BIPJ: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:05.652175] [INFO ] [MAIN ] BIPJ: Generated 1339 derivative records from 2171 primary records. [2025-09-16T21:13:05.652890] [DEBUG] [LOCAL ] BIPJ: Saving derivative data. [2025-09-16T21:13:05.665403] [DEBUG] [LOCAL ] BIPJ: Derivative data saved (1339 records). [2025-09-16T21:13:05.665519] [INFO ] [MAIN ] BIPJ: Successfully saved derivative data. [2025-09-16T21:13:05.667436] [INFO ] [MAIN ] Derivative Progress: 226/2026 symbols completed. BIPJ took 0.9s. Estimated remaining: 9m 48s. Rate: 183.6 symbols/min [2025-09-16T21:13:05.667656] [INFO ] [MAIN ] BJ: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:05.695691] [DEBUG] [MAIN ] BIT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:05.696548] [INFO ] [MAIN ] BIT: Generated 1339 derivative records from 16575 primary records. [2025-09-16T21:13:05.696663] [DEBUG] [LOCAL ] BIT: Saving derivative data. [2025-09-16T21:13:05.695975] [DEBUG] [MAIN ] BIRK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:05.697811] [INFO ] [MAIN ] BIRK: Generated 1339 derivative records from 37975 primary records. [2025-09-16T21:13:05.698061] [DEBUG] [LOCAL ] BIRK: Saving derivative data. [2025-09-16T21:13:05.729836] [DEBUG] [LOCAL ] BIRK: Derivative data saved (1339 records). [2025-09-16T21:13:05.730347] [INFO ] [MAIN ] BIRK: Successfully saved derivative data. [2025-09-16T21:13:05.730298] [DEBUG] [LOCAL ] BIT: Derivative data saved (1339 records). [2025-09-16T21:13:05.732433] [INFO ] [MAIN ] Derivative Progress: 227/2026 symbols completed. BIRK took 0.9s. Estimated remaining: 9m 46s. Rate: 184.3 symbols/min [2025-09-16T21:13:05.730442] [INFO ] [MAIN ] BIT: Successfully saved derivative data. [2025-09-16T21:13:05.732671] [INFO ] [MAIN ] BKD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:05.734387] [INFO ] [MAIN ] Derivative Progress: 228/2026 symbols completed. BIT took 0.9s. Estimated remaining: 9m 43s. Rate: 185.1 symbols/min [2025-09-16T21:13:05.734912] [INFO ] [MAIN ] BKE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:05.750367] [DEBUG] [LOCAL ] BJ: Loaded 38269 existing records from primary storage. [2025-09-16T21:13:05.750561] [INFO ] [MAIN ] BJ: Loaded 38269 primary data records. [2025-09-16T21:13:06.033073] [DEBUG] [LOCAL ] BKE: Loaded 25000 existing records from primary storage. [2025-09-16T21:13:06.043749] [INFO ] [MAIN ] BKE: Loaded 25000 primary data records. [2025-09-16T21:13:06.055792] [DEBUG] [LOCAL ] BKD: Loaded 37399 existing records from primary storage. [2025-09-16T21:13:06.082189] [INFO ] [MAIN ] BKD: Loaded 37399 primary data records. [2025-09-16T21:13:06.621299] [DEBUG] [MAIN ] BJ: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:06.622471] [INFO ] [MAIN ] BJ: Generated 1339 derivative records from 38269 primary records. [2025-09-16T21:13:06.622982] [DEBUG] [LOCAL ] BJ: Saving derivative data. [2025-09-16T21:13:06.639430] [DEBUG] [LOCAL ] BJ: Derivative data saved (1339 records). [2025-09-16T21:13:06.639793] [INFO ] [MAIN ] BJ: Successfully saved derivative data. [2025-09-16T21:13:06.642242] [INFO ] [MAIN ] Derivative Progress: 229/2026 symbols completed. BJ took 1.0s. Estimated remaining: 9m 47s. Rate: 183.6 symbols/min [2025-09-16T21:13:06.642836] [INFO ] [MAIN ] BKH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:06.667790] [DEBUG] [MAIN ] BKD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:06.668048] [DEBUG] [MAIN ] BKE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:06.668823] [INFO ] [MAIN ] BKD: Generated 1339 derivative records from 37399 primary records. [2025-09-16T21:13:06.669405] [INFO ] [MAIN ] BKE: Generated 1339 derivative records from 25000 primary records. [2025-09-16T21:13:06.669557] [DEBUG] [LOCAL ] BKD: Saving derivative data. [2025-09-16T21:13:06.669605] [DEBUG] [LOCAL ] BKE: Saving derivative data. [2025-09-16T21:13:06.698785] [DEBUG] [LOCAL ] BKE: Derivative data saved (1339 records). [2025-09-16T21:13:06.700231] [INFO ] [MAIN ] BKE: Successfully saved derivative data. [2025-09-16T21:13:06.702483] [INFO ] [MAIN ] Derivative Progress: 230/2026 symbols completed. BKE took 1.0s. Estimated remaining: 9m 45s. Rate: 184.3 symbols/min [2025-09-16T21:13:06.702860] [INFO ] [MAIN ] BKKT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:06.702674] [DEBUG] [LOCAL ] BKD: Derivative data saved (1339 records). [2025-09-16T21:13:06.703281] [INFO ] [MAIN ] BKD: Successfully saved derivative data. [2025-09-16T21:13:06.705947] [INFO ] [MAIN ] Derivative Progress: 231/2026 symbols completed. BKD took 1.0s. Estimated remaining: 9m 42s. Rate: 185.1 symbols/min [2025-09-16T21:13:06.706632] [INFO ] [MAIN ] BKSY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:06.716176] [DEBUG] [LOCAL ] BKH: Loaded 27582 existing records from primary storage. [2025-09-16T21:13:06.716312] [INFO ] [MAIN ] BKH: Loaded 27582 primary data records. [2025-09-16T21:13:06.923817] [DEBUG] [LOCAL ] BKKT: Loaded 26158 existing records from primary storage. [2025-09-16T21:13:07.006412] [INFO ] [MAIN ] BKKT: Loaded 26158 primary data records. [2025-09-16T21:13:07.121590] [DEBUG] [LOCAL ] BKSY: Loaded 36256 existing records from primary storage. [2025-09-16T21:13:07.127929] [INFO ] [MAIN ] BKSY: Loaded 36256 primary data records. [2025-09-16T21:13:07.575844] [DEBUG] [MAIN ] BKH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:07.577448] [INFO ] [MAIN ] BKH: Generated 1339 derivative records from 27582 primary records. [2025-09-16T21:13:07.577557] [DEBUG] [LOCAL ] BKH: Saving derivative data. [2025-09-16T21:13:07.593987] [DEBUG] [LOCAL ] BKH: Derivative data saved (1339 records). [2025-09-16T21:13:07.594122] [INFO ] [MAIN ] BKH: Successfully saved derivative data. [2025-09-16T21:13:07.596222] [INFO ] [MAIN ] Derivative Progress: 232/2026 symbols completed. BKH took 1.0s. Estimated remaining: 9m 46s. Rate: 183.7 symbols/min [2025-09-16T21:13:07.596805] [INFO ] [MAIN ] BKT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:07.606912] [DEBUG] [MAIN ] BKKT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:07.607834] [INFO ] [MAIN ] BKKT: Generated 1339 derivative records from 26158 primary records. [2025-09-16T21:13:07.608022] [DEBUG] [LOCAL ] BKKT: Saving derivative data. [2025-09-16T21:13:07.621015] [DEBUG] [LOCAL ] BKKT: Derivative data saved (1339 records). [2025-09-16T21:13:07.622878] [INFO ] [MAIN ] BKKT: Successfully saved derivative data. [2025-09-16T21:13:07.624538] [INFO ] [MAIN ] Derivative Progress: 233/2026 symbols completed. BKKT took 0.9s. Estimated remaining: 9m 43s. Rate: 184.4 symbols/min [2025-09-16T21:13:07.624859] [INFO ] [MAIN ] BKU: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:07.631739] [DEBUG] [LOCAL ] BKT: Loaded 8064 existing records from primary storage. [2025-09-16T21:13:07.632049] [INFO ] [MAIN ] BKT: Loaded 8064 primary data records. [2025-09-16T21:13:07.653121] [DEBUG] [MAIN ] BKSY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:07.685904] [INFO ] [MAIN ] BKSY: Generated 1339 derivative records from 36256 primary records. [2025-09-16T21:13:07.711737] [DEBUG] [LOCAL ] BKSY: Saving derivative data. [2025-09-16T21:13:07.831853] [DEBUG] [LOCAL ] BKSY: Derivative data saved (1339 records). [2025-09-16T21:13:07.851910] [INFO ] [MAIN ] BKSY: Successfully saved derivative data. [2025-09-16T21:13:07.855998] [DEBUG] [LOCAL ] BKU: Loaded 30997 existing records from primary storage. [2025-09-16T21:13:07.859359] [INFO ] [MAIN ] Derivative Progress: 234/2026 symbols completed. BKSY took 1.2s. Estimated remaining: 9m 42s. Rate: 184.6 symbols/min [2025-09-16T21:13:07.859910] [INFO ] [MAIN ] BKV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:07.859835] [INFO ] [MAIN ] BKU: Loaded 30997 primary data records. [2025-09-16T21:13:08.135047] [DEBUG] [LOCAL ] BKV: Loaded 21066 existing records from primary storage. [2025-09-16T21:13:08.211060] [INFO ] [MAIN ] BKV: Loaded 21066 primary data records. [2025-09-16T21:13:08.392005] [DEBUG] [MAIN ] BKT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:08.419588] [INFO ] [MAIN ] BKT: Generated 1339 derivative records from 8064 primary records. [2025-09-16T21:13:08.419900] [DEBUG] [LOCAL ] BKT: Saving derivative data. [2025-09-16T21:13:08.559781] [DEBUG] [LOCAL ] BKT: Derivative data saved (1339 records). [2025-09-16T21:13:08.560022] [INFO ] [MAIN ] BKT: Successfully saved derivative data. [2025-09-16T21:13:08.563292] [INFO ] [MAIN ] Derivative Progress: 235/2026 symbols completed. BKT took 1.0s. Estimated remaining: 9m 45s. Rate: 183.7 symbols/min [2025-09-16T21:13:08.563709] [INFO ] [MAIN ] BLCO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:08.577890] [DEBUG] [MAIN ] BKU: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:08.579431] [INFO ] [MAIN ] BKU: Generated 1339 derivative records from 30997 primary records. [2025-09-16T21:13:08.579802] [DEBUG] [LOCAL ] BKU: Saving derivative data. [2025-09-16T21:13:08.600907] [DEBUG] [LOCAL ] BKU: Derivative data saved (1339 records). [2025-09-16T21:13:08.601032] [INFO ] [MAIN ] BKU: Successfully saved derivative data. [2025-09-16T21:13:08.602992] [INFO ] [MAIN ] Derivative Progress: 236/2026 symbols completed. BKU took 1.0s. Estimated remaining: 9m 42s. Rate: 184.4 symbols/min [2025-09-16T21:13:08.603396] [INFO ] [MAIN ] BLD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:08.623473] [DEBUG] [MAIN ] BKV: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:08.625059] [INFO ] [MAIN ] BKV: Generated 1339 derivative records from 21066 primary records. [2025-09-16T21:13:08.625217] [DEBUG] [LOCAL ] BKV: Saving derivative data. [2025-09-16T21:13:08.625967] [DEBUG] [LOCAL ] BLCO: Loaded 26549 existing records from primary storage. [2025-09-16T21:13:08.626263] [INFO ] [MAIN ] BLCO: Loaded 26549 primary data records. [2025-09-16T21:13:08.712333] [DEBUG] [LOCAL ] BKV: Derivative data saved (1339 records). [2025-09-16T21:13:08.724607] [INFO ] [MAIN ] BKV: Successfully saved derivative data. [2025-09-16T21:13:08.750552] [INFO ] [MAIN ] Derivative Progress: 237/2026 symbols completed. BKV took 0.9s. Estimated remaining: 9m 41s. Rate: 184.8 symbols/min [2025-09-16T21:13:08.751307] [INFO ] [MAIN ] BLDR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:08.751118] [DEBUG] [LOCAL ] BLD: Loaded 20558 existing records from primary storage. [2025-09-16T21:13:08.755001] [INFO ] [MAIN ] BLD: Loaded 20558 primary data records. [2025-09-16T21:13:09.202899] [DEBUG] [LOCAL ] BLDR: Loaded 38691 existing records from primary storage. [2025-09-16T21:13:09.203988] [INFO ] [MAIN ] BLDR: Loaded 38691 primary data records. [2025-09-16T21:13:09.481686] [DEBUG] [MAIN ] BLCO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:09.483197] [INFO ] [MAIN ] BLCO: Generated 1339 derivative records from 26549 primary records. [2025-09-16T21:13:09.483322] [DEBUG] [LOCAL ] BLCO: Saving derivative data. [2025-09-16T21:13:09.497526] [DEBUG] [LOCAL ] BLCO: Derivative data saved (1339 records). [2025-09-16T21:13:09.497884] [INFO ] [MAIN ] BLCO: Successfully saved derivative data. [2025-09-16T21:13:09.499656] [INFO ] [MAIN ] Derivative Progress: 238/2026 symbols completed. BLCO took 0.9s. Estimated remaining: 9m 44s. Rate: 183.8 symbols/min [2025-09-16T21:13:09.514056] [DEBUG] [MAIN ] BLD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:09.515003] [INFO ] [MAIN ] BLD: Generated 1339 derivative records from 20558 primary records. [2025-09-16T21:13:09.515197] [DEBUG] [LOCAL ] BLD: Saving derivative data. [2025-09-16T21:13:09.528849] [DEBUG] [LOCAL ] BLD: Derivative data saved (1339 records). [2025-09-16T21:13:09.529062] [INFO ] [MAIN ] BLD: Successfully saved derivative data. [2025-09-16T21:13:09.530946] [INFO ] [MAIN ] Derivative Progress: 239/2026 symbols completed. BLD took 0.9s. Estimated remaining: 9m 41s. Rate: 184.5 symbols/min [2025-09-16T21:13:09.542477] [DEBUG] [MAIN ] BLDR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:09.543069] [INFO ] [MAIN ] BLDR: Generated 1339 derivative records from 38691 primary records. [2025-09-16T21:13:09.543129] [DEBUG] [LOCAL ] BLDR: Saving derivative data. [2025-09-16T21:13:09.554981] [DEBUG] [LOCAL ] BLDR: Derivative data saved (1339 records). [2025-09-16T21:13:09.555039] [INFO ] [MAIN ] BLDR: Successfully saved derivative data. [2025-09-16T21:13:09.557604] [INFO ] [MAIN ] Derivative Progress: 240/2026 symbols completed. BLDR took 0.8s. Estimated remaining: 9m 39s. Rate: 185.2 symbols/min [2025-09-16T21:13:09.558236] [INFO ] [MAIN ] BLND: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:09.558420] [INFO ] [MAIN ] BLW: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:09.558083] [INFO ] [MAIN ] BLE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:09.577721] [DEBUG] [LOCAL ] BLW: Loaded 9090 existing records from primary storage. [2025-09-16T21:13:09.577495] [DEBUG] [LOCAL ] BLE: Loaded 10217 existing records from primary storage. [2025-09-16T21:13:09.577856] [INFO ] [MAIN ] BLE: Loaded 10217 primary data records. [2025-09-16T21:13:09.577901] [INFO ] [MAIN ] BLW: Loaded 9090 primary data records. [2025-09-16T21:13:09.820537] [DEBUG] [LOCAL ] BLND: Loaded 36409 existing records from primary storage. [2025-09-16T21:13:09.858185] [INFO ] [MAIN ] BLND: Loaded 36409 primary data records. [2025-09-16T21:13:10.416529] [DEBUG] [MAIN ] BLE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:10.417473] [INFO ] [MAIN ] BLE: Generated 1339 derivative records from 10217 primary records. [2025-09-16T21:13:10.418566] [DEBUG] [LOCAL ] BLE: Saving derivative data. [2025-09-16T21:13:10.434038] [DEBUG] [LOCAL ] BLE: Derivative data saved (1339 records). [2025-09-16T21:13:10.434421] [INFO ] [MAIN ] BLE: Successfully saved derivative data. [2025-09-16T21:13:10.446223] [INFO ] [MAIN ] Derivative Progress: 241/2026 symbols completed. BLE took 0.9s. Estimated remaining: 9m 42s. Rate: 183.9 symbols/min [2025-09-16T21:13:10.446902] [INFO ] [MAIN ] BMA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:10.446661] [DEBUG] [MAIN ] BLW: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:10.448158] [INFO ] [MAIN ] BLW: Generated 1339 derivative records from 9090 primary records. [2025-09-16T21:13:10.448531] [DEBUG] [LOCAL ] BLW: Saving derivative data. [2025-09-16T21:13:10.461315] [DEBUG] [LOCAL ] BLW: Derivative data saved (1339 records). [2025-09-16T21:13:10.462211] [INFO ] [MAIN ] BLW: Successfully saved derivative data. [2025-09-16T21:13:10.465427] [INFO ] [MAIN ] Derivative Progress: 242/2026 symbols completed. BLW took 0.9s. Estimated remaining: 9m 40s. Rate: 184.6 symbols/min [2025-09-16T21:13:10.465864] [INFO ] [MAIN ] BME: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:10.476076] [DEBUG] [MAIN ] BLND: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:10.476765] [INFO ] [MAIN ] BLND: Generated 1339 derivative records from 36409 primary records. [2025-09-16T21:13:10.476993] [DEBUG] [LOCAL ] BLND: Saving derivative data. [2025-09-16T21:13:10.498549] [DEBUG] [LOCAL ] BLND: Derivative data saved (1339 records). [2025-09-16T21:13:10.510300] [INFO ] [MAIN ] BLND: Successfully saved derivative data. [2025-09-16T21:13:10.513506] [INFO ] [MAIN ] Derivative Progress: 243/2026 symbols completed. BLND took 1.0s. Estimated remaining: 9m 37s. Rate: 185.3 symbols/min [2025-09-16T21:13:10.514251] [INFO ] [MAIN ] BMEZ: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:10.514071] [DEBUG] [LOCAL ] BMA: Loaded 25533 existing records from primary storage. [2025-09-16T21:13:10.515191] [INFO ] [MAIN ] BMA: Loaded 25533 primary data records. [2025-09-16T21:13:10.514739] [DEBUG] [LOCAL ] BME: Loaded 8162 existing records from primary storage. [2025-09-16T21:13:10.515446] [INFO ] [MAIN ] BME: Loaded 8162 primary data records. [2025-09-16T21:13:10.818569] [DEBUG] [LOCAL ] BMEZ: Loaded 17832 existing records from primary storage. [2025-09-16T21:13:10.885765] [INFO ] [MAIN ] BMEZ: Loaded 17832 primary data records. [2025-09-16T21:13:11.393829] [DEBUG] [MAIN ] BMA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:11.403486] [INFO ] [MAIN ] BMA: Generated 1339 derivative records from 25533 primary records. [2025-09-16T21:13:11.404775] [DEBUG] [LOCAL ] BMA: Saving derivative data. [2025-09-16T21:13:11.404733] [DEBUG] [MAIN ] BME: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:11.405722] [INFO ] [MAIN ] BME: Generated 1339 derivative records from 8162 primary records. [2025-09-16T21:13:11.406102] [DEBUG] [LOCAL ] BME: Saving derivative data. [2025-09-16T21:13:11.427327] [DEBUG] [LOCAL ] BMA: Derivative data saved (1339 records). [2025-09-16T21:13:11.428750] [INFO ] [MAIN ] BMA: Successfully saved derivative data. [2025-09-16T21:13:11.429028] [DEBUG] [LOCAL ] BME: Derivative data saved (1339 records). [2025-09-16T21:13:11.429181] [INFO ] [MAIN ] BME: Successfully saved derivative data. [2025-09-16T21:13:11.430967] [INFO ] [MAIN ] Derivative Progress: 244/2026 symbols completed. BMA took 1.0s. Estimated remaining: 9m 41s. Rate: 183.9 symbols/min [2025-09-16T21:13:11.431298] [INFO ] [MAIN ] BMY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:11.433073] [INFO ] [MAIN ] Derivative Progress: 245/2026 symbols completed. BME took 1.0s. Estimated remaining: 9m 39s. Rate: 184.6 symbols/min [2025-09-16T21:13:11.433393] [INFO ] [MAIN ] BN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:11.446034] [DEBUG] [MAIN ] BMEZ: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:11.446735] [INFO ] [MAIN ] BMEZ: Generated 1339 derivative records from 17832 primary records. [2025-09-16T21:13:11.446817] [DEBUG] [LOCAL ] BMEZ: Saving derivative data. [2025-09-16T21:13:11.458980] [DEBUG] [LOCAL ] BMEZ: Derivative data saved (1339 records). [2025-09-16T21:13:11.459077] [INFO ] [MAIN ] BMEZ: Successfully saved derivative data. [2025-09-16T21:13:11.461271] [INFO ] [MAIN ] Derivative Progress: 246/2026 symbols completed. BMEZ took 0.9s. Estimated remaining: 9m 36s. Rate: 185.3 symbols/min [2025-09-16T21:13:11.461544] [INFO ] [MAIN ] BNH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:11.467183] [DEBUG] [LOCAL ] BNH: Loaded 3128 existing records from primary storage. [2025-09-16T21:13:11.467328] [INFO ] [MAIN ] BNH: Loaded 3128 primary data records. [2025-09-16T21:13:11.670040] [DEBUG] [LOCAL ] BMY: Loaded 40107 existing records from primary storage. [2025-09-16T21:13:11.752704] [INFO ] [MAIN ] BMY: Loaded 40107 primary data records. [2025-09-16T21:13:11.777323] [DEBUG] [LOCAL ] BN: Loaded 39392 existing records from primary storage. [2025-09-16T21:13:11.809254] [INFO ] [MAIN ] BN: Loaded 39392 primary data records. [2025-09-16T21:13:12.315332] [DEBUG] [MAIN ] BNH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:12.317748] [INFO ] [MAIN ] BNH: Generated 1339 derivative records from 3128 primary records. [2025-09-16T21:13:12.318121] [DEBUG] [LOCAL ] BNH: Saving derivative data. [2025-09-16T21:13:12.330702] [DEBUG] [LOCAL ] BNH: Derivative data saved (1339 records). [2025-09-16T21:13:12.331011] [INFO ] [MAIN ] BNH: Successfully saved derivative data. [2025-09-16T21:13:12.332994] [INFO ] [MAIN ] Derivative Progress: 247/2026 symbols completed. BNH took 0.9s. Estimated remaining: 9m 40s. Rate: 184.1 symbols/min [2025-09-16T21:13:12.333351] [INFO ] [MAIN ] BNJ: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:12.340968] [DEBUG] [LOCAL ] BNJ: Loaded 1747 existing records from primary storage. [2025-09-16T21:13:12.346902] [INFO ] [MAIN ] BNJ: Loaded 1747 primary data records. [2025-09-16T21:13:12.356692] [DEBUG] [MAIN ] BMY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:12.360974] [INFO ] [MAIN ] BMY: Generated 1339 derivative records from 40107 primary records. [2025-09-16T21:13:12.361371] [DEBUG] [LOCAL ] BMY: Saving derivative data. [2025-09-16T21:13:12.361302] [DEBUG] [MAIN ] BN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:12.404410] [INFO ] [MAIN ] BN: Generated 1339 derivative records from 39392 primary records. [2025-09-16T21:13:12.437135] [DEBUG] [LOCAL ] BN: Saving derivative data. [2025-09-16T21:13:12.437046] [DEBUG] [LOCAL ] BMY: Derivative data saved (1339 records). [2025-09-16T21:13:12.449405] [INFO ] [MAIN ] BMY: Successfully saved derivative data. [2025-09-16T21:13:12.462245] [INFO ] [MAIN ] Derivative Progress: 248/2026 symbols completed. BMY took 1.0s. Estimated remaining: 9m 38s. Rate: 184.5 symbols/min [2025-09-16T21:13:12.480998] [INFO ] [MAIN ] BNL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:12.568304] [DEBUG] [LOCAL ] BN: Derivative data saved (1339 records). [2025-09-16T21:13:12.639667] [INFO ] [MAIN ] BN: Successfully saved derivative data. [2025-09-16T21:13:12.653170] [INFO ] [MAIN ] Derivative Progress: 249/2026 symbols completed. BN took 1.2s. Estimated remaining: 9m 37s. Rate: 184.8 symbols/min [2025-09-16T21:13:12.654501] [INFO ] [MAIN ] BNS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:12.682532] [DEBUG] [LOCAL ] BNL: Loaded 34783 existing records from primary storage. [2025-09-16T21:13:12.692249] [INFO ] [MAIN ] BNL: Loaded 34783 primary data records. [2025-09-16T21:13:12.692183] [DEBUG] [MAIN ] BNJ: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:12.693064] [INFO ] [MAIN ] BNJ: Generated 1339 derivative records from 1747 primary records. [2025-09-16T21:13:12.693370] [DEBUG] [LOCAL ] BNJ: Saving derivative data. [2025-09-16T21:13:12.847838] [DEBUG] [LOCAL ] BNJ: Derivative data saved (1339 records). [2025-09-16T21:13:12.900544] [INFO ] [MAIN ] BNJ: Successfully saved derivative data. [2025-09-16T21:13:12.900411] [DEBUG] [LOCAL ] BNS: Loaded 38179 existing records from primary storage. [2025-09-16T21:13:12.903205] [INFO ] [MAIN ] BNS: Loaded 38179 primary data records. [2025-09-16T21:13:12.902408] [INFO ] [MAIN ] Derivative Progress: 250/2026 symbols completed. BNJ took 0.6s. Estimated remaining: 9m 36s. Rate: 185.0 symbols/min [2025-09-16T21:13:12.905946] [INFO ] [MAIN ] BNT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:13.122172] [DEBUG] [LOCAL ] BNT: Loaded 2089 existing records from primary storage. [2025-09-16T21:13:13.126618] [INFO ] [MAIN ] BNT: Loaded 2089 primary data records. [2025-09-16T21:13:13.661399] [DEBUG] [MAIN ] BNL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:13.664624] [INFO ] [MAIN ] BNL: Generated 1339 derivative records from 34783 primary records. [2025-09-16T21:13:13.665821] [DEBUG] [LOCAL ] BNL: Saving derivative data. [2025-09-16T21:13:13.686578] [DEBUG] [LOCAL ] BNL: Derivative data saved (1339 records). [2025-09-16T21:13:13.687810] [INFO ] [MAIN ] BNL: Successfully saved derivative data. [2025-09-16T21:13:13.690060] [INFO ] [MAIN ] Derivative Progress: 251/2026 symbols completed. BNL took 1.2s. Estimated remaining: 9m 39s. Rate: 183.9 symbols/min [2025-09-16T21:13:13.691355] [INFO ] [MAIN ] BNY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:13.710484] [DEBUG] [MAIN ] BNS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:13.711713] [INFO ] [MAIN ] BNS: Generated 1339 derivative records from 38179 primary records. [2025-09-16T21:13:13.712192] [DEBUG] [LOCAL ] BNS: Saving derivative data. [2025-09-16T21:13:13.717433] [DEBUG] [LOCAL ] BNY: Loaded 5332 existing records from primary storage. [2025-09-16T21:13:13.719597] [INFO ] [MAIN ] BNY: Loaded 5332 primary data records. [2025-09-16T21:13:13.873630] [DEBUG] [MAIN ] BNT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:13.887853] [DEBUG] [LOCAL ] BNS: Derivative data saved (1339 records). [2025-09-16T21:13:13.895127] [INFO ] [MAIN ] BNT: Generated 1339 derivative records from 2089 primary records. [2025-09-16T21:13:13.910362] [INFO ] [MAIN ] BNS: Successfully saved derivative data. [2025-09-16T21:13:13.928010] [INFO ] [MAIN ] Derivative Progress: 252/2026 symbols completed. BNS took 1.3s. Estimated remaining: 9m 38s. Rate: 184.1 symbols/min [2025-09-16T21:13:13.928756] [INFO ] [MAIN ] BOC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:13.919696] [DEBUG] [LOCAL ] BNT: Saving derivative data. [2025-09-16T21:13:14.008216] [DEBUG] [LOCAL ] BNT: Derivative data saved (1339 records). [2025-09-16T21:13:14.008633] [INFO ] [MAIN ] BNT: Successfully saved derivative data. [2025-09-16T21:13:14.011703] [INFO ] [MAIN ] Derivative Progress: 253/2026 symbols completed. BNT took 1.1s. Estimated remaining: 9m 36s. Rate: 184.7 symbols/min [2025-09-16T21:13:14.198527] [DEBUG] [LOCAL ] BOC: Loaded 13393 existing records from primary storage. [2025-09-16T21:13:14.198789] [INFO ] [MAIN ] BOC: Loaded 13393 primary data records. [2025-09-16T21:13:14.576455] [DEBUG] [MAIN ] BNY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:14.578286] [INFO ] [MAIN ] BNY: Generated 1339 derivative records from 5332 primary records. [2025-09-16T21:13:14.578469] [DEBUG] [LOCAL ] BNY: Saving derivative data. [2025-09-16T21:13:14.599322] [DEBUG] [LOCAL ] BNY: Derivative data saved (1339 records). [2025-09-16T21:13:14.599614] [INFO ] [MAIN ] BNY: Successfully saved derivative data. [2025-09-16T21:13:14.601463] [INFO ] [MAIN ] Derivative Progress: 254/2026 symbols completed. BNY took 0.9s. Estimated remaining: 9m 38s. Rate: 184.1 symbols/min [2025-09-16T21:13:14.616198] [DEBUG] [MAIN ] BOC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:14.616931] [INFO ] [MAIN ] BOC: Generated 1339 derivative records from 13393 primary records. [2025-09-16T21:13:14.617007] [DEBUG] [LOCAL ] BOC: Saving derivative data. [2025-09-16T21:13:14.630408] [DEBUG] [LOCAL ] BOC: Derivative data saved (1339 records). [2025-09-16T21:13:14.630577] [INFO ] [MAIN ] BOC: Successfully saved derivative data. [2025-09-16T21:13:14.632775] [INFO ] [MAIN ] Derivative Progress: 255/2026 symbols completed. BOC took 0.7s. Estimated remaining: 9m 35s. Rate: 184.7 symbols/min [2025-09-16T21:13:14.633470] [INFO ] [MAIN ] BOND: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:14.633750] [INFO ] [MAIN ] BOH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:14.633386] [INFO ] [MAIN ] BOE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:14.659029] [DEBUG] [LOCAL ] BOE: Loaded 11979 existing records from primary storage. [2025-09-16T21:13:14.659197] [INFO ] [MAIN ] BOE: Loaded 11979 primary data records. [2025-09-16T21:13:14.789441] [DEBUG] [LOCAL ] BOH: Loaded 22048 existing records from primary storage. [2025-09-16T21:13:14.789753] [DEBUG] [LOCAL ] BOND: Loaded 23774 existing records from primary storage. [2025-09-16T21:13:14.790070] [INFO ] [MAIN ] BOH: Loaded 22048 primary data records. [2025-09-16T21:13:14.789971] [INFO ] [MAIN ] BOND: Loaded 23774 primary data records. [2025-09-16T21:13:15.560180] [DEBUG] [MAIN ] BOE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:15.561204] [INFO ] [MAIN ] BOE: Generated 1339 derivative records from 11979 primary records. [2025-09-16T21:13:15.561461] [DEBUG] [LOCAL ] BOE: Saving derivative data. [2025-09-16T21:13:15.575465] [DEBUG] [LOCAL ] BOE: Derivative data saved (1339 records). [2025-09-16T21:13:15.576138] [INFO ] [MAIN ] BOE: Successfully saved derivative data. [2025-09-16T21:13:15.578553] [INFO ] [MAIN ] Derivative Progress: 256/2026 symbols completed. BOE took 0.9s. Estimated remaining: 9m 39s. Rate: 183.4 symbols/min [2025-09-16T21:13:15.580151] [INFO ] [MAIN ] BOOT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:15.590192] [DEBUG] [MAIN ] BOH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:15.591087] [INFO ] [MAIN ] BOH: Generated 1339 derivative records from 22048 primary records. [2025-09-16T21:13:15.597095] [DEBUG] [LOCAL ] BOH: Saving derivative data. [2025-09-16T21:13:15.601198] [DEBUG] [MAIN ] BOND: Filtered 5181 bins outside market hours, 5780 incomplete bins [2025-09-16T21:13:15.602781] [INFO ] [MAIN ] BOND: Generated 1338 derivative records from 23774 primary records. [2025-09-16T21:13:15.603100] [DEBUG] [LOCAL ] BOND: Saving derivative data. [2025-09-16T21:13:15.625896] [DEBUG] [LOCAL ] BOND: Derivative data saved (1338 records). [2025-09-16T21:13:15.626451] [INFO ] [MAIN ] BOND: Successfully saved derivative data. [2025-09-16T21:13:15.628718] [INFO ] [MAIN ] Derivative Progress: 257/2026 symbols completed. BOND took 1.0s. Estimated remaining: 9m 37s. Rate: 184.0 symbols/min [2025-09-16T21:13:15.628849] [DEBUG] [LOCAL ] BOH: Derivative data saved (1339 records). [2025-09-16T21:13:15.629085] [INFO ] [MAIN ] BORR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:15.629384] [INFO ] [MAIN ] BOH: Successfully saved derivative data. [2025-09-16T21:13:15.631765] [INFO ] [MAIN ] Derivative Progress: 258/2026 symbols completed. BOH took 1.0s. Estimated remaining: 9m 34s. Rate: 184.7 symbols/min [2025-09-16T21:13:15.639362] [INFO ] [MAIN ] BOW: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:15.653102] [DEBUG] [LOCAL ] BOOT: Loaded 29529 existing records from primary storage. [2025-09-16T21:13:15.656609] [INFO ] [MAIN ] BOOT: Loaded 29529 primary data records. [2025-09-16T21:13:15.770692] [DEBUG] [LOCAL ] BOW: Loaded 16305 existing records from primary storage. [2025-09-16T21:13:15.774146] [INFO ] [MAIN ] BOW: Loaded 16305 primary data records. [2025-09-16T21:13:15.954425] [DEBUG] [LOCAL ] BORR: Loaded 38074 existing records from primary storage. [2025-09-16T21:13:16.048121] [INFO ] [MAIN ] BORR: Loaded 38074 primary data records. [2025-09-16T21:13:16.504425] [DEBUG] [MAIN ] BOOT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:16.505397] [INFO ] [MAIN ] BOOT: Generated 1339 derivative records from 29529 primary records. [2025-09-16T21:13:16.505631] [DEBUG] [LOCAL ] BOOT: Saving derivative data. [2025-09-16T21:13:16.529565] [DEBUG] [MAIN ] BOW: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:16.532315] [DEBUG] [LOCAL ] BOOT: Derivative data saved (1339 records). [2025-09-16T21:13:16.534753] [INFO ] [MAIN ] BOW: Generated 1339 derivative records from 16305 primary records. [2025-09-16T21:13:16.535510] [DEBUG] [LOCAL ] BOW: Saving derivative data. [2025-09-16T21:13:16.535392] [INFO ] [MAIN ] BOOT: Successfully saved derivative data. [2025-09-16T21:13:16.544661] [INFO ] [MAIN ] Derivative Progress: 259/2026 symbols completed. BOOT took 1.0s. Estimated remaining: 9m 38s. Rate: 183.4 symbols/min [2025-09-16T21:13:16.548495] [INFO ] [MAIN ] BOX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:16.561050] [DEBUG] [MAIN ] BORR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:16.562085] [INFO ] [MAIN ] BORR: Generated 1339 derivative records from 38074 primary records. [2025-09-16T21:13:16.563012] [DEBUG] [LOCAL ] BOW: Derivative data saved (1339 records). [2025-09-16T21:13:16.562465] [DEBUG] [LOCAL ] BORR: Saving derivative data. [2025-09-16T21:13:16.563276] [INFO ] [MAIN ] BOW: Successfully saved derivative data. [2025-09-16T21:13:16.565765] [INFO ] [MAIN ] Derivative Progress: 260/2026 symbols completed. BOW took 0.9s. Estimated remaining: 9m 36s. Rate: 184.1 symbols/min [2025-09-16T21:13:16.566178] [INFO ] [MAIN ] BP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:16.578222] [DEBUG] [LOCAL ] BORR: Derivative data saved (1339 records). [2025-09-16T21:13:16.578431] [INFO ] [MAIN ] BORR: Successfully saved derivative data. [2025-09-16T21:13:16.580633] [INFO ] [MAIN ] Derivative Progress: 261/2026 symbols completed. BORR took 1.0s. Estimated remaining: 9m 33s. Rate: 184.7 symbols/min [2025-09-16T21:13:16.580966] [INFO ] [MAIN ] BR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:16.626899] [DEBUG] [LOCAL ] BR: Loaded 25280 existing records from primary storage. [2025-09-16T21:13:16.639468] [INFO ] [MAIN ] BR: Loaded 25280 primary data records. [2025-09-16T21:13:16.709286] [DEBUG] [LOCAL ] BOX: Loaded 37385 existing records from primary storage. [2025-09-16T21:13:16.723691] [DEBUG] [LOCAL ] BP: Loaded 40061 existing records from primary storage. [2025-09-16T21:13:16.755196] [INFO ] [MAIN ] BOX: Loaded 37385 primary data records. [2025-09-16T21:13:16.755119] [INFO ] [MAIN ] BP: Loaded 40061 primary data records. [2025-09-16T21:13:17.473303] [DEBUG] [MAIN ] BR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:17.474781] [INFO ] [MAIN ] BR: Generated 1339 derivative records from 25280 primary records. [2025-09-16T21:13:17.475975] [DEBUG] [LOCAL ] BR: Saving derivative data. [2025-09-16T21:13:17.497277] [DEBUG] [MAIN ] BOX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:17.498440] [INFO ] [MAIN ] BOX: Generated 1339 derivative records from 37385 primary records. [2025-09-16T21:13:17.508747] [DEBUG] [LOCAL ] BOX: Saving derivative data. [2025-09-16T21:13:17.509560] [DEBUG] [MAIN ] BP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:17.510453] [INFO ] [MAIN ] BP: Generated 1339 derivative records from 40061 primary records. [2025-09-16T21:13:17.510969] [DEBUG] [LOCAL ] BP: Saving derivative data. [2025-09-16T21:13:17.532111] [DEBUG] [LOCAL ] BOX: Derivative data saved (1339 records). [2025-09-16T21:13:17.532409] [INFO ] [MAIN ] BOX: Successfully saved derivative data. [2025-09-16T21:13:17.535059] [INFO ] [MAIN ] Derivative Progress: 262/2026 symbols completed. BOX took 1.0s. Estimated remaining: 9m 37s. Rate: 183.4 symbols/min [2025-09-16T21:13:17.533121] [DEBUG] [LOCAL ] BR: Derivative data saved (1339 records). [2025-09-16T21:13:17.535608] [INFO ] [MAIN ] BR: Successfully saved derivative data. [2025-09-16T21:13:17.535536] [INFO ] [MAIN ] BRBR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:17.538100] [INFO ] [MAIN ] Derivative Progress: 263/2026 symbols completed. BR took 1.0s. Estimated remaining: 9m 35s. Rate: 184.1 symbols/min [2025-09-16T21:13:17.539268] [INFO ] [MAIN ] BRC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:17.542633] [DEBUG] [LOCAL ] BP: Derivative data saved (1339 records). [2025-09-16T21:13:17.542866] [INFO ] [MAIN ] BP: Successfully saved derivative data. [2025-09-16T21:13:17.544989] [INFO ] [MAIN ] Derivative Progress: 264/2026 symbols completed. BP took 1.0s. Estimated remaining: 9m 32s. Rate: 184.8 symbols/min [2025-09-16T21:13:17.545256] [INFO ] [MAIN ] BRFS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:17.560611] [DEBUG] [LOCAL ] BRC: Loaded 13406 existing records from primary storage. [2025-09-16T21:13:17.560796] [INFO ] [MAIN ] BRC: Loaded 13406 primary data records. [2025-09-16T21:13:17.730332] [DEBUG] [LOCAL ] BRBR: Loaded 38872 existing records from primary storage. [2025-09-16T21:13:17.760960] [INFO ] [MAIN ] BRBR: Loaded 38872 primary data records. [2025-09-16T21:13:17.760896] [DEBUG] [LOCAL ] BRFS: Loaded 30222 existing records from primary storage. [2025-09-16T21:13:17.776737] [INFO ] [MAIN ] BRFS: Loaded 30222 primary data records. [2025-09-16T21:13:18.448300] [DEBUG] [MAIN ] BRC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:18.449325] [INFO ] [MAIN ] BRC: Generated 1339 derivative records from 13406 primary records. [2025-09-16T21:13:18.449557] [DEBUG] [LOCAL ] BRC: Saving derivative data. [2025-09-16T21:13:18.462827] [DEBUG] [LOCAL ] BRC: Derivative data saved (1339 records). [2025-09-16T21:13:18.463031] [INFO ] [MAIN ] BRC: Successfully saved derivative data. [2025-09-16T21:13:18.464384] [INFO ] [MAIN ] Derivative Progress: 265/2026 symbols completed. BRC took 0.9s. Estimated remaining: 9m 36s. Rate: 183.5 symbols/min [2025-09-16T21:13:18.464811] [INFO ] [MAIN ] BRO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:18.478391] [DEBUG] [MAIN ] BRBR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:18.479358] [INFO ] [MAIN ] BRBR: Generated 1339 derivative records from 38872 primary records. [2025-09-16T21:13:18.480163] [DEBUG] [LOCAL ] BRBR: Saving derivative data. [2025-09-16T21:13:18.503027] [DEBUG] [MAIN ] BRFS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:18.504168] [DEBUG] [LOCAL ] BRBR: Derivative data saved (1339 records). [2025-09-16T21:13:18.504863] [INFO ] [MAIN ] BRFS: Generated 1339 derivative records from 30222 primary records. [2025-09-16T21:13:18.504979] [INFO ] [MAIN ] BRBR: Successfully saved derivative data. [2025-09-16T21:13:18.505066] [DEBUG] [LOCAL ] BRFS: Saving derivative data. [2025-09-16T21:13:18.506997] [INFO ] [MAIN ] Derivative Progress: 266/2026 symbols completed. BRBR took 1.0s. Estimated remaining: 9m 34s. Rate: 184.1 symbols/min [2025-09-16T21:13:18.507962] [INFO ] [MAIN ] BROS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:18.529141] [DEBUG] [LOCAL ] BRFS: Derivative data saved (1339 records). [2025-09-16T21:13:18.529280] [INFO ] [MAIN ] BRFS: Successfully saved derivative data. [2025-09-16T21:13:18.531355] [INFO ] [MAIN ] Derivative Progress: 267/2026 symbols completed. BRFS took 1.0s. Estimated remaining: 9m 31s. Rate: 184.7 symbols/min [2025-09-16T21:13:18.531670] [INFO ] [MAIN ] BRSP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:18.548085] [DEBUG] [LOCAL ] BRO: Loaded 38727 existing records from primary storage. [2025-09-16T21:13:18.548272] [INFO ] [MAIN ] BRO: Loaded 38727 primary data records. [2025-09-16T21:13:18.741207] [DEBUG] [LOCAL ] BROS: Loaded 39721 existing records from primary storage. [2025-09-16T21:13:18.732404] [DEBUG] [LOCAL ] BRSP: Loaded 26482 existing records from primary storage. [2025-09-16T21:13:18.765518] [INFO ] [MAIN ] BROS: Loaded 39721 primary data records. [2025-09-16T21:13:18.765580] [INFO ] [MAIN ] BRSP: Loaded 26482 primary data records. [2025-09-16T21:13:19.412954] [DEBUG] [MAIN ] BRO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:19.413945] [INFO ] [MAIN ] BRO: Generated 1339 derivative records from 38727 primary records. [2025-09-16T21:13:19.414544] [DEBUG] [LOCAL ] BRO: Saving derivative data. [2025-09-16T21:13:19.444431] [DEBUG] [LOCAL ] BRO: Derivative data saved (1339 records). [2025-09-16T21:13:19.444714] [INFO ] [MAIN ] BRO: Successfully saved derivative data. [2025-09-16T21:13:19.446554] [INFO ] [MAIN ] Derivative Progress: 268/2026 symbols completed. BRO took 1.0s. Estimated remaining: 9m 35s. Rate: 183.5 symbols/min [2025-09-16T21:13:19.447065] [DEBUG] [MAIN ] BROS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:19.457230] [INFO ] [MAIN ] BROS: Generated 1339 derivative records from 39721 primary records. [2025-09-16T21:13:19.457588] [DEBUG] [LOCAL ] BROS: Saving derivative data. [2025-09-16T21:13:19.457546] [DEBUG] [MAIN ] BRSP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:19.458666] [INFO ] [MAIN ] BRSP: Generated 1339 derivative records from 26482 primary records. [2025-09-16T21:13:19.458887] [DEBUG] [LOCAL ] BRSP: Saving derivative data. [2025-09-16T21:13:19.480846] [DEBUG] [LOCAL ] BROS: Derivative data saved (1339 records). [2025-09-16T21:13:19.481527] [INFO ] [MAIN ] BROS: Successfully saved derivative data. [2025-09-16T21:13:19.484253] [INFO ] [MAIN ] Derivative Progress: 269/2026 symbols completed. BROS took 1.0s. Estimated remaining: 9m 33s. Rate: 184.1 symbols/min [2025-09-16T21:13:19.482212] [DEBUG] [LOCAL ] BRSP: Derivative data saved (1339 records). [2025-09-16T21:13:19.484454] [INFO ] [MAIN ] BRSP: Successfully saved derivative data. [2025-09-16T21:13:19.486378] [INFO ] [MAIN ] Derivative Progress: 270/2026 symbols completed. BRSP took 1.0s. Estimated remaining: 9m 30s. Rate: 184.8 symbols/min [2025-09-16T21:13:19.486815] [INFO ] [MAIN ] BRT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:19.487061] [INFO ] [MAIN ] BRW: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:19.487015] [INFO ] [MAIN ] BSAC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:19.493277] [DEBUG] [LOCAL ] BRT: Loaded 3507 existing records from primary storage. [2025-09-16T21:13:19.493485] [INFO ] [MAIN ] BRT: Loaded 3507 primary data records. [2025-09-16T21:13:19.621113] [DEBUG] [LOCAL ] BSAC: Loaded 24383 existing records from primary storage. [2025-09-16T21:13:19.620513] [DEBUG] [LOCAL ] BRW: Loaded 14443 existing records from primary storage. [2025-09-16T21:13:19.636638] [INFO ] [MAIN ] BSAC: Loaded 24383 primary data records. [2025-09-16T21:13:19.636760] [INFO ] [MAIN ] BRW: Loaded 14443 primary data records. [2025-09-16T21:13:20.406733] [DEBUG] [MAIN ] BRT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:20.408676] [INFO ] [MAIN ] BRT: Generated 1339 derivative records from 3507 primary records. [2025-09-16T21:13:20.409023] [DEBUG] [LOCAL ] BRT: Saving derivative data. [2025-09-16T21:13:20.422883] [DEBUG] [LOCAL ] BRT: Derivative data saved (1339 records). [2025-09-16T21:13:20.423465] [INFO ] [MAIN ] BRT: Successfully saved derivative data. [2025-09-16T21:13:20.425073] [INFO ] [MAIN ] Derivative Progress: 271/2026 symbols completed. BRT took 0.9s. Estimated remaining: 9m 34s. Rate: 183.5 symbols/min [2025-09-16T21:13:20.425684] [INFO ] [MAIN ] BSBR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:20.439441] [DEBUG] [MAIN ] BRW: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:20.440350] [INFO ] [MAIN ] BRW: Generated 1339 derivative records from 14443 primary records. [2025-09-16T21:13:20.440713] [DEBUG] [LOCAL ] BRW: Saving derivative data. [2025-09-16T21:13:20.463736] [DEBUG] [LOCAL ] BRW: Derivative data saved (1339 records). [2025-09-16T21:13:20.464053] [INFO ] [MAIN ] BRW: Successfully saved derivative data. [2025-09-16T21:13:20.475989] [INFO ] [MAIN ] Derivative Progress: 272/2026 symbols completed. BRW took 1.0s. Estimated remaining: 9m 32s. Rate: 184.1 symbols/min [2025-09-16T21:13:20.476367] [DEBUG] [MAIN ] BSAC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:20.476729] [INFO ] [MAIN ] BSL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:20.477960] [INFO ] [MAIN ] BSAC: Generated 1339 derivative records from 24383 primary records. [2025-09-16T21:13:20.478413] [DEBUG] [LOCAL ] BSAC: Saving derivative data. [2025-09-16T21:13:20.500379] [DEBUG] [LOCAL ] BSBR: Loaded 26737 existing records from primary storage. [2025-09-16T21:13:20.501273] [INFO ] [MAIN ] BSBR: Loaded 26737 primary data records. [2025-09-16T21:13:20.527446] [DEBUG] [LOCAL ] BSL: Loaded 5178 existing records from primary storage. [2025-09-16T21:13:20.538934] [INFO ] [MAIN ] BSL: Loaded 5178 primary data records. [2025-09-16T21:13:20.538802] [DEBUG] [LOCAL ] BSAC: Derivative data saved (1339 records). [2025-09-16T21:13:20.556501] [INFO ] [MAIN ] BSAC: Successfully saved derivative data. [2025-09-16T21:13:20.566729] [INFO ] [MAIN ] Derivative Progress: 273/2026 symbols completed. BSAC took 1.1s. Estimated remaining: 9m 30s. Rate: 184.6 symbols/min [2025-09-16T21:13:20.599014] [INFO ] [MAIN ] BSM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:21.073693] [DEBUG] [LOCAL ] BSM: Loaded 24221 existing records from primary storage. [2025-09-16T21:13:21.075445] [INFO ] [MAIN ] BSM: Loaded 24221 primary data records. [2025-09-16T21:13:21.380809] [DEBUG] [MAIN ] BSL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:21.388118] [INFO ] [MAIN ] BSL: Generated 1339 derivative records from 5178 primary records. [2025-09-16T21:13:21.392361] [DEBUG] [MAIN ] BSBR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:21.392413] [DEBUG] [LOCAL ] BSL: Saving derivative data. [2025-09-16T21:13:21.393089] [INFO ] [MAIN ] BSBR: Generated 1339 derivative records from 26737 primary records. [2025-09-16T21:13:21.394070] [DEBUG] [LOCAL ] BSBR: Saving derivative data. [2025-09-16T21:13:21.417665] [DEBUG] [LOCAL ] BSBR: Derivative data saved (1339 records). [2025-09-16T21:13:21.418278] [INFO ] [MAIN ] BSBR: Successfully saved derivative data. [2025-09-16T21:13:21.420801] [INFO ] [MAIN ] Derivative Progress: 274/2026 symbols completed. BSBR took 1.0s. Estimated remaining: 9m 33s. Rate: 183.5 symbols/min [2025-09-16T21:13:21.418623] [DEBUG] [LOCAL ] BSL: Derivative data saved (1339 records). [2025-09-16T21:13:21.421249] [INFO ] [MAIN ] BSL: Successfully saved derivative data. [2025-09-16T21:13:21.422720] [INFO ] [MAIN ] Derivative Progress: 275/2026 symbols completed. BSL took 0.9s. Estimated remaining: 9m 31s. Rate: 184.1 symbols/min [2025-09-16T21:13:21.421210] [INFO ] [MAIN ] BST: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:21.423127] [INFO ] [MAIN ] BSX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:21.443492] [DEBUG] [MAIN ] BSM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:21.444417] [INFO ] [MAIN ] BSM: Generated 1339 derivative records from 24221 primary records. [2025-09-16T21:13:21.450324] [DEBUG] [LOCAL ] BST: Loaded 13342 existing records from primary storage. [2025-09-16T21:13:21.451345] [DEBUG] [LOCAL ] BSM: Saving derivative data. [2025-09-16T21:13:21.451456] [INFO ] [MAIN ] BST: Loaded 13342 primary data records. [2025-09-16T21:13:21.608530] [DEBUG] [LOCAL ] BSM: Derivative data saved (1339 records). [2025-09-16T21:13:21.636359] [INFO ] [MAIN ] BSM: Successfully saved derivative data. [2025-09-16T21:13:21.643769] [INFO ] [MAIN ] Derivative Progress: 276/2026 symbols completed. BSM took 1.0s. Estimated remaining: 9m 30s. Rate: 184.4 symbols/min [2025-09-16T21:13:21.671258] [INFO ] [MAIN ] BTCM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:21.672056] [DEBUG] [LOCAL ] BSX: Loaded 40038 existing records from primary storage. [2025-09-16T21:13:21.672714] [INFO ] [MAIN ] BSX: Loaded 40038 primary data records. [2025-09-16T21:13:21.874091] [DEBUG] [LOCAL ] BTCM: Loaded 12997 existing records from primary storage. [2025-09-16T21:13:21.880126] [INFO ] [MAIN ] BTCM: Loaded 12997 primary data records. [2025-09-16T21:13:22.362712] [DEBUG] [MAIN ] BST: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:22.363869] [INFO ] [MAIN ] BST: Generated 1339 derivative records from 13342 primary records. [2025-09-16T21:13:22.364143] [DEBUG] [LOCAL ] BST: Saving derivative data. [2025-09-16T21:13:22.388943] [DEBUG] [LOCAL ] BST: Derivative data saved (1339 records). [2025-09-16T21:13:22.389469] [DEBUG] [MAIN ] BSX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:22.389706] [INFO ] [MAIN ] BST: Successfully saved derivative data. [2025-09-16T21:13:22.391853] [INFO ] [MAIN ] Derivative Progress: 277/2026 symbols completed. BST took 1.0s. Estimated remaining: 9m 32s. Rate: 183.5 symbols/min [2025-09-16T21:13:22.392126] [INFO ] [MAIN ] BTI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:22.390358] [INFO ] [MAIN ] BSX: Generated 1339 derivative records from 40038 primary records. [2025-09-16T21:13:22.393161] [DEBUG] [LOCAL ] BSX: Saving derivative data. [2025-09-16T21:13:22.413593] [DEBUG] [MAIN ] BTCM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:22.414755] [INFO ] [MAIN ] BTCM: Generated 1339 derivative records from 12997 primary records. [2025-09-16T21:13:22.415046] [DEBUG] [LOCAL ] BTCM: Saving derivative data. [2025-09-16T21:13:22.427496] [DEBUG] [LOCAL ] BSX: Derivative data saved (1339 records). [2025-09-16T21:13:22.428058] [INFO ] [MAIN ] BSX: Successfully saved derivative data. [2025-09-16T21:13:22.430941] [INFO ] [MAIN ] Derivative Progress: 278/2026 symbols completed. BSX took 1.0s. Estimated remaining: 9m 30s. Rate: 184.1 symbols/min [2025-09-16T21:13:22.431846] [INFO ] [MAIN ] BTO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:22.432698] [DEBUG] [LOCAL ] BTCM: Derivative data saved (1339 records). [2025-09-16T21:13:22.432783] [INFO ] [MAIN ] BTCM: Successfully saved derivative data. [2025-09-16T21:13:22.434734] [INFO ] [MAIN ] Derivative Progress: 279/2026 symbols completed. BTCM took 0.8s. Estimated remaining: 9m 27s. Rate: 184.7 symbols/min [2025-09-16T21:13:22.435710] [INFO ] [MAIN ] BTT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:22.450816] [DEBUG] [LOCAL ] BTO: Loaded 6236 existing records from primary storage. [2025-09-16T21:13:22.451006] [INFO ] [MAIN ] BTO: Loaded 6236 primary data records. [2025-09-16T21:13:22.573099] [DEBUG] [LOCAL ] BTT: Loaded 11485 existing records from primary storage. [2025-09-16T21:13:22.581496] [DEBUG] [LOCAL ] BTI: Loaded 39958 existing records from primary storage. [2025-09-16T21:13:22.581940] [INFO ] [MAIN ] BTT: Loaded 11485 primary data records. [2025-09-16T21:13:22.631141] [INFO ] [MAIN ] BTI: Loaded 39958 primary data records. [2025-09-16T21:13:23.309025] [DEBUG] [MAIN ] BTO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:23.309976] [INFO ] [MAIN ] BTO: Generated 1339 derivative records from 6236 primary records. [2025-09-16T21:13:23.310228] [DEBUG] [LOCAL ] BTO: Saving derivative data. [2025-09-16T21:13:23.334229] [DEBUG] [LOCAL ] BTO: Derivative data saved (1339 records). [2025-09-16T21:13:23.335400] [DEBUG] [MAIN ] BTT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:23.335481] [INFO ] [MAIN ] BTO: Successfully saved derivative data. [2025-09-16T21:13:23.337233] [INFO ] [MAIN ] BTT: Generated 1339 derivative records from 11485 primary records. [2025-09-16T21:13:23.338931] [INFO ] [MAIN ] Derivative Progress: 280/2026 symbols completed. BTO took 0.9s. Estimated remaining: 9m 31s. Rate: 183.6 symbols/min [2025-09-16T21:13:23.339326] [INFO ] [MAIN ] BTU: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:23.339180] [DEBUG] [LOCAL ] BTT: Saving derivative data. [2025-09-16T21:13:23.349599] [DEBUG] [MAIN ] BTI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:23.350301] [INFO ] [MAIN ] BTI: Generated 1339 derivative records from 39958 primary records. [2025-09-16T21:13:23.356135] [DEBUG] [LOCAL ] BTI: Saving derivative data. [2025-09-16T21:13:23.373357] [DEBUG] [LOCAL ] BTT: Derivative data saved (1339 records). [2025-09-16T21:13:23.374281] [INFO ] [MAIN ] BTT: Successfully saved derivative data. [2025-09-16T21:13:23.374224] [DEBUG] [LOCAL ] BTI: Derivative data saved (1339 records). [2025-09-16T21:13:23.376236] [INFO ] [MAIN ] Derivative Progress: 281/2026 symbols completed. BTT took 0.9s. Estimated remaining: 9m 29s. Rate: 184.1 symbols/min [2025-09-16T21:13:23.376855] [INFO ] [MAIN ] BTI: Successfully saved derivative data. [2025-09-16T21:13:23.376953] [INFO ] [MAIN ] BUI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:23.379108] [INFO ] [MAIN ] Derivative Progress: 282/2026 symbols completed. BTI took 1.0s. Estimated remaining: 9m 26s. Rate: 184.8 symbols/min [2025-09-16T21:13:23.379630] [INFO ] [MAIN ] BURL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:23.397857] [DEBUG] [LOCAL ] BUI: Loaded 8640 existing records from primary storage. [2025-09-16T21:13:23.398014] [INFO ] [MAIN ] BUI: Loaded 8640 primary data records. [2025-09-16T21:13:23.529216] [DEBUG] [LOCAL ] BTU: Loaded 39703 existing records from primary storage. [2025-09-16T21:13:23.535134] [INFO ] [MAIN ] BTU: Loaded 39703 primary data records. [2025-09-16T21:13:23.681088] [DEBUG] [LOCAL ] BURL: Loaded 33959 existing records from primary storage. [2025-09-16T21:13:23.812118] [INFO ] [MAIN ] BURL: Loaded 33959 primary data records. [2025-09-16T21:13:24.264752] [DEBUG] [MAIN ] BUI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:24.265687] [INFO ] [MAIN ] BUI: Generated 1339 derivative records from 8640 primary records. [2025-09-16T21:13:24.265970] [DEBUG] [LOCAL ] BUI: Saving derivative data. [2025-09-16T21:13:24.290323] [DEBUG] [MAIN ] BTU: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:24.290967] [DEBUG] [LOCAL ] BUI: Derivative data saved (1339 records). [2025-09-16T21:13:24.291221] [INFO ] [MAIN ] BUI: Successfully saved derivative data. [2025-09-16T21:13:24.292681] [INFO ] [MAIN ] Derivative Progress: 283/2026 symbols completed. BUI took 0.9s. Estimated remaining: 9m 30s. Rate: 183.6 symbols/min [2025-09-16T21:13:24.293482] [INFO ] [MAIN ] BTU: Generated 1339 derivative records from 39703 primary records. [2025-09-16T21:13:24.293883] [DEBUG] [LOCAL ] BTU: Saving derivative data. [2025-09-16T21:13:24.317630] [DEBUG] [LOCAL ] BTU: Derivative data saved (1339 records). [2025-09-16T21:13:24.317885] [DEBUG] [MAIN ] BURL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:24.317973] [INFO ] [MAIN ] BTU: Successfully saved derivative data. [2025-09-16T21:13:24.320062] [INFO ] [MAIN ] Derivative Progress: 284/2026 symbols completed. BTU took 1.0s. Estimated remaining: 9m 27s. Rate: 184.2 symbols/min [2025-09-16T21:13:24.320751] [INFO ] [MAIN ] BURL: Generated 1339 derivative records from 33959 primary records. [2025-09-16T21:13:24.320830] [DEBUG] [LOCAL ] BURL: Saving derivative data. [2025-09-16T21:13:24.332970] [DEBUG] [LOCAL ] BURL: Derivative data saved (1339 records). [2025-09-16T21:13:24.333040] [INFO ] [MAIN ] BURL: Successfully saved derivative data. [2025-09-16T21:13:24.335210] [INFO ] [MAIN ] Derivative Progress: 285/2026 symbols completed. BURL took 1.0s. Estimated remaining: 9m 25s. Rate: 184.8 symbols/min [2025-09-16T21:13:24.335629] [INFO ] [MAIN ] BUXX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:24.335795] [INFO ] [MAIN ] BVN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:24.335912] [INFO ] [MAIN ] BV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:24.349051] [DEBUG] [LOCAL ] BUXX: Loaded 11499 existing records from primary storage. [2025-09-16T21:13:24.349345] [INFO ] [MAIN ] BUXX: Loaded 11499 primary data records. [2025-09-16T21:13:24.535145] [DEBUG] [LOCAL ] BVN: Loaded 32229 existing records from primary storage. [2025-09-16T21:13:24.572867] [DEBUG] [LOCAL ] BV: Loaded 28578 existing records from primary storage. [2025-09-16T21:13:24.567193] [INFO ] [MAIN ] BVN: Loaded 32229 primary data records. [2025-09-16T21:13:24.585706] [INFO ] [MAIN ] BV: Loaded 28578 primary data records. [2025-09-16T21:13:25.250659] [DEBUG] [MAIN ] BUXX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:25.251881] [INFO ] [MAIN ] BUXX: Generated 1339 derivative records from 11499 primary records. [2025-09-16T21:13:25.252175] [DEBUG] [LOCAL ] BUXX: Saving derivative data. [2025-09-16T21:13:25.267518] [DEBUG] [LOCAL ] BUXX: Derivative data saved (1339 records). [2025-09-16T21:13:25.267768] [INFO ] [MAIN ] BUXX: Successfully saved derivative data. [2025-09-16T21:13:25.269421] [INFO ] [MAIN ] Derivative Progress: 286/2026 symbols completed. BUXX took 0.9s. Estimated remaining: 9m 29s. Rate: 183.6 symbols/min [2025-09-16T21:13:25.269743] [INFO ] [MAIN ] BW: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:25.294616] [DEBUG] [MAIN ] BV: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:25.296076] [INFO ] [MAIN ] BV: Generated 1339 derivative records from 28578 primary records. [2025-09-16T21:13:25.296172] [DEBUG] [LOCAL ] BV: Saving derivative data. [2025-09-16T21:13:25.295325] [DEBUG] [MAIN ] BVN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:25.297803] [INFO ] [MAIN ] BVN: Generated 1339 derivative records from 32229 primary records. [2025-09-16T21:13:25.306244] [DEBUG] [LOCAL ] BVN: Saving derivative data. [2025-09-16T21:13:25.319860] [DEBUG] [LOCAL ] BV: Derivative data saved (1339 records). [2025-09-16T21:13:25.326964] [INFO ] [MAIN ] BV: Successfully saved derivative data. [2025-09-16T21:13:25.329587] [INFO ] [MAIN ] Derivative Progress: 287/2026 symbols completed. BV took 1.0s. Estimated remaining: 9m 27s. Rate: 184.1 symbols/min [2025-09-16T21:13:25.330353] [INFO ] [MAIN ] BWA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:25.331995] [DEBUG] [LOCAL ] BVN: Derivative data saved (1339 records). [2025-09-16T21:13:25.332136] [INFO ] [MAIN ] BVN: Successfully saved derivative data. [2025-09-16T21:13:25.334524] [INFO ] [MAIN ] Derivative Progress: 288/2026 symbols completed. BVN took 1.0s. Estimated remaining: 9m 24s. Rate: 184.8 symbols/min [2025-09-16T21:13:25.334778] [INFO ] [MAIN ] BWG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:25.345235] [DEBUG] [LOCAL ] BW: Loaded 28462 existing records from primary storage. [2025-09-16T21:13:25.345498] [INFO ] [MAIN ] BW: Loaded 28462 primary data records. [2025-09-16T21:13:25.441365] [DEBUG] [LOCAL ] BWG: Loaded 9776 existing records from primary storage. [2025-09-16T21:13:25.456122] [INFO ] [MAIN ] BWG: Loaded 9776 primary data records. [2025-09-16T21:13:25.664291] [DEBUG] [LOCAL ] BWA: Loaded 38799 existing records from primary storage. [2025-09-16T21:13:25.748120] [INFO ] [MAIN ] BWA: Loaded 38799 primary data records. [2025-09-16T21:13:26.217837] [DEBUG] [MAIN ] BW: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:26.219433] [INFO ] [MAIN ] BW: Generated 1339 derivative records from 28462 primary records. [2025-09-16T21:13:26.219617] [DEBUG] [LOCAL ] BW: Saving derivative data. [2025-09-16T21:13:26.236524] [DEBUG] [LOCAL ] BW: Derivative data saved (1339 records). [2025-09-16T21:13:26.236835] [INFO ] [MAIN ] BW: Successfully saved derivative data. [2025-09-16T21:13:26.238568] [INFO ] [MAIN ] Derivative Progress: 289/2026 symbols completed. BW took 1.0s. Estimated remaining: 9m 28s. Rate: 183.6 symbols/min [2025-09-16T21:13:26.248409] [INFO ] [MAIN ] BWNB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:26.249217] [DEBUG] [MAIN ] BWG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:26.250429] [INFO ] [MAIN ] BWG: Generated 1339 derivative records from 9776 primary records. [2025-09-16T21:13:26.250721] [DEBUG] [LOCAL ] BWG: Saving derivative data. [2025-09-16T21:13:26.265355] [DEBUG] [LOCAL ] BWG: Derivative data saved (1339 records). [2025-09-16T21:13:26.268163] [DEBUG] [LOCAL ] BWNB: Loaded 3471 existing records from primary storage. [2025-09-16T21:13:26.268409] [INFO ] [MAIN ] BWG: Successfully saved derivative data. [2025-09-16T21:13:26.279750] [INFO ] [MAIN ] Derivative Progress: 290/2026 symbols completed. BWG took 0.9s. Estimated remaining: 9m 25s. Rate: 184.2 symbols/min [2025-09-16T21:13:26.280480] [INFO ] [MAIN ] BWSN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:26.280434] [DEBUG] [MAIN ] BWA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:26.281224] [INFO ] [MAIN ] BWA: Generated 1339 derivative records from 38799 primary records. [2025-09-16T21:13:26.281531] [DEBUG] [LOCAL ] BWA: Saving derivative data. [2025-09-16T21:13:26.279954] [INFO ] [MAIN ] BWNB: Loaded 3471 primary data records. [2025-09-16T21:13:26.337927] [DEBUG] [LOCAL ] BWA: Derivative data saved (1339 records). [2025-09-16T21:13:26.358754] [INFO ] [MAIN ] BWA: Successfully saved derivative data. [2025-09-16T21:13:26.373266] [DEBUG] [LOCAL ] BWSN: Loaded 4093 existing records from primary storage. [2025-09-16T21:13:26.385497] [INFO ] [MAIN ] BWSN: Loaded 4093 primary data records. [2025-09-16T21:13:26.375139] [INFO ] [MAIN ] Derivative Progress: 291/2026 symbols completed. BWA took 1.0s. Estimated remaining: 9m 24s. Rate: 184.6 symbols/min [2025-09-16T21:13:26.431178] [INFO ] [MAIN ] BWXT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:26.899892] [DEBUG] [LOCAL ] BWXT: Loaded 34954 existing records from primary storage. [2025-09-16T21:13:26.900535] [INFO ] [MAIN ] BWXT: Loaded 34954 primary data records. [2025-09-16T21:13:27.025345] [DEBUG] [MAIN ] BWNB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:27.026548] [INFO ] [MAIN ] BWNB: Generated 1339 derivative records from 3471 primary records. [2025-09-16T21:13:27.032128] [DEBUG] [LOCAL ] BWNB: Saving derivative data. [2025-09-16T21:13:27.093168] [DEBUG] [MAIN ] BWSN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:27.122411] [INFO ] [MAIN ] BWSN: Generated 1339 derivative records from 4093 primary records. [2025-09-16T21:13:27.122929] [DEBUG] [LOCAL ] BWSN: Saving derivative data. [2025-09-16T21:13:27.220732] [DEBUG] [LOCAL ] BWSN: Derivative data saved (1339 records). [2025-09-16T21:13:27.223141] [INFO ] [MAIN ] BWSN: Successfully saved derivative data. [2025-09-16T21:13:27.223028] [DEBUG] [LOCAL ] BWNB: Derivative data saved (1339 records). [2025-09-16T21:13:27.223371] [INFO ] [MAIN ] BWNB: Successfully saved derivative data. [2025-09-16T21:13:27.225830] [INFO ] [MAIN ] Derivative Progress: 292/2026 symbols completed. BWNB took 1.0s. Estimated remaining: 9m 27s. Rate: 183.6 symbols/min [2025-09-16T21:13:27.229852] [INFO ] [MAIN ] Derivative Progress: 293/2026 symbols completed. BWSN took 0.9s. Estimated remaining: 9m 24s. Rate: 184.2 symbols/min [2025-09-16T21:13:27.229757] [INFO ] [MAIN ] BX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:27.230552] [INFO ] [MAIN ] BXC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:27.247364] [DEBUG] [LOCAL ] BXC: Loaded 10137 existing records from primary storage. [2025-09-16T21:13:27.247789] [INFO ] [MAIN ] BXC: Loaded 10137 primary data records. [2025-09-16T21:13:27.474904] [DEBUG] [MAIN ] BWXT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:27.475007] [DEBUG] [LOCAL ] BX: Loaded 39866 existing records from primary storage. [2025-09-16T21:13:27.475976] [INFO ] [MAIN ] BX: Loaded 39866 primary data records. [2025-09-16T21:13:27.475837] [INFO ] [MAIN ] BWXT: Generated 1339 derivative records from 34954 primary records. [2025-09-16T21:13:27.476165] [DEBUG] [LOCAL ] BWXT: Saving derivative data. [2025-09-16T21:13:27.722368] [DEBUG] [LOCAL ] BWXT: Derivative data saved (1339 records). [2025-09-16T21:13:27.758070] [INFO ] [MAIN ] BWXT: Successfully saved derivative data. [2025-09-16T21:13:27.759979] [INFO ] [MAIN ] Derivative Progress: 294/2026 symbols completed. BWXT took 1.3s. Estimated remaining: 9m 25s. Rate: 183.9 symbols/min [2025-09-16T21:13:27.760250] [INFO ] [MAIN ] BXMT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:27.865787] [DEBUG] [MAIN ] BXC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:27.866799] [INFO ] [MAIN ] BXC: Generated 1339 derivative records from 10137 primary records. [2025-09-16T21:13:27.867105] [DEBUG] [LOCAL ] BXC: Saving derivative data. [2025-09-16T21:13:27.888529] [DEBUG] [LOCAL ] BXC: Derivative data saved (1339 records). [2025-09-16T21:13:27.890154] [INFO ] [MAIN ] BXC: Successfully saved derivative data. [2025-09-16T21:13:27.892002] [INFO ] [MAIN ] Derivative Progress: 295/2026 symbols completed. BXC took 0.7s. Estimated remaining: 9m 24s. Rate: 184.2 symbols/min [2025-09-16T21:13:27.892861] [INFO ] [MAIN ] BXMX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:27.914207] [DEBUG] [MAIN ] BX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:27.913917] [DEBUG] [LOCAL ] BXMT: Loaded 34285 existing records from primary storage. [2025-09-16T21:13:27.915093] [INFO ] [MAIN ] BX: Generated 1339 derivative records from 39866 primary records. [2025-09-16T21:13:27.915214] [INFO ] [MAIN ] BXMT: Loaded 34285 primary data records. [2025-09-16T21:13:27.915271] [DEBUG] [LOCAL ] BX: Saving derivative data. [2025-09-16T21:13:28.027504] [DEBUG] [LOCAL ] BXMX: Loaded 13505 existing records from primary storage. [2025-09-16T21:13:28.039136] [INFO ] [MAIN ] BXMX: Loaded 13505 primary data records. [2025-09-16T21:13:28.051463] [DEBUG] [LOCAL ] BX: Derivative data saved (1339 records). [2025-09-16T21:13:28.076812] [INFO ] [MAIN ] BX: Successfully saved derivative data. [2025-09-16T21:13:28.117679] [INFO ] [MAIN ] Derivative Progress: 296/2026 symbols completed. BX took 0.9s. Estimated remaining: 9m 23s. Rate: 184.4 symbols/min [2025-09-16T21:13:28.123855] [INFO ] [MAIN ] BXP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:28.538436] [DEBUG] [LOCAL ] BXP: Loaded 36936 existing records from primary storage. [2025-09-16T21:13:28.539061] [INFO ] [MAIN ] BXP: Loaded 36936 primary data records. [2025-09-16T21:13:28.752839] [DEBUG] [MAIN ] BXMX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:28.756019] [DEBUG] [MAIN ] BXMT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:28.832434] [INFO ] [MAIN ] BXMX: Generated 1339 derivative records from 13505 primary records. [2025-09-16T21:13:28.833031] [INFO ] [MAIN ] BXMT: Generated 1339 derivative records from 34285 primary records. [2025-09-16T21:13:28.843881] [DEBUG] [LOCAL ] BXMX: Saving derivative data. [2025-09-16T21:13:28.843683] [DEBUG] [LOCAL ] BXMT: Saving derivative data. [2025-09-16T21:13:28.868105] [DEBUG] [LOCAL ] BXMT: Derivative data saved (1339 records). [2025-09-16T21:13:28.870222] [INFO ] [MAIN ] BXMT: Successfully saved derivative data. [2025-09-16T21:13:28.872241] [INFO ] [MAIN ] Derivative Progress: 297/2026 symbols completed. BXMT took 1.1s. Estimated remaining: 9m 25s. Rate: 183.6 symbols/min [2025-09-16T21:13:28.872677] [INFO ] [MAIN ] BXSL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:28.872851] [DEBUG] [LOCAL ] BXMX: Derivative data saved (1339 records). [2025-09-16T21:13:28.874067] [INFO ] [MAIN ] BXMX: Successfully saved derivative data. [2025-09-16T21:13:28.876180] [INFO ] [MAIN ] Derivative Progress: 298/2026 symbols completed. BXMX took 1.0s. Estimated remaining: 9m 23s. Rate: 184.2 symbols/min [2025-09-16T21:13:28.899146] [DEBUG] [MAIN ] BXP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:28.900092] [INFO ] [MAIN ] BXP: Generated 1339 derivative records from 36936 primary records. [2025-09-16T21:13:28.900209] [DEBUG] [LOCAL ] BXP: Saving derivative data. [2025-09-16T21:13:28.922066] [DEBUG] [LOCAL ] BXP: Derivative data saved (1339 records). [2025-09-16T21:13:28.922220] [INFO ] [MAIN ] BXP: Successfully saved derivative data. [2025-09-16T21:13:28.924261] [INFO ] [MAIN ] Derivative Progress: 299/2026 symbols completed. BXP took 0.8s. Estimated remaining: 9m 21s. Rate: 184.7 symbols/min [2025-09-16T21:13:28.940744] [DEBUG] [LOCAL ] BXSL: Loaded 34756 existing records from primary storage. [2025-09-16T21:13:28.940938] [INFO ] [MAIN ] BXSL: Loaded 34756 primary data records. [2025-09-16T21:13:29.253371] [DEBUG] [MAIN ] BXSL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:29.254026] [INFO ] [MAIN ] BXSL: Generated 1339 derivative records from 34756 primary records. [2025-09-16T21:13:29.254088] [DEBUG] [LOCAL ] BXSL: Saving derivative data. [2025-09-16T21:13:29.265820] [DEBUG] [LOCAL ] BXSL: Derivative data saved (1339 records). [2025-09-16T21:13:29.265879] [INFO ] [MAIN ] BXSL: Successfully saved derivative data. [2025-09-16T21:13:29.267503] [INFO ] [MAIN ] Derivative Progress: 300/2026 symbols completed. BXSL took 0.4s. Estimated remaining: 9m 21s. Rate: 184.7 symbols/min [2025-09-16T21:13:29.268550] [INFO ] [MAIN ] BZH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:29.268666] [INFO ] [MAIN ] BYM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:29.268318] [INFO ] [MAIN ] BYD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:29.288108] [DEBUG] [LOCAL ] BYM: Loaded 8475 existing records from primary storage. [2025-09-16T21:13:29.288330] [INFO ] [MAIN ] BYM: Loaded 8475 primary data records. [2025-09-16T21:13:29.419126] [DEBUG] [LOCAL ] BZH: Loaded 24301 existing records from primary storage. [2025-09-16T21:13:29.429944] [INFO ] [MAIN ] BZH: Loaded 24301 primary data records. [2025-09-16T21:13:29.581559] [DEBUG] [LOCAL ] BYD: Loaded 33670 existing records from primary storage. [2025-09-16T21:13:29.707900] [INFO ] [MAIN ] BYD: Loaded 33670 primary data records. [2025-09-16T21:13:30.167001] [DEBUG] [MAIN ] BYM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:30.168579] [INFO ] [MAIN ] BYM: Generated 1339 derivative records from 8475 primary records. [2025-09-16T21:13:30.168794] [DEBUG] [LOCAL ] BYM: Saving derivative data. [2025-09-16T21:13:30.192629] [DEBUG] [LOCAL ] BYM: Derivative data saved (1339 records). [2025-09-16T21:13:30.196996] [INFO ] [MAIN ] BYM: Successfully saved derivative data. [2025-09-16T21:13:30.197278] [DEBUG] [MAIN ] BZH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:30.199188] [INFO ] [MAIN ] Derivative Progress: 301/2026 symbols completed. BYM took 0.9s. Estimated remaining: 9m 24s. Rate: 183.6 symbols/min [2025-09-16T21:13:30.200318] [INFO ] [MAIN ] CAAP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:30.199944] [INFO ] [MAIN ] BZH: Generated 1339 derivative records from 24301 primary records. [2025-09-16T21:13:30.200982] [DEBUG] [LOCAL ] BZH: Saving derivative data. [2025-09-16T21:13:30.214949] [DEBUG] [LOCAL ] BZH: Derivative data saved (1339 records). [2025-09-16T21:13:30.219856] [INFO ] [MAIN ] BZH: Successfully saved derivative data. [2025-09-16T21:13:30.223502] [INFO ] [MAIN ] Derivative Progress: 302/2026 symbols completed. BZH took 1.0s. Estimated remaining: 9m 22s. Rate: 184.1 symbols/min [2025-09-16T21:13:30.223867] [INFO ] [MAIN ] CADE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:30.230403] [DEBUG] [LOCAL ] CAAP: Loaded 13352 existing records from primary storage. [2025-09-16T21:13:30.245189] [INFO ] [MAIN ] CAAP: Loaded 13352 primary data records. [2025-09-16T21:13:30.251112] [DEBUG] [MAIN ] BYD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:30.268404] [INFO ] [MAIN ] BYD: Generated 1339 derivative records from 33670 primary records. [2025-09-16T21:13:30.268514] [DEBUG] [LOCAL ] BYD: Saving derivative data. [2025-09-16T21:13:30.361006] [DEBUG] [LOCAL ] BYD: Derivative data saved (1339 records). [2025-09-16T21:13:30.364335] [INFO ] [MAIN ] BYD: Successfully saved derivative data. [2025-09-16T21:13:30.367527] [INFO ] [MAIN ] Derivative Progress: 303/2026 symbols completed. BYD took 1.1s. Estimated remaining: 9m 20s. Rate: 184.5 symbols/min [2025-09-16T21:13:30.373104] [INFO ] [MAIN ] CAE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:30.557114] [DEBUG] [LOCAL ] CADE: Loaded 36711 existing records from primary storage. [2025-09-16T21:13:30.565271] [INFO ] [MAIN ] CADE: Loaded 36711 primary data records. [2025-09-16T21:13:30.714997] [DEBUG] [LOCAL ] CAE: Loaded 28505 existing records from primary storage. [2025-09-16T21:13:30.735877] [INFO ] [MAIN ] CAE: Loaded 28505 primary data records. [2025-09-16T21:13:31.154930] [DEBUG] [MAIN ] CAAP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:31.156145] [INFO ] [MAIN ] CAAP: Generated 1339 derivative records from 13352 primary records. [2025-09-16T21:13:31.157012] [DEBUG] [LOCAL ] CAAP: Saving derivative data. [2025-09-16T21:13:31.172692] [DEBUG] [LOCAL ] CAAP: Derivative data saved (1339 records). [2025-09-16T21:13:31.173569] [INFO ] [MAIN ] CAAP: Successfully saved derivative data. [2025-09-16T21:13:31.176787] [INFO ] [MAIN ] Derivative Progress: 304/2026 symbols completed. CAAP took 1.0s. Estimated remaining: 9m 23s. Rate: 183.6 symbols/min [2025-09-16T21:13:31.177253] [INFO ] [MAIN ] CAF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:31.192227] [DEBUG] [LOCAL ] CAF: Loaded 2322 existing records from primary storage. [2025-09-16T21:13:31.196567] [INFO ] [MAIN ] CAF: Loaded 2322 primary data records. [2025-09-16T21:13:31.202243] [DEBUG] [MAIN ] CADE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:31.230243] [INFO ] [MAIN ] CADE: Generated 1339 derivative records from 36711 primary records. [2025-09-16T21:13:31.248167] [DEBUG] [LOCAL ] CADE: Saving derivative data. [2025-09-16T21:13:31.330557] [DEBUG] [LOCAL ] CADE: Derivative data saved (1339 records). [2025-09-16T21:13:31.379736] [INFO ] [MAIN ] CADE: Successfully saved derivative data. [2025-09-16T21:13:31.386072] [INFO ] [MAIN ] Derivative Progress: 305/2026 symbols completed. CADE took 1.2s. Estimated remaining: 9m 22s. Rate: 183.8 symbols/min [2025-09-16T21:13:31.401887] [INFO ] [MAIN ] CAG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:31.540662] [DEBUG] [MAIN ] CAE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:31.541894] [INFO ] [MAIN ] CAE: Generated 1339 derivative records from 28505 primary records. [2025-09-16T21:13:31.541962] [DEBUG] [LOCAL ] CAE: Saving derivative data. [2025-09-16T21:13:31.557662] [DEBUG] [LOCAL ] CAE: Derivative data saved (1339 records). [2025-09-16T21:13:31.557887] [INFO ] [MAIN ] CAE: Successfully saved derivative data. [2025-09-16T21:13:31.559817] [INFO ] [MAIN ] Derivative Progress: 306/2026 symbols completed. CAE took 1.2s. Estimated remaining: 9m 21s. Rate: 184.1 symbols/min [2025-09-16T21:13:31.560399] [INFO ] [MAIN ] CAH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:31.590027] [DEBUG] [MAIN ] CAF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:31.590761] [INFO ] [MAIN ] CAF: Generated 1339 derivative records from 2322 primary records. [2025-09-16T21:13:31.590924] [DEBUG] [LOCAL ] CAF: Saving derivative data. [2025-09-16T21:13:31.625147] [DEBUG] [LOCAL ] CAG: Loaded 40018 existing records from primary storage. [2025-09-16T21:13:31.625817] [DEBUG] [LOCAL ] CAF: Derivative data saved (1339 records). [2025-09-16T21:13:31.626081] [INFO ] [MAIN ] CAF: Successfully saved derivative data. [2025-09-16T21:13:31.626175] [INFO ] [MAIN ] CAG: Loaded 40018 primary data records. [2025-09-16T21:13:31.628347] [INFO ] [MAIN ] Derivative Progress: 307/2026 symbols completed. CAF took 0.5s. Estimated remaining: 9m 19s. Rate: 184.5 symbols/min [2025-09-16T21:13:31.628676] [INFO ] [MAIN ] CAL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:31.749153] [DEBUG] [LOCAL ] CAH: Loaded 38301 existing records from primary storage. [2025-09-16T21:13:31.760542] [INFO ] [MAIN ] CAH: Loaded 38301 primary data records. [2025-09-16T21:13:32.040496] [DEBUG] [LOCAL ] CAL: Loaded 31697 existing records from primary storage. [2025-09-16T21:13:32.061998] [INFO ] [MAIN ] CAL: Loaded 31697 primary data records. [2025-09-16T21:13:32.524601] [DEBUG] [MAIN ] CAG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:32.530141] [INFO ] [MAIN ] CAG: Generated 1339 derivative records from 40018 primary records. [2025-09-16T21:13:32.530355] [DEBUG] [LOCAL ] CAG: Saving derivative data. [2025-09-16T21:13:32.549506] [DEBUG] [MAIN ] CAH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:32.553402] [INFO ] [MAIN ] CAH: Generated 1339 derivative records from 38301 primary records. [2025-09-16T21:13:32.553835] [DEBUG] [LOCAL ] CAH: Saving derivative data. [2025-09-16T21:13:32.569802] [DEBUG] [LOCAL ] CAG: Derivative data saved (1339 records). [2025-09-16T21:13:32.570708] [INFO ] [MAIN ] CAG: Successfully saved derivative data. [2025-09-16T21:13:32.572742] [INFO ] [MAIN ] Derivative Progress: 308/2026 symbols completed. CAG took 1.2s. Estimated remaining: 9m 22s. Rate: 183.4 symbols/min [2025-09-16T21:13:32.573579] [INFO ] [MAIN ] CALX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:32.573718] [DEBUG] [LOCAL ] CAH: Derivative data saved (1339 records). [2025-09-16T21:13:32.574090] [INFO ] [MAIN ] CAH: Successfully saved derivative data. [2025-09-16T21:13:32.576103] [INFO ] [MAIN ] Derivative Progress: 309/2026 symbols completed. CAH took 1.0s. Estimated remaining: 9m 20s. Rate: 184.0 symbols/min [2025-09-16T21:13:32.576397] [INFO ] [MAIN ] CANG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:32.591598] [DEBUG] [MAIN ] CAL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:32.592518] [INFO ] [MAIN ] CAL: Generated 1339 derivative records from 31697 primary records. [2025-09-16T21:13:32.598700] [DEBUG] [LOCAL ] CAL: Saving derivative data. [2025-09-16T21:13:32.619777] [DEBUG] [LOCAL ] CAL: Derivative data saved (1339 records). [2025-09-16T21:13:32.628630] [INFO ] [MAIN ] CAL: Successfully saved derivative data. [2025-09-16T21:13:32.639556] [DEBUG] [LOCAL ] CANG: Loaded 20458 existing records from primary storage. [2025-09-16T21:13:32.638717] [INFO ] [MAIN ] Derivative Progress: 310/2026 symbols completed. CAL took 1.0s. Estimated remaining: 9m 18s. Rate: 184.5 symbols/min [2025-09-16T21:13:32.640184] [DEBUG] [LOCAL ] CALX: Loaded 28624 existing records from primary storage. [2025-09-16T21:13:32.640280] [INFO ] [MAIN ] CANG: Loaded 20458 primary data records. [2025-09-16T21:13:32.645705] [INFO ] [MAIN ] CALX: Loaded 28624 primary data records. [2025-09-16T21:13:32.640568] [INFO ] [MAIN ] CAPL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:32.957548] [DEBUG] [LOCAL ] CAPL: Loaded 3928 existing records from primary storage. [2025-09-16T21:13:33.006228] [INFO ] [MAIN ] CAPL: Loaded 3928 primary data records. [2025-09-16T21:13:33.502579] [DEBUG] [MAIN ] CANG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:33.508027] [DEBUG] [MAIN ] CALX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:33.507789] [INFO ] [MAIN ] CANG: Generated 1339 derivative records from 20458 primary records. [2025-09-16T21:13:33.508298] [DEBUG] [LOCAL ] CANG: Saving derivative data. [2025-09-16T21:13:33.509519] [INFO ] [MAIN ] CALX: Generated 1339 derivative records from 28624 primary records. [2025-09-16T21:13:33.509957] [DEBUG] [LOCAL ] CALX: Saving derivative data. [2025-09-16T21:13:33.531988] [DEBUG] [LOCAL ] CANG: Derivative data saved (1339 records). [2025-09-16T21:13:33.532607] [INFO ] [MAIN ] CANG: Successfully saved derivative data. [2025-09-16T21:13:33.535312] [INFO ] [MAIN ] Derivative Progress: 311/2026 symbols completed. CANG took 1.0s. Estimated remaining: 9m 21s. Rate: 183.4 symbols/min [2025-09-16T21:13:33.536415] [INFO ] [MAIN ] CARR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:33.539667] [DEBUG] [LOCAL ] CALX: Derivative data saved (1339 records). [2025-09-16T21:13:33.539936] [INFO ] [MAIN ] CALX: Successfully saved derivative data. [2025-09-16T21:13:33.541890] [INFO ] [MAIN ] Derivative Progress: 312/2026 symbols completed. CALX took 1.0s. Estimated remaining: 9m 19s. Rate: 184.0 symbols/min [2025-09-16T21:13:33.552380] [INFO ] [MAIN ] CARS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:33.552769] [DEBUG] [MAIN ] CAPL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:33.554001] [INFO ] [MAIN ] CAPL: Generated 1339 derivative records from 3928 primary records. [2025-09-16T21:13:33.554235] [DEBUG] [LOCAL ] CAPL: Saving derivative data. [2025-09-16T21:13:33.567785] [DEBUG] [LOCAL ] CAPL: Derivative data saved (1339 records). [2025-09-16T21:13:33.567950] [INFO ] [MAIN ] CAPL: Successfully saved derivative data. [2025-09-16T21:13:33.569847] [INFO ] [MAIN ] Derivative Progress: 313/2026 symbols completed. CAPL took 0.9s. Estimated remaining: 9m 17s. Rate: 184.6 symbols/min [2025-09-16T21:13:33.611259] [DEBUG] [LOCAL ] CARR: Loaded 39965 existing records from primary storage. [2025-09-16T21:13:33.611476] [INFO ] [MAIN ] CARR: Loaded 39965 primary data records. [2025-09-16T21:13:33.682450] [DEBUG] [LOCAL ] CARS: Loaded 29216 existing records from primary storage. [2025-09-16T21:13:33.714737] [INFO ] [MAIN ] CARS: Loaded 29216 primary data records. [2025-09-16T21:13:34.223662] [DEBUG] [MAIN ] CARR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:34.224575] [INFO ] [MAIN ] CARR: Generated 1339 derivative records from 39965 primary records. [2025-09-16T21:13:34.225350] [DEBUG] [LOCAL ] CARR: Saving derivative data. [2025-09-16T21:13:34.240891] [DEBUG] [LOCAL ] CARR: Derivative data saved (1339 records). [2025-09-16T21:13:34.241251] [INFO ] [MAIN ] CARR: Successfully saved derivative data. [2025-09-16T21:13:34.244081] [INFO ] [MAIN ] Derivative Progress: 314/2026 symbols completed. CARR took 0.7s. Estimated remaining: 9m 18s. Rate: 183.9 symbols/min [2025-09-16T21:13:34.258788] [DEBUG] [MAIN ] CARS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:34.259421] [INFO ] [MAIN ] CARS: Generated 1339 derivative records from 29216 primary records. [2025-09-16T21:13:34.259484] [DEBUG] [LOCAL ] CARS: Saving derivative data. [2025-09-16T21:13:34.271450] [DEBUG] [LOCAL ] CARS: Derivative data saved (1339 records). [2025-09-16T21:13:34.271517] [INFO ] [MAIN ] CARS: Successfully saved derivative data. [2025-09-16T21:13:34.273221] [INFO ] [MAIN ] Derivative Progress: 315/2026 symbols completed. CARS took 0.7s. Estimated remaining: 9m 17s. Rate: 184.5 symbols/min [2025-09-16T21:13:34.274090] [INFO ] [MAIN ] CB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:34.274258] [INFO ] [MAIN ] CAT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:34.274211] [INFO ] [MAIN ] CATO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:34.282979] [DEBUG] [LOCAL ] CATO: Loaded 5079 existing records from primary storage. [2025-09-16T21:13:34.283185] [INFO ] [MAIN ] CATO: Loaded 5079 primary data records. [2025-09-16T21:13:34.549730] [DEBUG] [LOCAL ] CB: Loaded 37022 existing records from primary storage. [2025-09-16T21:13:34.588819] [DEBUG] [LOCAL ] CAT: Loaded 39407 existing records from primary storage. [2025-09-16T21:13:34.588064] [INFO ] [MAIN ] CB: Loaded 37022 primary data records. [2025-09-16T21:13:34.588996] [INFO ] [MAIN ] CAT: Loaded 39407 primary data records. [2025-09-16T21:13:35.131445] [DEBUG] [MAIN ] CATO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:35.133157] [INFO ] [MAIN ] CATO: Generated 1339 derivative records from 5079 primary records. [2025-09-16T21:13:35.133314] [DEBUG] [LOCAL ] CATO: Saving derivative data. [2025-09-16T21:13:35.147538] [DEBUG] [LOCAL ] CATO: Derivative data saved (1339 records). [2025-09-16T21:13:35.147832] [INFO ] [MAIN ] CATO: Successfully saved derivative data. [2025-09-16T21:13:35.149525] [INFO ] [MAIN ] Derivative Progress: 316/2026 symbols completed. CATO took 0.9s. Estimated remaining: 9m 19s. Rate: 183.5 symbols/min [2025-09-16T21:13:35.150097] [INFO ] [MAIN ] CBAN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:35.165115] [DEBUG] [MAIN ] CAT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:35.165942] [INFO ] [MAIN ] CAT: Generated 1339 derivative records from 39407 primary records. [2025-09-16T21:13:35.176930] [DEBUG] [LOCAL ] CAT: Saving derivative data. [2025-09-16T21:13:35.177239] [DEBUG] [MAIN ] CB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:35.177810] [INFO ] [MAIN ] CB: Generated 1339 derivative records from 37022 primary records. [2025-09-16T21:13:35.178578] [DEBUG] [LOCAL ] CB: Saving derivative data. [2025-09-16T21:13:35.191174] [DEBUG] [LOCAL ] CBAN: Loaded 7457 existing records from primary storage. [2025-09-16T21:13:35.197209] [INFO ] [MAIN ] CBAN: Loaded 7457 primary data records. [2025-09-16T21:13:35.225828] [DEBUG] [LOCAL ] CB: Derivative data saved (1339 records). [2025-09-16T21:13:35.241629] [INFO ] [MAIN ] CB: Successfully saved derivative data. [2025-09-16T21:13:35.243878] [INFO ] [MAIN ] Derivative Progress: 317/2026 symbols completed. CB took 1.0s. Estimated remaining: 9m 18s. Rate: 183.9 symbols/min [2025-09-16T21:13:35.251666] [INFO ] [MAIN ] CBL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:35.274501] [DEBUG] [LOCAL ] CAT: Derivative data saved (1339 records). [2025-09-16T21:13:35.299080] [INFO ] [MAIN ] CAT: Successfully saved derivative data. [2025-09-16T21:13:35.322811] [INFO ] [MAIN ] Derivative Progress: 318/2026 symbols completed. CAT took 1.0s. Estimated remaining: 9m 16s. Rate: 184.3 symbols/min [2025-09-16T21:13:35.345206] [INFO ] [MAIN ] CBNA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:35.379659] [DEBUG] [LOCAL ] CBL: Loaded 11971 existing records from primary storage. [2025-09-16T21:13:35.404226] [INFO ] [MAIN ] CBL: Loaded 11971 primary data records. [2025-09-16T21:13:35.563482] [DEBUG] [LOCAL ] CBNA: Loaded 2286 existing records from primary storage. [2025-09-16T21:13:35.600206] [INFO ] [MAIN ] CBNA: Loaded 2286 primary data records. [2025-09-16T21:13:36.080130] [DEBUG] [MAIN ] CBAN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:36.081440] [INFO ] [MAIN ] CBAN: Generated 1339 derivative records from 7457 primary records. [2025-09-16T21:13:36.081536] [DEBUG] [LOCAL ] CBAN: Saving derivative data. [2025-09-16T21:13:36.094910] [DEBUG] [LOCAL ] CBAN: Derivative data saved (1339 records). [2025-09-16T21:13:36.095206] [INFO ] [MAIN ] CBAN: Successfully saved derivative data. [2025-09-16T21:13:36.096671] [INFO ] [MAIN ] Derivative Progress: 319/2026 symbols completed. CBAN took 0.9s. Estimated remaining: 9m 18s. Rate: 183.5 symbols/min [2025-09-16T21:13:36.096983] [INFO ] [MAIN ] CBRE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:36.121460] [DEBUG] [MAIN ] CBL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:36.121842] [DEBUG] [MAIN ] CBNA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:36.122406] [INFO ] [MAIN ] CBL: Generated 1339 derivative records from 11971 primary records. [2025-09-16T21:13:36.122974] [INFO ] [MAIN ] CBNA: Generated 1339 derivative records from 2286 primary records. [2025-09-16T21:13:36.123082] [DEBUG] [LOCAL ] CBL: Saving derivative data. [2025-09-16T21:13:36.123476] [DEBUG] [LOCAL ] CBNA: Saving derivative data. [2025-09-16T21:13:36.153788] [DEBUG] [LOCAL ] CBNA: Derivative data saved (1339 records). [2025-09-16T21:13:36.153858] [DEBUG] [LOCAL ] CBL: Derivative data saved (1339 records). [2025-09-16T21:13:36.154043] [INFO ] [MAIN ] CBNA: Successfully saved derivative data. [2025-09-16T21:13:36.155915] [INFO ] [MAIN ] Derivative Progress: 320/2026 symbols completed. CBNA took 0.8s. Estimated remaining: 9m 16s. Rate: 184.0 symbols/min [2025-09-16T21:13:36.155992] [INFO ] [MAIN ] CBL: Successfully saved derivative data. [2025-09-16T21:13:36.156210] [INFO ] [MAIN ] CBT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:36.157980] [INFO ] [MAIN ] Derivative Progress: 321/2026 symbols completed. CBL took 0.9s. Estimated remaining: 9m 14s. Rate: 184.6 symbols/min [2025-09-16T21:13:36.158242] [INFO ] [MAIN ] CBU: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:36.173042] [DEBUG] [LOCAL ] CBRE: Loaded 37405 existing records from primary storage. [2025-09-16T21:13:36.173235] [INFO ] [MAIN ] CBRE: Loaded 37405 primary data records. [2025-09-16T21:13:36.297224] [DEBUG] [LOCAL ] CBU: Loaded 16385 existing records from primary storage. [2025-09-16T21:13:36.303619] [INFO ] [MAIN ] CBU: Loaded 16385 primary data records. [2025-09-16T21:13:36.305214] [DEBUG] [LOCAL ] CBT: Loaded 22881 existing records from primary storage. [2025-09-16T21:13:36.337458] [INFO ] [MAIN ] CBT: Loaded 22881 primary data records. [2025-09-16T21:13:37.047798] [DEBUG] [MAIN ] CBRE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:37.048786] [INFO ] [MAIN ] CBRE: Generated 1339 derivative records from 37405 primary records. [2025-09-16T21:13:37.049172] [DEBUG] [LOCAL ] CBRE: Saving derivative data. [2025-09-16T21:13:37.068027] [DEBUG] [LOCAL ] CBRE: Derivative data saved (1339 records). [2025-09-16T21:13:37.070042] [INFO ] [MAIN ] CBRE: Successfully saved derivative data. [2025-09-16T21:13:37.071748] [INFO ] [MAIN ] Derivative Progress: 322/2026 symbols completed. CBRE took 1.0s. Estimated remaining: 9m 17s. Rate: 183.6 symbols/min [2025-09-16T21:13:37.078043] [INFO ] [MAIN ] CBZ: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:37.082817] [DEBUG] [MAIN ] CBU: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:37.083854] [INFO ] [MAIN ] CBU: Generated 1339 derivative records from 16385 primary records. [2025-09-16T21:13:37.084054] [DEBUG] [LOCAL ] CBU: Saving derivative data. [2025-09-16T21:13:37.113706] [DEBUG] [LOCAL ] CBU: Derivative data saved (1339 records). [2025-09-16T21:13:37.114441] [INFO ] [MAIN ] CBU: Successfully saved derivative data. [2025-09-16T21:13:37.116528] [INFO ] [MAIN ] Derivative Progress: 323/2026 symbols completed. CBU took 1.0s. Estimated remaining: 9m 15s. Rate: 184.0 symbols/min [2025-09-16T21:13:37.116935] [INFO ] [MAIN ] CC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:37.114381] [DEBUG] [MAIN ] CBT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:37.123534] [INFO ] [MAIN ] CBT: Generated 1339 derivative records from 22881 primary records. [2025-09-16T21:13:37.124019] [DEBUG] [LOCAL ] CBT: Saving derivative data. [2025-09-16T21:13:37.145312] [DEBUG] [LOCAL ] CBZ: Loaded 24900 existing records from primary storage. [2025-09-16T21:13:37.146169] [DEBUG] [LOCAL ] CBT: Derivative data saved (1339 records). [2025-09-16T21:13:37.146269] [INFO ] [MAIN ] CBZ: Loaded 24900 primary data records. [2025-09-16T21:13:37.146504] [INFO ] [MAIN ] CBT: Successfully saved derivative data. [2025-09-16T21:13:37.184560] [INFO ] [MAIN ] Derivative Progress: 324/2026 symbols completed. CBT took 1.0s. Estimated remaining: 9m 14s. Rate: 184.5 symbols/min [2025-09-16T21:13:37.212904] [INFO ] [MAIN ] CCI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:37.443800] [DEBUG] [LOCAL ] CC: Loaded 39560 existing records from primary storage. [2025-09-16T21:13:37.444005] [INFO ] [MAIN ] CC: Loaded 39560 primary data records. [2025-09-16T21:13:37.656941] [DEBUG] [LOCAL ] CCI: Loaded 39559 existing records from primary storage. [2025-09-16T21:13:37.741191] [INFO ] [MAIN ] CCI: Loaded 39559 primary data records. [2025-09-16T21:13:38.018042] [DEBUG] [MAIN ] CBZ: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:38.018957] [INFO ] [MAIN ] CBZ: Generated 1339 derivative records from 24900 primary records. [2025-09-16T21:13:38.019066] [DEBUG] [LOCAL ] CBZ: Saving derivative data. [2025-09-16T21:13:38.032758] [DEBUG] [LOCAL ] CBZ: Derivative data saved (1339 records). [2025-09-16T21:13:38.033058] [INFO ] [MAIN ] CBZ: Successfully saved derivative data. [2025-09-16T21:13:38.034826] [INFO ] [MAIN ] Derivative Progress: 325/2026 symbols completed. CBZ took 1.0s. Estimated remaining: 9m 16s. Rate: 183.6 symbols/min [2025-09-16T21:13:38.036217] [INFO ] [MAIN ] CCIF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:38.048932] [DEBUG] [MAIN ] CC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:38.049554] [INFO ] [MAIN ] CC: Generated 1339 derivative records from 39560 primary records. [2025-09-16T21:13:38.049719] [DEBUG] [LOCAL ] CC: Saving derivative data. [2025-09-16T21:13:38.073218] [DEBUG] [LOCAL ] CCIF: Loaded 11293 existing records from primary storage. [2025-09-16T21:13:38.074156] [INFO ] [MAIN ] CCIF: Loaded 11293 primary data records. [2025-09-16T21:13:38.074098] [DEBUG] [LOCAL ] CC: Derivative data saved (1339 records). [2025-09-16T21:13:38.075661] [INFO ] [MAIN ] CC: Successfully saved derivative data. [2025-09-16T21:13:38.088723] [INFO ] [MAIN ] Derivative Progress: 326/2026 symbols completed. CC took 1.0s. Estimated remaining: 9m 14s. Rate: 184.1 symbols/min [2025-09-16T21:13:38.121832] [INFO ] [MAIN ] CCJ: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:38.160210] [DEBUG] [MAIN ] CCI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:38.191167] [INFO ] [MAIN ] CCI: Generated 1339 derivative records from 39559 primary records. [2025-09-16T21:13:38.194505] [DEBUG] [LOCAL ] CCI: Saving derivative data. [2025-09-16T21:13:38.279351] [DEBUG] [LOCAL ] CCI: Derivative data saved (1339 records). [2025-09-16T21:13:38.282201] [INFO ] [MAIN ] CCI: Successfully saved derivative data. [2025-09-16T21:13:38.284173] [INFO ] [MAIN ] Derivative Progress: 327/2026 symbols completed. CCI took 1.1s. Estimated remaining: 9m 13s. Rate: 184.3 symbols/min [2025-09-16T21:13:38.392999] [INFO ] [MAIN ] CCK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:38.422225] [DEBUG] [LOCAL ] CCJ: Loaded 40053 existing records from primary storage. [2025-09-16T21:13:38.422533] [INFO ] [MAIN ] CCJ: Loaded 40053 primary data records. [2025-09-16T21:13:38.642265] [DEBUG] [LOCAL ] CCK: Loaded 34509 existing records from primary storage. [2025-09-16T21:13:38.728477] [INFO ] [MAIN ] CCK: Loaded 34509 primary data records. [2025-09-16T21:13:38.717983] [DEBUG] [MAIN ] CCIF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:38.729996] [INFO ] [MAIN ] CCIF: Generated 1339 derivative records from 11293 primary records. [2025-09-16T21:13:38.766427] [DEBUG] [LOCAL ] CCIF: Saving derivative data. [2025-09-16T21:13:38.848414] [DEBUG] [LOCAL ] CCIF: Derivative data saved (1339 records). [2025-09-16T21:13:38.864255] [INFO ] [MAIN ] CCIF: Successfully saved derivative data. [2025-09-16T21:13:38.892418] [INFO ] [MAIN ] Derivative Progress: 328/2026 symbols completed. CCIF took 0.9s. Estimated remaining: 9m 14s. Rate: 183.8 symbols/min [2025-09-16T21:13:39.035876] [DEBUG] [MAIN ] CCJ: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:39.037349] [INFO ] [MAIN ] CCJ: Generated 1339 derivative records from 40053 primary records. [2025-09-16T21:13:39.037833] [DEBUG] [LOCAL ] CCJ: Saving derivative data. [2025-09-16T21:13:39.052372] [DEBUG] [LOCAL ] CCJ: Derivative data saved (1339 records). [2025-09-16T21:13:39.052481] [INFO ] [MAIN ] CCJ: Successfully saved derivative data. [2025-09-16T21:13:39.054439] [INFO ] [MAIN ] Derivative Progress: 329/2026 symbols completed. CCJ took 0.9s. Estimated remaining: 9m 13s. Rate: 184.1 symbols/min [2025-09-16T21:13:39.068489] [DEBUG] [MAIN ] CCK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:39.069140] [INFO ] [MAIN ] CCK: Generated 1339 derivative records from 34509 primary records. [2025-09-16T21:13:39.069256] [DEBUG] [LOCAL ] CCK: Saving derivative data. [2025-09-16T21:13:39.081612] [DEBUG] [LOCAL ] CCK: Derivative data saved (1339 records). [2025-09-16T21:13:39.081719] [INFO ] [MAIN ] CCK: Successfully saved derivative data. [2025-09-16T21:13:39.083419] [INFO ] [MAIN ] Derivative Progress: 330/2026 symbols completed. CCK took 0.7s. Estimated remaining: 9m 11s. Rate: 184.6 symbols/min [2025-09-16T21:13:39.084075] [INFO ] [MAIN ] CCL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:39.084431] [INFO ] [MAIN ] CCRD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:39.084297] [INFO ] [MAIN ] CCO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:39.094089] [DEBUG] [LOCAL ] CCRD: Loaded 7777 existing records from primary storage. [2025-09-16T21:13:39.094234] [INFO ] [MAIN ] CCRD: Loaded 7777 primary data records. [2025-09-16T21:13:39.409410] [DEBUG] [LOCAL ] CCO: Loaded 36204 existing records from primary storage. [2025-09-16T21:13:39.410159] [DEBUG] [LOCAL ] CCL: Loaded 40150 existing records from primary storage. [2025-09-16T21:13:39.410458] [INFO ] [MAIN ] CCL: Loaded 40150 primary data records. [2025-09-16T21:13:39.410383] [INFO ] [MAIN ] CCO: Loaded 36204 primary data records. [2025-09-16T21:13:39.973587] [DEBUG] [MAIN ] CCRD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:39.974458] [INFO ] [MAIN ] CCRD: Generated 1339 derivative records from 7777 primary records. [2025-09-16T21:13:39.975045] [DEBUG] [LOCAL ] CCRD: Saving derivative data. [2025-09-16T21:13:39.989674] [DEBUG] [LOCAL ] CCRD: Derivative data saved (1339 records). [2025-09-16T21:13:39.990548] [INFO ] [MAIN ] CCRD: Successfully saved derivative data. [2025-09-16T21:13:39.992598] [INFO ] [MAIN ] Derivative Progress: 331/2026 symbols completed. CCRD took 0.9s. Estimated remaining: 9m 14s. Rate: 183.6 symbols/min [2025-09-16T21:13:39.992904] [INFO ] [MAIN ] CCU: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:40.004821] [DEBUG] [MAIN ] CCL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:40.006803] [INFO ] [MAIN ] CCL: Generated 1339 derivative records from 40150 primary records. [2025-09-16T21:13:40.006988] [DEBUG] [LOCAL ] CCL: Saving derivative data. [2025-09-16T21:13:40.022770] [DEBUG] [MAIN ] CCO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:40.026292] [INFO ] [MAIN ] CCO: Generated 1339 derivative records from 36204 primary records. [2025-09-16T21:13:40.026811] [DEBUG] [LOCAL ] CCO: Saving derivative data. [2025-09-16T21:13:40.042704] [DEBUG] [LOCAL ] CCL: Derivative data saved (1339 records). [2025-09-16T21:13:40.043409] [INFO ] [MAIN ] CCL: Successfully saved derivative data. [2025-09-16T21:13:40.045845] [INFO ] [MAIN ] Derivative Progress: 332/2026 symbols completed. CCL took 1.0s. Estimated remaining: 9m 12s. Rate: 184.1 symbols/min [2025-09-16T21:13:40.052110] [INFO ] [MAIN ] CDE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:40.053273] [DEBUG] [LOCAL ] CCU: Loaded 16433 existing records from primary storage. [2025-09-16T21:13:40.053635] [INFO ] [MAIN ] CCU: Loaded 16433 primary data records. [2025-09-16T21:13:40.110115] [DEBUG] [LOCAL ] CCO: Derivative data saved (1339 records). [2025-09-16T21:13:40.124318] [INFO ] [MAIN ] CCO: Successfully saved derivative data. [2025-09-16T21:13:40.144140] [INFO ] [MAIN ] Derivative Progress: 333/2026 symbols completed. CCO took 1.1s. Estimated remaining: 9m 11s. Rate: 184.4 symbols/min [2025-09-16T21:13:40.162662] [INFO ] [MAIN ] CDLR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:40.352633] [DEBUG] [LOCAL ] CDLR: Loaded 7019 existing records from primary storage. [2025-09-16T21:13:40.354325] [INFO ] [MAIN ] CDLR: Loaded 7019 primary data records. [2025-09-16T21:13:40.377145] [DEBUG] [LOCAL ] CDE: Loaded 39994 existing records from primary storage. [2025-09-16T21:13:40.393456] [INFO ] [MAIN ] CDE: Loaded 39994 primary data records. [2025-09-16T21:13:40.955906] [DEBUG] [MAIN ] CCU: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:40.958107] [INFO ] [MAIN ] CCU: Generated 1339 derivative records from 16433 primary records. [2025-09-16T21:13:40.958430] [DEBUG] [LOCAL ] CCU: Saving derivative data. [2025-09-16T21:13:40.973950] [DEBUG] [LOCAL ] CCU: Derivative data saved (1339 records). [2025-09-16T21:13:40.975811] [INFO ] [MAIN ] CCU: Successfully saved derivative data. [2025-09-16T21:13:40.977688] [INFO ] [MAIN ] Derivative Progress: 334/2026 symbols completed. CCU took 1.0s. Estimated remaining: 9m 13s. Rate: 183.6 symbols/min [2025-09-16T21:13:40.978117] [INFO ] [MAIN ] CDP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:40.988815] [DEBUG] [MAIN ] CDLR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:40.989604] [INFO ] [MAIN ] CDLR: Generated 1339 derivative records from 7019 primary records. [2025-09-16T21:13:40.989728] [DEBUG] [LOCAL ] CDLR: Saving derivative data. [2025-09-16T21:13:41.003102] [DEBUG] [LOCAL ] CDLR: Derivative data saved (1339 records). [2025-09-16T21:13:41.003200] [INFO ] [MAIN ] CDLR: Successfully saved derivative data. [2025-09-16T21:13:41.005170] [INFO ] [MAIN ] Derivative Progress: 335/2026 symbols completed. CDLR took 0.8s. Estimated remaining: 9m 11s. Rate: 184.1 symbols/min [2025-09-16T21:13:41.005479] [INFO ] [MAIN ] CDRE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:41.015850] [DEBUG] [MAIN ] CDE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:41.016533] [INFO ] [MAIN ] CDE: Generated 1339 derivative records from 39994 primary records. [2025-09-16T21:13:41.016667] [DEBUG] [LOCAL ] CDE: Saving derivative data. [2025-09-16T21:13:41.040961] [DEBUG] [LOCAL ] CDE: Derivative data saved (1339 records). [2025-09-16T21:13:41.041055] [INFO ] [MAIN ] CDE: Successfully saved derivative data. [2025-09-16T21:13:41.044216] [INFO ] [MAIN ] Derivative Progress: 336/2026 symbols completed. CDE took 1.0s. Estimated remaining: 9m 9s. Rate: 184.6 symbols/min [2025-09-16T21:13:41.044567] [INFO ] [MAIN ] CE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:41.061875] [DEBUG] [LOCAL ] CDRE: Loaded 18653 existing records from primary storage. [2025-09-16T21:13:41.062069] [INFO ] [MAIN ] CDRE: Loaded 18653 primary data records. [2025-09-16T21:13:41.062609] [DEBUG] [LOCAL ] CDP: Loaded 31306 existing records from primary storage. [2025-09-16T21:13:41.093697] [INFO ] [MAIN ] CDP: Loaded 31306 primary data records. [2025-09-16T21:13:41.505195] [DEBUG] [LOCAL ] CE: Loaded 38140 existing records from primary storage. [2025-09-16T21:13:41.516084] [INFO ] [MAIN ] CE: Loaded 38140 primary data records. [2025-09-16T21:13:41.924556] [DEBUG] [MAIN ] CDRE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:41.934988] [INFO ] [MAIN ] CDRE: Generated 1339 derivative records from 18653 primary records. [2025-09-16T21:13:41.935259] [DEBUG] [LOCAL ] CDRE: Saving derivative data. [2025-09-16T21:13:41.936029] [DEBUG] [MAIN ] CDP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:41.937219] [INFO ] [MAIN ] CDP: Generated 1339 derivative records from 31306 primary records. [2025-09-16T21:13:41.947070] [DEBUG] [LOCAL ] CDP: Saving derivative data. [2025-09-16T21:13:41.975931] [DEBUG] [LOCAL ] CDP: Derivative data saved (1339 records). [2025-09-16T21:13:41.976611] [INFO ] [MAIN ] CDP: Successfully saved derivative data. [2025-09-16T21:13:41.976212] [DEBUG] [LOCAL ] CDRE: Derivative data saved (1339 records). [2025-09-16T21:13:41.978585] [INFO ] [MAIN ] Derivative Progress: 337/2026 symbols completed. CDP took 1.0s. Estimated remaining: 9m 12s. Rate: 183.5 symbols/min [2025-09-16T21:13:41.978962] [INFO ] [MAIN ] CEE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:41.978884] [INFO ] [MAIN ] CDRE: Successfully saved derivative data. [2025-09-16T21:13:41.976539] [DEBUG] [MAIN ] CE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:41.982129] [INFO ] [MAIN ] Derivative Progress: 338/2026 symbols completed. CDRE took 1.0s. Estimated remaining: 9m 10s. Rate: 184.1 symbols/min [2025-09-16T21:13:41.982399] [INFO ] [MAIN ] CEPU: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:41.983292] [INFO ] [MAIN ] CE: Generated 1339 derivative records from 38140 primary records. [2025-09-16T21:13:41.983737] [DEBUG] [LOCAL ] CE: Saving derivative data. [2025-09-16T21:13:42.001913] [DEBUG] [LOCAL ] CE: Derivative data saved (1339 records). [2025-09-16T21:13:42.002298] [INFO ] [MAIN ] CE: Successfully saved derivative data. [2025-09-16T21:13:42.002225] [DEBUG] [LOCAL ] CEE: Loaded 4013 existing records from primary storage. [2025-09-16T21:13:42.002440] [INFO ] [MAIN ] CEE: Loaded 4013 primary data records. [2025-09-16T21:13:42.005138] [INFO ] [MAIN ] Derivative Progress: 339/2026 symbols completed. CE took 1.0s. Estimated remaining: 9m 8s. Rate: 184.6 symbols/min [2025-09-16T21:13:42.039109] [INFO ] [MAIN ] CF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:42.120862] [DEBUG] [LOCAL ] CEPU: Loaded 18809 existing records from primary storage. [2025-09-16T21:13:42.142175] [INFO ] [MAIN ] CEPU: Loaded 18809 primary data records. [2025-09-16T21:13:42.461054] [DEBUG] [LOCAL ] CF: Loaded 38963 existing records from primary storage. [2025-09-16T21:13:42.503179] [INFO ] [MAIN ] CF: Loaded 38963 primary data records. [2025-09-16T21:13:42.919108] [DEBUG] [MAIN ] CEE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:42.920056] [INFO ] [MAIN ] CEE: Generated 1339 derivative records from 4013 primary records. [2025-09-16T21:13:42.920804] [DEBUG] [LOCAL ] CEE: Saving derivative data. [2025-09-16T21:13:42.934360] [DEBUG] [LOCAL ] CEE: Derivative data saved (1339 records). [2025-09-16T21:13:42.934881] [INFO ] [MAIN ] CEE: Successfully saved derivative data. [2025-09-16T21:13:42.936627] [INFO ] [MAIN ] Derivative Progress: 340/2026 symbols completed. CEE took 1.0s. Estimated remaining: 9m 11s. Rate: 183.6 symbols/min [2025-09-16T21:13:42.937576] [INFO ] [MAIN ] CFG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:42.950561] [DEBUG] [MAIN ] CEPU: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:42.951549] [INFO ] [MAIN ] CEPU: Generated 1339 derivative records from 18809 primary records. [2025-09-16T21:13:42.951705] [DEBUG] [LOCAL ] CEPU: Saving derivative data. [2025-09-16T21:13:42.967150] [DEBUG] [LOCAL ] CEPU: Derivative data saved (1339 records). [2025-09-16T21:13:42.968528] [INFO ] [MAIN ] CEPU: Successfully saved derivative data. [2025-09-16T21:13:42.970598] [INFO ] [MAIN ] Derivative Progress: 341/2026 symbols completed. CEPU took 1.0s. Estimated remaining: 9m 9s. Rate: 184.1 symbols/min [2025-09-16T21:13:42.970908] [INFO ] [MAIN ] CFR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:42.981188] [DEBUG] [MAIN ] CF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:42.991110] [INFO ] [MAIN ] CF: Generated 1339 derivative records from 38963 primary records. [2025-09-16T21:13:42.991362] [DEBUG] [LOCAL ] CF: Saving derivative data. [2025-09-16T21:13:43.003553] [DEBUG] [LOCAL ] CF: Derivative data saved (1339 records). [2025-09-16T21:13:43.004207] [INFO ] [MAIN ] CF: Successfully saved derivative data. [2025-09-16T21:13:43.006077] [INFO ] [MAIN ] Derivative Progress: 342/2026 symbols completed. CF took 1.0s. Estimated remaining: 9m 7s. Rate: 184.5 symbols/min [2025-09-16T21:13:43.006275] [INFO ] [MAIN ] CGAU: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:43.018557] [DEBUG] [LOCAL ] CFG: Loaded 39975 existing records from primary storage. [2025-09-16T21:13:43.018848] [INFO ] [MAIN ] CFG: Loaded 39975 primary data records. [2025-09-16T21:13:43.137614] [DEBUG] [LOCAL ] CFR: Loaded 24180 existing records from primary storage. [2025-09-16T21:13:43.158734] [INFO ] [MAIN ] CFR: Loaded 24180 primary data records. [2025-09-16T21:13:43.375198] [DEBUG] [LOCAL ] CGAU: Loaded 31389 existing records from primary storage. [2025-09-16T21:13:43.390736] [INFO ] [MAIN ] CGAU: Loaded 31389 primary data records. [2025-09-16T21:13:43.894423] [DEBUG] [MAIN ] CFG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:43.896680] [INFO ] [MAIN ] CFG: Generated 1339 derivative records from 39975 primary records. [2025-09-16T21:13:43.896996] [DEBUG] [LOCAL ] CFG: Saving derivative data. [2025-09-16T21:13:43.911770] [DEBUG] [LOCAL ] CFG: Derivative data saved (1339 records). [2025-09-16T21:13:43.913880] [INFO ] [MAIN ] CFG: Successfully saved derivative data. [2025-09-16T21:13:43.916134] [INFO ] [MAIN ] Derivative Progress: 343/2026 symbols completed. CFG took 1.0s. Estimated remaining: 9m 10s. Rate: 183.6 symbols/min [2025-09-16T21:13:43.926258] [DEBUG] [MAIN ] CFR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:43.927040] [INFO ] [MAIN ] CFR: Generated 1339 derivative records from 24180 primary records. [2025-09-16T21:13:43.927213] [DEBUG] [LOCAL ] CFR: Saving derivative data. [2025-09-16T21:13:43.949881] [DEBUG] [LOCAL ] CFR: Derivative data saved (1339 records). [2025-09-16T21:13:43.950269] [INFO ] [MAIN ] CFR: Successfully saved derivative data. [2025-09-16T21:13:43.950227] [DEBUG] [MAIN ] CGAU: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:43.952287] [INFO ] [MAIN ] Derivative Progress: 344/2026 symbols completed. CFR took 1.0s. Estimated remaining: 9m 8s. Rate: 184.1 symbols/min [2025-09-16T21:13:43.953024] [INFO ] [MAIN ] CGAU: Generated 1339 derivative records from 31389 primary records. [2025-09-16T21:13:43.953087] [DEBUG] [LOCAL ] CGAU: Saving derivative data. [2025-09-16T21:13:43.964676] [DEBUG] [LOCAL ] CGAU: Derivative data saved (1339 records). [2025-09-16T21:13:43.964740] [INFO ] [MAIN ] CGAU: Successfully saved derivative data. [2025-09-16T21:13:43.967181] [INFO ] [MAIN ] Derivative Progress: 345/2026 symbols completed. CGAU took 1.0s. Estimated remaining: 9m 6s. Rate: 184.6 symbols/min [2025-09-16T21:13:43.967597] [INFO ] [MAIN ] CHCT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:43.967772] [INFO ] [MAIN ] CGV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:43.968432] [INFO ] [MAIN ] CHE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:43.973205] [DEBUG] [LOCAL ] CGV: Loaded 954 existing records from primary storage. [2025-09-16T21:13:43.973373] [INFO ] [MAIN ] CGV: Loaded 954 primary data records. [2025-09-16T21:13:44.090628] [DEBUG] [LOCAL ] CHCT: Loaded 17905 existing records from primary storage. [2025-09-16T21:13:44.095468] [DEBUG] [LOCAL ] CHE: Loaded 11229 existing records from primary storage. [2025-09-16T21:13:44.095579] [INFO ] [MAIN ] CHCT: Loaded 17905 primary data records. [2025-09-16T21:13:44.111353] [INFO ] [MAIN ] CHE: Loaded 11229 primary data records. [2025-09-16T21:13:44.823711] [DEBUG] [MAIN ] CGV: Filtered 5181 bins outside market hours, 5781 incomplete bins [2025-09-16T21:13:44.878465] [INFO ] [MAIN ] CGV: Generated 1337 derivative records from 954 primary records. [2025-09-16T21:13:44.878886] [DEBUG] [LOCAL ] CGV: Saving derivative data. [2025-09-16T21:13:44.901765] [DEBUG] [MAIN ] CHCT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:44.901823] [DEBUG] [LOCAL ] CGV: Derivative data saved (1337 records). [2025-09-16T21:13:44.902075] [INFO ] [MAIN ] CGV: Successfully saved derivative data. [2025-09-16T21:13:44.903693] [INFO ] [MAIN ] Derivative Progress: 346/2026 symbols completed. CGV took 0.9s. Estimated remaining: 9m 9s. Rate: 183.6 symbols/min [2025-09-16T21:13:44.905030] [INFO ] [MAIN ] CHGG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:44.904894] [INFO ] [MAIN ] CHCT: Generated 1339 derivative records from 17905 primary records. [2025-09-16T21:13:44.906174] [DEBUG] [LOCAL ] CHCT: Saving derivative data. [2025-09-16T21:13:44.926759] [DEBUG] [MAIN ] CHE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:44.927888] [INFO ] [MAIN ] CHE: Generated 1339 derivative records from 11229 primary records. [2025-09-16T21:13:44.928406] [DEBUG] [LOCAL ] CHE: Saving derivative data. [2025-09-16T21:13:44.930473] [DEBUG] [LOCAL ] CHCT: Derivative data saved (1339 records). [2025-09-16T21:13:44.930543] [INFO ] [MAIN ] CHCT: Successfully saved derivative data. [2025-09-16T21:13:44.932508] [INFO ] [MAIN ] Derivative Progress: 347/2026 symbols completed. CHCT took 1.0s. Estimated remaining: 9m 7s. Rate: 184.1 symbols/min [2025-09-16T21:13:44.940952] [INFO ] [MAIN ] CHH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:44.945424] [DEBUG] [LOCAL ] CHE: Derivative data saved (1339 records). [2025-09-16T21:13:44.945610] [INFO ] [MAIN ] CHE: Successfully saved derivative data. [2025-09-16T21:13:44.947484] [INFO ] [MAIN ] Derivative Progress: 348/2026 symbols completed. CHE took 1.0s. Estimated remaining: 9m 6s. Rate: 184.6 symbols/min [2025-09-16T21:13:44.947783] [INFO ] [MAIN ] CHMI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:44.983917] [DEBUG] [LOCAL ] CHMI: Loaded 15316 existing records from primary storage. [2025-09-16T21:13:44.984856] [INFO ] [MAIN ] CHMI: Loaded 15316 primary data records. [2025-09-16T21:13:45.017191] [DEBUG] [LOCAL ] CHGG: Loaded 35600 existing records from primary storage. [2025-09-16T21:13:45.079044] [INFO ] [MAIN ] CHGG: Loaded 35600 primary data records. [2025-09-16T21:13:45.073827] [DEBUG] [LOCAL ] CHH: Loaded 23518 existing records from primary storage. [2025-09-16T21:13:45.116212] [INFO ] [MAIN ] CHH: Loaded 23518 primary data records. [2025-09-16T21:13:45.807003] [DEBUG] [MAIN ] CHMI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:45.807908] [INFO ] [MAIN ] CHMI: Generated 1339 derivative records from 15316 primary records. [2025-09-16T21:13:45.810618] [DEBUG] [LOCAL ] CHMI: Saving derivative data. [2025-09-16T21:13:45.832536] [DEBUG] [MAIN ] CHGG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:45.839790] [INFO ] [MAIN ] CHGG: Generated 1339 derivative records from 35600 primary records. [2025-09-16T21:13:45.844391] [DEBUG] [LOCAL ] CHGG: Saving derivative data. [2025-09-16T21:13:45.844590] [DEBUG] [MAIN ] CHH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:45.845781] [DEBUG] [LOCAL ] CHMI: Derivative data saved (1339 records). [2025-09-16T21:13:45.845908] [INFO ] [MAIN ] CHMI: Successfully saved derivative data. [2025-09-16T21:13:45.852210] [INFO ] [MAIN ] CHH: Generated 1339 derivative records from 23518 primary records. [2025-09-16T21:13:45.856516] [INFO ] [MAIN ] Derivative Progress: 349/2026 symbols completed. CHMI took 0.9s. Estimated remaining: 9m 8s. Rate: 183.6 symbols/min [2025-09-16T21:13:45.857171] [DEBUG] [LOCAL ] CHH: Saving derivative data. [2025-09-16T21:13:45.858706] [INFO ] [MAIN ] CHN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:45.870844] [DEBUG] [LOCAL ] CHGG: Derivative data saved (1339 records). [2025-09-16T21:13:45.871749] [INFO ] [MAIN ] CHGG: Successfully saved derivative data. [2025-09-16T21:13:45.877909] [DEBUG] [LOCAL ] CHN: Loaded 3643 existing records from primary storage. [2025-09-16T21:13:45.878290] [INFO ] [MAIN ] CHN: Loaded 3643 primary data records. [2025-09-16T21:13:45.879007] [DEBUG] [LOCAL ] CHH: Derivative data saved (1339 records). [2025-09-16T21:13:45.879098] [INFO ] [MAIN ] CHH: Successfully saved derivative data. [2025-09-16T21:13:45.877550] [INFO ] [MAIN ] Derivative Progress: 350/2026 symbols completed. CHGG took 1.0s. Estimated remaining: 9m 6s. Rate: 184.1 symbols/min [2025-09-16T21:13:45.955114] [INFO ] [MAIN ] CHPT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:45.971814] [INFO ] [MAIN ] Derivative Progress: 351/2026 symbols completed. CHH took 0.9s. Estimated remaining: 9m 5s. Rate: 184.5 symbols/min [2025-09-16T21:13:45.979726] [INFO ] [MAIN ] CHT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:46.149841] [DEBUG] [LOCAL ] CHT: Loaded 14367 existing records from primary storage. [2025-09-16T21:13:46.150011] [INFO ] [MAIN ] CHT: Loaded 14367 primary data records. [2025-09-16T21:13:46.355632] [DEBUG] [LOCAL ] CHPT: Loaded 36364 existing records from primary storage. [2025-09-16T21:13:46.438503] [INFO ] [MAIN ] CHPT: Loaded 36364 primary data records. [2025-09-16T21:13:46.590441] [DEBUG] [MAIN ] CHN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:46.624924] [INFO ] [MAIN ] CHN: Generated 1339 derivative records from 3643 primary records. [2025-09-16T21:13:46.644830] [DEBUG] [LOCAL ] CHN: Saving derivative data. [2025-09-16T21:13:46.749056] [DEBUG] [LOCAL ] CHN: Derivative data saved (1339 records). [2025-09-16T21:13:46.749282] [INFO ] [MAIN ] CHN: Successfully saved derivative data. [2025-09-16T21:13:46.751098] [INFO ] [MAIN ] Derivative Progress: 352/2026 symbols completed. CHN took 0.9s. Estimated remaining: 9m 7s. Rate: 183.8 symbols/min [2025-09-16T21:13:46.751443] [INFO ] [MAIN ] CHWY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:46.768479] [DEBUG] [MAIN ] CHT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:46.769895] [INFO ] [MAIN ] CHT: Generated 1339 derivative records from 14367 primary records. [2025-09-16T21:13:46.770056] [DEBUG] [LOCAL ] CHT: Saving derivative data. [2025-09-16T21:13:46.784342] [DEBUG] [LOCAL ] CHT: Derivative data saved (1339 records). [2025-09-16T21:13:46.784591] [INFO ] [MAIN ] CHT: Successfully saved derivative data. [2025-09-16T21:13:46.786763] [INFO ] [MAIN ] Derivative Progress: 353/2026 symbols completed. CHT took 0.8s. Estimated remaining: 9m 5s. Rate: 184.2 symbols/min [2025-09-16T21:13:46.787290] [INFO ] [MAIN ] CI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:46.813393] [DEBUG] [MAIN ] CHPT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:46.814246] [INFO ] [MAIN ] CHPT: Generated 1339 derivative records from 36364 primary records. [2025-09-16T21:13:46.814423] [DEBUG] [LOCAL ] CHPT: Saving derivative data. [2025-09-16T21:13:46.841738] [DEBUG] [LOCAL ] CHPT: Derivative data saved (1339 records). [2025-09-16T21:13:46.841908] [INFO ] [MAIN ] CHPT: Successfully saved derivative data. [2025-09-16T21:13:46.843775] [INFO ] [MAIN ] Derivative Progress: 354/2026 symbols completed. CHPT took 0.9s. Estimated remaining: 9m 3s. Rate: 184.7 symbols/min [2025-09-16T21:13:46.844726] [DEBUG] [LOCAL ] CHWY: Loaded 40012 existing records from primary storage. [2025-09-16T21:13:46.845287] [INFO ] [MAIN ] CIA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:46.845199] [INFO ] [MAIN ] CHWY: Loaded 40012 primary data records. [2025-09-16T21:13:47.004895] [DEBUG] [LOCAL ] CI: Loaded 37304 existing records from primary storage. [2025-09-16T21:13:47.037708] [INFO ] [MAIN ] CI: Loaded 37304 primary data records. [2025-09-16T21:13:47.050838] [DEBUG] [LOCAL ] CIA: Loaded 12780 existing records from primary storage. [2025-09-16T21:13:47.092531] [INFO ] [MAIN ] CIA: Loaded 12780 primary data records. [2025-09-16T21:13:47.751150] [DEBUG] [MAIN ] CHWY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:47.752340] [INFO ] [MAIN ] CHWY: Generated 1339 derivative records from 40012 primary records. [2025-09-16T21:13:47.752595] [DEBUG] [LOCAL ] CHWY: Saving derivative data. [2025-09-16T21:13:47.768175] [DEBUG] [LOCAL ] CHWY: Derivative data saved (1339 records). [2025-09-16T21:13:47.768337] [INFO ] [MAIN ] CHWY: Successfully saved derivative data. [2025-09-16T21:13:47.769973] [INFO ] [MAIN ] Derivative Progress: 355/2026 symbols completed. CHWY took 1.0s. Estimated remaining: 9m 6s. Rate: 183.7 symbols/min [2025-09-16T21:13:47.780281] [DEBUG] [MAIN ] CI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:47.780346] [INFO ] [MAIN ] CIB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:47.781165] [INFO ] [MAIN ] CI: Generated 1339 derivative records from 37304 primary records. [2025-09-16T21:13:47.781939] [DEBUG] [LOCAL ] CI: Saving derivative data. [2025-09-16T21:13:47.807202] [DEBUG] [MAIN ] CIA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:47.807931] [DEBUG] [LOCAL ] CI: Derivative data saved (1339 records). [2025-09-16T21:13:47.808728] [INFO ] [MAIN ] CIA: Generated 1339 derivative records from 12780 primary records. [2025-09-16T21:13:47.808066] [INFO ] [MAIN ] CI: Successfully saved derivative data. [2025-09-16T21:13:47.808829] [DEBUG] [LOCAL ] CIA: Saving derivative data. [2025-09-16T21:13:47.812346] [INFO ] [MAIN ] Derivative Progress: 356/2026 symbols completed. CI took 1.0s. Estimated remaining: 9m 4s. Rate: 184.1 symbols/min [2025-09-16T21:13:47.818031] [INFO ] [MAIN ] CIEN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:47.830452] [DEBUG] [LOCAL ] CIA: Derivative data saved (1339 records). [2025-09-16T21:13:47.837624] [INFO ] [MAIN ] CIA: Successfully saved derivative data. [2025-09-16T21:13:47.839906] [INFO ] [MAIN ] Derivative Progress: 357/2026 symbols completed. CIA took 1.0s. Estimated remaining: 9m 2s. Rate: 184.6 symbols/min [2025-09-16T21:13:47.840483] [DEBUG] [LOCAL ] CIB: Loaded 21993 existing records from primary storage. [2025-09-16T21:13:47.840756] [INFO ] [MAIN ] CIF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:47.840897] [INFO ] [MAIN ] CIB: Loaded 21993 primary data records. [2025-09-16T21:13:47.914663] [DEBUG] [LOCAL ] CIF: Loaded 2981 existing records from primary storage. [2025-09-16T21:13:47.956472] [INFO ] [MAIN ] CIF: Loaded 2981 primary data records. [2025-09-16T21:13:48.223268] [DEBUG] [LOCAL ] CIEN: Loaded 38661 existing records from primary storage. [2025-09-16T21:13:48.256815] [INFO ] [MAIN ] CIEN: Loaded 38661 primary data records. [2025-09-16T21:13:48.695993] [DEBUG] [MAIN ] CIB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:48.697673] [INFO ] [MAIN ] CIB: Generated 1339 derivative records from 21993 primary records. [2025-09-16T21:13:48.697778] [DEBUG] [LOCAL ] CIB: Saving derivative data. [2025-09-16T21:13:48.712390] [DEBUG] [LOCAL ] CIB: Derivative data saved (1339 records). [2025-09-16T21:13:48.712710] [INFO ] [MAIN ] CIB: Successfully saved derivative data. [2025-09-16T21:13:48.718176] [INFO ] [MAIN ] Derivative Progress: 358/2026 symbols completed. CIB took 0.9s. Estimated remaining: 9m 5s. Rate: 183.7 symbols/min [2025-09-16T21:13:48.731781] [DEBUG] [MAIN ] CIF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:48.732598] [INFO ] [MAIN ] CIF: Generated 1339 derivative records from 2981 primary records. [2025-09-16T21:13:48.732820] [DEBUG] [LOCAL ] CIF: Saving derivative data. [2025-09-16T21:13:48.744575] [DEBUG] [LOCAL ] CIF: Derivative data saved (1339 records). [2025-09-16T21:13:48.744860] [INFO ] [MAIN ] CIF: Successfully saved derivative data. [2025-09-16T21:13:48.747364] [INFO ] [MAIN ] Derivative Progress: 359/2026 symbols completed. CIF took 0.9s. Estimated remaining: 9m 3s. Rate: 184.2 symbols/min [2025-09-16T21:13:48.765474] [DEBUG] [MAIN ] CIEN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:48.766300] [INFO ] [MAIN ] CIEN: Generated 1339 derivative records from 38661 primary records. [2025-09-16T21:13:48.766366] [DEBUG] [LOCAL ] CIEN: Saving derivative data. [2025-09-16T21:13:48.778808] [DEBUG] [LOCAL ] CIEN: Derivative data saved (1339 records). [2025-09-16T21:13:48.778868] [INFO ] [MAIN ] CIEN: Successfully saved derivative data. [2025-09-16T21:13:48.780917] [INFO ] [MAIN ] Derivative Progress: 360/2026 symbols completed. CIEN took 1.0s. Estimated remaining: 9m 1s. Rate: 184.7 symbols/min [2025-09-16T21:13:48.782194] [INFO ] [MAIN ] CII: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:48.782592] [INFO ] [MAIN ] CIM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:48.782006] [INFO ] [MAIN ] CIG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:48.795996] [DEBUG] [LOCAL ] CII: Loaded 10219 existing records from primary storage. [2025-09-16T21:13:48.796214] [INFO ] [MAIN ] CII: Loaded 10219 primary data records. [2025-09-16T21:13:49.019359] [DEBUG] [LOCAL ] CIG: Loaded 32909 existing records from primary storage. [2025-09-16T21:13:49.020500] [DEBUG] [LOCAL ] CIM: Loaded 26648 existing records from primary storage. [2025-09-16T21:13:49.020618] [INFO ] [MAIN ] CIG: Loaded 32909 primary data records. [2025-09-16T21:13:49.104352] [INFO ] [MAIN ] CIM: Loaded 26648 primary data records. [2025-09-16T21:13:49.703483] [DEBUG] [MAIN ] CII: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:49.704425] [INFO ] [MAIN ] CII: Generated 1339 derivative records from 10219 primary records. [2025-09-16T21:13:49.704659] [DEBUG] [LOCAL ] CII: Saving derivative data. [2025-09-16T21:13:49.722948] [DEBUG] [LOCAL ] CII: Derivative data saved (1339 records). [2025-09-16T21:13:49.724607] [INFO ] [MAIN ] CII: Successfully saved derivative data. [2025-09-16T21:13:49.726713] [INFO ] [MAIN ] Derivative Progress: 361/2026 symbols completed. CII took 0.9s. Estimated remaining: 9m 4s. Rate: 183.7 symbols/min [2025-09-16T21:13:49.727007] [INFO ] [MAIN ] CIMN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:49.737807] [DEBUG] [MAIN ] CIG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:49.742771] [DEBUG] [LOCAL ] CIMN: Loaded 1937 existing records from primary storage. [2025-09-16T21:13:49.741002] [INFO ] [MAIN ] CIG: Generated 1339 derivative records from 32909 primary records. [2025-09-16T21:13:49.742917] [INFO ] [MAIN ] CIMN: Loaded 1937 primary data records. [2025-09-16T21:13:49.754234] [DEBUG] [LOCAL ] CIG: Saving derivative data. [2025-09-16T21:13:49.817109] [DEBUG] [MAIN ] CIM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:49.835159] [INFO ] [MAIN ] CIM: Generated 1339 derivative records from 26648 primary records. [2025-09-16T21:13:49.841086] [DEBUG] [LOCAL ] CIM: Saving derivative data. [2025-09-16T21:13:49.878986] [DEBUG] [LOCAL ] CIM: Derivative data saved (1339 records). [2025-09-16T21:13:49.884849] [DEBUG] [LOCAL ] CIG: Derivative data saved (1339 records). [2025-09-16T21:13:49.884913] [INFO ] [MAIN ] CIM: Successfully saved derivative data. [2025-09-16T21:13:49.895192] [INFO ] [MAIN ] CIG: Successfully saved derivative data. [2025-09-16T21:13:49.922075] [INFO ] [MAIN ] Derivative Progress: 362/2026 symbols completed. CIM took 1.1s. Estimated remaining: 9m 3s. Rate: 183.9 symbols/min [2025-09-16T21:13:49.957701] [INFO ] [MAIN ] Derivative Progress: 363/2026 symbols completed. CIG took 1.2s. Estimated remaining: 9m 1s. Rate: 184.4 symbols/min [2025-09-16T21:13:49.960445] [INFO ] [MAIN ] CINT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:49.933185] [INFO ] [MAIN ] CIMO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:50.047309] [DEBUG] [LOCAL ] CIMO: Loaded 2059 existing records from primary storage. [2025-09-16T21:13:50.047737] [INFO ] [MAIN ] CIMO: Loaded 2059 primary data records. [2025-09-16T21:13:50.149253] [DEBUG] [LOCAL ] CINT: Loaded 13656 existing records from primary storage. [2025-09-16T21:13:50.168079] [INFO ] [MAIN ] CINT: Loaded 13656 primary data records. [2025-09-16T21:13:50.535112] [DEBUG] [MAIN ] CIMN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:50.610585] [INFO ] [MAIN ] CIMN: Generated 1339 derivative records from 1937 primary records. [2025-09-16T21:13:50.622223] [DEBUG] [LOCAL ] CIMN: Saving derivative data. [2025-09-16T21:13:50.634860] [DEBUG] [LOCAL ] CIMN: Derivative data saved (1339 records). [2025-09-16T21:13:50.635412] [INFO ] [MAIN ] CIMN: Successfully saved derivative data. [2025-09-16T21:13:50.637102] [INFO ] [MAIN ] Derivative Progress: 364/2026 symbols completed. CIMN took 0.9s. Estimated remaining: 9m 3s. Rate: 183.8 symbols/min [2025-09-16T21:13:50.637517] [INFO ] [MAIN ] CIO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:50.659846] [DEBUG] [MAIN ] CIMO: Filtered 5181 bins outside market hours, 5780 incomplete bins [2025-09-16T21:13:50.660926] [INFO ] [MAIN ] CIMO: Generated 1338 derivative records from 2059 primary records. [2025-09-16T21:13:50.661479] [DEBUG] [LOCAL ] CIMO: Saving derivative data. [2025-09-16T21:13:50.669542] [DEBUG] [LOCAL ] CIO: Loaded 14659 existing records from primary storage. [2025-09-16T21:13:50.680200] [DEBUG] [LOCAL ] CIMO: Derivative data saved (1338 records). [2025-09-16T21:13:50.680399] [INFO ] [MAIN ] CIMO: Successfully saved derivative data. [2025-09-16T21:13:50.684724] [INFO ] [MAIN ] Derivative Progress: 365/2026 symbols completed. CIMO took 0.8s. Estimated remaining: 9m 1s. Rate: 184.2 symbols/min [2025-09-16T21:13:50.682296] [INFO ] [MAIN ] CIO: Loaded 14659 primary data records. [2025-09-16T21:13:50.685933] [INFO ] [MAIN ] CION: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:50.768863] [DEBUG] [MAIN ] CINT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:50.787928] [INFO ] [MAIN ] CINT: Generated 1339 derivative records from 13656 primary records. [2025-09-16T21:13:50.802450] [DEBUG] [LOCAL ] CINT: Saving derivative data. [2025-09-16T21:13:50.916035] [DEBUG] [LOCAL ] CINT: Derivative data saved (1339 records). [2025-09-16T21:13:50.919229] [INFO ] [MAIN ] CINT: Successfully saved derivative data. [2025-09-16T21:13:50.996844] [INFO ] [MAIN ] Derivative Progress: 366/2026 symbols completed. CINT took 1.0s. Estimated remaining: 9m 1s. Rate: 184.3 symbols/min [2025-09-16T21:13:51.007982] [INFO ] [MAIN ] CL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:50.996951] [DEBUG] [LOCAL ] CION: Loaded 20480 existing records from primary storage. [2025-09-16T21:13:51.008134] [INFO ] [MAIN ] CION: Loaded 20480 primary data records. [2025-09-16T21:13:51.303254] [DEBUG] [LOCAL ] CL: Loaded 39999 existing records from primary storage. [2025-09-16T21:13:51.305663] [INFO ] [MAIN ] CL: Loaded 39999 primary data records. [2025-09-16T21:13:51.381383] [DEBUG] [MAIN ] CIO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:51.393597] [INFO ] [MAIN ] CIO: Generated 1339 derivative records from 14659 primary records. [2025-09-16T21:13:51.421134] [DEBUG] [LOCAL ] CIO: Saving derivative data. [2025-09-16T21:13:51.509014] [DEBUG] [LOCAL ] CIO: Derivative data saved (1339 records). [2025-09-16T21:13:51.625442] [INFO ] [MAIN ] CIO: Successfully saved derivative data. [2025-09-16T21:13:51.641843] [INFO ] [MAIN ] Derivative Progress: 367/2026 symbols completed. CIO took 1.0s. Estimated remaining: 9m 2s. Rate: 183.8 symbols/min [2025-09-16T21:13:51.644495] [INFO ] [MAIN ] CLB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:51.657659] [DEBUG] [MAIN ] CION: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:51.658717] [INFO ] [MAIN ] CION: Generated 1339 derivative records from 20480 primary records. [2025-09-16T21:13:51.658986] [DEBUG] [LOCAL ] CION: Saving derivative data. [2025-09-16T21:13:51.674622] [DEBUG] [LOCAL ] CION: Derivative data saved (1339 records). [2025-09-16T21:13:51.675143] [INFO ] [MAIN ] CION: Successfully saved derivative data. [2025-09-16T21:13:51.682511] [INFO ] [MAIN ] Derivative Progress: 368/2026 symbols completed. CION took 1.0s. Estimated remaining: 9m 0s. Rate: 184.2 symbols/min [2025-09-16T21:13:51.683878] [INFO ] [MAIN ] CLCO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:51.699191] [DEBUG] [MAIN ] CL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:51.706897] [INFO ] [MAIN ] CL: Generated 1339 derivative records from 39999 primary records. [2025-09-16T21:13:51.710472] [DEBUG] [LOCAL ] CL: Saving derivative data. [2025-09-16T21:13:51.710414] [DEBUG] [LOCAL ] CLB: Loaded 24336 existing records from primary storage. [2025-09-16T21:13:51.710704] [DEBUG] [LOCAL ] CLCO: Loaded 7998 existing records from primary storage. [2025-09-16T21:13:51.711363] [INFO ] [MAIN ] CLB: Loaded 24336 primary data records. [2025-09-16T21:13:51.711498] [INFO ] [MAIN ] CLCO: Loaded 7998 primary data records. [2025-09-16T21:13:51.962471] [DEBUG] [LOCAL ] CL: Derivative data saved (1339 records). [2025-09-16T21:13:52.009950] [INFO ] [MAIN ] CL: Successfully saved derivative data. [2025-09-16T21:13:52.068142] [INFO ] [MAIN ] Derivative Progress: 369/2026 symbols completed. CL took 1.1s. Estimated remaining: 8m 60s. Rate: 184.1 symbols/min [2025-09-16T21:13:52.070317] [INFO ] [MAIN ] CLDT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:52.301506] [DEBUG] [LOCAL ] CLDT: Loaded 17684 existing records from primary storage. [2025-09-16T21:13:52.303082] [INFO ] [MAIN ] CLDT: Loaded 17684 primary data records. [2025-09-16T21:13:52.592907] [DEBUG] [MAIN ] CLCO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:52.603024] [INFO ] [MAIN ] CLCO: Generated 1339 derivative records from 7998 primary records. [2025-09-16T21:13:52.603298] [DEBUG] [LOCAL ] CLCO: Saving derivative data. [2025-09-16T21:13:52.603431] [DEBUG] [MAIN ] CLB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:52.604345] [INFO ] [MAIN ] CLB: Generated 1339 derivative records from 24336 primary records. [2025-09-16T21:13:52.605388] [DEBUG] [LOCAL ] CLB: Saving derivative data. [2025-09-16T21:13:52.619089] [DEBUG] [LOCAL ] CLCO: Derivative data saved (1339 records). [2025-09-16T21:13:52.625069] [INFO ] [MAIN ] CLCO: Successfully saved derivative data. [2025-09-16T21:13:52.630536] [INFO ] [MAIN ] Derivative Progress: 370/2026 symbols completed. CLCO took 0.9s. Estimated remaining: 9m 1s. Rate: 183.8 symbols/min [2025-09-16T21:13:52.630764] [INFO ] [MAIN ] CLF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:52.634743] [DEBUG] [LOCAL ] CLB: Derivative data saved (1339 records). [2025-09-16T21:13:52.635155] [INFO ] [MAIN ] CLB: Successfully saved derivative data. [2025-09-16T21:13:52.637587] [INFO ] [MAIN ] Derivative Progress: 371/2026 symbols completed. CLB took 1.0s. Estimated remaining: 8m 59s. Rate: 184.2 symbols/min [2025-09-16T21:13:52.638005] [INFO ] [MAIN ] CLH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:52.668562] [DEBUG] [MAIN ] CLDT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:52.669370] [INFO ] [MAIN ] CLDT: Generated 1339 derivative records from 17684 primary records. [2025-09-16T21:13:52.678139] [DEBUG] [LOCAL ] CLDT: Saving derivative data. [2025-09-16T21:13:52.696089] [DEBUG] [LOCAL ] CLH: Loaded 19781 existing records from primary storage. [2025-09-16T21:13:52.697270] [INFO ] [MAIN ] CLH: Loaded 19781 primary data records. [2025-09-16T21:13:52.756998] [DEBUG] [LOCAL ] CLDT: Derivative data saved (1339 records). [2025-09-16T21:13:52.766010] [INFO ] [MAIN ] CLDT: Successfully saved derivative data. [2025-09-16T21:13:52.773348] [INFO ] [MAIN ] Derivative Progress: 372/2026 symbols completed. CLDT took 0.7s. Estimated remaining: 8m 58s. Rate: 184.5 symbols/min [2025-09-16T21:13:52.778957] [INFO ] [MAIN ] CLS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:52.820940] [DEBUG] [LOCAL ] CLF: Loaded 40092 existing records from primary storage. [2025-09-16T21:13:52.821266] [INFO ] [MAIN ] CLF: Loaded 40092 primary data records. [2025-09-16T21:13:53.300852] [DEBUG] [LOCAL ] CLS: Loaded 40005 existing records from primary storage. [2025-09-16T21:13:53.301094] [INFO ] [MAIN ] CLS: Loaded 40005 primary data records. [2025-09-16T21:13:53.594517] [DEBUG] [MAIN ] CLH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:53.595812] [INFO ] [MAIN ] CLH: Generated 1339 derivative records from 19781 primary records. [2025-09-16T21:13:53.596153] [DEBUG] [LOCAL ] CLH: Saving derivative data. [2025-09-16T21:13:53.624878] [DEBUG] [MAIN ] CLF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:53.626606] [INFO ] [MAIN ] CLF: Generated 1339 derivative records from 40092 primary records. [2025-09-16T21:13:53.629580] [DEBUG] [LOCAL ] CLF: Saving derivative data. [2025-09-16T21:13:53.630232] [DEBUG] [LOCAL ] CLH: Derivative data saved (1339 records). [2025-09-16T21:13:53.631274] [INFO ] [MAIN ] CLH: Successfully saved derivative data. [2025-09-16T21:13:53.640965] [INFO ] [MAIN ] Derivative Progress: 373/2026 symbols completed. CLH took 1.0s. Estimated remaining: 8m 60s. Rate: 183.7 symbols/min [2025-09-16T21:13:53.648982] [DEBUG] [LOCAL ] CLF: Derivative data saved (1339 records). [2025-09-16T21:13:53.649244] [INFO ] [MAIN ] CLF: Successfully saved derivative data. [2025-09-16T21:13:53.651651] [INFO ] [MAIN ] Derivative Progress: 374/2026 symbols completed. CLF took 1.0s. Estimated remaining: 8m 58s. Rate: 184.2 symbols/min [2025-09-16T21:13:53.665935] [DEBUG] [MAIN ] CLS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:53.666751] [INFO ] [MAIN ] CLS: Generated 1339 derivative records from 40005 primary records. [2025-09-16T21:13:53.666820] [DEBUG] [LOCAL ] CLS: Saving derivative data. [2025-09-16T21:13:53.679967] [DEBUG] [LOCAL ] CLS: Derivative data saved (1339 records). [2025-09-16T21:13:53.680113] [INFO ] [MAIN ] CLS: Successfully saved derivative data. [2025-09-16T21:13:53.682056] [INFO ] [MAIN ] Derivative Progress: 375/2026 symbols completed. CLS took 0.9s. Estimated remaining: 8m 57s. Rate: 184.6 symbols/min [2025-09-16T21:13:53.682781] [INFO ] [MAIN ] CLVT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:53.682919] [INFO ] [MAIN ] CLX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:53.682737] [INFO ] [MAIN ] CLW: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:53.704189] [DEBUG] [LOCAL ] CLW: Loaded 15781 existing records from primary storage. [2025-09-16T21:13:53.704454] [INFO ] [MAIN ] CLW: Loaded 15781 primary data records. [2025-09-16T21:13:53.879922] [DEBUG] [LOCAL ] CLVT: Loaded 38762 existing records from primary storage. [2025-09-16T21:13:53.928539] [DEBUG] [LOCAL ] CLX: Loaded 38771 existing records from primary storage. [2025-09-16T21:13:53.928614] [INFO ] [MAIN ] CLVT: Loaded 38762 primary data records. [2025-09-16T21:13:53.932476] [INFO ] [MAIN ] CLX: Loaded 38771 primary data records. [2025-09-16T21:13:54.594596] [DEBUG] [MAIN ] CLW: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:54.595775] [INFO ] [MAIN ] CLW: Generated 1339 derivative records from 15781 primary records. [2025-09-16T21:13:54.597933] [DEBUG] [LOCAL ] CLW: Saving derivative data. [2025-09-16T21:13:54.623815] [DEBUG] [LOCAL ] CLW: Derivative data saved (1339 records). [2025-09-16T21:13:54.623402] [DEBUG] [MAIN ] CLVT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:54.625442] [INFO ] [MAIN ] CLVT: Generated 1339 derivative records from 38762 primary records. [2025-09-16T21:13:54.625496] [INFO ] [MAIN ] CLW: Successfully saved derivative data. [2025-09-16T21:13:54.627692] [INFO ] [MAIN ] Derivative Progress: 376/2026 symbols completed. CLW took 0.9s. Estimated remaining: 8m 59s. Rate: 183.7 symbols/min [2025-09-16T21:13:54.628312] [DEBUG] [LOCAL ] CLVT: Saving derivative data. [2025-09-16T21:13:54.629409] [INFO ] [MAIN ] CM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:54.649290] [DEBUG] [MAIN ] CLX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:54.651323] [INFO ] [MAIN ] CLX: Generated 1339 derivative records from 38771 primary records. [2025-09-16T21:13:54.651715] [DEBUG] [LOCAL ] CLX: Saving derivative data. [2025-09-16T21:13:54.659666] [DEBUG] [LOCAL ] CLVT: Derivative data saved (1339 records). [2025-09-16T21:13:54.662805] [INFO ] [MAIN ] CLVT: Successfully saved derivative data. [2025-09-16T21:13:54.666227] [INFO ] [MAIN ] Derivative Progress: 377/2026 symbols completed. CLVT took 1.0s. Estimated remaining: 8m 57s. Rate: 184.1 symbols/min [2025-09-16T21:13:54.668073] [INFO ] [MAIN ] CMA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:54.669290] [DEBUG] [LOCAL ] CLX: Derivative data saved (1339 records). [2025-09-16T21:13:54.669417] [INFO ] [MAIN ] CLX: Successfully saved derivative data. [2025-09-16T21:13:54.671759] [INFO ] [MAIN ] Derivative Progress: 378/2026 symbols completed. CLX took 1.0s. Estimated remaining: 8m 56s. Rate: 184.6 symbols/min [2025-09-16T21:13:54.672134] [INFO ] [MAIN ] CMBT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:54.700765] [DEBUG] [LOCAL ] CM: Loaded 36130 existing records from primary storage. [2025-09-16T21:13:54.700986] [INFO ] [MAIN ] CM: Loaded 36130 primary data records. [2025-09-16T21:13:54.772978] [DEBUG] [LOCAL ] CMBT: Loaded 17313 existing records from primary storage. [2025-09-16T21:13:54.786171] [INFO ] [MAIN ] CMBT: Loaded 17313 primary data records. [2025-09-16T21:13:54.996040] [DEBUG] [LOCAL ] CMA: Loaded 37171 existing records from primary storage. [2025-09-16T21:13:55.020846] [INFO ] [MAIN ] CMA: Loaded 37171 primary data records. [2025-09-16T21:13:55.542302] [DEBUG] [MAIN ] CM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:55.543415] [INFO ] [MAIN ] CM: Generated 1339 derivative records from 36130 primary records. [2025-09-16T21:13:55.543875] [DEBUG] [LOCAL ] CM: Saving derivative data. [2025-09-16T21:13:55.568780] [DEBUG] [MAIN ] CMBT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:55.570041] [INFO ] [MAIN ] CMBT: Generated 1339 derivative records from 17313 primary records. [2025-09-16T21:13:55.570847] [DEBUG] [LOCAL ] CMBT: Saving derivative data. [2025-09-16T21:13:55.572106] [DEBUG] [LOCAL ] CM: Derivative data saved (1339 records). [2025-09-16T21:13:55.578977] [INFO ] [MAIN ] CM: Successfully saved derivative data. [2025-09-16T21:13:55.582660] [INFO ] [MAIN ] Derivative Progress: 379/2026 symbols completed. CM took 1.0s. Estimated remaining: 8m 58s. Rate: 183.7 symbols/min [2025-09-16T21:13:55.584523] [INFO ] [MAIN ] CMC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:55.587626] [DEBUG] [LOCAL ] CMBT: Derivative data saved (1339 records). [2025-09-16T21:13:55.588215] [INFO ] [MAIN ] CMBT: Successfully saved derivative data. [2025-09-16T21:13:55.590464] [INFO ] [MAIN ] Derivative Progress: 380/2026 symbols completed. CMBT took 0.9s. Estimated remaining: 8m 56s. Rate: 184.2 symbols/min [2025-09-16T21:13:55.590823] [INFO ] [MAIN ] CMCM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:55.601546] [DEBUG] [MAIN ] CMA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:55.603283] [INFO ] [MAIN ] CMA: Generated 1339 derivative records from 37171 primary records. [2025-09-16T21:13:55.603393] [DEBUG] [LOCAL ] CMA: Saving derivative data. [2025-09-16T21:13:55.613333] [DEBUG] [LOCAL ] CMCM: Loaded 3467 existing records from primary storage. [2025-09-16T21:13:55.615574] [INFO ] [MAIN ] CMCM: Loaded 3467 primary data records. [2025-09-16T21:13:55.729864] [DEBUG] [LOCAL ] CMA: Derivative data saved (1339 records). [2025-09-16T21:13:55.735568] [INFO ] [MAIN ] CMA: Successfully saved derivative data. [2025-09-16T21:13:55.759996] [INFO ] [MAIN ] Derivative Progress: 381/2026 symbols completed. CMA took 1.1s. Estimated remaining: 8m 55s. Rate: 184.4 symbols/min [2025-09-16T21:13:55.817177] [INFO ] [MAIN ] CMG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:55.817864] [DEBUG] [LOCAL ] CMC: Loaded 33219 existing records from primary storage. [2025-09-16T21:13:55.821053] [INFO ] [MAIN ] CMC: Loaded 33219 primary data records. [2025-09-16T21:13:56.243486] [DEBUG] [LOCAL ] CMG: Loaded 40077 existing records from primary storage. [2025-09-16T21:13:56.244463] [INFO ] [MAIN ] CMG: Loaded 40077 primary data records. [2025-09-16T21:13:56.513744] [DEBUG] [MAIN ] CMCM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:56.526062] [INFO ] [MAIN ] CMCM: Generated 1339 derivative records from 3467 primary records. [2025-09-16T21:13:56.526231] [DEBUG] [LOCAL ] CMCM: Saving derivative data. [2025-09-16T21:13:56.538525] [DEBUG] [LOCAL ] CMCM: Derivative data saved (1339 records). [2025-09-16T21:13:56.539154] [INFO ] [MAIN ] CMCM: Successfully saved derivative data. [2025-09-16T21:13:56.541001] [INFO ] [MAIN ] Derivative Progress: 382/2026 symbols completed. CMCM took 1.0s. Estimated remaining: 8m 57s. Rate: 183.8 symbols/min [2025-09-16T21:13:56.541384] [INFO ] [MAIN ] CMI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:56.556699] [DEBUG] [MAIN ] CMC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:56.557864] [INFO ] [MAIN ] CMC: Generated 1339 derivative records from 33219 primary records. [2025-09-16T21:13:56.558128] [DEBUG] [LOCAL ] CMC: Saving derivative data. [2025-09-16T21:13:56.583447] [DEBUG] [LOCAL ] CMC: Derivative data saved (1339 records). [2025-09-16T21:13:56.584438] [INFO ] [MAIN ] CMC: Successfully saved derivative data. [2025-09-16T21:13:56.587231] [INFO ] [MAIN ] Derivative Progress: 383/2026 symbols completed. CMC took 1.0s. Estimated remaining: 8m 55s. Rate: 184.2 symbols/min [2025-09-16T21:13:56.587728] [INFO ] [MAIN ] CMP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:56.607348] [DEBUG] [MAIN ] CMG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:56.608099] [INFO ] [MAIN ] CMG: Generated 1339 derivative records from 40077 primary records. [2025-09-16T21:13:56.608271] [DEBUG] [LOCAL ] CMG: Saving derivative data. [2025-09-16T21:13:56.609309] [DEBUG] [LOCAL ] CMI: Loaded 30499 existing records from primary storage. [2025-09-16T21:13:56.609842] [INFO ] [MAIN ] CMI: Loaded 30499 primary data records. [2025-09-16T21:13:56.730910] [DEBUG] [LOCAL ] CMG: Derivative data saved (1339 records). [2025-09-16T21:13:56.731279] [INFO ] [MAIN ] CMG: Successfully saved derivative data. [2025-09-16T21:13:56.741175] [INFO ] [MAIN ] Derivative Progress: 384/2026 symbols completed. CMG took 0.9s. Estimated remaining: 8m 54s. Rate: 184.4 symbols/min [2025-09-16T21:13:56.742602] [INFO ] [MAIN ] CMRE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:56.754127] [DEBUG] [LOCAL ] CMP: Loaded 27600 existing records from primary storage. [2025-09-16T21:13:56.770244] [INFO ] [MAIN ] CMP: Loaded 27600 primary data records. [2025-09-16T21:13:57.025693] [DEBUG] [LOCAL ] CMRE: Loaded 26276 existing records from primary storage. [2025-09-16T21:13:57.042386] [INFO ] [MAIN ] CMRE: Loaded 26276 primary data records. [2025-09-16T21:13:57.482130] [DEBUG] [MAIN ] CMI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:57.483111] [INFO ] [MAIN ] CMI: Generated 1339 derivative records from 30499 primary records. [2025-09-16T21:13:57.483270] [DEBUG] [LOCAL ] CMI: Saving derivative data. [2025-09-16T21:13:57.500723] [DEBUG] [LOCAL ] CMI: Derivative data saved (1339 records). [2025-09-16T21:13:57.501952] [INFO ] [MAIN ] CMI: Successfully saved derivative data. [2025-09-16T21:13:57.503615] [INFO ] [MAIN ] Derivative Progress: 385/2026 symbols completed. CMI took 1.0s. Estimated remaining: 8m 56s. Rate: 183.8 symbols/min [2025-09-16T21:13:57.504318] [INFO ] [MAIN ] CMS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:57.519860] [DEBUG] [MAIN ] CMP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:57.520551] [INFO ] [MAIN ] CMP: Generated 1339 derivative records from 27600 primary records. [2025-09-16T21:13:57.520791] [DEBUG] [LOCAL ] CMP: Saving derivative data. [2025-09-16T21:13:57.533950] [DEBUG] [LOCAL ] CMP: Derivative data saved (1339 records). [2025-09-16T21:13:57.539571] [INFO ] [MAIN ] CMP: Successfully saved derivative data. [2025-09-16T21:13:57.542086] [INFO ] [MAIN ] Derivative Progress: 386/2026 symbols completed. CMP took 1.0s. Estimated remaining: 8m 54s. Rate: 184.2 symbols/min [2025-09-16T21:13:57.551676] [INFO ] [MAIN ] CMSA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:57.552826] [DEBUG] [MAIN ] CMRE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:57.553557] [INFO ] [MAIN ] CMRE: Generated 1339 derivative records from 26276 primary records. [2025-09-16T21:13:57.554521] [DEBUG] [LOCAL ] CMRE: Saving derivative data. [2025-09-16T21:13:57.567071] [DEBUG] [LOCAL ] CMSA: Loaded 2523 existing records from primary storage. [2025-09-16T21:13:57.567688] [INFO ] [MAIN ] CMSA: Loaded 2523 primary data records. [2025-09-16T21:13:57.694027] [DEBUG] [LOCAL ] CMS: Loaded 39283 existing records from primary storage. [2025-09-16T21:13:57.700494] [DEBUG] [LOCAL ] CMRE: Derivative data saved (1339 records). [2025-09-16T21:13:57.700409] [INFO ] [MAIN ] CMS: Loaded 39283 primary data records. [2025-09-16T21:13:57.710986] [INFO ] [MAIN ] CMRE: Successfully saved derivative data. [2025-09-16T21:13:57.723388] [INFO ] [MAIN ] Derivative Progress: 387/2026 symbols completed. CMRE took 1.0s. Estimated remaining: 8m 53s. Rate: 184.4 symbols/min [2025-09-16T21:13:57.728813] [INFO ] [MAIN ] CMSC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:57.974544] [DEBUG] [LOCAL ] CMSC: Loaded 3464 existing records from primary storage. [2025-09-16T21:13:57.985993] [INFO ] [MAIN ] CMSC: Loaded 3464 primary data records. [2025-09-16T21:13:58.462794] [DEBUG] [MAIN ] CMSA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:58.463971] [INFO ] [MAIN ] CMSA: Generated 1339 derivative records from 2523 primary records. [2025-09-16T21:13:58.464161] [DEBUG] [LOCAL ] CMSA: Saving derivative data. [2025-09-16T21:13:58.478757] [DEBUG] [LOCAL ] CMSA: Derivative data saved (1339 records). [2025-09-16T21:13:58.479040] [INFO ] [MAIN ] CMSA: Successfully saved derivative data. [2025-09-16T21:13:58.480789] [INFO ] [MAIN ] Derivative Progress: 388/2026 symbols completed. CMSA took 0.9s. Estimated remaining: 8m 55s. Rate: 183.8 symbols/min [2025-09-16T21:13:58.491049] [DEBUG] [MAIN ] CMS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:58.491924] [INFO ] [MAIN ] CMS: Generated 1339 derivative records from 39283 primary records. [2025-09-16T21:13:58.492222] [DEBUG] [LOCAL ] CMS: Saving derivative data. [2025-09-16T21:13:58.506405] [DEBUG] [LOCAL ] CMS: Derivative data saved (1339 records). [2025-09-16T21:13:58.506564] [INFO ] [MAIN ] CMS: Successfully saved derivative data. [2025-09-16T21:13:58.508762] [INFO ] [MAIN ] Derivative Progress: 389/2026 symbols completed. CMS took 1.0s. Estimated remaining: 8m 53s. Rate: 184.2 symbols/min [2025-09-16T21:13:58.518307] [DEBUG] [MAIN ] CMSC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:58.518905] [INFO ] [MAIN ] CMSC: Generated 1339 derivative records from 3464 primary records. [2025-09-16T21:13:58.518966] [DEBUG] [LOCAL ] CMSC: Saving derivative data. [2025-09-16T21:13:58.530095] [DEBUG] [LOCAL ] CMSC: Derivative data saved (1339 records). [2025-09-16T21:13:58.530153] [INFO ] [MAIN ] CMSC: Successfully saved derivative data. [2025-09-16T21:13:58.532087] [INFO ] [MAIN ] Derivative Progress: 390/2026 symbols completed. CMSC took 0.8s. Estimated remaining: 8m 52s. Rate: 184.7 symbols/min [2025-09-16T21:13:58.532729] [INFO ] [MAIN ] CMU: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:58.532802] [INFO ] [MAIN ] CMSD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:58.532934] [INFO ] [MAIN ] CMTG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:58.543766] [DEBUG] [LOCAL ] CMU: Loaded 4419 existing records from primary storage. [2025-09-16T21:13:58.543933] [INFO ] [MAIN ] CMU: Loaded 4419 primary data records. [2025-09-16T21:13:58.575091] [DEBUG] [LOCAL ] CMSD: Loaded 5674 existing records from primary storage. [2025-09-16T21:13:58.598040] [INFO ] [MAIN ] CMSD: Loaded 5674 primary data records. [2025-09-16T21:13:58.761982] [DEBUG] [LOCAL ] CMTG: Loaded 26595 existing records from primary storage. [2025-09-16T21:13:58.798712] [INFO ] [MAIN ] CMTG: Loaded 26595 primary data records. [2025-09-16T21:13:59.372323] [DEBUG] [MAIN ] CMU: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:59.373143] [INFO ] [MAIN ] CMU: Generated 1339 derivative records from 4419 primary records. [2025-09-16T21:13:59.373597] [DEBUG] [LOCAL ] CMU: Saving derivative data. [2025-09-16T21:13:59.389295] [DEBUG] [LOCAL ] CMU: Derivative data saved (1339 records). [2025-09-16T21:13:59.389942] [INFO ] [MAIN ] CMU: Successfully saved derivative data. [2025-09-16T21:13:59.400669] [INFO ] [MAIN ] Derivative Progress: 391/2026 symbols completed. CMU took 0.9s. Estimated remaining: 8m 54s. Rate: 183.9 symbols/min [2025-09-16T21:13:59.401445] [INFO ] [MAIN ] CNA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:59.401718] [DEBUG] [MAIN ] CMSD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:59.412286] [INFO ] [MAIN ] CMSD: Generated 1339 derivative records from 5674 primary records. [2025-09-16T21:13:59.412473] [DEBUG] [LOCAL ] CMSD: Saving derivative data. [2025-09-16T21:13:59.413237] [DEBUG] [MAIN ] CMTG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:13:59.414269] [INFO ] [MAIN ] CMTG: Generated 1339 derivative records from 26595 primary records. [2025-09-16T21:13:59.414557] [DEBUG] [LOCAL ] CMTG: Saving derivative data. [2025-09-16T21:13:59.436402] [DEBUG] [LOCAL ] CMTG: Derivative data saved (1339 records). [2025-09-16T21:13:59.437123] [INFO ] [MAIN ] CMTG: Successfully saved derivative data. [2025-09-16T21:13:59.439406] [INFO ] [MAIN ] Derivative Progress: 392/2026 symbols completed. CMTG took 0.9s. Estimated remaining: 8m 52s. Rate: 184.3 symbols/min [2025-09-16T21:13:59.446085] [INFO ] [MAIN ] CNC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:59.446004] [DEBUG] [LOCAL ] CMSD: Derivative data saved (1339 records). [2025-09-16T21:13:59.446247] [INFO ] [MAIN ] CMSD: Successfully saved derivative data. [2025-09-16T21:13:59.448354] [INFO ] [MAIN ] Derivative Progress: 393/2026 symbols completed. CMSD took 0.9s. Estimated remaining: 8m 50s. Rate: 184.7 symbols/min [2025-09-16T21:13:59.448878] [INFO ] [MAIN ] CNF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:13:59.462052] [DEBUG] [LOCAL ] CNA: Loaded 24774 existing records from primary storage. [2025-09-16T21:13:59.462456] [INFO ] [MAIN ] CNA: Loaded 24774 primary data records. [2025-09-16T21:13:59.509593] [DEBUG] [LOCAL ] CNF: Loaded 8738 existing records from primary storage. [2025-09-16T21:13:59.530318] [INFO ] [MAIN ] CNF: Loaded 8738 primary data records. [2025-09-16T21:13:59.780572] [DEBUG] [LOCAL ] CNC: Loaded 40138 existing records from primary storage. [2025-09-16T21:13:59.809906] [INFO ] [MAIN ] CNC: Loaded 40138 primary data records. [2025-09-16T21:14:00.309541] [DEBUG] [MAIN ] CNA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:00.316741] [INFO ] [MAIN ] CNA: Generated 1339 derivative records from 24774 primary records. [2025-09-16T21:14:00.320718] [DEBUG] [LOCAL ] CNA: Saving derivative data. [2025-09-16T21:14:00.321890] [DEBUG] [MAIN ] CNF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:00.330147] [INFO ] [MAIN ] CNF: Generated 1339 derivative records from 8738 primary records. [2025-09-16T21:14:00.333287] [DEBUG] [LOCAL ] CNF: Saving derivative data. [2025-09-16T21:14:00.335955] [DEBUG] [LOCAL ] CNA: Derivative data saved (1339 records). [2025-09-16T21:14:00.336457] [INFO ] [MAIN ] CNA: Successfully saved derivative data. [2025-09-16T21:14:00.338371] [INFO ] [MAIN ] Derivative Progress: 394/2026 symbols completed. CNA took 0.9s. Estimated remaining: 8m 52s. Rate: 183.9 symbols/min [2025-09-16T21:14:00.346586] [INFO ] [MAIN ] CNH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:00.351514] [DEBUG] [LOCAL ] CNF: Derivative data saved (1339 records). [2025-09-16T21:14:00.351831] [INFO ] [MAIN ] CNF: Successfully saved derivative data. [2025-09-16T21:14:00.354078] [INFO ] [MAIN ] Derivative Progress: 395/2026 symbols completed. CNF took 0.9s. Estimated remaining: 8m 51s. Rate: 184.4 symbols/min [2025-09-16T21:14:00.354495] [INFO ] [MAIN ] CNI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:00.368742] [DEBUG] [MAIN ] CNC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:00.369545] [INFO ] [MAIN ] CNC: Generated 1339 derivative records from 40138 primary records. [2025-09-16T21:14:00.369678] [DEBUG] [LOCAL ] CNC: Saving derivative data. [2025-09-16T21:14:00.384325] [DEBUG] [LOCAL ] CNC: Derivative data saved (1339 records). [2025-09-16T21:14:00.393420] [INFO ] [MAIN ] CNC: Successfully saved derivative data. [2025-09-16T21:14:00.396593] [INFO ] [MAIN ] Derivative Progress: 396/2026 symbols completed. CNC took 1.0s. Estimated remaining: 8m 49s. Rate: 184.8 symbols/min [2025-09-16T21:14:00.397128] [INFO ] [MAIN ] CNK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:00.422604] [DEBUG] [LOCAL ] CNH: Loaded 39916 existing records from primary storage. [2025-09-16T21:14:00.422927] [INFO ] [MAIN ] CNH: Loaded 39916 primary data records. [2025-09-16T21:14:00.520826] [DEBUG] [LOCAL ] CNI: Loaded 38509 existing records from primary storage. [2025-09-16T21:14:00.533354] [INFO ] [MAIN ] CNI: Loaded 38509 primary data records. [2025-09-16T21:14:00.762955] [DEBUG] [LOCAL ] CNK: Loaded 39385 existing records from primary storage. [2025-09-16T21:14:00.846805] [INFO ] [MAIN ] CNK: Loaded 39385 primary data records. [2025-09-16T21:14:01.357972] [DEBUG] [MAIN ] CNH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:01.359080] [INFO ] [MAIN ] CNH: Generated 1339 derivative records from 39916 primary records. [2025-09-16T21:14:01.362094] [DEBUG] [LOCAL ] CNH: Saving derivative data. [2025-09-16T21:14:01.385580] [DEBUG] [MAIN ] CNI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:01.386974] [INFO ] [MAIN ] CNI: Generated 1339 derivative records from 38509 primary records. [2025-09-16T21:14:01.390152] [DEBUG] [LOCAL ] CNI: Saving derivative data. [2025-09-16T21:14:01.390089] [DEBUG] [LOCAL ] CNH: Derivative data saved (1339 records). [2025-09-16T21:14:01.391389] [INFO ] [MAIN ] CNH: Successfully saved derivative data. [2025-09-16T21:14:01.393340] [INFO ] [MAIN ] Derivative Progress: 397/2026 symbols completed. CNH took 1.0s. Estimated remaining: 8m 52s. Rate: 183.8 symbols/min [2025-09-16T21:14:01.394178] [INFO ] [MAIN ] CNM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:01.409776] [DEBUG] [LOCAL ] CNI: Derivative data saved (1339 records). [2025-09-16T21:14:01.410135] [INFO ] [MAIN ] CNI: Successfully saved derivative data. [2025-09-16T21:14:01.412620] [INFO ] [MAIN ] Derivative Progress: 398/2026 symbols completed. CNI took 1.1s. Estimated remaining: 8m 50s. Rate: 184.3 symbols/min [2025-09-16T21:14:01.413321] [INFO ] [MAIN ] CNMD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:01.433628] [DEBUG] [MAIN ] CNK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:01.434684] [INFO ] [MAIN ] CNK: Generated 1339 derivative records from 39385 primary records. [2025-09-16T21:14:01.434838] [DEBUG] [LOCAL ] CNK: Saving derivative data. [2025-09-16T21:14:01.476340] [DEBUG] [LOCAL ] CNMD: Loaded 23618 existing records from primary storage. [2025-09-16T21:14:01.475768] [DEBUG] [LOCAL ] CNK: Derivative data saved (1339 records). [2025-09-16T21:14:01.476511] [INFO ] [MAIN ] CNK: Successfully saved derivative data. [2025-09-16T21:14:01.476601] [INFO ] [MAIN ] CNMD: Loaded 23618 primary data records. [2025-09-16T21:14:01.484572] [INFO ] [MAIN ] Derivative Progress: 399/2026 symbols completed. CNK took 1.1s. Estimated remaining: 8m 49s. Rate: 184.6 symbols/min [2025-09-16T21:14:01.517566] [INFO ] [MAIN ] CNNE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:01.586753] [DEBUG] [LOCAL ] CNM: Loaded 37677 existing records from primary storage. [2025-09-16T21:14:01.598172] [INFO ] [MAIN ] CNM: Loaded 37677 primary data records. [2025-09-16T21:14:01.934857] [DEBUG] [LOCAL ] CNNE: Loaded 26562 existing records from primary storage. [2025-09-16T21:14:01.984294] [INFO ] [MAIN ] CNNE: Loaded 26562 primary data records. [2025-09-16T21:14:02.365740] [DEBUG] [MAIN ] CNMD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:02.366486] [INFO ] [MAIN ] CNMD: Generated 1339 derivative records from 23618 primary records. [2025-09-16T21:14:02.366980] [DEBUG] [LOCAL ] CNMD: Saving derivative data. [2025-09-16T21:14:02.382473] [DEBUG] [LOCAL ] CNMD: Derivative data saved (1339 records). [2025-09-16T21:14:02.382611] [INFO ] [MAIN ] CNMD: Successfully saved derivative data. [2025-09-16T21:14:02.384192] [INFO ] [MAIN ] Derivative Progress: 400/2026 symbols completed. CNMD took 1.0s. Estimated remaining: 8m 51s. Rate: 183.8 symbols/min [2025-09-16T21:14:02.384692] [INFO ] [MAIN ] CNO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:02.395114] [DEBUG] [MAIN ] CNM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:02.395857] [INFO ] [MAIN ] CNM: Generated 1339 derivative records from 37677 primary records. [2025-09-16T21:14:02.396029] [DEBUG] [LOCAL ] CNM: Saving derivative data. [2025-09-16T21:14:02.408835] [DEBUG] [LOCAL ] CNM: Derivative data saved (1339 records). [2025-09-16T21:14:02.409003] [INFO ] [MAIN ] CNM: Successfully saved derivative data. [2025-09-16T21:14:02.411586] [INFO ] [MAIN ] Derivative Progress: 401/2026 symbols completed. CNM took 1.0s. Estimated remaining: 8m 49s. Rate: 184.2 symbols/min [2025-09-16T21:14:02.411892] [INFO ] [MAIN ] CNP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:02.425299] [DEBUG] [MAIN ] CNNE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:02.426082] [INFO ] [MAIN ] CNNE: Generated 1339 derivative records from 26562 primary records. [2025-09-16T21:14:02.433863] [DEBUG] [LOCAL ] CNNE: Saving derivative data. [2025-09-16T21:14:02.449186] [DEBUG] [LOCAL ] CNNE: Derivative data saved (1339 records). [2025-09-16T21:14:02.457926] [INFO ] [MAIN ] CNNE: Successfully saved derivative data. [2025-09-16T21:14:02.461113] [INFO ] [MAIN ] Derivative Progress: 402/2026 symbols completed. CNNE took 0.9s. Estimated remaining: 8m 48s. Rate: 184.6 symbols/min [2025-09-16T21:14:02.461475] [INFO ] [MAIN ] CNQ: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:02.462585] [DEBUG] [LOCAL ] CNO: Loaded 29999 existing records from primary storage. [2025-09-16T21:14:02.462958] [INFO ] [MAIN ] CNO: Loaded 29999 primary data records. [2025-09-16T21:14:02.625267] [DEBUG] [LOCAL ] CNP: Loaded 39844 existing records from primary storage. [2025-09-16T21:14:02.672249] [INFO ] [MAIN ] CNP: Loaded 39844 primary data records. [2025-09-16T21:14:02.908179] [DEBUG] [LOCAL ] CNQ: Loaded 39941 existing records from primary storage. [2025-09-16T21:14:02.935159] [INFO ] [MAIN ] CNQ: Loaded 39941 primary data records. [2025-09-16T21:14:03.384637] [DEBUG] [MAIN ] CNO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:03.386631] [INFO ] [MAIN ] CNO: Generated 1339 derivative records from 29999 primary records. [2025-09-16T21:14:03.387159] [DEBUG] [LOCAL ] CNO: Saving derivative data. [2025-09-16T21:14:03.403324] [DEBUG] [LOCAL ] CNO: Derivative data saved (1339 records). [2025-09-16T21:14:03.403548] [INFO ] [MAIN ] CNO: Successfully saved derivative data. [2025-09-16T21:14:03.405227] [INFO ] [MAIN ] Derivative Progress: 403/2026 symbols completed. CNO took 1.0s. Estimated remaining: 8m 50s. Rate: 183.8 symbols/min [2025-09-16T21:14:03.415382] [DEBUG] [MAIN ] CNP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:03.416298] [INFO ] [MAIN ] CNP: Generated 1339 derivative records from 39844 primary records. [2025-09-16T21:14:03.416485] [DEBUG] [LOCAL ] CNP: Saving derivative data. [2025-09-16T21:14:03.429183] [DEBUG] [LOCAL ] CNP: Derivative data saved (1339 records). [2025-09-16T21:14:03.430550] [INFO ] [MAIN ] CNP: Successfully saved derivative data. [2025-09-16T21:14:03.432723] [INFO ] [MAIN ] Derivative Progress: 404/2026 symbols completed. CNP took 1.0s. Estimated remaining: 8m 48s. Rate: 184.2 symbols/min [2025-09-16T21:14:03.442790] [DEBUG] [MAIN ] CNQ: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:03.443423] [INFO ] [MAIN ] CNQ: Generated 1339 derivative records from 39941 primary records. [2025-09-16T21:14:03.443485] [DEBUG] [LOCAL ] CNQ: Saving derivative data. [2025-09-16T21:14:03.455292] [DEBUG] [LOCAL ] CNQ: Derivative data saved (1339 records). [2025-09-16T21:14:03.455352] [INFO ] [MAIN ] CNQ: Successfully saved derivative data. [2025-09-16T21:14:03.457828] [INFO ] [MAIN ] Derivative Progress: 405/2026 symbols completed. CNQ took 1.0s. Estimated remaining: 8m 47s. Rate: 184.6 symbols/min [2025-09-16T21:14:03.458416] [INFO ] [MAIN ] CNR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:03.458529] [INFO ] [MAIN ] CNS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:03.459007] [INFO ] [MAIN ] CNX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:03.475003] [DEBUG] [LOCAL ] CNS: Loaded 14689 existing records from primary storage. [2025-09-16T21:14:03.475174] [INFO ] [MAIN ] CNS: Loaded 14689 primary data records. [2025-09-16T21:14:03.637540] [DEBUG] [LOCAL ] CNR: Loaded 32395 existing records from primary storage. [2025-09-16T21:14:03.677552] [INFO ] [MAIN ] CNR: Loaded 32395 primary data records. [2025-09-16T21:14:03.677453] [DEBUG] [LOCAL ] CNX: Loaded 38164 existing records from primary storage. [2025-09-16T21:14:03.693605] [INFO ] [MAIN ] CNX: Loaded 38164 primary data records. [2025-09-16T21:14:04.350316] [DEBUG] [MAIN ] CNS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:04.351761] [INFO ] [MAIN ] CNS: Generated 1339 derivative records from 14689 primary records. [2025-09-16T21:14:04.352722] [DEBUG] [LOCAL ] CNS: Saving derivative data. [2025-09-16T21:14:04.387107] [DEBUG] [LOCAL ] CNS: Derivative data saved (1339 records). [2025-09-16T21:14:04.387209] [INFO ] [MAIN ] CNS: Successfully saved derivative data. [2025-09-16T21:14:04.388720] [INFO ] [MAIN ] Derivative Progress: 406/2026 symbols completed. CNS took 0.9s. Estimated remaining: 8m 49s. Rate: 183.7 symbols/min [2025-09-16T21:14:04.386756] [DEBUG] [MAIN ] CNR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:04.390275] [INFO ] [MAIN ] CODI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:04.389932] [INFO ] [MAIN ] CNR: Generated 1339 derivative records from 32395 primary records. [2025-09-16T21:14:04.390631] [DEBUG] [LOCAL ] CNR: Saving derivative data. [2025-09-16T21:14:04.409671] [DEBUG] [LOCAL ] CNR: Derivative data saved (1339 records). [2025-09-16T21:14:04.409920] [INFO ] [MAIN ] CNR: Successfully saved derivative data. [2025-09-16T21:14:04.412157] [INFO ] [MAIN ] Derivative Progress: 407/2026 symbols completed. CNR took 1.0s. Estimated remaining: 8m 47s. Rate: 184.2 symbols/min [2025-09-16T21:14:04.412620] [INFO ] [MAIN ] COF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:04.430917] [DEBUG] [MAIN ] CNX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:04.431594] [INFO ] [MAIN ] CNX: Generated 1339 derivative records from 38164 primary records. [2025-09-16T21:14:04.431834] [DEBUG] [LOCAL ] CNX: Saving derivative data. [2025-09-16T21:14:04.444132] [DEBUG] [LOCAL ] CNX: Derivative data saved (1339 records). [2025-09-16T21:14:04.452427] [INFO ] [MAIN ] CNX: Successfully saved derivative data. [2025-09-16T21:14:04.454475] [INFO ] [MAIN ] Derivative Progress: 408/2026 symbols completed. CNX took 1.0s. Estimated remaining: 8m 46s. Rate: 184.6 symbols/min [2025-09-16T21:14:04.454744] [INFO ] [MAIN ] COHR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:04.456724] [DEBUG] [LOCAL ] CODI: Loaded 31403 existing records from primary storage. [2025-09-16T21:14:04.456914] [INFO ] [MAIN ] CODI: Loaded 31403 primary data records. [2025-09-16T21:14:04.749456] [DEBUG] [LOCAL ] COF: Loaded 39987 existing records from primary storage. [2025-09-16T21:14:04.749678] [INFO ] [MAIN ] COF: Loaded 39987 primary data records. [2025-09-16T21:14:04.857033] [DEBUG] [LOCAL ] COHR: Loaded 39783 existing records from primary storage. [2025-09-16T21:14:04.868664] [INFO ] [MAIN ] COHR: Loaded 39783 primary data records. [2025-09-16T21:14:05.349726] [DEBUG] [MAIN ] CODI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:05.350955] [INFO ] [MAIN ] CODI: Generated 1339 derivative records from 31403 primary records. [2025-09-16T21:14:05.351585] [DEBUG] [LOCAL ] CODI: Saving derivative data. [2025-09-16T21:14:05.366191] [DEBUG] [LOCAL ] CODI: Derivative data saved (1339 records). [2025-09-16T21:14:05.366538] [INFO ] [MAIN ] CODI: Successfully saved derivative data. [2025-09-16T21:14:05.369256] [INFO ] [MAIN ] Derivative Progress: 409/2026 symbols completed. CODI took 1.0s. Estimated remaining: 8m 48s. Rate: 183.7 symbols/min [2025-09-16T21:14:05.370267] [INFO ] [MAIN ] COLD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:05.385139] [DEBUG] [MAIN ] COF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:05.385888] [INFO ] [MAIN ] COF: Generated 1339 derivative records from 39987 primary records. [2025-09-16T21:14:05.386010] [DEBUG] [LOCAL ] COF: Saving derivative data. [2025-09-16T21:14:05.399653] [DEBUG] [LOCAL ] COF: Derivative data saved (1339 records). [2025-09-16T21:14:05.400684] [INFO ] [MAIN ] COF: Successfully saved derivative data. [2025-09-16T21:14:05.403388] [INFO ] [MAIN ] Derivative Progress: 410/2026 symbols completed. COF took 1.0s. Estimated remaining: 8m 47s. Rate: 184.1 symbols/min [2025-09-16T21:14:05.403662] [INFO ] [MAIN ] COMP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:05.414241] [DEBUG] [MAIN ] COHR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:05.415275] [INFO ] [MAIN ] COHR: Generated 1339 derivative records from 39783 primary records. [2025-09-16T21:14:05.415438] [DEBUG] [LOCAL ] COHR: Saving derivative data. [2025-09-16T21:14:05.427824] [DEBUG] [LOCAL ] COHR: Derivative data saved (1339 records). [2025-09-16T21:14:05.437479] [INFO ] [MAIN ] COHR: Successfully saved derivative data. [2025-09-16T21:14:05.441882] [INFO ] [MAIN ] Derivative Progress: 411/2026 symbols completed. COHR took 1.0s. Estimated remaining: 8m 45s. Rate: 184.5 symbols/min [2025-09-16T21:14:05.442284] [INFO ] [MAIN ] COOK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:05.463174] [DEBUG] [LOCAL ] COLD: Loaded 39001 existing records from primary storage. [2025-09-16T21:14:05.471430] [INFO ] [MAIN ] COLD: Loaded 39001 primary data records. [2025-09-16T21:14:05.529813] [DEBUG] [LOCAL ] COOK: Loaded 18606 existing records from primary storage. [2025-09-16T21:14:05.595867] [INFO ] [MAIN ] COOK: Loaded 18606 primary data records. [2025-09-16T21:14:05.622360] [DEBUG] [LOCAL ] COMP: Loaded 39767 existing records from primary storage. [2025-09-16T21:14:05.670418] [INFO ] [MAIN ] COMP: Loaded 39767 primary data records. [2025-09-16T21:14:06.431125] [DEBUG] [MAIN ] COLD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:06.444011] [INFO ] [MAIN ] COLD: Generated 1339 derivative records from 39001 primary records. [2025-09-16T21:14:06.444999] [DEBUG] [MAIN ] COOK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:06.445055] [DEBUG] [LOCAL ] COLD: Saving derivative data. [2025-09-16T21:14:06.459823] [INFO ] [MAIN ] COOK: Generated 1339 derivative records from 18606 primary records. [2025-09-16T21:14:06.460793] [DEBUG] [MAIN ] COMP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:06.461013] [DEBUG] [LOCAL ] COOK: Saving derivative data. [2025-09-16T21:14:06.462485] [INFO ] [MAIN ] COMP: Generated 1339 derivative records from 39767 primary records. [2025-09-16T21:14:06.487495] [DEBUG] [LOCAL ] COMP: Saving derivative data. [2025-09-16T21:14:06.510801] [DEBUG] [LOCAL ] COLD: Derivative data saved (1339 records). [2025-09-16T21:14:06.517767] [INFO ] [MAIN ] COLD: Successfully saved derivative data. [2025-09-16T21:14:06.523125] [DEBUG] [LOCAL ] COOK: Derivative data saved (1339 records). [2025-09-16T21:14:06.523702] [INFO ] [MAIN ] COOK: Successfully saved derivative data. [2025-09-16T21:14:06.532821] [INFO ] [MAIN ] Derivative Progress: 412/2026 symbols completed. COLD took 1.2s. Estimated remaining: 8m 48s. Rate: 183.5 symbols/min [2025-09-16T21:14:06.533391] [INFO ] [MAIN ] COP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:06.533456] [INFO ] [MAIN ] Derivative Progress: 413/2026 symbols completed. COOK took 1.1s. Estimated remaining: 8m 46s. Rate: 183.9 symbols/min [2025-09-16T21:14:06.536143] [INFO ] [MAIN ] COR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:06.538292] [DEBUG] [LOCAL ] COMP: Derivative data saved (1339 records). [2025-09-16T21:14:06.539322] [INFO ] [MAIN ] COMP: Successfully saved derivative data. [2025-09-16T21:14:06.542317] [INFO ] [MAIN ] Derivative Progress: 414/2026 symbols completed. COMP took 1.1s. Estimated remaining: 8m 45s. Rate: 184.4 symbols/min [2025-09-16T21:14:06.542668] [INFO ] [MAIN ] COTY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:06.610175] [DEBUG] [LOCAL ] COR: Loaded 34601 existing records from primary storage. [2025-09-16T21:14:06.646246] [INFO ] [MAIN ] COR: Loaded 34601 primary data records. [2025-09-16T21:14:06.645998] [DEBUG] [LOCAL ] COP: Loaded 40077 existing records from primary storage. [2025-09-16T21:14:06.682748] [INFO ] [MAIN ] COP: Loaded 40077 primary data records. [2025-09-16T21:14:06.790210] [DEBUG] [LOCAL ] COTY: Loaded 39719 existing records from primary storage. [2025-09-16T21:14:06.790465] [INFO ] [MAIN ] COTY: Loaded 39719 primary data records. [2025-09-16T21:14:07.736766] [DEBUG] [MAIN ] COR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:07.737576] [INFO ] [MAIN ] COR: Generated 1339 derivative records from 34601 primary records. [2025-09-16T21:14:07.737899] [DEBUG] [LOCAL ] COR: Saving derivative data. [2025-09-16T21:14:07.751155] [DEBUG] [LOCAL ] COR: Derivative data saved (1339 records). [2025-09-16T21:14:07.752722] [INFO ] [MAIN ] COR: Successfully saved derivative data. [2025-09-16T21:14:07.754214] [INFO ] [MAIN ] Derivative Progress: 415/2026 symbols completed. COR took 1.2s. Estimated remaining: 8m 48s. Rate: 183.2 symbols/min [2025-09-16T21:14:07.754410] [INFO ] [MAIN ] COUR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:07.773180] [DEBUG] [MAIN ] COTY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:07.777160] [DEBUG] [MAIN ] COP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:07.777980] [INFO ] [MAIN ] COTY: Generated 1339 derivative records from 39719 primary records. [2025-09-16T21:14:07.778109] [DEBUG] [LOCAL ] COTY: Saving derivative data. [2025-09-16T21:14:07.778737] [INFO ] [MAIN ] COP: Generated 1339 derivative records from 40077 primary records. [2025-09-16T21:14:07.779181] [DEBUG] [LOCAL ] COP: Saving derivative data. [2025-09-16T21:14:07.810923] [DEBUG] [LOCAL ] COP: Derivative data saved (1339 records). [2025-09-16T21:14:07.812493] [DEBUG] [LOCAL ] COTY: Derivative data saved (1339 records). [2025-09-16T21:14:07.812394] [INFO ] [MAIN ] COP: Successfully saved derivative data. [2025-09-16T21:14:07.815248] [INFO ] [MAIN ] COTY: Successfully saved derivative data. [2025-09-16T21:14:07.815160] [INFO ] [MAIN ] Derivative Progress: 416/2026 symbols completed. COP took 1.3s. Estimated remaining: 8m 46s. Rate: 183.5 symbols/min [2025-09-16T21:14:07.817661] [INFO ] [MAIN ] CP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:07.817816] [INFO ] [MAIN ] Derivative Progress: 417/2026 symbols completed. COTY took 1.3s. Estimated remaining: 8m 45s. Rate: 184.0 symbols/min [2025-09-16T21:14:07.818366] [INFO ] [MAIN ] CPA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:07.831085] [DEBUG] [LOCAL ] COUR: Loaded 36689 existing records from primary storage. [2025-09-16T21:14:07.831272] [INFO ] [MAIN ] COUR: Loaded 36689 primary data records. [2025-09-16T21:14:08.032873] [DEBUG] [LOCAL ] CPA: Loaded 21298 existing records from primary storage. [2025-09-16T21:14:08.141864] [INFO ] [MAIN ] CPA: Loaded 21298 primary data records. [2025-09-16T21:14:08.250121] [DEBUG] [LOCAL ] CP: Loaded 39666 existing records from primary storage. [2025-09-16T21:14:08.262497] [INFO ] [MAIN ] CP: Loaded 39666 primary data records. [2025-09-16T21:14:08.716207] [DEBUG] [MAIN ] COUR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:08.718152] [INFO ] [MAIN ] COUR: Generated 1339 derivative records from 36689 primary records. [2025-09-16T21:14:08.718427] [DEBUG] [LOCAL ] COUR: Saving derivative data. [2025-09-16T21:14:08.746391] [DEBUG] [LOCAL ] COUR: Derivative data saved (1339 records). [2025-09-16T21:14:08.747169] [INFO ] [MAIN ] COUR: Successfully saved derivative data. [2025-09-16T21:14:08.749850] [INFO ] [MAIN ] Derivative Progress: 418/2026 symbols completed. COUR took 1.0s. Estimated remaining: 8m 47s. Rate: 183.2 symbols/min [2025-09-16T21:14:08.746979] [DEBUG] [MAIN ] CPA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:08.750865] [INFO ] [MAIN ] CPA: Generated 1339 derivative records from 21298 primary records. [2025-09-16T21:14:08.751129] [DEBUG] [LOCAL ] CPA: Saving derivative data. [2025-09-16T21:14:08.765294] [DEBUG] [LOCAL ] CPA: Derivative data saved (1339 records). [2025-09-16T21:14:08.765388] [INFO ] [MAIN ] CPA: Successfully saved derivative data. [2025-09-16T21:14:08.767228] [INFO ] [MAIN ] Derivative Progress: 419/2026 symbols completed. CPA took 0.9s. Estimated remaining: 8m 45s. Rate: 183.6 symbols/min [2025-09-16T21:14:08.776915] [DEBUG] [MAIN ] CP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:08.777598] [INFO ] [MAIN ] CP: Generated 1339 derivative records from 39666 primary records. [2025-09-16T21:14:08.777683] [DEBUG] [LOCAL ] CP: Saving derivative data. [2025-09-16T21:14:08.789783] [DEBUG] [LOCAL ] CP: Derivative data saved (1339 records). [2025-09-16T21:14:08.789915] [INFO ] [MAIN ] CP: Successfully saved derivative data. [2025-09-16T21:14:08.792502] [INFO ] [MAIN ] Derivative Progress: 420/2026 symbols completed. CP took 1.0s. Estimated remaining: 8m 44s. Rate: 184.0 symbols/min [2025-09-16T21:14:08.793163] [INFO ] [MAIN ] CPAY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:08.793852] [INFO ] [MAIN ] CPF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:08.793970] [INFO ] [MAIN ] CPK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:08.807981] [DEBUG] [LOCAL ] CPF: Loaded 10949 existing records from primary storage. [2025-09-16T21:14:08.810738] [INFO ] [MAIN ] CPF: Loaded 10949 primary data records. [2025-09-16T21:14:08.902036] [DEBUG] [LOCAL ] CPK: Loaded 9239 existing records from primary storage. [2025-09-16T21:14:08.927578] [INFO ] [MAIN ] CPK: Loaded 9239 primary data records. [2025-09-16T21:14:08.957928] [DEBUG] [LOCAL ] CPAY: Loaded 22534 existing records from primary storage. [2025-09-16T21:14:09.027457] [INFO ] [MAIN ] CPAY: Loaded 22534 primary data records. [2025-09-16T21:14:09.675866] [DEBUG] [MAIN ] CPF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:09.677770] [INFO ] [MAIN ] CPF: Generated 1339 derivative records from 10949 primary records. [2025-09-16T21:14:09.678240] [DEBUG] [LOCAL ] CPF: Saving derivative data. [2025-09-16T21:14:09.702397] [DEBUG] [MAIN ] CPK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:09.703778] [INFO ] [MAIN ] CPK: Generated 1339 derivative records from 9239 primary records. [2025-09-16T21:14:09.706836] [DEBUG] [LOCAL ] CPK: Saving derivative data. [2025-09-16T21:14:09.708044] [DEBUG] [LOCAL ] CPF: Derivative data saved (1339 records). [2025-09-16T21:14:09.708380] [INFO ] [MAIN ] CPF: Successfully saved derivative data. [2025-09-16T21:14:09.715496] [INFO ] [MAIN ] Derivative Progress: 421/2026 symbols completed. CPF took 0.9s. Estimated remaining: 8m 46s. Rate: 183.2 symbols/min [2025-09-16T21:14:09.719053] [INFO ] [MAIN ] CPNG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:09.730275] [DEBUG] [MAIN ] CPAY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:09.732731] [INFO ] [MAIN ] CPAY: Generated 1339 derivative records from 22534 primary records. [2025-09-16T21:14:09.733158] [DEBUG] [LOCAL ] CPAY: Saving derivative data. [2025-09-16T21:14:09.734263] [DEBUG] [LOCAL ] CPK: Derivative data saved (1339 records). [2025-09-16T21:14:09.734328] [INFO ] [MAIN ] CPK: Successfully saved derivative data. [2025-09-16T21:14:09.736466] [INFO ] [MAIN ] Derivative Progress: 422/2026 symbols completed. CPK took 0.9s. Estimated remaining: 8m 44s. Rate: 183.6 symbols/min [2025-09-16T21:14:09.736698] [INFO ] [MAIN ] CPRI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:09.749264] [DEBUG] [LOCAL ] CPAY: Derivative data saved (1339 records). [2025-09-16T21:14:09.749529] [INFO ] [MAIN ] CPAY: Successfully saved derivative data. [2025-09-16T21:14:09.751501] [INFO ] [MAIN ] Derivative Progress: 423/2026 symbols completed. CPAY took 1.0s. Estimated remaining: 8m 43s. Rate: 184.0 symbols/min [2025-09-16T21:14:09.751813] [INFO ] [MAIN ] CPS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:09.789169] [DEBUG] [LOCAL ] CPS: Loaded 18635 existing records from primary storage. [2025-09-16T21:14:09.789379] [INFO ] [MAIN ] CPS: Loaded 18635 primary data records. [2025-09-16T21:14:09.916269] [DEBUG] [LOCAL ] CPNG: Loaded 40038 existing records from primary storage. [2025-09-16T21:14:09.916517] [INFO ] [MAIN ] CPNG: Loaded 40038 primary data records. [2025-09-16T21:14:09.917433] [DEBUG] [LOCAL ] CPRI: Loaded 39119 existing records from primary storage. [2025-09-16T21:14:09.965435] [INFO ] [MAIN ] CPRI: Loaded 39119 primary data records. [2025-09-16T21:14:10.670567] [DEBUG] [MAIN ] CPS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:10.671662] [INFO ] [MAIN ] CPS: Generated 1339 derivative records from 18635 primary records. [2025-09-16T21:14:10.671964] [DEBUG] [LOCAL ] CPS: Saving derivative data. [2025-09-16T21:14:10.685172] [DEBUG] [LOCAL ] CPS: Derivative data saved (1339 records). [2025-09-16T21:14:10.686008] [INFO ] [MAIN ] CPS: Successfully saved derivative data. [2025-09-16T21:14:10.687509] [INFO ] [MAIN ] Derivative Progress: 424/2026 symbols completed. CPS took 0.9s. Estimated remaining: 8m 45s. Rate: 183.2 symbols/min [2025-09-16T21:14:10.690959] [INFO ] [MAIN ] CPT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:10.711470] [DEBUG] [MAIN ] CPRI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:10.711759] [DEBUG] [MAIN ] CPNG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:10.712456] [INFO ] [MAIN ] CPRI: Generated 1339 derivative records from 39119 primary records. [2025-09-16T21:14:10.713282] [INFO ] [MAIN ] CPNG: Generated 1339 derivative records from 40038 primary records. [2025-09-16T21:14:10.713383] [DEBUG] [LOCAL ] CPNG: Saving derivative data. [2025-09-16T21:14:10.713435] [DEBUG] [LOCAL ] CPRI: Saving derivative data. [2025-09-16T21:14:10.735442] [DEBUG] [LOCAL ] CPNG: Derivative data saved (1339 records). [2025-09-16T21:14:10.735581] [INFO ] [MAIN ] CPNG: Successfully saved derivative data. [2025-09-16T21:14:10.738670] [INFO ] [MAIN ] Derivative Progress: 425/2026 symbols completed. CPNG took 1.0s. Estimated remaining: 8m 43s. Rate: 183.6 symbols/min [2025-09-16T21:14:10.739022] [INFO ] [MAIN ] CQP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:10.743142] [DEBUG] [LOCAL ] CPRI: Derivative data saved (1339 records). [2025-09-16T21:14:10.743299] [INFO ] [MAIN ] CPRI: Successfully saved derivative data. [2025-09-16T21:14:10.745450] [INFO ] [MAIN ] Derivative Progress: 426/2026 symbols completed. CPRI took 1.0s. Estimated remaining: 8m 42s. Rate: 184.0 symbols/min [2025-09-16T21:14:10.745931] [INFO ] [MAIN ] CR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:10.767401] [DEBUG] [LOCAL ] CQP: Loaded 15075 existing records from primary storage. [2025-09-16T21:14:10.780257] [INFO ] [MAIN ] CQP: Loaded 15075 primary data records. [2025-09-16T21:14:10.825417] [DEBUG] [LOCAL ] CPT: Loaded 32824 existing records from primary storage. [2025-09-16T21:14:10.830749] [INFO ] [MAIN ] CPT: Loaded 32824 primary data records. [2025-09-16T21:14:10.869498] [DEBUG] [LOCAL ] CR: Loaded 17929 existing records from primary storage. [2025-09-16T21:14:10.968452] [INFO ] [MAIN ] CR: Loaded 17929 primary data records. [2025-09-16T21:14:11.610125] [DEBUG] [MAIN ] CQP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:11.610981] [INFO ] [MAIN ] CQP: Generated 1339 derivative records from 15075 primary records. [2025-09-16T21:14:11.611244] [DEBUG] [LOCAL ] CQP: Saving derivative data. [2025-09-16T21:14:11.633000] [DEBUG] [LOCAL ] CQP: Derivative data saved (1339 records). [2025-09-16T21:14:11.633104] [INFO ] [MAIN ] CQP: Successfully saved derivative data. [2025-09-16T21:14:11.630710] [DEBUG] [MAIN ] CPT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:11.634831] [INFO ] [MAIN ] Derivative Progress: 427/2026 symbols completed. CQP took 0.9s. Estimated remaining: 8m 44s. Rate: 183.2 symbols/min [2025-09-16T21:14:11.635621] [INFO ] [MAIN ] CPT: Generated 1339 derivative records from 32824 primary records. [2025-09-16T21:14:11.637120] [INFO ] [MAIN ] CRBD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:11.635784] [DEBUG] [LOCAL ] CPT: Saving derivative data. [2025-09-16T21:14:11.657100] [DEBUG] [MAIN ] CR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:11.660275] [INFO ] [MAIN ] CR: Generated 1339 derivative records from 17929 primary records. [2025-09-16T21:14:11.660411] [DEBUG] [LOCAL ] CPT: Derivative data saved (1339 records). [2025-09-16T21:14:11.660473] [DEBUG] [LOCAL ] CR: Saving derivative data. [2025-09-16T21:14:11.663159] [INFO ] [MAIN ] CPT: Successfully saved derivative data. [2025-09-16T21:14:11.671217] [INFO ] [MAIN ] Derivative Progress: 428/2026 symbols completed. CPT took 1.0s. Estimated remaining: 8m 42s. Rate: 183.6 symbols/min [2025-09-16T21:14:11.674248] [INFO ] [MAIN ] CRBG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:11.681280] [DEBUG] [LOCAL ] CRBD: Loaded 6926 existing records from primary storage. [2025-09-16T21:14:11.681357] [DEBUG] [LOCAL ] CR: Derivative data saved (1339 records). [2025-09-16T21:14:11.681529] [INFO ] [MAIN ] CR: Successfully saved derivative data. [2025-09-16T21:14:11.681598] [INFO ] [MAIN ] CRBD: Loaded 6926 primary data records. [2025-09-16T21:14:11.683599] [INFO ] [MAIN ] Derivative Progress: 429/2026 symbols completed. CR took 0.9s. Estimated remaining: 8m 41s. Rate: 184.0 symbols/min [2025-09-16T21:14:11.715158] [INFO ] [MAIN ] CRC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:11.978223] [DEBUG] [LOCAL ] CRBG: Loaded 39103 existing records from primary storage. [2025-09-16T21:14:11.987867] [INFO ] [MAIN ] CRBG: Loaded 39103 primary data records. [2025-09-16T21:14:12.024743] [DEBUG] [LOCAL ] CRC: Loaded 32855 existing records from primary storage. [2025-09-16T21:14:12.043408] [INFO ] [MAIN ] CRC: Loaded 32855 primary data records. [2025-09-16T21:14:12.557672] [DEBUG] [MAIN ] CRBD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:12.559110] [INFO ] [MAIN ] CRBD: Generated 1339 derivative records from 6926 primary records. [2025-09-16T21:14:12.560060] [DEBUG] [LOCAL ] CRBD: Saving derivative data. [2025-09-16T21:14:12.574067] [DEBUG] [LOCAL ] CRBD: Derivative data saved (1339 records). [2025-09-16T21:14:12.574294] [INFO ] [MAIN ] CRBD: Successfully saved derivative data. [2025-09-16T21:14:12.575983] [INFO ] [MAIN ] Derivative Progress: 430/2026 symbols completed. CRBD took 0.9s. Estimated remaining: 8m 42s. Rate: 183.3 symbols/min [2025-09-16T21:14:12.576228] [INFO ] [MAIN ] CRGY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:12.592831] [DEBUG] [MAIN ] CRBG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:12.593526] [INFO ] [MAIN ] CRBG: Generated 1339 derivative records from 39103 primary records. [2025-09-16T21:14:12.593598] [DEBUG] [LOCAL ] CRBG: Saving derivative data. [2025-09-16T21:14:12.607419] [DEBUG] [LOCAL ] CRBG: Derivative data saved (1339 records). [2025-09-16T21:14:12.607524] [INFO ] [MAIN ] CRBG: Successfully saved derivative data. [2025-09-16T21:14:12.609325] [INFO ] [MAIN ] Derivative Progress: 431/2026 symbols completed. CRBG took 0.9s. Estimated remaining: 8m 41s. Rate: 183.7 symbols/min [2025-09-16T21:14:12.615301] [INFO ] [MAIN ] CRH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:12.619606] [DEBUG] [MAIN ] CRC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:12.620212] [INFO ] [MAIN ] CRC: Generated 1339 derivative records from 32855 primary records. [2025-09-16T21:14:12.620661] [DEBUG] [LOCAL ] CRC: Saving derivative data. [2025-09-16T21:14:12.642059] [DEBUG] [LOCAL ] CRC: Derivative data saved (1339 records). [2025-09-16T21:14:12.642256] [INFO ] [MAIN ] CRC: Successfully saved derivative data. [2025-09-16T21:14:12.644750] [INFO ] [MAIN ] Derivative Progress: 432/2026 symbols completed. CRC took 0.9s. Estimated remaining: 8m 40s. Rate: 184.1 symbols/min [2025-09-16T21:14:12.645184] [INFO ] [MAIN ] CRK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:12.660152] [DEBUG] [LOCAL ] CRGY: Loaded 38979 existing records from primary storage. [2025-09-16T21:14:12.660321] [INFO ] [MAIN ] CRGY: Loaded 38979 primary data records. [2025-09-16T21:14:12.978624] [DEBUG] [LOCAL ] CRH: Loaded 39829 existing records from primary storage. [2025-09-16T21:14:12.979395] [INFO ] [MAIN ] CRH: Loaded 39829 primary data records. [2025-09-16T21:14:12.979323] [DEBUG] [LOCAL ] CRK: Loaded 38747 existing records from primary storage. [2025-09-16T21:14:12.979751] [INFO ] [MAIN ] CRK: Loaded 38747 primary data records. [2025-09-16T21:14:13.545137] [DEBUG] [MAIN ] CRGY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:13.546314] [INFO ] [MAIN ] CRGY: Generated 1339 derivative records from 38979 primary records. [2025-09-16T21:14:13.546529] [DEBUG] [LOCAL ] CRGY: Saving derivative data. [2025-09-16T21:14:13.561367] [DEBUG] [LOCAL ] CRGY: Derivative data saved (1339 records). [2025-09-16T21:14:13.561597] [INFO ] [MAIN ] CRGY: Successfully saved derivative data. [2025-09-16T21:14:13.563687] [INFO ] [MAIN ] Derivative Progress: 433/2026 symbols completed. CRGY took 1.0s. Estimated remaining: 8m 41s. Rate: 183.3 symbols/min [2025-09-16T21:14:13.579007] [DEBUG] [MAIN ] CRH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:13.580699] [INFO ] [MAIN ] CRH: Generated 1339 derivative records from 39829 primary records. [2025-09-16T21:14:13.580888] [DEBUG] [LOCAL ] CRH: Saving derivative data. [2025-09-16T21:14:13.599968] [DEBUG] [MAIN ] CRK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:13.603097] [INFO ] [MAIN ] CRK: Generated 1339 derivative records from 38747 primary records. [2025-09-16T21:14:13.603267] [DEBUG] [LOCAL ] CRH: Derivative data saved (1339 records). [2025-09-16T21:14:13.603349] [DEBUG] [LOCAL ] CRK: Saving derivative data. [2025-09-16T21:14:13.603969] [INFO ] [MAIN ] CRH: Successfully saved derivative data. [2025-09-16T21:14:13.605540] [INFO ] [MAIN ] Derivative Progress: 434/2026 symbols completed. CRH took 1.0s. Estimated remaining: 8m 40s. Rate: 183.7 symbols/min [2025-09-16T21:14:13.617440] [DEBUG] [LOCAL ] CRK: Derivative data saved (1339 records). [2025-09-16T21:14:13.617508] [INFO ] [MAIN ] CRK: Successfully saved derivative data. [2025-09-16T21:14:13.620213] [INFO ] [MAIN ] Derivative Progress: 435/2026 symbols completed. CRK took 1.0s. Estimated remaining: 8m 39s. Rate: 184.1 symbols/min [2025-09-16T21:14:13.620773] [INFO ] [MAIN ] CRT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:13.620744] [INFO ] [MAIN ] CRS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:13.620869] [INFO ] [MAIN ] CRL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:13.626888] [DEBUG] [LOCAL ] CRT: Loaded 3500 existing records from primary storage. [2025-09-16T21:14:13.627017] [INFO ] [MAIN ] CRT: Loaded 3500 primary data records. [2025-09-16T21:14:13.934347] [DEBUG] [LOCAL ] CRS: Loaded 32329 existing records from primary storage. [2025-09-16T21:14:13.933824] [DEBUG] [LOCAL ] CRL: Loaded 31389 existing records from primary storage. [2025-09-16T21:14:13.934529] [INFO ] [MAIN ] CRS: Loaded 32329 primary data records. [2025-09-16T21:14:13.934749] [INFO ] [MAIN ] CRL: Loaded 31389 primary data records. [2025-09-16T21:14:14.498476] [DEBUG] [MAIN ] CRT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:14.499499] [INFO ] [MAIN ] CRT: Generated 1339 derivative records from 3500 primary records. [2025-09-16T21:14:14.500913] [DEBUG] [LOCAL ] CRT: Saving derivative data. [2025-09-16T21:14:14.514426] [DEBUG] [LOCAL ] CRT: Derivative data saved (1339 records). [2025-09-16T21:14:14.514495] [INFO ] [MAIN ] CRT: Successfully saved derivative data. [2025-09-16T21:14:14.516217] [INFO ] [MAIN ] Derivative Progress: 436/2026 symbols completed. CRT took 0.9s. Estimated remaining: 8m 40s. Rate: 183.3 symbols/min [2025-09-16T21:14:14.516666] [INFO ] [MAIN ] CSAN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:14.530593] [DEBUG] [MAIN ] CRS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:14.532759] [INFO ] [MAIN ] CRS: Generated 1339 derivative records from 32329 primary records. [2025-09-16T21:14:14.532914] [DEBUG] [LOCAL ] CRS: Saving derivative data. [2025-09-16T21:14:14.554988] [DEBUG] [LOCAL ] CRS: Derivative data saved (1339 records). [2025-09-16T21:14:14.555149] [INFO ] [MAIN ] CRS: Successfully saved derivative data. [2025-09-16T21:14:14.557282] [INFO ] [MAIN ] Derivative Progress: 437/2026 symbols completed. CRS took 0.9s. Estimated remaining: 8m 39s. Rate: 183.7 symbols/min [2025-09-16T21:14:14.557794] [DEBUG] [MAIN ] CRL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:14.557978] [INFO ] [MAIN ] CSL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:14.558801] [INFO ] [MAIN ] CRL: Generated 1339 derivative records from 31389 primary records. [2025-09-16T21:14:14.559190] [DEBUG] [LOCAL ] CRL: Saving derivative data. [2025-09-16T21:14:14.579739] [DEBUG] [LOCAL ] CRL: Derivative data saved (1339 records). [2025-09-16T21:14:14.579878] [INFO ] [MAIN ] CRL: Successfully saved derivative data. [2025-09-16T21:14:14.582006] [INFO ] [MAIN ] Derivative Progress: 438/2026 symbols completed. CRL took 1.0s. Estimated remaining: 8m 38s. Rate: 184.1 symbols/min [2025-09-16T21:14:14.582571] [INFO ] [MAIN ] CSR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:14.594299] [DEBUG] [LOCAL ] CSAN: Loaded 31504 existing records from primary storage. [2025-09-16T21:14:14.600812] [INFO ] [MAIN ] CSAN: Loaded 31504 primary data records. [2025-09-16T21:14:14.702509] [DEBUG] [LOCAL ] CSL: Loaded 22516 existing records from primary storage. [2025-09-16T21:14:14.713139] [DEBUG] [LOCAL ] CSR: Loaded 9535 existing records from primary storage. [2025-09-16T21:14:14.713332] [INFO ] [MAIN ] CSL: Loaded 22516 primary data records. [2025-09-16T21:14:14.713376] [INFO ] [MAIN ] CSR: Loaded 9535 primary data records. [2025-09-16T21:14:15.462705] [DEBUG] [MAIN ] CSAN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:15.463476] [INFO ] [MAIN ] CSAN: Generated 1339 derivative records from 31504 primary records. [2025-09-16T21:14:15.463681] [DEBUG] [LOCAL ] CSAN: Saving derivative data. [2025-09-16T21:14:15.481179] [DEBUG] [MAIN ] CSR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:15.485992] [INFO ] [MAIN ] CSR: Generated 1339 derivative records from 9535 primary records. [2025-09-16T21:14:15.488809] [DEBUG] [LOCAL ] CSAN: Derivative data saved (1339 records). [2025-09-16T21:14:15.488945] [INFO ] [MAIN ] CSAN: Successfully saved derivative data. [2025-09-16T21:14:15.486136] [DEBUG] [LOCAL ] CSR: Saving derivative data. [2025-09-16T21:14:15.499901] [INFO ] [MAIN ] Derivative Progress: 439/2026 symbols completed. CSAN took 1.0s. Estimated remaining: 8m 39s. Rate: 183.3 symbols/min [2025-09-16T21:14:15.500957] [INFO ] [MAIN ] CSTM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:15.507509] [DEBUG] [MAIN ] CSL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:15.511728] [INFO ] [MAIN ] CSL: Generated 1339 derivative records from 22516 primary records. [2025-09-16T21:14:15.512753] [DEBUG] [LOCAL ] CSL: Saving derivative data. [2025-09-16T21:14:15.515827] [DEBUG] [LOCAL ] CSR: Derivative data saved (1339 records). [2025-09-16T21:14:15.528045] [INFO ] [MAIN ] CSR: Successfully saved derivative data. [2025-09-16T21:14:15.531085] [INFO ] [MAIN ] Derivative Progress: 440/2026 symbols completed. CSR took 0.9s. Estimated remaining: 8m 38s. Rate: 183.7 symbols/min [2025-09-16T21:14:15.532114] [INFO ] [MAIN ] CSV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:15.537273] [DEBUG] [LOCAL ] CSL: Derivative data saved (1339 records). [2025-09-16T21:14:15.548164] [INFO ] [MAIN ] CSL: Successfully saved derivative data. [2025-09-16T21:14:15.550928] [INFO ] [MAIN ] Derivative Progress: 441/2026 symbols completed. CSL took 1.0s. Estimated remaining: 8m 37s. Rate: 184.1 symbols/min [2025-09-16T21:14:15.551390] [INFO ] [MAIN ] CTBB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:15.559761] [DEBUG] [LOCAL ] CSV: Loaded 8953 existing records from primary storage. [2025-09-16T21:14:15.559924] [INFO ] [MAIN ] CSV: Loaded 8953 primary data records. [2025-09-16T21:14:15.653271] [DEBUG] [LOCAL ] CTBB: Loaded 4822 existing records from primary storage. [2025-09-16T21:14:15.680636] [INFO ] [MAIN ] CTBB: Loaded 4822 primary data records. [2025-09-16T21:14:15.681689] [DEBUG] [LOCAL ] CSTM: Loaded 35217 existing records from primary storage. [2025-09-16T21:14:15.682194] [INFO ] [MAIN ] CSTM: Loaded 35217 primary data records. [2025-09-16T21:14:16.416865] [DEBUG] [MAIN ] CSV: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:16.417605] [INFO ] [MAIN ] CSV: Generated 1339 derivative records from 8953 primary records. [2025-09-16T21:14:16.417984] [DEBUG] [LOCAL ] CSV: Saving derivative data. [2025-09-16T21:14:16.433586] [DEBUG] [LOCAL ] CSV: Derivative data saved (1339 records). [2025-09-16T21:14:16.434579] [INFO ] [MAIN ] CSV: Successfully saved derivative data. [2025-09-16T21:14:16.446615] [INFO ] [MAIN ] Derivative Progress: 442/2026 symbols completed. CSV took 0.9s. Estimated remaining: 8m 38s. Rate: 183.4 symbols/min [2025-09-16T21:14:16.447108] [DEBUG] [MAIN ] CTBB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:16.457757] [INFO ] [MAIN ] CTBB: Generated 1339 derivative records from 4822 primary records. [2025-09-16T21:14:16.458325] [DEBUG] [MAIN ] CSTM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:16.458079] [DEBUG] [LOCAL ] CTBB: Saving derivative data. [2025-09-16T21:14:16.456811] [INFO ] [MAIN ] CTDD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:16.459372] [INFO ] [MAIN ] CSTM: Generated 1339 derivative records from 35217 primary records. [2025-09-16T21:14:16.460059] [DEBUG] [LOCAL ] CSTM: Saving derivative data. [2025-09-16T21:14:16.484091] [DEBUG] [LOCAL ] CTDD: Loaded 3822 existing records from primary storage. [2025-09-16T21:14:16.488431] [DEBUG] [LOCAL ] CSTM: Derivative data saved (1339 records). [2025-09-16T21:14:16.488545] [INFO ] [MAIN ] CSTM: Successfully saved derivative data. [2025-09-16T21:14:16.491020] [INFO ] [MAIN ] Derivative Progress: 443/2026 symbols completed. CSTM took 1.0s. Estimated remaining: 8m 37s. Rate: 183.7 symbols/min [2025-09-16T21:14:16.487610] [INFO ] [MAIN ] CTDD: Loaded 3822 primary data records. [2025-09-16T21:14:16.491749] [INFO ] [MAIN ] CTO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:16.497166] [DEBUG] [LOCAL ] CTBB: Derivative data saved (1339 records). [2025-09-16T21:14:16.530991] [INFO ] [MAIN ] CTBB: Successfully saved derivative data. [2025-09-16T21:14:16.553035] [INFO ] [MAIN ] Derivative Progress: 444/2026 symbols completed. CTBB took 1.0s. Estimated remaining: 8m 36s. Rate: 184.1 symbols/min [2025-09-16T21:14:16.580618] [INFO ] [MAIN ] CTOS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:16.693772] [DEBUG] [LOCAL ] CTO: Loaded 19613 existing records from primary storage. [2025-09-16T21:14:16.694075] [INFO ] [MAIN ] CTO: Loaded 19613 primary data records. [2025-09-16T21:14:16.894055] [DEBUG] [LOCAL ] CTOS: Loaded 26856 existing records from primary storage. [2025-09-16T21:14:16.905535] [INFO ] [MAIN ] CTOS: Loaded 26856 primary data records. [2025-09-16T21:14:17.403759] [DEBUG] [MAIN ] CTDD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:17.404777] [INFO ] [MAIN ] CTDD: Generated 1339 derivative records from 3822 primary records. [2025-09-16T21:14:17.405390] [DEBUG] [LOCAL ] CTDD: Saving derivative data. [2025-09-16T21:14:17.420295] [DEBUG] [LOCAL ] CTDD: Derivative data saved (1339 records). [2025-09-16T21:14:17.421121] [INFO ] [MAIN ] CTDD: Successfully saved derivative data. [2025-09-16T21:14:17.423016] [INFO ] [MAIN ] Derivative Progress: 445/2026 symbols completed. CTDD took 1.0s. Estimated remaining: 8m 37s. Rate: 183.4 symbols/min [2025-09-16T21:14:17.424215] [INFO ] [MAIN ] CTRA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:17.442870] [DEBUG] [MAIN ] CTO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:17.444380] [INFO ] [MAIN ] CTO: Generated 1339 derivative records from 19613 primary records. [2025-09-16T21:14:17.444862] [DEBUG] [LOCAL ] CTO: Saving derivative data. [2025-09-16T21:14:17.459272] [DEBUG] [LOCAL ] CTO: Derivative data saved (1339 records). [2025-09-16T21:14:17.469096] [INFO ] [MAIN ] CTO: Successfully saved derivative data. [2025-09-16T21:14:17.479157] [DEBUG] [MAIN ] CTOS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:17.481460] [INFO ] [MAIN ] Derivative Progress: 446/2026 symbols completed. CTO took 1.0s. Estimated remaining: 8m 36s. Rate: 183.7 symbols/min [2025-09-16T21:14:17.482523] [INFO ] [MAIN ] CTOS: Generated 1339 derivative records from 26856 primary records. [2025-09-16T21:14:17.482805] [INFO ] [MAIN ] CTRE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:17.482929] [DEBUG] [LOCAL ] CTOS: Saving derivative data. [2025-09-16T21:14:17.508243] [DEBUG] [LOCAL ] CTRA: Loaded 40002 existing records from primary storage. [2025-09-16T21:14:17.509542] [INFO ] [MAIN ] CTRA: Loaded 40002 primary data records. [2025-09-16T21:14:17.523106] [DEBUG] [LOCAL ] CTOS: Derivative data saved (1339 records). [2025-09-16T21:14:17.550977] [INFO ] [MAIN ] CTOS: Successfully saved derivative data. [2025-09-16T21:14:17.602598] [INFO ] [MAIN ] Derivative Progress: 447/2026 symbols completed. CTOS took 1.0s. Estimated remaining: 8m 35s. Rate: 184.0 symbols/min [2025-09-16T21:14:17.608168] [INFO ] [MAIN ] CTRI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:17.721680] [DEBUG] [LOCAL ] CTRE: Loaded 36634 existing records from primary storage. [2025-09-16T21:14:17.807727] [INFO ] [MAIN ] CTRE: Loaded 36634 primary data records. [2025-09-16T21:14:17.946339] [DEBUG] [LOCAL ] CTRI: Loaded 29346 existing records from primary storage. [2025-09-16T21:14:17.947155] [INFO ] [MAIN ] CTRI: Loaded 29346 primary data records. [2025-09-16T21:14:18.454586] [DEBUG] [MAIN ] CTRA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:18.456084] [INFO ] [MAIN ] CTRA: Generated 1339 derivative records from 40002 primary records. [2025-09-16T21:14:18.456852] [DEBUG] [LOCAL ] CTRA: Saving derivative data. [2025-09-16T21:14:18.474088] [DEBUG] [LOCAL ] CTRA: Derivative data saved (1339 records). [2025-09-16T21:14:18.474295] [INFO ] [MAIN ] CTRA: Successfully saved derivative data. [2025-09-16T21:14:18.476233] [INFO ] [MAIN ] Derivative Progress: 448/2026 symbols completed. CTRA took 1.1s. Estimated remaining: 8m 37s. Rate: 183.3 symbols/min [2025-09-16T21:14:18.492948] [DEBUG] [MAIN ] CTRE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:18.493960] [INFO ] [MAIN ] CTRE: Generated 1339 derivative records from 36634 primary records. [2025-09-16T21:14:18.494152] [DEBUG] [LOCAL ] CTRE: Saving derivative data. [2025-09-16T21:14:18.510147] [DEBUG] [LOCAL ] CTRE: Derivative data saved (1339 records). [2025-09-16T21:14:18.510462] [INFO ] [MAIN ] CTRE: Successfully saved derivative data. [2025-09-16T21:14:18.513160] [INFO ] [MAIN ] Derivative Progress: 449/2026 symbols completed. CTRE took 1.0s. Estimated remaining: 8m 35s. Rate: 183.6 symbols/min [2025-09-16T21:14:18.523798] [DEBUG] [MAIN ] CTRI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:18.524790] [INFO ] [MAIN ] CTRI: Generated 1339 derivative records from 29346 primary records. [2025-09-16T21:14:18.524862] [DEBUG] [LOCAL ] CTRI: Saving derivative data. [2025-09-16T21:14:18.538272] [DEBUG] [LOCAL ] CTRI: Derivative data saved (1339 records). [2025-09-16T21:14:18.538378] [INFO ] [MAIN ] CTRI: Successfully saved derivative data. [2025-09-16T21:14:18.541952] [INFO ] [MAIN ] Derivative Progress: 450/2026 symbols completed. CTRI took 0.9s. Estimated remaining: 8m 34s. Rate: 184.0 symbols/min [2025-09-16T21:14:18.542878] [INFO ] [MAIN ] CTVA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:18.543270] [INFO ] [MAIN ] CUBE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:18.543067] [INFO ] [MAIN ] CTS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:18.562226] [DEBUG] [LOCAL ] CTS: Loaded 13918 existing records from primary storage. [2025-09-16T21:14:18.562619] [INFO ] [MAIN ] CTS: Loaded 13918 primary data records. [2025-09-16T21:14:18.747346] [DEBUG] [LOCAL ] CUBE: Loaded 37936 existing records from primary storage. [2025-09-16T21:14:18.764666] [INFO ] [MAIN ] CUBE: Loaded 37936 primary data records. [2025-09-16T21:14:18.793032] [DEBUG] [LOCAL ] CTVA: Loaded 39714 existing records from primary storage. [2025-09-16T21:14:18.898880] [INFO ] [MAIN ] CTVA: Loaded 39714 primary data records. [2025-09-16T21:14:19.525569] [DEBUG] [MAIN ] CTS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:19.527440] [INFO ] [MAIN ] CTS: Generated 1339 derivative records from 13918 primary records. [2025-09-16T21:14:19.528704] [DEBUG] [LOCAL ] CTS: Saving derivative data. [2025-09-16T21:14:19.545284] [DEBUG] [LOCAL ] CTS: Derivative data saved (1339 records). [2025-09-16T21:14:19.545632] [INFO ] [MAIN ] CTS: Successfully saved derivative data. [2025-09-16T21:14:19.547216] [INFO ] [MAIN ] Derivative Progress: 451/2026 symbols completed. CTS took 1.0s. Estimated remaining: 8m 36s. Rate: 183.2 symbols/min [2025-09-16T21:14:19.547943] [INFO ] [MAIN ] CUBI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:19.559611] [DEBUG] [MAIN ] CUBE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:19.561549] [INFO ] [MAIN ] CUBE: Generated 1339 derivative records from 37936 primary records. [2025-09-16T21:14:19.562251] [DEBUG] [LOCAL ] CUBE: Saving derivative data. [2025-09-16T21:14:19.588983] [DEBUG] [LOCAL ] CUBE: Derivative data saved (1339 records). [2025-09-16T21:14:19.589718] [INFO ] [MAIN ] CUBE: Successfully saved derivative data. [2025-09-16T21:14:19.593972] [INFO ] [MAIN ] Derivative Progress: 452/2026 symbols completed. CUBE took 1.1s. Estimated remaining: 8m 35s. Rate: 183.5 symbols/min [2025-09-16T21:14:19.589492] [DEBUG] [MAIN ] CTVA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:19.595396] [INFO ] [MAIN ] CTVA: Generated 1339 derivative records from 39714 primary records. [2025-09-16T21:14:19.594487] [INFO ] [MAIN ] CUK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:19.601345] [DEBUG] [LOCAL ] CTVA: Saving derivative data. [2025-09-16T21:14:19.623585] [DEBUG] [LOCAL ] CUBI: Loaded 19849 existing records from primary storage. [2025-09-16T21:14:19.623245] [DEBUG] [LOCAL ] CTVA: Derivative data saved (1339 records). [2025-09-16T21:14:19.624073] [INFO ] [MAIN ] CUBI: Loaded 19849 primary data records. [2025-09-16T21:14:19.623822] [INFO ] [MAIN ] CTVA: Successfully saved derivative data. [2025-09-16T21:14:19.647410] [INFO ] [MAIN ] Derivative Progress: 453/2026 symbols completed. CTVA took 1.1s. Estimated remaining: 8m 33s. Rate: 183.9 symbols/min [2025-09-16T21:14:19.682792] [INFO ] [MAIN ] CULP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:19.758109] [DEBUG] [LOCAL ] CULP: Loaded 2000 existing records from primary storage. [2025-09-16T21:14:19.823803] [INFO ] [MAIN ] CULP: Loaded 2000 primary data records. [2025-09-16T21:14:19.944060] [DEBUG] [LOCAL ] CUK: Loaded 37737 existing records from primary storage. [2025-09-16T21:14:19.960003] [INFO ] [MAIN ] CUK: Loaded 37737 primary data records. [2025-09-16T21:14:20.516989] [DEBUG] [MAIN ] CUBI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:20.518376] [INFO ] [MAIN ] CUBI: Generated 1339 derivative records from 19849 primary records. [2025-09-16T21:14:20.518958] [DEBUG] [LOCAL ] CUBI: Saving derivative data. [2025-09-16T21:14:20.534191] [DEBUG] [LOCAL ] CUBI: Derivative data saved (1339 records). [2025-09-16T21:14:20.534630] [INFO ] [MAIN ] CUBI: Successfully saved derivative data. [2025-09-16T21:14:20.537390] [INFO ] [MAIN ] Derivative Progress: 454/2026 symbols completed. CUBI took 1.0s. Estimated remaining: 8m 35s. Rate: 183.2 symbols/min [2025-09-16T21:14:20.538505] [INFO ] [MAIN ] CURB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:20.549779] [DEBUG] [MAIN ] CULP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:20.550755] [INFO ] [MAIN ] CULP: Generated 1339 derivative records from 2000 primary records. [2025-09-16T21:14:20.551337] [DEBUG] [LOCAL ] CULP: Saving derivative data. [2025-09-16T21:14:20.563538] [DEBUG] [LOCAL ] CULP: Derivative data saved (1339 records). [2025-09-16T21:14:20.563625] [INFO ] [MAIN ] CULP: Successfully saved derivative data. [2025-09-16T21:14:20.571477] [INFO ] [MAIN ] Derivative Progress: 455/2026 symbols completed. CULP took 0.9s. Estimated remaining: 8m 34s. Rate: 183.5 symbols/min [2025-09-16T21:14:20.576180] [INFO ] [MAIN ] CURV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:20.576007] [DEBUG] [MAIN ] CUK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:20.576921] [INFO ] [MAIN ] CUK: Generated 1339 derivative records from 37737 primary records. [2025-09-16T21:14:20.582709] [DEBUG] [LOCAL ] CUK: Saving derivative data. [2025-09-16T21:14:20.595491] [DEBUG] [LOCAL ] CUK: Derivative data saved (1339 records). [2025-09-16T21:14:20.595821] [INFO ] [MAIN ] CUK: Successfully saved derivative data. [2025-09-16T21:14:20.598435] [INFO ] [MAIN ] Derivative Progress: 456/2026 symbols completed. CUK took 1.0s. Estimated remaining: 8m 32s. Rate: 183.9 symbols/min [2025-09-16T21:14:20.599355] [INFO ] [MAIN ] CUZ: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:20.612538] [DEBUG] [LOCAL ] CURB: Loaded 23660 existing records from primary storage. [2025-09-16T21:14:20.612761] [INFO ] [MAIN ] CURB: Loaded 23660 primary data records. [2025-09-16T21:14:20.712303] [DEBUG] [LOCAL ] CURV: Loaded 20011 existing records from primary storage. [2025-09-16T21:14:20.724447] [INFO ] [MAIN ] CURV: Loaded 20011 primary data records. [2025-09-16T21:14:20.928066] [DEBUG] [LOCAL ] CUZ: Loaded 36954 existing records from primary storage. [2025-09-16T21:14:21.055743] [INFO ] [MAIN ] CUZ: Loaded 36954 primary data records. [2025-09-16T21:14:21.470364] [DEBUG] [MAIN ] CURB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:21.471305] [INFO ] [MAIN ] CURB: Generated 1339 derivative records from 23660 primary records. [2025-09-16T21:14:21.472356] [DEBUG] [LOCAL ] CURB: Saving derivative data. [2025-09-16T21:14:21.486281] [DEBUG] [LOCAL ] CURB: Derivative data saved (1339 records). [2025-09-16T21:14:21.486531] [INFO ] [MAIN ] CURB: Successfully saved derivative data. [2025-09-16T21:14:21.489016] [INFO ] [MAIN ] Derivative Progress: 457/2026 symbols completed. CURB took 1.0s. Estimated remaining: 8m 34s. Rate: 183.2 symbols/min [2025-09-16T21:14:21.490131] [INFO ] [MAIN ] CVE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:21.500968] [DEBUG] [MAIN ] CURV: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:21.501865] [INFO ] [MAIN ] CURV: Generated 1339 derivative records from 20011 primary records. [2025-09-16T21:14:21.502570] [DEBUG] [LOCAL ] CURV: Saving derivative data. [2025-09-16T21:14:21.524668] [DEBUG] [MAIN ] CUZ: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:21.526349] [DEBUG] [LOCAL ] CURV: Derivative data saved (1339 records). [2025-09-16T21:14:21.527205] [INFO ] [MAIN ] CURV: Successfully saved derivative data. [2025-09-16T21:14:21.527051] [INFO ] [MAIN ] CUZ: Generated 1339 derivative records from 36954 primary records. [2025-09-16T21:14:21.529434] [DEBUG] [LOCAL ] CUZ: Saving derivative data. [2025-09-16T21:14:21.529357] [INFO ] [MAIN ] Derivative Progress: 458/2026 symbols completed. CURV took 1.0s. Estimated remaining: 8m 33s. Rate: 183.6 symbols/min [2025-09-16T21:14:21.539338] [INFO ] [MAIN ] CVEO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:21.542304] [DEBUG] [LOCAL ] CUZ: Derivative data saved (1339 records). [2025-09-16T21:14:21.542789] [INFO ] [MAIN ] CUZ: Successfully saved derivative data. [2025-09-16T21:14:21.554885] [INFO ] [MAIN ] Derivative Progress: 459/2026 symbols completed. CUZ took 1.0s. Estimated remaining: 8m 31s. Rate: 183.9 symbols/min [2025-09-16T21:14:21.555327] [INFO ] [MAIN ] CVLG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:21.569191] [DEBUG] [LOCAL ] CVEO: Loaded 11755 existing records from primary storage. [2025-09-16T21:14:21.569359] [INFO ] [MAIN ] CVEO: Loaded 11755 primary data records. [2025-09-16T21:14:21.624576] [DEBUG] [LOCAL ] CVE: Loaded 39924 existing records from primary storage. [2025-09-16T21:14:21.651112] [INFO ] [MAIN ] CVE: Loaded 39924 primary data records. [2025-09-16T21:14:21.630024] [DEBUG] [LOCAL ] CVLG: Loaded 11374 existing records from primary storage. [2025-09-16T21:14:21.738808] [INFO ] [MAIN ] CVLG: Loaded 11374 primary data records. [2025-09-16T21:14:22.498193] [DEBUG] [MAIN ] CVE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:22.499990] [INFO ] [MAIN ] CVE: Generated 1339 derivative records from 39924 primary records. [2025-09-16T21:14:22.500195] [DEBUG] [LOCAL ] CVE: Saving derivative data. [2025-09-16T21:14:22.521558] [DEBUG] [LOCAL ] CVE: Derivative data saved (1339 records). [2025-09-16T21:14:22.524986] [INFO ] [MAIN ] CVE: Successfully saved derivative data. [2025-09-16T21:14:22.532936] [INFO ] [MAIN ] Derivative Progress: 460/2026 symbols completed. CVE took 1.0s. Estimated remaining: 8m 33s. Rate: 183.1 symbols/min [2025-09-16T21:14:22.533357] [DEBUG] [MAIN ] CVEO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:22.537273] [INFO ] [MAIN ] CVNA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:22.538021] [INFO ] [MAIN ] CVEO: Generated 1339 derivative records from 11755 primary records. [2025-09-16T21:14:22.538398] [DEBUG] [LOCAL ] CVEO: Saving derivative data. [2025-09-16T21:14:22.538236] [DEBUG] [MAIN ] CVLG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:22.540375] [INFO ] [MAIN ] CVLG: Generated 1339 derivative records from 11374 primary records. [2025-09-16T21:14:22.541530] [DEBUG] [LOCAL ] CVLG: Saving derivative data. [2025-09-16T21:14:22.565293] [DEBUG] [LOCAL ] CVLG: Derivative data saved (1339 records). [2025-09-16T21:14:22.566083] [INFO ] [MAIN ] CVLG: Successfully saved derivative data. [2025-09-16T21:14:22.568926] [DEBUG] [LOCAL ] CVEO: Derivative data saved (1339 records). [2025-09-16T21:14:22.569033] [INFO ] [MAIN ] CVEO: Successfully saved derivative data. [2025-09-16T21:14:22.568489] [INFO ] [MAIN ] Derivative Progress: 461/2026 symbols completed. CVLG took 1.0s. Estimated remaining: 8m 32s. Rate: 183.5 symbols/min [2025-09-16T21:14:22.571744] [INFO ] [MAIN ] CVS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:22.571900] [INFO ] [MAIN ] Derivative Progress: 462/2026 symbols completed. CVEO took 1.0s. Estimated remaining: 8m 30s. Rate: 183.9 symbols/min [2025-09-16T21:14:22.572344] [INFO ] [MAIN ] CVX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:22.605069] [DEBUG] [LOCAL ] CVNA: Loaded 39474 existing records from primary storage. [2025-09-16T21:14:22.605307] [INFO ] [MAIN ] CVNA: Loaded 39474 primary data records. [2025-09-16T21:14:22.782916] [DEBUG] [LOCAL ] CVS: Loaded 40048 existing records from primary storage. [2025-09-16T21:14:22.814621] [INFO ] [MAIN ] CVS: Loaded 40048 primary data records. [2025-09-16T21:14:22.975064] [DEBUG] [LOCAL ] CVX: Loaded 40110 existing records from primary storage. [2025-09-16T21:14:22.996685] [INFO ] [MAIN ] CVX: Loaded 40110 primary data records. [2025-09-16T21:14:23.480327] [DEBUG] [MAIN ] CVNA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:23.481311] [INFO ] [MAIN ] CVNA: Generated 1339 derivative records from 39474 primary records. [2025-09-16T21:14:23.481443] [DEBUG] [LOCAL ] CVNA: Saving derivative data. [2025-09-16T21:14:23.494954] [DEBUG] [LOCAL ] CVNA: Derivative data saved (1339 records). [2025-09-16T21:14:23.495271] [INFO ] [MAIN ] CVNA: Successfully saved derivative data. [2025-09-16T21:14:23.497328] [INFO ] [MAIN ] Derivative Progress: 463/2026 symbols completed. CVNA took 1.0s. Estimated remaining: 8m 32s. Rate: 183.1 symbols/min [2025-09-16T21:14:23.509540] [DEBUG] [MAIN ] CVS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:23.510302] [INFO ] [MAIN ] CVS: Generated 1339 derivative records from 40048 primary records. [2025-09-16T21:14:23.510515] [DEBUG] [LOCAL ] CVS: Saving derivative data. [2025-09-16T21:14:23.533335] [DEBUG] [MAIN ] CVX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:23.534738] [DEBUG] [LOCAL ] CVS: Derivative data saved (1339 records). [2025-09-16T21:14:23.534683] [INFO ] [MAIN ] CVX: Generated 1339 derivative records from 40110 primary records. [2025-09-16T21:14:23.534820] [INFO ] [MAIN ] CVS: Successfully saved derivative data. [2025-09-16T21:14:23.536518] [INFO ] [MAIN ] Derivative Progress: 464/2026 symbols completed. CVS took 1.0s. Estimated remaining: 8m 31s. Rate: 183.5 symbols/min [2025-09-16T21:14:23.536600] [DEBUG] [LOCAL ] CVX: Saving derivative data. [2025-09-16T21:14:23.548508] [DEBUG] [LOCAL ] CVX: Derivative data saved (1339 records). [2025-09-16T21:14:23.548569] [INFO ] [MAIN ] CVX: Successfully saved derivative data. [2025-09-16T21:14:23.550674] [INFO ] [MAIN ] Derivative Progress: 465/2026 symbols completed. CVX took 1.0s. Estimated remaining: 8m 29s. Rate: 183.9 symbols/min [2025-09-16T21:14:23.551288] [INFO ] [MAIN ] CWK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:23.551205] [INFO ] [MAIN ] CWEN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:23.551366] [INFO ] [MAIN ] CW: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:23.570424] [DEBUG] [LOCAL ] CW: Loaded 16921 existing records from primary storage. [2025-09-16T21:14:23.570670] [INFO ] [MAIN ] CW: Loaded 16921 primary data records. [2025-09-16T21:14:23.725450] [DEBUG] [LOCAL ] CWK: Loaded 36655 existing records from primary storage. [2025-09-16T21:14:23.761005] [INFO ] [MAIN ] CWK: Loaded 36655 primary data records. [2025-09-16T21:14:23.840680] [DEBUG] [LOCAL ] CWEN: Loaded 33122 existing records from primary storage. [2025-09-16T21:14:23.866485] [INFO ] [MAIN ] CWEN: Loaded 33122 primary data records. [2025-09-16T21:14:24.475532] [DEBUG] [MAIN ] CW: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:24.476717] [INFO ] [MAIN ] CW: Generated 1339 derivative records from 16921 primary records. [2025-09-16T21:14:24.477093] [DEBUG] [LOCAL ] CW: Saving derivative data. [2025-09-16T21:14:24.490499] [DEBUG] [LOCAL ] CW: Derivative data saved (1339 records). [2025-09-16T21:14:24.490994] [INFO ] [MAIN ] CW: Successfully saved derivative data. [2025-09-16T21:14:24.492679] [INFO ] [MAIN ] Derivative Progress: 466/2026 symbols completed. CW took 0.9s. Estimated remaining: 8m 31s. Rate: 183.1 symbols/min [2025-09-16T21:14:24.493172] [INFO ] [MAIN ] CWT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:24.506893] [DEBUG] [MAIN ] CWK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:24.507570] [INFO ] [MAIN ] CWK: Generated 1339 derivative records from 36655 primary records. [2025-09-16T21:14:24.507797] [DEBUG] [LOCAL ] CWK: Saving derivative data. [2025-09-16T21:14:24.522222] [DEBUG] [LOCAL ] CWK: Derivative data saved (1339 records). [2025-09-16T21:14:24.522476] [INFO ] [MAIN ] CWK: Successfully saved derivative data. [2025-09-16T21:14:24.530237] [INFO ] [MAIN ] Derivative Progress: 467/2026 symbols completed. CWK took 1.0s. Estimated remaining: 8m 30s. Rate: 183.5 symbols/min [2025-09-16T21:14:24.530534] [INFO ] [MAIN ] CX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:24.540531] [DEBUG] [MAIN ] CWEN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:24.541323] [INFO ] [MAIN ] CWEN: Generated 1339 derivative records from 33122 primary records. [2025-09-16T21:14:24.541741] [DEBUG] [LOCAL ] CWEN: Saving derivative data. [2025-09-16T21:14:24.565494] [DEBUG] [LOCAL ] CWEN: Derivative data saved (1339 records). [2025-09-16T21:14:24.562863] [DEBUG] [LOCAL ] CWT: Loaded 20240 existing records from primary storage. [2025-09-16T21:14:24.565670] [INFO ] [MAIN ] CWEN: Successfully saved derivative data. [2025-09-16T21:14:24.567722] [INFO ] [MAIN ] Derivative Progress: 468/2026 symbols completed. CWEN took 1.0s. Estimated remaining: 8m 29s. Rate: 183.8 symbols/min [2025-09-16T21:14:24.567820] [INFO ] [MAIN ] CWT: Loaded 20240 primary data records. [2025-09-16T21:14:24.568090] [INFO ] [MAIN ] CXE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:24.677747] [DEBUG] [LOCAL ] CXE: Loaded 4683 existing records from primary storage. [2025-09-16T21:14:24.689605] [INFO ] [MAIN ] CXE: Loaded 4683 primary data records. [2025-09-16T21:14:24.858156] [DEBUG] [LOCAL ] CX: Loaded 39346 existing records from primary storage. [2025-09-16T21:14:24.971181] [INFO ] [MAIN ] CX: Loaded 39346 primary data records. [2025-09-16T21:14:25.423314] [DEBUG] [MAIN ] CWT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:25.424620] [INFO ] [MAIN ] CWT: Generated 1339 derivative records from 20240 primary records. [2025-09-16T21:14:25.424959] [DEBUG] [LOCAL ] CWT: Saving derivative data. [2025-09-16T21:14:25.440348] [DEBUG] [LOCAL ] CWT: Derivative data saved (1339 records). [2025-09-16T21:14:25.450231] [INFO ] [MAIN ] CWT: Successfully saved derivative data. [2025-09-16T21:14:25.452198] [INFO ] [MAIN ] Derivative Progress: 469/2026 symbols completed. CWT took 1.0s. Estimated remaining: 8m 30s. Rate: 183.2 symbols/min [2025-09-16T21:14:25.450444] [DEBUG] [MAIN ] CXE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:25.452499] [INFO ] [MAIN ] CXH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:25.453213] [INFO ] [MAIN ] CXE: Generated 1339 derivative records from 4683 primary records. [2025-09-16T21:14:25.453658] [DEBUG] [LOCAL ] CXE: Saving derivative data. [2025-09-16T21:14:25.479199] [DEBUG] [LOCAL ] CXH: Loaded 3921 existing records from primary storage. [2025-09-16T21:14:25.480163] [INFO ] [MAIN ] CXH: Loaded 3921 primary data records. [2025-09-16T21:14:25.480111] [DEBUG] [LOCAL ] CXE: Derivative data saved (1339 records). [2025-09-16T21:14:25.500903] [INFO ] [MAIN ] CXE: Successfully saved derivative data. [2025-09-16T21:14:25.480396] [DEBUG] [MAIN ] CX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:25.513139] [INFO ] [MAIN ] Derivative Progress: 470/2026 symbols completed. CXE took 0.9s. Estimated remaining: 8m 29s. Rate: 183.5 symbols/min [2025-09-16T21:14:25.537614] [INFO ] [MAIN ] CX: Generated 1339 derivative records from 39346 primary records. [2025-09-16T21:14:25.537752] [INFO ] [MAIN ] CXM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:25.551513] [DEBUG] [LOCAL ] CX: Saving derivative data. [2025-09-16T21:14:25.673524] [DEBUG] [LOCAL ] CX: Derivative data saved (1339 records). [2025-09-16T21:14:25.757019] [INFO ] [MAIN ] CX: Successfully saved derivative data. [2025-09-16T21:14:25.759112] [INFO ] [MAIN ] Derivative Progress: 471/2026 symbols completed. CX took 1.2s. Estimated remaining: 8m 28s. Rate: 183.6 symbols/min [2025-09-16T21:14:25.768543] [INFO ] [MAIN ] CXT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:25.785678] [DEBUG] [LOCAL ] CXM: Loaded 35428 existing records from primary storage. [2025-09-16T21:14:25.786161] [INFO ] [MAIN ] CXM: Loaded 35428 primary data records. [2025-09-16T21:14:25.923224] [DEBUG] [LOCAL ] CXT: Loaded 22307 existing records from primary storage. [2025-09-16T21:14:25.922860] [DEBUG] [MAIN ] CXH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:25.929218] [INFO ] [MAIN ] CXH: Generated 1339 derivative records from 3921 primary records. [2025-09-16T21:14:25.934406] [INFO ] [MAIN ] CXT: Loaded 22307 primary data records. [2025-09-16T21:14:25.934596] [DEBUG] [LOCAL ] CXH: Saving derivative data. [2025-09-16T21:14:26.117527] [DEBUG] [LOCAL ] CXH: Derivative data saved (1339 records). [2025-09-16T21:14:26.213294] [INFO ] [MAIN ] CXH: Successfully saved derivative data. [2025-09-16T21:14:26.262319] [INFO ] [MAIN ] Derivative Progress: 472/2026 symbols completed. CXH took 0.8s. Estimated remaining: 8m 28s. Rate: 183.4 symbols/min [2025-09-16T21:14:26.282031] [INFO ] [MAIN ] CYD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:26.426293] [DEBUG] [LOCAL ] CYD: Loaded 19154 existing records from primary storage. [2025-09-16T21:14:26.426888] [INFO ] [MAIN ] CYD: Loaded 19154 primary data records. [2025-09-16T21:14:26.436944] [DEBUG] [MAIN ] CXM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:26.487784] [INFO ] [MAIN ] CXM: Generated 1339 derivative records from 35428 primary records. [2025-09-16T21:14:26.526554] [DEBUG] [LOCAL ] CXM: Saving derivative data. [2025-09-16T21:14:26.630712] [DEBUG] [LOCAL ] CXM: Derivative data saved (1339 records). [2025-09-16T21:14:26.637594] [INFO ] [MAIN ] CXM: Successfully saved derivative data. [2025-09-16T21:14:26.660820] [INFO ] [MAIN ] Derivative Progress: 473/2026 symbols completed. CXM took 1.1s. Estimated remaining: 8m 28s. Rate: 183.3 symbols/min [2025-09-16T21:14:26.661378] [DEBUG] [MAIN ] CXT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:26.661574] [INFO ] [MAIN ] CYH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:26.666653] [INFO ] [MAIN ] CXT: Generated 1339 derivative records from 22307 primary records. [2025-09-16T21:14:26.667061] [DEBUG] [LOCAL ] CXT: Saving derivative data. [2025-09-16T21:14:26.767600] [DEBUG] [LOCAL ] CXT: Derivative data saved (1339 records). [2025-09-16T21:14:26.768561] [INFO ] [MAIN ] CXT: Successfully saved derivative data. [2025-09-16T21:14:26.770767] [INFO ] [MAIN ] Derivative Progress: 474/2026 symbols completed. CXT took 1.0s. Estimated remaining: 8m 27s. Rate: 183.5 symbols/min [2025-09-16T21:14:26.771404] [INFO ] [MAIN ] D: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:26.799198] [DEBUG] [MAIN ] CYD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:26.811034] [DEBUG] [LOCAL ] CYH: Loaded 35832 existing records from primary storage. [2025-09-16T21:14:26.810303] [INFO ] [MAIN ] CYD: Generated 1339 derivative records from 19154 primary records. [2025-09-16T21:14:26.811214] [INFO ] [MAIN ] CYH: Loaded 35832 primary data records. [2025-09-16T21:14:26.811150] [DEBUG] [LOCAL ] CYD: Saving derivative data. [2025-09-16T21:14:26.984879] [DEBUG] [LOCAL ] D: Loaded 40007 existing records from primary storage. [2025-09-16T21:14:27.008502] [DEBUG] [LOCAL ] CYD: Derivative data saved (1339 records). [2025-09-16T21:14:27.036807] [INFO ] [MAIN ] D: Loaded 40007 primary data records. [2025-09-16T21:14:27.037048] [INFO ] [MAIN ] CYD: Successfully saved derivative data. [2025-09-16T21:14:27.126049] [INFO ] [MAIN ] Derivative Progress: 475/2026 symbols completed. CYD took 0.8s. Estimated remaining: 8m 27s. Rate: 183.5 symbols/min [2025-09-16T21:14:27.147763] [INFO ] [MAIN ] DAC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:27.245164] [DEBUG] [LOCAL ] DAC: Loaded 9052 existing records from primary storage. [2025-09-16T21:14:27.251012] [INFO ] [MAIN ] DAC: Loaded 9052 primary data records. [2025-09-16T21:14:27.725497] [DEBUG] [MAIN ] CYH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:27.727180] [INFO ] [MAIN ] CYH: Generated 1339 derivative records from 35832 primary records. [2025-09-16T21:14:27.727556] [DEBUG] [LOCAL ] CYH: Saving derivative data. [2025-09-16T21:14:27.743197] [DEBUG] [LOCAL ] CYH: Derivative data saved (1339 records). [2025-09-16T21:14:27.743335] [INFO ] [MAIN ] CYH: Successfully saved derivative data. [2025-09-16T21:14:27.746124] [INFO ] [MAIN ] Derivative Progress: 476/2026 symbols completed. CYH took 1.1s. Estimated remaining: 8m 28s. Rate: 183.2 symbols/min [2025-09-16T21:14:27.748239] [INFO ] [MAIN ] DAL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:27.760702] [DEBUG] [MAIN ] D: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:27.761702] [INFO ] [MAIN ] D: Generated 1339 derivative records from 40007 primary records. [2025-09-16T21:14:27.761767] [DEBUG] [LOCAL ] D: Saving derivative data. [2025-09-16T21:14:27.774729] [DEBUG] [LOCAL ] D: Derivative data saved (1339 records). [2025-09-16T21:14:27.774815] [INFO ] [MAIN ] D: Successfully saved derivative data. [2025-09-16T21:14:27.776756] [INFO ] [MAIN ] Derivative Progress: 477/2026 symbols completed. D took 1.0s. Estimated remaining: 8m 26s. Rate: 183.5 symbols/min [2025-09-16T21:14:27.777028] [INFO ] [MAIN ] DAN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:27.790362] [DEBUG] [MAIN ] DAC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:27.791583] [INFO ] [MAIN ] DAC: Generated 1339 derivative records from 9052 primary records. [2025-09-16T21:14:27.791712] [DEBUG] [LOCAL ] DAC: Saving derivative data. [2025-09-16T21:14:27.804087] [DEBUG] [LOCAL ] DAC: Derivative data saved (1339 records). [2025-09-16T21:14:27.804368] [INFO ] [MAIN ] DAC: Successfully saved derivative data. [2025-09-16T21:14:27.806482] [INFO ] [MAIN ] Derivative Progress: 478/2026 symbols completed. DAC took 0.7s. Estimated remaining: 8m 25s. Rate: 183.9 symbols/min [2025-09-16T21:14:27.839766] [DEBUG] [LOCAL ] DAL: Loaded 40103 existing records from primary storage. [2025-09-16T21:14:27.839937] [INFO ] [MAIN ] DAL: Loaded 40103 primary data records. [2025-09-16T21:14:27.975306] [DEBUG] [LOCAL ] DAN: Loaded 36555 existing records from primary storage. [2025-09-16T21:14:27.997154] [INFO ] [MAIN ] DAN: Loaded 36555 primary data records. [2025-09-16T21:14:28.392890] [DEBUG] [MAIN ] DAL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:28.393680] [INFO ] [MAIN ] DAL: Generated 1339 derivative records from 40103 primary records. [2025-09-16T21:14:28.393830] [DEBUG] [LOCAL ] DAL: Saving derivative data. [2025-09-16T21:14:28.407449] [DEBUG] [LOCAL ] DAL: Derivative data saved (1339 records). [2025-09-16T21:14:28.408056] [INFO ] [MAIN ] DAL: Successfully saved derivative data. [2025-09-16T21:14:28.410085] [INFO ] [MAIN ] Derivative Progress: 479/2026 symbols completed. DAL took 0.7s. Estimated remaining: 8m 26s. Rate: 183.5 symbols/min [2025-09-16T21:14:28.419834] [DEBUG] [MAIN ] DAN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:28.420385] [INFO ] [MAIN ] DAN: Generated 1339 derivative records from 36555 primary records. [2025-09-16T21:14:28.420445] [DEBUG] [LOCAL ] DAN: Saving derivative data. [2025-09-16T21:14:28.432043] [DEBUG] [LOCAL ] DAN: Derivative data saved (1339 records). [2025-09-16T21:14:28.432103] [INFO ] [MAIN ] DAN: Successfully saved derivative data. [2025-09-16T21:14:28.434505] [INFO ] [MAIN ] Derivative Progress: 480/2026 symbols completed. DAN took 0.7s. Estimated remaining: 8m 24s. Rate: 183.9 symbols/min [2025-09-16T21:14:28.435359] [INFO ] [MAIN ] DAO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:28.435214] [INFO ] [MAIN ] DAVA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:28.435764] [INFO ] [MAIN ] DB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:28.449778] [DEBUG] [LOCAL ] DAO: Loaded 13384 existing records from primary storage. [2025-09-16T21:14:28.449961] [INFO ] [MAIN ] DAO: Loaded 13384 primary data records. [2025-09-16T21:14:28.637020] [DEBUG] [LOCAL ] DAVA: Loaded 30657 existing records from primary storage. [2025-09-16T21:14:28.654897] [INFO ] [MAIN ] DAVA: Loaded 30657 primary data records. [2025-09-16T21:14:28.824959] [DEBUG] [LOCAL ] DB: Loaded 39078 existing records from primary storage. [2025-09-16T21:14:28.845370] [INFO ] [MAIN ] DB: Loaded 39078 primary data records. [2025-09-16T21:14:29.335193] [DEBUG] [MAIN ] DAO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:29.336237] [INFO ] [MAIN ] DAO: Generated 1339 derivative records from 13384 primary records. [2025-09-16T21:14:29.336600] [DEBUG] [LOCAL ] DAO: Saving derivative data. [2025-09-16T21:14:29.350000] [DEBUG] [LOCAL ] DAO: Derivative data saved (1339 records). [2025-09-16T21:14:29.350394] [INFO ] [MAIN ] DAO: Successfully saved derivative data. [2025-09-16T21:14:29.352515] [INFO ] [MAIN ] Derivative Progress: 481/2026 symbols completed. DAO took 0.9s. Estimated remaining: 8m 26s. Rate: 183.2 symbols/min [2025-09-16T21:14:29.353039] [INFO ] [MAIN ] DBI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:29.379588] [DEBUG] [MAIN ] DB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:29.379826] [DEBUG] [MAIN ] DAVA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:29.381421] [INFO ] [MAIN ] DAVA: Generated 1339 derivative records from 30657 primary records. [2025-09-16T21:14:29.380662] [INFO ] [MAIN ] DB: Generated 1339 derivative records from 39078 primary records. [2025-09-16T21:14:29.381571] [DEBUG] [LOCAL ] DAVA: Saving derivative data. [2025-09-16T21:14:29.382244] [DEBUG] [LOCAL ] DB: Saving derivative data. [2025-09-16T21:14:29.414017] [DEBUG] [LOCAL ] DAVA: Derivative data saved (1339 records). [2025-09-16T21:14:29.414687] [INFO ] [MAIN ] DAVA: Successfully saved derivative data. [2025-09-16T21:14:29.416792] [INFO ] [MAIN ] Derivative Progress: 482/2026 symbols completed. DAVA took 1.0s. Estimated remaining: 8m 25s. Rate: 183.5 symbols/min [2025-09-16T21:14:29.425807] [INFO ] [MAIN ] DBRG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:29.427519] [DEBUG] [LOCAL ] DB: Derivative data saved (1339 records). [2025-09-16T21:14:29.428281] [DEBUG] [LOCAL ] DBI: Loaded 33046 existing records from primary storage. [2025-09-16T21:14:29.427856] [INFO ] [MAIN ] DB: Successfully saved derivative data. [2025-09-16T21:14:29.430544] [INFO ] [MAIN ] DBI: Loaded 33046 primary data records. [2025-09-16T21:14:29.430485] [INFO ] [MAIN ] Derivative Progress: 483/2026 symbols completed. DB took 1.0s. Estimated remaining: 8m 24s. Rate: 183.9 symbols/min [2025-09-16T21:14:29.431018] [INFO ] [MAIN ] DCI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:29.641997] [DEBUG] [LOCAL ] DCI: Loaded 27450 existing records from primary storage. [2025-09-16T21:14:29.739371] [INFO ] [MAIN ] DCI: Loaded 27450 primary data records. [2025-09-16T21:14:29.740009] [DEBUG] [LOCAL ] DBRG: Loaded 36985 existing records from primary storage. [2025-09-16T21:14:29.740448] [INFO ] [MAIN ] DBRG: Loaded 36985 primary data records. [2025-09-16T21:14:30.308819] [DEBUG] [MAIN ] DBI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:30.310292] [INFO ] [MAIN ] DBI: Generated 1339 derivative records from 33046 primary records. [2025-09-16T21:14:30.310513] [DEBUG] [LOCAL ] DBI: Saving derivative data. [2025-09-16T21:14:30.324363] [DEBUG] [LOCAL ] DBI: Derivative data saved (1339 records). [2025-09-16T21:14:30.324705] [INFO ] [MAIN ] DBI: Successfully saved derivative data. [2025-09-16T21:14:30.326811] [INFO ] [MAIN ] Derivative Progress: 484/2026 symbols completed. DBI took 1.0s. Estimated remaining: 8m 25s. Rate: 183.2 symbols/min [2025-09-16T21:14:30.327217] [INFO ] [MAIN ] DD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:30.341941] [DEBUG] [MAIN ] DCI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:30.343135] [INFO ] [MAIN ] DCI: Generated 1339 derivative records from 27450 primary records. [2025-09-16T21:14:30.343291] [DEBUG] [LOCAL ] DCI: Saving derivative data. [2025-09-16T21:14:30.362122] [DEBUG] [MAIN ] DBRG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:30.365026] [INFO ] [MAIN ] DBRG: Generated 1339 derivative records from 36985 primary records. [2025-09-16T21:14:30.366298] [DEBUG] [LOCAL ] DBRG: Saving derivative data. [2025-09-16T21:14:30.366943] [DEBUG] [LOCAL ] DCI: Derivative data saved (1339 records). [2025-09-16T21:14:30.367234] [INFO ] [MAIN ] DCI: Successfully saved derivative data. [2025-09-16T21:14:30.369831] [INFO ] [MAIN ] Derivative Progress: 485/2026 symbols completed. DCI took 0.9s. Estimated remaining: 8m 24s. Rate: 183.5 symbols/min [2025-09-16T21:14:30.370423] [INFO ] [MAIN ] DDD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:30.392531] [DEBUG] [LOCAL ] DBRG: Derivative data saved (1339 records). [2025-09-16T21:14:30.392603] [INFO ] [MAIN ] DBRG: Successfully saved derivative data. [2025-09-16T21:14:30.394853] [INFO ] [MAIN ] Derivative Progress: 486/2026 symbols completed. DBRG took 1.0s. Estimated remaining: 8m 22s. Rate: 183.9 symbols/min [2025-09-16T21:14:30.395117] [INFO ] [MAIN ] DDT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:30.410948] [DEBUG] [LOCAL ] DDT: Loaded 1367 existing records from primary storage. [2025-09-16T21:14:30.408803] [DEBUG] [LOCAL ] DD: Loaded 39373 existing records from primary storage. [2025-09-16T21:14:30.411145] [INFO ] [MAIN ] DDT: Loaded 1367 primary data records. [2025-09-16T21:14:30.422466] [INFO ] [MAIN ] DD: Loaded 39373 primary data records. [2025-09-16T21:14:30.681736] [DEBUG] [LOCAL ] DDD: Loaded 37715 existing records from primary storage. [2025-09-16T21:14:30.732292] [INFO ] [MAIN ] DDD: Loaded 37715 primary data records. [2025-09-16T21:14:31.318793] [DEBUG] [MAIN ] DDT: Filtered 5181 bins outside market hours, 5780 incomplete bins [2025-09-16T21:14:31.328981] [INFO ] [MAIN ] DDT: Generated 1338 derivative records from 1367 primary records. [2025-09-16T21:14:31.330158] [DEBUG] [LOCAL ] DDT: Saving derivative data. [2025-09-16T21:14:31.330036] [DEBUG] [MAIN ] DD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:31.330919] [INFO ] [MAIN ] DD: Generated 1339 derivative records from 39373 primary records. [2025-09-16T21:14:31.332152] [DEBUG] [LOCAL ] DD: Saving derivative data. [2025-09-16T21:14:31.349008] [DEBUG] [LOCAL ] DDT: Derivative data saved (1338 records). [2025-09-16T21:14:31.351862] [INFO ] [MAIN ] DDT: Successfully saved derivative data. [2025-09-16T21:14:31.354328] [INFO ] [MAIN ] Derivative Progress: 487/2026 symbols completed. DDT took 1.0s. Estimated remaining: 8m 24s. Rate: 183.2 symbols/min [2025-09-16T21:14:31.355049] [INFO ] [MAIN ] DE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:31.358491] [DEBUG] [LOCAL ] DD: Derivative data saved (1339 records). [2025-09-16T21:14:31.359284] [INFO ] [MAIN ] DD: Successfully saved derivative data. [2025-09-16T21:14:31.361203] [INFO ] [MAIN ] Derivative Progress: 488/2026 symbols completed. DD took 1.0s. Estimated remaining: 8m 23s. Rate: 183.5 symbols/min [2025-09-16T21:14:31.361450] [INFO ] [MAIN ] DEA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:31.373724] [DEBUG] [MAIN ] DDD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:31.374501] [INFO ] [MAIN ] DDD: Generated 1339 derivative records from 37715 primary records. [2025-09-16T21:14:31.374623] [DEBUG] [LOCAL ] DDD: Saving derivative data. [2025-09-16T21:14:31.389207] [DEBUG] [LOCAL ] DDD: Derivative data saved (1339 records). [2025-09-16T21:14:31.389362] [INFO ] [MAIN ] DDD: Successfully saved derivative data. [2025-09-16T21:14:31.391436] [INFO ] [MAIN ] Derivative Progress: 489/2026 symbols completed. DDD took 1.0s. Estimated remaining: 8m 22s. Rate: 183.9 symbols/min [2025-09-16T21:14:31.391706] [INFO ] [MAIN ] DEC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:31.440041] [DEBUG] [LOCAL ] DE: Loaded 35191 existing records from primary storage. [2025-09-16T21:14:31.440676] [INFO ] [MAIN ] DE: Loaded 35191 primary data records. [2025-09-16T21:14:31.440574] [DEBUG] [LOCAL ] DEA: Loaded 29272 existing records from primary storage. [2025-09-16T21:14:31.446130] [INFO ] [MAIN ] DEA: Loaded 29272 primary data records. [2025-09-16T21:14:31.605050] [DEBUG] [LOCAL ] DEC: Loaded 21218 existing records from primary storage. [2025-09-16T21:14:31.623165] [INFO ] [MAIN ] DEC: Loaded 21218 primary data records. [2025-09-16T21:14:32.295685] [DEBUG] [MAIN ] DE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:32.296822] [INFO ] [MAIN ] DE: Generated 1339 derivative records from 35191 primary records. [2025-09-16T21:14:32.297314] [DEBUG] [LOCAL ] DE: Saving derivative data. [2025-09-16T21:14:32.316801] [DEBUG] [MAIN ] DEA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:32.318203] [INFO ] [MAIN ] DEA: Generated 1339 derivative records from 29272 primary records. [2025-09-16T21:14:32.319421] [DEBUG] [LOCAL ] DEA: Saving derivative data. [2025-09-16T21:14:32.328593] [DEBUG] [LOCAL ] DE: Derivative data saved (1339 records). [2025-09-16T21:14:32.332118] [INFO ] [MAIN ] DE: Successfully saved derivative data. [2025-09-16T21:14:32.334835] [INFO ] [MAIN ] Derivative Progress: 490/2026 symbols completed. DE took 1.0s. Estimated remaining: 8m 23s. Rate: 183.2 symbols/min [2025-09-16T21:14:32.335264] [INFO ] [MAIN ] DECK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:32.338344] [DEBUG] [LOCAL ] DEA: Derivative data saved (1339 records). [2025-09-16T21:14:32.338715] [INFO ] [MAIN ] DEA: Successfully saved derivative data. [2025-09-16T21:14:32.340975] [INFO ] [MAIN ] Derivative Progress: 491/2026 symbols completed. DEA took 1.0s. Estimated remaining: 8m 22s. Rate: 183.5 symbols/min [2025-09-16T21:14:32.347154] [INFO ] [MAIN ] DEO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:32.352026] [DEBUG] [MAIN ] DEC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:32.352869] [INFO ] [MAIN ] DEC: Generated 1339 derivative records from 21218 primary records. [2025-09-16T21:14:32.353030] [DEBUG] [LOCAL ] DEC: Saving derivative data. [2025-09-16T21:14:32.366880] [DEBUG] [LOCAL ] DEC: Derivative data saved (1339 records). [2025-09-16T21:14:32.367021] [INFO ] [MAIN ] DEC: Successfully saved derivative data. [2025-09-16T21:14:32.369561] [INFO ] [MAIN ] Derivative Progress: 492/2026 symbols completed. DEC took 1.0s. Estimated remaining: 8m 21s. Rate: 183.9 symbols/min [2025-09-16T21:14:32.369866] [INFO ] [MAIN ] DFP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:32.392271] [DEBUG] [LOCAL ] DFP: Loaded 8662 existing records from primary storage. [2025-09-16T21:14:32.392697] [INFO ] [MAIN ] DFP: Loaded 8662 primary data records. [2025-09-16T21:14:32.538036] [DEBUG] [LOCAL ] DECK: Loaded 39727 existing records from primary storage. [2025-09-16T21:14:32.548919] [INFO ] [MAIN ] DECK: Loaded 39727 primary data records. [2025-09-16T21:14:32.560299] [DEBUG] [LOCAL ] DEO: Loaded 36147 existing records from primary storage. [2025-09-16T21:14:32.565494] [INFO ] [MAIN ] DEO: Loaded 36147 primary data records. [2025-09-16T21:14:33.294586] [DEBUG] [MAIN ] DFP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:33.295402] [INFO ] [MAIN ] DFP: Generated 1339 derivative records from 8662 primary records. [2025-09-16T21:14:33.295658] [DEBUG] [LOCAL ] DFP: Saving derivative data. [2025-09-16T21:14:33.308180] [DEBUG] [LOCAL ] DFP: Derivative data saved (1339 records). [2025-09-16T21:14:33.308445] [INFO ] [MAIN ] DFP: Successfully saved derivative data. [2025-09-16T21:14:33.310112] [INFO ] [MAIN ] Derivative Progress: 493/2026 symbols completed. DFP took 0.9s. Estimated remaining: 8m 22s. Rate: 183.2 symbols/min [2025-09-16T21:14:33.323666] [DEBUG] [MAIN ] DECK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:33.324394] [INFO ] [MAIN ] DECK: Generated 1339 derivative records from 39727 primary records. [2025-09-16T21:14:33.333288] [DEBUG] [LOCAL ] DECK: Saving derivative data. [2025-09-16T21:14:33.333714] [DEBUG] [MAIN ] DEO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:33.334539] [INFO ] [MAIN ] DEO: Generated 1339 derivative records from 36147 primary records. [2025-09-16T21:14:33.334773] [DEBUG] [LOCAL ] DEO: Saving derivative data. [2025-09-16T21:14:33.357783] [DEBUG] [LOCAL ] DEO: Derivative data saved (1339 records). [2025-09-16T21:14:33.358875] [INFO ] [MAIN ] DEO: Successfully saved derivative data. [2025-09-16T21:14:33.361013] [INFO ] [MAIN ] Derivative Progress: 494/2026 symbols completed. DEO took 1.0s. Estimated remaining: 8m 21s. Rate: 183.5 symbols/min [2025-09-16T21:14:33.358783] [DEBUG] [LOCAL ] DECK: Derivative data saved (1339 records). [2025-09-16T21:14:33.361265] [INFO ] [MAIN ] DECK: Successfully saved derivative data. [2025-09-16T21:14:33.363416] [INFO ] [MAIN ] Derivative Progress: 495/2026 symbols completed. DECK took 1.0s. Estimated remaining: 8m 20s. Rate: 183.8 symbols/min [2025-09-16T21:14:33.364049] [INFO ] [MAIN ] DHI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:33.364213] [INFO ] [MAIN ] DG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:33.363878] [INFO ] [MAIN ] DHF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:33.381190] [DEBUG] [LOCAL ] DHF: Loaded 15920 existing records from primary storage. [2025-09-16T21:14:33.381410] [INFO ] [MAIN ] DHF: Loaded 15920 primary data records. [2025-09-16T21:14:33.600720] [DEBUG] [LOCAL ] DG: Loaded 39688 existing records from primary storage. [2025-09-16T21:14:33.600911] [INFO ] [MAIN ] DG: Loaded 39688 primary data records. [2025-09-16T21:14:33.604474] [DEBUG] [LOCAL ] DHI: Loaded 39803 existing records from primary storage. [2025-09-16T21:14:33.609904] [INFO ] [MAIN ] DHI: Loaded 39803 primary data records. [2025-09-16T21:14:34.254925] [DEBUG] [MAIN ] DHF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:34.256519] [INFO ] [MAIN ] DHF: Generated 1339 derivative records from 15920 primary records. [2025-09-16T21:14:34.256735] [DEBUG] [LOCAL ] DHF: Saving derivative data. [2025-09-16T21:14:34.270369] [DEBUG] [LOCAL ] DHF: Derivative data saved (1339 records). [2025-09-16T21:14:34.270668] [INFO ] [MAIN ] DHF: Successfully saved derivative data. [2025-09-16T21:14:34.272675] [INFO ] [MAIN ] Derivative Progress: 496/2026 symbols completed. DHF took 0.9s. Estimated remaining: 8m 21s. Rate: 183.2 symbols/min [2025-09-16T21:14:34.273239] [INFO ] [MAIN ] DINO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:34.289157] [DEBUG] [MAIN ] DHI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:34.295668] [INFO ] [MAIN ] DHI: Generated 1339 derivative records from 39803 primary records. [2025-09-16T21:14:34.299529] [DEBUG] [LOCAL ] DHI: Saving derivative data. [2025-09-16T21:14:34.299758] [DEBUG] [MAIN ] DG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:34.300304] [INFO ] [MAIN ] DG: Generated 1339 derivative records from 39688 primary records. [2025-09-16T21:14:34.301324] [DEBUG] [LOCAL ] DG: Saving derivative data. [2025-09-16T21:14:34.323806] [DEBUG] [LOCAL ] DG: Derivative data saved (1339 records). [2025-09-16T21:14:34.324594] [INFO ] [MAIN ] DG: Successfully saved derivative data. [2025-09-16T21:14:34.327045] [INFO ] [MAIN ] Derivative Progress: 497/2026 symbols completed. DG took 1.0s. Estimated remaining: 8m 20s. Rate: 183.5 symbols/min [2025-09-16T21:14:34.327788] [INFO ] [MAIN ] DIS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:34.338883] [DEBUG] [LOCAL ] DHI: Derivative data saved (1339 records). [2025-09-16T21:14:34.339018] [INFO ] [MAIN ] DHI: Successfully saved derivative data. [2025-09-16T21:14:34.341091] [INFO ] [MAIN ] Derivative Progress: 498/2026 symbols completed. DHI took 1.0s. Estimated remaining: 8m 19s. Rate: 183.8 symbols/min [2025-09-16T21:14:34.341426] [INFO ] [MAIN ] DK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:34.357182] [DEBUG] [LOCAL ] DINO: Loaded 39480 existing records from primary storage. [2025-09-16T21:14:34.357389] [INFO ] [MAIN ] DINO: Loaded 39480 primary data records. [2025-09-16T21:14:34.678999] [DEBUG] [LOCAL ] DIS: Loaded 40138 existing records from primary storage. [2025-09-16T21:14:34.679230] [INFO ] [MAIN ] DIS: Loaded 40138 primary data records. [2025-09-16T21:14:34.691287] [DEBUG] [LOCAL ] DK: Loaded 36998 existing records from primary storage. [2025-09-16T21:14:34.711928] [INFO ] [MAIN ] DK: Loaded 36998 primary data records. [2025-09-16T21:14:35.238298] [DEBUG] [MAIN ] DINO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:35.239289] [INFO ] [MAIN ] DINO: Generated 1339 derivative records from 39480 primary records. [2025-09-16T21:14:35.240387] [DEBUG] [LOCAL ] DINO: Saving derivative data. [2025-09-16T21:14:35.256545] [DEBUG] [LOCAL ] DINO: Derivative data saved (1339 records). [2025-09-16T21:14:35.266306] [INFO ] [MAIN ] DINO: Successfully saved derivative data. [2025-09-16T21:14:35.266652] [DEBUG] [MAIN ] DIS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:35.268940] [INFO ] [MAIN ] Derivative Progress: 499/2026 symbols completed. DINO took 1.0s. Estimated remaining: 8m 20s. Rate: 183.2 symbols/min [2025-09-16T21:14:35.269191] [INFO ] [MAIN ] DKL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:35.270128] [INFO ] [MAIN ] DIS: Generated 1339 derivative records from 40138 primary records. [2025-09-16T21:14:35.270772] [DEBUG] [LOCAL ] DIS: Saving derivative data. [2025-09-16T21:14:35.299865] [DEBUG] [LOCAL ] DIS: Derivative data saved (1339 records). [2025-09-16T21:14:35.300517] [DEBUG] [MAIN ] DK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:35.300271] [INFO ] [MAIN ] DIS: Successfully saved derivative data. [2025-09-16T21:14:35.301289] [INFO ] [MAIN ] DK: Generated 1339 derivative records from 36998 primary records. [2025-09-16T21:14:35.303059] [INFO ] [MAIN ] Derivative Progress: 500/2026 symbols completed. DIS took 1.0s. Estimated remaining: 8m 19s. Rate: 183.5 symbols/min [2025-09-16T21:14:35.303394] [INFO ] [MAIN ] DKS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:35.303117] [DEBUG] [LOCAL ] DK: Saving derivative data. [2025-09-16T21:14:35.311392] [DEBUG] [LOCAL ] DKL: Loaded 12673 existing records from primary storage. [2025-09-16T21:14:35.317267] [INFO ] [MAIN ] DKL: Loaded 12673 primary data records. [2025-09-16T21:14:35.437726] [DEBUG] [LOCAL ] DK: Derivative data saved (1339 records). [2025-09-16T21:14:35.443145] [INFO ] [MAIN ] DK: Successfully saved derivative data. [2025-09-16T21:14:35.452127] [INFO ] [MAIN ] Derivative Progress: 501/2026 symbols completed. DK took 1.1s. Estimated remaining: 8m 18s. Rate: 183.7 symbols/min [2025-09-16T21:14:35.484056] [INFO ] [MAIN ] DLB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:35.649088] [DEBUG] [LOCAL ] DKS: Loaded 37152 existing records from primary storage. [2025-09-16T21:14:35.650986] [INFO ] [MAIN ] DKS: Loaded 37152 primary data records. [2025-09-16T21:14:35.917802] [DEBUG] [LOCAL ] DLB: Loaded 23929 existing records from primary storage. [2025-09-16T21:14:35.928886] [INFO ] [MAIN ] DLB: Loaded 23929 primary data records. [2025-09-16T21:14:36.210392] [DEBUG] [MAIN ] DKL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:36.211150] [INFO ] [MAIN ] DKL: Generated 1339 derivative records from 12673 primary records. [2025-09-16T21:14:36.211399] [DEBUG] [LOCAL ] DKL: Saving derivative data. [2025-09-16T21:14:36.225628] [DEBUG] [LOCAL ] DKL: Derivative data saved (1339 records). [2025-09-16T21:14:36.226082] [INFO ] [MAIN ] DKL: Successfully saved derivative data. [2025-09-16T21:14:36.228713] [INFO ] [MAIN ] Derivative Progress: 502/2026 symbols completed. DKL took 1.0s. Estimated remaining: 8m 19s. Rate: 183.2 symbols/min [2025-09-16T21:14:36.230115] [INFO ] [MAIN ] DLNG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:36.241484] [DEBUG] [MAIN ] DKS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:36.244071] [INFO ] [MAIN ] DKS: Generated 1339 derivative records from 37152 primary records. [2025-09-16T21:14:36.244270] [DEBUG] [LOCAL ] DKS: Saving derivative data. [2025-09-16T21:14:36.253242] [DEBUG] [LOCAL ] DLNG: Loaded 4310 existing records from primary storage. [2025-09-16T21:14:36.256060] [INFO ] [MAIN ] DLNG: Loaded 4310 primary data records. [2025-09-16T21:14:36.289476] [DEBUG] [LOCAL ] DKS: Derivative data saved (1339 records). [2025-09-16T21:14:36.313517] [INFO ] [MAIN ] DKS: Successfully saved derivative data. [2025-09-16T21:14:36.340539] [INFO ] [MAIN ] Derivative Progress: 503/2026 symbols completed. DKS took 1.0s. Estimated remaining: 8m 18s. Rate: 183.4 symbols/min [2025-09-16T21:14:36.359700] [INFO ] [MAIN ] DLR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:36.415586] [DEBUG] [MAIN ] DLB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:36.446609] [INFO ] [MAIN ] DLB: Generated 1339 derivative records from 23929 primary records. [2025-09-16T21:14:36.449737] [DEBUG] [LOCAL ] DLB: Saving derivative data. [2025-09-16T21:14:36.554503] [DEBUG] [LOCAL ] DLB: Derivative data saved (1339 records). [2025-09-16T21:14:36.555028] [INFO ] [MAIN ] DLB: Successfully saved derivative data. [2025-09-16T21:14:36.557393] [INFO ] [MAIN ] Derivative Progress: 504/2026 symbols completed. DLB took 1.1s. Estimated remaining: 8m 17s. Rate: 183.6 symbols/min [2025-09-16T21:14:36.557801] [INFO ] [MAIN ] DLX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:36.576181] [DEBUG] [LOCAL ] DLR: Loaded 37822 existing records from primary storage. [2025-09-16T21:14:36.582946] [INFO ] [MAIN ] DLR: Loaded 37822 primary data records. [2025-09-16T21:14:36.624479] [DEBUG] [MAIN ] DLNG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:36.676702] [INFO ] [MAIN ] DLNG: Generated 1339 derivative records from 4310 primary records. [2025-09-16T21:14:36.676791] [DEBUG] [LOCAL ] DLNG: Saving derivative data. [2025-09-16T21:14:36.676045] [DEBUG] [LOCAL ] DLX: Loaded 21590 existing records from primary storage. [2025-09-16T21:14:36.687393] [INFO ] [MAIN ] DLX: Loaded 21590 primary data records. [2025-09-16T21:14:36.823976] [DEBUG] [LOCAL ] DLNG: Derivative data saved (1339 records). [2025-09-16T21:14:36.871689] [INFO ] [MAIN ] DLNG: Successfully saved derivative data. [2025-09-16T21:14:36.889326] [INFO ] [MAIN ] Derivative Progress: 505/2026 symbols completed. DLNG took 0.7s. Estimated remaining: 8m 17s. Rate: 183.6 symbols/min [2025-09-16T21:14:36.889784] [INFO ] [MAIN ] DLY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:37.168198] [DEBUG] [LOCAL ] DLY: Loaded 13860 existing records from primary storage. [2025-09-16T21:14:37.168387] [INFO ] [MAIN ] DLY: Loaded 13860 primary data records. [2025-09-16T21:14:37.453064] [DEBUG] [MAIN ] DLR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:37.454835] [INFO ] [MAIN ] DLR: Generated 1339 derivative records from 37822 primary records. [2025-09-16T21:14:37.455389] [DEBUG] [LOCAL ] DLR: Saving derivative data. [2025-09-16T21:14:37.481705] [DEBUG] [LOCAL ] DLR: Derivative data saved (1339 records). [2025-09-16T21:14:37.482006] [DEBUG] [MAIN ] DLX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:37.483010] [INFO ] [MAIN ] DLR: Successfully saved derivative data. [2025-09-16T21:14:37.482952] [INFO ] [MAIN ] DLX: Generated 1339 derivative records from 21590 primary records. [2025-09-16T21:14:37.484701] [INFO ] [MAIN ] Derivative Progress: 506/2026 symbols completed. DLR took 1.1s. Estimated remaining: 8m 18s. Rate: 183.3 symbols/min [2025-09-16T21:14:37.484913] [DEBUG] [LOCAL ] DLX: Saving derivative data. [2025-09-16T21:14:37.485165] [INFO ] [MAIN ] DMA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:37.501440] [DEBUG] [LOCAL ] DMA: Loaded 3636 existing records from primary storage. [2025-09-16T21:14:37.502081] [INFO ] [MAIN ] DMA: Loaded 3636 primary data records. [2025-09-16T21:14:37.551613] [DEBUG] [LOCAL ] DLX: Derivative data saved (1339 records). [2025-09-16T21:14:37.564999] [INFO ] [MAIN ] DLX: Successfully saved derivative data. [2025-09-16T21:14:37.589241] [INFO ] [MAIN ] Derivative Progress: 507/2026 symbols completed. DLX took 1.0s. Estimated remaining: 8m 17s. Rate: 183.5 symbols/min [2025-09-16T21:14:37.621194] [INFO ] [MAIN ] DMB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:37.640958] [DEBUG] [MAIN ] DLY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:37.677086] [INFO ] [MAIN ] DLY: Generated 1339 derivative records from 13860 primary records. [2025-09-16T21:14:37.708983] [DEBUG] [LOCAL ] DLY: Saving derivative data. [2025-09-16T21:14:37.750704] [DEBUG] [LOCAL ] DMB: Loaded 7953 existing records from primary storage. [2025-09-16T21:14:37.843481] [INFO ] [MAIN ] DMB: Loaded 7953 primary data records. [2025-09-16T21:14:37.907011] [DEBUG] [LOCAL ] DLY: Derivative data saved (1339 records). [2025-09-16T21:14:37.939673] [INFO ] [MAIN ] DLY: Successfully saved derivative data. [2025-09-16T21:14:37.948979] [INFO ] [MAIN ] Derivative Progress: 508/2026 symbols completed. DLY took 1.1s. Estimated remaining: 8m 16s. Rate: 183.5 symbols/min [2025-09-16T21:14:38.136339] [DEBUG] [MAIN ] DMA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:38.137073] [INFO ] [MAIN ] DMA: Generated 1339 derivative records from 3636 primary records. [2025-09-16T21:14:38.137801] [DEBUG] [LOCAL ] DMA: Saving derivative data. [2025-09-16T21:14:38.148715] [DEBUG] [LOCAL ] DMA: Derivative data saved (1339 records). [2025-09-16T21:14:38.148931] [INFO ] [MAIN ] DMA: Successfully saved derivative data. [2025-09-16T21:14:38.150570] [INFO ] [MAIN ] Derivative Progress: 509/2026 symbols completed. DMA took 0.7s. Estimated remaining: 8m 16s. Rate: 183.6 symbols/min [2025-09-16T21:14:38.163340] [DEBUG] [MAIN ] DMB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:38.163866] [INFO ] [MAIN ] DMB: Generated 1339 derivative records from 7953 primary records. [2025-09-16T21:14:38.167629] [DEBUG] [LOCAL ] DMB: Saving derivative data. [2025-09-16T21:14:38.178977] [DEBUG] [LOCAL ] DMB: Derivative data saved (1339 records). [2025-09-16T21:14:38.179033] [INFO ] [MAIN ] DMB: Successfully saved derivative data. [2025-09-16T21:14:38.181926] [INFO ] [MAIN ] Derivative Progress: 510/2026 symbols completed. DMB took 0.6s. Estimated remaining: 8m 15s. Rate: 183.9 symbols/min [2025-09-16T21:14:38.182561] [INFO ] [MAIN ] DNOW: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:38.182530] [INFO ] [MAIN ] DMO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:38.182992] [INFO ] [MAIN ] DNA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:38.193092] [DEBUG] [LOCAL ] DMO: Loaded 6948 existing records from primary storage. [2025-09-16T21:14:38.193382] [INFO ] [MAIN ] DMO: Loaded 6948 primary data records. [2025-09-16T21:14:38.400946] [DEBUG] [LOCAL ] DNOW: Loaded 31921 existing records from primary storage. [2025-09-16T21:14:38.493553] [INFO ] [MAIN ] DNOW: Loaded 31921 primary data records. [2025-09-16T21:14:38.525773] [DEBUG] [LOCAL ] DNA: Loaded 35867 existing records from primary storage. [2025-09-16T21:14:38.531478] [INFO ] [MAIN ] DNA: Loaded 35867 primary data records. [2025-09-16T21:14:39.046940] [DEBUG] [MAIN ] DMO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:39.048236] [INFO ] [MAIN ] DMO: Generated 1339 derivative records from 6948 primary records. [2025-09-16T21:14:39.048794] [DEBUG] [LOCAL ] DMO: Saving derivative data. [2025-09-16T21:14:39.067321] [DEBUG] [LOCAL ] DMO: Derivative data saved (1339 records). [2025-09-16T21:14:39.067492] [INFO ] [MAIN ] DMO: Successfully saved derivative data. [2025-09-16T21:14:39.069450] [INFO ] [MAIN ] Derivative Progress: 511/2026 symbols completed. DMO took 0.9s. Estimated remaining: 8m 16s. Rate: 183.3 symbols/min [2025-09-16T21:14:39.071190] [INFO ] [MAIN ] DNP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:39.088404] [DEBUG] [MAIN ] DNOW: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:39.096970] [INFO ] [MAIN ] DNOW: Generated 1339 derivative records from 31921 primary records. [2025-09-16T21:14:39.097197] [DEBUG] [LOCAL ] DNOW: Saving derivative data. [2025-09-16T21:14:39.116813] [DEBUG] [MAIN ] DNA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:39.120241] [DEBUG] [LOCAL ] DNOW: Derivative data saved (1339 records). [2025-09-16T21:14:39.120441] [INFO ] [MAIN ] DNOW: Successfully saved derivative data. [2025-09-16T21:14:39.123167] [INFO ] [MAIN ] Derivative Progress: 512/2026 symbols completed. DNOW took 0.9s. Estimated remaining: 8m 15s. Rate: 183.6 symbols/min [2025-09-16T21:14:39.121132] [INFO ] [MAIN ] DNA: Generated 1339 derivative records from 35867 primary records. [2025-09-16T21:14:39.131340] [DEBUG] [LOCAL ] DNP: Loaded 24576 existing records from primary storage. [2025-09-16T21:14:39.130959] [DEBUG] [LOCAL ] DNA: Saving derivative data. [2025-09-16T21:14:39.130839] [INFO ] [MAIN ] DOC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:39.132525] [INFO ] [MAIN ] DNP: Loaded 24576 primary data records. [2025-09-16T21:14:39.298416] [DEBUG] [LOCAL ] DNA: Derivative data saved (1339 records). [2025-09-16T21:14:39.329999] [INFO ] [MAIN ] DNA: Successfully saved derivative data. [2025-09-16T21:14:39.405905] [INFO ] [MAIN ] Derivative Progress: 513/2026 symbols completed. DNA took 1.2s. Estimated remaining: 8m 14s. Rate: 183.7 symbols/min [2025-09-16T21:14:39.418428] [INFO ] [MAIN ] DOCN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:39.431972] [DEBUG] [LOCAL ] DOC: Loaded 39924 existing records from primary storage. [2025-09-16T21:14:39.433054] [INFO ] [MAIN ] DOC: Loaded 39924 primary data records. [2025-09-16T21:14:39.758893] [DEBUG] [LOCAL ] DOCN: Loaded 37915 existing records from primary storage. [2025-09-16T21:14:39.769969] [INFO ] [MAIN ] DOCN: Loaded 37915 primary data records. [2025-09-16T21:14:39.889006] [DEBUG] [MAIN ] DNP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:39.893955] [INFO ] [MAIN ] DNP: Generated 1339 derivative records from 24576 primary records. [2025-09-16T21:14:39.894346] [DEBUG] [LOCAL ] DNP: Saving derivative data. [2025-09-16T21:14:39.982751] [DEBUG] [LOCAL ] DNP: Derivative data saved (1339 records). [2025-09-16T21:14:40.068171] [INFO ] [MAIN ] DNP: Successfully saved derivative data. [2025-09-16T21:14:40.070398] [INFO ] [MAIN ] Derivative Progress: 514/2026 symbols completed. DNP took 1.0s. Estimated remaining: 8m 15s. Rate: 183.3 symbols/min [2025-09-16T21:14:40.070737] [INFO ] [MAIN ] DOCS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:40.088528] [DEBUG] [MAIN ] DOC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:40.089306] [INFO ] [MAIN ] DOC: Generated 1339 derivative records from 39924 primary records. [2025-09-16T21:14:40.089667] [DEBUG] [LOCAL ] DOC: Saving derivative data. [2025-09-16T21:14:40.103218] [DEBUG] [LOCAL ] DOC: Derivative data saved (1339 records). [2025-09-16T21:14:40.103498] [INFO ] [MAIN ] DOC: Successfully saved derivative data. [2025-09-16T21:14:40.106398] [INFO ] [MAIN ] Derivative Progress: 515/2026 symbols completed. DOC took 1.0s. Estimated remaining: 8m 14s. Rate: 183.6 symbols/min [2025-09-16T21:14:40.107107] [INFO ] [MAIN ] DOLE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:40.120191] [DEBUG] [MAIN ] DOCN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:40.120853] [INFO ] [MAIN ] DOCN: Generated 1339 derivative records from 37915 primary records. [2025-09-16T21:14:40.129515] [DEBUG] [LOCAL ] DOCN: Saving derivative data. [2025-09-16T21:14:40.142007] [DEBUG] [LOCAL ] DOCN: Derivative data saved (1339 records). [2025-09-16T21:14:40.142100] [INFO ] [MAIN ] DOCN: Successfully saved derivative data. [2025-09-16T21:14:40.144165] [INFO ] [MAIN ] Derivative Progress: 516/2026 symbols completed. DOCN took 0.7s. Estimated remaining: 8m 13s. Rate: 183.9 symbols/min [2025-09-16T21:14:40.145039] [INFO ] [MAIN ] DOV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:40.159428] [DEBUG] [LOCAL ] DOCS: Loaded 37942 existing records from primary storage. [2025-09-16T21:14:40.167132] [INFO ] [MAIN ] DOCS: Loaded 37942 primary data records. [2025-09-16T21:14:40.282001] [DEBUG] [LOCAL ] DOLE: Loaded 28584 existing records from primary storage. [2025-09-16T21:14:40.285746] [INFO ] [MAIN ] DOLE: Loaded 28584 primary data records. [2025-09-16T21:14:40.494714] [DEBUG] [LOCAL ] DOV: Loaded 33591 existing records from primary storage. [2025-09-16T21:14:40.495249] [INFO ] [MAIN ] DOV: Loaded 33591 primary data records. [2025-09-16T21:14:41.046173] [DEBUG] [MAIN ] DOCS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:41.047880] [INFO ] [MAIN ] DOCS: Generated 1339 derivative records from 37942 primary records. [2025-09-16T21:14:41.048092] [DEBUG] [LOCAL ] DOCS: Saving derivative data. [2025-09-16T21:14:41.072573] [DEBUG] [LOCAL ] DOCS: Derivative data saved (1339 records). [2025-09-16T21:14:41.072853] [DEBUG] [MAIN ] DOLE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:41.073817] [INFO ] [MAIN ] DOLE: Generated 1339 derivative records from 28584 primary records. [2025-09-16T21:14:41.074061] [DEBUG] [LOCAL ] DOLE: Saving derivative data. [2025-09-16T21:14:41.073208] [INFO ] [MAIN ] DOCS: Successfully saved derivative data. [2025-09-16T21:14:41.077423] [INFO ] [MAIN ] Derivative Progress: 517/2026 symbols completed. DOCS took 1.0s. Estimated remaining: 8m 14s. Rate: 183.3 symbols/min [2025-09-16T21:14:41.077849] [INFO ] [MAIN ] DOW: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:41.092155] [DEBUG] [LOCAL ] DOLE: Derivative data saved (1339 records). [2025-09-16T21:14:41.092251] [INFO ] [MAIN ] DOLE: Successfully saved derivative data. [2025-09-16T21:14:41.095389] [INFO ] [MAIN ] Derivative Progress: 518/2026 symbols completed. DOLE took 1.0s. Estimated remaining: 8m 13s. Rate: 183.6 symbols/min [2025-09-16T21:14:41.095810] [INFO ] [MAIN ] DPG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:41.106404] [DEBUG] [MAIN ] DOV: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:41.107163] [INFO ] [MAIN ] DOV: Generated 1339 derivative records from 33591 primary records. [2025-09-16T21:14:41.107244] [DEBUG] [LOCAL ] DOV: Saving derivative data. [2025-09-16T21:14:41.122486] [DEBUG] [LOCAL ] DOV: Derivative data saved (1339 records). [2025-09-16T21:14:41.122747] [INFO ] [MAIN ] DOV: Successfully saved derivative data. [2025-09-16T21:14:41.124752] [INFO ] [MAIN ] Derivative Progress: 519/2026 symbols completed. DOV took 1.0s. Estimated remaining: 8m 12s. Rate: 183.9 symbols/min [2025-09-16T21:14:41.125019] [INFO ] [MAIN ] DQ: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:41.132717] [DEBUG] [LOCAL ] DPG: Loaded 9792 existing records from primary storage. [2025-09-16T21:14:41.142077] [INFO ] [MAIN ] DPG: Loaded 9792 primary data records. [2025-09-16T21:14:41.269600] [DEBUG] [LOCAL ] DOW: Loaded 40083 existing records from primary storage. [2025-09-16T21:14:41.275435] [INFO ] [MAIN ] DOW: Loaded 40083 primary data records. [2025-09-16T21:14:41.516512] [DEBUG] [LOCAL ] DQ: Loaded 31641 existing records from primary storage. [2025-09-16T21:14:41.544547] [INFO ] [MAIN ] DQ: Loaded 31641 primary data records. [2025-09-16T21:14:42.072564] [DEBUG] [MAIN ] DPG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:42.073947] [INFO ] [MAIN ] DPG: Generated 1339 derivative records from 9792 primary records. [2025-09-16T21:14:42.074208] [DEBUG] [LOCAL ] DPG: Saving derivative data. [2025-09-16T21:14:42.087349] [DEBUG] [LOCAL ] DPG: Derivative data saved (1339 records). [2025-09-16T21:14:42.088422] [INFO ] [MAIN ] DPG: Successfully saved derivative data. [2025-09-16T21:14:42.090907] [INFO ] [MAIN ] Derivative Progress: 520/2026 symbols completed. DPG took 1.0s. Estimated remaining: 8m 13s. Rate: 183.2 symbols/min [2025-09-16T21:14:42.091516] [INFO ] [MAIN ] DRH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:42.104057] [DEBUG] [MAIN ] DOW: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:42.104972] [INFO ] [MAIN ] DOW: Generated 1339 derivative records from 40083 primary records. [2025-09-16T21:14:42.105197] [DEBUG] [LOCAL ] DOW: Saving derivative data. [2025-09-16T21:14:42.117787] [DEBUG] [LOCAL ] DOW: Derivative data saved (1339 records). [2025-09-16T21:14:42.117978] [INFO ] [MAIN ] DOW: Successfully saved derivative data. [2025-09-16T21:14:42.120432] [INFO ] [MAIN ] Derivative Progress: 521/2026 symbols completed. DOW took 1.0s. Estimated remaining: 8m 12s. Rate: 183.6 symbols/min [2025-09-16T21:14:42.122128] [INFO ] [MAIN ] DRI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:42.134997] [DEBUG] [MAIN ] DQ: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:42.136040] [INFO ] [MAIN ] DQ: Generated 1339 derivative records from 31641 primary records. [2025-09-16T21:14:42.136490] [DEBUG] [LOCAL ] DQ: Saving derivative data. [2025-09-16T21:14:42.157431] [DEBUG] [LOCAL ] DQ: Derivative data saved (1339 records). [2025-09-16T21:14:42.157614] [INFO ] [MAIN ] DQ: Successfully saved derivative data. [2025-09-16T21:14:42.159876] [INFO ] [MAIN ] Derivative Progress: 522/2026 symbols completed. DQ took 1.0s. Estimated remaining: 8m 11s. Rate: 183.9 symbols/min [2025-09-16T21:14:42.160206] [INFO ] [MAIN ] DRLL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:42.173040] [DEBUG] [LOCAL ] DRH: Loaded 37403 existing records from primary storage. [2025-09-16T21:14:42.175128] [INFO ] [MAIN ] DRH: Loaded 37403 primary data records. [2025-09-16T21:14:42.235762] [DEBUG] [LOCAL ] DRLL: Loaded 6504 existing records from primary storage. [2025-09-16T21:14:42.274830] [INFO ] [MAIN ] DRLL: Loaded 6504 primary data records. [2025-09-16T21:14:42.333826] [DEBUG] [LOCAL ] DRI: Loaded 35099 existing records from primary storage. [2025-09-16T21:14:42.356314] [INFO ] [MAIN ] DRI: Loaded 35099 primary data records. [2025-09-16T21:14:43.040198] [DEBUG] [MAIN ] DRH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:43.041175] [INFO ] [MAIN ] DRH: Generated 1339 derivative records from 37403 primary records. [2025-09-16T21:14:43.041435] [DEBUG] [LOCAL ] DRH: Saving derivative data. [2025-09-16T21:14:43.058465] [DEBUG] [LOCAL ] DRH: Derivative data saved (1339 records). [2025-09-16T21:14:43.068151] [INFO ] [MAIN ] DRH: Successfully saved derivative data. [2025-09-16T21:14:43.068481] [DEBUG] [MAIN ] DRI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:43.076627] [INFO ] [MAIN ] Derivative Progress: 523/2026 symbols completed. DRH took 1.0s. Estimated remaining: 8m 12s. Rate: 183.2 symbols/min [2025-09-16T21:14:43.081259] [INFO ] [MAIN ] DRI: Generated 1339 derivative records from 35099 primary records. [2025-09-16T21:14:43.081541] [DEBUG] [MAIN ] DRLL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:43.081624] [DEBUG] [LOCAL ] DRI: Saving derivative data. [2025-09-16T21:14:43.082947] [INFO ] [MAIN ] DRLL: Generated 1339 derivative records from 6504 primary records. [2025-09-16T21:14:43.088891] [DEBUG] [LOCAL ] DRLL: Saving derivative data. [2025-09-16T21:14:43.095353] [DEBUG] [LOCAL ] DRI: Derivative data saved (1339 records). [2025-09-16T21:14:43.101064] [INFO ] [MAIN ] DRI: Successfully saved derivative data. [2025-09-16T21:14:43.103219] [INFO ] [MAIN ] Derivative Progress: 524/2026 symbols completed. DRI took 1.0s. Estimated remaining: 8m 11s. Rate: 183.6 symbols/min [2025-09-16T21:14:43.109216] [DEBUG] [LOCAL ] DRLL: Derivative data saved (1339 records). [2025-09-16T21:14:43.109290] [INFO ] [MAIN ] DRLL: Successfully saved derivative data. [2025-09-16T21:14:43.111325] [INFO ] [MAIN ] Derivative Progress: 525/2026 symbols completed. DRLL took 1.0s. Estimated remaining: 8m 10s. Rate: 183.9 symbols/min [2025-09-16T21:14:43.111942] [INFO ] [MAIN ] DSL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:43.112088] [INFO ] [MAIN ] DSM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:43.112461] [INFO ] [MAIN ] DSU: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:43.140105] [DEBUG] [LOCAL ] DSM: Loaded 10175 existing records from primary storage. [2025-09-16T21:14:43.140467] [DEBUG] [LOCAL ] DSU: Loaded 15673 existing records from primary storage. [2025-09-16T21:14:43.140712] [INFO ] [MAIN ] DSU: Loaded 15673 primary data records. [2025-09-16T21:14:43.140802] [INFO ] [MAIN ] DSM: Loaded 10175 primary data records. [2025-09-16T21:14:43.228352] [DEBUG] [LOCAL ] DSL: Loaded 20214 existing records from primary storage. [2025-09-16T21:14:43.317850] [INFO ] [MAIN ] DSL: Loaded 20214 primary data records. [2025-09-16T21:14:43.983494] [DEBUG] [MAIN ] DSU: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:43.984513] [INFO ] [MAIN ] DSU: Generated 1339 derivative records from 15673 primary records. [2025-09-16T21:14:43.984713] [DEBUG] [LOCAL ] DSU: Saving derivative data. [2025-09-16T21:14:43.983912] [DEBUG] [MAIN ] DSM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:43.986312] [INFO ] [MAIN ] DSM: Generated 1339 derivative records from 10175 primary records. [2025-09-16T21:14:43.986581] [DEBUG] [LOCAL ] DSM: Saving derivative data. [2025-09-16T21:14:44.010276] [DEBUG] [LOCAL ] DSU: Derivative data saved (1339 records). [2025-09-16T21:14:44.010367] [INFO ] [MAIN ] DSU: Successfully saved derivative data. [2025-09-16T21:14:44.011710] [DEBUG] [LOCAL ] DSM: Derivative data saved (1339 records). [2025-09-16T21:14:44.013383] [INFO ] [MAIN ] Derivative Progress: 526/2026 symbols completed. DSU took 0.9s. Estimated remaining: 8m 11s. Rate: 183.3 symbols/min [2025-09-16T21:14:44.013597] [INFO ] [MAIN ] DSX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:44.023154] [INFO ] [MAIN ] DSM: Successfully saved derivative data. [2025-09-16T21:14:44.025788] [INFO ] [MAIN ] Derivative Progress: 527/2026 symbols completed. DSM took 0.9s. Estimated remaining: 8m 10s. Rate: 183.6 symbols/min [2025-09-16T21:14:44.023618] [DEBUG] [MAIN ] DSL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:44.026834] [INFO ] [MAIN ] DSL: Generated 1339 derivative records from 20214 primary records. [2025-09-16T21:14:44.027019] [DEBUG] [LOCAL ] DSL: Saving derivative data. [2025-09-16T21:14:44.027172] [INFO ] [MAIN ] DT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:44.040577] [DEBUG] [LOCAL ] DSL: Derivative data saved (1339 records). [2025-09-16T21:14:44.040665] [INFO ] [MAIN ] DSL: Successfully saved derivative data. [2025-09-16T21:14:44.042756] [INFO ] [MAIN ] Derivative Progress: 528/2026 symbols completed. DSL took 0.9s. Estimated remaining: 8m 9s. Rate: 183.9 symbols/min [2025-09-16T21:14:44.042957] [INFO ] [MAIN ] DTB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:44.054785] [DEBUG] [LOCAL ] DTB: Loaded 3766 existing records from primary storage. [2025-09-16T21:14:44.060876] [INFO ] [MAIN ] DTB: Loaded 3766 primary data records. [2025-09-16T21:14:44.082302] [DEBUG] [LOCAL ] DSX: Loaded 17834 existing records from primary storage. [2025-09-16T21:14:44.134363] [INFO ] [MAIN ] DSX: Loaded 17834 primary data records. [2025-09-16T21:14:44.270877] [DEBUG] [LOCAL ] DT: Loaded 39430 existing records from primary storage. [2025-09-16T21:14:44.314785] [INFO ] [MAIN ] DT: Loaded 39430 primary data records. [2025-09-16T21:14:44.935160] [DEBUG] [MAIN ] DTB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:44.937075] [INFO ] [MAIN ] DTB: Generated 1339 derivative records from 3766 primary records. [2025-09-16T21:14:44.937347] [DEBUG] [LOCAL ] DTB: Saving derivative data. [2025-09-16T21:14:44.951315] [DEBUG] [LOCAL ] DTB: Derivative data saved (1339 records). [2025-09-16T21:14:44.951532] [INFO ] [MAIN ] DTB: Successfully saved derivative data. [2025-09-16T21:14:44.953291] [INFO ] [MAIN ] Derivative Progress: 529/2026 symbols completed. DTB took 0.9s. Estimated remaining: 8m 10s. Rate: 183.3 symbols/min [2025-09-16T21:14:44.953759] [INFO ] [MAIN ] DTE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:44.963888] [DEBUG] [MAIN ] DSX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:44.965468] [INFO ] [MAIN ] DSX: Generated 1339 derivative records from 17834 primary records. [2025-09-16T21:14:44.966239] [DEBUG] [LOCAL ] DSX: Saving derivative data. [2025-09-16T21:14:44.988270] [DEBUG] [LOCAL ] DSX: Derivative data saved (1339 records). [2025-09-16T21:14:44.988405] [INFO ] [MAIN ] DSX: Successfully saved derivative data. [2025-09-16T21:14:44.987945] [DEBUG] [MAIN ] DT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:44.991248] [INFO ] [MAIN ] DT: Generated 1339 derivative records from 39430 primary records. [2025-09-16T21:14:44.990613] [INFO ] [MAIN ] Derivative Progress: 530/2026 symbols completed. DSX took 1.0s. Estimated remaining: 8m 9s. Rate: 183.6 symbols/min [2025-09-16T21:14:44.991488] [INFO ] [MAIN ] DTM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:44.991533] [DEBUG] [LOCAL ] DT: Saving derivative data. [2025-09-16T21:14:45.004344] [DEBUG] [LOCAL ] DT: Derivative data saved (1339 records). [2025-09-16T21:14:45.004493] [INFO ] [MAIN ] DT: Successfully saved derivative data. [2025-09-16T21:14:45.006658] [INFO ] [MAIN ] Derivative Progress: 531/2026 symbols completed. DT took 1.0s. Estimated remaining: 8m 8s. Rate: 184.0 symbols/min [2025-09-16T21:14:45.006875] [INFO ] [MAIN ] DTW: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:45.021822] [DEBUG] [LOCAL ] DTW: Loaded 3569 existing records from primary storage. [2025-09-16T21:14:45.021957] [INFO ] [MAIN ] DTW: Loaded 3569 primary data records. [2025-09-16T21:14:45.147005] [DEBUG] [LOCAL ] DTE: Loaded 35490 existing records from primary storage. [2025-09-16T21:14:45.157975] [INFO ] [MAIN ] DTE: Loaded 35490 primary data records. [2025-09-16T21:14:45.253000] [DEBUG] [LOCAL ] DTM: Loaded 32101 existing records from primary storage. [2025-09-16T21:14:45.304021] [INFO ] [MAIN ] DTM: Loaded 32101 primary data records. [2025-09-16T21:14:45.867916] [DEBUG] [MAIN ] DTW: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:45.868850] [INFO ] [MAIN ] DTW: Generated 1339 derivative records from 3569 primary records. [2025-09-16T21:14:45.869675] [DEBUG] [LOCAL ] DTW: Saving derivative data. [2025-09-16T21:14:45.883022] [DEBUG] [LOCAL ] DTW: Derivative data saved (1339 records). [2025-09-16T21:14:45.883713] [INFO ] [MAIN ] DTW: Successfully saved derivative data. [2025-09-16T21:14:45.885477] [INFO ] [MAIN ] Derivative Progress: 532/2026 symbols completed. DTW took 0.9s. Estimated remaining: 8m 9s. Rate: 183.4 symbols/min [2025-09-16T21:14:45.886099] [INFO ] [MAIN ] DUK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:45.896315] [DEBUG] [MAIN ] DTE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:45.897282] [INFO ] [MAIN ] DTE: Generated 1339 derivative records from 35490 primary records. [2025-09-16T21:14:45.897438] [DEBUG] [LOCAL ] DTE: Saving derivative data. [2025-09-16T21:14:45.910453] [DEBUG] [LOCAL ] DTE: Derivative data saved (1339 records). [2025-09-16T21:14:45.910834] [INFO ] [MAIN ] DTE: Successfully saved derivative data. [2025-09-16T21:14:45.913686] [INFO ] [MAIN ] Derivative Progress: 533/2026 symbols completed. DTE took 1.0s. Estimated remaining: 8m 8s. Rate: 183.7 symbols/min [2025-09-16T21:14:45.913971] [INFO ] [MAIN ] DUKB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:45.925875] [DEBUG] [MAIN ] DTM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:45.926609] [INFO ] [MAIN ] DTM: Generated 1339 derivative records from 32101 primary records. [2025-09-16T21:14:45.926734] [DEBUG] [LOCAL ] DTM: Saving derivative data. [2025-09-16T21:14:45.940328] [DEBUG] [LOCAL ] DTM: Derivative data saved (1339 records). [2025-09-16T21:14:45.942937] [DEBUG] [LOCAL ] DUKB: Loaded 4679 existing records from primary storage. [2025-09-16T21:14:45.952101] [INFO ] [MAIN ] DUKB: Loaded 4679 primary data records. [2025-09-16T21:14:45.952151] [INFO ] [MAIN ] DTM: Successfully saved derivative data. [2025-09-16T21:14:45.965472] [INFO ] [MAIN ] Derivative Progress: 534/2026 symbols completed. DTM took 1.0s. Estimated remaining: 8m 7s. Rate: 184.0 symbols/min [2025-09-16T21:14:45.974855] [INFO ] [MAIN ] DV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:46.059089] [DEBUG] [LOCAL ] DUK: Loaded 39839 existing records from primary storage. [2025-09-16T21:14:46.069835] [INFO ] [MAIN ] DUK: Loaded 39839 primary data records. [2025-09-16T21:14:46.555887] [DEBUG] [LOCAL ] DV: Loaded 37966 existing records from primary storage. [2025-09-16T21:14:46.567684] [INFO ] [MAIN ] DV: Loaded 37966 primary data records. [2025-09-16T21:14:46.842737] [DEBUG] [MAIN ] DUKB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:46.843634] [INFO ] [MAIN ] DUKB: Generated 1339 derivative records from 4679 primary records. [2025-09-16T21:14:46.843812] [DEBUG] [LOCAL ] DUKB: Saving derivative data. [2025-09-16T21:14:46.860279] [DEBUG] [LOCAL ] DUKB: Derivative data saved (1339 records). [2025-09-16T21:14:46.860560] [INFO ] [MAIN ] DUKB: Successfully saved derivative data. [2025-09-16T21:14:46.862318] [INFO ] [MAIN ] Derivative Progress: 535/2026 symbols completed. DUKB took 0.9s. Estimated remaining: 8m 8s. Rate: 183.4 symbols/min [2025-09-16T21:14:46.868297] [INFO ] [MAIN ] DVA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:46.873528] [DEBUG] [MAIN ] DUK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:46.874711] [INFO ] [MAIN ] DUK: Generated 1339 derivative records from 39839 primary records. [2025-09-16T21:14:46.874926] [DEBUG] [LOCAL ] DUK: Saving derivative data. [2025-09-16T21:14:46.890863] [DEBUG] [LOCAL ] DUK: Derivative data saved (1339 records). [2025-09-16T21:14:46.891135] [INFO ] [MAIN ] DUK: Successfully saved derivative data. [2025-09-16T21:14:46.893430] [INFO ] [MAIN ] Derivative Progress: 536/2026 symbols completed. DUK took 1.0s. Estimated remaining: 8m 7s. Rate: 183.7 symbols/min [2025-09-16T21:14:46.899613] [INFO ] [MAIN ] DVN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:46.905896] [DEBUG] [MAIN ] DV: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:46.906692] [INFO ] [MAIN ] DV: Generated 1339 derivative records from 37966 primary records. [2025-09-16T21:14:46.906855] [DEBUG] [LOCAL ] DV: Saving derivative data. [2025-09-16T21:14:46.926830] [DEBUG] [LOCAL ] DV: Derivative data saved (1339 records). [2025-09-16T21:14:46.926911] [INFO ] [MAIN ] DV: Successfully saved derivative data. [2025-09-16T21:14:46.928808] [INFO ] [MAIN ] Derivative Progress: 537/2026 symbols completed. DV took 1.0s. Estimated remaining: 8m 6s. Rate: 184.0 symbols/min [2025-09-16T21:14:46.929589] [INFO ] [MAIN ] DX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:46.940075] [DEBUG] [LOCAL ] DVA: Loaded 30522 existing records from primary storage. [2025-09-16T21:14:46.940188] [INFO ] [MAIN ] DVA: Loaded 30522 primary data records. [2025-09-16T21:14:47.132615] [DEBUG] [LOCAL ] DVN: Loaded 40049 existing records from primary storage. [2025-09-16T21:14:47.133334] [INFO ] [MAIN ] DVN: Loaded 40049 primary data records. [2025-09-16T21:14:47.353962] [DEBUG] [LOCAL ] DX: Loaded 39065 existing records from primary storage. [2025-09-16T21:14:47.354145] [INFO ] [MAIN ] DX: Loaded 39065 primary data records. [2025-09-16T21:14:47.802449] [DEBUG] [MAIN ] DVA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:47.803465] [INFO ] [MAIN ] DVA: Generated 1339 derivative records from 30522 primary records. [2025-09-16T21:14:47.805048] [DEBUG] [LOCAL ] DVA: Saving derivative data. [2025-09-16T21:14:47.828249] [DEBUG] [LOCAL ] DVA: Derivative data saved (1339 records). [2025-09-16T21:14:47.828426] [DEBUG] [MAIN ] DVN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:47.828971] [INFO ] [MAIN ] DVA: Successfully saved derivative data. [2025-09-16T21:14:47.831264] [INFO ] [MAIN ] Derivative Progress: 538/2026 symbols completed. DVA took 1.0s. Estimated remaining: 8m 7s. Rate: 183.4 symbols/min [2025-09-16T21:14:47.832759] [INFO ] [MAIN ] DVN: Generated 1339 derivative records from 40049 primary records. [2025-09-16T21:14:47.832859] [DEBUG] [LOCAL ] DVN: Saving derivative data. [2025-09-16T21:14:47.854870] [DEBUG] [LOCAL ] DVN: Derivative data saved (1339 records). [2025-09-16T21:14:47.855034] [INFO ] [MAIN ] DVN: Successfully saved derivative data. [2025-09-16T21:14:47.857030] [INFO ] [MAIN ] Derivative Progress: 539/2026 symbols completed. DVN took 1.0s. Estimated remaining: 8m 6s. Rate: 183.7 symbols/min [2025-09-16T21:14:47.855290] [DEBUG] [MAIN ] DX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:47.857812] [INFO ] [MAIN ] DX: Generated 1339 derivative records from 39065 primary records. [2025-09-16T21:14:47.857879] [DEBUG] [LOCAL ] DX: Saving derivative data. [2025-09-16T21:14:47.869911] [DEBUG] [LOCAL ] DX: Derivative data saved (1339 records). [2025-09-16T21:14:47.870001] [INFO ] [MAIN ] DX: Successfully saved derivative data. [2025-09-16T21:14:47.873114] [INFO ] [MAIN ] Derivative Progress: 540/2026 symbols completed. DX took 0.9s. Estimated remaining: 8m 4s. Rate: 184.0 symbols/min [2025-09-16T21:14:47.873805] [INFO ] [MAIN ] DY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:47.873717] [INFO ] [MAIN ] DXC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:47.874031] [INFO ] [MAIN ] DXYZ: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:47.919906] [DEBUG] [LOCAL ] DY: Loaded 21107 existing records from primary storage. [2025-09-16T21:14:47.920561] [DEBUG] [LOCAL ] DXYZ: Loaded 26694 existing records from primary storage. [2025-09-16T21:14:47.920792] [INFO ] [MAIN ] DY: Loaded 21107 primary data records. [2025-09-16T21:14:47.920882] [INFO ] [MAIN ] DXYZ: Loaded 26694 primary data records. [2025-09-16T21:14:48.119984] [DEBUG] [LOCAL ] DXC: Loaded 37119 existing records from primary storage. [2025-09-16T21:14:48.140500] [INFO ] [MAIN ] DXC: Loaded 37119 primary data records. [2025-09-16T21:14:48.796114] [DEBUG] [MAIN ] DXYZ: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:48.806484] [INFO ] [MAIN ] DXYZ: Generated 1339 derivative records from 26694 primary records. [2025-09-16T21:14:48.806677] [DEBUG] [LOCAL ] DXYZ: Saving derivative data. [2025-09-16T21:14:48.809821] [DEBUG] [MAIN ] DY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:48.816143] [INFO ] [MAIN ] DY: Generated 1339 derivative records from 21107 primary records. [2025-09-16T21:14:48.824845] [DEBUG] [LOCAL ] DY: Saving derivative data. [2025-09-16T21:14:48.831686] [DEBUG] [LOCAL ] DXYZ: Derivative data saved (1339 records). [2025-09-16T21:14:48.832141] [INFO ] [MAIN ] DXYZ: Successfully saved derivative data. [2025-09-16T21:14:48.832080] [DEBUG] [MAIN ] DXC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:48.833909] [INFO ] [MAIN ] Derivative Progress: 541/2026 symbols completed. DXYZ took 1.0s. Estimated remaining: 8m 6s. Rate: 183.4 symbols/min [2025-09-16T21:14:48.843340] [INFO ] [MAIN ] EAI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:48.840839] [INFO ] [MAIN ] DXC: Generated 1339 derivative records from 37119 primary records. [2025-09-16T21:14:48.844989] [DEBUG] [LOCAL ] DXC: Saving derivative data. [2025-09-16T21:14:48.847514] [DEBUG] [LOCAL ] DY: Derivative data saved (1339 records). [2025-09-16T21:14:48.848248] [INFO ] [MAIN ] DY: Successfully saved derivative data. [2025-09-16T21:14:48.856146] [INFO ] [MAIN ] Derivative Progress: 542/2026 symbols completed. DY took 1.0s. Estimated remaining: 8m 5s. Rate: 183.7 symbols/min [2025-09-16T21:14:48.859347] [INFO ] [MAIN ] EB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:48.864484] [DEBUG] [LOCAL ] EAI: Loaded 2911 existing records from primary storage. [2025-09-16T21:14:48.865577] [DEBUG] [LOCAL ] DXC: Derivative data saved (1339 records). [2025-09-16T21:14:48.865168] [INFO ] [MAIN ] EAI: Loaded 2911 primary data records. [2025-09-16T21:14:48.865713] [INFO ] [MAIN ] DXC: Successfully saved derivative data. [2025-09-16T21:14:48.898477] [INFO ] [MAIN ] Derivative Progress: 543/2026 symbols completed. DXC took 1.0s. Estimated remaining: 8m 4s. Rate: 184.0 symbols/min [2025-09-16T21:14:48.909796] [INFO ] [MAIN ] EBF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:49.142433] [DEBUG] [LOCAL ] EBF: Loaded 13951 existing records from primary storage. [2025-09-16T21:14:49.150456] [INFO ] [MAIN ] EBF: Loaded 13951 primary data records. [2025-09-16T21:14:49.182396] [DEBUG] [LOCAL ] EB: Loaded 27190 existing records from primary storage. [2025-09-16T21:14:49.215683] [INFO ] [MAIN ] EB: Loaded 27190 primary data records. [2025-09-16T21:14:49.695341] [DEBUG] [MAIN ] EAI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:49.696334] [INFO ] [MAIN ] EAI: Generated 1339 derivative records from 2911 primary records. [2025-09-16T21:14:49.697270] [DEBUG] [LOCAL ] EAI: Saving derivative data. [2025-09-16T21:14:49.710155] [DEBUG] [LOCAL ] EAI: Derivative data saved (1339 records). [2025-09-16T21:14:49.710474] [INFO ] [MAIN ] EAI: Successfully saved derivative data. [2025-09-16T21:14:49.712137] [INFO ] [MAIN ] Derivative Progress: 544/2026 symbols completed. EAI took 0.9s. Estimated remaining: 8m 5s. Rate: 183.5 symbols/min [2025-09-16T21:14:49.713706] [INFO ] [MAIN ] EBR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:49.726902] [DEBUG] [MAIN ] EBF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:49.727534] [INFO ] [MAIN ] EBF: Generated 1339 derivative records from 13951 primary records. [2025-09-16T21:14:49.727765] [DEBUG] [LOCAL ] EBF: Saving derivative data. [2025-09-16T21:14:49.750516] [DEBUG] [LOCAL ] EBF: Derivative data saved (1339 records). [2025-09-16T21:14:49.750717] [INFO ] [MAIN ] EBF: Successfully saved derivative data. [2025-09-16T21:14:49.753722] [INFO ] [MAIN ] Derivative Progress: 545/2026 symbols completed. EBF took 0.8s. Estimated remaining: 8m 4s. Rate: 183.8 symbols/min [2025-09-16T21:14:49.754082] [INFO ] [MAIN ] EBS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:49.764753] [DEBUG] [MAIN ] EB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:49.766043] [INFO ] [MAIN ] EB: Generated 1339 derivative records from 27190 primary records. [2025-09-16T21:14:49.766157] [DEBUG] [LOCAL ] EB: Saving derivative data. [2025-09-16T21:14:49.785565] [DEBUG] [LOCAL ] EBR: Loaded 31640 existing records from primary storage. [2025-09-16T21:14:49.786437] [INFO ] [MAIN ] EBR: Loaded 31640 primary data records. [2025-09-16T21:14:49.788806] [DEBUG] [LOCAL ] EB: Derivative data saved (1339 records). [2025-09-16T21:14:49.809892] [INFO ] [MAIN ] EB: Successfully saved derivative data. [2025-09-16T21:14:49.826512] [INFO ] [MAIN ] Derivative Progress: 546/2026 symbols completed. EB took 1.0s. Estimated remaining: 8m 3s. Rate: 184.0 symbols/min [2025-09-16T21:14:49.859051] [INFO ] [MAIN ] EC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:49.947781] [DEBUG] [LOCAL ] EBS: Loaded 35107 existing records from primary storage. [2025-09-16T21:14:49.998504] [INFO ] [MAIN ] EBS: Loaded 35107 primary data records. [2025-09-16T21:14:50.231985] [DEBUG] [LOCAL ] EC: Loaded 36426 existing records from primary storage. [2025-09-16T21:14:50.259333] [INFO ] [MAIN ] EC: Loaded 36426 primary data records. [2025-09-16T21:14:50.566234] [DEBUG] [MAIN ] EBR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:50.567281] [INFO ] [MAIN ] EBR: Generated 1339 derivative records from 31640 primary records. [2025-09-16T21:14:50.567500] [DEBUG] [LOCAL ] EBR: Saving derivative data. [2025-09-16T21:14:50.672580] [DEBUG] [LOCAL ] EBR: Derivative data saved (1339 records). [2025-09-16T21:14:50.676595] [INFO ] [MAIN ] EBR: Successfully saved derivative data. [2025-09-16T21:14:50.678745] [INFO ] [MAIN ] Derivative Progress: 547/2026 symbols completed. EBR took 1.0s. Estimated remaining: 8m 4s. Rate: 183.5 symbols/min [2025-09-16T21:14:50.679012] [INFO ] [MAIN ] ECAT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:50.690550] [DEBUG] [MAIN ] EBS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:50.691232] [INFO ] [MAIN ] EBS: Generated 1339 derivative records from 35107 primary records. [2025-09-16T21:14:50.691481] [DEBUG] [LOCAL ] EBS: Saving derivative data. [2025-09-16T21:14:50.704211] [DEBUG] [LOCAL ] EBS: Derivative data saved (1339 records). [2025-09-16T21:14:50.704430] [INFO ] [MAIN ] EBS: Successfully saved derivative data. [2025-09-16T21:14:50.708079] [INFO ] [MAIN ] Derivative Progress: 548/2026 symbols completed. EBS took 1.0s. Estimated remaining: 8m 2s. Rate: 183.8 symbols/min [2025-09-16T21:14:50.708359] [INFO ] [MAIN ] ECC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:50.725988] [DEBUG] [MAIN ] EC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:50.726725] [INFO ] [MAIN ] EC: Generated 1339 derivative records from 36426 primary records. [2025-09-16T21:14:50.726839] [DEBUG] [LOCAL ] EC: Saving derivative data. [2025-09-16T21:14:50.748228] [DEBUG] [LOCAL ] ECAT: Loaded 21933 existing records from primary storage. [2025-09-16T21:14:50.747799] [DEBUG] [LOCAL ] EC: Derivative data saved (1339 records). [2025-09-16T21:14:50.748451] [INFO ] [MAIN ] EC: Successfully saved derivative data. [2025-09-16T21:14:50.751053] [INFO ] [MAIN ] Derivative Progress: 549/2026 symbols completed. EC took 0.9s. Estimated remaining: 8m 1s. Rate: 184.1 symbols/min [2025-09-16T21:14:50.751160] [INFO ] [MAIN ] ECAT: Loaded 21933 primary data records. [2025-09-16T21:14:50.762810] [INFO ] [MAIN ] ECCU: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:50.866774] [DEBUG] [LOCAL ] ECCU: Loaded 1691 existing records from primary storage. [2025-09-16T21:14:50.866973] [INFO ] [MAIN ] ECCU: Loaded 1691 primary data records. [2025-09-16T21:14:51.170191] [DEBUG] [LOCAL ] ECC: Loaded 31843 existing records from primary storage. [2025-09-16T21:14:51.187142] [INFO ] [MAIN ] ECC: Loaded 31843 primary data records. [2025-09-16T21:14:51.612668] [DEBUG] [MAIN ] ECAT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:51.614527] [INFO ] [MAIN ] ECAT: Generated 1339 derivative records from 21933 primary records. [2025-09-16T21:14:51.614985] [DEBUG] [LOCAL ] ECAT: Saving derivative data. [2025-09-16T21:14:51.640432] [DEBUG] [MAIN ] ECCU: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:51.642222] [INFO ] [MAIN ] ECCU: Generated 1339 derivative records from 1691 primary records. [2025-09-16T21:14:51.641581] [DEBUG] [LOCAL ] ECAT: Derivative data saved (1339 records). [2025-09-16T21:14:51.642366] [INFO ] [MAIN ] ECAT: Successfully saved derivative data. [2025-09-16T21:14:51.642507] [DEBUG] [LOCAL ] ECCU: Saving derivative data. [2025-09-16T21:14:51.644313] [INFO ] [MAIN ] Derivative Progress: 550/2026 symbols completed. ECAT took 1.0s. Estimated remaining: 8m 3s. Rate: 183.5 symbols/min [2025-09-16T21:14:51.650732] [INFO ] [MAIN ] ECG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:51.656961] [DEBUG] [LOCAL ] ECCU: Derivative data saved (1339 records). [2025-09-16T21:14:51.658599] [INFO ] [MAIN ] ECCU: Successfully saved derivative data. [2025-09-16T21:14:51.660928] [INFO ] [MAIN ] Derivative Progress: 551/2026 symbols completed. ECCU took 0.9s. Estimated remaining: 8m 1s. Rate: 183.8 symbols/min [2025-09-16T21:14:51.661360] [INFO ] [MAIN ] ECL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:51.674499] [DEBUG] [MAIN ] ECC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:51.675242] [INFO ] [MAIN ] ECC: Generated 1339 derivative records from 31843 primary records. [2025-09-16T21:14:51.675326] [DEBUG] [LOCAL ] ECC: Saving derivative data. [2025-09-16T21:14:51.693537] [DEBUG] [LOCAL ] ECC: Derivative data saved (1339 records). [2025-09-16T21:14:51.693731] [INFO ] [MAIN ] ECC: Successfully saved derivative data. [2025-09-16T21:14:51.696857] [INFO ] [MAIN ] Derivative Progress: 552/2026 symbols completed. ECC took 1.0s. Estimated remaining: 8m 0s. Rate: 184.1 symbols/min [2025-09-16T21:14:51.710068] [INFO ] [MAIN ] ECO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:51.710733] [DEBUG] [LOCAL ] ECG: Loaded 24286 existing records from primary storage. [2025-09-16T21:14:51.711272] [INFO ] [MAIN ] ECG: Loaded 24286 primary data records. [2025-09-16T21:14:51.876589] [DEBUG] [LOCAL ] ECL: Loaded 34316 existing records from primary storage. [2025-09-16T21:14:51.876849] [DEBUG] [LOCAL ] ECO: Loaded 13314 existing records from primary storage. [2025-09-16T21:14:51.896254] [INFO ] [MAIN ] ECL: Loaded 34316 primary data records. [2025-09-16T21:14:51.922014] [INFO ] [MAIN ] ECO: Loaded 13314 primary data records. [2025-09-16T21:14:52.567665] [DEBUG] [MAIN ] ECG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:52.568886] [INFO ] [MAIN ] ECG: Generated 1339 derivative records from 24286 primary records. [2025-09-16T21:14:52.569134] [DEBUG] [LOCAL ] ECG: Saving derivative data. [2025-09-16T21:14:52.586422] [DEBUG] [LOCAL ] ECG: Derivative data saved (1339 records). [2025-09-16T21:14:52.586679] [INFO ] [MAIN ] ECG: Successfully saved derivative data. [2025-09-16T21:14:52.597068] [INFO ] [MAIN ] Derivative Progress: 553/2026 symbols completed. ECG took 1.0s. Estimated remaining: 8m 2s. Rate: 183.5 symbols/min [2025-09-16T21:14:52.610982] [DEBUG] [MAIN ] ECO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:52.611254] [DEBUG] [MAIN ] ECL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:52.612474] [INFO ] [MAIN ] ECO: Generated 1339 derivative records from 13314 primary records. [2025-09-16T21:14:52.612025] [INFO ] [MAIN ] ECL: Generated 1339 derivative records from 34316 primary records. [2025-09-16T21:14:52.612585] [DEBUG] [LOCAL ] ECO: Saving derivative data. [2025-09-16T21:14:52.612622] [DEBUG] [LOCAL ] ECL: Saving derivative data. [2025-09-16T21:14:52.635281] [DEBUG] [LOCAL ] ECO: Derivative data saved (1339 records). [2025-09-16T21:14:52.636183] [INFO ] [MAIN ] ECO: Successfully saved derivative data. [2025-09-16T21:14:52.639313] [INFO ] [MAIN ] Derivative Progress: 554/2026 symbols completed. ECO took 0.9s. Estimated remaining: 8m 0s. Rate: 183.8 symbols/min [2025-09-16T21:14:52.639613] [DEBUG] [LOCAL ] ECL: Derivative data saved (1339 records). [2025-09-16T21:14:52.639697] [INFO ] [MAIN ] ECL: Successfully saved derivative data. [2025-09-16T21:14:52.641623] [INFO ] [MAIN ] Derivative Progress: 555/2026 symbols completed. ECL took 1.0s. Estimated remaining: 7m 59s. Rate: 184.2 symbols/min [2025-09-16T21:14:52.642060] [INFO ] [MAIN ] ECVT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:52.642436] [INFO ] [MAIN ] ED: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:52.642308] [INFO ] [MAIN ] EDD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:52.670806] [DEBUG] [LOCAL ] EDD: Loaded 20209 existing records from primary storage. [2025-09-16T21:14:52.670984] [INFO ] [MAIN ] EDD: Loaded 20209 primary data records. [2025-09-16T21:14:52.859616] [DEBUG] [LOCAL ] ED: Loaded 39343 existing records from primary storage. [2025-09-16T21:14:52.816036] [DEBUG] [LOCAL ] ECVT: Loaded 32031 existing records from primary storage. [2025-09-16T21:14:52.885239] [INFO ] [MAIN ] ECVT: Loaded 32031 primary data records. [2025-09-16T21:14:52.883185] [INFO ] [MAIN ] ED: Loaded 39343 primary data records. [2025-09-16T21:14:53.589908] [DEBUG] [MAIN ] EDD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:53.591287] [INFO ] [MAIN ] EDD: Generated 1339 derivative records from 20209 primary records. [2025-09-16T21:14:53.591506] [DEBUG] [LOCAL ] EDD: Saving derivative data. [2025-09-16T21:14:53.607011] [DEBUG] [LOCAL ] EDD: Derivative data saved (1339 records). [2025-09-16T21:14:53.607325] [INFO ] [MAIN ] EDD: Successfully saved derivative data. [2025-09-16T21:14:53.608972] [INFO ] [MAIN ] Derivative Progress: 556/2026 symbols completed. EDD took 1.0s. Estimated remaining: 8m 1s. Rate: 183.5 symbols/min [2025-09-16T21:14:53.611707] [INFO ] [MAIN ] EDF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:53.622973] [DEBUG] [MAIN ] ED: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:53.623845] [INFO ] [MAIN ] ED: Generated 1339 derivative records from 39343 primary records. [2025-09-16T21:14:53.625016] [DEBUG] [LOCAL ] ED: Saving derivative data. [2025-09-16T21:14:53.651985] [DEBUG] [LOCAL ] EDF: Loaded 9544 existing records from primary storage. [2025-09-16T21:14:53.656455] [INFO ] [MAIN ] EDF: Loaded 9544 primary data records. [2025-09-16T21:14:53.652241] [DEBUG] [LOCAL ] ED: Derivative data saved (1339 records). [2025-09-16T21:14:53.668304] [DEBUG] [MAIN ] ECVT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:53.668444] [INFO ] [MAIN ] ED: Successfully saved derivative data. [2025-09-16T21:14:53.679061] [INFO ] [MAIN ] ECVT: Generated 1339 derivative records from 32031 primary records. [2025-09-16T21:14:53.701486] [DEBUG] [LOCAL ] ECVT: Saving derivative data. [2025-09-16T21:14:53.705023] [INFO ] [MAIN ] Derivative Progress: 557/2026 symbols completed. ED took 1.1s. Estimated remaining: 7m 60s. Rate: 183.7 symbols/min [2025-09-16T21:14:53.745557] [INFO ] [MAIN ] EDN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:53.780178] [DEBUG] [LOCAL ] ECVT: Derivative data saved (1339 records). [2025-09-16T21:14:53.825188] [INFO ] [MAIN ] ECVT: Successfully saved derivative data. [2025-09-16T21:14:53.841595] [INFO ] [MAIN ] Derivative Progress: 558/2026 symbols completed. ECVT took 1.2s. Estimated remaining: 7m 59s. Rate: 183.9 symbols/min [2025-09-16T21:14:53.950301] [INFO ] [MAIN ] EDU: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:53.950973] [DEBUG] [LOCAL ] EDN: Loaded 13047 existing records from primary storage. [2025-09-16T21:14:53.951277] [INFO ] [MAIN ] EDN: Loaded 13047 primary data records. [2025-09-16T21:14:54.226327] [DEBUG] [LOCAL ] EDU: Loaded 32909 existing records from primary storage. [2025-09-16T21:14:54.237404] [INFO ] [MAIN ] EDU: Loaded 32909 primary data records. [2025-09-16T21:14:54.395670] [DEBUG] [MAIN ] EDF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:54.428795] [INFO ] [MAIN ] EDF: Generated 1339 derivative records from 9544 primary records. [2025-09-16T21:14:54.450179] [DEBUG] [LOCAL ] EDF: Saving derivative data. [2025-09-16T21:14:54.549001] [DEBUG] [LOCAL ] EDF: Derivative data saved (1339 records). [2025-09-16T21:14:54.549493] [INFO ] [MAIN ] EDF: Successfully saved derivative data. [2025-09-16T21:14:54.551527] [INFO ] [MAIN ] Derivative Progress: 559/2026 symbols completed. EDF took 0.9s. Estimated remaining: 7m 60s. Rate: 183.5 symbols/min [2025-09-16T21:14:54.554471] [INFO ] [MAIN ] EE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:54.565161] [DEBUG] [MAIN ] EDN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:54.565873] [INFO ] [MAIN ] EDN: Generated 1339 derivative records from 13047 primary records. [2025-09-16T21:14:54.566803] [DEBUG] [LOCAL ] EDN: Saving derivative data. [2025-09-16T21:14:54.579275] [DEBUG] [LOCAL ] EDN: Derivative data saved (1339 records). [2025-09-16T21:14:54.579399] [INFO ] [MAIN ] EDN: Successfully saved derivative data. [2025-09-16T21:14:54.581622] [INFO ] [MAIN ] Derivative Progress: 560/2026 symbols completed. EDN took 0.8s. Estimated remaining: 7m 58s. Rate: 183.8 symbols/min [2025-09-16T21:14:54.582045] [INFO ] [MAIN ] EEA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:54.586284] [DEBUG] [LOCAL ] EEA: Loaded 1988 existing records from primary storage. [2025-09-16T21:14:54.586485] [INFO ] [MAIN ] EEA: Loaded 1988 primary data records. [2025-09-16T21:14:54.703369] [DEBUG] [LOCAL ] EE: Loaded 24150 existing records from primary storage. [2025-09-16T21:14:54.708906] [INFO ] [MAIN ] EE: Loaded 24150 primary data records. [2025-09-16T21:14:54.745691] [DEBUG] [MAIN ] EDU: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:54.839254] [INFO ] [MAIN ] EDU: Generated 1339 derivative records from 32909 primary records. [2025-09-16T21:14:54.844557] [DEBUG] [LOCAL ] EDU: Saving derivative data. [2025-09-16T21:14:55.004137] [DEBUG] [LOCAL ] EDU: Derivative data saved (1339 records). [2025-09-16T21:14:55.043309] [INFO ] [MAIN ] EDU: Successfully saved derivative data. [2025-09-16T21:14:55.045395] [INFO ] [MAIN ] Derivative Progress: 561/2026 symbols completed. EDU took 1.1s. Estimated remaining: 7m 58s. Rate: 183.7 symbols/min [2025-09-16T21:14:55.047295] [INFO ] [MAIN ] EEX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:55.160128] [DEBUG] [LOCAL ] EEX: Loaded 7285 existing records from primary storage. [2025-09-16T21:14:55.160549] [INFO ] [MAIN ] EEX: Loaded 7285 primary data records. [2025-09-16T21:14:55.356737] [DEBUG] [MAIN ] EEA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:55.366339] [INFO ] [MAIN ] EEA: Generated 1339 derivative records from 1988 primary records. [2025-09-16T21:14:55.486245] [DEBUG] [LOCAL ] EEA: Saving derivative data. [2025-09-16T21:14:55.507447] [DEBUG] [LOCAL ] EEA: Derivative data saved (1339 records). [2025-09-16T21:14:55.507838] [INFO ] [MAIN ] EEA: Successfully saved derivative data. [2025-09-16T21:14:55.509804] [INFO ] [MAIN ] Derivative Progress: 562/2026 symbols completed. EEA took 0.9s. Estimated remaining: 7m 59s. Rate: 183.6 symbols/min [2025-09-16T21:14:55.510148] [INFO ] [MAIN ] EFC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:55.521418] [DEBUG] [MAIN ] EE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:55.522171] [INFO ] [MAIN ] EE: Generated 1339 derivative records from 24150 primary records. [2025-09-16T21:14:55.523165] [DEBUG] [LOCAL ] EE: Saving derivative data. [2025-09-16T21:14:55.536064] [DEBUG] [LOCAL ] EE: Derivative data saved (1339 records). [2025-09-16T21:14:55.536311] [INFO ] [MAIN ] EE: Successfully saved derivative data. [2025-09-16T21:14:55.540882] [INFO ] [MAIN ] Derivative Progress: 563/2026 symbols completed. EE took 1.0s. Estimated remaining: 7m 57s. Rate: 183.9 symbols/min [2025-09-16T21:14:55.541839] [INFO ] [MAIN ] EFR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:55.565078] [DEBUG] [MAIN ] EEX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:55.565815] [INFO ] [MAIN ] EEX: Generated 1339 derivative records from 7285 primary records. [2025-09-16T21:14:55.565907] [DEBUG] [LOCAL ] EEX: Saving derivative data. [2025-09-16T21:14:55.579838] [DEBUG] [LOCAL ] EFR: Loaded 10364 existing records from primary storage. [2025-09-16T21:14:55.580779] [INFO ] [MAIN ] EFR: Loaded 10364 primary data records. [2025-09-16T21:14:55.654579] [DEBUG] [LOCAL ] EFC: Loaded 34040 existing records from primary storage. [2025-09-16T21:14:55.621862] [DEBUG] [LOCAL ] EEX: Derivative data saved (1339 records). [2025-09-16T21:14:55.676544] [INFO ] [MAIN ] EFC: Loaded 34040 primary data records. [2025-09-16T21:14:55.703272] [INFO ] [MAIN ] EEX: Successfully saved derivative data. [2025-09-16T21:14:55.742225] [INFO ] [MAIN ] Derivative Progress: 564/2026 symbols completed. EEX took 0.7s. Estimated remaining: 7m 57s. Rate: 184.0 symbols/min [2025-09-16T21:14:55.749933] [INFO ] [MAIN ] EFT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:55.925195] [DEBUG] [LOCAL ] EFT: Loaded 9155 existing records from primary storage. [2025-09-16T21:14:55.948149] [INFO ] [MAIN ] EFT: Loaded 9155 primary data records. [2025-09-16T21:14:56.409244] [DEBUG] [MAIN ] EFR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:56.418843] [DEBUG] [MAIN ] EFC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:56.419472] [INFO ] [MAIN ] EFR: Generated 1339 derivative records from 10364 primary records. [2025-09-16T21:14:56.420748] [DEBUG] [LOCAL ] EFR: Saving derivative data. [2025-09-16T21:14:56.420478] [INFO ] [MAIN ] EFC: Generated 1339 derivative records from 34040 primary records. [2025-09-16T21:14:56.421227] [DEBUG] [LOCAL ] EFC: Saving derivative data. [2025-09-16T21:14:56.444547] [DEBUG] [LOCAL ] EFC: Derivative data saved (1339 records). [2025-09-16T21:14:56.445390] [DEBUG] [LOCAL ] EFR: Derivative data saved (1339 records). [2025-09-16T21:14:56.444906] [INFO ] [MAIN ] EFC: Successfully saved derivative data. [2025-09-16T21:14:56.448148] [INFO ] [MAIN ] Derivative Progress: 565/2026 symbols completed. EFC took 0.9s. Estimated remaining: 7m 57s. Rate: 183.6 symbols/min [2025-09-16T21:14:56.448277] [INFO ] [MAIN ] EFR: Successfully saved derivative data. [2025-09-16T21:14:56.450195] [INFO ] [MAIN ] EFX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:56.451329] [INFO ] [MAIN ] Derivative Progress: 566/2026 symbols completed. EFR took 0.9s. Estimated remaining: 7m 56s. Rate: 183.9 symbols/min [2025-09-16T21:14:56.451775] [INFO ] [MAIN ] EFXT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:56.464126] [DEBUG] [MAIN ] EFT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:56.464782] [INFO ] [MAIN ] EFT: Generated 1339 derivative records from 9155 primary records. [2025-09-16T21:14:56.464842] [DEBUG] [LOCAL ] EFT: Saving derivative data. [2025-09-16T21:14:56.476874] [DEBUG] [LOCAL ] EFT: Derivative data saved (1339 records). [2025-09-16T21:14:56.477007] [INFO ] [MAIN ] EFT: Successfully saved derivative data. [2025-09-16T21:14:56.479078] [INFO ] [MAIN ] Derivative Progress: 567/2026 symbols completed. EFT took 0.7s. Estimated remaining: 7m 55s. Rate: 184.2 symbols/min [2025-09-16T21:14:56.479441] [INFO ] [MAIN ] EG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:56.509179] [DEBUG] [LOCAL ] EFXT: Loaded 21228 existing records from primary storage. [2025-09-16T21:14:56.509398] [INFO ] [MAIN ] EFXT: Loaded 21228 primary data records. [2025-09-16T21:14:56.609298] [DEBUG] [LOCAL ] EG: Loaded 21087 existing records from primary storage. [2025-09-16T21:14:56.635968] [INFO ] [MAIN ] EG: Loaded 21087 primary data records. [2025-09-16T21:14:56.656909] [DEBUG] [LOCAL ] EFX: Loaded 32959 existing records from primary storage. [2025-09-16T21:14:56.695489] [INFO ] [MAIN ] EFX: Loaded 32959 primary data records. [2025-09-16T21:14:57.349282] [DEBUG] [MAIN ] EFXT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:57.350201] [INFO ] [MAIN ] EFXT: Generated 1339 derivative records from 21228 primary records. [2025-09-16T21:14:57.350521] [DEBUG] [LOCAL ] EFXT: Saving derivative data. [2025-09-16T21:14:57.385482] [DEBUG] [LOCAL ] EFXT: Derivative data saved (1339 records). [2025-09-16T21:14:57.385072] [DEBUG] [MAIN ] EFX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:57.386280] [INFO ] [MAIN ] EFX: Generated 1339 derivative records from 32959 primary records. [2025-09-16T21:14:57.385657] [INFO ] [MAIN ] EFXT: Successfully saved derivative data. [2025-09-16T21:14:57.388131] [INFO ] [MAIN ] Derivative Progress: 568/2026 symbols completed. EFXT took 0.9s. Estimated remaining: 7m 56s. Rate: 183.6 symbols/min [2025-09-16T21:14:57.386565] [DEBUG] [MAIN ] EG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:57.388322] [DEBUG] [LOCAL ] EFX: Saving derivative data. [2025-09-16T21:14:57.388934] [INFO ] [MAIN ] EG: Generated 1339 derivative records from 21087 primary records. [2025-09-16T21:14:57.389584] [DEBUG] [LOCAL ] EG: Saving derivative data. [2025-09-16T21:14:57.410618] [DEBUG] [LOCAL ] EFX: Derivative data saved (1339 records). [2025-09-16T21:14:57.411620] [INFO ] [MAIN ] EFX: Successfully saved derivative data. [2025-09-16T21:14:57.413870] [INFO ] [MAIN ] Derivative Progress: 569/2026 symbols completed. EFX took 1.0s. Estimated remaining: 7m 55s. Rate: 183.9 symbols/min [2025-09-16T21:14:57.414709] [DEBUG] [LOCAL ] EG: Derivative data saved (1339 records). [2025-09-16T21:14:57.414879] [INFO ] [MAIN ] EG: Successfully saved derivative data. [2025-09-16T21:14:57.417049] [INFO ] [MAIN ] Derivative Progress: 570/2026 symbols completed. EG took 0.9s. Estimated remaining: 7m 54s. Rate: 184.3 symbols/min [2025-09-16T21:14:57.417581] [INFO ] [MAIN ] EGP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:57.417548] [INFO ] [MAIN ] EGY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:57.417422] [INFO ] [MAIN ] EGO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:57.447060] [DEBUG] [LOCAL ] EGP: Loaded 22312 existing records from primary storage. [2025-09-16T21:14:57.447314] [INFO ] [MAIN ] EGP: Loaded 22312 primary data records. [2025-09-16T21:14:57.557183] [DEBUG] [LOCAL ] EGY: Loaded 30724 existing records from primary storage. [2025-09-16T21:14:57.578730] [INFO ] [MAIN ] EGY: Loaded 30724 primary data records. [2025-09-16T21:14:57.584765] [DEBUG] [LOCAL ] EGO: Loaded 38230 existing records from primary storage. [2025-09-16T21:14:57.662971] [INFO ] [MAIN ] EGO: Loaded 38230 primary data records. [2025-09-16T21:14:58.310857] [DEBUG] [MAIN ] EGP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:58.318567] [INFO ] [MAIN ] EGP: Generated 1339 derivative records from 22312 primary records. [2025-09-16T21:14:58.322541] [DEBUG] [LOCAL ] EGP: Saving derivative data. [2025-09-16T21:14:58.322481] [DEBUG] [MAIN ] EGY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:58.323239] [INFO ] [MAIN ] EGY: Generated 1339 derivative records from 30724 primary records. [2025-09-16T21:14:58.324692] [DEBUG] [LOCAL ] EGY: Saving derivative data. [2025-09-16T21:14:58.352158] [DEBUG] [LOCAL ] EGP: Derivative data saved (1339 records). [2025-09-16T21:14:58.355821] [INFO ] [MAIN ] EGP: Successfully saved derivative data. [2025-09-16T21:14:58.357531] [INFO ] [MAIN ] Derivative Progress: 571/2026 symbols completed. EGP took 0.9s. Estimated remaining: 7m 55s. Rate: 183.7 symbols/min [2025-09-16T21:14:58.358572] [DEBUG] [MAIN ] EGO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:58.358296] [INFO ] [MAIN ] EHAB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:58.359562] [INFO ] [MAIN ] EGO: Generated 1339 derivative records from 38230 primary records. [2025-09-16T21:14:58.359752] [DEBUG] [LOCAL ] EGO: Saving derivative data. [2025-09-16T21:14:58.374794] [DEBUG] [LOCAL ] EGY: Derivative data saved (1339 records). [2025-09-16T21:14:58.374936] [INFO ] [MAIN ] EGY: Successfully saved derivative data. [2025-09-16T21:14:58.374728] [DEBUG] [LOCAL ] EGO: Derivative data saved (1339 records). [2025-09-16T21:14:58.377113] [INFO ] [MAIN ] Derivative Progress: 572/2026 symbols completed. EGY took 1.0s. Estimated remaining: 7m 54s. Rate: 184.0 symbols/min [2025-09-16T21:14:58.377302] [INFO ] [MAIN ] EGO: Successfully saved derivative data. [2025-09-16T21:14:58.377526] [INFO ] [MAIN ] EHC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:58.380469] [INFO ] [MAIN ] Derivative Progress: 573/2026 symbols completed. EGO took 1.0s. Estimated remaining: 7m 53s. Rate: 184.3 symbols/min [2025-09-16T21:14:58.381016] [INFO ] [MAIN ] EHI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:58.399298] [DEBUG] [LOCAL ] EHAB: Loaded 22697 existing records from primary storage. [2025-09-16T21:14:58.399547] [INFO ] [MAIN ] EHAB: Loaded 22697 primary data records. [2025-09-16T21:14:58.468915] [DEBUG] [LOCAL ] EHI: Loaded 7902 existing records from primary storage. [2025-09-16T21:14:58.515027] [INFO ] [MAIN ] EHI: Loaded 7902 primary data records. [2025-09-16T21:14:58.689926] [DEBUG] [LOCAL ] EHC: Loaded 30997 existing records from primary storage. [2025-09-16T21:14:58.785003] [INFO ] [MAIN ] EHC: Loaded 30997 primary data records. [2025-09-16T21:14:59.268547] [DEBUG] [MAIN ] EHAB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:59.269513] [INFO ] [MAIN ] EHAB: Generated 1339 derivative records from 22697 primary records. [2025-09-16T21:14:59.269953] [DEBUG] [LOCAL ] EHAB: Saving derivative data. [2025-09-16T21:14:59.294569] [DEBUG] [MAIN ] EHI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:59.297310] [DEBUG] [LOCAL ] EHAB: Derivative data saved (1339 records). [2025-09-16T21:14:59.298264] [INFO ] [MAIN ] EHI: Generated 1339 derivative records from 7902 primary records. [2025-09-16T21:14:59.297404] [INFO ] [MAIN ] EHAB: Successfully saved derivative data. [2025-09-16T21:14:59.301585] [INFO ] [MAIN ] Derivative Progress: 574/2026 symbols completed. EHAB took 0.9s. Estimated remaining: 7m 54s. Rate: 183.7 symbols/min [2025-09-16T21:14:59.298858] [DEBUG] [LOCAL ] EHI: Saving derivative data. [2025-09-16T21:14:59.304360] [INFO ] [MAIN ] EIC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:59.320848] [DEBUG] [LOCAL ] EHI: Derivative data saved (1339 records). [2025-09-16T21:14:59.333949] [INFO ] [MAIN ] EHI: Successfully saved derivative data. [2025-09-16T21:14:59.337088] [INFO ] [MAIN ] Derivative Progress: 575/2026 symbols completed. EHI took 1.0s. Estimated remaining: 7m 53s. Rate: 184.0 symbols/min [2025-09-16T21:14:59.333804] [DEBUG] [MAIN ] EHC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:14:59.337493] [INFO ] [MAIN ] EIG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:14:59.339027] [INFO ] [MAIN ] EHC: Generated 1339 derivative records from 30997 primary records. [2025-09-16T21:14:59.339366] [DEBUG] [LOCAL ] EHC: Saving derivative data. [2025-09-16T21:14:59.376768] [DEBUG] [LOCAL ] EIC: Loaded 17796 existing records from primary storage. [2025-09-16T21:14:59.377828] [INFO ] [MAIN ] EIC: Loaded 17796 primary data records. [2025-09-16T21:14:59.391912] [DEBUG] [LOCAL ] EHC: Derivative data saved (1339 records). [2025-09-16T21:14:59.430796] [INFO ] [MAIN ] EHC: Successfully saved derivative data. [2025-09-16T21:14:59.436571] [DEBUG] [LOCAL ] EIG: Loaded 15610 existing records from primary storage. [2025-09-16T21:14:59.453982] [INFO ] [MAIN ] Derivative Progress: 576/2026 symbols completed. EHC took 1.1s. Estimated remaining: 7m 52s. Rate: 184.2 symbols/min [2025-09-16T21:14:59.490141] [INFO ] [MAIN ] EIG: Loaded 15610 primary data records. [2025-09-16T21:14:59.517764] [INFO ] [MAIN ] EIX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:00.286984] [DEBUG] [LOCAL ] EIX: Loaded 39795 existing records from primary storage. [2025-09-16T21:15:00.287337] [INFO ] [MAIN ] EIX: Loaded 39795 primary data records. [2025-09-16T21:15:00.594348] [DEBUG] [MAIN ] EIC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:00.595685] [INFO ] [MAIN ] EIC: Generated 1339 derivative records from 17796 primary records. [2025-09-16T21:15:00.596163] [DEBUG] [LOCAL ] EIC: Saving derivative data. [2025-09-16T21:15:00.622162] [DEBUG] [MAIN ] EIG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:00.623001] [DEBUG] [LOCAL ] EIC: Derivative data saved (1339 records). [2025-09-16T21:15:00.623686] [INFO ] [MAIN ] EIC: Successfully saved derivative data. [2025-09-16T21:15:00.623586] [INFO ] [MAIN ] EIG: Generated 1339 derivative records from 15610 primary records. [2025-09-16T21:15:00.625462] [DEBUG] [LOCAL ] EIG: Saving derivative data. [2025-09-16T21:15:00.625407] [INFO ] [MAIN ] Derivative Progress: 577/2026 symbols completed. EIC took 1.3s. Estimated remaining: 7m 54s. Rate: 183.4 symbols/min [2025-09-16T21:15:00.626561] [INFO ] [MAIN ] EL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:00.639988] [DEBUG] [LOCAL ] EIG: Derivative data saved (1339 records). [2025-09-16T21:15:00.641454] [INFO ] [MAIN ] EIG: Successfully saved derivative data. [2025-09-16T21:15:00.644381] [INFO ] [MAIN ] Derivative Progress: 578/2026 symbols completed. EIG took 1.3s. Estimated remaining: 7m 53s. Rate: 183.7 symbols/min [2025-09-16T21:15:00.644724] [INFO ] [MAIN ] ELAN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:00.656056] [DEBUG] [MAIN ] EIX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:00.656844] [INFO ] [MAIN ] EIX: Generated 1339 derivative records from 39795 primary records. [2025-09-16T21:15:00.656945] [DEBUG] [LOCAL ] EIX: Saving derivative data. [2025-09-16T21:15:00.682822] [DEBUG] [LOCAL ] EIX: Derivative data saved (1339 records). [2025-09-16T21:15:00.682969] [INFO ] [MAIN ] EIX: Successfully saved derivative data. [2025-09-16T21:15:00.684890] [INFO ] [MAIN ] Derivative Progress: 579/2026 symbols completed. EIX took 1.2s. Estimated remaining: 7m 52s. Rate: 183.9 symbols/min [2025-09-16T21:15:00.685135] [INFO ] [MAIN ] ELC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:00.698066] [DEBUG] [LOCAL ] ELC: Loaded 2672 existing records from primary storage. [2025-09-16T21:15:00.698250] [INFO ] [MAIN ] ELC: Loaded 2672 primary data records. [2025-09-16T21:15:00.804215] [DEBUG] [LOCAL ] EL: Loaded 39892 existing records from primary storage. [2025-09-16T21:15:00.826802] [DEBUG] [LOCAL ] ELAN: Loaded 39704 existing records from primary storage. [2025-09-16T21:15:00.826045] [INFO ] [MAIN ] EL: Loaded 39892 primary data records. [2025-09-16T21:15:00.842443] [INFO ] [MAIN ] ELAN: Loaded 39704 primary data records. [2025-09-16T21:15:01.582286] [DEBUG] [MAIN ] ELC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:01.583351] [INFO ] [MAIN ] ELC: Generated 1339 derivative records from 2672 primary records. [2025-09-16T21:15:01.583763] [DEBUG] [LOCAL ] ELC: Saving derivative data. [2025-09-16T21:15:01.597243] [DEBUG] [LOCAL ] ELC: Derivative data saved (1339 records). [2025-09-16T21:15:01.597738] [INFO ] [MAIN ] ELC: Successfully saved derivative data. [2025-09-16T21:15:01.599408] [INFO ] [MAIN ] Derivative Progress: 580/2026 symbols completed. ELC took 0.9s. Estimated remaining: 7m 53s. Rate: 183.4 symbols/min [2025-09-16T21:15:01.599803] [INFO ] [MAIN ] ELF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:01.615110] [DEBUG] [MAIN ] EL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:01.616866] [INFO ] [MAIN ] EL: Generated 1339 derivative records from 39892 primary records. [2025-09-16T21:15:01.617817] [DEBUG] [LOCAL ] EL: Saving derivative data. [2025-09-16T21:15:01.639284] [DEBUG] [MAIN ] ELAN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:01.641506] [INFO ] [MAIN ] ELAN: Generated 1339 derivative records from 39704 primary records. [2025-09-16T21:15:01.642151] [DEBUG] [LOCAL ] ELAN: Saving derivative data. [2025-09-16T21:15:01.650506] [DEBUG] [LOCAL ] EL: Derivative data saved (1339 records). [2025-09-16T21:15:01.653872] [INFO ] [MAIN ] EL: Successfully saved derivative data. [2025-09-16T21:15:01.656319] [INFO ] [MAIN ] Derivative Progress: 581/2026 symbols completed. EL took 1.0s. Estimated remaining: 7m 52s. Rate: 183.6 symbols/min [2025-09-16T21:15:01.657758] [INFO ] [MAIN ] ELME: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:01.668952] [DEBUG] [LOCAL ] ELAN: Derivative data saved (1339 records). [2025-09-16T21:15:01.669503] [INFO ] [MAIN ] ELAN: Successfully saved derivative data. [2025-09-16T21:15:01.671770] [INFO ] [MAIN ] Derivative Progress: 582/2026 symbols completed. ELAN took 1.0s. Estimated remaining: 7m 51s. Rate: 183.9 symbols/min [2025-09-16T21:15:01.672292] [INFO ] [MAIN ] ELS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:01.690181] [DEBUG] [LOCAL ] ELF: Loaded 38878 existing records from primary storage. [2025-09-16T21:15:01.690511] [INFO ] [MAIN ] ELF: Loaded 38878 primary data records. [2025-09-16T21:15:01.857439] [DEBUG] [LOCAL ] ELME: Loaded 29238 existing records from primary storage. [2025-09-16T21:15:01.908602] [INFO ] [MAIN ] ELME: Loaded 29238 primary data records. [2025-09-16T21:15:02.054835] [DEBUG] [LOCAL ] ELS: Loaded 36880 existing records from primary storage. [2025-09-16T21:15:02.085745] [INFO ] [MAIN ] ELS: Loaded 36880 primary data records. [2025-09-16T21:15:02.696306] [DEBUG] [MAIN ] ELF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:02.697290] [INFO ] [MAIN ] ELF: Generated 1339 derivative records from 38878 primary records. [2025-09-16T21:15:02.698206] [DEBUG] [LOCAL ] ELF: Saving derivative data. [2025-09-16T21:15:02.712392] [DEBUG] [LOCAL ] ELF: Derivative data saved (1339 records). [2025-09-16T21:15:02.712504] [INFO ] [MAIN ] ELF: Successfully saved derivative data. [2025-09-16T21:15:02.714985] [INFO ] [MAIN ] Derivative Progress: 583/2026 symbols completed. ELF took 1.1s. Estimated remaining: 7m 52s. Rate: 183.2 symbols/min [2025-09-16T21:15:02.728545] [DEBUG] [MAIN ] ELME: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:02.729184] [INFO ] [MAIN ] ELME: Generated 1339 derivative records from 29238 primary records. [2025-09-16T21:15:02.729374] [DEBUG] [LOCAL ] ELME: Saving derivative data. [2025-09-16T21:15:02.743059] [DEBUG] [LOCAL ] ELME: Derivative data saved (1339 records). [2025-09-16T21:15:02.743166] [INFO ] [MAIN ] ELME: Successfully saved derivative data. [2025-09-16T21:15:02.745488] [INFO ] [MAIN ] Derivative Progress: 584/2026 symbols completed. ELME took 1.1s. Estimated remaining: 7m 51s. Rate: 183.5 symbols/min [2025-09-16T21:15:02.754930] [DEBUG] [MAIN ] ELS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:02.755495] [INFO ] [MAIN ] ELS: Generated 1339 derivative records from 36880 primary records. [2025-09-16T21:15:02.755556] [DEBUG] [LOCAL ] ELS: Saving derivative data. [2025-09-16T21:15:02.766974] [DEBUG] [LOCAL ] ELS: Derivative data saved (1339 records). [2025-09-16T21:15:02.767034] [INFO ] [MAIN ] ELS: Successfully saved derivative data. [2025-09-16T21:15:02.769338] [INFO ] [MAIN ] Derivative Progress: 585/2026 symbols completed. ELS took 1.1s. Estimated remaining: 7m 50s. Rate: 183.8 symbols/min [2025-09-16T21:15:02.769882] [INFO ] [MAIN ] EME: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:02.769794] [INFO ] [MAIN ] ELV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:02.770001] [INFO ] [MAIN ] EMD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:02.793851] [DEBUG] [LOCAL ] EMD: Loaded 15174 existing records from primary storage. [2025-09-16T21:15:02.794021] [INFO ] [MAIN ] EMD: Loaded 15174 primary data records. [2025-09-16T21:15:02.908392] [DEBUG] [LOCAL ] EME: Loaded 22441 existing records from primary storage. [2025-09-16T21:15:02.940450] [INFO ] [MAIN ] EME: Loaded 22441 primary data records. [2025-09-16T21:15:03.013042] [DEBUG] [LOCAL ] ELV: Loaded 37831 existing records from primary storage. [2025-09-16T21:15:03.066452] [INFO ] [MAIN ] ELV: Loaded 37831 primary data records. [2025-09-16T21:15:03.682208] [DEBUG] [MAIN ] EMD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:03.683133] [INFO ] [MAIN ] EMD: Generated 1339 derivative records from 15174 primary records. [2025-09-16T21:15:03.683327] [DEBUG] [LOCAL ] EMD: Saving derivative data. [2025-09-16T21:15:03.707725] [DEBUG] [LOCAL ] EMD: Derivative data saved (1339 records). [2025-09-16T21:15:03.707665] [DEBUG] [MAIN ] EME: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:03.707963] [INFO ] [MAIN ] EMD: Successfully saved derivative data. [2025-09-16T21:15:03.708537] [INFO ] [MAIN ] EME: Generated 1339 derivative records from 22441 primary records. [2025-09-16T21:15:03.709394] [DEBUG] [LOCAL ] EME: Saving derivative data. [2025-09-16T21:15:03.711774] [INFO ] [MAIN ] Derivative Progress: 586/2026 symbols completed. EMD took 0.9s. Estimated remaining: 7m 52s. Rate: 183.2 symbols/min [2025-09-16T21:15:03.713466] [INFO ] [MAIN ] EMN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:03.735519] [DEBUG] [LOCAL ] EME: Derivative data saved (1339 records). [2025-09-16T21:15:03.736016] [INFO ] [MAIN ] EME: Successfully saved derivative data. [2025-09-16T21:15:03.735895] [DEBUG] [MAIN ] ELV: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:03.738212] [INFO ] [MAIN ] Derivative Progress: 587/2026 symbols completed. EME took 1.0s. Estimated remaining: 7m 50s. Rate: 183.5 symbols/min [2025-09-16T21:15:03.738582] [INFO ] [MAIN ] EMO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:03.739333] [INFO ] [MAIN ] ELV: Generated 1339 derivative records from 37831 primary records. [2025-09-16T21:15:03.739457] [DEBUG] [LOCAL ] ELV: Saving derivative data. [2025-09-16T21:15:03.752341] [DEBUG] [LOCAL ] ELV: Derivative data saved (1339 records). [2025-09-16T21:15:03.752449] [INFO ] [MAIN ] ELV: Successfully saved derivative data. [2025-09-16T21:15:03.754433] [INFO ] [MAIN ] Derivative Progress: 588/2026 symbols completed. ELV took 1.0s. Estimated remaining: 7m 49s. Rate: 183.8 symbols/min [2025-09-16T21:15:03.756831] [INFO ] [MAIN ] EMP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:03.763113] [DEBUG] [LOCAL ] EMO: Loaded 9509 existing records from primary storage. [2025-09-16T21:15:03.763482] [INFO ] [MAIN ] EMO: Loaded 9509 primary data records. [2025-09-16T21:15:03.765476] [DEBUG] [LOCAL ] EMP: Loaded 2224 existing records from primary storage. [2025-09-16T21:15:03.777078] [INFO ] [MAIN ] EMP: Loaded 2224 primary data records. [2025-09-16T21:15:04.019196] [DEBUG] [LOCAL ] EMN: Loaded 37814 existing records from primary storage. [2025-09-16T21:15:04.056482] [INFO ] [MAIN ] EMN: Loaded 37814 primary data records. [2025-09-16T21:15:04.630729] [DEBUG] [MAIN ] EMO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:04.632677] [INFO ] [MAIN ] EMO: Generated 1339 derivative records from 9509 primary records. [2025-09-16T21:15:04.633038] [DEBUG] [LOCAL ] EMO: Saving derivative data. [2025-09-16T21:15:04.649043] [DEBUG] [MAIN ] EMP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:04.649888] [INFO ] [MAIN ] EMP: Generated 1339 derivative records from 2224 primary records. [2025-09-16T21:15:04.651033] [DEBUG] [LOCAL ] EMP: Saving derivative data. [2025-09-16T21:15:04.656855] [DEBUG] [LOCAL ] EMO: Derivative data saved (1339 records). [2025-09-16T21:15:04.657119] [INFO ] [MAIN ] EMO: Successfully saved derivative data. [2025-09-16T21:15:04.666405] [INFO ] [MAIN ] Derivative Progress: 589/2026 symbols completed. EMO took 0.9s. Estimated remaining: 7m 51s. Rate: 183.3 symbols/min [2025-09-16T21:15:04.667115] [INFO ] [MAIN ] ENB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:04.669111] [DEBUG] [LOCAL ] EMP: Derivative data saved (1339 records). [2025-09-16T21:15:04.669349] [INFO ] [MAIN ] EMP: Successfully saved derivative data. [2025-09-16T21:15:04.671486] [INFO ] [MAIN ] Derivative Progress: 590/2026 symbols completed. EMP took 0.9s. Estimated remaining: 7m 49s. Rate: 183.6 symbols/min [2025-09-16T21:15:04.673677] [INFO ] [MAIN ] EOD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:04.687233] [DEBUG] [MAIN ] EMN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:04.688048] [INFO ] [MAIN ] EMN: Generated 1339 derivative records from 37814 primary records. [2025-09-16T21:15:04.688193] [DEBUG] [LOCAL ] EMN: Saving derivative data. [2025-09-16T21:15:04.707709] [DEBUG] [LOCAL ] EOD: Loaded 10922 existing records from primary storage. [2025-09-16T21:15:04.709811] [INFO ] [MAIN ] EOD: Loaded 10922 primary data records. [2025-09-16T21:15:04.756271] [DEBUG] [LOCAL ] EMN: Derivative data saved (1339 records). [2025-09-16T21:15:04.782818] [INFO ] [MAIN ] EMN: Successfully saved derivative data. [2025-09-16T21:15:04.829370] [INFO ] [MAIN ] Derivative Progress: 591/2026 symbols completed. EMN took 1.1s. Estimated remaining: 7m 49s. Rate: 183.7 symbols/min [2025-09-16T21:15:04.830242] [INFO ] [MAIN ] EOG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:04.992733] [DEBUG] [LOCAL ] ENB: Loaded 39899 existing records from primary storage. [2025-09-16T21:15:05.038966] [INFO ] [MAIN ] ENB: Loaded 39899 primary data records. [2025-09-16T21:15:05.330699] [DEBUG] [LOCAL ] EOG: Loaded 39747 existing records from primary storage. [2025-09-16T21:15:05.330997] [INFO ] [MAIN ] EOG: Loaded 39747 primary data records. [2025-09-16T21:15:05.531506] [DEBUG] [MAIN ] EOD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:05.616941] [INFO ] [MAIN ] EOD: Generated 1339 derivative records from 10922 primary records. [2025-09-16T21:15:05.617588] [DEBUG] [LOCAL ] EOD: Saving derivative data. [2025-09-16T21:15:05.643145] [DEBUG] [MAIN ] ENB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:05.644285] [INFO ] [MAIN ] ENB: Generated 1339 derivative records from 39899 primary records. [2025-09-16T21:15:05.643614] [DEBUG] [LOCAL ] EOD: Derivative data saved (1339 records). [2025-09-16T21:15:05.644491] [DEBUG] [LOCAL ] ENB: Saving derivative data. [2025-09-16T21:15:05.644572] [INFO ] [MAIN ] EOD: Successfully saved derivative data. [2025-09-16T21:15:05.647903] [INFO ] [MAIN ] Derivative Progress: 592/2026 symbols completed. EOD took 1.0s. Estimated remaining: 7m 50s. Rate: 183.3 symbols/min [2025-09-16T21:15:05.648208] [INFO ] [MAIN ] EOI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:05.664401] [DEBUG] [LOCAL ] ENB: Derivative data saved (1339 records). [2025-09-16T21:15:05.667950] [DEBUG] [LOCAL ] EOI: Loaded 6949 existing records from primary storage. [2025-09-16T21:15:05.668015] [INFO ] [MAIN ] ENB: Successfully saved derivative data. [2025-09-16T21:15:05.668223] [INFO ] [MAIN ] EOI: Loaded 6949 primary data records. [2025-09-16T21:15:05.670472] [INFO ] [MAIN ] Derivative Progress: 593/2026 symbols completed. ENB took 1.0s. Estimated remaining: 7m 48s. Rate: 183.5 symbols/min [2025-09-16T21:15:05.670690] [INFO ] [MAIN ] EOT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:05.846714] [DEBUG] [MAIN ] EOG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:05.865404] [DEBUG] [LOCAL ] EOT: Loaded 5065 existing records from primary storage. [2025-09-16T21:15:05.941054] [INFO ] [MAIN ] EOT: Loaded 5065 primary data records. [2025-09-16T21:15:05.952867] [INFO ] [MAIN ] EOG: Generated 1339 derivative records from 39747 primary records. [2025-09-16T21:15:05.953464] [DEBUG] [LOCAL ] EOG: Saving derivative data. [2025-09-16T21:15:06.119589] [DEBUG] [LOCAL ] EOG: Derivative data saved (1339 records). [2025-09-16T21:15:06.143721] [INFO ] [MAIN ] EOG: Successfully saved derivative data. [2025-09-16T21:15:06.160848] [INFO ] [MAIN ] Derivative Progress: 594/2026 symbols completed. EOG took 1.3s. Estimated remaining: 7m 49s. Rate: 183.4 symbols/min [2025-09-16T21:15:06.235877] [INFO ] [MAIN ] EPAC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:06.269850] [DEBUG] [MAIN ] EOI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:06.271604] [INFO ] [MAIN ] EOI: Generated 1339 derivative records from 6949 primary records. [2025-09-16T21:15:06.271776] [DEBUG] [LOCAL ] EOI: Saving derivative data. [2025-09-16T21:15:06.288565] [DEBUG] [LOCAL ] EPAC: Loaded 19167 existing records from primary storage. [2025-09-16T21:15:06.291584] [DEBUG] [LOCAL ] EOI: Derivative data saved (1339 records). [2025-09-16T21:15:06.291908] [INFO ] [MAIN ] EOI: Successfully saved derivative data. [2025-09-16T21:15:06.291686] [INFO ] [MAIN ] EPAC: Loaded 19167 primary data records. [2025-09-16T21:15:06.304957] [INFO ] [MAIN ] Derivative Progress: 595/2026 symbols completed. EOI took 0.7s. Estimated remaining: 7m 48s. Rate: 183.6 symbols/min [2025-09-16T21:15:06.336033] [INFO ] [MAIN ] EPD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:06.486999] [DEBUG] [MAIN ] EOT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:06.580350] [INFO ] [MAIN ] EOT: Generated 1339 derivative records from 5065 primary records. [2025-09-16T21:15:06.580594] [DEBUG] [LOCAL ] EOT: Saving derivative data. [2025-09-16T21:15:06.595031] [DEBUG] [LOCAL ] EOT: Derivative data saved (1339 records). [2025-09-16T21:15:06.595494] [INFO ] [MAIN ] EOT: Successfully saved derivative data. [2025-09-16T21:15:06.598320] [INFO ] [MAIN ] Derivative Progress: 596/2026 symbols completed. EOT took 0.9s. Estimated remaining: 7m 47s. Rate: 183.6 symbols/min [2025-09-16T21:15:06.599220] [INFO ] [MAIN ] EPRT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:06.612830] [DEBUG] [LOCAL ] EPD: Loaded 39972 existing records from primary storage. [2025-09-16T21:15:06.614221] [INFO ] [MAIN ] EPD: Loaded 39972 primary data records. [2025-09-16T21:15:06.830170] [DEBUG] [LOCAL ] EPRT: Loaded 35910 existing records from primary storage. [2025-09-16T21:15:06.926385] [INFO ] [MAIN ] EPRT: Loaded 35910 primary data records. [2025-09-16T21:15:06.931078] [DEBUG] [MAIN ] EPAC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:06.969452] [INFO ] [MAIN ] EPAC: Generated 1339 derivative records from 19167 primary records. [2025-09-16T21:15:07.003421] [DEBUG] [LOCAL ] EPAC: Saving derivative data. [2025-09-16T21:15:07.138393] [DEBUG] [LOCAL ] EPAC: Derivative data saved (1339 records). [2025-09-16T21:15:07.202430] [INFO ] [MAIN ] EPAC: Successfully saved derivative data. [2025-09-16T21:15:07.270544] [INFO ] [MAIN ] Derivative Progress: 597/2026 symbols completed. EPAC took 1.1s. Estimated remaining: 7m 48s. Rate: 183.3 symbols/min [2025-09-16T21:15:07.271870] [INFO ] [MAIN ] EQBK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:07.293443] [DEBUG] [LOCAL ] EQBK: Loaded 8045 existing records from primary storage. [2025-09-16T21:15:07.293746] [DEBUG] [MAIN ] EPD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:07.293943] [INFO ] [MAIN ] EQBK: Loaded 8045 primary data records. [2025-09-16T21:15:07.294666] [INFO ] [MAIN ] EPD: Generated 1339 derivative records from 39972 primary records. [2025-09-16T21:15:07.327059] [DEBUG] [LOCAL ] EPD: Saving derivative data. [2025-09-16T21:15:07.414533] [DEBUG] [LOCAL ] EPD: Derivative data saved (1339 records). [2025-09-16T21:15:07.414940] [INFO ] [MAIN ] EPD: Successfully saved derivative data. [2025-09-16T21:15:07.427100] [INFO ] [MAIN ] Derivative Progress: 598/2026 symbols completed. EPD took 1.1s. Estimated remaining: 7m 47s. Rate: 183.4 symbols/min [2025-09-16T21:15:07.596928] [DEBUG] [MAIN ] EPRT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:07.597685] [INFO ] [MAIN ] EPRT: Generated 1339 derivative records from 35910 primary records. [2025-09-16T21:15:07.597846] [DEBUG] [LOCAL ] EPRT: Saving derivative data. [2025-09-16T21:15:07.611744] [DEBUG] [LOCAL ] EPRT: Derivative data saved (1339 records). [2025-09-16T21:15:07.611938] [INFO ] [MAIN ] EPRT: Successfully saved derivative data. [2025-09-16T21:15:07.614242] [INFO ] [MAIN ] Derivative Progress: 599/2026 symbols completed. EPRT took 1.0s. Estimated remaining: 7m 46s. Rate: 183.6 symbols/min [2025-09-16T21:15:07.630314] [DEBUG] [MAIN ] EQBK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:07.630901] [INFO ] [MAIN ] EQBK: Generated 1339 derivative records from 8045 primary records. [2025-09-16T21:15:07.630961] [DEBUG] [LOCAL ] EQBK: Saving derivative data. [2025-09-16T21:15:07.642255] [DEBUG] [LOCAL ] EQBK: Derivative data saved (1339 records). [2025-09-16T21:15:07.642313] [INFO ] [MAIN ] EQBK: Successfully saved derivative data. [2025-09-16T21:15:07.644098] [INFO ] [MAIN ] Derivative Progress: 600/2026 symbols completed. EQBK took 0.4s. Estimated remaining: 7m 45s. Rate: 183.8 symbols/min [2025-09-16T21:15:07.644515] [INFO ] [MAIN ] EQH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:07.644731] [INFO ] [MAIN ] EQT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:07.644653] [INFO ] [MAIN ] EQNR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:07.711615] [DEBUG] [LOCAL ] EQH: Loaded 39156 existing records from primary storage. [2025-09-16T21:15:07.711527] [DEBUG] [LOCAL ] EQT: Loaded 40035 existing records from primary storage. [2025-09-16T21:15:07.722943] [INFO ] [MAIN ] EQT: Loaded 40035 primary data records. [2025-09-16T21:15:07.723001] [INFO ] [MAIN ] EQH: Loaded 39156 primary data records. [2025-09-16T21:15:07.723631] [DEBUG] [LOCAL ] EQNR: Loaded 39521 existing records from primary storage. [2025-09-16T21:15:07.744247] [INFO ] [MAIN ] EQNR: Loaded 39521 primary data records. [2025-09-16T21:15:08.564342] [DEBUG] [MAIN ] EQH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:08.564724] [DEBUG] [MAIN ] EQT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:08.571078] [INFO ] [MAIN ] EQT: Generated 1339 derivative records from 40035 primary records. [2025-09-16T21:15:08.571564] [INFO ] [MAIN ] EQH: Generated 1339 derivative records from 39156 primary records. [2025-09-16T21:15:08.575661] [DEBUG] [LOCAL ] EQT: Saving derivative data. [2025-09-16T21:15:08.575600] [DEBUG] [LOCAL ] EQH: Saving derivative data. [2025-09-16T21:15:08.575553] [DEBUG] [MAIN ] EQNR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:08.577360] [INFO ] [MAIN ] EQNR: Generated 1339 derivative records from 39521 primary records. [2025-09-16T21:15:08.584530] [DEBUG] [LOCAL ] EQNR: Saving derivative data. [2025-09-16T21:15:08.614922] [DEBUG] [LOCAL ] EQH: Derivative data saved (1339 records). [2025-09-16T21:15:08.610959] [DEBUG] [LOCAL ] EQT: Derivative data saved (1339 records). [2025-09-16T21:15:08.615039] [INFO ] [MAIN ] EQH: Successfully saved derivative data. [2025-09-16T21:15:08.615880] [INFO ] [MAIN ] EQT: Successfully saved derivative data. [2025-09-16T21:15:08.619794] [INFO ] [MAIN ] Derivative Progress: 601/2026 symbols completed. EQT took 1.0s. Estimated remaining: 7m 47s. Rate: 183.2 symbols/min [2025-09-16T21:15:08.622088] [INFO ] [MAIN ] Derivative Progress: 602/2026 symbols completed. EQH took 1.0s. Estimated remaining: 7m 46s. Rate: 183.5 symbols/min [2025-09-16T21:15:08.617624] [DEBUG] [LOCAL ] EQNR: Derivative data saved (1339 records). [2025-09-16T21:15:08.622012] [INFO ] [MAIN ] ERJ: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:08.622314] [INFO ] [MAIN ] ERO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:08.622494] [INFO ] [MAIN ] EQNR: Successfully saved derivative data. [2025-09-16T21:15:08.624778] [INFO ] [MAIN ] Derivative Progress: 603/2026 symbols completed. EQNR took 1.0s. Estimated remaining: 7m 44s. Rate: 183.8 symbols/min [2025-09-16T21:15:08.624964] [INFO ] [MAIN ] ES: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:08.676917] [DEBUG] [LOCAL ] ES: Loaded 39171 existing records from primary storage. [2025-09-16T21:15:08.677151] [INFO ] [MAIN ] ES: Loaded 39171 primary data records. [2025-09-16T21:15:08.798051] [DEBUG] [LOCAL ] ERO: Loaded 30125 existing records from primary storage. [2025-09-16T21:15:08.809290] [DEBUG] [LOCAL ] ERJ: Loaded 37655 existing records from primary storage. [2025-09-16T21:15:08.808830] [INFO ] [MAIN ] ERO: Loaded 30125 primary data records. [2025-09-16T21:15:08.814625] [INFO ] [MAIN ] ERJ: Loaded 37655 primary data records. [2025-09-16T21:15:09.553697] [DEBUG] [MAIN ] ES: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:09.556083] [INFO ] [MAIN ] ES: Generated 1339 derivative records from 39171 primary records. [2025-09-16T21:15:09.556296] [DEBUG] [LOCAL ] ES: Saving derivative data. [2025-09-16T21:15:09.575743] [DEBUG] [MAIN ] ERO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:09.578872] [INFO ] [MAIN ] ERO: Generated 1339 derivative records from 30125 primary records. [2025-09-16T21:15:09.580057] [DEBUG] [LOCAL ] ERO: Saving derivative data. [2025-09-16T21:15:09.582530] [DEBUG] [LOCAL ] ES: Derivative data saved (1339 records). [2025-09-16T21:15:09.599556] [DEBUG] [MAIN ] ERJ: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:09.605286] [DEBUG] [LOCAL ] ERO: Derivative data saved (1339 records). [2025-09-16T21:15:09.606074] [INFO ] [MAIN ] ERJ: Generated 1339 derivative records from 37655 primary records. [2025-09-16T21:15:09.602460] [INFO ] [MAIN ] ES: Successfully saved derivative data. [2025-09-16T21:15:09.606171] [DEBUG] [LOCAL ] ERJ: Saving derivative data. [2025-09-16T21:15:09.606220] [INFO ] [MAIN ] ERO: Successfully saved derivative data. [2025-09-16T21:15:09.607624] [INFO ] [MAIN ] Derivative Progress: 604/2026 symbols completed. ES took 1.0s. Estimated remaining: 7m 46s. Rate: 183.2 symbols/min [2025-09-16T21:15:09.608617] [INFO ] [MAIN ] ESE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:09.610689] [INFO ] [MAIN ] Derivative Progress: 605/2026 symbols completed. ERO took 1.0s. Estimated remaining: 7m 45s. Rate: 183.5 symbols/min [2025-09-16T21:15:09.620728] [INFO ] [MAIN ] ESI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:09.625686] [DEBUG] [LOCAL ] ERJ: Derivative data saved (1339 records). [2025-09-16T21:15:09.625837] [INFO ] [MAIN ] ERJ: Successfully saved derivative data. [2025-09-16T21:15:09.628736] [INFO ] [MAIN ] Derivative Progress: 606/2026 symbols completed. ERJ took 1.0s. Estimated remaining: 7m 44s. Rate: 183.8 symbols/min [2025-09-16T21:15:09.629145] [INFO ] [MAIN ] ESNT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:09.643792] [DEBUG] [LOCAL ] ESE: Loaded 12263 existing records from primary storage. [2025-09-16T21:15:09.644141] [INFO ] [MAIN ] ESE: Loaded 12263 primary data records. [2025-09-16T21:15:09.838948] [DEBUG] [LOCAL ] ESI: Loaded 37431 existing records from primary storage. [2025-09-16T21:15:09.847389] [INFO ] [MAIN ] ESI: Loaded 37431 primary data records. [2025-09-16T21:15:09.885277] [DEBUG] [LOCAL ] ESNT: Loaded 28016 existing records from primary storage. [2025-09-16T21:15:09.945086] [INFO ] [MAIN ] ESNT: Loaded 28016 primary data records. [2025-09-16T21:15:10.521982] [DEBUG] [MAIN ] ESE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:10.523146] [INFO ] [MAIN ] ESE: Generated 1339 derivative records from 12263 primary records. [2025-09-16T21:15:10.523328] [DEBUG] [LOCAL ] ESE: Saving derivative data. [2025-09-16T21:15:10.539633] [DEBUG] [LOCAL ] ESE: Derivative data saved (1339 records). [2025-09-16T21:15:10.539916] [INFO ] [MAIN ] ESE: Successfully saved derivative data. [2025-09-16T21:15:10.551032] [INFO ] [MAIN ] Derivative Progress: 607/2026 symbols completed. ESE took 0.9s. Estimated remaining: 7m 45s. Rate: 183.3 symbols/min [2025-09-16T21:15:10.551533] [INFO ] [MAIN ] ESRT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:10.551234] [DEBUG] [MAIN ] ESI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:10.552574] [INFO ] [MAIN ] ESI: Generated 1339 derivative records from 37431 primary records. [2025-09-16T21:15:10.553007] [DEBUG] [LOCAL ] ESI: Saving derivative data. [2025-09-16T21:15:10.565875] [DEBUG] [LOCAL ] ESI: Derivative data saved (1339 records). [2025-09-16T21:15:10.566021] [INFO ] [MAIN ] ESI: Successfully saved derivative data. [2025-09-16T21:15:10.567907] [INFO ] [MAIN ] Derivative Progress: 608/2026 symbols completed. ESI took 0.9s. Estimated remaining: 7m 44s. Rate: 183.5 symbols/min [2025-09-16T21:15:10.570040] [INFO ] [MAIN ] ESS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:10.580257] [DEBUG] [MAIN ] ESNT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:10.580925] [INFO ] [MAIN ] ESNT: Generated 1339 derivative records from 28016 primary records. [2025-09-16T21:15:10.580998] [DEBUG] [LOCAL ] ESNT: Saving derivative data. [2025-09-16T21:15:10.593302] [DEBUG] [LOCAL ] ESNT: Derivative data saved (1339 records). [2025-09-16T21:15:10.593443] [INFO ] [MAIN ] ESNT: Successfully saved derivative data. [2025-09-16T21:15:10.595738] [INFO ] [MAIN ] Derivative Progress: 609/2026 symbols completed. ESNT took 1.0s. Estimated remaining: 7m 43s. Rate: 183.8 symbols/min [2025-09-16T21:15:10.604685] [INFO ] [MAIN ] ESTC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:10.622164] [DEBUG] [LOCAL ] ESRT: Loaded 34466 existing records from primary storage. [2025-09-16T21:15:10.622371] [INFO ] [MAIN ] ESRT: Loaded 34466 primary data records. [2025-09-16T21:15:10.672757] [DEBUG] [LOCAL ] ESS: Loaded 22109 existing records from primary storage. [2025-09-16T21:15:10.705614] [INFO ] [MAIN ] ESS: Loaded 22109 primary data records. [2025-09-16T21:15:10.982443] [DEBUG] [LOCAL ] ESTC: Loaded 37574 existing records from primary storage. [2025-09-16T21:15:11.165687] [INFO ] [MAIN ] ESTC: Loaded 37574 primary data records. [2025-09-16T21:15:11.478603] [DEBUG] [MAIN ] ESS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:11.479979] [INFO ] [MAIN ] ESS: Generated 1339 derivative records from 22109 primary records. [2025-09-16T21:15:11.479176] [DEBUG] [MAIN ] ESRT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:11.480273] [DEBUG] [LOCAL ] ESS: Saving derivative data. [2025-09-16T21:15:11.481373] [INFO ] [MAIN ] ESRT: Generated 1339 derivative records from 34466 primary records. [2025-09-16T21:15:11.481978] [DEBUG] [LOCAL ] ESRT: Saving derivative data. [2025-09-16T21:15:11.505072] [DEBUG] [LOCAL ] ESRT: Derivative data saved (1339 records). [2025-09-16T21:15:11.505609] [INFO ] [MAIN ] ESRT: Successfully saved derivative data. [2025-09-16T21:15:11.507344] [INFO ] [MAIN ] Derivative Progress: 610/2026 symbols completed. ESRT took 1.0s. Estimated remaining: 7m 44s. Rate: 183.3 symbols/min [2025-09-16T21:15:11.508679] [INFO ] [MAIN ] ETB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:11.510960] [DEBUG] [LOCAL ] ESS: Derivative data saved (1339 records). [2025-09-16T21:15:11.511870] [INFO ] [MAIN ] ESS: Successfully saved derivative data. [2025-09-16T21:15:11.513806] [INFO ] [MAIN ] Derivative Progress: 611/2026 symbols completed. ESS took 0.9s. Estimated remaining: 7m 42s. Rate: 183.6 symbols/min [2025-09-16T21:15:11.514111] [INFO ] [MAIN ] ETD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:11.524324] [DEBUG] [MAIN ] ESTC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:11.525200] [INFO ] [MAIN ] ESTC: Generated 1339 derivative records from 37574 primary records. [2025-09-16T21:15:11.525404] [DEBUG] [LOCAL ] ESTC: Saving derivative data. [2025-09-16T21:15:11.540112] [DEBUG] [LOCAL ] ESTC: Derivative data saved (1339 records). [2025-09-16T21:15:11.543949] [INFO ] [MAIN ] ESTC: Successfully saved derivative data. [2025-09-16T21:15:11.547010] [INFO ] [MAIN ] Derivative Progress: 612/2026 symbols completed. ESTC took 0.9s. Estimated remaining: 7m 41s. Rate: 183.8 symbols/min [2025-09-16T21:15:11.544365] [DEBUG] [LOCAL ] ETB: Loaded 8126 existing records from primary storage. [2025-09-16T21:15:11.547413] [INFO ] [MAIN ] ETN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:11.547476] [INFO ] [MAIN ] ETB: Loaded 8126 primary data records. [2025-09-16T21:15:11.666984] [DEBUG] [LOCAL ] ETD: Loaded 20572 existing records from primary storage. [2025-09-16T21:15:11.677829] [INFO ] [MAIN ] ETD: Loaded 20572 primary data records. [2025-09-16T21:15:12.004009] [DEBUG] [LOCAL ] ETN: Loaded 39261 existing records from primary storage. [2025-09-16T21:15:12.054540] [INFO ] [MAIN ] ETN: Loaded 39261 primary data records. [2025-09-16T21:15:12.437393] [DEBUG] [MAIN ] ETB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:12.438409] [INFO ] [MAIN ] ETB: Generated 1339 derivative records from 8126 primary records. [2025-09-16T21:15:12.438724] [DEBUG] [LOCAL ] ETB: Saving derivative data. [2025-09-16T21:15:12.455948] [DEBUG] [LOCAL ] ETB: Derivative data saved (1339 records). [2025-09-16T21:15:12.456202] [INFO ] [MAIN ] ETB: Successfully saved derivative data. [2025-09-16T21:15:12.466028] [DEBUG] [MAIN ] ETD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:12.467761] [INFO ] [MAIN ] Derivative Progress: 613/2026 symbols completed. ETB took 1.0s. Estimated remaining: 7m 43s. Rate: 183.3 symbols/min [2025-09-16T21:15:12.468834] [INFO ] [MAIN ] ETD: Generated 1339 derivative records from 20572 primary records. [2025-09-16T21:15:12.469042] [DEBUG] [LOCAL ] ETD: Saving derivative data. [2025-09-16T21:15:12.481926] [DEBUG] [LOCAL ] ETD: Derivative data saved (1339 records). [2025-09-16T21:15:12.482153] [INFO ] [MAIN ] ETD: Successfully saved derivative data. [2025-09-16T21:15:12.483980] [INFO ] [MAIN ] Derivative Progress: 614/2026 symbols completed. ETD took 1.0s. Estimated remaining: 7m 41s. Rate: 183.6 symbols/min [2025-09-16T21:15:12.496223] [DEBUG] [MAIN ] ETN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:12.496818] [INFO ] [MAIN ] ETN: Generated 1339 derivative records from 39261 primary records. [2025-09-16T21:15:12.496881] [DEBUG] [LOCAL ] ETN: Saving derivative data. [2025-09-16T21:15:12.509013] [DEBUG] [LOCAL ] ETN: Derivative data saved (1339 records). [2025-09-16T21:15:12.509080] [INFO ] [MAIN ] ETN: Successfully saved derivative data. [2025-09-16T21:15:12.511409] [INFO ] [MAIN ] Derivative Progress: 615/2026 symbols completed. ETN took 1.0s. Estimated remaining: 7m 40s. Rate: 183.9 symbols/min [2025-09-16T21:15:12.511998] [INFO ] [MAIN ] ETO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:12.512338] [INFO ] [MAIN ] ETV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:12.512126] [INFO ] [MAIN ] ETR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:12.520833] [DEBUG] [LOCAL ] ETO: Loaded 4864 existing records from primary storage. [2025-09-16T21:15:12.521003] [INFO ] [MAIN ] ETO: Loaded 4864 primary data records. [2025-09-16T21:15:12.645775] [DEBUG] [LOCAL ] ETV: Loaded 15040 existing records from primary storage. [2025-09-16T21:15:12.646018] [INFO ] [MAIN ] ETV: Loaded 15040 primary data records. [2025-09-16T21:15:12.939262] [DEBUG] [LOCAL ] ETR: Loaded 39652 existing records from primary storage. [2025-09-16T21:15:12.950666] [INFO ] [MAIN ] ETR: Loaded 39652 primary data records. [2025-09-16T21:15:13.387039] [DEBUG] [MAIN ] ETO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:13.388382] [INFO ] [MAIN ] ETO: Generated 1339 derivative records from 4864 primary records. [2025-09-16T21:15:13.388504] [DEBUG] [LOCAL ] ETO: Saving derivative data. [2025-09-16T21:15:13.404100] [DEBUG] [LOCAL ] ETO: Derivative data saved (1339 records). [2025-09-16T21:15:13.404340] [INFO ] [MAIN ] ETO: Successfully saved derivative data. [2025-09-16T21:15:13.406108] [INFO ] [MAIN ] Derivative Progress: 616/2026 symbols completed. ETO took 0.9s. Estimated remaining: 7m 41s. Rate: 183.3 symbols/min [2025-09-16T21:15:13.411934] [INFO ] [MAIN ] ETW: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:13.417014] [DEBUG] [MAIN ] ETV: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:13.418001] [INFO ] [MAIN ] ETV: Generated 1339 derivative records from 15040 primary records. [2025-09-16T21:15:13.418295] [DEBUG] [LOCAL ] ETV: Saving derivative data. [2025-09-16T21:15:13.433449] [DEBUG] [LOCAL ] ETV: Derivative data saved (1339 records). [2025-09-16T21:15:13.433619] [INFO ] [MAIN ] ETV: Successfully saved derivative data. [2025-09-16T21:15:13.440885] [INFO ] [MAIN ] Derivative Progress: 617/2026 symbols completed. ETV took 0.9s. Estimated remaining: 7m 40s. Rate: 183.6 symbols/min [2025-09-16T21:15:13.441283] [INFO ] [MAIN ] ETX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:13.451746] [DEBUG] [MAIN ] ETR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:13.460473] [DEBUG] [LOCAL ] ETW: Loaded 18084 existing records from primary storage. [2025-09-16T21:15:13.460076] [INFO ] [MAIN ] ETR: Generated 1339 derivative records from 39652 primary records. [2025-09-16T21:15:13.460736] [INFO ] [MAIN ] ETW: Loaded 18084 primary data records. [2025-09-16T21:15:13.460784] [DEBUG] [LOCAL ] ETR: Saving derivative data. [2025-09-16T21:15:13.463610] [DEBUG] [LOCAL ] ETX: Loaded 4122 existing records from primary storage. [2025-09-16T21:15:13.464230] [INFO ] [MAIN ] ETX: Loaded 4122 primary data records. [2025-09-16T21:15:13.756204] [DEBUG] [LOCAL ] ETR: Derivative data saved (1339 records). [2025-09-16T21:15:13.817522] [INFO ] [MAIN ] ETR: Successfully saved derivative data. [2025-09-16T21:15:13.824193] [INFO ] [MAIN ] Derivative Progress: 618/2026 symbols completed. ETR took 1.3s. Estimated remaining: 7m 40s. Rate: 183.6 symbols/min [2025-09-16T21:15:13.827521] [INFO ] [MAIN ] ETY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:14.073743] [DEBUG] [LOCAL ] ETY: Loaded 16334 existing records from primary storage. [2025-09-16T21:15:14.074040] [INFO ] [MAIN ] ETY: Loaded 16334 primary data records. [2025-09-16T21:15:14.220936] [DEBUG] [MAIN ] ETW: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:14.248830] [INFO ] [MAIN ] ETW: Generated 1339 derivative records from 18084 primary records. [2025-09-16T21:15:14.275279] [DEBUG] [LOCAL ] ETW: Saving derivative data. [2025-09-16T21:15:14.371873] [DEBUG] [LOCAL ] ETW: Derivative data saved (1339 records). [2025-09-16T21:15:14.372268] [INFO ] [MAIN ] ETW: Successfully saved derivative data. [2025-09-16T21:15:14.373971] [INFO ] [MAIN ] Derivative Progress: 619/2026 symbols completed. ETW took 1.0s. Estimated remaining: 7m 40s. Rate: 183.4 symbols/min [2025-09-16T21:15:14.374240] [INFO ] [MAIN ] EVF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:14.384592] [DEBUG] [MAIN ] ETX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:14.385388] [INFO ] [MAIN ] ETX: Generated 1339 derivative records from 4122 primary records. [2025-09-16T21:15:14.385788] [DEBUG] [LOCAL ] ETX: Saving derivative data. [2025-09-16T21:15:14.399675] [DEBUG] [LOCAL ] ETX: Derivative data saved (1339 records). [2025-09-16T21:15:14.402821] [INFO ] [MAIN ] ETX: Successfully saved derivative data. [2025-09-16T21:15:14.405036] [INFO ] [MAIN ] Derivative Progress: 620/2026 symbols completed. ETX took 1.0s. Estimated remaining: 7m 39s. Rate: 183.6 symbols/min [2025-09-16T21:15:14.405235] [INFO ] [MAIN ] EVG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:14.402978] [DEBUG] [LOCAL ] EVF: Loaded 6450 existing records from primary storage. [2025-09-16T21:15:14.405988] [INFO ] [MAIN ] EVF: Loaded 6450 primary data records. [2025-09-16T21:15:14.490342] [DEBUG] [LOCAL ] EVG: Loaded 4332 existing records from primary storage. [2025-09-16T21:15:14.496876] [INFO ] [MAIN ] EVG: Loaded 4332 primary data records. [2025-09-16T21:15:14.668755] [DEBUG] [MAIN ] ETY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:14.703873] [INFO ] [MAIN ] ETY: Generated 1339 derivative records from 16334 primary records. [2025-09-16T21:15:14.787539] [DEBUG] [LOCAL ] ETY: Saving derivative data. [2025-09-16T21:15:14.958255] [DEBUG] [LOCAL ] ETY: Derivative data saved (1339 records). [2025-09-16T21:15:14.959039] [INFO ] [MAIN ] ETY: Successfully saved derivative data. [2025-09-16T21:15:14.961092] [INFO ] [MAIN ] Derivative Progress: 621/2026 symbols completed. ETY took 1.1s. Estimated remaining: 7m 40s. Rate: 183.4 symbols/min [2025-09-16T21:15:14.961374] [INFO ] [MAIN ] EVN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:14.975672] [DEBUG] [LOCAL ] EVN: Loaded 7786 existing records from primary storage. [2025-09-16T21:15:14.976564] [INFO ] [MAIN ] EVN: Loaded 7786 primary data records. [2025-09-16T21:15:15.039289] [DEBUG] [MAIN ] EVF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:15.066065] [INFO ] [MAIN ] EVF: Generated 1339 derivative records from 6450 primary records. [2025-09-16T21:15:15.079184] [DEBUG] [LOCAL ] EVF: Saving derivative data. [2025-09-16T21:15:15.079109] [DEBUG] [MAIN ] EVG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:15.117354] [INFO ] [MAIN ] EVG: Generated 1339 derivative records from 4332 primary records. [2025-09-16T21:15:15.118852] [DEBUG] [LOCAL ] EVG: Saving derivative data. [2025-09-16T21:15:15.205731] [DEBUG] [LOCAL ] EVF: Derivative data saved (1339 records). [2025-09-16T21:15:15.206436] [DEBUG] [LOCAL ] EVG: Derivative data saved (1339 records). [2025-09-16T21:15:15.209220] [INFO ] [MAIN ] EVF: Successfully saved derivative data. [2025-09-16T21:15:15.211111] [INFO ] [MAIN ] EVG: Successfully saved derivative data. [2025-09-16T21:15:15.211054] [INFO ] [MAIN ] Derivative Progress: 622/2026 symbols completed. EVF took 0.8s. Estimated remaining: 7m 39s. Rate: 183.5 symbols/min [2025-09-16T21:15:15.298715] [INFO ] [MAIN ] Derivative Progress: 623/2026 symbols completed. EVG took 0.9s. Estimated remaining: 7m 38s. Rate: 183.7 symbols/min [2025-09-16T21:15:15.298545] [INFO ] [MAIN ] EVR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:15.298888] [INFO ] [MAIN ] EVT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:15.314756] [DEBUG] [LOCAL ] EVT: Loaded 12703 existing records from primary storage. [2025-09-16T21:15:15.315098] [INFO ] [MAIN ] EVT: Loaded 12703 primary data records. [2025-09-16T21:15:15.448621] [DEBUG] [LOCAL ] EVR: Loaded 25174 existing records from primary storage. [2025-09-16T21:15:15.454363] [INFO ] [MAIN ] EVR: Loaded 25174 primary data records. [2025-09-16T21:15:15.553405] [DEBUG] [MAIN ] EVN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:15.652563] [INFO ] [MAIN ] EVN: Generated 1339 derivative records from 7786 primary records. [2025-09-16T21:15:15.691113] [DEBUG] [LOCAL ] EVN: Saving derivative data. [2025-09-16T21:15:15.803299] [DEBUG] [LOCAL ] EVN: Derivative data saved (1339 records). [2025-09-16T21:15:15.808552] [INFO ] [MAIN ] EVN: Successfully saved derivative data. [2025-09-16T21:15:15.896936] [INFO ] [MAIN ] Derivative Progress: 624/2026 symbols completed. EVN took 0.9s. Estimated remaining: 7m 39s. Rate: 183.5 symbols/min [2025-09-16T21:15:15.897425] [INFO ] [MAIN ] EVTC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:15.916313] [DEBUG] [MAIN ] EVT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:15.917085] [INFO ] [MAIN ] EVT: Generated 1339 derivative records from 12703 primary records. [2025-09-16T21:15:15.917242] [DEBUG] [LOCAL ] EVT: Saving derivative data. [2025-09-16T21:15:15.939561] [DEBUG] [LOCAL ] EVT: Derivative data saved (1339 records). [2025-09-16T21:15:15.940293] [INFO ] [MAIN ] EVT: Successfully saved derivative data. [2025-09-16T21:15:15.942387] [INFO ] [MAIN ] Derivative Progress: 625/2026 symbols completed. EVT took 0.6s. Estimated remaining: 7m 38s. Rate: 183.7 symbols/min [2025-09-16T21:15:15.942835] [INFO ] [MAIN ] EVTL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:15.951803] [DEBUG] [LOCAL ] EVTC: Loaded 19478 existing records from primary storage. [2025-09-16T21:15:15.953870] [INFO ] [MAIN ] EVTC: Loaded 19478 primary data records. [2025-09-16T21:15:16.025124] [DEBUG] [MAIN ] EVR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:16.048772] [INFO ] [MAIN ] EVR: Generated 1339 derivative records from 25174 primary records. [2025-09-16T21:15:16.074484] [DEBUG] [LOCAL ] EVR: Saving derivative data. [2025-09-16T21:15:16.141226] [DEBUG] [LOCAL ] EVR: Derivative data saved (1339 records). [2025-09-16T21:15:16.165362] [INFO ] [MAIN ] EVR: Successfully saved derivative data. [2025-09-16T21:15:16.166933] [DEBUG] [LOCAL ] EVTL: Loaded 30107 existing records from primary storage. [2025-09-16T21:15:16.169635] [INFO ] [MAIN ] Derivative Progress: 626/2026 symbols completed. EVR took 0.9s. Estimated remaining: 7m 37s. Rate: 183.8 symbols/min [2025-09-16T21:15:16.189706] [INFO ] [MAIN ] EVTL: Loaded 30107 primary data records. [2025-09-16T21:15:16.189886] [INFO ] [MAIN ] EVTR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:16.477831] [DEBUG] [LOCAL ] EVTR: Loaded 17483 existing records from primary storage. [2025-09-16T21:15:16.504760] [INFO ] [MAIN ] EVTR: Loaded 17483 primary data records. [2025-09-16T21:15:16.793324] [DEBUG] [MAIN ] EVTC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:16.879369] [INFO ] [MAIN ] EVTC: Generated 1339 derivative records from 19478 primary records. [2025-09-16T21:15:16.880171] [DEBUG] [LOCAL ] EVTC: Saving derivative data. [2025-09-16T21:15:16.895659] [DEBUG] [LOCAL ] EVTC: Derivative data saved (1339 records). [2025-09-16T21:15:16.896180] [INFO ] [MAIN ] EVTC: Successfully saved derivative data. [2025-09-16T21:15:16.897897] [INFO ] [MAIN ] Derivative Progress: 627/2026 symbols completed. EVTC took 1.0s. Estimated remaining: 7m 38s. Rate: 183.4 symbols/min [2025-09-16T21:15:16.900369] [INFO ] [MAIN ] EW: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:16.913287] [DEBUG] [MAIN ] EVTL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:16.914241] [INFO ] [MAIN ] EVTL: Generated 1339 derivative records from 30107 primary records. [2025-09-16T21:15:16.914441] [DEBUG] [LOCAL ] EVTL: Saving derivative data. [2025-09-16T21:15:16.929113] [DEBUG] [LOCAL ] EVTL: Derivative data saved (1339 records). [2025-09-16T21:15:16.929230] [INFO ] [MAIN ] EVTL: Successfully saved derivative data. [2025-09-16T21:15:16.931324] [INFO ] [MAIN ] Derivative Progress: 628/2026 symbols completed. EVTL took 1.0s. Estimated remaining: 7m 37s. Rate: 183.7 symbols/min [2025-09-16T21:15:16.943815] [DEBUG] [MAIN ] EVTR: Filtered 5181 bins outside market hours, 5780 incomplete bins [2025-09-16T21:15:16.945262] [INFO ] [MAIN ] EVTR: Generated 1338 derivative records from 17483 primary records. [2025-09-16T21:15:16.945339] [DEBUG] [LOCAL ] EVTR: Saving derivative data. [2025-09-16T21:15:16.965903] [DEBUG] [LOCAL ] EVTR: Derivative data saved (1338 records). [2025-09-16T21:15:16.966008] [INFO ] [MAIN ] EVTR: Successfully saved derivative data. [2025-09-16T21:15:16.967920] [INFO ] [MAIN ] Derivative Progress: 629/2026 symbols completed. EVTR took 0.8s. Estimated remaining: 7m 36s. Rate: 184.0 symbols/min [2025-09-16T21:15:16.981789] [DEBUG] [LOCAL ] EW: Loaded 39779 existing records from primary storage. [2025-09-16T21:15:16.981888] [INFO ] [MAIN ] EW: Loaded 39779 primary data records. [2025-09-16T21:15:17.260230] [DEBUG] [MAIN ] EW: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:17.260874] [INFO ] [MAIN ] EW: Generated 1339 derivative records from 39779 primary records. [2025-09-16T21:15:17.260937] [DEBUG] [LOCAL ] EW: Saving derivative data. [2025-09-16T21:15:17.272288] [DEBUG] [LOCAL ] EW: Derivative data saved (1339 records). [2025-09-16T21:15:17.272345] [INFO ] [MAIN ] EW: Successfully saved derivative data. [2025-09-16T21:15:17.273924] [INFO ] [MAIN ] Derivative Progress: 630/2026 symbols completed. EW took 0.4s. Estimated remaining: 7m 35s. Rate: 184.0 symbols/min [2025-09-16T21:15:17.274957] [INFO ] [MAIN ] EXG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:17.275049] [INFO ] [MAIN ] EXR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:17.275259] [INFO ] [MAIN ] EXPD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:17.319544] [DEBUG] [LOCAL ] EXG: Loaded 25052 existing records from primary storage. [2025-09-16T21:15:17.328912] [INFO ] [MAIN ] EXG: Loaded 25052 primary data records. [2025-09-16T21:15:17.335838] [DEBUG] [LOCAL ] EXPD: Loaded 35628 existing records from primary storage. [2025-09-16T21:15:17.353681] [INFO ] [MAIN ] EXPD: Loaded 35628 primary data records. [2025-09-16T21:15:17.544824] [DEBUG] [LOCAL ] EXR: Loaded 33814 existing records from primary storage. [2025-09-16T21:15:17.562138] [INFO ] [MAIN ] EXR: Loaded 33814 primary data records. [2025-09-16T21:15:18.180389] [DEBUG] [MAIN ] EXPD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:18.181108] [INFO ] [MAIN ] EXPD: Generated 1339 derivative records from 35628 primary records. [2025-09-16T21:15:18.181531] [DEBUG] [LOCAL ] EXPD: Saving derivative data. [2025-09-16T21:15:18.198310] [DEBUG] [MAIN ] EXG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:18.204141] [DEBUG] [LOCAL ] EXPD: Derivative data saved (1339 records). [2025-09-16T21:15:18.202516] [INFO ] [MAIN ] EXG: Generated 1339 derivative records from 25052 primary records. [2025-09-16T21:15:18.204367] [INFO ] [MAIN ] EXPD: Successfully saved derivative data. [2025-09-16T21:15:18.206291] [INFO ] [MAIN ] Derivative Progress: 631/2026 symbols completed. EXPD took 0.9s. Estimated remaining: 7m 36s. Rate: 183.4 symbols/min [2025-09-16T21:15:18.206480] [INFO ] [MAIN ] F: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:18.204422] [DEBUG] [LOCAL ] EXG: Saving derivative data. [2025-09-16T21:15:18.221449] [DEBUG] [LOCAL ] EXG: Derivative data saved (1339 records). [2025-09-16T21:15:18.230891] [INFO ] [MAIN ] EXG: Successfully saved derivative data. [2025-09-16T21:15:18.233224] [INFO ] [MAIN ] Derivative Progress: 632/2026 symbols completed. EXG took 1.0s. Estimated remaining: 7m 35s. Rate: 183.7 symbols/min [2025-09-16T21:15:18.231195] [DEBUG] [MAIN ] EXR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:18.233496] [INFO ] [MAIN ] FBIN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:18.234162] [INFO ] [MAIN ] EXR: Generated 1339 derivative records from 33814 primary records. [2025-09-16T21:15:18.234528] [DEBUG] [LOCAL ] EXR: Saving derivative data. [2025-09-16T21:15:18.248204] [DEBUG] [LOCAL ] EXR: Derivative data saved (1339 records). [2025-09-16T21:15:18.248439] [INFO ] [MAIN ] EXR: Successfully saved derivative data. [2025-09-16T21:15:18.250234] [INFO ] [MAIN ] Derivative Progress: 633/2026 symbols completed. EXR took 1.0s. Estimated remaining: 7m 34s. Rate: 184.0 symbols/min [2025-09-16T21:15:18.250520] [INFO ] [MAIN ] FBK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:18.311254] [DEBUG] [LOCAL ] F: Loaded 40170 existing records from primary storage. [2025-09-16T21:15:18.312456] [DEBUG] [LOCAL ] FBK: Loaded 19358 existing records from primary storage. [2025-09-16T21:15:18.312582] [INFO ] [MAIN ] F: Loaded 40170 primary data records. [2025-09-16T21:15:18.312702] [INFO ] [MAIN ] FBK: Loaded 19358 primary data records. [2025-09-16T21:15:18.318549] [DEBUG] [LOCAL ] FBIN: Loaded 37713 existing records from primary storage. [2025-09-16T21:15:18.358675] [INFO ] [MAIN ] FBIN: Loaded 37713 primary data records. [2025-09-16T21:15:19.175559] [DEBUG] [MAIN ] F: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:19.177021] [INFO ] [MAIN ] F: Generated 1339 derivative records from 40170 primary records. [2025-09-16T21:15:19.177239] [DEBUG] [LOCAL ] F: Saving derivative data. [2025-09-16T21:15:19.188074] [DEBUG] [MAIN ] FBK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:19.190013] [INFO ] [MAIN ] FBK: Generated 1339 derivative records from 19358 primary records. [2025-09-16T21:15:19.190578] [DEBUG] [LOCAL ] FBK: Saving derivative data. [2025-09-16T21:15:19.223490] [DEBUG] [LOCAL ] FBK: Derivative data saved (1339 records). [2025-09-16T21:15:19.224995] [INFO ] [MAIN ] FBK: Successfully saved derivative data. [2025-09-16T21:15:19.227351] [INFO ] [MAIN ] Derivative Progress: 634/2026 symbols completed. FBK took 1.0s. Estimated remaining: 7m 35s. Rate: 183.4 symbols/min [2025-09-16T21:15:19.224912] [DEBUG] [LOCAL ] F: Derivative data saved (1339 records). [2025-09-16T21:15:19.227593] [DEBUG] [MAIN ] FBIN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:19.227775] [INFO ] [MAIN ] F: Successfully saved derivative data. [2025-09-16T21:15:19.230350] [INFO ] [MAIN ] Derivative Progress: 635/2026 symbols completed. F took 1.0s. Estimated remaining: 7m 34s. Rate: 183.7 symbols/min [2025-09-16T21:15:19.228468] [INFO ] [MAIN ] FBIN: Generated 1339 derivative records from 37713 primary records. [2025-09-16T21:15:19.230696] [DEBUG] [LOCAL ] FBIN: Saving derivative data. [2025-09-16T21:15:19.230797] [INFO ] [MAIN ] FCF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:19.230879] [INFO ] [MAIN ] FBRT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:19.247420] [DEBUG] [LOCAL ] FBIN: Derivative data saved (1339 records). [2025-09-16T21:15:19.247617] [INFO ] [MAIN ] FBIN: Successfully saved derivative data. [2025-09-16T21:15:19.249841] [INFO ] [MAIN ] Derivative Progress: 636/2026 symbols completed. FBIN took 1.0s. Estimated remaining: 7m 33s. Rate: 184.0 symbols/min [2025-09-16T21:15:19.250181] [INFO ] [MAIN ] FCT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:19.287630] [DEBUG] [LOCAL ] FCT: Loaded 10467 existing records from primary storage. [2025-09-16T21:15:19.288087] [INFO ] [MAIN ] FCT: Loaded 10467 primary data records. [2025-09-16T21:15:19.317833] [DEBUG] [LOCAL ] FBRT: Loaded 25233 existing records from primary storage. [2025-09-16T21:15:19.341794] [INFO ] [MAIN ] FBRT: Loaded 25233 primary data records. [2025-09-16T21:15:19.390877] [DEBUG] [LOCAL ] FCF: Loaded 28310 existing records from primary storage. [2025-09-16T21:15:19.432309] [INFO ] [MAIN ] FCF: Loaded 28310 primary data records. [2025-09-16T21:15:20.135432] [DEBUG] [MAIN ] FCT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:20.138551] [INFO ] [MAIN ] FCT: Generated 1339 derivative records from 10467 primary records. [2025-09-16T21:15:20.139255] [DEBUG] [LOCAL ] FCT: Saving derivative data. [2025-09-16T21:15:20.160967] [DEBUG] [MAIN ] FBRT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:20.170255] [INFO ] [MAIN ] FBRT: Generated 1339 derivative records from 25233 primary records. [2025-09-16T21:15:20.171141] [DEBUG] [LOCAL ] FCT: Derivative data saved (1339 records). [2025-09-16T21:15:20.171287] [DEBUG] [LOCAL ] FBRT: Saving derivative data. [2025-09-16T21:15:20.171954] [DEBUG] [MAIN ] FCF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:20.172337] [INFO ] [MAIN ] FCT: Successfully saved derivative data. [2025-09-16T21:15:20.178738] [INFO ] [MAIN ] FCF: Generated 1339 derivative records from 28310 primary records. [2025-09-16T21:15:20.182786] [INFO ] [MAIN ] Derivative Progress: 637/2026 symbols completed. FCT took 0.9s. Estimated remaining: 7m 34s. Rate: 183.4 symbols/min [2025-09-16T21:15:20.179403] [DEBUG] [LOCAL ] FCF: Saving derivative data. [2025-09-16T21:15:20.183996] [INFO ] [MAIN ] FCX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:20.192942] [DEBUG] [LOCAL ] FBRT: Derivative data saved (1339 records). [2025-09-16T21:15:20.193075] [INFO ] [MAIN ] FBRT: Successfully saved derivative data. [2025-09-16T21:15:20.200508] [INFO ] [MAIN ] Derivative Progress: 638/2026 symbols completed. FBRT took 1.0s. Estimated remaining: 7m 33s. Rate: 183.7 symbols/min [2025-09-16T21:15:20.201805] [DEBUG] [LOCAL ] FCF: Derivative data saved (1339 records). [2025-09-16T21:15:20.202049] [INFO ] [MAIN ] FCF: Successfully saved derivative data. [2025-09-16T21:15:20.204325] [INFO ] [MAIN ] Derivative Progress: 639/2026 symbols completed. FCF took 1.0s. Estimated remaining: 7m 32s. Rate: 184.0 symbols/min [2025-09-16T21:15:20.204619] [INFO ] [MAIN ] FDS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:20.204765] [INFO ] [MAIN ] FDP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:20.241284] [DEBUG] [LOCAL ] FDP: Loaded 22537 existing records from primary storage. [2025-09-16T21:15:20.248191] [INFO ] [MAIN ] FDP: Loaded 22537 primary data records. [2025-09-16T21:15:20.248693] [DEBUG] [LOCAL ] FDS: Loaded 18492 existing records from primary storage. [2025-09-16T21:15:20.254717] [INFO ] [MAIN ] FDS: Loaded 18492 primary data records. [2025-09-16T21:15:20.435090] [DEBUG] [LOCAL ] FCX: Loaded 40052 existing records from primary storage. [2025-09-16T21:15:20.465603] [INFO ] [MAIN ] FCX: Loaded 40052 primary data records. [2025-09-16T21:15:21.124919] [DEBUG] [MAIN ] FDP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:21.129816] [INFO ] [MAIN ] FDP: Generated 1339 derivative records from 22537 primary records. [2025-09-16T21:15:21.129114] [DEBUG] [MAIN ] FDS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:21.130562] [DEBUG] [LOCAL ] FDP: Saving derivative data. [2025-09-16T21:15:21.131307] [INFO ] [MAIN ] FDS: Generated 1339 derivative records from 18492 primary records. [2025-09-16T21:15:21.132695] [DEBUG] [LOCAL ] FDS: Saving derivative data. [2025-09-16T21:15:21.154346] [DEBUG] [LOCAL ] FDP: Derivative data saved (1339 records). [2025-09-16T21:15:21.160753] [INFO ] [MAIN ] FDP: Successfully saved derivative data. [2025-09-16T21:15:21.169026] [DEBUG] [LOCAL ] FDS: Derivative data saved (1339 records). [2025-09-16T21:15:21.168947] [INFO ] [MAIN ] Derivative Progress: 640/2026 symbols completed. FDP took 1.0s. Estimated remaining: 7m 33s. Rate: 183.4 symbols/min [2025-09-16T21:15:21.169469] [INFO ] [MAIN ] FDS: Successfully saved derivative data. [2025-09-16T21:15:21.169816] [INFO ] [MAIN ] FDX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:21.171380] [INFO ] [MAIN ] Derivative Progress: 641/2026 symbols completed. FDS took 1.0s. Estimated remaining: 7m 32s. Rate: 183.7 symbols/min [2025-09-16T21:15:21.171818] [DEBUG] [MAIN ] FCX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:21.172474] [INFO ] [MAIN ] FE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:21.173258] [INFO ] [MAIN ] FCX: Generated 1339 derivative records from 40052 primary records. [2025-09-16T21:15:21.174093] [DEBUG] [LOCAL ] FCX: Saving derivative data. [2025-09-16T21:15:21.187777] [DEBUG] [LOCAL ] FCX: Derivative data saved (1339 records). [2025-09-16T21:15:21.187956] [INFO ] [MAIN ] FCX: Successfully saved derivative data. [2025-09-16T21:15:21.190133] [INFO ] [MAIN ] Derivative Progress: 642/2026 symbols completed. FCX took 1.0s. Estimated remaining: 7m 31s. Rate: 184.0 symbols/min [2025-09-16T21:15:21.190374] [INFO ] [MAIN ] FET: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:21.202228] [DEBUG] [LOCAL ] FET: Loaded 9003 existing records from primary storage. [2025-09-16T21:15:21.210802] [INFO ] [MAIN ] FET: Loaded 9003 primary data records. [2025-09-16T21:15:21.350836] [DEBUG] [LOCAL ] FDX: Loaded 38297 existing records from primary storage. [2025-09-16T21:15:21.376582] [INFO ] [MAIN ] FDX: Loaded 38297 primary data records. [2025-09-16T21:15:21.394455] [DEBUG] [LOCAL ] FE: Loaded 39837 existing records from primary storage. [2025-09-16T21:15:21.406014] [INFO ] [MAIN ] FE: Loaded 39837 primary data records. [2025-09-16T21:15:22.069583] [DEBUG] [MAIN ] FET: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:22.070823] [INFO ] [MAIN ] FET: Generated 1339 derivative records from 9003 primary records. [2025-09-16T21:15:22.071153] [DEBUG] [LOCAL ] FET: Saving derivative data. [2025-09-16T21:15:22.086004] [DEBUG] [LOCAL ] FET: Derivative data saved (1339 records). [2025-09-16T21:15:22.086371] [INFO ] [MAIN ] FET: Successfully saved derivative data. [2025-09-16T21:15:22.088008] [INFO ] [MAIN ] Derivative Progress: 643/2026 symbols completed. FET took 0.9s. Estimated remaining: 7m 32s. Rate: 183.5 symbols/min [2025-09-16T21:15:22.098311] [DEBUG] [MAIN ] FE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:22.098905] [INFO ] [MAIN ] FE: Generated 1339 derivative records from 39837 primary records. [2025-09-16T21:15:22.099032] [DEBUG] [LOCAL ] FE: Saving derivative data. [2025-09-16T21:15:22.120813] [DEBUG] [MAIN ] FDX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:22.122196] [INFO ] [MAIN ] FDX: Generated 1339 derivative records from 38297 primary records. [2025-09-16T21:15:22.122378] [DEBUG] [LOCAL ] FE: Derivative data saved (1339 records). [2025-09-16T21:15:22.122453] [DEBUG] [LOCAL ] FDX: Saving derivative data. [2025-09-16T21:15:22.122521] [INFO ] [MAIN ] FE: Successfully saved derivative data. [2025-09-16T21:15:22.124888] [INFO ] [MAIN ] Derivative Progress: 644/2026 symbols completed. FE took 1.0s. Estimated remaining: 7m 31s. Rate: 183.7 symbols/min [2025-09-16T21:15:22.136810] [DEBUG] [LOCAL ] FDX: Derivative data saved (1339 records). [2025-09-16T21:15:22.136867] [INFO ] [MAIN ] FDX: Successfully saved derivative data. [2025-09-16T21:15:22.138664] [INFO ] [MAIN ] Derivative Progress: 645/2026 symbols completed. FDX took 1.0s. Estimated remaining: 7m 30s. Rate: 184.0 symbols/min [2025-09-16T21:15:22.139003] [INFO ] [MAIN ] FGN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:22.139262] [INFO ] [MAIN ] FG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:22.139216] [INFO ] [MAIN ] FGSN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:22.144610] [DEBUG] [LOCAL ] FGN: Loaded 2748 existing records from primary storage. [2025-09-16T21:15:22.145732] [INFO ] [MAIN ] FGN: Loaded 2748 primary data records. [2025-09-16T21:15:22.217342] [DEBUG] [LOCAL ] FGSN: Loaded 3526 existing records from primary storage. [2025-09-16T21:15:22.254623] [INFO ] [MAIN ] FGSN: Loaded 3526 primary data records. [2025-09-16T21:15:22.346526] [DEBUG] [LOCAL ] FG: Loaded 15335 existing records from primary storage. [2025-09-16T21:15:22.368997] [INFO ] [MAIN ] FG: Loaded 15335 primary data records. [2025-09-16T21:15:23.038538] [DEBUG] [MAIN ] FGN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:23.045334] [INFO ] [MAIN ] FGN: Generated 1339 derivative records from 2748 primary records. [2025-09-16T21:15:23.049427] [DEBUG] [MAIN ] FGSN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:23.049487] [DEBUG] [LOCAL ] FGN: Saving derivative data. [2025-09-16T21:15:23.050047] [INFO ] [MAIN ] FGSN: Generated 1339 derivative records from 3526 primary records. [2025-09-16T21:15:23.050812] [DEBUG] [LOCAL ] FGSN: Saving derivative data. [2025-09-16T21:15:23.070377] [DEBUG] [LOCAL ] FGN: Derivative data saved (1339 records). [2025-09-16T21:15:23.072575] [DEBUG] [LOCAL ] FGSN: Derivative data saved (1339 records). [2025-09-16T21:15:23.072744] [INFO ] [MAIN ] FGSN: Successfully saved derivative data. [2025-09-16T21:15:23.075094] [INFO ] [MAIN ] Derivative Progress: 646/2026 symbols completed. FGSN took 0.9s. Estimated remaining: 7m 31s. Rate: 183.5 symbols/min [2025-09-16T21:15:23.072865] [INFO ] [MAIN ] FGN: Successfully saved derivative data. [2025-09-16T21:15:23.078689] [INFO ] [MAIN ] Derivative Progress: 647/2026 symbols completed. FGN took 0.9s. Estimated remaining: 7m 30s. Rate: 183.8 symbols/min [2025-09-16T21:15:23.079042] [INFO ] [MAIN ] FHN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:23.079140] [INFO ] [MAIN ] FHI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:23.090408] [DEBUG] [MAIN ] FG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:23.091161] [INFO ] [MAIN ] FG: Generated 1339 derivative records from 15335 primary records. [2025-09-16T21:15:23.091273] [DEBUG] [LOCAL ] FG: Saving derivative data. [2025-09-16T21:15:23.103590] [DEBUG] [LOCAL ] FG: Derivative data saved (1339 records). [2025-09-16T21:15:23.103743] [INFO ] [MAIN ] FG: Successfully saved derivative data. [2025-09-16T21:15:23.105731] [INFO ] [MAIN ] Derivative Progress: 648/2026 symbols completed. FG took 1.0s. Estimated remaining: 7m 29s. Rate: 184.0 symbols/min [2025-09-16T21:15:23.106153] [INFO ] [MAIN ] FI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:23.144177] [DEBUG] [LOCAL ] FHI: Loaded 30062 existing records from primary storage. [2025-09-16T21:15:23.153938] [INFO ] [MAIN ] FHI: Loaded 30062 primary data records. [2025-09-16T21:15:23.285537] [DEBUG] [LOCAL ] FHN: Loaded 39754 existing records from primary storage. [2025-09-16T21:15:23.285995] [INFO ] [MAIN ] FHN: Loaded 39754 primary data records. [2025-09-16T21:15:23.297057] [DEBUG] [LOCAL ] FI: Loaded 39987 existing records from primary storage. [2025-09-16T21:15:23.307378] [INFO ] [MAIN ] FI: Loaded 39987 primary data records. [2025-09-16T21:15:23.992357] [DEBUG] [MAIN ] FHI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:23.993057] [INFO ] [MAIN ] FHI: Generated 1339 derivative records from 30062 primary records. [2025-09-16T21:15:23.993445] [DEBUG] [LOCAL ] FHI: Saving derivative data. [2025-09-16T21:15:24.006107] [DEBUG] [LOCAL ] FHI: Derivative data saved (1339 records). [2025-09-16T21:15:24.006341] [INFO ] [MAIN ] FHI: Successfully saved derivative data. [2025-09-16T21:15:24.007794] [INFO ] [MAIN ] Derivative Progress: 649/2026 symbols completed. FHI took 0.9s. Estimated remaining: 7m 30s. Rate: 183.5 symbols/min [2025-09-16T21:15:24.008198] [INFO ] [MAIN ] FICO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:24.030979] [DEBUG] [MAIN ] FI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:24.031840] [INFO ] [MAIN ] FI: Generated 1339 derivative records from 39987 primary records. [2025-09-16T21:15:24.031175] [DEBUG] [MAIN ] FHN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:24.031968] [DEBUG] [LOCAL ] FI: Saving derivative data. [2025-09-16T21:15:24.032480] [INFO ] [MAIN ] FHN: Generated 1339 derivative records from 39754 primary records. [2025-09-16T21:15:24.033357] [DEBUG] [LOCAL ] FHN: Saving derivative data. [2025-09-16T21:15:24.057571] [DEBUG] [LOCAL ] FI: Derivative data saved (1339 records). [2025-09-16T21:15:24.058773] [INFO ] [MAIN ] FI: Successfully saved derivative data. [2025-09-16T21:15:24.069053] [INFO ] [MAIN ] Derivative Progress: 650/2026 symbols completed. FI took 1.0s. Estimated remaining: 7m 29s. Rate: 183.7 symbols/min [2025-09-16T21:15:24.066003] [DEBUG] [LOCAL ] FHN: Derivative data saved (1339 records). [2025-09-16T21:15:24.069693] [INFO ] [MAIN ] FHN: Successfully saved derivative data. [2025-09-16T21:15:24.069623] [INFO ] [MAIN ] FIGS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:24.070210] [DEBUG] [LOCAL ] FICO: Loaded 16209 existing records from primary storage. [2025-09-16T21:15:24.072187] [INFO ] [MAIN ] Derivative Progress: 651/2026 symbols completed. FHN took 1.0s. Estimated remaining: 7m 28s. Rate: 184.0 symbols/min [2025-09-16T21:15:24.072597] [INFO ] [MAIN ] FIHL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:24.072966] [INFO ] [MAIN ] FICO: Loaded 16209 primary data records. [2025-09-16T21:15:24.361346] [DEBUG] [LOCAL ] FIHL: Loaded 28860 existing records from primary storage. [2025-09-16T21:15:24.371584] [INFO ] [MAIN ] FIHL: Loaded 28860 primary data records. [2025-09-16T21:15:24.372351] [DEBUG] [LOCAL ] FIGS: Loaded 36336 existing records from primary storage. [2025-09-16T21:15:24.378062] [INFO ] [MAIN ] FIGS: Loaded 36336 primary data records. [2025-09-16T21:15:24.977516] [DEBUG] [MAIN ] FICO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:24.978516] [INFO ] [MAIN ] FICO: Generated 1339 derivative records from 16209 primary records. [2025-09-16T21:15:24.978665] [DEBUG] [LOCAL ] FICO: Saving derivative data. [2025-09-16T21:15:24.995434] [DEBUG] [LOCAL ] FICO: Derivative data saved (1339 records). [2025-09-16T21:15:24.996278] [INFO ] [MAIN ] FICO: Successfully saved derivative data. [2025-09-16T21:15:24.998787] [INFO ] [MAIN ] Derivative Progress: 652/2026 symbols completed. FICO took 1.0s. Estimated remaining: 7m 29s. Rate: 183.5 symbols/min [2025-09-16T21:15:24.999084] [INFO ] [MAIN ] FINS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:25.016970] [DEBUG] [MAIN ] FIHL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:25.017903] [INFO ] [MAIN ] FIHL: Generated 1339 derivative records from 28860 primary records. [2025-09-16T21:15:25.018128] [DEBUG] [LOCAL ] FIHL: Saving derivative data. [2025-09-16T21:15:25.022000] [DEBUG] [LOCAL ] FINS: Loaded 6435 existing records from primary storage. [2025-09-16T21:15:25.027698] [INFO ] [MAIN ] FINS: Loaded 6435 primary data records. [2025-09-16T21:15:25.130667] [DEBUG] [LOCAL ] FIHL: Derivative data saved (1339 records). [2025-09-16T21:15:25.158350] [INFO ] [MAIN ] FIHL: Successfully saved derivative data. [2025-09-16T21:15:25.165656] [INFO ] [MAIN ] Derivative Progress: 653/2026 symbols completed. FIHL took 1.1s. Estimated remaining: 7m 29s. Rate: 183.6 symbols/min [2025-09-16T21:15:25.166063] [DEBUG] [MAIN ] FIGS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:25.186820] [INFO ] [MAIN ] FINV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:25.210278] [INFO ] [MAIN ] FIGS: Generated 1339 derivative records from 36336 primary records. [2025-09-16T21:15:25.220227] [DEBUG] [LOCAL ] FIGS: Saving derivative data. [2025-09-16T21:15:25.340095] [DEBUG] [LOCAL ] FIGS: Derivative data saved (1339 records). [2025-09-16T21:15:25.340415] [INFO ] [MAIN ] FIGS: Successfully saved derivative data. [2025-09-16T21:15:25.342989] [INFO ] [MAIN ] Derivative Progress: 654/2026 symbols completed. FIGS took 1.3s. Estimated remaining: 7m 28s. Rate: 183.8 symbols/min [2025-09-16T21:15:25.343388] [INFO ] [MAIN ] FIS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:25.368160] [DEBUG] [MAIN ] FINS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:25.368962] [INFO ] [MAIN ] FINS: Generated 1339 derivative records from 6435 primary records. [2025-09-16T21:15:25.378375] [DEBUG] [LOCAL ] FINS: Saving derivative data. [2025-09-16T21:15:25.379785] [DEBUG] [LOCAL ] FINV: Loaded 33313 existing records from primary storage. [2025-09-16T21:15:25.380050] [INFO ] [MAIN ] FINV: Loaded 33313 primary data records. [2025-09-16T21:15:25.503867] [DEBUG] [LOCAL ] FINS: Derivative data saved (1339 records). [2025-09-16T21:15:25.504508] [INFO ] [MAIN ] FINS: Successfully saved derivative data. [2025-09-16T21:15:25.506158] [INFO ] [MAIN ] Derivative Progress: 655/2026 symbols completed. FINS took 0.5s. Estimated remaining: 7m 27s. Rate: 183.9 symbols/min [2025-09-16T21:15:25.506358] [INFO ] [MAIN ] FIX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:25.543571] [DEBUG] [LOCAL ] FIS: Loaded 39736 existing records from primary storage. [2025-09-16T21:15:25.565954] [INFO ] [MAIN ] FIS: Loaded 39736 primary data records. [2025-09-16T21:15:25.801028] [DEBUG] [LOCAL ] FIX: Loaded 21252 existing records from primary storage. [2025-09-16T21:15:25.806986] [INFO ] [MAIN ] FIX: Loaded 21252 primary data records. [2025-09-16T21:15:26.261717] [DEBUG] [MAIN ] FINV: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:26.263295] [INFO ] [MAIN ] FINV: Generated 1339 derivative records from 33313 primary records. [2025-09-16T21:15:26.263403] [DEBUG] [LOCAL ] FINV: Saving derivative data. [2025-09-16T21:15:26.277537] [DEBUG] [LOCAL ] FINV: Derivative data saved (1339 records). [2025-09-16T21:15:26.279979] [INFO ] [MAIN ] FINV: Successfully saved derivative data. [2025-09-16T21:15:26.281682] [INFO ] [MAIN ] Derivative Progress: 656/2026 symbols completed. FINV took 1.1s. Estimated remaining: 7m 28s. Rate: 183.5 symbols/min [2025-09-16T21:15:26.293187] [DEBUG] [MAIN ] FIS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:26.282324] [INFO ] [MAIN ] FLC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:26.294665] [INFO ] [MAIN ] FIS: Generated 1339 derivative records from 39736 primary records. [2025-09-16T21:15:26.294945] [DEBUG] [LOCAL ] FIS: Saving derivative data. [2025-09-16T21:15:26.312017] [DEBUG] [LOCAL ] FIS: Derivative data saved (1339 records). [2025-09-16T21:15:26.312360] [INFO ] [MAIN ] FIS: Successfully saved derivative data. [2025-09-16T21:15:26.317949] [INFO ] [MAIN ] Derivative Progress: 657/2026 symbols completed. FIS took 1.0s. Estimated remaining: 7m 27s. Rate: 183.8 symbols/min [2025-09-16T21:15:26.315229] [DEBUG] [LOCAL ] FLC: Loaded 3942 existing records from primary storage. [2025-09-16T21:15:26.328360] [INFO ] [MAIN ] FLG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:26.328501] [INFO ] [MAIN ] FLC: Loaded 3942 primary data records. [2025-09-16T21:15:26.328988] [DEBUG] [MAIN ] FIX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:26.386297] [INFO ] [MAIN ] FIX: Generated 1339 derivative records from 21252 primary records. [2025-09-16T21:15:26.410351] [DEBUG] [LOCAL ] FIX: Saving derivative data. [2025-09-16T21:15:26.559979] [DEBUG] [LOCAL ] FIX: Derivative data saved (1339 records). [2025-09-16T21:15:26.648043] [INFO ] [MAIN ] FIX: Successfully saved derivative data. [2025-09-16T21:15:26.650134] [INFO ] [MAIN ] Derivative Progress: 658/2026 symbols completed. FIX took 1.1s. Estimated remaining: 7m 27s. Rate: 183.8 symbols/min [2025-09-16T21:15:26.674199] [DEBUG] [LOCAL ] FLG: Loaded 39734 existing records from primary storage. [2025-09-16T21:15:26.674621] [INFO ] [MAIN ] FLG: Loaded 39734 primary data records. [2025-09-16T21:15:26.885208] [DEBUG] [MAIN ] FLC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:26.888691] [INFO ] [MAIN ] FLC: Generated 1339 derivative records from 3942 primary records. [2025-09-16T21:15:26.974968] [DEBUG] [LOCAL ] FLC: Saving derivative data. [2025-09-16T21:15:26.988156] [DEBUG] [LOCAL ] FLC: Derivative data saved (1339 records). [2025-09-16T21:15:26.988601] [INFO ] [MAIN ] FLC: Successfully saved derivative data. [2025-09-16T21:15:26.990436] [INFO ] [MAIN ] Derivative Progress: 659/2026 symbols completed. FLC took 0.7s. Estimated remaining: 7m 26s. Rate: 183.8 symbols/min [2025-09-16T21:15:27.007029] [DEBUG] [MAIN ] FLG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:27.007742] [INFO ] [MAIN ] FLG: Generated 1339 derivative records from 39734 primary records. [2025-09-16T21:15:27.007807] [DEBUG] [LOCAL ] FLG: Saving derivative data. [2025-09-16T21:15:27.020027] [DEBUG] [LOCAL ] FLG: Derivative data saved (1339 records). [2025-09-16T21:15:27.020108] [INFO ] [MAIN ] FLG: Successfully saved derivative data. [2025-09-16T21:15:27.022038] [INFO ] [MAIN ] Derivative Progress: 660/2026 symbols completed. FLG took 0.7s. Estimated remaining: 7m 25s. Rate: 184.0 symbols/min [2025-09-16T21:15:27.022808] [INFO ] [MAIN ] FLNG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:27.023018] [INFO ] [MAIN ] FLOC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:27.022727] [INFO ] [MAIN ] FLO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:27.071060] [DEBUG] [LOCAL ] FLNG: Loaded 25121 existing records from primary storage. [2025-09-16T21:15:27.071879] [DEBUG] [LOCAL ] FLOC: Loaded 20716 existing records from primary storage. [2025-09-16T21:15:27.072195] [INFO ] [MAIN ] FLNG: Loaded 25121 primary data records. [2025-09-16T21:15:27.072269] [INFO ] [MAIN ] FLOC: Loaded 20716 primary data records. [2025-09-16T21:15:27.313846] [DEBUG] [LOCAL ] FLO: Loaded 38799 existing records from primary storage. [2025-09-16T21:15:27.314141] [INFO ] [MAIN ] FLO: Loaded 38799 primary data records. [2025-09-16T21:15:28.000538] [DEBUG] [MAIN ] FLNG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:28.002630] [INFO ] [MAIN ] FLNG: Generated 1339 derivative records from 25121 primary records. [2025-09-16T21:15:28.002964] [DEBUG] [LOCAL ] FLNG: Saving derivative data. [2025-09-16T21:15:28.023686] [DEBUG] [MAIN ] FLOC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:28.026747] [DEBUG] [LOCAL ] FLNG: Derivative data saved (1339 records). [2025-09-16T21:15:28.026373] [INFO ] [MAIN ] FLOC: Generated 1339 derivative records from 20716 primary records. [2025-09-16T21:15:28.026915] [INFO ] [MAIN ] FLNG: Successfully saved derivative data. [2025-09-16T21:15:28.026988] [DEBUG] [LOCAL ] FLOC: Saving derivative data. [2025-09-16T21:15:28.028369] [INFO ] [MAIN ] Derivative Progress: 661/2026 symbols completed. FLNG took 1.0s. Estimated remaining: 7m 26s. Rate: 183.4 symbols/min [2025-09-16T21:15:28.030702] [INFO ] [MAIN ] FLR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:28.050178] [DEBUG] [MAIN ] FLO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:28.052133] [INFO ] [MAIN ] FLO: Generated 1339 derivative records from 38799 primary records. [2025-09-16T21:15:28.054017] [DEBUG] [LOCAL ] FLOC: Derivative data saved (1339 records). [2025-09-16T21:15:28.053792] [DEBUG] [LOCAL ] FLO: Saving derivative data. [2025-09-16T21:15:28.054111] [INFO ] [MAIN ] FLOC: Successfully saved derivative data. [2025-09-16T21:15:28.056878] [INFO ] [MAIN ] Derivative Progress: 662/2026 symbols completed. FLOC took 1.0s. Estimated remaining: 7m 26s. Rate: 183.7 symbols/min [2025-09-16T21:15:28.062936] [INFO ] [MAIN ] FLS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:28.070962] [DEBUG] [LOCAL ] FLO: Derivative data saved (1339 records). [2025-09-16T21:15:28.071117] [INFO ] [MAIN ] FLO: Successfully saved derivative data. [2025-09-16T21:15:28.073695] [INFO ] [MAIN ] Derivative Progress: 663/2026 symbols completed. FLO took 1.1s. Estimated remaining: 7m 25s. Rate: 183.9 symbols/min [2025-09-16T21:15:28.082710] [INFO ] [MAIN ] FLUT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:28.101754] [DEBUG] [LOCAL ] FLR: Loaded 39691 existing records from primary storage. [2025-09-16T21:15:28.102007] [INFO ] [MAIN ] FLR: Loaded 39691 primary data records. [2025-09-16T21:15:28.315015] [DEBUG] [LOCAL ] FLS: Loaded 37213 existing records from primary storage. [2025-09-16T21:15:28.403088] [INFO ] [MAIN ] FLS: Loaded 37213 primary data records. [2025-09-16T21:15:28.435233] [DEBUG] [LOCAL ] FLUT: Loaded 37703 existing records from primary storage. [2025-09-16T21:15:28.458884] [INFO ] [MAIN ] FLUT: Loaded 37703 primary data records. [2025-09-16T21:15:28.998861] [DEBUG] [MAIN ] FLR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:29.000019] [INFO ] [MAIN ] FLR: Generated 1339 derivative records from 39691 primary records. [2025-09-16T21:15:29.000608] [DEBUG] [LOCAL ] FLR: Saving derivative data. [2025-09-16T21:15:29.016175] [DEBUG] [LOCAL ] FLR: Derivative data saved (1339 records). [2025-09-16T21:15:29.016360] [INFO ] [MAIN ] FLR: Successfully saved derivative data. [2025-09-16T21:15:29.018201] [INFO ] [MAIN ] Derivative Progress: 664/2026 symbols completed. FLR took 1.0s. Estimated remaining: 7m 26s. Rate: 183.4 symbols/min [2025-09-16T21:15:29.019173] [INFO ] [MAIN ] FLXR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:29.035781] [DEBUG] [MAIN ] FLUT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:29.042551] [INFO ] [MAIN ] FLUT: Generated 1339 derivative records from 37703 primary records. [2025-09-16T21:15:29.046341] [DEBUG] [LOCAL ] FLUT: Saving derivative data. [2025-09-16T21:15:29.057097] [DEBUG] [MAIN ] FLS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:29.060960] [INFO ] [MAIN ] FLS: Generated 1339 derivative records from 37213 primary records. [2025-09-16T21:15:29.061928] [DEBUG] [LOCAL ] FLS: Saving derivative data. [2025-09-16T21:15:29.068262] [DEBUG] [LOCAL ] FLXR: Loaded 15343 existing records from primary storage. [2025-09-16T21:15:29.069560] [INFO ] [MAIN ] FLXR: Loaded 15343 primary data records. [2025-09-16T21:15:29.111416] [DEBUG] [LOCAL ] FLUT: Derivative data saved (1339 records). [2025-09-16T21:15:29.124457] [INFO ] [MAIN ] FLUT: Successfully saved derivative data. [2025-09-16T21:15:29.126762] [DEBUG] [LOCAL ] FLS: Derivative data saved (1339 records). [2025-09-16T21:15:29.140701] [INFO ] [MAIN ] Derivative Progress: 665/2026 symbols completed. FLUT took 1.1s. Estimated remaining: 7m 25s. Rate: 183.6 symbols/min [2025-09-16T21:15:29.149601] [INFO ] [MAIN ] FLS: Successfully saved derivative data. [2025-09-16T21:15:29.155000] [INFO ] [MAIN ] FMN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:29.163003] [INFO ] [MAIN ] Derivative Progress: 666/2026 symbols completed. FLS took 1.1s. Estimated remaining: 7m 24s. Rate: 183.9 symbols/min [2025-09-16T21:15:29.163353] [INFO ] [MAIN ] FMS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:29.275463] [DEBUG] [LOCAL ] FMN: Loaded 3836 existing records from primary storage. [2025-09-16T21:15:29.361167] [INFO ] [MAIN ] FMN: Loaded 3836 primary data records. [2025-09-16T21:15:29.458663] [DEBUG] [LOCAL ] FMS: Loaded 22350 existing records from primary storage. [2025-09-16T21:15:29.475685] [INFO ] [MAIN ] FMS: Loaded 22350 primary data records. [2025-09-16T21:15:29.958339] [DEBUG] [MAIN ] FLXR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:29.959460] [INFO ] [MAIN ] FLXR: Generated 1339 derivative records from 15343 primary records. [2025-09-16T21:15:29.959628] [DEBUG] [LOCAL ] FLXR: Saving derivative data. [2025-09-16T21:15:29.974994] [DEBUG] [LOCAL ] FLXR: Derivative data saved (1339 records). [2025-09-16T21:15:29.975305] [INFO ] [MAIN ] FLXR: Successfully saved derivative data. [2025-09-16T21:15:29.976934] [INFO ] [MAIN ] Derivative Progress: 667/2026 symbols completed. FLXR took 1.0s. Estimated remaining: 7m 24s. Rate: 183.4 symbols/min [2025-09-16T21:15:29.978045] [INFO ] [MAIN ] FMY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:29.983252] [DEBUG] [LOCAL ] FMY: Loaded 1027 existing records from primary storage. [2025-09-16T21:15:29.983556] [INFO ] [MAIN ] FMY: Loaded 1027 primary data records. [2025-09-16T21:15:30.097996] [DEBUG] [MAIN ] FMN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:30.098988] [INFO ] [MAIN ] FMN: Generated 1339 derivative records from 3836 primary records. [2025-09-16T21:15:30.128126] [DEBUG] [LOCAL ] FMN: Saving derivative data. [2025-09-16T21:15:30.288454] [DEBUG] [MAIN ] FMS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:30.290119] [INFO ] [MAIN ] FMS: Generated 1339 derivative records from 22350 primary records. [2025-09-16T21:15:30.290941] [DEBUG] [LOCAL ] FMS: Saving derivative data. [2025-09-16T21:15:30.291040] [DEBUG] [LOCAL ] FMN: Derivative data saved (1339 records). [2025-09-16T21:15:30.292370] [INFO ] [MAIN ] FMN: Successfully saved derivative data. [2025-09-16T21:15:30.300455] [INFO ] [MAIN ] Derivative Progress: 668/2026 symbols completed. FMN took 1.1s. Estimated remaining: 7m 24s. Rate: 183.4 symbols/min [2025-09-16T21:15:30.303918] [INFO ] [MAIN ] FN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:30.308117] [DEBUG] [LOCAL ] FMS: Derivative data saved (1339 records). [2025-09-16T21:15:30.309183] [INFO ] [MAIN ] FMS: Successfully saved derivative data. [2025-09-16T21:15:30.311524] [INFO ] [MAIN ] Derivative Progress: 669/2026 symbols completed. FMS took 1.1s. Estimated remaining: 7m 23s. Rate: 183.7 symbols/min [2025-09-16T21:15:30.312097] [INFO ] [MAIN ] FNB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:30.327108] [DEBUG] [MAIN ] FMY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:30.335630] [INFO ] [MAIN ] FMY: Generated 1339 derivative records from 1027 primary records. [2025-09-16T21:15:30.335885] [DEBUG] [LOCAL ] FMY: Saving derivative data. [2025-09-16T21:15:30.356392] [DEBUG] [LOCAL ] FMY: Derivative data saved (1339 records). [2025-09-16T21:15:30.357322] [INFO ] [MAIN ] FMY: Successfully saved derivative data. [2025-09-16T21:15:30.358854] [INFO ] [MAIN ] Derivative Progress: 670/2026 symbols completed. FMY took 0.4s. Estimated remaining: 7m 22s. Rate: 183.9 symbols/min [2025-09-16T21:15:30.359752] [DEBUG] [LOCAL ] FN: Loaded 28485 existing records from primary storage. [2025-09-16T21:15:30.359143] [INFO ] [MAIN ] FND: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:30.360105] [INFO ] [MAIN ] FN: Loaded 28485 primary data records. [2025-09-16T21:15:30.497487] [DEBUG] [LOCAL ] FNB: Loaded 38986 existing records from primary storage. [2025-09-16T21:15:30.508020] [INFO ] [MAIN ] FNB: Loaded 38986 primary data records. [2025-09-16T21:15:30.802531] [DEBUG] [LOCAL ] FND: Loaded 38807 existing records from primary storage. [2025-09-16T21:15:30.808302] [INFO ] [MAIN ] FND: Loaded 38807 primary data records. [2025-09-16T21:15:31.258032] [DEBUG] [MAIN ] FN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:31.259687] [INFO ] [MAIN ] FN: Generated 1339 derivative records from 28485 primary records. [2025-09-16T21:15:31.260055] [DEBUG] [LOCAL ] FN: Saving derivative data. [2025-09-16T21:15:31.274845] [DEBUG] [LOCAL ] FN: Derivative data saved (1339 records). [2025-09-16T21:15:31.275624] [INFO ] [MAIN ] FN: Successfully saved derivative data. [2025-09-16T21:15:31.278615] [INFO ] [MAIN ] Derivative Progress: 671/2026 symbols completed. FN took 1.0s. Estimated remaining: 7m 23s. Rate: 183.4 symbols/min [2025-09-16T21:15:31.280161] [INFO ] [MAIN ] FNF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:31.290838] [DEBUG] [MAIN ] FNB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:31.291614] [INFO ] [MAIN ] FNB: Generated 1339 derivative records from 38986 primary records. [2025-09-16T21:15:31.291848] [DEBUG] [LOCAL ] FNB: Saving derivative data. [2025-09-16T21:15:31.304608] [DEBUG] [LOCAL ] FNB: Derivative data saved (1339 records). [2025-09-16T21:15:31.304831] [INFO ] [MAIN ] FNB: Successfully saved derivative data. [2025-09-16T21:15:31.306917] [INFO ] [MAIN ] Derivative Progress: 672/2026 symbols completed. FNB took 1.0s. Estimated remaining: 7m 22s. Rate: 183.7 symbols/min [2025-09-16T21:15:31.307245] [INFO ] [MAIN ] FOF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:31.324606] [DEBUG] [LOCAL ] FOF: Loaded 5797 existing records from primary storage. [2025-09-16T21:15:31.328487] [INFO ] [MAIN ] FOF: Loaded 5797 primary data records. [2025-09-16T21:15:31.328422] [DEBUG] [MAIN ] FND: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:31.329223] [INFO ] [MAIN ] FND: Generated 1339 derivative records from 38807 primary records. [2025-09-16T21:15:31.360142] [DEBUG] [LOCAL ] FND: Saving derivative data. [2025-09-16T21:15:31.493055] [DEBUG] [LOCAL ] FNF: Loaded 36510 existing records from primary storage. [2025-09-16T21:15:31.518155] [INFO ] [MAIN ] FNF: Loaded 36510 primary data records. [2025-09-16T21:15:31.518233] [DEBUG] [LOCAL ] FND: Derivative data saved (1339 records). [2025-09-16T21:15:31.525600] [INFO ] [MAIN ] FND: Successfully saved derivative data. [2025-09-16T21:15:31.527764] [INFO ] [MAIN ] Derivative Progress: 673/2026 symbols completed. FND took 1.2s. Estimated remaining: 7m 22s. Rate: 183.8 symbols/min [2025-09-16T21:15:31.952983] [DEBUG] [MAIN ] FOF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:31.953779] [INFO ] [MAIN ] FOF: Generated 1339 derivative records from 5797 primary records. [2025-09-16T21:15:31.953938] [DEBUG] [LOCAL ] FOF: Saving derivative data. [2025-09-16T21:15:31.966516] [DEBUG] [LOCAL ] FOF: Derivative data saved (1339 records). [2025-09-16T21:15:31.966576] [INFO ] [MAIN ] FOF: Successfully saved derivative data. [2025-09-16T21:15:31.968081] [INFO ] [MAIN ] Derivative Progress: 674/2026 symbols completed. FOF took 0.7s. Estimated remaining: 7m 22s. Rate: 183.7 symbols/min [2025-09-16T21:15:31.979593] [DEBUG] [MAIN ] FNF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:31.980117] [INFO ] [MAIN ] FNF: Generated 1339 derivative records from 36510 primary records. [2025-09-16T21:15:31.980176] [DEBUG] [LOCAL ] FNF: Saving derivative data. [2025-09-16T21:15:31.991857] [DEBUG] [LOCAL ] FNF: Derivative data saved (1339 records). [2025-09-16T21:15:31.991923] [INFO ] [MAIN ] FNF: Successfully saved derivative data. [2025-09-16T21:15:31.994248] [INFO ] [MAIN ] Derivative Progress: 675/2026 symbols completed. FNF took 0.7s. Estimated remaining: 7m 21s. Rate: 183.9 symbols/min [2025-09-16T21:15:31.994850] [INFO ] [MAIN ] FPF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:31.994982] [INFO ] [MAIN ] FOUR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:31.995113] [INFO ] [MAIN ] FOR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:32.019466] [DEBUG] [LOCAL ] FPF: Loaded 12881 existing records from primary storage. [2025-09-16T21:15:32.019051] [DEBUG] [LOCAL ] FOR: Loaded 14590 existing records from primary storage. [2025-09-16T21:15:32.019668] [INFO ] [MAIN ] FPF: Loaded 12881 primary data records. [2025-09-16T21:15:32.019714] [INFO ] [MAIN ] FOR: Loaded 14590 primary data records. [2025-09-16T21:15:32.365977] [DEBUG] [LOCAL ] FOUR: Loaded 36659 existing records from primary storage. [2025-09-16T21:15:32.476449] [INFO ] [MAIN ] FOUR: Loaded 36659 primary data records. [2025-09-16T21:15:32.862578] [DEBUG] [MAIN ] FOR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:32.867302] [INFO ] [MAIN ] FOR: Generated 1339 derivative records from 14590 primary records. [2025-09-16T21:15:32.867729] [DEBUG] [LOCAL ] FOR: Saving derivative data. [2025-09-16T21:15:32.867594] [DEBUG] [MAIN ] FPF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:32.868927] [INFO ] [MAIN ] FPF: Generated 1339 derivative records from 12881 primary records. [2025-09-16T21:15:32.869284] [DEBUG] [LOCAL ] FPF: Saving derivative data. [2025-09-16T21:15:32.895659] [DEBUG] [LOCAL ] FPF: Derivative data saved (1339 records). [2025-09-16T21:15:32.894892] [DEBUG] [LOCAL ] FOR: Derivative data saved (1339 records). [2025-09-16T21:15:32.895917] [INFO ] [MAIN ] FOR: Successfully saved derivative data. [2025-09-16T21:15:32.896040] [INFO ] [MAIN ] FPF: Successfully saved derivative data. [2025-09-16T21:15:32.897733] [INFO ] [MAIN ] Derivative Progress: 676/2026 symbols completed. FOR took 0.9s. Estimated remaining: 7m 22s. Rate: 183.5 symbols/min [2025-09-16T21:15:32.897978] [INFO ] [MAIN ] FPH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:32.909387] [INFO ] [MAIN ] Derivative Progress: 677/2026 symbols completed. FPF took 0.9s. Estimated remaining: 7m 21s. Rate: 183.7 symbols/min [2025-09-16T21:15:32.910158] [DEBUG] [MAIN ] FOUR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:32.910394] [INFO ] [MAIN ] FPI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:32.911022] [INFO ] [MAIN ] FOUR: Generated 1339 derivative records from 36659 primary records. [2025-09-16T21:15:32.911556] [DEBUG] [LOCAL ] FOUR: Saving derivative data. [2025-09-16T21:15:32.924058] [DEBUG] [LOCAL ] FOUR: Derivative data saved (1339 records). [2025-09-16T21:15:32.924191] [INFO ] [MAIN ] FOUR: Successfully saved derivative data. [2025-09-16T21:15:32.926460] [INFO ] [MAIN ] Derivative Progress: 678/2026 symbols completed. FOUR took 0.9s. Estimated remaining: 7m 20s. Rate: 184.0 symbols/min [2025-09-16T21:15:32.926879] [INFO ] [MAIN ] FR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:32.938779] [DEBUG] [LOCAL ] FPH: Loaded 14629 existing records from primary storage. [2025-09-16T21:15:32.945395] [INFO ] [MAIN ] FPH: Loaded 14629 primary data records. [2025-09-16T21:15:33.066768] [DEBUG] [LOCAL ] FPI: Loaded 23420 existing records from primary storage. [2025-09-16T21:15:33.077719] [INFO ] [MAIN ] FPI: Loaded 23420 primary data records. [2025-09-16T21:15:33.240652] [DEBUG] [LOCAL ] FR: Loaded 34514 existing records from primary storage. [2025-09-16T21:15:33.337127] [INFO ] [MAIN ] FR: Loaded 34514 primary data records. [2025-09-16T21:15:33.826929] [DEBUG] [MAIN ] FPH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:33.828385] [INFO ] [MAIN ] FPH: Generated 1339 derivative records from 14629 primary records. [2025-09-16T21:15:33.828813] [DEBUG] [LOCAL ] FPH: Saving derivative data. [2025-09-16T21:15:33.844937] [DEBUG] [LOCAL ] FPH: Derivative data saved (1339 records). [2025-09-16T21:15:33.845497] [INFO ] [MAIN ] FPH: Successfully saved derivative data. [2025-09-16T21:15:33.856734] [INFO ] [MAIN ] Derivative Progress: 679/2026 symbols completed. FPH took 1.0s. Estimated remaining: 7m 20s. Rate: 183.5 symbols/min [2025-09-16T21:15:33.857140] [DEBUG] [MAIN ] FPI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:33.858152] [INFO ] [MAIN ] FPI: Generated 1339 derivative records from 23420 primary records. [2025-09-16T21:15:33.858216] [INFO ] [MAIN ] FRA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:33.858501] [DEBUG] [LOCAL ] FPI: Saving derivative data. [2025-09-16T21:15:33.874461] [DEBUG] [LOCAL ] FPI: Derivative data saved (1339 records). [2025-09-16T21:15:33.874678] [INFO ] [MAIN ] FPI: Successfully saved derivative data. [2025-09-16T21:15:33.878917] [INFO ] [MAIN ] Derivative Progress: 680/2026 symbols completed. FPI took 1.0s. Estimated remaining: 7m 20s. Rate: 183.7 symbols/min [2025-09-16T21:15:33.885211] [INFO ] [MAIN ] FRGE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:33.889847] [DEBUG] [MAIN ] FR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:33.894772] [INFO ] [MAIN ] FR: Generated 1339 derivative records from 34514 primary records. [2025-09-16T21:15:33.895060] [DEBUG] [LOCAL ] FRA: Loaded 10140 existing records from primary storage. [2025-09-16T21:15:33.895258] [INFO ] [MAIN ] FRA: Loaded 10140 primary data records. [2025-09-16T21:15:33.906518] [DEBUG] [LOCAL ] FR: Saving derivative data. [2025-09-16T21:15:34.027258] [DEBUG] [LOCAL ] FRGE: Loaded 11551 existing records from primary storage. [2025-09-16T21:15:34.033308] [INFO ] [MAIN ] FRGE: Loaded 11551 primary data records. [2025-09-16T21:15:34.028120] [DEBUG] [LOCAL ] FR: Derivative data saved (1339 records). [2025-09-16T21:15:34.043716] [INFO ] [MAIN ] FR: Successfully saved derivative data. [2025-09-16T21:15:34.102026] [INFO ] [MAIN ] Derivative Progress: 681/2026 symbols completed. FR took 1.2s. Estimated remaining: 7m 19s. Rate: 183.8 symbols/min [2025-09-16T21:15:34.158472] [INFO ] [MAIN ] FRO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:34.515552] [DEBUG] [LOCAL ] FRO: Loaded 38509 existing records from primary storage. [2025-09-16T21:15:34.516558] [INFO ] [MAIN ] FRO: Loaded 38509 primary data records. [2025-09-16T21:15:34.632724] [DEBUG] [MAIN ] FRA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:34.656356] [INFO ] [MAIN ] FRA: Generated 1339 derivative records from 10140 primary records. [2025-09-16T21:15:34.705404] [DEBUG] [LOCAL ] FRA: Saving derivative data. [2025-09-16T21:15:34.815793] [DEBUG] [MAIN ] FRGE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:34.817966] [INFO ] [MAIN ] FRGE: Generated 1339 derivative records from 11551 primary records. [2025-09-16T21:15:34.818979] [DEBUG] [LOCAL ] FRGE: Saving derivative data. [2025-09-16T21:15:34.820905] [DEBUG] [LOCAL ] FRA: Derivative data saved (1339 records). [2025-09-16T21:15:34.822595] [INFO ] [MAIN ] FRA: Successfully saved derivative data. [2025-09-16T21:15:34.824493] [INFO ] [MAIN ] Derivative Progress: 682/2026 symbols completed. FRA took 1.0s. Estimated remaining: 7m 19s. Rate: 183.5 symbols/min [2025-09-16T21:15:34.832059] [INFO ] [MAIN ] FRT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:34.838961] [DEBUG] [LOCAL ] FRGE: Derivative data saved (1339 records). [2025-09-16T21:15:34.839213] [INFO ] [MAIN ] FRGE: Successfully saved derivative data. [2025-09-16T21:15:34.841622] [INFO ] [MAIN ] Derivative Progress: 683/2026 symbols completed. FRGE took 1.0s. Estimated remaining: 7m 19s. Rate: 183.7 symbols/min [2025-09-16T21:15:34.842399] [INFO ] [MAIN ] FSCO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:34.877073] [DEBUG] [MAIN ] FRO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:34.878004] [INFO ] [MAIN ] FRO: Generated 1339 derivative records from 38509 primary records. [2025-09-16T21:15:34.878189] [DEBUG] [LOCAL ] FRO: Saving derivative data. [2025-09-16T21:15:34.891477] [DEBUG] [LOCAL ] FRO: Derivative data saved (1339 records). [2025-09-16T21:15:34.900757] [INFO ] [MAIN ] FRO: Successfully saved derivative data. [2025-09-16T21:15:34.911344] [INFO ] [MAIN ] Derivative Progress: 684/2026 symbols completed. FRO took 0.8s. Estimated remaining: 7m 18s. Rate: 184.0 symbols/min [2025-09-16T21:15:34.912102] [DEBUG] [LOCAL ] FRT: Loaded 31128 existing records from primary storage. [2025-09-16T21:15:34.912230] [INFO ] [MAIN ] FRT: Loaded 31128 primary data records. [2025-09-16T21:15:34.912824] [DEBUG] [LOCAL ] FSCO: Loaded 27172 existing records from primary storage. [2025-09-16T21:15:34.913047] [INFO ] [MAIN ] FSK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:34.944521] [INFO ] [MAIN ] FSCO: Loaded 27172 primary data records. [2025-09-16T21:15:35.387431] [DEBUG] [LOCAL ] FSK: Loaded 36028 existing records from primary storage. [2025-09-16T21:15:35.480997] [INFO ] [MAIN ] FSK: Loaded 36028 primary data records. [2025-09-16T21:15:35.773865] [DEBUG] [MAIN ] FRT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:35.776495] [INFO ] [MAIN ] FRT: Generated 1339 derivative records from 31128 primary records. [2025-09-16T21:15:35.777224] [DEBUG] [LOCAL ] FRT: Saving derivative data. [2025-09-16T21:15:35.797178] [DEBUG] [MAIN ] FSCO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:35.800196] [INFO ] [MAIN ] FSCO: Generated 1339 derivative records from 27172 primary records. [2025-09-16T21:15:35.801301] [DEBUG] [LOCAL ] FRT: Derivative data saved (1339 records). [2025-09-16T21:15:35.800779] [DEBUG] [LOCAL ] FSCO: Saving derivative data. [2025-09-16T21:15:35.801406] [INFO ] [MAIN ] FRT: Successfully saved derivative data. [2025-09-16T21:15:35.803211] [INFO ] [MAIN ] Derivative Progress: 685/2026 symbols completed. FRT took 1.0s. Estimated remaining: 7m 18s. Rate: 183.5 symbols/min [2025-09-16T21:15:35.803499] [INFO ] [MAIN ] FSLY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:35.816029] [DEBUG] [LOCAL ] FSCO: Derivative data saved (1339 records). [2025-09-16T21:15:35.816336] [INFO ] [MAIN ] FSCO: Successfully saved derivative data. [2025-09-16T21:15:35.818811] [INFO ] [MAIN ] Derivative Progress: 686/2026 symbols completed. FSCO took 1.0s. Estimated remaining: 7m 18s. Rate: 183.7 symbols/min [2025-09-16T21:15:35.819124] [INFO ] [MAIN ] FSM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:35.831625] [DEBUG] [MAIN ] FSK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:35.832273] [INFO ] [MAIN ] FSK: Generated 1339 derivative records from 36028 primary records. [2025-09-16T21:15:35.832393] [DEBUG] [LOCAL ] FSK: Saving derivative data. [2025-09-16T21:15:35.844597] [DEBUG] [LOCAL ] FSK: Derivative data saved (1339 records). [2025-09-16T21:15:35.844772] [INFO ] [MAIN ] FSK: Successfully saved derivative data. [2025-09-16T21:15:35.847329] [INFO ] [MAIN ] Derivative Progress: 687/2026 symbols completed. FSK took 0.9s. Estimated remaining: 7m 17s. Rate: 184.0 symbols/min [2025-09-16T21:15:35.847542] [INFO ] [MAIN ] FT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:35.863818] [DEBUG] [LOCAL ] FT: Loaded 4736 existing records from primary storage. [2025-09-16T21:15:35.864090] [INFO ] [MAIN ] FT: Loaded 4736 primary data records. [2025-09-16T21:15:35.987305] [DEBUG] [LOCAL ] FSLY: Loaded 38013 existing records from primary storage. [2025-09-16T21:15:35.997831] [INFO ] [MAIN ] FSLY: Loaded 38013 primary data records. [2025-09-16T21:15:36.030859] [DEBUG] [LOCAL ] FSM: Loaded 39669 existing records from primary storage. [2025-09-16T21:15:36.068510] [INFO ] [MAIN ] FSM: Loaded 39669 primary data records. [2025-09-16T21:15:36.751033] [DEBUG] [MAIN ] FT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:36.762267] [INFO ] [MAIN ] FT: Generated 1339 derivative records from 4736 primary records. [2025-09-16T21:15:36.763077] [DEBUG] [MAIN ] FSLY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:36.763160] [DEBUG] [LOCAL ] FT: Saving derivative data. [2025-09-16T21:15:36.764548] [INFO ] [MAIN ] FSLY: Generated 1339 derivative records from 38013 primary records. [2025-09-16T21:15:36.765020] [DEBUG] [LOCAL ] FSLY: Saving derivative data. [2025-09-16T21:15:36.785414] [DEBUG] [LOCAL ] FT: Derivative data saved (1339 records). [2025-09-16T21:15:36.786303] [DEBUG] [MAIN ] FSM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:36.786059] [INFO ] [MAIN ] FT: Successfully saved derivative data. [2025-09-16T21:15:36.788547] [INFO ] [MAIN ] Derivative Progress: 688/2026 symbols completed. FT took 0.9s. Estimated remaining: 7m 18s. Rate: 183.5 symbols/min [2025-09-16T21:15:36.794569] [INFO ] [MAIN ] FSM: Generated 1339 derivative records from 39669 primary records. [2025-09-16T21:15:36.794792] [DEBUG] [LOCAL ] FSM: Saving derivative data. [2025-09-16T21:15:36.811893] [DEBUG] [LOCAL ] FSLY: Derivative data saved (1339 records). [2025-09-16T21:15:36.813561] [INFO ] [MAIN ] FSLY: Successfully saved derivative data. [2025-09-16T21:15:36.813473] [DEBUG] [LOCAL ] FSM: Derivative data saved (1339 records). [2025-09-16T21:15:36.813707] [INFO ] [MAIN ] FSM: Successfully saved derivative data. [2025-09-16T21:15:36.816018] [INFO ] [MAIN ] Derivative Progress: 689/2026 symbols completed. FSLY took 1.0s. Estimated remaining: 7m 17s. Rate: 183.7 symbols/min [2025-09-16T21:15:36.818859] [INFO ] [MAIN ] Derivative Progress: 690/2026 symbols completed. FSM took 1.0s. Estimated remaining: 7m 16s. Rate: 184.0 symbols/min [2025-09-16T21:15:36.819316] [INFO ] [MAIN ] FTS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:36.819495] [INFO ] [MAIN ] FTHY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:36.819819] [INFO ] [MAIN ] FTI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:36.833149] [DEBUG] [LOCAL ] FTHY: Loaded 8557 existing records from primary storage. [2025-09-16T21:15:36.833403] [INFO ] [MAIN ] FTHY: Loaded 8557 primary data records. [2025-09-16T21:15:37.068232] [DEBUG] [LOCAL ] FTS: Loaded 31471 existing records from primary storage. [2025-09-16T21:15:37.067800] [DEBUG] [LOCAL ] FTI: Loaded 39696 existing records from primary storage. [2025-09-16T21:15:37.150727] [INFO ] [MAIN ] FTI: Loaded 39696 primary data records. [2025-09-16T21:15:37.150848] [INFO ] [MAIN ] FTS: Loaded 31471 primary data records. [2025-09-16T21:15:37.727618] [DEBUG] [MAIN ] FTHY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:37.729555] [INFO ] [MAIN ] FTHY: Generated 1339 derivative records from 8557 primary records. [2025-09-16T21:15:37.729696] [DEBUG] [LOCAL ] FTHY: Saving derivative data. [2025-09-16T21:15:37.743187] [DEBUG] [LOCAL ] FTHY: Derivative data saved (1339 records). [2025-09-16T21:15:37.743581] [INFO ] [MAIN ] FTHY: Successfully saved derivative data. [2025-09-16T21:15:37.745228] [INFO ] [MAIN ] Derivative Progress: 691/2026 symbols completed. FTHY took 0.9s. Estimated remaining: 7m 16s. Rate: 183.5 symbols/min [2025-09-16T21:15:37.745517] [INFO ] [MAIN ] FTV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:37.770695] [DEBUG] [MAIN ] FTI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:37.771926] [INFO ] [MAIN ] FTI: Generated 1339 derivative records from 39696 primary records. [2025-09-16T21:15:37.772081] [DEBUG] [LOCAL ] FTI: Saving derivative data. [2025-09-16T21:15:37.771220] [DEBUG] [MAIN ] FTS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:37.772845] [INFO ] [MAIN ] FTS: Generated 1339 derivative records from 31471 primary records. [2025-09-16T21:15:37.773544] [DEBUG] [LOCAL ] FTS: Saving derivative data. [2025-09-16T21:15:37.787456] [DEBUG] [LOCAL ] FTI: Derivative data saved (1339 records). [2025-09-16T21:15:37.797674] [INFO ] [MAIN ] FTI: Successfully saved derivative data. [2025-09-16T21:15:37.799873] [INFO ] [MAIN ] Derivative Progress: 692/2026 symbols completed. FTI took 1.0s. Estimated remaining: 7m 16s. Rate: 183.7 symbols/min [2025-09-16T21:15:37.801577] [INFO ] [MAIN ] FUBO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:37.803479] [DEBUG] [LOCAL ] FTS: Derivative data saved (1339 records). [2025-09-16T21:15:37.803744] [INFO ] [MAIN ] FTS: Successfully saved derivative data. [2025-09-16T21:15:37.819052] [INFO ] [MAIN ] Derivative Progress: 693/2026 symbols completed. FTS took 1.0s. Estimated remaining: 7m 15s. Rate: 184.0 symbols/min [2025-09-16T21:15:37.819409] [INFO ] [MAIN ] FUL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:37.836915] [DEBUG] [LOCAL ] FTV: Loaded 39565 existing records from primary storage. [2025-09-16T21:15:37.837112] [INFO ] [MAIN ] FTV: Loaded 39565 primary data records. [2025-09-16T21:15:37.961469] [DEBUG] [LOCAL ] FUL: Loaded 22955 existing records from primary storage. [2025-09-16T21:15:37.967605] [INFO ] [MAIN ] FUL: Loaded 22955 primary data records. [2025-09-16T21:15:38.095703] [DEBUG] [LOCAL ] FUBO: Loaded 40078 existing records from primary storage. [2025-09-16T21:15:38.119234] [INFO ] [MAIN ] FUBO: Loaded 40078 primary data records. [2025-09-16T21:15:38.758714] [DEBUG] [MAIN ] FTV: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:38.760084] [INFO ] [MAIN ] FTV: Generated 1339 derivative records from 39565 primary records. [2025-09-16T21:15:38.760506] [DEBUG] [LOCAL ] FTV: Saving derivative data. [2025-09-16T21:15:38.779213] [DEBUG] [LOCAL ] FTV: Derivative data saved (1339 records). [2025-09-16T21:15:38.789718] [INFO ] [MAIN ] FTV: Successfully saved derivative data. [2025-09-16T21:15:38.789608] [DEBUG] [MAIN ] FUL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:38.790701] [INFO ] [MAIN ] FUL: Generated 1339 derivative records from 22955 primary records. [2025-09-16T21:15:38.792910] [INFO ] [MAIN ] Derivative Progress: 694/2026 symbols completed. FTV took 1.0s. Estimated remaining: 7m 16s. Rate: 183.5 symbols/min [2025-09-16T21:15:38.793698] [DEBUG] [LOCAL ] FUL: Saving derivative data. [2025-09-16T21:15:38.794486] [INFO ] [MAIN ] FUN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:38.810851] [DEBUG] [LOCAL ] FUL: Derivative data saved (1339 records). [2025-09-16T21:15:38.811167] [INFO ] [MAIN ] FUL: Successfully saved derivative data. [2025-09-16T21:15:38.822655] [INFO ] [MAIN ] Derivative Progress: 695/2026 symbols completed. FUL took 1.0s. Estimated remaining: 7m 15s. Rate: 183.7 symbols/min [2025-09-16T21:15:38.823364] [INFO ] [MAIN ] FVRR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:38.823165] [DEBUG] [MAIN ] FUBO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:38.824332] [INFO ] [MAIN ] FUBO: Generated 1339 derivative records from 40078 primary records. [2025-09-16T21:15:38.826747] [DEBUG] [LOCAL ] FUBO: Saving derivative data. [2025-09-16T21:15:38.839463] [DEBUG] [LOCAL ] FUBO: Derivative data saved (1339 records). [2025-09-16T21:15:38.839554] [INFO ] [MAIN ] FUBO: Successfully saved derivative data. [2025-09-16T21:15:38.841713] [INFO ] [MAIN ] Derivative Progress: 696/2026 symbols completed. FUBO took 1.0s. Estimated remaining: 7m 14s. Rate: 183.9 symbols/min [2025-09-16T21:15:38.841959] [INFO ] [MAIN ] G: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:38.883707] [DEBUG] [LOCAL ] FVRR: Loaded 29987 existing records from primary storage. [2025-09-16T21:15:38.884370] [DEBUG] [LOCAL ] FUN: Loaded 38812 existing records from primary storage. [2025-09-16T21:15:38.884564] [INFO ] [MAIN ] FUN: Loaded 38812 primary data records. [2025-09-16T21:15:38.905261] [INFO ] [MAIN ] FVRR: Loaded 29987 primary data records. [2025-09-16T21:15:39.270884] [DEBUG] [LOCAL ] G: Loaded 37121 existing records from primary storage. [2025-09-16T21:15:39.288296] [INFO ] [MAIN ] G: Loaded 37121 primary data records. [2025-09-16T21:15:39.754618] [DEBUG] [MAIN ] FUN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:39.759680] [INFO ] [MAIN ] FUN: Generated 1339 derivative records from 38812 primary records. [2025-09-16T21:15:39.759960] [DEBUG] [LOCAL ] FUN: Saving derivative data. [2025-09-16T21:15:39.758865] [DEBUG] [MAIN ] FVRR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:39.761502] [INFO ] [MAIN ] FVRR: Generated 1339 derivative records from 29987 primary records. [2025-09-16T21:15:39.761946] [DEBUG] [LOCAL ] FVRR: Saving derivative data. [2025-09-16T21:15:39.785744] [DEBUG] [LOCAL ] FUN: Derivative data saved (1339 records). [2025-09-16T21:15:39.786231] [INFO ] [MAIN ] FUN: Successfully saved derivative data. [2025-09-16T21:15:39.788927] [INFO ] [MAIN ] Derivative Progress: 697/2026 symbols completed. FUN took 1.0s. Estimated remaining: 7m 15s. Rate: 183.4 symbols/min [2025-09-16T21:15:39.790280] [INFO ] [MAIN ] GAB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:39.802131] [DEBUG] [MAIN ] G: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:39.804696] [INFO ] [MAIN ] G: Generated 1339 derivative records from 37121 primary records. [2025-09-16T21:15:39.804573] [DEBUG] [LOCAL ] FVRR: Derivative data saved (1339 records). [2025-09-16T21:15:39.804914] [DEBUG] [LOCAL ] G: Saving derivative data. [2025-09-16T21:15:39.805007] [INFO ] [MAIN ] FVRR: Successfully saved derivative data. [2025-09-16T21:15:39.808296] [INFO ] [MAIN ] Derivative Progress: 698/2026 symbols completed. FVRR took 1.0s. Estimated remaining: 7m 14s. Rate: 183.7 symbols/min [2025-09-16T21:15:39.808885] [INFO ] [MAIN ] GAM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:39.826922] [DEBUG] [LOCAL ] G: Derivative data saved (1339 records). [2025-09-16T21:15:39.827101] [INFO ] [MAIN ] G: Successfully saved derivative data. [2025-09-16T21:15:39.829698] [INFO ] [MAIN ] Derivative Progress: 699/2026 symbols completed. G took 1.0s. Estimated remaining: 7m 13s. Rate: 183.9 symbols/min [2025-09-16T21:15:39.829887] [INFO ] [MAIN ] GAP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:39.834417] [DEBUG] [LOCAL ] GAM: Loaded 2806 existing records from primary storage. [2025-09-16T21:15:39.841620] [INFO ] [MAIN ] GAM: Loaded 2806 primary data records. [2025-09-16T21:15:39.847412] [DEBUG] [LOCAL ] GAB: Loaded 19527 existing records from primary storage. [2025-09-16T21:15:39.881505] [INFO ] [MAIN ] GAB: Loaded 19527 primary data records. [2025-09-16T21:15:40.272206] [DEBUG] [LOCAL ] GAP: Loaded 40007 existing records from primary storage. [2025-09-16T21:15:40.309702] [INFO ] [MAIN ] GAP: Loaded 40007 primary data records. [2025-09-16T21:15:40.726069] [DEBUG] [MAIN ] GAM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:40.728372] [INFO ] [MAIN ] GAM: Generated 1339 derivative records from 2806 primary records. [2025-09-16T21:15:40.728531] [DEBUG] [LOCAL ] GAM: Saving derivative data. [2025-09-16T21:15:40.745663] [DEBUG] [MAIN ] GAB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:40.750402] [INFO ] [MAIN ] GAB: Generated 1339 derivative records from 19527 primary records. [2025-09-16T21:15:40.752220] [DEBUG] [LOCAL ] GAM: Derivative data saved (1339 records). [2025-09-16T21:15:40.752470] [DEBUG] [LOCAL ] GAB: Saving derivative data. [2025-09-16T21:15:40.752425] [INFO ] [MAIN ] GAM: Successfully saved derivative data. [2025-09-16T21:15:40.755328] [INFO ] [MAIN ] Derivative Progress: 700/2026 symbols completed. GAM took 0.9s. Estimated remaining: 7m 14s. Rate: 183.5 symbols/min [2025-09-16T21:15:40.763773] [INFO ] [MAIN ] GATX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:40.766867] [DEBUG] [LOCAL ] GAB: Derivative data saved (1339 records). [2025-09-16T21:15:40.767369] [INFO ] [MAIN ] GAB: Successfully saved derivative data. [2025-09-16T21:15:40.769425] [INFO ] [MAIN ] Derivative Progress: 701/2026 symbols completed. GAB took 1.0s. Estimated remaining: 7m 13s. Rate: 183.7 symbols/min [2025-09-16T21:15:40.769840] [INFO ] [MAIN ] GBAB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:40.792377] [DEBUG] [MAIN ] GAP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:40.793252] [INFO ] [MAIN ] GAP: Generated 1339 derivative records from 40007 primary records. [2025-09-16T21:15:40.793377] [DEBUG] [LOCAL ] GAP: Saving derivative data. [2025-09-16T21:15:40.815430] [DEBUG] [LOCAL ] GBAB: Loaded 9666 existing records from primary storage. [2025-09-16T21:15:40.816559] [DEBUG] [LOCAL ] GATX: Loaded 13206 existing records from primary storage. [2025-09-16T21:15:40.817319] [INFO ] [MAIN ] GATX: Loaded 13206 primary data records. [2025-09-16T21:15:40.816968] [INFO ] [MAIN ] GBAB: Loaded 9666 primary data records. [2025-09-16T21:15:40.876045] [DEBUG] [LOCAL ] GAP: Derivative data saved (1339 records). [2025-09-16T21:15:40.949166] [INFO ] [MAIN ] GAP: Successfully saved derivative data. [2025-09-16T21:15:41.024854] [INFO ] [MAIN ] Derivative Progress: 702/2026 symbols completed. GAP took 1.2s. Estimated remaining: 7m 12s. Rate: 183.8 symbols/min [2025-09-16T21:15:41.075631] [INFO ] [MAIN ] GBCI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:41.444044] [DEBUG] [LOCAL ] GBCI: Loaded 29687 existing records from primary storage. [2025-09-16T21:15:41.444600] [INFO ] [MAIN ] GBCI: Loaded 29687 primary data records. [2025-09-16T21:15:41.593130] [DEBUG] [MAIN ] GBAB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:41.618898] [INFO ] [MAIN ] GBAB: Generated 1339 derivative records from 9666 primary records. [2025-09-16T21:15:41.619272] [DEBUG] [LOCAL ] GBAB: Saving derivative data. [2025-09-16T21:15:41.761810] [DEBUG] [MAIN ] GATX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:41.761888] [DEBUG] [LOCAL ] GBAB: Derivative data saved (1339 records). [2025-09-16T21:15:41.763273] [INFO ] [MAIN ] GBAB: Successfully saved derivative data. [2025-09-16T21:15:41.765198] [INFO ] [MAIN ] Derivative Progress: 703/2026 symbols completed. GBAB took 1.0s. Estimated remaining: 7m 13s. Rate: 183.4 symbols/min [2025-09-16T21:15:41.762971] [INFO ] [MAIN ] GATX: Generated 1339 derivative records from 13206 primary records. [2025-09-16T21:15:41.765557] [DEBUG] [LOCAL ] GATX: Saving derivative data. [2025-09-16T21:15:41.779420] [DEBUG] [LOCAL ] GATX: Derivative data saved (1339 records). [2025-09-16T21:15:41.779533] [INFO ] [MAIN ] GATX: Successfully saved derivative data. [2025-09-16T21:15:41.781711] [INFO ] [MAIN ] Derivative Progress: 704/2026 symbols completed. GATX took 1.0s. Estimated remaining: 7m 12s. Rate: 183.7 symbols/min [2025-09-16T21:15:41.796679] [DEBUG] [MAIN ] GBCI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:41.797272] [INFO ] [MAIN ] GBCI: Generated 1339 derivative records from 29687 primary records. [2025-09-16T21:15:41.797336] [DEBUG] [LOCAL ] GBCI: Saving derivative data. [2025-09-16T21:15:41.808779] [DEBUG] [LOCAL ] GBCI: Derivative data saved (1339 records). [2025-09-16T21:15:41.808847] [INFO ] [MAIN ] GBCI: Successfully saved derivative data. [2025-09-16T21:15:41.811019] [INFO ] [MAIN ] Derivative Progress: 705/2026 symbols completed. GBCI took 0.7s. Estimated remaining: 7m 11s. Rate: 183.9 symbols/min [2025-09-16T21:15:41.811595] [INFO ] [MAIN ] GBTG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:41.811547] [INFO ] [MAIN ] GBX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:41.811712] [INFO ] [MAIN ] GCI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:41.846981] [DEBUG] [LOCAL ] GBX: Loaded 20479 existing records from primary storage. [2025-09-16T21:15:41.847157] [INFO ] [MAIN ] GBX: Loaded 20479 primary data records. [2025-09-16T21:15:41.971126] [DEBUG] [LOCAL ] GBTG: Loaded 30025 existing records from primary storage. [2025-09-16T21:15:41.982274] [INFO ] [MAIN ] GBTG: Loaded 30025 primary data records. [2025-09-16T21:15:41.982211] [DEBUG] [LOCAL ] GCI: Loaded 32576 existing records from primary storage. [2025-09-16T21:15:42.020427] [INFO ] [MAIN ] GCI: Loaded 32576 primary data records. [2025-09-16T21:15:42.706685] [DEBUG] [MAIN ] GBX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:42.708046] [INFO ] [MAIN ] GBX: Generated 1339 derivative records from 20479 primary records. [2025-09-16T21:15:42.708982] [DEBUG] [LOCAL ] GBX: Saving derivative data. [2025-09-16T21:15:42.726000] [DEBUG] [LOCAL ] GBX: Derivative data saved (1339 records). [2025-09-16T21:15:42.726160] [INFO ] [MAIN ] GBX: Successfully saved derivative data. [2025-09-16T21:15:42.727817] [INFO ] [MAIN ] Derivative Progress: 706/2026 symbols completed. GBX took 0.9s. Estimated remaining: 7m 12s. Rate: 183.4 symbols/min [2025-09-16T21:15:42.734633] [INFO ] [MAIN ] GCO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:42.739208] [DEBUG] [MAIN ] GBTG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:42.740839] [INFO ] [MAIN ] GBTG: Generated 1339 derivative records from 30025 primary records. [2025-09-16T21:15:42.740991] [DEBUG] [LOCAL ] GBTG: Saving derivative data. [2025-09-16T21:15:42.760056] [DEBUG] [MAIN ] GCI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:42.761712] [INFO ] [MAIN ] GCI: Generated 1339 derivative records from 32576 primary records. [2025-09-16T21:15:42.763360] [DEBUG] [LOCAL ] GCI: Saving derivative data. [2025-09-16T21:15:42.764453] [DEBUG] [LOCAL ] GBTG: Derivative data saved (1339 records). [2025-09-16T21:15:42.768494] [INFO ] [MAIN ] GBTG: Successfully saved derivative data. [2025-09-16T21:15:42.770891] [INFO ] [MAIN ] Derivative Progress: 707/2026 symbols completed. GBTG took 1.0s. Estimated remaining: 7m 11s. Rate: 183.7 symbols/min [2025-09-16T21:15:42.777310] [INFO ] [MAIN ] GCTS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:42.794485] [DEBUG] [LOCAL ] GCI: Derivative data saved (1339 records). [2025-09-16T21:15:42.795982] [DEBUG] [LOCAL ] GCO: Loaded 17442 existing records from primary storage. [2025-09-16T21:15:42.795699] [INFO ] [MAIN ] GCI: Successfully saved derivative data. [2025-09-16T21:15:42.799129] [INFO ] [MAIN ] GCO: Loaded 17442 primary data records. [2025-09-16T21:15:42.799036] [INFO ] [MAIN ] Derivative Progress: 708/2026 symbols completed. GCI took 1.0s. Estimated remaining: 7m 10s. Rate: 183.9 symbols/min [2025-09-16T21:15:42.828787] [INFO ] [MAIN ] GD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:42.914890] [DEBUG] [LOCAL ] GCTS: Loaded 15587 existing records from primary storage. [2025-09-16T21:15:42.930897] [INFO ] [MAIN ] GCTS: Loaded 15587 primary data records. [2025-09-16T21:15:43.279499] [DEBUG] [LOCAL ] GD: Loaded 34593 existing records from primary storage. [2025-09-16T21:15:43.393935] [INFO ] [MAIN ] GD: Loaded 34593 primary data records. [2025-09-16T21:15:43.688986] [DEBUG] [MAIN ] GCO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:43.690106] [INFO ] [MAIN ] GCO: Generated 1339 derivative records from 17442 primary records. [2025-09-16T21:15:43.690768] [DEBUG] [LOCAL ] GCO: Saving derivative data. [2025-09-16T21:15:43.706899] [DEBUG] [LOCAL ] GCO: Derivative data saved (1339 records). [2025-09-16T21:15:43.707309] [INFO ] [MAIN ] GCO: Successfully saved derivative data. [2025-09-16T21:15:43.709001] [INFO ] [MAIN ] Derivative Progress: 709/2026 symbols completed. GCO took 1.0s. Estimated remaining: 7m 11s. Rate: 183.4 symbols/min [2025-09-16T21:15:43.709410] [INFO ] [MAIN ] GDDY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:43.719710] [DEBUG] [MAIN ] GCTS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:43.720920] [INFO ] [MAIN ] GCTS: Generated 1339 derivative records from 15587 primary records. [2025-09-16T21:15:43.721232] [DEBUG] [LOCAL ] GCTS: Saving derivative data. [2025-09-16T21:15:43.735137] [DEBUG] [LOCAL ] GCTS: Derivative data saved (1339 records). [2025-09-16T21:15:43.735467] [INFO ] [MAIN ] GCTS: Successfully saved derivative data. [2025-09-16T21:15:43.738398] [INFO ] [MAIN ] Derivative Progress: 710/2026 symbols completed. GCTS took 1.0s. Estimated remaining: 7m 10s. Rate: 183.7 symbols/min [2025-09-16T21:15:43.740277] [INFO ] [MAIN ] GDIV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:43.750809] [DEBUG] [MAIN ] GD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:43.751517] [INFO ] [MAIN ] GD: Generated 1339 derivative records from 34593 primary records. [2025-09-16T21:15:43.752442] [DEBUG] [LOCAL ] GD: Saving derivative data. [2025-09-16T21:15:43.766458] [DEBUG] [LOCAL ] GDIV: Loaded 2606 existing records from primary storage. [2025-09-16T21:15:43.768013] [INFO ] [MAIN ] GDIV: Loaded 2606 primary data records. [2025-09-16T21:15:43.788399] [DEBUG] [LOCAL ] GD: Derivative data saved (1339 records). [2025-09-16T21:15:43.832548] [INFO ] [MAIN ] GD: Successfully saved derivative data. [2025-09-16T21:15:43.858238] [INFO ] [MAIN ] Derivative Progress: 711/2026 symbols completed. GD took 1.0s. Estimated remaining: 7m 9s. Rate: 183.8 symbols/min [2025-09-16T21:15:43.883226] [DEBUG] [LOCAL ] GDDY: Loaded 36908 existing records from primary storage. [2025-09-16T21:15:43.894705] [INFO ] [MAIN ] GDDY: Loaded 36908 primary data records. [2025-09-16T21:15:43.894927] [INFO ] [MAIN ] GDO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:44.149610] [DEBUG] [LOCAL ] GDO: Loaded 4393 existing records from primary storage. [2025-09-16T21:15:44.176225] [INFO ] [MAIN ] GDO: Loaded 4393 primary data records. [2025-09-16T21:15:44.620845] [DEBUG] [MAIN ] GDIV: Filtered 5181 bins outside market hours, 5780 incomplete bins [2025-09-16T21:15:44.623441] [INFO ] [MAIN ] GDIV: Generated 1338 derivative records from 2606 primary records. [2025-09-16T21:15:44.624288] [DEBUG] [LOCAL ] GDIV: Saving derivative data. [2025-09-16T21:15:44.647545] [DEBUG] [LOCAL ] GDIV: Derivative data saved (1338 records). [2025-09-16T21:15:44.648239] [INFO ] [MAIN ] GDIV: Successfully saved derivative data. [2025-09-16T21:15:44.648168] [DEBUG] [MAIN ] GDDY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:44.649121] [INFO ] [MAIN ] GDDY: Generated 1339 derivative records from 36908 primary records. [2025-09-16T21:15:44.650842] [INFO ] [MAIN ] Derivative Progress: 712/2026 symbols completed. GDIV took 0.9s. Estimated remaining: 7m 10s. Rate: 183.5 symbols/min [2025-09-16T21:15:44.651341] [INFO ] [MAIN ] GDV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:44.651527] [DEBUG] [LOCAL ] GDDY: Saving derivative data. [2025-09-16T21:15:44.667968] [DEBUG] [LOCAL ] GDDY: Derivative data saved (1339 records). [2025-09-16T21:15:44.673964] [INFO ] [MAIN ] GDDY: Successfully saved derivative data. [2025-09-16T21:15:44.677868] [DEBUG] [MAIN ] GDO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:44.680752] [INFO ] [MAIN ] Derivative Progress: 713/2026 symbols completed. GDDY took 1.0s. Estimated remaining: 7m 9s. Rate: 183.7 symbols/min [2025-09-16T21:15:44.681733] [INFO ] [MAIN ] GDO: Generated 1339 derivative records from 4393 primary records. [2025-09-16T21:15:44.681854] [DEBUG] [LOCAL ] GDO: Saving derivative data. [2025-09-16T21:15:44.681069] [INFO ] [MAIN ] GEF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:44.699866] [DEBUG] [LOCAL ] GDO: Derivative data saved (1339 records). [2025-09-16T21:15:44.705477] [INFO ] [MAIN ] GDO: Successfully saved derivative data. [2025-09-16T21:15:44.707831] [INFO ] [MAIN ] Derivative Progress: 714/2026 symbols completed. GDO took 0.8s. Estimated remaining: 7m 8s. Rate: 183.9 symbols/min [2025-09-16T21:15:44.708230] [DEBUG] [LOCAL ] GDV: Loaded 14371 existing records from primary storage. [2025-09-16T21:15:44.708682] [INFO ] [MAIN ] GEL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:44.708851] [INFO ] [MAIN ] GDV: Loaded 14371 primary data records. [2025-09-16T21:15:44.806448] [DEBUG] [LOCAL ] GEF: Loaded 15462 existing records from primary storage. [2025-09-16T21:15:44.820378] [INFO ] [MAIN ] GEF: Loaded 15462 primary data records. [2025-09-16T21:15:45.134807] [DEBUG] [LOCAL ] GEL: Loaded 24970 existing records from primary storage. [2025-09-16T21:15:45.156249] [INFO ] [MAIN ] GEL: Loaded 24970 primary data records. [2025-09-16T21:15:45.617085] [DEBUG] [MAIN ] GDV: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:45.620261] [INFO ] [MAIN ] GDV: Generated 1339 derivative records from 14371 primary records. [2025-09-16T21:15:45.620473] [DEBUG] [LOCAL ] GDV: Saving derivative data. [2025-09-16T21:15:45.642788] [DEBUG] [MAIN ] GEF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:45.644080] [INFO ] [MAIN ] GEF: Generated 1339 derivative records from 15462 primary records. [2025-09-16T21:15:45.644321] [DEBUG] [LOCAL ] GEF: Saving derivative data. [2025-09-16T21:15:45.644362] [DEBUG] [LOCAL ] GDV: Derivative data saved (1339 records). [2025-09-16T21:15:45.645300] [INFO ] [MAIN ] GDV: Successfully saved derivative data. [2025-09-16T21:15:45.655004] [INFO ] [MAIN ] Derivative Progress: 715/2026 symbols completed. GDV took 1.0s. Estimated remaining: 7m 9s. Rate: 183.5 symbols/min [2025-09-16T21:15:45.657347] [INFO ] [MAIN ] GENI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:45.658288] [DEBUG] [LOCAL ] GEF: Derivative data saved (1339 records). [2025-09-16T21:15:45.660509] [INFO ] [MAIN ] GEF: Successfully saved derivative data. [2025-09-16T21:15:45.663560] [INFO ] [MAIN ] Derivative Progress: 716/2026 symbols completed. GEF took 1.0s. Estimated remaining: 7m 8s. Rate: 183.7 symbols/min [2025-09-16T21:15:45.663804] [INFO ] [MAIN ] GEO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:45.675068] [DEBUG] [MAIN ] GEL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:45.676069] [INFO ] [MAIN ] GEL: Generated 1339 derivative records from 24970 primary records. [2025-09-16T21:15:45.676186] [DEBUG] [LOCAL ] GEL: Saving derivative data. [2025-09-16T21:15:45.689727] [DEBUG] [LOCAL ] GEL: Derivative data saved (1339 records). [2025-09-16T21:15:45.689935] [INFO ] [MAIN ] GEL: Successfully saved derivative data. [2025-09-16T21:15:45.692773] [INFO ] [MAIN ] Derivative Progress: 717/2026 symbols completed. GEL took 1.0s. Estimated remaining: 7m 7s. Rate: 183.9 symbols/min [2025-09-16T21:15:45.693072] [INFO ] [MAIN ] GES: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:45.732159] [DEBUG] [LOCAL ] GEO: Loaded 38814 existing records from primary storage. [2025-09-16T21:15:45.732366] [INFO ] [MAIN ] GEO: Loaded 38814 primary data records. [2025-09-16T21:15:45.854901] [DEBUG] [LOCAL ] GENI: Loaded 39386 existing records from primary storage. [2025-09-16T21:15:45.870854] [INFO ] [MAIN ] GENI: Loaded 39386 primary data records. [2025-09-16T21:15:46.105923] [DEBUG] [LOCAL ] GES: Loaded 28333 existing records from primary storage. [2025-09-16T21:15:46.117585] [INFO ] [MAIN ] GES: Loaded 28333 primary data records. [2025-09-16T21:15:46.589806] [DEBUG] [MAIN ] GEO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:46.590909] [INFO ] [MAIN ] GEO: Generated 1339 derivative records from 38814 primary records. [2025-09-16T21:15:46.591478] [DEBUG] [LOCAL ] GEO: Saving derivative data. [2025-09-16T21:15:46.617804] [DEBUG] [MAIN ] GENI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:46.617475] [DEBUG] [LOCAL ] GEO: Derivative data saved (1339 records). [2025-09-16T21:15:46.618505] [INFO ] [MAIN ] GENI: Generated 1339 derivative records from 39386 primary records. [2025-09-16T21:15:46.618672] [INFO ] [MAIN ] GEO: Successfully saved derivative data. [2025-09-16T21:15:46.620678] [DEBUG] [LOCAL ] GENI: Saving derivative data. [2025-09-16T21:15:46.620613] [INFO ] [MAIN ] Derivative Progress: 718/2026 symbols completed. GEO took 1.0s. Estimated remaining: 7m 8s. Rate: 183.5 symbols/min [2025-09-16T21:15:46.635129] [DEBUG] [LOCAL ] GENI: Derivative data saved (1339 records). [2025-09-16T21:15:46.635275] [INFO ] [MAIN ] GENI: Successfully saved derivative data. [2025-09-16T21:15:46.637617] [INFO ] [MAIN ] Derivative Progress: 719/2026 symbols completed. GENI took 1.0s. Estimated remaining: 7m 7s. Rate: 183.7 symbols/min [2025-09-16T21:15:46.647679] [DEBUG] [MAIN ] GES: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:46.648258] [INFO ] [MAIN ] GES: Generated 1339 derivative records from 28333 primary records. [2025-09-16T21:15:46.648320] [DEBUG] [LOCAL ] GES: Saving derivative data. [2025-09-16T21:15:46.660081] [DEBUG] [LOCAL ] GES: Derivative data saved (1339 records). [2025-09-16T21:15:46.660146] [INFO ] [MAIN ] GES: Successfully saved derivative data. [2025-09-16T21:15:46.662275] [INFO ] [MAIN ] Derivative Progress: 720/2026 symbols completed. GES took 1.0s. Estimated remaining: 7m 6s. Rate: 184.0 symbols/min [2025-09-16T21:15:46.662818] [INFO ] [MAIN ] GETY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:46.662779] [INFO ] [MAIN ] GF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:46.662957] [INFO ] [MAIN ] GFI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:46.667595] [DEBUG] [LOCAL ] GF: Loaded 2114 existing records from primary storage. [2025-09-16T21:15:46.667765] [INFO ] [MAIN ] GF: Loaded 2114 primary data records. [2025-09-16T21:15:46.880045] [DEBUG] [LOCAL ] GETY: Loaded 25881 existing records from primary storage. [2025-09-16T21:15:46.965533] [INFO ] [MAIN ] GETY: Loaded 25881 primary data records. [2025-09-16T21:15:47.046230] [DEBUG] [LOCAL ] GFI: Loaded 39500 existing records from primary storage. [2025-09-16T21:15:47.075957] [INFO ] [MAIN ] GFI: Loaded 39500 primary data records. [2025-09-16T21:15:47.574614] [DEBUG] [MAIN ] GF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:47.575914] [INFO ] [MAIN ] GF: Generated 1339 derivative records from 2114 primary records. [2025-09-16T21:15:47.576085] [DEBUG] [LOCAL ] GF: Saving derivative data. [2025-09-16T21:15:47.590120] [DEBUG] [LOCAL ] GF: Derivative data saved (1339 records). [2025-09-16T21:15:47.590887] [INFO ] [MAIN ] GF: Successfully saved derivative data. [2025-09-16T21:15:47.593089] [INFO ] [MAIN ] Derivative Progress: 721/2026 symbols completed. GF took 0.9s. Estimated remaining: 7m 7s. Rate: 183.5 symbols/min [2025-09-16T21:15:47.593463] [INFO ] [MAIN ] GFL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:47.609128] [DEBUG] [MAIN ] GETY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:47.610213] [INFO ] [MAIN ] GETY: Generated 1339 derivative records from 25881 primary records. [2025-09-16T21:15:47.610340] [DEBUG] [LOCAL ] GETY: Saving derivative data. [2025-09-16T21:15:47.625168] [DEBUG] [LOCAL ] GETY: Derivative data saved (1339 records). [2025-09-16T21:15:47.633788] [INFO ] [MAIN ] GETY: Successfully saved derivative data. [2025-09-16T21:15:47.641697] [INFO ] [MAIN ] Derivative Progress: 722/2026 symbols completed. GETY took 1.0s. Estimated remaining: 7m 6s. Rate: 183.7 symbols/min [2025-09-16T21:15:47.646270] [INFO ] [MAIN ] GFR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:47.646000] [DEBUG] [MAIN ] GFI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:47.647113] [INFO ] [MAIN ] GFI: Generated 1339 derivative records from 39500 primary records. [2025-09-16T21:15:47.647493] [DEBUG] [LOCAL ] GFI: Saving derivative data. [2025-09-16T21:15:47.674712] [DEBUG] [LOCAL ] GFL: Loaded 35126 existing records from primary storage. [2025-09-16T21:15:47.675410] [INFO ] [MAIN ] GFL: Loaded 35126 primary data records. [2025-09-16T21:15:47.675614] [DEBUG] [LOCAL ] GFI: Derivative data saved (1339 records). [2025-09-16T21:15:47.675994] [DEBUG] [LOCAL ] GFR: Loaded 5148 existing records from primary storage. [2025-09-16T21:15:47.696622] [INFO ] [MAIN ] GFI: Successfully saved derivative data. [2025-09-16T21:15:47.719061] [INFO ] [MAIN ] GFR: Loaded 5148 primary data records. [2025-09-16T21:15:47.733148] [INFO ] [MAIN ] Derivative Progress: 723/2026 symbols completed. GFI took 1.1s. Estimated remaining: 7m 5s. Rate: 183.9 symbols/min [2025-09-16T21:15:47.771346] [INFO ] [MAIN ] GGB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:48.251581] [DEBUG] [LOCAL ] GGB: Loaded 38267 existing records from primary storage. [2025-09-16T21:15:48.294592] [INFO ] [MAIN ] GGB: Loaded 38267 primary data records. [2025-09-16T21:15:48.585152] [DEBUG] [MAIN ] GFL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:48.587728] [INFO ] [MAIN ] GFL: Generated 1339 derivative records from 35126 primary records. [2025-09-16T21:15:48.588519] [DEBUG] [LOCAL ] GFL: Saving derivative data. [2025-09-16T21:15:48.608083] [DEBUG] [MAIN ] GFR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:48.609624] [INFO ] [MAIN ] GFR: Generated 1339 derivative records from 5148 primary records. [2025-09-16T21:15:48.610099] [DEBUG] [LOCAL ] GFR: Saving derivative data. [2025-09-16T21:15:48.622704] [DEBUG] [LOCAL ] GFL: Derivative data saved (1339 records). [2025-09-16T21:15:48.622816] [INFO ] [MAIN ] GFL: Successfully saved derivative data. [2025-09-16T21:15:48.625874] [INFO ] [MAIN ] Derivative Progress: 724/2026 symbols completed. GFL took 1.0s. Estimated remaining: 7m 6s. Rate: 183.4 symbols/min [2025-09-16T21:15:48.626840] [INFO ] [MAIN ] GGG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:48.628418] [DEBUG] [LOCAL ] GFR: Derivative data saved (1339 records). [2025-09-16T21:15:48.628788] [INFO ] [MAIN ] GFR: Successfully saved derivative data. [2025-09-16T21:15:48.631400] [INFO ] [MAIN ] Derivative Progress: 725/2026 symbols completed. GFR took 1.0s. Estimated remaining: 7m 5s. Rate: 183.7 symbols/min [2025-09-16T21:15:48.631730] [INFO ] [MAIN ] GGT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:48.644432] [DEBUG] [MAIN ] GGB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:48.647735] [INFO ] [MAIN ] GGB: Generated 1339 derivative records from 38267 primary records. [2025-09-16T21:15:48.647831] [DEBUG] [LOCAL ] GGB: Saving derivative data. [2025-09-16T21:15:48.664182] [DEBUG] [LOCAL ] GGT: Loaded 11129 existing records from primary storage. [2025-09-16T21:15:48.664393] [DEBUG] [LOCAL ] GGB: Derivative data saved (1339 records). [2025-09-16T21:15:48.664548] [INFO ] [MAIN ] GGB: Successfully saved derivative data. [2025-09-16T21:15:48.664508] [INFO ] [MAIN ] GGT: Loaded 11129 primary data records. [2025-09-16T21:15:48.666609] [INFO ] [MAIN ] Derivative Progress: 726/2026 symbols completed. GGB took 0.9s. Estimated remaining: 7m 4s. Rate: 183.9 symbols/min [2025-09-16T21:15:48.666824] [INFO ] [MAIN ] GGZ: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:48.764164] [DEBUG] [LOCAL ] GGZ: Loaded 1704 existing records from primary storage. [2025-09-16T21:15:48.791895] [INFO ] [MAIN ] GGZ: Loaded 1704 primary data records. [2025-09-16T21:15:48.845960] [DEBUG] [LOCAL ] GGG: Loaded 29913 existing records from primary storage. [2025-09-16T21:15:48.877166] [INFO ] [MAIN ] GGG: Loaded 29913 primary data records. [2025-09-16T21:15:49.509745] [DEBUG] [MAIN ] GGT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:49.510829] [INFO ] [MAIN ] GGT: Generated 1339 derivative records from 11129 primary records. [2025-09-16T21:15:49.511015] [DEBUG] [LOCAL ] GGT: Saving derivative data. [2025-09-16T21:15:49.536927] [DEBUG] [LOCAL ] GGT: Derivative data saved (1339 records). [2025-09-16T21:15:49.536854] [DEBUG] [MAIN ] GGG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:49.537167] [INFO ] [MAIN ] GGT: Successfully saved derivative data. [2025-09-16T21:15:49.543206] [INFO ] [MAIN ] GGG: Generated 1339 derivative records from 29913 primary records. [2025-09-16T21:15:49.548808] [INFO ] [MAIN ] Derivative Progress: 727/2026 symbols completed. GGT took 0.9s. Estimated remaining: 7m 5s. Rate: 183.5 symbols/min [2025-09-16T21:15:49.547143] [DEBUG] [MAIN ] GGZ: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:49.548914] [DEBUG] [LOCAL ] GGG: Saving derivative data. [2025-09-16T21:15:49.549119] [INFO ] [MAIN ] GHC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:49.549894] [INFO ] [MAIN ] GGZ: Generated 1339 derivative records from 1704 primary records. [2025-09-16T21:15:49.550343] [DEBUG] [LOCAL ] GGZ: Saving derivative data. [2025-09-16T21:15:49.573944] [DEBUG] [LOCAL ] GHC: Loaded 2082 existing records from primary storage. [2025-09-16T21:15:49.574588] [INFO ] [MAIN ] GHC: Loaded 2082 primary data records. [2025-09-16T21:15:49.597758] [DEBUG] [LOCAL ] GGZ: Derivative data saved (1339 records). [2025-09-16T21:15:49.597882] [INFO ] [MAIN ] GGZ: Successfully saved derivative data. [2025-09-16T21:15:49.597673] [DEBUG] [LOCAL ] GGG: Derivative data saved (1339 records). [2025-09-16T21:15:49.608355] [INFO ] [MAIN ] GGG: Successfully saved derivative data. [2025-09-16T21:15:49.610442] [INFO ] [MAIN ] Derivative Progress: 728/2026 symbols completed. GGZ took 0.9s. Estimated remaining: 7m 4s. Rate: 183.7 symbols/min [2025-09-16T21:15:49.618027] [INFO ] [MAIN ] Derivative Progress: 729/2026 symbols completed. GGG took 1.0s. Estimated remaining: 7m 3s. Rate: 183.9 symbols/min [2025-09-16T21:15:49.610706] [INFO ] [MAIN ] GHI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:49.628805] [INFO ] [MAIN ] GHLD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:49.765115] [DEBUG] [LOCAL ] GHI: Loaded 5260 existing records from primary storage. [2025-09-16T21:15:49.767732] [INFO ] [MAIN ] GHI: Loaded 5260 primary data records. [2025-09-16T21:15:49.767571] [DEBUG] [LOCAL ] GHLD: Loaded 3340 existing records from primary storage. [2025-09-16T21:15:49.788190] [INFO ] [MAIN ] GHLD: Loaded 3340 primary data records. [2025-09-16T21:15:50.437350] [DEBUG] [MAIN ] GHC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:50.438248] [INFO ] [MAIN ] GHC: Generated 1339 derivative records from 2082 primary records. [2025-09-16T21:15:50.439093] [DEBUG] [LOCAL ] GHC: Saving derivative data. [2025-09-16T21:15:50.451152] [DEBUG] [LOCAL ] GHC: Derivative data saved (1339 records). [2025-09-16T21:15:50.451333] [INFO ] [MAIN ] GHC: Successfully saved derivative data. [2025-09-16T21:15:50.453365] [INFO ] [MAIN ] Derivative Progress: 730/2026 symbols completed. GHC took 0.9s. Estimated remaining: 7m 4s. Rate: 183.5 symbols/min [2025-09-16T21:15:50.453690] [INFO ] [MAIN ] GHM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:50.473188] [DEBUG] [MAIN ] GHLD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:50.474035] [INFO ] [MAIN ] GHLD: Generated 1339 derivative records from 3340 primary records. [2025-09-16T21:15:50.483346] [DEBUG] [LOCAL ] GHLD: Saving derivative data. [2025-09-16T21:15:50.487827] [DEBUG] [LOCAL ] GHM: Loaded 10550 existing records from primary storage. [2025-09-16T21:15:50.488144] [INFO ] [MAIN ] GHM: Loaded 10550 primary data records. [2025-09-16T21:15:50.488462] [DEBUG] [MAIN ] GHI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:50.526937] [INFO ] [MAIN ] GHI: Generated 1339 derivative records from 5260 primary records. [2025-09-16T21:15:50.539596] [DEBUG] [LOCAL ] GHI: Saving derivative data. [2025-09-16T21:15:50.579478] [DEBUG] [LOCAL ] GHLD: Derivative data saved (1339 records). [2025-09-16T21:15:50.601558] [INFO ] [MAIN ] GHLD: Successfully saved derivative data. [2025-09-16T21:15:50.609860] [INFO ] [MAIN ] Derivative Progress: 731/2026 symbols completed. GHLD took 1.0s. Estimated remaining: 7m 3s. Rate: 183.7 symbols/min [2025-09-16T21:15:50.624503] [INFO ] [MAIN ] GHY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:50.663471] [DEBUG] [LOCAL ] GHI: Derivative data saved (1339 records). [2025-09-16T21:15:50.691097] [INFO ] [MAIN ] GHI: Successfully saved derivative data. [2025-09-16T21:15:50.693534] [INFO ] [MAIN ] Derivative Progress: 732/2026 symbols completed. GHI took 1.1s. Estimated remaining: 7m 2s. Rate: 183.9 symbols/min [2025-09-16T21:15:50.779240] [INFO ] [MAIN ] GIB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:50.793540] [DEBUG] [LOCAL ] GHY: Loaded 14955 existing records from primary storage. [2025-09-16T21:15:50.794014] [INFO ] [MAIN ] GHY: Loaded 14955 primary data records. [2025-09-16T21:15:50.929251] [DEBUG] [LOCAL ] GIB: Loaded 22835 existing records from primary storage. [2025-09-16T21:15:50.939836] [INFO ] [MAIN ] GIB: Loaded 22835 primary data records. [2025-09-16T21:15:51.215362] [DEBUG] [MAIN ] GHM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:51.251504] [INFO ] [MAIN ] GHM: Generated 1339 derivative records from 10550 primary records. [2025-09-16T21:15:51.266520] [DEBUG] [LOCAL ] GHM: Saving derivative data. [2025-09-16T21:15:51.368601] [DEBUG] [LOCAL ] GHM: Derivative data saved (1339 records). [2025-09-16T21:15:51.369512] [INFO ] [MAIN ] GHM: Successfully saved derivative data. [2025-09-16T21:15:51.371464] [INFO ] [MAIN ] Derivative Progress: 733/2026 symbols completed. GHM took 0.9s. Estimated remaining: 7m 3s. Rate: 183.6 symbols/min [2025-09-16T21:15:51.388874] [DEBUG] [MAIN ] GHY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:51.389669] [INFO ] [MAIN ] GHY: Generated 1339 derivative records from 14955 primary records. [2025-09-16T21:15:51.389926] [DEBUG] [LOCAL ] GHY: Saving derivative data. [2025-09-16T21:15:51.404226] [DEBUG] [LOCAL ] GHY: Derivative data saved (1339 records). [2025-09-16T21:15:51.404435] [INFO ] [MAIN ] GHY: Successfully saved derivative data. [2025-09-16T21:15:51.415730] [INFO ] [MAIN ] Derivative Progress: 734/2026 symbols completed. GHY took 0.8s. Estimated remaining: 7m 2s. Rate: 183.8 symbols/min [2025-09-16T21:15:51.416413] [DEBUG] [MAIN ] GIB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:51.417075] [INFO ] [MAIN ] GIB: Generated 1339 derivative records from 22835 primary records. [2025-09-16T21:15:51.417139] [DEBUG] [LOCAL ] GIB: Saving derivative data. [2025-09-16T21:15:51.428778] [DEBUG] [LOCAL ] GIB: Derivative data saved (1339 records). [2025-09-16T21:15:51.428835] [INFO ] [MAIN ] GIB: Successfully saved derivative data. [2025-09-16T21:15:51.431065] [INFO ] [MAIN ] Derivative Progress: 735/2026 symbols completed. GIB took 0.7s. Estimated remaining: 7m 1s. Rate: 184.0 symbols/min [2025-09-16T21:15:51.431815] [INFO ] [MAIN ] GIC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:51.431659] [INFO ] [MAIN ] GIS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:51.431912] [INFO ] [MAIN ] GIL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:51.443368] [DEBUG] [LOCAL ] GIC: Loaded 9935 existing records from primary storage. [2025-09-16T21:15:51.443566] [INFO ] [MAIN ] GIC: Loaded 9935 primary data records. [2025-09-16T21:15:51.740859] [DEBUG] [LOCAL ] GIL: Loaded 31974 existing records from primary storage. [2025-09-16T21:15:51.731080] [DEBUG] [LOCAL ] GIS: Loaded 40031 existing records from primary storage. [2025-09-16T21:15:51.750043] [INFO ] [MAIN ] GIS: Loaded 40031 primary data records. [2025-09-16T21:15:51.749509] [INFO ] [MAIN ] GIL: Loaded 31974 primary data records. [2025-09-16T21:15:52.386049] [DEBUG] [MAIN ] GIC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:52.387693] [INFO ] [MAIN ] GIC: Generated 1339 derivative records from 9935 primary records. [2025-09-16T21:15:52.387882] [DEBUG] [LOCAL ] GIC: Saving derivative data. [2025-09-16T21:15:52.403428] [DEBUG] [LOCAL ] GIC: Derivative data saved (1339 records). [2025-09-16T21:15:52.403597] [INFO ] [MAIN ] GIC: Successfully saved derivative data. [2025-09-16T21:15:52.406005] [INFO ] [MAIN ] Derivative Progress: 736/2026 symbols completed. GIC took 1.0s. Estimated remaining: 7m 2s. Rate: 183.5 symbols/min [2025-09-16T21:15:52.406539] [INFO ] [MAIN ] GKOS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:52.420125] [DEBUG] [MAIN ] GIL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:52.421010] [INFO ] [MAIN ] GIL: Generated 1339 derivative records from 31974 primary records. [2025-09-16T21:15:52.421172] [DEBUG] [LOCAL ] GIL: Saving derivative data. [2025-09-16T21:15:52.435673] [DEBUG] [LOCAL ] GIL: Derivative data saved (1339 records). [2025-09-16T21:15:52.435797] [INFO ] [MAIN ] GIL: Successfully saved derivative data. [2025-09-16T21:15:52.443707] [INFO ] [MAIN ] Derivative Progress: 737/2026 symbols completed. GIL took 1.0s. Estimated remaining: 7m 1s. Rate: 183.8 symbols/min [2025-09-16T21:15:52.447667] [INFO ] [MAIN ] GL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:52.448010] [DEBUG] [MAIN ] GIS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:52.448993] [INFO ] [MAIN ] GIS: Generated 1339 derivative records from 40031 primary records. [2025-09-16T21:15:52.449380] [DEBUG] [LOCAL ] GIS: Saving derivative data. [2025-09-16T21:15:52.464574] [DEBUG] [LOCAL ] GIS: Derivative data saved (1339 records). [2025-09-16T21:15:52.473622] [INFO ] [MAIN ] GIS: Successfully saved derivative data. [2025-09-16T21:15:52.475826] [INFO ] [MAIN ] Derivative Progress: 738/2026 symbols completed. GIS took 1.0s. Estimated remaining: 7m 0s. Rate: 184.0 symbols/min [2025-09-16T21:15:52.476179] [INFO ] [MAIN ] GLOB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:52.495973] [DEBUG] [LOCAL ] GKOS: Loaded 31616 existing records from primary storage. [2025-09-16T21:15:52.504022] [INFO ] [MAIN ] GKOS: Loaded 31616 primary data records. [2025-09-16T21:15:52.624055] [DEBUG] [LOCAL ] GL: Loaded 27947 existing records from primary storage. [2025-09-16T21:15:52.635101] [INFO ] [MAIN ] GL: Loaded 27947 primary data records. [2025-09-16T21:15:52.864783] [DEBUG] [LOCAL ] GLOB: Loaded 35748 existing records from primary storage. [2025-09-16T21:15:52.897601] [INFO ] [MAIN ] GLOB: Loaded 35748 primary data records. [2025-09-16T21:15:53.362050] [DEBUG] [MAIN ] GKOS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:53.363576] [INFO ] [MAIN ] GKOS: Generated 1339 derivative records from 31616 primary records. [2025-09-16T21:15:53.364368] [DEBUG] [LOCAL ] GKOS: Saving derivative data. [2025-09-16T21:15:53.380509] [DEBUG] [LOCAL ] GKOS: Derivative data saved (1339 records). [2025-09-16T21:15:53.380822] [INFO ] [MAIN ] GKOS: Successfully saved derivative data. [2025-09-16T21:15:53.383063] [INFO ] [MAIN ] Derivative Progress: 739/2026 symbols completed. GKOS took 1.0s. Estimated remaining: 7m 1s. Rate: 183.6 symbols/min [2025-09-16T21:15:53.383612] [INFO ] [MAIN ] GLW: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:53.393600] [DEBUG] [MAIN ] GL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:53.394591] [INFO ] [MAIN ] GL: Generated 1339 derivative records from 27947 primary records. [2025-09-16T21:15:53.394881] [DEBUG] [LOCAL ] GL: Saving derivative data. [2025-09-16T21:15:53.407524] [DEBUG] [LOCAL ] GL: Derivative data saved (1339 records). [2025-09-16T21:15:53.407785] [INFO ] [MAIN ] GL: Successfully saved derivative data. [2025-09-16T21:15:53.410132] [INFO ] [MAIN ] Derivative Progress: 740/2026 symbols completed. GL took 1.0s. Estimated remaining: 6m 60s. Rate: 183.8 symbols/min [2025-09-16T21:15:53.411309] [INFO ] [MAIN ] GM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:53.425001] [DEBUG] [MAIN ] GLOB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:53.425699] [INFO ] [MAIN ] GLOB: Generated 1339 derivative records from 35748 primary records. [2025-09-16T21:15:53.425803] [DEBUG] [LOCAL ] GLOB: Saving derivative data. [2025-09-16T21:15:53.438618] [DEBUG] [LOCAL ] GLOB: Derivative data saved (1339 records). [2025-09-16T21:15:53.447887] [INFO ] [MAIN ] GLOB: Successfully saved derivative data. [2025-09-16T21:15:53.450352] [INFO ] [MAIN ] Derivative Progress: 741/2026 symbols completed. GLOB took 1.0s. Estimated remaining: 6m 59s. Rate: 184.0 symbols/min [2025-09-16T21:15:53.450713] [INFO ] [MAIN ] GME: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:53.467038] [DEBUG] [LOCAL ] GLW: Loaded 39988 existing records from primary storage. [2025-09-16T21:15:53.467257] [INFO ] [MAIN ] GLW: Loaded 39988 primary data records. [2025-09-16T21:15:53.637832] [DEBUG] [LOCAL ] GM: Loaded 40079 existing records from primary storage. [2025-09-16T21:15:53.659136] [INFO ] [MAIN ] GM: Loaded 40079 primary data records. [2025-09-16T21:15:53.781601] [DEBUG] [LOCAL ] GME: Loaded 40137 existing records from primary storage. [2025-09-16T21:15:53.849420] [INFO ] [MAIN ] GME: Loaded 40137 primary data records. [2025-09-16T21:15:54.417967] [DEBUG] [MAIN ] GLW: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:54.420016] [INFO ] [MAIN ] GLW: Generated 1339 derivative records from 39988 primary records. [2025-09-16T21:15:54.422329] [DEBUG] [LOCAL ] GLW: Saving derivative data. [2025-09-16T21:15:54.447651] [DEBUG] [MAIN ] GM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:54.450493] [INFO ] [MAIN ] GM: Generated 1339 derivative records from 40079 primary records. [2025-09-16T21:15:54.451717] [DEBUG] [LOCAL ] GM: Saving derivative data. [2025-09-16T21:15:54.452460] [DEBUG] [LOCAL ] GLW: Derivative data saved (1339 records). [2025-09-16T21:15:54.453393] [INFO ] [MAIN ] GLW: Successfully saved derivative data. [2025-09-16T21:15:54.457006] [INFO ] [MAIN ] Derivative Progress: 742/2026 symbols completed. GLW took 1.1s. Estimated remaining: 6m 60s. Rate: 183.5 symbols/min [2025-09-16T21:15:54.463662] [INFO ] [MAIN ] GMED: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:54.483687] [DEBUG] [LOCAL ] GM: Derivative data saved (1339 records). [2025-09-16T21:15:54.484153] [INFO ] [MAIN ] GM: Successfully saved derivative data. [2025-09-16T21:15:54.483940] [DEBUG] [MAIN ] GME: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:54.488093] [INFO ] [MAIN ] GME: Generated 1339 derivative records from 40137 primary records. [2025-09-16T21:15:54.487378] [INFO ] [MAIN ] Derivative Progress: 743/2026 symbols completed. GM took 1.1s. Estimated remaining: 6m 59s. Rate: 183.7 symbols/min [2025-09-16T21:15:54.488456] [DEBUG] [LOCAL ] GME: Saving derivative data. [2025-09-16T21:15:54.488564] [INFO ] [MAIN ] GMRE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:54.502160] [DEBUG] [LOCAL ] GME: Derivative data saved (1339 records). [2025-09-16T21:15:54.502277] [INFO ] [MAIN ] GME: Successfully saved derivative data. [2025-09-16T21:15:54.504419] [INFO ] [MAIN ] Derivative Progress: 744/2026 symbols completed. GME took 1.1s. Estimated remaining: 6m 58s. Rate: 183.9 symbols/min [2025-09-16T21:15:54.504689] [INFO ] [MAIN ] GNE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:54.545052] [DEBUG] [LOCAL ] GNE: Loaded 14670 existing records from primary storage. [2025-09-16T21:15:54.545879] [INFO ] [MAIN ] GNE: Loaded 14670 primary data records. [2025-09-16T21:15:54.545675] [DEBUG] [LOCAL ] GMRE: Loaded 28154 existing records from primary storage. [2025-09-16T21:15:54.557695] [INFO ] [MAIN ] GMRE: Loaded 28154 primary data records. [2025-09-16T21:15:54.780342] [DEBUG] [LOCAL ] GMED: Loaded 35875 existing records from primary storage. [2025-09-16T21:15:54.801180] [INFO ] [MAIN ] GMED: Loaded 35875 primary data records. [2025-09-16T21:15:55.447871] [DEBUG] [MAIN ] GNE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:55.448611] [INFO ] [MAIN ] GNE: Generated 1339 derivative records from 14670 primary records. [2025-09-16T21:15:55.449146] [DEBUG] [LOCAL ] GNE: Saving derivative data. [2025-09-16T21:15:55.463740] [DEBUG] [LOCAL ] GNE: Derivative data saved (1339 records). [2025-09-16T21:15:55.463959] [INFO ] [MAIN ] GNE: Successfully saved derivative data. [2025-09-16T21:15:55.465986] [INFO ] [MAIN ] Derivative Progress: 745/2026 symbols completed. GNE took 1.0s. Estimated remaining: 6m 59s. Rate: 183.5 symbols/min [2025-09-16T21:15:55.471932] [INFO ] [MAIN ] GNK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:55.477166] [DEBUG] [MAIN ] GMRE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:55.479325] [INFO ] [MAIN ] GMRE: Generated 1339 derivative records from 28154 primary records. [2025-09-16T21:15:55.479499] [DEBUG] [LOCAL ] GMRE: Saving derivative data. [2025-09-16T21:15:55.497927] [DEBUG] [MAIN ] GMED: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:55.501343] [DEBUG] [LOCAL ] GMRE: Derivative data saved (1339 records). [2025-09-16T21:15:55.500510] [INFO ] [MAIN ] GMED: Generated 1339 derivative records from 35875 primary records. [2025-09-16T21:15:55.501484] [INFO ] [MAIN ] GMRE: Successfully saved derivative data. [2025-09-16T21:15:55.503745] [INFO ] [MAIN ] Derivative Progress: 746/2026 symbols completed. GMRE took 1.0s. Estimated remaining: 6m 58s. Rate: 183.7 symbols/min [2025-09-16T21:15:55.504071] [INFO ] [MAIN ] GNL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:55.501519] [DEBUG] [LOCAL ] GMED: Saving derivative data. [2025-09-16T21:15:55.524116] [DEBUG] [LOCAL ] GMED: Derivative data saved (1339 records). [2025-09-16T21:15:55.524318] [INFO ] [MAIN ] GMED: Successfully saved derivative data. [2025-09-16T21:15:55.526867] [INFO ] [MAIN ] Derivative Progress: 747/2026 symbols completed. GMED took 1.1s. Estimated remaining: 6m 57s. Rate: 183.9 symbols/min [2025-09-16T21:15:55.527184] [INFO ] [MAIN ] GNRC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:55.539110] [DEBUG] [LOCAL ] GNK: Loaded 29717 existing records from primary storage. [2025-09-16T21:15:55.539318] [INFO ] [MAIN ] GNK: Loaded 29717 primary data records. [2025-09-16T21:15:55.682233] [DEBUG] [LOCAL ] GNL: Loaded 34634 existing records from primary storage. [2025-09-16T21:15:55.703095] [INFO ] [MAIN ] GNL: Loaded 34634 primary data records. [2025-09-16T21:15:55.901541] [DEBUG] [LOCAL ] GNRC: Loaded 33506 existing records from primary storage. [2025-09-16T21:15:55.940565] [INFO ] [MAIN ] GNRC: Loaded 33506 primary data records. [2025-09-16T21:15:56.413385] [DEBUG] [MAIN ] GNK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:56.414628] [INFO ] [MAIN ] GNK: Generated 1339 derivative records from 29717 primary records. [2025-09-16T21:15:56.415035] [DEBUG] [LOCAL ] GNK: Saving derivative data. [2025-09-16T21:15:56.429756] [DEBUG] [LOCAL ] GNK: Derivative data saved (1339 records). [2025-09-16T21:15:56.430004] [INFO ] [MAIN ] GNK: Successfully saved derivative data. [2025-09-16T21:15:56.431676] [INFO ] [MAIN ] Derivative Progress: 748/2026 symbols completed. GNK took 1.0s. Estimated remaining: 6m 58s. Rate: 183.5 symbols/min [2025-09-16T21:15:56.445370] [DEBUG] [MAIN ] GNL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:56.446054] [INFO ] [MAIN ] GNL: Generated 1339 derivative records from 34634 primary records. [2025-09-16T21:15:56.446241] [DEBUG] [LOCAL ] GNL: Saving derivative data. [2025-09-16T21:15:56.458899] [DEBUG] [LOCAL ] GNL: Derivative data saved (1339 records). [2025-09-16T21:15:56.460166] [INFO ] [MAIN ] GNL: Successfully saved derivative data. [2025-09-16T21:15:56.462584] [INFO ] [MAIN ] Derivative Progress: 749/2026 symbols completed. GNL took 1.0s. Estimated remaining: 6m 57s. Rate: 183.7 symbols/min [2025-09-16T21:15:56.472632] [DEBUG] [MAIN ] GNRC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:56.473339] [INFO ] [MAIN ] GNRC: Generated 1339 derivative records from 33506 primary records. [2025-09-16T21:15:56.473404] [DEBUG] [LOCAL ] GNRC: Saving derivative data. [2025-09-16T21:15:56.485424] [DEBUG] [LOCAL ] GNRC: Derivative data saved (1339 records). [2025-09-16T21:15:56.485531] [INFO ] [MAIN ] GNRC: Successfully saved derivative data. [2025-09-16T21:15:56.488096] [INFO ] [MAIN ] Derivative Progress: 750/2026 symbols completed. GNRC took 1.0s. Estimated remaining: 6m 56s. Rate: 183.9 symbols/min [2025-09-16T21:15:56.488703] [INFO ] [MAIN ] GNT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:56.488938] [INFO ] [MAIN ] GNTY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:56.488850] [INFO ] [MAIN ] GOF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:56.498137] [DEBUG] [LOCAL ] GNTY: Loaded 5679 existing records from primary storage. [2025-09-16T21:15:56.498308] [INFO ] [MAIN ] GNTY: Loaded 5679 primary data records. [2025-09-16T21:15:56.532209] [DEBUG] [LOCAL ] GNT: Loaded 5867 existing records from primary storage. [2025-09-16T21:15:56.556147] [INFO ] [MAIN ] GNT: Loaded 5867 primary data records. [2025-09-16T21:15:56.800175] [DEBUG] [LOCAL ] GOF: Loaded 31297 existing records from primary storage. [2025-09-16T21:15:56.810909] [INFO ] [MAIN ] GOF: Loaded 31297 primary data records. [2025-09-16T21:15:57.375477] [DEBUG] [MAIN ] GNTY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:57.377881] [INFO ] [MAIN ] GNTY: Generated 1339 derivative records from 5679 primary records. [2025-09-16T21:15:57.378249] [DEBUG] [LOCAL ] GNTY: Saving derivative data. [2025-09-16T21:15:57.389130] [DEBUG] [MAIN ] GNT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:57.390061] [INFO ] [MAIN ] GNT: Generated 1339 derivative records from 5867 primary records. [2025-09-16T21:15:57.396195] [DEBUG] [LOCAL ] GNT: Saving derivative data. [2025-09-16T21:15:57.409748] [DEBUG] [LOCAL ] GNTY: Derivative data saved (1339 records). [2025-09-16T21:15:57.410175] [INFO ] [MAIN ] GNTY: Successfully saved derivative data. [2025-09-16T21:15:57.412786] [DEBUG] [LOCAL ] GNT: Derivative data saved (1339 records). [2025-09-16T21:15:57.414477] [INFO ] [MAIN ] Derivative Progress: 751/2026 symbols completed. GNTY took 0.9s. Estimated remaining: 6m 57s. Rate: 183.5 symbols/min [2025-09-16T21:15:57.414841] [INFO ] [MAIN ] GNT: Successfully saved derivative data. [2025-09-16T21:15:57.417520] [INFO ] [MAIN ] Derivative Progress: 752/2026 symbols completed. GNT took 0.9s. Estimated remaining: 6m 56s. Rate: 183.7 symbols/min [2025-09-16T21:15:57.417721] [INFO ] [MAIN ] GPI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:57.417476] [INFO ] [MAIN ] GOTU: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:57.431833] [DEBUG] [MAIN ] GOF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:57.435260] [INFO ] [MAIN ] GOF: Generated 1339 derivative records from 31297 primary records. [2025-09-16T21:15:57.435374] [DEBUG] [LOCAL ] GOF: Saving derivative data. [2025-09-16T21:15:57.452985] [DEBUG] [LOCAL ] GPI: Loaded 10230 existing records from primary storage. [2025-09-16T21:15:57.454791] [INFO ] [MAIN ] GPI: Loaded 10230 primary data records. [2025-09-16T21:15:57.455030] [DEBUG] [LOCAL ] GOF: Derivative data saved (1339 records). [2025-09-16T21:15:57.491112] [INFO ] [MAIN ] GOF: Successfully saved derivative data. [2025-09-16T21:15:57.539461] [INFO ] [MAIN ] Derivative Progress: 753/2026 symbols completed. GOF took 1.1s. Estimated remaining: 6m 55s. Rate: 183.9 symbols/min [2025-09-16T21:15:57.555869] [INFO ] [MAIN ] GPJA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:57.646917] [DEBUG] [LOCAL ] GOTU: Loaded 27891 existing records from primary storage. [2025-09-16T21:15:57.648729] [INFO ] [MAIN ] GOTU: Loaded 27891 primary data records. [2025-09-16T21:15:57.736171] [DEBUG] [LOCAL ] GPJA: Loaded 3120 existing records from primary storage. [2025-09-16T21:15:57.748140] [INFO ] [MAIN ] GPJA: Loaded 3120 primary data records. [2025-09-16T21:15:58.294748] [DEBUG] [MAIN ] GPI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:58.296041] [INFO ] [MAIN ] GPI: Generated 1339 derivative records from 10230 primary records. [2025-09-16T21:15:58.296740] [DEBUG] [LOCAL ] GPI: Saving derivative data. [2025-09-16T21:15:58.311138] [DEBUG] [LOCAL ] GPI: Derivative data saved (1339 records). [2025-09-16T21:15:58.311384] [INFO ] [MAIN ] GPI: Successfully saved derivative data. [2025-09-16T21:15:58.313206] [INFO ] [MAIN ] Derivative Progress: 754/2026 symbols completed. GPI took 0.9s. Estimated remaining: 6m 56s. Rate: 183.5 symbols/min [2025-09-16T21:15:58.313517] [INFO ] [MAIN ] GPK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:58.327535] [DEBUG] [MAIN ] GOTU: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:58.328910] [INFO ] [MAIN ] GOTU: Generated 1339 derivative records from 27891 primary records. [2025-09-16T21:15:58.329033] [DEBUG] [LOCAL ] GOTU: Saving derivative data. [2025-09-16T21:15:58.347863] [DEBUG] [MAIN ] GPJA: Filtered 5181 bins outside market hours, 5780 incomplete bins [2025-09-16T21:15:58.349265] [INFO ] [MAIN ] GPJA: Generated 1338 derivative records from 3120 primary records. [2025-09-16T21:15:58.350275] [DEBUG] [LOCAL ] GPJA: Saving derivative data. [2025-09-16T21:15:58.352944] [DEBUG] [LOCAL ] GOTU: Derivative data saved (1339 records). [2025-09-16T21:15:58.361732] [INFO ] [MAIN ] GOTU: Successfully saved derivative data. [2025-09-16T21:15:58.373476] [INFO ] [MAIN ] Derivative Progress: 755/2026 symbols completed. GOTU took 1.0s. Estimated remaining: 6m 55s. Rate: 183.7 symbols/min [2025-09-16T21:15:58.375166] [INFO ] [MAIN ] GPMT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:58.375324] [DEBUG] [LOCAL ] GPJA: Derivative data saved (1338 records). [2025-09-16T21:15:58.375657] [INFO ] [MAIN ] GPJA: Successfully saved derivative data. [2025-09-16T21:15:58.377874] [INFO ] [MAIN ] Derivative Progress: 756/2026 symbols completed. GPJA took 0.8s. Estimated remaining: 6m 54s. Rate: 184.0 symbols/min [2025-09-16T21:15:58.378209] [INFO ] [MAIN ] GPOR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:58.394766] [DEBUG] [LOCAL ] GPK: Loaded 39401 existing records from primary storage. [2025-09-16T21:15:58.395020] [INFO ] [MAIN ] GPK: Loaded 39401 primary data records. [2025-09-16T21:15:58.531523] [DEBUG] [LOCAL ] GPMT: Loaded 20304 existing records from primary storage. [2025-09-16T21:15:58.547069] [INFO ] [MAIN ] GPMT: Loaded 20304 primary data records. [2025-09-16T21:15:58.531603] [DEBUG] [LOCAL ] GPOR: Loaded 16532 existing records from primary storage. [2025-09-16T21:15:58.592261] [INFO ] [MAIN ] GPOR: Loaded 16532 primary data records. [2025-09-16T21:15:59.308905] [DEBUG] [MAIN ] GPK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:59.310525] [INFO ] [MAIN ] GPK: Generated 1339 derivative records from 39401 primary records. [2025-09-16T21:15:59.310986] [DEBUG] [LOCAL ] GPK: Saving derivative data. [2025-09-16T21:15:59.326883] [DEBUG] [LOCAL ] GPK: Derivative data saved (1339 records). [2025-09-16T21:15:59.327277] [INFO ] [MAIN ] GPK: Successfully saved derivative data. [2025-09-16T21:15:59.329040] [INFO ] [MAIN ] Derivative Progress: 757/2026 symbols completed. GPK took 1.0s. Estimated remaining: 6m 55s. Rate: 183.5 symbols/min [2025-09-16T21:15:59.329305] [INFO ] [MAIN ] GPRK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:59.342390] [DEBUG] [MAIN ] GPOR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:59.343374] [INFO ] [MAIN ] GPOR: Generated 1339 derivative records from 16532 primary records. [2025-09-16T21:15:59.343578] [DEBUG] [LOCAL ] GPOR: Saving derivative data. [2025-09-16T21:15:59.368168] [DEBUG] [LOCAL ] GPOR: Derivative data saved (1339 records). [2025-09-16T21:15:59.365859] [DEBUG] [MAIN ] GPMT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:15:59.368562] [INFO ] [MAIN ] GPOR: Successfully saved derivative data. [2025-09-16T21:15:59.369548] [INFO ] [MAIN ] GPMT: Generated 1339 derivative records from 20304 primary records. [2025-09-16T21:15:59.369737] [DEBUG] [LOCAL ] GPMT: Saving derivative data. [2025-09-16T21:15:59.372102] [INFO ] [MAIN ] Derivative Progress: 758/2026 symbols completed. GPOR took 1.0s. Estimated remaining: 6m 54s. Rate: 183.7 symbols/min [2025-09-16T21:15:59.373491] [INFO ] [MAIN ] GRBK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:59.396579] [DEBUG] [LOCAL ] GPMT: Derivative data saved (1339 records). [2025-09-16T21:15:59.405814] [INFO ] [MAIN ] GPMT: Successfully saved derivative data. [2025-09-16T21:15:59.408508] [INFO ] [MAIN ] Derivative Progress: 759/2026 symbols completed. GPMT took 1.0s. Estimated remaining: 6m 53s. Rate: 183.9 symbols/min [2025-09-16T21:15:59.409760] [DEBUG] [LOCAL ] GPRK: Loaded 28709 existing records from primary storage. [2025-09-16T21:15:59.408918] [INFO ] [MAIN ] GRC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:15:59.409971] [INFO ] [MAIN ] GPRK: Loaded 28709 primary data records. [2025-09-16T21:15:59.529818] [DEBUG] [LOCAL ] GRBK: Loaded 19673 existing records from primary storage. [2025-09-16T21:15:59.543671] [INFO ] [MAIN ] GRBK: Loaded 19673 primary data records. [2025-09-16T21:15:59.533137] [DEBUG] [LOCAL ] GRC: Loaded 6338 existing records from primary storage. [2025-09-16T21:15:59.594045] [INFO ] [MAIN ] GRC: Loaded 6338 primary data records. [2025-09-16T21:16:00.293026] [DEBUG] [MAIN ] GPRK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:00.294541] [INFO ] [MAIN ] GPRK: Generated 1339 derivative records from 28709 primary records. [2025-09-16T21:16:00.294833] [DEBUG] [LOCAL ] GPRK: Saving derivative data. [2025-09-16T21:16:00.312368] [DEBUG] [LOCAL ] GPRK: Derivative data saved (1339 records). [2025-09-16T21:16:00.313589] [INFO ] [MAIN ] GPRK: Successfully saved derivative data. [2025-09-16T21:16:00.315518] [INFO ] [MAIN ] Derivative Progress: 760/2026 symbols completed. GPRK took 1.0s. Estimated remaining: 6m 54s. Rate: 183.5 symbols/min [2025-09-16T21:16:00.315818] [INFO ] [MAIN ] GRDN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:00.336836] [DEBUG] [MAIN ] GRBK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:00.337211] [DEBUG] [MAIN ] GRC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:00.338050] [INFO ] [MAIN ] GRBK: Generated 1339 derivative records from 19673 primary records. [2025-09-16T21:16:00.339157] [DEBUG] [LOCAL ] GRBK: Saving derivative data. [2025-09-16T21:16:00.338969] [INFO ] [MAIN ] GRC: Generated 1339 derivative records from 6338 primary records. [2025-09-16T21:16:00.339285] [DEBUG] [LOCAL ] GRC: Saving derivative data. [2025-09-16T21:16:00.368205] [DEBUG] [LOCAL ] GRC: Derivative data saved (1339 records). [2025-09-16T21:16:00.368735] [INFO ] [MAIN ] GRC: Successfully saved derivative data. [2025-09-16T21:16:00.368892] [DEBUG] [LOCAL ] GRBK: Derivative data saved (1339 records). [2025-09-16T21:16:00.371277] [INFO ] [MAIN ] Derivative Progress: 761/2026 symbols completed. GRC took 1.0s. Estimated remaining: 6m 53s. Rate: 183.7 symbols/min [2025-09-16T21:16:00.377184] [INFO ] [MAIN ] GRMN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:00.377600] [INFO ] [MAIN ] GRBK: Successfully saved derivative data. [2025-09-16T21:16:00.377963] [DEBUG] [LOCAL ] GRDN: Loaded 15220 existing records from primary storage. [2025-09-16T21:16:00.378328] [INFO ] [MAIN ] GRDN: Loaded 15220 primary data records. [2025-09-16T21:16:00.380736] [INFO ] [MAIN ] Derivative Progress: 762/2026 symbols completed. GRBK took 1.0s. Estimated remaining: 6m 52s. Rate: 183.9 symbols/min [2025-09-16T21:16:00.381205] [INFO ] [MAIN ] GRND: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:00.694759] [DEBUG] [LOCAL ] GRMN: Loaded 30105 existing records from primary storage. [2025-09-16T21:16:00.693809] [DEBUG] [LOCAL ] GRND: Loaded 37247 existing records from primary storage. [2025-09-16T21:16:00.695076] [INFO ] [MAIN ] GRMN: Loaded 30105 primary data records. [2025-09-16T21:16:00.695038] [INFO ] [MAIN ] GRND: Loaded 37247 primary data records. [2025-09-16T21:16:01.245770] [DEBUG] [MAIN ] GRDN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:01.247497] [INFO ] [MAIN ] GRDN: Generated 1339 derivative records from 15220 primary records. [2025-09-16T21:16:01.247797] [DEBUG] [LOCAL ] GRDN: Saving derivative data. [2025-09-16T21:16:01.264910] [DEBUG] [LOCAL ] GRDN: Derivative data saved (1339 records). [2025-09-16T21:16:01.265151] [INFO ] [MAIN ] GRDN: Successfully saved derivative data. [2025-09-16T21:16:01.267711] [INFO ] [MAIN ] Derivative Progress: 763/2026 symbols completed. GRDN took 1.0s. Estimated remaining: 6m 53s. Rate: 183.5 symbols/min [2025-09-16T21:16:01.283636] [DEBUG] [MAIN ] GRND: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:01.284341] [INFO ] [MAIN ] GRND: Generated 1339 derivative records from 37247 primary records. [2025-09-16T21:16:01.284414] [DEBUG] [LOCAL ] GRND: Saving derivative data. [2025-09-16T21:16:01.307306] [DEBUG] [MAIN ] GRMN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:01.308530] [INFO ] [MAIN ] GRMN: Generated 1339 derivative records from 30105 primary records. [2025-09-16T21:16:01.307913] [DEBUG] [LOCAL ] GRND: Derivative data saved (1339 records). [2025-09-16T21:16:01.308655] [DEBUG] [LOCAL ] GRMN: Saving derivative data. [2025-09-16T21:16:01.308723] [INFO ] [MAIN ] GRND: Successfully saved derivative data. [2025-09-16T21:16:01.311327] [INFO ] [MAIN ] Derivative Progress: 764/2026 symbols completed. GRND took 0.9s. Estimated remaining: 6m 52s. Rate: 183.7 symbols/min [2025-09-16T21:16:01.322981] [DEBUG] [LOCAL ] GRMN: Derivative data saved (1339 records). [2025-09-16T21:16:01.323046] [INFO ] [MAIN ] GRMN: Successfully saved derivative data. [2025-09-16T21:16:01.325931] [INFO ] [MAIN ] Derivative Progress: 765/2026 symbols completed. GRMN took 0.9s. Estimated remaining: 6m 51s. Rate: 184.0 symbols/min [2025-09-16T21:16:01.326537] [INFO ] [MAIN ] GRX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:01.326457] [INFO ] [MAIN ] GROV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:01.326407] [INFO ] [MAIN ] GRNT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:01.332581] [DEBUG] [LOCAL ] GRX: Loaded 3340 existing records from primary storage. [2025-09-16T21:16:01.332782] [INFO ] [MAIN ] GRX: Loaded 3340 primary data records. [2025-09-16T21:16:01.448303] [DEBUG] [LOCAL ] GROV: Loaded 6863 existing records from primary storage. [2025-09-16T21:16:01.451920] [INFO ] [MAIN ] GROV: Loaded 6863 primary data records. [2025-09-16T21:16:01.751297] [DEBUG] [LOCAL ] GRNT: Loaded 24876 existing records from primary storage. [2025-09-16T21:16:01.765815] [INFO ] [MAIN ] GRNT: Loaded 24876 primary data records. [2025-09-16T21:16:02.253036] [DEBUG] [MAIN ] GRX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:02.255708] [INFO ] [MAIN ] GRX: Generated 1339 derivative records from 3340 primary records. [2025-09-16T21:16:02.256197] [DEBUG] [LOCAL ] GRX: Saving derivative data. [2025-09-16T21:16:02.266492] [DEBUG] [MAIN ] GROV: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:02.267835] [INFO ] [MAIN ] GROV: Generated 1339 derivative records from 6863 primary records. [2025-09-16T21:16:02.267920] [DEBUG] [LOCAL ] GROV: Saving derivative data. [2025-09-16T21:16:02.292848] [DEBUG] [LOCAL ] GRX: Derivative data saved (1339 records). [2025-09-16T21:16:02.294007] [INFO ] [MAIN ] GRX: Successfully saved derivative data. [2025-09-16T21:16:02.296029] [INFO ] [MAIN ] Derivative Progress: 766/2026 symbols completed. GRX took 1.0s. Estimated remaining: 6m 52s. Rate: 183.5 symbols/min [2025-09-16T21:16:02.293027] [DEBUG] [LOCAL ] GROV: Derivative data saved (1339 records). [2025-09-16T21:16:02.296428] [INFO ] [MAIN ] GS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:02.296245] [INFO ] [MAIN ] GROV: Successfully saved derivative data. [2025-09-16T21:16:02.300272] [INFO ] [MAIN ] Derivative Progress: 767/2026 symbols completed. GROV took 1.0s. Estimated remaining: 6m 51s. Rate: 183.7 symbols/min [2025-09-16T21:16:02.301281] [INFO ] [MAIN ] GSBD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:02.314050] [DEBUG] [MAIN ] GRNT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:02.314798] [INFO ] [MAIN ] GRNT: Generated 1339 derivative records from 24876 primary records. [2025-09-16T21:16:02.314924] [DEBUG] [LOCAL ] GRNT: Saving derivative data. [2025-09-16T21:16:02.329988] [DEBUG] [LOCAL ] GRNT: Derivative data saved (1339 records). [2025-09-16T21:16:02.330165] [INFO ] [MAIN ] GRNT: Successfully saved derivative data. [2025-09-16T21:16:02.335575] [INFO ] [MAIN ] Derivative Progress: 768/2026 symbols completed. GRNT took 1.0s. Estimated remaining: 6m 50s. Rate: 183.9 symbols/min [2025-09-16T21:16:02.336182] [INFO ] [MAIN ] GSK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:02.370360] [DEBUG] [LOCAL ] GSBD: Loaded 28138 existing records from primary storage. [2025-09-16T21:16:02.381190] [INFO ] [MAIN ] GSBD: Loaded 28138 primary data records. [2025-09-16T21:16:02.392982] [DEBUG] [LOCAL ] GS: Loaded 38615 existing records from primary storage. [2025-09-16T21:16:02.420738] [INFO ] [MAIN ] GS: Loaded 38615 primary data records. [2025-09-16T21:16:02.734696] [DEBUG] [LOCAL ] GSK: Loaded 39887 existing records from primary storage. [2025-09-16T21:16:02.787934] [INFO ] [MAIN ] GSK: Loaded 39887 primary data records. [2025-09-16T21:16:03.284731] [DEBUG] [MAIN ] GS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:03.285737] [INFO ] [MAIN ] GS: Generated 1339 derivative records from 38615 primary records. [2025-09-16T21:16:03.294695] [DEBUG] [LOCAL ] GS: Saving derivative data. [2025-09-16T21:16:03.295383] [DEBUG] [MAIN ] GSBD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:03.296755] [INFO ] [MAIN ] GSBD: Generated 1339 derivative records from 28138 primary records. [2025-09-16T21:16:03.297053] [DEBUG] [LOCAL ] GSBD: Saving derivative data. [2025-09-16T21:16:03.321729] [DEBUG] [LOCAL ] GSBD: Derivative data saved (1339 records). [2025-09-16T21:16:03.321814] [INFO ] [MAIN ] GSBD: Successfully saved derivative data. [2025-09-16T21:16:03.323452] [INFO ] [MAIN ] Derivative Progress: 769/2026 symbols completed. GSBD took 1.0s. Estimated remaining: 6m 51s. Rate: 183.5 symbols/min [2025-09-16T21:16:03.320997] [DEBUG] [LOCAL ] GS: Derivative data saved (1339 records). [2025-09-16T21:16:03.323739] [INFO ] [MAIN ] GSL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:03.324138] [INFO ] [MAIN ] GS: Successfully saved derivative data. [2025-09-16T21:16:03.326757] [INFO ] [MAIN ] Derivative Progress: 770/2026 symbols completed. GS took 1.0s. Estimated remaining: 6m 50s. Rate: 183.7 symbols/min [2025-09-16T21:16:03.327000] [INFO ] [MAIN ] GTES: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:03.340365] [DEBUG] [MAIN ] GSK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:03.341063] [INFO ] [MAIN ] GSK: Generated 1339 derivative records from 39887 primary records. [2025-09-16T21:16:03.341168] [DEBUG] [LOCAL ] GSK: Saving derivative data. [2025-09-16T21:16:03.359321] [DEBUG] [LOCAL ] GSK: Derivative data saved (1339 records). [2025-09-16T21:16:03.359484] [INFO ] [MAIN ] GSK: Successfully saved derivative data. [2025-09-16T21:16:03.361604] [INFO ] [MAIN ] Derivative Progress: 771/2026 symbols completed. GSK took 1.0s. Estimated remaining: 6m 49s. Rate: 183.9 symbols/min [2025-09-16T21:16:03.362315] [INFO ] [MAIN ] GTLS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:03.370721] [DEBUG] [LOCAL ] GSL: Loaded 24570 existing records from primary storage. [2025-09-16T21:16:03.378629] [INFO ] [MAIN ] GSL: Loaded 24570 primary data records. [2025-09-16T21:16:03.523136] [DEBUG] [LOCAL ] GTES: Loaded 37387 existing records from primary storage. [2025-09-16T21:16:03.560694] [INFO ] [MAIN ] GTES: Loaded 37387 primary data records. [2025-09-16T21:16:03.689772] [DEBUG] [LOCAL ] GTLS: Loaded 32299 existing records from primary storage. [2025-09-16T21:16:03.712594] [INFO ] [MAIN ] GTLS: Loaded 32299 primary data records. [2025-09-16T21:16:04.289750] [DEBUG] [MAIN ] GSL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:04.290875] [INFO ] [MAIN ] GSL: Generated 1339 derivative records from 24570 primary records. [2025-09-16T21:16:04.291916] [DEBUG] [LOCAL ] GSL: Saving derivative data. [2025-09-16T21:16:04.308590] [DEBUG] [LOCAL ] GSL: Derivative data saved (1339 records). [2025-09-16T21:16:04.309235] [INFO ] [MAIN ] GSL: Successfully saved derivative data. [2025-09-16T21:16:04.311393] [INFO ] [MAIN ] Derivative Progress: 772/2026 symbols completed. GSL took 1.0s. Estimated remaining: 6m 50s. Rate: 183.4 symbols/min [2025-09-16T21:16:04.311968] [INFO ] [MAIN ] GTN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:04.327336] [DEBUG] [MAIN ] GTES: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:04.337528] [DEBUG] [MAIN ] GTLS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:04.337309] [INFO ] [MAIN ] GTES: Generated 1339 derivative records from 37387 primary records. [2025-09-16T21:16:04.338158] [INFO ] [MAIN ] GTLS: Generated 1339 derivative records from 32299 primary records. [2025-09-16T21:16:04.338303] [DEBUG] [LOCAL ] GTLS: Saving derivative data. [2025-09-16T21:16:04.338257] [DEBUG] [LOCAL ] GTES: Saving derivative data. [2025-09-16T21:16:04.363309] [DEBUG] [LOCAL ] GTES: Derivative data saved (1339 records). [2025-09-16T21:16:04.372690] [INFO ] [MAIN ] GTES: Successfully saved derivative data. [2025-09-16T21:16:04.373841] [DEBUG] [LOCAL ] GTLS: Derivative data saved (1339 records). [2025-09-16T21:16:04.376885] [INFO ] [MAIN ] Derivative Progress: 773/2026 symbols completed. GTES took 1.0s. Estimated remaining: 6m 49s. Rate: 183.6 symbols/min [2025-09-16T21:16:04.377235] [INFO ] [MAIN ] GTLS: Successfully saved derivative data. [2025-09-16T21:16:04.377479] [INFO ] [MAIN ] GTY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:04.379773] [INFO ] [MAIN ] Derivative Progress: 774/2026 symbols completed. GTLS took 1.0s. Estimated remaining: 6m 49s. Rate: 183.9 symbols/min [2025-09-16T21:16:04.380495] [INFO ] [MAIN ] GUG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:04.393416] [DEBUG] [LOCAL ] GTN: Loaded 33708 existing records from primary storage. [2025-09-16T21:16:04.395714] [INFO ] [MAIN ] GTN: Loaded 33708 primary data records. [2025-09-16T21:16:04.464355] [DEBUG] [LOCAL ] GUG: Loaded 8867 existing records from primary storage. [2025-09-16T21:16:04.486767] [INFO ] [MAIN ] GUG: Loaded 8867 primary data records. [2025-09-16T21:16:04.623299] [DEBUG] [LOCAL ] GTY: Loaded 21887 existing records from primary storage. [2025-09-16T21:16:04.698005] [INFO ] [MAIN ] GTY: Loaded 21887 primary data records. [2025-09-16T21:16:05.277772] [DEBUG] [MAIN ] GTN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:05.278776] [INFO ] [MAIN ] GTN: Generated 1339 derivative records from 33708 primary records. [2025-09-16T21:16:05.280321] [DEBUG] [LOCAL ] GTN: Saving derivative data. [2025-09-16T21:16:05.295953] [DEBUG] [LOCAL ] GTN: Derivative data saved (1339 records). [2025-09-16T21:16:05.296730] [INFO ] [MAIN ] GTN: Successfully saved derivative data. [2025-09-16T21:16:05.298785] [INFO ] [MAIN ] Derivative Progress: 775/2026 symbols completed. GTN took 1.0s. Estimated remaining: 6m 49s. Rate: 183.4 symbols/min [2025-09-16T21:16:05.299323] [INFO ] [MAIN ] GUT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:05.333174] [DEBUG] [LOCAL ] GUT: Loaded 11583 existing records from primary storage. [2025-09-16T21:16:05.333508] [DEBUG] [MAIN ] GUG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:05.338743] [INFO ] [MAIN ] GUG: Generated 1339 derivative records from 8867 primary records. [2025-09-16T21:16:05.338848] [INFO ] [MAIN ] GUT: Loaded 11583 primary data records. [2025-09-16T21:16:05.337927] [DEBUG] [MAIN ] GTY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:05.338974] [DEBUG] [LOCAL ] GUG: Saving derivative data. [2025-09-16T21:16:05.340016] [INFO ] [MAIN ] GTY: Generated 1339 derivative records from 21887 primary records. [2025-09-16T21:16:05.340420] [DEBUG] [LOCAL ] GTY: Saving derivative data. [2025-09-16T21:16:05.414843] [DEBUG] [LOCAL ] GTY: Derivative data saved (1339 records). [2025-09-16T21:16:05.454243] [DEBUG] [LOCAL ] GUG: Derivative data saved (1339 records). [2025-09-16T21:16:05.466559] [INFO ] [MAIN ] GTY: Successfully saved derivative data. [2025-09-16T21:16:05.477569] [INFO ] [MAIN ] GUG: Successfully saved derivative data. [2025-09-16T21:16:05.479920] [INFO ] [MAIN ] Derivative Progress: 776/2026 symbols completed. GUG took 1.1s. Estimated remaining: 6m 49s. Rate: 183.5 symbols/min [2025-09-16T21:16:05.480189] [INFO ] [MAIN ] GVA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:05.482576] [INFO ] [MAIN ] Derivative Progress: 777/2026 symbols completed. GTY took 1.1s. Estimated remaining: 6m 48s. Rate: 183.8 symbols/min [2025-09-16T21:16:05.488910] [INFO ] [MAIN ] GWH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:05.654893] [DEBUG] [LOCAL ] GWH: Loaded 12976 existing records from primary storage. [2025-09-16T21:16:05.655035] [INFO ] [MAIN ] GWH: Loaded 12976 primary data records. [2025-09-16T21:16:05.757102] [DEBUG] [LOCAL ] GVA: Loaded 24076 existing records from primary storage. [2025-09-16T21:16:05.775605] [INFO ] [MAIN ] GVA: Loaded 24076 primary data records. [2025-09-16T21:16:06.273050] [DEBUG] [MAIN ] GUT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:06.275068] [INFO ] [MAIN ] GUT: Generated 1339 derivative records from 11583 primary records. [2025-09-16T21:16:06.275731] [DEBUG] [LOCAL ] GUT: Saving derivative data. [2025-09-16T21:16:06.293949] [DEBUG] [LOCAL ] GUT: Derivative data saved (1339 records). [2025-09-16T21:16:06.294268] [INFO ] [MAIN ] GUT: Successfully saved derivative data. [2025-09-16T21:16:06.296429] [INFO ] [MAIN ] Derivative Progress: 778/2026 symbols completed. GUT took 1.0s. Estimated remaining: 6m 48s. Rate: 183.4 symbols/min [2025-09-16T21:16:06.307073] [DEBUG] [MAIN ] GWH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:06.307846] [INFO ] [MAIN ] GWH: Generated 1339 derivative records from 12976 primary records. [2025-09-16T21:16:06.308006] [DEBUG] [LOCAL ] GWH: Saving derivative data. [2025-09-16T21:16:06.320194] [DEBUG] [LOCAL ] GWH: Derivative data saved (1339 records). [2025-09-16T21:16:06.320329] [INFO ] [MAIN ] GWH: Successfully saved derivative data. [2025-09-16T21:16:06.322579] [INFO ] [MAIN ] Derivative Progress: 779/2026 symbols completed. GWH took 0.8s. Estimated remaining: 6m 47s. Rate: 183.6 symbols/min [2025-09-16T21:16:06.333854] [DEBUG] [MAIN ] GVA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:06.334380] [INFO ] [MAIN ] GVA: Generated 1339 derivative records from 24076 primary records. [2025-09-16T21:16:06.334441] [DEBUG] [LOCAL ] GVA: Saving derivative data. [2025-09-16T21:16:06.346440] [DEBUG] [LOCAL ] GVA: Derivative data saved (1339 records). [2025-09-16T21:16:06.346501] [INFO ] [MAIN ] GVA: Successfully saved derivative data. [2025-09-16T21:16:06.348667] [INFO ] [MAIN ] Derivative Progress: 780/2026 symbols completed. GVA took 0.9s. Estimated remaining: 6m 47s. Rate: 183.9 symbols/min [2025-09-16T21:16:06.349221] [INFO ] [MAIN ] GXO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:06.349186] [INFO ] [MAIN ] GWW: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:06.349047] [INFO ] [MAIN ] GWRE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:06.366334] [DEBUG] [LOCAL ] GWW: Loaded 14090 existing records from primary storage. [2025-09-16T21:16:06.366517] [INFO ] [MAIN ] GWW: Loaded 14090 primary data records. [2025-09-16T21:16:06.522116] [DEBUG] [LOCAL ] GWRE: Loaded 30089 existing records from primary storage. [2025-09-16T21:16:06.555690] [DEBUG] [LOCAL ] GXO: Loaded 34488 existing records from primary storage. [2025-09-16T21:16:06.562566] [INFO ] [MAIN ] GWRE: Loaded 30089 primary data records. [2025-09-16T21:16:06.578401] [INFO ] [MAIN ] GXO: Loaded 34488 primary data records. [2025-09-16T21:16:07.224066] [DEBUG] [MAIN ] GWW: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:07.225274] [INFO ] [MAIN ] GWW: Generated 1339 derivative records from 14090 primary records. [2025-09-16T21:16:07.225894] [DEBUG] [LOCAL ] GWW: Saving derivative data. [2025-09-16T21:16:07.238795] [DEBUG] [LOCAL ] GWW: Derivative data saved (1339 records). [2025-09-16T21:16:07.239868] [INFO ] [MAIN ] GWW: Successfully saved derivative data. [2025-09-16T21:16:07.242812] [INFO ] [MAIN ] Derivative Progress: 781/2026 symbols completed. GWW took 0.9s. Estimated remaining: 6m 47s. Rate: 183.5 symbols/min [2025-09-16T21:16:07.245180] [INFO ] [MAIN ] GYLD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:07.257659] [DEBUG] [MAIN ] GWRE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:07.268905] [DEBUG] [LOCAL ] GYLD: Loaded 1117 existing records from primary storage. [2025-09-16T21:16:07.269966] [INFO ] [MAIN ] GYLD: Loaded 1117 primary data records. [2025-09-16T21:16:07.269869] [DEBUG] [MAIN ] GXO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:07.269617] [INFO ] [MAIN ] GWRE: Generated 1339 derivative records from 30089 primary records. [2025-09-16T21:16:07.290597] [DEBUG] [LOCAL ] GWRE: Saving derivative data. [2025-09-16T21:16:07.302090] [INFO ] [MAIN ] GXO: Generated 1339 derivative records from 34488 primary records. [2025-09-16T21:16:07.314904] [DEBUG] [LOCAL ] GXO: Saving derivative data. [2025-09-16T21:16:07.419739] [DEBUG] [LOCAL ] GWRE: Derivative data saved (1339 records). [2025-09-16T21:16:07.440470] [INFO ] [MAIN ] GWRE: Successfully saved derivative data. [2025-09-16T21:16:07.479014] [INFO ] [MAIN ] Derivative Progress: 782/2026 symbols completed. GWRE took 1.1s. Estimated remaining: 6m 47s. Rate: 183.5 symbols/min [2025-09-16T21:16:07.480199] [INFO ] [MAIN ] H: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:07.476832] [DEBUG] [LOCAL ] GXO: Derivative data saved (1339 records). [2025-09-16T21:16:07.480399] [INFO ] [MAIN ] GXO: Successfully saved derivative data. [2025-09-16T21:16:07.485898] [INFO ] [MAIN ] Derivative Progress: 783/2026 symbols completed. GXO took 1.1s. Estimated remaining: 6m 46s. Rate: 183.8 symbols/min [2025-09-16T21:16:07.571085] [INFO ] [MAIN ] HAE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:07.595823] [DEBUG] [MAIN ] GYLD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:07.596482] [INFO ] [MAIN ] GYLD: Generated 1339 derivative records from 1117 primary records. [2025-09-16T21:16:07.596818] [DEBUG] [LOCAL ] GYLD: Saving derivative data. [2025-09-16T21:16:07.621998] [DEBUG] [LOCAL ] GYLD: Derivative data saved (1339 records). [2025-09-16T21:16:07.622121] [INFO ] [MAIN ] GYLD: Successfully saved derivative data. [2025-09-16T21:16:07.623755] [INFO ] [MAIN ] Derivative Progress: 784/2026 symbols completed. GYLD took 0.4s. Estimated remaining: 6m 45s. Rate: 183.9 symbols/min [2025-09-16T21:16:07.624177] [INFO ] [MAIN ] HAFN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:07.645208] [DEBUG] [LOCAL ] HAE: Loaded 28192 existing records from primary storage. [2025-09-16T21:16:07.646130] [DEBUG] [LOCAL ] H: Loaded 33240 existing records from primary storage. [2025-09-16T21:16:07.646247] [INFO ] [MAIN ] H: Loaded 33240 primary data records. [2025-09-16T21:16:07.646337] [INFO ] [MAIN ] HAE: Loaded 28192 primary data records. [2025-09-16T21:16:07.940406] [DEBUG] [LOCAL ] HAFN: Loaded 31774 existing records from primary storage. [2025-09-16T21:16:07.970874] [INFO ] [MAIN ] HAFN: Loaded 31774 primary data records. [2025-09-16T21:16:08.540786] [DEBUG] [MAIN ] HAE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:08.541173] [DEBUG] [MAIN ] H: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:08.542024] [INFO ] [MAIN ] HAE: Generated 1339 derivative records from 28192 primary records. [2025-09-16T21:16:08.542555] [INFO ] [MAIN ] H: Generated 1339 derivative records from 33240 primary records. [2025-09-16T21:16:08.542614] [DEBUG] [LOCAL ] HAE: Saving derivative data. [2025-09-16T21:16:08.543266] [DEBUG] [LOCAL ] H: Saving derivative data. [2025-09-16T21:16:08.565898] [DEBUG] [LOCAL ] H: Derivative data saved (1339 records). [2025-09-16T21:16:08.566564] [INFO ] [MAIN ] H: Successfully saved derivative data. [2025-09-16T21:16:08.570568] [DEBUG] [LOCAL ] HAE: Derivative data saved (1339 records). [2025-09-16T21:16:08.568542] [INFO ] [MAIN ] Derivative Progress: 785/2026 symbols completed. H took 1.1s. Estimated remaining: 6m 46s. Rate: 183.4 symbols/min [2025-09-16T21:16:08.570714] [INFO ] [MAIN ] HAE: Successfully saved derivative data. [2025-09-16T21:16:08.572771] [INFO ] [MAIN ] Derivative Progress: 786/2026 symbols completed. HAE took 1.0s. Estimated remaining: 6m 45s. Rate: 183.7 symbols/min [2025-09-16T21:16:08.570985] [INFO ] [MAIN ] HAL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:08.573782] [INFO ] [MAIN ] HBB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:08.586389] [DEBUG] [MAIN ] HAFN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:08.588335] [INFO ] [MAIN ] HAFN: Generated 1339 derivative records from 31774 primary records. [2025-09-16T21:16:08.588530] [DEBUG] [LOCAL ] HAFN: Saving derivative data. [2025-09-16T21:16:08.602896] [DEBUG] [LOCAL ] HBB: Loaded 4754 existing records from primary storage. [2025-09-16T21:16:08.603627] [DEBUG] [LOCAL ] HAFN: Derivative data saved (1339 records). [2025-09-16T21:16:08.603914] [INFO ] [MAIN ] HAFN: Successfully saved derivative data. [2025-09-16T21:16:08.603843] [INFO ] [MAIN ] HBB: Loaded 4754 primary data records. [2025-09-16T21:16:08.606790] [INFO ] [MAIN ] Derivative Progress: 787/2026 symbols completed. HAFN took 1.0s. Estimated remaining: 6m 44s. Rate: 183.9 symbols/min [2025-09-16T21:16:08.607138] [INFO ] [MAIN ] HBI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:08.793857] [DEBUG] [LOCAL ] HAL: Loaded 40068 existing records from primary storage. [2025-09-16T21:16:08.804555] [INFO ] [MAIN ] HAL: Loaded 40068 primary data records. [2025-09-16T21:16:09.028702] [DEBUG] [LOCAL ] HBI: Loaded 39471 existing records from primary storage. [2025-09-16T21:16:09.030064] [INFO ] [MAIN ] HBI: Loaded 39471 primary data records. [2025-09-16T21:16:09.486555] [DEBUG] [MAIN ] HBB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:09.488482] [INFO ] [MAIN ] HBB: Generated 1339 derivative records from 4754 primary records. [2025-09-16T21:16:09.488799] [DEBUG] [LOCAL ] HBB: Saving derivative data. [2025-09-16T21:16:09.504865] [DEBUG] [LOCAL ] HBB: Derivative data saved (1339 records). [2025-09-16T21:16:09.505448] [INFO ] [MAIN ] HBB: Successfully saved derivative data. [2025-09-16T21:16:09.508214] [INFO ] [MAIN ] Derivative Progress: 788/2026 symbols completed. HBB took 0.9s. Estimated remaining: 6m 45s. Rate: 183.5 symbols/min [2025-09-16T21:16:09.508905] [INFO ] [MAIN ] HBM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:09.519776] [DEBUG] [MAIN ] HAL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:09.520792] [INFO ] [MAIN ] HAL: Generated 1339 derivative records from 40068 primary records. [2025-09-16T21:16:09.521018] [DEBUG] [LOCAL ] HAL: Saving derivative data. [2025-09-16T21:16:09.535494] [DEBUG] [LOCAL ] HAL: Derivative data saved (1339 records). [2025-09-16T21:16:09.535630] [INFO ] [MAIN ] HAL: Successfully saved derivative data. [2025-09-16T21:16:09.538119] [INFO ] [MAIN ] Derivative Progress: 789/2026 symbols completed. HAL took 1.0s. Estimated remaining: 6m 44s. Rate: 183.7 symbols/min [2025-09-16T21:16:09.538771] [INFO ] [MAIN ] HCA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:09.551699] [DEBUG] [MAIN ] HBI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:09.552555] [INFO ] [MAIN ] HBI: Generated 1339 derivative records from 39471 primary records. [2025-09-16T21:16:09.552702] [DEBUG] [LOCAL ] HBI: Saving derivative data. [2025-09-16T21:16:09.574541] [DEBUG] [LOCAL ] HBI: Derivative data saved (1339 records). [2025-09-16T21:16:09.574807] [INFO ] [MAIN ] HBI: Successfully saved derivative data. [2025-09-16T21:16:09.577074] [INFO ] [MAIN ] Derivative Progress: 790/2026 symbols completed. HBI took 1.0s. Estimated remaining: 6m 43s. Rate: 183.9 symbols/min [2025-09-16T21:16:09.577508] [INFO ] [MAIN ] HCC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:09.603458] [DEBUG] [LOCAL ] HBM: Loaded 39386 existing records from primary storage. [2025-09-16T21:16:09.603666] [INFO ] [MAIN ] HBM: Loaded 39386 primary data records. [2025-09-16T21:16:09.730120] [DEBUG] [LOCAL ] HCA: Loaded 35145 existing records from primary storage. [2025-09-16T21:16:09.730342] [INFO ] [MAIN ] HCA: Loaded 35145 primary data records. [2025-09-16T21:16:10.015857] [DEBUG] [LOCAL ] HCC: Loaded 33661 existing records from primary storage. [2025-09-16T21:16:10.016036] [INFO ] [MAIN ] HCC: Loaded 33661 primary data records. [2025-09-16T21:16:10.473878] [DEBUG] [MAIN ] HBM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:10.476063] [INFO ] [MAIN ] HBM: Generated 1339 derivative records from 39386 primary records. [2025-09-16T21:16:10.476300] [DEBUG] [LOCAL ] HBM: Saving derivative data. [2025-09-16T21:16:10.492095] [DEBUG] [LOCAL ] HBM: Derivative data saved (1339 records). [2025-09-16T21:16:10.492362] [INFO ] [MAIN ] HBM: Successfully saved derivative data. [2025-09-16T21:16:10.494343] [INFO ] [MAIN ] Derivative Progress: 791/2026 symbols completed. HBM took 1.0s. Estimated remaining: 6m 44s. Rate: 183.5 symbols/min [2025-09-16T21:16:10.494903] [INFO ] [MAIN ] HD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:10.505290] [DEBUG] [MAIN ] HCA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:10.506122] [INFO ] [MAIN ] HCA: Generated 1339 derivative records from 35145 primary records. [2025-09-16T21:16:10.506406] [DEBUG] [LOCAL ] HCA: Saving derivative data. [2025-09-16T21:16:10.529411] [DEBUG] [MAIN ] HCC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:10.531142] [INFO ] [MAIN ] HCC: Generated 1339 derivative records from 33661 primary records. [2025-09-16T21:16:10.531291] [DEBUG] [LOCAL ] HCC: Saving derivative data. [2025-09-16T21:16:10.531721] [DEBUG] [LOCAL ] HCA: Derivative data saved (1339 records). [2025-09-16T21:16:10.532327] [INFO ] [MAIN ] HCA: Successfully saved derivative data. [2025-09-16T21:16:10.534329] [INFO ] [MAIN ] Derivative Progress: 792/2026 symbols completed. HCA took 1.0s. Estimated remaining: 6m 43s. Rate: 183.7 symbols/min [2025-09-16T21:16:10.534801] [INFO ] [MAIN ] HDB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:10.547720] [DEBUG] [LOCAL ] HCC: Derivative data saved (1339 records). [2025-09-16T21:16:10.547807] [INFO ] [MAIN ] HCC: Successfully saved derivative data. [2025-09-16T21:16:10.549944] [INFO ] [MAIN ] Derivative Progress: 793/2026 symbols completed. HCC took 1.0s. Estimated remaining: 6m 42s. Rate: 183.9 symbols/min [2025-09-16T21:16:10.578492] [DEBUG] [LOCAL ] HD: Loaded 39898 existing records from primary storage. [2025-09-16T21:16:10.578679] [INFO ] [MAIN ] HD: Loaded 39898 primary data records. [2025-09-16T21:16:10.775819] [DEBUG] [LOCAL ] HDB: Loaded 38408 existing records from primary storage. [2025-09-16T21:16:10.779233] [INFO ] [MAIN ] HDB: Loaded 38408 primary data records. [2025-09-16T21:16:11.187088] [DEBUG] [MAIN ] HD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:11.187890] [INFO ] [MAIN ] HD: Generated 1339 derivative records from 39898 primary records. [2025-09-16T21:16:11.188057] [DEBUG] [LOCAL ] HD: Saving derivative data. [2025-09-16T21:16:11.200768] [DEBUG] [LOCAL ] HD: Derivative data saved (1339 records). [2025-09-16T21:16:11.200909] [INFO ] [MAIN ] HD: Successfully saved derivative data. [2025-09-16T21:16:11.202596] [INFO ] [MAIN ] Derivative Progress: 794/2026 symbols completed. HD took 0.7s. Estimated remaining: 6m 42s. Rate: 183.7 symbols/min [2025-09-16T21:16:11.214344] [DEBUG] [MAIN ] HDB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:11.215014] [INFO ] [MAIN ] HDB: Generated 1339 derivative records from 38408 primary records. [2025-09-16T21:16:11.215079] [DEBUG] [LOCAL ] HDB: Saving derivative data. [2025-09-16T21:16:11.226878] [DEBUG] [LOCAL ] HDB: Derivative data saved (1339 records). [2025-09-16T21:16:11.226938] [INFO ] [MAIN ] HDB: Successfully saved derivative data. [2025-09-16T21:16:11.228909] [INFO ] [MAIN ] Derivative Progress: 795/2026 symbols completed. HDB took 0.7s. Estimated remaining: 6m 42s. Rate: 183.9 symbols/min [2025-09-16T21:16:11.229609] [INFO ] [MAIN ] HEI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:11.229840] [INFO ] [MAIN ] HEQ: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:11.229707] [INFO ] [MAIN ] HE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:11.239148] [DEBUG] [LOCAL ] HEQ: Loaded 4338 existing records from primary storage. [2025-09-16T21:16:11.239362] [INFO ] [MAIN ] HEQ: Loaded 4338 primary data records. [2025-09-16T21:16:11.441850] [DEBUG] [LOCAL ] HEI: Loaded 23607 existing records from primary storage. [2025-09-16T21:16:11.445157] [INFO ] [MAIN ] HEI: Loaded 23607 primary data records. [2025-09-16T21:16:11.620827] [DEBUG] [LOCAL ] HE: Loaded 36245 existing records from primary storage. [2025-09-16T21:16:11.632301] [INFO ] [MAIN ] HE: Loaded 36245 primary data records. [2025-09-16T21:16:12.181562] [DEBUG] [MAIN ] HEQ: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:12.184123] [INFO ] [MAIN ] HEQ: Generated 1339 derivative records from 4338 primary records. [2025-09-16T21:16:12.184456] [DEBUG] [LOCAL ] HEQ: Saving derivative data. [2025-09-16T21:16:12.201395] [DEBUG] [LOCAL ] HEQ: Derivative data saved (1339 records). [2025-09-16T21:16:12.201753] [INFO ] [MAIN ] HEQ: Successfully saved derivative data. [2025-09-16T21:16:12.206676] [INFO ] [MAIN ] Derivative Progress: 796/2026 symbols completed. HEQ took 1.0s. Estimated remaining: 6m 42s. Rate: 183.4 symbols/min [2025-09-16T21:16:12.208304] [INFO ] [MAIN ] HESM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:12.219998] [DEBUG] [MAIN ] HEI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:12.223636] [INFO ] [MAIN ] HEI: Generated 1339 derivative records from 23607 primary records. [2025-09-16T21:16:12.242193] [DEBUG] [MAIN ] HE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:12.227282] [DEBUG] [LOCAL ] HEI: Saving derivative data. [2025-09-16T21:16:12.243274] [INFO ] [MAIN ] HE: Generated 1339 derivative records from 36245 primary records. [2025-09-16T21:16:12.243666] [DEBUG] [LOCAL ] HE: Saving derivative data. [2025-09-16T21:16:12.280628] [DEBUG] [LOCAL ] HE: Derivative data saved (1339 records). [2025-09-16T21:16:12.285975] [DEBUG] [LOCAL ] HEI: Derivative data saved (1339 records). [2025-09-16T21:16:12.285817] [INFO ] [MAIN ] HE: Successfully saved derivative data. [2025-09-16T21:16:12.286220] [INFO ] [MAIN ] HEI: Successfully saved derivative data. [2025-09-16T21:16:12.289261] [INFO ] [MAIN ] Derivative Progress: 797/2026 symbols completed. HEI took 1.1s. Estimated remaining: 6m 42s. Rate: 183.6 symbols/min [2025-09-16T21:16:12.293088] [INFO ] [MAIN ] Derivative Progress: 798/2026 symbols completed. HE took 1.1s. Estimated remaining: 6m 41s. Rate: 183.8 symbols/min [2025-09-16T21:16:12.289742] [INFO ] [MAIN ] HFRO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:12.293672] [INFO ] [MAIN ] HGER: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:12.325915] [DEBUG] [LOCAL ] HGER: Loaded 9995 existing records from primary storage. [2025-09-16T21:16:12.326426] [INFO ] [MAIN ] HGER: Loaded 9995 primary data records. [2025-09-16T21:16:12.424193] [DEBUG] [LOCAL ] HFRO: Loaded 11949 existing records from primary storage. [2025-09-16T21:16:12.446834] [INFO ] [MAIN ] HFRO: Loaded 11949 primary data records. [2025-09-16T21:16:12.472873] [DEBUG] [LOCAL ] HESM: Loaded 35958 existing records from primary storage. [2025-09-16T21:16:12.473102] [INFO ] [MAIN ] HESM: Loaded 35958 primary data records. [2025-09-16T21:16:13.420863] [DEBUG] [MAIN ] HESM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:13.421344] [DEBUG] [MAIN ] HGER: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:13.423617] [INFO ] [MAIN ] HESM: Generated 1339 derivative records from 35958 primary records. [2025-09-16T21:16:13.422554] [INFO ] [MAIN ] HGER: Generated 1339 derivative records from 9995 primary records. [2025-09-16T21:16:13.424237] [DEBUG] [LOCAL ] HESM: Saving derivative data. [2025-09-16T21:16:13.424333] [DEBUG] [LOCAL ] HGER: Saving derivative data. [2025-09-16T21:16:13.452100] [DEBUG] [MAIN ] HFRO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:13.454288] [INFO ] [MAIN ] HFRO: Generated 1339 derivative records from 11949 primary records. [2025-09-16T21:16:13.455176] [DEBUG] [LOCAL ] HFRO: Saving derivative data. [2025-09-16T21:16:13.465327] [DEBUG] [LOCAL ] HESM: Derivative data saved (1339 records). [2025-09-16T21:16:13.465828] [INFO ] [MAIN ] HESM: Successfully saved derivative data. [2025-09-16T21:16:13.467804] [INFO ] [MAIN ] Derivative Progress: 799/2026 symbols completed. HESM took 1.3s. Estimated remaining: 6m 42s. Rate: 183.2 symbols/min [2025-09-16T21:16:13.468337] [INFO ] [MAIN ] HGLB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:13.468620] [DEBUG] [LOCAL ] HGER: Derivative data saved (1339 records). [2025-09-16T21:16:13.471121] [DEBUG] [LOCAL ] HFRO: Derivative data saved (1339 records). [2025-09-16T21:16:13.469814] [INFO ] [MAIN ] HGER: Successfully saved derivative data. [2025-09-16T21:16:13.473220] [INFO ] [MAIN ] Derivative Progress: 800/2026 symbols completed. HGER took 1.2s. Estimated remaining: 6m 41s. Rate: 183.4 symbols/min [2025-09-16T21:16:13.473383] [INFO ] [MAIN ] HGTY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:13.473772] [INFO ] [MAIN ] HFRO: Successfully saved derivative data. [2025-09-16T21:16:13.476114] [INFO ] [MAIN ] Derivative Progress: 801/2026 symbols completed. HFRO took 1.2s. Estimated remaining: 6m 40s. Rate: 183.7 symbols/min [2025-09-16T21:16:13.476475] [INFO ] [MAIN ] HGV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:13.485835] [DEBUG] [LOCAL ] HGLB: Loaded 6562 existing records from primary storage. [2025-09-16T21:16:13.486051] [INFO ] [MAIN ] HGLB: Loaded 6562 primary data records. [2025-09-16T21:16:13.572735] [DEBUG] [LOCAL ] HGTY: Loaded 10001 existing records from primary storage. [2025-09-16T21:16:13.578078] [INFO ] [MAIN ] HGTY: Loaded 10001 primary data records. [2025-09-16T21:16:13.833460] [DEBUG] [LOCAL ] HGV: Loaded 35072 existing records from primary storage. [2025-09-16T21:16:13.896807] [INFO ] [MAIN ] HGV: Loaded 35072 primary data records. [2025-09-16T21:16:14.335797] [DEBUG] [MAIN ] HGLB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:14.336799] [INFO ] [MAIN ] HGLB: Generated 1339 derivative records from 6562 primary records. [2025-09-16T21:16:14.336971] [DEBUG] [LOCAL ] HGLB: Saving derivative data. [2025-09-16T21:16:14.360244] [DEBUG] [MAIN ] HGTY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:14.361670] [DEBUG] [LOCAL ] HGLB: Derivative data saved (1339 records). [2025-09-16T21:16:14.361790] [INFO ] [MAIN ] HGLB: Successfully saved derivative data. [2025-09-16T21:16:14.363667] [INFO ] [MAIN ] Derivative Progress: 802/2026 symbols completed. HGLB took 0.9s. Estimated remaining: 6m 41s. Rate: 183.3 symbols/min [2025-09-16T21:16:14.364364] [INFO ] [MAIN ] HGTY: Generated 1339 derivative records from 10001 primary records. [2025-09-16T21:16:14.364892] [DEBUG] [LOCAL ] HGTY: Saving derivative data. [2025-09-16T21:16:14.364720] [INFO ] [MAIN ] HHH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:14.377231] [DEBUG] [LOCAL ] HGTY: Derivative data saved (1339 records). [2025-09-16T21:16:14.377474] [INFO ] [MAIN ] HGTY: Successfully saved derivative data. [2025-09-16T21:16:14.379563] [INFO ] [MAIN ] Derivative Progress: 803/2026 symbols completed. HGTY took 0.9s. Estimated remaining: 6m 40s. Rate: 183.5 symbols/min [2025-09-16T21:16:14.379821] [INFO ] [MAIN ] HI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:14.393019] [DEBUG] [MAIN ] HGV: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:14.393684] [INFO ] [MAIN ] HGV: Generated 1339 derivative records from 35072 primary records. [2025-09-16T21:16:14.393801] [DEBUG] [LOCAL ] HGV: Saving derivative data. [2025-09-16T21:16:14.419276] [DEBUG] [LOCAL ] HGV: Derivative data saved (1339 records). [2025-09-16T21:16:14.419823] [INFO ] [MAIN ] HGV: Successfully saved derivative data. [2025-09-16T21:16:14.429670] [INFO ] [MAIN ] Derivative Progress: 804/2026 symbols completed. HGV took 1.0s. Estimated remaining: 6m 39s. Rate: 183.7 symbols/min [2025-09-16T21:16:14.430607] [DEBUG] [LOCAL ] HHH: Loaded 25732 existing records from primary storage. [2025-09-16T21:16:14.429944] [INFO ] [MAIN ] HIG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:14.430792] [INFO ] [MAIN ] HHH: Loaded 25732 primary data records. [2025-09-16T21:16:14.541860] [DEBUG] [LOCAL ] HI: Loaded 25850 existing records from primary storage. [2025-09-16T21:16:14.552734] [INFO ] [MAIN ] HI: Loaded 25850 primary data records. [2025-09-16T21:16:14.865204] [DEBUG] [LOCAL ] HIG: Loaded 38323 existing records from primary storage. [2025-09-16T21:16:14.988471] [INFO ] [MAIN ] HIG: Loaded 38323 primary data records. [2025-09-16T21:16:15.276284] [DEBUG] [MAIN ] HHH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:15.277090] [INFO ] [MAIN ] HHH: Generated 1339 derivative records from 25732 primary records. [2025-09-16T21:16:15.277984] [DEBUG] [LOCAL ] HHH: Saving derivative data. [2025-09-16T21:16:15.302589] [DEBUG] [MAIN ] HI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:15.305444] [DEBUG] [LOCAL ] HHH: Derivative data saved (1339 records). [2025-09-16T21:16:15.305301] [INFO ] [MAIN ] HI: Generated 1339 derivative records from 25850 primary records. [2025-09-16T21:16:15.305685] [DEBUG] [LOCAL ] HI: Saving derivative data. [2025-09-16T21:16:15.306110] [INFO ] [MAIN ] HHH: Successfully saved derivative data. [2025-09-16T21:16:15.307977] [INFO ] [MAIN ] Derivative Progress: 805/2026 symbols completed. HHH took 0.9s. Estimated remaining: 6m 40s. Rate: 183.3 symbols/min [2025-09-16T21:16:15.308930] [INFO ] [MAIN ] HII: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:15.321586] [DEBUG] [LOCAL ] HI: Derivative data saved (1339 records). [2025-09-16T21:16:15.321886] [INFO ] [MAIN ] HI: Successfully saved derivative data. [2025-09-16T21:16:15.323859] [INFO ] [MAIN ] Derivative Progress: 806/2026 symbols completed. HI took 0.9s. Estimated remaining: 6m 39s. Rate: 183.5 symbols/min [2025-09-16T21:16:15.324178] [INFO ] [MAIN ] HIMS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:15.337003] [DEBUG] [MAIN ] HIG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:15.337901] [INFO ] [MAIN ] HIG: Generated 1339 derivative records from 38323 primary records. [2025-09-16T21:16:15.343575] [DEBUG] [LOCAL ] HIG: Saving derivative data. [2025-09-16T21:16:15.356399] [DEBUG] [LOCAL ] HIG: Derivative data saved (1339 records). [2025-09-16T21:16:15.363518] [INFO ] [MAIN ] HIG: Successfully saved derivative data. [2025-09-16T21:16:15.366809] [INFO ] [MAIN ] Derivative Progress: 807/2026 symbols completed. HIG took 0.9s. Estimated remaining: 6m 38s. Rate: 183.7 symbols/min [2025-09-16T21:16:15.367846] [INFO ] [MAIN ] HIO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:15.367608] [DEBUG] [LOCAL ] HII: Loaded 24405 existing records from primary storage. [2025-09-16T21:16:15.368017] [INFO ] [MAIN ] HII: Loaded 24405 primary data records. [2025-09-16T21:16:15.557921] [DEBUG] [LOCAL ] HIMS: Loaded 40167 existing records from primary storage. [2025-09-16T21:16:15.581443] [INFO ] [MAIN ] HIMS: Loaded 40167 primary data records. [2025-09-16T21:16:15.581784] [DEBUG] [LOCAL ] HIO: Loaded 16041 existing records from primary storage. [2025-09-16T21:16:15.681272] [INFO ] [MAIN ] HIO: Loaded 16041 primary data records. [2025-09-16T21:16:16.288103] [DEBUG] [MAIN ] HII: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:16.289720] [INFO ] [MAIN ] HII: Generated 1339 derivative records from 24405 primary records. [2025-09-16T21:16:16.290025] [DEBUG] [LOCAL ] HII: Saving derivative data. [2025-09-16T21:16:16.309240] [DEBUG] [LOCAL ] HII: Derivative data saved (1339 records). [2025-09-16T21:16:16.319333] [DEBUG] [MAIN ] HIMS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:16.320047] [INFO ] [MAIN ] HIMS: Generated 1339 derivative records from 40167 primary records. [2025-09-16T21:16:16.325845] [DEBUG] [LOCAL ] HIMS: Saving derivative data. [2025-09-16T21:16:16.320134] [INFO ] [MAIN ] HII: Successfully saved derivative data. [2025-09-16T21:16:16.331877] [INFO ] [MAIN ] Derivative Progress: 808/2026 symbols completed. HII took 1.0s. Estimated remaining: 6m 39s. Rate: 183.3 symbols/min [2025-09-16T21:16:16.332602] [DEBUG] [MAIN ] HIO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:16.338867] [INFO ] [MAIN ] HIO: Generated 1339 derivative records from 16041 primary records. [2025-09-16T21:16:16.343784] [DEBUG] [LOCAL ] HIO: Saving derivative data. [2025-09-16T21:16:16.344851] [DEBUG] [LOCAL ] HIMS: Derivative data saved (1339 records). [2025-09-16T21:16:16.345043] [INFO ] [MAIN ] HIMS: Successfully saved derivative data. [2025-09-16T21:16:16.352240] [INFO ] [MAIN ] Derivative Progress: 809/2026 symbols completed. HIMS took 1.0s. Estimated remaining: 6m 38s. Rate: 183.5 symbols/min [2025-09-16T21:16:16.357538] [DEBUG] [LOCAL ] HIO: Derivative data saved (1339 records). [2025-09-16T21:16:16.357600] [INFO ] [MAIN ] HIO: Successfully saved derivative data. [2025-09-16T21:16:16.359718] [INFO ] [MAIN ] Derivative Progress: 810/2026 symbols completed. HIO took 1.0s. Estimated remaining: 6m 37s. Rate: 183.7 symbols/min [2025-09-16T21:16:16.360074] [INFO ] [MAIN ] HIW: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:16.360421] [INFO ] [MAIN ] HIX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:16.360228] [INFO ] [MAIN ] HIPO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:16.389053] [DEBUG] [LOCAL ] HIX: Loaded 15027 existing records from primary storage. [2025-09-16T21:16:16.389232] [INFO ] [MAIN ] HIX: Loaded 15027 primary data records. [2025-09-16T21:16:16.389778] [DEBUG] [LOCAL ] HIPO: Loaded 16781 existing records from primary storage. [2025-09-16T21:16:16.401265] [INFO ] [MAIN ] HIPO: Loaded 16781 primary data records. [2025-09-16T21:16:16.662323] [DEBUG] [LOCAL ] HIW: Loaded 33209 existing records from primary storage. [2025-09-16T21:16:16.732199] [INFO ] [MAIN ] HIW: Loaded 33209 primary data records. [2025-09-16T21:16:17.221519] [DEBUG] [MAIN ] HIX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:17.222312] [INFO ] [MAIN ] HIX: Generated 1339 derivative records from 15027 primary records. [2025-09-16T21:16:17.222437] [DEBUG] [LOCAL ] HIX: Saving derivative data. [2025-09-16T21:16:17.233038] [DEBUG] [MAIN ] HIPO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:17.242154] [INFO ] [MAIN ] HIPO: Generated 1339 derivative records from 16781 primary records. [2025-09-16T21:16:17.242585] [DEBUG] [LOCAL ] HIPO: Saving derivative data. [2025-09-16T21:16:17.255824] [DEBUG] [LOCAL ] HIX: Derivative data saved (1339 records). [2025-09-16T21:16:17.255988] [INFO ] [MAIN ] HIX: Successfully saved derivative data. [2025-09-16T21:16:17.257965] [INFO ] [MAIN ] Derivative Progress: 811/2026 symbols completed. HIX took 0.9s. Estimated remaining: 6m 38s. Rate: 183.3 symbols/min [2025-09-16T21:16:17.258822] [INFO ] [MAIN ] HKD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:17.259759] [DEBUG] [LOCAL ] HIPO: Derivative data saved (1339 records). [2025-09-16T21:16:17.259981] [INFO ] [MAIN ] HIPO: Successfully saved derivative data. [2025-09-16T21:16:17.262060] [INFO ] [MAIN ] Derivative Progress: 812/2026 symbols completed. HIPO took 0.9s. Estimated remaining: 6m 37s. Rate: 183.5 symbols/min [2025-09-16T21:16:17.262318] [INFO ] [MAIN ] HL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:17.278582] [DEBUG] [MAIN ] HIW: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:17.279352] [INFO ] [MAIN ] HIW: Generated 1339 derivative records from 33209 primary records. [2025-09-16T21:16:17.283096] [DEBUG] [LOCAL ] HIW: Saving derivative data. [2025-09-16T21:16:17.300503] [DEBUG] [LOCAL ] HKD: Loaded 13531 existing records from primary storage. [2025-09-16T21:16:17.301099] [INFO ] [MAIN ] HKD: Loaded 13531 primary data records. [2025-09-16T21:16:17.343508] [DEBUG] [LOCAL ] HIW: Derivative data saved (1339 records). [2025-09-16T21:16:17.391214] [INFO ] [MAIN ] HIW: Successfully saved derivative data. [2025-09-16T21:16:17.419326] [INFO ] [MAIN ] Derivative Progress: 813/2026 symbols completed. HIW took 1.1s. Estimated remaining: 6m 36s. Rate: 183.7 symbols/min [2025-09-16T21:16:17.423350] [INFO ] [MAIN ] HLF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:17.435357] [DEBUG] [LOCAL ] HL: Loaded 40027 existing records from primary storage. [2025-09-16T21:16:17.435519] [INFO ] [MAIN ] HL: Loaded 40027 primary data records. [2025-09-16T21:16:17.916815] [DEBUG] [LOCAL ] HLF: Loaded 36426 existing records from primary storage. [2025-09-16T21:16:17.918072] [INFO ] [MAIN ] HLF: Loaded 36426 primary data records. [2025-09-16T21:16:18.203233] [DEBUG] [MAIN ] HKD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:18.204308] [INFO ] [MAIN ] HKD: Generated 1339 derivative records from 13531 primary records. [2025-09-16T21:16:18.205505] [DEBUG] [LOCAL ] HKD: Saving derivative data. [2025-09-16T21:16:18.228247] [DEBUG] [MAIN ] HL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:18.229355] [INFO ] [MAIN ] HL: Generated 1339 derivative records from 40027 primary records. [2025-09-16T21:16:18.229746] [DEBUG] [LOCAL ] HL: Saving derivative data. [2025-09-16T21:16:18.243549] [DEBUG] [LOCAL ] HKD: Derivative data saved (1339 records). [2025-09-16T21:16:18.244139] [INFO ] [MAIN ] HKD: Successfully saved derivative data. [2025-09-16T21:16:18.244345] [DEBUG] [LOCAL ] HL: Derivative data saved (1339 records). [2025-09-16T21:16:18.246209] [INFO ] [MAIN ] HL: Successfully saved derivative data. [2025-09-16T21:16:18.246143] [INFO ] [MAIN ] Derivative Progress: 814/2026 symbols completed. HKD took 1.0s. Estimated remaining: 6m 37s. Rate: 183.3 symbols/min [2025-09-16T21:16:18.248862] [INFO ] [MAIN ] HLI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:18.248955] [INFO ] [MAIN ] Derivative Progress: 815/2026 symbols completed. HL took 1.0s. Estimated remaining: 6m 36s. Rate: 183.5 symbols/min [2025-09-16T21:16:18.249315] [INFO ] [MAIN ] HLIO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:18.265911] [DEBUG] [MAIN ] HLF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:18.266719] [INFO ] [MAIN ] HLF: Generated 1339 derivative records from 36426 primary records. [2025-09-16T21:16:18.266866] [DEBUG] [LOCAL ] HLF: Saving derivative data. [2025-09-16T21:16:18.297389] [DEBUG] [LOCAL ] HLF: Derivative data saved (1339 records). [2025-09-16T21:16:18.298017] [DEBUG] [LOCAL ] HLIO: Loaded 21798 existing records from primary storage. [2025-09-16T21:16:18.297611] [INFO ] [MAIN ] HLF: Successfully saved derivative data. [2025-09-16T21:16:18.300101] [INFO ] [MAIN ] Derivative Progress: 816/2026 symbols completed. HLF took 0.9s. Estimated remaining: 6m 35s. Rate: 183.7 symbols/min [2025-09-16T21:16:18.300464] [INFO ] [MAIN ] HLIO: Loaded 21798 primary data records. [2025-09-16T21:16:18.300318] [INFO ] [MAIN ] HLLY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:18.410530] [DEBUG] [LOCAL ] HLI: Loaded 22663 existing records from primary storage. [2025-09-16T21:16:18.410830] [INFO ] [MAIN ] HLI: Loaded 22663 primary data records. [2025-09-16T21:16:18.583203] [DEBUG] [LOCAL ] HLLY: Loaded 24752 existing records from primary storage. [2025-09-16T21:16:18.689119] [INFO ] [MAIN ] HLLY: Loaded 24752 primary data records. [2025-09-16T21:16:19.142609] [DEBUG] [MAIN ] HLIO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:19.143785] [INFO ] [MAIN ] HLIO: Generated 1339 derivative records from 21798 primary records. [2025-09-16T21:16:19.144177] [DEBUG] [LOCAL ] HLIO: Saving derivative data. [2025-09-16T21:16:19.158966] [DEBUG] [LOCAL ] HLIO: Derivative data saved (1339 records). [2025-09-16T21:16:19.159901] [INFO ] [MAIN ] HLIO: Successfully saved derivative data. [2025-09-16T21:16:19.161629] [INFO ] [MAIN ] Derivative Progress: 817/2026 symbols completed. HLIO took 0.9s. Estimated remaining: 6m 36s. Rate: 183.4 symbols/min [2025-09-16T21:16:19.162141] [INFO ] [MAIN ] HLN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:19.173036] [DEBUG] [MAIN ] HLI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:19.173947] [INFO ] [MAIN ] HLI: Generated 1339 derivative records from 22663 primary records. [2025-09-16T21:16:19.174250] [DEBUG] [LOCAL ] HLI: Saving derivative data. [2025-09-16T21:16:19.199818] [DEBUG] [LOCAL ] HLI: Derivative data saved (1339 records). [2025-09-16T21:16:19.200192] [INFO ] [MAIN ] HLI: Successfully saved derivative data. [2025-09-16T21:16:19.200051] [DEBUG] [MAIN ] HLLY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:19.202295] [INFO ] [MAIN ] Derivative Progress: 818/2026 symbols completed. HLI took 1.0s. Estimated remaining: 6m 35s. Rate: 183.6 symbols/min [2025-09-16T21:16:19.212055] [INFO ] [MAIN ] HLT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:19.203214] [INFO ] [MAIN ] HLLY: Generated 1339 derivative records from 24752 primary records. [2025-09-16T21:16:19.212298] [DEBUG] [LOCAL ] HLLY: Saving derivative data. [2025-09-16T21:16:19.239086] [DEBUG] [LOCAL ] HLLY: Derivative data saved (1339 records). [2025-09-16T21:16:19.239876] [DEBUG] [LOCAL ] HLN: Loaded 39568 existing records from primary storage. [2025-09-16T21:16:19.239325] [INFO ] [MAIN ] HLLY: Successfully saved derivative data. [2025-09-16T21:16:19.242433] [INFO ] [MAIN ] Derivative Progress: 819/2026 symbols completed. HLLY took 0.9s. Estimated remaining: 6m 34s. Rate: 183.8 symbols/min [2025-09-16T21:16:19.239992] [INFO ] [MAIN ] HLN: Loaded 39568 primary data records. [2025-09-16T21:16:19.242679] [INFO ] [MAIN ] HLX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:19.422843] [DEBUG] [LOCAL ] HLT: Loaded 37473 existing records from primary storage. [2025-09-16T21:16:19.424143] [INFO ] [MAIN ] HLT: Loaded 37473 primary data records. [2025-09-16T21:16:19.650501] [DEBUG] [LOCAL ] HLX: Loaded 35463 existing records from primary storage. [2025-09-16T21:16:19.663379] [INFO ] [MAIN ] HLX: Loaded 35463 primary data records. [2025-09-16T21:16:20.160842] [DEBUG] [MAIN ] HLN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:20.162718] [INFO ] [MAIN ] HLN: Generated 1339 derivative records from 39568 primary records. [2025-09-16T21:16:20.163056] [DEBUG] [LOCAL ] HLN: Saving derivative data. [2025-09-16T21:16:20.177291] [DEBUG] [LOCAL ] HLN: Derivative data saved (1339 records). [2025-09-16T21:16:20.177681] [INFO ] [MAIN ] HLN: Successfully saved derivative data. [2025-09-16T21:16:20.179887] [INFO ] [MAIN ] Derivative Progress: 820/2026 symbols completed. HLN took 1.0s. Estimated remaining: 6m 35s. Rate: 183.3 symbols/min [2025-09-16T21:16:20.180341] [INFO ] [MAIN ] HMC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:20.195110] [DEBUG] [MAIN ] HLT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:20.196353] [INFO ] [MAIN ] HLT: Generated 1339 derivative records from 37473 primary records. [2025-09-16T21:16:20.196670] [DEBUG] [LOCAL ] HLT: Saving derivative data. [2025-09-16T21:16:20.219298] [DEBUG] [LOCAL ] HLT: Derivative data saved (1339 records). [2025-09-16T21:16:20.220559] [INFO ] [MAIN ] HLT: Successfully saved derivative data. [2025-09-16T21:16:20.223132] [INFO ] [MAIN ] Derivative Progress: 821/2026 symbols completed. HLT took 1.0s. Estimated remaining: 6m 34s. Rate: 183.5 symbols/min [2025-09-16T21:16:20.223634] [INFO ] [MAIN ] HMN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:20.234209] [DEBUG] [MAIN ] HLX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:20.234977] [INFO ] [MAIN ] HLX: Generated 1339 derivative records from 35463 primary records. [2025-09-16T21:16:20.235677] [DEBUG] [LOCAL ] HLX: Saving derivative data. [2025-09-16T21:16:20.247439] [DEBUG] [LOCAL ] HMC: Loaded 34329 existing records from primary storage. [2025-09-16T21:16:20.247887] [INFO ] [MAIN ] HMC: Loaded 34329 primary data records. [2025-09-16T21:16:20.315475] [DEBUG] [LOCAL ] HLX: Derivative data saved (1339 records). [2025-09-16T21:16:20.346049] [INFO ] [MAIN ] HLX: Successfully saved derivative data. [2025-09-16T21:16:20.384270] [INFO ] [MAIN ] Derivative Progress: 822/2026 symbols completed. HLX took 1.1s. Estimated remaining: 6m 33s. Rate: 183.6 symbols/min [2025-09-16T21:16:20.384865] [DEBUG] [LOCAL ] HMN: Loaded 17941 existing records from primary storage. [2025-09-16T21:16:20.385091] [INFO ] [MAIN ] HMY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:20.385283] [INFO ] [MAIN ] HMN: Loaded 17941 primary data records. [2025-09-16T21:16:20.843278] [DEBUG] [LOCAL ] HMY: Loaded 39534 existing records from primary storage. [2025-09-16T21:16:20.843943] [INFO ] [MAIN ] HMY: Loaded 39534 primary data records. [2025-09-16T21:16:20.968304] [DEBUG] [MAIN ] HMC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:21.016569] [INFO ] [MAIN ] HMC: Generated 1339 derivative records from 34329 primary records. [2025-09-16T21:16:21.041665] [DEBUG] [LOCAL ] HMC: Saving derivative data. [2025-09-16T21:16:21.152953] [DEBUG] [LOCAL ] HMC: Derivative data saved (1339 records). [2025-09-16T21:16:21.153606] [INFO ] [MAIN ] HMC: Successfully saved derivative data. [2025-09-16T21:16:21.155518] [INFO ] [MAIN ] Derivative Progress: 823/2026 symbols completed. HMC took 1.0s. Estimated remaining: 6m 34s. Rate: 183.3 symbols/min [2025-09-16T21:16:21.155898] [DEBUG] [MAIN ] HMN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:21.157022] [INFO ] [MAIN ] HMN: Generated 1339 derivative records from 17941 primary records. [2025-09-16T21:16:21.157204] [DEBUG] [LOCAL ] HMN: Saving derivative data. [2025-09-16T21:16:21.170009] [DEBUG] [LOCAL ] HMN: Derivative data saved (1339 records). [2025-09-16T21:16:21.170231] [INFO ] [MAIN ] HMN: Successfully saved derivative data. [2025-09-16T21:16:21.172236] [INFO ] [MAIN ] Derivative Progress: 824/2026 symbols completed. HMN took 0.9s. Estimated remaining: 6m 33s. Rate: 183.5 symbols/min [2025-09-16T21:16:21.185211] [DEBUG] [MAIN ] HMY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:21.185862] [INFO ] [MAIN ] HMY: Generated 1339 derivative records from 39534 primary records. [2025-09-16T21:16:21.185940] [DEBUG] [LOCAL ] HMY: Saving derivative data. [2025-09-16T21:16:21.198479] [DEBUG] [LOCAL ] HMY: Derivative data saved (1339 records). [2025-09-16T21:16:21.198542] [INFO ] [MAIN ] HMY: Successfully saved derivative data. [2025-09-16T21:16:21.200516] [INFO ] [MAIN ] Derivative Progress: 825/2026 symbols completed. HMY took 0.8s. Estimated remaining: 6m 32s. Rate: 183.8 symbols/min [2025-09-16T21:16:21.200943] [INFO ] [MAIN ] HNI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:21.201106] [INFO ] [MAIN ] HOMB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:21.201060] [INFO ] [MAIN ] HOG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:21.224382] [DEBUG] [LOCAL ] HNI: Loaded 21452 existing records from primary storage. [2025-09-16T21:16:21.231487] [INFO ] [MAIN ] HNI: Loaded 21452 primary data records. [2025-09-16T21:16:21.389424] [DEBUG] [LOCAL ] HOMB: Loaded 31713 existing records from primary storage. [2025-09-16T21:16:21.389898] [DEBUG] [LOCAL ] HOG: Loaded 37825 existing records from primary storage. [2025-09-16T21:16:21.446859] [INFO ] [MAIN ] HOMB: Loaded 31713 primary data records. [2025-09-16T21:16:21.444571] [INFO ] [MAIN ] HOG: Loaded 37825 primary data records. [2025-09-16T21:16:22.125665] [DEBUG] [MAIN ] HNI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:22.126375] [INFO ] [MAIN ] HNI: Generated 1339 derivative records from 21452 primary records. [2025-09-16T21:16:22.126995] [DEBUG] [LOCAL ] HNI: Saving derivative data. [2025-09-16T21:16:22.140374] [DEBUG] [LOCAL ] HNI: Derivative data saved (1339 records). [2025-09-16T21:16:22.140754] [INFO ] [MAIN ] HNI: Successfully saved derivative data. [2025-09-16T21:16:22.142348] [INFO ] [MAIN ] Derivative Progress: 826/2026 symbols completed. HNI took 0.9s. Estimated remaining: 6m 33s. Rate: 183.3 symbols/min [2025-09-16T21:16:22.142699] [INFO ] [MAIN ] HOUS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:22.157458] [DEBUG] [MAIN ] HOMB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:22.167223] [INFO ] [MAIN ] HOMB: Generated 1339 derivative records from 31713 primary records. [2025-09-16T21:16:22.167570] [DEBUG] [LOCAL ] HOMB: Saving derivative data. [2025-09-16T21:16:22.167529] [DEBUG] [MAIN ] HOG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:22.168660] [INFO ] [MAIN ] HOG: Generated 1339 derivative records from 37825 primary records. [2025-09-16T21:16:22.168927] [DEBUG] [LOCAL ] HOG: Saving derivative data. [2025-09-16T21:16:22.198018] [DEBUG] [LOCAL ] HOMB: Derivative data saved (1339 records). [2025-09-16T21:16:22.198952] [INFO ] [MAIN ] HOMB: Successfully saved derivative data. [2025-09-16T21:16:22.200373] [DEBUG] [LOCAL ] HOG: Derivative data saved (1339 records). [2025-09-16T21:16:22.202702] [INFO ] [MAIN ] Derivative Progress: 827/2026 symbols completed. HOMB took 1.0s. Estimated remaining: 6m 32s. Rate: 183.5 symbols/min [2025-09-16T21:16:22.203278] [INFO ] [MAIN ] HOG: Successfully saved derivative data. [2025-09-16T21:16:22.205811] [INFO ] [MAIN ] Derivative Progress: 828/2026 symbols completed. HOG took 1.0s. Estimated remaining: 6m 31s. Rate: 183.7 symbols/min [2025-09-16T21:16:22.203431] [INFO ] [MAIN ] HOV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:22.206439] [INFO ] [MAIN ] HP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:22.216934] [DEBUG] [LOCAL ] HOUS: Loaded 32881 existing records from primary storage. [2025-09-16T21:16:22.217232] [INFO ] [MAIN ] HOUS: Loaded 32881 primary data records. [2025-09-16T21:16:22.335858] [DEBUG] [LOCAL ] HOV: Loaded 10592 existing records from primary storage. [2025-09-16T21:16:22.336126] [INFO ] [MAIN ] HOV: Loaded 10592 primary data records. [2025-09-16T21:16:22.623077] [DEBUG] [LOCAL ] HP: Loaded 38678 existing records from primary storage. [2025-09-16T21:16:22.628709] [INFO ] [MAIN ] HP: Loaded 38678 primary data records. [2025-09-16T21:16:23.077589] [DEBUG] [MAIN ] HOUS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:23.079411] [INFO ] [MAIN ] HOUS: Generated 1339 derivative records from 32881 primary records. [2025-09-16T21:16:23.080089] [DEBUG] [LOCAL ] HOUS: Saving derivative data. [2025-09-16T21:16:23.095927] [DEBUG] [LOCAL ] HOUS: Derivative data saved (1339 records). [2025-09-16T21:16:23.102013] [INFO ] [MAIN ] HOUS: Successfully saved derivative data. [2025-09-16T21:16:23.107364] [INFO ] [MAIN ] Derivative Progress: 829/2026 symbols completed. HOUS took 1.0s. Estimated remaining: 6m 32s. Rate: 183.3 symbols/min [2025-09-16T21:16:23.107677] [DEBUG] [MAIN ] HOV: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:23.108611] [INFO ] [MAIN ] HOV: Generated 1339 derivative records from 10592 primary records. [2025-09-16T21:16:23.108715] [DEBUG] [LOCAL ] HOV: Saving derivative data. [2025-09-16T21:16:23.109850] [INFO ] [MAIN ] HPE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:23.121740] [DEBUG] [LOCAL ] HOV: Derivative data saved (1339 records). [2025-09-16T21:16:23.121950] [INFO ] [MAIN ] HOV: Successfully saved derivative data. [2025-09-16T21:16:23.124112] [INFO ] [MAIN ] Derivative Progress: 830/2026 symbols completed. HOV took 0.9s. Estimated remaining: 6m 31s. Rate: 183.6 symbols/min [2025-09-16T21:16:23.124320] [INFO ] [MAIN ] HPF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:23.138070] [DEBUG] [MAIN ] HP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:23.138756] [INFO ] [MAIN ] HP: Generated 1339 derivative records from 38678 primary records. [2025-09-16T21:16:23.138911] [DEBUG] [LOCAL ] HP: Saving derivative data. [2025-09-16T21:16:23.149211] [DEBUG] [LOCAL ] HPF: Loaded 5625 existing records from primary storage. [2025-09-16T21:16:23.153314] [INFO ] [MAIN ] HPF: Loaded 5625 primary data records. [2025-09-16T21:16:23.177442] [DEBUG] [LOCAL ] HP: Derivative data saved (1339 records). [2025-09-16T21:16:23.227575] [INFO ] [MAIN ] HP: Successfully saved derivative data. [2025-09-16T21:16:23.230057] [INFO ] [MAIN ] Derivative Progress: 831/2026 symbols completed. HP took 1.0s. Estimated remaining: 6m 30s. Rate: 183.7 symbols/min [2025-09-16T21:16:23.275929] [INFO ] [MAIN ] HPI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:23.364119] [DEBUG] [LOCAL ] HPE: Loaded 40047 existing records from primary storage. [2025-09-16T21:16:23.448804] [INFO ] [MAIN ] HPE: Loaded 40047 primary data records. [2025-09-16T21:16:23.508952] [DEBUG] [LOCAL ] HPI: Loaded 7756 existing records from primary storage. [2025-09-16T21:16:23.530303] [INFO ] [MAIN ] HPI: Loaded 7756 primary data records. [2025-09-16T21:16:24.024934] [DEBUG] [MAIN ] HPF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:24.026095] [INFO ] [MAIN ] HPF: Generated 1339 derivative records from 5625 primary records. [2025-09-16T21:16:24.026547] [DEBUG] [LOCAL ] HPF: Saving derivative data. [2025-09-16T21:16:24.041707] [DEBUG] [LOCAL ] HPF: Derivative data saved (1339 records). [2025-09-16T21:16:24.042788] [INFO ] [MAIN ] HPF: Successfully saved derivative data. [2025-09-16T21:16:24.045497] [INFO ] [MAIN ] Derivative Progress: 832/2026 symbols completed. HPF took 0.9s. Estimated remaining: 6m 31s. Rate: 183.4 symbols/min [2025-09-16T21:16:24.045888] [INFO ] [MAIN ] HPP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:24.057600] [DEBUG] [MAIN ] HPE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:24.059395] [INFO ] [MAIN ] HPE: Generated 1339 derivative records from 40047 primary records. [2025-09-16T21:16:24.060485] [DEBUG] [LOCAL ] HPE: Saving derivative data. [2025-09-16T21:16:24.083889] [DEBUG] [MAIN ] HPI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:24.090585] [INFO ] [MAIN ] HPI: Generated 1339 derivative records from 7756 primary records. [2025-09-16T21:16:24.091101] [DEBUG] [LOCAL ] HPE: Derivative data saved (1339 records). [2025-09-16T21:16:24.091286] [DEBUG] [LOCAL ] HPI: Saving derivative data. [2025-09-16T21:16:24.091615] [INFO ] [MAIN ] HPE: Successfully saved derivative data. [2025-09-16T21:16:24.095413] [INFO ] [MAIN ] Derivative Progress: 833/2026 symbols completed. HPE took 1.0s. Estimated remaining: 6m 30s. Rate: 183.6 symbols/min [2025-09-16T21:16:24.095800] [INFO ] [MAIN ] HPQ: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:24.119839] [DEBUG] [LOCAL ] HPI: Derivative data saved (1339 records). [2025-09-16T21:16:24.120201] [INFO ] [MAIN ] HPI: Successfully saved derivative data. [2025-09-16T21:16:24.122340] [INFO ] [MAIN ] Derivative Progress: 834/2026 symbols completed. HPI took 0.9s. Estimated remaining: 6m 29s. Rate: 183.8 symbols/min [2025-09-16T21:16:24.122695] [INFO ] [MAIN ] HPS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:24.140333] [DEBUG] [LOCAL ] HPP: Loaded 38143 existing records from primary storage. [2025-09-16T21:16:24.140549] [INFO ] [MAIN ] HPP: Loaded 38143 primary data records. [2025-09-16T21:16:24.155885] [DEBUG] [LOCAL ] HPS: Loaded 7704 existing records from primary storage. [2025-09-16T21:16:24.180967] [INFO ] [MAIN ] HPS: Loaded 7704 primary data records. [2025-09-16T21:16:24.470218] [DEBUG] [LOCAL ] HPQ: Loaded 40021 existing records from primary storage. [2025-09-16T21:16:24.562496] [INFO ] [MAIN ] HPQ: Loaded 40021 primary data records. [2025-09-16T21:16:25.078502] [DEBUG] [MAIN ] HPS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:25.079347] [INFO ] [MAIN ] HPS: Generated 1339 derivative records from 7704 primary records. [2025-09-16T21:16:25.079581] [DEBUG] [LOCAL ] HPS: Saving derivative data. [2025-09-16T21:16:25.090056] [DEBUG] [MAIN ] HPP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:25.102440] [INFO ] [MAIN ] HPP: Generated 1339 derivative records from 38143 primary records. [2025-09-16T21:16:25.109309] [DEBUG] [LOCAL ] HPP: Saving derivative data. [2025-09-16T21:16:25.114865] [DEBUG] [MAIN ] HPQ: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:25.123591] [DEBUG] [LOCAL ] HPS: Derivative data saved (1339 records). [2025-09-16T21:16:25.121940] [INFO ] [MAIN ] HPQ: Generated 1339 derivative records from 40021 primary records. [2025-09-16T21:16:25.125857] [INFO ] [MAIN ] HPS: Successfully saved derivative data. [2025-09-16T21:16:25.128207] [INFO ] [MAIN ] Derivative Progress: 835/2026 symbols completed. HPS took 1.0s. Estimated remaining: 6m 30s. Rate: 183.3 symbols/min [2025-09-16T21:16:25.128271] [DEBUG] [LOCAL ] HPQ: Saving derivative data. [2025-09-16T21:16:25.129056] [INFO ] [MAIN ] HQH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:25.138756] [DEBUG] [LOCAL ] HPP: Derivative data saved (1339 records). [2025-09-16T21:16:25.142449] [INFO ] [MAIN ] HPP: Successfully saved derivative data. [2025-09-16T21:16:25.144944] [INFO ] [MAIN ] Derivative Progress: 836/2026 symbols completed. HPP took 1.1s. Estimated remaining: 6m 29s. Rate: 183.5 symbols/min [2025-09-16T21:16:25.145578] [INFO ] [MAIN ] HQL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:25.148990] [DEBUG] [LOCAL ] HPQ: Derivative data saved (1339 records). [2025-09-16T21:16:25.149114] [INFO ] [MAIN ] HPQ: Successfully saved derivative data. [2025-09-16T21:16:25.151306] [INFO ] [MAIN ] Derivative Progress: 837/2026 symbols completed. HPQ took 1.1s. Estimated remaining: 6m 28s. Rate: 183.7 symbols/min [2025-09-16T21:16:25.151586] [INFO ] [MAIN ] HRB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:25.172730] [DEBUG] [LOCAL ] HQH: Loaded 18896 existing records from primary storage. [2025-09-16T21:16:25.173175] [INFO ] [MAIN ] HQH: Loaded 18896 primary data records. [2025-09-16T21:16:25.173021] [DEBUG] [LOCAL ] HQL: Loaded 11773 existing records from primary storage. [2025-09-16T21:16:25.184560] [INFO ] [MAIN ] HQL: Loaded 11773 primary data records. [2025-09-16T21:16:25.552722] [DEBUG] [LOCAL ] HRB: Loaded 36056 existing records from primary storage. [2025-09-16T21:16:25.628461] [INFO ] [MAIN ] HRB: Loaded 36056 primary data records. [2025-09-16T21:16:26.039177] [DEBUG] [MAIN ] HQH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:26.040744] [INFO ] [MAIN ] HQH: Generated 1339 derivative records from 18896 primary records. [2025-09-16T21:16:26.041366] [DEBUG] [LOCAL ] HQH: Saving derivative data. [2025-09-16T21:16:26.053566] [DEBUG] [MAIN ] HQL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:26.054549] [INFO ] [MAIN ] HQL: Generated 1339 derivative records from 11773 primary records. [2025-09-16T21:16:26.054737] [DEBUG] [LOCAL ] HQL: Saving derivative data. [2025-09-16T21:16:26.076936] [DEBUG] [LOCAL ] HQL: Derivative data saved (1339 records). [2025-09-16T21:16:26.077977] [INFO ] [MAIN ] HQL: Successfully saved derivative data. [2025-09-16T21:16:26.079737] [DEBUG] [LOCAL ] HQH: Derivative data saved (1339 records). [2025-09-16T21:16:26.081916] [INFO ] [MAIN ] Derivative Progress: 838/2026 symbols completed. HQL took 0.9s. Estimated remaining: 6m 29s. Rate: 183.3 symbols/min [2025-09-16T21:16:26.079903] [INFO ] [MAIN ] HQH: Successfully saved derivative data. [2025-09-16T21:16:26.084112] [INFO ] [MAIN ] Derivative Progress: 839/2026 symbols completed. HQH took 1.0s. Estimated remaining: 6m 28s. Rate: 183.5 symbols/min [2025-09-16T21:16:26.096678] [DEBUG] [MAIN ] HRB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:26.097249] [INFO ] [MAIN ] HRB: Generated 1339 derivative records from 36056 primary records. [2025-09-16T21:16:26.097360] [DEBUG] [LOCAL ] HRB: Saving derivative data. [2025-09-16T21:16:26.109221] [DEBUG] [LOCAL ] HRB: Derivative data saved (1339 records). [2025-09-16T21:16:26.109287] [INFO ] [MAIN ] HRB: Successfully saved derivative data. [2025-09-16T21:16:26.111524] [INFO ] [MAIN ] Derivative Progress: 840/2026 symbols completed. HRB took 1.0s. Estimated remaining: 6m 27s. Rate: 183.7 symbols/min [2025-09-16T21:16:26.111955] [INFO ] [MAIN ] HRI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:26.112107] [INFO ] [MAIN ] HRL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:26.112195] [INFO ] [MAIN ] HRTG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:26.153249] [DEBUG] [LOCAL ] HRTG: Loaded 25347 existing records from primary storage. [2025-09-16T21:16:26.160816] [INFO ] [MAIN ] HRTG: Loaded 25347 primary data records. [2025-09-16T21:16:26.172451] [DEBUG] [LOCAL ] HRI: Loaded 24045 existing records from primary storage. [2025-09-16T21:16:26.199031] [INFO ] [MAIN ] HRI: Loaded 24045 primary data records. [2025-09-16T21:16:26.275423] [DEBUG] [LOCAL ] HRL: Loaded 39585 existing records from primary storage. [2025-09-16T21:16:26.330260] [INFO ] [MAIN ] HRL: Loaded 39585 primary data records. [2025-09-16T21:16:27.066619] [DEBUG] [MAIN ] HRTG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:27.067948] [INFO ] [MAIN ] HRTG: Generated 1339 derivative records from 25347 primary records. [2025-09-16T21:16:27.068449] [DEBUG] [LOCAL ] HRTG: Saving derivative data. [2025-09-16T21:16:27.086135] [DEBUG] [LOCAL ] HRTG: Derivative data saved (1339 records). [2025-09-16T21:16:27.086493] [INFO ] [MAIN ] HRTG: Successfully saved derivative data. [2025-09-16T21:16:27.088100] [INFO ] [MAIN ] Derivative Progress: 841/2026 symbols completed. HRTG took 1.0s. Estimated remaining: 6m 28s. Rate: 183.3 symbols/min [2025-09-16T21:16:27.094392] [INFO ] [MAIN ] HSBC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:27.108377] [DEBUG] [MAIN ] HRI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:27.108946] [DEBUG] [MAIN ] HRL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:27.109796] [INFO ] [MAIN ] HRL: Generated 1339 derivative records from 39585 primary records. [2025-09-16T21:16:27.110574] [INFO ] [MAIN ] HRI: Generated 1339 derivative records from 24045 primary records. [2025-09-16T21:16:27.110727] [DEBUG] [LOCAL ] HRL: Saving derivative data. [2025-09-16T21:16:27.110833] [DEBUG] [LOCAL ] HRI: Saving derivative data. [2025-09-16T21:16:27.137427] [DEBUG] [LOCAL ] HRI: Derivative data saved (1339 records). [2025-09-16T21:16:27.135940] [DEBUG] [LOCAL ] HRL: Derivative data saved (1339 records). [2025-09-16T21:16:27.137767] [INFO ] [MAIN ] HRL: Successfully saved derivative data. [2025-09-16T21:16:27.137600] [INFO ] [MAIN ] HRI: Successfully saved derivative data. [2025-09-16T21:16:27.139900] [INFO ] [MAIN ] Derivative Progress: 842/2026 symbols completed. HRI took 1.0s. Estimated remaining: 6m 27s. Rate: 183.5 symbols/min [2025-09-16T21:16:27.142779] [INFO ] [MAIN ] HSHP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:27.142845] [INFO ] [MAIN ] Derivative Progress: 843/2026 symbols completed. HRL took 1.0s. Estimated remaining: 6m 26s. Rate: 183.7 symbols/min [2025-09-16T21:16:27.143537] [INFO ] [MAIN ] HSY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:27.169287] [DEBUG] [LOCAL ] HSHP: Loaded 10229 existing records from primary storage. [2025-09-16T21:16:27.169733] [INFO ] [MAIN ] HSHP: Loaded 10229 primary data records. [2025-09-16T21:16:27.286823] [DEBUG] [LOCAL ] HSBC: Loaded 37817 existing records from primary storage. [2025-09-16T21:16:27.333582] [INFO ] [MAIN ] HSBC: Loaded 37817 primary data records. [2025-09-16T21:16:27.386843] [DEBUG] [LOCAL ] HSY: Loaded 37663 existing records from primary storage. [2025-09-16T21:16:27.387057] [INFO ] [MAIN ] HSY: Loaded 37663 primary data records. [2025-09-16T21:16:28.049014] [DEBUG] [MAIN ] HSHP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:28.050238] [INFO ] [MAIN ] HSHP: Generated 1339 derivative records from 10229 primary records. [2025-09-16T21:16:28.051072] [DEBUG] [LOCAL ] HSHP: Saving derivative data. [2025-09-16T21:16:28.067601] [DEBUG] [LOCAL ] HSHP: Derivative data saved (1339 records). [2025-09-16T21:16:28.069394] [INFO ] [MAIN ] HSHP: Successfully saved derivative data. [2025-09-16T21:16:28.073018] [INFO ] [MAIN ] Derivative Progress: 844/2026 symbols completed. HSHP took 0.9s. Estimated remaining: 6m 27s. Rate: 183.3 symbols/min [2025-09-16T21:16:28.079371] [INFO ] [MAIN ] HTD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:28.084182] [DEBUG] [MAIN ] HSBC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:28.094240] [INFO ] [MAIN ] HSBC: Generated 1339 derivative records from 37817 primary records. [2025-09-16T21:16:28.094451] [DEBUG] [MAIN ] HSY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:28.095225] [INFO ] [MAIN ] HSY: Generated 1339 derivative records from 37663 primary records. [2025-09-16T21:16:28.094667] [DEBUG] [LOCAL ] HSBC: Saving derivative data. [2025-09-16T21:16:28.095342] [DEBUG] [LOCAL ] HSY: Saving derivative data. [2025-09-16T21:16:28.124119] [DEBUG] [LOCAL ] HSBC: Derivative data saved (1339 records). [2025-09-16T21:16:28.128231] [DEBUG] [LOCAL ] HSY: Derivative data saved (1339 records). [2025-09-16T21:16:28.128676] [INFO ] [MAIN ] HSY: Successfully saved derivative data. [2025-09-16T21:16:28.128808] [INFO ] [MAIN ] HSBC: Successfully saved derivative data. [2025-09-16T21:16:28.130734] [INFO ] [MAIN ] Derivative Progress: 845/2026 symbols completed. HSY took 1.0s. Estimated remaining: 6m 26s. Rate: 183.5 symbols/min [2025-09-16T21:16:28.128572] [DEBUG] [LOCAL ] HTD: Loaded 10000 existing records from primary storage. [2025-09-16T21:16:28.133207] [INFO ] [MAIN ] HTGC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:28.133271] [INFO ] [MAIN ] Derivative Progress: 846/2026 symbols completed. HSBC took 1.0s. Estimated remaining: 6m 25s. Rate: 183.7 symbols/min [2025-09-16T21:16:28.133947] [INFO ] [MAIN ] HTD: Loaded 10000 primary data records. [2025-09-16T21:16:28.133745] [INFO ] [MAIN ] HTH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:28.358398] [DEBUG] [LOCAL ] HTH: Loaded 25177 existing records from primary storage. [2025-09-16T21:16:28.423820] [INFO ] [MAIN ] HTH: Loaded 25177 primary data records. [2025-09-16T21:16:28.448167] [DEBUG] [LOCAL ] HTGC: Loaded 35199 existing records from primary storage. [2025-09-16T21:16:28.460555] [INFO ] [MAIN ] HTGC: Loaded 35199 primary data records. [2025-09-16T21:16:29.058336] [DEBUG] [MAIN ] HTD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:29.059312] [INFO ] [MAIN ] HTD: Generated 1339 derivative records from 10000 primary records. [2025-09-16T21:16:29.060065] [DEBUG] [LOCAL ] HTD: Saving derivative data. [2025-09-16T21:16:29.076750] [DEBUG] [LOCAL ] HTD: Derivative data saved (1339 records). [2025-09-16T21:16:29.076974] [INFO ] [MAIN ] HTD: Successfully saved derivative data. [2025-09-16T21:16:29.078891] [INFO ] [MAIN ] Derivative Progress: 847/2026 symbols completed. HTD took 1.0s. Estimated remaining: 6m 26s. Rate: 183.3 symbols/min [2025-09-16T21:16:29.080388] [INFO ] [MAIN ] HUBB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:29.094169] [DEBUG] [MAIN ] HTH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:29.094886] [INFO ] [MAIN ] HTH: Generated 1339 derivative records from 25177 primary records. [2025-09-16T21:16:29.095029] [DEBUG] [LOCAL ] HTH: Saving derivative data. [2025-09-16T21:16:29.115385] [DEBUG] [MAIN ] HTGC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:29.118638] [INFO ] [MAIN ] HTGC: Generated 1339 derivative records from 35199 primary records. [2025-09-16T21:16:29.119482] [DEBUG] [LOCAL ] HTGC: Saving derivative data. [2025-09-16T21:16:29.119562] [DEBUG] [LOCAL ] HTH: Derivative data saved (1339 records). [2025-09-16T21:16:29.120375] [INFO ] [MAIN ] HTH: Successfully saved derivative data. [2025-09-16T21:16:29.122328] [INFO ] [MAIN ] Derivative Progress: 848/2026 symbols completed. HTH took 1.0s. Estimated remaining: 6m 25s. Rate: 183.5 symbols/min [2025-09-16T21:16:29.122808] [INFO ] [MAIN ] HUBS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:29.142928] [DEBUG] [LOCAL ] HTGC: Derivative data saved (1339 records). [2025-09-16T21:16:29.143571] [INFO ] [MAIN ] HTGC: Successfully saved derivative data. [2025-09-16T21:16:29.152599] [INFO ] [MAIN ] Derivative Progress: 849/2026 symbols completed. HTGC took 1.0s. Estimated remaining: 6m 24s. Rate: 183.7 symbols/min [2025-09-16T21:16:29.154117] [INFO ] [MAIN ] HUM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:29.154742] [DEBUG] [LOCAL ] HUBB: Loaded 26937 existing records from primary storage. [2025-09-16T21:16:29.155078] [INFO ] [MAIN ] HUBB: Loaded 26937 primary data records. [2025-09-16T21:16:29.440557] [DEBUG] [LOCAL ] HUBS: Loaded 29255 existing records from primary storage. [2025-09-16T21:16:29.440850] [INFO ] [MAIN ] HUBS: Loaded 29255 primary data records. [2025-09-16T21:16:29.543159] [DEBUG] [LOCAL ] HUM: Loaded 36539 existing records from primary storage. [2025-09-16T21:16:29.561840] [INFO ] [MAIN ] HUM: Loaded 36539 primary data records. [2025-09-16T21:16:30.001284] [DEBUG] [MAIN ] HUBB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:30.002518] [INFO ] [MAIN ] HUBB: Generated 1339 derivative records from 26937 primary records. [2025-09-16T21:16:30.003335] [DEBUG] [LOCAL ] HUBB: Saving derivative data. [2025-09-16T21:16:30.018595] [DEBUG] [LOCAL ] HUBB: Derivative data saved (1339 records). [2025-09-16T21:16:30.020397] [INFO ] [MAIN ] HUBB: Successfully saved derivative data. [2025-09-16T21:16:30.022938] [INFO ] [MAIN ] Derivative Progress: 850/2026 symbols completed. HUBB took 0.9s. Estimated remaining: 6m 25s. Rate: 183.3 symbols/min [2025-09-16T21:16:30.023373] [INFO ] [MAIN ] HUN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:30.034206] [DEBUG] [MAIN ] HUBS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:30.034872] [INFO ] [MAIN ] HUBS: Generated 1339 derivative records from 29255 primary records. [2025-09-16T21:16:30.034976] [DEBUG] [LOCAL ] HUBS: Saving derivative data. [2025-09-16T21:16:30.059759] [DEBUG] [LOCAL ] HUBS: Derivative data saved (1339 records). [2025-09-16T21:16:30.060149] [DEBUG] [MAIN ] HUM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:30.060221] [INFO ] [MAIN ] HUBS: Successfully saved derivative data. [2025-09-16T21:16:30.061964] [INFO ] [MAIN ] Derivative Progress: 851/2026 symbols completed. HUBS took 0.9s. Estimated remaining: 6m 24s. Rate: 183.5 symbols/min [2025-09-16T21:16:30.063320] [INFO ] [MAIN ] HUYA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:30.063255] [INFO ] [MAIN ] HUM: Generated 1339 derivative records from 36539 primary records. [2025-09-16T21:16:30.063810] [DEBUG] [LOCAL ] HUM: Saving derivative data. [2025-09-16T21:16:30.076574] [DEBUG] [LOCAL ] HUM: Derivative data saved (1339 records). [2025-09-16T21:16:30.076745] [INFO ] [MAIN ] HUM: Successfully saved derivative data. [2025-09-16T21:16:30.078875] [INFO ] [MAIN ] Derivative Progress: 852/2026 symbols completed. HUM took 0.9s. Estimated remaining: 6m 23s. Rate: 183.7 symbols/min [2025-09-16T21:16:30.087971] [INFO ] [MAIN ] HVT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:30.118512] [DEBUG] [LOCAL ] HUN: Loaded 39628 existing records from primary storage. [2025-09-16T21:16:30.118699] [INFO ] [MAIN ] HUN: Loaded 39628 primary data records. [2025-09-16T21:16:30.134445] [DEBUG] [LOCAL ] HVT: Loaded 11049 existing records from primary storage. [2025-09-16T21:16:30.155372] [INFO ] [MAIN ] HVT: Loaded 11049 primary data records. [2025-09-16T21:16:30.358682] [DEBUG] [LOCAL ] HUYA: Loaded 32344 existing records from primary storage. [2025-09-16T21:16:30.416227] [INFO ] [MAIN ] HUYA: Loaded 32344 primary data records. [2025-09-16T21:16:30.942090] [DEBUG] [MAIN ] HUN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:30.943017] [INFO ] [MAIN ] HUN: Generated 1339 derivative records from 39628 primary records. [2025-09-16T21:16:30.943245] [DEBUG] [LOCAL ] HUN: Saving derivative data. [2025-09-16T21:16:30.958073] [DEBUG] [LOCAL ] HUN: Derivative data saved (1339 records). [2025-09-16T21:16:30.958229] [INFO ] [MAIN ] HUN: Successfully saved derivative data. [2025-09-16T21:16:30.959863] [INFO ] [MAIN ] Derivative Progress: 853/2026 symbols completed. HUN took 0.9s. Estimated remaining: 6m 24s. Rate: 183.3 symbols/min [2025-09-16T21:16:30.970017] [DEBUG] [MAIN ] HVT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:30.970568] [INFO ] [MAIN ] HVT: Generated 1339 derivative records from 11049 primary records. [2025-09-16T21:16:30.970703] [DEBUG] [LOCAL ] HVT: Saving derivative data. [2025-09-16T21:16:30.984331] [DEBUG] [LOCAL ] HVT: Derivative data saved (1339 records). [2025-09-16T21:16:30.984516] [INFO ] [MAIN ] HVT: Successfully saved derivative data. [2025-09-16T21:16:30.986508] [INFO ] [MAIN ] Derivative Progress: 854/2026 symbols completed. HVT took 0.9s. Estimated remaining: 6m 23s. Rate: 183.5 symbols/min [2025-09-16T21:16:30.995942] [DEBUG] [MAIN ] HUYA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:30.996461] [INFO ] [MAIN ] HUYA: Generated 1339 derivative records from 32344 primary records. [2025-09-16T21:16:30.996521] [DEBUG] [LOCAL ] HUYA: Saving derivative data. [2025-09-16T21:16:31.007866] [DEBUG] [LOCAL ] HUYA: Derivative data saved (1339 records). [2025-09-16T21:16:31.007923] [INFO ] [MAIN ] HUYA: Successfully saved derivative data. [2025-09-16T21:16:31.010121] [INFO ] [MAIN ] Derivative Progress: 855/2026 symbols completed. HUYA took 0.9s. Estimated remaining: 6m 22s. Rate: 183.7 symbols/min [2025-09-16T21:16:31.010484] [INFO ] [MAIN ] HWM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:31.010715] [INFO ] [MAIN ] HY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:31.010616] [INFO ] [MAIN ] HXL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:31.020608] [DEBUG] [LOCAL ] HY: Loaded 7194 existing records from primary storage. [2025-09-16T21:16:31.020819] [INFO ] [MAIN ] HY: Loaded 7194 primary data records. [2025-09-16T21:16:31.347458] [DEBUG] [LOCAL ] HWM: Loaded 39509 existing records from primary storage. [2025-09-16T21:16:31.347655] [INFO ] [MAIN ] HWM: Loaded 39509 primary data records. [2025-09-16T21:16:31.348067] [DEBUG] [LOCAL ] HXL: Loaded 34210 existing records from primary storage. [2025-09-16T21:16:31.359429] [INFO ] [MAIN ] HXL: Loaded 34210 primary data records. [2025-09-16T21:16:31.889711] [DEBUG] [MAIN ] HY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:31.890747] [INFO ] [MAIN ] HY: Generated 1339 derivative records from 7194 primary records. [2025-09-16T21:16:31.891236] [DEBUG] [LOCAL ] HY: Saving derivative data. [2025-09-16T21:16:31.904719] [DEBUG] [LOCAL ] HY: Derivative data saved (1339 records). [2025-09-16T21:16:31.905121] [INFO ] [MAIN ] HY: Successfully saved derivative data. [2025-09-16T21:16:31.907177] [INFO ] [MAIN ] Derivative Progress: 856/2026 symbols completed. HY took 0.9s. Estimated remaining: 6m 23s. Rate: 183.4 symbols/min [2025-09-16T21:16:31.907578] [INFO ] [MAIN ] HYI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:31.920571] [DEBUG] [MAIN ] HWM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:31.921228] [INFO ] [MAIN ] HWM: Generated 1339 derivative records from 39509 primary records. [2025-09-16T21:16:31.923123] [DEBUG] [LOCAL ] HWM: Saving derivative data. [2025-09-16T21:16:31.936706] [DEBUG] [LOCAL ] HYI: Loaded 6467 existing records from primary storage. [2025-09-16T21:16:31.937333] [INFO ] [MAIN ] HYI: Loaded 6467 primary data records. [2025-09-16T21:16:31.982571] [DEBUG] [LOCAL ] HWM: Derivative data saved (1339 records). [2025-09-16T21:16:32.004840] [INFO ] [MAIN ] HWM: Successfully saved derivative data. [2025-09-16T21:16:32.011691] [INFO ] [MAIN ] Derivative Progress: 857/2026 symbols completed. HWM took 1.0s. Estimated remaining: 6m 22s. Rate: 183.5 symbols/min [2025-09-16T21:16:32.023552] [INFO ] [MAIN ] HYT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:32.065794] [DEBUG] [MAIN ] HXL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:32.105838] [INFO ] [MAIN ] HXL: Generated 1339 derivative records from 34210 primary records. [2025-09-16T21:16:32.129051] [DEBUG] [LOCAL ] HXL: Saving derivative data. [2025-09-16T21:16:32.231323] [DEBUG] [LOCAL ] HXL: Derivative data saved (1339 records). [2025-09-16T21:16:32.232163] [INFO ] [MAIN ] HXL: Successfully saved derivative data. [2025-09-16T21:16:32.241271] [INFO ] [MAIN ] Derivative Progress: 858/2026 symbols completed. HXL took 1.2s. Estimated remaining: 6m 22s. Rate: 183.6 symbols/min [2025-09-16T21:16:32.241938] [INFO ] [MAIN ] HYTR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:32.242655] [DEBUG] [LOCAL ] HYT: Loaded 24402 existing records from primary storage. [2025-09-16T21:16:32.242933] [INFO ] [MAIN ] HYT: Loaded 24402 primary data records. [2025-09-16T21:16:32.315179] [DEBUG] [LOCAL ] HYTR: Loaded 2235 existing records from primary storage. [2025-09-16T21:16:32.321796] [INFO ] [MAIN ] HYTR: Loaded 2235 primary data records. [2025-09-16T21:16:32.672417] [DEBUG] [MAIN ] HYI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:32.693180] [INFO ] [MAIN ] HYI: Generated 1339 derivative records from 6467 primary records. [2025-09-16T21:16:32.775004] [DEBUG] [LOCAL ] HYI: Saving derivative data. [2025-09-16T21:16:32.790918] [DEBUG] [LOCAL ] HYI: Derivative data saved (1339 records). [2025-09-16T21:16:32.791191] [INFO ] [MAIN ] HYI: Successfully saved derivative data. [2025-09-16T21:16:32.792800] [INFO ] [MAIN ] Derivative Progress: 859/2026 symbols completed. HYI took 0.9s. Estimated remaining: 6m 22s. Rate: 183.4 symbols/min [2025-09-16T21:16:32.793319] [INFO ] [MAIN ] HZO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:32.810324] [DEBUG] [MAIN ] HYT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:32.816394] [INFO ] [MAIN ] HYT: Generated 1339 derivative records from 24402 primary records. [2025-09-16T21:16:32.817038] [DEBUG] [LOCAL ] HYT: Saving derivative data. [2025-09-16T21:16:32.839943] [DEBUG] [MAIN ] HYTR: Filtered 5181 bins outside market hours, 5780 incomplete bins [2025-09-16T21:16:32.843814] [DEBUG] [LOCAL ] HZO: Loaded 20719 existing records from primary storage. [2025-09-16T21:16:32.843085] [INFO ] [MAIN ] HYTR: Generated 1338 derivative records from 2235 primary records. [2025-09-16T21:16:32.843920] [INFO ] [MAIN ] HZO: Loaded 20719 primary data records. [2025-09-16T21:16:32.844020] [DEBUG] [LOCAL ] HYTR: Saving derivative data. [2025-09-16T21:16:32.924658] [DEBUG] [LOCAL ] HYT: Derivative data saved (1339 records). [2025-09-16T21:16:32.932220] [INFO ] [MAIN ] HYT: Successfully saved derivative data. [2025-09-16T21:16:32.933721] [DEBUG] [LOCAL ] HYTR: Derivative data saved (1338 records). [2025-09-16T21:16:32.940814] [INFO ] [MAIN ] Derivative Progress: 860/2026 symbols completed. HYT took 0.9s. Estimated remaining: 6m 21s. Rate: 183.5 symbols/min [2025-09-16T21:16:32.940906] [INFO ] [MAIN ] HYTR: Successfully saved derivative data. [2025-09-16T21:16:32.948517] [INFO ] [MAIN ] Derivative Progress: 861/2026 symbols completed. HYTR took 0.7s. Estimated remaining: 6m 20s. Rate: 183.8 symbols/min [2025-09-16T21:16:32.946210] [INFO ] [MAIN ] IAE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:32.955453] [INFO ] [MAIN ] IAG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:33.132087] [DEBUG] [LOCAL ] IAE: Loaded 4267 existing records from primary storage. [2025-09-16T21:16:33.133310] [INFO ] [MAIN ] IAE: Loaded 4267 primary data records. [2025-09-16T21:16:33.274221] [DEBUG] [LOCAL ] IAG: Loaded 39848 existing records from primary storage. [2025-09-16T21:16:33.305052] [INFO ] [MAIN ] IAG: Loaded 39848 primary data records. [2025-09-16T21:16:33.740298] [DEBUG] [MAIN ] HZO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:33.741170] [INFO ] [MAIN ] HZO: Generated 1339 derivative records from 20719 primary records. [2025-09-16T21:16:33.741378] [DEBUG] [LOCAL ] HZO: Saving derivative data. [2025-09-16T21:16:33.758900] [DEBUG] [LOCAL ] HZO: Derivative data saved (1339 records). [2025-09-16T21:16:33.759230] [INFO ] [MAIN ] HZO: Successfully saved derivative data. [2025-09-16T21:16:33.761742] [INFO ] [MAIN ] Derivative Progress: 862/2026 symbols completed. HZO took 1.0s. Estimated remaining: 6m 21s. Rate: 183.4 symbols/min [2025-09-16T21:16:33.762820] [INFO ] [MAIN ] IBM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:33.776904] [DEBUG] [MAIN ] IAE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:33.777768] [INFO ] [MAIN ] IAE: Generated 1339 derivative records from 4267 primary records. [2025-09-16T21:16:33.778017] [DEBUG] [LOCAL ] IAE: Saving derivative data. [2025-09-16T21:16:33.803597] [DEBUG] [MAIN ] IAG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:33.804147] [DEBUG] [LOCAL ] IAE: Derivative data saved (1339 records). [2025-09-16T21:16:33.805023] [INFO ] [MAIN ] IAE: Successfully saved derivative data. [2025-09-16T21:16:33.804898] [INFO ] [MAIN ] IAG: Generated 1339 derivative records from 39848 primary records. [2025-09-16T21:16:33.805126] [DEBUG] [LOCAL ] IAG: Saving derivative data. [2025-09-16T21:16:33.807536] [INFO ] [MAIN ] Derivative Progress: 863/2026 symbols completed. IAE took 0.9s. Estimated remaining: 6m 20s. Rate: 183.6 symbols/min [2025-09-16T21:16:33.808417] [INFO ] [MAIN ] IBN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:33.828993] [DEBUG] [LOCAL ] IAG: Derivative data saved (1339 records). [2025-09-16T21:16:33.829189] [INFO ] [MAIN ] IAG: Successfully saved derivative data. [2025-09-16T21:16:33.831134] [INFO ] [MAIN ] Derivative Progress: 864/2026 symbols completed. IAG took 0.9s. Estimated remaining: 6m 19s. Rate: 183.8 symbols/min [2025-09-16T21:16:33.831508] [INFO ] [MAIN ] IBP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:33.848303] [DEBUG] [LOCAL ] IBM: Loaded 40001 existing records from primary storage. [2025-09-16T21:16:33.848511] [INFO ] [MAIN ] IBM: Loaded 40001 primary data records. [2025-09-16T21:16:33.984728] [DEBUG] [LOCAL ] IBP: Loaded 21669 existing records from primary storage. [2025-09-16T21:16:33.995583] [INFO ] [MAIN ] IBP: Loaded 21669 primary data records. [2025-09-16T21:16:34.037601] [DEBUG] [LOCAL ] IBN: Loaded 39380 existing records from primary storage. [2025-09-16T21:16:34.053064] [INFO ] [MAIN ] IBN: Loaded 39380 primary data records. [2025-09-16T21:16:34.717179] [DEBUG] [MAIN ] IBM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:34.718868] [INFO ] [MAIN ] IBM: Generated 1339 derivative records from 40001 primary records. [2025-09-16T21:16:34.719234] [DEBUG] [LOCAL ] IBM: Saving derivative data. [2025-09-16T21:16:34.732186] [DEBUG] [LOCAL ] IBM: Derivative data saved (1339 records). [2025-09-16T21:16:34.732866] [INFO ] [MAIN ] IBM: Successfully saved derivative data. [2025-09-16T21:16:34.734429] [INFO ] [MAIN ] Derivative Progress: 865/2026 symbols completed. IBM took 1.0s. Estimated remaining: 6m 20s. Rate: 183.4 symbols/min [2025-09-16T21:16:34.735414] [INFO ] [MAIN ] IBTA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:34.760104] [DEBUG] [MAIN ] IBP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:34.759796] [DEBUG] [MAIN ] IBN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:34.761053] [INFO ] [MAIN ] IBP: Generated 1339 derivative records from 21669 primary records. [2025-09-16T21:16:34.761197] [DEBUG] [LOCAL ] IBP: Saving derivative data. [2025-09-16T21:16:34.762038] [INFO ] [MAIN ] IBN: Generated 1339 derivative records from 39380 primary records. [2025-09-16T21:16:34.762844] [DEBUG] [LOCAL ] IBN: Saving derivative data. [2025-09-16T21:16:34.792097] [DEBUG] [LOCAL ] IBP: Derivative data saved (1339 records). [2025-09-16T21:16:34.794038] [DEBUG] [LOCAL ] IBN: Derivative data saved (1339 records). [2025-09-16T21:16:34.794131] [INFO ] [MAIN ] IBP: Successfully saved derivative data. [2025-09-16T21:16:34.804350] [INFO ] [MAIN ] Derivative Progress: 866/2026 symbols completed. IBP took 1.0s. Estimated remaining: 6m 19s. Rate: 183.6 symbols/min [2025-09-16T21:16:34.804463] [INFO ] [MAIN ] IBN: Successfully saved derivative data. [2025-09-16T21:16:34.804812] [INFO ] [MAIN ] ICE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:34.806129] [DEBUG] [LOCAL ] IBTA: Loaded 26290 existing records from primary storage. [2025-09-16T21:16:34.808601] [INFO ] [MAIN ] Derivative Progress: 867/2026 symbols completed. IBN took 1.0s. Estimated remaining: 6m 18s. Rate: 183.8 symbols/min [2025-09-16T21:16:34.809002] [INFO ] [MAIN ] IBTA: Loaded 26290 primary data records. [2025-09-16T21:16:34.808935] [INFO ] [MAIN ] ICL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:35.015878] [DEBUG] [LOCAL ] ICL: Loaded 28534 existing records from primary storage. [2025-09-16T21:16:35.097026] [INFO ] [MAIN ] ICL: Loaded 28534 primary data records. [2025-09-16T21:16:35.185283] [DEBUG] [LOCAL ] ICE: Loaded 39416 existing records from primary storage. [2025-09-16T21:16:35.208933] [INFO ] [MAIN ] ICE: Loaded 39416 primary data records. [2025-09-16T21:16:35.692059] [DEBUG] [MAIN ] IBTA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:35.692926] [INFO ] [MAIN ] IBTA: Generated 1339 derivative records from 26290 primary records. [2025-09-16T21:16:35.693381] [DEBUG] [LOCAL ] IBTA: Saving derivative data. [2025-09-16T21:16:35.708866] [DEBUG] [LOCAL ] IBTA: Derivative data saved (1339 records). [2025-09-16T21:16:35.709811] [INFO ] [MAIN ] IBTA: Successfully saved derivative data. [2025-09-16T21:16:35.711974] [INFO ] [MAIN ] Derivative Progress: 868/2026 symbols completed. IBTA took 1.0s. Estimated remaining: 6m 19s. Rate: 183.4 symbols/min [2025-09-16T21:16:35.727572] [DEBUG] [MAIN ] ICL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:35.736979] [INFO ] [MAIN ] ICL: Generated 1339 derivative records from 28534 primary records. [2025-09-16T21:16:35.737328] [DEBUG] [LOCAL ] ICL: Saving derivative data. [2025-09-16T21:16:35.737279] [DEBUG] [MAIN ] ICE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:35.738316] [INFO ] [MAIN ] ICE: Generated 1339 derivative records from 39416 primary records. [2025-09-16T21:16:35.738530] [DEBUG] [LOCAL ] ICE: Saving derivative data. [2025-09-16T21:16:35.757798] [DEBUG] [LOCAL ] ICL: Derivative data saved (1339 records). [2025-09-16T21:16:35.758597] [INFO ] [MAIN ] ICL: Successfully saved derivative data. [2025-09-16T21:16:35.760590] [INFO ] [MAIN ] Derivative Progress: 869/2026 symbols completed. ICL took 1.0s. Estimated remaining: 6m 18s. Rate: 183.6 symbols/min [2025-09-16T21:16:35.762618] [DEBUG] [LOCAL ] ICE: Derivative data saved (1339 records). [2025-09-16T21:16:35.762700] [INFO ] [MAIN ] ICE: Successfully saved derivative data. [2025-09-16T21:16:35.764298] [INFO ] [MAIN ] Derivative Progress: 870/2026 symbols completed. ICE took 1.0s. Estimated remaining: 6m 17s. Rate: 183.8 symbols/min [2025-09-16T21:16:35.764702] [INFO ] [MAIN ] IDA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:35.764855] [INFO ] [MAIN ] IDT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:35.764946] [INFO ] [MAIN ] IDE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:35.773675] [DEBUG] [LOCAL ] IDE: Loaded 6599 existing records from primary storage. [2025-09-16T21:16:35.773852] [INFO ] [MAIN ] IDE: Loaded 6599 primary data records. [2025-09-16T21:16:35.889603] [DEBUG] [LOCAL ] IDT: Loaded 13221 existing records from primary storage. [2025-09-16T21:16:35.895234] [INFO ] [MAIN ] IDT: Loaded 13221 primary data records. [2025-09-16T21:16:36.041172] [DEBUG] [LOCAL ] IDA: Loaded 24824 existing records from primary storage. [2025-09-16T21:16:36.139558] [INFO ] [MAIN ] IDA: Loaded 24824 primary data records. [2025-09-16T21:16:36.614704] [DEBUG] [MAIN ] IDE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:36.616717] [INFO ] [MAIN ] IDE: Generated 1339 derivative records from 6599 primary records. [2025-09-16T21:16:36.617280] [DEBUG] [LOCAL ] IDE: Saving derivative data. [2025-09-16T21:16:36.639717] [DEBUG] [MAIN ] IDT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:36.641156] [INFO ] [MAIN ] IDT: Generated 1339 derivative records from 13221 primary records. [2025-09-16T21:16:36.641207] [DEBUG] [LOCAL ] IDE: Derivative data saved (1339 records). [2025-09-16T21:16:36.641428] [INFO ] [MAIN ] IDE: Successfully saved derivative data. [2025-09-16T21:16:36.641377] [DEBUG] [LOCAL ] IDT: Saving derivative data. [2025-09-16T21:16:36.643066] [INFO ] [MAIN ] Derivative Progress: 871/2026 symbols completed. IDE took 0.9s. Estimated remaining: 6m 18s. Rate: 183.5 symbols/min [2025-09-16T21:16:36.644290] [INFO ] [MAIN ] IEX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:36.656380] [DEBUG] [LOCAL ] IDT: Derivative data saved (1339 records). [2025-09-16T21:16:36.656465] [INFO ] [MAIN ] IDT: Successfully saved derivative data. [2025-09-16T21:16:36.658435] [INFO ] [MAIN ] Derivative Progress: 872/2026 symbols completed. IDT took 0.9s. Estimated remaining: 6m 17s. Rate: 183.7 symbols/min [2025-09-16T21:16:36.658887] [INFO ] [MAIN ] IFF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:36.672229] [DEBUG] [MAIN ] IDA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:36.673008] [INFO ] [MAIN ] IDA: Generated 1339 derivative records from 24824 primary records. [2025-09-16T21:16:36.673142] [DEBUG] [LOCAL ] IDA: Saving derivative data. [2025-09-16T21:16:36.695023] [DEBUG] [LOCAL ] IDA: Derivative data saved (1339 records). [2025-09-16T21:16:36.695178] [INFO ] [MAIN ] IDA: Successfully saved derivative data. [2025-09-16T21:16:36.697824] [INFO ] [MAIN ] Derivative Progress: 873/2026 symbols completed. IDA took 0.9s. Estimated remaining: 6m 16s. Rate: 183.9 symbols/min [2025-09-16T21:16:36.698205] [INFO ] [MAIN ] IFN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:36.709395] [DEBUG] [LOCAL ] IEX: Loaded 28751 existing records from primary storage. [2025-09-16T21:16:36.717663] [INFO ] [MAIN ] IEX: Loaded 28751 primary data records. [2025-09-16T21:16:36.842944] [DEBUG] [LOCAL ] IFN: Loaded 13709 existing records from primary storage. [2025-09-16T21:16:36.842623] [DEBUG] [LOCAL ] IFF: Loaded 37927 existing records from primary storage. [2025-09-16T21:16:36.848763] [INFO ] [MAIN ] IFF: Loaded 37927 primary data records. [2025-09-16T21:16:36.843436] [INFO ] [MAIN ] IFN: Loaded 13709 primary data records. [2025-09-16T21:16:37.569383] [DEBUG] [MAIN ] IEX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:37.570224] [INFO ] [MAIN ] IEX: Generated 1339 derivative records from 28751 primary records. [2025-09-16T21:16:37.570565] [DEBUG] [LOCAL ] IEX: Saving derivative data. [2025-09-16T21:16:37.585742] [DEBUG] [LOCAL ] IEX: Derivative data saved (1339 records). [2025-09-16T21:16:37.586282] [INFO ] [MAIN ] IEX: Successfully saved derivative data. [2025-09-16T21:16:37.596830] [INFO ] [MAIN ] Derivative Progress: 874/2026 symbols completed. IEX took 1.0s. Estimated remaining: 6m 17s. Rate: 183.5 symbols/min [2025-09-16T21:16:37.597669] [DEBUG] [MAIN ] IFF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:37.598807] [INFO ] [MAIN ] IFF: Generated 1339 derivative records from 37927 primary records. [2025-09-16T21:16:37.597415] [INFO ] [MAIN ] IFS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:37.598960] [DEBUG] [LOCAL ] IFF: Saving derivative data. [2025-09-16T21:16:37.613701] [DEBUG] [LOCAL ] IFF: Derivative data saved (1339 records). [2025-09-16T21:16:37.614515] [INFO ] [MAIN ] IFF: Successfully saved derivative data. [2025-09-16T21:16:37.616727] [INFO ] [MAIN ] Derivative Progress: 875/2026 symbols completed. IFF took 1.0s. Estimated remaining: 6m 16s. Rate: 183.7 symbols/min [2025-09-16T21:16:37.616980] [INFO ] [MAIN ] IGA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:37.631663] [DEBUG] [MAIN ] IFN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:37.632416] [INFO ] [MAIN ] IFN: Generated 1339 derivative records from 13709 primary records. [2025-09-16T21:16:37.634390] [DEBUG] [LOCAL ] IFN: Saving derivative data. [2025-09-16T21:16:37.647772] [DEBUG] [LOCAL ] IGA: Loaded 7019 existing records from primary storage. [2025-09-16T21:16:37.653381] [INFO ] [MAIN ] IGA: Loaded 7019 primary data records. [2025-09-16T21:16:37.653955] [DEBUG] [LOCAL ] IFS: Loaded 16478 existing records from primary storage. [2025-09-16T21:16:37.665349] [INFO ] [MAIN ] IFS: Loaded 16478 primary data records. [2025-09-16T21:16:37.791695] [DEBUG] [LOCAL ] IFN: Derivative data saved (1339 records). [2025-09-16T21:16:37.837985] [INFO ] [MAIN ] IFN: Successfully saved derivative data. [2025-09-16T21:16:37.857763] [INFO ] [MAIN ] Derivative Progress: 876/2026 symbols completed. IFN took 1.2s. Estimated remaining: 6m 16s. Rate: 183.7 symbols/min [2025-09-16T21:16:37.866384] [INFO ] [MAIN ] IGD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:38.226026] [DEBUG] [LOCAL ] IGD: Loaded 13912 existing records from primary storage. [2025-09-16T21:16:38.226385] [INFO ] [MAIN ] IGD: Loaded 13912 primary data records. [2025-09-16T21:16:38.518092] [DEBUG] [MAIN ] IGA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:38.519225] [INFO ] [MAIN ] IGA: Generated 1339 derivative records from 7019 primary records. [2025-09-16T21:16:38.519396] [DEBUG] [LOCAL ] IGA: Saving derivative data. [2025-09-16T21:16:38.529489] [DEBUG] [MAIN ] IFS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:38.530380] [INFO ] [MAIN ] IFS: Generated 1339 derivative records from 16478 primary records. [2025-09-16T21:16:38.536290] [DEBUG] [LOCAL ] IFS: Saving derivative data. [2025-09-16T21:16:38.552255] [DEBUG] [LOCAL ] IGA: Derivative data saved (1339 records). [2025-09-16T21:16:38.552774] [INFO ] [MAIN ] IGA: Successfully saved derivative data. [2025-09-16T21:16:38.555234] [DEBUG] [LOCAL ] IFS: Derivative data saved (1339 records). [2025-09-16T21:16:38.557119] [INFO ] [MAIN ] IFS: Successfully saved derivative data. [2025-09-16T21:16:38.557027] [INFO ] [MAIN ] Derivative Progress: 877/2026 symbols completed. IGA took 0.9s. Estimated remaining: 6m 16s. Rate: 183.5 symbols/min [2025-09-16T21:16:38.557424] [INFO ] [MAIN ] IGI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:38.559411] [INFO ] [MAIN ] Derivative Progress: 878/2026 symbols completed. IFS took 1.0s. Estimated remaining: 6m 15s. Rate: 183.7 symbols/min [2025-09-16T21:16:38.559858] [INFO ] [MAIN ] IGR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:38.566711] [DEBUG] [LOCAL ] IGI: Loaded 2729 existing records from primary storage. [2025-09-16T21:16:38.567056] [INFO ] [MAIN ] IGI: Loaded 2729 primary data records. [2025-09-16T21:16:38.663118] [DEBUG] [MAIN ] IGD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:38.685865] [INFO ] [MAIN ] IGD: Generated 1339 derivative records from 13912 primary records. [2025-09-16T21:16:38.697358] [DEBUG] [LOCAL ] IGD: Saving derivative data. [2025-09-16T21:16:38.749448] [DEBUG] [LOCAL ] IGR: Loaded 22600 existing records from primary storage. [2025-09-16T21:16:38.774972] [INFO ] [MAIN ] IGR: Loaded 22600 primary data records. [2025-09-16T21:16:38.970566] [DEBUG] [LOCAL ] IGD: Derivative data saved (1339 records). [2025-09-16T21:16:38.971338] [INFO ] [MAIN ] IGD: Successfully saved derivative data. [2025-09-16T21:16:38.979151] [INFO ] [MAIN ] Derivative Progress: 879/2026 symbols completed. IGD took 1.1s. Estimated remaining: 6m 15s. Rate: 183.7 symbols/min [2025-09-16T21:16:38.989911] [INFO ] [MAIN ] IH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:39.138491] [DEBUG] [LOCAL ] IH: Loaded 2033 existing records from primary storage. [2025-09-16T21:16:39.138632] [INFO ] [MAIN ] IH: Loaded 2033 primary data records. [2025-09-16T21:16:39.421363] [DEBUG] [MAIN ] IGI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:39.423304] [INFO ] [MAIN ] IGI: Generated 1339 derivative records from 2729 primary records. [2025-09-16T21:16:39.423873] [DEBUG] [LOCAL ] IGI: Saving derivative data. [2025-09-16T21:16:39.439818] [DEBUG] [LOCAL ] IGI: Derivative data saved (1339 records). [2025-09-16T21:16:39.440149] [INFO ] [MAIN ] IGI: Successfully saved derivative data. [2025-09-16T21:16:39.447943] [INFO ] [MAIN ] Derivative Progress: 880/2026 symbols completed. IGI took 0.9s. Estimated remaining: 6m 15s. Rate: 183.6 symbols/min [2025-09-16T21:16:39.448295] [INFO ] [MAIN ] IHD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:39.453300] [DEBUG] [MAIN ] IGR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:39.454448] [INFO ] [MAIN ] IGR: Generated 1339 derivative records from 22600 primary records. [2025-09-16T21:16:39.454656] [DEBUG] [LOCAL ] IGR: Saving derivative data. [2025-09-16T21:16:39.470306] [DEBUG] [LOCAL ] IGR: Derivative data saved (1339 records). [2025-09-16T21:16:39.471046] [INFO ] [MAIN ] IGR: Successfully saved derivative data. [2025-09-16T21:16:39.473810] [INFO ] [MAIN ] Derivative Progress: 881/2026 symbols completed. IGR took 0.9s. Estimated remaining: 6m 14s. Rate: 183.8 symbols/min [2025-09-16T21:16:39.477113] [DEBUG] [LOCAL ] IHD: Loaded 5213 existing records from primary storage. [2025-09-16T21:16:39.477477] [INFO ] [MAIN ] IHG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:39.483378] [INFO ] [MAIN ] IHD: Loaded 5213 primary data records. [2025-09-16T21:16:39.487594] [DEBUG] [MAIN ] IH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:39.500113] [INFO ] [MAIN ] IH: Generated 1339 derivative records from 2033 primary records. [2025-09-16T21:16:39.510434] [DEBUG] [LOCAL ] IH: Saving derivative data. [2025-09-16T21:16:39.604408] [DEBUG] [LOCAL ] IH: Derivative data saved (1339 records). [2025-09-16T21:16:39.616474] [INFO ] [MAIN ] IH: Successfully saved derivative data. [2025-09-16T21:16:39.618623] [INFO ] [MAIN ] Derivative Progress: 882/2026 symbols completed. IH took 0.6s. Estimated remaining: 6m 13s. Rate: 183.9 symbols/min [2025-09-16T21:16:39.623506] [INFO ] [MAIN ] IHS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:39.705842] [DEBUG] [LOCAL ] IHG: Loaded 17709 existing records from primary storage. [2025-09-16T21:16:39.786707] [INFO ] [MAIN ] IHG: Loaded 17709 primary data records. [2025-09-16T21:16:39.890749] [DEBUG] [LOCAL ] IHS: Loaded 29352 existing records from primary storage. [2025-09-16T21:16:39.914596] [INFO ] [MAIN ] IHS: Loaded 29352 primary data records. [2025-09-16T21:16:40.312779] [DEBUG] [MAIN ] IHD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:40.386193] [INFO ] [MAIN ] IHD: Generated 1339 derivative records from 5213 primary records. [2025-09-16T21:16:40.398022] [DEBUG] [LOCAL ] IHD: Saving derivative data. [2025-09-16T21:16:40.415185] [DEBUG] [LOCAL ] IHD: Derivative data saved (1339 records). [2025-09-16T21:16:40.415763] [INFO ] [MAIN ] IHD: Successfully saved derivative data. [2025-09-16T21:16:40.417900] [INFO ] [MAIN ] Derivative Progress: 883/2026 symbols completed. IHD took 1.0s. Estimated remaining: 6m 14s. Rate: 183.6 symbols/min [2025-09-16T21:16:40.432424] [DEBUG] [MAIN ] IHG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:40.433045] [INFO ] [MAIN ] IHG: Generated 1339 derivative records from 17709 primary records. [2025-09-16T21:16:40.433235] [DEBUG] [LOCAL ] IHG: Saving derivative data. [2025-09-16T21:16:40.455913] [DEBUG] [LOCAL ] IHG: Derivative data saved (1339 records). [2025-09-16T21:16:40.456145] [DEBUG] [MAIN ] IHS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:40.456234] [INFO ] [MAIN ] IHG: Successfully saved derivative data. [2025-09-16T21:16:40.458334] [INFO ] [MAIN ] Derivative Progress: 884/2026 symbols completed. IHG took 1.0s. Estimated remaining: 6m 13s. Rate: 183.8 symbols/min [2025-09-16T21:16:40.458977] [INFO ] [MAIN ] IHS: Generated 1339 derivative records from 29352 primary records. [2025-09-16T21:16:40.459176] [DEBUG] [LOCAL ] IHS: Saving derivative data. [2025-09-16T21:16:40.470497] [DEBUG] [LOCAL ] IHS: Derivative data saved (1339 records). [2025-09-16T21:16:40.470557] [INFO ] [MAIN ] IHS: Successfully saved derivative data. [2025-09-16T21:16:40.472427] [INFO ] [MAIN ] Derivative Progress: 885/2026 symbols completed. IHS took 0.8s. Estimated remaining: 6m 12s. Rate: 184.0 symbols/min [2025-09-16T21:16:40.472875] [INFO ] [MAIN ] IIF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:40.473010] [INFO ] [MAIN ] IIM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:40.473131] [INFO ] [MAIN ] IIIN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:40.479976] [DEBUG] [LOCAL ] IIF: Loaded 4047 existing records from primary storage. [2025-09-16T21:16:40.480211] [INFO ] [MAIN ] IIF: Loaded 4047 primary data records. [2025-09-16T21:16:40.581457] [DEBUG] [LOCAL ] IIM: Loaded 11438 existing records from primary storage. [2025-09-16T21:16:40.581223] [DEBUG] [LOCAL ] IIIN: Loaded 11751 existing records from primary storage. [2025-09-16T21:16:40.598302] [INFO ] [MAIN ] IIIN: Loaded 11751 primary data records. [2025-09-16T21:16:40.598446] [INFO ] [MAIN ] IIM: Loaded 11438 primary data records. [2025-09-16T21:16:41.312015] [DEBUG] [MAIN ] IIF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:41.313418] [INFO ] [MAIN ] IIF: Generated 1339 derivative records from 4047 primary records. [2025-09-16T21:16:41.313660] [DEBUG] [LOCAL ] IIF: Saving derivative data. [2025-09-16T21:16:41.325512] [DEBUG] [MAIN ] IIIN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:41.332001] [INFO ] [MAIN ] IIIN: Generated 1339 derivative records from 11751 primary records. [2025-09-16T21:16:41.334228] [DEBUG] [LOCAL ] IIIN: Saving derivative data. [2025-09-16T21:16:41.353512] [DEBUG] [MAIN ] IIM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:41.356245] [INFO ] [MAIN ] IIM: Generated 1339 derivative records from 11438 primary records. [2025-09-16T21:16:41.357796] [DEBUG] [LOCAL ] IIM: Saving derivative data. [2025-09-16T21:16:41.357465] [DEBUG] [LOCAL ] IIIN: Derivative data saved (1339 records). [2025-09-16T21:16:41.358553] [INFO ] [MAIN ] IIIN: Successfully saved derivative data. [2025-09-16T21:16:41.361406] [INFO ] [MAIN ] Derivative Progress: 886/2026 symbols completed. IIIN took 0.9s. Estimated remaining: 6m 13s. Rate: 183.6 symbols/min [2025-09-16T21:16:41.367072] [DEBUG] [LOCAL ] IIF: Derivative data saved (1339 records). [2025-09-16T21:16:41.367168] [INFO ] [MAIN ] IIF: Successfully saved derivative data. [2025-09-16T21:16:41.369944] [INFO ] [MAIN ] IIPR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:41.372734] [DEBUG] [LOCAL ] IIM: Derivative data saved (1339 records). [2025-09-16T21:16:41.374670] [INFO ] [MAIN ] Derivative Progress: 887/2026 symbols completed. IIF took 0.9s. Estimated remaining: 6m 12s. Rate: 183.8 symbols/min [2025-09-16T21:16:41.374959] [INFO ] [MAIN ] IMAX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:41.375165] [INFO ] [MAIN ] IIM: Successfully saved derivative data. [2025-09-16T21:16:41.377424] [INFO ] [MAIN ] Derivative Progress: 888/2026 symbols completed. IIM took 0.9s. Estimated remaining: 6m 11s. Rate: 184.0 symbols/min [2025-09-16T21:16:41.377679] [INFO ] [MAIN ] INFA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:41.395970] [DEBUG] [LOCAL ] IIPR: Loaded 20792 existing records from primary storage. [2025-09-16T21:16:41.396161] [INFO ] [MAIN ] IIPR: Loaded 20792 primary data records. [2025-09-16T21:16:41.525894] [DEBUG] [LOCAL ] IMAX: Loaded 31866 existing records from primary storage. [2025-09-16T21:16:41.536784] [INFO ] [MAIN ] IMAX: Loaded 31866 primary data records. [2025-09-16T21:16:41.644376] [DEBUG] [LOCAL ] INFA: Loaded 37288 existing records from primary storage. [2025-09-16T21:16:41.673151] [INFO ] [MAIN ] INFA: Loaded 37288 primary data records. [2025-09-16T21:16:42.312289] [DEBUG] [MAIN ] IIPR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:42.313378] [INFO ] [MAIN ] IIPR: Generated 1339 derivative records from 20792 primary records. [2025-09-16T21:16:42.313735] [DEBUG] [LOCAL ] IIPR: Saving derivative data. [2025-09-16T21:16:42.327552] [DEBUG] [LOCAL ] IIPR: Derivative data saved (1339 records). [2025-09-16T21:16:42.327724] [INFO ] [MAIN ] IIPR: Successfully saved derivative data. [2025-09-16T21:16:42.329367] [INFO ] [MAIN ] Derivative Progress: 889/2026 symbols completed. IIPR took 1.0s. Estimated remaining: 6m 12s. Rate: 183.6 symbols/min [2025-09-16T21:16:42.329566] [INFO ] [MAIN ] INFY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:42.356074] [DEBUG] [MAIN ] IMAX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:42.360199] [DEBUG] [MAIN ] INFA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:42.361317] [INFO ] [MAIN ] IMAX: Generated 1339 derivative records from 31866 primary records. [2025-09-16T21:16:42.361854] [INFO ] [MAIN ] INFA: Generated 1339 derivative records from 37288 primary records. [2025-09-16T21:16:42.362032] [DEBUG] [LOCAL ] INFA: Saving derivative data. [2025-09-16T21:16:42.361948] [DEBUG] [LOCAL ] IMAX: Saving derivative data. [2025-09-16T21:16:42.387928] [DEBUG] [LOCAL ] INFA: Derivative data saved (1339 records). [2025-09-16T21:16:42.389656] [INFO ] [MAIN ] INFA: Successfully saved derivative data. [2025-09-16T21:16:42.392740] [INFO ] [MAIN ] Derivative Progress: 890/2026 symbols completed. INFA took 1.0s. Estimated remaining: 6m 11s. Rate: 183.8 symbols/min [2025-09-16T21:16:42.402587] [INFO ] [MAIN ] ING: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:42.403065] [DEBUG] [LOCAL ] IMAX: Derivative data saved (1339 records). [2025-09-16T21:16:42.403355] [INFO ] [MAIN ] IMAX: Successfully saved derivative data. [2025-09-16T21:16:42.408407] [INFO ] [MAIN ] Derivative Progress: 891/2026 symbols completed. IMAX took 1.0s. Estimated remaining: 6m 10s. Rate: 184.0 symbols/min [2025-09-16T21:16:42.408841] [INFO ] [MAIN ] INGM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:42.428582] [DEBUG] [LOCAL ] INFY: Loaded 39957 existing records from primary storage. [2025-09-16T21:16:42.428778] [INFO ] [MAIN ] INFY: Loaded 39957 primary data records. [2025-09-16T21:16:42.563896] [DEBUG] [LOCAL ] INGM: Loaded 20171 existing records from primary storage. [2025-09-16T21:16:42.574739] [INFO ] [MAIN ] INGM: Loaded 20171 primary data records. [2025-09-16T21:16:42.676577] [DEBUG] [LOCAL ] ING: Loaded 37640 existing records from primary storage. [2025-09-16T21:16:42.846315] [INFO ] [MAIN ] ING: Loaded 37640 primary data records. [2025-09-16T21:16:43.313254] [DEBUG] [MAIN ] INFY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:43.314711] [INFO ] [MAIN ] INFY: Generated 1339 derivative records from 39957 primary records. [2025-09-16T21:16:43.315320] [DEBUG] [LOCAL ] INFY: Saving derivative data. [2025-09-16T21:16:43.331793] [DEBUG] [LOCAL ] INFY: Derivative data saved (1339 records). [2025-09-16T21:16:43.332236] [INFO ] [MAIN ] INFY: Successfully saved derivative data. [2025-09-16T21:16:43.334852] [INFO ] [MAIN ] Derivative Progress: 892/2026 symbols completed. INFY took 1.0s. Estimated remaining: 6m 11s. Rate: 183.6 symbols/min [2025-09-16T21:16:43.344859] [INFO ] [MAIN ] INGR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:43.345430] [DEBUG] [MAIN ] INGM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:43.346490] [INFO ] [MAIN ] INGM: Generated 1339 derivative records from 20171 primary records. [2025-09-16T21:16:43.346660] [DEBUG] [LOCAL ] INGM: Saving derivative data. [2025-09-16T21:16:43.369437] [DEBUG] [MAIN ] ING: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:43.371163] [INFO ] [MAIN ] ING: Generated 1339 derivative records from 37640 primary records. [2025-09-16T21:16:43.371561] [DEBUG] [LOCAL ] INGM: Derivative data saved (1339 records). [2025-09-16T21:16:43.371676] [INFO ] [MAIN ] INGM: Successfully saved derivative data. [2025-09-16T21:16:43.371713] [DEBUG] [LOCAL ] ING: Saving derivative data. [2025-09-16T21:16:43.374292] [INFO ] [MAIN ] Derivative Progress: 893/2026 symbols completed. INGM took 1.0s. Estimated remaining: 6m 10s. Rate: 183.8 symbols/min [2025-09-16T21:16:43.374769] [INFO ] [MAIN ] INN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:43.393134] [DEBUG] [LOCAL ] ING: Derivative data saved (1339 records). [2025-09-16T21:16:43.393295] [INFO ] [MAIN ] ING: Successfully saved derivative data. [2025-09-16T21:16:43.396366] [INFO ] [MAIN ] Derivative Progress: 894/2026 symbols completed. ING took 1.0s. Estimated remaining: 6m 9s. Rate: 184.0 symbols/min [2025-09-16T21:16:43.396735] [INFO ] [MAIN ] INR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:43.406266] [DEBUG] [LOCAL ] INGR: Loaded 24186 existing records from primary storage. [2025-09-16T21:16:43.406462] [INFO ] [MAIN ] INGR: Loaded 24186 primary data records. [2025-09-16T21:16:43.538248] [DEBUG] [LOCAL ] INR: Loaded 19261 existing records from primary storage. [2025-09-16T21:16:43.549184] [INFO ] [MAIN ] INR: Loaded 19261 primary data records. [2025-09-16T21:16:43.630838] [DEBUG] [LOCAL ] INN: Loaded 31561 existing records from primary storage. [2025-09-16T21:16:43.702056] [INFO ] [MAIN ] INN: Loaded 31561 primary data records. [2025-09-16T21:16:44.276472] [DEBUG] [MAIN ] INGR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:44.277597] [INFO ] [MAIN ] INGR: Generated 1339 derivative records from 24186 primary records. [2025-09-16T21:16:44.277894] [DEBUG] [LOCAL ] INGR: Saving derivative data. [2025-09-16T21:16:44.291331] [DEBUG] [LOCAL ] INGR: Derivative data saved (1339 records). [2025-09-16T21:16:44.291745] [INFO ] [MAIN ] INGR: Successfully saved derivative data. [2025-09-16T21:16:44.293392] [INFO ] [MAIN ] Derivative Progress: 895/2026 symbols completed. INGR took 0.9s. Estimated remaining: 6m 10s. Rate: 183.6 symbols/min [2025-09-16T21:16:44.294275] [INFO ] [MAIN ] INSP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:44.308166] [DEBUG] [MAIN ] INR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:44.309021] [INFO ] [MAIN ] INR: Generated 1339 derivative records from 19261 primary records. [2025-09-16T21:16:44.309538] [DEBUG] [LOCAL ] INR: Saving derivative data. [2025-09-16T21:16:44.332395] [DEBUG] [LOCAL ] INR: Derivative data saved (1339 records). [2025-09-16T21:16:44.332680] [INFO ] [MAIN ] INR: Successfully saved derivative data. [2025-09-16T21:16:44.334895] [INFO ] [MAIN ] Derivative Progress: 896/2026 symbols completed. INR took 0.9s. Estimated remaining: 6m 9s. Rate: 183.8 symbols/min [2025-09-16T21:16:44.345421] [INFO ] [MAIN ] INSW: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:44.345905] [DEBUG] [MAIN ] INN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:44.346882] [INFO ] [MAIN ] INN: Generated 1339 derivative records from 31561 primary records. [2025-09-16T21:16:44.347100] [DEBUG] [LOCAL ] INN: Saving derivative data. [2025-09-16T21:16:44.368373] [DEBUG] [LOCAL ] INSP: Loaded 28015 existing records from primary storage. [2025-09-16T21:16:44.369088] [INFO ] [MAIN ] INSP: Loaded 28015 primary data records. [2025-09-16T21:16:44.369023] [DEBUG] [LOCAL ] INN: Derivative data saved (1339 records). [2025-09-16T21:16:44.369215] [INFO ] [MAIN ] INN: Successfully saved derivative data. [2025-09-16T21:16:44.387630] [INFO ] [MAIN ] Derivative Progress: 897/2026 symbols completed. INN took 1.0s. Estimated remaining: 6m 8s. Rate: 184.0 symbols/min [2025-09-16T21:16:44.410218] [INFO ] [MAIN ] INVH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:44.517227] [DEBUG] [LOCAL ] INSW: Loaded 29451 existing records from primary storage. [2025-09-16T21:16:44.532698] [INFO ] [MAIN ] INSW: Loaded 29451 primary data records. [2025-09-16T21:16:45.002385] [DEBUG] [LOCAL ] INVH: Loaded 39610 existing records from primary storage. [2025-09-16T21:16:45.003016] [INFO ] [MAIN ] INVH: Loaded 39610 primary data records. [2025-09-16T21:16:45.289325] [DEBUG] [MAIN ] INSP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:45.290332] [INFO ] [MAIN ] INSP: Generated 1339 derivative records from 28015 primary records. [2025-09-16T21:16:45.290505] [DEBUG] [LOCAL ] INSP: Saving derivative data. [2025-09-16T21:16:45.306529] [DEBUG] [LOCAL ] INSP: Derivative data saved (1339 records). [2025-09-16T21:16:45.307055] [INFO ] [MAIN ] INSP: Successfully saved derivative data. [2025-09-16T21:16:45.317967] [INFO ] [MAIN ] Derivative Progress: 898/2026 symbols completed. INSP took 1.0s. Estimated remaining: 6m 9s. Rate: 183.6 symbols/min [2025-09-16T21:16:45.318601] [DEBUG] [MAIN ] INSW: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:45.319959] [INFO ] [MAIN ] INSW: Generated 1339 derivative records from 29451 primary records. [2025-09-16T21:16:45.320188] [DEBUG] [LOCAL ] INSW: Saving derivative data. [2025-09-16T21:16:45.332592] [DEBUG] [LOCAL ] INSW: Derivative data saved (1339 records). [2025-09-16T21:16:45.332674] [INFO ] [MAIN ] INSW: Successfully saved derivative data. [2025-09-16T21:16:45.334863] [INFO ] [MAIN ] Derivative Progress: 899/2026 symbols completed. INSW took 1.0s. Estimated remaining: 6m 8s. Rate: 183.8 symbols/min [2025-09-16T21:16:45.346182] [DEBUG] [MAIN ] INVH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:45.346709] [INFO ] [MAIN ] INVH: Generated 1339 derivative records from 39610 primary records. [2025-09-16T21:16:45.346769] [DEBUG] [LOCAL ] INVH: Saving derivative data. [2025-09-16T21:16:45.357967] [DEBUG] [LOCAL ] INVH: Derivative data saved (1339 records). [2025-09-16T21:16:45.358023] [INFO ] [MAIN ] INVH: Successfully saved derivative data. [2025-09-16T21:16:45.359878] [INFO ] [MAIN ] Derivative Progress: 900/2026 symbols completed. INVH took 1.0s. Estimated remaining: 6m 7s. Rate: 184.0 symbols/min [2025-09-16T21:16:45.360412] [INFO ] [MAIN ] INVX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:45.360554] [INFO ] [MAIN ] IOT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:45.360824] [INFO ] [MAIN ] IONQ: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:45.382559] [DEBUG] [LOCAL ] INVX: Loaded 21435 existing records from primary storage. [2025-09-16T21:16:45.382830] [INFO ] [MAIN ] INVX: Loaded 21435 primary data records. [2025-09-16T21:16:45.521747] [DEBUG] [LOCAL ] IOT: Loaded 39868 existing records from primary storage. [2025-09-16T21:16:45.532557] [INFO ] [MAIN ] IOT: Loaded 39868 primary data records. [2025-09-16T21:16:45.625249] [DEBUG] [LOCAL ] IONQ: Loaded 40138 existing records from primary storage. [2025-09-16T21:16:45.668189] [INFO ] [MAIN ] IONQ: Loaded 40138 primary data records. [2025-09-16T21:16:46.276628] [DEBUG] [MAIN ] INVX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:46.277900] [INFO ] [MAIN ] INVX: Generated 1339 derivative records from 21435 primary records. [2025-09-16T21:16:46.278296] [DEBUG] [LOCAL ] INVX: Saving derivative data. [2025-09-16T21:16:46.294387] [DEBUG] [LOCAL ] INVX: Derivative data saved (1339 records). [2025-09-16T21:16:46.294761] [INFO ] [MAIN ] INVX: Successfully saved derivative data. [2025-09-16T21:16:46.297405] [INFO ] [MAIN ] Derivative Progress: 901/2026 symbols completed. INVX took 0.9s. Estimated remaining: 6m 8s. Rate: 183.6 symbols/min [2025-09-16T21:16:46.308712] [DEBUG] [MAIN ] IOT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:46.319400] [INFO ] [MAIN ] IOT: Generated 1339 derivative records from 39868 primary records. [2025-09-16T21:16:46.318634] [DEBUG] [MAIN ] IONQ: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:46.308831] [INFO ] [MAIN ] IP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:46.320296] [DEBUG] [LOCAL ] IOT: Saving derivative data. [2025-09-16T21:16:46.320228] [INFO ] [MAIN ] IONQ: Generated 1339 derivative records from 40138 primary records. [2025-09-16T21:16:46.320953] [DEBUG] [LOCAL ] IONQ: Saving derivative data. [2025-09-16T21:16:46.340907] [DEBUG] [LOCAL ] IONQ: Derivative data saved (1339 records). [2025-09-16T21:16:46.341046] [INFO ] [MAIN ] IONQ: Successfully saved derivative data. [2025-09-16T21:16:46.346977] [INFO ] [MAIN ] Derivative Progress: 902/2026 symbols completed. IONQ took 1.0s. Estimated remaining: 6m 7s. Rate: 183.7 symbols/min [2025-09-16T21:16:46.348266] [INFO ] [MAIN ] IPG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:46.349447] [DEBUG] [LOCAL ] IOT: Derivative data saved (1339 records). [2025-09-16T21:16:46.349706] [INFO ] [MAIN ] IOT: Successfully saved derivative data. [2025-09-16T21:16:46.351793] [INFO ] [MAIN ] Derivative Progress: 903/2026 symbols completed. IOT took 1.0s. Estimated remaining: 6m 6s. Rate: 184.0 symbols/min [2025-09-16T21:16:46.352168] [INFO ] [MAIN ] IPI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:46.379522] [DEBUG] [LOCAL ] IPI: Loaded 15552 existing records from primary storage. [2025-09-16T21:16:46.379756] [INFO ] [MAIN ] IPI: Loaded 15552 primary data records. [2025-09-16T21:16:46.523607] [DEBUG] [LOCAL ] IP: Loaded 39704 existing records from primary storage. [2025-09-16T21:16:46.544398] [INFO ] [MAIN ] IP: Loaded 39704 primary data records. [2025-09-16T21:16:46.589938] [DEBUG] [LOCAL ] IPG: Loaded 39697 existing records from primary storage. [2025-09-16T21:16:46.596873] [INFO ] [MAIN ] IPG: Loaded 39697 primary data records. [2025-09-16T21:16:47.274030] [DEBUG] [MAIN ] IPI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:47.275052] [INFO ] [MAIN ] IPI: Generated 1339 derivative records from 15552 primary records. [2025-09-16T21:16:47.275369] [DEBUG] [LOCAL ] IPI: Saving derivative data. [2025-09-16T21:16:47.289377] [DEBUG] [LOCAL ] IPI: Derivative data saved (1339 records). [2025-09-16T21:16:47.289755] [INFO ] [MAIN ] IPI: Successfully saved derivative data. [2025-09-16T21:16:47.291611] [INFO ] [MAIN ] Derivative Progress: 904/2026 symbols completed. IPI took 0.9s. Estimated remaining: 6m 7s. Rate: 183.6 symbols/min [2025-09-16T21:16:47.292150] [INFO ] [MAIN ] IQI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:47.305831] [DEBUG] [MAIN ] IP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:47.307587] [INFO ] [MAIN ] IP: Generated 1339 derivative records from 39704 primary records. [2025-09-16T21:16:47.307825] [DEBUG] [LOCAL ] IP: Saving derivative data. [2025-09-16T21:16:47.334159] [DEBUG] [MAIN ] IPG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:47.336477] [INFO ] [MAIN ] IPG: Generated 1339 derivative records from 39697 primary records. [2025-09-16T21:16:47.337112] [DEBUG] [LOCAL ] IPG: Saving derivative data. [2025-09-16T21:16:47.345599] [DEBUG] [LOCAL ] IP: Derivative data saved (1339 records). [2025-09-16T21:16:47.348511] [INFO ] [MAIN ] IP: Successfully saved derivative data. [2025-09-16T21:16:47.356401] [INFO ] [MAIN ] Derivative Progress: 905/2026 symbols completed. IP took 1.0s. Estimated remaining: 6m 6s. Rate: 183.7 symbols/min [2025-09-16T21:16:47.358550] [INFO ] [MAIN ] IR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:47.357494] [DEBUG] [LOCAL ] IQI: Loaded 13543 existing records from primary storage. [2025-09-16T21:16:47.360058] [INFO ] [MAIN ] IQI: Loaded 13543 primary data records. [2025-09-16T21:16:47.361142] [DEBUG] [LOCAL ] IPG: Derivative data saved (1339 records). [2025-09-16T21:16:47.366432] [INFO ] [MAIN ] IPG: Successfully saved derivative data. [2025-09-16T21:16:47.376071] [INFO ] [MAIN ] Derivative Progress: 906/2026 symbols completed. IPG took 1.0s. Estimated remaining: 6m 5s. Rate: 183.9 symbols/min [2025-09-16T21:16:47.407500] [INFO ] [MAIN ] IRM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:47.649525] [DEBUG] [LOCAL ] IR: Loaded 39275 existing records from primary storage. [2025-09-16T21:16:47.660150] [INFO ] [MAIN ] IR: Loaded 39275 primary data records. [2025-09-16T21:16:47.817683] [DEBUG] [LOCAL ] IRM: Loaded 36386 existing records from primary storage. [2025-09-16T21:16:47.827711] [INFO ] [MAIN ] IRM: Loaded 36386 primary data records. [2025-09-16T21:16:48.111961] [DEBUG] [MAIN ] IQI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:48.129895] [INFO ] [MAIN ] IQI: Generated 1339 derivative records from 13543 primary records. [2025-09-16T21:16:48.132599] [DEBUG] [LOCAL ] IQI: Saving derivative data. [2025-09-16T21:16:48.231838] [DEBUG] [LOCAL ] IQI: Derivative data saved (1339 records). [2025-09-16T21:16:48.232398] [INFO ] [MAIN ] IQI: Successfully saved derivative data. [2025-09-16T21:16:48.234240] [INFO ] [MAIN ] Derivative Progress: 907/2026 symbols completed. IQI took 0.9s. Estimated remaining: 6m 6s. Rate: 183.6 symbols/min [2025-09-16T21:16:48.234853] [INFO ] [MAIN ] IRS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:48.255961] [DEBUG] [MAIN ] IR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:48.257044] [INFO ] [MAIN ] IR: Generated 1339 derivative records from 39275 primary records. [2025-09-16T21:16:48.257242] [DEBUG] [LOCAL ] IR: Saving derivative data. [2025-09-16T21:16:48.281348] [DEBUG] [LOCAL ] IRS: Loaded 16397 existing records from primary storage. [2025-09-16T21:16:48.283066] [DEBUG] [LOCAL ] IR: Derivative data saved (1339 records). [2025-09-16T21:16:48.288993] [INFO ] [MAIN ] IRS: Loaded 16397 primary data records. [2025-09-16T21:16:48.289070] [INFO ] [MAIN ] IR: Successfully saved derivative data. [2025-09-16T21:16:48.291748] [INFO ] [MAIN ] Derivative Progress: 908/2026 symbols completed. IR took 0.9s. Estimated remaining: 6m 5s. Rate: 183.8 symbols/min [2025-09-16T21:16:48.317898] [INFO ] [MAIN ] IRT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:48.318337] [DEBUG] [MAIN ] IRM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:48.348686] [INFO ] [MAIN ] IRM: Generated 1339 derivative records from 36386 primary records. [2025-09-16T21:16:48.386802] [DEBUG] [LOCAL ] IRM: Saving derivative data. [2025-09-16T21:16:48.517277] [DEBUG] [LOCAL ] IRM: Derivative data saved (1339 records). [2025-09-16T21:16:48.589801] [INFO ] [MAIN ] IRM: Successfully saved derivative data. [2025-09-16T21:16:48.603950] [INFO ] [MAIN ] Derivative Progress: 909/2026 symbols completed. IRM took 1.2s. Estimated remaining: 6m 5s. Rate: 183.8 symbols/min [2025-09-16T21:16:48.605115] [INFO ] [MAIN ] ISD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:48.617783] [DEBUG] [LOCAL ] IRT: Loaded 37574 existing records from primary storage. [2025-09-16T21:16:48.618968] [INFO ] [MAIN ] IRT: Loaded 37574 primary data records. [2025-09-16T21:16:48.737476] [DEBUG] [LOCAL ] ISD: Loaded 11160 existing records from primary storage. [2025-09-16T21:16:48.748635] [INFO ] [MAIN ] ISD: Loaded 11160 primary data records. [2025-09-16T21:16:49.206861] [DEBUG] [MAIN ] IRS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:49.219204] [INFO ] [MAIN ] IRS: Generated 1339 derivative records from 16397 primary records. [2025-09-16T21:16:49.219435] [DEBUG] [LOCAL ] IRS: Saving derivative data. [2025-09-16T21:16:49.238421] [DEBUG] [LOCAL ] IRS: Derivative data saved (1339 records). [2025-09-16T21:16:49.238546] [INFO ] [MAIN ] IRS: Successfully saved derivative data. [2025-09-16T21:16:49.240412] [INFO ] [MAIN ] Derivative Progress: 910/2026 symbols completed. IRS took 1.0s. Estimated remaining: 6m 5s. Rate: 183.6 symbols/min [2025-09-16T21:16:49.241355] [INFO ] [MAIN ] IT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:49.255213] [DEBUG] [MAIN ] IRT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:49.256505] [INFO ] [MAIN ] IRT: Generated 1339 derivative records from 37574 primary records. [2025-09-16T21:16:49.257800] [DEBUG] [LOCAL ] IRT: Saving derivative data. [2025-09-16T21:16:49.277902] [DEBUG] [MAIN ] ISD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:49.280333] [INFO ] [MAIN ] ISD: Generated 1339 derivative records from 11160 primary records. [2025-09-16T21:16:49.280847] [DEBUG] [LOCAL ] ISD: Saving derivative data. [2025-09-16T21:16:49.283322] [DEBUG] [LOCAL ] IRT: Derivative data saved (1339 records). [2025-09-16T21:16:49.288949] [INFO ] [MAIN ] IRT: Successfully saved derivative data. [2025-09-16T21:16:49.302413] [INFO ] [MAIN ] Derivative Progress: 911/2026 symbols completed. IRT took 1.0s. Estimated remaining: 6m 4s. Rate: 183.7 symbols/min [2025-09-16T21:16:49.304895] [DEBUG] [LOCAL ] ISD: Derivative data saved (1339 records). [2025-09-16T21:16:49.304970] [INFO ] [MAIN ] ISD: Successfully saved derivative data. [2025-09-16T21:16:49.303656] [INFO ] [MAIN ] ITGR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:49.307196] [INFO ] [MAIN ] Derivative Progress: 912/2026 symbols completed. ISD took 0.7s. Estimated remaining: 6m 3s. Rate: 183.9 symbols/min [2025-09-16T21:16:49.307682] [INFO ] [MAIN ] ITT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:49.320235] [DEBUG] [LOCAL ] IT: Loaded 31073 existing records from primary storage. [2025-09-16T21:16:49.320535] [INFO ] [MAIN ] IT: Loaded 31073 primary data records. [2025-09-16T21:16:49.473058] [DEBUG] [LOCAL ] ITGR: Loaded 22250 existing records from primary storage. [2025-09-16T21:16:49.483706] [DEBUG] [LOCAL ] ITT: Loaded 23458 existing records from primary storage. [2025-09-16T21:16:49.503370] [INFO ] [MAIN ] ITT: Loaded 23458 primary data records. [2025-09-16T21:16:49.530806] [INFO ] [MAIN ] ITGR: Loaded 22250 primary data records. [2025-09-16T21:16:50.193762] [DEBUG] [MAIN ] IT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:50.194718] [INFO ] [MAIN ] IT: Generated 1339 derivative records from 31073 primary records. [2025-09-16T21:16:50.196319] [DEBUG] [LOCAL ] IT: Saving derivative data. [2025-09-16T21:16:50.219158] [DEBUG] [MAIN ] ITT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:50.219685] [DEBUG] [LOCAL ] IT: Derivative data saved (1339 records). [2025-09-16T21:16:50.220717] [INFO ] [MAIN ] IT: Successfully saved derivative data. [2025-09-16T21:16:50.220554] [INFO ] [MAIN ] ITT: Generated 1339 derivative records from 23458 primary records. [2025-09-16T21:16:50.220936] [DEBUG] [LOCAL ] ITT: Saving derivative data. [2025-09-16T21:16:50.223388] [INFO ] [MAIN ] Derivative Progress: 913/2026 symbols completed. IT took 1.0s. Estimated remaining: 6m 4s. Rate: 183.6 symbols/min [2025-09-16T21:16:50.245498] [DEBUG] [MAIN ] ITGR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:50.246500] [INFO ] [MAIN ] ITGR: Generated 1339 derivative records from 22250 primary records. [2025-09-16T21:16:50.247124] [DEBUG] [LOCAL ] ITGR: Saving derivative data. [2025-09-16T21:16:50.247317] [DEBUG] [LOCAL ] ITT: Derivative data saved (1339 records). [2025-09-16T21:16:50.247406] [INFO ] [MAIN ] ITT: Successfully saved derivative data. [2025-09-16T21:16:50.249662] [INFO ] [MAIN ] Derivative Progress: 914/2026 symbols completed. ITT took 0.9s. Estimated remaining: 6m 3s. Rate: 183.8 symbols/min [2025-09-16T21:16:50.261169] [DEBUG] [LOCAL ] ITGR: Derivative data saved (1339 records). [2025-09-16T21:16:50.261226] [INFO ] [MAIN ] ITGR: Successfully saved derivative data. [2025-09-16T21:16:50.263302] [INFO ] [MAIN ] Derivative Progress: 915/2026 symbols completed. ITGR took 1.0s. Estimated remaining: 6m 2s. Rate: 184.0 symbols/min [2025-09-16T21:16:50.263948] [INFO ] [MAIN ] ITUB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:50.263772] [INFO ] [MAIN ] ITW: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:50.264320] [INFO ] [MAIN ] IVR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:50.325514] [DEBUG] [LOCAL ] ITW: Loaded 34070 existing records from primary storage. [2025-09-16T21:16:50.335659] [INFO ] [MAIN ] ITW: Loaded 34070 primary data records. [2025-09-16T21:16:50.324732] [DEBUG] [LOCAL ] IVR: Loaded 35217 existing records from primary storage. [2025-09-16T21:16:50.379448] [DEBUG] [LOCAL ] ITUB: Loaded 39769 existing records from primary storage. [2025-09-16T21:16:50.367214] [INFO ] [MAIN ] IVR: Loaded 35217 primary data records. [2025-09-16T21:16:50.411518] [INFO ] [MAIN ] ITUB: Loaded 39769 primary data records. [2025-09-16T21:16:51.171248] [DEBUG] [MAIN ] ITW: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:51.172978] [INFO ] [MAIN ] ITW: Generated 1339 derivative records from 34070 primary records. [2025-09-16T21:16:51.172214] [DEBUG] [MAIN ] IVR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:51.173345] [DEBUG] [LOCAL ] ITW: Saving derivative data. [2025-09-16T21:16:51.174147] [INFO ] [MAIN ] IVR: Generated 1339 derivative records from 35217 primary records. [2025-09-16T21:16:51.183994] [DEBUG] [LOCAL ] IVR: Saving derivative data. [2025-09-16T21:16:51.184570] [DEBUG] [MAIN ] ITUB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:51.194217] [INFO ] [MAIN ] ITUB: Generated 1339 derivative records from 39769 primary records. [2025-09-16T21:16:51.194699] [DEBUG] [LOCAL ] ITUB: Saving derivative data. [2025-09-16T21:16:51.204605] [DEBUG] [LOCAL ] ITW: Derivative data saved (1339 records). [2025-09-16T21:16:51.207296] [INFO ] [MAIN ] ITW: Successfully saved derivative data. [2025-09-16T21:16:51.209316] [DEBUG] [LOCAL ] ITUB: Derivative data saved (1339 records). [2025-09-16T21:16:51.216241] [INFO ] [MAIN ] ITUB: Successfully saved derivative data. [2025-09-16T21:16:51.216176] [INFO ] [MAIN ] Derivative Progress: 916/2026 symbols completed. ITW took 1.0s. Estimated remaining: 6m 3s. Rate: 183.6 symbols/min [2025-09-16T21:16:51.218565] [INFO ] [MAIN ] Derivative Progress: 917/2026 symbols completed. ITUB took 1.0s. Estimated remaining: 6m 2s. Rate: 183.8 symbols/min [2025-09-16T21:16:51.218457] [INFO ] [MAIN ] IVT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:51.220090] [INFO ] [MAIN ] IVZ: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:51.225813] [DEBUG] [LOCAL ] IVR: Derivative data saved (1339 records). [2025-09-16T21:16:51.226095] [INFO ] [MAIN ] IVR: Successfully saved derivative data. [2025-09-16T21:16:51.228795] [INFO ] [MAIN ] Derivative Progress: 918/2026 symbols completed. IVR took 1.0s. Estimated remaining: 6m 1s. Rate: 184.0 symbols/min [2025-09-16T21:16:51.229124] [INFO ] [MAIN ] IX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:51.252843] [DEBUG] [LOCAL ] IVT: Loaded 22503 existing records from primary storage. [2025-09-16T21:16:51.253005] [INFO ] [MAIN ] IVT: Loaded 22503 primary data records. [2025-09-16T21:16:51.281179] [DEBUG] [LOCAL ] IX: Loaded 16330 existing records from primary storage. [2025-09-16T21:16:51.313062] [INFO ] [MAIN ] IX: Loaded 16330 primary data records. [2025-09-16T21:16:51.573093] [DEBUG] [LOCAL ] IVZ: Loaded 39555 existing records from primary storage. [2025-09-16T21:16:51.591762] [INFO ] [MAIN ] IVZ: Loaded 39555 primary data records. [2025-09-16T21:16:52.142822] [DEBUG] [MAIN ] IVT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:52.144703] [INFO ] [MAIN ] IVT: Generated 1339 derivative records from 22503 primary records. [2025-09-16T21:16:52.144859] [DEBUG] [LOCAL ] IVT: Saving derivative data. [2025-09-16T21:16:52.155583] [DEBUG] [MAIN ] IX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:52.165047] [INFO ] [MAIN ] IX: Generated 1339 derivative records from 16330 primary records. [2025-09-16T21:16:52.165616] [DEBUG] [LOCAL ] IX: Saving derivative data. [2025-09-16T21:16:52.175676] [DEBUG] [LOCAL ] IVT: Derivative data saved (1339 records). [2025-09-16T21:16:52.175873] [INFO ] [MAIN ] IVT: Successfully saved derivative data. [2025-09-16T21:16:52.181303] [INFO ] [MAIN ] Derivative Progress: 919/2026 symbols completed. IVT took 1.0s. Estimated remaining: 6m 2s. Rate: 183.6 symbols/min [2025-09-16T21:16:52.182609] [INFO ] [MAIN ] J: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:52.182441] [DEBUG] [LOCAL ] IX: Derivative data saved (1339 records). [2025-09-16T21:16:52.182865] [INFO ] [MAIN ] IX: Successfully saved derivative data. [2025-09-16T21:16:52.184957] [INFO ] [MAIN ] Derivative Progress: 920/2026 symbols completed. IX took 1.0s. Estimated remaining: 6m 1s. Rate: 183.8 symbols/min [2025-09-16T21:16:52.185732] [INFO ] [MAIN ] JBGS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:52.200394] [DEBUG] [MAIN ] IVZ: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:52.201322] [INFO ] [MAIN ] IVZ: Generated 1339 derivative records from 39555 primary records. [2025-09-16T21:16:52.201493] [DEBUG] [LOCAL ] IVZ: Saving derivative data. [2025-09-16T21:16:52.218745] [DEBUG] [LOCAL ] IVZ: Derivative data saved (1339 records). [2025-09-16T21:16:52.218934] [INFO ] [MAIN ] IVZ: Successfully saved derivative data. [2025-09-16T21:16:52.221148] [INFO ] [MAIN ] Derivative Progress: 921/2026 symbols completed. IVZ took 1.0s. Estimated remaining: 6m 0s. Rate: 184.0 symbols/min [2025-09-16T21:16:52.221481] [INFO ] [MAIN ] JBI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:52.260591] [DEBUG] [LOCAL ] JBGS: Loaded 31570 existing records from primary storage. [2025-09-16T21:16:52.260044] [DEBUG] [LOCAL ] J: Loaded 29574 existing records from primary storage. [2025-09-16T21:16:52.260789] [INFO ] [MAIN ] JBGS: Loaded 31570 primary data records. [2025-09-16T21:16:52.260983] [INFO ] [MAIN ] J: Loaded 29574 primary data records. [2025-09-16T21:16:52.478227] [DEBUG] [LOCAL ] JBI: Loaded 31900 existing records from primary storage. [2025-09-16T21:16:52.524336] [INFO ] [MAIN ] JBI: Loaded 31900 primary data records. [2025-09-16T21:16:53.136485] [DEBUG] [MAIN ] JBGS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:53.138263] [INFO ] [MAIN ] JBGS: Generated 1339 derivative records from 31570 primary records. [2025-09-16T21:16:53.149188] [DEBUG] [LOCAL ] JBGS: Saving derivative data. [2025-09-16T21:16:53.149537] [DEBUG] [MAIN ] J: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:53.153541] [INFO ] [MAIN ] J: Generated 1339 derivative records from 29574 primary records. [2025-09-16T21:16:53.159382] [DEBUG] [LOCAL ] J: Saving derivative data. [2025-09-16T21:16:53.189856] [DEBUG] [LOCAL ] JBGS: Derivative data saved (1339 records). [2025-09-16T21:16:53.191753] [INFO ] [MAIN ] JBGS: Successfully saved derivative data. [2025-09-16T21:16:53.194818] [INFO ] [MAIN ] Derivative Progress: 922/2026 symbols completed. JBGS took 1.0s. Estimated remaining: 6m 1s. Rate: 183.6 symbols/min [2025-09-16T21:16:53.190224] [DEBUG] [MAIN ] JBI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:53.191628] [DEBUG] [LOCAL ] J: Derivative data saved (1339 records). [2025-09-16T21:16:53.195275] [INFO ] [MAIN ] JBL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:53.196145] [INFO ] [MAIN ] JBI: Generated 1339 derivative records from 31900 primary records. [2025-09-16T21:16:53.196535] [INFO ] [MAIN ] J: Successfully saved derivative data. [2025-09-16T21:16:53.198869] [INFO ] [MAIN ] Derivative Progress: 923/2026 symbols completed. J took 1.0s. Estimated remaining: 6m 0s. Rate: 183.8 symbols/min [2025-09-16T21:16:53.199117] [INFO ] [MAIN ] JBND: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:53.199165] [DEBUG] [LOCAL ] JBI: Saving derivative data. [2025-09-16T21:16:53.213928] [DEBUG] [LOCAL ] JBI: Derivative data saved (1339 records). [2025-09-16T21:16:53.214012] [INFO ] [MAIN ] JBI: Successfully saved derivative data. [2025-09-16T21:16:53.216248] [INFO ] [MAIN ] Derivative Progress: 924/2026 symbols completed. JBI took 1.0s. Estimated remaining: 5m 59s. Rate: 183.9 symbols/min [2025-09-16T21:16:53.216578] [INFO ] [MAIN ] JBTM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:53.235881] [DEBUG] [LOCAL ] JBND: Loaded 19070 existing records from primary storage. [2025-09-16T21:16:53.236084] [INFO ] [MAIN ] JBND: Loaded 19070 primary data records. [2025-09-16T21:16:53.389661] [DEBUG] [LOCAL ] JBTM: Loaded 24015 existing records from primary storage. [2025-09-16T21:16:53.405856] [DEBUG] [LOCAL ] JBL: Loaded 35457 existing records from primary storage. [2025-09-16T21:16:53.435712] [INFO ] [MAIN ] JBTM: Loaded 24015 primary data records. [2025-09-16T21:16:53.457332] [INFO ] [MAIN ] JBL: Loaded 35457 primary data records. [2025-09-16T21:16:54.138925] [DEBUG] [MAIN ] JBND: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:54.140210] [INFO ] [MAIN ] JBND: Generated 1339 derivative records from 19070 primary records. [2025-09-16T21:16:54.140830] [DEBUG] [LOCAL ] JBND: Saving derivative data. [2025-09-16T21:16:54.157769] [DEBUG] [LOCAL ] JBND: Derivative data saved (1339 records). [2025-09-16T21:16:54.159157] [INFO ] [MAIN ] JBND: Successfully saved derivative data. [2025-09-16T21:16:54.161822] [INFO ] [MAIN ] Derivative Progress: 925/2026 symbols completed. JBND took 1.0s. Estimated remaining: 5m 60s. Rate: 183.6 symbols/min [2025-09-16T21:16:54.163555] [INFO ] [MAIN ] JCE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:54.181386] [DEBUG] [MAIN ] JBL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:54.186254] [INFO ] [MAIN ] JBL: Generated 1339 derivative records from 35457 primary records. [2025-09-16T21:16:54.186805] [DEBUG] [MAIN ] JBTM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:54.188238] [DEBUG] [LOCAL ] JBL: Saving derivative data. [2025-09-16T21:16:54.190022] [INFO ] [MAIN ] JBTM: Generated 1339 derivative records from 24015 primary records. [2025-09-16T21:16:54.190177] [DEBUG] [LOCAL ] JBTM: Saving derivative data. [2025-09-16T21:16:54.202761] [DEBUG] [LOCAL ] JCE: Loaded 4761 existing records from primary storage. [2025-09-16T21:16:54.212721] [INFO ] [MAIN ] JCE: Loaded 4761 primary data records. [2025-09-16T21:16:54.216990] [DEBUG] [LOCAL ] JBL: Derivative data saved (1339 records). [2025-09-16T21:16:54.217361] [INFO ] [MAIN ] JBL: Successfully saved derivative data. [2025-09-16T21:16:54.219976] [INFO ] [MAIN ] Derivative Progress: 926/2026 symbols completed. JBL took 1.0s. Estimated remaining: 5m 59s. Rate: 183.7 symbols/min [2025-09-16T21:16:54.241920] [INFO ] [MAIN ] JCI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:54.313687] [DEBUG] [LOCAL ] JBTM: Derivative data saved (1339 records). [2025-09-16T21:16:54.332685] [INFO ] [MAIN ] JBTM: Successfully saved derivative data. [2025-09-16T21:16:54.334964] [INFO ] [MAIN ] Derivative Progress: 927/2026 symbols completed. JBTM took 1.1s. Estimated remaining: 5m 59s. Rate: 183.9 symbols/min [2025-09-16T21:16:54.341167] [INFO ] [MAIN ] JEF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:54.545017] [DEBUG] [LOCAL ] JCI: Loaded 39917 existing records from primary storage. [2025-09-16T21:16:54.545541] [INFO ] [MAIN ] JCI: Loaded 39917 primary data records. [2025-09-16T21:16:54.667453] [DEBUG] [LOCAL ] JEF: Loaded 36773 existing records from primary storage. [2025-09-16T21:16:54.690581] [INFO ] [MAIN ] JEF: Loaded 36773 primary data records. [2025-09-16T21:16:54.812831] [DEBUG] [MAIN ] JCE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:54.839620] [INFO ] [MAIN ] JCE: Generated 1339 derivative records from 4761 primary records. [2025-09-16T21:16:54.928393] [DEBUG] [LOCAL ] JCE: Saving derivative data. [2025-09-16T21:16:55.026904] [DEBUG] [LOCAL ] JCE: Derivative data saved (1339 records). [2025-09-16T21:16:55.114629] [INFO ] [MAIN ] JCE: Successfully saved derivative data. [2025-09-16T21:16:55.116766] [INFO ] [MAIN ] Derivative Progress: 928/2026 symbols completed. JCE took 1.0s. Estimated remaining: 5m 59s. Rate: 183.6 symbols/min [2025-09-16T21:16:55.135137] [DEBUG] [MAIN ] JCI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:55.135921] [INFO ] [MAIN ] JCI: Generated 1339 derivative records from 39917 primary records. [2025-09-16T21:16:55.136059] [DEBUG] [LOCAL ] JCI: Saving derivative data. [2025-09-16T21:16:55.159410] [DEBUG] [LOCAL ] JCI: Derivative data saved (1339 records). [2025-09-16T21:16:55.159714] [DEBUG] [MAIN ] JEF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:55.159850] [INFO ] [MAIN ] JCI: Successfully saved derivative data. [2025-09-16T21:16:55.160591] [INFO ] [MAIN ] JEF: Generated 1339 derivative records from 36773 primary records. [2025-09-16T21:16:55.162914] [INFO ] [MAIN ] Derivative Progress: 929/2026 symbols completed. JCI took 0.9s. Estimated remaining: 5m 58s. Rate: 183.7 symbols/min [2025-09-16T21:16:55.160746] [DEBUG] [LOCAL ] JEF: Saving derivative data. [2025-09-16T21:16:55.178519] [DEBUG] [LOCAL ] JEF: Derivative data saved (1339 records). [2025-09-16T21:16:55.178655] [INFO ] [MAIN ] JEF: Successfully saved derivative data. [2025-09-16T21:16:55.181067] [INFO ] [MAIN ] Derivative Progress: 930/2026 symbols completed. JEF took 0.8s. Estimated remaining: 5m 58s. Rate: 183.9 symbols/min [2025-09-16T21:16:55.181875] [INFO ] [MAIN ] JELD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:55.181921] [INFO ] [MAIN ] JFR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:55.182092] [INFO ] [MAIN ] JEQ: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:55.194440] [DEBUG] [LOCAL ] JEQ: Loaded 5934 existing records from primary storage. [2025-09-16T21:16:55.194743] [INFO ] [MAIN ] JEQ: Loaded 5934 primary data records. [2025-09-16T21:16:55.344540] [DEBUG] [LOCAL ] JELD: Loaded 34406 existing records from primary storage. [2025-09-16T21:16:55.354841] [INFO ] [MAIN ] JELD: Loaded 34406 primary data records. [2025-09-16T21:16:55.333746] [DEBUG] [LOCAL ] JFR: Loaded 21662 existing records from primary storage. [2025-09-16T21:16:55.387663] [INFO ] [MAIN ] JFR: Loaded 21662 primary data records. [2025-09-16T21:16:56.090183] [DEBUG] [MAIN ] JEQ: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:56.091208] [INFO ] [MAIN ] JEQ: Generated 1339 derivative records from 5934 primary records. [2025-09-16T21:16:56.091462] [DEBUG] [LOCAL ] JEQ: Saving derivative data. [2025-09-16T21:16:56.103193] [DEBUG] [LOCAL ] JEQ: Derivative data saved (1339 records). [2025-09-16T21:16:56.103387] [INFO ] [MAIN ] JEQ: Successfully saved derivative data. [2025-09-16T21:16:56.104800] [INFO ] [MAIN ] Derivative Progress: 931/2026 symbols completed. JEQ took 0.9s. Estimated remaining: 5m 58s. Rate: 183.6 symbols/min [2025-09-16T21:16:56.105252] [INFO ] [MAIN ] JGH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:56.122074] [DEBUG] [MAIN ] JELD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:56.122842] [INFO ] [MAIN ] JELD: Generated 1339 derivative records from 34406 primary records. [2025-09-16T21:16:56.122996] [DEBUG] [LOCAL ] JELD: Saving derivative data. [2025-09-16T21:16:56.135944] [DEBUG] [MAIN ] JFR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:56.136129] [DEBUG] [LOCAL ] JGH: Loaded 8121 existing records from primary storage. [2025-09-16T21:16:56.136913] [INFO ] [MAIN ] JFR: Generated 1339 derivative records from 21662 primary records. [2025-09-16T21:16:56.136994] [DEBUG] [LOCAL ] JFR: Saving derivative data. [2025-09-16T21:16:56.137053] [INFO ] [MAIN ] JGH: Loaded 8121 primary data records. [2025-09-16T21:16:56.261996] [DEBUG] [LOCAL ] JELD: Derivative data saved (1339 records). [2025-09-16T21:16:56.262605] [INFO ] [MAIN ] JELD: Successfully saved derivative data. [2025-09-16T21:16:56.264871] [INFO ] [MAIN ] Derivative Progress: 932/2026 symbols completed. JELD took 1.1s. Estimated remaining: 5m 57s. Rate: 183.7 symbols/min [2025-09-16T21:16:56.265071] [INFO ] [MAIN ] JHG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:56.266006] [DEBUG] [LOCAL ] JFR: Derivative data saved (1339 records). [2025-09-16T21:16:56.276399] [INFO ] [MAIN ] JFR: Successfully saved derivative data. [2025-09-16T21:16:56.288741] [INFO ] [MAIN ] Derivative Progress: 933/2026 symbols completed. JFR took 1.1s. Estimated remaining: 5m 57s. Rate: 183.9 symbols/min [2025-09-16T21:16:56.308484] [INFO ] [MAIN ] JHI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:56.426728] [DEBUG] [LOCAL ] JHI: Loaded 2505 existing records from primary storage. [2025-09-16T21:16:56.426899] [INFO ] [MAIN ] JHI: Loaded 2505 primary data records. [2025-09-16T21:16:56.719834] [DEBUG] [LOCAL ] JHG: Loaded 35502 existing records from primary storage. [2025-09-16T21:16:56.720869] [INFO ] [MAIN ] JHG: Loaded 35502 primary data records. [2025-09-16T21:16:56.880388] [DEBUG] [MAIN ] JGH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:56.896049] [INFO ] [MAIN ] JGH: Generated 1339 derivative records from 8121 primary records. [2025-09-16T21:16:56.912420] [DEBUG] [LOCAL ] JGH: Saving derivative data. [2025-09-16T21:16:57.013675] [DEBUG] [LOCAL ] JGH: Derivative data saved (1339 records). [2025-09-16T21:16:57.013966] [INFO ] [MAIN ] JGH: Successfully saved derivative data. [2025-09-16T21:16:57.015585] [INFO ] [MAIN ] Derivative Progress: 934/2026 symbols completed. JGH took 0.9s. Estimated remaining: 5m 57s. Rate: 183.6 symbols/min [2025-09-16T21:16:57.016036] [INFO ] [MAIN ] JHS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:57.032195] [DEBUG] [MAIN ] JHI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:57.034293] [DEBUG] [LOCAL ] JHS: Loaded 2298 existing records from primary storage. [2025-09-16T21:16:57.035439] [INFO ] [MAIN ] JHI: Generated 1339 derivative records from 2505 primary records. [2025-09-16T21:16:57.035543] [INFO ] [MAIN ] JHS: Loaded 2298 primary data records. [2025-09-16T21:16:57.047324] [DEBUG] [LOCAL ] JHI: Saving derivative data. [2025-09-16T21:16:57.124224] [DEBUG] [LOCAL ] JHI: Derivative data saved (1339 records). [2025-09-16T21:16:57.129738] [INFO ] [MAIN ] JHI: Successfully saved derivative data. [2025-09-16T21:16:57.131867] [INFO ] [MAIN ] Derivative Progress: 935/2026 symbols completed. JHI took 0.8s. Estimated remaining: 5m 56s. Rate: 183.7 symbols/min [2025-09-16T21:16:57.150473] [INFO ] [MAIN ] JHX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:57.332984] [DEBUG] [MAIN ] JHG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:57.343248] [INFO ] [MAIN ] JHG: Generated 1339 derivative records from 35502 primary records. [2025-09-16T21:16:57.343685] [DEBUG] [LOCAL ] JHG: Saving derivative data. [2025-09-16T21:16:57.370972] [DEBUG] [LOCAL ] JHX: Loaded 39604 existing records from primary storage. [2025-09-16T21:16:57.370178] [DEBUG] [LOCAL ] JHG: Derivative data saved (1339 records). [2025-09-16T21:16:57.371349] [INFO ] [MAIN ] JHX: Loaded 39604 primary data records. [2025-09-16T21:16:57.371433] [INFO ] [MAIN ] JHG: Successfully saved derivative data. [2025-09-16T21:16:57.378859] [INFO ] [MAIN ] Derivative Progress: 936/2026 symbols completed. JHG took 1.1s. Estimated remaining: 5m 56s. Rate: 183.8 symbols/min [2025-09-16T21:16:57.396449] [INFO ] [MAIN ] JILL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:57.539754] [DEBUG] [LOCAL ] JILL: Loaded 11627 existing records from primary storage. [2025-09-16T21:16:57.558314] [INFO ] [MAIN ] JILL: Loaded 11627 primary data records. [2025-09-16T21:16:57.588525] [DEBUG] [MAIN ] JHS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:57.610412] [INFO ] [MAIN ] JHS: Generated 1339 derivative records from 2298 primary records. [2025-09-16T21:16:57.711201] [DEBUG] [LOCAL ] JHS: Saving derivative data. [2025-09-16T21:16:57.784427] [DEBUG] [LOCAL ] JHS: Derivative data saved (1339 records). [2025-09-16T21:16:57.807170] [INFO ] [MAIN ] JHS: Successfully saved derivative data. [2025-09-16T21:16:57.814282] [INFO ] [MAIN ] Derivative Progress: 937/2026 symbols completed. JHS took 0.8s. Estimated remaining: 5m 56s. Rate: 183.7 symbols/min [2025-09-16T21:16:57.825398] [INFO ] [MAIN ] JKS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:57.983824] [DEBUG] [MAIN ] JHX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:57.984840] [INFO ] [MAIN ] JHX: Generated 1339 derivative records from 39604 primary records. [2025-09-16T21:16:57.985089] [DEBUG] [LOCAL ] JHX: Saving derivative data. [2025-09-16T21:16:58.008371] [DEBUG] [LOCAL ] JHX: Derivative data saved (1339 records). [2025-09-16T21:16:58.006424] [DEBUG] [LOCAL ] JKS: Loaded 28572 existing records from primary storage. [2025-09-16T21:16:58.008516] [INFO ] [MAIN ] JHX: Successfully saved derivative data. [2025-09-16T21:16:58.010543] [INFO ] [MAIN ] Derivative Progress: 938/2026 symbols completed. JHX took 0.9s. Estimated remaining: 5m 55s. Rate: 183.8 symbols/min [2025-09-16T21:16:58.010635] [INFO ] [MAIN ] JKS: Loaded 28572 primary data records. [2025-09-16T21:16:58.016258] [INFO ] [MAIN ] JLL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:58.125910] [DEBUG] [MAIN ] JILL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:58.126935] [INFO ] [MAIN ] JILL: Generated 1339 derivative records from 11627 primary records. [2025-09-16T21:16:58.142704] [DEBUG] [LOCAL ] JILL: Saving derivative data. [2025-09-16T21:16:58.254100] [DEBUG] [LOCAL ] JILL: Derivative data saved (1339 records). [2025-09-16T21:16:58.329333] [INFO ] [MAIN ] JILL: Successfully saved derivative data. [2025-09-16T21:16:58.349727] [INFO ] [MAIN ] Derivative Progress: 939/2026 symbols completed. JILL took 1.0s. Estimated remaining: 5m 55s. Rate: 183.8 symbols/min [2025-09-16T21:16:58.350241] [INFO ] [MAIN ] JLS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:58.350879] [DEBUG] [LOCAL ] JLL: Loaded 24106 existing records from primary storage. [2025-09-16T21:16:58.352087] [INFO ] [MAIN ] JLL: Loaded 24106 primary data records. [2025-09-16T21:16:58.435188] [DEBUG] [LOCAL ] JLS: Loaded 2896 existing records from primary storage. [2025-09-16T21:16:58.440500] [INFO ] [MAIN ] JLS: Loaded 2896 primary data records. [2025-09-16T21:16:58.906610] [DEBUG] [MAIN ] JKS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:58.907528] [INFO ] [MAIN ] JKS: Generated 1339 derivative records from 28572 primary records. [2025-09-16T21:16:58.908825] [DEBUG] [LOCAL ] JKS: Saving derivative data. [2025-09-16T21:16:58.923933] [DEBUG] [LOCAL ] JKS: Derivative data saved (1339 records). [2025-09-16T21:16:58.924795] [INFO ] [MAIN ] JKS: Successfully saved derivative data. [2025-09-16T21:16:58.927123] [INFO ] [MAIN ] Derivative Progress: 940/2026 symbols completed. JKS took 1.1s. Estimated remaining: 5m 55s. Rate: 183.6 symbols/min [2025-09-16T21:16:58.928012] [INFO ] [MAIN ] JMIA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:58.940572] [DEBUG] [MAIN ] JLL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:58.941317] [INFO ] [MAIN ] JLL: Generated 1339 derivative records from 24106 primary records. [2025-09-16T21:16:58.941483] [DEBUG] [LOCAL ] JLL: Saving derivative data. [2025-09-16T21:16:58.954335] [DEBUG] [LOCAL ] JLL: Derivative data saved (1339 records). [2025-09-16T21:16:58.955175] [INFO ] [MAIN ] JLL: Successfully saved derivative data. [2025-09-16T21:16:58.957673] [INFO ] [MAIN ] Derivative Progress: 941/2026 symbols completed. JLL took 0.9s. Estimated remaining: 5m 54s. Rate: 183.8 symbols/min [2025-09-16T21:16:58.958410] [INFO ] [MAIN ] JNJ: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:58.968840] [DEBUG] [MAIN ] JLS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:58.969767] [INFO ] [MAIN ] JLS: Generated 1339 derivative records from 2896 primary records. [2025-09-16T21:16:58.969851] [DEBUG] [LOCAL ] JLS: Saving derivative data. [2025-09-16T21:16:58.989779] [DEBUG] [LOCAL ] JLS: Derivative data saved (1339 records). [2025-09-16T21:16:58.989965] [INFO ] [MAIN ] JLS: Successfully saved derivative data. [2025-09-16T21:16:58.992096] [INFO ] [MAIN ] Derivative Progress: 942/2026 symbols completed. JLS took 0.6s. Estimated remaining: 5m 53s. Rate: 184.0 symbols/min [2025-09-16T21:16:58.992387] [INFO ] [MAIN ] JOBY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:59.007487] [DEBUG] [LOCAL ] JMIA: Loaded 37976 existing records from primary storage. [2025-09-16T21:16:59.007671] [INFO ] [MAIN ] JMIA: Loaded 37976 primary data records. [2025-09-16T21:16:59.190864] [DEBUG] [LOCAL ] JNJ: Loaded 40103 existing records from primary storage. [2025-09-16T21:16:59.209964] [INFO ] [MAIN ] JNJ: Loaded 40103 primary data records. [2025-09-16T21:16:59.235559] [DEBUG] [LOCAL ] JOBY: Loaded 40161 existing records from primary storage. [2025-09-16T21:16:59.280887] [INFO ] [MAIN ] JOBY: Loaded 40161 primary data records. [2025-09-16T21:16:59.863138] [DEBUG] [MAIN ] JMIA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:59.864215] [INFO ] [MAIN ] JMIA: Generated 1339 derivative records from 37976 primary records. [2025-09-16T21:16:59.864670] [DEBUG] [LOCAL ] JMIA: Saving derivative data. [2025-09-16T21:16:59.881308] [DEBUG] [LOCAL ] JMIA: Derivative data saved (1339 records). [2025-09-16T21:16:59.882064] [INFO ] [MAIN ] JMIA: Successfully saved derivative data. [2025-09-16T21:16:59.884567] [INFO ] [MAIN ] Derivative Progress: 943/2026 symbols completed. JMIA took 1.0s. Estimated remaining: 5m 54s. Rate: 183.7 symbols/min [2025-09-16T21:16:59.894435] [DEBUG] [MAIN ] JNJ: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:59.895168] [INFO ] [MAIN ] JNJ: Generated 1339 derivative records from 40103 primary records. [2025-09-16T21:16:59.895331] [DEBUG] [LOCAL ] JNJ: Saving derivative data. [2025-09-16T21:16:59.913958] [DEBUG] [MAIN ] JOBY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:16:59.915443] [INFO ] [MAIN ] JOBY: Generated 1339 derivative records from 40161 primary records. [2025-09-16T21:16:59.916291] [DEBUG] [LOCAL ] JOBY: Saving derivative data. [2025-09-16T21:16:59.917078] [DEBUG] [LOCAL ] JNJ: Derivative data saved (1339 records). [2025-09-16T21:16:59.917336] [INFO ] [MAIN ] JNJ: Successfully saved derivative data. [2025-09-16T21:16:59.919365] [INFO ] [MAIN ] Derivative Progress: 944/2026 symbols completed. JNJ took 1.0s. Estimated remaining: 5m 53s. Rate: 183.8 symbols/min [2025-09-16T21:16:59.930897] [DEBUG] [LOCAL ] JOBY: Derivative data saved (1339 records). [2025-09-16T21:16:59.930959] [INFO ] [MAIN ] JOBY: Successfully saved derivative data. [2025-09-16T21:16:59.933864] [INFO ] [MAIN ] Derivative Progress: 945/2026 symbols completed. JOBY took 0.9s. Estimated remaining: 5m 52s. Rate: 184.0 symbols/min [2025-09-16T21:16:59.934725] [INFO ] [MAIN ] JOE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:59.934941] [INFO ] [MAIN ] JPC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:59.934656] [INFO ] [MAIN ] JOF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:16:59.943247] [DEBUG] [LOCAL ] JOF: Loaded 5071 existing records from primary storage. [2025-09-16T21:16:59.943380] [INFO ] [MAIN ] JOF: Loaded 5071 primary data records. [2025-09-16T21:17:00.071822] [DEBUG] [LOCAL ] JOE: Loaded 17782 existing records from primary storage. [2025-09-16T21:17:00.115383] [INFO ] [MAIN ] JOE: Loaded 17782 primary data records. [2025-09-16T21:17:00.314443] [DEBUG] [LOCAL ] JPC: Loaded 27000 existing records from primary storage. [2025-09-16T21:17:00.359820] [INFO ] [MAIN ] JPC: Loaded 27000 primary data records. [2025-09-16T21:17:00.829795] [DEBUG] [MAIN ] JOF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:00.830616] [INFO ] [MAIN ] JOF: Generated 1339 derivative records from 5071 primary records. [2025-09-16T21:17:00.832099] [DEBUG] [LOCAL ] JOF: Saving derivative data. [2025-09-16T21:17:00.845699] [DEBUG] [LOCAL ] JOF: Derivative data saved (1339 records). [2025-09-16T21:17:00.845972] [INFO ] [MAIN ] JOF: Successfully saved derivative data. [2025-09-16T21:17:00.847625] [INFO ] [MAIN ] Derivative Progress: 946/2026 symbols completed. JOF took 0.9s. Estimated remaining: 5m 53s. Rate: 183.7 symbols/min [2025-09-16T21:17:00.848331] [INFO ] [MAIN ] JPI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:00.866724] [DEBUG] [MAIN ] JOE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:00.866227] [DEBUG] [LOCAL ] JPI: Loaded 3856 existing records from primary storage. [2025-09-16T21:17:00.866872] [INFO ] [MAIN ] JPI: Loaded 3856 primary data records. [2025-09-16T21:17:00.867435] [INFO ] [MAIN ] JOE: Generated 1339 derivative records from 17782 primary records. [2025-09-16T21:17:00.878564] [DEBUG] [LOCAL ] JOE: Saving derivative data. [2025-09-16T21:17:01.015575] [DEBUG] [MAIN ] JPC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:01.035664] [INFO ] [MAIN ] JPC: Generated 1339 derivative records from 27000 primary records. [2025-09-16T21:17:01.043840] [DEBUG] [LOCAL ] JPC: Saving derivative data. [2025-09-16T21:17:01.065997] [DEBUG] [LOCAL ] JOE: Derivative data saved (1339 records). [2025-09-16T21:17:01.069111] [INFO ] [MAIN ] JOE: Successfully saved derivative data. [2025-09-16T21:17:01.155904] [INFO ] [MAIN ] Derivative Progress: 947/2026 symbols completed. JOE took 1.2s. Estimated remaining: 5m 52s. Rate: 183.7 symbols/min [2025-09-16T21:17:01.167181] [INFO ] [MAIN ] JPM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:01.170436] [DEBUG] [LOCAL ] JPC: Derivative data saved (1339 records). [2025-09-16T21:17:01.171126] [INFO ] [MAIN ] JPC: Successfully saved derivative data. [2025-09-16T21:17:01.173192] [INFO ] [MAIN ] Derivative Progress: 948/2026 symbols completed. JPC took 1.2s. Estimated remaining: 5m 52s. Rate: 183.9 symbols/min [2025-09-16T21:17:01.173512] [INFO ] [MAIN ] JQC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:01.198756] [DEBUG] [MAIN ] JPI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:01.199468] [INFO ] [MAIN ] JPI: Generated 1339 derivative records from 3856 primary records. [2025-09-16T21:17:01.199558] [DEBUG] [LOCAL ] JPI: Saving derivative data. [2025-09-16T21:17:01.226015] [DEBUG] [LOCAL ] JPI: Derivative data saved (1339 records). [2025-09-16T21:17:01.226821] [DEBUG] [LOCAL ] JQC: Loaded 24293 existing records from primary storage. [2025-09-16T21:17:01.227054] [INFO ] [MAIN ] JQC: Loaded 24293 primary data records. [2025-09-16T21:17:01.227003] [INFO ] [MAIN ] JPI: Successfully saved derivative data. [2025-09-16T21:17:01.228719] [INFO ] [MAIN ] Derivative Progress: 949/2026 symbols completed. JPI took 0.4s. Estimated remaining: 5m 51s. Rate: 184.0 symbols/min [2025-09-16T21:17:01.229051] [INFO ] [MAIN ] JRI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:01.346832] [DEBUG] [LOCAL ] JPM: Loaded 40144 existing records from primary storage. [2025-09-16T21:17:01.347027] [INFO ] [MAIN ] JPM: Loaded 40144 primary data records. [2025-09-16T21:17:01.517744] [DEBUG] [LOCAL ] JRI: Loaded 11215 existing records from primary storage. [2025-09-16T21:17:01.611625] [INFO ] [MAIN ] JRI: Loaded 11215 primary data records. [2025-09-16T21:17:02.067661] [DEBUG] [MAIN ] JQC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:02.068716] [INFO ] [MAIN ] JQC: Generated 1339 derivative records from 24293 primary records. [2025-09-16T21:17:02.068878] [DEBUG] [LOCAL ] JQC: Saving derivative data. [2025-09-16T21:17:02.082516] [DEBUG] [LOCAL ] JQC: Derivative data saved (1339 records). [2025-09-16T21:17:02.082843] [INFO ] [MAIN ] JQC: Successfully saved derivative data. [2025-09-16T21:17:02.084448] [INFO ] [MAIN ] Derivative Progress: 950/2026 symbols completed. JQC took 0.9s. Estimated remaining: 5m 51s. Rate: 183.7 symbols/min [2025-09-16T21:17:02.087045] [INFO ] [MAIN ] JRS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:02.100606] [DEBUG] [MAIN ] JPM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:02.101422] [INFO ] [MAIN ] JPM: Generated 1339 derivative records from 40144 primary records. [2025-09-16T21:17:02.103788] [DEBUG] [LOCAL ] JPM: Saving derivative data. [2025-09-16T21:17:02.118260] [DEBUG] [LOCAL ] JRS: Loaded 8343 existing records from primary storage. [2025-09-16T21:17:02.120853] [INFO ] [MAIN ] JRS: Loaded 8343 primary data records. [2025-09-16T21:17:02.121319] [DEBUG] [LOCAL ] JPM: Derivative data saved (1339 records). [2025-09-16T21:17:02.132561] [INFO ] [MAIN ] JPM: Successfully saved derivative data. [2025-09-16T21:17:02.207008] [DEBUG] [MAIN ] JRI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:02.209232] [INFO ] [MAIN ] Derivative Progress: 951/2026 symbols completed. JPM took 1.0s. Estimated remaining: 5m 51s. Rate: 183.8 symbols/min [2025-09-16T21:17:02.226333] [INFO ] [MAIN ] JRI: Generated 1339 derivative records from 11215 primary records. [2025-09-16T21:17:02.237418] [DEBUG] [LOCAL ] JRI: Saving derivative data. [2025-09-16T21:17:02.234051] [INFO ] [MAIN ] JXN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:02.324009] [DEBUG] [LOCAL ] JRI: Derivative data saved (1339 records). [2025-09-16T21:17:02.324181] [INFO ] [MAIN ] JRI: Successfully saved derivative data. [2025-09-16T21:17:02.408210] [INFO ] [MAIN ] Derivative Progress: 952/2026 symbols completed. JRI took 1.2s. Estimated remaining: 5m 50s. Rate: 183.9 symbols/min [2025-09-16T21:17:02.409127] [INFO ] [MAIN ] K: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:02.434386] [DEBUG] [LOCAL ] JXN: Loaded 33286 existing records from primary storage. [2025-09-16T21:17:02.434742] [INFO ] [MAIN ] JXN: Loaded 33286 primary data records. [2025-09-16T21:17:02.610182] [DEBUG] [MAIN ] JRS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:02.667535] [INFO ] [MAIN ] JRS: Generated 1339 derivative records from 8343 primary records. [2025-09-16T21:17:02.678404] [DEBUG] [LOCAL ] JRS: Saving derivative data. [2025-09-16T21:17:02.753288] [DEBUG] [LOCAL ] K: Loaded 37359 existing records from primary storage. [2025-09-16T21:17:02.763867] [INFO ] [MAIN ] K: Loaded 37359 primary data records. [2025-09-16T21:17:02.864427] [DEBUG] [LOCAL ] JRS: Derivative data saved (1339 records). [2025-09-16T21:17:02.883567] [INFO ] [MAIN ] JRS: Successfully saved derivative data. [2025-09-16T21:17:02.890560] [INFO ] [MAIN ] Derivative Progress: 953/2026 symbols completed. JRS took 0.8s. Estimated remaining: 5m 50s. Rate: 183.8 symbols/min [2025-09-16T21:17:02.890831] [INFO ] [MAIN ] KAI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:03.059587] [DEBUG] [LOCAL ] KAI: Loaded 9846 existing records from primary storage. [2025-09-16T21:17:03.059780] [INFO ] [MAIN ] KAI: Loaded 9846 primary data records. [2025-09-16T21:17:03.154835] [DEBUG] [MAIN ] JXN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:03.166688] [INFO ] [MAIN ] JXN: Generated 1339 derivative records from 33286 primary records. [2025-09-16T21:17:03.177837] [DEBUG] [LOCAL ] JXN: Saving derivative data. [2025-09-16T21:17:03.266464] [DEBUG] [LOCAL ] JXN: Derivative data saved (1339 records). [2025-09-16T21:17:03.351329] [INFO ] [MAIN ] JXN: Successfully saved derivative data. [2025-09-16T21:17:03.353347] [INFO ] [MAIN ] Derivative Progress: 954/2026 symbols completed. JXN took 1.1s. Estimated remaining: 5m 50s. Rate: 183.7 symbols/min [2025-09-16T21:17:03.354051] [INFO ] [MAIN ] KAR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:03.368862] [DEBUG] [MAIN ] K: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:03.369850] [INFO ] [MAIN ] K: Generated 1339 derivative records from 37359 primary records. [2025-09-16T21:17:03.369963] [DEBUG] [LOCAL ] K: Saving derivative data. [2025-09-16T21:17:03.391361] [DEBUG] [LOCAL ] K: Derivative data saved (1339 records). [2025-09-16T21:17:03.391492] [INFO ] [MAIN ] K: Successfully saved derivative data. [2025-09-16T21:17:03.393225] [INFO ] [MAIN ] Derivative Progress: 955/2026 symbols completed. K took 1.0s. Estimated remaining: 5m 49s. Rate: 183.9 symbols/min [2025-09-16T21:17:03.393717] [INFO ] [MAIN ] KB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:03.416636] [DEBUG] [LOCAL ] KAR: Loaded 29727 existing records from primary storage. [2025-09-16T21:17:03.416779] [INFO ] [MAIN ] KAR: Loaded 29727 primary data records. [2025-09-16T21:17:03.416094] [DEBUG] [MAIN ] KAI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:03.417493] [INFO ] [MAIN ] KAI: Generated 1339 derivative records from 9846 primary records. [2025-09-16T21:17:03.453594] [DEBUG] [LOCAL ] KAI: Saving derivative data. [2025-09-16T21:17:03.511400] [DEBUG] [LOCAL ] KB: Loaded 17934 existing records from primary storage. [2025-09-16T21:17:03.540418] [INFO ] [MAIN ] KB: Loaded 17934 primary data records. [2025-09-16T21:17:03.701340] [DEBUG] [LOCAL ] KAI: Derivative data saved (1339 records). [2025-09-16T21:17:03.717860] [INFO ] [MAIN ] KAI: Successfully saved derivative data. [2025-09-16T21:17:03.725510] [INFO ] [MAIN ] Derivative Progress: 956/2026 symbols completed. KAI took 0.8s. Estimated remaining: 5m 49s. Rate: 183.9 symbols/min [2025-09-16T21:17:03.829585] [INFO ] [MAIN ] KBDC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:03.990002] [DEBUG] [LOCAL ] KBDC: Loaded 14804 existing records from primary storage. [2025-09-16T21:17:03.990446] [INFO ] [MAIN ] KBDC: Loaded 14804 primary data records. [2025-09-16T21:17:04.267687] [DEBUG] [MAIN ] KAR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:04.269391] [INFO ] [MAIN ] KAR: Generated 1339 derivative records from 29727 primary records. [2025-09-16T21:17:04.270547] [DEBUG] [LOCAL ] KAR: Saving derivative data. [2025-09-16T21:17:04.284280] [DEBUG] [LOCAL ] KAR: Derivative data saved (1339 records). [2025-09-16T21:17:04.293772] [INFO ] [MAIN ] KAR: Successfully saved derivative data. [2025-09-16T21:17:04.295835] [INFO ] [MAIN ] Derivative Progress: 957/2026 symbols completed. KAR took 0.9s. Estimated remaining: 5m 49s. Rate: 183.8 symbols/min [2025-09-16T21:17:04.296251] [DEBUG] [MAIN ] KB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:04.298214] [INFO ] [MAIN ] KBH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:04.297571] [INFO ] [MAIN ] KB: Generated 1339 derivative records from 17934 primary records. [2025-09-16T21:17:04.298383] [DEBUG] [LOCAL ] KB: Saving derivative data. [2025-09-16T21:17:04.312975] [DEBUG] [LOCAL ] KB: Derivative data saved (1339 records). [2025-09-16T21:17:04.313403] [INFO ] [MAIN ] KB: Successfully saved derivative data. [2025-09-16T21:17:04.315346] [INFO ] [MAIN ] Derivative Progress: 958/2026 symbols completed. KB took 0.9s. Estimated remaining: 5m 48s. Rate: 183.9 symbols/min [2025-09-16T21:17:04.327928] [DEBUG] [MAIN ] KBDC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:04.328687] [INFO ] [MAIN ] KBDC: Generated 1339 derivative records from 14804 primary records. [2025-09-16T21:17:04.328763] [DEBUG] [LOCAL ] KBDC: Saving derivative data. [2025-09-16T21:17:04.349406] [DEBUG] [LOCAL ] KBDC: Derivative data saved (1339 records). [2025-09-16T21:17:04.349582] [INFO ] [MAIN ] KBDC: Successfully saved derivative data. [2025-09-16T21:17:04.351524] [INFO ] [MAIN ] Derivative Progress: 959/2026 symbols completed. KBDC took 0.5s. Estimated remaining: 5m 48s. Rate: 184.1 symbols/min [2025-09-16T21:17:04.364612] [DEBUG] [LOCAL ] KBH: Loaded 36047 existing records from primary storage. [2025-09-16T21:17:04.364781] [INFO ] [MAIN ] KBH: Loaded 36047 primary data records. [2025-09-16T21:17:04.701672] [DEBUG] [MAIN ] KBH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:04.702619] [INFO ] [MAIN ] KBH: Generated 1339 derivative records from 36047 primary records. [2025-09-16T21:17:04.702727] [DEBUG] [LOCAL ] KBH: Saving derivative data. [2025-09-16T21:17:04.722095] [DEBUG] [LOCAL ] KBH: Derivative data saved (1339 records). [2025-09-16T21:17:04.722243] [INFO ] [MAIN ] KBH: Successfully saved derivative data. [2025-09-16T21:17:04.725607] [INFO ] [MAIN ] Derivative Progress: 960/2026 symbols completed. KBH took 0.4s. Estimated remaining: 5m 47s. Rate: 184.1 symbols/min [2025-09-16T21:17:04.726408] [INFO ] [MAIN ] KBR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:04.726946] [INFO ] [MAIN ] KD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:04.727006] [INFO ] [MAIN ] KEN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:04.735863] [DEBUG] [LOCAL ] KEN: Loaded 3309 existing records from primary storage. [2025-09-16T21:17:04.736098] [INFO ] [MAIN ] KEN: Loaded 3309 primary data records. [2025-09-16T21:17:04.974977] [DEBUG] [LOCAL ] KD: Loaded 38888 existing records from primary storage. [2025-09-16T21:17:04.995216] [INFO ] [MAIN ] KD: Loaded 38888 primary data records. [2025-09-16T21:17:05.007000] [DEBUG] [LOCAL ] KBR: Loaded 35949 existing records from primary storage. [2025-09-16T21:17:05.091300] [INFO ] [MAIN ] KBR: Loaded 35949 primary data records. [2025-09-16T21:17:05.920563] [DEBUG] [MAIN ] KEN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:05.921718] [INFO ] [MAIN ] KEN: Generated 1339 derivative records from 3309 primary records. [2025-09-16T21:17:05.921902] [DEBUG] [LOCAL ] KEN: Saving derivative data. [2025-09-16T21:17:05.936464] [DEBUG] [LOCAL ] KEN: Derivative data saved (1339 records). [2025-09-16T21:17:05.936834] [INFO ] [MAIN ] KEN: Successfully saved derivative data. [2025-09-16T21:17:05.939381] [INFO ] [MAIN ] Derivative Progress: 961/2026 symbols completed. KEN took 1.2s. Estimated remaining: 5m 48s. Rate: 183.6 symbols/min [2025-09-16T21:17:05.945423] [INFO ] [MAIN ] KEP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:05.950262] [DEBUG] [MAIN ] KD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:05.951341] [INFO ] [MAIN ] KD: Generated 1339 derivative records from 38888 primary records. [2025-09-16T21:17:05.951763] [DEBUG] [LOCAL ] KD: Saving derivative data. [2025-09-16T21:17:05.967071] [DEBUG] [LOCAL ] KD: Derivative data saved (1339 records). [2025-09-16T21:17:05.976801] [INFO ] [MAIN ] KD: Successfully saved derivative data. [2025-09-16T21:17:05.982594] [DEBUG] [MAIN ] KBR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:05.984761] [INFO ] [MAIN ] Derivative Progress: 962/2026 symbols completed. KD took 1.3s. Estimated remaining: 5m 47s. Rate: 183.7 symbols/min [2025-09-16T21:17:05.985520] [INFO ] [MAIN ] KBR: Generated 1339 derivative records from 35949 primary records. [2025-09-16T21:17:05.986026] [DEBUG] [LOCAL ] KBR: Saving derivative data. [2025-09-16T21:17:05.985794] [INFO ] [MAIN ] KEYS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:06.008175] [DEBUG] [LOCAL ] KBR: Derivative data saved (1339 records). [2025-09-16T21:17:06.008623] [DEBUG] [LOCAL ] KEP: Loaded 24401 existing records from primary storage. [2025-09-16T21:17:06.008793] [INFO ] [MAIN ] KEP: Loaded 24401 primary data records. [2025-09-16T21:17:06.008732] [INFO ] [MAIN ] KBR: Successfully saved derivative data. [2025-09-16T21:17:06.010825] [INFO ] [MAIN ] Derivative Progress: 963/2026 symbols completed. KBR took 1.3s. Estimated remaining: 5m 47s. Rate: 183.9 symbols/min [2025-09-16T21:17:06.016877] [INFO ] [MAIN ] KF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:06.125247] [DEBUG] [LOCAL ] KF: Loaded 1755 existing records from primary storage. [2025-09-16T21:17:06.146410] [INFO ] [MAIN ] KF: Loaded 1755 primary data records. [2025-09-16T21:17:06.285468] [DEBUG] [LOCAL ] KEYS: Loaded 31718 existing records from primary storage. [2025-09-16T21:17:06.303139] [INFO ] [MAIN ] KEYS: Loaded 31718 primary data records. [2025-09-16T21:17:06.852198] [DEBUG] [MAIN ] KEP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:06.853094] [INFO ] [MAIN ] KEP: Generated 1339 derivative records from 24401 primary records. [2025-09-16T21:17:06.853295] [DEBUG] [LOCAL ] KEP: Saving derivative data. [2025-09-16T21:17:06.868811] [DEBUG] [LOCAL ] KEP: Derivative data saved (1339 records). [2025-09-16T21:17:06.868935] [INFO ] [MAIN ] KEP: Successfully saved derivative data. [2025-09-16T21:17:06.879442] [INFO ] [MAIN ] Derivative Progress: 964/2026 symbols completed. KEP took 0.9s. Estimated remaining: 5m 47s. Rate: 183.6 symbols/min [2025-09-16T21:17:06.879710] [INFO ] [MAIN ] KFRC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:06.880525] [DEBUG] [MAIN ] KF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:06.881215] [INFO ] [MAIN ] KF: Generated 1339 derivative records from 1755 primary records. [2025-09-16T21:17:06.881394] [DEBUG] [LOCAL ] KF: Saving derivative data. [2025-09-16T21:17:06.893608] [DEBUG] [LOCAL ] KF: Derivative data saved (1339 records). [2025-09-16T21:17:06.906713] [INFO ] [MAIN ] KF: Successfully saved derivative data. [2025-09-16T21:17:06.907125] [DEBUG] [MAIN ] KEYS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:06.908923] [INFO ] [MAIN ] Derivative Progress: 965/2026 symbols completed. KF took 0.9s. Estimated remaining: 5m 46s. Rate: 183.8 symbols/min [2025-09-16T21:17:06.909615] [INFO ] [MAIN ] KEYS: Generated 1339 derivative records from 31718 primary records. [2025-09-16T21:17:06.909788] [INFO ] [MAIN ] KFS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:06.909971] [DEBUG] [LOCAL ] KEYS: Saving derivative data. [2025-09-16T21:17:06.916483] [DEBUG] [LOCAL ] KFRC: Loaded 14991 existing records from primary storage. [2025-09-16T21:17:06.924889] [INFO ] [MAIN ] KFRC: Loaded 14991 primary data records. [2025-09-16T21:17:06.986699] [DEBUG] [LOCAL ] KEYS: Derivative data saved (1339 records). [2025-09-16T21:17:07.007167] [DEBUG] [LOCAL ] KFS: Loaded 6350 existing records from primary storage. [2025-09-16T21:17:07.012404] [INFO ] [MAIN ] KEYS: Successfully saved derivative data. [2025-09-16T21:17:07.012343] [INFO ] [MAIN ] KFS: Loaded 6350 primary data records. [2025-09-16T21:17:07.019474] [INFO ] [MAIN ] Derivative Progress: 966/2026 symbols completed. KEYS took 1.0s. Estimated remaining: 5m 46s. Rate: 183.9 symbols/min [2025-09-16T21:17:07.032783] [INFO ] [MAIN ] KFY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:07.499254] [DEBUG] [LOCAL ] KFY: Loaded 21739 existing records from primary storage. [2025-09-16T21:17:07.499496] [INFO ] [MAIN ] KFY: Loaded 21739 primary data records. [2025-09-16T21:17:07.786484] [DEBUG] [MAIN ] KFRC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:07.795840] [DEBUG] [MAIN ] KFS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:07.796486] [INFO ] [MAIN ] KFRC: Generated 1339 derivative records from 14991 primary records. [2025-09-16T21:17:07.797845] [INFO ] [MAIN ] KFS: Generated 1339 derivative records from 6350 primary records. [2025-09-16T21:17:07.798055] [DEBUG] [LOCAL ] KFRC: Saving derivative data. [2025-09-16T21:17:07.798221] [DEBUG] [LOCAL ] KFS: Saving derivative data. [2025-09-16T21:17:07.821622] [DEBUG] [LOCAL ] KFS: Derivative data saved (1339 records). [2025-09-16T21:17:07.822527] [DEBUG] [LOCAL ] KFRC: Derivative data saved (1339 records). [2025-09-16T21:17:07.822857] [INFO ] [MAIN ] KFRC: Successfully saved derivative data. [2025-09-16T21:17:07.822771] [INFO ] [MAIN ] KFS: Successfully saved derivative data. [2025-09-16T21:17:07.826065] [INFO ] [MAIN ] Derivative Progress: 967/2026 symbols completed. KFRC took 0.9s. Estimated remaining: 5m 46s. Rate: 183.6 symbols/min [2025-09-16T21:17:07.828051] [INFO ] [MAIN ] Derivative Progress: 968/2026 symbols completed. KFS took 0.9s. Estimated remaining: 5m 45s. Rate: 183.8 symbols/min [2025-09-16T21:17:07.837808] [INFO ] [MAIN ] KGS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:07.827885] [INFO ] [MAIN ] KGC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:07.838799] [DEBUG] [MAIN ] KFY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:07.839671] [INFO ] [MAIN ] KFY: Generated 1339 derivative records from 21739 primary records. [2025-09-16T21:17:07.839900] [DEBUG] [LOCAL ] KFY: Saving derivative data. [2025-09-16T21:17:07.852093] [DEBUG] [LOCAL ] KFY: Derivative data saved (1339 records). [2025-09-16T21:17:07.852180] [INFO ] [MAIN ] KFY: Successfully saved derivative data. [2025-09-16T21:17:07.854280] [INFO ] [MAIN ] Derivative Progress: 969/2026 symbols completed. KFY took 0.8s. Estimated remaining: 5m 45s. Rate: 184.0 symbols/min [2025-09-16T21:17:07.854594] [INFO ] [MAIN ] KIM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:07.922107] [DEBUG] [LOCAL ] KIM: Loaded 39507 existing records from primary storage. [2025-09-16T21:17:07.923046] [INFO ] [MAIN ] KIM: Loaded 39507 primary data records. [2025-09-16T21:17:07.922965] [DEBUG] [LOCAL ] KGS: Loaded 33944 existing records from primary storage. [2025-09-16T21:17:07.923214] [INFO ] [MAIN ] KGS: Loaded 33944 primary data records. [2025-09-16T21:17:08.098032] [DEBUG] [LOCAL ] KGC: Loaded 40050 existing records from primary storage. [2025-09-16T21:17:08.115458] [INFO ] [MAIN ] KGC: Loaded 40050 primary data records. [2025-09-16T21:17:08.755830] [DEBUG] [MAIN ] KIM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:08.758232] [INFO ] [MAIN ] KIM: Generated 1339 derivative records from 39507 primary records. [2025-09-16T21:17:08.759459] [DEBUG] [LOCAL ] KIM: Saving derivative data. [2025-09-16T21:17:08.789338] [DEBUG] [MAIN ] KGC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:08.789958] [DEBUG] [MAIN ] KGS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:08.790963] [INFO ] [MAIN ] KGC: Generated 1339 derivative records from 40050 primary records. [2025-09-16T21:17:08.794203] [DEBUG] [LOCAL ] KIM: Derivative data saved (1339 records). [2025-09-16T21:17:08.791894] [INFO ] [MAIN ] KGS: Generated 1339 derivative records from 33944 primary records. [2025-09-16T21:17:08.794366] [DEBUG] [LOCAL ] KGS: Saving derivative data. [2025-09-16T21:17:08.792764] [DEBUG] [LOCAL ] KGC: Saving derivative data. [2025-09-16T21:17:08.794461] [INFO ] [MAIN ] KIM: Successfully saved derivative data. [2025-09-16T21:17:08.796653] [INFO ] [MAIN ] Derivative Progress: 970/2026 symbols completed. KIM took 0.9s. Estimated remaining: 5m 45s. Rate: 183.6 symbols/min [2025-09-16T21:17:08.803453] [INFO ] [MAIN ] KIO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:08.823151] [DEBUG] [LOCAL ] KGS: Derivative data saved (1339 records). [2025-09-16T21:17:08.824325] [INFO ] [MAIN ] KGS: Successfully saved derivative data. [2025-09-16T21:17:08.829865] [DEBUG] [LOCAL ] KGC: Derivative data saved (1339 records). [2025-09-16T21:17:08.829790] [INFO ] [MAIN ] Derivative Progress: 971/2026 symbols completed. KGS took 1.0s. Estimated remaining: 5m 44s. Rate: 183.8 symbols/min [2025-09-16T21:17:08.830051] [INFO ] [MAIN ] KGC: Successfully saved derivative data. [2025-09-16T21:17:08.830264] [INFO ] [MAIN ] KKR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:08.832143] [INFO ] [MAIN ] Derivative Progress: 972/2026 symbols completed. KGC took 1.0s. Estimated remaining: 5m 44s. Rate: 184.0 symbols/min [2025-09-16T21:17:08.832758] [INFO ] [MAIN ] KKRS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:08.842683] [DEBUG] [LOCAL ] KIO: Loaded 15558 existing records from primary storage. [2025-09-16T21:17:08.842842] [INFO ] [MAIN ] KIO: Loaded 15558 primary data records. [2025-09-16T21:17:08.900341] [DEBUG] [LOCAL ] KKRS: Loaded 4505 existing records from primary storage. [2025-09-16T21:17:08.926078] [INFO ] [MAIN ] KKRS: Loaded 4505 primary data records. [2025-09-16T21:17:09.276452] [DEBUG] [LOCAL ] KKR: Loaded 39871 existing records from primary storage. [2025-09-16T21:17:09.308070] [INFO ] [MAIN ] KKR: Loaded 39871 primary data records. [2025-09-16T21:17:09.713633] [DEBUG] [MAIN ] KIO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:09.714823] [INFO ] [MAIN ] KIO: Generated 1339 derivative records from 15558 primary records. [2025-09-16T21:17:09.715030] [DEBUG] [LOCAL ] KIO: Saving derivative data. [2025-09-16T21:17:09.738656] [DEBUG] [MAIN ] KKRS: Filtered 5181 bins outside market hours, 5780 incomplete bins [2025-09-16T21:17:09.740460] [INFO ] [MAIN ] KKRS: Generated 1338 derivative records from 4505 primary records. [2025-09-16T21:17:09.740754] [DEBUG] [LOCAL ] KIO: Derivative data saved (1339 records). [2025-09-16T21:17:09.740908] [INFO ] [MAIN ] KIO: Successfully saved derivative data. [2025-09-16T21:17:09.742521] [INFO ] [MAIN ] Derivative Progress: 973/2026 symbols completed. KIO took 0.9s. Estimated remaining: 5m 44s. Rate: 183.6 symbols/min [2025-09-16T21:17:09.741066] [DEBUG] [LOCAL ] KKRS: Saving derivative data. [2025-09-16T21:17:09.764845] [DEBUG] [LOCAL ] KKRS: Derivative data saved (1338 records). [2025-09-16T21:17:09.765001] [DEBUG] [MAIN ] KKR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:09.765112] [INFO ] [MAIN ] KKRS: Successfully saved derivative data. [2025-09-16T21:17:09.767404] [INFO ] [MAIN ] Derivative Progress: 974/2026 symbols completed. KKRS took 0.9s. Estimated remaining: 5m 43s. Rate: 183.8 symbols/min [2025-09-16T21:17:09.765680] [INFO ] [MAIN ] KKR: Generated 1339 derivative records from 39871 primary records. [2025-09-16T21:17:09.767509] [DEBUG] [LOCAL ] KKR: Saving derivative data. [2025-09-16T21:17:09.779321] [DEBUG] [LOCAL ] KKR: Derivative data saved (1339 records). [2025-09-16T21:17:09.779378] [INFO ] [MAIN ] KKR: Successfully saved derivative data. [2025-09-16T21:17:09.781219] [INFO ] [MAIN ] Derivative Progress: 975/2026 symbols completed. KKR took 1.0s. Estimated remaining: 5m 43s. Rate: 184.0 symbols/min [2025-09-16T21:17:09.781741] [INFO ] [MAIN ] KMI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:09.781700] [INFO ] [MAIN ] KLC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:09.781900] [INFO ] [MAIN ] KLG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:09.816256] [DEBUG] [LOCAL ] KLC: Loaded 26417 existing records from primary storage. [2025-09-16T21:17:09.816475] [INFO ] [MAIN ] KLC: Loaded 26417 primary data records. [2025-09-16T21:17:09.969505] [DEBUG] [LOCAL ] KMI: Loaded 40043 existing records from primary storage. [2025-09-16T21:17:09.948340] [DEBUG] [LOCAL ] KLG: Loaded 31005 existing records from primary storage. [2025-09-16T21:17:09.989424] [INFO ] [MAIN ] KMI: Loaded 40043 primary data records. [2025-09-16T21:17:09.989508] [INFO ] [MAIN ] KLG: Loaded 31005 primary data records. [2025-09-16T21:17:10.661971] [DEBUG] [MAIN ] KLC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:10.664752] [INFO ] [MAIN ] KLC: Generated 1339 derivative records from 26417 primary records. [2025-09-16T21:17:10.665198] [DEBUG] [LOCAL ] KLC: Saving derivative data. [2025-09-16T21:17:10.680014] [DEBUG] [LOCAL ] KLC: Derivative data saved (1339 records). [2025-09-16T21:17:10.680211] [INFO ] [MAIN ] KLC: Successfully saved derivative data. [2025-09-16T21:17:10.682632] [INFO ] [MAIN ] Derivative Progress: 976/2026 symbols completed. KLC took 0.9s. Estimated remaining: 5m 43s. Rate: 183.7 symbols/min [2025-09-16T21:17:10.684809] [INFO ] [MAIN ] KMPB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:10.706798] [DEBUG] [MAIN ] KMI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:10.710133] [DEBUG] [LOCAL ] KMPB: Loaded 2577 existing records from primary storage. [2025-09-16T21:17:10.707918] [INFO ] [MAIN ] KMI: Generated 1339 derivative records from 40043 primary records. [2025-09-16T21:17:10.708257] [DEBUG] [MAIN ] KLG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:10.710915] [INFO ] [MAIN ] KLG: Generated 1339 derivative records from 31005 primary records. [2025-09-16T21:17:10.710828] [DEBUG] [LOCAL ] KMI: Saving derivative data. [2025-09-16T21:17:10.711045] [DEBUG] [LOCAL ] KLG: Saving derivative data. [2025-09-16T21:17:10.711131] [INFO ] [MAIN ] KMPB: Loaded 2577 primary data records. [2025-09-16T21:17:10.836930] [DEBUG] [LOCAL ] KLG: Derivative data saved (1339 records). [2025-09-16T21:17:10.837114] [INFO ] [MAIN ] KLG: Successfully saved derivative data. [2025-09-16T21:17:10.840717] [INFO ] [MAIN ] Derivative Progress: 977/2026 symbols completed. KLG took 1.1s. Estimated remaining: 5m 43s. Rate: 183.7 symbols/min [2025-09-16T21:17:10.837794] [DEBUG] [LOCAL ] KMI: Derivative data saved (1339 records). [2025-09-16T21:17:10.840977] [INFO ] [MAIN ] KMPR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:10.846416] [INFO ] [MAIN ] KMI: Successfully saved derivative data. [2025-09-16T21:17:10.854305] [INFO ] [MAIN ] Derivative Progress: 978/2026 symbols completed. KMI took 1.1s. Estimated remaining: 5m 42s. Rate: 183.9 symbols/min [2025-09-16T21:17:10.870170] [INFO ] [MAIN ] KMT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:11.054677] [DEBUG] [LOCAL ] KMPR: Loaded 29360 existing records from primary storage. [2025-09-16T21:17:11.055320] [INFO ] [MAIN ] KMPR: Loaded 29360 primary data records. [2025-09-16T21:17:11.055258] [DEBUG] [MAIN ] KMPB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:11.056039] [INFO ] [MAIN ] KMPB: Generated 1339 derivative records from 2577 primary records. [2025-09-16T21:17:11.067329] [DEBUG] [LOCAL ] KMPB: Saving derivative data. [2025-09-16T21:17:11.144962] [DEBUG] [LOCAL ] KMT: Loaded 32017 existing records from primary storage. [2025-09-16T21:17:11.152131] [INFO ] [MAIN ] KMT: Loaded 32017 primary data records. [2025-09-16T21:17:11.251450] [DEBUG] [LOCAL ] KMPB: Derivative data saved (1339 records). [2025-09-16T21:17:11.279146] [INFO ] [MAIN ] KMPB: Successfully saved derivative data. [2025-09-16T21:17:11.291430] [INFO ] [MAIN ] Derivative Progress: 979/2026 symbols completed. KMPB took 0.6s. Estimated remaining: 5m 42s. Rate: 183.9 symbols/min [2025-09-16T21:17:11.303146] [INFO ] [MAIN ] KMX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:11.692873] [DEBUG] [MAIN ] KMPR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:11.703201] [INFO ] [MAIN ] KMPR: Generated 1339 derivative records from 29360 primary records. [2025-09-16T21:17:11.702587] [DEBUG] [LOCAL ] KMX: Loaded 39668 existing records from primary storage. [2025-09-16T21:17:11.703658] [DEBUG] [LOCAL ] KMPR: Saving derivative data. [2025-09-16T21:17:11.703744] [INFO ] [MAIN ] KMX: Loaded 39668 primary data records. [2025-09-16T21:17:11.703605] [DEBUG] [MAIN ] KMT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:11.704330] [INFO ] [MAIN ] KMT: Generated 1339 derivative records from 32017 primary records. [2025-09-16T21:17:11.716052] [DEBUG] [LOCAL ] KMT: Saving derivative data. [2025-09-16T21:17:11.827757] [DEBUG] [LOCAL ] KMT: Derivative data saved (1339 records). [2025-09-16T21:17:11.844124] [INFO ] [MAIN ] KMT: Successfully saved derivative data. [2025-09-16T21:17:11.857005] [INFO ] [MAIN ] Derivative Progress: 980/2026 symbols completed. KMT took 1.0s. Estimated remaining: 5m 42s. Rate: 183.7 symbols/min [2025-09-16T21:17:11.879156] [INFO ] [MAIN ] KN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:11.906953] [DEBUG] [LOCAL ] KMPR: Derivative data saved (1339 records). [2025-09-16T21:17:11.987822] [INFO ] [MAIN ] KMPR: Successfully saved derivative data. [2025-09-16T21:17:11.990214] [INFO ] [MAIN ] Derivative Progress: 981/2026 symbols completed. KMPR took 1.1s. Estimated remaining: 5m 41s. Rate: 183.8 symbols/min [2025-09-16T21:17:11.990432] [INFO ] [MAIN ] KNF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:12.031507] [DEBUG] [MAIN ] KMX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:12.033027] [INFO ] [MAIN ] KMX: Generated 1339 derivative records from 39668 primary records. [2025-09-16T21:17:12.033538] [DEBUG] [LOCAL ] KN: Loaded 28017 existing records from primary storage. [2025-09-16T21:17:12.033669] [INFO ] [MAIN ] KN: Loaded 28017 primary data records. [2025-09-16T21:17:12.033627] [DEBUG] [LOCAL ] KMX: Saving derivative data. [2025-09-16T21:17:12.153106] [DEBUG] [LOCAL ] KNF: Loaded 26715 existing records from primary storage. [2025-09-16T21:17:12.169689] [INFO ] [MAIN ] KNF: Loaded 26715 primary data records. [2025-09-16T21:17:12.372678] [DEBUG] [LOCAL ] KMX: Derivative data saved (1339 records). [2025-09-16T21:17:12.394025] [INFO ] [MAIN ] KMX: Successfully saved derivative data. [2025-09-16T21:17:12.401422] [INFO ] [MAIN ] Derivative Progress: 982/2026 symbols completed. KMX took 1.1s. Estimated remaining: 5m 41s. Rate: 183.8 symbols/min [2025-09-16T21:17:12.425770] [INFO ] [MAIN ] KNOP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:12.600792] [DEBUG] [LOCAL ] KNOP: Loaded 6647 existing records from primary storage. [2025-09-16T21:17:12.600971] [INFO ] [MAIN ] KNOP: Loaded 6647 primary data records. [2025-09-16T21:17:12.891292] [DEBUG] [MAIN ] KN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:12.892687] [INFO ] [MAIN ] KN: Generated 1339 derivative records from 28017 primary records. [2025-09-16T21:17:12.893077] [DEBUG] [LOCAL ] KN: Saving derivative data. [2025-09-16T21:17:12.909611] [DEBUG] [LOCAL ] KN: Derivative data saved (1339 records). [2025-09-16T21:17:12.910656] [INFO ] [MAIN ] KN: Successfully saved derivative data. [2025-09-16T21:17:12.921530] [INFO ] [MAIN ] Derivative Progress: 983/2026 symbols completed. KN took 1.0s. Estimated remaining: 5m 41s. Rate: 183.7 symbols/min [2025-09-16T21:17:12.922776] [DEBUG] [MAIN ] KNF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:12.923886] [INFO ] [MAIN ] KNF: Generated 1339 derivative records from 26715 primary records. [2025-09-16T21:17:12.923011] [INFO ] [MAIN ] KNSL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:12.924077] [DEBUG] [LOCAL ] KNF: Saving derivative data. [2025-09-16T21:17:12.939448] [DEBUG] [LOCAL ] KNF: Derivative data saved (1339 records). [2025-09-16T21:17:12.939741] [INFO ] [MAIN ] KNF: Successfully saved derivative data. [2025-09-16T21:17:12.941769] [INFO ] [MAIN ] Derivative Progress: 984/2026 symbols completed. KNF took 1.0s. Estimated remaining: 5m 40s. Rate: 183.9 symbols/min [2025-09-16T21:17:12.942378] [INFO ] [MAIN ] KNTK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:12.965285] [DEBUG] [LOCAL ] KNSL: Loaded 13618 existing records from primary storage. [2025-09-16T21:17:12.965761] [INFO ] [MAIN ] KNSL: Loaded 13618 primary data records. [2025-09-16T21:17:12.965685] [DEBUG] [MAIN ] KNOP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:12.966434] [INFO ] [MAIN ] KNOP: Generated 1339 derivative records from 6647 primary records. [2025-09-16T21:17:13.004017] [DEBUG] [LOCAL ] KNOP: Saving derivative data. [2025-09-16T21:17:13.165214] [DEBUG] [LOCAL ] KNOP: Derivative data saved (1339 records). [2025-09-16T21:17:13.185755] [INFO ] [MAIN ] KNOP: Successfully saved derivative data. [2025-09-16T21:17:13.187778] [INFO ] [MAIN ] Derivative Progress: 985/2026 symbols completed. KNOP took 0.8s. Estimated remaining: 5m 40s. Rate: 183.9 symbols/min [2025-09-16T21:17:13.188634] [DEBUG] [LOCAL ] KNTK: Loaded 35014 existing records from primary storage. [2025-09-16T21:17:13.276330] [INFO ] [MAIN ] KNTK: Loaded 35014 primary data records. [2025-09-16T21:17:13.276480] [INFO ] [MAIN ] KNX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:13.607008] [DEBUG] [LOCAL ] KNX: Loaded 39070 existing records from primary storage. [2025-09-16T21:17:13.605803] [DEBUG] [MAIN ] KNSL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:13.608368] [INFO ] [MAIN ] KNX: Loaded 39070 primary data records. [2025-09-16T21:17:13.608223] [INFO ] [MAIN ] KNSL: Generated 1339 derivative records from 13618 primary records. [2025-09-16T21:17:13.608876] [DEBUG] [LOCAL ] KNSL: Saving derivative data. [2025-09-16T21:17:13.763274] [DEBUG] [LOCAL ] KNSL: Derivative data saved (1339 records). [2025-09-16T21:17:13.789841] [INFO ] [MAIN ] KNSL: Successfully saved derivative data. [2025-09-16T21:17:13.812088] [INFO ] [MAIN ] Derivative Progress: 986/2026 symbols completed. KNSL took 0.9s. Estimated remaining: 5m 40s. Rate: 183.7 symbols/min [2025-09-16T21:17:13.915724] [INFO ] [MAIN ] KO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:13.960470] [DEBUG] [MAIN ] KNTK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:13.961628] [INFO ] [MAIN ] KNTK: Generated 1339 derivative records from 35014 primary records. [2025-09-16T21:17:13.962453] [DEBUG] [LOCAL ] KNTK: Saving derivative data. [2025-09-16T21:17:13.978917] [DEBUG] [LOCAL ] KNTK: Derivative data saved (1339 records). [2025-09-16T21:17:13.980049] [INFO ] [MAIN ] KNTK: Successfully saved derivative data. [2025-09-16T21:17:13.982294] [INFO ] [MAIN ] Derivative Progress: 987/2026 symbols completed. KNTK took 1.0s. Estimated remaining: 5m 39s. Rate: 183.8 symbols/min [2025-09-16T21:17:13.983034] [INFO ] [MAIN ] KODK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:14.010172] [DEBUG] [MAIN ] KNX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:14.011184] [INFO ] [MAIN ] KNX: Generated 1339 derivative records from 39070 primary records. [2025-09-16T21:17:14.011360] [DEBUG] [LOCAL ] KNX: Saving derivative data. [2025-09-16T21:17:14.034544] [DEBUG] [LOCAL ] KNX: Derivative data saved (1339 records). [2025-09-16T21:17:14.047452] [INFO ] [MAIN ] KNX: Successfully saved derivative data. [2025-09-16T21:17:14.050564] [DEBUG] [LOCAL ] KO: Loaded 40168 existing records from primary storage. [2025-09-16T21:17:14.051019] [INFO ] [MAIN ] KO: Loaded 40168 primary data records. [2025-09-16T21:17:14.049329] [INFO ] [MAIN ] Derivative Progress: 988/2026 symbols completed. KNX took 0.8s. Estimated remaining: 5m 39s. Rate: 184.0 symbols/min [2025-09-16T21:17:14.143794] [DEBUG] [LOCAL ] KODK: Loaded 32256 existing records from primary storage. [2025-09-16T21:17:14.166870] [INFO ] [MAIN ] KODK: Loaded 32256 primary data records. [2025-09-16T21:17:14.653174] [DEBUG] [MAIN ] KO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:14.654251] [INFO ] [MAIN ] KO: Generated 1339 derivative records from 40168 primary records. [2025-09-16T21:17:14.654474] [DEBUG] [LOCAL ] KO: Saving derivative data. [2025-09-16T21:17:14.667990] [DEBUG] [LOCAL ] KO: Derivative data saved (1339 records). [2025-09-16T21:17:14.668133] [INFO ] [MAIN ] KO: Successfully saved derivative data. [2025-09-16T21:17:14.669791] [INFO ] [MAIN ] Derivative Progress: 989/2026 symbols completed. KO took 0.8s. Estimated remaining: 5m 39s. Rate: 183.8 symbols/min [2025-09-16T21:17:14.682290] [DEBUG] [MAIN ] KODK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:14.682962] [INFO ] [MAIN ] KODK: Generated 1339 derivative records from 32256 primary records. [2025-09-16T21:17:14.683025] [DEBUG] [LOCAL ] KODK: Saving derivative data. [2025-09-16T21:17:14.694687] [DEBUG] [LOCAL ] KODK: Derivative data saved (1339 records). [2025-09-16T21:17:14.694766] [INFO ] [MAIN ] KODK: Successfully saved derivative data. [2025-09-16T21:17:14.696204] [INFO ] [MAIN ] Derivative Progress: 990/2026 symbols completed. KODK took 0.7s. Estimated remaining: 5m 38s. Rate: 184.0 symbols/min [2025-09-16T21:17:14.697134] [INFO ] [MAIN ] KOF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:14.697311] [INFO ] [MAIN ] KORE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:14.697430] [INFO ] [MAIN ] KOP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:14.704051] [DEBUG] [LOCAL ] KORE: Loaded 1535 existing records from primary storage. [2025-09-16T21:17:14.704239] [INFO ] [MAIN ] KORE: Loaded 1535 primary data records. [2025-09-16T21:17:14.830976] [DEBUG] [LOCAL ] KOP: Loaded 12808 existing records from primary storage. [2025-09-16T21:17:14.831443] [DEBUG] [LOCAL ] KOF: Loaded 19629 existing records from primary storage. [2025-09-16T21:17:14.831936] [INFO ] [MAIN ] KOP: Loaded 12808 primary data records. [2025-09-16T21:17:14.842471] [INFO ] [MAIN ] KOF: Loaded 19629 primary data records. [2025-09-16T21:17:15.555805] [DEBUG] [MAIN ] KORE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:15.557187] [INFO ] [MAIN ] KORE: Generated 1339 derivative records from 1535 primary records. [2025-09-16T21:17:15.557747] [DEBUG] [LOCAL ] KORE: Saving derivative data. [2025-09-16T21:17:15.572101] [DEBUG] [LOCAL ] KORE: Derivative data saved (1339 records). [2025-09-16T21:17:15.574693] [INFO ] [MAIN ] KORE: Successfully saved derivative data. [2025-09-16T21:17:15.577673] [INFO ] [MAIN ] Derivative Progress: 991/2026 symbols completed. KORE took 0.9s. Estimated remaining: 5m 38s. Rate: 183.7 symbols/min [2025-09-16T21:17:15.597209] [INFO ] [MAIN ] KOS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:15.602002] [DEBUG] [MAIN ] KOP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:15.603688] [INFO ] [MAIN ] KOP: Generated 1339 derivative records from 12808 primary records. [2025-09-16T21:17:15.604028] [DEBUG] [MAIN ] KOF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:15.604111] [DEBUG] [LOCAL ] KOP: Saving derivative data. [2025-09-16T21:17:15.605236] [INFO ] [MAIN ] KOF: Generated 1339 derivative records from 19629 primary records. [2025-09-16T21:17:15.605855] [DEBUG] [LOCAL ] KOF: Saving derivative data. [2025-09-16T21:17:15.628977] [DEBUG] [LOCAL ] KOP: Derivative data saved (1339 records). [2025-09-16T21:17:15.632375] [INFO ] [MAIN ] KOP: Successfully saved derivative data. [2025-09-16T21:17:15.634838] [INFO ] [MAIN ] Derivative Progress: 992/2026 symbols completed. KOP took 0.9s. Estimated remaining: 5m 38s. Rate: 183.8 symbols/min [2025-09-16T21:17:15.635406] [INFO ] [MAIN ] KR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:15.647716] [DEBUG] [LOCAL ] KOF: Derivative data saved (1339 records). [2025-09-16T21:17:15.647878] [INFO ] [MAIN ] KOF: Successfully saved derivative data. [2025-09-16T21:17:15.649691] [INFO ] [MAIN ] Derivative Progress: 993/2026 symbols completed. KOF took 1.0s. Estimated remaining: 5m 37s. Rate: 184.0 symbols/min [2025-09-16T21:17:15.650068] [INFO ] [MAIN ] KRC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:15.694738] [DEBUG] [LOCAL ] KOS: Loaded 39572 existing records from primary storage. [2025-09-16T21:17:15.705846] [INFO ] [MAIN ] KOS: Loaded 39572 primary data records. [2025-09-16T21:17:15.784034] [DEBUG] [LOCAL ] KR: Loaded 40033 existing records from primary storage. [2025-09-16T21:17:15.814328] [INFO ] [MAIN ] KR: Loaded 40033 primary data records. [2025-09-16T21:17:15.855817] [DEBUG] [LOCAL ] KRC: Loaded 35713 existing records from primary storage. [2025-09-16T21:17:15.855928] [INFO ] [MAIN ] KRC: Loaded 35713 primary data records. [2025-09-16T21:17:16.648412] [DEBUG] [MAIN ] KOS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:16.650064] [INFO ] [MAIN ] KOS: Generated 1339 derivative records from 39572 primary records. [2025-09-16T21:17:16.650156] [DEBUG] [LOCAL ] KOS: Saving derivative data. [2025-09-16T21:17:16.650347] [DEBUG] [MAIN ] KR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:16.660993] [INFO ] [MAIN ] KR: Generated 1339 derivative records from 40033 primary records. [2025-09-16T21:17:16.661138] [DEBUG] [LOCAL ] KR: Saving derivative data. [2025-09-16T21:17:16.661691] [DEBUG] [MAIN ] KRC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:16.671203] [INFO ] [MAIN ] KRC: Generated 1339 derivative records from 35713 primary records. [2025-09-16T21:17:16.677583] [DEBUG] [LOCAL ] KRC: Saving derivative data. [2025-09-16T21:17:16.694336] [DEBUG] [LOCAL ] KR: Derivative data saved (1339 records). [2025-09-16T21:17:16.694662] [INFO ] [MAIN ] KR: Successfully saved derivative data. [2025-09-16T21:17:16.696812] [INFO ] [MAIN ] Derivative Progress: 994/2026 symbols completed. KR took 1.1s. Estimated remaining: 5m 37s. Rate: 183.6 symbols/min [2025-09-16T21:17:16.697915] [INFO ] [MAIN ] KREF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:16.698754] [DEBUG] [LOCAL ] KOS: Derivative data saved (1339 records). [2025-09-16T21:17:16.699839] [DEBUG] [LOCAL ] KRC: Derivative data saved (1339 records). [2025-09-16T21:17:16.699955] [INFO ] [MAIN ] KOS: Successfully saved derivative data. [2025-09-16T21:17:16.702240] [INFO ] [MAIN ] Derivative Progress: 995/2026 symbols completed. KOS took 1.1s. Estimated remaining: 5m 37s. Rate: 183.8 symbols/min [2025-09-16T21:17:16.702317] [INFO ] [MAIN ] KRC: Successfully saved derivative data. [2025-09-16T21:17:16.702674] [INFO ] [MAIN ] KRG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:16.704756] [INFO ] [MAIN ] Derivative Progress: 996/2026 symbols completed. KRC took 1.1s. Estimated remaining: 5m 36s. Rate: 183.9 symbols/min [2025-09-16T21:17:16.705317] [INFO ] [MAIN ] KRO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:16.738663] [DEBUG] [LOCAL ] KRO: Loaded 19557 existing records from primary storage. [2025-09-16T21:17:16.739789] [INFO ] [MAIN ] KRO: Loaded 19557 primary data records. [2025-09-16T21:17:16.740383] [DEBUG] [LOCAL ] KREF: Loaded 27305 existing records from primary storage. [2025-09-16T21:17:16.751979] [INFO ] [MAIN ] KREF: Loaded 27305 primary data records. [2025-09-16T21:17:16.964347] [DEBUG] [LOCAL ] KRG: Loaded 36453 existing records from primary storage. [2025-09-16T21:17:17.003272] [INFO ] [MAIN ] KRG: Loaded 36453 primary data records. [2025-09-16T21:17:17.585420] [DEBUG] [MAIN ] KREF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:17.586426] [INFO ] [MAIN ] KREF: Generated 1339 derivative records from 27305 primary records. [2025-09-16T21:17:17.586580] [DEBUG] [LOCAL ] KREF: Saving derivative data. [2025-09-16T21:17:17.585799] [DEBUG] [MAIN ] KRO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:17.587988] [INFO ] [MAIN ] KRO: Generated 1339 derivative records from 19557 primary records. [2025-09-16T21:17:17.593446] [DEBUG] [LOCAL ] KRO: Saving derivative data. [2025-09-16T21:17:17.600075] [DEBUG] [LOCAL ] KREF: Derivative data saved (1339 records). [2025-09-16T21:17:17.600305] [INFO ] [MAIN ] KREF: Successfully saved derivative data. [2025-09-16T21:17:17.608892] [INFO ] [MAIN ] Derivative Progress: 997/2026 symbols completed. KREF took 0.9s. Estimated remaining: 5m 36s. Rate: 183.6 symbols/min [2025-09-16T21:17:17.611626] [INFO ] [MAIN ] KRP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:17.624878] [DEBUG] [MAIN ] KRG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:17.625611] [DEBUG] [LOCAL ] KRO: Derivative data saved (1339 records). [2025-09-16T21:17:17.626634] [INFO ] [MAIN ] KRO: Successfully saved derivative data. [2025-09-16T21:17:17.626546] [INFO ] [MAIN ] KRG: Generated 1339 derivative records from 36453 primary records. [2025-09-16T21:17:17.628180] [INFO ] [MAIN ] Derivative Progress: 998/2026 symbols completed. KRO took 0.9s. Estimated remaining: 5m 36s. Rate: 183.8 symbols/min [2025-09-16T21:17:17.628258] [DEBUG] [LOCAL ] KRG: Saving derivative data. [2025-09-16T21:17:17.629001] [INFO ] [MAIN ] KSS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:17.655272] [DEBUG] [LOCAL ] KRG: Derivative data saved (1339 records). [2025-09-16T21:17:17.655553] [INFO ] [MAIN ] KRG: Successfully saved derivative data. [2025-09-16T21:17:17.657451] [INFO ] [MAIN ] Derivative Progress: 999/2026 symbols completed. KRG took 1.0s. Estimated remaining: 5m 35s. Rate: 184.0 symbols/min [2025-09-16T21:17:17.657899] [INFO ] [MAIN ] KT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:17.670373] [DEBUG] [LOCAL ] KRP: Loaded 26905 existing records from primary storage. [2025-09-16T21:17:17.670621] [INFO ] [MAIN ] KRP: Loaded 26905 primary data records. [2025-09-16T21:17:17.860021] [DEBUG] [LOCAL ] KSS: Loaded 39965 existing records from primary storage. [2025-09-16T21:17:17.882901] [INFO ] [MAIN ] KSS: Loaded 39965 primary data records. [2025-09-16T21:17:18.023437] [DEBUG] [LOCAL ] KT: Loaded 33570 existing records from primary storage. [2025-09-16T21:17:18.044875] [INFO ] [MAIN ] KT: Loaded 33570 primary data records. [2025-09-16T21:17:18.566506] [DEBUG] [MAIN ] KRP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:18.567863] [INFO ] [MAIN ] KRP: Generated 1339 derivative records from 26905 primary records. [2025-09-16T21:17:18.568187] [DEBUG] [LOCAL ] KRP: Saving derivative data. [2025-09-16T21:17:18.581227] [DEBUG] [LOCAL ] KRP: Derivative data saved (1339 records). [2025-09-16T21:17:18.581411] [INFO ] [MAIN ] KRP: Successfully saved derivative data. [2025-09-16T21:17:18.584067] [INFO ] [MAIN ] Derivative Progress: 1000/2026 symbols completed. KRP took 1.0s. Estimated remaining: 5m 35s. Rate: 183.6 symbols/min [2025-09-16T21:17:18.584510] [INFO ] [MAIN ] KTB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:18.597576] [DEBUG] [MAIN ] KSS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:18.598326] [INFO ] [MAIN ] KSS: Generated 1339 derivative records from 39965 primary records. [2025-09-16T21:17:18.598509] [DEBUG] [LOCAL ] KSS: Saving derivative data. [2025-09-16T21:17:18.620623] [DEBUG] [MAIN ] KT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:18.629533] [INFO ] [MAIN ] KT: Generated 1339 derivative records from 33570 primary records. [2025-09-16T21:17:18.630167] [DEBUG] [LOCAL ] KT: Saving derivative data. [2025-09-16T21:17:18.637321] [DEBUG] [LOCAL ] KSS: Derivative data saved (1339 records). [2025-09-16T21:17:18.640053] [INFO ] [MAIN ] KSS: Successfully saved derivative data. [2025-09-16T21:17:18.642264] [INFO ] [MAIN ] Derivative Progress: 1001/2026 symbols completed. KSS took 1.0s. Estimated remaining: 5m 35s. Rate: 183.8 symbols/min [2025-09-16T21:17:18.644977] [DEBUG] [LOCAL ] KT: Derivative data saved (1339 records). [2025-09-16T21:17:18.645066] [INFO ] [MAIN ] KT: Successfully saved derivative data. [2025-09-16T21:17:18.647614] [INFO ] [MAIN ] KTF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:18.647548] [INFO ] [MAIN ] Derivative Progress: 1002/2026 symbols completed. KT took 1.0s. Estimated remaining: 5m 34s. Rate: 183.9 symbols/min [2025-09-16T21:17:18.658198] [INFO ] [MAIN ] KVUE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:18.659131] [DEBUG] [LOCAL ] KTB: Loaded 30470 existing records from primary storage. [2025-09-16T21:17:18.659351] [INFO ] [MAIN ] KTB: Loaded 30470 primary data records. [2025-09-16T21:17:18.796296] [DEBUG] [LOCAL ] KTF: Loaded 8672 existing records from primary storage. [2025-09-16T21:17:18.813728] [INFO ] [MAIN ] KTF: Loaded 8672 primary data records. [2025-09-16T21:17:19.123507] [DEBUG] [LOCAL ] KVUE: Loaded 40017 existing records from primary storage. [2025-09-16T21:17:19.139689] [INFO ] [MAIN ] KVUE: Loaded 40017 primary data records. [2025-09-16T21:17:19.571590] [DEBUG] [MAIN ] KTB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:19.572685] [INFO ] [MAIN ] KTB: Generated 1339 derivative records from 30470 primary records. [2025-09-16T21:17:19.573575] [DEBUG] [LOCAL ] KTB: Saving derivative data. [2025-09-16T21:17:19.594904] [DEBUG] [LOCAL ] KTB: Derivative data saved (1339 records). [2025-09-16T21:17:19.596935] [INFO ] [MAIN ] KTB: Successfully saved derivative data. [2025-09-16T21:17:19.598441] [INFO ] [MAIN ] Derivative Progress: 1003/2026 symbols completed. KTB took 1.0s. Estimated remaining: 5m 34s. Rate: 183.6 symbols/min [2025-09-16T21:17:19.608980] [DEBUG] [MAIN ] KTF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:19.609632] [INFO ] [MAIN ] KTF: Generated 1339 derivative records from 8672 primary records. [2025-09-16T21:17:19.609856] [DEBUG] [LOCAL ] KTF: Saving derivative data. [2025-09-16T21:17:19.633483] [DEBUG] [LOCAL ] KTF: Derivative data saved (1339 records). [2025-09-16T21:17:19.633746] [DEBUG] [MAIN ] KVUE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:19.634459] [INFO ] [MAIN ] KTF: Successfully saved derivative data. [2025-09-16T21:17:19.634421] [INFO ] [MAIN ] KVUE: Generated 1339 derivative records from 40017 primary records. [2025-09-16T21:17:19.636106] [INFO ] [MAIN ] Derivative Progress: 1004/2026 symbols completed. KTF took 1.0s. Estimated remaining: 5m 34s. Rate: 183.8 symbols/min [2025-09-16T21:17:19.636229] [DEBUG] [LOCAL ] KVUE: Saving derivative data. [2025-09-16T21:17:19.648457] [DEBUG] [LOCAL ] KVUE: Derivative data saved (1339 records). [2025-09-16T21:17:19.648540] [INFO ] [MAIN ] KVUE: Successfully saved derivative data. [2025-09-16T21:17:19.650531] [INFO ] [MAIN ] Derivative Progress: 1005/2026 symbols completed. KVUE took 1.0s. Estimated remaining: 5m 33s. Rate: 183.9 symbols/min [2025-09-16T21:17:19.651135] [INFO ] [MAIN ] KVYO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:19.651254] [INFO ] [MAIN ] KW: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:19.651092] [INFO ] [MAIN ] KWR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:19.665230] [DEBUG] [LOCAL ] KWR: Loaded 12353 existing records from primary storage. [2025-09-16T21:17:19.665505] [INFO ] [MAIN ] KWR: Loaded 12353 primary data records. [2025-09-16T21:17:19.840695] [DEBUG] [LOCAL ] KW: Loaded 30155 existing records from primary storage. [2025-09-16T21:17:19.874774] [INFO ] [MAIN ] KW: Loaded 30155 primary data records. [2025-09-16T21:17:19.857760] [DEBUG] [LOCAL ] KVYO: Loaded 37611 existing records from primary storage. [2025-09-16T21:17:19.897466] [INFO ] [MAIN ] KVYO: Loaded 37611 primary data records. [2025-09-16T21:17:20.537124] [DEBUG] [MAIN ] KWR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:20.538494] [INFO ] [MAIN ] KWR: Generated 1339 derivative records from 12353 primary records. [2025-09-16T21:17:20.538833] [DEBUG] [LOCAL ] KWR: Saving derivative data. [2025-09-16T21:17:20.553276] [DEBUG] [LOCAL ] KWR: Derivative data saved (1339 records). [2025-09-16T21:17:20.554143] [INFO ] [MAIN ] KWR: Successfully saved derivative data. [2025-09-16T21:17:20.557048] [INFO ] [MAIN ] Derivative Progress: 1006/2026 symbols completed. KWR took 0.9s. Estimated remaining: 5m 33s. Rate: 183.6 symbols/min [2025-09-16T21:17:20.557779] [INFO ] [MAIN ] KYN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:20.569759] [DEBUG] [MAIN ] KW: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:20.570500] [INFO ] [MAIN ] KW: Generated 1339 derivative records from 30155 primary records. [2025-09-16T21:17:20.570695] [DEBUG] [LOCAL ] KW: Saving derivative data. [2025-09-16T21:17:20.580941] [DEBUG] [MAIN ] KVYO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:20.590154] [INFO ] [MAIN ] KVYO: Generated 1339 derivative records from 37611 primary records. [2025-09-16T21:17:20.591083] [DEBUG] [LOCAL ] KVYO: Saving derivative data. [2025-09-16T21:17:20.593732] [DEBUG] [LOCAL ] KW: Derivative data saved (1339 records). [2025-09-16T21:17:20.593808] [INFO ] [MAIN ] KW: Successfully saved derivative data. [2025-09-16T21:17:20.601778] [INFO ] [MAIN ] Derivative Progress: 1007/2026 symbols completed. KW took 1.0s. Estimated remaining: 5m 33s. Rate: 183.8 symbols/min [2025-09-16T21:17:20.602089] [INFO ] [MAIN ] L: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:20.613544] [DEBUG] [LOCAL ] KVYO: Derivative data saved (1339 records). [2025-09-16T21:17:20.619734] [INFO ] [MAIN ] KVYO: Successfully saved derivative data. [2025-09-16T21:17:20.622669] [INFO ] [MAIN ] Derivative Progress: 1008/2026 symbols completed. KVYO took 1.0s. Estimated remaining: 5m 32s. Rate: 183.9 symbols/min [2025-09-16T21:17:20.622922] [INFO ] [MAIN ] LAC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:20.623567] [DEBUG] [LOCAL ] KYN: Loaded 22074 existing records from primary storage. [2025-09-16T21:17:20.623809] [INFO ] [MAIN ] KYN: Loaded 22074 primary data records. [2025-09-16T21:17:20.939095] [DEBUG] [LOCAL ] L: Loaded 30321 existing records from primary storage. [2025-09-16T21:17:20.939259] [INFO ] [MAIN ] L: Loaded 30321 primary data records. [2025-09-16T21:17:21.036153] [DEBUG] [LOCAL ] LAC: Loaded 39040 existing records from primary storage. [2025-09-16T21:17:21.041867] [INFO ] [MAIN ] LAC: Loaded 39040 primary data records. [2025-09-16T21:17:21.502853] [DEBUG] [MAIN ] KYN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:21.503996] [INFO ] [MAIN ] KYN: Generated 1339 derivative records from 22074 primary records. [2025-09-16T21:17:21.504173] [DEBUG] [LOCAL ] KYN: Saving derivative data. [2025-09-16T21:17:21.519967] [DEBUG] [LOCAL ] KYN: Derivative data saved (1339 records). [2025-09-16T21:17:21.520167] [INFO ] [MAIN ] KYN: Successfully saved derivative data. [2025-09-16T21:17:21.522058] [INFO ] [MAIN ] Derivative Progress: 1009/2026 symbols completed. KYN took 1.0s. Estimated remaining: 5m 32s. Rate: 183.6 symbols/min [2025-09-16T21:17:21.522350] [INFO ] [MAIN ] LAD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:21.536863] [DEBUG] [MAIN ] L: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:21.537700] [INFO ] [MAIN ] L: Generated 1339 derivative records from 30321 primary records. [2025-09-16T21:17:21.537892] [DEBUG] [LOCAL ] L: Saving derivative data. [2025-09-16T21:17:21.555087] [DEBUG] [LOCAL ] L: Derivative data saved (1339 records). [2025-09-16T21:17:21.561973] [INFO ] [MAIN ] L: Successfully saved derivative data. [2025-09-16T21:17:21.563781] [INFO ] [MAIN ] Derivative Progress: 1010/2026 symbols completed. L took 1.0s. Estimated remaining: 5m 32s. Rate: 183.8 symbols/min [2025-09-16T21:17:21.573523] [DEBUG] [LOCAL ] LAD: Loaded 16994 existing records from primary storage. [2025-09-16T21:17:21.573920] [INFO ] [MAIN ] LAD: Loaded 16994 primary data records. [2025-09-16T21:17:21.574001] [INFO ] [MAIN ] LADR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:21.611003] [DEBUG] [MAIN ] LAC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:21.639765] [INFO ] [MAIN ] LAC: Generated 1339 derivative records from 39040 primary records. [2025-09-16T21:17:21.656771] [DEBUG] [LOCAL ] LAC: Saving derivative data. [2025-09-16T21:17:21.868603] [DEBUG] [LOCAL ] LAC: Derivative data saved (1339 records). [2025-09-16T21:17:21.869604] [INFO ] [MAIN ] LAC: Successfully saved derivative data. [2025-09-16T21:17:21.871511] [INFO ] [MAIN ] Derivative Progress: 1011/2026 symbols completed. LAC took 1.2s. Estimated remaining: 5m 31s. Rate: 183.8 symbols/min [2025-09-16T21:17:21.872160] [DEBUG] [LOCAL ] LADR: Loaded 28533 existing records from primary storage. [2025-09-16T21:17:21.872970] [INFO ] [MAIN ] LANV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:21.872800] [INFO ] [MAIN ] LADR: Loaded 28533 primary data records. [2025-09-16T21:17:21.940598] [DEBUG] [LOCAL ] LANV: Loaded 1929 existing records from primary storage. [2025-09-16T21:17:21.952797] [INFO ] [MAIN ] LANV: Loaded 1929 primary data records. [2025-09-16T21:17:22.419178] [DEBUG] [MAIN ] LAD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:22.420169] [INFO ] [MAIN ] LAD: Generated 1339 derivative records from 16994 primary records. [2025-09-16T21:17:22.421209] [DEBUG] [LOCAL ] LAD: Saving derivative data. [2025-09-16T21:17:22.435057] [DEBUG] [LOCAL ] LAD: Derivative data saved (1339 records). [2025-09-16T21:17:22.435614] [INFO ] [MAIN ] LAD: Successfully saved derivative data. [2025-09-16T21:17:22.437414] [INFO ] [MAIN ] Derivative Progress: 1012/2026 symbols completed. LAD took 0.9s. Estimated remaining: 5m 31s. Rate: 183.7 symbols/min [2025-09-16T21:17:22.437925] [INFO ] [MAIN ] LAR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:22.451078] [DEBUG] [MAIN ] LADR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:22.452490] [INFO ] [MAIN ] LADR: Generated 1339 derivative records from 28533 primary records. [2025-09-16T21:17:22.453970] [DEBUG] [LOCAL ] LADR: Saving derivative data. [2025-09-16T21:17:22.475780] [DEBUG] [LOCAL ] LADR: Derivative data saved (1339 records). [2025-09-16T21:17:22.476121] [INFO ] [MAIN ] LADR: Successfully saved derivative data. [2025-09-16T21:17:22.476008] [DEBUG] [MAIN ] LANV: Filtered 5181 bins outside market hours, 5780 incomplete bins [2025-09-16T21:17:22.478056] [INFO ] [MAIN ] Derivative Progress: 1013/2026 symbols completed. LADR took 0.9s. Estimated remaining: 5m 31s. Rate: 183.8 symbols/min [2025-09-16T21:17:22.479256] [INFO ] [MAIN ] LAW: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:22.479139] [INFO ] [MAIN ] LANV: Generated 1338 derivative records from 1929 primary records. [2025-09-16T21:17:22.479432] [DEBUG] [LOCAL ] LANV: Saving derivative data. [2025-09-16T21:17:22.499999] [DEBUG] [LOCAL ] LANV: Derivative data saved (1338 records). [2025-09-16T21:17:22.500152] [INFO ] [MAIN ] LANV: Successfully saved derivative data. [2025-09-16T21:17:22.502053] [INFO ] [MAIN ] Derivative Progress: 1014/2026 symbols completed. LANV took 0.6s. Estimated remaining: 5m 30s. Rate: 184.0 symbols/min [2025-09-16T21:17:22.502393] [INFO ] [MAIN ] LAZ: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:22.518476] [DEBUG] [LOCAL ] LAR: Loaded 33661 existing records from primary storage. [2025-09-16T21:17:22.517455] [DEBUG] [LOCAL ] LAW: Loaded 10628 existing records from primary storage. [2025-09-16T21:17:22.518697] [INFO ] [MAIN ] LAR: Loaded 33661 primary data records. [2025-09-16T21:17:22.518652] [INFO ] [MAIN ] LAW: Loaded 10628 primary data records. [2025-09-16T21:17:22.978392] [DEBUG] [LOCAL ] LAZ: Loaded 33463 existing records from primary storage. [2025-09-16T21:17:23.084513] [INFO ] [MAIN ] LAZ: Loaded 33463 primary data records. [2025-09-16T21:17:23.389243] [DEBUG] [MAIN ] LAR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:23.389467] [DEBUG] [MAIN ] LAW: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:23.390222] [INFO ] [MAIN ] LAR: Generated 1339 derivative records from 33661 primary records. [2025-09-16T21:17:23.390983] [DEBUG] [LOCAL ] LAR: Saving derivative data. [2025-09-16T21:17:23.391475] [INFO ] [MAIN ] LAW: Generated 1339 derivative records from 10628 primary records. [2025-09-16T21:17:23.392481] [DEBUG] [LOCAL ] LAW: Saving derivative data. [2025-09-16T21:17:23.415605] [DEBUG] [LOCAL ] LAR: Derivative data saved (1339 records). [2025-09-16T21:17:23.415800] [INFO ] [MAIN ] LAR: Successfully saved derivative data. [2025-09-16T21:17:23.415476] [DEBUG] [LOCAL ] LAW: Derivative data saved (1339 records). [2025-09-16T21:17:23.417806] [INFO ] [MAIN ] Derivative Progress: 1015/2026 symbols completed. LAR took 1.0s. Estimated remaining: 5m 30s. Rate: 183.7 symbols/min [2025-09-16T21:17:23.418022] [INFO ] [MAIN ] LAW: Successfully saved derivative data. [2025-09-16T21:17:23.418167] [INFO ] [MAIN ] LB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:23.419703] [INFO ] [MAIN ] Derivative Progress: 1016/2026 symbols completed. LAW took 0.9s. Estimated remaining: 5m 30s. Rate: 183.8 symbols/min [2025-09-16T21:17:23.420374] [INFO ] [MAIN ] LBRT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:23.433079] [DEBUG] [MAIN ] LAZ: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:23.433746] [INFO ] [MAIN ] LAZ: Generated 1339 derivative records from 33463 primary records. [2025-09-16T21:17:23.433851] [DEBUG] [LOCAL ] LAZ: Saving derivative data. [2025-09-16T21:17:23.446015] [DEBUG] [LOCAL ] LAZ: Derivative data saved (1339 records). [2025-09-16T21:17:23.449487] [INFO ] [MAIN ] LAZ: Successfully saved derivative data. [2025-09-16T21:17:23.451395] [INFO ] [MAIN ] Derivative Progress: 1017/2026 symbols completed. LAZ took 0.9s. Estimated remaining: 5m 29s. Rate: 184.0 symbols/min [2025-09-16T21:17:23.458972] [INFO ] [MAIN ] LC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:23.479083] [DEBUG] [LOCAL ] LB: Loaded 27672 existing records from primary storage. [2025-09-16T21:17:23.479310] [INFO ] [MAIN ] LB: Loaded 27672 primary data records. [2025-09-16T21:17:23.613090] [DEBUG] [LOCAL ] LBRT: Loaded 39400 existing records from primary storage. [2025-09-16T21:17:23.619036] [INFO ] [MAIN ] LBRT: Loaded 39400 primary data records. [2025-09-16T21:17:23.778993] [DEBUG] [LOCAL ] LC: Loaded 35580 existing records from primary storage. [2025-09-16T21:17:23.901003] [INFO ] [MAIN ] LC: Loaded 35580 primary data records. [2025-09-16T21:17:24.387181] [DEBUG] [MAIN ] LB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:24.388557] [INFO ] [MAIN ] LB: Generated 1339 derivative records from 27672 primary records. [2025-09-16T21:17:24.388832] [DEBUG] [LOCAL ] LB: Saving derivative data. [2025-09-16T21:17:24.419814] [DEBUG] [MAIN ] LBRT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:24.419915] [DEBUG] [LOCAL ] LB: Derivative data saved (1339 records). [2025-09-16T21:17:24.420906] [INFO ] [MAIN ] LBRT: Generated 1339 derivative records from 39400 primary records. [2025-09-16T21:17:24.421197] [DEBUG] [LOCAL ] LBRT: Saving derivative data. [2025-09-16T21:17:24.421311] [INFO ] [MAIN ] LB: Successfully saved derivative data. [2025-09-16T21:17:24.423341] [INFO ] [MAIN ] Derivative Progress: 1018/2026 symbols completed. LB took 1.0s. Estimated remaining: 5m 29s. Rate: 183.6 symbols/min [2025-09-16T21:17:24.446957] [DEBUG] [MAIN ] LC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:24.448146] [INFO ] [MAIN ] LC: Generated 1339 derivative records from 35580 primary records. [2025-09-16T21:17:24.448204] [DEBUG] [LOCAL ] LBRT: Derivative data saved (1339 records). [2025-09-16T21:17:24.448283] [DEBUG] [LOCAL ] LC: Saving derivative data. [2025-09-16T21:17:24.448365] [INFO ] [MAIN ] LBRT: Successfully saved derivative data. [2025-09-16T21:17:24.451612] [INFO ] [MAIN ] Derivative Progress: 1019/2026 symbols completed. LBRT took 1.0s. Estimated remaining: 5m 29s. Rate: 183.8 symbols/min [2025-09-16T21:17:24.462919] [DEBUG] [LOCAL ] LC: Derivative data saved (1339 records). [2025-09-16T21:17:24.462978] [INFO ] [MAIN ] LC: Successfully saved derivative data. [2025-09-16T21:17:24.464842] [INFO ] [MAIN ] Derivative Progress: 1020/2026 symbols completed. LC took 1.0s. Estimated remaining: 5m 28s. Rate: 184.0 symbols/min [2025-09-16T21:17:24.465331] [INFO ] [MAIN ] LCII: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:24.465540] [INFO ] [MAIN ] LDI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:24.465966] [INFO ] [MAIN ] LDOS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:24.498582] [DEBUG] [LOCAL ] LCII: Loaded 20266 existing records from primary storage. [2025-09-16T21:17:24.498829] [INFO ] [MAIN ] LCII: Loaded 20266 primary data records. [2025-09-16T21:17:24.634452] [DEBUG] [LOCAL ] LDOS: Loaded 33529 existing records from primary storage. [2025-09-16T21:17:24.634368] [DEBUG] [LOCAL ] LDI: Loaded 32271 existing records from primary storage. [2025-09-16T21:17:24.634669] [INFO ] [MAIN ] LDOS: Loaded 33529 primary data records. [2025-09-16T21:17:24.634885] [INFO ] [MAIN ] LDI: Loaded 32271 primary data records. [2025-09-16T21:17:25.402255] [DEBUG] [MAIN ] LCII: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:25.403021] [INFO ] [MAIN ] LCII: Generated 1339 derivative records from 20266 primary records. [2025-09-16T21:17:25.403273] [DEBUG] [LOCAL ] LCII: Saving derivative data. [2025-09-16T21:17:25.416295] [DEBUG] [LOCAL ] LCII: Derivative data saved (1339 records). [2025-09-16T21:17:25.416661] [INFO ] [MAIN ] LCII: Successfully saved derivative data. [2025-09-16T21:17:25.418157] [INFO ] [MAIN ] Derivative Progress: 1021/2026 symbols completed. LCII took 1.0s. Estimated remaining: 5m 28s. Rate: 183.6 symbols/min [2025-09-16T21:17:25.419191] [INFO ] [MAIN ] LDP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:25.443444] [DEBUG] [MAIN ] LDI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:25.446581] [INFO ] [MAIN ] LDI: Generated 1339 derivative records from 32271 primary records. [2025-09-16T21:17:25.446819] [DEBUG] [MAIN ] LDOS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:25.447391] [INFO ] [MAIN ] LDOS: Generated 1339 derivative records from 33529 primary records. [2025-09-16T21:17:25.447504] [DEBUG] [LOCAL ] LDOS: Saving derivative data. [2025-09-16T21:17:25.447543] [DEBUG] [LOCAL ] LDI: Saving derivative data. [2025-09-16T21:17:25.476526] [DEBUG] [LOCAL ] LDP: Loaded 9457 existing records from primary storage. [2025-09-16T21:17:25.477194] [DEBUG] [LOCAL ] LDI: Derivative data saved (1339 records). [2025-09-16T21:17:25.476608] [DEBUG] [LOCAL ] LDOS: Derivative data saved (1339 records). [2025-09-16T21:17:25.477334] [INFO ] [MAIN ] LDI: Successfully saved derivative data. [2025-09-16T21:17:25.479368] [INFO ] [MAIN ] Derivative Progress: 1022/2026 symbols completed. LDI took 1.0s. Estimated remaining: 5m 28s. Rate: 183.8 symbols/min [2025-09-16T21:17:25.476953] [INFO ] [MAIN ] LDP: Loaded 9457 primary data records. [2025-09-16T21:17:25.484965] [INFO ] [MAIN ] LEA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:25.484770] [INFO ] [MAIN ] LDOS: Successfully saved derivative data. [2025-09-16T21:17:25.508159] [INFO ] [MAIN ] Derivative Progress: 1023/2026 symbols completed. LDOS took 1.0s. Estimated remaining: 5m 27s. Rate: 183.9 symbols/min [2025-09-16T21:17:25.531226] [INFO ] [MAIN ] LEG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:25.777230] [DEBUG] [LOCAL ] LEA: Loaded 30603 existing records from primary storage. [2025-09-16T21:17:25.777407] [INFO ] [MAIN ] LEA: Loaded 30603 primary data records. [2025-09-16T21:17:25.875591] [DEBUG] [LOCAL ] LEG: Loaded 37283 existing records from primary storage. [2025-09-16T21:17:25.892691] [INFO ] [MAIN ] LEG: Loaded 37283 primary data records. [2025-09-16T21:17:26.330801] [DEBUG] [MAIN ] LDP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:26.332763] [INFO ] [MAIN ] LDP: Generated 1339 derivative records from 9457 primary records. [2025-09-16T21:17:26.333037] [DEBUG] [LOCAL ] LDP: Saving derivative data. [2025-09-16T21:17:26.346953] [DEBUG] [LOCAL ] LDP: Derivative data saved (1339 records). [2025-09-16T21:17:26.347114] [INFO ] [MAIN ] LDP: Successfully saved derivative data. [2025-09-16T21:17:26.349233] [INFO ] [MAIN ] Derivative Progress: 1024/2026 symbols completed. LDP took 0.9s. Estimated remaining: 5m 27s. Rate: 183.7 symbols/min [2025-09-16T21:17:26.349662] [INFO ] [MAIN ] LEN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:26.364449] [DEBUG] [MAIN ] LEA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:26.365152] [INFO ] [MAIN ] LEA: Generated 1339 derivative records from 30603 primary records. [2025-09-16T21:17:26.365371] [DEBUG] [LOCAL ] LEA: Saving derivative data. [2025-09-16T21:17:26.378140] [DEBUG] [LOCAL ] LEA: Derivative data saved (1339 records). [2025-09-16T21:17:26.378996] [INFO ] [MAIN ] LEA: Successfully saved derivative data. [2025-09-16T21:17:26.380577] [INFO ] [MAIN ] Derivative Progress: 1025/2026 symbols completed. LEA took 0.9s. Estimated remaining: 5m 27s. Rate: 183.8 symbols/min [2025-09-16T21:17:26.382372] [INFO ] [MAIN ] LEO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:26.393159] [DEBUG] [MAIN ] LEG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:26.393938] [INFO ] [MAIN ] LEG: Generated 1339 derivative records from 37283 primary records. [2025-09-16T21:17:26.403483] [DEBUG] [LOCAL ] LEG: Saving derivative data. [2025-09-16T21:17:26.418937] [DEBUG] [LOCAL ] LEG: Derivative data saved (1339 records). [2025-09-16T21:17:26.419168] [INFO ] [MAIN ] LEG: Successfully saved derivative data. [2025-09-16T21:17:26.421279] [INFO ] [MAIN ] Derivative Progress: 1026/2026 symbols completed. LEG took 0.9s. Estimated remaining: 5m 26s. Rate: 184.0 symbols/min [2025-09-16T21:17:26.426237] [INFO ] [MAIN ] LEVI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:26.426496] [DEBUG] [LOCAL ] LEO: Loaded 12057 existing records from primary storage. [2025-09-16T21:17:26.426804] [INFO ] [MAIN ] LEO: Loaded 12057 primary data records. [2025-09-16T21:17:26.542706] [DEBUG] [LOCAL ] LEN: Loaded 39613 existing records from primary storage. [2025-09-16T21:17:26.548356] [INFO ] [MAIN ] LEN: Loaded 39613 primary data records. [2025-09-16T21:17:26.909842] [DEBUG] [LOCAL ] LEVI: Loaded 38348 existing records from primary storage. [2025-09-16T21:17:26.915148] [INFO ] [MAIN ] LEVI: Loaded 38348 primary data records. [2025-09-16T21:17:27.294887] [DEBUG] [MAIN ] LEO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:27.296098] [INFO ] [MAIN ] LEO: Generated 1339 derivative records from 12057 primary records. [2025-09-16T21:17:27.296225] [DEBUG] [LOCAL ] LEO: Saving derivative data. [2025-09-16T21:17:27.309220] [DEBUG] [LOCAL ] LEO: Derivative data saved (1339 records). [2025-09-16T21:17:27.309308] [INFO ] [MAIN ] LEO: Successfully saved derivative data. [2025-09-16T21:17:27.311214] [INFO ] [MAIN ] Derivative Progress: 1027/2026 symbols completed. LEO took 0.9s. Estimated remaining: 5m 26s. Rate: 183.7 symbols/min [2025-09-16T21:17:27.311447] [INFO ] [MAIN ] LFT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:27.328432] [DEBUG] [MAIN ] LEN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:27.332967] [INFO ] [MAIN ] LEN: Generated 1339 derivative records from 39613 primary records. [2025-09-16T21:17:27.333988] [DEBUG] [LOCAL ] LEN: Saving derivative data. [2025-09-16T21:17:27.347940] [DEBUG] [LOCAL ] LFT: Loaded 14075 existing records from primary storage. [2025-09-16T21:17:27.353202] [INFO ] [MAIN ] LFT: Loaded 14075 primary data records. [2025-09-16T21:17:27.353721] [DEBUG] [LOCAL ] LEN: Derivative data saved (1339 records). [2025-09-16T21:17:27.374533] [INFO ] [MAIN ] LEN: Successfully saved derivative data. [2025-09-16T21:17:27.387855] [INFO ] [MAIN ] Derivative Progress: 1028/2026 symbols completed. LEN took 1.0s. Estimated remaining: 5m 26s. Rate: 183.8 symbols/min [2025-09-16T21:17:27.421579] [INFO ] [MAIN ] LGI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:27.526378] [DEBUG] [MAIN ] LEVI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:27.552408] [INFO ] [MAIN ] LEVI: Generated 1339 derivative records from 38348 primary records. [2025-09-16T21:17:27.559091] [DEBUG] [LOCAL ] LGI: Loaded 7314 existing records from primary storage. [2025-09-16T21:17:27.667820] [DEBUG] [LOCAL ] LEVI: Saving derivative data. [2025-09-16T21:17:27.680008] [INFO ] [MAIN ] LGI: Loaded 7314 primary data records. [2025-09-16T21:17:27.784968] [DEBUG] [LOCAL ] LEVI: Derivative data saved (1339 records). [2025-09-16T21:17:27.814496] [INFO ] [MAIN ] LEVI: Successfully saved derivative data. [2025-09-16T21:17:27.821998] [INFO ] [MAIN ] Derivative Progress: 1029/2026 symbols completed. LEVI took 1.4s. Estimated remaining: 5m 26s. Rate: 183.7 symbols/min [2025-09-16T21:17:27.863471] [INFO ] [MAIN ] LH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:28.000619] [DEBUG] [MAIN ] LFT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:28.002012] [INFO ] [MAIN ] LFT: Generated 1339 derivative records from 14075 primary records. [2025-09-16T21:17:28.002776] [DEBUG] [LOCAL ] LFT: Saving derivative data. [2025-09-16T21:17:28.024606] [DEBUG] [LOCAL ] LH: Loaded 28126 existing records from primary storage. [2025-09-16T21:17:28.025854] [INFO ] [MAIN ] LH: Loaded 28126 primary data records. [2025-09-16T21:17:28.042999] [DEBUG] [LOCAL ] LFT: Derivative data saved (1339 records). [2025-09-16T21:17:28.106760] [DEBUG] [MAIN ] LGI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:28.124302] [INFO ] [MAIN ] LGI: Generated 1339 derivative records from 7314 primary records. [2025-09-16T21:17:28.063318] [INFO ] [MAIN ] LFT: Successfully saved derivative data. [2025-09-16T21:17:28.126124] [INFO ] [MAIN ] Derivative Progress: 1030/2026 symbols completed. LFT took 0.8s. Estimated remaining: 5m 25s. Rate: 183.8 symbols/min [2025-09-16T21:17:28.137133] [DEBUG] [LOCAL ] LGI: Saving derivative data. [2025-09-16T21:17:28.137224] [INFO ] [MAIN ] LHX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:28.166057] [DEBUG] [LOCAL ] LGI: Derivative data saved (1339 records). [2025-09-16T21:17:28.181619] [INFO ] [MAIN ] LGI: Successfully saved derivative data. [2025-09-16T21:17:28.211417] [INFO ] [MAIN ] Derivative Progress: 1031/2026 symbols completed. LGI took 0.8s. Estimated remaining: 5m 25s. Rate: 183.9 symbols/min [2025-09-16T21:17:28.313627] [INFO ] [MAIN ] LII: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:28.356863] [DEBUG] [LOCAL ] LHX: Loaded 36532 existing records from primary storage. [2025-09-16T21:17:28.357380] [INFO ] [MAIN ] LHX: Loaded 36532 primary data records. [2025-09-16T21:17:28.448700] [DEBUG] [LOCAL ] LII: Loaded 20348 existing records from primary storage. [2025-09-16T21:17:28.494747] [INFO ] [MAIN ] LII: Loaded 20348 primary data records. [2025-09-16T21:17:28.562503] [DEBUG] [MAIN ] LH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:28.668936] [INFO ] [MAIN ] LH: Generated 1339 derivative records from 28126 primary records. [2025-09-16T21:17:28.679738] [DEBUG] [LOCAL ] LH: Saving derivative data. [2025-09-16T21:17:28.817716] [DEBUG] [LOCAL ] LH: Derivative data saved (1339 records). [2025-09-16T21:17:28.845162] [INFO ] [MAIN ] LH: Successfully saved derivative data. [2025-09-16T21:17:28.932604] [INFO ] [MAIN ] Derivative Progress: 1032/2026 symbols completed. LH took 1.1s. Estimated remaining: 5m 25s. Rate: 183.7 symbols/min [2025-09-16T21:17:28.933120] [INFO ] [MAIN ] LION: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:28.950277] [DEBUG] [MAIN ] LHX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:28.951031] [INFO ] [MAIN ] LHX: Generated 1339 derivative records from 36532 primary records. [2025-09-16T21:17:28.952064] [DEBUG] [LOCAL ] LHX: Saving derivative data. [2025-09-16T21:17:28.973464] [DEBUG] [LOCAL ] LHX: Derivative data saved (1339 records). [2025-09-16T21:17:28.973580] [INFO ] [MAIN ] LHX: Successfully saved derivative data. [2025-09-16T21:17:28.975934] [INFO ] [MAIN ] Derivative Progress: 1033/2026 symbols completed. LHX took 0.8s. Estimated remaining: 5m 24s. Rate: 183.8 symbols/min [2025-09-16T21:17:28.990443] [DEBUG] [LOCAL ] LION: Loaded 35711 existing records from primary storage. [2025-09-16T21:17:28.999822] [INFO ] [MAIN ] LION: Loaded 35711 primary data records. [2025-09-16T21:17:29.000238] [DEBUG] [MAIN ] LII: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:29.056223] [INFO ] [MAIN ] LII: Generated 1339 derivative records from 20348 primary records. [2025-09-16T21:17:29.066904] [DEBUG] [LOCAL ] LII: Saving derivative data. [2025-09-16T21:17:29.145111] [DEBUG] [LOCAL ] LII: Derivative data saved (1339 records). [2025-09-16T21:17:29.174297] [INFO ] [MAIN ] LII: Successfully saved derivative data. [2025-09-16T21:17:29.183457] [INFO ] [MAIN ] Derivative Progress: 1034/2026 symbols completed. LII took 0.9s. Estimated remaining: 5m 24s. Rate: 183.9 symbols/min [2025-09-16T21:17:29.303670] [DEBUG] [MAIN ] LION: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:29.304341] [INFO ] [MAIN ] LION: Generated 1339 derivative records from 35711 primary records. [2025-09-16T21:17:29.304405] [DEBUG] [LOCAL ] LION: Saving derivative data. [2025-09-16T21:17:29.315753] [DEBUG] [LOCAL ] LION: Derivative data saved (1339 records). [2025-09-16T21:17:29.315811] [INFO ] [MAIN ] LION: Successfully saved derivative data. [2025-09-16T21:17:29.317287] [INFO ] [MAIN ] Derivative Progress: 1035/2026 symbols completed. LION took 0.4s. Estimated remaining: 5m 23s. Rate: 184.0 symbols/min [2025-09-16T21:17:29.317985] [INFO ] [MAIN ] LMND: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:29.318040] [INFO ] [MAIN ] LITB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:29.318182] [INFO ] [MAIN ] LLY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:29.323192] [DEBUG] [LOCAL ] LITB: Loaded 2344 existing records from primary storage. [2025-09-16T21:17:29.323368] [INFO ] [MAIN ] LITB: Loaded 2344 primary data records. [2025-09-16T21:17:29.619933] [DEBUG] [LOCAL ] LMND: Loaded 38824 existing records from primary storage. [2025-09-16T21:17:29.620223] [INFO ] [MAIN ] LMND: Loaded 38824 primary data records. [2025-09-16T21:17:29.734997] [DEBUG] [LOCAL ] LLY: Loaded 39727 existing records from primary storage. [2025-09-16T21:17:29.738327] [INFO ] [MAIN ] LLY: Loaded 39727 primary data records. [2025-09-16T21:17:30.237593] [DEBUG] [MAIN ] LITB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:30.238667] [INFO ] [MAIN ] LITB: Generated 1339 derivative records from 2344 primary records. [2025-09-16T21:17:30.239086] [DEBUG] [LOCAL ] LITB: Saving derivative data. [2025-09-16T21:17:30.251514] [DEBUG] [LOCAL ] LITB: Derivative data saved (1339 records). [2025-09-16T21:17:30.251840] [INFO ] [MAIN ] LITB: Successfully saved derivative data. [2025-09-16T21:17:30.253730] [INFO ] [MAIN ] Derivative Progress: 1036/2026 symbols completed. LITB took 0.9s. Estimated remaining: 5m 23s. Rate: 183.7 symbols/min [2025-09-16T21:17:30.254591] [INFO ] [MAIN ] LMT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:30.269130] [DEBUG] [MAIN ] LMND: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:30.269845] [INFO ] [MAIN ] LMND: Generated 1339 derivative records from 38824 primary records. [2025-09-16T21:17:30.270066] [DEBUG] [LOCAL ] LMND: Saving derivative data. [2025-09-16T21:17:30.295321] [DEBUG] [MAIN ] LLY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:30.294989] [DEBUG] [LOCAL ] LMND: Derivative data saved (1339 records). [2025-09-16T21:17:30.295496] [INFO ] [MAIN ] LMND: Successfully saved derivative data. [2025-09-16T21:17:30.298012] [INFO ] [MAIN ] Derivative Progress: 1037/2026 symbols completed. LMND took 1.0s. Estimated remaining: 5m 23s. Rate: 183.8 symbols/min [2025-09-16T21:17:30.296233] [INFO ] [MAIN ] LLY: Generated 1339 derivative records from 39727 primary records. [2025-09-16T21:17:30.298377] [INFO ] [MAIN ] LNC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:30.298553] [DEBUG] [LOCAL ] LLY: Saving derivative data. [2025-09-16T21:17:30.322343] [DEBUG] [LOCAL ] LLY: Derivative data saved (1339 records). [2025-09-16T21:17:30.322501] [INFO ] [MAIN ] LLY: Successfully saved derivative data. [2025-09-16T21:17:30.324501] [INFO ] [MAIN ] Derivative Progress: 1038/2026 symbols completed. LLY took 1.0s. Estimated remaining: 5m 22s. Rate: 184.0 symbols/min [2025-09-16T21:17:30.326015] [INFO ] [MAIN ] LND: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:30.341064] [DEBUG] [LOCAL ] LMT: Loaded 37058 existing records from primary storage. [2025-09-16T21:17:30.342313] [INFO ] [MAIN ] LMT: Loaded 37058 primary data records. [2025-09-16T21:17:30.421856] [DEBUG] [LOCAL ] LND: Loaded 3632 existing records from primary storage. [2025-09-16T21:17:30.434459] [INFO ] [MAIN ] LND: Loaded 3632 primary data records. [2025-09-16T21:17:30.584000] [DEBUG] [LOCAL ] LNC: Loaded 38332 existing records from primary storage. [2025-09-16T21:17:30.645503] [INFO ] [MAIN ] LNC: Loaded 38332 primary data records. [2025-09-16T21:17:31.232959] [DEBUG] [MAIN ] LMT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:31.235533] [INFO ] [MAIN ] LMT: Generated 1339 derivative records from 37058 primary records. [2025-09-16T21:17:31.236103] [DEBUG] [LOCAL ] LMT: Saving derivative data. [2025-09-16T21:17:31.258528] [DEBUG] [LOCAL ] LMT: Derivative data saved (1339 records). [2025-09-16T21:17:31.258867] [INFO ] [MAIN ] LMT: Successfully saved derivative data. [2025-09-16T21:17:31.260570] [INFO ] [MAIN ] Derivative Progress: 1039/2026 symbols completed. LMT took 1.0s. Estimated remaining: 5m 22s. Rate: 183.7 symbols/min [2025-09-16T21:17:31.261939] [DEBUG] [MAIN ] LND: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:31.262343] [INFO ] [MAIN ] LNN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:31.263981] [INFO ] [MAIN ] LND: Generated 1339 derivative records from 3632 primary records. [2025-09-16T21:17:31.264096] [DEBUG] [LOCAL ] LND: Saving derivative data. [2025-09-16T21:17:31.286917] [DEBUG] [LOCAL ] LND: Derivative data saved (1339 records). [2025-09-16T21:17:31.289911] [INFO ] [MAIN ] LND: Successfully saved derivative data. [2025-09-16T21:17:31.285220] [DEBUG] [MAIN ] LNC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:31.291904] [INFO ] [MAIN ] Derivative Progress: 1040/2026 symbols completed. LND took 1.0s. Estimated remaining: 5m 22s. Rate: 183.8 symbols/min [2025-09-16T21:17:31.292663] [INFO ] [MAIN ] LNC: Generated 1339 derivative records from 38332 primary records. [2025-09-16T21:17:31.292797] [DEBUG] [LOCAL ] LNC: Saving derivative data. [2025-09-16T21:17:31.293073] [INFO ] [MAIN ] LOAR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:31.311435] [DEBUG] [LOCAL ] LNC: Derivative data saved (1339 records). [2025-09-16T21:17:31.311579] [INFO ] [MAIN ] LNC: Successfully saved derivative data. [2025-09-16T21:17:31.313434] [INFO ] [MAIN ] Derivative Progress: 1041/2026 symbols completed. LNC took 1.0s. Estimated remaining: 5m 21s. Rate: 184.0 symbols/min [2025-09-16T21:17:31.314046] [DEBUG] [LOCAL ] LNN: Loaded 8163 existing records from primary storage. [2025-09-16T21:17:31.314510] [INFO ] [MAIN ] LOB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:31.314614] [INFO ] [MAIN ] LNN: Loaded 8163 primary data records. [2025-09-16T21:17:31.476303] [DEBUG] [LOCAL ] LOB: Loaded 19344 existing records from primary storage. [2025-09-16T21:17:31.520921] [INFO ] [MAIN ] LOB: Loaded 19344 primary data records. [2025-09-16T21:17:31.521954] [DEBUG] [LOCAL ] LOAR: Loaded 32474 existing records from primary storage. [2025-09-16T21:17:31.546896] [INFO ] [MAIN ] LOAR: Loaded 32474 primary data records. [2025-09-16T21:17:32.253153] [DEBUG] [MAIN ] LNN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:32.264508] [INFO ] [MAIN ] LNN: Generated 1339 derivative records from 8163 primary records. [2025-09-16T21:17:32.264956] [DEBUG] [MAIN ] LOB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:32.265453] [DEBUG] [LOCAL ] LNN: Saving derivative data. [2025-09-16T21:17:32.267260] [INFO ] [MAIN ] LOB: Generated 1339 derivative records from 19344 primary records. [2025-09-16T21:17:32.267442] [DEBUG] [LOCAL ] LOB: Saving derivative data. [2025-09-16T21:17:32.300696] [DEBUG] [LOCAL ] LOB: Derivative data saved (1339 records). [2025-09-16T21:17:32.300982] [INFO ] [MAIN ] LOB: Successfully saved derivative data. [2025-09-16T21:17:32.299229] [DEBUG] [LOCAL ] LNN: Derivative data saved (1339 records). [2025-09-16T21:17:32.306979] [INFO ] [MAIN ] LNN: Successfully saved derivative data. [2025-09-16T21:17:32.311059] [DEBUG] [MAIN ] LOAR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:32.313058] [INFO ] [MAIN ] Derivative Progress: 1042/2026 symbols completed. LOB took 1.0s. Estimated remaining: 5m 22s. Rate: 183.6 symbols/min [2025-09-16T21:17:32.315151] [INFO ] [MAIN ] LOCL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:32.315909] [INFO ] [MAIN ] LOAR: Generated 1339 derivative records from 32474 primary records. [2025-09-16T21:17:32.316033] [DEBUG] [LOCAL ] LOAR: Saving derivative data. [2025-09-16T21:17:32.316988] [INFO ] [MAIN ] Derivative Progress: 1043/2026 symbols completed. LNN took 1.1s. Estimated remaining: 5m 21s. Rate: 183.8 symbols/min [2025-09-16T21:17:32.326885] [INFO ] [MAIN ] LOMA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:32.329825] [DEBUG] [LOCAL ] LOCL: Loaded 1993 existing records from primary storage. [2025-09-16T21:17:32.331104] [INFO ] [MAIN ] LOCL: Loaded 1993 primary data records. [2025-09-16T21:17:32.376822] [DEBUG] [LOCAL ] LOAR: Derivative data saved (1339 records). [2025-09-16T21:17:32.409421] [INFO ] [MAIN ] LOAR: Successfully saved derivative data. [2025-09-16T21:17:32.438396] [INFO ] [MAIN ] Derivative Progress: 1044/2026 symbols completed. LOAR took 1.1s. Estimated remaining: 5m 20s. Rate: 183.9 symbols/min [2025-09-16T21:17:32.438826] [INFO ] [MAIN ] LOW: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:32.619062] [DEBUG] [LOCAL ] LOMA: Loaded 23279 existing records from primary storage. [2025-09-16T21:17:32.619781] [INFO ] [MAIN ] LOMA: Loaded 23279 primary data records. [2025-09-16T21:17:32.905870] [DEBUG] [LOCAL ] LOW: Loaded 39480 existing records from primary storage. [2025-09-16T21:17:32.906391] [INFO ] [MAIN ] LOW: Loaded 39480 primary data records. [2025-09-16T21:17:33.181525] [DEBUG] [MAIN ] LOCL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:33.193625] [INFO ] [MAIN ] LOCL: Generated 1339 derivative records from 1993 primary records. [2025-09-16T21:17:33.194013] [DEBUG] [LOCAL ] LOCL: Saving derivative data. [2025-09-16T21:17:33.210871] [DEBUG] [LOCAL ] LOCL: Derivative data saved (1339 records). [2025-09-16T21:17:33.211775] [INFO ] [MAIN ] LOCL: Successfully saved derivative data. [2025-09-16T21:17:33.213725] [INFO ] [MAIN ] Derivative Progress: 1045/2026 symbols completed. LOCL took 0.9s. Estimated remaining: 5m 20s. Rate: 183.7 symbols/min [2025-09-16T21:17:33.225636] [INFO ] [MAIN ] LPG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:33.225419] [DEBUG] [MAIN ] LOMA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:33.226917] [INFO ] [MAIN ] LOMA: Generated 1339 derivative records from 23279 primary records. [2025-09-16T21:17:33.227213] [DEBUG] [LOCAL ] LOMA: Saving derivative data. [2025-09-16T21:17:33.246357] [DEBUG] [LOCAL ] LOMA: Derivative data saved (1339 records). [2025-09-16T21:17:33.246612] [INFO ] [MAIN ] LOMA: Successfully saved derivative data. [2025-09-16T21:17:33.249124] [INFO ] [MAIN ] Derivative Progress: 1046/2026 symbols completed. LOMA took 0.9s. Estimated remaining: 5m 20s. Rate: 183.8 symbols/min [2025-09-16T21:17:33.259747] [DEBUG] [MAIN ] LOW: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:33.259852] [INFO ] [MAIN ] LPL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:33.268543] [INFO ] [MAIN ] LOW: Generated 1339 derivative records from 39480 primary records. [2025-09-16T21:17:33.268738] [DEBUG] [LOCAL ] LOW: Saving derivative data. [2025-09-16T21:17:33.291315] [DEBUG] [LOCAL ] LPG: Loaded 29760 existing records from primary storage. [2025-09-16T21:17:33.291815] [INFO ] [MAIN ] LPG: Loaded 29760 primary data records. [2025-09-16T21:17:33.291870] [DEBUG] [LOCAL ] LOW: Derivative data saved (1339 records). [2025-09-16T21:17:33.292039] [INFO ] [MAIN ] LOW: Successfully saved derivative data. [2025-09-16T21:17:33.330290] [INFO ] [MAIN ] Derivative Progress: 1047/2026 symbols completed. LOW took 0.9s. Estimated remaining: 5m 19s. Rate: 183.9 symbols/min [2025-09-16T21:17:33.368612] [INFO ] [MAIN ] LPX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:33.436105] [DEBUG] [LOCAL ] LPL: Loaded 19329 existing records from primary storage. [2025-09-16T21:17:33.450095] [INFO ] [MAIN ] LPL: Loaded 19329 primary data records. [2025-09-16T21:17:33.707218] [DEBUG] [LOCAL ] LPX: Loaded 29644 existing records from primary storage. [2025-09-16T21:17:33.718366] [INFO ] [MAIN ] LPX: Loaded 29644 primary data records. [2025-09-16T21:17:34.133544] [DEBUG] [MAIN ] LPG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:34.134400] [INFO ] [MAIN ] LPG: Generated 1339 derivative records from 29760 primary records. [2025-09-16T21:17:34.135378] [DEBUG] [LOCAL ] LPG: Saving derivative data. [2025-09-16T21:17:34.159506] [DEBUG] [MAIN ] LPL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:34.159288] [DEBUG] [LOCAL ] LPG: Derivative data saved (1339 records). [2025-09-16T21:17:34.159748] [INFO ] [MAIN ] LPG: Successfully saved derivative data. [2025-09-16T21:17:34.160303] [INFO ] [MAIN ] LPL: Generated 1339 derivative records from 19329 primary records. [2025-09-16T21:17:34.163259] [INFO ] [MAIN ] Derivative Progress: 1048/2026 symbols completed. LPG took 0.9s. Estimated remaining: 5m 19s. Rate: 183.7 symbols/min [2025-09-16T21:17:34.160958] [DEBUG] [LOCAL ] LPL: Saving derivative data. [2025-09-16T21:17:34.180496] [DEBUG] [MAIN ] LPX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:34.183010] [INFO ] [MAIN ] LPX: Generated 1339 derivative records from 29644 primary records. [2025-09-16T21:17:34.184613] [DEBUG] [LOCAL ] LPX: Saving derivative data. [2025-09-16T21:17:34.191834] [DEBUG] [LOCAL ] LPL: Derivative data saved (1339 records). [2025-09-16T21:17:34.194390] [INFO ] [MAIN ] LPL: Successfully saved derivative data. [2025-09-16T21:17:34.197253] [INFO ] [MAIN ] Derivative Progress: 1049/2026 symbols completed. LPL took 0.9s. Estimated remaining: 5m 19s. Rate: 183.8 symbols/min [2025-09-16T21:17:34.198950] [DEBUG] [LOCAL ] LPX: Derivative data saved (1339 records). [2025-09-16T21:17:34.199009] [INFO ] [MAIN ] LPX: Successfully saved derivative data. [2025-09-16T21:17:34.200920] [INFO ] [MAIN ] Derivative Progress: 1050/2026 symbols completed. LPX took 0.8s. Estimated remaining: 5m 18s. Rate: 184.0 symbols/min [2025-09-16T21:17:34.201388] [INFO ] [MAIN ] LTH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:34.201441] [INFO ] [MAIN ] LTC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:34.201265] [INFO ] [MAIN ] LSPD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:34.225552] [DEBUG] [LOCAL ] LTC: Loaded 22342 existing records from primary storage. [2025-09-16T21:17:34.240000] [INFO ] [MAIN ] LTC: Loaded 22342 primary data records. [2025-09-16T21:17:34.372149] [DEBUG] [LOCAL ] LSPD: Loaded 31234 existing records from primary storage. [2025-09-16T21:17:34.372077] [DEBUG] [LOCAL ] LTH: Loaded 38610 existing records from primary storage. [2025-09-16T21:17:34.382892] [INFO ] [MAIN ] LSPD: Loaded 31234 primary data records. [2025-09-16T21:17:34.377755] [INFO ] [MAIN ] LTH: Loaded 38610 primary data records. [2025-09-16T21:17:35.117438] [DEBUG] [MAIN ] LTC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:35.118268] [INFO ] [MAIN ] LTC: Generated 1339 derivative records from 22342 primary records. [2025-09-16T21:17:35.118509] [DEBUG] [LOCAL ] LTC: Saving derivative data. [2025-09-16T21:17:35.133620] [DEBUG] [LOCAL ] LTC: Derivative data saved (1339 records). [2025-09-16T21:17:35.133876] [INFO ] [MAIN ] LTC: Successfully saved derivative data. [2025-09-16T21:17:35.135490] [INFO ] [MAIN ] Derivative Progress: 1051/2026 symbols completed. LTC took 0.9s. Estimated remaining: 5m 18s. Rate: 183.7 symbols/min [2025-09-16T21:17:35.150323] [INFO ] [MAIN ] LTM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:35.154107] [DEBUG] [MAIN ] LTH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:35.155137] [INFO ] [MAIN ] LTH: Generated 1339 derivative records from 38610 primary records. [2025-09-16T21:17:35.154549] [DEBUG] [MAIN ] LSPD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:35.155948] [INFO ] [MAIN ] LSPD: Generated 1339 derivative records from 31234 primary records. [2025-09-16T21:17:35.155435] [DEBUG] [LOCAL ] LTH: Saving derivative data. [2025-09-16T21:17:35.156132] [DEBUG] [LOCAL ] LSPD: Saving derivative data. [2025-09-16T21:17:35.179071] [DEBUG] [LOCAL ] LTH: Derivative data saved (1339 records). [2025-09-16T21:17:35.180424] [DEBUG] [LOCAL ] LSPD: Derivative data saved (1339 records). [2025-09-16T21:17:35.180379] [INFO ] [MAIN ] LTH: Successfully saved derivative data. [2025-09-16T21:17:35.180498] [INFO ] [MAIN ] LSPD: Successfully saved derivative data. [2025-09-16T21:17:35.183464] [INFO ] [MAIN ] Derivative Progress: 1052/2026 symbols completed. LTH took 1.0s. Estimated remaining: 5m 18s. Rate: 183.8 symbols/min [2025-09-16T21:17:35.193190] [INFO ] [MAIN ] LU: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:35.193041] [INFO ] [MAIN ] Derivative Progress: 1053/2026 symbols completed. LSPD took 1.0s. Estimated remaining: 5m 17s. Rate: 184.0 symbols/min [2025-09-16T21:17:35.193430] [INFO ] [MAIN ] LUCK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:35.205358] [DEBUG] [LOCAL ] LTM: Loaded 28294 existing records from primary storage. [2025-09-16T21:17:35.205500] [INFO ] [MAIN ] LTM: Loaded 28294 primary data records. [2025-09-16T21:17:35.363395] [DEBUG] [LOCAL ] LUCK: Loaded 17666 existing records from primary storage. [2025-09-16T21:17:35.386524] [INFO ] [MAIN ] LUCK: Loaded 17666 primary data records. [2025-09-16T21:17:35.589754] [DEBUG] [LOCAL ] LU: Loaded 36575 existing records from primary storage. [2025-09-16T21:17:35.609214] [INFO ] [MAIN ] LU: Loaded 36575 primary data records. [2025-09-16T21:17:36.053983] [DEBUG] [MAIN ] LTM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:36.055201] [INFO ] [MAIN ] LTM: Generated 1339 derivative records from 28294 primary records. [2025-09-16T21:17:36.057194] [DEBUG] [LOCAL ] LTM: Saving derivative data. [2025-09-16T21:17:36.076219] [DEBUG] [MAIN ] LUCK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:36.078520] [INFO ] [MAIN ] LUCK: Generated 1339 derivative records from 17666 primary records. [2025-09-16T21:17:36.078868] [DEBUG] [LOCAL ] LUCK: Saving derivative data. [2025-09-16T21:17:36.079905] [DEBUG] [LOCAL ] LTM: Derivative data saved (1339 records). [2025-09-16T21:17:36.080527] [INFO ] [MAIN ] LTM: Successfully saved derivative data. [2025-09-16T21:17:36.082413] [INFO ] [MAIN ] Derivative Progress: 1054/2026 symbols completed. LTM took 0.9s. Estimated remaining: 5m 17s. Rate: 183.7 symbols/min [2025-09-16T21:17:36.088383] [INFO ] [MAIN ] LUMN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:36.096575] [DEBUG] [LOCAL ] LUCK: Derivative data saved (1339 records). [2025-09-16T21:17:36.096849] [INFO ] [MAIN ] LUCK: Successfully saved derivative data. [2025-09-16T21:17:36.098547] [INFO ] [MAIN ] Derivative Progress: 1055/2026 symbols completed. LUCK took 0.9s. Estimated remaining: 5m 17s. Rate: 183.9 symbols/min [2025-09-16T21:17:36.098842] [INFO ] [MAIN ] LUV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:36.108863] [DEBUG] [MAIN ] LU: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:36.109560] [INFO ] [MAIN ] LU: Generated 1339 derivative records from 36575 primary records. [2025-09-16T21:17:36.109748] [DEBUG] [LOCAL ] LU: Saving derivative data. [2025-09-16T21:17:36.123455] [DEBUG] [LOCAL ] LU: Derivative data saved (1339 records). [2025-09-16T21:17:36.123591] [INFO ] [MAIN ] LU: Successfully saved derivative data. [2025-09-16T21:17:36.125484] [INFO ] [MAIN ] Derivative Progress: 1056/2026 symbols completed. LU took 0.9s. Estimated remaining: 5m 16s. Rate: 184.0 symbols/min [2025-09-16T21:17:36.125712] [INFO ] [MAIN ] LVS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:36.163817] [DEBUG] [LOCAL ] LUMN: Loaded 40009 existing records from primary storage. [2025-09-16T21:17:36.164142] [INFO ] [MAIN ] LUMN: Loaded 40009 primary data records. [2025-09-16T21:17:36.287621] [DEBUG] [LOCAL ] LUV: Loaded 40039 existing records from primary storage. [2025-09-16T21:17:36.288572] [INFO ] [MAIN ] LUV: Loaded 40039 primary data records. [2025-09-16T21:17:36.439570] [DEBUG] [LOCAL ] LVS: Loaded 39929 existing records from primary storage. [2025-09-16T21:17:36.547414] [INFO ] [MAIN ] LVS: Loaded 39929 primary data records. [2025-09-16T21:17:37.039369] [DEBUG] [MAIN ] LUMN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:37.040986] [INFO ] [MAIN ] LUMN: Generated 1339 derivative records from 40009 primary records. [2025-09-16T21:17:37.041377] [DEBUG] [LOCAL ] LUMN: Saving derivative data. [2025-09-16T21:17:37.067629] [DEBUG] [LOCAL ] LUMN: Derivative data saved (1339 records). [2025-09-16T21:17:37.066183] [DEBUG] [MAIN ] LUV: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:37.068375] [INFO ] [MAIN ] LUV: Generated 1339 derivative records from 40039 primary records. [2025-09-16T21:17:37.068626] [DEBUG] [LOCAL ] LUV: Saving derivative data. [2025-09-16T21:17:37.068576] [INFO ] [MAIN ] LUMN: Successfully saved derivative data. [2025-09-16T21:17:37.071225] [INFO ] [MAIN ] Derivative Progress: 1057/2026 symbols completed. LUMN took 1.0s. Estimated remaining: 5m 17s. Rate: 183.7 symbols/min [2025-09-16T21:17:37.071917] [INFO ] [MAIN ] LW: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:37.085095] [DEBUG] [LOCAL ] LUV: Derivative data saved (1339 records). [2025-09-16T21:17:37.086467] [INFO ] [MAIN ] LUV: Successfully saved derivative data. [2025-09-16T21:17:37.089501] [INFO ] [MAIN ] Derivative Progress: 1058/2026 symbols completed. LUV took 1.0s. Estimated remaining: 5m 16s. Rate: 183.9 symbols/min [2025-09-16T21:17:37.090510] [INFO ] [MAIN ] LXFR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:37.102202] [DEBUG] [MAIN ] LVS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:37.103028] [INFO ] [MAIN ] LVS: Generated 1339 derivative records from 39929 primary records. [2025-09-16T21:17:37.103175] [DEBUG] [LOCAL ] LVS: Saving derivative data. [2025-09-16T21:17:37.121885] [DEBUG] [LOCAL ] LVS: Derivative data saved (1339 records). [2025-09-16T21:17:37.126758] [DEBUG] [LOCAL ] LXFR: Loaded 12410 existing records from primary storage. [2025-09-16T21:17:37.126931] [INFO ] [MAIN ] LXFR: Loaded 12410 primary data records. [2025-09-16T21:17:37.127052] [INFO ] [MAIN ] LVS: Successfully saved derivative data. [2025-09-16T21:17:37.160083] [INFO ] [MAIN ] Derivative Progress: 1059/2026 symbols completed. LVS took 1.0s. Estimated remaining: 5m 15s. Rate: 184.0 symbols/min [2025-09-16T21:17:37.231327] [INFO ] [MAIN ] LXP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:37.275313] [DEBUG] [LOCAL ] LW: Loaded 37983 existing records from primary storage. [2025-09-16T21:17:37.307991] [INFO ] [MAIN ] LW: Loaded 37983 primary data records. [2025-09-16T21:17:37.624626] [DEBUG] [LOCAL ] LXP: Loaded 37755 existing records from primary storage. [2025-09-16T21:17:37.624936] [INFO ] [MAIN ] LXP: Loaded 37755 primary data records. [2025-09-16T21:17:37.905130] [DEBUG] [MAIN ] LXFR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:38.005419] [INFO ] [MAIN ] LXFR: Generated 1339 derivative records from 12410 primary records. [2025-09-16T21:17:38.006060] [DEBUG] [LOCAL ] LXFR: Saving derivative data. [2025-09-16T21:17:38.020195] [DEBUG] [LOCAL ] LXFR: Derivative data saved (1339 records). [2025-09-16T21:17:38.020517] [INFO ] [MAIN ] LXFR: Successfully saved derivative data. [2025-09-16T21:17:38.022155] [INFO ] [MAIN ] Derivative Progress: 1060/2026 symbols completed. LXFR took 0.9s. Estimated remaining: 5m 16s. Rate: 183.7 symbols/min [2025-09-16T21:17:38.023834] [INFO ] [MAIN ] LXU: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:38.035171] [DEBUG] [MAIN ] LW: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:38.035901] [INFO ] [MAIN ] LW: Generated 1339 derivative records from 37983 primary records. [2025-09-16T21:17:38.036882] [DEBUG] [LOCAL ] LW: Saving derivative data. [2025-09-16T21:17:38.049727] [DEBUG] [LOCAL ] LW: Derivative data saved (1339 records). [2025-09-16T21:17:38.049799] [INFO ] [MAIN ] LW: Successfully saved derivative data. [2025-09-16T21:17:38.051617] [INFO ] [MAIN ] Derivative Progress: 1061/2026 symbols completed. LW took 1.0s. Estimated remaining: 5m 15s. Rate: 183.9 symbols/min [2025-09-16T21:17:38.052063] [INFO ] [MAIN ] LYB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:38.078134] [DEBUG] [LOCAL ] LXU: Loaded 23663 existing records from primary storage. [2025-09-16T21:17:38.078452] [DEBUG] [MAIN ] LXP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:38.079142] [INFO ] [MAIN ] LXU: Loaded 23663 primary data records. [2025-09-16T21:17:38.079091] [INFO ] [MAIN ] LXP: Generated 1339 derivative records from 37755 primary records. [2025-09-16T21:17:38.099870] [DEBUG] [LOCAL ] LXP: Saving derivative data. [2025-09-16T21:17:38.272826] [DEBUG] [LOCAL ] LXP: Derivative data saved (1339 records). [2025-09-16T21:17:38.370428] [INFO ] [MAIN ] LXP: Successfully saved derivative data. [2025-09-16T21:17:38.374637] [INFO ] [MAIN ] Derivative Progress: 1062/2026 symbols completed. LXP took 1.2s. Estimated remaining: 5m 15s. Rate: 183.9 symbols/min [2025-09-16T21:17:38.375951] [DEBUG] [LOCAL ] LYB: Loaded 39975 existing records from primary storage. [2025-09-16T21:17:38.375005] [INFO ] [MAIN ] LYG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:38.376343] [INFO ] [MAIN ] LYB: Loaded 39975 primary data records. [2025-09-16T21:17:38.693769] [DEBUG] [MAIN ] LXU: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:38.693474] [DEBUG] [LOCAL ] LYG: Loaded 39363 existing records from primary storage. [2025-09-16T21:17:38.695446] [INFO ] [MAIN ] LYG: Loaded 39363 primary data records. [2025-09-16T21:17:38.694916] [INFO ] [MAIN ] LXU: Generated 1339 derivative records from 23663 primary records. [2025-09-16T21:17:38.695828] [DEBUG] [LOCAL ] LXU: Saving derivative data. [2025-09-16T21:17:38.794578] [DEBUG] [LOCAL ] LXU: Derivative data saved (1339 records). [2025-09-16T21:17:38.808189] [INFO ] [MAIN ] LXU: Successfully saved derivative data. [2025-09-16T21:17:38.813783] [INFO ] [MAIN ] Derivative Progress: 1063/2026 symbols completed. LXU took 0.8s. Estimated remaining: 5m 14s. Rate: 183.8 symbols/min [2025-09-16T21:17:39.015213] [DEBUG] [MAIN ] LYB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:39.015951] [INFO ] [MAIN ] LYB: Generated 1339 derivative records from 39975 primary records. [2025-09-16T21:17:39.016093] [DEBUG] [LOCAL ] LYB: Saving derivative data. [2025-09-16T21:17:39.029453] [DEBUG] [LOCAL ] LYB: Derivative data saved (1339 records). [2025-09-16T21:17:39.029627] [INFO ] [MAIN ] LYB: Successfully saved derivative data. [2025-09-16T21:17:39.032019] [INFO ] [MAIN ] Derivative Progress: 1064/2026 symbols completed. LYB took 1.0s. Estimated remaining: 5m 14s. Rate: 183.9 symbols/min [2025-09-16T21:17:39.046853] [DEBUG] [MAIN ] LYG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:39.047372] [INFO ] [MAIN ] LYG: Generated 1339 derivative records from 39363 primary records. [2025-09-16T21:17:39.047437] [DEBUG] [LOCAL ] LYG: Saving derivative data. [2025-09-16T21:17:39.058603] [DEBUG] [LOCAL ] LYG: Derivative data saved (1339 records). [2025-09-16T21:17:39.058674] [INFO ] [MAIN ] LYG: Successfully saved derivative data. [2025-09-16T21:17:39.060437] [INFO ] [MAIN ] Derivative Progress: 1065/2026 symbols completed. LYG took 0.7s. Estimated remaining: 5m 13s. Rate: 184.0 symbols/min [2025-09-16T21:17:39.060889] [INFO ] [MAIN ] LZM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:39.060975] [INFO ] [MAIN ] LZB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:39.061660] [INFO ] [MAIN ] LYV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:39.071874] [DEBUG] [LOCAL ] LZM: Loaded 8881 existing records from primary storage. [2025-09-16T21:17:39.072070] [INFO ] [MAIN ] LZM: Loaded 8881 primary data records. [2025-09-16T21:17:39.281065] [DEBUG] [LOCAL ] LZB: Loaded 26279 existing records from primary storage. [2025-09-16T21:17:39.371384] [INFO ] [MAIN ] LZB: Loaded 26279 primary data records. [2025-09-16T21:17:39.404726] [DEBUG] [LOCAL ] LYV: Loaded 37955 existing records from primary storage. [2025-09-16T21:17:39.439179] [INFO ] [MAIN ] LYV: Loaded 37955 primary data records. [2025-09-16T21:17:39.915238] [DEBUG] [MAIN ] LZM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:39.916165] [INFO ] [MAIN ] LZM: Generated 1339 derivative records from 8881 primary records. [2025-09-16T21:17:39.916825] [DEBUG] [LOCAL ] LZM: Saving derivative data. [2025-09-16T21:17:39.929555] [DEBUG] [LOCAL ] LZM: Derivative data saved (1339 records). [2025-09-16T21:17:39.929688] [INFO ] [MAIN ] LZM: Successfully saved derivative data. [2025-09-16T21:17:39.932391] [INFO ] [MAIN ] Derivative Progress: 1066/2026 symbols completed. LZM took 0.9s. Estimated remaining: 5m 14s. Rate: 183.7 symbols/min [2025-09-16T21:17:39.932868] [INFO ] [MAIN ] M: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:39.945408] [DEBUG] [MAIN ] LZB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:39.946040] [INFO ] [MAIN ] LZB: Generated 1339 derivative records from 26279 primary records. [2025-09-16T21:17:39.946251] [DEBUG] [LOCAL ] LZB: Saving derivative data. [2025-09-16T21:17:39.962356] [DEBUG] [LOCAL ] LZB: Derivative data saved (1339 records). [2025-09-16T21:17:39.962619] [INFO ] [MAIN ] LZB: Successfully saved derivative data. [2025-09-16T21:17:39.964453] [INFO ] [MAIN ] Derivative Progress: 1067/2026 symbols completed. LZB took 0.9s. Estimated remaining: 5m 13s. Rate: 183.9 symbols/min [2025-09-16T21:17:39.973697] [INFO ] [MAIN ] MA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:39.974622] [DEBUG] [MAIN ] LYV: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:39.975326] [INFO ] [MAIN ] LYV: Generated 1339 derivative records from 37955 primary records. [2025-09-16T21:17:39.984416] [DEBUG] [LOCAL ] LYV: Saving derivative data. [2025-09-16T21:17:39.996486] [DEBUG] [LOCAL ] LYV: Derivative data saved (1339 records). [2025-09-16T21:17:39.996583] [INFO ] [MAIN ] LYV: Successfully saved derivative data. [2025-09-16T21:17:39.998606] [INFO ] [MAIN ] Derivative Progress: 1068/2026 symbols completed. LYV took 0.9s. Estimated remaining: 5m 12s. Rate: 184.0 symbols/min [2025-09-16T21:17:39.998906] [INFO ] [MAIN ] MAA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:40.012346] [DEBUG] [LOCAL ] M: Loaded 39907 existing records from primary storage. [2025-09-16T21:17:40.012538] [INFO ] [MAIN ] M: Loaded 39907 primary data records. [2025-09-16T21:17:40.194009] [DEBUG] [LOCAL ] MA: Loaded 39040 existing records from primary storage. [2025-09-16T21:17:40.224154] [INFO ] [MAIN ] MA: Loaded 39040 primary data records. [2025-09-16T21:17:40.396130] [DEBUG] [LOCAL ] MAA: Loaded 31954 existing records from primary storage. [2025-09-16T21:17:40.407037] [INFO ] [MAIN ] MAA: Loaded 31954 primary data records. [2025-09-16T21:17:40.851631] [DEBUG] [MAIN ] M: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:40.852789] [INFO ] [MAIN ] M: Generated 1339 derivative records from 39907 primary records. [2025-09-16T21:17:40.853400] [DEBUG] [LOCAL ] M: Saving derivative data. [2025-09-16T21:17:40.866898] [DEBUG] [LOCAL ] M: Derivative data saved (1339 records). [2025-09-16T21:17:40.868770] [INFO ] [MAIN ] M: Successfully saved derivative data. [2025-09-16T21:17:40.871028] [INFO ] [MAIN ] Derivative Progress: 1069/2026 symbols completed. M took 0.9s. Estimated remaining: 5m 12s. Rate: 183.8 symbols/min [2025-09-16T21:17:40.871571] [INFO ] [MAIN ] MAC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:40.896260] [DEBUG] [MAIN ] MAA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:40.896559] [DEBUG] [MAIN ] MA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:40.897240] [INFO ] [MAIN ] MAA: Generated 1339 derivative records from 31954 primary records. [2025-09-16T21:17:40.897941] [DEBUG] [LOCAL ] MAA: Saving derivative data. [2025-09-16T21:17:40.897829] [INFO ] [MAIN ] MA: Generated 1339 derivative records from 39040 primary records. [2025-09-16T21:17:40.898737] [DEBUG] [LOCAL ] MA: Saving derivative data. [2025-09-16T21:17:40.916916] [DEBUG] [LOCAL ] MAA: Derivative data saved (1339 records). [2025-09-16T21:17:40.920354] [INFO ] [MAIN ] MAA: Successfully saved derivative data. [2025-09-16T21:17:40.922900] [INFO ] [MAIN ] Derivative Progress: 1070/2026 symbols completed. MAA took 0.9s. Estimated remaining: 5m 12s. Rate: 183.9 symbols/min [2025-09-16T21:17:40.924363] [INFO ] [MAIN ] MAGN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:40.927063] [DEBUG] [LOCAL ] MA: Derivative data saved (1339 records). [2025-09-16T21:17:40.927211] [INFO ] [MAIN ] MA: Successfully saved derivative data. [2025-09-16T21:17:40.929467] [INFO ] [MAIN ] Derivative Progress: 1071/2026 symbols completed. MA took 1.0s. Estimated remaining: 5m 11s. Rate: 184.1 symbols/min [2025-09-16T21:17:40.929833] [INFO ] [MAIN ] MAIN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:40.960608] [DEBUG] [LOCAL ] MAGN: Loaded 26255 existing records from primary storage. [2025-09-16T21:17:40.971006] [INFO ] [MAIN ] MAGN: Loaded 26255 primary data records. [2025-09-16T21:17:41.036063] [DEBUG] [LOCAL ] MAC: Loaded 36799 existing records from primary storage. [2025-09-16T21:17:41.067225] [INFO ] [MAIN ] MAC: Loaded 36799 primary data records. [2025-09-16T21:17:41.169391] [DEBUG] [LOCAL ] MAIN: Loaded 30668 existing records from primary storage. [2025-09-16T21:17:41.224808] [INFO ] [MAIN ] MAIN: Loaded 30668 primary data records. [2025-09-16T21:17:41.854096] [DEBUG] [MAIN ] MAGN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:41.864334] [INFO ] [MAIN ] MAGN: Generated 1339 derivative records from 26255 primary records. [2025-09-16T21:17:41.864844] [DEBUG] [LOCAL ] MAGN: Saving derivative data. [2025-09-16T21:17:41.865320] [DEBUG] [MAIN ] MAC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:41.873198] [INFO ] [MAIN ] MAC: Generated 1339 derivative records from 36799 primary records. [2025-09-16T21:17:41.874151] [DEBUG] [LOCAL ] MAC: Saving derivative data. [2025-09-16T21:17:41.887701] [DEBUG] [LOCAL ] MAGN: Derivative data saved (1339 records). [2025-09-16T21:17:41.887924] [INFO ] [MAIN ] MAGN: Successfully saved derivative data. [2025-09-16T21:17:41.891487] [INFO ] [MAIN ] Derivative Progress: 1072/2026 symbols completed. MAGN took 1.0s. Estimated remaining: 5m 12s. Rate: 183.7 symbols/min [2025-09-16T21:17:41.893497] [INFO ] [MAIN ] MAN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:41.894731] [DEBUG] [LOCAL ] MAC: Derivative data saved (1339 records). [2025-09-16T21:17:41.901000] [INFO ] [MAIN ] MAC: Successfully saved derivative data. [2025-09-16T21:17:41.907030] [INFO ] [MAIN ] Derivative Progress: 1073/2026 symbols completed. MAC took 1.0s. Estimated remaining: 5m 11s. Rate: 183.9 symbols/min [2025-09-16T21:17:41.907327] [INFO ] [MAIN ] MANU: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:41.907737] [DEBUG] [MAIN ] MAIN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:41.908753] [INFO ] [MAIN ] MAIN: Generated 1339 derivative records from 30668 primary records. [2025-09-16T21:17:41.908921] [DEBUG] [LOCAL ] MAIN: Saving derivative data. [2025-09-16T21:17:41.921894] [DEBUG] [LOCAL ] MAIN: Derivative data saved (1339 records). [2025-09-16T21:17:41.921962] [INFO ] [MAIN ] MAIN: Successfully saved derivative data. [2025-09-16T21:17:41.923925] [INFO ] [MAIN ] Derivative Progress: 1074/2026 symbols completed. MAIN took 1.0s. Estimated remaining: 5m 10s. Rate: 184.1 symbols/min [2025-09-16T21:17:41.924180] [INFO ] [MAIN ] MAS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:41.946330] [DEBUG] [LOCAL ] MANU: Loaded 19379 existing records from primary storage. [2025-09-16T21:17:41.946482] [INFO ] [MAIN ] MANU: Loaded 19379 primary data records. [2025-09-16T21:17:42.000028] [DEBUG] [LOCAL ] MAN: Loaded 32640 existing records from primary storage. [2025-09-16T21:17:42.026983] [INFO ] [MAIN ] MAN: Loaded 32640 primary data records. [2025-09-16T21:17:42.254695] [DEBUG] [LOCAL ] MAS: Loaded 39000 existing records from primary storage. [2025-09-16T21:17:42.290893] [INFO ] [MAIN ] MAS: Loaded 39000 primary data records. [2025-09-16T21:17:42.839458] [DEBUG] [MAIN ] MANU: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:42.840712] [INFO ] [MAIN ] MANU: Generated 1339 derivative records from 19379 primary records. [2025-09-16T21:17:42.840870] [DEBUG] [LOCAL ] MANU: Saving derivative data. [2025-09-16T21:17:42.856586] [DEBUG] [LOCAL ] MANU: Derivative data saved (1339 records). [2025-09-16T21:17:42.856977] [INFO ] [MAIN ] MANU: Successfully saved derivative data. [2025-09-16T21:17:42.868760] [INFO ] [MAIN ] Derivative Progress: 1075/2026 symbols completed. MANU took 1.0s. Estimated remaining: 5m 11s. Rate: 183.7 symbols/min [2025-09-16T21:17:42.869665] [DEBUG] [MAIN ] MAN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:42.869813] [INFO ] [MAIN ] MATV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:42.870676] [INFO ] [MAIN ] MAN: Generated 1339 derivative records from 32640 primary records. [2025-09-16T21:17:42.871321] [DEBUG] [LOCAL ] MAN: Saving derivative data. [2025-09-16T21:17:42.887557] [DEBUG] [LOCAL ] MAN: Derivative data saved (1339 records). [2025-09-16T21:17:42.887814] [INFO ] [MAIN ] MAN: Successfully saved derivative data. [2025-09-16T21:17:42.890254] [INFO ] [MAIN ] Derivative Progress: 1076/2026 symbols completed. MAN took 1.0s. Estimated remaining: 5m 10s. Rate: 183.9 symbols/min [2025-09-16T21:17:42.900844] [INFO ] [MAIN ] MATX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:42.900448] [DEBUG] [MAIN ] MAS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:42.901668] [INFO ] [MAIN ] MAS: Generated 1339 derivative records from 39000 primary records. [2025-09-16T21:17:42.901843] [DEBUG] [LOCAL ] MAS: Saving derivative data. [2025-09-16T21:17:42.934052] [DEBUG] [LOCAL ] MATV: Loaded 26810 existing records from primary storage. [2025-09-16T21:17:42.933326] [DEBUG] [LOCAL ] MAS: Derivative data saved (1339 records). [2025-09-16T21:17:42.934391] [INFO ] [MAIN ] MAS: Successfully saved derivative data. [2025-09-16T21:17:42.934305] [INFO ] [MAIN ] MATV: Loaded 26810 primary data records. [2025-09-16T21:17:42.936939] [INFO ] [MAIN ] Derivative Progress: 1077/2026 symbols completed. MAS took 1.0s. Estimated remaining: 5m 9s. Rate: 184.0 symbols/min [2025-09-16T21:17:42.937286] [INFO ] [MAIN ] MAX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:43.065790] [DEBUG] [LOCAL ] MATX: Loaded 23742 existing records from primary storage. [2025-09-16T21:17:43.071589] [INFO ] [MAIN ] MATX: Loaded 23742 primary data records. [2025-09-16T21:17:43.194829] [DEBUG] [LOCAL ] MAX: Loaded 22245 existing records from primary storage. [2025-09-16T21:17:43.316991] [INFO ] [MAIN ] MAX: Loaded 22245 primary data records. [2025-09-16T21:17:43.844602] [DEBUG] [MAIN ] MATV: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:43.847002] [INFO ] [MAIN ] MATV: Generated 1339 derivative records from 26810 primary records. [2025-09-16T21:17:43.848836] [DEBUG] [LOCAL ] MATV: Saving derivative data. [2025-09-16T21:17:43.875244] [DEBUG] [MAIN ] MATX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:43.874614] [DEBUG] [LOCAL ] MATV: Derivative data saved (1339 records). [2025-09-16T21:17:43.876732] [INFO ] [MAIN ] MATV: Successfully saved derivative data. [2025-09-16T21:17:43.878572] [INFO ] [MAIN ] Derivative Progress: 1078/2026 symbols completed. MATV took 1.0s. Estimated remaining: 5m 10s. Rate: 183.7 symbols/min [2025-09-16T21:17:43.876483] [INFO ] [MAIN ] MATX: Generated 1339 derivative records from 23742 primary records. [2025-09-16T21:17:43.879039] [DEBUG] [LOCAL ] MATX: Saving derivative data. [2025-09-16T21:17:43.902028] [DEBUG] [MAIN ] MAX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:43.903361] [INFO ] [MAIN ] MAX: Generated 1339 derivative records from 22245 primary records. [2025-09-16T21:17:43.904307] [DEBUG] [LOCAL ] MAX: Saving derivative data. [2025-09-16T21:17:43.905216] [DEBUG] [LOCAL ] MATX: Derivative data saved (1339 records). [2025-09-16T21:17:43.911030] [INFO ] [MAIN ] MATX: Successfully saved derivative data. [2025-09-16T21:17:43.916268] [INFO ] [MAIN ] Derivative Progress: 1079/2026 symbols completed. MATX took 1.0s. Estimated remaining: 5m 9s. Rate: 183.9 symbols/min [2025-09-16T21:17:43.919251] [DEBUG] [LOCAL ] MAX: Derivative data saved (1339 records). [2025-09-16T21:17:43.919327] [INFO ] [MAIN ] MAX: Successfully saved derivative data. [2025-09-16T21:17:43.921126] [INFO ] [MAIN ] Derivative Progress: 1080/2026 symbols completed. MAX took 1.0s. Estimated remaining: 5m 8s. Rate: 184.0 symbols/min [2025-09-16T21:17:43.921689] [INFO ] [MAIN ] MBC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:43.921921] [INFO ] [MAIN ] MBI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:43.921817] [INFO ] [MAIN ] MC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:43.941425] [DEBUG] [LOCAL ] MBI: Loaded 17717 existing records from primary storage. [2025-09-16T21:17:43.941736] [INFO ] [MAIN ] MBI: Loaded 17717 primary data records. [2025-09-16T21:17:44.081396] [DEBUG] [LOCAL ] MBC: Loaded 31783 existing records from primary storage. [2025-09-16T21:17:44.106296] [INFO ] [MAIN ] MBC: Loaded 31783 primary data records. [2025-09-16T21:17:44.168918] [DEBUG] [LOCAL ] MC: Loaded 32527 existing records from primary storage. [2025-09-16T21:17:44.297754] [INFO ] [MAIN ] MC: Loaded 32527 primary data records. [2025-09-16T21:17:44.821074] [DEBUG] [MAIN ] MBI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:44.823616] [INFO ] [MAIN ] MBI: Generated 1339 derivative records from 17717 primary records. [2025-09-16T21:17:44.824233] [DEBUG] [LOCAL ] MBI: Saving derivative data. [2025-09-16T21:17:44.851073] [DEBUG] [LOCAL ] MBI: Derivative data saved (1339 records). [2025-09-16T21:17:44.850468] [DEBUG] [MAIN ] MBC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:44.851327] [INFO ] [MAIN ] MBI: Successfully saved derivative data. [2025-09-16T21:17:44.851981] [INFO ] [MAIN ] MBC: Generated 1339 derivative records from 31783 primary records. [2025-09-16T21:17:44.852184] [DEBUG] [LOCAL ] MBC: Saving derivative data. [2025-09-16T21:17:44.854067] [INFO ] [MAIN ] Derivative Progress: 1081/2026 symbols completed. MBI took 0.9s. Estimated remaining: 5m 9s. Rate: 183.7 symbols/min [2025-09-16T21:17:44.864636] [INFO ] [MAIN ] MCB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:44.868066] [DEBUG] [LOCAL ] MBC: Derivative data saved (1339 records). [2025-09-16T21:17:44.868233] [INFO ] [MAIN ] MBC: Successfully saved derivative data. [2025-09-16T21:17:44.871514] [INFO ] [MAIN ] Derivative Progress: 1082/2026 symbols completed. MBC took 0.9s. Estimated remaining: 5m 8s. Rate: 183.9 symbols/min [2025-09-16T21:17:44.871813] [INFO ] [MAIN ] MCD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:44.886415] [DEBUG] [MAIN ] MC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:44.887220] [INFO ] [MAIN ] MC: Generated 1339 derivative records from 32527 primary records. [2025-09-16T21:17:44.887396] [DEBUG] [LOCAL ] MC: Saving derivative data. [2025-09-16T21:17:44.900453] [DEBUG] [LOCAL ] MCB: Loaded 8210 existing records from primary storage. [2025-09-16T21:17:44.900542] [INFO ] [MAIN ] MCB: Loaded 8210 primary data records. [2025-09-16T21:17:44.996876] [DEBUG] [LOCAL ] MC: Derivative data saved (1339 records). [2025-09-16T21:17:45.007937] [INFO ] [MAIN ] MC: Successfully saved derivative data. [2025-09-16T21:17:45.010140] [INFO ] [MAIN ] Derivative Progress: 1083/2026 symbols completed. MC took 1.1s. Estimated remaining: 5m 8s. Rate: 184.0 symbols/min [2025-09-16T21:17:45.035074] [INFO ] [MAIN ] MCI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:45.195893] [DEBUG] [LOCAL ] MCD: Loaded 39855 existing records from primary storage. [2025-09-16T21:17:45.199351] [DEBUG] [LOCAL ] MCI: Loaded 4644 existing records from primary storage. [2025-09-16T21:17:45.199692] [INFO ] [MAIN ] MCD: Loaded 39855 primary data records. [2025-09-16T21:17:45.199917] [INFO ] [MAIN ] MCI: Loaded 4644 primary data records. [2025-09-16T21:17:45.781796] [DEBUG] [MAIN ] MCB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:45.782983] [INFO ] [MAIN ] MCB: Generated 1339 derivative records from 8210 primary records. [2025-09-16T21:17:45.783992] [DEBUG] [LOCAL ] MCB: Saving derivative data. [2025-09-16T21:17:45.798718] [DEBUG] [LOCAL ] MCB: Derivative data saved (1339 records). [2025-09-16T21:17:45.798926] [INFO ] [MAIN ] MCB: Successfully saved derivative data. [2025-09-16T21:17:45.800989] [INFO ] [MAIN ] Derivative Progress: 1084/2026 symbols completed. MCB took 0.9s. Estimated remaining: 5m 8s. Rate: 183.7 symbols/min [2025-09-16T21:17:45.801469] [INFO ] [MAIN ] MCK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:45.816245] [DEBUG] [MAIN ] MCD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:45.816983] [INFO ] [MAIN ] MCD: Generated 1339 derivative records from 39855 primary records. [2025-09-16T21:17:45.817200] [DEBUG] [LOCAL ] MCD: Saving derivative data. [2025-09-16T21:17:45.840048] [DEBUG] [MAIN ] MCI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:45.842229] [INFO ] [MAIN ] MCI: Generated 1339 derivative records from 4644 primary records. [2025-09-16T21:17:45.842678] [DEBUG] [LOCAL ] MCI: Saving derivative data. [2025-09-16T21:17:45.844582] [DEBUG] [LOCAL ] MCD: Derivative data saved (1339 records). [2025-09-16T21:17:45.844709] [INFO ] [MAIN ] MCD: Successfully saved derivative data. [2025-09-16T21:17:45.847494] [INFO ] [MAIN ] Derivative Progress: 1085/2026 symbols completed. MCD took 1.0s. Estimated remaining: 5m 7s. Rate: 183.9 symbols/min [2025-09-16T21:17:45.853500] [INFO ] [MAIN ] MCN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:45.869344] [DEBUG] [LOCAL ] MCI: Derivative data saved (1339 records). [2025-09-16T21:17:45.869592] [INFO ] [MAIN ] MCI: Successfully saved derivative data. [2025-09-16T21:17:45.882968] [DEBUG] [LOCAL ] MCK: Loaded 28557 existing records from primary storage. [2025-09-16T21:17:45.882102] [INFO ] [MAIN ] Derivative Progress: 1086/2026 symbols completed. MCI took 0.8s. Estimated remaining: 5m 6s. Rate: 184.0 symbols/min [2025-09-16T21:17:45.883386] [INFO ] [MAIN ] MCO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:45.883481] [INFO ] [MAIN ] MCK: Loaded 28557 primary data records. [2025-09-16T21:17:45.918667] [DEBUG] [LOCAL ] MCN: Loaded 5967 existing records from primary storage. [2025-09-16T21:17:45.951465] [INFO ] [MAIN ] MCN: Loaded 5967 primary data records. [2025-09-16T21:17:46.430500] [DEBUG] [LOCAL ] MCO: Loaded 27948 existing records from primary storage. [2025-09-16T21:17:46.430820] [INFO ] [MAIN ] MCO: Loaded 27948 primary data records. [2025-09-16T21:17:46.726990] [DEBUG] [MAIN ] MCN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:46.728017] [INFO ] [MAIN ] MCN: Generated 1339 derivative records from 5967 primary records. [2025-09-16T21:17:46.728315] [DEBUG] [LOCAL ] MCN: Saving derivative data. [2025-09-16T21:17:46.748158] [DEBUG] [MAIN ] MCK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:46.751029] [DEBUG] [LOCAL ] MCN: Derivative data saved (1339 records). [2025-09-16T21:17:46.751105] [INFO ] [MAIN ] MCN: Successfully saved derivative data. [2025-09-16T21:17:46.753837] [INFO ] [MAIN ] Derivative Progress: 1087/2026 symbols completed. MCN took 0.9s. Estimated remaining: 5m 7s. Rate: 183.8 symbols/min [2025-09-16T21:17:46.751814] [INFO ] [MAIN ] MCK: Generated 1339 derivative records from 28557 primary records. [2025-09-16T21:17:46.754314] [INFO ] [MAIN ] MCR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:46.754588] [DEBUG] [LOCAL ] MCK: Saving derivative data. [2025-09-16T21:17:46.770736] [DEBUG] [LOCAL ] MCK: Derivative data saved (1339 records). [2025-09-16T21:17:46.770891] [INFO ] [MAIN ] MCK: Successfully saved derivative data. [2025-09-16T21:17:46.773516] [INFO ] [MAIN ] Derivative Progress: 1088/2026 symbols completed. MCK took 1.0s. Estimated remaining: 5m 6s. Rate: 183.9 symbols/min [2025-09-16T21:17:46.776861] [DEBUG] [LOCAL ] MCR: Loaded 6564 existing records from primary storage. [2025-09-16T21:17:46.777674] [INFO ] [MAIN ] MCR: Loaded 6564 primary data records. [2025-09-16T21:17:46.789528] [INFO ] [MAIN ] MCS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:46.852897] [DEBUG] [MAIN ] MCO: Filtered 5181 bins outside market hours, 5780 incomplete bins [2025-09-16T21:17:46.901635] [INFO ] [MAIN ] MCO: Generated 1338 derivative records from 27948 primary records. [2025-09-16T21:17:46.912486] [DEBUG] [LOCAL ] MCO: Saving derivative data. [2025-09-16T21:17:46.995515] [DEBUG] [LOCAL ] MCS: Loaded 15589 existing records from primary storage. [2025-09-16T21:17:47.076376] [INFO ] [MAIN ] MCS: Loaded 15589 primary data records. [2025-09-16T21:17:47.173428] [DEBUG] [LOCAL ] MCO: Derivative data saved (1338 records). [2025-09-16T21:17:47.195367] [INFO ] [MAIN ] MCO: Successfully saved derivative data. [2025-09-16T21:17:47.197453] [INFO ] [MAIN ] Derivative Progress: 1089/2026 symbols completed. MCO took 1.3s. Estimated remaining: 5m 6s. Rate: 183.9 symbols/min [2025-09-16T21:17:47.197933] [INFO ] [MAIN ] MCY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:47.374410] [DEBUG] [LOCAL ] MCY: Loaded 17638 existing records from primary storage. [2025-09-16T21:17:47.376333] [INFO ] [MAIN ] MCY: Loaded 17638 primary data records. [2025-09-16T21:17:47.467561] [DEBUG] [MAIN ] MCR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:47.490289] [INFO ] [MAIN ] MCR: Generated 1339 derivative records from 6564 primary records. [2025-09-16T21:17:47.490634] [DEBUG] [LOCAL ] MCR: Saving derivative data. [2025-09-16T21:17:47.577578] [DEBUG] [LOCAL ] MCR: Derivative data saved (1339 records). [2025-09-16T21:17:47.578813] [INFO ] [MAIN ] MCR: Successfully saved derivative data. [2025-09-16T21:17:47.580614] [INFO ] [MAIN ] Derivative Progress: 1090/2026 symbols completed. MCR took 0.8s. Estimated remaining: 5m 6s. Rate: 183.8 symbols/min [2025-09-16T21:17:47.702978] [INFO ] [MAIN ] MD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:47.712785] [DEBUG] [MAIN ] MCS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:47.713397] [INFO ] [MAIN ] MCS: Generated 1339 derivative records from 15589 primary records. [2025-09-16T21:17:47.713965] [DEBUG] [LOCAL ] MCS: Saving derivative data. [2025-09-16T21:17:47.727547] [DEBUG] [LOCAL ] MCS: Derivative data saved (1339 records). [2025-09-16T21:17:47.728079] [INFO ] [MAIN ] MCS: Successfully saved derivative data. [2025-09-16T21:17:47.730070] [INFO ] [MAIN ] Derivative Progress: 1091/2026 symbols completed. MCS took 0.9s. Estimated remaining: 5m 5s. Rate: 183.9 symbols/min [2025-09-16T21:17:47.730306] [INFO ] [MAIN ] MDST: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:47.744412] [DEBUG] [LOCAL ] MDST: Loaded 4121 existing records from primary storage. [2025-09-16T21:17:47.744618] [INFO ] [MAIN ] MDST: Loaded 4121 primary data records. [2025-09-16T21:17:47.858312] [DEBUG] [LOCAL ] MD: Loaded 29126 existing records from primary storage. [2025-09-16T21:17:47.864001] [INFO ] [MAIN ] MD: Loaded 29126 primary data records. [2025-09-16T21:17:48.008203] [DEBUG] [MAIN ] MCY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:48.113494] [INFO ] [MAIN ] MCY: Generated 1339 derivative records from 17638 primary records. [2025-09-16T21:17:48.127630] [DEBUG] [LOCAL ] MCY: Saving derivative data. [2025-09-16T21:17:48.300392] [DEBUG] [LOCAL ] MCY: Derivative data saved (1339 records). [2025-09-16T21:17:48.300740] [INFO ] [MAIN ] MCY: Successfully saved derivative data. [2025-09-16T21:17:48.302567] [INFO ] [MAIN ] Derivative Progress: 1092/2026 symbols completed. MCY took 1.1s. Estimated remaining: 5m 5s. Rate: 183.8 symbols/min [2025-09-16T21:17:48.302907] [INFO ] [MAIN ] MDT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:48.322833] [DEBUG] [MAIN ] MDST: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:48.323704] [INFO ] [MAIN ] MDST: Generated 1339 derivative records from 4121 primary records. [2025-09-16T21:17:48.324021] [DEBUG] [LOCAL ] MDST: Saving derivative data. [2025-09-16T21:17:48.335838] [DEBUG] [LOCAL ] MDST: Derivative data saved (1339 records). [2025-09-16T21:17:48.336107] [INFO ] [MAIN ] MDST: Successfully saved derivative data. [2025-09-16T21:17:48.346850] [INFO ] [MAIN ] Derivative Progress: 1093/2026 symbols completed. MDST took 0.6s. Estimated remaining: 5m 4s. Rate: 183.9 symbols/min [2025-09-16T21:17:48.359131] [DEBUG] [MAIN ] MD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:48.360354] [INFO ] [MAIN ] MD: Generated 1339 derivative records from 29126 primary records. [2025-09-16T21:17:48.371469] [DEBUG] [LOCAL ] MD: Saving derivative data. [2025-09-16T21:17:48.372743] [DEBUG] [LOCAL ] MDT: Loaded 40028 existing records from primary storage. [2025-09-16T21:17:48.378533] [INFO ] [MAIN ] MDT: Loaded 40028 primary data records. [2025-09-16T21:17:48.485461] [DEBUG] [LOCAL ] MD: Derivative data saved (1339 records). [2025-09-16T21:17:48.485632] [INFO ] [MAIN ] MD: Successfully saved derivative data. [2025-09-16T21:17:48.488984] [INFO ] [MAIN ] Derivative Progress: 1094/2026 symbols completed. MD took 0.8s. Estimated remaining: 5m 4s. Rate: 184.0 symbols/min [2025-09-16T21:17:48.657882] [DEBUG] [MAIN ] MDT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:48.658482] [INFO ] [MAIN ] MDT: Generated 1339 derivative records from 40028 primary records. [2025-09-16T21:17:48.658545] [DEBUG] [LOCAL ] MDT: Saving derivative data. [2025-09-16T21:17:48.670174] [DEBUG] [LOCAL ] MDT: Derivative data saved (1339 records). [2025-09-16T21:17:48.670231] [INFO ] [MAIN ] MDT: Successfully saved derivative data. [2025-09-16T21:17:48.671884] [INFO ] [MAIN ] Derivative Progress: 1095/2026 symbols completed. MDT took 0.4s. Estimated remaining: 5m 3s. Rate: 184.1 symbols/min [2025-09-16T21:17:48.672493] [INFO ] [MAIN ] MEC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:48.672950] [INFO ] [MAIN ] MDU: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:48.673198] [INFO ] [MAIN ] MDV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:48.686282] [DEBUG] [LOCAL ] MDV: Loaded 6546 existing records from primary storage. [2025-09-16T21:17:48.686492] [INFO ] [MAIN ] MDV: Loaded 6546 primary data records. [2025-09-16T21:17:48.768209] [DEBUG] [LOCAL ] MEC: Loaded 12359 existing records from primary storage. [2025-09-16T21:17:48.786364] [INFO ] [MAIN ] MEC: Loaded 12359 primary data records. [2025-09-16T21:17:49.009101] [DEBUG] [LOCAL ] MDU: Loaded 35119 existing records from primary storage. [2025-09-16T21:17:49.121556] [INFO ] [MAIN ] MDU: Loaded 35119 primary data records. [2025-09-16T21:17:49.537073] [DEBUG] [MAIN ] MEC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:49.537367] [DEBUG] [MAIN ] MDV: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:49.538212] [INFO ] [MAIN ] MEC: Generated 1339 derivative records from 12359 primary records. [2025-09-16T21:17:49.539195] [DEBUG] [LOCAL ] MEC: Saving derivative data. [2025-09-16T21:17:49.539122] [INFO ] [MAIN ] MDV: Generated 1339 derivative records from 6546 primary records. [2025-09-16T21:17:49.539316] [DEBUG] [LOCAL ] MDV: Saving derivative data. [2025-09-16T21:17:49.563374] [DEBUG] [LOCAL ] MDV: Derivative data saved (1339 records). [2025-09-16T21:17:49.564902] [INFO ] [MAIN ] MDV: Successfully saved derivative data. [2025-09-16T21:17:49.567870] [DEBUG] [LOCAL ] MEC: Derivative data saved (1339 records). [2025-09-16T21:17:49.566717] [INFO ] [MAIN ] Derivative Progress: 1096/2026 symbols completed. MDV took 0.9s. Estimated remaining: 5m 4s. Rate: 183.8 symbols/min [2025-09-16T21:17:49.577345] [INFO ] [MAIN ] MEC: Successfully saved derivative data. [2025-09-16T21:17:49.580490] [DEBUG] [MAIN ] MDU: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:49.580566] [INFO ] [MAIN ] MED: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:49.579993] [INFO ] [MAIN ] Derivative Progress: 1097/2026 symbols completed. MEC took 0.9s. Estimated remaining: 5m 3s. Rate: 184.0 symbols/min [2025-09-16T21:17:49.581469] [INFO ] [MAIN ] MDU: Generated 1339 derivative records from 35119 primary records. [2025-09-16T21:17:49.582032] [DEBUG] [LOCAL ] MDU: Saving derivative data. [2025-09-16T21:17:49.581765] [INFO ] [MAIN ] MEG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:49.596127] [DEBUG] [LOCAL ] MDU: Derivative data saved (1339 records). [2025-09-16T21:17:49.596255] [INFO ] [MAIN ] MDU: Successfully saved derivative data. [2025-09-16T21:17:49.598024] [INFO ] [MAIN ] Derivative Progress: 1098/2026 symbols completed. MDU took 0.9s. Estimated remaining: 5m 2s. Rate: 184.1 symbols/min [2025-09-16T21:17:49.598299] [INFO ] [MAIN ] MEGI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:49.617038] [DEBUG] [LOCAL ] MED: Loaded 15705 existing records from primary storage. [2025-09-16T21:17:49.617196] [INFO ] [MAIN ] MED: Loaded 15705 primary data records. [2025-09-16T21:17:49.724467] [DEBUG] [LOCAL ] MEGI: Loaded 15098 existing records from primary storage. [2025-09-16T21:17:49.724672] [INFO ] [MAIN ] MEGI: Loaded 15098 primary data records. [2025-09-16T21:17:49.724358] [DEBUG] [LOCAL ] MEG: Loaded 22538 existing records from primary storage. [2025-09-16T21:17:49.732251] [INFO ] [MAIN ] MEG: Loaded 22538 primary data records. [2025-09-16T21:17:50.487191] [DEBUG] [MAIN ] MED: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:50.488528] [INFO ] [MAIN ] MED: Generated 1339 derivative records from 15705 primary records. [2025-09-16T21:17:50.488661] [DEBUG] [LOCAL ] MED: Saving derivative data. [2025-09-16T21:17:50.501597] [DEBUG] [LOCAL ] MED: Derivative data saved (1339 records). [2025-09-16T21:17:50.501877] [INFO ] [MAIN ] MED: Successfully saved derivative data. [2025-09-16T21:17:50.504339] [INFO ] [MAIN ] Derivative Progress: 1099/2026 symbols completed. MED took 0.9s. Estimated remaining: 5m 3s. Rate: 183.8 symbols/min [2025-09-16T21:17:50.506111] [INFO ] [MAIN ] MEI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:50.527484] [DEBUG] [MAIN ] MEG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:50.527788] [DEBUG] [MAIN ] MEGI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:50.528534] [INFO ] [MAIN ] MEG: Generated 1339 derivative records from 22538 primary records. [2025-09-16T21:17:50.529280] [INFO ] [MAIN ] MEGI: Generated 1339 derivative records from 15098 primary records. [2025-09-16T21:17:50.529446] [DEBUG] [LOCAL ] MEG: Saving derivative data. [2025-09-16T21:17:50.529490] [DEBUG] [LOCAL ] MEGI: Saving derivative data. [2025-09-16T21:17:50.557285] [DEBUG] [LOCAL ] MEG: Derivative data saved (1339 records). [2025-09-16T21:17:50.560097] [DEBUG] [LOCAL ] MEGI: Derivative data saved (1339 records). [2025-09-16T21:17:50.560411] [INFO ] [MAIN ] MEGI: Successfully saved derivative data. [2025-09-16T21:17:50.562564] [INFO ] [MAIN ] Derivative Progress: 1100/2026 symbols completed. MEGI took 1.0s. Estimated remaining: 5m 2s. Rate: 184.0 symbols/min [2025-09-16T21:17:50.560221] [INFO ] [MAIN ] MEG: Successfully saved derivative data. [2025-09-16T21:17:50.569372] [INFO ] [MAIN ] MET: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:50.571306] [INFO ] [MAIN ] Derivative Progress: 1101/2026 symbols completed. MEG took 1.0s. Estimated remaining: 5m 1s. Rate: 184.1 symbols/min [2025-09-16T21:17:50.572557] [INFO ] [MAIN ] MFA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:50.573573] [DEBUG] [LOCAL ] MEI: Loaded 23284 existing records from primary storage. [2025-09-16T21:17:50.573820] [INFO ] [MAIN ] MEI: Loaded 23284 primary data records. [2025-09-16T21:17:50.884168] [DEBUG] [LOCAL ] MFA: Loaded 33246 existing records from primary storage. [2025-09-16T21:17:50.884519] [INFO ] [MAIN ] MFA: Loaded 33246 primary data records. [2025-09-16T21:17:50.885110] [DEBUG] [LOCAL ] MET: Loaded 39713 existing records from primary storage. [2025-09-16T21:17:50.891474] [INFO ] [MAIN ] MET: Loaded 39713 primary data records. [2025-09-16T21:17:51.431607] [DEBUG] [MAIN ] MEI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:51.432631] [INFO ] [MAIN ] MEI: Generated 1339 derivative records from 23284 primary records. [2025-09-16T21:17:51.433048] [DEBUG] [LOCAL ] MEI: Saving derivative data. [2025-09-16T21:17:51.446843] [DEBUG] [LOCAL ] MEI: Derivative data saved (1339 records). [2025-09-16T21:17:51.447172] [INFO ] [MAIN ] MEI: Successfully saved derivative data. [2025-09-16T21:17:51.449376] [INFO ] [MAIN ] Derivative Progress: 1102/2026 symbols completed. MEI took 0.9s. Estimated remaining: 5m 2s. Rate: 183.9 symbols/min [2025-09-16T21:17:51.449915] [INFO ] [MAIN ] MFAN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:51.455397] [DEBUG] [LOCAL ] MFAN: Loaded 3025 existing records from primary storage. [2025-09-16T21:17:51.455719] [INFO ] [MAIN ] MFAN: Loaded 3025 primary data records. [2025-09-16T21:17:51.580810] [DEBUG] [MAIN ] MFA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:51.580595] [DEBUG] [MAIN ] MET: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:51.597238] [INFO ] [MAIN ] MFA: Generated 1339 derivative records from 33246 primary records. [2025-09-16T21:17:51.623074] [DEBUG] [LOCAL ] MFA: Saving derivative data. [2025-09-16T21:17:51.630809] [INFO ] [MAIN ] MET: Generated 1339 derivative records from 39713 primary records. [2025-09-16T21:17:51.665793] [DEBUG] [LOCAL ] MET: Saving derivative data. [2025-09-16T21:17:51.767361] [DEBUG] [LOCAL ] MFA: Derivative data saved (1339 records). [2025-09-16T21:17:51.772664] [INFO ] [MAIN ] MFA: Successfully saved derivative data. [2025-09-16T21:17:51.775841] [INFO ] [MAIN ] Derivative Progress: 1103/2026 symbols completed. MFA took 1.2s. Estimated remaining: 5m 1s. Rate: 183.9 symbols/min [2025-09-16T21:17:51.777228] [INFO ] [MAIN ] MFAO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:51.779964] [DEBUG] [LOCAL ] MET: Derivative data saved (1339 records). [2025-09-16T21:17:51.780365] [INFO ] [MAIN ] MET: Successfully saved derivative data. [2025-09-16T21:17:51.782658] [INFO ] [MAIN ] Derivative Progress: 1104/2026 symbols completed. MET took 1.2s. Estimated remaining: 5m 1s. Rate: 184.0 symbols/min [2025-09-16T21:17:51.784040] [INFO ] [MAIN ] MFC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:51.788381] [DEBUG] [LOCAL ] MFAO: Loaded 2842 existing records from primary storage. [2025-09-16T21:17:51.788692] [INFO ] [MAIN ] MFAO: Loaded 2842 primary data records. [2025-09-16T21:17:52.109528] [DEBUG] [MAIN ] MFAN: Filtered 5181 bins outside market hours, 5782 incomplete bins [2025-09-16T21:17:52.135563] [INFO ] [MAIN ] MFAN: Generated 1336 derivative records from 3025 primary records. [2025-09-16T21:17:52.136359] [DEBUG] [LOCAL ] MFC: Loaded 37998 existing records from primary storage. [2025-09-16T21:17:52.135808] [DEBUG] [LOCAL ] MFAN: Saving derivative data. [2025-09-16T21:17:52.137811] [INFO ] [MAIN ] MFC: Loaded 37998 primary data records. [2025-09-16T21:17:52.231158] [DEBUG] [LOCAL ] MFAN: Derivative data saved (1336 records). [2025-09-16T21:17:52.252228] [INFO ] [MAIN ] MFAN: Successfully saved derivative data. [2025-09-16T21:17:52.254360] [INFO ] [MAIN ] Derivative Progress: 1105/2026 symbols completed. MFAN took 0.8s. Estimated remaining: 5m 0s. Rate: 183.9 symbols/min [2025-09-16T21:17:52.276367] [INFO ] [MAIN ] MFG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:52.435907] [DEBUG] [MAIN ] MFAO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:52.436716] [INFO ] [MAIN ] MFAO: Generated 1339 derivative records from 2842 primary records. [2025-09-16T21:17:52.447946] [DEBUG] [LOCAL ] MFAO: Saving derivative data. [2025-09-16T21:17:52.459895] [DEBUG] [LOCAL ] MFAO: Derivative data saved (1339 records). [2025-09-16T21:17:52.460197] [INFO ] [MAIN ] MFAO: Successfully saved derivative data. [2025-09-16T21:17:52.462045] [INFO ] [MAIN ] Derivative Progress: 1106/2026 symbols completed. MFAO took 0.7s. Estimated remaining: 4m 60s. Rate: 184.0 symbols/min [2025-09-16T21:17:52.462442] [INFO ] [MAIN ] MFM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:52.475088] [DEBUG] [LOCAL ] MFG: Loaded 36915 existing records from primary storage. [2025-09-16T21:17:52.476264] [INFO ] [MAIN ] MFG: Loaded 36915 primary data records. [2025-09-16T21:17:52.572385] [DEBUG] [MAIN ] MFC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:52.596448] [INFO ] [MAIN ] MFC: Generated 1339 derivative records from 37998 primary records. [2025-09-16T21:17:52.600525] [DEBUG] [LOCAL ] MFM: Loaded 9639 existing records from primary storage. [2025-09-16T21:17:52.600714] [INFO ] [MAIN ] MFM: Loaded 9639 primary data records. [2025-09-16T21:17:52.600675] [DEBUG] [LOCAL ] MFC: Saving derivative data. [2025-09-16T21:17:52.734500] [DEBUG] [LOCAL ] MFC: Derivative data saved (1339 records). [2025-09-16T21:17:52.777813] [INFO ] [MAIN ] MFC: Successfully saved derivative data. [2025-09-16T21:17:52.785980] [INFO ] [MAIN ] Derivative Progress: 1107/2026 symbols completed. MFC took 1.0s. Estimated remaining: 4m 60s. Rate: 184.0 symbols/min [2025-09-16T21:17:52.869576] [INFO ] [MAIN ] MFSG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:52.961890] [DEBUG] [LOCAL ] MFSG: Loaded 3995 existing records from primary storage. [2025-09-16T21:17:53.046374] [INFO ] [MAIN ] MFSG: Loaded 3995 primary data records. [2025-09-16T21:17:53.349171] [DEBUG] [MAIN ] MFG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:53.350768] [INFO ] [MAIN ] MFG: Generated 1339 derivative records from 36915 primary records. [2025-09-16T21:17:53.351177] [DEBUG] [LOCAL ] MFG: Saving derivative data. [2025-09-16T21:17:53.367720] [DEBUG] [MAIN ] MFM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:53.374173] [DEBUG] [LOCAL ] MFG: Derivative data saved (1339 records). [2025-09-16T21:17:53.375042] [INFO ] [MAIN ] MFM: Generated 1339 derivative records from 9639 primary records. [2025-09-16T21:17:53.375327] [INFO ] [MAIN ] MFG: Successfully saved derivative data. [2025-09-16T21:17:53.377126] [INFO ] [MAIN ] Derivative Progress: 1108/2026 symbols completed. MFG took 1.1s. Estimated remaining: 4m 60s. Rate: 183.9 symbols/min [2025-09-16T21:17:53.377238] [DEBUG] [LOCAL ] MFM: Saving derivative data. [2025-09-16T21:17:53.391634] [DEBUG] [LOCAL ] MFM: Derivative data saved (1339 records). [2025-09-16T21:17:53.401482] [INFO ] [MAIN ] MFM: Successfully saved derivative data. [2025-09-16T21:17:53.401748] [DEBUG] [MAIN ] MFSG: Filtered 5181 bins outside market hours, 5780 incomplete bins [2025-09-16T21:17:53.404700] [INFO ] [MAIN ] Derivative Progress: 1109/2026 symbols completed. MFM took 0.9s. Estimated remaining: 4m 59s. Rate: 184.0 symbols/min [2025-09-16T21:17:53.402470] [INFO ] [MAIN ] MFSG: Generated 1338 derivative records from 3995 primary records. [2025-09-16T21:17:53.404992] [DEBUG] [LOCAL ] MFSG: Saving derivative data. [2025-09-16T21:17:53.416833] [DEBUG] [LOCAL ] MFSG: Derivative data saved (1338 records). [2025-09-16T21:17:53.416897] [INFO ] [MAIN ] MFSG: Successfully saved derivative data. [2025-09-16T21:17:53.418733] [INFO ] [MAIN ] Derivative Progress: 1110/2026 symbols completed. MFSG took 0.6s. Estimated remaining: 4m 58s. Rate: 184.2 symbols/min [2025-09-16T21:17:53.419380] [INFO ] [MAIN ] MFSV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:53.419231] [INFO ] [MAIN ] MFSI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:53.419503] [INFO ] [MAIN ] MG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:53.423886] [DEBUG] [LOCAL ] MFSV: Loaded 1713 existing records from primary storage. [2025-09-16T21:17:53.424169] [INFO ] [MAIN ] MFSV: Loaded 1713 primary data records. [2025-09-16T21:17:53.530396] [DEBUG] [LOCAL ] MFSI: Loaded 9004 existing records from primary storage. [2025-09-16T21:17:53.567163] [INFO ] [MAIN ] MFSI: Loaded 9004 primary data records. [2025-09-16T21:17:53.551760] [DEBUG] [LOCAL ] MG: Loaded 11519 existing records from primary storage. [2025-09-16T21:17:53.628562] [INFO ] [MAIN ] MG: Loaded 11519 primary data records. [2025-09-16T21:17:54.328429] [DEBUG] [MAIN ] MFSV: Filtered 5181 bins outside market hours, 5780 incomplete bins [2025-09-16T21:17:54.329523] [INFO ] [MAIN ] MFSV: Generated 1338 derivative records from 1713 primary records. [2025-09-16T21:17:54.329908] [DEBUG] [LOCAL ] MFSV: Saving derivative data. [2025-09-16T21:17:54.342062] [DEBUG] [LOCAL ] MFSV: Derivative data saved (1338 records). [2025-09-16T21:17:54.342228] [INFO ] [MAIN ] MFSV: Successfully saved derivative data. [2025-09-16T21:17:54.344051] [INFO ] [MAIN ] Derivative Progress: 1111/2026 symbols completed. MFSV took 0.9s. Estimated remaining: 4m 59s. Rate: 183.9 symbols/min [2025-09-16T21:17:54.345426] [INFO ] [MAIN ] MGA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:54.358145] [DEBUG] [MAIN ] MFSI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:54.359093] [INFO ] [MAIN ] MFSI: Generated 1339 derivative records from 9004 primary records. [2025-09-16T21:17:54.359813] [DEBUG] [LOCAL ] MFSI: Saving derivative data. [2025-09-16T21:17:54.384064] [DEBUG] [MAIN ] MG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:54.384846] [DEBUG] [LOCAL ] MFSI: Derivative data saved (1339 records). [2025-09-16T21:17:54.385798] [INFO ] [MAIN ] MG: Generated 1339 derivative records from 11519 primary records. [2025-09-16T21:17:54.385976] [DEBUG] [LOCAL ] MG: Saving derivative data. [2025-09-16T21:17:54.386064] [INFO ] [MAIN ] MFSI: Successfully saved derivative data. [2025-09-16T21:17:54.389139] [INFO ] [MAIN ] Derivative Progress: 1112/2026 symbols completed. MFSI took 1.0s. Estimated remaining: 4m 58s. Rate: 184.0 symbols/min [2025-09-16T21:17:54.406812] [INFO ] [MAIN ] MGF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:54.409679] [DEBUG] [LOCAL ] MG: Derivative data saved (1339 records). [2025-09-16T21:17:54.410274] [INFO ] [MAIN ] MG: Successfully saved derivative data. [2025-09-16T21:17:54.412250] [INFO ] [MAIN ] Derivative Progress: 1113/2026 symbols completed. MG took 1.0s. Estimated remaining: 4m 57s. Rate: 184.2 symbols/min [2025-09-16T21:17:54.412619] [INFO ] [MAIN ] MGM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:54.418063] [DEBUG] [LOCAL ] MGF: Loaded 3182 existing records from primary storage. [2025-09-16T21:17:54.418205] [INFO ] [MAIN ] MGF: Loaded 3182 primary data records. [2025-09-16T21:17:54.516636] [DEBUG] [LOCAL ] MGA: Loaded 37416 existing records from primary storage. [2025-09-16T21:17:54.537208] [INFO ] [MAIN ] MGA: Loaded 37416 primary data records. [2025-09-16T21:17:54.867984] [DEBUG] [LOCAL ] MGM: Loaded 39964 existing records from primary storage. [2025-09-16T21:17:54.883632] [INFO ] [MAIN ] MGM: Loaded 39964 primary data records. [2025-09-16T21:17:55.287900] [DEBUG] [MAIN ] MGF: Filtered 5181 bins outside market hours, 5780 incomplete bins [2025-09-16T21:17:55.289040] [INFO ] [MAIN ] MGF: Generated 1338 derivative records from 3182 primary records. [2025-09-16T21:17:55.290075] [DEBUG] [LOCAL ] MGF: Saving derivative data. [2025-09-16T21:17:55.320543] [DEBUG] [LOCAL ] MGF: Derivative data saved (1338 records). [2025-09-16T21:17:55.321360] [INFO ] [MAIN ] MGF: Successfully saved derivative data. [2025-09-16T21:17:55.323371] [INFO ] [MAIN ] Derivative Progress: 1114/2026 symbols completed. MGF took 0.9s. Estimated remaining: 4m 58s. Rate: 183.9 symbols/min [2025-09-16T21:17:55.320988] [DEBUG] [MAIN ] MGA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:55.324569] [INFO ] [MAIN ] MGA: Generated 1339 derivative records from 37416 primary records. [2025-09-16T21:17:55.325109] [INFO ] [MAIN ] MGR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:55.325381] [DEBUG] [LOCAL ] MGA: Saving derivative data. [2025-09-16T21:17:55.348863] [DEBUG] [LOCAL ] MGR: Loaded 4160 existing records from primary storage. [2025-09-16T21:17:55.349545] [INFO ] [MAIN ] MGR: Loaded 4160 primary data records. [2025-09-16T21:17:55.399151] [DEBUG] [LOCAL ] MGA: Derivative data saved (1339 records). [2025-09-16T21:17:55.412054] [INFO ] [MAIN ] MGA: Successfully saved derivative data. [2025-09-16T21:17:55.423438] [INFO ] [MAIN ] Derivative Progress: 1115/2026 symbols completed. MGA took 1.1s. Estimated remaining: 4m 57s. Rate: 184.0 symbols/min [2025-09-16T21:17:55.462634] [INFO ] [MAIN ] MGRB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:55.423885] [DEBUG] [MAIN ] MGM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:55.463836] [INFO ] [MAIN ] MGM: Generated 1339 derivative records from 39964 primary records. [2025-09-16T21:17:55.475794] [DEBUG] [LOCAL ] MGM: Saving derivative data. [2025-09-16T21:17:55.562712] [DEBUG] [LOCAL ] MGRB: Loaded 3049 existing records from primary storage. [2025-09-16T21:17:55.568412] [INFO ] [MAIN ] MGRB: Loaded 3049 primary data records. [2025-09-16T21:17:55.568281] [DEBUG] [LOCAL ] MGM: Derivative data saved (1339 records). [2025-09-16T21:17:55.668255] [INFO ] [MAIN ] MGM: Successfully saved derivative data. [2025-09-16T21:17:55.703947] [INFO ] [MAIN ] Derivative Progress: 1116/2026 symbols completed. MGM took 1.3s. Estimated remaining: 4m 57s. Rate: 184.0 symbols/min [2025-09-16T21:17:55.762768] [INFO ] [MAIN ] MGRD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:55.921137] [DEBUG] [LOCAL ] MGRD: Loaded 1647 existing records from primary storage. [2025-09-16T21:17:55.933239] [INFO ] [MAIN ] MGRD: Loaded 1647 primary data records. [2025-09-16T21:17:56.221909] [DEBUG] [MAIN ] MGR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:56.223687] [INFO ] [MAIN ] MGR: Generated 1339 derivative records from 4160 primary records. [2025-09-16T21:17:56.224176] [DEBUG] [LOCAL ] MGR: Saving derivative data. [2025-09-16T21:17:56.240724] [DEBUG] [LOCAL ] MGR: Derivative data saved (1339 records). [2025-09-16T21:17:56.250601] [INFO ] [MAIN ] MGR: Successfully saved derivative data. [2025-09-16T21:17:56.252551] [INFO ] [MAIN ] Derivative Progress: 1117/2026 symbols completed. MGR took 0.9s. Estimated remaining: 4m 57s. Rate: 183.9 symbols/min [2025-09-16T21:17:56.252895] [INFO ] [MAIN ] MGRE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:56.253251] [DEBUG] [MAIN ] MGRB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:56.254575] [INFO ] [MAIN ] MGRB: Generated 1339 derivative records from 3049 primary records. [2025-09-16T21:17:56.254803] [DEBUG] [LOCAL ] MGRB: Saving derivative data. [2025-09-16T21:17:56.267863] [DEBUG] [LOCAL ] MGRB: Derivative data saved (1339 records). [2025-09-16T21:17:56.268211] [INFO ] [MAIN ] MGRB: Successfully saved derivative data. [2025-09-16T21:17:56.270359] [INFO ] [MAIN ] Derivative Progress: 1118/2026 symbols completed. MGRB took 0.8s. Estimated remaining: 4m 56s. Rate: 184.1 symbols/min [2025-09-16T21:17:56.270608] [INFO ] [MAIN ] MGY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:56.273871] [DEBUG] [LOCAL ] MGRE: Loaded 4916 existing records from primary storage. [2025-09-16T21:17:56.274882] [INFO ] [MAIN ] MGRE: Loaded 4916 primary data records. [2025-09-16T21:17:56.361100] [DEBUG] [MAIN ] MGRD: Filtered 5181 bins outside market hours, 5783 incomplete bins [2025-09-16T21:17:56.388259] [INFO ] [MAIN ] MGRD: Generated 1335 derivative records from 1647 primary records. [2025-09-16T21:17:56.388424] [DEBUG] [LOCAL ] MGRD: Saving derivative data. [2025-09-16T21:17:56.606438] [DEBUG] [LOCAL ] MGRD: Derivative data saved (1335 records). [2025-09-16T21:17:56.606710] [INFO ] [MAIN ] MGRD: Successfully saved derivative data. [2025-09-16T21:17:56.608747] [INFO ] [MAIN ] Derivative Progress: 1119/2026 symbols completed. MGRD took 0.9s. Estimated remaining: 4m 56s. Rate: 184.0 symbols/min [2025-09-16T21:17:56.609101] [INFO ] [MAIN ] MHD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:56.621792] [DEBUG] [LOCAL ] MGY: Loaded 39012 existing records from primary storage. [2025-09-16T21:17:56.622374] [INFO ] [MAIN ] MGY: Loaded 39012 primary data records. [2025-09-16T21:17:56.722038] [DEBUG] [LOCAL ] MHD: Loaded 8795 existing records from primary storage. [2025-09-16T21:17:56.733367] [INFO ] [MAIN ] MHD: Loaded 8795 primary data records. [2025-09-16T21:17:57.198800] [DEBUG] [MAIN ] MGRE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:57.213094] [INFO ] [MAIN ] MGRE: Generated 1339 derivative records from 4916 primary records. [2025-09-16T21:17:57.213410] [DEBUG] [LOCAL ] MGRE: Saving derivative data. [2025-09-16T21:17:57.232338] [DEBUG] [LOCAL ] MGRE: Derivative data saved (1339 records). [2025-09-16T21:17:57.232998] [INFO ] [MAIN ] MGRE: Successfully saved derivative data. [2025-09-16T21:17:57.236173] [INFO ] [MAIN ] Derivative Progress: 1120/2026 symbols completed. MGRE took 1.0s. Estimated remaining: 4m 56s. Rate: 183.9 symbols/min [2025-09-16T21:17:57.236698] [INFO ] [MAIN ] MHF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:57.266221] [DEBUG] [LOCAL ] MHF: Loaded 6905 existing records from primary storage. [2025-09-16T21:17:57.262796] [DEBUG] [MAIN ] MGY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:57.267315] [INFO ] [MAIN ] MHF: Loaded 6905 primary data records. [2025-09-16T21:17:57.267211] [INFO ] [MAIN ] MGY: Generated 1339 derivative records from 39012 primary records. [2025-09-16T21:17:57.267441] [DEBUG] [LOCAL ] MGY: Saving derivative data. [2025-09-16T21:17:57.412560] [DEBUG] [MAIN ] MHD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:57.430189] [INFO ] [MAIN ] MHD: Generated 1339 derivative records from 8795 primary records. [2025-09-16T21:17:57.432509] [DEBUG] [LOCAL ] MGY: Derivative data saved (1339 records). [2025-09-16T21:17:57.453806] [DEBUG] [LOCAL ] MHD: Saving derivative data. [2025-09-16T21:17:57.453692] [INFO ] [MAIN ] MGY: Successfully saved derivative data. [2025-09-16T21:17:57.462401] [INFO ] [MAIN ] Derivative Progress: 1121/2026 symbols completed. MGY took 1.2s. Estimated remaining: 4m 55s. Rate: 183.9 symbols/min [2025-09-16T21:17:57.517625] [INFO ] [MAIN ] MHK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:57.562557] [DEBUG] [LOCAL ] MHD: Derivative data saved (1339 records). [2025-09-16T21:17:57.680322] [INFO ] [MAIN ] MHD: Successfully saved derivative data. [2025-09-16T21:17:57.683700] [INFO ] [MAIN ] Derivative Progress: 1122/2026 symbols completed. MHD took 1.1s. Estimated remaining: 4m 55s. Rate: 184.0 symbols/min [2025-09-16T21:17:57.684153] [INFO ] [MAIN ] MHN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:57.701854] [DEBUG] [LOCAL ] MHN: Loaded 5615 existing records from primary storage. [2025-09-16T21:17:57.702351] [INFO ] [MAIN ] MHN: Loaded 5615 primary data records. [2025-09-16T21:17:57.876525] [DEBUG] [LOCAL ] MHK: Loaded 31599 existing records from primary storage. [2025-09-16T21:17:57.898625] [INFO ] [MAIN ] MHK: Loaded 31599 primary data records. [2025-09-16T21:17:57.982789] [DEBUG] [MAIN ] MHF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:58.033552] [INFO ] [MAIN ] MHF: Generated 1339 derivative records from 6905 primary records. [2025-09-16T21:17:58.098114] [DEBUG] [LOCAL ] MHF: Saving derivative data. [2025-09-16T21:17:58.363330] [DEBUG] [LOCAL ] MHF: Derivative data saved (1339 records). [2025-09-16T21:17:58.366244] [INFO ] [MAIN ] MHF: Successfully saved derivative data. [2025-09-16T21:17:58.458990] [INFO ] [MAIN ] Derivative Progress: 1123/2026 symbols completed. MHF took 1.2s. Estimated remaining: 4m 55s. Rate: 183.8 symbols/min [2025-09-16T21:17:58.478137] [DEBUG] [MAIN ] MHN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:58.478918] [INFO ] [MAIN ] MHN: Generated 1339 derivative records from 5615 primary records. [2025-09-16T21:17:58.479179] [DEBUG] [LOCAL ] MHN: Saving derivative data. [2025-09-16T21:17:58.490988] [DEBUG] [LOCAL ] MHN: Derivative data saved (1339 records). [2025-09-16T21:17:58.491065] [INFO ] [MAIN ] MHN: Successfully saved derivative data. [2025-09-16T21:17:58.493103] [INFO ] [MAIN ] Derivative Progress: 1124/2026 symbols completed. MHN took 0.8s. Estimated remaining: 4m 54s. Rate: 183.9 symbols/min [2025-09-16T21:17:58.504626] [DEBUG] [MAIN ] MHK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:58.505164] [INFO ] [MAIN ] MHK: Generated 1339 derivative records from 31599 primary records. [2025-09-16T21:17:58.505224] [DEBUG] [LOCAL ] MHK: Saving derivative data. [2025-09-16T21:17:58.516657] [DEBUG] [LOCAL ] MHK: Derivative data saved (1339 records). [2025-09-16T21:17:58.516716] [INFO ] [MAIN ] MHK: Successfully saved derivative data. [2025-09-16T21:17:58.518784] [INFO ] [MAIN ] Derivative Progress: 1125/2026 symbols completed. MHK took 1.0s. Estimated remaining: 4m 54s. Rate: 184.1 symbols/min [2025-09-16T21:17:58.519218] [INFO ] [MAIN ] MIN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:58.519633] [INFO ] [MAIN ] MIR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:58.519550] [INFO ] [MAIN ] MHO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:58.536521] [DEBUG] [LOCAL ] MIN: Loaded 10688 existing records from primary storage. [2025-09-16T21:17:58.536717] [INFO ] [MAIN ] MIN: Loaded 10688 primary data records. [2025-09-16T21:17:58.657469] [DEBUG] [LOCAL ] MHO: Loaded 17852 existing records from primary storage. [2025-09-16T21:17:58.657729] [INFO ] [MAIN ] MHO: Loaded 17852 primary data records. [2025-09-16T21:17:58.936266] [DEBUG] [LOCAL ] MIR: Loaded 38141 existing records from primary storage. [2025-09-16T21:17:58.947324] [INFO ] [MAIN ] MIR: Loaded 38141 primary data records. [2025-09-16T21:17:59.426851] [DEBUG] [MAIN ] MIN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:59.427793] [INFO ] [MAIN ] MIN: Generated 1339 derivative records from 10688 primary records. [2025-09-16T21:17:59.428069] [DEBUG] [LOCAL ] MIN: Saving derivative data. [2025-09-16T21:17:59.443113] [DEBUG] [LOCAL ] MIN: Derivative data saved (1339 records). [2025-09-16T21:17:59.443393] [INFO ] [MAIN ] MIN: Successfully saved derivative data. [2025-09-16T21:17:59.445525] [INFO ] [MAIN ] Derivative Progress: 1126/2026 symbols completed. MIN took 0.9s. Estimated remaining: 4m 54s. Rate: 183.8 symbols/min [2025-09-16T21:17:59.455220] [INFO ] [MAIN ] MITP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:59.455480] [DEBUG] [MAIN ] MHO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:59.456859] [INFO ] [MAIN ] MHO: Generated 1339 derivative records from 17852 primary records. [2025-09-16T21:17:59.457157] [DEBUG] [LOCAL ] MHO: Saving derivative data. [2025-09-16T21:17:59.473305] [DEBUG] [LOCAL ] MITP: Loaded 1620 existing records from primary storage. [2025-09-16T21:17:59.479970] [INFO ] [MAIN ] MITP: Loaded 1620 primary data records. [2025-09-16T21:17:59.484251] [DEBUG] [LOCAL ] MHO: Derivative data saved (1339 records). [2025-09-16T21:17:59.515500] [DEBUG] [MAIN ] MIR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:17:59.527571] [INFO ] [MAIN ] MHO: Successfully saved derivative data. [2025-09-16T21:17:59.555900] [INFO ] [MAIN ] Derivative Progress: 1127/2026 symbols completed. MHO took 1.0s. Estimated remaining: 4m 53s. Rate: 183.9 symbols/min [2025-09-16T21:17:59.553877] [INFO ] [MAIN ] MIR: Generated 1339 derivative records from 38141 primary records. [2025-09-16T21:17:59.556159] [INFO ] [MAIN ] MIY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:17:59.561338] [DEBUG] [LOCAL ] MIR: Saving derivative data. [2025-09-16T21:17:59.644822] [DEBUG] [LOCAL ] MIY: Loaded 4430 existing records from primary storage. [2025-09-16T21:17:59.645387] [INFO ] [MAIN ] MIY: Loaded 4430 primary data records. [2025-09-16T21:17:59.794837] [DEBUG] [LOCAL ] MIR: Derivative data saved (1339 records). [2025-09-16T21:17:59.844781] [INFO ] [MAIN ] MIR: Successfully saved derivative data. [2025-09-16T21:17:59.870319] [INFO ] [MAIN ] Derivative Progress: 1128/2026 symbols completed. MIR took 1.4s. Estimated remaining: 4m 53s. Rate: 183.9 symbols/min [2025-09-16T21:17:59.871319] [INFO ] [MAIN ] MKC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:00.067389] [DEBUG] [MAIN ] MITP: Filtered 5181 bins outside market hours, 5780 incomplete bins [2025-09-16T21:18:00.068815] [INFO ] [MAIN ] MITP: Generated 1338 derivative records from 1620 primary records. [2025-09-16T21:18:00.069003] [DEBUG] [LOCAL ] MITP: Saving derivative data. [2025-09-16T21:18:00.080475] [DEBUG] [LOCAL ] MITP: Derivative data saved (1338 records). [2025-09-16T21:18:00.091507] [INFO ] [MAIN ] MITP: Successfully saved derivative data. [2025-09-16T21:18:00.093322] [INFO ] [MAIN ] Derivative Progress: 1129/2026 symbols completed. MITP took 0.6s. Estimated remaining: 4m 53s. Rate: 183.9 symbols/min [2025-09-16T21:18:00.094341] [DEBUG] [LOCAL ] MKC: Loaded 39110 existing records from primary storage. [2025-09-16T21:18:00.094627] [INFO ] [MAIN ] MKC: Loaded 39110 primary data records. [2025-09-16T21:18:00.115813] [INFO ] [MAIN ] MKL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:00.211038] [DEBUG] [MAIN ] MIY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:00.211926] [INFO ] [MAIN ] MIY: Generated 1339 derivative records from 4430 primary records. [2025-09-16T21:18:00.222921] [DEBUG] [LOCAL ] MIY: Saving derivative data. [2025-09-16T21:18:00.394414] [DEBUG] [LOCAL ] MIY: Derivative data saved (1339 records). [2025-09-16T21:18:00.394722] [INFO ] [MAIN ] MIY: Successfully saved derivative data. [2025-09-16T21:18:00.396831] [INFO ] [MAIN ] Derivative Progress: 1130/2026 symbols completed. MIY took 0.8s. Estimated remaining: 4m 52s. Rate: 183.9 symbols/min [2025-09-16T21:18:00.404361] [INFO ] [MAIN ] MLI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:00.406840] [DEBUG] [LOCAL ] MKL: Loaded 25288 existing records from primary storage. [2025-09-16T21:18:00.407223] [INFO ] [MAIN ] MKL: Loaded 25288 primary data records. [2025-09-16T21:18:00.695121] [DEBUG] [LOCAL ] MLI: Loaded 32230 existing records from primary storage. [2025-09-16T21:18:00.695439] [INFO ] [MAIN ] MLI: Loaded 32230 primary data records. [2025-09-16T21:18:00.857169] [DEBUG] [MAIN ] MKC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:00.978783] [INFO ] [MAIN ] MKC: Generated 1339 derivative records from 39110 primary records. [2025-09-16T21:18:00.979546] [DEBUG] [LOCAL ] MKC: Saving derivative data. [2025-09-16T21:18:01.005406] [DEBUG] [MAIN ] MKL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:01.006859] [INFO ] [MAIN ] MKL: Generated 1339 derivative records from 25288 primary records. [2025-09-16T21:18:01.007276] [DEBUG] [LOCAL ] MKL: Saving derivative data. [2025-09-16T21:18:01.008321] [DEBUG] [LOCAL ] MKC: Derivative data saved (1339 records). [2025-09-16T21:18:01.008613] [INFO ] [MAIN ] MKC: Successfully saved derivative data. [2025-09-16T21:18:01.016525] [INFO ] [MAIN ] Derivative Progress: 1131/2026 symbols completed. MKC took 1.1s. Estimated remaining: 4m 52s. Rate: 183.8 symbols/min [2025-09-16T21:18:01.020819] [INFO ] [MAIN ] MLM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:01.024663] [DEBUG] [LOCAL ] MKL: Derivative data saved (1339 records). [2025-09-16T21:18:01.024844] [INFO ] [MAIN ] MKL: Successfully saved derivative data. [2025-09-16T21:18:01.027069] [INFO ] [MAIN ] Derivative Progress: 1132/2026 symbols completed. MKL took 0.9s. Estimated remaining: 4m 52s. Rate: 184.0 symbols/min [2025-09-16T21:18:01.027297] [INFO ] [MAIN ] MLNK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:01.048063] [DEBUG] [MAIN ] MLI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:01.053479] [INFO ] [MAIN ] MLI: Generated 1339 derivative records from 32230 primary records. [2025-09-16T21:18:01.053671] [DEBUG] [LOCAL ] MLI: Saving derivative data. [2025-09-16T21:18:01.070596] [DEBUG] [LOCAL ] MLNK: Loaded 19036 existing records from primary storage. [2025-09-16T21:18:01.071464] [INFO ] [MAIN ] MLNK: Loaded 19036 primary data records. [2025-09-16T21:18:01.078923] [DEBUG] [LOCAL ] MLI: Derivative data saved (1339 records). [2025-09-16T21:18:01.091982] [INFO ] [MAIN ] MLI: Successfully saved derivative data. [2025-09-16T21:18:01.102100] [DEBUG] [LOCAL ] MLM: Loaded 21554 existing records from primary storage. [2025-09-16T21:18:01.114246] [INFO ] [MAIN ] Derivative Progress: 1133/2026 symbols completed. MLI took 0.7s. Estimated remaining: 4m 51s. Rate: 184.1 symbols/min [2025-09-16T21:18:01.114353] [INFO ] [MAIN ] MLM: Loaded 21554 primary data records. [2025-09-16T21:18:01.119750] [INFO ] [MAIN ] MLP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:01.312461] [DEBUG] [LOCAL ] MLP: Loaded 2271 existing records from primary storage. [2025-09-16T21:18:01.337942] [INFO ] [MAIN ] MLP: Loaded 2271 primary data records. [2025-09-16T21:18:01.931012] [DEBUG] [MAIN ] MLM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:01.941152] [INFO ] [MAIN ] MLM: Generated 1339 derivative records from 21554 primary records. [2025-09-16T21:18:01.941562] [DEBUG] [LOCAL ] MLM: Saving derivative data. [2025-09-16T21:18:01.941505] [DEBUG] [MAIN ] MLNK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:01.942725] [INFO ] [MAIN ] MLNK: Generated 1339 derivative records from 19036 primary records. [2025-09-16T21:18:01.943197] [DEBUG] [LOCAL ] MLNK: Saving derivative data. [2025-09-16T21:18:01.964526] [DEBUG] [LOCAL ] MLNK: Derivative data saved (1339 records). [2025-09-16T21:18:01.965586] [INFO ] [MAIN ] MLNK: Successfully saved derivative data. [2025-09-16T21:18:01.967591] [INFO ] [MAIN ] Derivative Progress: 1134/2026 symbols completed. MLNK took 0.9s. Estimated remaining: 4m 51s. Rate: 183.8 symbols/min [2025-09-16T21:18:01.969682] [INFO ] [MAIN ] MLR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:01.971812] [DEBUG] [LOCAL ] MLM: Derivative data saved (1339 records). [2025-09-16T21:18:01.981743] [DEBUG] [MAIN ] MLP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:01.982445] [INFO ] [MAIN ] MLP: Generated 1339 derivative records from 2271 primary records. [2025-09-16T21:18:01.982501] [INFO ] [MAIN ] MLM: Successfully saved derivative data. [2025-09-16T21:18:01.984682] [INFO ] [MAIN ] Derivative Progress: 1135/2026 symbols completed. MLM took 1.0s. Estimated remaining: 4m 51s. Rate: 184.0 symbols/min [2025-09-16T21:18:01.982583] [DEBUG] [LOCAL ] MLP: Saving derivative data. [2025-09-16T21:18:01.987778] [INFO ] [MAIN ] MMC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:01.997410] [DEBUG] [LOCAL ] MLP: Derivative data saved (1339 records). [2025-09-16T21:18:01.997490] [INFO ] [MAIN ] MLP: Successfully saved derivative data. [2025-09-16T21:18:02.002855] [INFO ] [MAIN ] Derivative Progress: 1136/2026 symbols completed. MLP took 0.9s. Estimated remaining: 4m 50s. Rate: 184.1 symbols/min [2025-09-16T21:18:02.003105] [DEBUG] [LOCAL ] MLR: Loaded 8483 existing records from primary storage. [2025-09-16T21:18:02.003313] [INFO ] [MAIN ] MLR: Loaded 8483 primary data records. [2025-09-16T21:18:02.003449] [INFO ] [MAIN ] MMD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:02.130741] [DEBUG] [LOCAL ] MMD: Loaded 7827 existing records from primary storage. [2025-09-16T21:18:02.141234] [INFO ] [MAIN ] MMD: Loaded 7827 primary data records. [2025-09-16T21:18:02.401726] [DEBUG] [LOCAL ] MMC: Loaded 38574 existing records from primary storage. [2025-09-16T21:18:02.437031] [INFO ] [MAIN ] MMC: Loaded 38574 primary data records. [2025-09-16T21:18:02.832899] [DEBUG] [MAIN ] MLR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:02.834129] [INFO ] [MAIN ] MLR: Generated 1339 derivative records from 8483 primary records. [2025-09-16T21:18:02.834616] [DEBUG] [LOCAL ] MLR: Saving derivative data. [2025-09-16T21:18:02.859115] [DEBUG] [LOCAL ] MLR: Derivative data saved (1339 records). [2025-09-16T21:18:02.859342] [DEBUG] [MAIN ] MMD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:02.859539] [INFO ] [MAIN ] MLR: Successfully saved derivative data. [2025-09-16T21:18:02.861381] [INFO ] [MAIN ] Derivative Progress: 1137/2026 symbols completed. MLR took 0.9s. Estimated remaining: 4m 50s. Rate: 183.9 symbols/min [2025-09-16T21:18:02.862059] [INFO ] [MAIN ] MMD: Generated 1339 derivative records from 7827 primary records. [2025-09-16T21:18:02.862454] [INFO ] [MAIN ] MMI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:02.862892] [DEBUG] [LOCAL ] MMD: Saving derivative data. [2025-09-16T21:18:02.880000] [DEBUG] [LOCAL ] MMD: Derivative data saved (1339 records). [2025-09-16T21:18:02.880170] [INFO ] [MAIN ] MMD: Successfully saved derivative data. [2025-09-16T21:18:02.881993] [INFO ] [MAIN ] Derivative Progress: 1138/2026 symbols completed. MMD took 0.9s. Estimated remaining: 4m 50s. Rate: 184.0 symbols/min [2025-09-16T21:18:02.895907] [DEBUG] [LOCAL ] MMI: Loaded 10858 existing records from primary storage. [2025-09-16T21:18:02.895992] [INFO ] [MAIN ] MMI: Loaded 10858 primary data records. [2025-09-16T21:18:02.895850] [DEBUG] [MAIN ] MMC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:02.928040] [INFO ] [MAIN ] MMC: Generated 1339 derivative records from 38574 primary records. [2025-09-16T21:18:02.968011] [DEBUG] [LOCAL ] MMC: Saving derivative data. [2025-09-16T21:18:03.168061] [DEBUG] [LOCAL ] MMC: Derivative data saved (1339 records). [2025-09-16T21:18:03.168181] [INFO ] [MAIN ] MMC: Successfully saved derivative data. [2025-09-16T21:18:03.170589] [INFO ] [MAIN ] Derivative Progress: 1139/2026 symbols completed. MMC took 1.2s. Estimated remaining: 4m 49s. Rate: 184.0 symbols/min [2025-09-16T21:18:03.188224] [DEBUG] [MAIN ] MMI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:03.188973] [INFO ] [MAIN ] MMI: Generated 1339 derivative records from 10858 primary records. [2025-09-16T21:18:03.189038] [DEBUG] [LOCAL ] MMI: Saving derivative data. [2025-09-16T21:18:03.200515] [DEBUG] [LOCAL ] MMI: Derivative data saved (1339 records). [2025-09-16T21:18:03.200572] [INFO ] [MAIN ] MMI: Successfully saved derivative data. [2025-09-16T21:18:03.202150] [INFO ] [MAIN ] Derivative Progress: 1140/2026 symbols completed. MMI took 0.3s. Estimated remaining: 4m 49s. Rate: 184.2 symbols/min [2025-09-16T21:18:03.202594] [INFO ] [MAIN ] MMS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:03.202852] [INFO ] [MAIN ] MMT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:03.202762] [INFO ] [MAIN ] MMM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:03.212390] [DEBUG] [LOCAL ] MMT: Loaded 7760 existing records from primary storage. [2025-09-16T21:18:03.212567] [INFO ] [MAIN ] MMT: Loaded 7760 primary data records. [2025-09-16T21:18:03.416324] [DEBUG] [LOCAL ] MMS: Loaded 24619 existing records from primary storage. [2025-09-16T21:18:03.496494] [INFO ] [MAIN ] MMS: Loaded 24619 primary data records. [2025-09-16T21:18:03.556044] [DEBUG] [LOCAL ] MMM: Loaded 39647 existing records from primary storage. [2025-09-16T21:18:03.579308] [INFO ] [MAIN ] MMM: Loaded 39647 primary data records. [2025-09-16T21:18:04.091165] [DEBUG] [MAIN ] MMT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:04.092935] [INFO ] [MAIN ] MMT: Generated 1339 derivative records from 7760 primary records. [2025-09-16T21:18:04.093302] [DEBUG] [LOCAL ] MMT: Saving derivative data. [2025-09-16T21:18:04.106386] [DEBUG] [LOCAL ] MMT: Derivative data saved (1339 records). [2025-09-16T21:18:04.106626] [INFO ] [MAIN ] MMT: Successfully saved derivative data. [2025-09-16T21:18:04.108927] [INFO ] [MAIN ] Derivative Progress: 1141/2026 symbols completed. MMT took 0.9s. Estimated remaining: 4m 49s. Rate: 183.9 symbols/min [2025-09-16T21:18:04.109159] [INFO ] [MAIN ] MMU: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:04.124953] [DEBUG] [MAIN ] MMS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:04.137877] [DEBUG] [MAIN ] MMM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:04.137570] [INFO ] [MAIN ] MMS: Generated 1339 derivative records from 24619 primary records. [2025-09-16T21:18:04.138658] [DEBUG] [LOCAL ] MMS: Saving derivative data. [2025-09-16T21:18:04.138599] [INFO ] [MAIN ] MMM: Generated 1339 derivative records from 39647 primary records. [2025-09-16T21:18:04.139291] [DEBUG] [LOCAL ] MMM: Saving derivative data. [2025-09-16T21:18:04.159356] [DEBUG] [LOCAL ] MMU: Loaded 12224 existing records from primary storage. [2025-09-16T21:18:04.161427] [INFO ] [MAIN ] MMU: Loaded 12224 primary data records. [2025-09-16T21:18:04.223152] [DEBUG] [LOCAL ] MMS: Derivative data saved (1339 records). [2025-09-16T21:18:04.240795] [INFO ] [MAIN ] MMS: Successfully saved derivative data. [2025-09-16T21:18:04.242393] [INFO ] [MAIN ] Derivative Progress: 1142/2026 symbols completed. MMS took 1.0s. Estimated remaining: 4m 48s. Rate: 184.0 symbols/min [2025-09-16T21:18:04.240721] [DEBUG] [LOCAL ] MMM: Derivative data saved (1339 records). [2025-09-16T21:18:04.273583] [INFO ] [MAIN ] MMM: Successfully saved derivative data. [2025-09-16T21:18:04.277056] [INFO ] [MAIN ] MNR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:04.279347] [INFO ] [MAIN ] Derivative Progress: 1143/2026 symbols completed. MMM took 1.1s. Estimated remaining: 4m 48s. Rate: 184.1 symbols/min [2025-09-16T21:18:04.285745] [INFO ] [MAIN ] MNSO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:04.460818] [DEBUG] [LOCAL ] MNR: Loaded 18688 existing records from primary storage. [2025-09-16T21:18:04.461100] [INFO ] [MAIN ] MNR: Loaded 18688 primary data records. [2025-09-16T21:18:04.576063] [DEBUG] [LOCAL ] MNSO: Loaded 31998 existing records from primary storage. [2025-09-16T21:18:04.587544] [INFO ] [MAIN ] MNSO: Loaded 31998 primary data records. [2025-09-16T21:18:05.007311] [DEBUG] [MAIN ] MMU: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:05.008138] [INFO ] [MAIN ] MMU: Generated 1339 derivative records from 12224 primary records. [2025-09-16T21:18:05.008243] [DEBUG] [LOCAL ] MMU: Saving derivative data. [2025-09-16T21:18:05.022496] [DEBUG] [LOCAL ] MMU: Derivative data saved (1339 records). [2025-09-16T21:18:05.022754] [INFO ] [MAIN ] MMU: Successfully saved derivative data. [2025-09-16T21:18:05.024636] [INFO ] [MAIN ] Derivative Progress: 1144/2026 symbols completed. MMU took 0.9s. Estimated remaining: 4m 48s. Rate: 183.9 symbols/min [2025-09-16T21:18:05.025176] [INFO ] [MAIN ] MO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:05.040706] [DEBUG] [MAIN ] MNR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:05.041497] [INFO ] [MAIN ] MNR: Generated 1339 derivative records from 18688 primary records. [2025-09-16T21:18:05.041766] [DEBUG] [LOCAL ] MNR: Saving derivative data. [2025-09-16T21:18:05.056683] [DEBUG] [LOCAL ] MNR: Derivative data saved (1339 records). [2025-09-16T21:18:05.056826] [INFO ] [MAIN ] MNR: Successfully saved derivative data. [2025-09-16T21:18:05.058673] [INFO ] [MAIN ] Derivative Progress: 1145/2026 symbols completed. MNR took 0.8s. Estimated remaining: 4m 47s. Rate: 184.1 symbols/min [2025-09-16T21:18:05.058983] [INFO ] [MAIN ] MOD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:05.068820] [DEBUG] [MAIN ] MNSO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:05.078777] [INFO ] [MAIN ] MNSO: Generated 1339 derivative records from 31998 primary records. [2025-09-16T21:18:05.079004] [DEBUG] [LOCAL ] MNSO: Saving derivative data. [2025-09-16T21:18:05.102780] [DEBUG] [LOCAL ] MNSO: Derivative data saved (1339 records). [2025-09-16T21:18:05.103476] [DEBUG] [LOCAL ] MO: Loaded 40104 existing records from primary storage. [2025-09-16T21:18:05.102905] [INFO ] [MAIN ] MNSO: Successfully saved derivative data. [2025-09-16T21:18:05.105771] [INFO ] [MAIN ] Derivative Progress: 1146/2026 symbols completed. MNSO took 0.8s. Estimated remaining: 4m 47s. Rate: 184.2 symbols/min [2025-09-16T21:18:05.106123] [INFO ] [MAIN ] MODG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:05.105935] [INFO ] [MAIN ] MO: Loaded 40104 primary data records. [2025-09-16T21:18:05.236748] [DEBUG] [LOCAL ] MOD: Loaded 33252 existing records from primary storage. [2025-09-16T21:18:05.287818] [INFO ] [MAIN ] MOD: Loaded 33252 primary data records. [2025-09-16T21:18:05.514588] [DEBUG] [LOCAL ] MODG: Loaded 38532 existing records from primary storage. [2025-09-16T21:18:05.515221] [INFO ] [MAIN ] MODG: Loaded 38532 primary data records. [2025-09-16T21:18:05.986657] [DEBUG] [MAIN ] MO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:05.987721] [INFO ] [MAIN ] MO: Generated 1339 derivative records from 40104 primary records. [2025-09-16T21:18:05.988825] [DEBUG] [LOCAL ] MO: Saving derivative data. [2025-09-16T21:18:06.013113] [DEBUG] [MAIN ] MOD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:06.014436] [INFO ] [MAIN ] MOD: Generated 1339 derivative records from 33252 primary records. [2025-09-16T21:18:06.014813] [DEBUG] [LOCAL ] MOD: Saving derivative data. [2025-09-16T21:18:06.016437] [DEBUG] [LOCAL ] MO: Derivative data saved (1339 records). [2025-09-16T21:18:06.022226] [INFO ] [MAIN ] MO: Successfully saved derivative data. [2025-09-16T21:18:06.024138] [INFO ] [MAIN ] Derivative Progress: 1147/2026 symbols completed. MO took 1.0s. Estimated remaining: 4m 47s. Rate: 183.9 symbols/min [2025-09-16T21:18:06.027469] [INFO ] [MAIN ] MOH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:06.034540] [DEBUG] [LOCAL ] MOD: Derivative data saved (1339 records). [2025-09-16T21:18:06.034775] [INFO ] [MAIN ] MOD: Successfully saved derivative data. [2025-09-16T21:18:06.036885] [INFO ] [MAIN ] Derivative Progress: 1148/2026 symbols completed. MOD took 1.0s. Estimated remaining: 4m 46s. Rate: 184.1 symbols/min [2025-09-16T21:18:06.037124] [INFO ] [MAIN ] MOS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:06.047084] [DEBUG] [MAIN ] MODG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:06.047872] [INFO ] [MAIN ] MODG: Generated 1339 derivative records from 38532 primary records. [2025-09-16T21:18:06.048022] [DEBUG] [LOCAL ] MODG: Saving derivative data. [2025-09-16T21:18:06.068119] [DEBUG] [LOCAL ] MODG: Derivative data saved (1339 records). [2025-09-16T21:18:06.068247] [INFO ] [MAIN ] MODG: Successfully saved derivative data. [2025-09-16T21:18:06.070502] [INFO ] [MAIN ] Derivative Progress: 1149/2026 symbols completed. MODG took 1.0s. Estimated remaining: 4m 46s. Rate: 184.2 symbols/min [2025-09-16T21:18:06.070839] [INFO ] [MAIN ] MOV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:06.085623] [DEBUG] [LOCAL ] MOH: Loaded 31868 existing records from primary storage. [2025-09-16T21:18:06.085864] [INFO ] [MAIN ] MOH: Loaded 31868 primary data records. [2025-09-16T21:18:06.217744] [DEBUG] [LOCAL ] MOV: Loaded 15530 existing records from primary storage. [2025-09-16T21:18:06.229204] [INFO ] [MAIN ] MOV: Loaded 15530 primary data records. [2025-09-16T21:18:06.309408] [DEBUG] [LOCAL ] MOS: Loaded 39894 existing records from primary storage. [2025-09-16T21:18:06.344435] [INFO ] [MAIN ] MOS: Loaded 39894 primary data records. [2025-09-16T21:18:06.940195] [DEBUG] [MAIN ] MOH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:06.942124] [INFO ] [MAIN ] MOH: Generated 1339 derivative records from 31868 primary records. [2025-09-16T21:18:06.942809] [DEBUG] [LOCAL ] MOH: Saving derivative data. [2025-09-16T21:18:06.962552] [DEBUG] [MAIN ] MOV: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:06.963831] [INFO ] [MAIN ] MOV: Generated 1339 derivative records from 15530 primary records. [2025-09-16T21:18:06.964420] [DEBUG] [LOCAL ] MOV: Saving derivative data. [2025-09-16T21:18:06.977036] [DEBUG] [LOCAL ] MOH: Derivative data saved (1339 records). [2025-09-16T21:18:06.979004] [DEBUG] [LOCAL ] MOV: Derivative data saved (1339 records). [2025-09-16T21:18:06.979225] [INFO ] [MAIN ] MOH: Successfully saved derivative data. [2025-09-16T21:18:06.981093] [INFO ] [MAIN ] Derivative Progress: 1150/2026 symbols completed. MOH took 1.0s. Estimated remaining: 4m 46s. Rate: 183.9 symbols/min [2025-09-16T21:18:06.979349] [INFO ] [MAIN ] MOV: Successfully saved derivative data. [2025-09-16T21:18:06.986869] [INFO ] [MAIN ] MP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:06.992613] [INFO ] [MAIN ] Derivative Progress: 1151/2026 symbols completed. MOV took 0.9s. Estimated remaining: 4m 45s. Rate: 184.1 symbols/min [2025-09-16T21:18:06.993012] [DEBUG] [MAIN ] MOS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:06.993448] [INFO ] [MAIN ] MPA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:06.994227] [INFO ] [MAIN ] MOS: Generated 1339 derivative records from 39894 primary records. [2025-09-16T21:18:06.994310] [DEBUG] [LOCAL ] MOS: Saving derivative data. [2025-09-16T21:18:07.013481] [DEBUG] [LOCAL ] MPA: Loaded 4016 existing records from primary storage. [2025-09-16T21:18:07.014185] [INFO ] [MAIN ] MPA: Loaded 4016 primary data records. [2025-09-16T21:18:07.014131] [DEBUG] [LOCAL ] MOS: Derivative data saved (1339 records). [2025-09-16T21:18:07.025514] [INFO ] [MAIN ] MOS: Successfully saved derivative data. [2025-09-16T21:18:07.037933] [INFO ] [MAIN ] Derivative Progress: 1152/2026 symbols completed. MOS took 1.0s. Estimated remaining: 4m 45s. Rate: 184.2 symbols/min [2025-09-16T21:18:07.060909] [INFO ] [MAIN ] MPC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:07.302276] [DEBUG] [LOCAL ] MP: Loaded 40094 existing records from primary storage. [2025-09-16T21:18:07.302468] [INFO ] [MAIN ] MP: Loaded 40094 primary data records. [2025-09-16T21:18:07.465180] [DEBUG] [LOCAL ] MPC: Loaded 38723 existing records from primary storage. [2025-09-16T21:18:07.497066] [INFO ] [MAIN ] MPC: Loaded 38723 primary data records. [2025-09-16T21:18:07.748155] [DEBUG] [MAIN ] MPA: Filtered 5181 bins outside market hours, 5781 incomplete bins [2025-09-16T21:18:07.759331] [INFO ] [MAIN ] MPA: Generated 1337 derivative records from 4016 primary records. [2025-09-16T21:18:07.774304] [DEBUG] [LOCAL ] MPA: Saving derivative data. [2025-09-16T21:18:07.943743] [DEBUG] [LOCAL ] MPA: Derivative data saved (1337 records). [2025-09-16T21:18:07.943959] [INFO ] [MAIN ] MPA: Successfully saved derivative data. [2025-09-16T21:18:07.945851] [INFO ] [MAIN ] Derivative Progress: 1153/2026 symbols completed. MPA took 1.0s. Estimated remaining: 4m 45s. Rate: 183.9 symbols/min [2025-09-16T21:18:07.960067] [DEBUG] [MAIN ] MP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:07.960775] [INFO ] [MAIN ] MP: Generated 1339 derivative records from 40094 primary records. [2025-09-16T21:18:07.961485] [DEBUG] [LOCAL ] MP: Saving derivative data. [2025-09-16T21:18:07.974763] [DEBUG] [LOCAL ] MP: Derivative data saved (1339 records). [2025-09-16T21:18:07.974977] [INFO ] [MAIN ] MP: Successfully saved derivative data. [2025-09-16T21:18:07.978244] [INFO ] [MAIN ] Derivative Progress: 1154/2026 symbols completed. MP took 1.0s. Estimated remaining: 4m 44s. Rate: 184.1 symbols/min [2025-09-16T21:18:07.988823] [DEBUG] [MAIN ] MPC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:07.989538] [INFO ] [MAIN ] MPC: Generated 1339 derivative records from 38723 primary records. [2025-09-16T21:18:07.989603] [DEBUG] [LOCAL ] MPC: Saving derivative data. [2025-09-16T21:18:08.001688] [DEBUG] [LOCAL ] MPC: Derivative data saved (1339 records). [2025-09-16T21:18:08.001809] [INFO ] [MAIN ] MPC: Successfully saved derivative data. [2025-09-16T21:18:08.003781] [INFO ] [MAIN ] Derivative Progress: 1155/2026 symbols completed. MPC took 0.9s. Estimated remaining: 4m 44s. Rate: 184.2 symbols/min [2025-09-16T21:18:08.004389] [INFO ] [MAIN ] MPLX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:08.004271] [INFO ] [MAIN ] MPX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:08.004590] [INFO ] [MAIN ] MQT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:08.010193] [DEBUG] [LOCAL ] MPX: Loaded 2879 existing records from primary storage. [2025-09-16T21:18:08.011638] [INFO ] [MAIN ] MPX: Loaded 2879 primary data records. [2025-09-16T21:18:08.048878] [DEBUG] [LOCAL ] MQT: Loaded 5341 existing records from primary storage. [2025-09-16T21:18:08.054939] [INFO ] [MAIN ] MQT: Loaded 5341 primary data records. [2025-09-16T21:18:08.495335] [DEBUG] [LOCAL ] MPLX: Loaded 37526 existing records from primary storage. [2025-09-16T21:18:08.496271] [INFO ] [MAIN ] MPLX: Loaded 37526 primary data records. [2025-09-16T21:18:08.883124] [DEBUG] [MAIN ] MPX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:08.887555] [INFO ] [MAIN ] MPX: Generated 1339 derivative records from 2879 primary records. [2025-09-16T21:18:08.888592] [DEBUG] [LOCAL ] MPX: Saving derivative data. [2025-09-16T21:18:08.889812] [DEBUG] [MAIN ] MQT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:08.898395] [INFO ] [MAIN ] MQT: Generated 1339 derivative records from 5341 primary records. [2025-09-16T21:18:08.898626] [DEBUG] [LOCAL ] MQT: Saving derivative data. [2025-09-16T21:18:08.901772] [DEBUG] [LOCAL ] MPX: Derivative data saved (1339 records). [2025-09-16T21:18:08.902047] [INFO ] [MAIN ] MPX: Successfully saved derivative data. [2025-09-16T21:18:08.905257] [INFO ] [MAIN ] Derivative Progress: 1156/2026 symbols completed. MPX took 0.9s. Estimated remaining: 4m 44s. Rate: 183.9 symbols/min [2025-09-16T21:18:08.913659] [INFO ] [MAIN ] MQY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:08.917105] [DEBUG] [LOCAL ] MQT: Derivative data saved (1339 records). [2025-09-16T21:18:08.917417] [INFO ] [MAIN ] MQT: Successfully saved derivative data. [2025-09-16T21:18:08.919467] [INFO ] [MAIN ] Derivative Progress: 1157/2026 symbols completed. MQT took 0.9s. Estimated remaining: 4m 43s. Rate: 184.1 symbols/min [2025-09-16T21:18:08.919751] [INFO ] [MAIN ] MRC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:08.935383] [DEBUG] [MAIN ] MPLX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:08.936095] [INFO ] [MAIN ] MPLX: Generated 1339 derivative records from 37526 primary records. [2025-09-16T21:18:08.936225] [DEBUG] [LOCAL ] MPLX: Saving derivative data. [2025-09-16T21:18:08.941983] [DEBUG] [LOCAL ] MQY: Loaded 11779 existing records from primary storage. [2025-09-16T21:18:08.947585] [INFO ] [MAIN ] MQY: Loaded 11779 primary data records. [2025-09-16T21:18:08.990235] [DEBUG] [LOCAL ] MPLX: Derivative data saved (1339 records). [2025-09-16T21:18:08.997243] [INFO ] [MAIN ] MPLX: Successfully saved derivative data. [2025-09-16T21:18:09.040432] [INFO ] [MAIN ] Derivative Progress: 1158/2026 symbols completed. MPLX took 1.0s. Estimated remaining: 4m 43s. Rate: 184.2 symbols/min [2025-09-16T21:18:09.065035] [INFO ] [MAIN ] MRK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:09.118323] [DEBUG] [LOCAL ] MRC: Loaded 27104 existing records from primary storage. [2025-09-16T21:18:09.129134] [INFO ] [MAIN ] MRC: Loaded 27104 primary data records. [2025-09-16T21:18:09.535256] [DEBUG] [LOCAL ] MRK: Loaded 40141 existing records from primary storage. [2025-09-16T21:18:09.535708] [INFO ] [MAIN ] MRK: Loaded 40141 primary data records. [2025-09-16T21:18:09.745441] [DEBUG] [MAIN ] MQY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:09.832561] [INFO ] [MAIN ] MQY: Generated 1339 derivative records from 11779 primary records. [2025-09-16T21:18:09.833214] [DEBUG] [LOCAL ] MQY: Saving derivative data. [2025-09-16T21:18:09.859493] [DEBUG] [MAIN ] MRC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:09.861316] [INFO ] [MAIN ] MRC: Generated 1339 derivative records from 27104 primary records. [2025-09-16T21:18:09.861918] [DEBUG] [LOCAL ] MRC: Saving derivative data. [2025-09-16T21:18:09.863564] [DEBUG] [LOCAL ] MQY: Derivative data saved (1339 records). [2025-09-16T21:18:09.864242] [INFO ] [MAIN ] MQY: Successfully saved derivative data. [2025-09-16T21:18:09.866544] [INFO ] [MAIN ] Derivative Progress: 1159/2026 symbols completed. MQY took 1.0s. Estimated remaining: 4m 43s. Rate: 183.9 symbols/min [2025-09-16T21:18:09.872710] [INFO ] [MAIN ] MRP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:09.880564] [DEBUG] [LOCAL ] MRC: Derivative data saved (1339 records). [2025-09-16T21:18:09.881186] [INFO ] [MAIN ] MRC: Successfully saved derivative data. [2025-09-16T21:18:09.883272] [INFO ] [MAIN ] Derivative Progress: 1160/2026 symbols completed. MRC took 1.0s. Estimated remaining: 4m 42s. Rate: 184.1 symbols/min [2025-09-16T21:18:09.883721] [INFO ] [MAIN ] MS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:09.898728] [DEBUG] [MAIN ] MRK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:09.899440] [INFO ] [MAIN ] MRK: Generated 1339 derivative records from 40141 primary records. [2025-09-16T21:18:09.899539] [DEBUG] [LOCAL ] MRK: Saving derivative data. [2025-09-16T21:18:09.914918] [DEBUG] [LOCAL ] MRK: Derivative data saved (1339 records). [2025-09-16T21:18:09.915138] [INFO ] [MAIN ] MRK: Successfully saved derivative data. [2025-09-16T21:18:09.917433] [INFO ] [MAIN ] Derivative Progress: 1161/2026 symbols completed. MRK took 0.9s. Estimated remaining: 4m 42s. Rate: 184.2 symbols/min [2025-09-16T21:18:09.917947] [INFO ] [MAIN ] MSA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:09.960173] [DEBUG] [LOCAL ] MRP: Loaded 34515 existing records from primary storage. [2025-09-16T21:18:09.960586] [DEBUG] [LOCAL ] MSA: Loaded 13942 existing records from primary storage. [2025-09-16T21:18:09.960698] [INFO ] [MAIN ] MRP: Loaded 34515 primary data records. [2025-09-16T21:18:09.960751] [INFO ] [MAIN ] MSA: Loaded 13942 primary data records. [2025-09-16T21:18:10.179698] [DEBUG] [LOCAL ] MS: Loaded 40047 existing records from primary storage. [2025-09-16T21:18:10.205741] [INFO ] [MAIN ] MS: Loaded 40047 primary data records. [2025-09-16T21:18:10.826189] [DEBUG] [MAIN ] MSA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:10.836045] [INFO ] [MAIN ] MSA: Generated 1339 derivative records from 13942 primary records. [2025-09-16T21:18:10.836194] [DEBUG] [LOCAL ] MSA: Saving derivative data. [2025-09-16T21:18:10.837123] [DEBUG] [MAIN ] MRP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:10.837704] [INFO ] [MAIN ] MRP: Generated 1339 derivative records from 34515 primary records. [2025-09-16T21:18:10.849201] [DEBUG] [LOCAL ] MRP: Saving derivative data. [2025-09-16T21:18:10.874759] [DEBUG] [LOCAL ] MSA: Derivative data saved (1339 records). [2025-09-16T21:18:10.875891] [INFO ] [MAIN ] MSA: Successfully saved derivative data. [2025-09-16T21:18:10.875345] [DEBUG] [MAIN ] MS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:10.878469] [INFO ] [MAIN ] Derivative Progress: 1162/2026 symbols completed. MSA took 1.0s. Estimated remaining: 4m 42s. Rate: 183.9 symbols/min [2025-09-16T21:18:10.879604] [INFO ] [MAIN ] MS: Generated 1339 derivative records from 40047 primary records. [2025-09-16T21:18:10.880665] [DEBUG] [LOCAL ] MS: Saving derivative data. [2025-09-16T21:18:10.880133] [INFO ] [MAIN ] MSB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:10.882184] [DEBUG] [LOCAL ] MRP: Derivative data saved (1339 records). [2025-09-16T21:18:10.882610] [INFO ] [MAIN ] MRP: Successfully saved derivative data. [2025-09-16T21:18:10.894015] [INFO ] [MAIN ] Derivative Progress: 1163/2026 symbols completed. MRP took 1.0s. Estimated remaining: 4m 41s. Rate: 184.1 symbols/min [2025-09-16T21:18:10.894533] [INFO ] [MAIN ] MSCI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:10.900497] [DEBUG] [LOCAL ] MS: Derivative data saved (1339 records). [2025-09-16T21:18:10.900742] [INFO ] [MAIN ] MS: Successfully saved derivative data. [2025-09-16T21:18:10.903494] [INFO ] [MAIN ] Derivative Progress: 1164/2026 symbols completed. MS took 1.0s. Estimated remaining: 4m 41s. Rate: 184.2 symbols/min [2025-09-16T21:18:10.907047] [DEBUG] [LOCAL ] MSB: Loaded 5977 existing records from primary storage. [2025-09-16T21:18:10.907292] [INFO ] [MAIN ] MSD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:10.907433] [INFO ] [MAIN ] MSB: Loaded 5977 primary data records. [2025-09-16T21:18:11.087065] [DEBUG] [LOCAL ] MSD: Loaded 12137 existing records from primary storage. [2025-09-16T21:18:11.106769] [DEBUG] [LOCAL ] MSCI: Loaded 25367 existing records from primary storage. [2025-09-16T21:18:11.109485] [INFO ] [MAIN ] MSD: Loaded 12137 primary data records. [2025-09-16T21:18:11.211728] [INFO ] [MAIN ] MSCI: Loaded 25367 primary data records. [2025-09-16T21:18:11.739037] [DEBUG] [MAIN ] MSB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:11.740334] [INFO ] [MAIN ] MSB: Generated 1339 derivative records from 5977 primary records. [2025-09-16T21:18:11.740707] [DEBUG] [LOCAL ] MSB: Saving derivative data. [2025-09-16T21:18:11.756576] [DEBUG] [LOCAL ] MSB: Derivative data saved (1339 records). [2025-09-16T21:18:11.757106] [INFO ] [MAIN ] MSB: Successfully saved derivative data. [2025-09-16T21:18:11.764443] [INFO ] [MAIN ] Derivative Progress: 1165/2026 symbols completed. MSB took 0.9s. Estimated remaining: 4m 41s. Rate: 184.0 symbols/min [2025-09-16T21:18:11.768827] [INFO ] [MAIN ] MSDL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:11.769080] [DEBUG] [MAIN ] MSD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:11.770315] [INFO ] [MAIN ] MSD: Generated 1339 derivative records from 12137 primary records. [2025-09-16T21:18:11.770680] [DEBUG] [LOCAL ] MSD: Saving derivative data. [2025-09-16T21:18:11.791401] [DEBUG] [LOCAL ] MSD: Derivative data saved (1339 records). [2025-09-16T21:18:11.799683] [INFO ] [MAIN ] MSD: Successfully saved derivative data. [2025-09-16T21:18:11.802516] [INFO ] [MAIN ] Derivative Progress: 1166/2026 symbols completed. MSD took 0.9s. Estimated remaining: 4m 40s. Rate: 184.1 symbols/min [2025-09-16T21:18:11.800111] [DEBUG] [MAIN ] MSCI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:11.803541] [INFO ] [MAIN ] MSCI: Generated 1339 derivative records from 25367 primary records. [2025-09-16T21:18:11.803725] [INFO ] [MAIN ] MSGE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:11.803807] [DEBUG] [LOCAL ] MSCI: Saving derivative data. [2025-09-16T21:18:11.824533] [DEBUG] [LOCAL ] MSCI: Derivative data saved (1339 records). [2025-09-16T21:18:11.824716] [INFO ] [MAIN ] MSCI: Successfully saved derivative data. [2025-09-16T21:18:11.826781] [INFO ] [MAIN ] Derivative Progress: 1167/2026 symbols completed. MSCI took 0.9s. Estimated remaining: 4m 40s. Rate: 184.3 symbols/min [2025-09-16T21:18:11.827171] [INFO ] [MAIN ] MSGS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:11.843372] [DEBUG] [LOCAL ] MSDL: Loaded 27398 existing records from primary storage. [2025-09-16T21:18:11.843580] [INFO ] [MAIN ] MSDL: Loaded 27398 primary data records. [2025-09-16T21:18:11.964687] [DEBUG] [LOCAL ] MSGS: Loaded 12394 existing records from primary storage. [2025-09-16T21:18:11.965610] [INFO ] [MAIN ] MSGS: Loaded 12394 primary data records. [2025-09-16T21:18:11.965197] [DEBUG] [LOCAL ] MSGE: Loaded 19265 existing records from primary storage. [2025-09-16T21:18:12.018905] [INFO ] [MAIN ] MSGE: Loaded 19265 primary data records. [2025-09-16T21:18:12.708142] [DEBUG] [MAIN ] MSDL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:12.708993] [INFO ] [MAIN ] MSDL: Generated 1339 derivative records from 27398 primary records. [2025-09-16T21:18:12.709259] [DEBUG] [LOCAL ] MSDL: Saving derivative data. [2025-09-16T21:18:12.731227] [DEBUG] [LOCAL ] MSDL: Derivative data saved (1339 records). [2025-09-16T21:18:12.738292] [INFO ] [MAIN ] MSDL: Successfully saved derivative data. [2025-09-16T21:18:12.744384] [INFO ] [MAIN ] Derivative Progress: 1168/2026 symbols completed. MSDL took 1.0s. Estimated remaining: 4m 40s. Rate: 184.0 symbols/min [2025-09-16T21:18:12.742158] [DEBUG] [MAIN ] MSGS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:12.745397] [INFO ] [MAIN ] MSGS: Generated 1339 derivative records from 12394 primary records. [2025-09-16T21:18:12.754661] [DEBUG] [MAIN ] MSGE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:12.754727] [DEBUG] [LOCAL ] MSGS: Saving derivative data. [2025-09-16T21:18:12.755196] [INFO ] [MAIN ] MSGE: Generated 1339 derivative records from 19265 primary records. [2025-09-16T21:18:12.755876] [DEBUG] [LOCAL ] MSGE: Saving derivative data. [2025-09-16T21:18:12.777263] [DEBUG] [LOCAL ] MSGE: Derivative data saved (1339 records). [2025-09-16T21:18:12.777915] [INFO ] [MAIN ] MSGE: Successfully saved derivative data. [2025-09-16T21:18:12.781593] [INFO ] [MAIN ] Derivative Progress: 1169/2026 symbols completed. MSGE took 1.0s. Estimated remaining: 4m 39s. Rate: 184.1 symbols/min [2025-09-16T21:18:12.778609] [DEBUG] [LOCAL ] MSGS: Derivative data saved (1339 records). [2025-09-16T21:18:12.781723] [INFO ] [MAIN ] MSGS: Successfully saved derivative data. [2025-09-16T21:18:12.784111] [INFO ] [MAIN ] Derivative Progress: 1170/2026 symbols completed. MSGS took 1.0s. Estimated remaining: 4m 39s. Rate: 184.3 symbols/min [2025-09-16T21:18:12.784590] [INFO ] [MAIN ] MSM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:12.784516] [INFO ] [MAIN ] MSI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:12.784952] [INFO ] [MAIN ] MSIF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:12.797834] [DEBUG] [LOCAL ] MSIF: Loaded 10694 existing records from primary storage. [2025-09-16T21:18:12.798052] [INFO ] [MAIN ] MSIF: Loaded 10694 primary data records. [2025-09-16T21:18:12.950030] [DEBUG] [LOCAL ] MSM: Loaded 25497 existing records from primary storage. [2025-09-16T21:18:12.960323] [INFO ] [MAIN ] MSM: Loaded 25497 primary data records. [2025-09-16T21:18:12.949478] [DEBUG] [LOCAL ] MSI: Loaded 29947 existing records from primary storage. [2025-09-16T21:18:13.038788] [INFO ] [MAIN ] MSI: Loaded 29947 primary data records. [2025-09-16T21:18:13.636505] [DEBUG] [MAIN ] MSIF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:13.637603] [INFO ] [MAIN ] MSIF: Generated 1339 derivative records from 10694 primary records. [2025-09-16T21:18:13.638592] [DEBUG] [LOCAL ] MSIF: Saving derivative data. [2025-09-16T21:18:13.652248] [DEBUG] [LOCAL ] MSIF: Derivative data saved (1339 records). [2025-09-16T21:18:13.652613] [INFO ] [MAIN ] MSIF: Successfully saved derivative data. [2025-09-16T21:18:13.654145] [INFO ] [MAIN ] Derivative Progress: 1171/2026 symbols completed. MSIF took 0.9s. Estimated remaining: 4m 39s. Rate: 184.0 symbols/min [2025-09-16T21:18:13.654475] [INFO ] [MAIN ] MT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:13.678559] [DEBUG] [MAIN ] MSI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:13.678798] [DEBUG] [MAIN ] MSM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:13.679468] [INFO ] [MAIN ] MSI: Generated 1339 derivative records from 29947 primary records. [2025-09-16T21:18:13.679978] [INFO ] [MAIN ] MSM: Generated 1339 derivative records from 25497 primary records. [2025-09-16T21:18:13.680133] [DEBUG] [LOCAL ] MSM: Saving derivative data. [2025-09-16T21:18:13.680740] [DEBUG] [LOCAL ] MSI: Saving derivative data. [2025-09-16T21:18:13.701712] [DEBUG] [LOCAL ] MSM: Derivative data saved (1339 records). [2025-09-16T21:18:13.703101] [INFO ] [MAIN ] MSM: Successfully saved derivative data. [2025-09-16T21:18:13.705275] [INFO ] [MAIN ] Derivative Progress: 1172/2026 symbols completed. MSM took 0.9s. Estimated remaining: 4m 38s. Rate: 184.1 symbols/min [2025-09-16T21:18:13.714028] [INFO ] [MAIN ] MTB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:13.715314] [DEBUG] [LOCAL ] MSI: Derivative data saved (1339 records). [2025-09-16T21:18:13.715386] [INFO ] [MAIN ] MSI: Successfully saved derivative data. [2025-09-16T21:18:13.717756] [INFO ] [MAIN ] Derivative Progress: 1173/2026 symbols completed. MSI took 0.9s. Estimated remaining: 4m 38s. Rate: 184.3 symbols/min [2025-09-16T21:18:13.718239] [INFO ] [MAIN ] MTD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:13.732707] [DEBUG] [LOCAL ] MT: Loaded 37445 existing records from primary storage. [2025-09-16T21:18:13.732844] [INFO ] [MAIN ] MT: Loaded 37445 primary data records. [2025-09-16T21:18:13.847302] [DEBUG] [LOCAL ] MTD: Loaded 11088 existing records from primary storage. [2025-09-16T21:18:13.850675] [INFO ] [MAIN ] MTD: Loaded 11088 primary data records. [2025-09-16T21:18:14.033724] [DEBUG] [LOCAL ] MTB: Loaded 34580 existing records from primary storage. [2025-09-16T21:18:14.118255] [INFO ] [MAIN ] MTB: Loaded 34580 primary data records. [2025-09-16T21:18:14.615391] [DEBUG] [MAIN ] MT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:14.616208] [INFO ] [MAIN ] MT: Generated 1339 derivative records from 37445 primary records. [2025-09-16T21:18:14.617635] [DEBUG] [LOCAL ] MT: Saving derivative data. [2025-09-16T21:18:14.638981] [DEBUG] [MAIN ] MTD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:14.640201] [INFO ] [MAIN ] MTD: Generated 1339 derivative records from 11088 primary records. [2025-09-16T21:18:14.640620] [DEBUG] [LOCAL ] MTD: Saving derivative data. [2025-09-16T21:18:14.643066] [DEBUG] [LOCAL ] MT: Derivative data saved (1339 records). [2025-09-16T21:18:14.651885] [INFO ] [MAIN ] MT: Successfully saved derivative data. [2025-09-16T21:18:14.655164] [INFO ] [MAIN ] Derivative Progress: 1174/2026 symbols completed. MT took 1.0s. Estimated remaining: 4m 38s. Rate: 184.0 symbols/min [2025-09-16T21:18:14.657044] [INFO ] [MAIN ] MTDR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:14.658356] [DEBUG] [LOCAL ] MTD: Derivative data saved (1339 records). [2025-09-16T21:18:14.668404] [INFO ] [MAIN ] MTD: Successfully saved derivative data. [2025-09-16T21:18:14.668674] [DEBUG] [MAIN ] MTB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:14.670826] [INFO ] [MAIN ] Derivative Progress: 1175/2026 symbols completed. MTD took 1.0s. Estimated remaining: 4m 37s. Rate: 184.1 symbols/min [2025-09-16T21:18:14.671244] [INFO ] [MAIN ] MTG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:14.672095] [INFO ] [MAIN ] MTB: Generated 1339 derivative records from 34580 primary records. [2025-09-16T21:18:14.672215] [DEBUG] [LOCAL ] MTB: Saving derivative data. [2025-09-16T21:18:14.686087] [DEBUG] [LOCAL ] MTB: Derivative data saved (1339 records). [2025-09-16T21:18:14.686290] [INFO ] [MAIN ] MTB: Successfully saved derivative data. [2025-09-16T21:18:14.688254] [INFO ] [MAIN ] Derivative Progress: 1176/2026 symbols completed. MTB took 1.0s. Estimated remaining: 4m 37s. Rate: 184.3 symbols/min [2025-09-16T21:18:14.688550] [INFO ] [MAIN ] MTH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:14.748605] [DEBUG] [LOCAL ] MTDR: Loaded 38375 existing records from primary storage. [2025-09-16T21:18:14.749931] [INFO ] [MAIN ] MTDR: Loaded 38375 primary data records. [2025-09-16T21:18:14.786955] [DEBUG] [LOCAL ] MTG: Loaded 37903 existing records from primary storage. [2025-09-16T21:18:14.814937] [INFO ] [MAIN ] MTG: Loaded 37903 primary data records. [2025-09-16T21:18:14.852350] [DEBUG] [LOCAL ] MTH: Loaded 32475 existing records from primary storage. [2025-09-16T21:18:14.883501] [INFO ] [MAIN ] MTH: Loaded 32475 primary data records. [2025-09-16T21:18:15.563370] [DEBUG] [MAIN ] MTDR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:15.564726] [INFO ] [MAIN ] MTDR: Generated 1339 derivative records from 38375 primary records. [2025-09-16T21:18:15.565392] [DEBUG] [LOCAL ] MTDR: Saving derivative data. [2025-09-16T21:18:15.590761] [DEBUG] [MAIN ] MTH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:15.601846] [DEBUG] [MAIN ] MTG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:15.602580] [INFO ] [MAIN ] MTG: Generated 1339 derivative records from 37903 primary records. [2025-09-16T21:18:15.601559] [DEBUG] [LOCAL ] MTDR: Derivative data saved (1339 records). [2025-09-16T21:18:15.603204] [INFO ] [MAIN ] MTH: Generated 1339 derivative records from 32475 primary records. [2025-09-16T21:18:15.603369] [INFO ] [MAIN ] MTDR: Successfully saved derivative data. [2025-09-16T21:18:15.604873] [INFO ] [MAIN ] Derivative Progress: 1177/2026 symbols completed. MTDR took 0.9s. Estimated remaining: 4m 37s. Rate: 184.0 symbols/min [2025-09-16T21:18:15.602689] [DEBUG] [LOCAL ] MTG: Saving derivative data. [2025-09-16T21:18:15.604950] [DEBUG] [LOCAL ] MTH: Saving derivative data. [2025-09-16T21:18:15.605200] [INFO ] [MAIN ] MTN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:15.628210] [DEBUG] [LOCAL ] MTG: Derivative data saved (1339 records). [2025-09-16T21:18:15.628578] [INFO ] [MAIN ] MTG: Successfully saved derivative data. [2025-09-16T21:18:15.631056] [INFO ] [MAIN ] Derivative Progress: 1178/2026 symbols completed. MTG took 1.0s. Estimated remaining: 4m 36s. Rate: 184.2 symbols/min [2025-09-16T21:18:15.631483] [INFO ] [MAIN ] MTR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:15.632793] [DEBUG] [LOCAL ] MTH: Derivative data saved (1339 records). [2025-09-16T21:18:15.632856] [INFO ] [MAIN ] MTH: Successfully saved derivative data. [2025-09-16T21:18:15.635114] [INFO ] [MAIN ] Derivative Progress: 1179/2026 symbols completed. MTH took 0.9s. Estimated remaining: 4m 36s. Rate: 184.3 symbols/min [2025-09-16T21:18:15.635311] [INFO ] [MAIN ] MTRN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:15.638935] [DEBUG] [LOCAL ] MTR: Loaded 1590 existing records from primary storage. [2025-09-16T21:18:15.639128] [INFO ] [MAIN ] MTR: Loaded 1590 primary data records. [2025-09-16T21:18:15.782672] [DEBUG] [LOCAL ] MTN: Loaded 28880 existing records from primary storage. [2025-09-16T21:18:15.771753] [DEBUG] [LOCAL ] MTRN: Loaded 13726 existing records from primary storage. [2025-09-16T21:18:15.798094] [INFO ] [MAIN ] MTN: Loaded 28880 primary data records. [2025-09-16T21:18:15.820566] [INFO ] [MAIN ] MTRN: Loaded 13726 primary data records. [2025-09-16T21:18:16.477500] [DEBUG] [MAIN ] MTR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:16.478672] [INFO ] [MAIN ] MTR: Generated 1339 derivative records from 1590 primary records. [2025-09-16T21:18:16.479624] [DEBUG] [LOCAL ] MTR: Saving derivative data. [2025-09-16T21:18:16.502263] [DEBUG] [LOCAL ] MTR: Derivative data saved (1339 records). [2025-09-16T21:18:16.502736] [DEBUG] [MAIN ] MTN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:16.502898] [INFO ] [MAIN ] MTR: Successfully saved derivative data. [2025-09-16T21:18:16.504685] [INFO ] [MAIN ] Derivative Progress: 1180/2026 symbols completed. MTR took 0.9s. Estimated remaining: 4m 36s. Rate: 184.0 symbols/min [2025-09-16T21:18:16.504891] [INFO ] [MAIN ] MTUS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:16.505744] [INFO ] [MAIN ] MTN: Generated 1339 derivative records from 28880 primary records. [2025-09-16T21:18:16.515303] [DEBUG] [LOCAL ] MTN: Saving derivative data. [2025-09-16T21:18:16.515753] [DEBUG] [MAIN ] MTRN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:16.516969] [INFO ] [MAIN ] MTRN: Generated 1339 derivative records from 13726 primary records. [2025-09-16T21:18:16.517049] [DEBUG] [LOCAL ] MTRN: Saving derivative data. [2025-09-16T21:18:16.539149] [DEBUG] [LOCAL ] MTN: Derivative data saved (1339 records). [2025-09-16T21:18:16.544430] [INFO ] [MAIN ] MTN: Successfully saved derivative data. [2025-09-16T21:18:16.546868] [INFO ] [MAIN ] Derivative Progress: 1181/2026 symbols completed. MTN took 0.9s. Estimated remaining: 4m 35s. Rate: 184.2 symbols/min [2025-09-16T21:18:16.547875] [INFO ] [MAIN ] MTW: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:16.548341] [DEBUG] [LOCAL ] MTRN: Derivative data saved (1339 records). [2025-09-16T21:18:16.548661] [INFO ] [MAIN ] MTRN: Successfully saved derivative data. [2025-09-16T21:18:16.550881] [INFO ] [MAIN ] Derivative Progress: 1182/2026 symbols completed. MTRN took 0.9s. Estimated remaining: 4m 35s. Rate: 184.3 symbols/min [2025-09-16T21:18:16.552052] [INFO ] [MAIN ] MTX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:16.560084] [DEBUG] [LOCAL ] MTUS: Loaded 20861 existing records from primary storage. [2025-09-16T21:18:16.560322] [INFO ] [MAIN ] MTUS: Loaded 20861 primary data records. [2025-09-16T21:18:16.685946] [DEBUG] [LOCAL ] MTW: Loaded 19869 existing records from primary storage. [2025-09-16T21:18:16.701946] [DEBUG] [LOCAL ] MTX: Loaded 17516 existing records from primary storage. [2025-09-16T21:18:16.712224] [INFO ] [MAIN ] MTX: Loaded 17516 primary data records. [2025-09-16T21:18:16.712292] [INFO ] [MAIN ] MTW: Loaded 19869 primary data records. [2025-09-16T21:18:17.413070] [DEBUG] [MAIN ] MTUS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:17.413816] [INFO ] [MAIN ] MTUS: Generated 1339 derivative records from 20861 primary records. [2025-09-16T21:18:17.414200] [DEBUG] [LOCAL ] MTUS: Saving derivative data. [2025-09-16T21:18:17.436424] [DEBUG] [LOCAL ] MTUS: Derivative data saved (1339 records). [2025-09-16T21:18:17.440238] [DEBUG] [MAIN ] MTW: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:17.440455] [INFO ] [MAIN ] MTUS: Successfully saved derivative data. [2025-09-16T21:18:17.451082] [INFO ] [MAIN ] Derivative Progress: 1183/2026 symbols completed. MTUS took 0.9s. Estimated remaining: 4m 35s. Rate: 184.1 symbols/min [2025-09-16T21:18:17.451910] [INFO ] [MAIN ] MTW: Generated 1339 derivative records from 19869 primary records. [2025-09-16T21:18:17.452288] [DEBUG] [MAIN ] MTX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:17.452520] [DEBUG] [LOCAL ] MTW: Saving derivative data. [2025-09-16T21:18:17.453036] [INFO ] [MAIN ] MTX: Generated 1339 derivative records from 17516 primary records. [2025-09-16T21:18:17.453608] [DEBUG] [LOCAL ] MTX: Saving derivative data. [2025-09-16T21:18:17.474952] [DEBUG] [LOCAL ] MTW: Derivative data saved (1339 records). [2025-09-16T21:18:17.475404] [INFO ] [MAIN ] MTW: Successfully saved derivative data. [2025-09-16T21:18:17.477778] [INFO ] [MAIN ] Derivative Progress: 1184/2026 symbols completed. MTW took 0.9s. Estimated remaining: 4m 34s. Rate: 184.2 symbols/min [2025-09-16T21:18:17.477849] [DEBUG] [LOCAL ] MTX: Derivative data saved (1339 records). [2025-09-16T21:18:17.477985] [INFO ] [MAIN ] MTX: Successfully saved derivative data. [2025-09-16T21:18:17.480113] [INFO ] [MAIN ] Derivative Progress: 1185/2026 symbols completed. MTX took 0.9s. Estimated remaining: 4m 34s. Rate: 184.4 symbols/min [2025-09-16T21:18:17.480616] [INFO ] [MAIN ] MTZ: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:17.480826] [INFO ] [MAIN ] MUA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:17.480896] [INFO ] [MAIN ] MUC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:17.495310] [DEBUG] [LOCAL ] MUA: Loaded 8428 existing records from primary storage. [2025-09-16T21:18:17.495438] [INFO ] [MAIN ] MUA: Loaded 8428 primary data records. [2025-09-16T21:18:17.576923] [DEBUG] [LOCAL ] MUC: Loaded 14448 existing records from primary storage. [2025-09-16T21:18:17.607198] [INFO ] [MAIN ] MUC: Loaded 14448 primary data records. [2025-09-16T21:18:17.799907] [DEBUG] [LOCAL ] MTZ: Loaded 31729 existing records from primary storage. [2025-09-16T21:18:17.879150] [INFO ] [MAIN ] MTZ: Loaded 31729 primary data records. [2025-09-16T21:18:18.346133] [DEBUG] [MAIN ] MUA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:18.346911] [INFO ] [MAIN ] MUA: Generated 1339 derivative records from 8428 primary records. [2025-09-16T21:18:18.347223] [DEBUG] [LOCAL ] MUA: Saving derivative data. [2025-09-16T21:18:18.364408] [DEBUG] [MAIN ] MUC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:18.369350] [INFO ] [MAIN ] MUC: Generated 1339 derivative records from 14448 primary records. [2025-09-16T21:18:18.369934] [DEBUG] [LOCAL ] MUC: Saving derivative data. [2025-09-16T21:18:18.370457] [DEBUG] [LOCAL ] MUA: Derivative data saved (1339 records). [2025-09-16T21:18:18.371393] [INFO ] [MAIN ] MUA: Successfully saved derivative data. [2025-09-16T21:18:18.382770] [INFO ] [MAIN ] Derivative Progress: 1186/2026 symbols completed. MUA took 0.9s. Estimated remaining: 4m 34s. Rate: 184.1 symbols/min [2025-09-16T21:18:18.384318] [INFO ] [MAIN ] MUE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:18.385994] [DEBUG] [LOCAL ] MUC: Derivative data saved (1339 records). [2025-09-16T21:18:18.386354] [INFO ] [MAIN ] MUC: Successfully saved derivative data. [2025-09-16T21:18:18.397734] [INFO ] [MAIN ] Derivative Progress: 1187/2026 symbols completed. MUC took 0.9s. Estimated remaining: 4m 33s. Rate: 184.2 symbols/min [2025-09-16T21:18:18.398257] [DEBUG] [MAIN ] MTZ: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:18.399093] [INFO ] [MAIN ] MTZ: Generated 1339 derivative records from 31729 primary records. [2025-09-16T21:18:18.398474] [INFO ] [MAIN ] MUFG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:18.399202] [DEBUG] [LOCAL ] MTZ: Saving derivative data. [2025-09-16T21:18:18.414153] [DEBUG] [LOCAL ] MTZ: Derivative data saved (1339 records). [2025-09-16T21:18:18.414335] [INFO ] [MAIN ] MTZ: Successfully saved derivative data. [2025-09-16T21:18:18.417262] [INFO ] [MAIN ] Derivative Progress: 1188/2026 symbols completed. MTZ took 0.9s. Estimated remaining: 4m 33s. Rate: 184.4 symbols/min [2025-09-16T21:18:18.421385] [INFO ] [MAIN ] MUJ: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:18.421729] [DEBUG] [LOCAL ] MUE: Loaded 9379 existing records from primary storage. [2025-09-16T21:18:18.421900] [INFO ] [MAIN ] MUE: Loaded 9379 primary data records. [2025-09-16T21:18:18.593059] [DEBUG] [LOCAL ] MUJ: Loaded 10300 existing records from primary storage. [2025-09-16T21:18:18.698708] [INFO ] [MAIN ] MUJ: Loaded 10300 primary data records. [2025-09-16T21:18:18.733785] [DEBUG] [LOCAL ] MUFG: Loaded 39152 existing records from primary storage. [2025-09-16T21:18:18.759445] [INFO ] [MAIN ] MUFG: Loaded 39152 primary data records. [2025-09-16T21:18:19.310056] [DEBUG] [MAIN ] MUE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:19.311119] [INFO ] [MAIN ] MUE: Generated 1339 derivative records from 9379 primary records. [2025-09-16T21:18:19.311857] [DEBUG] [LOCAL ] MUE: Saving derivative data. [2025-09-16T21:18:19.327672] [DEBUG] [LOCAL ] MUE: Derivative data saved (1339 records). [2025-09-16T21:18:19.329878] [INFO ] [MAIN ] MUE: Successfully saved derivative data. [2025-09-16T21:18:19.331847] [INFO ] [MAIN ] Derivative Progress: 1189/2026 symbols completed. MUE took 0.9s. Estimated remaining: 4m 33s. Rate: 184.1 symbols/min [2025-09-16T21:18:19.341656] [INFO ] [MAIN ] MUR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:19.342212] [DEBUG] [MAIN ] MUJ: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:19.343172] [INFO ] [MAIN ] MUJ: Generated 1339 derivative records from 10300 primary records. [2025-09-16T21:18:19.343498] [DEBUG] [LOCAL ] MUJ: Saving derivative data. [2025-09-16T21:18:19.357109] [DEBUG] [LOCAL ] MUJ: Derivative data saved (1339 records). [2025-09-16T21:18:19.359026] [INFO ] [MAIN ] MUJ: Successfully saved derivative data. [2025-09-16T21:18:19.361057] [INFO ] [MAIN ] Derivative Progress: 1190/2026 symbols completed. MUJ took 0.9s. Estimated remaining: 4m 32s. Rate: 184.2 symbols/min [2025-09-16T21:18:19.361883] [INFO ] [MAIN ] MUSA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:19.374734] [DEBUG] [MAIN ] MUFG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:19.375740] [INFO ] [MAIN ] MUFG: Generated 1339 derivative records from 39152 primary records. [2025-09-16T21:18:19.375853] [DEBUG] [LOCAL ] MUFG: Saving derivative data. [2025-09-16T21:18:19.388883] [DEBUG] [LOCAL ] MUFG: Derivative data saved (1339 records). [2025-09-16T21:18:19.389155] [INFO ] [MAIN ] MUFG: Successfully saved derivative data. [2025-09-16T21:18:19.391175] [INFO ] [MAIN ] Derivative Progress: 1191/2026 symbols completed. MUFG took 1.0s. Estimated remaining: 4m 32s. Rate: 184.4 symbols/min [2025-09-16T21:18:19.391446] [INFO ] [MAIN ] MUX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:19.412750] [DEBUG] [LOCAL ] MUSA: Loaded 18704 existing records from primary storage. [2025-09-16T21:18:19.412928] [INFO ] [MAIN ] MUSA: Loaded 18704 primary data records. [2025-09-16T21:18:19.544814] [DEBUG] [LOCAL ] MUR: Loaded 39364 existing records from primary storage. [2025-09-16T21:18:19.561181] [INFO ] [MAIN ] MUR: Loaded 39364 primary data records. [2025-09-16T21:18:19.658515] [DEBUG] [LOCAL ] MUX: Loaded 31233 existing records from primary storage. [2025-09-16T21:18:19.790227] [INFO ] [MAIN ] MUX: Loaded 31233 primary data records. [2025-09-16T21:18:20.271935] [DEBUG] [MAIN ] MUSA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:20.272945] [INFO ] [MAIN ] MUSA: Generated 1339 derivative records from 18704 primary records. [2025-09-16T21:18:20.273141] [DEBUG] [LOCAL ] MUSA: Saving derivative data. [2025-09-16T21:18:20.288696] [DEBUG] [LOCAL ] MUSA: Derivative data saved (1339 records). [2025-09-16T21:18:20.288863] [INFO ] [MAIN ] MUSA: Successfully saved derivative data. [2025-09-16T21:18:20.290455] [INFO ] [MAIN ] Derivative Progress: 1192/2026 symbols completed. MUSA took 0.9s. Estimated remaining: 4m 32s. Rate: 184.1 symbols/min [2025-09-16T21:18:20.291154] [INFO ] [MAIN ] MVF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:20.301901] [DEBUG] [MAIN ] MUR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:20.302791] [INFO ] [MAIN ] MUR: Generated 1339 derivative records from 39364 primary records. [2025-09-16T21:18:20.303030] [DEBUG] [LOCAL ] MUR: Saving derivative data. [2025-09-16T21:18:20.321373] [DEBUG] [LOCAL ] MVF: Loaded 8944 existing records from primary storage. [2025-09-16T21:18:20.328832] [INFO ] [MAIN ] MVF: Loaded 8944 primary data records. [2025-09-16T21:18:20.329853] [DEBUG] [LOCAL ] MUR: Derivative data saved (1339 records). [2025-09-16T21:18:20.371848] [DEBUG] [MAIN ] MUX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:20.371592] [INFO ] [MAIN ] MUR: Successfully saved derivative data. [2025-09-16T21:18:20.402308] [INFO ] [MAIN ] MUX: Generated 1339 derivative records from 31233 primary records. [2025-09-16T21:18:20.415175] [DEBUG] [LOCAL ] MUX: Saving derivative data. [2025-09-16T21:18:20.417483] [INFO ] [MAIN ] Derivative Progress: 1193/2026 symbols completed. MUR took 1.1s. Estimated remaining: 4m 31s. Rate: 184.2 symbols/min [2025-09-16T21:18:20.443456] [INFO ] [MAIN ] MVO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:20.491097] [DEBUG] [LOCAL ] MUX: Derivative data saved (1339 records). [2025-09-16T21:18:20.542959] [INFO ] [MAIN ] MUX: Successfully saved derivative data. [2025-09-16T21:18:20.544695] [INFO ] [MAIN ] Derivative Progress: 1194/2026 symbols completed. MUX took 1.2s. Estimated remaining: 4m 31s. Rate: 184.3 symbols/min [2025-09-16T21:18:20.544937] [INFO ] [MAIN ] MVT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:20.633465] [DEBUG] [LOCAL ] MVO: Loaded 6446 existing records from primary storage. [2025-09-16T21:18:20.633584] [INFO ] [MAIN ] MVO: Loaded 6446 primary data records. [2025-09-16T21:18:20.721699] [DEBUG] [LOCAL ] MVT: Loaded 7404 existing records from primary storage. [2025-09-16T21:18:20.732829] [INFO ] [MAIN ] MVT: Loaded 7404 primary data records. [2025-09-16T21:18:21.214115] [DEBUG] [MAIN ] MVF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:21.215421] [INFO ] [MAIN ] MVF: Generated 1339 derivative records from 8944 primary records. [2025-09-16T21:18:21.216545] [DEBUG] [LOCAL ] MVF: Saving derivative data. [2025-09-16T21:18:21.229209] [DEBUG] [LOCAL ] MVF: Derivative data saved (1339 records). [2025-09-16T21:18:21.230010] [INFO ] [MAIN ] MVF: Successfully saved derivative data. [2025-09-16T21:18:21.231651] [INFO ] [MAIN ] Derivative Progress: 1195/2026 symbols completed. MVF took 0.9s. Estimated remaining: 4m 31s. Rate: 184.1 symbols/min [2025-09-16T21:18:21.231986] [INFO ] [MAIN ] MWA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:21.244789] [DEBUG] [MAIN ] MVO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:21.245400] [INFO ] [MAIN ] MVO: Generated 1339 derivative records from 6446 primary records. [2025-09-16T21:18:21.245674] [DEBUG] [LOCAL ] MVO: Saving derivative data. [2025-09-16T21:18:21.259304] [DEBUG] [LOCAL ] MVO: Derivative data saved (1339 records). [2025-09-16T21:18:21.268864] [INFO ] [MAIN ] MVO: Successfully saved derivative data. [2025-09-16T21:18:21.269139] [DEBUG] [MAIN ] MVT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:21.271399] [INFO ] [MAIN ] Derivative Progress: 1196/2026 symbols completed. MVO took 0.8s. Estimated remaining: 4m 30s. Rate: 184.3 symbols/min [2025-09-16T21:18:21.272435] [INFO ] [MAIN ] MX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:21.272396] [INFO ] [MAIN ] MVT: Generated 1339 derivative records from 7404 primary records. [2025-09-16T21:18:21.272554] [DEBUG] [LOCAL ] MVT: Saving derivative data. [2025-09-16T21:18:21.292669] [DEBUG] [LOCAL ] MVT: Derivative data saved (1339 records). [2025-09-16T21:18:21.292834] [INFO ] [MAIN ] MVT: Successfully saved derivative data. [2025-09-16T21:18:21.294844] [INFO ] [MAIN ] Derivative Progress: 1197/2026 symbols completed. MVT took 0.7s. Estimated remaining: 4m 30s. Rate: 184.4 symbols/min [2025-09-16T21:18:21.295191] [INFO ] [MAIN ] MXF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:21.311330] [DEBUG] [LOCAL ] MWA: Loaded 34072 existing records from primary storage. [2025-09-16T21:18:21.311509] [INFO ] [MAIN ] MWA: Loaded 34072 primary data records. [2025-09-16T21:18:21.352301] [DEBUG] [LOCAL ] MXF: Loaded 4061 existing records from primary storage. [2025-09-16T21:18:21.392304] [INFO ] [MAIN ] MXF: Loaded 4061 primary data records. [2025-09-16T21:18:21.417764] [DEBUG] [LOCAL ] MX: Loaded 16635 existing records from primary storage. [2025-09-16T21:18:21.440329] [INFO ] [MAIN ] MX: Loaded 16635 primary data records. [2025-09-16T21:18:22.128467] [DEBUG] [MAIN ] MWA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:22.130256] [INFO ] [MAIN ] MWA: Generated 1339 derivative records from 34072 primary records. [2025-09-16T21:18:22.130541] [DEBUG] [LOCAL ] MWA: Saving derivative data. [2025-09-16T21:18:22.146823] [DEBUG] [MAIN ] MXF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:22.148479] [INFO ] [MAIN ] MXF: Generated 1339 derivative records from 4061 primary records. [2025-09-16T21:18:22.151447] [DEBUG] [LOCAL ] MXF: Saving derivative data. [2025-09-16T21:18:22.167806] [DEBUG] [MAIN ] MX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:22.173322] [DEBUG] [LOCAL ] MXF: Derivative data saved (1339 records). [2025-09-16T21:18:22.173686] [INFO ] [MAIN ] MXF: Successfully saved derivative data. [2025-09-16T21:18:22.171487] [INFO ] [MAIN ] MX: Generated 1339 derivative records from 16635 primary records. [2025-09-16T21:18:22.176278] [INFO ] [MAIN ] Derivative Progress: 1198/2026 symbols completed. MXF took 0.9s. Estimated remaining: 4m 30s. Rate: 184.1 symbols/min [2025-09-16T21:18:22.174160] [DEBUG] [LOCAL ] MX: Saving derivative data. [2025-09-16T21:18:22.184009] [DEBUG] [LOCAL ] MWA: Derivative data saved (1339 records). [2025-09-16T21:18:22.186593] [INFO ] [MAIN ] MWA: Successfully saved derivative data. [2025-09-16T21:18:22.189803] [INFO ] [MAIN ] Derivative Progress: 1199/2026 symbols completed. MWA took 1.0s. Estimated remaining: 4m 29s. Rate: 184.3 symbols/min [2025-09-16T21:18:22.191504] [DEBUG] [LOCAL ] MX: Derivative data saved (1339 records). [2025-09-16T21:18:22.191603] [INFO ] [MAIN ] MX: Successfully saved derivative data. [2025-09-16T21:18:22.193538] [INFO ] [MAIN ] Derivative Progress: 1200/2026 symbols completed. MX took 0.9s. Estimated remaining: 4m 29s. Rate: 184.4 symbols/min [2025-09-16T21:18:22.194132] [INFO ] [MAIN ] MYD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:22.194218] [INFO ] [MAIN ] MYE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:22.194332] [INFO ] [MAIN ] MYI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:22.209499] [DEBUG] [LOCAL ] MYD: Loaded 9219 existing records from primary storage. [2025-09-16T21:18:22.209661] [INFO ] [MAIN ] MYD: Loaded 9219 primary data records. [2025-09-16T21:18:22.273282] [DEBUG] [LOCAL ] MYI: Loaded 13530 existing records from primary storage. [2025-09-16T21:18:22.304544] [INFO ] [MAIN ] MYI: Loaded 13530 primary data records. [2025-09-16T21:18:22.422332] [DEBUG] [LOCAL ] MYE: Loaded 17614 existing records from primary storage. [2025-09-16T21:18:22.479788] [INFO ] [MAIN ] MYE: Loaded 17614 primary data records. [2025-09-16T21:18:23.076408] [DEBUG] [MAIN ] MYD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:23.077801] [INFO ] [MAIN ] MYD: Generated 1339 derivative records from 9219 primary records. [2025-09-16T21:18:23.078178] [DEBUG] [LOCAL ] MYD: Saving derivative data. [2025-09-16T21:18:23.088179] [DEBUG] [MAIN ] MYI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:23.088881] [INFO ] [MAIN ] MYI: Generated 1339 derivative records from 13530 primary records. [2025-09-16T21:18:23.095342] [DEBUG] [LOCAL ] MYI: Saving derivative data. [2025-09-16T21:18:23.109822] [DEBUG] [LOCAL ] MYD: Derivative data saved (1339 records). [2025-09-16T21:18:23.112115] [INFO ] [MAIN ] MYD: Successfully saved derivative data. [2025-09-16T21:18:23.115507] [INFO ] [MAIN ] Derivative Progress: 1201/2026 symbols completed. MYD took 0.9s. Estimated remaining: 4m 29s. Rate: 184.2 symbols/min [2025-09-16T21:18:23.116082] [INFO ] [MAIN ] MYN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:23.117804] [DEBUG] [LOCAL ] MYI: Derivative data saved (1339 records). [2025-09-16T21:18:23.128519] [INFO ] [MAIN ] MYI: Successfully saved derivative data. [2025-09-16T21:18:23.131267] [DEBUG] [MAIN ] MYE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:23.130891] [INFO ] [MAIN ] Derivative Progress: 1202/2026 symbols completed. MYI took 0.9s. Estimated remaining: 4m 28s. Rate: 184.3 symbols/min [2025-09-16T21:18:23.132085] [INFO ] [MAIN ] MYE: Generated 1339 derivative records from 17614 primary records. [2025-09-16T21:18:23.134208] [INFO ] [MAIN ] NABL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:23.134282] [DEBUG] [LOCAL ] MYE: Saving derivative data. [2025-09-16T21:18:23.149282] [DEBUG] [LOCAL ] MYN: Loaded 7569 existing records from primary storage. [2025-09-16T21:18:23.149963] [INFO ] [MAIN ] MYN: Loaded 7569 primary data records. [2025-09-16T21:18:23.163081] [DEBUG] [LOCAL ] MYE: Derivative data saved (1339 records). [2025-09-16T21:18:23.175749] [INFO ] [MAIN ] MYE: Successfully saved derivative data. [2025-09-16T21:18:23.205723] [INFO ] [MAIN ] Derivative Progress: 1203/2026 symbols completed. MYE took 1.0s. Estimated remaining: 4m 28s. Rate: 184.4 symbols/min [2025-09-16T21:18:23.221459] [INFO ] [MAIN ] NAC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:23.360213] [DEBUG] [LOCAL ] NABL: Loaded 29329 existing records from primary storage. [2025-09-16T21:18:23.442276] [INFO ] [MAIN ] NABL: Loaded 29329 primary data records. [2025-09-16T21:18:23.512728] [DEBUG] [LOCAL ] NAC: Loaded 17830 existing records from primary storage. [2025-09-16T21:18:23.529822] [INFO ] [MAIN ] NAC: Loaded 17830 primary data records. [2025-09-16T21:18:23.998273] [DEBUG] [MAIN ] MYN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:23.999123] [INFO ] [MAIN ] MYN: Generated 1339 derivative records from 7569 primary records. [2025-09-16T21:18:23.999309] [DEBUG] [LOCAL ] MYN: Saving derivative data. [2025-09-16T21:18:24.014459] [DEBUG] [LOCAL ] MYN: Derivative data saved (1339 records). [2025-09-16T21:18:24.014872] [INFO ] [MAIN ] MYN: Successfully saved derivative data. [2025-09-16T21:18:24.017665] [INFO ] [MAIN ] Derivative Progress: 1204/2026 symbols completed. MYN took 0.9s. Estimated remaining: 4m 28s. Rate: 184.2 symbols/min [2025-09-16T21:18:24.018067] [INFO ] [MAIN ] NAD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:24.032443] [DEBUG] [MAIN ] NABL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:24.033810] [INFO ] [MAIN ] NABL: Generated 1339 derivative records from 29329 primary records. [2025-09-16T21:18:24.034537] [DEBUG] [LOCAL ] NABL: Saving derivative data. [2025-09-16T21:18:24.062157] [DEBUG] [LOCAL ] NABL: Derivative data saved (1339 records). [2025-09-16T21:18:24.062397] [DEBUG] [MAIN ] NAC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:24.062523] [INFO ] [MAIN ] NABL: Successfully saved derivative data. [2025-09-16T21:18:24.065147] [INFO ] [MAIN ] Derivative Progress: 1205/2026 symbols completed. NABL took 0.9s. Estimated remaining: 4m 27s. Rate: 184.3 symbols/min [2025-09-16T21:18:24.065358] [INFO ] [MAIN ] NAN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:24.063139] [INFO ] [MAIN ] NAC: Generated 1339 derivative records from 17830 primary records. [2025-09-16T21:18:24.065808] [DEBUG] [LOCAL ] NAC: Saving derivative data. [2025-09-16T21:18:24.085974] [DEBUG] [LOCAL ] NAC: Derivative data saved (1339 records). [2025-09-16T21:18:24.086474] [DEBUG] [LOCAL ] NAD: Loaded 25046 existing records from primary storage. [2025-09-16T21:18:24.087789] [INFO ] [MAIN ] NAC: Successfully saved derivative data. [2025-09-16T21:18:24.087844] [INFO ] [MAIN ] NAD: Loaded 25046 primary data records. [2025-09-16T21:18:24.090093] [INFO ] [MAIN ] Derivative Progress: 1206/2026 symbols completed. NAC took 0.9s. Estimated remaining: 4m 27s. Rate: 184.5 symbols/min [2025-09-16T21:18:24.095455] [INFO ] [MAIN ] NAT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:24.163183] [DEBUG] [LOCAL ] NAN: Loaded 6308 existing records from primary storage. [2025-09-16T21:18:24.206451] [INFO ] [MAIN ] NAN: Loaded 6308 primary data records. [2025-09-16T21:18:24.570278] [DEBUG] [LOCAL ] NAT: Loaded 36263 existing records from primary storage. [2025-09-16T21:18:24.570768] [INFO ] [MAIN ] NAT: Loaded 36263 primary data records. [2025-09-16T21:18:24.930333] [DEBUG] [MAIN ] NAD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:24.931058] [INFO ] [MAIN ] NAD: Generated 1339 derivative records from 25046 primary records. [2025-09-16T21:18:24.931308] [DEBUG] [LOCAL ] NAD: Saving derivative data. [2025-09-16T21:18:24.947920] [DEBUG] [LOCAL ] NAD: Derivative data saved (1339 records). [2025-09-16T21:18:24.948126] [INFO ] [MAIN ] NAD: Successfully saved derivative data. [2025-09-16T21:18:24.949871] [INFO ] [MAIN ] Derivative Progress: 1207/2026 symbols completed. NAD took 0.9s. Estimated remaining: 4m 27s. Rate: 184.2 symbols/min [2025-09-16T21:18:24.950174] [INFO ] [MAIN ] NATL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:24.960813] [DEBUG] [MAIN ] NAN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:24.961787] [INFO ] [MAIN ] NAN: Generated 1339 derivative records from 6308 primary records. [2025-09-16T21:18:24.962032] [DEBUG] [LOCAL ] NAN: Saving derivative data. [2025-09-16T21:18:24.974081] [DEBUG] [LOCAL ] NAN: Derivative data saved (1339 records). [2025-09-16T21:18:24.974333] [INFO ] [MAIN ] NAN: Successfully saved derivative data. [2025-09-16T21:18:24.976396] [INFO ] [MAIN ] Derivative Progress: 1208/2026 symbols completed. NAN took 0.9s. Estimated remaining: 4m 26s. Rate: 184.4 symbols/min [2025-09-16T21:18:24.976704] [INFO ] [MAIN ] NAZ: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:24.995107] [DEBUG] [MAIN ] NAT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:24.995809] [INFO ] [MAIN ] NAT: Generated 1339 derivative records from 36263 primary records. [2025-09-16T21:18:24.997629] [DEBUG] [LOCAL ] NAZ: Loaded 1976 existing records from primary storage. [2025-09-16T21:18:24.997763] [DEBUG] [LOCAL ] NAT: Saving derivative data. [2025-09-16T21:18:24.997803] [INFO ] [MAIN ] NAZ: Loaded 1976 primary data records. [2025-09-16T21:18:25.112608] [DEBUG] [LOCAL ] NATL: Loaded 24282 existing records from primary storage. [2025-09-16T21:18:25.121999] [INFO ] [MAIN ] NATL: Loaded 24282 primary data records. [2025-09-16T21:18:25.128799] [DEBUG] [LOCAL ] NAT: Derivative data saved (1339 records). [2025-09-16T21:18:25.128929] [INFO ] [MAIN ] NAT: Successfully saved derivative data. [2025-09-16T21:18:25.161665] [INFO ] [MAIN ] Derivative Progress: 1209/2026 symbols completed. NAT took 1.1s. Estimated remaining: 4m 26s. Rate: 184.4 symbols/min [2025-09-16T21:18:25.215801] [INFO ] [MAIN ] NBB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:25.487035] [DEBUG] [LOCAL ] NBB: Loaded 6451 existing records from primary storage. [2025-09-16T21:18:25.570707] [INFO ] [MAIN ] NBB: Loaded 6451 primary data records. [2025-09-16T21:18:25.854511] [DEBUG] [MAIN ] NAZ: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:25.855343] [INFO ] [MAIN ] NAZ: Generated 1339 derivative records from 1976 primary records. [2025-09-16T21:18:25.856197] [DEBUG] [LOCAL ] NAZ: Saving derivative data. [2025-09-16T21:18:25.874183] [DEBUG] [MAIN ] NATL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:25.876181] [INFO ] [MAIN ] NATL: Generated 1339 derivative records from 24282 primary records. [2025-09-16T21:18:25.877465] [DEBUG] [LOCAL ] NAZ: Derivative data saved (1339 records). [2025-09-16T21:18:25.877663] [DEBUG] [LOCAL ] NATL: Saving derivative data. [2025-09-16T21:18:25.877618] [INFO ] [MAIN ] NAZ: Successfully saved derivative data. [2025-09-16T21:18:25.879841] [INFO ] [MAIN ] Derivative Progress: 1210/2026 symbols completed. NAZ took 0.9s. Estimated remaining: 4m 26s. Rate: 184.2 symbols/min [2025-09-16T21:18:25.880413] [INFO ] [MAIN ] NBHC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:25.893180] [DEBUG] [LOCAL ] NATL: Derivative data saved (1339 records). [2025-09-16T21:18:25.894469] [INFO ] [MAIN ] NATL: Successfully saved derivative data. [2025-09-16T21:18:25.896819] [INFO ] [MAIN ] Derivative Progress: 1211/2026 symbols completed. NATL took 0.9s. Estimated remaining: 4m 25s. Rate: 184.4 symbols/min [2025-09-16T21:18:25.897133] [INFO ] [MAIN ] NBR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:25.907592] [DEBUG] [MAIN ] NBB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:25.908370] [INFO ] [MAIN ] NBB: Generated 1339 derivative records from 6451 primary records. [2025-09-16T21:18:25.912559] [DEBUG] [LOCAL ] NBB: Saving derivative data. [2025-09-16T21:18:25.930004] [DEBUG] [LOCAL ] NBB: Derivative data saved (1339 records). [2025-09-16T21:18:25.930386] [DEBUG] [LOCAL ] NBHC: Loaded 16614 existing records from primary storage. [2025-09-16T21:18:25.930456] [INFO ] [MAIN ] NBB: Successfully saved derivative data. [2025-09-16T21:18:25.932471] [INFO ] [MAIN ] Derivative Progress: 1212/2026 symbols completed. NBB took 0.7s. Estimated remaining: 4m 25s. Rate: 184.5 symbols/min [2025-09-16T21:18:25.930535] [INFO ] [MAIN ] NBHC: Loaded 16614 primary data records. [2025-09-16T21:18:25.967381] [INFO ] [MAIN ] NBXG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:26.104987] [DEBUG] [LOCAL ] NBR: Loaded 26240 existing records from primary storage. [2025-09-16T21:18:26.125670] [INFO ] [MAIN ] NBR: Loaded 26240 primary data records. [2025-09-16T21:18:26.285285] [DEBUG] [LOCAL ] NBXG: Loaded 16130 existing records from primary storage. [2025-09-16T21:18:26.303087] [INFO ] [MAIN ] NBXG: Loaded 16130 primary data records. [2025-09-16T21:18:26.760701] [DEBUG] [MAIN ] NBHC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:26.761774] [INFO ] [MAIN ] NBHC: Generated 1339 derivative records from 16614 primary records. [2025-09-16T21:18:26.762608] [DEBUG] [LOCAL ] NBHC: Saving derivative data. [2025-09-16T21:18:26.775623] [DEBUG] [LOCAL ] NBHC: Derivative data saved (1339 records). [2025-09-16T21:18:26.775849] [INFO ] [MAIN ] NBHC: Successfully saved derivative data. [2025-09-16T21:18:26.777617] [INFO ] [MAIN ] Derivative Progress: 1213/2026 symbols completed. NBHC took 0.9s. Estimated remaining: 4m 25s. Rate: 184.3 symbols/min [2025-09-16T21:18:26.799812] [DEBUG] [MAIN ] NBXG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:26.800681] [INFO ] [MAIN ] NBXG: Generated 1339 derivative records from 16130 primary records. [2025-09-16T21:18:26.800812] [DEBUG] [LOCAL ] NBXG: Saving derivative data. [2025-09-16T21:18:26.800994] [DEBUG] [MAIN ] NBR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:26.801984] [INFO ] [MAIN ] NBR: Generated 1339 derivative records from 26240 primary records. [2025-09-16T21:18:26.802054] [DEBUG] [LOCAL ] NBR: Saving derivative data. [2025-09-16T21:18:26.823598] [DEBUG] [LOCAL ] NBR: Derivative data saved (1339 records). [2025-09-16T21:18:26.824530] [INFO ] [MAIN ] NBR: Successfully saved derivative data. [2025-09-16T21:18:26.824885] [DEBUG] [LOCAL ] NBXG: Derivative data saved (1339 records). [2025-09-16T21:18:26.824969] [INFO ] [MAIN ] NBXG: Successfully saved derivative data. [2025-09-16T21:18:26.827161] [INFO ] [MAIN ] Derivative Progress: 1214/2026 symbols completed. NBR took 0.9s. Estimated remaining: 4m 24s. Rate: 184.4 symbols/min [2025-09-16T21:18:26.829261] [INFO ] [MAIN ] Derivative Progress: 1215/2026 symbols completed. NBXG took 0.9s. Estimated remaining: 4m 24s. Rate: 184.6 symbols/min [2025-09-16T21:18:26.829791] [INFO ] [MAIN ] NCDL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:26.829705] [INFO ] [MAIN ] NC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:26.830117] [INFO ] [MAIN ] NCA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:26.833893] [DEBUG] [LOCAL ] NC: Loaded 1170 existing records from primary storage. [2025-09-16T21:18:26.834118] [INFO ] [MAIN ] NC: Loaded 1170 primary data records. [2025-09-16T21:18:26.950560] [DEBUG] [LOCAL ] NCA: Loaded 7192 existing records from primary storage. [2025-09-16T21:18:26.954451] [INFO ] [MAIN ] NCA: Loaded 7192 primary data records. [2025-09-16T21:18:27.074998] [DEBUG] [LOCAL ] NCDL: Loaded 15032 existing records from primary storage. [2025-09-16T21:18:27.135350] [INFO ] [MAIN ] NCDL: Loaded 15032 primary data records. [2025-09-16T21:18:27.698101] [DEBUG] [MAIN ] NC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:27.707885] [INFO ] [MAIN ] NC: Generated 1339 derivative records from 1170 primary records. [2025-09-16T21:18:27.708225] [DEBUG] [MAIN ] NCA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:27.708340] [DEBUG] [LOCAL ] NC: Saving derivative data. [2025-09-16T21:18:27.708823] [INFO ] [MAIN ] NCA: Generated 1339 derivative records from 7192 primary records. [2025-09-16T21:18:27.709617] [DEBUG] [LOCAL ] NCA: Saving derivative data. [2025-09-16T21:18:27.731765] [DEBUG] [LOCAL ] NCA: Derivative data saved (1339 records). [2025-09-16T21:18:27.732192] [INFO ] [MAIN ] NCA: Successfully saved derivative data. [2025-09-16T21:18:27.734502] [INFO ] [MAIN ] Derivative Progress: 1216/2026 symbols completed. NCA took 0.9s. Estimated remaining: 4m 24s. Rate: 184.3 symbols/min [2025-09-16T21:18:27.734716] [INFO ] [MAIN ] NCLH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:27.732267] [DEBUG] [LOCAL ] NC: Derivative data saved (1339 records). [2025-09-16T21:18:27.735022] [INFO ] [MAIN ] NC: Successfully saved derivative data. [2025-09-16T21:18:27.746888] [DEBUG] [MAIN ] NCDL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:27.746172] [INFO ] [MAIN ] Derivative Progress: 1217/2026 symbols completed. NC took 0.9s. Estimated remaining: 4m 23s. Rate: 184.4 symbols/min [2025-09-16T21:18:27.747241] [INFO ] [MAIN ] NCV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:27.748142] [INFO ] [MAIN ] NCDL: Generated 1339 derivative records from 15032 primary records. [2025-09-16T21:18:27.748573] [DEBUG] [LOCAL ] NCDL: Saving derivative data. [2025-09-16T21:18:27.764100] [DEBUG] [LOCAL ] NCDL: Derivative data saved (1339 records). [2025-09-16T21:18:27.764218] [INFO ] [MAIN ] NCDL: Successfully saved derivative data. [2025-09-16T21:18:27.766250] [INFO ] [MAIN ] Derivative Progress: 1218/2026 symbols completed. NCDL took 0.9s. Estimated remaining: 4m 23s. Rate: 184.6 symbols/min [2025-09-16T21:18:27.766572] [INFO ] [MAIN ] NCZ: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:27.771381] [DEBUG] [LOCAL ] NCV: Loaded 9628 existing records from primary storage. [2025-09-16T21:18:27.771569] [INFO ] [MAIN ] NCV: Loaded 9628 primary data records. [2025-09-16T21:18:27.877120] [DEBUG] [LOCAL ] NCZ: Loaded 8195 existing records from primary storage. [2025-09-16T21:18:27.895281] [INFO ] [MAIN ] NCZ: Loaded 8195 primary data records. [2025-09-16T21:18:28.083842] [DEBUG] [LOCAL ] NCLH: Loaded 40103 existing records from primary storage. [2025-09-16T21:18:28.182631] [INFO ] [MAIN ] NCLH: Loaded 40103 primary data records. [2025-09-16T21:18:28.631468] [DEBUG] [MAIN ] NCV: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:28.632624] [INFO ] [MAIN ] NCV: Generated 1339 derivative records from 9628 primary records. [2025-09-16T21:18:28.632805] [DEBUG] [LOCAL ] NCV: Saving derivative data. [2025-09-16T21:18:28.647434] [DEBUG] [LOCAL ] NCV: Derivative data saved (1339 records). [2025-09-16T21:18:28.647729] [INFO ] [MAIN ] NCV: Successfully saved derivative data. [2025-09-16T21:18:28.655105] [INFO ] [MAIN ] Derivative Progress: 1219/2026 symbols completed. NCV took 0.9s. Estimated remaining: 4m 23s. Rate: 184.3 symbols/min [2025-09-16T21:18:28.659076] [DEBUG] [MAIN ] NCZ: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:28.659933] [INFO ] [MAIN ] NDMO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:28.659803] [INFO ] [MAIN ] NCZ: Generated 1339 derivative records from 8195 primary records. [2025-09-16T21:18:28.660269] [DEBUG] [LOCAL ] NCZ: Saving derivative data. [2025-09-16T21:18:28.673255] [DEBUG] [LOCAL ] NCZ: Derivative data saved (1339 records). [2025-09-16T21:18:28.673544] [INFO ] [MAIN ] NCZ: Successfully saved derivative data. [2025-09-16T21:18:28.679607] [INFO ] [MAIN ] Derivative Progress: 1220/2026 symbols completed. NCZ took 0.9s. Estimated remaining: 4m 22s. Rate: 184.4 symbols/min [2025-09-16T21:18:28.681237] [INFO ] [MAIN ] NE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:28.696494] [DEBUG] [LOCAL ] NDMO: Loaded 12625 existing records from primary storage. [2025-09-16T21:18:28.696873] [DEBUG] [MAIN ] NCLH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:28.696998] [INFO ] [MAIN ] NDMO: Loaded 12625 primary data records. [2025-09-16T21:18:28.697593] [INFO ] [MAIN ] NCLH: Generated 1339 derivative records from 40103 primary records. [2025-09-16T21:18:28.697724] [DEBUG] [LOCAL ] NCLH: Saving derivative data. [2025-09-16T21:18:28.829519] [DEBUG] [LOCAL ] NCLH: Derivative data saved (1339 records). [2025-09-16T21:18:28.835337] [INFO ] [MAIN ] NCLH: Successfully saved derivative data. [2025-09-16T21:18:28.847660] [INFO ] [MAIN ] Derivative Progress: 1221/2026 symbols completed. NCLH took 1.1s. Estimated remaining: 4m 22s. Rate: 184.5 symbols/min [2025-09-16T21:18:28.858208] [INFO ] [MAIN ] NEA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:29.006730] [DEBUG] [LOCAL ] NE: Loaded 38963 existing records from primary storage. [2025-09-16T21:18:29.007561] [INFO ] [MAIN ] NE: Loaded 38963 primary data records. [2025-09-16T21:18:29.275601] [DEBUG] [LOCAL ] NEA: Loaded 26143 existing records from primary storage. [2025-09-16T21:18:29.286918] [INFO ] [MAIN ] NEA: Loaded 26143 primary data records. [2025-09-16T21:18:29.423517] [DEBUG] [MAIN ] NDMO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:29.461823] [INFO ] [MAIN ] NDMO: Generated 1339 derivative records from 12625 primary records. [2025-09-16T21:18:29.487171] [DEBUG] [LOCAL ] NDMO: Saving derivative data. [2025-09-16T21:18:29.639499] [DEBUG] [LOCAL ] NDMO: Derivative data saved (1339 records). [2025-09-16T21:18:29.640011] [INFO ] [MAIN ] NDMO: Successfully saved derivative data. [2025-09-16T21:18:29.642132] [INFO ] [MAIN ] Derivative Progress: 1222/2026 symbols completed. NDMO took 1.0s. Estimated remaining: 4m 22s. Rate: 184.3 symbols/min [2025-09-16T21:18:29.642437] [INFO ] [MAIN ] NEE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:29.656134] [DEBUG] [MAIN ] NE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:29.656776] [INFO ] [MAIN ] NE: Generated 1339 derivative records from 38963 primary records. [2025-09-16T21:18:29.656920] [DEBUG] [LOCAL ] NE: Saving derivative data. [2025-09-16T21:18:29.670497] [DEBUG] [LOCAL ] NE: Derivative data saved (1339 records). [2025-09-16T21:18:29.671716] [INFO ] [MAIN ] NE: Successfully saved derivative data. [2025-09-16T21:18:29.675476] [INFO ] [MAIN ] Derivative Progress: 1223/2026 symbols completed. NE took 1.0s. Estimated remaining: 4m 21s. Rate: 184.4 symbols/min [2025-09-16T21:18:29.676482] [INFO ] [MAIN ] NEM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:29.688015] [DEBUG] [MAIN ] NEA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:29.688936] [INFO ] [MAIN ] NEA: Generated 1339 derivative records from 26143 primary records. [2025-09-16T21:18:29.689077] [DEBUG] [LOCAL ] NEA: Saving derivative data. [2025-09-16T21:18:29.711620] [DEBUG] [LOCAL ] NEA: Derivative data saved (1339 records). [2025-09-16T21:18:29.711818] [INFO ] [MAIN ] NEA: Successfully saved derivative data. [2025-09-16T21:18:29.714252] [INFO ] [MAIN ] Derivative Progress: 1224/2026 symbols completed. NEA took 0.9s. Estimated remaining: 4m 21s. Rate: 184.6 symbols/min [2025-09-16T21:18:29.714692] [INFO ] [MAIN ] NET: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:29.741546] [DEBUG] [LOCAL ] NEE: Loaded 40057 existing records from primary storage. [2025-09-16T21:18:29.741798] [INFO ] [MAIN ] NEE: Loaded 40057 primary data records. [2025-09-16T21:18:29.870433] [DEBUG] [LOCAL ] NEM: Loaded 40058 existing records from primary storage. [2025-09-16T21:18:29.886181] [INFO ] [MAIN ] NEM: Loaded 40058 primary data records. [2025-09-16T21:18:30.148802] [DEBUG] [LOCAL ] NET: Loaded 39495 existing records from primary storage. [2025-09-16T21:18:30.149263] [INFO ] [MAIN ] NET: Loaded 39495 primary data records. [2025-09-16T21:18:30.600081] [DEBUG] [MAIN ] NEE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:30.601801] [INFO ] [MAIN ] NEE: Generated 1339 derivative records from 40057 primary records. [2025-09-16T21:18:30.604993] [DEBUG] [LOCAL ] NEE: Saving derivative data. [2025-09-16T21:18:30.624811] [DEBUG] [LOCAL ] NEE: Derivative data saved (1339 records). [2025-09-16T21:18:30.628615] [INFO ] [MAIN ] NEE: Successfully saved derivative data. [2025-09-16T21:18:30.630735] [INFO ] [MAIN ] Derivative Progress: 1225/2026 symbols completed. NEE took 1.0s. Estimated remaining: 4m 21s. Rate: 184.3 symbols/min [2025-09-16T21:18:30.631052] [DEBUG] [MAIN ] NEM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:30.631360] [INFO ] [MAIN ] NEU: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:30.632265] [INFO ] [MAIN ] NEM: Generated 1339 derivative records from 40058 primary records. [2025-09-16T21:18:30.633421] [DEBUG] [LOCAL ] NEM: Saving derivative data. [2025-09-16T21:18:30.658970] [DEBUG] [LOCAL ] NEM: Derivative data saved (1339 records). [2025-09-16T21:18:30.659195] [INFO ] [MAIN ] NEM: Successfully saved derivative data. [2025-09-16T21:18:30.661971] [INFO ] [MAIN ] Derivative Progress: 1226/2026 symbols completed. NEM took 1.0s. Estimated remaining: 4m 20s. Rate: 184.4 symbols/min [2025-09-16T21:18:30.659476] [DEBUG] [MAIN ] NET: Filtered 5181 bins outside market hours, 5780 incomplete bins [2025-09-16T21:18:30.663076] [INFO ] [MAIN ] NEUE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:30.663007] [INFO ] [MAIN ] NET: Generated 1338 derivative records from 39495 primary records. [2025-09-16T21:18:30.666675] [DEBUG] [LOCAL ] NEU: Loaded 6819 existing records from primary storage. [2025-09-16T21:18:30.666849] [INFO ] [MAIN ] NEU: Loaded 6819 primary data records. [2025-09-16T21:18:30.666801] [DEBUG] [LOCAL ] NET: Saving derivative data. [2025-09-16T21:18:30.749929] [DEBUG] [LOCAL ] NEUE: Loaded 1188 existing records from primary storage. [2025-09-16T21:18:30.742587] [DEBUG] [LOCAL ] NET: Derivative data saved (1338 records). [2025-09-16T21:18:30.767063] [INFO ] [MAIN ] NEUE: Loaded 1188 primary data records. [2025-09-16T21:18:30.773083] [INFO ] [MAIN ] NET: Successfully saved derivative data. [2025-09-16T21:18:30.791737] [INFO ] [MAIN ] Derivative Progress: 1227/2026 symbols completed. NET took 1.1s. Estimated remaining: 4m 20s. Rate: 184.5 symbols/min [2025-09-16T21:18:30.792107] [INFO ] [MAIN ] NEXA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:30.967379] [DEBUG] [LOCAL ] NEXA: Loaded 3014 existing records from primary storage. [2025-09-16T21:18:30.969556] [INFO ] [MAIN ] NEXA: Loaded 3014 primary data records. [2025-09-16T21:18:31.499876] [DEBUG] [MAIN ] NEU: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:31.502958] [INFO ] [MAIN ] NEU: Generated 1339 derivative records from 6819 primary records. [2025-09-16T21:18:31.503235] [DEBUG] [LOCAL ] NEU: Saving derivative data. [2025-09-16T21:18:31.522152] [DEBUG] [MAIN ] NEUE: Filtered 5181 bins outside market hours, 5781 incomplete bins [2025-09-16T21:18:31.524928] [DEBUG] [LOCAL ] NEU: Derivative data saved (1339 records). [2025-09-16T21:18:31.525748] [INFO ] [MAIN ] NEUE: Generated 1337 derivative records from 1188 primary records. [2025-09-16T21:18:31.525157] [INFO ] [MAIN ] NEU: Successfully saved derivative data. [2025-09-16T21:18:31.527512] [INFO ] [MAIN ] Derivative Progress: 1228/2026 symbols completed. NEU took 0.9s. Estimated remaining: 4m 20s. Rate: 184.3 symbols/min [2025-09-16T21:18:31.527710] [DEBUG] [LOCAL ] NEUE: Saving derivative data. [2025-09-16T21:18:31.549053] [DEBUG] [LOCAL ] NEUE: Derivative data saved (1337 records). [2025-09-16T21:18:31.549290] [INFO ] [MAIN ] NEUE: Successfully saved derivative data. [2025-09-16T21:18:31.551631] [INFO ] [MAIN ] Derivative Progress: 1229/2026 symbols completed. NEUE took 0.9s. Estimated remaining: 4m 19s. Rate: 184.5 symbols/min [2025-09-16T21:18:31.549430] [DEBUG] [MAIN ] NEXA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:31.552398] [INFO ] [MAIN ] NEXA: Generated 1339 derivative records from 3014 primary records. [2025-09-16T21:18:31.552460] [DEBUG] [LOCAL ] NEXA: Saving derivative data. [2025-09-16T21:18:31.562544] [DEBUG] [LOCAL ] NEXA: Derivative data saved (1339 records). [2025-09-16T21:18:31.562601] [INFO ] [MAIN ] NEXA: Successfully saved derivative data. [2025-09-16T21:18:31.564613] [INFO ] [MAIN ] Derivative Progress: 1230/2026 symbols completed. NEXA took 0.8s. Estimated remaining: 4m 19s. Rate: 184.6 symbols/min [2025-09-16T21:18:31.565148] [INFO ] [MAIN ] NFG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:31.565090] [INFO ] [MAIN ] NFJ: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:31.565817] [INFO ] [MAIN ] NGG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:31.589528] [DEBUG] [LOCAL ] NFJ: Loaded 14583 existing records from primary storage. [2025-09-16T21:18:31.589810] [INFO ] [MAIN ] NFJ: Loaded 14583 primary data records. [2025-09-16T21:18:31.721582] [DEBUG] [LOCAL ] NFG: Loaded 28137 existing records from primary storage. [2025-09-16T21:18:31.721789] [INFO ] [MAIN ] NFG: Loaded 28137 primary data records. [2025-09-16T21:18:31.722225] [DEBUG] [LOCAL ] NGG: Loaded 34801 existing records from primary storage. [2025-09-16T21:18:31.754744] [INFO ] [MAIN ] NGG: Loaded 34801 primary data records. [2025-09-16T21:18:32.468906] [DEBUG] [MAIN ] NFJ: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:32.469944] [INFO ] [MAIN ] NFJ: Generated 1339 derivative records from 14583 primary records. [2025-09-16T21:18:32.470036] [DEBUG] [LOCAL ] NFJ: Saving derivative data. [2025-09-16T21:18:32.485464] [DEBUG] [LOCAL ] NFJ: Derivative data saved (1339 records). [2025-09-16T21:18:32.486905] [INFO ] [MAIN ] NFJ: Successfully saved derivative data. [2025-09-16T21:18:32.498068] [INFO ] [MAIN ] Derivative Progress: 1231/2026 symbols completed. NFJ took 0.9s. Estimated remaining: 4m 19s. Rate: 184.3 symbols/min [2025-09-16T21:18:32.498413] [INFO ] [MAIN ] NGL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:32.498684] [DEBUG] [MAIN ] NFG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:32.508835] [INFO ] [MAIN ] NFG: Generated 1339 derivative records from 28137 primary records. [2025-09-16T21:18:32.509453] [DEBUG] [LOCAL ] NFG: Saving derivative data. [2025-09-16T21:18:32.509151] [DEBUG] [MAIN ] NGG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:32.510590] [INFO ] [MAIN ] NGG: Generated 1339 derivative records from 34801 primary records. [2025-09-16T21:18:32.510865] [DEBUG] [LOCAL ] NGG: Saving derivative data. [2025-09-16T21:18:32.528332] [DEBUG] [LOCAL ] NFG: Derivative data saved (1339 records). [2025-09-16T21:18:32.528448] [INFO ] [MAIN ] NFG: Successfully saved derivative data. [2025-09-16T21:18:32.531293] [INFO ] [MAIN ] Derivative Progress: 1232/2026 symbols completed. NFG took 1.0s. Estimated remaining: 4m 18s. Rate: 184.5 symbols/min [2025-09-16T21:18:32.533878] [INFO ] [MAIN ] NGS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:32.536310] [DEBUG] [LOCAL ] NGG: Derivative data saved (1339 records). [2025-09-16T21:18:32.542140] [INFO ] [MAIN ] NGG: Successfully saved derivative data. [2025-09-16T21:18:32.544459] [INFO ] [MAIN ] Derivative Progress: 1233/2026 symbols completed. NGG took 1.0s. Estimated remaining: 4m 18s. Rate: 184.6 symbols/min [2025-09-16T21:18:32.544799] [INFO ] [MAIN ] NGVC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:32.558230] [DEBUG] [LOCAL ] NGL: Loaded 22839 existing records from primary storage. [2025-09-16T21:18:32.558499] [INFO ] [MAIN ] NGL: Loaded 22839 primary data records. [2025-09-16T21:18:32.577934] [DEBUG] [LOCAL ] NGS: Loaded 8086 existing records from primary storage. [2025-09-16T21:18:32.599049] [INFO ] [MAIN ] NGS: Loaded 8086 primary data records. [2025-09-16T21:18:32.801485] [DEBUG] [LOCAL ] NGVC: Loaded 17387 existing records from primary storage. [2025-09-16T21:18:32.891953] [INFO ] [MAIN ] NGVC: Loaded 17387 primary data records. [2025-09-16T21:18:33.391528] [DEBUG] [MAIN ] NGL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:33.398044] [INFO ] [MAIN ] NGL: Generated 1339 derivative records from 22839 primary records. [2025-09-16T21:18:33.401632] [DEBUG] [LOCAL ] NGL: Saving derivative data. [2025-09-16T21:18:33.401874] [DEBUG] [MAIN ] NGS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:33.403154] [INFO ] [MAIN ] NGS: Generated 1339 derivative records from 8086 primary records. [2025-09-16T21:18:33.408650] [DEBUG] [LOCAL ] NGS: Saving derivative data. [2025-09-16T21:18:33.420543] [DEBUG] [LOCAL ] NGL: Derivative data saved (1339 records). [2025-09-16T21:18:33.420698] [INFO ] [MAIN ] NGL: Successfully saved derivative data. [2025-09-16T21:18:33.422989] [INFO ] [MAIN ] Derivative Progress: 1234/2026 symbols completed. NGL took 0.9s. Estimated remaining: 4m 18s. Rate: 184.4 symbols/min [2025-09-16T21:18:33.423166] [INFO ] [MAIN ] NGVT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:33.430886] [DEBUG] [LOCAL ] NGS: Derivative data saved (1339 records). [2025-09-16T21:18:33.440232] [INFO ] [MAIN ] NGS: Successfully saved derivative data. [2025-09-16T21:18:33.440595] [DEBUG] [MAIN ] NGVC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:33.442837] [INFO ] [MAIN ] Derivative Progress: 1235/2026 symbols completed. NGS took 0.9s. Estimated remaining: 4m 17s. Rate: 184.5 symbols/min [2025-09-16T21:18:33.443804] [INFO ] [MAIN ] NGVC: Generated 1339 derivative records from 17387 primary records. [2025-09-16T21:18:33.443953] [INFO ] [MAIN ] NHI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:33.444000] [DEBUG] [LOCAL ] NGVC: Saving derivative data. [2025-09-16T21:18:33.468369] [DEBUG] [LOCAL ] NGVT: Loaded 17986 existing records from primary storage. [2025-09-16T21:18:33.468018] [DEBUG] [LOCAL ] NGVC: Derivative data saved (1339 records). [2025-09-16T21:18:33.471904] [INFO ] [MAIN ] NGVT: Loaded 17986 primary data records. [2025-09-16T21:18:33.471960] [INFO ] [MAIN ] NGVC: Successfully saved derivative data. [2025-09-16T21:18:33.474150] [INFO ] [MAIN ] Derivative Progress: 1236/2026 symbols completed. NGVC took 0.9s. Estimated remaining: 4m 17s. Rate: 184.6 symbols/min [2025-09-16T21:18:33.505344] [INFO ] [MAIN ] NI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:33.570987] [DEBUG] [LOCAL ] NHI: Loaded 16442 existing records from primary storage. [2025-09-16T21:18:33.587524] [INFO ] [MAIN ] NHI: Loaded 16442 primary data records. [2025-09-16T21:18:34.103558] [DEBUG] [LOCAL ] NI: Loaded 39798 existing records from primary storage. [2025-09-16T21:18:34.103861] [INFO ] [MAIN ] NI: Loaded 39798 primary data records. [2025-09-16T21:18:34.392225] [DEBUG] [MAIN ] NGVT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:34.393942] [INFO ] [MAIN ] NGVT: Generated 1339 derivative records from 17986 primary records. [2025-09-16T21:18:34.394360] [DEBUG] [LOCAL ] NGVT: Saving derivative data. [2025-09-16T21:18:34.415819] [DEBUG] [LOCAL ] NGVT: Derivative data saved (1339 records). [2025-09-16T21:18:34.419722] [INFO ] [MAIN ] NGVT: Successfully saved derivative data. [2025-09-16T21:18:34.421735] [INFO ] [MAIN ] Derivative Progress: 1237/2026 symbols completed. NGVT took 1.0s. Estimated remaining: 4m 17s. Rate: 184.3 symbols/min [2025-09-16T21:18:34.419567] [DEBUG] [MAIN ] NHI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:34.422884] [INFO ] [MAIN ] NIC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:34.423829] [INFO ] [MAIN ] NHI: Generated 1339 derivative records from 16442 primary records. [2025-09-16T21:18:34.424150] [DEBUG] [LOCAL ] NHI: Saving derivative data. [2025-09-16T21:18:34.438932] [DEBUG] [LOCAL ] NHI: Derivative data saved (1339 records). [2025-09-16T21:18:34.439252] [INFO ] [MAIN ] NHI: Successfully saved derivative data. [2025-09-16T21:18:34.441525] [INFO ] [MAIN ] Derivative Progress: 1238/2026 symbols completed. NHI took 1.0s. Estimated remaining: 4m 16s. Rate: 184.5 symbols/min [2025-09-16T21:18:34.441760] [INFO ] [MAIN ] NIE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:34.446085] [DEBUG] [LOCAL ] NIC: Loaded 6454 existing records from primary storage. [2025-09-16T21:18:34.447791] [INFO ] [MAIN ] NIC: Loaded 6454 primary data records. [2025-09-16T21:18:34.530683] [DEBUG] [MAIN ] NI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:34.552103] [INFO ] [MAIN ] NI: Generated 1339 derivative records from 39798 primary records. [2025-09-16T21:18:34.541032] [DEBUG] [LOCAL ] NIE: Loaded 8168 existing records from primary storage. [2025-09-16T21:18:34.552329] [INFO ] [MAIN ] NIE: Loaded 8168 primary data records. [2025-09-16T21:18:34.552246] [DEBUG] [LOCAL ] NI: Saving derivative data. [2025-09-16T21:18:34.705357] [DEBUG] [LOCAL ] NI: Derivative data saved (1339 records). [2025-09-16T21:18:34.752462] [INFO ] [MAIN ] NI: Successfully saved derivative data. [2025-09-16T21:18:34.846611] [INFO ] [MAIN ] Derivative Progress: 1239/2026 symbols completed. NI took 1.3s. Estimated remaining: 4m 16s. Rate: 184.5 symbols/min [2025-09-16T21:18:34.857834] [INFO ] [MAIN ] NIM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:34.924233] [DEBUG] [LOCAL ] NIM: Loaded 2731 existing records from primary storage. [2025-09-16T21:18:34.924452] [INFO ] [MAIN ] NIM: Loaded 2731 primary data records. [2025-09-16T21:18:35.298313] [DEBUG] [MAIN ] NIC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:35.300194] [INFO ] [MAIN ] NIC: Generated 1339 derivative records from 6454 primary records. [2025-09-16T21:18:35.301145] [DEBUG] [LOCAL ] NIC: Saving derivative data. [2025-09-16T21:18:35.315691] [DEBUG] [LOCAL ] NIC: Derivative data saved (1339 records). [2025-09-16T21:18:35.316031] [INFO ] [MAIN ] NIC: Successfully saved derivative data. [2025-09-16T21:18:35.324410] [INFO ] [MAIN ] Derivative Progress: 1240/2026 symbols completed. NIC took 0.9s. Estimated remaining: 4m 16s. Rate: 184.4 symbols/min [2025-09-16T21:18:35.328237] [INFO ] [MAIN ] NINE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:35.329186] [DEBUG] [MAIN ] NIE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:35.330127] [INFO ] [MAIN ] NIE: Generated 1339 derivative records from 8168 primary records. [2025-09-16T21:18:35.330426] [DEBUG] [LOCAL ] NIE: Saving derivative data. [2025-09-16T21:18:35.343295] [DEBUG] [LOCAL ] NIE: Derivative data saved (1339 records). [2025-09-16T21:18:35.343485] [INFO ] [MAIN ] NIE: Successfully saved derivative data. [2025-09-16T21:18:35.345720] [INFO ] [MAIN ] Derivative Progress: 1241/2026 symbols completed. NIE took 0.9s. Estimated remaining: 4m 15s. Rate: 184.5 symbols/min [2025-09-16T21:18:35.346420] [INFO ] [MAIN ] NIO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:35.372932] [DEBUG] [MAIN ] NIM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:35.373464] [DEBUG] [LOCAL ] NINE: Loaded 21737 existing records from primary storage. [2025-09-16T21:18:35.374194] [INFO ] [MAIN ] NIM: Generated 1339 derivative records from 2731 primary records. [2025-09-16T21:18:35.374394] [INFO ] [MAIN ] NINE: Loaded 21737 primary data records. [2025-09-16T21:18:35.374343] [DEBUG] [LOCAL ] NIM: Saving derivative data. [2025-09-16T21:18:35.553023] [DEBUG] [LOCAL ] NIM: Derivative data saved (1339 records). [2025-09-16T21:18:35.583719] [INFO ] [MAIN ] NIM: Successfully saved derivative data. [2025-09-16T21:18:35.669133] [DEBUG] [LOCAL ] NIO: Loaded 40152 existing records from primary storage. [2025-09-16T21:18:35.671274] [INFO ] [MAIN ] Derivative Progress: 1242/2026 symbols completed. NIM took 0.8s. Estimated remaining: 4m 15s. Rate: 184.5 symbols/min [2025-09-16T21:18:35.671581] [INFO ] [MAIN ] NIO: Loaded 40152 primary data records. [2025-09-16T21:18:35.683253] [INFO ] [MAIN ] NJR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:35.963973] [DEBUG] [LOCAL ] NJR: Loaded 28028 existing records from primary storage. [2025-09-16T21:18:35.964230] [INFO ] [MAIN ] NJR: Loaded 28028 primary data records. [2025-09-16T21:18:36.139544] [DEBUG] [MAIN ] NINE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:36.170570] [INFO ] [MAIN ] NINE: Generated 1339 derivative records from 21737 primary records. [2025-09-16T21:18:36.196689] [DEBUG] [LOCAL ] NINE: Saving derivative data. [2025-09-16T21:18:36.317320] [DEBUG] [LOCAL ] NINE: Derivative data saved (1339 records). [2025-09-16T21:18:36.318872] [INFO ] [MAIN ] NINE: Successfully saved derivative data. [2025-09-16T21:18:36.321803] [INFO ] [MAIN ] Derivative Progress: 1243/2026 symbols completed. NINE took 1.0s. Estimated remaining: 4m 15s. Rate: 184.4 symbols/min [2025-09-16T21:18:36.332400] [DEBUG] [MAIN ] NIO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:36.333446] [INFO ] [MAIN ] NIO: Generated 1339 derivative records from 40152 primary records. [2025-09-16T21:18:36.333515] [DEBUG] [LOCAL ] NIO: Saving derivative data. [2025-09-16T21:18:36.346202] [DEBUG] [LOCAL ] NIO: Derivative data saved (1339 records). [2025-09-16T21:18:36.346275] [INFO ] [MAIN ] NIO: Successfully saved derivative data. [2025-09-16T21:18:36.348958] [INFO ] [MAIN ] Derivative Progress: 1244/2026 symbols completed. NIO took 1.0s. Estimated remaining: 4m 14s. Rate: 184.5 symbols/min [2025-09-16T21:18:36.361380] [DEBUG] [MAIN ] NJR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:36.361920] [INFO ] [MAIN ] NJR: Generated 1339 derivative records from 28028 primary records. [2025-09-16T21:18:36.361979] [DEBUG] [LOCAL ] NJR: Saving derivative data. [2025-09-16T21:18:36.373321] [DEBUG] [LOCAL ] NJR: Derivative data saved (1339 records). [2025-09-16T21:18:36.373379] [INFO ] [MAIN ] NJR: Successfully saved derivative data. [2025-09-16T21:18:36.375575] [INFO ] [MAIN ] Derivative Progress: 1245/2026 symbols completed. NJR took 0.7s. Estimated remaining: 4m 14s. Rate: 184.6 symbols/min [2025-09-16T21:18:36.376162] [INFO ] [MAIN ] NLY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:36.376221] [INFO ] [MAIN ] NLOP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:36.376026] [INFO ] [MAIN ] NKX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:36.389033] [DEBUG] [LOCAL ] NLOP: Loaded 8444 existing records from primary storage. [2025-09-16T21:18:36.392937] [INFO ] [MAIN ] NLOP: Loaded 8444 primary data records. [2025-09-16T21:18:36.393206] [DEBUG] [LOCAL ] NKX: Loaded 10327 existing records from primary storage. [2025-09-16T21:18:36.413729] [INFO ] [MAIN ] NKX: Loaded 10327 primary data records. [2025-09-16T21:18:36.805015] [DEBUG] [LOCAL ] NLY: Loaded 39940 existing records from primary storage. [2025-09-16T21:18:36.850835] [INFO ] [MAIN ] NLY: Loaded 39940 primary data records. [2025-09-16T21:18:37.225324] [DEBUG] [MAIN ] NLOP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:37.226275] [INFO ] [MAIN ] NLOP: Generated 1339 derivative records from 8444 primary records. [2025-09-16T21:18:37.235617] [DEBUG] [LOCAL ] NLOP: Saving derivative data. [2025-09-16T21:18:37.235836] [DEBUG] [MAIN ] NKX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:37.236808] [INFO ] [MAIN ] NKX: Generated 1339 derivative records from 10327 primary records. [2025-09-16T21:18:37.242840] [DEBUG] [LOCAL ] NKX: Saving derivative data. [2025-09-16T21:18:37.260565] [DEBUG] [LOCAL ] NLOP: Derivative data saved (1339 records). [2025-09-16T21:18:37.261958] [DEBUG] [LOCAL ] NKX: Derivative data saved (1339 records). [2025-09-16T21:18:37.262037] [INFO ] [MAIN ] NKX: Successfully saved derivative data. [2025-09-16T21:18:37.261486] [INFO ] [MAIN ] NLOP: Successfully saved derivative data. [2025-09-16T21:18:37.264003] [INFO ] [MAIN ] Derivative Progress: 1246/2026 symbols completed. NLOP took 0.9s. Estimated remaining: 4m 14s. Rate: 184.4 symbols/min [2025-09-16T21:18:37.266247] [INFO ] [MAIN ] NMAI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:37.266438] [INFO ] [MAIN ] Derivative Progress: 1247/2026 symbols completed. NKX took 0.9s. Estimated remaining: 4m 13s. Rate: 184.5 symbols/min [2025-09-16T21:18:37.266688] [INFO ] [MAIN ] NMCO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:37.276802] [DEBUG] [MAIN ] NLY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:37.277416] [INFO ] [MAIN ] NLY: Generated 1339 derivative records from 39940 primary records. [2025-09-16T21:18:37.277656] [DEBUG] [LOCAL ] NLY: Saving derivative data. [2025-09-16T21:18:37.295079] [DEBUG] [LOCAL ] NLY: Derivative data saved (1339 records). [2025-09-16T21:18:37.295202] [INFO ] [MAIN ] NLY: Successfully saved derivative data. [2025-09-16T21:18:37.297260] [INFO ] [MAIN ] Derivative Progress: 1248/2026 symbols completed. NLY took 0.9s. Estimated remaining: 4m 13s. Rate: 184.7 symbols/min [2025-09-16T21:18:37.297513] [INFO ] [MAIN ] NMG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:37.306865] [DEBUG] [LOCAL ] NMAI: Loaded 9353 existing records from primary storage. [2025-09-16T21:18:37.307088] [DEBUG] [LOCAL ] NMCO: Loaded 12358 existing records from primary storage. [2025-09-16T21:18:37.307294] [INFO ] [MAIN ] NMCO: Loaded 12358 primary data records. [2025-09-16T21:18:37.307248] [INFO ] [MAIN ] NMAI: Loaded 9353 primary data records. [2025-09-16T21:18:37.433840] [DEBUG] [LOCAL ] NMG: Loaded 5702 existing records from primary storage. [2025-09-16T21:18:37.510236] [INFO ] [MAIN ] NMG: Loaded 5702 primary data records. [2025-09-16T21:18:38.124656] [DEBUG] [MAIN ] NMCO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:38.125461] [INFO ] [MAIN ] NMCO: Generated 1339 derivative records from 12358 primary records. [2025-09-16T21:18:38.125744] [DEBUG] [LOCAL ] NMCO: Saving derivative data. [2025-09-16T21:18:38.137919] [DEBUG] [LOCAL ] NMCO: Derivative data saved (1339 records). [2025-09-16T21:18:38.138083] [INFO ] [MAIN ] NMCO: Successfully saved derivative data. [2025-09-16T21:18:38.140232] [INFO ] [MAIN ] Derivative Progress: 1249/2026 symbols completed. NMCO took 0.9s. Estimated remaining: 4m 13s. Rate: 184.4 symbols/min [2025-09-16T21:18:38.142046] [INFO ] [MAIN ] NMI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:38.156605] [DEBUG] [MAIN ] NMG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:38.168975] [DEBUG] [LOCAL ] NMI: Loaded 3398 existing records from primary storage. [2025-09-16T21:18:38.169316] [INFO ] [MAIN ] NMI: Loaded 3398 primary data records. [2025-09-16T21:18:38.169254] [DEBUG] [MAIN ] NMAI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:38.166722] [INFO ] [MAIN ] NMG: Generated 1339 derivative records from 5702 primary records. [2025-09-16T21:18:38.170006] [INFO ] [MAIN ] NMAI: Generated 1339 derivative records from 9353 primary records. [2025-09-16T21:18:38.206130] [DEBUG] [LOCAL ] NMG: Saving derivative data. [2025-09-16T21:18:38.213082] [DEBUG] [LOCAL ] NMAI: Saving derivative data. [2025-09-16T21:18:38.343499] [DEBUG] [LOCAL ] NMAI: Derivative data saved (1339 records). [2025-09-16T21:18:38.353981] [INFO ] [MAIN ] NMAI: Successfully saved derivative data. [2025-09-16T21:18:38.378998] [INFO ] [MAIN ] Derivative Progress: 1250/2026 symbols completed. NMAI took 1.1s. Estimated remaining: 4m 12s. Rate: 184.5 symbols/min [2025-09-16T21:18:38.503050] [INFO ] [MAIN ] NMM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:38.502611] [DEBUG] [LOCAL ] NMG: Derivative data saved (1339 records). [2025-09-16T21:18:38.503288] [INFO ] [MAIN ] NMG: Successfully saved derivative data. [2025-09-16T21:18:38.505709] [INFO ] [MAIN ] Derivative Progress: 1251/2026 symbols completed. NMG took 1.2s. Estimated remaining: 4m 12s. Rate: 184.6 symbols/min [2025-09-16T21:18:38.505977] [INFO ] [MAIN ] NMR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:38.518129] [DEBUG] [LOCAL ] NMM: Loaded 9943 existing records from primary storage. [2025-09-16T21:18:38.518334] [INFO ] [MAIN ] NMM: Loaded 9943 primary data records. [2025-09-16T21:18:38.663693] [DEBUG] [LOCAL ] NMR: Loaded 25500 existing records from primary storage. [2025-09-16T21:18:38.686849] [INFO ] [MAIN ] NMR: Loaded 25500 primary data records. [2025-09-16T21:18:38.893150] [DEBUG] [MAIN ] NMI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:38.910546] [INFO ] [MAIN ] NMI: Generated 1339 derivative records from 3398 primary records. [2025-09-16T21:18:38.916871] [DEBUG] [LOCAL ] NMI: Saving derivative data. [2025-09-16T21:18:39.001300] [DEBUG] [LOCAL ] NMI: Derivative data saved (1339 records). [2025-09-16T21:18:39.021763] [INFO ] [MAIN ] NMI: Successfully saved derivative data. [2025-09-16T21:18:39.111071] [INFO ] [MAIN ] Derivative Progress: 1252/2026 symbols completed. NMI took 1.0s. Estimated remaining: 4m 12s. Rate: 184.4 symbols/min [2025-09-16T21:18:39.112036] [INFO ] [MAIN ] NMS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:39.119764] [DEBUG] [LOCAL ] NMS: Loaded 2310 existing records from primary storage. [2025-09-16T21:18:39.120245] [INFO ] [MAIN ] NMS: Loaded 2310 primary data records. [2025-09-16T21:18:39.199888] [DEBUG] [MAIN ] NMM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:39.223371] [INFO ] [MAIN ] NMM: Generated 1339 derivative records from 9943 primary records. [2025-09-16T21:18:39.238040] [DEBUG] [LOCAL ] NMM: Saving derivative data. [2025-09-16T21:18:39.329375] [DEBUG] [LOCAL ] NMM: Derivative data saved (1339 records). [2025-09-16T21:18:39.329578] [INFO ] [MAIN ] NMM: Successfully saved derivative data. [2025-09-16T21:18:39.331827] [INFO ] [MAIN ] Derivative Progress: 1253/2026 symbols completed. NMM took 0.8s. Estimated remaining: 4m 11s. Rate: 184.5 symbols/min [2025-09-16T21:18:39.417838] [INFO ] [MAIN ] NMT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:39.433832] [DEBUG] [LOCAL ] NMT: Loaded 2165 existing records from primary storage. [2025-09-16T21:18:39.434555] [DEBUG] [MAIN ] NMR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:39.434742] [INFO ] [MAIN ] NMT: Loaded 2165 primary data records. [2025-09-16T21:18:39.447011] [INFO ] [MAIN ] NMR: Generated 1339 derivative records from 25500 primary records. [2025-09-16T21:18:39.484497] [DEBUG] [LOCAL ] NMR: Saving derivative data. [2025-09-16T21:18:39.627038] [DEBUG] [LOCAL ] NMR: Derivative data saved (1339 records). [2025-09-16T21:18:39.629757] [INFO ] [MAIN ] NMR: Successfully saved derivative data. [2025-09-16T21:18:39.713961] [INFO ] [MAIN ] Derivative Progress: 1254/2026 symbols completed. NMR took 1.2s. Estimated remaining: 4m 11s. Rate: 184.5 symbols/min [2025-09-16T21:18:39.715113] [INFO ] [MAIN ] NMZ: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:39.729569] [DEBUG] [MAIN ] NMS: Filtered 5181 bins outside market hours, 5780 incomplete bins [2025-09-16T21:18:39.730815] [INFO ] [MAIN ] NMS: Generated 1338 derivative records from 2310 primary records. [2025-09-16T21:18:39.731169] [DEBUG] [LOCAL ] NMS: Saving derivative data. [2025-09-16T21:18:39.747337] [DEBUG] [LOCAL ] NMS: Derivative data saved (1338 records). [2025-09-16T21:18:39.753199] [DEBUG] [LOCAL ] NMZ: Loaded 15515 existing records from primary storage. [2025-09-16T21:18:39.752953] [INFO ] [MAIN ] NMS: Successfully saved derivative data. [2025-09-16T21:18:39.753444] [INFO ] [MAIN ] NMZ: Loaded 15515 primary data records. [2025-09-16T21:18:39.755456] [INFO ] [MAIN ] Derivative Progress: 1255/2026 symbols completed. NMS took 0.6s. Estimated remaining: 4m 11s. Rate: 184.6 symbols/min [2025-09-16T21:18:39.761085] [INFO ] [MAIN ] NNI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:39.890806] [DEBUG] [MAIN ] NMT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:39.941227] [INFO ] [MAIN ] NMT: Generated 1339 derivative records from 2165 primary records. [2025-09-16T21:18:39.920217] [DEBUG] [LOCAL ] NNI: Loaded 8009 existing records from primary storage. [2025-09-16T21:18:39.966263] [DEBUG] [LOCAL ] NMT: Saving derivative data. [2025-09-16T21:18:39.968859] [INFO ] [MAIN ] NNI: Loaded 8009 primary data records. [2025-09-16T21:18:40.157308] [DEBUG] [LOCAL ] NMT: Derivative data saved (1339 records). [2025-09-16T21:18:40.175818] [INFO ] [MAIN ] NMT: Successfully saved derivative data. [2025-09-16T21:18:40.177998] [INFO ] [MAIN ] Derivative Progress: 1256/2026 symbols completed. NMT took 0.8s. Estimated remaining: 4m 10s. Rate: 184.5 symbols/min [2025-09-16T21:18:40.178854] [INFO ] [MAIN ] NNN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:40.356355] [DEBUG] [MAIN ] NMZ: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:40.357338] [INFO ] [MAIN ] NMZ: Generated 1339 derivative records from 15515 primary records. [2025-09-16T21:18:40.358430] [DEBUG] [LOCAL ] NMZ: Saving derivative data. [2025-09-16T21:18:40.379403] [DEBUG] [LOCAL ] NMZ: Derivative data saved (1339 records). [2025-09-16T21:18:40.379678] [INFO ] [MAIN ] NMZ: Successfully saved derivative data. [2025-09-16T21:18:40.381754] [INFO ] [MAIN ] Derivative Progress: 1257/2026 symbols completed. NMZ took 0.7s. Estimated remaining: 4m 10s. Rate: 184.6 symbols/min [2025-09-16T21:18:40.382108] [INFO ] [MAIN ] NNY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:40.408818] [DEBUG] [LOCAL ] NNN: Loaded 35852 existing records from primary storage. [2025-09-16T21:18:40.408977] [DEBUG] [LOCAL ] NNY: Loaded 4241 existing records from primary storage. [2025-09-16T21:18:40.409504] [INFO ] [MAIN ] NNY: Loaded 4241 primary data records. [2025-09-16T21:18:40.409585] [INFO ] [MAIN ] NNN: Loaded 35852 primary data records. [2025-09-16T21:18:40.409437] [DEBUG] [MAIN ] NNI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:40.410251] [INFO ] [MAIN ] NNI: Generated 1339 derivative records from 8009 primary records. [2025-09-16T21:18:40.463194] [DEBUG] [LOCAL ] NNI: Saving derivative data. [2025-09-16T21:18:40.647567] [DEBUG] [LOCAL ] NNI: Derivative data saved (1339 records). [2025-09-16T21:18:40.693826] [INFO ] [MAIN ] NNI: Successfully saved derivative data. [2025-09-16T21:18:40.735011] [INFO ] [MAIN ] Derivative Progress: 1258/2026 symbols completed. NNI took 1.0s. Estimated remaining: 4m 10s. Rate: 184.6 symbols/min [2025-09-16T21:18:41.027215] [DEBUG] [MAIN ] NNN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:41.027010] [DEBUG] [MAIN ] NNY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:41.027941] [INFO ] [MAIN ] NNN: Generated 1339 derivative records from 35852 primary records. [2025-09-16T21:18:41.028414] [INFO ] [MAIN ] NNY: Generated 1339 derivative records from 4241 primary records. [2025-09-16T21:18:41.028494] [DEBUG] [LOCAL ] NNN: Saving derivative data. [2025-09-16T21:18:41.028578] [DEBUG] [LOCAL ] NNY: Saving derivative data. [2025-09-16T21:18:41.048764] [DEBUG] [LOCAL ] NNY: Derivative data saved (1339 records). [2025-09-16T21:18:41.051566] [INFO ] [MAIN ] NNY: Successfully saved derivative data. [2025-09-16T21:18:41.053862] [INFO ] [MAIN ] Derivative Progress: 1259/2026 symbols completed. NNY took 0.7s. Estimated remaining: 4m 9s. Rate: 184.6 symbols/min [2025-09-16T21:18:41.051626] [DEBUG] [LOCAL ] NNN: Derivative data saved (1339 records). [2025-09-16T21:18:41.053998] [INFO ] [MAIN ] NNN: Successfully saved derivative data. [2025-09-16T21:18:41.055996] [INFO ] [MAIN ] Derivative Progress: 1260/2026 symbols completed. NNN took 0.9s. Estimated remaining: 4m 9s. Rate: 184.7 symbols/min [2025-09-16T21:18:41.056391] [INFO ] [MAIN ] NOA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:41.056591] [INFO ] [MAIN ] NOC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:41.056534] [INFO ] [MAIN ] NOAH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:41.073213] [DEBUG] [LOCAL ] NOA: Loaded 11427 existing records from primary storage. [2025-09-16T21:18:41.073441] [INFO ] [MAIN ] NOA: Loaded 11427 primary data records. [2025-09-16T21:18:41.138939] [DEBUG] [LOCAL ] NOAH: Loaded 14444 existing records from primary storage. [2025-09-16T21:18:41.173599] [INFO ] [MAIN ] NOAH: Loaded 14444 primary data records. [2025-09-16T21:18:41.386823] [DEBUG] [LOCAL ] NOC: Loaded 31318 existing records from primary storage. [2025-09-16T21:18:41.463618] [INFO ] [MAIN ] NOC: Loaded 31318 primary data records. [2025-09-16T21:18:41.929303] [DEBUG] [MAIN ] NOA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:41.932418] [INFO ] [MAIN ] NOA: Generated 1339 derivative records from 11427 primary records. [2025-09-16T21:18:41.933247] [DEBUG] [LOCAL ] NOA: Saving derivative data. [2025-09-16T21:18:41.944098] [DEBUG] [MAIN ] NOAH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:41.945059] [INFO ] [MAIN ] NOAH: Generated 1339 derivative records from 14444 primary records. [2025-09-16T21:18:41.945510] [DEBUG] [LOCAL ] NOAH: Saving derivative data. [2025-09-16T21:18:41.967355] [DEBUG] [LOCAL ] NOAH: Derivative data saved (1339 records). [2025-09-16T21:18:41.968748] [INFO ] [MAIN ] NOAH: Successfully saved derivative data. [2025-09-16T21:18:41.969175] [DEBUG] [LOCAL ] NOA: Derivative data saved (1339 records). [2025-09-16T21:18:41.971339] [INFO ] [MAIN ] Derivative Progress: 1261/2026 symbols completed. NOAH took 0.9s. Estimated remaining: 4m 9s. Rate: 184.5 symbols/min [2025-09-16T21:18:41.971492] [INFO ] [MAIN ] NOA: Successfully saved derivative data. [2025-09-16T21:18:41.971716] [INFO ] [MAIN ] NOG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:41.973600] [INFO ] [MAIN ] Derivative Progress: 1262/2026 symbols completed. NOA took 0.9s. Estimated remaining: 4m 8s. Rate: 184.6 symbols/min [2025-09-16T21:18:41.973888] [INFO ] [MAIN ] NOK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:41.987316] [DEBUG] [MAIN ] NOC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:41.987984] [INFO ] [MAIN ] NOC: Generated 1339 derivative records from 31318 primary records. [2025-09-16T21:18:41.988101] [DEBUG] [LOCAL ] NOC: Saving derivative data. [2025-09-16T21:18:42.000187] [DEBUG] [LOCAL ] NOC: Derivative data saved (1339 records). [2025-09-16T21:18:42.000295] [INFO ] [MAIN ] NOC: Successfully saved derivative data. [2025-09-16T21:18:42.002410] [INFO ] [MAIN ] Derivative Progress: 1263/2026 symbols completed. NOC took 0.9s. Estimated remaining: 4m 8s. Rate: 184.7 symbols/min [2025-09-16T21:18:42.002671] [INFO ] [MAIN ] NOMD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:42.062549] [DEBUG] [LOCAL ] NOK: Loaded 39972 existing records from primary storage. [2025-09-16T21:18:42.062795] [INFO ] [MAIN ] NOK: Loaded 39972 primary data records. [2025-09-16T21:18:42.063285] [DEBUG] [LOCAL ] NOG: Loaded 37995 existing records from primary storage. [2025-09-16T21:18:42.068704] [INFO ] [MAIN ] NOG: Loaded 37995 primary data records. [2025-09-16T21:18:42.269688] [DEBUG] [LOCAL ] NOMD: Loaded 31155 existing records from primary storage. [2025-09-16T21:18:42.287279] [INFO ] [MAIN ] NOMD: Loaded 31155 primary data records. [2025-09-16T21:18:42.958313] [DEBUG] [MAIN ] NOG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:42.959293] [INFO ] [MAIN ] NOG: Generated 1339 derivative records from 37995 primary records. [2025-09-16T21:18:42.961128] [DEBUG] [LOCAL ] NOG: Saving derivative data. [2025-09-16T21:18:42.979935] [DEBUG] [LOCAL ] NOG: Derivative data saved (1339 records). [2025-09-16T21:18:42.980023] [INFO ] [MAIN ] NOG: Successfully saved derivative data. [2025-09-16T21:18:42.985083] [INFO ] [MAIN ] Derivative Progress: 1264/2026 symbols completed. NOG took 1.0s. Estimated remaining: 4m 8s. Rate: 184.4 symbols/min [2025-09-16T21:18:42.986241] [INFO ] [MAIN ] NOTE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:42.985383] [DEBUG] [MAIN ] NOK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:42.988591] [INFO ] [MAIN ] NOK: Generated 1339 derivative records from 39972 primary records. [2025-09-16T21:18:42.988812] [DEBUG] [LOCAL ] NOK: Saving derivative data. [2025-09-16T21:18:43.007684] [DEBUG] [MAIN ] NOMD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:43.010319] [INFO ] [MAIN ] NOMD: Generated 1339 derivative records from 31155 primary records. [2025-09-16T21:18:43.010470] [DEBUG] [LOCAL ] NOMD: Saving derivative data. [2025-09-16T21:18:43.012023] [DEBUG] [LOCAL ] NOK: Derivative data saved (1339 records). [2025-09-16T21:18:43.020821] [INFO ] [MAIN ] NOK: Successfully saved derivative data. [2025-09-16T21:18:43.025517] [INFO ] [MAIN ] Derivative Progress: 1265/2026 symbols completed. NOK took 1.1s. Estimated remaining: 4m 7s. Rate: 184.6 symbols/min [2025-09-16T21:18:43.028215] [DEBUG] [LOCAL ] NOMD: Derivative data saved (1339 records). [2025-09-16T21:18:43.028414] [INFO ] [MAIN ] NOMD: Successfully saved derivative data. [2025-09-16T21:18:43.030799] [INFO ] [MAIN ] NOV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:43.030942] [INFO ] [MAIN ] Derivative Progress: 1266/2026 symbols completed. NOMD took 1.0s. Estimated remaining: 4m 7s. Rate: 184.7 symbols/min [2025-09-16T21:18:43.031401] [INFO ] [MAIN ] NOW: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:43.053584] [DEBUG] [LOCAL ] NOTE: Loaded 32557 existing records from primary storage. [2025-09-16T21:18:43.053768] [INFO ] [MAIN ] NOTE: Loaded 32557 primary data records. [2025-09-16T21:18:43.358771] [DEBUG] [LOCAL ] NOW: Loaded 35748 existing records from primary storage. [2025-09-16T21:18:43.359530] [DEBUG] [LOCAL ] NOV: Loaded 39589 existing records from primary storage. [2025-09-16T21:18:43.359959] [INFO ] [MAIN ] NOV: Loaded 39589 primary data records. [2025-09-16T21:18:43.360056] [INFO ] [MAIN ] NOW: Loaded 35748 primary data records. [2025-09-16T21:18:43.918062] [DEBUG] [MAIN ] NOTE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:43.919791] [INFO ] [MAIN ] NOTE: Generated 1339 derivative records from 32557 primary records. [2025-09-16T21:18:43.920366] [DEBUG] [LOCAL ] NOTE: Saving derivative data. [2025-09-16T21:18:43.934956] [DEBUG] [LOCAL ] NOTE: Derivative data saved (1339 records). [2025-09-16T21:18:43.935163] [INFO ] [MAIN ] NOTE: Successfully saved derivative data. [2025-09-16T21:18:43.937165] [INFO ] [MAIN ] Derivative Progress: 1267/2026 symbols completed. NOTE took 1.0s. Estimated remaining: 4m 7s. Rate: 184.5 symbols/min [2025-09-16T21:18:43.937461] [INFO ] [MAIN ] NPCT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:43.964139] [DEBUG] [MAIN ] NOV: Filtered 5181 bins outside market hours, 5780 incomplete bins [2025-09-16T21:18:43.968353] [DEBUG] [MAIN ] NOW: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:43.973704] [INFO ] [MAIN ] NOV: Generated 1338 derivative records from 39589 primary records. [2025-09-16T21:18:43.974005] [DEBUG] [LOCAL ] NPCT: Loaded 12794 existing records from primary storage. [2025-09-16T21:18:43.974290] [INFO ] [MAIN ] NPCT: Loaded 12794 primary data records. [2025-09-16T21:18:43.975460] [DEBUG] [LOCAL ] NOV: Saving derivative data. [2025-09-16T21:18:43.975272] [INFO ] [MAIN ] NOW: Generated 1339 derivative records from 35748 primary records. [2025-09-16T21:18:43.976245] [DEBUG] [LOCAL ] NOW: Saving derivative data. [2025-09-16T21:18:44.114512] [DEBUG] [LOCAL ] NOV: Derivative data saved (1338 records). [2025-09-16T21:18:44.120934] [INFO ] [MAIN ] NOV: Successfully saved derivative data. [2025-09-16T21:18:44.132825] [DEBUG] [LOCAL ] NOW: Derivative data saved (1339 records). [2025-09-16T21:18:44.132958] [INFO ] [MAIN ] NOW: Successfully saved derivative data. [2025-09-16T21:18:44.134974] [INFO ] [MAIN ] Derivative Progress: 1268/2026 symbols completed. NOW took 1.1s. Estimated remaining: 4m 6s. Rate: 184.5 symbols/min [2025-09-16T21:18:44.150204] [INFO ] [MAIN ] Derivative Progress: 1269/2026 symbols completed. NOV took 1.1s. Estimated remaining: 4m 6s. Rate: 184.7 symbols/min [2025-09-16T21:18:44.183088] [INFO ] [MAIN ] NPFD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:44.182844] [INFO ] [MAIN ] NPK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:44.318074] [DEBUG] [LOCAL ] NPFD: Loaded 6777 existing records from primary storage. [2025-09-16T21:18:44.318401] [INFO ] [MAIN ] NPFD: Loaded 6777 primary data records. [2025-09-16T21:18:44.355385] [DEBUG] [LOCAL ] NPK: Loaded 6388 existing records from primary storage. [2025-09-16T21:18:44.367946] [INFO ] [MAIN ] NPK: Loaded 6388 primary data records. [2025-09-16T21:18:44.875846] [DEBUG] [MAIN ] NPCT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:44.877616] [INFO ] [MAIN ] NPCT: Generated 1339 derivative records from 12794 primary records. [2025-09-16T21:18:44.878373] [DEBUG] [LOCAL ] NPCT: Saving derivative data. [2025-09-16T21:18:44.893304] [DEBUG] [LOCAL ] NPCT: Derivative data saved (1339 records). [2025-09-16T21:18:44.893661] [INFO ] [MAIN ] NPCT: Successfully saved derivative data. [2025-09-16T21:18:44.895173] [INFO ] [MAIN ] Derivative Progress: 1270/2026 symbols completed. NPCT took 1.0s. Estimated remaining: 4m 6s. Rate: 184.5 symbols/min [2025-09-16T21:18:44.895468] [INFO ] [MAIN ] NPKI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:44.912618] [DEBUG] [MAIN ] NPFD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:44.913630] [INFO ] [MAIN ] NPFD: Generated 1339 derivative records from 6777 primary records. [2025-09-16T21:18:44.914001] [DEBUG] [LOCAL ] NPFD: Saving derivative data. [2025-09-16T21:18:44.940734] [DEBUG] [MAIN ] NPK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:44.942221] [INFO ] [MAIN ] NPK: Generated 1339 derivative records from 6388 primary records. [2025-09-16T21:18:44.942312] [DEBUG] [LOCAL ] NPK: Saving derivative data. [2025-09-16T21:18:44.945682] [DEBUG] [LOCAL ] NPFD: Derivative data saved (1339 records). [2025-09-16T21:18:44.946021] [INFO ] [MAIN ] NPFD: Successfully saved derivative data. [2025-09-16T21:18:44.948102] [INFO ] [MAIN ] Derivative Progress: 1271/2026 symbols completed. NPFD took 0.8s. Estimated remaining: 4m 5s. Rate: 184.6 symbols/min [2025-09-16T21:18:44.956939] [INFO ] [MAIN ] NPO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:44.971149] [DEBUG] [LOCAL ] NPK: Derivative data saved (1339 records). [2025-09-16T21:18:44.971241] [INFO ] [MAIN ] NPK: Successfully saved derivative data. [2025-09-16T21:18:44.973392] [INFO ] [MAIN ] Derivative Progress: 1272/2026 symbols completed. NPK took 0.8s. Estimated remaining: 4m 5s. Rate: 184.7 symbols/min [2025-09-16T21:18:44.973574] [INFO ] [MAIN ] NPV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:44.971032] [DEBUG] [LOCAL ] NPKI: Loaded 30489 existing records from primary storage. [2025-09-16T21:18:44.974248] [INFO ] [MAIN ] NPKI: Loaded 30489 primary data records. [2025-09-16T21:18:45.074172] [DEBUG] [LOCAL ] NPV: Loaded 3802 existing records from primary storage. [2025-09-16T21:18:45.080215] [DEBUG] [LOCAL ] NPO: Loaded 9372 existing records from primary storage. [2025-09-16T21:18:45.091514] [INFO ] [MAIN ] NPO: Loaded 9372 primary data records. [2025-09-16T21:18:45.091283] [INFO ] [MAIN ] NPV: Loaded 3802 primary data records. [2025-09-16T21:18:45.876450] [DEBUG] [MAIN ] NPKI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:45.878321] [INFO ] [MAIN ] NPKI: Generated 1339 derivative records from 30489 primary records. [2025-09-16T21:18:45.878899] [DEBUG] [LOCAL ] NPKI: Saving derivative data. [2025-09-16T21:18:45.901180] [DEBUG] [LOCAL ] NPKI: Derivative data saved (1339 records). [2025-09-16T21:18:45.901690] [DEBUG] [MAIN ] NPO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:45.902735] [INFO ] [MAIN ] NPO: Generated 1339 derivative records from 9372 primary records. [2025-09-16T21:18:45.902838] [DEBUG] [LOCAL ] NPO: Saving derivative data. [2025-09-16T21:18:45.902040] [INFO ] [MAIN ] NPKI: Successfully saved derivative data. [2025-09-16T21:18:45.904628] [INFO ] [MAIN ] Derivative Progress: 1273/2026 symbols completed. NPKI took 1.0s. Estimated remaining: 4m 5s. Rate: 184.5 symbols/min [2025-09-16T21:18:45.920345] [DEBUG] [LOCAL ] NPO: Derivative data saved (1339 records). [2025-09-16T21:18:45.920496] [INFO ] [MAIN ] NPO: Successfully saved derivative data. [2025-09-16T21:18:45.922860] [INFO ] [MAIN ] Derivative Progress: 1274/2026 symbols completed. NPO took 1.0s. Estimated remaining: 4m 4s. Rate: 184.6 symbols/min [2025-09-16T21:18:45.936346] [DEBUG] [MAIN ] NPV: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:45.937082] [INFO ] [MAIN ] NPV: Generated 1339 derivative records from 3802 primary records. [2025-09-16T21:18:45.937195] [DEBUG] [LOCAL ] NPV: Saving derivative data. [2025-09-16T21:18:45.950000] [DEBUG] [LOCAL ] NPV: Derivative data saved (1339 records). [2025-09-16T21:18:45.950066] [INFO ] [MAIN ] NPV: Successfully saved derivative data. [2025-09-16T21:18:45.952178] [INFO ] [MAIN ] Derivative Progress: 1275/2026 symbols completed. NPV took 1.0s. Estimated remaining: 4m 4s. Rate: 184.7 symbols/min [2025-09-16T21:18:45.952633] [INFO ] [MAIN ] NPWR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:45.952853] [INFO ] [MAIN ] NQP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:45.953598] [INFO ] [MAIN ] NRDY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:45.964120] [DEBUG] [LOCAL ] NQP: Loaded 6743 existing records from primary storage. [2025-09-16T21:18:45.964293] [INFO ] [MAIN ] NQP: Loaded 6743 primary data records. [2025-09-16T21:18:46.127426] [DEBUG] [LOCAL ] NRDY: Loaded 24025 existing records from primary storage. [2025-09-16T21:18:46.174308] [INFO ] [MAIN ] NRDY: Loaded 24025 primary data records. [2025-09-16T21:18:46.174958] [DEBUG] [LOCAL ] NPWR: Loaded 32076 existing records from primary storage. [2025-09-16T21:18:46.267395] [INFO ] [MAIN ] NPWR: Loaded 32076 primary data records. [2025-09-16T21:18:46.826059] [DEBUG] [MAIN ] NQP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:46.827310] [INFO ] [MAIN ] NQP: Generated 1339 derivative records from 6743 primary records. [2025-09-16T21:18:46.827576] [DEBUG] [LOCAL ] NQP: Saving derivative data. [2025-09-16T21:18:46.843039] [DEBUG] [LOCAL ] NQP: Derivative data saved (1339 records). [2025-09-16T21:18:46.843255] [INFO ] [MAIN ] NQP: Successfully saved derivative data. [2025-09-16T21:18:46.844745] [INFO ] [MAIN ] Derivative Progress: 1276/2026 symbols completed. NQP took 0.9s. Estimated remaining: 4m 4s. Rate: 184.5 symbols/min [2025-09-16T21:18:46.845054] [INFO ] [MAIN ] NREF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:46.862687] [DEBUG] [MAIN ] NPWR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:46.866015] [DEBUG] [LOCAL ] NREF: Loaded 5655 existing records from primary storage. [2025-09-16T21:18:46.872601] [INFO ] [MAIN ] NPWR: Generated 1339 derivative records from 32076 primary records. [2025-09-16T21:18:46.872715] [DEBUG] [LOCAL ] NPWR: Saving derivative data. [2025-09-16T21:18:46.872807] [INFO ] [MAIN ] NREF: Loaded 5655 primary data records. [2025-09-16T21:18:46.914046] [DEBUG] [MAIN ] NRDY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:46.957149] [INFO ] [MAIN ] NRDY: Generated 1339 derivative records from 24025 primary records. [2025-09-16T21:18:46.965664] [DEBUG] [LOCAL ] NRDY: Saving derivative data. [2025-09-16T21:18:46.965599] [DEBUG] [LOCAL ] NPWR: Derivative data saved (1339 records). [2025-09-16T21:18:46.990474] [INFO ] [MAIN ] NPWR: Successfully saved derivative data. [2025-09-16T21:18:47.004623] [INFO ] [MAIN ] Derivative Progress: 1277/2026 symbols completed. NPWR took 1.1s. Estimated remaining: 4m 4s. Rate: 184.5 symbols/min [2025-09-16T21:18:47.006418] [INFO ] [MAIN ] NRG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:47.082894] [DEBUG] [LOCAL ] NRDY: Derivative data saved (1339 records). [2025-09-16T21:18:47.088376] [INFO ] [MAIN ] NRDY: Successfully saved derivative data. [2025-09-16T21:18:47.090812] [INFO ] [MAIN ] Derivative Progress: 1278/2026 symbols completed. NRDY took 1.1s. Estimated remaining: 4m 3s. Rate: 184.6 symbols/min [2025-09-16T21:18:47.091087] [INFO ] [MAIN ] NRGV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:47.210631] [DEBUG] [MAIN ] NREF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:47.211390] [INFO ] [MAIN ] NREF: Generated 1339 derivative records from 5655 primary records. [2025-09-16T21:18:47.212116] [DEBUG] [LOCAL ] NREF: Saving derivative data. [2025-09-16T21:18:47.236375] [DEBUG] [LOCAL ] NREF: Derivative data saved (1339 records). [2025-09-16T21:18:47.236242] [DEBUG] [LOCAL ] NRG: Loaded 39448 existing records from primary storage. [2025-09-16T21:18:47.236482] [INFO ] [MAIN ] NREF: Successfully saved derivative data. [2025-09-16T21:18:47.247499] [INFO ] [MAIN ] Derivative Progress: 1279/2026 symbols completed. NREF took 0.4s. Estimated remaining: 4m 3s. Rate: 184.7 symbols/min [2025-09-16T21:18:47.247630] [INFO ] [MAIN ] NRG: Loaded 39448 primary data records. [2025-09-16T21:18:47.247989] [INFO ] [MAIN ] NRP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:47.248881] [DEBUG] [LOCAL ] NRGV: Loaded 31331 existing records from primary storage. [2025-09-16T21:18:47.294286] [INFO ] [MAIN ] NRGV: Loaded 31331 primary data records. [2025-09-16T21:18:47.325397] [DEBUG] [LOCAL ] NRP: Loaded 2791 existing records from primary storage. [2025-09-16T21:18:47.363749] [INFO ] [MAIN ] NRP: Loaded 2791 primary data records. [2025-09-16T21:18:48.145334] [DEBUG] [MAIN ] NRG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:48.148794] [INFO ] [MAIN ] NRG: Generated 1339 derivative records from 39448 primary records. [2025-09-16T21:18:48.149233] [DEBUG] [LOCAL ] NRG: Saving derivative data. [2025-09-16T21:18:48.174770] [DEBUG] [MAIN ] NRP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:48.179273] [INFO ] [MAIN ] NRP: Generated 1339 derivative records from 2791 primary records. [2025-09-16T21:18:48.179820] [DEBUG] [LOCAL ] NRP: Saving derivative data. [2025-09-16T21:18:48.175394] [DEBUG] [MAIN ] NRGV: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:48.181874] [INFO ] [MAIN ] NRGV: Generated 1339 derivative records from 31331 primary records. [2025-09-16T21:18:48.182015] [DEBUG] [LOCAL ] NRGV: Saving derivative data. [2025-09-16T21:18:48.203041] [DEBUG] [LOCAL ] NRP: Derivative data saved (1339 records). [2025-09-16T21:18:48.205013] [DEBUG] [LOCAL ] NRG: Derivative data saved (1339 records). [2025-09-16T21:18:48.206494] [INFO ] [MAIN ] NRG: Successfully saved derivative data. [2025-09-16T21:18:48.206427] [DEBUG] [LOCAL ] NRGV: Derivative data saved (1339 records). [2025-09-16T21:18:48.206674] [INFO ] [MAIN ] NRGV: Successfully saved derivative data. [2025-09-16T21:18:48.209587] [INFO ] [MAIN ] Derivative Progress: 1280/2026 symbols completed. NRG took 1.2s. Estimated remaining: 4m 3s. Rate: 184.4 symbols/min [2025-09-16T21:18:48.211526] [INFO ] [MAIN ] NRP: Successfully saved derivative data. [2025-09-16T21:18:48.213953] [INFO ] [MAIN ] Derivative Progress: 1281/2026 symbols completed. NRGV took 1.1s. Estimated remaining: 4m 2s. Rate: 184.6 symbols/min [2025-09-16T21:18:48.213838] [INFO ] [MAIN ] NRT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:48.214248] [INFO ] [MAIN ] Derivative Progress: 1282/2026 symbols completed. NRP took 1.0s. Estimated remaining: 4m 2s. Rate: 184.7 symbols/min [2025-09-16T21:18:48.214422] [INFO ] [MAIN ] NRUC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:48.214622] [INFO ] [MAIN ] NSA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:48.221230] [DEBUG] [LOCAL ] NRUC: Loaded 2230 existing records from primary storage. [2025-09-16T21:18:48.223697] [DEBUG] [LOCAL ] NRT: Loaded 3683 existing records from primary storage. [2025-09-16T21:18:48.223837] [INFO ] [MAIN ] NRUC: Loaded 2230 primary data records. [2025-09-16T21:18:48.223930] [INFO ] [MAIN ] NRT: Loaded 3683 primary data records. [2025-09-16T21:18:48.769804] [DEBUG] [LOCAL ] NSA: Loaded 33725 existing records from primary storage. [2025-09-16T21:18:48.781827] [INFO ] [MAIN ] NSA: Loaded 33725 primary data records. [2025-09-16T21:18:49.093084] [DEBUG] [MAIN ] NRUC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:49.094831] [INFO ] [MAIN ] NRUC: Generated 1339 derivative records from 2230 primary records. [2025-09-16T21:18:49.093974] [DEBUG] [MAIN ] NRT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:49.094997] [DEBUG] [LOCAL ] NRUC: Saving derivative data. [2025-09-16T21:18:49.095621] [INFO ] [MAIN ] NRT: Generated 1339 derivative records from 3683 primary records. [2025-09-16T21:18:49.096060] [DEBUG] [LOCAL ] NRT: Saving derivative data. [2025-09-16T21:18:49.116384] [DEBUG] [LOCAL ] NRT: Derivative data saved (1339 records). [2025-09-16T21:18:49.117161] [INFO ] [MAIN ] NRT: Successfully saved derivative data. [2025-09-16T21:18:49.120699] [INFO ] [MAIN ] Derivative Progress: 1283/2026 symbols completed. NRT took 0.9s. Estimated remaining: 4m 2s. Rate: 184.5 symbols/min [2025-09-16T21:18:49.121387] [INFO ] [MAIN ] NSC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:49.122992] [DEBUG] [LOCAL ] NRUC: Derivative data saved (1339 records). [2025-09-16T21:18:49.123187] [INFO ] [MAIN ] NRUC: Successfully saved derivative data. [2025-09-16T21:18:49.124865] [INFO ] [MAIN ] Derivative Progress: 1284/2026 symbols completed. NRUC took 0.9s. Estimated remaining: 4m 1s. Rate: 184.6 symbols/min [2025-09-16T21:18:49.125247] [INFO ] [MAIN ] NSP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:49.138318] [DEBUG] [MAIN ] NSA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:49.139056] [INFO ] [MAIN ] NSA: Generated 1339 derivative records from 33725 primary records. [2025-09-16T21:18:49.139163] [DEBUG] [LOCAL ] NSA: Saving derivative data. [2025-09-16T21:18:49.152028] [DEBUG] [LOCAL ] NSA: Derivative data saved (1339 records). [2025-09-16T21:18:49.152203] [INFO ] [MAIN ] NSA: Successfully saved derivative data. [2025-09-16T21:18:49.154325] [INFO ] [MAIN ] Derivative Progress: 1285/2026 symbols completed. NSA took 0.9s. Estimated remaining: 4m 1s. Rate: 184.7 symbols/min [2025-09-16T21:18:49.162490] [INFO ] [MAIN ] NTB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:49.181501] [DEBUG] [LOCAL ] NSP: Loaded 26492 existing records from primary storage. [2025-09-16T21:18:49.186615] [INFO ] [MAIN ] NSP: Loaded 26492 primary data records. [2025-09-16T21:18:49.231262] [DEBUG] [LOCAL ] NSC: Loaded 36514 existing records from primary storage. [2025-09-16T21:18:49.253593] [INFO ] [MAIN ] NSC: Loaded 36514 primary data records. [2025-09-16T21:18:49.332531] [DEBUG] [LOCAL ] NTB: Loaded 14787 existing records from primary storage. [2025-09-16T21:18:49.374555] [INFO ] [MAIN ] NTB: Loaded 14787 primary data records. [2025-09-16T21:18:50.270501] [DEBUG] [MAIN ] NSP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:50.272858] [INFO ] [MAIN ] NSP: Generated 1339 derivative records from 26492 primary records. [2025-09-16T21:18:50.274014] [DEBUG] [LOCAL ] NSP: Saving derivative data. [2025-09-16T21:18:50.295300] [DEBUG] [LOCAL ] NSP: Derivative data saved (1339 records). [2025-09-16T21:18:50.296339] [INFO ] [MAIN ] NSP: Successfully saved derivative data. [2025-09-16T21:18:50.298554] [INFO ] [MAIN ] Derivative Progress: 1286/2026 symbols completed. NSP took 1.2s. Estimated remaining: 4m 1s. Rate: 184.4 symbols/min [2025-09-16T21:18:50.299592] [INFO ] [MAIN ] NTR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:50.323375] [DEBUG] [MAIN ] NSC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:50.325299] [INFO ] [MAIN ] NSC: Generated 1339 derivative records from 36514 primary records. [2025-09-16T21:18:50.325858] [DEBUG] [LOCAL ] NSC: Saving derivative data. [2025-09-16T21:18:50.347947] [DEBUG] [LOCAL ] NSC: Derivative data saved (1339 records). [2025-09-16T21:18:50.359417] [INFO ] [MAIN ] NSC: Successfully saved derivative data. [2025-09-16T21:18:50.359819] [DEBUG] [MAIN ] NTB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:50.363441] [INFO ] [MAIN ] NTB: Generated 1339 derivative records from 14787 primary records. [2025-09-16T21:18:50.363631] [DEBUG] [LOCAL ] NTB: Saving derivative data. [2025-09-16T21:18:50.362292] [INFO ] [MAIN ] Derivative Progress: 1287/2026 symbols completed. NSC took 1.2s. Estimated remaining: 4m 0s. Rate: 184.5 symbols/min [2025-09-16T21:18:50.387245] [INFO ] [MAIN ] NTST: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:50.393129] [DEBUG] [LOCAL ] NTB: Derivative data saved (1339 records). [2025-09-16T21:18:50.393860] [INFO ] [MAIN ] NTB: Successfully saved derivative data. [2025-09-16T21:18:50.396619] [INFO ] [MAIN ] Derivative Progress: 1288/2026 symbols completed. NTB took 1.2s. Estimated remaining: 3m 60s. Rate: 184.6 symbols/min [2025-09-16T21:18:50.421894] [DEBUG] [LOCAL ] NTR: Loaded 39127 existing records from primary storage. [2025-09-16T21:18:50.422153] [INFO ] [MAIN ] NTR: Loaded 39127 primary data records. [2025-09-16T21:18:50.715910] [DEBUG] [LOCAL ] NTST: Loaded 32324 existing records from primary storage. [2025-09-16T21:18:50.721950] [INFO ] [MAIN ] NTST: Loaded 32324 primary data records. [2025-09-16T21:18:51.131750] [DEBUG] [MAIN ] NTR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:51.132536] [INFO ] [MAIN ] NTR: Generated 1339 derivative records from 39127 primary records. [2025-09-16T21:18:51.132849] [DEBUG] [LOCAL ] NTR: Saving derivative data. [2025-09-16T21:18:51.145300] [DEBUG] [LOCAL ] NTR: Derivative data saved (1339 records). [2025-09-16T21:18:51.145408] [INFO ] [MAIN ] NTR: Successfully saved derivative data. [2025-09-16T21:18:51.146902] [INFO ] [MAIN ] Derivative Progress: 1289/2026 symbols completed. NTR took 0.8s. Estimated remaining: 3m 60s. Rate: 184.4 symbols/min [2025-09-16T21:18:51.159493] [DEBUG] [MAIN ] NTST: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:51.160200] [INFO ] [MAIN ] NTST: Generated 1339 derivative records from 32324 primary records. [2025-09-16T21:18:51.160265] [DEBUG] [LOCAL ] NTST: Saving derivative data. [2025-09-16T21:18:51.172568] [DEBUG] [LOCAL ] NTST: Derivative data saved (1339 records). [2025-09-16T21:18:51.172734] [INFO ] [MAIN ] NTST: Successfully saved derivative data. [2025-09-16T21:18:51.174729] [INFO ] [MAIN ] Derivative Progress: 1290/2026 symbols completed. NTST took 0.8s. Estimated remaining: 3m 59s. Rate: 184.6 symbols/min [2025-09-16T21:18:51.175488] [INFO ] [MAIN ] NUS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:51.175336] [INFO ] [MAIN ] NU: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:51.176008] [INFO ] [MAIN ] NUV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:51.202500] [DEBUG] [LOCAL ] NUV: Loaded 16417 existing records from primary storage. [2025-09-16T21:18:51.210043] [INFO ] [MAIN ] NUV: Loaded 16417 primary data records. [2025-09-16T21:18:51.251373] [DEBUG] [LOCAL ] NUS: Loaded 26600 existing records from primary storage. [2025-09-16T21:18:51.282896] [INFO ] [MAIN ] NUS: Loaded 26600 primary data records. [2025-09-16T21:18:51.453077] [DEBUG] [LOCAL ] NU: Loaded 40096 existing records from primary storage. [2025-09-16T21:18:51.484514] [INFO ] [MAIN ] NU: Loaded 40096 primary data records. [2025-09-16T21:18:52.093190] [DEBUG] [MAIN ] NUV: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:52.094851] [INFO ] [MAIN ] NUV: Generated 1339 derivative records from 16417 primary records. [2025-09-16T21:18:52.095069] [DEBUG] [LOCAL ] NUV: Saving derivative data. [2025-09-16T21:18:52.112851] [DEBUG] [LOCAL ] NUV: Derivative data saved (1339 records). [2025-09-16T21:18:52.123077] [DEBUG] [MAIN ] NU: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:52.133950] [INFO ] [MAIN ] NU: Generated 1339 derivative records from 40096 primary records. [2025-09-16T21:18:52.134060] [INFO ] [MAIN ] NUV: Successfully saved derivative data. [2025-09-16T21:18:52.134144] [DEBUG] [LOCAL ] NU: Saving derivative data. [2025-09-16T21:18:52.134497] [DEBUG] [MAIN ] NUS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:52.137712] [INFO ] [MAIN ] Derivative Progress: 1291/2026 symbols completed. NUV took 1.0s. Estimated remaining: 3m 59s. Rate: 184.3 symbols/min [2025-09-16T21:18:52.136072] [INFO ] [MAIN ] NUS: Generated 1339 derivative records from 26600 primary records. [2025-09-16T21:18:52.144923] [INFO ] [MAIN ] NUVB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:52.144841] [DEBUG] [LOCAL ] NUS: Saving derivative data. [2025-09-16T21:18:52.157320] [DEBUG] [LOCAL ] NU: Derivative data saved (1339 records). [2025-09-16T21:18:52.161317] [INFO ] [MAIN ] NU: Successfully saved derivative data. [2025-09-16T21:18:52.163425] [INFO ] [MAIN ] Derivative Progress: 1292/2026 symbols completed. NU took 1.0s. Estimated remaining: 3m 59s. Rate: 184.4 symbols/min [2025-09-16T21:18:52.164753] [INFO ] [MAIN ] NUW: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:52.167612] [DEBUG] [LOCAL ] NUS: Derivative data saved (1339 records). [2025-09-16T21:18:52.168144] [INFO ] [MAIN ] NUS: Successfully saved derivative data. [2025-09-16T21:18:52.170421] [INFO ] [MAIN ] Derivative Progress: 1293/2026 symbols completed. NUS took 1.0s. Estimated remaining: 3m 58s. Rate: 184.6 symbols/min [2025-09-16T21:18:52.170785] [INFO ] [MAIN ] NVG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:52.177865] [DEBUG] [LOCAL ] NUW: Loaded 5126 existing records from primary storage. [2025-09-16T21:18:52.178020] [INFO ] [MAIN ] NUW: Loaded 5126 primary data records. [2025-09-16T21:18:52.321164] [DEBUG] [LOCAL ] NVG: Loaded 20150 existing records from primary storage. [2025-09-16T21:18:52.367188] [INFO ] [MAIN ] NVG: Loaded 20150 primary data records. [2025-09-16T21:18:52.397753] [DEBUG] [LOCAL ] NUVB: Loaded 38462 existing records from primary storage. [2025-09-16T21:18:52.546776] [INFO ] [MAIN ] NUVB: Loaded 38462 primary data records. [2025-09-16T21:18:53.069811] [DEBUG] [MAIN ] NUW: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:53.070875] [INFO ] [MAIN ] NUW: Generated 1339 derivative records from 5126 primary records. [2025-09-16T21:18:53.071018] [DEBUG] [LOCAL ] NUW: Saving derivative data. [2025-09-16T21:18:53.087122] [DEBUG] [LOCAL ] NUW: Derivative data saved (1339 records). [2025-09-16T21:18:53.087896] [INFO ] [MAIN ] NUW: Successfully saved derivative data. [2025-09-16T21:18:53.089783] [INFO ] [MAIN ] Derivative Progress: 1294/2026 symbols completed. NUW took 0.9s. Estimated remaining: 3m 58s. Rate: 184.3 symbols/min [2025-09-16T21:18:53.090310] [INFO ] [MAIN ] NVGS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:53.101283] [DEBUG] [MAIN ] NVG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:53.102344] [INFO ] [MAIN ] NVG: Generated 1339 derivative records from 20150 primary records. [2025-09-16T21:18:53.102550] [DEBUG] [LOCAL ] NVG: Saving derivative data. [2025-09-16T21:18:53.125616] [DEBUG] [LOCAL ] NVG: Derivative data saved (1339 records). [2025-09-16T21:18:53.135087] [INFO ] [MAIN ] NVG: Successfully saved derivative data. [2025-09-16T21:18:53.137377] [INFO ] [MAIN ] Derivative Progress: 1295/2026 symbols completed. NVG took 1.0s. Estimated remaining: 3m 58s. Rate: 184.4 symbols/min [2025-09-16T21:18:53.135394] [DEBUG] [MAIN ] NUVB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:53.137722] [INFO ] [MAIN ] NVO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:53.138679] [INFO ] [MAIN ] NUVB: Generated 1339 derivative records from 38462 primary records. [2025-09-16T21:18:53.139179] [DEBUG] [LOCAL ] NUVB: Saving derivative data. [2025-09-16T21:18:53.160567] [DEBUG] [LOCAL ] NUVB: Derivative data saved (1339 records). [2025-09-16T21:18:53.161165] [DEBUG] [LOCAL ] NVGS: Loaded 23457 existing records from primary storage. [2025-09-16T21:18:53.161321] [INFO ] [MAIN ] NUVB: Successfully saved derivative data. [2025-09-16T21:18:53.163661] [INFO ] [MAIN ] Derivative Progress: 1296/2026 symbols completed. NUVB took 1.0s. Estimated remaining: 3m 57s. Rate: 184.6 symbols/min [2025-09-16T21:18:53.163934] [INFO ] [MAIN ] NVR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:53.161392] [INFO ] [MAIN ] NVGS: Loaded 23457 primary data records. [2025-09-16T21:18:53.292497] [DEBUG] [LOCAL ] NVR: Loaded 13127 existing records from primary storage. [2025-09-16T21:18:53.298717] [INFO ] [MAIN ] NVR: Loaded 13127 primary data records. [2025-09-16T21:18:53.429959] [DEBUG] [LOCAL ] NVO: Loaded 40134 existing records from primary storage. [2025-09-16T21:18:53.518334] [INFO ] [MAIN ] NVO: Loaded 40134 primary data records. [2025-09-16T21:18:54.025878] [DEBUG] [MAIN ] NVGS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:54.026900] [INFO ] [MAIN ] NVGS: Generated 1339 derivative records from 23457 primary records. [2025-09-16T21:18:54.027245] [DEBUG] [LOCAL ] NVGS: Saving derivative data. [2025-09-16T21:18:54.042116] [DEBUG] [LOCAL ] NVGS: Derivative data saved (1339 records). [2025-09-16T21:18:54.047881] [INFO ] [MAIN ] NVGS: Successfully saved derivative data. [2025-09-16T21:18:54.053059] [INFO ] [MAIN ] Derivative Progress: 1297/2026 symbols completed. NVGS took 1.0s. Estimated remaining: 3m 57s. Rate: 184.3 symbols/min [2025-09-16T21:18:54.053315] [DEBUG] [MAIN ] NVR: Filtered 5181 bins outside market hours, 5780 incomplete bins [2025-09-16T21:18:54.055309] [INFO ] [MAIN ] NVR: Generated 1338 derivative records from 13127 primary records. [2025-09-16T21:18:54.056078] [INFO ] [MAIN ] NVRI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:54.055855] [DEBUG] [LOCAL ] NVR: Saving derivative data. [2025-09-16T21:18:54.075782] [DEBUG] [MAIN ] NVO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:54.078722] [INFO ] [MAIN ] NVO: Generated 1339 derivative records from 40134 primary records. [2025-09-16T21:18:54.079008] [DEBUG] [LOCAL ] NVR: Derivative data saved (1338 records). [2025-09-16T21:18:54.079138] [INFO ] [MAIN ] NVR: Successfully saved derivative data. [2025-09-16T21:18:54.081005] [INFO ] [MAIN ] Derivative Progress: 1298/2026 symbols completed. NVR took 0.9s. Estimated remaining: 3m 57s. Rate: 184.4 symbols/min [2025-09-16T21:18:54.081290] [INFO ] [MAIN ] NVS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:54.081512] [DEBUG] [LOCAL ] NVO: Saving derivative data. [2025-09-16T21:18:54.101318] [DEBUG] [LOCAL ] NVO: Derivative data saved (1339 records). [2025-09-16T21:18:54.101447] [INFO ] [MAIN ] NVO: Successfully saved derivative data. [2025-09-16T21:18:54.104121] [INFO ] [MAIN ] Derivative Progress: 1299/2026 symbols completed. NVO took 1.0s. Estimated remaining: 3m 56s. Rate: 184.6 symbols/min [2025-09-16T21:18:54.104431] [INFO ] [MAIN ] NVST: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:54.116226] [DEBUG] [LOCAL ] NVRI: Loaded 28361 existing records from primary storage. [2025-09-16T21:18:54.116379] [INFO ] [MAIN ] NVRI: Loaded 28361 primary data records. [2025-09-16T21:18:54.345852] [DEBUG] [LOCAL ] NVS: Loaded 38269 existing records from primary storage. [2025-09-16T21:18:54.346468] [DEBUG] [LOCAL ] NVST: Loaded 38272 existing records from primary storage. [2025-09-16T21:18:54.346527] [INFO ] [MAIN ] NVS: Loaded 38269 primary data records. [2025-09-16T21:18:54.418191] [INFO ] [MAIN ] NVST: Loaded 38272 primary data records. [2025-09-16T21:18:55.015111] [DEBUG] [MAIN ] NVRI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:55.017567] [INFO ] [MAIN ] NVRI: Generated 1339 derivative records from 28361 primary records. [2025-09-16T21:18:55.017825] [DEBUG] [LOCAL ] NVRI: Saving derivative data. [2025-09-16T21:18:55.030427] [DEBUG] [LOCAL ] NVRI: Derivative data saved (1339 records). [2025-09-16T21:18:55.030794] [INFO ] [MAIN ] NVRI: Successfully saved derivative data. [2025-09-16T21:18:55.032260] [INFO ] [MAIN ] Derivative Progress: 1300/2026 symbols completed. NVRI took 1.0s. Estimated remaining: 3m 56s. Rate: 184.3 symbols/min [2025-09-16T21:18:55.032818] [INFO ] [MAIN ] NVT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:55.053442] [DEBUG] [MAIN ] NVS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:55.064010] [INFO ] [MAIN ] NVS: Generated 1339 derivative records from 38269 primary records. [2025-09-16T21:18:55.064211] [DEBUG] [MAIN ] NVST: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:55.064310] [DEBUG] [LOCAL ] NVS: Saving derivative data. [2025-09-16T21:18:55.065124] [INFO ] [MAIN ] NVST: Generated 1339 derivative records from 38272 primary records. [2025-09-16T21:18:55.065476] [DEBUG] [LOCAL ] NVST: Saving derivative data. [2025-09-16T21:18:55.088830] [DEBUG] [LOCAL ] NVS: Derivative data saved (1339 records). [2025-09-16T21:18:55.097665] [INFO ] [MAIN ] NVS: Successfully saved derivative data. [2025-09-16T21:18:55.097525] [DEBUG] [LOCAL ] NVST: Derivative data saved (1339 records). [2025-09-16T21:18:55.099690] [INFO ] [MAIN ] Derivative Progress: 1301/2026 symbols completed. NVS took 1.0s. Estimated remaining: 3m 56s. Rate: 184.4 symbols/min [2025-09-16T21:18:55.099978] [INFO ] [MAIN ] NWG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:55.099814] [INFO ] [MAIN ] NVST: Successfully saved derivative data. [2025-09-16T21:18:55.102769] [INFO ] [MAIN ] Derivative Progress: 1302/2026 symbols completed. NVST took 1.0s. Estimated remaining: 3m 55s. Rate: 184.6 symbols/min [2025-09-16T21:18:55.103295] [INFO ] [MAIN ] NWN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:55.117744] [DEBUG] [LOCAL ] NVT: Loaded 38225 existing records from primary storage. [2025-09-16T21:18:55.118074] [INFO ] [MAIN ] NVT: Loaded 38225 primary data records. [2025-09-16T21:18:55.301578] [DEBUG] [LOCAL ] NWN: Loaded 20316 existing records from primary storage. [2025-09-16T21:18:55.320347] [INFO ] [MAIN ] NWN: Loaded 20316 primary data records. [2025-09-16T21:18:55.524519] [DEBUG] [LOCAL ] NWG: Loaded 38406 existing records from primary storage. [2025-09-16T21:18:55.530891] [INFO ] [MAIN ] NWG: Loaded 38406 primary data records. [2025-09-16T21:18:55.969729] [DEBUG] [MAIN ] NVT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:55.970832] [INFO ] [MAIN ] NVT: Generated 1339 derivative records from 38225 primary records. [2025-09-16T21:18:55.971195] [DEBUG] [LOCAL ] NVT: Saving derivative data. [2025-09-16T21:18:55.984592] [DEBUG] [LOCAL ] NVT: Derivative data saved (1339 records). [2025-09-16T21:18:55.986205] [INFO ] [MAIN ] NVT: Successfully saved derivative data. [2025-09-16T21:18:55.988045] [INFO ] [MAIN ] Derivative Progress: 1303/2026 symbols completed. NVT took 1.0s. Estimated remaining: 3m 55s. Rate: 184.3 symbols/min [2025-09-16T21:18:55.999335] [DEBUG] [MAIN ] NWN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:56.000134] [INFO ] [MAIN ] NWN: Generated 1339 derivative records from 20316 primary records. [2025-09-16T21:18:56.000435] [DEBUG] [LOCAL ] NWN: Saving derivative data. [2025-09-16T21:18:56.012860] [DEBUG] [LOCAL ] NWN: Derivative data saved (1339 records). [2025-09-16T21:18:56.013142] [INFO ] [MAIN ] NWN: Successfully saved derivative data. [2025-09-16T21:18:56.014833] [INFO ] [MAIN ] Derivative Progress: 1304/2026 symbols completed. NWN took 0.9s. Estimated remaining: 3m 55s. Rate: 184.4 symbols/min [2025-09-16T21:18:56.026820] [DEBUG] [MAIN ] NWG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:56.027416] [INFO ] [MAIN ] NWG: Generated 1339 derivative records from 38406 primary records. [2025-09-16T21:18:56.027478] [DEBUG] [LOCAL ] NWG: Saving derivative data. [2025-09-16T21:18:56.039373] [DEBUG] [LOCAL ] NWG: Derivative data saved (1339 records). [2025-09-16T21:18:56.039430] [INFO ] [MAIN ] NWG: Successfully saved derivative data. [2025-09-16T21:18:56.041668] [INFO ] [MAIN ] Derivative Progress: 1305/2026 symbols completed. NWG took 0.9s. Estimated remaining: 3m 54s. Rate: 184.6 symbols/min [2025-09-16T21:18:56.042299] [INFO ] [MAIN ] NXC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:56.042130] [INFO ] [MAIN ] NX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:56.042701] [INFO ] [MAIN ] NXDT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:56.048377] [DEBUG] [LOCAL ] NXC: Loaded 2965 existing records from primary storage. [2025-09-16T21:18:56.048491] [INFO ] [MAIN ] NXC: Loaded 2965 primary data records. [2025-09-16T21:18:56.167768] [DEBUG] [LOCAL ] NXDT: Loaded 10785 existing records from primary storage. [2025-09-16T21:18:56.188620] [INFO ] [MAIN ] NXDT: Loaded 10785 primary data records. [2025-09-16T21:18:56.332604] [DEBUG] [LOCAL ] NX: Loaded 24326 existing records from primary storage. [2025-09-16T21:18:56.354232] [INFO ] [MAIN ] NX: Loaded 24326 primary data records. [2025-09-16T21:18:56.950060] [DEBUG] [MAIN ] NXC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:56.951195] [INFO ] [MAIN ] NXC: Generated 1339 derivative records from 2965 primary records. [2025-09-16T21:18:56.951286] [DEBUG] [LOCAL ] NXC: Saving derivative data. [2025-09-16T21:18:56.965990] [DEBUG] [LOCAL ] NXC: Derivative data saved (1339 records). [2025-09-16T21:18:56.966293] [INFO ] [MAIN ] NXC: Successfully saved derivative data. [2025-09-16T21:18:56.967999] [INFO ] [MAIN ] Derivative Progress: 1306/2026 symbols completed. NXC took 0.9s. Estimated remaining: 3m 54s. Rate: 184.3 symbols/min [2025-09-16T21:18:56.979387] [INFO ] [MAIN ] NXE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:56.979774] [DEBUG] [MAIN ] NXDT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:56.980934] [INFO ] [MAIN ] NXDT: Generated 1339 derivative records from 10785 primary records. [2025-09-16T21:18:56.981226] [DEBUG] [LOCAL ] NXDT: Saving derivative data. [2025-09-16T21:18:56.995903] [DEBUG] [LOCAL ] NXDT: Derivative data saved (1339 records). [2025-09-16T21:18:56.996524] [INFO ] [MAIN ] NXDT: Successfully saved derivative data. [2025-09-16T21:18:56.998509] [INFO ] [MAIN ] Derivative Progress: 1307/2026 symbols completed. NXDT took 1.0s. Estimated remaining: 3m 54s. Rate: 184.4 symbols/min [2025-09-16T21:18:56.998828] [INFO ] [MAIN ] NXG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:57.010376] [DEBUG] [MAIN ] NX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:57.011106] [INFO ] [MAIN ] NX: Generated 1339 derivative records from 24326 primary records. [2025-09-16T21:18:57.011234] [DEBUG] [LOCAL ] NX: Saving derivative data. [2025-09-16T21:18:57.043266] [DEBUG] [LOCAL ] NX: Derivative data saved (1339 records). [2025-09-16T21:18:57.044529] [DEBUG] [LOCAL ] NXG: Loaded 7436 existing records from primary storage. [2025-09-16T21:18:57.044847] [INFO ] [MAIN ] NX: Successfully saved derivative data. [2025-09-16T21:18:57.047816] [INFO ] [MAIN ] NXG: Loaded 7436 primary data records. [2025-09-16T21:18:57.047673] [INFO ] [MAIN ] Derivative Progress: 1308/2026 symbols completed. NX took 1.0s. Estimated remaining: 3m 53s. Rate: 184.6 symbols/min [2025-09-16T21:18:57.053464] [INFO ] [MAIN ] NXJ: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:57.163590] [DEBUG] [LOCAL ] NXE: Loaded 39497 existing records from primary storage. [2025-09-16T21:18:57.166879] [INFO ] [MAIN ] NXE: Loaded 39497 primary data records. [2025-09-16T21:18:57.239408] [DEBUG] [LOCAL ] NXJ: Loaded 11778 existing records from primary storage. [2025-09-16T21:18:57.276190] [INFO ] [MAIN ] NXJ: Loaded 11778 primary data records. [2025-09-16T21:18:57.917029] [DEBUG] [MAIN ] NXG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:57.918436] [INFO ] [MAIN ] NXG: Generated 1339 derivative records from 7436 primary records. [2025-09-16T21:18:57.918676] [DEBUG] [LOCAL ] NXG: Saving derivative data. [2025-09-16T21:18:57.934153] [DEBUG] [LOCAL ] NXG: Derivative data saved (1339 records). [2025-09-16T21:18:57.934281] [INFO ] [MAIN ] NXG: Successfully saved derivative data. [2025-09-16T21:18:57.946859] [INFO ] [MAIN ] Derivative Progress: 1309/2026 symbols completed. NXG took 0.9s. Estimated remaining: 3m 53s. Rate: 184.3 symbols/min [2025-09-16T21:18:57.947736] [INFO ] [MAIN ] NXN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:57.948479] [DEBUG] [MAIN ] NXE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:57.949848] [INFO ] [MAIN ] NXE: Generated 1339 derivative records from 39497 primary records. [2025-09-16T21:18:57.950349] [DEBUG] [LOCAL ] NXE: Saving derivative data. [2025-09-16T21:18:57.961590] [DEBUG] [MAIN ] NXJ: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:57.968090] [INFO ] [MAIN ] NXJ: Generated 1339 derivative records from 11778 primary records. [2025-09-16T21:18:57.970080] [DEBUG] [LOCAL ] NXN: Loaded 1750 existing records from primary storage. [2025-09-16T21:18:57.971020] [DEBUG] [LOCAL ] NXJ: Saving derivative data. [2025-09-16T21:18:57.973532] [INFO ] [MAIN ] NXN: Loaded 1750 primary data records. [2025-09-16T21:18:57.976759] [DEBUG] [LOCAL ] NXE: Derivative data saved (1339 records). [2025-09-16T21:18:58.013675] [INFO ] [MAIN ] NXE: Successfully saved derivative data. [2025-09-16T21:18:58.053289] [INFO ] [MAIN ] Derivative Progress: 1310/2026 symbols completed. NXE took 1.1s. Estimated remaining: 3m 53s. Rate: 184.4 symbols/min [2025-09-16T21:18:58.053452] [DEBUG] [LOCAL ] NXJ: Derivative data saved (1339 records). [2025-09-16T21:18:58.065748] [INFO ] [MAIN ] NXP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:58.081547] [INFO ] [MAIN ] NXJ: Successfully saved derivative data. [2025-09-16T21:18:58.091612] [INFO ] [MAIN ] Derivative Progress: 1311/2026 symbols completed. NXJ took 1.0s. Estimated remaining: 3m 52s. Rate: 184.5 symbols/min [2025-09-16T21:18:58.103187] [INFO ] [MAIN ] NXRT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:58.277098] [DEBUG] [LOCAL ] NXP: Loaded 9142 existing records from primary storage. [2025-09-16T21:18:58.277341] [INFO ] [MAIN ] NXP: Loaded 9142 primary data records. [2025-09-16T21:18:58.347455] [DEBUG] [LOCAL ] NXRT: Loaded 13690 existing records from primary storage. [2025-09-16T21:18:58.383173] [INFO ] [MAIN ] NXRT: Loaded 13690 primary data records. [2025-09-16T21:18:58.831918] [DEBUG] [MAIN ] NXN: Filtered 5181 bins outside market hours, 5780 incomplete bins [2025-09-16T21:18:58.833070] [INFO ] [MAIN ] NXN: Generated 1338 derivative records from 1750 primary records. [2025-09-16T21:18:58.833979] [DEBUG] [LOCAL ] NXN: Saving derivative data. [2025-09-16T21:18:58.849244] [DEBUG] [LOCAL ] NXN: Derivative data saved (1338 records). [2025-09-16T21:18:58.849581] [INFO ] [MAIN ] NXN: Successfully saved derivative data. [2025-09-16T21:18:58.851366] [INFO ] [MAIN ] Derivative Progress: 1312/2026 symbols completed. NXN took 0.9s. Estimated remaining: 3m 52s. Rate: 184.3 symbols/min [2025-09-16T21:18:58.857340] [INFO ] [MAIN ] NYT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:58.862193] [DEBUG] [MAIN ] NXP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:58.863010] [INFO ] [MAIN ] NXP: Generated 1339 derivative records from 9142 primary records. [2025-09-16T21:18:58.863192] [DEBUG] [LOCAL ] NXP: Saving derivative data. [2025-09-16T21:18:58.877888] [DEBUG] [LOCAL ] NXP: Derivative data saved (1339 records). [2025-09-16T21:18:58.878038] [INFO ] [MAIN ] NXP: Successfully saved derivative data. [2025-09-16T21:18:58.889608] [INFO ] [MAIN ] Derivative Progress: 1313/2026 symbols completed. NXP took 0.8s. Estimated remaining: 3m 52s. Rate: 184.5 symbols/min [2025-09-16T21:18:58.890393] [INFO ] [MAIN ] NZF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:58.890125] [DEBUG] [MAIN ] NXRT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:58.891411] [INFO ] [MAIN ] NXRT: Generated 1339 derivative records from 13690 primary records. [2025-09-16T21:18:58.891606] [DEBUG] [LOCAL ] NXRT: Saving derivative data. [2025-09-16T21:18:58.915970] [DEBUG] [LOCAL ] NXRT: Derivative data saved (1339 records). [2025-09-16T21:18:58.916122] [INFO ] [MAIN ] NXRT: Successfully saved derivative data. [2025-09-16T21:18:58.918466] [INFO ] [MAIN ] Derivative Progress: 1314/2026 symbols completed. NXRT took 0.8s. Estimated remaining: 3m 51s. Rate: 184.6 symbols/min [2025-09-16T21:18:58.918834] [INFO ] [MAIN ] OBDC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:58.935150] [DEBUG] [LOCAL ] NZF: Loaded 21331 existing records from primary storage. [2025-09-16T21:18:58.935312] [INFO ] [MAIN ] NZF: Loaded 21331 primary data records. [2025-09-16T21:18:59.010329] [DEBUG] [LOCAL ] NYT: Loaded 37131 existing records from primary storage. [2025-09-16T21:18:59.022477] [INFO ] [MAIN ] NYT: Loaded 37131 primary data records. [2025-09-16T21:18:59.257419] [DEBUG] [LOCAL ] OBDC: Loaded 38178 existing records from primary storage. [2025-09-16T21:18:59.390555] [INFO ] [MAIN ] OBDC: Loaded 38178 primary data records. [2025-09-16T21:18:59.828111] [DEBUG] [MAIN ] NZF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:59.829994] [INFO ] [MAIN ] NZF: Generated 1339 derivative records from 21331 primary records. [2025-09-16T21:18:59.830245] [DEBUG] [LOCAL ] NZF: Saving derivative data. [2025-09-16T21:18:59.842033] [DEBUG] [MAIN ] NYT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:59.851033] [INFO ] [MAIN ] NYT: Generated 1339 derivative records from 37131 primary records. [2025-09-16T21:18:59.851574] [DEBUG] [LOCAL ] NYT: Saving derivative data. [2025-09-16T21:18:59.854781] [DEBUG] [LOCAL ] NZF: Derivative data saved (1339 records). [2025-09-16T21:18:59.854973] [INFO ] [MAIN ] NZF: Successfully saved derivative data. [2025-09-16T21:18:59.861974] [INFO ] [MAIN ] Derivative Progress: 1315/2026 symbols completed. NZF took 1.0s. Estimated remaining: 3m 51s. Rate: 184.3 symbols/min [2025-09-16T21:18:59.865569] [INFO ] [MAIN ] OBK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:59.869104] [DEBUG] [LOCAL ] NYT: Derivative data saved (1339 records). [2025-09-16T21:18:59.869942] [INFO ] [MAIN ] NYT: Successfully saved derivative data. [2025-09-16T21:18:59.872015] [INFO ] [MAIN ] Derivative Progress: 1316/2026 symbols completed. NYT took 1.0s. Estimated remaining: 3m 51s. Rate: 184.5 symbols/min [2025-09-16T21:18:59.872278] [INFO ] [MAIN ] OC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:18:59.886962] [DEBUG] [MAIN ] OBDC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:18:59.891656] [DEBUG] [LOCAL ] OBK: Loaded 11883 existing records from primary storage. [2025-09-16T21:18:59.892278] [INFO ] [MAIN ] OBDC: Generated 1339 derivative records from 38178 primary records. [2025-09-16T21:18:59.892388] [INFO ] [MAIN ] OBK: Loaded 11883 primary data records. [2025-09-16T21:18:59.903702] [DEBUG] [LOCAL ] OBDC: Saving derivative data. [2025-09-16T21:19:00.069188] [DEBUG] [LOCAL ] OBDC: Derivative data saved (1339 records). [2025-09-16T21:19:00.094045] [INFO ] [MAIN ] OBDC: Successfully saved derivative data. [2025-09-16T21:19:00.099632] [INFO ] [MAIN ] Derivative Progress: 1317/2026 symbols completed. OBDC took 1.2s. Estimated remaining: 3m 51s. Rate: 184.5 symbols/min [2025-09-16T21:19:00.099847] [INFO ] [MAIN ] OCFT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:00.194955] [DEBUG] [LOCAL ] OC: Loaded 32752 existing records from primary storage. [2025-09-16T21:19:00.195267] [INFO ] [MAIN ] OC: Loaded 32752 primary data records. [2025-09-16T21:19:00.302042] [DEBUG] [LOCAL ] OCFT: Loaded 5772 existing records from primary storage. [2025-09-16T21:19:00.305657] [INFO ] [MAIN ] OCFT: Loaded 5772 primary data records. [2025-09-16T21:19:00.753601] [DEBUG] [MAIN ] OBK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:00.754798] [INFO ] [MAIN ] OBK: Generated 1339 derivative records from 11883 primary records. [2025-09-16T21:19:00.755221] [DEBUG] [LOCAL ] OBK: Saving derivative data. [2025-09-16T21:19:00.768504] [DEBUG] [LOCAL ] OBK: Derivative data saved (1339 records). [2025-09-16T21:19:00.771245] [INFO ] [MAIN ] OBK: Successfully saved derivative data. [2025-09-16T21:19:00.778983] [INFO ] [MAIN ] Derivative Progress: 1318/2026 symbols completed. OBK took 0.9s. Estimated remaining: 3m 50s. Rate: 184.4 symbols/min [2025-09-16T21:19:00.783352] [DEBUG] [MAIN ] OC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:00.784011] [INFO ] [MAIN ] OC: Generated 1339 derivative records from 32752 primary records. [2025-09-16T21:19:00.784176] [DEBUG] [LOCAL ] OC: Saving derivative data. [2025-09-16T21:19:00.798696] [DEBUG] [LOCAL ] OC: Derivative data saved (1339 records). [2025-09-16T21:19:00.798802] [INFO ] [MAIN ] OC: Successfully saved derivative data. [2025-09-16T21:19:00.800675] [INFO ] [MAIN ] Derivative Progress: 1319/2026 symbols completed. OC took 0.9s. Estimated remaining: 3m 50s. Rate: 184.5 symbols/min [2025-09-16T21:19:00.810578] [DEBUG] [MAIN ] OCFT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:00.811158] [INFO ] [MAIN ] OCFT: Generated 1339 derivative records from 5772 primary records. [2025-09-16T21:19:00.811221] [DEBUG] [LOCAL ] OCFT: Saving derivative data. [2025-09-16T21:19:00.821741] [DEBUG] [LOCAL ] OCFT: Derivative data saved (1339 records). [2025-09-16T21:19:00.821799] [INFO ] [MAIN ] OCFT: Successfully saved derivative data. [2025-09-16T21:19:00.823983] [INFO ] [MAIN ] Derivative Progress: 1320/2026 symbols completed. OCFT took 0.7s. Estimated remaining: 3m 49s. Rate: 184.6 symbols/min [2025-09-16T21:19:00.824539] [INFO ] [MAIN ] OEC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:00.824494] [INFO ] [MAIN ] ODC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:00.824993] [INFO ] [MAIN ] ODV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:00.833803] [DEBUG] [LOCAL ] ODC: Loaded 6472 existing records from primary storage. [2025-09-16T21:19:00.834096] [INFO ] [MAIN ] ODC: Loaded 6472 primary data records. [2025-09-16T21:19:00.954698] [DEBUG] [LOCAL ] ODV: Loaded 20103 existing records from primary storage. [2025-09-16T21:19:00.978250] [INFO ] [MAIN ] ODV: Loaded 20103 primary data records. [2025-09-16T21:19:01.003679] [DEBUG] [LOCAL ] OEC: Loaded 27552 existing records from primary storage. [2025-09-16T21:19:01.035092] [INFO ] [MAIN ] OEC: Loaded 27552 primary data records. [2025-09-16T21:19:01.724722] [DEBUG] [MAIN ] ODC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:01.726482] [INFO ] [MAIN ] ODC: Generated 1339 derivative records from 6472 primary records. [2025-09-16T21:19:01.727947] [DEBUG] [LOCAL ] ODC: Saving derivative data. [2025-09-16T21:19:01.746934] [DEBUG] [MAIN ] ODV: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:01.750220] [INFO ] [MAIN ] ODV: Generated 1339 derivative records from 20103 primary records. [2025-09-16T21:19:01.750767] [DEBUG] [LOCAL ] ODV: Saving derivative data. [2025-09-16T21:19:01.752938] [DEBUG] [LOCAL ] ODC: Derivative data saved (1339 records). [2025-09-16T21:19:01.758594] [INFO ] [MAIN ] ODC: Successfully saved derivative data. [2025-09-16T21:19:01.768812] [INFO ] [MAIN ] Derivative Progress: 1321/2026 symbols completed. ODC took 0.9s. Estimated remaining: 3m 49s. Rate: 184.3 symbols/min [2025-09-16T21:19:01.769070] [INFO ] [MAIN ] OFG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:01.775257] [DEBUG] [MAIN ] OEC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:01.776635] [INFO ] [MAIN ] OEC: Generated 1339 derivative records from 27552 primary records. [2025-09-16T21:19:01.776817] [DEBUG] [LOCAL ] OEC: Saving derivative data. [2025-09-16T21:19:01.777133] [DEBUG] [LOCAL ] ODV: Derivative data saved (1339 records). [2025-09-16T21:19:01.777237] [INFO ] [MAIN ] ODV: Successfully saved derivative data. [2025-09-16T21:19:01.779287] [INFO ] [MAIN ] Derivative Progress: 1322/2026 symbols completed. ODV took 1.0s. Estimated remaining: 3m 49s. Rate: 184.5 symbols/min [2025-09-16T21:19:01.780110] [INFO ] [MAIN ] OGE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:01.792115] [DEBUG] [LOCAL ] OEC: Derivative data saved (1339 records). [2025-09-16T21:19:01.795985] [INFO ] [MAIN ] OEC: Successfully saved derivative data. [2025-09-16T21:19:01.798171] [INFO ] [MAIN ] Derivative Progress: 1323/2026 symbols completed. OEC took 1.0s. Estimated remaining: 3m 48s. Rate: 184.6 symbols/min [2025-09-16T21:19:01.798551] [INFO ] [MAIN ] OGN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:01.805948] [DEBUG] [LOCAL ] OFG: Loaded 15322 existing records from primary storage. [2025-09-16T21:19:01.806277] [INFO ] [MAIN ] OFG: Loaded 15322 primary data records. [2025-09-16T21:19:02.103998] [DEBUG] [LOCAL ] OGE: Loaded 34385 existing records from primary storage. [2025-09-16T21:19:02.104314] [INFO ] [MAIN ] OGE: Loaded 34385 primary data records. [2025-09-16T21:19:02.153181] [DEBUG] [LOCAL ] OGN: Loaded 39602 existing records from primary storage. [2025-09-16T21:19:02.182658] [INFO ] [MAIN ] OGN: Loaded 39602 primary data records. [2025-09-16T21:19:02.671077] [DEBUG] [MAIN ] OFG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:02.672216] [INFO ] [MAIN ] OFG: Generated 1339 derivative records from 15322 primary records. [2025-09-16T21:19:02.672706] [DEBUG] [LOCAL ] OFG: Saving derivative data. [2025-09-16T21:19:02.687574] [DEBUG] [LOCAL ] OFG: Derivative data saved (1339 records). [2025-09-16T21:19:02.688782] [INFO ] [MAIN ] OFG: Successfully saved derivative data. [2025-09-16T21:19:02.691285] [INFO ] [MAIN ] Derivative Progress: 1324/2026 symbols completed. OFG took 0.9s. Estimated remaining: 3m 48s. Rate: 184.4 symbols/min [2025-09-16T21:19:02.691739] [INFO ] [MAIN ] OGS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:02.702008] [DEBUG] [MAIN ] OGE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:02.702696] [INFO ] [MAIN ] OGE: Generated 1339 derivative records from 34385 primary records. [2025-09-16T21:19:02.702828] [DEBUG] [LOCAL ] OGE: Saving derivative data. [2025-09-16T21:19:02.717574] [DEBUG] [LOCAL ] OGE: Derivative data saved (1339 records). [2025-09-16T21:19:02.717895] [INFO ] [MAIN ] OGE: Successfully saved derivative data. [2025-09-16T21:19:02.719469] [INFO ] [MAIN ] Derivative Progress: 1325/2026 symbols completed. OGE took 0.9s. Estimated remaining: 3m 48s. Rate: 184.5 symbols/min [2025-09-16T21:19:02.726877] [INFO ] [MAIN ] OHI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:02.737066] [DEBUG] [MAIN ] OGN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:02.737855] [INFO ] [MAIN ] OGN: Generated 1339 derivative records from 39602 primary records. [2025-09-16T21:19:02.737948] [DEBUG] [LOCAL ] OGN: Saving derivative data. [2025-09-16T21:19:02.758424] [DEBUG] [LOCAL ] OGS: Loaded 25928 existing records from primary storage. [2025-09-16T21:19:02.758551] [DEBUG] [LOCAL ] OGN: Derivative data saved (1339 records). [2025-09-16T21:19:02.758632] [INFO ] [MAIN ] OGS: Loaded 25928 primary data records. [2025-09-16T21:19:02.758820] [INFO ] [MAIN ] OGN: Successfully saved derivative data. [2025-09-16T21:19:02.773104] [INFO ] [MAIN ] Derivative Progress: 1326/2026 symbols completed. OGN took 1.0s. Estimated remaining: 3m 48s. Rate: 184.6 symbols/min [2025-09-16T21:19:02.783587] [INFO ] [MAIN ] OI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:02.954163] [DEBUG] [LOCAL ] OHI: Loaded 38819 existing records from primary storage. [2025-09-16T21:19:02.973240] [INFO ] [MAIN ] OHI: Loaded 38819 primary data records. [2025-09-16T21:19:03.158028] [DEBUG] [LOCAL ] OI: Loaded 34975 existing records from primary storage. [2025-09-16T21:19:03.163992] [INFO ] [MAIN ] OI: Loaded 34975 primary data records. [2025-09-16T21:19:03.677993] [DEBUG] [MAIN ] OGS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:03.679552] [INFO ] [MAIN ] OGS: Generated 1339 derivative records from 25928 primary records. [2025-09-16T21:19:03.679774] [DEBUG] [LOCAL ] OGS: Saving derivative data. [2025-09-16T21:19:03.697145] [DEBUG] [LOCAL ] OGS: Derivative data saved (1339 records). [2025-09-16T21:19:03.697355] [INFO ] [MAIN ] OGS: Successfully saved derivative data. [2025-09-16T21:19:03.699756] [INFO ] [MAIN ] Derivative Progress: 1327/2026 symbols completed. OGS took 1.0s. Estimated remaining: 3m 47s. Rate: 184.4 symbols/min [2025-09-16T21:19:03.700352] [INFO ] [MAIN ] OIA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:03.716814] [DEBUG] [MAIN ] OHI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:03.717630] [INFO ] [MAIN ] OHI: Generated 1339 derivative records from 38819 primary records. [2025-09-16T21:19:03.718852] [DEBUG] [LOCAL ] OHI: Saving derivative data. [2025-09-16T21:19:03.724658] [DEBUG] [LOCAL ] OIA: Loaded 9965 existing records from primary storage. [2025-09-16T21:19:03.725287] [INFO ] [MAIN ] OIA: Loaded 9965 primary data records. [2025-09-16T21:19:03.796185] [DEBUG] [MAIN ] OI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:03.820500] [DEBUG] [LOCAL ] OHI: Derivative data saved (1339 records). [2025-09-16T21:19:03.820241] [INFO ] [MAIN ] OI: Generated 1339 derivative records from 34975 primary records. [2025-09-16T21:19:03.832614] [INFO ] [MAIN ] OHI: Successfully saved derivative data. [2025-09-16T21:19:03.856686] [INFO ] [MAIN ] Derivative Progress: 1328/2026 symbols completed. OHI took 1.1s. Estimated remaining: 3m 47s. Rate: 184.4 symbols/min [2025-09-16T21:19:03.851771] [DEBUG] [LOCAL ] OI: Saving derivative data. [2025-09-16T21:19:03.878914] [INFO ] [MAIN ] OII: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:04.040170] [DEBUG] [LOCAL ] OI: Derivative data saved (1339 records). [2025-09-16T21:19:04.040333] [INFO ] [MAIN ] OI: Successfully saved derivative data. [2025-09-16T21:19:04.042748] [INFO ] [MAIN ] Derivative Progress: 1329/2026 symbols completed. OI took 1.3s. Estimated remaining: 3m 47s. Rate: 184.5 symbols/min [2025-09-16T21:19:04.043177] [INFO ] [MAIN ] OIS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:04.069936] [DEBUG] [LOCAL ] OII: Loaded 31404 existing records from primary storage. [2025-09-16T21:19:04.070255] [INFO ] [MAIN ] OII: Loaded 31404 primary data records. [2025-09-16T21:19:04.197069] [DEBUG] [MAIN ] OIA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:04.214677] [DEBUG] [LOCAL ] OIS: Loaded 29731 existing records from primary storage. [2025-09-16T21:19:04.221322] [INFO ] [MAIN ] OIA: Generated 1339 derivative records from 9965 primary records. [2025-09-16T21:19:04.236724] [DEBUG] [LOCAL ] OIA: Saving derivative data. [2025-09-16T21:19:04.236816] [INFO ] [MAIN ] OIS: Loaded 29731 primary data records. [2025-09-16T21:19:04.379143] [DEBUG] [LOCAL ] OIA: Derivative data saved (1339 records). [2025-09-16T21:19:04.492668] [INFO ] [MAIN ] OIA: Successfully saved derivative data. [2025-09-16T21:19:04.494451] [INFO ] [MAIN ] Derivative Progress: 1330/2026 symbols completed. OIA took 0.8s. Estimated remaining: 3m 46s. Rate: 184.4 symbols/min [2025-09-16T21:19:04.494671] [INFO ] [MAIN ] OKE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:04.700133] [DEBUG] [MAIN ] OII: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:04.701870] [INFO ] [MAIN ] OII: Generated 1339 derivative records from 31404 primary records. [2025-09-16T21:19:04.701068] [DEBUG] [LOCAL ] OKE: Loaded 39937 existing records from primary storage. [2025-09-16T21:19:04.702123] [DEBUG] [LOCAL ] OII: Saving derivative data. [2025-09-16T21:19:04.702892] [INFO ] [MAIN ] OKE: Loaded 39937 primary data records. [2025-09-16T21:19:04.789412] [DEBUG] [LOCAL ] OII: Derivative data saved (1339 records). [2025-09-16T21:19:04.794799] [INFO ] [MAIN ] OII: Successfully saved derivative data. [2025-09-16T21:19:04.797074] [INFO ] [MAIN ] Derivative Progress: 1331/2026 symbols completed. OII took 0.9s. Estimated remaining: 3m 46s. Rate: 184.4 symbols/min [2025-09-16T21:19:04.804030] [INFO ] [MAIN ] OKLO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:04.803848] [DEBUG] [MAIN ] OIS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:04.810201] [INFO ] [MAIN ] OIS: Generated 1339 derivative records from 29731 primary records. [2025-09-16T21:19:04.821345] [DEBUG] [LOCAL ] OIS: Saving derivative data. [2025-09-16T21:19:04.919031] [DEBUG] [LOCAL ] OIS: Derivative data saved (1339 records). [2025-09-16T21:19:05.000725] [INFO ] [MAIN ] OIS: Successfully saved derivative data. [2025-09-16T21:19:05.002387] [INFO ] [MAIN ] Derivative Progress: 1332/2026 symbols completed. OIS took 1.0s. Estimated remaining: 3m 46s. Rate: 184.5 symbols/min [2025-09-16T21:19:05.002746] [INFO ] [MAIN ] OLN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:05.033281] [DEBUG] [LOCAL ] OKLO: Loaded 40169 existing records from primary storage. [2025-09-16T21:19:05.034061] [INFO ] [MAIN ] OKLO: Loaded 40169 primary data records. [2025-09-16T21:19:05.122550] [DEBUG] [MAIN ] OKE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:05.145709] [INFO ] [MAIN ] OKE: Generated 1339 derivative records from 39937 primary records. [2025-09-16T21:19:05.157226] [DEBUG] [LOCAL ] OKE: Saving derivative data. [2025-09-16T21:19:05.195405] [DEBUG] [LOCAL ] OLN: Loaded 38719 existing records from primary storage. [2025-09-16T21:19:05.225759] [INFO ] [MAIN ] OLN: Loaded 38719 primary data records. [2025-09-16T21:19:05.467906] [DEBUG] [LOCAL ] OKE: Derivative data saved (1339 records). [2025-09-16T21:19:05.501499] [INFO ] [MAIN ] OKE: Successfully saved derivative data. [2025-09-16T21:19:05.529807] [INFO ] [MAIN ] Derivative Progress: 1333/2026 symbols completed. OKE took 1.0s. Estimated remaining: 3m 45s. Rate: 184.4 symbols/min [2025-09-16T21:19:05.630974] [DEBUG] [MAIN ] OKLO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:05.631716] [INFO ] [MAIN ] OKLO: Generated 1339 derivative records from 40169 primary records. [2025-09-16T21:19:05.632115] [DEBUG] [LOCAL ] OKLO: Saving derivative data. [2025-09-16T21:19:05.659762] [DEBUG] [MAIN ] OLN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:05.660542] [DEBUG] [LOCAL ] OKLO: Derivative data saved (1339 records). [2025-09-16T21:19:05.661318] [INFO ] [MAIN ] OKLO: Successfully saved derivative data. [2025-09-16T21:19:05.663697] [INFO ] [MAIN ] Derivative Progress: 1334/2026 symbols completed. OKLO took 0.9s. Estimated remaining: 3m 45s. Rate: 184.5 symbols/min [2025-09-16T21:19:05.661138] [INFO ] [MAIN ] OLN: Generated 1339 derivative records from 38719 primary records. [2025-09-16T21:19:05.663954] [DEBUG] [LOCAL ] OLN: Saving derivative data. [2025-09-16T21:19:05.676416] [DEBUG] [LOCAL ] OLN: Derivative data saved (1339 records). [2025-09-16T21:19:05.676483] [INFO ] [MAIN ] OLN: Successfully saved derivative data. [2025-09-16T21:19:05.678823] [INFO ] [MAIN ] Derivative Progress: 1335/2026 symbols completed. OLN took 0.7s. Estimated remaining: 3m 45s. Rate: 184.6 symbols/min [2025-09-16T21:19:05.679607] [INFO ] [MAIN ] OMC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:05.679495] [INFO ] [MAIN ] OLP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:05.679762] [INFO ] [MAIN ] OMF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:05.690476] [DEBUG] [LOCAL ] OLP: Loaded 6931 existing records from primary storage. [2025-09-16T21:19:05.690613] [INFO ] [MAIN ] OLP: Loaded 6931 primary data records. [2025-09-16T21:19:06.002341] [DEBUG] [LOCAL ] OMF: Loaded 34025 existing records from primary storage. [2025-09-16T21:19:06.002580] [INFO ] [MAIN ] OMF: Loaded 34025 primary data records. [2025-09-16T21:19:06.057421] [DEBUG] [LOCAL ] OMC: Loaded 39669 existing records from primary storage. [2025-09-16T21:19:06.078906] [INFO ] [MAIN ] OMC: Loaded 39669 primary data records. [2025-09-16T21:19:06.571346] [DEBUG] [MAIN ] OLP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:06.572590] [INFO ] [MAIN ] OLP: Generated 1339 derivative records from 6931 primary records. [2025-09-16T21:19:06.572747] [DEBUG] [LOCAL ] OLP: Saving derivative data. [2025-09-16T21:19:06.588603] [DEBUG] [LOCAL ] OLP: Derivative data saved (1339 records). [2025-09-16T21:19:06.589868] [INFO ] [MAIN ] OLP: Successfully saved derivative data. [2025-09-16T21:19:06.594357] [INFO ] [MAIN ] Derivative Progress: 1336/2026 symbols completed. OLP took 0.9s. Estimated remaining: 3m 45s. Rate: 184.4 symbols/min [2025-09-16T21:19:06.595795] [INFO ] [MAIN ] OMI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:06.611765] [DEBUG] [MAIN ] OMC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:06.616043] [INFO ] [MAIN ] OMC: Generated 1339 derivative records from 39669 primary records. [2025-09-16T21:19:06.616271] [DEBUG] [LOCAL ] OMC: Saving derivative data. [2025-09-16T21:19:06.616459] [DEBUG] [MAIN ] OMF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:06.617567] [INFO ] [MAIN ] OMF: Generated 1339 derivative records from 34025 primary records. [2025-09-16T21:19:06.617917] [DEBUG] [LOCAL ] OMF: Saving derivative data. [2025-09-16T21:19:06.642340] [DEBUG] [LOCAL ] OMF: Derivative data saved (1339 records). [2025-09-16T21:19:06.643115] [INFO ] [MAIN ] OMF: Successfully saved derivative data. [2025-09-16T21:19:06.643557] [DEBUG] [LOCAL ] OMC: Derivative data saved (1339 records). [2025-09-16T21:19:06.653312] [INFO ] [MAIN ] Derivative Progress: 1337/2026 symbols completed. OMF took 1.0s. Estimated remaining: 3m 44s. Rate: 184.5 symbols/min [2025-09-16T21:19:06.653668] [INFO ] [MAIN ] ONIT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:06.653798] [INFO ] [MAIN ] OMC: Successfully saved derivative data. [2025-09-16T21:19:06.656264] [INFO ] [MAIN ] Derivative Progress: 1338/2026 symbols completed. OMC took 1.0s. Estimated remaining: 3m 44s. Rate: 184.6 symbols/min [2025-09-16T21:19:06.656600] [INFO ] [MAIN ] ONL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:06.663163] [DEBUG] [LOCAL ] ONIT: Loaded 5817 existing records from primary storage. [2025-09-16T21:19:06.663293] [INFO ] [MAIN ] ONIT: Loaded 5817 primary data records. [2025-09-16T21:19:06.780306] [DEBUG] [LOCAL ] OMI: Loaded 33837 existing records from primary storage. [2025-09-16T21:19:06.783629] [INFO ] [MAIN ] OMI: Loaded 33837 primary data records. [2025-09-16T21:19:06.891551] [DEBUG] [LOCAL ] ONL: Loaded 22251 existing records from primary storage. [2025-09-16T21:19:06.941171] [INFO ] [MAIN ] ONL: Loaded 22251 primary data records. [2025-09-16T21:19:07.519804] [DEBUG] [MAIN ] ONIT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:07.521116] [INFO ] [MAIN ] ONIT: Generated 1339 derivative records from 5817 primary records. [2025-09-16T21:19:07.521375] [DEBUG] [LOCAL ] ONIT: Saving derivative data. [2025-09-16T21:19:07.536137] [DEBUG] [LOCAL ] ONIT: Derivative data saved (1339 records). [2025-09-16T21:19:07.536361] [INFO ] [MAIN ] ONIT: Successfully saved derivative data. [2025-09-16T21:19:07.538074] [INFO ] [MAIN ] Derivative Progress: 1339/2026 symbols completed. ONIT took 0.9s. Estimated remaining: 3m 44s. Rate: 184.4 symbols/min [2025-09-16T21:19:07.548843] [DEBUG] [MAIN ] OMI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:07.548534] [INFO ] [MAIN ] ONON: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:07.549690] [INFO ] [MAIN ] OMI: Generated 1339 derivative records from 33837 primary records. [2025-09-16T21:19:07.550237] [DEBUG] [LOCAL ] OMI: Saving derivative data. [2025-09-16T21:19:07.577267] [DEBUG] [MAIN ] ONL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:07.578297] [INFO ] [MAIN ] ONL: Generated 1339 derivative records from 22251 primary records. [2025-09-16T21:19:07.576723] [DEBUG] [LOCAL ] OMI: Derivative data saved (1339 records). [2025-09-16T21:19:07.578427] [DEBUG] [LOCAL ] ONL: Saving derivative data. [2025-09-16T21:19:07.578542] [INFO ] [MAIN ] OMI: Successfully saved derivative data. [2025-09-16T21:19:07.581152] [INFO ] [MAIN ] Derivative Progress: 1340/2026 symbols completed. OMI took 1.0s. Estimated remaining: 3m 43s. Rate: 184.5 symbols/min [2025-09-16T21:19:07.581737] [INFO ] [MAIN ] ONTF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:07.604444] [DEBUG] [LOCAL ] ONL: Derivative data saved (1339 records). [2025-09-16T21:19:07.604603] [INFO ] [MAIN ] ONL: Successfully saved derivative data. [2025-09-16T21:19:07.606666] [INFO ] [MAIN ] Derivative Progress: 1341/2026 symbols completed. ONL took 1.0s. Estimated remaining: 3m 43s. Rate: 184.6 symbols/min [2025-09-16T21:19:07.607006] [INFO ] [MAIN ] ONTO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:07.620027] [DEBUG] [LOCAL ] ONON: Loaded 39970 existing records from primary storage. [2025-09-16T21:19:07.623721] [INFO ] [MAIN ] ONON: Loaded 39970 primary data records. [2025-09-16T21:19:07.738151] [DEBUG] [LOCAL ] ONTF: Loaded 17288 existing records from primary storage. [2025-09-16T21:19:07.743948] [INFO ] [MAIN ] ONTF: Loaded 17288 primary data records. [2025-09-16T21:19:08.015310] [DEBUG] [LOCAL ] ONTO: Loaded 35074 existing records from primary storage. [2025-09-16T21:19:08.031083] [INFO ] [MAIN ] ONTO: Loaded 35074 primary data records. [2025-09-16T21:19:08.521699] [DEBUG] [MAIN ] ONON: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:08.522714] [INFO ] [MAIN ] ONON: Generated 1339 derivative records from 39970 primary records. [2025-09-16T21:19:08.523894] [DEBUG] [LOCAL ] ONON: Saving derivative data. [2025-09-16T21:19:08.537894] [DEBUG] [LOCAL ] ONON: Derivative data saved (1339 records). [2025-09-16T21:19:08.538085] [INFO ] [MAIN ] ONON: Successfully saved derivative data. [2025-09-16T21:19:08.539958] [INFO ] [MAIN ] Derivative Progress: 1342/2026 symbols completed. ONON took 1.0s. Estimated remaining: 3m 43s. Rate: 184.4 symbols/min [2025-09-16T21:19:08.540245] [INFO ] [MAIN ] OOMA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:08.560018] [DEBUG] [MAIN ] ONTF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:08.560842] [INFO ] [MAIN ] ONTF: Generated 1339 derivative records from 17288 primary records. [2025-09-16T21:19:08.561144] [DEBUG] [LOCAL ] ONTF: Saving derivative data. [2025-09-16T21:19:08.584759] [DEBUG] [LOCAL ] OOMA: Loaded 13831 existing records from primary storage. [2025-09-16T21:19:08.585280] [INFO ] [MAIN ] OOMA: Loaded 13831 primary data records. [2025-09-16T21:19:08.585558] [DEBUG] [MAIN ] ONTO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:08.587040] [INFO ] [MAIN ] ONTO: Generated 1339 derivative records from 35074 primary records. [2025-09-16T21:19:08.608117] [DEBUG] [LOCAL ] ONTO: Saving derivative data. [2025-09-16T21:19:08.669993] [DEBUG] [LOCAL ] ONTF: Derivative data saved (1339 records). [2025-09-16T21:19:08.682033] [INFO ] [MAIN ] ONTF: Successfully saved derivative data. [2025-09-16T21:19:08.684327] [INFO ] [MAIN ] Derivative Progress: 1343/2026 symbols completed. ONTF took 1.1s. Estimated remaining: 3m 42s. Rate: 184.4 symbols/min [2025-09-16T21:19:08.684833] [INFO ] [MAIN ] OPAD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:08.726395] [DEBUG] [LOCAL ] ONTO: Derivative data saved (1339 records). [2025-09-16T21:19:08.759542] [INFO ] [MAIN ] ONTO: Successfully saved derivative data. [2025-09-16T21:19:08.783841] [INFO ] [MAIN ] Derivative Progress: 1344/2026 symbols completed. ONTO took 1.2s. Estimated remaining: 3m 42s. Rate: 184.5 symbols/min [2025-09-16T21:19:08.793042] [INFO ] [MAIN ] OPFI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:08.898976] [DEBUG] [LOCAL ] OPAD: Loaded 16833 existing records from primary storage. [2025-09-16T21:19:08.899294] [INFO ] [MAIN ] OPAD: Loaded 16833 primary data records. [2025-09-16T21:19:09.186470] [DEBUG] [LOCAL ] OPFI: Loaded 34683 existing records from primary storage. [2025-09-16T21:19:09.187472] [INFO ] [MAIN ] OPFI: Loaded 34683 primary data records. [2025-09-16T21:19:09.304254] [DEBUG] [MAIN ] OOMA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:09.316291] [INFO ] [MAIN ] OOMA: Generated 1339 derivative records from 13831 primary records. [2025-09-16T21:19:09.354997] [DEBUG] [LOCAL ] OOMA: Saving derivative data. [2025-09-16T21:19:09.477708] [DEBUG] [LOCAL ] OOMA: Derivative data saved (1339 records). [2025-09-16T21:19:09.479570] [INFO ] [MAIN ] OOMA: Successfully saved derivative data. [2025-09-16T21:19:09.481433] [INFO ] [MAIN ] Derivative Progress: 1345/2026 symbols completed. OOMA took 0.9s. Estimated remaining: 3m 42s. Rate: 184.4 symbols/min [2025-09-16T21:19:09.488102] [INFO ] [MAIN ] OPP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:09.491966] [DEBUG] [MAIN ] OPAD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:09.492837] [INFO ] [MAIN ] OPAD: Generated 1339 derivative records from 16833 primary records. [2025-09-16T21:19:09.493030] [DEBUG] [LOCAL ] OPAD: Saving derivative data. [2025-09-16T21:19:09.511291] [DEBUG] [LOCAL ] OPP: Loaded 8770 existing records from primary storage. [2025-09-16T21:19:09.512151] [DEBUG] [LOCAL ] OPAD: Derivative data saved (1339 records). [2025-09-16T21:19:09.512243] [INFO ] [MAIN ] OPP: Loaded 8770 primary data records. [2025-09-16T21:19:09.512287] [INFO ] [MAIN ] OPAD: Successfully saved derivative data. [2025-09-16T21:19:09.514355] [INFO ] [MAIN ] Derivative Progress: 1346/2026 symbols completed. OPAD took 0.8s. Estimated remaining: 3m 41s. Rate: 184.5 symbols/min [2025-09-16T21:19:09.514600] [INFO ] [MAIN ] OR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:09.647936] [DEBUG] [MAIN ] OPFI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:09.669260] [INFO ] [MAIN ] OPFI: Generated 1339 derivative records from 34683 primary records. [2025-09-16T21:19:09.720914] [DEBUG] [LOCAL ] OPFI: Saving derivative data. [2025-09-16T21:19:09.816674] [DEBUG] [LOCAL ] OR: Loaded 33968 existing records from primary storage. [2025-09-16T21:19:09.817103] [INFO ] [MAIN ] OR: Loaded 33968 primary data records. [2025-09-16T21:19:09.912424] [DEBUG] [LOCAL ] OPFI: Derivative data saved (1339 records). [2025-09-16T21:19:09.934249] [INFO ] [MAIN ] OPFI: Successfully saved derivative data. [2025-09-16T21:19:09.936762] [INFO ] [MAIN ] Derivative Progress: 1347/2026 symbols completed. OPFI took 1.1s. Estimated remaining: 3m 41s. Rate: 184.5 symbols/min [2025-09-16T21:19:09.942381] [INFO ] [MAIN ] ORA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:10.159324] [DEBUG] [MAIN ] OPP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:10.160507] [INFO ] [MAIN ] OPP: Generated 1339 derivative records from 8770 primary records. [2025-09-16T21:19:10.161474] [DEBUG] [LOCAL ] OPP: Saving derivative data. [2025-09-16T21:19:10.181759] [DEBUG] [LOCAL ] OPP: Derivative data saved (1339 records). [2025-09-16T21:19:10.181887] [INFO ] [MAIN ] OPP: Successfully saved derivative data. [2025-09-16T21:19:10.183710] [INFO ] [MAIN ] Derivative Progress: 1348/2026 symbols completed. OPP took 0.7s. Estimated remaining: 3m 40s. Rate: 184.5 symbols/min [2025-09-16T21:19:10.184562] [DEBUG] [LOCAL ] ORA: Loaded 23864 existing records from primary storage. [2025-09-16T21:19:10.184882] [INFO ] [MAIN ] ORA: Loaded 23864 primary data records. [2025-09-16T21:19:10.354368] [DEBUG] [MAIN ] OR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:10.369982] [INFO ] [MAIN ] OR: Generated 1339 derivative records from 33968 primary records. [2025-09-16T21:19:10.375089] [DEBUG] [LOCAL ] OR: Saving derivative data. [2025-09-16T21:19:10.475225] [DEBUG] [LOCAL ] OR: Derivative data saved (1339 records). [2025-09-16T21:19:10.475574] [INFO ] [MAIN ] OR: Successfully saved derivative data. [2025-09-16T21:19:10.477997] [INFO ] [MAIN ] Derivative Progress: 1349/2026 symbols completed. OR took 1.0s. Estimated remaining: 3m 40s. Rate: 184.5 symbols/min [2025-09-16T21:19:10.493408] [DEBUG] [MAIN ] ORA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:10.494055] [INFO ] [MAIN ] ORA: Generated 1339 derivative records from 23864 primary records. [2025-09-16T21:19:10.494120] [DEBUG] [LOCAL ] ORA: Saving derivative data. [2025-09-16T21:19:10.505718] [DEBUG] [LOCAL ] ORA: Derivative data saved (1339 records). [2025-09-16T21:19:10.505777] [INFO ] [MAIN ] ORA: Successfully saved derivative data. [2025-09-16T21:19:10.507549] [INFO ] [MAIN ] Derivative Progress: 1350/2026 symbols completed. ORA took 0.6s. Estimated remaining: 3m 40s. Rate: 184.6 symbols/min [2025-09-16T21:19:10.508011] [INFO ] [MAIN ] ORC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:10.508179] [INFO ] [MAIN ] ORN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:10.508439] [INFO ] [MAIN ] OSCR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:10.565327] [DEBUG] [LOCAL ] ORC: Loaded 39061 existing records from primary storage. [2025-09-16T21:19:10.564319] [DEBUG] [LOCAL ] ORN: Loaded 23286 existing records from primary storage. [2025-09-16T21:19:10.565518] [INFO ] [MAIN ] ORN: Loaded 23286 primary data records. [2025-09-16T21:19:10.565652] [INFO ] [MAIN ] ORC: Loaded 39061 primary data records. [2025-09-16T21:19:10.783957] [DEBUG] [LOCAL ] OSCR: Loaded 40152 existing records from primary storage. [2025-09-16T21:19:10.794908] [INFO ] [MAIN ] OSCR: Loaded 40152 primary data records. [2025-09-16T21:19:11.394685] [DEBUG] [MAIN ] ORC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:11.397631] [INFO ] [MAIN ] ORC: Generated 1339 derivative records from 39061 primary records. [2025-09-16T21:19:11.398505] [DEBUG] [LOCAL ] ORC: Saving derivative data. [2025-09-16T21:19:11.418927] [DEBUG] [MAIN ] ORN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:11.420432] [INFO ] [MAIN ] ORN: Generated 1339 derivative records from 23286 primary records. [2025-09-16T21:19:11.421212] [DEBUG] [LOCAL ] ORN: Saving derivative data. [2025-09-16T21:19:11.421162] [DEBUG] [LOCAL ] ORC: Derivative data saved (1339 records). [2025-09-16T21:19:11.422241] [INFO ] [MAIN ] ORC: Successfully saved derivative data. [2025-09-16T21:19:11.428888] [INFO ] [MAIN ] Derivative Progress: 1351/2026 symbols completed. ORC took 0.9s. Estimated remaining: 3m 40s. Rate: 184.4 symbols/min [2025-09-16T21:19:11.432123] [INFO ] [MAIN ] OTIS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:11.438491] [DEBUG] [LOCAL ] ORN: Derivative data saved (1339 records). [2025-09-16T21:19:11.439145] [INFO ] [MAIN ] ORN: Successfully saved derivative data. [2025-09-16T21:19:11.441215] [INFO ] [MAIN ] Derivative Progress: 1352/2026 symbols completed. ORN took 0.9s. Estimated remaining: 3m 39s. Rate: 184.5 symbols/min [2025-09-16T21:19:11.441432] [INFO ] [MAIN ] OUT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:11.452204] [DEBUG] [MAIN ] OSCR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:11.452899] [INFO ] [MAIN ] OSCR: Generated 1339 derivative records from 40152 primary records. [2025-09-16T21:19:11.453013] [DEBUG] [LOCAL ] OSCR: Saving derivative data. [2025-09-16T21:19:11.467987] [DEBUG] [LOCAL ] OSCR: Derivative data saved (1339 records). [2025-09-16T21:19:11.468193] [INFO ] [MAIN ] OSCR: Successfully saved derivative data. [2025-09-16T21:19:11.470190] [INFO ] [MAIN ] Derivative Progress: 1353/2026 symbols completed. OSCR took 1.0s. Estimated remaining: 3m 39s. Rate: 184.6 symbols/min [2025-09-16T21:19:11.470501] [INFO ] [MAIN ] OVV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:11.504483] [DEBUG] [LOCAL ] OTIS: Loaded 39307 existing records from primary storage. [2025-09-16T21:19:11.504691] [INFO ] [MAIN ] OTIS: Loaded 39307 primary data records. [2025-09-16T21:19:11.558077] [DEBUG] [LOCAL ] OUT: Loaded 35820 existing records from primary storage. [2025-09-16T21:19:11.613970] [INFO ] [MAIN ] OUT: Loaded 35820 primary data records. [2025-09-16T21:19:11.896946] [DEBUG] [LOCAL ] OVV: Loaded 39887 existing records from primary storage. [2025-09-16T21:19:11.912693] [INFO ] [MAIN ] OVV: Loaded 39887 primary data records. [2025-09-16T21:19:12.382300] [DEBUG] [MAIN ] OTIS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:12.384362] [INFO ] [MAIN ] OTIS: Generated 1339 derivative records from 39307 primary records. [2025-09-16T21:19:12.384918] [DEBUG] [LOCAL ] OTIS: Saving derivative data. [2025-09-16T21:19:12.395985] [DEBUG] [MAIN ] OUT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:12.402292] [INFO ] [MAIN ] OUT: Generated 1339 derivative records from 35820 primary records. [2025-09-16T21:19:12.405321] [DEBUG] [LOCAL ] OUT: Saving derivative data. [2025-09-16T21:19:12.419495] [DEBUG] [LOCAL ] OTIS: Derivative data saved (1339 records). [2025-09-16T21:19:12.419925] [INFO ] [MAIN ] OTIS: Successfully saved derivative data. [2025-09-16T21:19:12.422104] [INFO ] [MAIN ] Derivative Progress: 1354/2026 symbols completed. OTIS took 1.0s. Estimated remaining: 3m 39s. Rate: 184.4 symbols/min [2025-09-16T21:19:12.423071] [INFO ] [MAIN ] OWLT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:12.423901] [DEBUG] [LOCAL ] OUT: Derivative data saved (1339 records). [2025-09-16T21:19:12.424248] [INFO ] [MAIN ] OUT: Successfully saved derivative data. [2025-09-16T21:19:12.426156] [INFO ] [MAIN ] Derivative Progress: 1355/2026 symbols completed. OUT took 1.0s. Estimated remaining: 3m 38s. Rate: 184.5 symbols/min [2025-09-16T21:19:12.426466] [INFO ] [MAIN ] OXM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:12.442193] [DEBUG] [MAIN ] OVV: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:12.442904] [INFO ] [MAIN ] OVV: Generated 1339 derivative records from 39887 primary records. [2025-09-16T21:19:12.443012] [DEBUG] [LOCAL ] OVV: Saving derivative data. [2025-09-16T21:19:12.447502] [DEBUG] [LOCAL ] OWLT: Loaded 7029 existing records from primary storage. [2025-09-16T21:19:12.454040] [INFO ] [MAIN ] OWLT: Loaded 7029 primary data records. [2025-09-16T21:19:12.544630] [DEBUG] [LOCAL ] OVV: Derivative data saved (1339 records). [2025-09-16T21:19:12.563420] [INFO ] [MAIN ] OVV: Successfully saved derivative data. [2025-09-16T21:19:12.568502] [INFO ] [MAIN ] Derivative Progress: 1356/2026 symbols completed. OVV took 1.1s. Estimated remaining: 3m 38s. Rate: 184.6 symbols/min [2025-09-16T21:19:12.576376] [INFO ] [MAIN ] PAAS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:12.597564] [DEBUG] [LOCAL ] OXM: Loaded 24453 existing records from primary storage. [2025-09-16T21:19:12.617203] [INFO ] [MAIN ] OXM: Loaded 24453 primary data records. [2025-09-16T21:19:13.028317] [DEBUG] [LOCAL ] PAAS: Loaded 39975 existing records from primary storage. [2025-09-16T21:19:13.029404] [INFO ] [MAIN ] PAAS: Loaded 39975 primary data records. [2025-09-16T21:19:13.311532] [DEBUG] [MAIN ] OWLT: Filtered 5181 bins outside market hours, 5781 incomplete bins [2025-09-16T21:19:13.312862] [INFO ] [MAIN ] OWLT: Generated 1337 derivative records from 7029 primary records. [2025-09-16T21:19:13.313288] [DEBUG] [LOCAL ] OWLT: Saving derivative data. [2025-09-16T21:19:13.338757] [DEBUG] [LOCAL ] OWLT: Derivative data saved (1337 records). [2025-09-16T21:19:13.339331] [INFO ] [MAIN ] OWLT: Successfully saved derivative data. [2025-09-16T21:19:13.343198] [INFO ] [MAIN ] Derivative Progress: 1357/2026 symbols completed. OWLT took 0.9s. Estimated remaining: 3m 38s. Rate: 184.4 symbols/min [2025-09-16T21:19:13.340000] [DEBUG] [MAIN ] OXM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:13.344273] [INFO ] [MAIN ] OXM: Generated 1339 derivative records from 24453 primary records. [2025-09-16T21:19:13.344776] [INFO ] [MAIN ] PAC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:13.344920] [DEBUG] [LOCAL ] OXM: Saving derivative data. [2025-09-16T21:19:13.360036] [DEBUG] [LOCAL ] OXM: Derivative data saved (1339 records). [2025-09-16T21:19:13.360691] [INFO ] [MAIN ] OXM: Successfully saved derivative data. [2025-09-16T21:19:13.368423] [DEBUG] [LOCAL ] PAC: Loaded 8440 existing records from primary storage. [2025-09-16T21:19:13.364385] [INFO ] [MAIN ] Derivative Progress: 1358/2026 symbols completed. OXM took 0.9s. Estimated remaining: 3m 37s. Rate: 184.5 symbols/min [2025-09-16T21:19:13.368680] [INFO ] [MAIN ] PAC: Loaded 8440 primary data records. [2025-09-16T21:19:13.368948] [INFO ] [MAIN ] PACK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:13.454233] [DEBUG] [MAIN ] PAAS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:13.481635] [INFO ] [MAIN ] PAAS: Generated 1339 derivative records from 39975 primary records. [2025-09-16T21:19:13.481831] [DEBUG] [LOCAL ] PAAS: Saving derivative data. [2025-09-16T21:19:13.575784] [DEBUG] [LOCAL ] PAAS: Derivative data saved (1339 records). [2025-09-16T21:19:13.657602] [INFO ] [MAIN ] PAAS: Successfully saved derivative data. [2025-09-16T21:19:13.666845] [INFO ] [MAIN ] Derivative Progress: 1359/2026 symbols completed. PAAS took 1.1s. Estimated remaining: 3m 37s. Rate: 184.5 symbols/min [2025-09-16T21:19:13.667497] [INFO ] [MAIN ] PACS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:13.668307] [DEBUG] [LOCAL ] PACK: Loaded 22965 existing records from primary storage. [2025-09-16T21:19:13.669099] [INFO ] [MAIN ] PACK: Loaded 22965 primary data records. [2025-09-16T21:19:13.944946] [DEBUG] [LOCAL ] PACS: Loaded 25146 existing records from primary storage. [2025-09-16T21:19:13.945333] [INFO ] [MAIN ] PACS: Loaded 25146 primary data records. [2025-09-16T21:19:14.142230] [DEBUG] [MAIN ] PAC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:14.143362] [INFO ] [MAIN ] PAC: Generated 1339 derivative records from 8440 primary records. [2025-09-16T21:19:14.182007] [DEBUG] [LOCAL ] PAC: Saving derivative data. [2025-09-16T21:19:14.245780] [DEBUG] [LOCAL ] PAC: Derivative data saved (1339 records). [2025-09-16T21:19:14.246683] [INFO ] [MAIN ] PAC: Successfully saved derivative data. [2025-09-16T21:19:14.248400] [INFO ] [MAIN ] Derivative Progress: 1360/2026 symbols completed. PAC took 0.9s. Estimated remaining: 3m 37s. Rate: 184.4 symbols/min [2025-09-16T21:19:14.249721] [INFO ] [MAIN ] PAG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:14.260500] [DEBUG] [MAIN ] PACK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:14.261350] [INFO ] [MAIN ] PACK: Generated 1339 derivative records from 22965 primary records. [2025-09-16T21:19:14.261588] [DEBUG] [LOCAL ] PACK: Saving derivative data. [2025-09-16T21:19:14.273716] [DEBUG] [LOCAL ] PACK: Derivative data saved (1339 records). [2025-09-16T21:19:14.273909] [INFO ] [MAIN ] PACK: Successfully saved derivative data. [2025-09-16T21:19:14.275635] [INFO ] [MAIN ] Derivative Progress: 1361/2026 symbols completed. PACK took 0.9s. Estimated remaining: 3m 36s. Rate: 184.6 symbols/min [2025-09-16T21:19:14.275832] [INFO ] [MAIN ] PAGS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:14.294196] [DEBUG] [MAIN ] PACS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:14.294912] [INFO ] [MAIN ] PACS: Generated 1339 derivative records from 25146 primary records. [2025-09-16T21:19:14.295025] [DEBUG] [LOCAL ] PACS: Saving derivative data. [2025-09-16T21:19:14.310936] [DEBUG] [LOCAL ] PAG: Loaded 15484 existing records from primary storage. [2025-09-16T21:19:14.313320] [INFO ] [MAIN ] PAG: Loaded 15484 primary data records. [2025-09-16T21:19:14.313409] [DEBUG] [LOCAL ] PACS: Derivative data saved (1339 records). [2025-09-16T21:19:14.334546] [INFO ] [MAIN ] PACS: Successfully saved derivative data. [2025-09-16T21:19:14.352292] [INFO ] [MAIN ] Derivative Progress: 1362/2026 symbols completed. PACS took 0.7s. Estimated remaining: 3m 36s. Rate: 184.7 symbols/min [2025-09-16T21:19:14.394613] [INFO ] [MAIN ] PAI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:14.461960] [DEBUG] [LOCAL ] PAGS: Loaded 39351 existing records from primary storage. [2025-09-16T21:19:14.467273] [INFO ] [MAIN ] PAGS: Loaded 39351 primary data records. [2025-09-16T21:19:14.491747] [DEBUG] [LOCAL ] PAI: Loaded 2013 existing records from primary storage. [2025-09-16T21:19:14.515910] [INFO ] [MAIN ] PAI: Loaded 2013 primary data records. [2025-09-16T21:19:15.187513] [DEBUG] [MAIN ] PAG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:15.188421] [INFO ] [MAIN ] PAG: Generated 1339 derivative records from 15484 primary records. [2025-09-16T21:19:15.188757] [DEBUG] [LOCAL ] PAG: Saving derivative data. [2025-09-16T21:19:15.203829] [DEBUG] [LOCAL ] PAG: Derivative data saved (1339 records). [2025-09-16T21:19:15.204011] [INFO ] [MAIN ] PAG: Successfully saved derivative data. [2025-09-16T21:19:15.205516] [INFO ] [MAIN ] Derivative Progress: 1363/2026 symbols completed. PAG took 1.0s. Estimated remaining: 3m 36s. Rate: 184.4 symbols/min [2025-09-16T21:19:15.216349] [DEBUG] [MAIN ] PAI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:15.225810] [INFO ] [MAIN ] PAI: Generated 1339 derivative records from 2013 primary records. [2025-09-16T21:19:15.226136] [DEBUG] [LOCAL ] PAI: Saving derivative data. [2025-09-16T21:19:15.226097] [DEBUG] [MAIN ] PAGS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:15.226869] [INFO ] [MAIN ] PAGS: Generated 1339 derivative records from 39351 primary records. [2025-09-16T21:19:15.227217] [DEBUG] [LOCAL ] PAGS: Saving derivative data. [2025-09-16T21:19:15.245822] [DEBUG] [LOCAL ] PAI: Derivative data saved (1339 records). [2025-09-16T21:19:15.247235] [INFO ] [MAIN ] PAI: Successfully saved derivative data. [2025-09-16T21:19:15.249389] [INFO ] [MAIN ] Derivative Progress: 1364/2026 symbols completed. PAI took 0.9s. Estimated remaining: 3m 35s. Rate: 184.6 symbols/min [2025-09-16T21:19:15.250410] [DEBUG] [LOCAL ] PAGS: Derivative data saved (1339 records). [2025-09-16T21:19:15.250480] [INFO ] [MAIN ] PAGS: Successfully saved derivative data. [2025-09-16T21:19:15.252626] [INFO ] [MAIN ] Derivative Progress: 1365/2026 symbols completed. PAGS took 1.0s. Estimated remaining: 3m 35s. Rate: 184.7 symbols/min [2025-09-16T21:19:15.253209] [INFO ] [MAIN ] PAR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:15.253097] [INFO ] [MAIN ] PAM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:15.253267] [INFO ] [MAIN ] PARR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:15.272950] [DEBUG] [LOCAL ] PAM: Loaded 20264 existing records from primary storage. [2025-09-16T21:19:15.273145] [INFO ] [MAIN ] PAM: Loaded 20264 primary data records. [2025-09-16T21:19:15.407701] [DEBUG] [LOCAL ] PAR: Loaded 24137 existing records from primary storage. [2025-09-16T21:19:15.477328] [INFO ] [MAIN ] PAR: Loaded 24137 primary data records. [2025-09-16T21:19:15.428683] [DEBUG] [LOCAL ] PARR: Loaded 35926 existing records from primary storage. [2025-09-16T21:19:15.477546] [INFO ] [MAIN ] PARR: Loaded 35926 primary data records. [2025-09-16T21:19:16.129557] [DEBUG] [MAIN ] PAM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:16.130923] [INFO ] [MAIN ] PAM: Generated 1339 derivative records from 20264 primary records. [2025-09-16T21:19:16.131256] [DEBUG] [LOCAL ] PAM: Saving derivative data. [2025-09-16T21:19:16.149342] [DEBUG] [LOCAL ] PAM: Derivative data saved (1339 records). [2025-09-16T21:19:16.165113] [INFO ] [MAIN ] PAM: Successfully saved derivative data. [2025-09-16T21:19:16.159294] [DEBUG] [MAIN ] PARR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:16.170158] [INFO ] [MAIN ] Derivative Progress: 1366/2026 symbols completed. PAM took 0.9s. Estimated remaining: 3m 35s. Rate: 184.4 symbols/min [2025-09-16T21:19:16.170447] [INFO ] [MAIN ] PATH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:16.171811] [DEBUG] [MAIN ] PAR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:16.171459] [INFO ] [MAIN ] PARR: Generated 1339 derivative records from 35926 primary records. [2025-09-16T21:19:16.172685] [INFO ] [MAIN ] PAR: Generated 1339 derivative records from 24137 primary records. [2025-09-16T21:19:16.172810] [DEBUG] [LOCAL ] PARR: Saving derivative data. [2025-09-16T21:19:16.173068] [DEBUG] [LOCAL ] PAR: Saving derivative data. [2025-09-16T21:19:16.186504] [DEBUG] [LOCAL ] PARR: Derivative data saved (1339 records). [2025-09-16T21:19:16.195089] [INFO ] [MAIN ] PARR: Successfully saved derivative data. [2025-09-16T21:19:16.199482] [INFO ] [MAIN ] Derivative Progress: 1367/2026 symbols completed. PARR took 0.9s. Estimated remaining: 3m 34s. Rate: 184.6 symbols/min [2025-09-16T21:19:16.200767] [DEBUG] [LOCAL ] PAR: Derivative data saved (1339 records). [2025-09-16T21:19:16.201224] [INFO ] [MAIN ] PAR: Successfully saved derivative data. [2025-09-16T21:19:16.201143] [INFO ] [MAIN ] PAXS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:16.203471] [INFO ] [MAIN ] Derivative Progress: 1368/2026 symbols completed. PAR took 1.0s. Estimated remaining: 3m 34s. Rate: 184.7 symbols/min [2025-09-16T21:19:16.204177] [INFO ] [MAIN ] PAY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:16.239754] [DEBUG] [LOCAL ] PAXS: Loaded 15865 existing records from primary storage. [2025-09-16T21:19:16.239929] [INFO ] [MAIN ] PAXS: Loaded 15865 primary data records. [2025-09-16T21:19:16.338303] [DEBUG] [LOCAL ] PAY: Loaded 28642 existing records from primary storage. [2025-09-16T21:19:16.349629] [DEBUG] [LOCAL ] PATH: Loaded 40034 existing records from primary storage. [2025-09-16T21:19:16.366169] [INFO ] [MAIN ] PATH: Loaded 40034 primary data records. [2025-09-16T21:19:16.366111] [INFO ] [MAIN ] PAY: Loaded 28642 primary data records. [2025-09-16T21:19:17.124095] [DEBUG] [MAIN ] PAXS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:17.125181] [INFO ] [MAIN ] PAXS: Generated 1339 derivative records from 15865 primary records. [2025-09-16T21:19:17.125482] [DEBUG] [LOCAL ] PAXS: Saving derivative data. [2025-09-16T21:19:17.150303] [DEBUG] [MAIN ] PAY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:17.161560] [DEBUG] [LOCAL ] PAXS: Derivative data saved (1339 records). [2025-09-16T21:19:17.162660] [DEBUG] [MAIN ] PATH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:17.161689] [INFO ] [MAIN ] PAXS: Successfully saved derivative data. [2025-09-16T21:19:17.162487] [INFO ] [MAIN ] PAY: Generated 1339 derivative records from 28642 primary records. [2025-09-16T21:19:17.164721] [INFO ] [MAIN ] Derivative Progress: 1369/2026 symbols completed. PAXS took 1.0s. Estimated remaining: 3m 34s. Rate: 184.4 symbols/min [2025-09-16T21:19:17.163249] [INFO ] [MAIN ] PATH: Generated 1339 derivative records from 40034 primary records. [2025-09-16T21:19:17.165049] [DEBUG] [LOCAL ] PATH: Saving derivative data. [2025-09-16T21:19:17.164993] [INFO ] [MAIN ] PAYC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:17.164950] [DEBUG] [LOCAL ] PAY: Saving derivative data. [2025-09-16T21:19:17.188713] [DEBUG] [LOCAL ] PATH: Derivative data saved (1339 records). [2025-09-16T21:19:17.189575] [INFO ] [MAIN ] PATH: Successfully saved derivative data. [2025-09-16T21:19:17.192171] [INFO ] [MAIN ] Derivative Progress: 1370/2026 symbols completed. PATH took 1.0s. Estimated remaining: 3m 33s. Rate: 184.6 symbols/min [2025-09-16T21:19:17.193982] [INFO ] [MAIN ] PB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:17.194444] [DEBUG] [LOCAL ] PAY: Derivative data saved (1339 records). [2025-09-16T21:19:17.194523] [INFO ] [MAIN ] PAY: Successfully saved derivative data. [2025-09-16T21:19:17.196826] [INFO ] [MAIN ] Derivative Progress: 1371/2026 symbols completed. PAY took 1.0s. Estimated remaining: 3m 33s. Rate: 184.7 symbols/min [2025-09-16T21:19:17.197210] [INFO ] [MAIN ] PBA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:17.232542] [DEBUG] [LOCAL ] PAYC: Loaded 26339 existing records from primary storage. [2025-09-16T21:19:17.241138] [INFO ] [MAIN ] PAYC: Loaded 26339 primary data records. [2025-09-16T21:19:17.269472] [DEBUG] [LOCAL ] PB: Loaded 31070 existing records from primary storage. [2025-09-16T21:19:17.302115] [INFO ] [MAIN ] PB: Loaded 31070 primary data records. [2025-09-16T21:19:17.468908] [DEBUG] [LOCAL ] PBA: Loaded 36557 existing records from primary storage. [2025-09-16T21:19:17.479378] [INFO ] [MAIN ] PBA: Loaded 36557 primary data records. [2025-09-16T21:19:18.118814] [DEBUG] [MAIN ] PAYC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:18.120404] [INFO ] [MAIN ] PAYC: Generated 1339 derivative records from 26339 primary records. [2025-09-16T21:19:18.121053] [DEBUG] [LOCAL ] PAYC: Saving derivative data. [2025-09-16T21:19:18.141219] [DEBUG] [MAIN ] PB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:18.142959] [INFO ] [MAIN ] PB: Generated 1339 derivative records from 31070 primary records. [2025-09-16T21:19:18.145824] [DEBUG] [LOCAL ] PAYC: Derivative data saved (1339 records). [2025-09-16T21:19:18.145894] [DEBUG] [LOCAL ] PB: Saving derivative data. [2025-09-16T21:19:18.147484] [INFO ] [MAIN ] PAYC: Successfully saved derivative data. [2025-09-16T21:19:18.150271] [INFO ] [MAIN ] Derivative Progress: 1372/2026 symbols completed. PAYC took 1.0s. Estimated remaining: 3m 33s. Rate: 184.4 symbols/min [2025-09-16T21:19:18.163265] [INFO ] [MAIN ] PBF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:18.169034] [DEBUG] [LOCAL ] PB: Derivative data saved (1339 records). [2025-09-16T21:19:18.173261] [INFO ] [MAIN ] PB: Successfully saved derivative data. [2025-09-16T21:19:18.173523] [DEBUG] [MAIN ] PBA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:18.176633] [INFO ] [MAIN ] PBA: Generated 1339 derivative records from 36557 primary records. [2025-09-16T21:19:18.175899] [INFO ] [MAIN ] Derivative Progress: 1373/2026 symbols completed. PB took 1.0s. Estimated remaining: 3m 32s. Rate: 184.6 symbols/min [2025-09-16T21:19:18.177034] [INFO ] [MAIN ] PBH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:18.176857] [DEBUG] [LOCAL ] PBA: Saving derivative data. [2025-09-16T21:19:18.196101] [DEBUG] [LOCAL ] PBA: Derivative data saved (1339 records). [2025-09-16T21:19:18.196307] [INFO ] [MAIN ] PBA: Successfully saved derivative data. [2025-09-16T21:19:18.198462] [INFO ] [MAIN ] Derivative Progress: 1374/2026 symbols completed. PBA took 1.0s. Estimated remaining: 3m 32s. Rate: 184.7 symbols/min [2025-09-16T21:19:18.198911] [INFO ] [MAIN ] PBI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:18.224511] [DEBUG] [LOCAL ] PBH: Loaded 23938 existing records from primary storage. [2025-09-16T21:19:18.224727] [INFO ] [MAIN ] PBH: Loaded 23938 primary data records. [2025-09-16T21:19:18.353160] [DEBUG] [LOCAL ] PBF: Loaded 39624 existing records from primary storage. [2025-09-16T21:19:18.384871] [INFO ] [MAIN ] PBF: Loaded 39624 primary data records. [2025-09-16T21:19:18.390614] [DEBUG] [LOCAL ] PBI: Loaded 37127 existing records from primary storage. [2025-09-16T21:19:18.413045] [INFO ] [MAIN ] PBI: Loaded 37127 primary data records. [2025-09-16T21:19:19.134751] [DEBUG] [MAIN ] PBH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:19.136140] [INFO ] [MAIN ] PBH: Generated 1339 derivative records from 23938 primary records. [2025-09-16T21:19:19.136463] [DEBUG] [LOCAL ] PBH: Saving derivative data. [2025-09-16T21:19:19.151452] [DEBUG] [LOCAL ] PBH: Derivative data saved (1339 records). [2025-09-16T21:19:19.151900] [INFO ] [MAIN ] PBH: Successfully saved derivative data. [2025-09-16T21:19:19.153328] [INFO ] [MAIN ] Derivative Progress: 1375/2026 symbols completed. PBH took 1.0s. Estimated remaining: 3m 32s. Rate: 184.4 symbols/min [2025-09-16T21:19:19.153902] [INFO ] [MAIN ] PBR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:19.168221] [DEBUG] [MAIN ] PBF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:19.170154] [INFO ] [MAIN ] PBF: Generated 1339 derivative records from 39624 primary records. [2025-09-16T21:19:19.170481] [DEBUG] [LOCAL ] PBF: Saving derivative data. [2025-09-16T21:19:19.190166] [DEBUG] [MAIN ] PBI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:19.191575] [INFO ] [MAIN ] PBI: Generated 1339 derivative records from 37127 primary records. [2025-09-16T21:19:19.191914] [DEBUG] [LOCAL ] PBI: Saving derivative data. [2025-09-16T21:19:19.205482] [DEBUG] [LOCAL ] PBF: Derivative data saved (1339 records). [2025-09-16T21:19:19.206542] [INFO ] [MAIN ] PBF: Successfully saved derivative data. [2025-09-16T21:19:19.209688] [INFO ] [MAIN ] Derivative Progress: 1376/2026 symbols completed. PBF took 1.1s. Estimated remaining: 3m 31s. Rate: 184.5 symbols/min [2025-09-16T21:19:19.210501] [DEBUG] [LOCAL ] PBI: Derivative data saved (1339 records). [2025-09-16T21:19:19.210604] [INFO ] [MAIN ] PBT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:19.219829] [INFO ] [MAIN ] PBI: Successfully saved derivative data. [2025-09-16T21:19:19.222146] [INFO ] [MAIN ] Derivative Progress: 1377/2026 symbols completed. PBI took 1.0s. Estimated remaining: 3m 31s. Rate: 184.7 symbols/min [2025-09-16T21:19:19.222690] [INFO ] [MAIN ] PCF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:19.241667] [DEBUG] [LOCAL ] PBR: Loaded 40068 existing records from primary storage. [2025-09-16T21:19:19.241841] [INFO ] [MAIN ] PBR: Loaded 40068 primary data records. [2025-09-16T21:19:19.260293] [DEBUG] [LOCAL ] PCF: Loaded 6580 existing records from primary storage. [2025-09-16T21:19:19.281197] [INFO ] [MAIN ] PCF: Loaded 6580 primary data records. [2025-09-16T21:19:19.462188] [DEBUG] [LOCAL ] PBT: Loaded 13404 existing records from primary storage. [2025-09-16T21:19:19.467487] [INFO ] [MAIN ] PBT: Loaded 13404 primary data records. [2025-09-16T21:19:20.121582] [DEBUG] [MAIN ] PCF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:20.122612] [INFO ] [MAIN ] PCF: Generated 1339 derivative records from 6580 primary records. [2025-09-16T21:19:20.122716] [DEBUG] [LOCAL ] PCF: Saving derivative data. [2025-09-16T21:19:20.149060] [DEBUG] [MAIN ] PBR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:20.153952] [INFO ] [MAIN ] PBR: Generated 1339 derivative records from 40068 primary records. [2025-09-16T21:19:20.154405] [DEBUG] [LOCAL ] PCF: Derivative data saved (1339 records). [2025-09-16T21:19:20.154727] [DEBUG] [LOCAL ] PBR: Saving derivative data. [2025-09-16T21:19:20.155940] [INFO ] [MAIN ] PCF: Successfully saved derivative data. [2025-09-16T21:19:20.157950] [INFO ] [MAIN ] Derivative Progress: 1378/2026 symbols completed. PCF took 0.9s. Estimated remaining: 3m 31s. Rate: 184.4 symbols/min [2025-09-16T21:19:20.180087] [DEBUG] [LOCAL ] PBR: Derivative data saved (1339 records). [2025-09-16T21:19:20.180384] [DEBUG] [MAIN ] PBT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:20.180532] [INFO ] [MAIN ] PBR: Successfully saved derivative data. [2025-09-16T21:19:20.183046] [INFO ] [MAIN ] Derivative Progress: 1379/2026 symbols completed. PBR took 1.0s. Estimated remaining: 3m 30s. Rate: 184.5 symbols/min [2025-09-16T21:19:20.183986] [INFO ] [MAIN ] PBT: Generated 1339 derivative records from 13404 primary records. [2025-09-16T21:19:20.184185] [DEBUG] [LOCAL ] PBT: Saving derivative data. [2025-09-16T21:19:20.196194] [DEBUG] [LOCAL ] PBT: Derivative data saved (1339 records). [2025-09-16T21:19:20.196254] [INFO ] [MAIN ] PBT: Successfully saved derivative data. [2025-09-16T21:19:20.198418] [INFO ] [MAIN ] Derivative Progress: 1380/2026 symbols completed. PBT took 1.0s. Estimated remaining: 3m 30s. Rate: 184.7 symbols/min [2025-09-16T21:19:20.199016] [INFO ] [MAIN ] PCG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:20.199154] [INFO ] [MAIN ] PCN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:20.199315] [INFO ] [MAIN ] PCM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:20.210963] [DEBUG] [LOCAL ] PCM: Loaded 4972 existing records from primary storage. [2025-09-16T21:19:20.211235] [INFO ] [MAIN ] PCM: Loaded 4972 primary data records. [2025-09-16T21:19:20.329656] [DEBUG] [LOCAL ] PCN: Loaded 18268 existing records from primary storage. [2025-09-16T21:19:20.329844] [INFO ] [MAIN ] PCN: Loaded 18268 primary data records. [2025-09-16T21:19:20.533156] [DEBUG] [LOCAL ] PCG: Loaded 40069 existing records from primary storage. [2025-09-16T21:19:20.621014] [INFO ] [MAIN ] PCG: Loaded 40069 primary data records. [2025-09-16T21:19:21.080261] [DEBUG] [MAIN ] PCM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:21.082201] [INFO ] [MAIN ] PCM: Generated 1339 derivative records from 4972 primary records. [2025-09-16T21:19:21.082445] [DEBUG] [LOCAL ] PCM: Saving derivative data. [2025-09-16T21:19:21.105924] [DEBUG] [LOCAL ] PCM: Derivative data saved (1339 records). [2025-09-16T21:19:21.106436] [INFO ] [MAIN ] PCM: Successfully saved derivative data. [2025-09-16T21:19:21.106263] [DEBUG] [MAIN ] PCN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:21.108037] [INFO ] [MAIN ] Derivative Progress: 1381/2026 symbols completed. PCM took 0.9s. Estimated remaining: 3m 30s. Rate: 184.4 symbols/min [2025-09-16T21:19:21.108249] [INFO ] [MAIN ] PCOR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:21.108988] [INFO ] [MAIN ] PCN: Generated 1339 derivative records from 18268 primary records. [2025-09-16T21:19:21.109483] [DEBUG] [LOCAL ] PCN: Saving derivative data. [2025-09-16T21:19:21.123116] [DEBUG] [LOCAL ] PCN: Derivative data saved (1339 records). [2025-09-16T21:19:21.124193] [INFO ] [MAIN ] PCN: Successfully saved derivative data. [2025-09-16T21:19:21.127324] [INFO ] [MAIN ] Derivative Progress: 1382/2026 symbols completed. PCN took 0.9s. Estimated remaining: 3m 29s. Rate: 184.5 symbols/min [2025-09-16T21:19:21.128362] [INFO ] [MAIN ] PCQ: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:21.141565] [DEBUG] [MAIN ] PCG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:21.142331] [INFO ] [MAIN ] PCG: Generated 1339 derivative records from 40069 primary records. [2025-09-16T21:19:21.142454] [DEBUG] [LOCAL ] PCG: Saving derivative data. [2025-09-16T21:19:21.165812] [DEBUG] [LOCAL ] PCG: Derivative data saved (1339 records). [2025-09-16T21:19:21.170014] [INFO ] [MAIN ] PCG: Successfully saved derivative data. [2025-09-16T21:19:21.172125] [INFO ] [MAIN ] Derivative Progress: 1383/2026 symbols completed. PCG took 1.0s. Estimated remaining: 3m 29s. Rate: 184.7 symbols/min [2025-09-16T21:19:21.172771] [INFO ] [MAIN ] PD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:21.172473] [DEBUG] [LOCAL ] PCQ: Loaded 8657 existing records from primary storage. [2025-09-16T21:19:21.173239] [INFO ] [MAIN ] PCQ: Loaded 8657 primary data records. [2025-09-16T21:19:21.286779] [DEBUG] [LOCAL ] PCOR: Loaded 35516 existing records from primary storage. [2025-09-16T21:19:21.297715] [INFO ] [MAIN ] PCOR: Loaded 35516 primary data records. [2025-09-16T21:19:21.680515] [DEBUG] [LOCAL ] PD: Loaded 35634 existing records from primary storage. [2025-09-16T21:19:21.768921] [INFO ] [MAIN ] PD: Loaded 35634 primary data records. [2025-09-16T21:19:22.060618] [DEBUG] [MAIN ] PCQ: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:22.063239] [INFO ] [MAIN ] PCQ: Generated 1339 derivative records from 8657 primary records. [2025-09-16T21:19:22.063413] [DEBUG] [LOCAL ] PCQ: Saving derivative data. [2025-09-16T21:19:22.075922] [DEBUG] [MAIN ] PCOR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:22.086524] [INFO ] [MAIN ] PCOR: Generated 1339 derivative records from 35516 primary records. [2025-09-16T21:19:22.088282] [DEBUG] [LOCAL ] PCQ: Derivative data saved (1339 records). [2025-09-16T21:19:22.088550] [DEBUG] [LOCAL ] PCOR: Saving derivative data. [2025-09-16T21:19:22.088489] [INFO ] [MAIN ] PCQ: Successfully saved derivative data. [2025-09-16T21:19:22.090559] [INFO ] [MAIN ] Derivative Progress: 1384/2026 symbols completed. PCQ took 1.0s. Estimated remaining: 3m 29s. Rate: 184.4 symbols/min [2025-09-16T21:19:22.091278] [INFO ] [MAIN ] PDI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:22.104189] [DEBUG] [LOCAL ] PCOR: Derivative data saved (1339 records). [2025-09-16T21:19:22.104336] [INFO ] [MAIN ] PCOR: Successfully saved derivative data. [2025-09-16T21:19:22.106397] [INFO ] [MAIN ] Derivative Progress: 1385/2026 symbols completed. PCOR took 1.0s. Estimated remaining: 3m 28s. Rate: 184.5 symbols/min [2025-09-16T21:19:22.106709] [INFO ] [MAIN ] PDM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:22.119471] [DEBUG] [MAIN ] PD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:22.120191] [INFO ] [MAIN ] PD: Generated 1339 derivative records from 35634 primary records. [2025-09-16T21:19:22.120298] [DEBUG] [LOCAL ] PD: Saving derivative data. [2025-09-16T21:19:22.133280] [DEBUG] [LOCAL ] PD: Derivative data saved (1339 records). [2025-09-16T21:19:22.148759] [INFO ] [MAIN ] PD: Successfully saved derivative data. [2025-09-16T21:19:22.150872] [INFO ] [MAIN ] Derivative Progress: 1386/2026 symbols completed. PD took 1.0s. Estimated remaining: 3m 28s. Rate: 184.7 symbols/min [2025-09-16T21:19:22.151060] [INFO ] [MAIN ] PDO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:22.164127] [DEBUG] [LOCAL ] PDM: Loaded 29341 existing records from primary storage. [2025-09-16T21:19:22.173933] [INFO ] [MAIN ] PDM: Loaded 29341 primary data records. [2025-09-16T21:19:22.239106] [DEBUG] [LOCAL ] PDI: Loaded 37200 existing records from primary storage. [2025-09-16T21:19:22.283555] [INFO ] [MAIN ] PDI: Loaded 37200 primary data records. [2025-09-16T21:19:22.409962] [DEBUG] [LOCAL ] PDO: Loaded 22731 existing records from primary storage. [2025-09-16T21:19:22.423711] [INFO ] [MAIN ] PDO: Loaded 22731 primary data records. [2025-09-16T21:19:23.017796] [DEBUG] [MAIN ] PDM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:23.018999] [INFO ] [MAIN ] PDM: Generated 1339 derivative records from 29341 primary records. [2025-09-16T21:19:23.019291] [DEBUG] [LOCAL ] PDM: Saving derivative data. [2025-09-16T21:19:23.034927] [DEBUG] [MAIN ] PDI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:23.038710] [INFO ] [MAIN ] PDI: Generated 1339 derivative records from 37200 primary records. [2025-09-16T21:19:23.039857] [DEBUG] [LOCAL ] PDI: Saving derivative data. [2025-09-16T21:19:23.042380] [DEBUG] [LOCAL ] PDM: Derivative data saved (1339 records). [2025-09-16T21:19:23.042465] [INFO ] [MAIN ] PDM: Successfully saved derivative data. [2025-09-16T21:19:23.044146] [INFO ] [MAIN ] Derivative Progress: 1387/2026 symbols completed. PDM took 0.9s. Estimated remaining: 3m 28s. Rate: 184.4 symbols/min [2025-09-16T21:19:23.044740] [INFO ] [MAIN ] PDS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:23.064672] [DEBUG] [LOCAL ] PDI: Derivative data saved (1339 records). [2025-09-16T21:19:23.070853] [INFO ] [MAIN ] PDI: Successfully saved derivative data. [2025-09-16T21:19:23.071170] [DEBUG] [MAIN ] PDO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:23.073486] [INFO ] [MAIN ] Derivative Progress: 1388/2026 symbols completed. PDI took 1.0s. Estimated remaining: 3m 27s. Rate: 184.6 symbols/min [2025-09-16T21:19:23.074353] [INFO ] [MAIN ] PDO: Generated 1339 derivative records from 22731 primary records. [2025-09-16T21:19:23.074668] [DEBUG] [LOCAL ] PDO: Saving derivative data. [2025-09-16T21:19:23.074725] [INFO ] [MAIN ] PDT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:23.081378] [DEBUG] [LOCAL ] PDS: Loaded 12219 existing records from primary storage. [2025-09-16T21:19:23.090141] [INFO ] [MAIN ] PDS: Loaded 12219 primary data records. [2025-09-16T21:19:23.113766] [DEBUG] [LOCAL ] PDO: Derivative data saved (1339 records). [2025-09-16T21:19:23.114020] [INFO ] [MAIN ] PDO: Successfully saved derivative data. [2025-09-16T21:19:23.131675] [INFO ] [MAIN ] Derivative Progress: 1389/2026 symbols completed. PDO took 1.0s. Estimated remaining: 3m 27s. Rate: 184.7 symbols/min [2025-09-16T21:19:23.180430] [INFO ] [MAIN ] PDX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:23.207935] [DEBUG] [LOCAL ] PDT: Loaded 12983 existing records from primary storage. [2025-09-16T21:19:23.219031] [INFO ] [MAIN ] PDT: Loaded 12983 primary data records. [2025-09-16T21:19:23.335275] [DEBUG] [LOCAL ] PDX: Loaded 10487 existing records from primary storage. [2025-09-16T21:19:23.461355] [INFO ] [MAIN ] PDX: Loaded 10487 primary data records. [2025-09-16T21:19:23.978147] [DEBUG] [MAIN ] PDS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:23.979763] [INFO ] [MAIN ] PDS: Generated 1339 derivative records from 12219 primary records. [2025-09-16T21:19:23.979922] [DEBUG] [LOCAL ] PDS: Saving derivative data. [2025-09-16T21:19:23.999255] [DEBUG] [MAIN ] PDT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:24.003175] [INFO ] [MAIN ] PDT: Generated 1339 derivative records from 12983 primary records. [2025-09-16T21:19:24.003271] [DEBUG] [LOCAL ] PDT: Saving derivative data. [2025-09-16T21:19:24.002420] [DEBUG] [LOCAL ] PDS: Derivative data saved (1339 records). [2025-09-16T21:19:24.004286] [INFO ] [MAIN ] PDS: Successfully saved derivative data. [2025-09-16T21:19:24.006264] [INFO ] [MAIN ] Derivative Progress: 1390/2026 symbols completed. PDS took 1.0s. Estimated remaining: 3m 27s. Rate: 184.4 symbols/min [2025-09-16T21:19:24.015123] [INFO ] [MAIN ] PEB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:24.019208] [DEBUG] [LOCAL ] PDT: Derivative data saved (1339 records). [2025-09-16T21:19:24.020231] [INFO ] [MAIN ] PDT: Successfully saved derivative data. [2025-09-16T21:19:24.023763] [INFO ] [MAIN ] Derivative Progress: 1391/2026 symbols completed. PDT took 1.0s. Estimated remaining: 3m 26s. Rate: 184.6 symbols/min [2025-09-16T21:19:24.023985] [INFO ] [MAIN ] PEG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:24.034823] [DEBUG] [MAIN ] PDX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:24.035458] [INFO ] [MAIN ] PDX: Generated 1339 derivative records from 10487 primary records. [2025-09-16T21:19:24.035576] [DEBUG] [LOCAL ] PDX: Saving derivative data. [2025-09-16T21:19:24.048246] [DEBUG] [LOCAL ] PDX: Derivative data saved (1339 records). [2025-09-16T21:19:24.048352] [INFO ] [MAIN ] PDX: Successfully saved derivative data. [2025-09-16T21:19:24.050522] [INFO ] [MAIN ] Derivative Progress: 1392/2026 symbols completed. PDX took 0.9s. Estimated remaining: 3m 26s. Rate: 184.7 symbols/min [2025-09-16T21:19:24.053328] [INFO ] [MAIN ] PEN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:24.113511] [DEBUG] [LOCAL ] PEB: Loaded 37647 existing records from primary storage. [2025-09-16T21:19:24.113695] [DEBUG] [LOCAL ] PEN: Loaded 22527 existing records from primary storage. [2025-09-16T21:19:24.114441] [INFO ] [MAIN ] PEB: Loaded 37647 primary data records. [2025-09-16T21:19:24.113797] [INFO ] [MAIN ] PEN: Loaded 22527 primary data records. [2025-09-16T21:19:24.114364] [DEBUG] [LOCAL ] PEG: Loaded 39629 existing records from primary storage. [2025-09-16T21:19:24.137387] [INFO ] [MAIN ] PEG: Loaded 39629 primary data records. [2025-09-16T21:19:24.961716] [DEBUG] [MAIN ] PEB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:24.973104] [INFO ] [MAIN ] PEB: Generated 1339 derivative records from 37647 primary records. [2025-09-16T21:19:24.973210] [DEBUG] [LOCAL ] PEB: Saving derivative data. [2025-09-16T21:19:24.978084] [DEBUG] [MAIN ] PEN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:24.972262] [DEBUG] [MAIN ] PEG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:24.984816] [INFO ] [MAIN ] PEN: Generated 1339 derivative records from 22527 primary records. [2025-09-16T21:19:24.985331] [INFO ] [MAIN ] PEG: Generated 1339 derivative records from 39629 primary records. [2025-09-16T21:19:24.988598] [DEBUG] [LOCAL ] PEG: Saving derivative data. [2025-09-16T21:19:24.992084] [DEBUG] [LOCAL ] PEB: Derivative data saved (1339 records). [2025-09-16T21:19:24.990278] [DEBUG] [LOCAL ] PEN: Saving derivative data. [2025-09-16T21:19:24.992701] [INFO ] [MAIN ] PEB: Successfully saved derivative data. [2025-09-16T21:19:24.994610] [INFO ] [MAIN ] Derivative Progress: 1393/2026 symbols completed. PEB took 1.0s. Estimated remaining: 3m 26s. Rate: 184.4 symbols/min [2025-09-16T21:19:25.015293] [DEBUG] [LOCAL ] PEG: Derivative data saved (1339 records). [2025-09-16T21:19:25.015881] [INFO ] [MAIN ] PEG: Successfully saved derivative data. [2025-09-16T21:19:25.018483] [INFO ] [MAIN ] Derivative Progress: 1394/2026 symbols completed. PEG took 1.0s. Estimated remaining: 3m 25s. Rate: 184.6 symbols/min [2025-09-16T21:19:25.020740] [DEBUG] [LOCAL ] PEN: Derivative data saved (1339 records). [2025-09-16T21:19:25.020813] [INFO ] [MAIN ] PEN: Successfully saved derivative data. [2025-09-16T21:19:25.022788] [INFO ] [MAIN ] Derivative Progress: 1395/2026 symbols completed. PEN took 1.0s. Estimated remaining: 3m 25s. Rate: 184.7 symbols/min [2025-09-16T21:19:25.023456] [INFO ] [MAIN ] PEO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:25.024200] [INFO ] [MAIN ] PERF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:25.023621] [INFO ] [MAIN ] PFD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:25.037447] [DEBUG] [LOCAL ] PEO: Loaded 8035 existing records from primary storage. [2025-09-16T21:19:25.040778] [INFO ] [MAIN ] PEO: Loaded 8035 primary data records. [2025-09-16T21:19:25.065709] [DEBUG] [LOCAL ] PFD: Loaded 3849 existing records from primary storage. [2025-09-16T21:19:25.086329] [DEBUG] [LOCAL ] PERF: Loaded 11407 existing records from primary storage. [2025-09-16T21:19:25.105441] [INFO ] [MAIN ] PFD: Loaded 3849 primary data records. [2025-09-16T21:19:25.119529] [INFO ] [MAIN ] PERF: Loaded 11407 primary data records. [2025-09-16T21:19:25.941716] [DEBUG] [MAIN ] PEO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:25.942635] [INFO ] [MAIN ] PEO: Generated 1339 derivative records from 8035 primary records. [2025-09-16T21:19:25.943134] [DEBUG] [LOCAL ] PEO: Saving derivative data. [2025-09-16T21:19:25.956953] [DEBUG] [LOCAL ] PEO: Derivative data saved (1339 records). [2025-09-16T21:19:25.957739] [INFO ] [MAIN ] PEO: Successfully saved derivative data. [2025-09-16T21:19:25.959410] [INFO ] [MAIN ] Derivative Progress: 1396/2026 symbols completed. PEO took 0.9s. Estimated remaining: 3m 25s. Rate: 184.4 symbols/min [2025-09-16T21:19:25.960325] [INFO ] [MAIN ] PFE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:25.972457] [DEBUG] [MAIN ] PFD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:25.973345] [INFO ] [MAIN ] PFD: Generated 1339 derivative records from 3849 primary records. [2025-09-16T21:19:25.979297] [DEBUG] [LOCAL ] PFD: Saving derivative data. [2025-09-16T21:19:25.984231] [DEBUG] [MAIN ] PERF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:25.992858] [INFO ] [MAIN ] PERF: Generated 1339 derivative records from 11407 primary records. [2025-09-16T21:19:25.993655] [DEBUG] [LOCAL ] PERF: Saving derivative data. [2025-09-16T21:19:26.007710] [DEBUG] [LOCAL ] PERF: Derivative data saved (1339 records). [2025-09-16T21:19:26.008514] [DEBUG] [LOCAL ] PFD: Derivative data saved (1339 records). [2025-09-16T21:19:26.008618] [INFO ] [MAIN ] PFD: Successfully saved derivative data. [2025-09-16T21:19:26.010737] [INFO ] [MAIN ] Derivative Progress: 1397/2026 symbols completed. PFD took 1.0s. Estimated remaining: 3m 25s. Rate: 184.5 symbols/min [2025-09-16T21:19:26.010855] [INFO ] [MAIN ] PERF: Successfully saved derivative data. [2025-09-16T21:19:26.013338] [INFO ] [MAIN ] PFGC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:26.013391] [INFO ] [MAIN ] Derivative Progress: 1398/2026 symbols completed. PERF took 1.0s. Estimated remaining: 3m 24s. Rate: 184.7 symbols/min [2025-09-16T21:19:26.014051] [INFO ] [MAIN ] PFH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:26.035754] [DEBUG] [LOCAL ] PFH: Loaded 5118 existing records from primary storage. [2025-09-16T21:19:26.035900] [INFO ] [MAIN ] PFH: Loaded 5118 primary data records. [2025-09-16T21:19:26.151318] [DEBUG] [LOCAL ] PFE: Loaded 40163 existing records from primary storage. [2025-09-16T21:19:26.162224] [INFO ] [MAIN ] PFE: Loaded 40163 primary data records. [2025-09-16T21:19:26.433204] [DEBUG] [LOCAL ] PFGC: Loaded 35322 existing records from primary storage. [2025-09-16T21:19:26.439341] [INFO ] [MAIN ] PFGC: Loaded 35322 primary data records. [2025-09-16T21:19:26.892563] [DEBUG] [MAIN ] PFH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:26.893846] [INFO ] [MAIN ] PFH: Generated 1339 derivative records from 5118 primary records. [2025-09-16T21:19:26.894328] [DEBUG] [LOCAL ] PFH: Saving derivative data. [2025-09-16T21:19:26.918422] [DEBUG] [MAIN ] PFE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:26.919879] [INFO ] [MAIN ] PFE: Generated 1339 derivative records from 40163 primary records. [2025-09-16T21:19:26.920241] [DEBUG] [LOCAL ] PFE: Saving derivative data. [2025-09-16T21:19:26.921725] [DEBUG] [LOCAL ] PFH: Derivative data saved (1339 records). [2025-09-16T21:19:26.921994] [INFO ] [MAIN ] PFH: Successfully saved derivative data. [2025-09-16T21:19:26.923833] [INFO ] [MAIN ] Derivative Progress: 1399/2026 symbols completed. PFH took 0.9s. Estimated remaining: 3m 24s. Rate: 184.4 symbols/min [2025-09-16T21:19:26.932848] [INFO ] [MAIN ] PFL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:26.936475] [DEBUG] [LOCAL ] PFE: Derivative data saved (1339 records). [2025-09-16T21:19:26.936763] [INFO ] [MAIN ] PFE: Successfully saved derivative data. [2025-09-16T21:19:26.939123] [INFO ] [MAIN ] Derivative Progress: 1400/2026 symbols completed. PFE took 1.0s. Estimated remaining: 3m 24s. Rate: 184.6 symbols/min [2025-09-16T21:19:26.940300] [INFO ] [MAIN ] PFLT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:26.955936] [DEBUG] [MAIN ] PFGC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:26.956667] [INFO ] [MAIN ] PFGC: Generated 1339 derivative records from 35322 primary records. [2025-09-16T21:19:26.956798] [DEBUG] [LOCAL ] PFGC: Saving derivative data. [2025-09-16T21:19:26.961409] [DEBUG] [LOCAL ] PFL: Loaded 9789 existing records from primary storage. [2025-09-16T21:19:26.961688] [INFO ] [MAIN ] PFL: Loaded 9789 primary data records. [2025-09-16T21:19:27.088737] [DEBUG] [LOCAL ] PFGC: Derivative data saved (1339 records). [2025-09-16T21:19:27.088867] [INFO ] [MAIN ] PFGC: Successfully saved derivative data. [2025-09-16T21:19:27.091248] [INFO ] [MAIN ] Derivative Progress: 1401/2026 symbols completed. PFGC took 1.1s. Estimated remaining: 3m 23s. Rate: 184.6 symbols/min [2025-09-16T21:19:27.112981] [INFO ] [MAIN ] PFN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:27.267959] [DEBUG] [LOCAL ] PFLT: Loaded 31693 existing records from primary storage. [2025-09-16T21:19:27.268355] [INFO ] [MAIN ] PFLT: Loaded 31693 primary data records. [2025-09-16T21:19:27.389064] [DEBUG] [LOCAL ] PFN: Loaded 15615 existing records from primary storage. [2025-09-16T21:19:27.431417] [INFO ] [MAIN ] PFN: Loaded 15615 primary data records. [2025-09-16T21:19:27.841324] [DEBUG] [MAIN ] PFL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:27.842987] [INFO ] [MAIN ] PFL: Generated 1339 derivative records from 9789 primary records. [2025-09-16T21:19:27.843674] [DEBUG] [LOCAL ] PFL: Saving derivative data. [2025-09-16T21:19:27.858308] [DEBUG] [LOCAL ] PFL: Derivative data saved (1339 records). [2025-09-16T21:19:27.858633] [INFO ] [MAIN ] PFL: Successfully saved derivative data. [2025-09-16T21:19:27.860247] [INFO ] [MAIN ] Derivative Progress: 1402/2026 symbols completed. PFL took 0.9s. Estimated remaining: 3m 23s. Rate: 184.5 symbols/min [2025-09-16T21:19:27.860575] [INFO ] [MAIN ] PFO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:27.869465] [DEBUG] [LOCAL ] PFO: Loaded 4550 existing records from primary storage. [2025-09-16T21:19:27.875737] [INFO ] [MAIN ] PFO: Loaded 4550 primary data records. [2025-09-16T21:19:27.891082] [DEBUG] [MAIN ] PFLT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:27.923846] [INFO ] [MAIN ] PFLT: Generated 1339 derivative records from 31693 primary records. [2025-09-16T21:19:27.951834] [DEBUG] [LOCAL ] PFLT: Saving derivative data. [2025-09-16T21:19:28.016542] [DEBUG] [MAIN ] PFN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:28.028380] [INFO ] [MAIN ] PFN: Generated 1339 derivative records from 15615 primary records. [2025-09-16T21:19:28.049343] [DEBUG] [LOCAL ] PFN: Saving derivative data. [2025-09-16T21:19:28.050803] [DEBUG] [LOCAL ] PFLT: Derivative data saved (1339 records). [2025-09-16T21:19:28.051204] [INFO ] [MAIN ] PFLT: Successfully saved derivative data. [2025-09-16T21:19:28.068366] [INFO ] [MAIN ] Derivative Progress: 1403/2026 symbols completed. PFLT took 1.1s. Estimated remaining: 3m 23s. Rate: 184.5 symbols/min [2025-09-16T21:19:28.091868] [INFO ] [MAIN ] PFS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:28.219589] [DEBUG] [LOCAL ] PFN: Derivative data saved (1339 records). [2025-09-16T21:19:28.226096] [INFO ] [MAIN ] PFN: Successfully saved derivative data. [2025-09-16T21:19:28.228372] [INFO ] [MAIN ] Derivative Progress: 1404/2026 symbols completed. PFN took 1.1s. Estimated remaining: 3m 22s. Rate: 184.6 symbols/min [2025-09-16T21:19:28.228951] [INFO ] [MAIN ] PFSI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:28.257940] [DEBUG] [LOCAL ] PFS: Loaded 25628 existing records from primary storage. [2025-09-16T21:19:28.258275] [INFO ] [MAIN ] PFS: Loaded 25628 primary data records. [2025-09-16T21:19:28.328974] [DEBUG] [MAIN ] PFO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:28.366729] [INFO ] [MAIN ] PFO: Generated 1339 derivative records from 4550 primary records. [2025-09-16T21:19:28.385089] [DEBUG] [LOCAL ] PFSI: Loaded 20936 existing records from primary storage. [2025-09-16T21:19:28.385197] [DEBUG] [LOCAL ] PFO: Saving derivative data. [2025-09-16T21:19:28.396035] [INFO ] [MAIN ] PFSI: Loaded 20936 primary data records. [2025-09-16T21:19:28.536169] [DEBUG] [LOCAL ] PFO: Derivative data saved (1339 records). [2025-09-16T21:19:28.545035] [INFO ] [MAIN ] PFO: Successfully saved derivative data. [2025-09-16T21:19:28.552194] [INFO ] [MAIN ] Derivative Progress: 1405/2026 symbols completed. PFO took 0.7s. Estimated remaining: 3m 22s. Rate: 184.6 symbols/min [2025-09-16T21:19:28.558943] [INFO ] [MAIN ] PG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:28.866214] [DEBUG] [MAIN ] PFS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:28.867118] [INFO ] [MAIN ] PFS: Generated 1339 derivative records from 25628 primary records. [2025-09-16T21:19:28.868552] [DEBUG] [LOCAL ] PFS: Saving derivative data. [2025-09-16T21:19:28.900735] [DEBUG] [MAIN ] PFSI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:28.902298] [INFO ] [MAIN ] PFSI: Generated 1339 derivative records from 20936 primary records. [2025-09-16T21:19:28.902813] [DEBUG] [LOCAL ] PFSI: Saving derivative data. [2025-09-16T21:19:28.904607] [DEBUG] [LOCAL ] PG: Loaded 40104 existing records from primary storage. [2025-09-16T21:19:28.905831] [INFO ] [MAIN ] PG: Loaded 40104 primary data records. [2025-09-16T21:19:28.911448] [DEBUG] [LOCAL ] PFS: Derivative data saved (1339 records). [2025-09-16T21:19:28.938024] [DEBUG] [LOCAL ] PFSI: Derivative data saved (1339 records). [2025-09-16T21:19:28.938135] [INFO ] [MAIN ] PFSI: Successfully saved derivative data. [2025-09-16T21:19:28.940446] [INFO ] [MAIN ] Derivative Progress: 1406/2026 symbols completed. PFSI took 0.7s. Estimated remaining: 3m 22s. Rate: 184.5 symbols/min [2025-09-16T21:19:28.931702] [INFO ] [MAIN ] PFS: Successfully saved derivative data. [2025-09-16T21:19:28.942433] [INFO ] [MAIN ] Derivative Progress: 1407/2026 symbols completed. PFS took 0.9s. Estimated remaining: 3m 21s. Rate: 184.7 symbols/min [2025-09-16T21:19:28.942584] [INFO ] [MAIN ] PGP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:28.953087] [INFO ] [MAIN ] PGR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:29.029979] [DEBUG] [LOCAL ] PGP: Loaded 4027 existing records from primary storage. [2025-09-16T21:19:29.040862] [INFO ] [MAIN ] PGP: Loaded 4027 primary data records. [2025-09-16T21:19:29.402360] [DEBUG] [LOCAL ] PGR: Loaded 39425 existing records from primary storage. [2025-09-16T21:19:29.486352] [INFO ] [MAIN ] PGR: Loaded 39425 primary data records. [2025-09-16T21:19:29.760748] [DEBUG] [MAIN ] PG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:29.762080] [INFO ] [MAIN ] PG: Generated 1339 derivative records from 40104 primary records. [2025-09-16T21:19:29.762770] [DEBUG] [LOCAL ] PG: Saving derivative data. [2025-09-16T21:19:29.788596] [DEBUG] [LOCAL ] PG: Derivative data saved (1339 records). [2025-09-16T21:19:29.788792] [INFO ] [MAIN ] PG: Successfully saved derivative data. [2025-09-16T21:19:29.790889] [INFO ] [MAIN ] Derivative Progress: 1408/2026 symbols completed. PG took 1.2s. Estimated remaining: 3m 21s. Rate: 184.5 symbols/min [2025-09-16T21:19:29.788245] [DEBUG] [MAIN ] PGP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:29.792176] [INFO ] [MAIN ] PGP: Generated 1339 derivative records from 4027 primary records. [2025-09-16T21:19:29.792437] [DEBUG] [LOCAL ] PGP: Saving derivative data. [2025-09-16T21:19:29.805457] [DEBUG] [LOCAL ] PGP: Derivative data saved (1339 records). [2025-09-16T21:19:29.814446] [INFO ] [MAIN ] PGP: Successfully saved derivative data. [2025-09-16T21:19:29.816662] [INFO ] [MAIN ] Derivative Progress: 1409/2026 symbols completed. PGP took 0.9s. Estimated remaining: 3m 21s. Rate: 184.6 symbols/min [2025-09-16T21:19:29.814759] [DEBUG] [MAIN ] PGR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:29.817334] [INFO ] [MAIN ] PGR: Generated 1339 derivative records from 39425 primary records. [2025-09-16T21:19:29.817393] [DEBUG] [LOCAL ] PGR: Saving derivative data. [2025-09-16T21:19:29.829243] [DEBUG] [LOCAL ] PGR: Derivative data saved (1339 records). [2025-09-16T21:19:29.829300] [INFO ] [MAIN ] PGR: Successfully saved derivative data. [2025-09-16T21:19:29.831522] [INFO ] [MAIN ] Derivative Progress: 1410/2026 symbols completed. PGR took 0.9s. Estimated remaining: 3m 20s. Rate: 184.7 symbols/min [2025-09-16T21:19:29.831901] [INFO ] [MAIN ] PGRE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:29.832107] [INFO ] [MAIN ] PGZ: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:29.832064] [INFO ] [MAIN ] PH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:29.839079] [DEBUG] [LOCAL ] PGZ: Loaded 4157 existing records from primary storage. [2025-09-16T21:19:29.839231] [INFO ] [MAIN ] PGZ: Loaded 4157 primary data records. [2025-09-16T21:19:30.050528] [DEBUG] [LOCAL ] PH: Loaded 27760 existing records from primary storage. [2025-09-16T21:19:30.053764] [INFO ] [MAIN ] PH: Loaded 27760 primary data records. [2025-09-16T21:19:30.053702] [DEBUG] [LOCAL ] PGRE: Loaded 34845 existing records from primary storage. [2025-09-16T21:19:30.159193] [INFO ] [MAIN ] PGRE: Loaded 34845 primary data records. [2025-09-16T21:19:30.730700] [DEBUG] [MAIN ] PGZ: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:30.731834] [INFO ] [MAIN ] PGZ: Generated 1339 derivative records from 4157 primary records. [2025-09-16T21:19:30.732096] [DEBUG] [LOCAL ] PGZ: Saving derivative data. [2025-09-16T21:19:30.747423] [DEBUG] [LOCAL ] PGZ: Derivative data saved (1339 records). [2025-09-16T21:19:30.747887] [INFO ] [MAIN ] PGZ: Successfully saved derivative data. [2025-09-16T21:19:30.749583] [INFO ] [MAIN ] Derivative Progress: 1411/2026 symbols completed. PGZ took 0.9s. Estimated remaining: 3m 20s. Rate: 184.5 symbols/min [2025-09-16T21:19:30.750104] [INFO ] [MAIN ] PHD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:30.762154] [DEBUG] [LOCAL ] PHD: Loaded 6883 existing records from primary storage. [2025-09-16T21:19:30.781343] [INFO ] [MAIN ] PHD: Loaded 6883 primary data records. [2025-09-16T21:19:30.782055] [DEBUG] [MAIN ] PGRE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:30.781205] [DEBUG] [MAIN ] PH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:30.783429] [INFO ] [MAIN ] PH: Generated 1339 derivative records from 27760 primary records. [2025-09-16T21:19:30.782837] [INFO ] [MAIN ] PGRE: Generated 1339 derivative records from 34845 primary records. [2025-09-16T21:19:30.794597] [DEBUG] [LOCAL ] PH: Saving derivative data. [2025-09-16T21:19:30.804308] [DEBUG] [LOCAL ] PGRE: Saving derivative data. [2025-09-16T21:19:30.867108] [DEBUG] [LOCAL ] PH: Derivative data saved (1339 records). [2025-09-16T21:19:30.879548] [INFO ] [MAIN ] PH: Successfully saved derivative data. [2025-09-16T21:19:30.888615] [INFO ] [MAIN ] Derivative Progress: 1412/2026 symbols completed. PH took 1.1s. Estimated remaining: 3m 20s. Rate: 184.5 symbols/min [2025-09-16T21:19:30.902295] [INFO ] [MAIN ] PHG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:30.915928] [DEBUG] [LOCAL ] PGRE: Derivative data saved (1339 records). [2025-09-16T21:19:30.916255] [INFO ] [MAIN ] PGRE: Successfully saved derivative data. [2025-09-16T21:19:30.918573] [INFO ] [MAIN ] Derivative Progress: 1413/2026 symbols completed. PGRE took 1.1s. Estimated remaining: 3m 19s. Rate: 184.7 symbols/min [2025-09-16T21:19:30.918912] [INFO ] [MAIN ] PHIN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:31.107350] [DEBUG] [LOCAL ] PHIN: Loaded 23455 existing records from primary storage. [2025-09-16T21:19:31.117523] [INFO ] [MAIN ] PHIN: Loaded 23455 primary data records. [2025-09-16T21:19:31.140050] [DEBUG] [LOCAL ] PHG: Loaded 34281 existing records from primary storage. [2025-09-16T21:19:31.185156] [INFO ] [MAIN ] PHG: Loaded 34281 primary data records. [2025-09-16T21:19:31.383747] [DEBUG] [MAIN ] PHD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:31.400255] [INFO ] [MAIN ] PHD: Generated 1339 derivative records from 6883 primary records. [2025-09-16T21:19:31.578266] [DEBUG] [LOCAL ] PHD: Saving derivative data. [2025-09-16T21:19:31.683799] [DEBUG] [LOCAL ] PHD: Derivative data saved (1339 records). [2025-09-16T21:19:31.684802] [INFO ] [MAIN ] PHD: Successfully saved derivative data. [2025-09-16T21:19:31.686656] [INFO ] [MAIN ] Derivative Progress: 1414/2026 symbols completed. PHD took 0.9s. Estimated remaining: 3m 19s. Rate: 184.5 symbols/min [2025-09-16T21:19:31.688670] [INFO ] [MAIN ] PHK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:31.713360] [DEBUG] [LOCAL ] PHK: Loaded 19231 existing records from primary storage. [2025-09-16T21:19:31.713966] [INFO ] [MAIN ] PHK: Loaded 19231 primary data records. [2025-09-16T21:19:31.734853] [DEBUG] [MAIN ] PHIN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:31.768414] [INFO ] [MAIN ] PHIN: Generated 1339 derivative records from 23455 primary records. [2025-09-16T21:19:31.786933] [DEBUG] [LOCAL ] PHIN: Saving derivative data. [2025-09-16T21:19:31.812414] [DEBUG] [MAIN ] PHG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:31.830785] [INFO ] [MAIN ] PHG: Generated 1339 derivative records from 34281 primary records. [2025-09-16T21:19:31.842530] [DEBUG] [LOCAL ] PHG: Saving derivative data. [2025-09-16T21:19:31.937558] [DEBUG] [LOCAL ] PHIN: Derivative data saved (1339 records). [2025-09-16T21:19:32.022008] [INFO ] [MAIN ] PHIN: Successfully saved derivative data. [2025-09-16T21:19:32.024036] [DEBUG] [LOCAL ] PHG: Derivative data saved (1339 records). [2025-09-16T21:19:32.025696] [INFO ] [MAIN ] Derivative Progress: 1415/2026 symbols completed. PHIN took 1.1s. Estimated remaining: 3m 19s. Rate: 184.5 symbols/min [2025-09-16T21:19:32.025928] [INFO ] [MAIN ] PHG: Successfully saved derivative data. [2025-09-16T21:19:32.028205] [INFO ] [MAIN ] PHM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:32.028946] [INFO ] [MAIN ] Derivative Progress: 1416/2026 symbols completed. PHG took 1.1s. Estimated remaining: 3m 18s. Rate: 184.6 symbols/min [2025-09-16T21:19:32.029524] [INFO ] [MAIN ] PHR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:32.048512] [DEBUG] [MAIN ] PHK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:32.056574] [INFO ] [MAIN ] PHK: Generated 1339 derivative records from 19231 primary records. [2025-09-16T21:19:32.056690] [DEBUG] [LOCAL ] PHK: Saving derivative data. [2025-09-16T21:19:32.076231] [DEBUG] [LOCAL ] PHK: Derivative data saved (1339 records). [2025-09-16T21:19:32.083631] [INFO ] [MAIN ] PHK: Successfully saved derivative data. [2025-09-16T21:19:32.086346] [INFO ] [MAIN ] Derivative Progress: 1417/2026 symbols completed. PHK took 0.4s. Estimated remaining: 3m 18s. Rate: 184.7 symbols/min [2025-09-16T21:19:32.087396] [INFO ] [MAIN ] PHT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:32.087185] [DEBUG] [LOCAL ] PHR: Loaded 27627 existing records from primary storage. [2025-09-16T21:19:32.088099] [INFO ] [MAIN ] PHR: Loaded 27627 primary data records. [2025-09-16T21:19:32.190008] [DEBUG] [LOCAL ] PHM: Loaded 38479 existing records from primary storage. [2025-09-16T21:19:32.212288] [INFO ] [MAIN ] PHM: Loaded 38479 primary data records. [2025-09-16T21:19:32.212154] [DEBUG] [LOCAL ] PHT: Loaded 12100 existing records from primary storage. [2025-09-16T21:19:32.223307] [INFO ] [MAIN ] PHT: Loaded 12100 primary data records. [2025-09-16T21:19:32.978268] [DEBUG] [MAIN ] PHR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:32.980396] [INFO ] [MAIN ] PHR: Generated 1339 derivative records from 27627 primary records. [2025-09-16T21:19:32.980557] [DEBUG] [LOCAL ] PHR: Saving derivative data. [2025-09-16T21:19:32.998933] [DEBUG] [MAIN ] PHT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:33.002318] [INFO ] [MAIN ] PHT: Generated 1339 derivative records from 12100 primary records. [2025-09-16T21:19:33.004612] [DEBUG] [LOCAL ] PHR: Derivative data saved (1339 records). [2025-09-16T21:19:33.010470] [DEBUG] [LOCAL ] PHT: Saving derivative data. [2025-09-16T21:19:33.010670] [INFO ] [MAIN ] PHR: Successfully saved derivative data. [2025-09-16T21:19:33.016296] [INFO ] [MAIN ] Derivative Progress: 1418/2026 symbols completed. PHR took 1.0s. Estimated remaining: 3m 18s. Rate: 184.5 symbols/min [2025-09-16T21:19:33.016900] [INFO ] [MAIN ] PII: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:33.016849] [DEBUG] [MAIN ] PHM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:33.027181] [INFO ] [MAIN ] PHM: Generated 1339 derivative records from 38479 primary records. [2025-09-16T21:19:33.030464] [DEBUG] [LOCAL ] PHT: Derivative data saved (1339 records). [2025-09-16T21:19:33.030780] [INFO ] [MAIN ] PHT: Successfully saved derivative data. [2025-09-16T21:19:33.030607] [DEBUG] [LOCAL ] PHM: Saving derivative data. [2025-09-16T21:19:33.033076] [INFO ] [MAIN ] Derivative Progress: 1419/2026 symbols completed. PHT took 0.9s. Estimated remaining: 3m 17s. Rate: 184.6 symbols/min [2025-09-16T21:19:33.033930] [INFO ] [MAIN ] PIM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:33.053391] [DEBUG] [LOCAL ] PIM: Loaded 3777 existing records from primary storage. [2025-09-16T21:19:33.054395] [INFO ] [MAIN ] PIM: Loaded 3777 primary data records. [2025-09-16T21:19:33.086798] [DEBUG] [LOCAL ] PHM: Derivative data saved (1339 records). [2025-09-16T21:19:33.092106] [INFO ] [MAIN ] PHM: Successfully saved derivative data. [2025-09-16T21:19:33.101545] [INFO ] [MAIN ] Derivative Progress: 1420/2026 symbols completed. PHM took 1.1s. Estimated remaining: 3m 17s. Rate: 184.7 symbols/min [2025-09-16T21:19:33.142752] [INFO ] [MAIN ] PINE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:33.258354] [DEBUG] [LOCAL ] PII: Loaded 36553 existing records from primary storage. [2025-09-16T21:19:33.258841] [INFO ] [MAIN ] PII: Loaded 36553 primary data records. [2025-09-16T21:19:33.301860] [DEBUG] [LOCAL ] PINE: Loaded 10458 existing records from primary storage. [2025-09-16T21:19:33.395185] [INFO ] [MAIN ] PINE: Loaded 10458 primary data records. [2025-09-16T21:19:33.907778] [DEBUG] [MAIN ] PIM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:33.908901] [INFO ] [MAIN ] PIM: Generated 1339 derivative records from 3777 primary records. [2025-09-16T21:19:33.910330] [DEBUG] [LOCAL ] PIM: Saving derivative data. [2025-09-16T21:19:33.923091] [DEBUG] [LOCAL ] PIM: Derivative data saved (1339 records). [2025-09-16T21:19:33.923199] [INFO ] [MAIN ] PIM: Successfully saved derivative data. [2025-09-16T21:19:33.924885] [INFO ] [MAIN ] Derivative Progress: 1421/2026 symbols completed. PIM took 0.9s. Estimated remaining: 3m 17s. Rate: 184.5 symbols/min [2025-09-16T21:19:33.925248] [INFO ] [MAIN ] PINS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:33.939879] [DEBUG] [MAIN ] PII: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:33.940716] [INFO ] [MAIN ] PII: Generated 1339 derivative records from 36553 primary records. [2025-09-16T21:19:33.941548] [DEBUG] [LOCAL ] PII: Saving derivative data. [2025-09-16T21:19:33.965109] [DEBUG] [LOCAL ] PII: Derivative data saved (1339 records). [2025-09-16T21:19:33.964504] [DEBUG] [MAIN ] PINE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:33.965337] [INFO ] [MAIN ] PII: Successfully saved derivative data. [2025-09-16T21:19:33.976189] [INFO ] [MAIN ] Derivative Progress: 1422/2026 symbols completed. PII took 1.0s. Estimated remaining: 3m 16s. Rate: 184.6 symbols/min [2025-09-16T21:19:33.976982] [INFO ] [MAIN ] PINE: Generated 1339 derivative records from 10458 primary records. [2025-09-16T21:19:33.977169] [INFO ] [MAIN ] PIPR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:33.977408] [DEBUG] [LOCAL ] PINE: Saving derivative data. [2025-09-16T21:19:33.989960] [DEBUG] [LOCAL ] PINE: Derivative data saved (1339 records). [2025-09-16T21:19:33.990559] [INFO ] [MAIN ] PINE: Successfully saved derivative data. [2025-09-16T21:19:33.992692] [INFO ] [MAIN ] Derivative Progress: 1423/2026 symbols completed. PINE took 0.9s. Estimated remaining: 3m 16s. Rate: 184.7 symbols/min [2025-09-16T21:19:34.007585] [DEBUG] [LOCAL ] PINS: Loaded 40043 existing records from primary storage. [2025-09-16T21:19:34.007800] [INFO ] [MAIN ] PINS: Loaded 40043 primary data records. [2025-09-16T21:19:34.088568] [DEBUG] [LOCAL ] PIPR: Loaded 10931 existing records from primary storage. [2025-09-16T21:19:34.112412] [INFO ] [MAIN ] PIPR: Loaded 10931 primary data records. [2025-09-16T21:19:34.558553] [DEBUG] [MAIN ] PINS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:34.560704] [INFO ] [MAIN ] PINS: Generated 1339 derivative records from 40043 primary records. [2025-09-16T21:19:34.561254] [DEBUG] [LOCAL ] PINS: Saving derivative data. [2025-09-16T21:19:34.583152] [DEBUG] [LOCAL ] PINS: Derivative data saved (1339 records). [2025-09-16T21:19:34.582946] [DEBUG] [MAIN ] PIPR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:34.583319] [INFO ] [MAIN ] PINS: Successfully saved derivative data. [2025-09-16T21:19:34.584913] [INFO ] [MAIN ] Derivative Progress: 1424/2026 symbols completed. PINS took 0.7s. Estimated remaining: 3m 16s. Rate: 184.6 symbols/min [2025-09-16T21:19:34.585556] [INFO ] [MAIN ] PIPR: Generated 1339 derivative records from 10931 primary records. [2025-09-16T21:19:34.585778] [DEBUG] [LOCAL ] PIPR: Saving derivative data. [2025-09-16T21:19:34.597410] [DEBUG] [LOCAL ] PIPR: Derivative data saved (1339 records). [2025-09-16T21:19:34.597469] [INFO ] [MAIN ] PIPR: Successfully saved derivative data. [2025-09-16T21:19:34.599231] [INFO ] [MAIN ] Derivative Progress: 1425/2026 symbols completed. PIPR took 0.6s. Estimated remaining: 3m 15s. Rate: 184.8 symbols/min [2025-09-16T21:19:34.600035] [INFO ] [MAIN ] PKE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:34.599919] [INFO ] [MAIN ] PK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:34.600178] [INFO ] [MAIN ] PJT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:34.611378] [DEBUG] [LOCAL ] PKE: Loaded 10033 existing records from primary storage. [2025-09-16T21:19:34.611515] [INFO ] [MAIN ] PKE: Loaded 10033 primary data records. [2025-09-16T21:19:34.725624] [DEBUG] [LOCAL ] PJT: Loaded 15907 existing records from primary storage. [2025-09-16T21:19:34.742106] [INFO ] [MAIN ] PJT: Loaded 15907 primary data records. [2025-09-16T21:19:35.035716] [DEBUG] [LOCAL ] PK: Loaded 39339 existing records from primary storage. [2025-09-16T21:19:35.047158] [INFO ] [MAIN ] PK: Loaded 39339 primary data records. [2025-09-16T21:19:35.481024] [DEBUG] [MAIN ] PKE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:35.482722] [INFO ] [MAIN ] PKE: Generated 1339 derivative records from 10033 primary records. [2025-09-16T21:19:35.483806] [DEBUG] [LOCAL ] PKE: Saving derivative data. [2025-09-16T21:19:35.497837] [DEBUG] [LOCAL ] PKE: Derivative data saved (1339 records). [2025-09-16T21:19:35.498013] [INFO ] [MAIN ] PKE: Successfully saved derivative data. [2025-09-16T21:19:35.505485] [INFO ] [MAIN ] Derivative Progress: 1426/2026 symbols completed. PKE took 0.9s. Estimated remaining: 3m 15s. Rate: 184.5 symbols/min [2025-09-16T21:19:35.509539] [INFO ] [MAIN ] PKG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:35.510684] [DEBUG] [MAIN ] PJT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:35.511569] [INFO ] [MAIN ] PJT: Generated 1339 derivative records from 15907 primary records. [2025-09-16T21:19:35.511761] [DEBUG] [LOCAL ] PJT: Saving derivative data. [2025-09-16T21:19:35.532408] [DEBUG] [LOCAL ] PJT: Derivative data saved (1339 records). [2025-09-16T21:19:35.535956] [INFO ] [MAIN ] PJT: Successfully saved derivative data. [2025-09-16T21:19:35.537766] [INFO ] [MAIN ] Derivative Progress: 1427/2026 symbols completed. PJT took 0.9s. Estimated remaining: 3m 15s. Rate: 184.6 symbols/min [2025-09-16T21:19:35.538180] [INFO ] [MAIN ] PKST: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:35.538476] [DEBUG] [MAIN ] PK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:35.539509] [INFO ] [MAIN ] PK: Generated 1339 derivative records from 39339 primary records. [2025-09-16T21:19:35.539588] [DEBUG] [LOCAL ] PK: Saving derivative data. [2025-09-16T21:19:35.562657] [DEBUG] [LOCAL ] PK: Derivative data saved (1339 records). [2025-09-16T21:19:35.562837] [INFO ] [MAIN ] PK: Successfully saved derivative data. [2025-09-16T21:19:35.564932] [INFO ] [MAIN ] Derivative Progress: 1428/2026 symbols completed. PK took 1.0s. Estimated remaining: 3m 14s. Rate: 184.8 symbols/min [2025-09-16T21:19:35.565592] [INFO ] [MAIN ] PKX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:35.575187] [DEBUG] [LOCAL ] PKG: Loaded 28855 existing records from primary storage. [2025-09-16T21:19:35.575347] [INFO ] [MAIN ] PKG: Loaded 28855 primary data records. [2025-09-16T21:19:35.635553] [DEBUG] [LOCAL ] PKST: Loaded 12953 existing records from primary storage. [2025-09-16T21:19:35.661309] [INFO ] [MAIN ] PKST: Loaded 12953 primary data records. [2025-09-16T21:19:35.861147] [DEBUG] [LOCAL ] PKX: Loaded 16636 existing records from primary storage. [2025-09-16T21:19:35.947910] [INFO ] [MAIN ] PKX: Loaded 16636 primary data records. [2025-09-16T21:19:36.394082] [DEBUG] [MAIN ] PKG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:36.395084] [INFO ] [MAIN ] PKG: Generated 1339 derivative records from 28855 primary records. [2025-09-16T21:19:36.395487] [DEBUG] [LOCAL ] PKG: Saving derivative data. [2025-09-16T21:19:36.416548] [DEBUG] [LOCAL ] PKG: Derivative data saved (1339 records). [2025-09-16T21:19:36.420085] [INFO ] [MAIN ] PKG: Successfully saved derivative data. [2025-09-16T21:19:36.421923] [INFO ] [MAIN ] Derivative Progress: 1429/2026 symbols completed. PKG took 0.9s. Estimated remaining: 3m 14s. Rate: 184.5 symbols/min [2025-09-16T21:19:36.422258] [INFO ] [MAIN ] PL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:36.431600] [DEBUG] [MAIN ] PKX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:36.432174] [DEBUG] [MAIN ] PKST: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:36.432801] [INFO ] [MAIN ] PKX: Generated 1339 derivative records from 16636 primary records. [2025-09-16T21:19:36.433506] [DEBUG] [LOCAL ] PKX: Saving derivative data. [2025-09-16T21:19:36.433377] [INFO ] [MAIN ] PKST: Generated 1339 derivative records from 12953 primary records. [2025-09-16T21:19:36.434130] [DEBUG] [LOCAL ] PKST: Saving derivative data. [2025-09-16T21:19:36.456222] [DEBUG] [LOCAL ] PKX: Derivative data saved (1339 records). [2025-09-16T21:19:36.457224] [DEBUG] [LOCAL ] PKST: Derivative data saved (1339 records). [2025-09-16T21:19:36.457341] [INFO ] [MAIN ] PKST: Successfully saved derivative data. [2025-09-16T21:19:36.457385] [INFO ] [MAIN ] PKX: Successfully saved derivative data. [2025-09-16T21:19:36.459067] [INFO ] [MAIN ] Derivative Progress: 1430/2026 symbols completed. PKST took 0.9s. Estimated remaining: 3m 14s. Rate: 184.7 symbols/min [2025-09-16T21:19:36.461375] [INFO ] [MAIN ] PLD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:36.461619] [INFO ] [MAIN ] Derivative Progress: 1431/2026 symbols completed. PKX took 0.9s. Estimated remaining: 3m 13s. Rate: 184.8 symbols/min [2025-09-16T21:19:36.462101] [INFO ] [MAIN ] PLNT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:36.495035] [DEBUG] [LOCAL ] PL: Loaded 39639 existing records from primary storage. [2025-09-16T21:19:36.495287] [INFO ] [MAIN ] PL: Loaded 39639 primary data records. [2025-09-16T21:19:36.710370] [DEBUG] [LOCAL ] PLD: Loaded 39856 existing records from primary storage. [2025-09-16T21:19:36.713284] [DEBUG] [LOCAL ] PLNT: Loaded 35944 existing records from primary storage. [2025-09-16T21:19:36.797370] [INFO ] [MAIN ] PLD: Loaded 39856 primary data records. [2025-09-16T21:19:36.797555] [INFO ] [MAIN ] PLNT: Loaded 35944 primary data records. [2025-09-16T21:19:37.363204] [DEBUG] [MAIN ] PL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:37.364879] [INFO ] [MAIN ] PL: Generated 1339 derivative records from 39639 primary records. [2025-09-16T21:19:37.365163] [DEBUG] [LOCAL ] PL: Saving derivative data. [2025-09-16T21:19:37.377957] [DEBUG] [LOCAL ] PL: Derivative data saved (1339 records). [2025-09-16T21:19:37.378202] [INFO ] [MAIN ] PL: Successfully saved derivative data. [2025-09-16T21:19:37.379890] [INFO ] [MAIN ] Derivative Progress: 1432/2026 symbols completed. PL took 1.0s. Estimated remaining: 3m 13s. Rate: 184.6 symbols/min [2025-09-16T21:19:37.380338] [INFO ] [MAIN ] PLOW: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:37.396047] [DEBUG] [MAIN ] PLD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:37.396823] [INFO ] [MAIN ] PLD: Generated 1339 derivative records from 39856 primary records. [2025-09-16T21:19:37.397007] [DEBUG] [LOCAL ] PLD: Saving derivative data. [2025-09-16T21:19:37.416604] [DEBUG] [MAIN ] PLNT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:37.420067] [INFO ] [MAIN ] PLNT: Generated 1339 derivative records from 35944 primary records. [2025-09-16T21:19:37.426502] [DEBUG] [LOCAL ] PLNT: Saving derivative data. [2025-09-16T21:19:37.427186] [DEBUG] [LOCAL ] PLOW: Loaded 15306 existing records from primary storage. [2025-09-16T21:19:37.427282] [INFO ] [MAIN ] PLOW: Loaded 15306 primary data records. [2025-09-16T21:19:37.470085] [DEBUG] [LOCAL ] PLD: Derivative data saved (1339 records). [2025-09-16T21:19:37.491460] [INFO ] [MAIN ] PLD: Successfully saved derivative data. [2025-09-16T21:19:37.503970] [INFO ] [MAIN ] Derivative Progress: 1433/2026 symbols completed. PLD took 1.0s. Estimated remaining: 3m 13s. Rate: 184.6 symbols/min [2025-09-16T21:19:37.522358] [INFO ] [MAIN ] PLYM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:37.543056] [DEBUG] [LOCAL ] PLNT: Derivative data saved (1339 records). [2025-09-16T21:19:37.546847] [INFO ] [MAIN ] PLNT: Successfully saved derivative data. [2025-09-16T21:19:37.554556] [INFO ] [MAIN ] Derivative Progress: 1434/2026 symbols completed. PLNT took 1.1s. Estimated remaining: 3m 12s. Rate: 184.7 symbols/min [2025-09-16T21:19:37.575739] [INFO ] [MAIN ] PM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:37.726871] [DEBUG] [LOCAL ] PLYM: Loaded 24687 existing records from primary storage. [2025-09-16T21:19:37.727336] [INFO ] [MAIN ] PLYM: Loaded 24687 primary data records. [2025-09-16T21:19:38.023590] [DEBUG] [LOCAL ] PM: Loaded 40027 existing records from primary storage. [2025-09-16T21:19:38.024019] [INFO ] [MAIN ] PM: Loaded 40027 primary data records. [2025-09-16T21:19:38.072474] [DEBUG] [MAIN ] PLOW: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:38.094578] [INFO ] [MAIN ] PLOW: Generated 1339 derivative records from 15306 primary records. [2025-09-16T21:19:38.109134] [DEBUG] [LOCAL ] PLOW: Saving derivative data. [2025-09-16T21:19:38.157054] [DEBUG] [LOCAL ] PLOW: Derivative data saved (1339 records). [2025-09-16T21:19:38.177794] [INFO ] [MAIN ] PLOW: Successfully saved derivative data. [2025-09-16T21:19:38.215214] [INFO ] [MAIN ] Derivative Progress: 1435/2026 symbols completed. PLOW took 0.8s. Estimated remaining: 3m 12s. Rate: 184.6 symbols/min [2025-09-16T21:19:38.216723] [INFO ] [MAIN ] PML: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:38.342739] [DEBUG] [MAIN ] PLYM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:38.343728] [INFO ] [MAIN ] PLYM: Generated 1339 derivative records from 24687 primary records. [2025-09-16T21:19:38.350089] [DEBUG] [LOCAL ] PLYM: Saving derivative data. [2025-09-16T21:19:38.350020] [DEBUG] [LOCAL ] PML: Loaded 15622 existing records from primary storage. [2025-09-16T21:19:38.350925] [INFO ] [MAIN ] PML: Loaded 15622 primary data records. [2025-09-16T21:19:38.488685] [DEBUG] [LOCAL ] PLYM: Derivative data saved (1339 records). [2025-09-16T21:19:38.521882] [INFO ] [MAIN ] PLYM: Successfully saved derivative data. [2025-09-16T21:19:38.547546] [INFO ] [MAIN ] Derivative Progress: 1436/2026 symbols completed. PLYM took 1.0s. Estimated remaining: 3m 12s. Rate: 184.6 symbols/min [2025-09-16T21:19:38.553482] [INFO ] [MAIN ] PMM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:38.657877] [DEBUG] [MAIN ] PM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:38.660581] [INFO ] [MAIN ] PM: Generated 1339 derivative records from 40027 primary records. [2025-09-16T21:19:38.664637] [DEBUG] [LOCAL ] PMM: Loaded 6847 existing records from primary storage. [2025-09-16T21:19:38.664400] [DEBUG] [LOCAL ] PM: Saving derivative data. [2025-09-16T21:19:38.665372] [INFO ] [MAIN ] PMM: Loaded 6847 primary data records. [2025-09-16T21:19:38.759248] [DEBUG] [LOCAL ] PM: Derivative data saved (1339 records). [2025-09-16T21:19:38.772266] [INFO ] [MAIN ] PM: Successfully saved derivative data. [2025-09-16T21:19:38.786473] [INFO ] [MAIN ] Derivative Progress: 1437/2026 symbols completed. PM took 1.2s. Estimated remaining: 3m 11s. Rate: 184.6 symbols/min [2025-09-16T21:19:38.800225] [INFO ] [MAIN ] PMO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:38.892610] [DEBUG] [MAIN ] PML: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:38.893669] [INFO ] [MAIN ] PML: Generated 1339 derivative records from 15622 primary records. [2025-09-16T21:19:38.903699] [DEBUG] [LOCAL ] PML: Saving derivative data. [2025-09-16T21:19:38.980595] [DEBUG] [LOCAL ] PMO: Loaded 6885 existing records from primary storage. [2025-09-16T21:19:38.986461] [INFO ] [MAIN ] PMO: Loaded 6885 primary data records. [2025-09-16T21:19:38.992591] [DEBUG] [LOCAL ] PML: Derivative data saved (1339 records). [2025-09-16T21:19:39.013364] [INFO ] [MAIN ] PML: Successfully saved derivative data. [2025-09-16T21:19:39.015182] [INFO ] [MAIN ] Derivative Progress: 1438/2026 symbols completed. PML took 0.8s. Estimated remaining: 3m 11s. Rate: 184.7 symbols/min [2025-09-16T21:19:39.315823] [DEBUG] [MAIN ] PMM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:39.316615] [INFO ] [MAIN ] PMM: Generated 1339 derivative records from 6847 primary records. [2025-09-16T21:19:39.317145] [DEBUG] [LOCAL ] PMM: Saving derivative data. [2025-09-16T21:19:39.330011] [DEBUG] [LOCAL ] PMM: Derivative data saved (1339 records). [2025-09-16T21:19:39.330890] [INFO ] [MAIN ] PMM: Successfully saved derivative data. [2025-09-16T21:19:39.332823] [INFO ] [MAIN ] Derivative Progress: 1439/2026 symbols completed. PMM took 0.8s. Estimated remaining: 3m 11s. Rate: 184.7 symbols/min [2025-09-16T21:19:39.346744] [DEBUG] [MAIN ] PMO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:39.347374] [INFO ] [MAIN ] PMO: Generated 1339 derivative records from 6885 primary records. [2025-09-16T21:19:39.347434] [DEBUG] [LOCAL ] PMO: Saving derivative data. [2025-09-16T21:19:39.358916] [DEBUG] [LOCAL ] PMO: Derivative data saved (1339 records). [2025-09-16T21:19:39.358976] [INFO ] [MAIN ] PMO: Successfully saved derivative data. [2025-09-16T21:19:39.360798] [INFO ] [MAIN ] Derivative Progress: 1440/2026 symbols completed. PMO took 0.6s. Estimated remaining: 3m 10s. Rate: 184.8 symbols/min [2025-09-16T21:19:39.361264] [INFO ] [MAIN ] PNC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:39.361616] [INFO ] [MAIN ] PMT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:39.361413] [INFO ] [MAIN ] PNI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:39.371073] [DEBUG] [LOCAL ] PNI: Loaded 4914 existing records from primary storage. [2025-09-16T21:19:39.371248] [INFO ] [MAIN ] PNI: Loaded 4914 primary data records. [2025-09-16T21:19:39.599399] [DEBUG] [LOCAL ] PMT: Loaded 29376 existing records from primary storage. [2025-09-16T21:19:39.681821] [DEBUG] [LOCAL ] PNC: Loaded 38873 existing records from primary storage. [2025-09-16T21:19:39.681283] [INFO ] [MAIN ] PMT: Loaded 29376 primary data records. [2025-09-16T21:19:39.682218] [INFO ] [MAIN ] PNC: Loaded 38873 primary data records. [2025-09-16T21:19:40.224631] [DEBUG] [MAIN ] PNI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:40.225508] [INFO ] [MAIN ] PNI: Generated 1339 derivative records from 4914 primary records. [2025-09-16T21:19:40.225839] [DEBUG] [LOCAL ] PNI: Saving derivative data. [2025-09-16T21:19:40.238042] [DEBUG] [LOCAL ] PNI: Derivative data saved (1339 records). [2025-09-16T21:19:40.238164] [INFO ] [MAIN ] PNI: Successfully saved derivative data. [2025-09-16T21:19:40.239890] [INFO ] [MAIN ] Derivative Progress: 1441/2026 symbols completed. PNI took 0.9s. Estimated remaining: 3m 10s. Rate: 184.6 symbols/min [2025-09-16T21:19:40.240317] [INFO ] [MAIN ] PNNT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:40.255057] [DEBUG] [MAIN ] PNC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:40.256532] [INFO ] [MAIN ] PNC: Generated 1339 derivative records from 38873 primary records. [2025-09-16T21:19:40.256697] [DEBUG] [LOCAL ] PNC: Saving derivative data. [2025-09-16T21:19:40.283252] [DEBUG] [MAIN ] PMT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:40.285011] [INFO ] [MAIN ] PMT: Generated 1339 derivative records from 29376 primary records. [2025-09-16T21:19:40.293018] [DEBUG] [LOCAL ] PMT: Saving derivative data. [2025-09-16T21:19:40.294656] [DEBUG] [LOCAL ] PNC: Derivative data saved (1339 records). [2025-09-16T21:19:40.303819] [INFO ] [MAIN ] PNC: Successfully saved derivative data. [2025-09-16T21:19:40.308045] [INFO ] [MAIN ] Derivative Progress: 1442/2026 symbols completed. PNC took 0.9s. Estimated remaining: 3m 10s. Rate: 184.7 symbols/min [2025-09-16T21:19:40.308327] [INFO ] [MAIN ] PNR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:40.300754] [DEBUG] [LOCAL ] PNNT: Loaded 24027 existing records from primary storage. [2025-09-16T21:19:40.309161] [INFO ] [MAIN ] PNNT: Loaded 24027 primary data records. [2025-09-16T21:19:40.309701] [DEBUG] [LOCAL ] PMT: Derivative data saved (1339 records). [2025-09-16T21:19:40.309883] [INFO ] [MAIN ] PMT: Successfully saved derivative data. [2025-09-16T21:19:40.348698] [INFO ] [MAIN ] Derivative Progress: 1443/2026 symbols completed. PMT took 1.0s. Estimated remaining: 3m 9s. Rate: 184.8 symbols/min [2025-09-16T21:19:40.387551] [INFO ] [MAIN ] PNW: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:40.597535] [DEBUG] [LOCAL ] PNR: Loaded 35430 existing records from primary storage. [2025-09-16T21:19:40.598979] [INFO ] [MAIN ] PNR: Loaded 35430 primary data records. [2025-09-16T21:19:40.738361] [DEBUG] [LOCAL ] PNW: Loaded 34266 existing records from primary storage. [2025-09-16T21:19:40.738881] [INFO ] [MAIN ] PNW: Loaded 34266 primary data records. [2025-09-16T21:19:41.075174] [DEBUG] [MAIN ] PNNT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:41.165912] [INFO ] [MAIN ] PNNT: Generated 1339 derivative records from 24027 primary records. [2025-09-16T21:19:41.166711] [DEBUG] [LOCAL ] PNNT: Saving derivative data. [2025-09-16T21:19:41.180659] [DEBUG] [LOCAL ] PNNT: Derivative data saved (1339 records). [2025-09-16T21:19:41.181044] [INFO ] [MAIN ] PNNT: Successfully saved derivative data. [2025-09-16T21:19:41.182820] [INFO ] [MAIN ] Derivative Progress: 1444/2026 symbols completed. PNNT took 0.9s. Estimated remaining: 3m 9s. Rate: 184.6 symbols/min [2025-09-16T21:19:41.184284] [INFO ] [MAIN ] POR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:41.200062] [DEBUG] [MAIN ] PNR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:41.200965] [INFO ] [MAIN ] PNR: Generated 1339 derivative records from 35430 primary records. [2025-09-16T21:19:41.201325] [DEBUG] [LOCAL ] PNR: Saving derivative data. [2025-09-16T21:19:41.213855] [DEBUG] [LOCAL ] PNR: Derivative data saved (1339 records). [2025-09-16T21:19:41.214069] [INFO ] [MAIN ] PNR: Successfully saved derivative data. [2025-09-16T21:19:41.216678] [INFO ] [MAIN ] Derivative Progress: 1445/2026 symbols completed. PNR took 0.9s. Estimated remaining: 3m 9s. Rate: 184.7 symbols/min [2025-09-16T21:19:41.216932] [INFO ] [MAIN ] POST: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:41.238757] [DEBUG] [MAIN ] PNW: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:41.239557] [INFO ] [MAIN ] PNW: Generated 1339 derivative records from 34266 primary records. [2025-09-16T21:19:41.239621] [DEBUG] [LOCAL ] PNW: Saving derivative data. [2025-09-16T21:19:41.251980] [DEBUG] [LOCAL ] PNW: Derivative data saved (1339 records). [2025-09-16T21:19:41.262213] [INFO ] [MAIN ] PNW: Successfully saved derivative data. [2025-09-16T21:19:41.264962] [INFO ] [MAIN ] Derivative Progress: 1446/2026 symbols completed. PNW took 0.9s. Estimated remaining: 3m 8s. Rate: 184.8 symbols/min [2025-09-16T21:19:41.265312] [INFO ] [MAIN ] PPG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:41.266243] [DEBUG] [LOCAL ] POR: Loaded 34867 existing records from primary storage. [2025-09-16T21:19:41.266631] [INFO ] [MAIN ] POR: Loaded 34867 primary data records. [2025-09-16T21:19:41.434135] [DEBUG] [LOCAL ] POST: Loaded 28970 existing records from primary storage. [2025-09-16T21:19:41.467039] [INFO ] [MAIN ] POST: Loaded 28970 primary data records. [2025-09-16T21:19:41.698903] [DEBUG] [LOCAL ] PPG: Loaded 37459 existing records from primary storage. [2025-09-16T21:19:41.700076] [INFO ] [MAIN ] PPG: Loaded 37459 primary data records. [2025-09-16T21:19:42.163435] [DEBUG] [MAIN ] POR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:42.164713] [INFO ] [MAIN ] POR: Generated 1339 derivative records from 34867 primary records. [2025-09-16T21:19:42.165243] [DEBUG] [LOCAL ] POR: Saving derivative data. [2025-09-16T21:19:42.179298] [DEBUG] [LOCAL ] POR: Derivative data saved (1339 records). [2025-09-16T21:19:42.179464] [INFO ] [MAIN ] POR: Successfully saved derivative data. [2025-09-16T21:19:42.181296] [INFO ] [MAIN ] Derivative Progress: 1447/2026 symbols completed. POR took 1.0s. Estimated remaining: 3m 8s. Rate: 184.6 symbols/min [2025-09-16T21:19:42.182742] [INFO ] [MAIN ] PPL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:42.197551] [DEBUG] [MAIN ] POST: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:42.198479] [INFO ] [MAIN ] POST: Generated 1339 derivative records from 28970 primary records. [2025-09-16T21:19:42.198712] [DEBUG] [LOCAL ] POST: Saving derivative data. [2025-09-16T21:19:42.214841] [DEBUG] [LOCAL ] POST: Derivative data saved (1339 records). [2025-09-16T21:19:42.224395] [INFO ] [MAIN ] POST: Successfully saved derivative data. [2025-09-16T21:19:42.227118] [INFO ] [MAIN ] Derivative Progress: 1448/2026 symbols completed. POST took 1.0s. Estimated remaining: 3m 8s. Rate: 184.7 symbols/min [2025-09-16T21:19:42.225141] [DEBUG] [MAIN ] PPG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:42.227906] [INFO ] [MAIN ] PPG: Generated 1339 derivative records from 37459 primary records. [2025-09-16T21:19:42.228205] [INFO ] [MAIN ] PPT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:42.228035] [DEBUG] [LOCAL ] PPG: Saving derivative data. [2025-09-16T21:19:42.250307] [DEBUG] [LOCAL ] PPG: Derivative data saved (1339 records). [2025-09-16T21:19:42.250440] [INFO ] [MAIN ] PPG: Successfully saved derivative data. [2025-09-16T21:19:42.252557] [INFO ] [MAIN ] Derivative Progress: 1449/2026 symbols completed. PPG took 1.0s. Estimated remaining: 3m 7s. Rate: 184.8 symbols/min [2025-09-16T21:19:42.256495] [INFO ] [MAIN ] PR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:42.264681] [DEBUG] [LOCAL ] PPT: Loaded 14800 existing records from primary storage. [2025-09-16T21:19:42.265372] [INFO ] [MAIN ] PPT: Loaded 14800 primary data records. [2025-09-16T21:19:42.314553] [DEBUG] [LOCAL ] PPL: Loaded 39888 existing records from primary storage. [2025-09-16T21:19:42.346969] [INFO ] [MAIN ] PPL: Loaded 39888 primary data records. [2025-09-16T21:19:42.832847] [DEBUG] [LOCAL ] PR: Loaded 39964 existing records from primary storage. [2025-09-16T21:19:42.833156] [INFO ] [MAIN ] PR: Loaded 39964 primary data records. [2025-09-16T21:19:43.117940] [DEBUG] [MAIN ] PPT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:43.128273] [INFO ] [MAIN ] PPT: Generated 1339 derivative records from 14800 primary records. [2025-09-16T21:19:43.128556] [DEBUG] [LOCAL ] PPT: Saving derivative data. [2025-09-16T21:19:43.129586] [DEBUG] [MAIN ] PPL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:43.131181] [INFO ] [MAIN ] PPL: Generated 1339 derivative records from 39888 primary records. [2025-09-16T21:19:43.136893] [DEBUG] [LOCAL ] PPL: Saving derivative data. [2025-09-16T21:19:43.155801] [DEBUG] [LOCAL ] PPL: Derivative data saved (1339 records). [2025-09-16T21:19:43.154234] [DEBUG] [LOCAL ] PPT: Derivative data saved (1339 records). [2025-09-16T21:19:43.156602] [INFO ] [MAIN ] PPL: Successfully saved derivative data. [2025-09-16T21:19:43.156696] [INFO ] [MAIN ] PPT: Successfully saved derivative data. [2025-09-16T21:19:43.158666] [INFO ] [MAIN ] Derivative Progress: 1450/2026 symbols completed. PPL took 1.0s. Estimated remaining: 3m 7s. Rate: 184.6 symbols/min [2025-09-16T21:19:43.162333] [INFO ] [MAIN ] Derivative Progress: 1451/2026 symbols completed. PPT took 0.9s. Estimated remaining: 3m 7s. Rate: 184.7 symbols/min [2025-09-16T21:19:43.160204] [INFO ] [MAIN ] PRA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:43.162607] [INFO ] [MAIN ] PRCS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:43.174000] [DEBUG] [MAIN ] PR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:43.174714] [INFO ] [MAIN ] PR: Generated 1339 derivative records from 39964 primary records. [2025-09-16T21:19:43.174906] [DEBUG] [LOCAL ] PR: Saving derivative data. [2025-09-16T21:19:43.177376] [DEBUG] [LOCAL ] PRCS: Loaded 2004 existing records from primary storage. [2025-09-16T21:19:43.186346] [INFO ] [MAIN ] PRCS: Loaded 2004 primary data records. [2025-09-16T21:19:43.199605] [DEBUG] [LOCAL ] PR: Derivative data saved (1339 records). [2025-09-16T21:19:43.219563] [INFO ] [MAIN ] PR: Successfully saved derivative data. [2025-09-16T21:19:43.233751] [INFO ] [MAIN ] Derivative Progress: 1452/2026 symbols completed. PR took 1.0s. Estimated remaining: 3m 6s. Rate: 184.8 symbols/min [2025-09-16T21:19:43.264859] [INFO ] [MAIN ] PRG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:43.389388] [DEBUG] [LOCAL ] PRA: Loaded 25842 existing records from primary storage. [2025-09-16T21:19:43.470346] [INFO ] [MAIN ] PRA: Loaded 25842 primary data records. [2025-09-16T21:19:43.580512] [DEBUG] [LOCAL ] PRG: Loaded 21741 existing records from primary storage. [2025-09-16T21:19:43.589842] [INFO ] [MAIN ] PRG: Loaded 21741 primary data records. [2025-09-16T21:19:43.972909] [DEBUG] [MAIN ] PRCS: Filtered 5181 bins outside market hours, 5781 incomplete bins [2025-09-16T21:19:44.062769] [INFO ] [MAIN ] PRCS: Generated 1337 derivative records from 2004 primary records. [2025-09-16T21:19:44.062962] [DEBUG] [LOCAL ] PRCS: Saving derivative data. [2025-09-16T21:19:44.075011] [DEBUG] [LOCAL ] PRCS: Derivative data saved (1337 records). [2025-09-16T21:19:44.075790] [INFO ] [MAIN ] PRCS: Successfully saved derivative data. [2025-09-16T21:19:44.077968] [INFO ] [MAIN ] Derivative Progress: 1453/2026 symbols completed. PRCS took 0.9s. Estimated remaining: 3m 6s. Rate: 184.6 symbols/min [2025-09-16T21:19:44.091887] [DEBUG] [MAIN ] PRA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:44.092504] [INFO ] [MAIN ] PRA: Generated 1339 derivative records from 25842 primary records. [2025-09-16T21:19:44.092825] [DEBUG] [LOCAL ] PRA: Saving derivative data. [2025-09-16T21:19:44.106557] [DEBUG] [LOCAL ] PRA: Derivative data saved (1339 records). [2025-09-16T21:19:44.107739] [INFO ] [MAIN ] PRA: Successfully saved derivative data. [2025-09-16T21:19:44.109427] [INFO ] [MAIN ] Derivative Progress: 1454/2026 symbols completed. PRA took 0.9s. Estimated remaining: 3m 6s. Rate: 184.7 symbols/min [2025-09-16T21:19:44.119161] [DEBUG] [MAIN ] PRG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:44.119795] [INFO ] [MAIN ] PRG: Generated 1339 derivative records from 21741 primary records. [2025-09-16T21:19:44.119857] [DEBUG] [LOCAL ] PRG: Saving derivative data. [2025-09-16T21:19:44.131651] [DEBUG] [LOCAL ] PRG: Derivative data saved (1339 records). [2025-09-16T21:19:44.131709] [INFO ] [MAIN ] PRG: Successfully saved derivative data. [2025-09-16T21:19:44.133835] [INFO ] [MAIN ] Derivative Progress: 1455/2026 symbols completed. PRG took 0.9s. Estimated remaining: 3m 5s. Rate: 184.8 symbols/min [2025-09-16T21:19:44.134501] [INFO ] [MAIN ] PRI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:44.134599] [INFO ] [MAIN ] PRGO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:44.134698] [INFO ] [MAIN ] PRH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:44.140941] [DEBUG] [LOCAL ] PRH: Loaded 3527 existing records from primary storage. [2025-09-16T21:19:44.141043] [INFO ] [MAIN ] PRH: Loaded 3527 primary data records. [2025-09-16T21:19:44.288902] [DEBUG] [LOCAL ] PRI: Loaded 13205 existing records from primary storage. [2025-09-16T21:19:44.433244] [INFO ] [MAIN ] PRI: Loaded 13205 primary data records. [2025-09-16T21:19:44.465918] [DEBUG] [LOCAL ] PRGO: Loaded 34405 existing records from primary storage. [2025-09-16T21:19:44.511989] [INFO ] [MAIN ] PRGO: Loaded 34405 primary data records. [2025-09-16T21:19:44.977631] [DEBUG] [MAIN ] PRH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:44.978759] [INFO ] [MAIN ] PRH: Generated 1339 derivative records from 3527 primary records. [2025-09-16T21:19:44.979031] [DEBUG] [LOCAL ] PRH: Saving derivative data. [2025-09-16T21:19:44.991065] [DEBUG] [LOCAL ] PRH: Derivative data saved (1339 records). [2025-09-16T21:19:44.991285] [INFO ] [MAIN ] PRH: Successfully saved derivative data. [2025-09-16T21:19:44.993327] [INFO ] [MAIN ] Derivative Progress: 1456/2026 symbols completed. PRH took 0.9s. Estimated remaining: 3m 5s. Rate: 184.6 symbols/min [2025-09-16T21:19:44.995222] [INFO ] [MAIN ] PRIM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:45.007811] [DEBUG] [MAIN ] PRI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:45.008550] [INFO ] [MAIN ] PRI: Generated 1339 derivative records from 13205 primary records. [2025-09-16T21:19:45.008819] [DEBUG] [LOCAL ] PRI: Saving derivative data. [2025-09-16T21:19:45.021520] [DEBUG] [LOCAL ] PRI: Derivative data saved (1339 records). [2025-09-16T21:19:45.021634] [INFO ] [MAIN ] PRI: Successfully saved derivative data. [2025-09-16T21:19:45.024785] [INFO ] [MAIN ] Derivative Progress: 1457/2026 symbols completed. PRI took 0.9s. Estimated remaining: 3m 5s. Rate: 184.7 symbols/min [2025-09-16T21:19:45.025192] [INFO ] [MAIN ] PRKS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:45.044327] [DEBUG] [MAIN ] PRGO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:45.045123] [INFO ] [MAIN ] PRGO: Generated 1339 derivative records from 34405 primary records. [2025-09-16T21:19:45.045302] [DEBUG] [LOCAL ] PRGO: Saving derivative data. [2025-09-16T21:19:45.057702] [DEBUG] [LOCAL ] PRGO: Derivative data saved (1339 records). [2025-09-16T21:19:45.057867] [INFO ] [MAIN ] PRGO: Successfully saved derivative data. [2025-09-16T21:19:45.059995] [INFO ] [MAIN ] Derivative Progress: 1458/2026 symbols completed. PRGO took 0.9s. Estimated remaining: 3m 4s. Rate: 184.9 symbols/min [2025-09-16T21:19:45.069731] [INFO ] [MAIN ] PRLB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:45.070204] [DEBUG] [LOCAL ] PRIM: Loaded 33058 existing records from primary storage. [2025-09-16T21:19:45.070609] [INFO ] [MAIN ] PRIM: Loaded 33058 primary data records. [2025-09-16T21:19:45.199625] [DEBUG] [LOCAL ] PRLB: Loaded 14854 existing records from primary storage. [2025-09-16T21:19:45.220520] [INFO ] [MAIN ] PRLB: Loaded 14854 primary data records. [2025-09-16T21:19:45.226634] [DEBUG] [LOCAL ] PRKS: Loaded 31477 existing records from primary storage. [2025-09-16T21:19:45.283136] [INFO ] [MAIN ] PRKS: Loaded 31477 primary data records. [2025-09-16T21:19:45.938966] [DEBUG] [MAIN ] PRIM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:45.940674] [INFO ] [MAIN ] PRIM: Generated 1339 derivative records from 33058 primary records. [2025-09-16T21:19:45.940985] [DEBUG] [LOCAL ] PRIM: Saving derivative data. [2025-09-16T21:19:45.957505] [DEBUG] [LOCAL ] PRIM: Derivative data saved (1339 records). [2025-09-16T21:19:45.957671] [INFO ] [MAIN ] PRIM: Successfully saved derivative data. [2025-09-16T21:19:45.959583] [INFO ] [MAIN ] Derivative Progress: 1459/2026 symbols completed. PRIM took 1.0s. Estimated remaining: 3m 4s. Rate: 184.6 symbols/min [2025-09-16T21:19:45.960041] [INFO ] [MAIN ] PRM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:45.971865] [DEBUG] [MAIN ] PRLB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:45.972701] [INFO ] [MAIN ] PRLB: Generated 1339 derivative records from 14854 primary records. [2025-09-16T21:19:45.972827] [DEBUG] [LOCAL ] PRLB: Saving derivative data. [2025-09-16T21:19:45.982827] [DEBUG] [MAIN ] PRKS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:45.992970] [INFO ] [MAIN ] PRKS: Generated 1339 derivative records from 31477 primary records. [2025-09-16T21:19:45.993623] [DEBUG] [LOCAL ] PRKS: Saving derivative data. [2025-09-16T21:19:45.994828] [DEBUG] [LOCAL ] PRLB: Derivative data saved (1339 records). [2025-09-16T21:19:45.994972] [INFO ] [MAIN ] PRLB: Successfully saved derivative data. [2025-09-16T21:19:45.998016] [INFO ] [MAIN ] Derivative Progress: 1460/2026 symbols completed. PRLB took 0.9s. Estimated remaining: 3m 4s. Rate: 184.7 symbols/min [2025-09-16T21:19:46.004516] [INFO ] [MAIN ] PRMB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:46.010414] [DEBUG] [LOCAL ] PRKS: Derivative data saved (1339 records). [2025-09-16T21:19:46.010728] [INFO ] [MAIN ] PRKS: Successfully saved derivative data. [2025-09-16T21:19:46.012892] [INFO ] [MAIN ] Derivative Progress: 1461/2026 symbols completed. PRKS took 1.0s. Estimated remaining: 3m 3s. Rate: 184.9 symbols/min [2025-09-16T21:19:46.021115] [INFO ] [MAIN ] PRO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:46.037118] [DEBUG] [LOCAL ] PRM: Loaded 32987 existing records from primary storage. [2025-09-16T21:19:46.037328] [INFO ] [MAIN ] PRM: Loaded 32987 primary data records. [2025-09-16T21:19:46.194249] [DEBUG] [LOCAL ] PRO: Loaded 28842 existing records from primary storage. [2025-09-16T21:19:46.200367] [INFO ] [MAIN ] PRO: Loaded 28842 primary data records. [2025-09-16T21:19:46.221363] [DEBUG] [LOCAL ] PRMB: Loaded 39667 existing records from primary storage. [2025-09-16T21:19:46.250684] [INFO ] [MAIN ] PRMB: Loaded 39667 primary data records. [2025-09-16T21:19:46.895689] [DEBUG] [MAIN ] PRM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:46.896629] [INFO ] [MAIN ] PRM: Generated 1339 derivative records from 32987 primary records. [2025-09-16T21:19:46.896919] [DEBUG] [LOCAL ] PRM: Saving derivative data. [2025-09-16T21:19:46.909270] [DEBUG] [LOCAL ] PRM: Derivative data saved (1339 records). [2025-09-16T21:19:46.909602] [INFO ] [MAIN ] PRM: Successfully saved derivative data. [2025-09-16T21:19:46.912675] [INFO ] [MAIN ] Derivative Progress: 1462/2026 symbols completed. PRM took 1.0s. Estimated remaining: 3m 3s. Rate: 184.6 symbols/min [2025-09-16T21:19:46.913565] [INFO ] [MAIN ] PRSU: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:46.925998] [DEBUG] [MAIN ] PRO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:46.926815] [INFO ] [MAIN ] PRO: Generated 1339 derivative records from 28842 primary records. [2025-09-16T21:19:46.926968] [DEBUG] [LOCAL ] PRO: Saving derivative data. [2025-09-16T21:19:46.945792] [DEBUG] [MAIN ] PRMB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:46.952706] [INFO ] [MAIN ] PRMB: Generated 1339 derivative records from 39667 primary records. [2025-09-16T21:19:46.953326] [DEBUG] [LOCAL ] PRO: Derivative data saved (1339 records). [2025-09-16T21:19:46.953366] [DEBUG] [LOCAL ] PRMB: Saving derivative data. [2025-09-16T21:19:46.954038] [INFO ] [MAIN ] PRO: Successfully saved derivative data. [2025-09-16T21:19:46.956081] [INFO ] [MAIN ] Derivative Progress: 1463/2026 symbols completed. PRO took 0.9s. Estimated remaining: 3m 3s. Rate: 184.7 symbols/min [2025-09-16T21:19:46.956508] [INFO ] [MAIN ] PRT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:46.973503] [DEBUG] [LOCAL ] PRSU: Loaded 17710 existing records from primary storage. [2025-09-16T21:19:46.974258] [INFO ] [MAIN ] PRSU: Loaded 17710 primary data records. [2025-09-16T21:19:46.974559] [DEBUG] [LOCAL ] PRMB: Derivative data saved (1339 records). [2025-09-16T21:19:46.986563] [INFO ] [MAIN ] PRMB: Successfully saved derivative data. [2025-09-16T21:19:47.008210] [INFO ] [MAIN ] Derivative Progress: 1464/2026 symbols completed. PRMB took 1.0s. Estimated remaining: 3m 2s. Rate: 184.9 symbols/min [2025-09-16T21:19:47.020365] [INFO ] [MAIN ] PRU: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:47.048512] [DEBUG] [LOCAL ] PRT: Loaded 3670 existing records from primary storage. [2025-09-16T21:19:47.054752] [INFO ] [MAIN ] PRT: Loaded 3670 primary data records. [2025-09-16T21:19:47.524703] [DEBUG] [LOCAL ] PRU: Loaded 38205 existing records from primary storage. [2025-09-16T21:19:47.525980] [INFO ] [MAIN ] PRU: Loaded 38205 primary data records. [2025-09-16T21:19:47.852789] [DEBUG] [MAIN ] PRSU: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:47.856019] [INFO ] [MAIN ] PRSU: Generated 1339 derivative records from 17710 primary records. [2025-09-16T21:19:47.856353] [DEBUG] [LOCAL ] PRSU: Saving derivative data. [2025-09-16T21:19:47.878803] [DEBUG] [LOCAL ] PRSU: Derivative data saved (1339 records). [2025-09-16T21:19:47.879110] [INFO ] [MAIN ] PRSU: Successfully saved derivative data. [2025-09-16T21:19:47.881536] [INFO ] [MAIN ] Derivative Progress: 1465/2026 symbols completed. PRSU took 1.0s. Estimated remaining: 3m 2s. Rate: 184.6 symbols/min [2025-09-16T21:19:47.882291] [DEBUG] [MAIN ] PRT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:47.883151] [INFO ] [MAIN ] PSA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:47.882979] [INFO ] [MAIN ] PRT: Generated 1339 derivative records from 3670 primary records. [2025-09-16T21:19:47.883363] [DEBUG] [LOCAL ] PRT: Saving derivative data. [2025-09-16T21:19:47.895214] [DEBUG] [LOCAL ] PRT: Derivative data saved (1339 records). [2025-09-16T21:19:47.895563] [INFO ] [MAIN ] PRT: Successfully saved derivative data. [2025-09-16T21:19:47.897693] [INFO ] [MAIN ] Derivative Progress: 1466/2026 symbols completed. PRT took 0.9s. Estimated remaining: 3m 2s. Rate: 184.8 symbols/min [2025-09-16T21:19:47.898188] [INFO ] [MAIN ] PSBD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:47.911972] [DEBUG] [MAIN ] PRU: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:47.912773] [INFO ] [MAIN ] PRU: Generated 1339 derivative records from 38205 primary records. [2025-09-16T21:19:47.912944] [DEBUG] [LOCAL ] PRU: Saving derivative data. [2025-09-16T21:19:47.916698] [DEBUG] [LOCAL ] PSBD: Loaded 5191 existing records from primary storage. [2025-09-16T21:19:47.922584] [INFO ] [MAIN ] PSBD: Loaded 5191 primary data records. [2025-09-16T21:19:47.933701] [DEBUG] [LOCAL ] PRU: Derivative data saved (1339 records). [2025-09-16T21:19:47.957439] [INFO ] [MAIN ] PRU: Successfully saved derivative data. [2025-09-16T21:19:47.975030] [INFO ] [MAIN ] Derivative Progress: 1467/2026 symbols completed. PRU took 1.0s. Estimated remaining: 3m 1s. Rate: 184.9 symbols/min [2025-09-16T21:19:47.982225] [INFO ] [MAIN ] PSF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:48.057858] [DEBUG] [LOCAL ] PSA: Loaded 31255 existing records from primary storage. [2025-09-16T21:19:48.095532] [DEBUG] [LOCAL ] PSF: Loaded 5008 existing records from primary storage. [2025-09-16T21:19:48.124702] [INFO ] [MAIN ] PSF: Loaded 5008 primary data records. [2025-09-16T21:19:48.095606] [INFO ] [MAIN ] PSA: Loaded 31255 primary data records. [2025-09-16T21:19:48.756928] [DEBUG] [MAIN ] PSBD: Filtered 5181 bins outside market hours, 5781 incomplete bins [2025-09-16T21:19:48.758495] [INFO ] [MAIN ] PSBD: Generated 1337 derivative records from 5191 primary records. [2025-09-16T21:19:48.758850] [DEBUG] [LOCAL ] PSBD: Saving derivative data. [2025-09-16T21:19:48.771568] [DEBUG] [LOCAL ] PSBD: Derivative data saved (1337 records). [2025-09-16T21:19:48.771775] [INFO ] [MAIN ] PSBD: Successfully saved derivative data. [2025-09-16T21:19:48.773491] [INFO ] [MAIN ] Derivative Progress: 1468/2026 symbols completed. PSBD took 0.9s. Estimated remaining: 3m 1s. Rate: 184.7 symbols/min [2025-09-16T21:19:48.797212] [DEBUG] [MAIN ] PSF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:48.797536] [DEBUG] [MAIN ] PSA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:48.798212] [INFO ] [MAIN ] PSA: Generated 1339 derivative records from 31255 primary records. [2025-09-16T21:19:48.798861] [INFO ] [MAIN ] PSF: Generated 1339 derivative records from 5008 primary records. [2025-09-16T21:19:48.799021] [DEBUG] [LOCAL ] PSA: Saving derivative data. [2025-09-16T21:19:48.799067] [DEBUG] [LOCAL ] PSF: Saving derivative data. [2025-09-16T21:19:48.821471] [DEBUG] [LOCAL ] PSA: Derivative data saved (1339 records). [2025-09-16T21:19:48.822458] [DEBUG] [LOCAL ] PSF: Derivative data saved (1339 records). [2025-09-16T21:19:48.822549] [INFO ] [MAIN ] PSA: Successfully saved derivative data. [2025-09-16T21:19:48.824792] [INFO ] [MAIN ] Derivative Progress: 1469/2026 symbols completed. PSA took 0.9s. Estimated remaining: 3m 1s. Rate: 184.8 symbols/min [2025-09-16T21:19:48.824899] [INFO ] [MAIN ] PSF: Successfully saved derivative data. [2025-09-16T21:19:48.827057] [INFO ] [MAIN ] Derivative Progress: 1470/2026 symbols completed. PSF took 0.8s. Estimated remaining: 3m 0s. Rate: 184.9 symbols/min [2025-09-16T21:19:48.827557] [INFO ] [MAIN ] PSO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:48.827740] [INFO ] [MAIN ] PSN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:48.827443] [INFO ] [MAIN ] PSFE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:48.863098] [DEBUG] [LOCAL ] PSFE: Loaded 22752 existing records from primary storage. [2025-09-16T21:19:48.863234] [INFO ] [MAIN ] PSFE: Loaded 22752 primary data records. [2025-09-16T21:19:48.980622] [DEBUG] [LOCAL ] PSO: Loaded 27028 existing records from primary storage. [2025-09-16T21:19:48.984363] [INFO ] [MAIN ] PSO: Loaded 27028 primary data records. [2025-09-16T21:19:49.011810] [DEBUG] [LOCAL ] PSN: Loaded 33985 existing records from primary storage. [2025-09-16T21:19:49.067957] [INFO ] [MAIN ] PSN: Loaded 33985 primary data records. [2025-09-16T21:19:49.691311] [DEBUG] [MAIN ] PSFE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:49.692253] [INFO ] [MAIN ] PSFE: Generated 1339 derivative records from 22752 primary records. [2025-09-16T21:19:49.692542] [DEBUG] [LOCAL ] PSFE: Saving derivative data. [2025-09-16T21:19:49.708417] [DEBUG] [LOCAL ] PSFE: Derivative data saved (1339 records). [2025-09-16T21:19:49.717478] [INFO ] [MAIN ] PSFE: Successfully saved derivative data. [2025-09-16T21:19:49.728147] [INFO ] [MAIN ] Derivative Progress: 1471/2026 symbols completed. PSFE took 0.9s. Estimated remaining: 3m 0s. Rate: 184.7 symbols/min [2025-09-16T21:19:49.728717] [INFO ] [MAIN ] PSQH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:49.728399] [DEBUG] [MAIN ] PSO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:49.729600] [INFO ] [MAIN ] PSO: Generated 1339 derivative records from 27028 primary records. [2025-09-16T21:19:49.729715] [DEBUG] [LOCAL ] PSO: Saving derivative data. [2025-09-16T21:19:49.729032] [DEBUG] [MAIN ] PSN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:49.730872] [INFO ] [MAIN ] PSN: Generated 1339 derivative records from 33985 primary records. [2025-09-16T21:19:49.731063] [DEBUG] [LOCAL ] PSN: Saving derivative data. [2025-09-16T21:19:49.751972] [DEBUG] [LOCAL ] PSO: Derivative data saved (1339 records). [2025-09-16T21:19:49.752842] [INFO ] [MAIN ] PSO: Successfully saved derivative data. [2025-09-16T21:19:49.756160] [INFO ] [MAIN ] Derivative Progress: 1472/2026 symbols completed. PSO took 0.9s. Estimated remaining: 2m 60s. Rate: 184.8 symbols/min [2025-09-16T21:19:49.756454] [INFO ] [MAIN ] PSTG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:49.756266] [DEBUG] [LOCAL ] PSN: Derivative data saved (1339 records). [2025-09-16T21:19:49.756949] [INFO ] [MAIN ] PSN: Successfully saved derivative data. [2025-09-16T21:19:49.760114] [INFO ] [MAIN ] Derivative Progress: 1473/2026 symbols completed. PSN took 0.9s. Estimated remaining: 2m 59s. Rate: 184.9 symbols/min [2025-09-16T21:19:49.762747] [INFO ] [MAIN ] PSTL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:49.780544] [DEBUG] [LOCAL ] PSQH: Loaded 25211 existing records from primary storage. [2025-09-16T21:19:49.780733] [INFO ] [MAIN ] PSQH: Loaded 25211 primary data records. [2025-09-16T21:19:49.899812] [DEBUG] [LOCAL ] PSTL: Loaded 14935 existing records from primary storage. [2025-09-16T21:19:49.910577] [INFO ] [MAIN ] PSTL: Loaded 14935 primary data records. [2025-09-16T21:19:50.159560] [DEBUG] [LOCAL ] PSTG: Loaded 39292 existing records from primary storage. [2025-09-16T21:19:50.188238] [INFO ] [MAIN ] PSTG: Loaded 39292 primary data records. [2025-09-16T21:19:50.637399] [DEBUG] [MAIN ] PSQH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:50.638612] [INFO ] [MAIN ] PSQH: Generated 1339 derivative records from 25211 primary records. [2025-09-16T21:19:50.638723] [DEBUG] [LOCAL ] PSQH: Saving derivative data. [2025-09-16T21:19:50.663544] [DEBUG] [MAIN ] PSTL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:50.665609] [INFO ] [MAIN ] PSTL: Generated 1339 derivative records from 14935 primary records. [2025-09-16T21:19:50.664905] [DEBUG] [LOCAL ] PSQH: Derivative data saved (1339 records). [2025-09-16T21:19:50.665991] [INFO ] [MAIN ] PSQH: Successfully saved derivative data. [2025-09-16T21:19:50.666044] [DEBUG] [LOCAL ] PSTL: Saving derivative data. [2025-09-16T21:19:50.668362] [INFO ] [MAIN ] Derivative Progress: 1474/2026 symbols completed. PSQH took 0.9s. Estimated remaining: 2m 59s. Rate: 184.7 symbols/min [2025-09-16T21:19:50.668681] [INFO ] [MAIN ] PSX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:50.684215] [DEBUG] [LOCAL ] PSTL: Derivative data saved (1339 records). [2025-09-16T21:19:50.684425] [INFO ] [MAIN ] PSTL: Successfully saved derivative data. [2025-09-16T21:19:50.687083] [INFO ] [MAIN ] Derivative Progress: 1475/2026 symbols completed. PSTL took 0.9s. Estimated remaining: 2m 59s. Rate: 184.8 symbols/min [2025-09-16T21:19:50.693038] [INFO ] [MAIN ] PTA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:50.697479] [DEBUG] [MAIN ] PSTG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:50.698106] [INFO ] [MAIN ] PSTG: Generated 1339 derivative records from 39292 primary records. [2025-09-16T21:19:50.698237] [DEBUG] [LOCAL ] PSTG: Saving derivative data. [2025-09-16T21:19:50.710625] [DEBUG] [LOCAL ] PSTG: Derivative data saved (1339 records). [2025-09-16T21:19:50.710746] [INFO ] [MAIN ] PSTG: Successfully saved derivative data. [2025-09-16T21:19:50.715074] [INFO ] [MAIN ] Derivative Progress: 1476/2026 symbols completed. PSTG took 1.0s. Estimated remaining: 2m 58s. Rate: 184.9 symbols/min [2025-09-16T21:19:50.715414] [INFO ] [MAIN ] PTY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:50.721345] [DEBUG] [LOCAL ] PTA: Loaded 10626 existing records from primary storage. [2025-09-16T21:19:50.721460] [INFO ] [MAIN ] PTA: Loaded 10626 primary data records. [2025-09-16T21:19:50.925656] [DEBUG] [LOCAL ] PSX: Loaded 39616 existing records from primary storage. [2025-09-16T21:19:50.931663] [INFO ] [MAIN ] PSX: Loaded 39616 primary data records. [2025-09-16T21:19:51.097846] [DEBUG] [LOCAL ] PTY: Loaded 27365 existing records from primary storage. [2025-09-16T21:19:51.116891] [INFO ] [MAIN ] PTY: Loaded 27365 primary data records. [2025-09-16T21:19:51.553547] [DEBUG] [MAIN ] PTA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:51.554405] [INFO ] [MAIN ] PTA: Generated 1339 derivative records from 10626 primary records. [2025-09-16T21:19:51.554875] [DEBUG] [LOCAL ] PTA: Saving derivative data. [2025-09-16T21:19:51.568014] [DEBUG] [LOCAL ] PTA: Derivative data saved (1339 records). [2025-09-16T21:19:51.568298] [INFO ] [MAIN ] PTA: Successfully saved derivative data. [2025-09-16T21:19:51.570844] [INFO ] [MAIN ] Derivative Progress: 1477/2026 symbols completed. PTA took 0.9s. Estimated remaining: 2m 58s. Rate: 184.7 symbols/min [2025-09-16T21:19:51.571794] [INFO ] [MAIN ] PUK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:51.583169] [DEBUG] [MAIN ] PSX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:51.583884] [INFO ] [MAIN ] PSX: Generated 1339 derivative records from 39616 primary records. [2025-09-16T21:19:51.584028] [DEBUG] [LOCAL ] PSX: Saving derivative data. [2025-09-16T21:19:51.597827] [DEBUG] [LOCAL ] PSX: Derivative data saved (1339 records). [2025-09-16T21:19:51.607393] [INFO ] [MAIN ] PSX: Successfully saved derivative data. [2025-09-16T21:19:51.609283] [INFO ] [MAIN ] Derivative Progress: 1478/2026 symbols completed. PSX took 0.9s. Estimated remaining: 2m 58s. Rate: 184.8 symbols/min [2025-09-16T21:19:51.609574] [DEBUG] [MAIN ] PTY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:51.609909] [INFO ] [MAIN ] PUMP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:51.610557] [INFO ] [MAIN ] PTY: Generated 1339 derivative records from 27365 primary records. [2025-09-16T21:19:51.610928] [DEBUG] [LOCAL ] PTY: Saving derivative data. [2025-09-16T21:19:51.630786] [DEBUG] [LOCAL ] PTY: Derivative data saved (1339 records). [2025-09-16T21:19:51.630906] [INFO ] [MAIN ] PTY: Successfully saved derivative data. [2025-09-16T21:19:51.633071] [INFO ] [MAIN ] Derivative Progress: 1479/2026 symbols completed. PTY took 0.9s. Estimated remaining: 2m 57s. Rate: 184.9 symbols/min [2025-09-16T21:19:51.633310] [INFO ] [MAIN ] PVH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:51.645301] [DEBUG] [LOCAL ] PUK: Loaded 32480 existing records from primary storage. [2025-09-16T21:19:51.645489] [INFO ] [MAIN ] PUK: Loaded 32480 primary data records. [2025-09-16T21:19:51.852146] [DEBUG] [LOCAL ] PUMP: Loaded 36673 existing records from primary storage. [2025-09-16T21:19:51.855105] [INFO ] [MAIN ] PUMP: Loaded 36673 primary data records. [2025-09-16T21:19:51.995492] [DEBUG] [LOCAL ] PVH: Loaded 37679 existing records from primary storage. [2025-09-16T21:19:52.018395] [INFO ] [MAIN ] PVH: Loaded 37679 primary data records. [2025-09-16T21:19:52.528306] [DEBUG] [MAIN ] PUK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:52.529410] [INFO ] [MAIN ] PUK: Generated 1339 derivative records from 32480 primary records. [2025-09-16T21:19:52.529617] [DEBUG] [LOCAL ] PUK: Saving derivative data. [2025-09-16T21:19:52.543554] [DEBUG] [LOCAL ] PUK: Derivative data saved (1339 records). [2025-09-16T21:19:52.544208] [INFO ] [MAIN ] PUK: Successfully saved derivative data. [2025-09-16T21:19:52.546263] [INFO ] [MAIN ] Derivative Progress: 1480/2026 symbols completed. PUK took 1.0s. Estimated remaining: 2m 57s. Rate: 184.7 symbols/min [2025-09-16T21:19:52.546704] [INFO ] [MAIN ] PVL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:52.555185] [DEBUG] [LOCAL ] PVL: Loaded 3507 existing records from primary storage. [2025-09-16T21:19:52.564761] [INFO ] [MAIN ] PVL: Loaded 3507 primary data records. [2025-09-16T21:19:52.570930] [DEBUG] [MAIN ] PVH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:52.595821] [INFO ] [MAIN ] PVH: Generated 1339 derivative records from 37679 primary records. [2025-09-16T21:19:52.585713] [DEBUG] [MAIN ] PUMP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:52.631163] [DEBUG] [LOCAL ] PVH: Saving derivative data. [2025-09-16T21:19:52.618935] [INFO ] [MAIN ] PUMP: Generated 1339 derivative records from 36673 primary records. [2025-09-16T21:19:52.640600] [DEBUG] [LOCAL ] PUMP: Saving derivative data. [2025-09-16T21:19:52.699947] [DEBUG] [LOCAL ] PVH: Derivative data saved (1339 records). [2025-09-16T21:19:52.705496] [INFO ] [MAIN ] PVH: Successfully saved derivative data. [2025-09-16T21:19:52.748131] [INFO ] [MAIN ] Derivative Progress: 1481/2026 symbols completed. PVH took 1.1s. Estimated remaining: 2m 57s. Rate: 184.8 symbols/min [2025-09-16T21:19:52.748510] [DEBUG] [LOCAL ] PUMP: Derivative data saved (1339 records). [2025-09-16T21:19:52.748339] [INFO ] [MAIN ] PWR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:52.780622] [INFO ] [MAIN ] PUMP: Successfully saved derivative data. [2025-09-16T21:19:52.786077] [INFO ] [MAIN ] Derivative Progress: 1482/2026 symbols completed. PUMP took 1.2s. Estimated remaining: 2m 57s. Rate: 184.9 symbols/min [2025-09-16T21:19:52.870044] [INFO ] [MAIN ] PX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:52.898162] [DEBUG] [MAIN ] PVL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:52.914376] [DEBUG] [LOCAL ] PX: Loaded 25920 existing records from primary storage. [2025-09-16T21:19:52.913841] [INFO ] [MAIN ] PVL: Generated 1339 derivative records from 3507 primary records. [2025-09-16T21:19:52.914570] [INFO ] [MAIN ] PX: Loaded 25920 primary data records. [2025-09-16T21:19:52.914528] [DEBUG] [LOCAL ] PVL: Saving derivative data. [2025-09-16T21:19:53.032293] [DEBUG] [LOCAL ] PWR: Loaded 34768 existing records from primary storage. [2025-09-16T21:19:53.036133] [INFO ] [MAIN ] PWR: Loaded 34768 primary data records. [2025-09-16T21:19:53.048037] [DEBUG] [LOCAL ] PVL: Derivative data saved (1339 records). [2025-09-16T21:19:53.067555] [INFO ] [MAIN ] PVL: Successfully saved derivative data. [2025-09-16T21:19:53.089686] [INFO ] [MAIN ] Derivative Progress: 1483/2026 symbols completed. PVL took 0.5s. Estimated remaining: 2m 56s. Rate: 184.9 symbols/min [2025-09-16T21:19:53.473654] [DEBUG] [MAIN ] PX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:53.474325] [INFO ] [MAIN ] PX: Generated 1339 derivative records from 25920 primary records. [2025-09-16T21:19:53.474520] [DEBUG] [LOCAL ] PX: Saving derivative data. [2025-09-16T21:19:53.488080] [DEBUG] [LOCAL ] PX: Derivative data saved (1339 records). [2025-09-16T21:19:53.488174] [INFO ] [MAIN ] PX: Successfully saved derivative data. [2025-09-16T21:19:53.489763] [INFO ] [MAIN ] Derivative Progress: 1484/2026 symbols completed. PX took 0.6s. Estimated remaining: 2m 56s. Rate: 184.9 symbols/min [2025-09-16T21:19:53.499203] [DEBUG] [MAIN ] PWR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:53.499758] [INFO ] [MAIN ] PWR: Generated 1339 derivative records from 34768 primary records. [2025-09-16T21:19:53.499817] [DEBUG] [LOCAL ] PWR: Saving derivative data. [2025-09-16T21:19:53.511254] [DEBUG] [LOCAL ] PWR: Derivative data saved (1339 records). [2025-09-16T21:19:53.511311] [INFO ] [MAIN ] PWR: Successfully saved derivative data. [2025-09-16T21:19:53.513475] [INFO ] [MAIN ] Derivative Progress: 1485/2026 symbols completed. PWR took 0.8s. Estimated remaining: 2m 55s. Rate: 185.0 symbols/min [2025-09-16T21:19:53.514080] [INFO ] [MAIN ] QD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:53.514159] [INFO ] [MAIN ] QGEN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:53.514819] [INFO ] [MAIN ] QBTS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:53.534911] [DEBUG] [LOCAL ] QD: Loaded 20498 existing records from primary storage. [2025-09-16T21:19:53.535078] [INFO ] [MAIN ] QD: Loaded 20498 primary data records. [2025-09-16T21:19:53.741462] [DEBUG] [LOCAL ] QGEN: Loaded 36667 existing records from primary storage. [2025-09-16T21:19:53.829170] [INFO ] [MAIN ] QGEN: Loaded 36667 primary data records. [2025-09-16T21:19:53.840579] [DEBUG] [LOCAL ] QBTS: Loaded 40170 existing records from primary storage. [2025-09-16T21:19:53.840854] [INFO ] [MAIN ] QBTS: Loaded 40170 primary data records. [2025-09-16T21:19:54.434897] [DEBUG] [MAIN ] QD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:54.435976] [INFO ] [MAIN ] QD: Generated 1339 derivative records from 20498 primary records. [2025-09-16T21:19:54.436806] [DEBUG] [LOCAL ] QD: Saving derivative data. [2025-09-16T21:19:54.450053] [DEBUG] [LOCAL ] QD: Derivative data saved (1339 records). [2025-09-16T21:19:54.450350] [INFO ] [MAIN ] QD: Successfully saved derivative data. [2025-09-16T21:19:54.452094] [INFO ] [MAIN ] Derivative Progress: 1486/2026 symbols completed. QD took 0.9s. Estimated remaining: 2m 55s. Rate: 184.7 symbols/min [2025-09-16T21:19:54.452363] [INFO ] [MAIN ] QS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:54.469598] [DEBUG] [MAIN ] QBTS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:54.470393] [INFO ] [MAIN ] QBTS: Generated 1339 derivative records from 40170 primary records. [2025-09-16T21:19:54.475977] [DEBUG] [LOCAL ] QBTS: Saving derivative data. [2025-09-16T21:19:54.479977] [DEBUG] [MAIN ] QGEN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:54.481118] [INFO ] [MAIN ] QGEN: Generated 1339 derivative records from 36667 primary records. [2025-09-16T21:19:54.488560] [DEBUG] [LOCAL ] QGEN: Saving derivative data. [2025-09-16T21:19:54.513834] [DEBUG] [LOCAL ] QBTS: Derivative data saved (1339 records). [2025-09-16T21:19:54.515094] [DEBUG] [LOCAL ] QGEN: Derivative data saved (1339 records). [2025-09-16T21:19:54.515215] [INFO ] [MAIN ] QBTS: Successfully saved derivative data. [2025-09-16T21:19:54.515306] [INFO ] [MAIN ] QGEN: Successfully saved derivative data. [2025-09-16T21:19:54.517455] [INFO ] [MAIN ] Derivative Progress: 1487/2026 symbols completed. QGEN took 1.0s. Estimated remaining: 2m 55s. Rate: 184.8 symbols/min [2025-09-16T21:19:54.517746] [INFO ] [MAIN ] QSR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:54.519300] [INFO ] [MAIN ] Derivative Progress: 1488/2026 symbols completed. QBTS took 1.0s. Estimated remaining: 2m 55s. Rate: 185.0 symbols/min [2025-09-16T21:19:54.520343] [INFO ] [MAIN ] QTWO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:54.533152] [DEBUG] [LOCAL ] QS: Loaded 40119 existing records from primary storage. [2025-09-16T21:19:54.533304] [INFO ] [MAIN ] QS: Loaded 40119 primary data records. [2025-09-16T21:19:54.831080] [DEBUG] [LOCAL ] QTWO: Loaded 28169 existing records from primary storage. [2025-09-16T21:19:54.831278] [INFO ] [MAIN ] QTWO: Loaded 28169 primary data records. [2025-09-16T21:19:54.831828] [DEBUG] [LOCAL ] QSR: Loaded 39075 existing records from primary storage. [2025-09-16T21:19:54.843081] [INFO ] [MAIN ] QSR: Loaded 39075 primary data records. [2025-09-16T21:19:55.374921] [DEBUG] [MAIN ] QS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:55.377142] [INFO ] [MAIN ] QS: Generated 1339 derivative records from 40119 primary records. [2025-09-16T21:19:55.377463] [DEBUG] [LOCAL ] QS: Saving derivative data. [2025-09-16T21:19:55.392131] [DEBUG] [LOCAL ] QS: Derivative data saved (1339 records). [2025-09-16T21:19:55.392248] [INFO ] [MAIN ] QS: Successfully saved derivative data. [2025-09-16T21:19:55.394029] [INFO ] [MAIN ] Derivative Progress: 1489/2026 symbols completed. QS took 0.9s. Estimated remaining: 2m 54s. Rate: 184.7 symbols/min [2025-09-16T21:19:55.394458] [INFO ] [MAIN ] QUAD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:55.407682] [DEBUG] [MAIN ] QTWO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:55.408305] [INFO ] [MAIN ] QTWO: Generated 1339 derivative records from 28169 primary records. [2025-09-16T21:19:55.408468] [DEBUG] [LOCAL ] QTWO: Saving derivative data. [2025-09-16T21:19:55.422296] [DEBUG] [LOCAL ] QTWO: Derivative data saved (1339 records). [2025-09-16T21:19:55.427241] [INFO ] [MAIN ] QTWO: Successfully saved derivative data. [2025-09-16T21:19:55.428866] [INFO ] [MAIN ] Derivative Progress: 1490/2026 symbols completed. QTWO took 0.9s. Estimated remaining: 2m 54s. Rate: 184.9 symbols/min [2025-09-16T21:19:55.429196] [INFO ] [MAIN ] QVCC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:55.440580] [DEBUG] [MAIN ] QSR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:55.448636] [INFO ] [MAIN ] QSR: Generated 1339 derivative records from 39075 primary records. [2025-09-16T21:19:55.448791] [DEBUG] [LOCAL ] QSR: Saving derivative data. [2025-09-16T21:19:55.449167] [DEBUG] [LOCAL ] QUAD: Loaded 17753 existing records from primary storage. [2025-09-16T21:19:55.449963] [INFO ] [MAIN ] QUAD: Loaded 17753 primary data records. [2025-09-16T21:19:55.452976] [DEBUG] [LOCAL ] QVCC: Loaded 6522 existing records from primary storage. [2025-09-16T21:19:55.458743] [INFO ] [MAIN ] QVCC: Loaded 6522 primary data records. [2025-09-16T21:19:55.614873] [DEBUG] [LOCAL ] QSR: Derivative data saved (1339 records). [2025-09-16T21:19:55.658288] [INFO ] [MAIN ] QSR: Successfully saved derivative data. [2025-09-16T21:19:55.668743] [INFO ] [MAIN ] Derivative Progress: 1491/2026 symbols completed. QSR took 1.2s. Estimated remaining: 2m 54s. Rate: 184.9 symbols/min [2025-09-16T21:19:55.671961] [INFO ] [MAIN ] QVCD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:55.987775] [DEBUG] [LOCAL ] QVCD: Loaded 3381 existing records from primary storage. [2025-09-16T21:19:55.988625] [INFO ] [MAIN ] QVCD: Loaded 3381 primary data records. [2025-09-16T21:19:56.270832] [DEBUG] [MAIN ] QUAD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:56.272166] [INFO ] [MAIN ] QUAD: Generated 1339 derivative records from 17753 primary records. [2025-09-16T21:19:56.274029] [DEBUG] [LOCAL ] QUAD: Saving derivative data. [2025-09-16T21:19:56.290856] [DEBUG] [MAIN ] QVCC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:56.291478] [INFO ] [MAIN ] QVCC: Generated 1339 derivative records from 6522 primary records. [2025-09-16T21:19:56.293816] [DEBUG] [LOCAL ] QVCC: Saving derivative data. [2025-09-16T21:19:56.296943] [DEBUG] [LOCAL ] QUAD: Derivative data saved (1339 records). [2025-09-16T21:19:56.297230] [INFO ] [MAIN ] QUAD: Successfully saved derivative data. [2025-09-16T21:19:56.307553] [INFO ] [MAIN ] Derivative Progress: 1492/2026 symbols completed. QUAD took 0.9s. Estimated remaining: 2m 53s. Rate: 184.8 symbols/min [2025-09-16T21:19:56.308615] [INFO ] [MAIN ] QXO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:56.309757] [DEBUG] [LOCAL ] QVCC: Derivative data saved (1339 records). [2025-09-16T21:19:56.310075] [INFO ] [MAIN ] QVCC: Successfully saved derivative data. [2025-09-16T21:19:56.312911] [INFO ] [MAIN ] Derivative Progress: 1493/2026 symbols completed. QVCC took 0.9s. Estimated remaining: 2m 53s. Rate: 184.9 symbols/min [2025-09-16T21:19:56.314577] [INFO ] [MAIN ] R: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:56.324870] [DEBUG] [MAIN ] QVCD: Filtered 5181 bins outside market hours, 5781 incomplete bins [2025-09-16T21:19:56.325498] [INFO ] [MAIN ] QVCD: Generated 1337 derivative records from 3381 primary records. [2025-09-16T21:19:56.325628] [DEBUG] [LOCAL ] QVCD: Saving derivative data. [2025-09-16T21:19:56.336562] [DEBUG] [LOCAL ] QVCD: Derivative data saved (1337 records). [2025-09-16T21:19:56.336719] [INFO ] [MAIN ] QVCD: Successfully saved derivative data. [2025-09-16T21:19:56.338887] [INFO ] [MAIN ] Derivative Progress: 1494/2026 symbols completed. QVCD took 0.7s. Estimated remaining: 2m 53s. Rate: 185.0 symbols/min [2025-09-16T21:19:56.339137] [INFO ] [MAIN ] RA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:56.358920] [DEBUG] [LOCAL ] R: Loaded 20314 existing records from primary storage. [2025-09-16T21:19:56.366899] [INFO ] [MAIN ] R: Loaded 20314 primary data records. [2025-09-16T21:19:56.421768] [DEBUG] [LOCAL ] RA: Loaded 15866 existing records from primary storage. [2025-09-16T21:19:56.443278] [INFO ] [MAIN ] RA: Loaded 15866 primary data records. [2025-09-16T21:19:56.621965] [DEBUG] [LOCAL ] QXO: Loaded 39903 existing records from primary storage. [2025-09-16T21:19:56.672492] [INFO ] [MAIN ] QXO: Loaded 39903 primary data records. [2025-09-16T21:19:57.241238] [DEBUG] [MAIN ] R: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:57.243107] [INFO ] [MAIN ] R: Generated 1339 derivative records from 20314 primary records. [2025-09-16T21:19:57.243376] [DEBUG] [LOCAL ] R: Saving derivative data. [2025-09-16T21:19:57.269499] [DEBUG] [MAIN ] RA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:57.271791] [DEBUG] [MAIN ] QXO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:57.272915] [INFO ] [MAIN ] RA: Generated 1339 derivative records from 15866 primary records. [2025-09-16T21:19:57.273265] [DEBUG] [LOCAL ] RA: Saving derivative data. [2025-09-16T21:19:57.273816] [INFO ] [MAIN ] QXO: Generated 1339 derivative records from 39903 primary records. [2025-09-16T21:19:57.276084] [DEBUG] [LOCAL ] QXO: Saving derivative data. [2025-09-16T21:19:57.277172] [DEBUG] [LOCAL ] R: Derivative data saved (1339 records). [2025-09-16T21:19:57.291409] [INFO ] [MAIN ] R: Successfully saved derivative data. [2025-09-16T21:19:57.300654] [DEBUG] [LOCAL ] QXO: Derivative data saved (1339 records). [2025-09-16T21:19:57.299688] [INFO ] [MAIN ] Derivative Progress: 1495/2026 symbols completed. R took 1.0s. Estimated remaining: 2m 52s. Rate: 184.8 symbols/min [2025-09-16T21:19:57.301391] [INFO ] [MAIN ] RACE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:57.301003] [INFO ] [MAIN ] QXO: Successfully saved derivative data. [2025-09-16T21:19:57.302355] [DEBUG] [LOCAL ] RA: Derivative data saved (1339 records). [2025-09-16T21:19:57.304805] [INFO ] [MAIN ] Derivative Progress: 1496/2026 symbols completed. QXO took 1.0s. Estimated remaining: 2m 52s. Rate: 184.9 symbols/min [2025-09-16T21:19:57.305205] [INFO ] [MAIN ] RBA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:57.305258] [INFO ] [MAIN ] RA: Successfully saved derivative data. [2025-09-16T21:19:57.307346] [INFO ] [MAIN ] Derivative Progress: 1497/2026 symbols completed. RA took 1.0s. Estimated remaining: 2m 52s. Rate: 185.0 symbols/min [2025-09-16T21:19:57.307602] [INFO ] [MAIN ] RBC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:57.329825] [DEBUG] [LOCAL ] RBC: Loaded 10908 existing records from primary storage. [2025-09-16T21:19:57.329970] [INFO ] [MAIN ] RBC: Loaded 10908 primary data records. [2025-09-16T21:19:57.458064] [DEBUG] [LOCAL ] RACE: Loaded 22749 existing records from primary storage. [2025-09-16T21:19:57.458891] [DEBUG] [LOCAL ] RBA: Loaded 34109 existing records from primary storage. [2025-09-16T21:19:57.469367] [INFO ] [MAIN ] RACE: Loaded 22749 primary data records. [2025-09-16T21:19:57.479706] [INFO ] [MAIN ] RBA: Loaded 34109 primary data records. [2025-09-16T21:19:58.179363] [DEBUG] [MAIN ] RBC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:58.180573] [INFO ] [MAIN ] RBC: Generated 1339 derivative records from 10908 primary records. [2025-09-16T21:19:58.180702] [DEBUG] [LOCAL ] RBC: Saving derivative data. [2025-09-16T21:19:58.194457] [DEBUG] [LOCAL ] RBC: Derivative data saved (1339 records). [2025-09-16T21:19:58.194703] [INFO ] [MAIN ] RBC: Successfully saved derivative data. [2025-09-16T21:19:58.196566] [INFO ] [MAIN ] Derivative Progress: 1498/2026 symbols completed. RBC took 0.9s. Estimated remaining: 2m 51s. Rate: 184.8 symbols/min [2025-09-16T21:19:58.212356] [DEBUG] [MAIN ] RACE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:58.222416] [INFO ] [MAIN ] RACE: Generated 1339 derivative records from 22749 primary records. [2025-09-16T21:19:58.222609] [DEBUG] [MAIN ] RBA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:58.222736] [DEBUG] [LOCAL ] RACE: Saving derivative data. [2025-09-16T21:19:58.223457] [INFO ] [MAIN ] RBA: Generated 1339 derivative records from 34109 primary records. [2025-09-16T21:19:58.224165] [DEBUG] [LOCAL ] RBA: Saving derivative data. [2025-09-16T21:19:58.245243] [DEBUG] [LOCAL ] RACE: Derivative data saved (1339 records). [2025-09-16T21:19:58.248187] [DEBUG] [LOCAL ] RBA: Derivative data saved (1339 records). [2025-09-16T21:19:58.248369] [INFO ] [MAIN ] RBA: Successfully saved derivative data. [2025-09-16T21:19:58.248420] [INFO ] [MAIN ] RACE: Successfully saved derivative data. [2025-09-16T21:19:58.250609] [INFO ] [MAIN ] Derivative Progress: 1499/2026 symbols completed. RBA took 0.9s. Estimated remaining: 2m 51s. Rate: 184.9 symbols/min [2025-09-16T21:19:58.253007] [INFO ] [MAIN ] Derivative Progress: 1500/2026 symbols completed. RACE took 1.0s. Estimated remaining: 2m 51s. Rate: 185.0 symbols/min [2025-09-16T21:19:58.253680] [INFO ] [MAIN ] RBOT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:58.253858] [INFO ] [MAIN ] RBRK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:58.254393] [INFO ] [MAIN ] RBLX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:58.259915] [DEBUG] [LOCAL ] RBOT: Loaded 3831 existing records from primary storage. [2025-09-16T21:19:58.260099] [INFO ] [MAIN ] RBOT: Loaded 3831 primary data records. [2025-09-16T21:19:58.558055] [DEBUG] [LOCAL ] RBRK: Loaded 39640 existing records from primary storage. [2025-09-16T21:19:58.570074] [INFO ] [MAIN ] RBRK: Loaded 39640 primary data records. [2025-09-16T21:19:58.570771] [DEBUG] [LOCAL ] RBLX: Loaded 40082 existing records from primary storage. [2025-09-16T21:19:58.576128] [INFO ] [MAIN ] RBLX: Loaded 40082 primary data records. [2025-09-16T21:19:59.142040] [DEBUG] [MAIN ] RBOT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:59.143372] [INFO ] [MAIN ] RBOT: Generated 1339 derivative records from 3831 primary records. [2025-09-16T21:19:59.144218] [DEBUG] [LOCAL ] RBOT: Saving derivative data. [2025-09-16T21:19:59.156696] [DEBUG] [LOCAL ] RBOT: Derivative data saved (1339 records). [2025-09-16T21:19:59.156936] [INFO ] [MAIN ] RBOT: Successfully saved derivative data. [2025-09-16T21:19:59.158785] [INFO ] [MAIN ] Derivative Progress: 1501/2026 symbols completed. RBOT took 0.9s. Estimated remaining: 2m 50s. Rate: 184.8 symbols/min [2025-09-16T21:19:59.159155] [INFO ] [MAIN ] RC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:59.174531] [DEBUG] [MAIN ] RBRK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:59.184426] [DEBUG] [MAIN ] RBLX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:19:59.184225] [INFO ] [MAIN ] RBRK: Generated 1339 derivative records from 39640 primary records. [2025-09-16T21:19:59.185067] [DEBUG] [LOCAL ] RBRK: Saving derivative data. [2025-09-16T21:19:59.185012] [INFO ] [MAIN ] RBLX: Generated 1339 derivative records from 40082 primary records. [2025-09-16T21:19:59.185673] [DEBUG] [LOCAL ] RBLX: Saving derivative data. [2025-09-16T21:19:59.207015] [DEBUG] [LOCAL ] RBRK: Derivative data saved (1339 records). [2025-09-16T21:19:59.215396] [INFO ] [MAIN ] RBRK: Successfully saved derivative data. [2025-09-16T21:19:59.217430] [INFO ] [MAIN ] Derivative Progress: 1502/2026 symbols completed. RBRK took 1.0s. Estimated remaining: 2m 50s. Rate: 184.9 symbols/min [2025-09-16T21:19:59.218135] [INFO ] [MAIN ] RCD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:59.219736] [DEBUG] [LOCAL ] RBLX: Derivative data saved (1339 records). [2025-09-16T21:19:59.220388] [INFO ] [MAIN ] RBLX: Successfully saved derivative data. [2025-09-16T21:19:59.222410] [INFO ] [MAIN ] Derivative Progress: 1503/2026 symbols completed. RBLX took 1.0s. Estimated remaining: 2m 50s. Rate: 185.0 symbols/min [2025-09-16T21:19:59.222693] [INFO ] [MAIN ] RCI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:19:59.234801] [DEBUG] [LOCAL ] RCD: Loaded 2583 existing records from primary storage. [2025-09-16T21:19:59.235830] [INFO ] [MAIN ] RCD: Loaded 2583 primary data records. [2025-09-16T21:19:59.257029] [DEBUG] [LOCAL ] RC: Loaded 36064 existing records from primary storage. [2025-09-16T21:19:59.285628] [INFO ] [MAIN ] RC: Loaded 36064 primary data records. [2025-09-16T21:19:59.772978] [DEBUG] [LOCAL ] RCI: Loaded 36083 existing records from primary storage. [2025-09-16T21:19:59.773309] [INFO ] [MAIN ] RCI: Loaded 36083 primary data records. [2025-09-16T21:20:00.074497] [DEBUG] [MAIN ] RC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:00.075015] [DEBUG] [MAIN ] RCD: Filtered 5181 bins outside market hours, 5780 incomplete bins [2025-09-16T21:20:00.076495] [INFO ] [MAIN ] RC: Generated 1339 derivative records from 36064 primary records. [2025-09-16T21:20:00.077081] [INFO ] [MAIN ] RCD: Generated 1338 derivative records from 2583 primary records. [2025-09-16T21:20:00.077283] [DEBUG] [LOCAL ] RCD: Saving derivative data. [2025-09-16T21:20:00.077241] [DEBUG] [LOCAL ] RC: Saving derivative data. [2025-09-16T21:20:00.098839] [DEBUG] [LOCAL ] RCD: Derivative data saved (1338 records). [2025-09-16T21:20:00.099177] [INFO ] [MAIN ] RCD: Successfully saved derivative data. [2025-09-16T21:20:00.100037] [DEBUG] [LOCAL ] RC: Derivative data saved (1339 records). [2025-09-16T21:20:00.102068] [INFO ] [MAIN ] RC: Successfully saved derivative data. [2025-09-16T21:20:00.101917] [INFO ] [MAIN ] Derivative Progress: 1504/2026 symbols completed. RCD took 0.9s. Estimated remaining: 2m 49s. Rate: 184.8 symbols/min [2025-09-16T21:20:00.102383] [INFO ] [MAIN ] RCL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:00.104430] [INFO ] [MAIN ] Derivative Progress: 1505/2026 symbols completed. RC took 0.9s. Estimated remaining: 2m 49s. Rate: 184.9 symbols/min [2025-09-16T21:20:00.105859] [INFO ] [MAIN ] RCS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:00.117900] [DEBUG] [MAIN ] RCI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:00.118589] [INFO ] [MAIN ] RCI: Generated 1339 derivative records from 36083 primary records. [2025-09-16T21:20:00.118718] [DEBUG] [LOCAL ] RCI: Saving derivative data. [2025-09-16T21:20:00.132812] [DEBUG] [LOCAL ] RCI: Derivative data saved (1339 records). [2025-09-16T21:20:00.132955] [INFO ] [MAIN ] RCI: Successfully saved derivative data. [2025-09-16T21:20:00.135008] [INFO ] [MAIN ] Derivative Progress: 1506/2026 symbols completed. RCI took 0.9s. Estimated remaining: 2m 49s. Rate: 185.0 symbols/min [2025-09-16T21:20:00.135262] [INFO ] [MAIN ] RCUS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:00.139438] [DEBUG] [LOCAL ] RCS: Loaded 8493 existing records from primary storage. [2025-09-16T21:20:00.139699] [INFO ] [MAIN ] RCS: Loaded 8493 primary data records. [2025-09-16T21:20:00.432395] [DEBUG] [LOCAL ] RCL: Loaded 38736 existing records from primary storage. [2025-09-16T21:20:00.433417] [INFO ] [MAIN ] RCL: Loaded 38736 primary data records. [2025-09-16T21:20:00.445322] [DEBUG] [LOCAL ] RCUS: Loaded 31661 existing records from primary storage. [2025-09-16T21:20:00.470694] [INFO ] [MAIN ] RCUS: Loaded 31661 primary data records. [2025-09-16T21:20:01.028493] [DEBUG] [MAIN ] RCS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:01.029445] [INFO ] [MAIN ] RCS: Generated 1339 derivative records from 8493 primary records. [2025-09-16T21:20:01.029729] [DEBUG] [LOCAL ] RCS: Saving derivative data. [2025-09-16T21:20:01.044538] [DEBUG] [LOCAL ] RCS: Derivative data saved (1339 records). [2025-09-16T21:20:01.045321] [INFO ] [MAIN ] RCS: Successfully saved derivative data. [2025-09-16T21:20:01.047445] [INFO ] [MAIN ] Derivative Progress: 1507/2026 symbols completed. RCS took 0.9s. Estimated remaining: 2m 48s. Rate: 184.8 symbols/min [2025-09-16T21:20:01.047917] [INFO ] [MAIN ] RDDT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:01.058016] [DEBUG] [MAIN ] RCL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:01.058853] [INFO ] [MAIN ] RCL: Generated 1339 derivative records from 38736 primary records. [2025-09-16T21:20:01.059069] [DEBUG] [LOCAL ] RCL: Saving derivative data. [2025-09-16T21:20:01.073188] [DEBUG] [LOCAL ] RCL: Derivative data saved (1339 records). [2025-09-16T21:20:01.078957] [INFO ] [MAIN ] RCL: Successfully saved derivative data. [2025-09-16T21:20:01.084439] [INFO ] [MAIN ] Derivative Progress: 1508/2026 symbols completed. RCL took 1.0s. Estimated remaining: 2m 48s. Rate: 184.9 symbols/min [2025-09-16T21:20:01.084760] [INFO ] [MAIN ] RDN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:01.085163] [DEBUG] [MAIN ] RCUS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:01.086031] [INFO ] [MAIN ] RCUS: Generated 1339 derivative records from 31661 primary records. [2025-09-16T21:20:01.086285] [DEBUG] [LOCAL ] RCUS: Saving derivative data. [2025-09-16T21:20:01.103243] [DEBUG] [LOCAL ] RCUS: Derivative data saved (1339 records). [2025-09-16T21:20:01.103487] [INFO ] [MAIN ] RCUS: Successfully saved derivative data. [2025-09-16T21:20:01.105506] [INFO ] [MAIN ] Derivative Progress: 1509/2026 symbols completed. RCUS took 1.0s. Estimated remaining: 2m 48s. Rate: 185.0 symbols/min [2025-09-16T21:20:01.114913] [INFO ] [MAIN ] RDW: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:01.150437] [DEBUG] [LOCAL ] RDDT: Loaded 40138 existing records from primary storage. [2025-09-16T21:20:01.150663] [INFO ] [MAIN ] RDDT: Loaded 40138 primary data records. [2025-09-16T21:20:01.151109] [DEBUG] [LOCAL ] RDN: Loaded 32603 existing records from primary storage. [2025-09-16T21:20:01.162701] [INFO ] [MAIN ] RDN: Loaded 32603 primary data records. [2025-09-16T21:20:01.424750] [DEBUG] [LOCAL ] RDW: Loaded 38815 existing records from primary storage. [2025-09-16T21:20:01.472559] [INFO ] [MAIN ] RDW: Loaded 38815 primary data records. [2025-09-16T21:20:01.992114] [DEBUG] [MAIN ] RDDT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:01.993197] [INFO ] [MAIN ] RDDT: Generated 1339 derivative records from 40138 primary records. [2025-09-16T21:20:01.999091] [DEBUG] [LOCAL ] RDDT: Saving derivative data. [2025-09-16T21:20:02.004092] [DEBUG] [MAIN ] RDN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:02.014263] [INFO ] [MAIN ] RDN: Generated 1339 derivative records from 32603 primary records. [2025-09-16T21:20:02.014455] [DEBUG] [LOCAL ] RDN: Saving derivative data. [2025-09-16T21:20:02.019525] [DEBUG] [LOCAL ] RDDT: Derivative data saved (1339 records). [2025-09-16T21:20:02.025893] [INFO ] [MAIN ] RDDT: Successfully saved derivative data. [2025-09-16T21:20:02.030147] [INFO ] [MAIN ] Derivative Progress: 1510/2026 symbols completed. RDDT took 1.0s. Estimated remaining: 2m 48s. Rate: 184.8 symbols/min [2025-09-16T21:20:02.040119] [INFO ] [MAIN ] RDY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:02.041255] [DEBUG] [MAIN ] RDW: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:02.043688] [INFO ] [MAIN ] RDW: Generated 1339 derivative records from 38815 primary records. [2025-09-16T21:20:02.045070] [DEBUG] [LOCAL ] RDN: Derivative data saved (1339 records). [2025-09-16T21:20:02.045011] [DEBUG] [LOCAL ] RDW: Saving derivative data. [2025-09-16T21:20:02.045677] [INFO ] [MAIN ] RDN: Successfully saved derivative data. [2025-09-16T21:20:02.047883] [INFO ] [MAIN ] Derivative Progress: 1511/2026 symbols completed. RDN took 1.0s. Estimated remaining: 2m 47s. Rate: 184.9 symbols/min [2025-09-16T21:20:02.048369] [INFO ] [MAIN ] RELX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:02.062386] [DEBUG] [LOCAL ] RDW: Derivative data saved (1339 records). [2025-09-16T21:20:02.062537] [INFO ] [MAIN ] RDW: Successfully saved derivative data. [2025-09-16T21:20:02.065629] [INFO ] [MAIN ] Derivative Progress: 1512/2026 symbols completed. RDW took 1.0s. Estimated remaining: 2m 47s. Rate: 185.0 symbols/min [2025-09-16T21:20:02.066056] [INFO ] [MAIN ] RERE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:02.095710] [DEBUG] [LOCAL ] RDY: Loaded 34693 existing records from primary storage. [2025-09-16T21:20:02.103129] [INFO ] [MAIN ] RDY: Loaded 34693 primary data records. [2025-09-16T21:20:02.236909] [DEBUG] [LOCAL ] RELX: Loaded 36011 existing records from primary storage. [2025-09-16T21:20:02.277929] [INFO ] [MAIN ] RELX: Loaded 36011 primary data records. [2025-09-16T21:20:02.258146] [DEBUG] [LOCAL ] RERE: Loaded 30764 existing records from primary storage. [2025-09-16T21:20:02.327504] [INFO ] [MAIN ] RERE: Loaded 30764 primary data records. [2025-09-16T21:20:02.938295] [DEBUG] [MAIN ] RDY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:02.939195] [INFO ] [MAIN ] RDY: Generated 1339 derivative records from 34693 primary records. [2025-09-16T21:20:02.940059] [DEBUG] [LOCAL ] RDY: Saving derivative data. [2025-09-16T21:20:02.954594] [DEBUG] [LOCAL ] RDY: Derivative data saved (1339 records). [2025-09-16T21:20:02.954793] [INFO ] [MAIN ] RDY: Successfully saved derivative data. [2025-09-16T21:20:02.956871] [INFO ] [MAIN ] Derivative Progress: 1513/2026 symbols completed. RDY took 0.9s. Estimated remaining: 2m 47s. Rate: 184.8 symbols/min [2025-09-16T21:20:02.967170] [DEBUG] [MAIN ] RELX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:02.967772] [INFO ] [MAIN ] RELX: Generated 1339 derivative records from 36011 primary records. [2025-09-16T21:20:02.968045] [DEBUG] [LOCAL ] RELX: Saving derivative data. [2025-09-16T21:20:02.981609] [DEBUG] [LOCAL ] RELX: Derivative data saved (1339 records). [2025-09-16T21:20:02.981729] [INFO ] [MAIN ] RELX: Successfully saved derivative data. [2025-09-16T21:20:02.992377] [INFO ] [MAIN ] Derivative Progress: 1514/2026 symbols completed. RELX took 0.9s. Estimated remaining: 2m 46s. Rate: 184.9 symbols/min [2025-09-16T21:20:02.992821] [DEBUG] [MAIN ] RERE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:02.993334] [INFO ] [MAIN ] RERE: Generated 1339 derivative records from 30764 primary records. [2025-09-16T21:20:02.993392] [DEBUG] [LOCAL ] RERE: Saving derivative data. [2025-09-16T21:20:03.004491] [DEBUG] [LOCAL ] RERE: Derivative data saved (1339 records). [2025-09-16T21:20:03.004547] [INFO ] [MAIN ] RERE: Successfully saved derivative data. [2025-09-16T21:20:03.006670] [INFO ] [MAIN ] Derivative Progress: 1515/2026 symbols completed. RERE took 0.9s. Estimated remaining: 2m 46s. Rate: 185.1 symbols/min [2025-09-16T21:20:03.007159] [INFO ] [MAIN ] REVG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:03.007324] [INFO ] [MAIN ] RES: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:03.007260] [INFO ] [MAIN ] REX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:03.019732] [DEBUG] [LOCAL ] REX: Loaded 9297 existing records from primary storage. [2025-09-16T21:20:03.019965] [INFO ] [MAIN ] REX: Loaded 9297 primary data records. [2025-09-16T21:20:03.245374] [DEBUG] [LOCAL ] REVG: Loaded 30284 existing records from primary storage. [2025-09-16T21:20:03.311822] [INFO ] [MAIN ] REVG: Loaded 30284 primary data records. [2025-09-16T21:20:03.341005] [DEBUG] [LOCAL ] RES: Loaded 34980 existing records from primary storage. [2025-09-16T21:20:03.414543] [INFO ] [MAIN ] RES: Loaded 34980 primary data records. [2025-09-16T21:20:04.164792] [DEBUG] [MAIN ] REX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:04.167335] [INFO ] [MAIN ] REX: Generated 1339 derivative records from 9297 primary records. [2025-09-16T21:20:04.168545] [DEBUG] [LOCAL ] REX: Saving derivative data. [2025-09-16T21:20:04.189531] [DEBUG] [LOCAL ] REX: Derivative data saved (1339 records). [2025-09-16T21:20:04.189754] [INFO ] [MAIN ] REX: Successfully saved derivative data. [2025-09-16T21:20:04.192189] [INFO ] [MAIN ] Derivative Progress: 1516/2026 symbols completed. REX took 1.2s. Estimated remaining: 2m 46s. Rate: 184.7 symbols/min [2025-09-16T21:20:04.194341] [INFO ] [MAIN ] REXR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:04.219688] [DEBUG] [MAIN ] REVG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:04.221021] [INFO ] [MAIN ] REVG: Generated 1339 derivative records from 30284 primary records. [2025-09-16T21:20:04.236513] [DEBUG] [MAIN ] RES: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:04.236073] [DEBUG] [LOCAL ] REVG: Saving derivative data. [2025-09-16T21:20:04.238530] [INFO ] [MAIN ] RES: Generated 1339 derivative records from 34980 primary records. [2025-09-16T21:20:04.247612] [DEBUG] [LOCAL ] RES: Saving derivative data. [2025-09-16T21:20:04.280327] [DEBUG] [LOCAL ] REVG: Derivative data saved (1339 records). [2025-09-16T21:20:04.281586] [INFO ] [MAIN ] REVG: Successfully saved derivative data. [2025-09-16T21:20:04.284297] [INFO ] [MAIN ] Derivative Progress: 1517/2026 symbols completed. REVG took 1.3s. Estimated remaining: 2m 45s. Rate: 184.8 symbols/min [2025-09-16T21:20:04.286875] [INFO ] [MAIN ] REZI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:04.289662] [DEBUG] [LOCAL ] RES: Derivative data saved (1339 records). [2025-09-16T21:20:04.291232] [INFO ] [MAIN ] RES: Successfully saved derivative data. [2025-09-16T21:20:04.294505] [INFO ] [MAIN ] Derivative Progress: 1518/2026 symbols completed. RES took 1.3s. Estimated remaining: 2m 45s. Rate: 184.9 symbols/min [2025-09-16T21:20:04.307298] [INFO ] [MAIN ] RF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:04.308817] [DEBUG] [LOCAL ] REXR: Loaded 38785 existing records from primary storage. [2025-09-16T21:20:04.309031] [INFO ] [MAIN ] REXR: Loaded 38785 primary data records. [2025-09-16T21:20:04.643756] [DEBUG] [LOCAL ] REZI: Loaded 34828 existing records from primary storage. [2025-09-16T21:20:04.644321] [INFO ] [MAIN ] REZI: Loaded 34828 primary data records. [2025-09-16T21:20:04.644960] [DEBUG] [LOCAL ] RF: Loaded 39983 existing records from primary storage. [2025-09-16T21:20:04.666236] [INFO ] [MAIN ] RF: Loaded 39983 primary data records. [2025-09-16T21:20:05.198093] [DEBUG] [MAIN ] REXR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:05.199183] [INFO ] [MAIN ] REXR: Generated 1339 derivative records from 38785 primary records. [2025-09-16T21:20:05.199315] [DEBUG] [LOCAL ] REXR: Saving derivative data. [2025-09-16T21:20:05.215265] [DEBUG] [LOCAL ] REXR: Derivative data saved (1339 records). [2025-09-16T21:20:05.216204] [INFO ] [MAIN ] REXR: Successfully saved derivative data. [2025-09-16T21:20:05.218270] [INFO ] [MAIN ] Derivative Progress: 1519/2026 symbols completed. REXR took 1.0s. Estimated remaining: 2m 45s. Rate: 184.7 symbols/min [2025-09-16T21:20:05.218895] [INFO ] [MAIN ] RFI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:05.230851] [DEBUG] [MAIN ] REZI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:05.231759] [INFO ] [MAIN ] REZI: Generated 1339 derivative records from 34828 primary records. [2025-09-16T21:20:05.231871] [DEBUG] [LOCAL ] REZI: Saving derivative data. [2025-09-16T21:20:05.248564] [DEBUG] [MAIN ] RF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:05.253820] [INFO ] [MAIN ] RF: Generated 1339 derivative records from 39983 primary records. [2025-09-16T21:20:05.254186] [DEBUG] [LOCAL ] RF: Saving derivative data. [2025-09-16T21:20:05.257273] [DEBUG] [LOCAL ] REZI: Derivative data saved (1339 records). [2025-09-16T21:20:05.257498] [INFO ] [MAIN ] REZI: Successfully saved derivative data. [2025-09-16T21:20:05.264946] [INFO ] [MAIN ] Derivative Progress: 1520/2026 symbols completed. REZI took 1.0s. Estimated remaining: 2m 44s. Rate: 184.8 symbols/min [2025-09-16T21:20:05.274143] [INFO ] [MAIN ] RFL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:05.274064] [DEBUG] [LOCAL ] RF: Derivative data saved (1339 records). [2025-09-16T21:20:05.274349] [INFO ] [MAIN ] RF: Successfully saved derivative data. [2025-09-16T21:20:05.277285] [DEBUG] [LOCAL ] RFI: Loaded 7806 existing records from primary storage. [2025-09-16T21:20:05.276975] [INFO ] [MAIN ] Derivative Progress: 1521/2026 symbols completed. RF took 1.0s. Estimated remaining: 2m 44s. Rate: 184.9 symbols/min [2025-09-16T21:20:05.277544] [INFO ] [MAIN ] RFI: Loaded 7806 primary data records. [2025-09-16T21:20:05.277790] [INFO ] [MAIN ] RFM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:05.372233] [DEBUG] [LOCAL ] RFM: Loaded 2907 existing records from primary storage. [2025-09-16T21:20:05.381513] [INFO ] [MAIN ] RFM: Loaded 2907 primary data records. [2025-09-16T21:20:05.428460] [DEBUG] [LOCAL ] RFL: Loaded 9143 existing records from primary storage. [2025-09-16T21:20:05.484701] [INFO ] [MAIN ] RFL: Loaded 9143 primary data records. [2025-09-16T21:20:06.150731] [DEBUG] [MAIN ] RFI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:06.151476] [INFO ] [MAIN ] RFI: Generated 1339 derivative records from 7806 primary records. [2025-09-16T21:20:06.151850] [DEBUG] [LOCAL ] RFI: Saving derivative data. [2025-09-16T21:20:06.176381] [DEBUG] [LOCAL ] RFI: Derivative data saved (1339 records). [2025-09-16T21:20:06.176888] [INFO ] [MAIN ] RFI: Successfully saved derivative data. [2025-09-16T21:20:06.178472] [INFO ] [MAIN ] Derivative Progress: 1522/2026 symbols completed. RFI took 1.0s. Estimated remaining: 2m 44s. Rate: 184.7 symbols/min [2025-09-16T21:20:06.178664] [INFO ] [MAIN ] RFMZ: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:06.176843] [DEBUG] [MAIN ] RFM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:06.188997] [INFO ] [MAIN ] RFM: Generated 1339 derivative records from 2907 primary records. [2025-09-16T21:20:06.189220] [DEBUG] [MAIN ] RFL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:06.189814] [DEBUG] [LOCAL ] RFM: Saving derivative data. [2025-09-16T21:20:06.190335] [INFO ] [MAIN ] RFL: Generated 1339 derivative records from 9143 primary records. [2025-09-16T21:20:06.190826] [DEBUG] [LOCAL ] RFL: Saving derivative data. [2025-09-16T21:20:06.209957] [DEBUG] [LOCAL ] RFM: Derivative data saved (1339 records). [2025-09-16T21:20:06.210052] [INFO ] [MAIN ] RFM: Successfully saved derivative data. [2025-09-16T21:20:06.214989] [INFO ] [MAIN ] Derivative Progress: 1523/2026 symbols completed. RFM took 0.9s. Estimated remaining: 2m 43s. Rate: 184.8 symbols/min [2025-09-16T21:20:06.215206] [INFO ] [MAIN ] RGA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:06.215445] [DEBUG] [LOCAL ] RFMZ: Loaded 6057 existing records from primary storage. [2025-09-16T21:20:06.220716] [DEBUG] [LOCAL ] RFL: Derivative data saved (1339 records). [2025-09-16T21:20:06.220895] [INFO ] [MAIN ] RFMZ: Loaded 6057 primary data records. [2025-09-16T21:20:06.220954] [INFO ] [MAIN ] RFL: Successfully saved derivative data. [2025-09-16T21:20:06.223329] [INFO ] [MAIN ] Derivative Progress: 1524/2026 symbols completed. RFL took 0.9s. Estimated remaining: 2m 43s. Rate: 184.9 symbols/min [2025-09-16T21:20:06.235567] [INFO ] [MAIN ] RGR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:06.433860] [DEBUG] [LOCAL ] RGA: Loaded 21395 existing records from primary storage. [2025-09-16T21:20:06.484176] [DEBUG] [LOCAL ] RGR: Loaded 15556 existing records from primary storage. [2025-09-16T21:20:06.484253] [INFO ] [MAIN ] RGA: Loaded 21395 primary data records. [2025-09-16T21:20:06.518324] [INFO ] [MAIN ] RGR: Loaded 15556 primary data records. [2025-09-16T21:20:07.085545] [DEBUG] [MAIN ] RFMZ: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:07.086736] [INFO ] [MAIN ] RFMZ: Generated 1339 derivative records from 6057 primary records. [2025-09-16T21:20:07.087627] [DEBUG] [LOCAL ] RFMZ: Saving derivative data. [2025-09-16T21:20:07.100979] [DEBUG] [LOCAL ] RFMZ: Derivative data saved (1339 records). [2025-09-16T21:20:07.101243] [INFO ] [MAIN ] RFMZ: Successfully saved derivative data. [2025-09-16T21:20:07.103038] [INFO ] [MAIN ] Derivative Progress: 1525/2026 symbols completed. RFMZ took 0.9s. Estimated remaining: 2m 43s. Rate: 184.7 symbols/min [2025-09-16T21:20:07.103462] [INFO ] [MAIN ] RGT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:07.110186] [DEBUG] [LOCAL ] RGT: Loaded 1979 existing records from primary storage. [2025-09-16T21:20:07.111425] [INFO ] [MAIN ] RGT: Loaded 1979 primary data records. [2025-09-16T21:20:07.157231] [DEBUG] [MAIN ] RGR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:07.200759] [INFO ] [MAIN ] RGR: Generated 1339 derivative records from 15556 primary records. [2025-09-16T21:20:07.232606] [DEBUG] [MAIN ] RGA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:07.232338] [DEBUG] [LOCAL ] RGR: Saving derivative data. [2025-09-16T21:20:07.236877] [INFO ] [MAIN ] RGA: Generated 1339 derivative records from 21395 primary records. [2025-09-16T21:20:07.248099] [DEBUG] [LOCAL ] RGA: Saving derivative data. [2025-09-16T21:20:07.411043] [DEBUG] [LOCAL ] RGR: Derivative data saved (1339 records). [2025-09-16T21:20:07.423993] [INFO ] [MAIN ] RGR: Successfully saved derivative data. [2025-09-16T21:20:07.429842] [DEBUG] [LOCAL ] RGA: Derivative data saved (1339 records). [2025-09-16T21:20:07.428204] [INFO ] [MAIN ] Derivative Progress: 1526/2026 symbols completed. RGR took 1.2s. Estimated remaining: 2m 42s. Rate: 184.7 symbols/min [2025-09-16T21:20:07.429975] [INFO ] [MAIN ] RGA: Successfully saved derivative data. [2025-09-16T21:20:07.430163] [INFO ] [MAIN ] RH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:07.432231] [INFO ] [MAIN ] Derivative Progress: 1527/2026 symbols completed. RGA took 1.2s. Estimated remaining: 2m 42s. Rate: 184.9 symbols/min [2025-09-16T21:20:07.433398] [INFO ] [MAIN ] RHI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:07.461743] [DEBUG] [MAIN ] RGT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:07.471630] [INFO ] [MAIN ] RGT: Generated 1339 derivative records from 1979 primary records. [2025-09-16T21:20:07.471882] [DEBUG] [LOCAL ] RGT: Saving derivative data. [2025-09-16T21:20:07.503491] [DEBUG] [LOCAL ] RHI: Loaded 37038 existing records from primary storage. [2025-09-16T21:20:07.504275] [DEBUG] [LOCAL ] RGT: Derivative data saved (1339 records). [2025-09-16T21:20:07.504566] [INFO ] [MAIN ] RGT: Successfully saved derivative data. [2025-09-16T21:20:07.504514] [INFO ] [MAIN ] RHI: Loaded 37038 primary data records. [2025-09-16T21:20:07.516207] [INFO ] [MAIN ] Derivative Progress: 1528/2026 symbols completed. RGT took 0.4s. Estimated remaining: 2m 42s. Rate: 185.0 symbols/min [2025-09-16T21:20:07.552896] [DEBUG] [LOCAL ] RH: Loaded 35174 existing records from primary storage. [2025-09-16T21:20:07.581249] [INFO ] [MAIN ] RH: Loaded 35174 primary data records. [2025-09-16T21:20:08.096163] [DEBUG] [MAIN ] RHI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:08.097027] [INFO ] [MAIN ] RHI: Generated 1339 derivative records from 37038 primary records. [2025-09-16T21:20:08.097126] [DEBUG] [LOCAL ] RHI: Saving derivative data. [2025-09-16T21:20:08.120394] [DEBUG] [LOCAL ] RHI: Derivative data saved (1339 records). [2025-09-16T21:20:08.120803] [INFO ] [MAIN ] RHI: Successfully saved derivative data. [2025-09-16T21:20:08.120766] [DEBUG] [MAIN ] RH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:08.122439] [INFO ] [MAIN ] Derivative Progress: 1529/2026 symbols completed. RHI took 0.7s. Estimated remaining: 2m 41s. Rate: 184.8 symbols/min [2025-09-16T21:20:08.123072] [INFO ] [MAIN ] RH: Generated 1339 derivative records from 35174 primary records. [2025-09-16T21:20:08.123317] [DEBUG] [LOCAL ] RH: Saving derivative data. [2025-09-16T21:20:08.135072] [DEBUG] [LOCAL ] RH: Derivative data saved (1339 records). [2025-09-16T21:20:08.135129] [INFO ] [MAIN ] RH: Successfully saved derivative data. [2025-09-16T21:20:08.137011] [INFO ] [MAIN ] Derivative Progress: 1530/2026 symbols completed. RH took 0.7s. Estimated remaining: 2m 41s. Rate: 185.0 symbols/min [2025-09-16T21:20:08.137628] [INFO ] [MAIN ] RIO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:08.137772] [INFO ] [MAIN ] RIG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:08.137584] [INFO ] [MAIN ] RHP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:08.173328] [DEBUG] [LOCAL ] RHP: Loaded 29862 existing records from primary storage. [2025-09-16T21:20:08.173493] [INFO ] [MAIN ] RHP: Loaded 29862 primary data records. [2025-09-16T21:20:08.393351] [DEBUG] [LOCAL ] RIO: Loaded 39773 existing records from primary storage. [2025-09-16T21:20:08.480454] [INFO ] [MAIN ] RIO: Loaded 39773 primary data records. [2025-09-16T21:20:08.482527] [DEBUG] [LOCAL ] RIG: Loaded 40031 existing records from primary storage. [2025-09-16T21:20:08.529805] [INFO ] [MAIN ] RIG: Loaded 40031 primary data records. [2025-09-16T21:20:09.085924] [DEBUG] [MAIN ] RHP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:09.087403] [INFO ] [MAIN ] RHP: Generated 1339 derivative records from 29862 primary records. [2025-09-16T21:20:09.087812] [DEBUG] [LOCAL ] RHP: Saving derivative data. [2025-09-16T21:20:09.104277] [DEBUG] [LOCAL ] RHP: Derivative data saved (1339 records). [2025-09-16T21:20:09.114142] [INFO ] [MAIN ] RHP: Successfully saved derivative data. [2025-09-16T21:20:09.114082] [DEBUG] [MAIN ] RIO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:09.116432] [INFO ] [MAIN ] Derivative Progress: 1531/2026 symbols completed. RHP took 1.0s. Estimated remaining: 2m 41s. Rate: 184.7 symbols/min [2025-09-16T21:20:09.114873] [INFO ] [MAIN ] RIO: Generated 1339 derivative records from 39773 primary records. [2025-09-16T21:20:09.116621] [INFO ] [MAIN ] RIV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:09.116978] [DEBUG] [LOCAL ] RIO: Saving derivative data. [2025-09-16T21:20:09.134039] [DEBUG] [LOCAL ] RIO: Derivative data saved (1339 records). [2025-09-16T21:20:09.134234] [INFO ] [MAIN ] RIO: Successfully saved derivative data. [2025-09-16T21:20:09.136137] [INFO ] [MAIN ] Derivative Progress: 1532/2026 symbols completed. RIO took 1.0s. Estimated remaining: 2m 40s. Rate: 184.8 symbols/min [2025-09-16T21:20:09.136501] [INFO ] [MAIN ] RJF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:09.151165] [DEBUG] [MAIN ] RIG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:09.150802] [DEBUG] [LOCAL ] RIV: Loaded 8780 existing records from primary storage. [2025-09-16T21:20:09.151438] [INFO ] [MAIN ] RIV: Loaded 8780 primary data records. [2025-09-16T21:20:09.152263] [INFO ] [MAIN ] RIG: Generated 1339 derivative records from 40031 primary records. [2025-09-16T21:20:09.167352] [DEBUG] [LOCAL ] RIG: Saving derivative data. [2025-09-16T21:20:09.337552] [DEBUG] [LOCAL ] RIG: Derivative data saved (1339 records). [2025-09-16T21:20:09.364081] [INFO ] [MAIN ] RIG: Successfully saved derivative data. [2025-09-16T21:20:09.384917] [INFO ] [MAIN ] Derivative Progress: 1533/2026 symbols completed. RIG took 1.2s. Estimated remaining: 2m 40s. Rate: 184.9 symbols/min [2025-09-16T21:20:09.385159] [INFO ] [MAIN ] RKT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:09.473585] [DEBUG] [LOCAL ] RJF: Loaded 34319 existing records from primary storage. [2025-09-16T21:20:09.474449] [INFO ] [MAIN ] RJF: Loaded 34319 primary data records. [2025-09-16T21:20:09.791000] [DEBUG] [MAIN ] RIV: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:09.792481] [DEBUG] [LOCAL ] RKT: Loaded 40080 existing records from primary storage. [2025-09-16T21:20:09.791774] [INFO ] [MAIN ] RIV: Generated 1339 derivative records from 8780 primary records. [2025-09-16T21:20:09.792819] [INFO ] [MAIN ] RKT: Loaded 40080 primary data records. [2025-09-16T21:20:09.792892] [DEBUG] [LOCAL ] RIV: Saving derivative data. [2025-09-16T21:20:09.910992] [DEBUG] [LOCAL ] RIV: Derivative data saved (1339 records). [2025-09-16T21:20:09.911624] [INFO ] [MAIN ] RIV: Successfully saved derivative data. [2025-09-16T21:20:09.913458] [INFO ] [MAIN ] Derivative Progress: 1534/2026 symbols completed. RIV took 0.8s. Estimated remaining: 2m 40s. Rate: 184.8 symbols/min [2025-09-16T21:20:09.919222] [INFO ] [MAIN ] RL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:10.083402] [DEBUG] [MAIN ] RJF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:10.084267] [INFO ] [MAIN ] RJF: Generated 1339 derivative records from 34319 primary records. [2025-09-16T21:20:10.084492] [DEBUG] [LOCAL ] RJF: Saving derivative data. [2025-09-16T21:20:10.106229] [DEBUG] [LOCAL ] RJF: Derivative data saved (1339 records). [2025-09-16T21:20:10.106573] [INFO ] [MAIN ] RJF: Successfully saved derivative data. [2025-09-16T21:20:10.108774] [INFO ] [MAIN ] Derivative Progress: 1535/2026 symbols completed. RJF took 1.0s. Estimated remaining: 2m 39s. Rate: 184.8 symbols/min [2025-09-16T21:20:10.109038] [INFO ] [MAIN ] RLI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:10.121138] [DEBUG] [LOCAL ] RL: Loaded 29962 existing records from primary storage. [2025-09-16T21:20:10.121483] [INFO ] [MAIN ] RL: Loaded 29962 primary data records. [2025-09-16T21:20:10.330068] [DEBUG] [MAIN ] RKT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:10.334750] [DEBUG] [LOCAL ] RLI: Loaded 25044 existing records from primary storage. [2025-09-16T21:20:10.333932] [INFO ] [MAIN ] RKT: Generated 1339 derivative records from 40080 primary records. [2025-09-16T21:20:10.440014] [INFO ] [MAIN ] RLI: Loaded 25044 primary data records. [2025-09-16T21:20:10.450281] [DEBUG] [LOCAL ] RKT: Saving derivative data. [2025-09-16T21:20:10.576660] [DEBUG] [LOCAL ] RKT: Derivative data saved (1339 records). [2025-09-16T21:20:10.592810] [INFO ] [MAIN ] RKT: Successfully saved derivative data. [2025-09-16T21:20:10.599741] [INFO ] [MAIN ] Derivative Progress: 1536/2026 symbols completed. RKT took 1.2s. Estimated remaining: 2m 39s. Rate: 184.8 symbols/min [2025-09-16T21:20:10.650868] [INFO ] [MAIN ] RLJ: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:10.757016] [DEBUG] [MAIN ] RL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:10.757785] [INFO ] [MAIN ] RL: Generated 1339 derivative records from 29962 primary records. [2025-09-16T21:20:10.758891] [DEBUG] [LOCAL ] RL: Saving derivative data. [2025-09-16T21:20:10.780607] [DEBUG] [LOCAL ] RL: Derivative data saved (1339 records). [2025-09-16T21:20:10.781046] [INFO ] [MAIN ] RL: Successfully saved derivative data. [2025-09-16T21:20:10.782958] [INFO ] [MAIN ] Derivative Progress: 1537/2026 symbols completed. RL took 0.9s. Estimated remaining: 2m 39s. Rate: 184.8 symbols/min [2025-09-16T21:20:10.783455] [INFO ] [MAIN ] RLTY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:10.798275] [DEBUG] [MAIN ] RLI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:10.808668] [INFO ] [MAIN ] RLI: Generated 1339 derivative records from 25044 primary records. [2025-09-16T21:20:10.809830] [DEBUG] [LOCAL ] RLI: Saving derivative data. [2025-09-16T21:20:10.811304] [DEBUG] [LOCAL ] RLJ: Loaded 35399 existing records from primary storage. [2025-09-16T21:20:10.823313] [INFO ] [MAIN ] RLJ: Loaded 35399 primary data records. [2025-09-16T21:20:10.823243] [DEBUG] [LOCAL ] RLTY: Loaded 7978 existing records from primary storage. [2025-09-16T21:20:10.823735] [INFO ] [MAIN ] RLTY: Loaded 7978 primary data records. [2025-09-16T21:20:10.837423] [DEBUG] [LOCAL ] RLI: Derivative data saved (1339 records). [2025-09-16T21:20:10.837592] [INFO ] [MAIN ] RLI: Successfully saved derivative data. [2025-09-16T21:20:10.880416] [INFO ] [MAIN ] Derivative Progress: 1538/2026 symbols completed. RLI took 0.8s. Estimated remaining: 2m 38s. Rate: 184.9 symbols/min [2025-09-16T21:20:10.902227] [INFO ] [MAIN ] RLX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:11.388238] [DEBUG] [LOCAL ] RLX: Loaded 35429 existing records from primary storage. [2025-09-16T21:20:11.389387] [INFO ] [MAIN ] RLX: Loaded 35429 primary data records. [2025-09-16T21:20:11.685457] [DEBUG] [MAIN ] RLTY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:11.686777] [INFO ] [MAIN ] RLTY: Generated 1339 derivative records from 7978 primary records. [2025-09-16T21:20:11.693105] [DEBUG] [LOCAL ] RLTY: Saving derivative data. [2025-09-16T21:20:11.698344] [DEBUG] [MAIN ] RLJ: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:11.699393] [INFO ] [MAIN ] RLJ: Generated 1339 derivative records from 35399 primary records. [2025-09-16T21:20:11.705061] [DEBUG] [LOCAL ] RLJ: Saving derivative data. [2025-09-16T21:20:11.721192] [DEBUG] [LOCAL ] RLTY: Derivative data saved (1339 records). [2025-09-16T21:20:11.721510] [INFO ] [MAIN ] RLTY: Successfully saved derivative data. [2025-09-16T21:20:11.723469] [INFO ] [MAIN ] Derivative Progress: 1539/2026 symbols completed. RLTY took 0.9s. Estimated remaining: 2m 38s. Rate: 184.7 symbols/min [2025-09-16T21:20:11.724668] [INFO ] [MAIN ] RM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:11.727366] [DEBUG] [LOCAL ] RLJ: Derivative data saved (1339 records). [2025-09-16T21:20:11.727634] [INFO ] [MAIN ] RLJ: Successfully saved derivative data. [2025-09-16T21:20:11.729443] [INFO ] [MAIN ] Derivative Progress: 1540/2026 symbols completed. RLJ took 1.1s. Estimated remaining: 2m 38s. Rate: 184.8 symbols/min [2025-09-16T21:20:11.731001] [INFO ] [MAIN ] RMAX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:11.735799] [DEBUG] [LOCAL ] RM: Loaded 5649 existing records from primary storage. [2025-09-16T21:20:11.736693] [INFO ] [MAIN ] RM: Loaded 5649 primary data records. [2025-09-16T21:20:11.835736] [DEBUG] [MAIN ] RLX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:11.841800] [INFO ] [MAIN ] RLX: Generated 1339 derivative records from 35429 primary records. [2025-09-16T21:20:11.865332] [DEBUG] [LOCAL ] RLX: Saving derivative data. [2025-09-16T21:20:11.865937] [DEBUG] [LOCAL ] RMAX: Loaded 16631 existing records from primary storage. [2025-09-16T21:20:11.876668] [INFO ] [MAIN ] RMAX: Loaded 16631 primary data records. [2025-09-16T21:20:12.025393] [DEBUG] [LOCAL ] RLX: Derivative data saved (1339 records). [2025-09-16T21:20:12.043090] [INFO ] [MAIN ] RLX: Successfully saved derivative data. [2025-09-16T21:20:12.134659] [INFO ] [MAIN ] Derivative Progress: 1541/2026 symbols completed. RLX took 1.2s. Estimated remaining: 2m 37s. Rate: 184.8 symbols/min [2025-09-16T21:20:12.147368] [INFO ] [MAIN ] RMD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:12.340216] [DEBUG] [MAIN ] RM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:12.341030] [INFO ] [MAIN ] RM: Generated 1339 derivative records from 5649 primary records. [2025-09-16T21:20:12.341742] [DEBUG] [LOCAL ] RM: Saving derivative data. [2025-09-16T21:20:12.351871] [DEBUG] [LOCAL ] RMD: Loaded 31128 existing records from primary storage. [2025-09-16T21:20:12.352305] [INFO ] [MAIN ] RMD: Loaded 31128 primary data records. [2025-09-16T21:20:12.471304] [DEBUG] [MAIN ] RMAX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:12.490730] [DEBUG] [LOCAL ] RM: Derivative data saved (1339 records). [2025-09-16T21:20:12.490675] [INFO ] [MAIN ] RMAX: Generated 1339 derivative records from 16631 primary records. [2025-09-16T21:20:12.490904] [INFO ] [MAIN ] RM: Successfully saved derivative data. [2025-09-16T21:20:12.491259] [DEBUG] [LOCAL ] RMAX: Saving derivative data. [2025-09-16T21:20:12.503346] [INFO ] [MAIN ] Derivative Progress: 1542/2026 symbols completed. RM took 0.8s. Estimated remaining: 2m 37s. Rate: 184.8 symbols/min [2025-09-16T21:20:12.513896] [INFO ] [MAIN ] RMI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:12.705201] [DEBUG] [LOCAL ] RMI: Loaded 3529 existing records from primary storage. [2025-09-16T21:20:12.706103] [INFO ] [MAIN ] RMI: Loaded 3529 primary data records. [2025-09-16T21:20:12.706584] [DEBUG] [LOCAL ] RMAX: Derivative data saved (1339 records). [2025-09-16T21:20:12.706725] [INFO ] [MAIN ] RMAX: Successfully saved derivative data. [2025-09-16T21:20:12.713747] [INFO ] [MAIN ] Derivative Progress: 1543/2026 symbols completed. RMAX took 1.0s. Estimated remaining: 2m 37s. Rate: 184.8 symbols/min [2025-09-16T21:20:12.996624] [DEBUG] [MAIN ] RMD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:12.997370] [INFO ] [MAIN ] RMD: Generated 1339 derivative records from 31128 primary records. [2025-09-16T21:20:12.998085] [DEBUG] [LOCAL ] RMD: Saving derivative data. [2025-09-16T21:20:13.010473] [DEBUG] [LOCAL ] RMD: Derivative data saved (1339 records). [2025-09-16T21:20:13.010535] [INFO ] [MAIN ] RMD: Successfully saved derivative data. [2025-09-16T21:20:13.012166] [INFO ] [MAIN ] Derivative Progress: 1544/2026 symbols completed. RMD took 0.9s. Estimated remaining: 2m 36s. Rate: 184.8 symbols/min [2025-09-16T21:20:13.024777] [DEBUG] [MAIN ] RMI: Filtered 5181 bins outside market hours, 5780 incomplete bins [2025-09-16T21:20:13.025375] [INFO ] [MAIN ] RMI: Generated 1338 derivative records from 3529 primary records. [2025-09-16T21:20:13.025434] [DEBUG] [LOCAL ] RMI: Saving derivative data. [2025-09-16T21:20:13.036141] [DEBUG] [LOCAL ] RMI: Derivative data saved (1338 records). [2025-09-16T21:20:13.036204] [INFO ] [MAIN ] RMI: Successfully saved derivative data. [2025-09-16T21:20:13.038061] [INFO ] [MAIN ] Derivative Progress: 1545/2026 symbols completed. RMI took 0.5s. Estimated remaining: 2m 36s. Rate: 184.9 symbols/min [2025-09-16T21:20:13.038488] [INFO ] [MAIN ] RMM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:13.038614] [INFO ] [MAIN ] RMT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:13.038694] [INFO ] [MAIN ] RMMZ: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:13.050536] [DEBUG] [LOCAL ] RMMZ: Loaded 3694 existing records from primary storage. [2025-09-16T21:20:13.050729] [INFO ] [MAIN ] RMMZ: Loaded 3694 primary data records. [2025-09-16T21:20:13.120026] [DEBUG] [LOCAL ] RMM: Loaded 7584 existing records from primary storage. [2025-09-16T21:20:13.143257] [DEBUG] [LOCAL ] RMT: Loaded 12707 existing records from primary storage. [2025-09-16T21:20:13.137624] [INFO ] [MAIN ] RMM: Loaded 7584 primary data records. [2025-09-16T21:20:13.143417] [INFO ] [MAIN ] RMT: Loaded 12707 primary data records. [2025-09-16T21:20:13.875504] [DEBUG] [MAIN ] RMMZ: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:13.876263] [INFO ] [MAIN ] RMMZ: Generated 1339 derivative records from 3694 primary records. [2025-09-16T21:20:13.876517] [DEBUG] [LOCAL ] RMMZ: Saving derivative data. [2025-09-16T21:20:13.908985] [DEBUG] [MAIN ] RMM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:13.910692] [DEBUG] [LOCAL ] RMMZ: Derivative data saved (1339 records). [2025-09-16T21:20:13.910944] [DEBUG] [MAIN ] RMT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:13.910992] [INFO ] [MAIN ] RMMZ: Successfully saved derivative data. [2025-09-16T21:20:13.912719] [INFO ] [MAIN ] Derivative Progress: 1546/2026 symbols completed. RMMZ took 0.9s. Estimated remaining: 2m 36s. Rate: 184.7 symbols/min [2025-09-16T21:20:13.913909] [INFO ] [MAIN ] RMT: Generated 1339 derivative records from 12707 primary records. [2025-09-16T21:20:13.914126] [DEBUG] [LOCAL ] RMT: Saving derivative data. [2025-09-16T21:20:13.914207] [INFO ] [MAIN ] RNG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:13.913354] [INFO ] [MAIN ] RMM: Generated 1339 derivative records from 7584 primary records. [2025-09-16T21:20:13.915311] [DEBUG] [LOCAL ] RMM: Saving derivative data. [2025-09-16T21:20:13.936970] [DEBUG] [LOCAL ] RMT: Derivative data saved (1339 records). [2025-09-16T21:20:13.937483] [INFO ] [MAIN ] RMT: Successfully saved derivative data. [2025-09-16T21:20:13.939868] [INFO ] [MAIN ] Derivative Progress: 1547/2026 symbols completed. RMT took 0.9s. Estimated remaining: 2m 35s. Rate: 184.9 symbols/min [2025-09-16T21:20:13.940085] [INFO ] [MAIN ] RNGR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:13.940787] [DEBUG] [LOCAL ] RMM: Derivative data saved (1339 records). [2025-09-16T21:20:13.941157] [INFO ] [MAIN ] RMM: Successfully saved derivative data. [2025-09-16T21:20:13.943041] [INFO ] [MAIN ] Derivative Progress: 1548/2026 symbols completed. RMM took 0.9s. Estimated remaining: 2m 35s. Rate: 185.0 symbols/min [2025-09-16T21:20:13.943361] [INFO ] [MAIN ] RNP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:13.972373] [DEBUG] [LOCAL ] RNP: Loaded 11693 existing records from primary storage. [2025-09-16T21:20:13.972687] [DEBUG] [LOCAL ] RNGR: Loaded 15757 existing records from primary storage. [2025-09-16T21:20:13.972801] [INFO ] [MAIN ] RNGR: Loaded 15757 primary data records. [2025-09-16T21:20:13.972847] [INFO ] [MAIN ] RNP: Loaded 11693 primary data records. [2025-09-16T21:20:14.143260] [DEBUG] [LOCAL ] RNG: Loaded 35432 existing records from primary storage. [2025-09-16T21:20:14.180547] [INFO ] [MAIN ] RNG: Loaded 35432 primary data records. [2025-09-16T21:20:14.874200] [DEBUG] [MAIN ] RNP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:14.874743] [DEBUG] [MAIN ] RNGR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:14.875368] [INFO ] [MAIN ] RNP: Generated 1339 derivative records from 11693 primary records. [2025-09-16T21:20:14.876771] [INFO ] [MAIN ] RNGR: Generated 1339 derivative records from 15757 primary records. [2025-09-16T21:20:14.877606] [DEBUG] [LOCAL ] RNP: Saving derivative data. [2025-09-16T21:20:14.877554] [DEBUG] [LOCAL ] RNGR: Saving derivative data. [2025-09-16T21:20:14.905085] [DEBUG] [MAIN ] RNG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:14.908365] [INFO ] [MAIN ] RNG: Generated 1339 derivative records from 35432 primary records. [2025-09-16T21:20:14.909453] [DEBUG] [LOCAL ] RNG: Saving derivative data. [2025-09-16T21:20:14.919454] [DEBUG] [LOCAL ] RNP: Derivative data saved (1339 records). [2025-09-16T21:20:14.921617] [DEBUG] [LOCAL ] RNGR: Derivative data saved (1339 records). [2025-09-16T21:20:14.922095] [INFO ] [MAIN ] RNGR: Successfully saved derivative data. [2025-09-16T21:20:14.925313] [INFO ] [MAIN ] RNP: Successfully saved derivative data. [2025-09-16T21:20:14.926125] [DEBUG] [LOCAL ] RNG: Derivative data saved (1339 records). [2025-09-16T21:20:14.925253] [INFO ] [MAIN ] Derivative Progress: 1549/2026 symbols completed. RNGR took 1.0s. Estimated remaining: 2m 35s. Rate: 184.7 symbols/min [2025-09-16T21:20:14.928064] [INFO ] [MAIN ] RNG: Successfully saved derivative data. [2025-09-16T21:20:14.930147] [INFO ] [MAIN ] RNR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:14.930217] [INFO ] [MAIN ] Derivative Progress: 1550/2026 symbols completed. RNP took 1.0s. Estimated remaining: 2m 35s. Rate: 184.8 symbols/min [2025-09-16T21:20:14.930697] [INFO ] [MAIN ] Derivative Progress: 1551/2026 symbols completed. RNG took 1.0s. Estimated remaining: 2m 34s. Rate: 185.0 symbols/min [2025-09-16T21:20:14.930748] [INFO ] [MAIN ] RNST: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:14.930974] [INFO ] [MAIN ] ROG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:14.960413] [DEBUG] [LOCAL ] ROG: Loaded 16504 existing records from primary storage. [2025-09-16T21:20:14.960623] [INFO ] [MAIN ] ROG: Loaded 16504 primary data records. [2025-09-16T21:20:15.087294] [DEBUG] [LOCAL ] RNST: Loaded 26578 existing records from primary storage. [2025-09-16T21:20:15.081758] [DEBUG] [LOCAL ] RNR: Loaded 25274 existing records from primary storage. [2025-09-16T21:20:15.097684] [INFO ] [MAIN ] RNR: Loaded 25274 primary data records. [2025-09-16T21:20:15.102854] [INFO ] [MAIN ] RNST: Loaded 26578 primary data records. [2025-09-16T21:20:15.794979] [DEBUG] [MAIN ] ROG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:15.796172] [INFO ] [MAIN ] ROG: Generated 1339 derivative records from 16504 primary records. [2025-09-16T21:20:15.799847] [DEBUG] [LOCAL ] ROG: Saving derivative data. [2025-09-16T21:20:15.823759] [DEBUG] [MAIN ] RNST: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:15.825376] [DEBUG] [LOCAL ] ROG: Derivative data saved (1339 records). [2025-09-16T21:20:15.826315] [INFO ] [MAIN ] ROG: Successfully saved derivative data. [2025-09-16T21:20:15.826261] [INFO ] [MAIN ] RNST: Generated 1339 derivative records from 26578 primary records. [2025-09-16T21:20:15.827886] [INFO ] [MAIN ] Derivative Progress: 1552/2026 symbols completed. ROG took 0.9s. Estimated remaining: 2m 34s. Rate: 184.8 symbols/min [2025-09-16T21:20:15.833796] [DEBUG] [LOCAL ] RNST: Saving derivative data. [2025-09-16T21:20:15.833743] [INFO ] [MAIN ] ROK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:15.839267] [DEBUG] [MAIN ] RNR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:15.849079] [INFO ] [MAIN ] RNR: Generated 1339 derivative records from 25274 primary records. [2025-09-16T21:20:15.849201] [DEBUG] [LOCAL ] RNR: Saving derivative data. [2025-09-16T21:20:15.863675] [DEBUG] [LOCAL ] RNST: Derivative data saved (1339 records). [2025-09-16T21:20:15.864272] [INFO ] [MAIN ] RNST: Successfully saved derivative data. [2025-09-16T21:20:15.866397] [INFO ] [MAIN ] Derivative Progress: 1553/2026 symbols completed. RNST took 0.9s. Estimated remaining: 2m 34s. Rate: 184.9 symbols/min [2025-09-16T21:20:15.867143] [INFO ] [MAIN ] ROL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:15.869376] [DEBUG] [LOCAL ] RNR: Derivative data saved (1339 records). [2025-09-16T21:20:15.869478] [INFO ] [MAIN ] RNR: Successfully saved derivative data. [2025-09-16T21:20:15.871227] [INFO ] [MAIN ] Derivative Progress: 1554/2026 symbols completed. RNR took 0.9s. Estimated remaining: 2m 33s. Rate: 185.0 symbols/min [2025-09-16T21:20:15.871773] [INFO ] [MAIN ] RPM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:15.900074] [DEBUG] [LOCAL ] ROK: Loaded 32359 existing records from primary storage. [2025-09-16T21:20:15.900254] [INFO ] [MAIN ] ROK: Loaded 32359 primary data records. [2025-09-16T21:20:16.067699] [DEBUG] [LOCAL ] ROL: Loaded 37082 existing records from primary storage. [2025-09-16T21:20:16.127434] [DEBUG] [LOCAL ] RPM: Loaded 30788 existing records from primary storage. [2025-09-16T21:20:16.127518] [INFO ] [MAIN ] ROL: Loaded 37082 primary data records. [2025-09-16T21:20:16.187695] [INFO ] [MAIN ] RPM: Loaded 30788 primary data records. [2025-09-16T21:20:16.838187] [DEBUG] [MAIN ] ROK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:16.839504] [INFO ] [MAIN ] ROK: Generated 1339 derivative records from 32359 primary records. [2025-09-16T21:20:16.839853] [DEBUG] [LOCAL ] ROK: Saving derivative data. [2025-09-16T21:20:16.853133] [DEBUG] [LOCAL ] ROK: Derivative data saved (1339 records). [2025-09-16T21:20:16.853394] [INFO ] [MAIN ] ROK: Successfully saved derivative data. [2025-09-16T21:20:16.854976] [INFO ] [MAIN ] Derivative Progress: 1555/2026 symbols completed. ROK took 1.0s. Estimated remaining: 2m 33s. Rate: 184.7 symbols/min [2025-09-16T21:20:16.855528] [INFO ] [MAIN ] RPT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:16.876116] [DEBUG] [MAIN ] ROL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:16.886275] [INFO ] [MAIN ] ROL: Generated 1339 derivative records from 37082 primary records. [2025-09-16T21:20:16.891514] [DEBUG] [MAIN ] RPM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:16.892036] [DEBUG] [LOCAL ] RPT: Loaded 14514 existing records from primary storage. [2025-09-16T21:20:16.891693] [DEBUG] [LOCAL ] ROL: Saving derivative data. [2025-09-16T21:20:16.893034] [INFO ] [MAIN ] RPM: Generated 1339 derivative records from 30788 primary records. [2025-09-16T21:20:16.893588] [DEBUG] [LOCAL ] RPM: Saving derivative data. [2025-09-16T21:20:16.893486] [INFO ] [MAIN ] RPT: Loaded 14514 primary data records. [2025-09-16T21:20:16.988110] [DEBUG] [LOCAL ] RPM: Derivative data saved (1339 records). [2025-09-16T21:20:16.996061] [INFO ] [MAIN ] RPM: Successfully saved derivative data. [2025-09-16T21:20:17.003964] [INFO ] [MAIN ] Derivative Progress: 1556/2026 symbols completed. RPM took 1.1s. Estimated remaining: 2m 33s. Rate: 184.8 symbols/min [2025-09-16T21:20:17.028562] [INFO ] [MAIN ] RQI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:17.029138] [DEBUG] [LOCAL ] ROL: Derivative data saved (1339 records). [2025-09-16T21:20:17.039510] [INFO ] [MAIN ] ROL: Successfully saved derivative data. [2025-09-16T21:20:17.057949] [INFO ] [MAIN ] Derivative Progress: 1557/2026 symbols completed. ROL took 1.2s. Estimated remaining: 2m 32s. Rate: 184.9 symbols/min [2025-09-16T21:20:17.103744] [INFO ] [MAIN ] RRC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:17.210214] [DEBUG] [LOCAL ] RQI: Loaded 21100 existing records from primary storage. [2025-09-16T21:20:17.210407] [INFO ] [MAIN ] RQI: Loaded 21100 primary data records. [2025-09-16T21:20:17.410546] [DEBUG] [MAIN ] RPT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:17.435979] [DEBUG] [LOCAL ] RRC: Loaded 39320 existing records from primary storage. [2025-09-16T21:20:17.436758] [INFO ] [MAIN ] RPT: Generated 1339 derivative records from 14514 primary records. [2025-09-16T21:20:17.436116] [INFO ] [MAIN ] RRC: Loaded 39320 primary data records. [2025-09-16T21:20:17.521340] [DEBUG] [LOCAL ] RPT: Saving derivative data. [2025-09-16T21:20:17.648034] [DEBUG] [LOCAL ] RPT: Derivative data saved (1339 records). [2025-09-16T21:20:17.664225] [INFO ] [MAIN ] RPT: Successfully saved derivative data. [2025-09-16T21:20:17.715670] [INFO ] [MAIN ] Derivative Progress: 1558/2026 symbols completed. RPT took 0.9s. Estimated remaining: 2m 32s. Rate: 184.8 symbols/min [2025-09-16T21:20:17.821362] [DEBUG] [MAIN ] RQI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:17.822090] [INFO ] [MAIN ] RQI: Generated 1339 derivative records from 21100 primary records. [2025-09-16T21:20:17.822334] [DEBUG] [LOCAL ] RQI: Saving derivative data. [2025-09-16T21:20:17.836471] [DEBUG] [LOCAL ] RQI: Derivative data saved (1339 records). [2025-09-16T21:20:17.836606] [INFO ] [MAIN ] RQI: Successfully saved derivative data. [2025-09-16T21:20:17.838513] [INFO ] [MAIN ] Derivative Progress: 1559/2026 symbols completed. RQI took 0.8s. Estimated remaining: 2m 32s. Rate: 184.9 symbols/min [2025-09-16T21:20:17.848087] [DEBUG] [MAIN ] RRC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:17.848684] [INFO ] [MAIN ] RRC: Generated 1339 derivative records from 39320 primary records. [2025-09-16T21:20:17.848747] [DEBUG] [LOCAL ] RRC: Saving derivative data. [2025-09-16T21:20:17.860266] [DEBUG] [LOCAL ] RRC: Derivative data saved (1339 records). [2025-09-16T21:20:17.860329] [INFO ] [MAIN ] RRC: Successfully saved derivative data. [2025-09-16T21:20:17.862752] [INFO ] [MAIN ] Derivative Progress: 1560/2026 symbols completed. RRC took 0.8s. Estimated remaining: 2m 31s. Rate: 185.0 symbols/min [2025-09-16T21:20:17.863380] [INFO ] [MAIN ] RRX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:17.863612] [INFO ] [MAIN ] RS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:17.864312] [INFO ] [MAIN ] RSF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:17.870185] [DEBUG] [LOCAL ] RSF: Loaded 3399 existing records from primary storage. [2025-09-16T21:20:17.870275] [INFO ] [MAIN ] RSF: Loaded 3399 primary data records. [2025-09-16T21:20:17.994133] [DEBUG] [LOCAL ] RS: Loaded 18087 existing records from primary storage. [2025-09-16T21:20:18.004951] [INFO ] [MAIN ] RS: Loaded 18087 primary data records. [2025-09-16T21:20:18.266434] [DEBUG] [LOCAL ] RRX: Loaded 30168 existing records from primary storage. [2025-09-16T21:20:18.270637] [INFO ] [MAIN ] RRX: Loaded 30168 primary data records. [2025-09-16T21:20:18.725539] [DEBUG] [MAIN ] RSF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:18.727211] [INFO ] [MAIN ] RSF: Generated 1339 derivative records from 3399 primary records. [2025-09-16T21:20:18.727364] [DEBUG] [LOCAL ] RSF: Saving derivative data. [2025-09-16T21:20:18.740909] [DEBUG] [LOCAL ] RSF: Derivative data saved (1339 records). [2025-09-16T21:20:18.741261] [INFO ] [MAIN ] RSF: Successfully saved derivative data. [2025-09-16T21:20:18.742974] [INFO ] [MAIN ] Derivative Progress: 1561/2026 symbols completed. RSF took 0.9s. Estimated remaining: 2m 31s. Rate: 184.8 symbols/min [2025-09-16T21:20:18.743554] [INFO ] [MAIN ] RSG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:18.760777] [DEBUG] [MAIN ] RS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:18.767453] [INFO ] [MAIN ] RS: Generated 1339 derivative records from 18087 primary records. [2025-09-16T21:20:18.771068] [DEBUG] [LOCAL ] RS: Saving derivative data. [2025-09-16T21:20:18.771516] [DEBUG] [MAIN ] RRX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:18.773010] [INFO ] [MAIN ] RRX: Generated 1339 derivative records from 30168 primary records. [2025-09-16T21:20:18.773109] [DEBUG] [LOCAL ] RRX: Saving derivative data. [2025-09-16T21:20:18.786355] [DEBUG] [LOCAL ] RS: Derivative data saved (1339 records). [2025-09-16T21:20:18.793029] [INFO ] [MAIN ] RS: Successfully saved derivative data. [2025-09-16T21:20:18.797053] [INFO ] [MAIN ] Derivative Progress: 1562/2026 symbols completed. RS took 0.9s. Estimated remaining: 2m 31s. Rate: 184.9 symbols/min [2025-09-16T21:20:18.797304] [INFO ] [MAIN ] RSI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:18.809457] [DEBUG] [LOCAL ] RRX: Derivative data saved (1339 records). [2025-09-16T21:20:18.809621] [INFO ] [MAIN ] RRX: Successfully saved derivative data. [2025-09-16T21:20:18.811483] [INFO ] [MAIN ] Derivative Progress: 1563/2026 symbols completed. RRX took 0.9s. Estimated remaining: 2m 30s. Rate: 185.0 symbols/min [2025-09-16T21:20:18.811817] [INFO ] [MAIN ] RSKD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:18.825931] [DEBUG] [LOCAL ] RSG: Loaded 35194 existing records from primary storage. [2025-09-16T21:20:18.826091] [INFO ] [MAIN ] RSG: Loaded 35194 primary data records. [2025-09-16T21:20:18.981521] [DEBUG] [LOCAL ] RSI: Loaded 34601 existing records from primary storage. [2025-09-16T21:20:19.011969] [INFO ] [MAIN ] RSI: Loaded 34601 primary data records. [2025-09-16T21:20:19.056238] [DEBUG] [LOCAL ] RSKD: Loaded 24980 existing records from primary storage. [2025-09-16T21:20:19.196953] [INFO ] [MAIN ] RSKD: Loaded 24980 primary data records. [2025-09-16T21:20:19.709129] [DEBUG] [MAIN ] RSG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:19.710972] [INFO ] [MAIN ] RSG: Generated 1339 derivative records from 35194 primary records. [2025-09-16T21:20:19.711225] [DEBUG] [LOCAL ] RSG: Saving derivative data. [2025-09-16T21:20:19.726497] [DEBUG] [LOCAL ] RSG: Derivative data saved (1339 records). [2025-09-16T21:20:19.726786] [INFO ] [MAIN ] RSG: Successfully saved derivative data. [2025-09-16T21:20:19.728730] [INFO ] [MAIN ] Derivative Progress: 1564/2026 symbols completed. RSG took 1.0s. Estimated remaining: 2m 30s. Rate: 184.8 symbols/min [2025-09-16T21:20:19.729556] [INFO ] [MAIN ] RTO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:19.744142] [DEBUG] [MAIN ] RSI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:19.745013] [INFO ] [MAIN ] RSI: Generated 1339 derivative records from 34601 primary records. [2025-09-16T21:20:19.745129] [DEBUG] [LOCAL ] RSI: Saving derivative data. [2025-09-16T21:20:19.760071] [DEBUG] [LOCAL ] RSI: Derivative data saved (1339 records). [2025-09-16T21:20:19.760229] [INFO ] [MAIN ] RSI: Successfully saved derivative data. [2025-09-16T21:20:19.763329] [INFO ] [MAIN ] Derivative Progress: 1565/2026 symbols completed. RSI took 1.0s. Estimated remaining: 2m 30s. Rate: 184.9 symbols/min [2025-09-16T21:20:19.773182] [INFO ] [MAIN ] RTX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:19.781675] [DEBUG] [MAIN ] RSKD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:19.782676] [INFO ] [MAIN ] RSKD: Generated 1339 derivative records from 24980 primary records. [2025-09-16T21:20:19.782823] [DEBUG] [LOCAL ] RSKD: Saving derivative data. [2025-09-16T21:20:19.804845] [DEBUG] [LOCAL ] RSKD: Derivative data saved (1339 records). [2025-09-16T21:20:19.805384] [DEBUG] [LOCAL ] RTO: Loaded 29228 existing records from primary storage. [2025-09-16T21:20:19.805579] [INFO ] [MAIN ] RSKD: Successfully saved derivative data. [2025-09-16T21:20:19.807625] [INFO ] [MAIN ] RTO: Loaded 29228 primary data records. [2025-09-16T21:20:19.807523] [INFO ] [MAIN ] Derivative Progress: 1566/2026 symbols completed. RSKD took 1.0s. Estimated remaining: 2m 29s. Rate: 185.0 symbols/min [2025-09-16T21:20:19.807869] [INFO ] [MAIN ] RVLV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:20.111301] [DEBUG] [LOCAL ] RVLV: Loaded 35444 existing records from primary storage. [2025-09-16T21:20:20.111159] [DEBUG] [LOCAL ] RTX: Loaded 40065 existing records from primary storage. [2025-09-16T21:20:20.111475] [INFO ] [MAIN ] RTX: Loaded 40065 primary data records. [2025-09-16T21:20:20.111635] [INFO ] [MAIN ] RVLV: Loaded 35444 primary data records. [2025-09-16T21:20:20.677466] [DEBUG] [MAIN ] RTO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:20.679278] [INFO ] [MAIN ] RTO: Generated 1339 derivative records from 29228 primary records. [2025-09-16T21:20:20.679546] [DEBUG] [LOCAL ] RTO: Saving derivative data. [2025-09-16T21:20:20.693200] [DEBUG] [LOCAL ] RTO: Derivative data saved (1339 records). [2025-09-16T21:20:20.693612] [INFO ] [MAIN ] RTO: Successfully saved derivative data. [2025-09-16T21:20:20.695564] [INFO ] [MAIN ] Derivative Progress: 1567/2026 symbols completed. RTO took 1.0s. Estimated remaining: 2m 29s. Rate: 184.8 symbols/min [2025-09-16T21:20:20.696184] [INFO ] [MAIN ] RVT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:20.713897] [DEBUG] [MAIN ] RTX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:20.723967] [INFO ] [MAIN ] RTX: Generated 1339 derivative records from 40065 primary records. [2025-09-16T21:20:20.728960] [DEBUG] [LOCAL ] RTX: Saving derivative data. [2025-09-16T21:20:20.729317] [DEBUG] [MAIN ] RVLV: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:20.730941] [INFO ] [MAIN ] RVLV: Generated 1339 derivative records from 35444 primary records. [2025-09-16T21:20:20.736857] [DEBUG] [LOCAL ] RVLV: Saving derivative data. [2025-09-16T21:20:20.743664] [DEBUG] [LOCAL ] RTX: Derivative data saved (1339 records). [2025-09-16T21:20:20.755910] [INFO ] [MAIN ] RTX: Successfully saved derivative data. [2025-09-16T21:20:20.758524] [INFO ] [MAIN ] Derivative Progress: 1568/2026 symbols completed. RTX took 1.0s. Estimated remaining: 2m 29s. Rate: 184.9 symbols/min [2025-09-16T21:20:20.763522] [DEBUG] [LOCAL ] RVLV: Derivative data saved (1339 records). [2025-09-16T21:20:20.763633] [INFO ] [MAIN ] RVLV: Successfully saved derivative data. [2025-09-16T21:20:20.766317] [DEBUG] [LOCAL ] RVT: Loaded 19541 existing records from primary storage. [2025-09-16T21:20:20.766524] [INFO ] [MAIN ] RVT: Loaded 19541 primary data records. [2025-09-16T21:20:20.765862] [INFO ] [MAIN ] Derivative Progress: 1569/2026 symbols completed. RVLV took 1.0s. Estimated remaining: 2m 28s. Rate: 185.0 symbols/min [2025-09-16T21:20:20.766914] [INFO ] [MAIN ] RWT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:20.763818] [INFO ] [MAIN ] RVTY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:20.963172] [DEBUG] [LOCAL ] RWT: Loaded 29629 existing records from primary storage. [2025-09-16T21:20:21.044465] [INFO ] [MAIN ] RWT: Loaded 29629 primary data records. [2025-09-16T21:20:21.172635] [DEBUG] [LOCAL ] RVTY: Loaded 35314 existing records from primary storage. [2025-09-16T21:20:21.178879] [INFO ] [MAIN ] RVTY: Loaded 35314 primary data records. [2025-09-16T21:20:21.674637] [DEBUG] [MAIN ] RVT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:21.675793] [INFO ] [MAIN ] RVT: Generated 1339 derivative records from 19541 primary records. [2025-09-16T21:20:21.676530] [DEBUG] [LOCAL ] RVT: Saving derivative data. [2025-09-16T21:20:21.690666] [DEBUG] [LOCAL ] RVT: Derivative data saved (1339 records). [2025-09-16T21:20:21.691421] [INFO ] [MAIN ] RVT: Successfully saved derivative data. [2025-09-16T21:20:21.693273] [INFO ] [MAIN ] Derivative Progress: 1570/2026 symbols completed. RVT took 1.0s. Estimated remaining: 2m 28s. Rate: 184.8 symbols/min [2025-09-16T21:20:21.693580] [INFO ] [MAIN ] RWTP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:21.701383] [DEBUG] [LOCAL ] RWTP: Loaded 1997 existing records from primary storage. [2025-09-16T21:20:21.701795] [INFO ] [MAIN ] RWTP: Loaded 1997 primary data records. [2025-09-16T21:20:21.781758] [DEBUG] [MAIN ] RWT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:21.799616] [INFO ] [MAIN ] RWT: Generated 1339 derivative records from 29629 primary records. [2025-09-16T21:20:21.799735] [DEBUG] [LOCAL ] RWT: Saving derivative data. [2025-09-16T21:20:21.839338] [DEBUG] [LOCAL ] RWT: Derivative data saved (1339 records). [2025-09-16T21:20:21.854878] [INFO ] [MAIN ] RWT: Successfully saved derivative data. [2025-09-16T21:20:21.870961] [INFO ] [MAIN ] Derivative Progress: 1571/2026 symbols completed. RWT took 1.1s. Estimated remaining: 2m 28s. Rate: 184.8 symbols/min [2025-09-16T21:20:21.898915] [DEBUG] [MAIN ] RVTY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:21.898991] [INFO ] [MAIN ] RXO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:21.906338] [INFO ] [MAIN ] RVTY: Generated 1339 derivative records from 35314 primary records. [2025-09-16T21:20:21.924311] [DEBUG] [LOCAL ] RVTY: Saving derivative data. [2025-09-16T21:20:22.025078] [DEBUG] [LOCAL ] RVTY: Derivative data saved (1339 records). [2025-09-16T21:20:22.025736] [INFO ] [MAIN ] RVTY: Successfully saved derivative data. [2025-09-16T21:20:22.027907] [INFO ] [MAIN ] Derivative Progress: 1572/2026 symbols completed. RVTY took 1.3s. Estimated remaining: 2m 27s. Rate: 184.9 symbols/min [2025-09-16T21:20:22.028340] [INFO ] [MAIN ] RY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:22.054206] [DEBUG] [MAIN ] RWTP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:22.054904] [INFO ] [MAIN ] RWTP: Generated 1339 derivative records from 1997 primary records. [2025-09-16T21:20:22.055027] [DEBUG] [LOCAL ] RWTP: Saving derivative data. [2025-09-16T21:20:22.065492] [DEBUG] [LOCAL ] RWTP: Derivative data saved (1339 records). [2025-09-16T21:20:22.066200] [INFO ] [MAIN ] RWTP: Successfully saved derivative data. [2025-09-16T21:20:22.067975] [INFO ] [MAIN ] Derivative Progress: 1573/2026 symbols completed. RWTP took 0.4s. Estimated remaining: 2m 27s. Rate: 185.0 symbols/min [2025-09-16T21:20:22.086590] [DEBUG] [LOCAL ] RXO: Loaded 35638 existing records from primary storage. [2025-09-16T21:20:22.086801] [INFO ] [MAIN ] RXO: Loaded 35638 primary data records. [2025-09-16T21:20:22.231677] [DEBUG] [LOCAL ] RY: Loaded 35331 existing records from primary storage. [2025-09-16T21:20:22.254427] [INFO ] [MAIN ] RY: Loaded 35331 primary data records. [2025-09-16T21:20:22.646936] [DEBUG] [MAIN ] RXO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:22.647858] [INFO ] [MAIN ] RXO: Generated 1339 derivative records from 35638 primary records. [2025-09-16T21:20:22.648020] [DEBUG] [LOCAL ] RXO: Saving derivative data. [2025-09-16T21:20:22.660509] [DEBUG] [LOCAL ] RXO: Derivative data saved (1339 records). [2025-09-16T21:20:22.660674] [INFO ] [MAIN ] RXO: Successfully saved derivative data. [2025-09-16T21:20:22.662252] [INFO ] [MAIN ] Derivative Progress: 1574/2026 symbols completed. RXO took 0.8s. Estimated remaining: 2m 27s. Rate: 184.9 symbols/min [2025-09-16T21:20:22.673770] [DEBUG] [MAIN ] RY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:22.674422] [INFO ] [MAIN ] RY: Generated 1339 derivative records from 35331 primary records. [2025-09-16T21:20:22.674484] [DEBUG] [LOCAL ] RY: Saving derivative data. [2025-09-16T21:20:22.686443] [DEBUG] [LOCAL ] RY: Derivative data saved (1339 records). [2025-09-16T21:20:22.686503] [INFO ] [MAIN ] RY: Successfully saved derivative data. [2025-09-16T21:20:22.688446] [INFO ] [MAIN ] Derivative Progress: 1575/2026 symbols completed. RY took 0.7s. Estimated remaining: 2m 26s. Rate: 185.0 symbols/min [2025-09-16T21:20:22.689061] [INFO ] [MAIN ] RYAM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:22.689392] [INFO ] [MAIN ] RYAN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:22.689236] [INFO ] [MAIN ] RYI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:22.712677] [DEBUG] [LOCAL ] RYI: Loaded 16169 existing records from primary storage. [2025-09-16T21:20:22.712921] [INFO ] [MAIN ] RYI: Loaded 16169 primary data records. [2025-09-16T21:20:22.831636] [DEBUG] [LOCAL ] RYAM: Loaded 25883 existing records from primary storage. [2025-09-16T21:20:22.837575] [INFO ] [MAIN ] RYAM: Loaded 25883 primary data records. [2025-09-16T21:20:22.931991] [DEBUG] [LOCAL ] RYAN: Loaded 32531 existing records from primary storage. [2025-09-16T21:20:22.944379] [INFO ] [MAIN ] RYAN: Loaded 32531 primary data records. [2025-09-16T21:20:23.594146] [DEBUG] [MAIN ] RYI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:23.595091] [INFO ] [MAIN ] RYI: Generated 1339 derivative records from 16169 primary records. [2025-09-16T21:20:23.595227] [DEBUG] [LOCAL ] RYI: Saving derivative data. [2025-09-16T21:20:23.620370] [DEBUG] [LOCAL ] RYI: Derivative data saved (1339 records). [2025-09-16T21:20:23.620493] [INFO ] [MAIN ] RYI: Successfully saved derivative data. [2025-09-16T21:20:23.619362] [DEBUG] [MAIN ] RYAM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:23.622018] [INFO ] [MAIN ] Derivative Progress: 1576/2026 symbols completed. RYI took 0.9s. Estimated remaining: 2m 26s. Rate: 184.8 symbols/min [2025-09-16T21:20:23.622199] [INFO ] [MAIN ] RYN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:23.622849] [INFO ] [MAIN ] RYAM: Generated 1339 derivative records from 25883 primary records. [2025-09-16T21:20:23.632499] [DEBUG] [LOCAL ] RYAM: Saving derivative data. [2025-09-16T21:20:23.632717] [DEBUG] [MAIN ] RYAN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:23.634049] [INFO ] [MAIN ] RYAN: Generated 1339 derivative records from 32531 primary records. [2025-09-16T21:20:23.634146] [DEBUG] [LOCAL ] RYAN: Saving derivative data. [2025-09-16T21:20:23.655501] [DEBUG] [LOCAL ] RYAN: Derivative data saved (1339 records). [2025-09-16T21:20:23.656621] [INFO ] [MAIN ] RYAN: Successfully saved derivative data. [2025-09-16T21:20:23.658915] [INFO ] [MAIN ] Derivative Progress: 1577/2026 symbols completed. RYAN took 1.0s. Estimated remaining: 2m 26s. Rate: 184.9 symbols/min [2025-09-16T21:20:23.659339] [DEBUG] [LOCAL ] RYAM: Derivative data saved (1339 records). [2025-09-16T21:20:23.659418] [INFO ] [MAIN ] RYAM: Successfully saved derivative data. [2025-09-16T21:20:23.661790] [INFO ] [MAIN ] RZB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:23.661704] [INFO ] [MAIN ] Derivative Progress: 1578/2026 symbols completed. RYAM took 1.0s. Estimated remaining: 2m 25s. Rate: 185.0 symbols/min [2025-09-16T21:20:23.662451] [INFO ] [MAIN ] RZC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:23.679760] [DEBUG] [LOCAL ] RZB: Loaded 4735 existing records from primary storage. [2025-09-16T21:20:23.679943] [DEBUG] [LOCAL ] RZC: Loaded 4971 existing records from primary storage. [2025-09-16T21:20:23.680126] [INFO ] [MAIN ] RZB: Loaded 4735 primary data records. [2025-09-16T21:20:23.680082] [INFO ] [MAIN ] RZC: Loaded 4971 primary data records. [2025-09-16T21:20:23.870687] [DEBUG] [LOCAL ] RYN: Loaded 33847 existing records from primary storage. [2025-09-16T21:20:23.902432] [INFO ] [MAIN ] RYN: Loaded 33847 primary data records. [2025-09-16T21:20:24.520723] [DEBUG] [MAIN ] RZC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:24.520940] [DEBUG] [MAIN ] RZB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:24.522107] [INFO ] [MAIN ] RZC: Generated 1339 derivative records from 4971 primary records. [2025-09-16T21:20:24.522316] [DEBUG] [LOCAL ] RZC: Saving derivative data. [2025-09-16T21:20:24.522844] [INFO ] [MAIN ] RZB: Generated 1339 derivative records from 4735 primary records. [2025-09-16T21:20:24.523956] [DEBUG] [LOCAL ] RZB: Saving derivative data. [2025-09-16T21:20:24.535451] [DEBUG] [LOCAL ] RZC: Derivative data saved (1339 records). [2025-09-16T21:20:24.535730] [INFO ] [MAIN ] RZC: Successfully saved derivative data. [2025-09-16T21:20:24.542692] [INFO ] [MAIN ] Derivative Progress: 1579/2026 symbols completed. RZC took 0.9s. Estimated remaining: 2m 25s. Rate: 184.8 symbols/min [2025-09-16T21:20:24.544940] [INFO ] [MAIN ] S: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:24.551067] [DEBUG] [LOCAL ] RZB: Derivative data saved (1339 records). [2025-09-16T21:20:24.551277] [INFO ] [MAIN ] RZB: Successfully saved derivative data. [2025-09-16T21:20:24.553082] [INFO ] [MAIN ] Derivative Progress: 1580/2026 symbols completed. RZB took 0.9s. Estimated remaining: 2m 25s. Rate: 184.9 symbols/min [2025-09-16T21:20:24.553437] [INFO ] [MAIN ] SA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:24.563948] [DEBUG] [MAIN ] RYN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:24.564676] [INFO ] [MAIN ] RYN: Generated 1339 derivative records from 33847 primary records. [2025-09-16T21:20:24.564854] [DEBUG] [LOCAL ] RYN: Saving derivative data. [2025-09-16T21:20:24.577933] [DEBUG] [LOCAL ] RYN: Derivative data saved (1339 records). [2025-09-16T21:20:24.578061] [INFO ] [MAIN ] RYN: Successfully saved derivative data. [2025-09-16T21:20:24.580325] [INFO ] [MAIN ] Derivative Progress: 1581/2026 symbols completed. RYN took 1.0s. Estimated remaining: 2m 24s. Rate: 185.0 symbols/min [2025-09-16T21:20:24.580633] [INFO ] [MAIN ] SABA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:24.604618] [DEBUG] [LOCAL ] SABA: Loaded 6936 existing records from primary storage. [2025-09-16T21:20:24.604774] [INFO ] [MAIN ] SABA: Loaded 6936 primary data records. [2025-09-16T21:20:24.732726] [DEBUG] [LOCAL ] SA: Loaded 31891 existing records from primary storage. [2025-09-16T21:20:24.732620] [DEBUG] [LOCAL ] S: Loaded 39911 existing records from primary storage. [2025-09-16T21:20:24.736957] [INFO ] [MAIN ] SA: Loaded 31891 primary data records. [2025-09-16T21:20:24.736904] [INFO ] [MAIN ] S: Loaded 39911 primary data records. [2025-09-16T21:20:25.443663] [DEBUG] [MAIN ] SABA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:25.445041] [INFO ] [MAIN ] SABA: Generated 1339 derivative records from 6936 primary records. [2025-09-16T21:20:25.445176] [DEBUG] [LOCAL ] SABA: Saving derivative data. [2025-09-16T21:20:25.458007] [DEBUG] [LOCAL ] SABA: Derivative data saved (1339 records). [2025-09-16T21:20:25.458244] [INFO ] [MAIN ] SABA: Successfully saved derivative data. [2025-09-16T21:20:25.459825] [INFO ] [MAIN ] Derivative Progress: 1582/2026 symbols completed. SABA took 0.9s. Estimated remaining: 2m 24s. Rate: 184.8 symbols/min [2025-09-16T21:20:25.460069] [INFO ] [MAIN ] SAFE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:25.484579] [DEBUG] [MAIN ] S: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:25.485122] [DEBUG] [MAIN ] SA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:25.485734] [INFO ] [MAIN ] S: Generated 1339 derivative records from 39911 primary records. [2025-09-16T21:20:25.486365] [DEBUG] [LOCAL ] S: Saving derivative data. [2025-09-16T21:20:25.486484] [INFO ] [MAIN ] SA: Generated 1339 derivative records from 31891 primary records. [2025-09-16T21:20:25.496686] [DEBUG] [LOCAL ] SA: Saving derivative data. [2025-09-16T21:20:25.503908] [DEBUG] [LOCAL ] S: Derivative data saved (1339 records). [2025-09-16T21:20:25.505220] [INFO ] [MAIN ] S: Successfully saved derivative data. [2025-09-16T21:20:25.507286] [INFO ] [MAIN ] Derivative Progress: 1583/2026 symbols completed. S took 1.0s. Estimated remaining: 2m 24s. Rate: 184.9 symbols/min [2025-09-16T21:20:25.513772] [INFO ] [MAIN ] SAH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:25.527863] [DEBUG] [LOCAL ] SA: Derivative data saved (1339 records). [2025-09-16T21:20:25.528273] [DEBUG] [LOCAL ] SAFE: Loaded 22425 existing records from primary storage. [2025-09-16T21:20:25.528499] [INFO ] [MAIN ] SA: Successfully saved derivative data. [2025-09-16T21:20:25.528666] [INFO ] [MAIN ] SAFE: Loaded 22425 primary data records. [2025-09-16T21:20:25.530795] [INFO ] [MAIN ] Derivative Progress: 1584/2026 symbols completed. SA took 1.0s. Estimated remaining: 2m 23s. Rate: 185.0 symbols/min [2025-09-16T21:20:25.536181] [INFO ] [MAIN ] SAM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:25.647980] [DEBUG] [LOCAL ] SAH: Loaded 15649 existing records from primary storage. [2025-09-16T21:20:25.658653] [INFO ] [MAIN ] SAH: Loaded 15649 primary data records. [2025-09-16T21:20:25.808447] [DEBUG] [LOCAL ] SAM: Loaded 16309 existing records from primary storage. [2025-09-16T21:20:25.829599] [INFO ] [MAIN ] SAM: Loaded 16309 primary data records. [2025-09-16T21:20:26.394536] [DEBUG] [MAIN ] SAFE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:26.395800] [INFO ] [MAIN ] SAFE: Generated 1339 derivative records from 22425 primary records. [2025-09-16T21:20:26.404977] [DEBUG] [LOCAL ] SAFE: Saving derivative data. [2025-09-16T21:20:26.406324] [DEBUG] [MAIN ] SAH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:26.415264] [INFO ] [MAIN ] SAH: Generated 1339 derivative records from 15649 primary records. [2025-09-16T21:20:26.415873] [DEBUG] [LOCAL ] SAH: Saving derivative data. [2025-09-16T21:20:26.426601] [DEBUG] [LOCAL ] SAFE: Derivative data saved (1339 records). [2025-09-16T21:20:26.432381] [DEBUG] [LOCAL ] SAH: Derivative data saved (1339 records). [2025-09-16T21:20:26.432698] [INFO ] [MAIN ] SAFE: Successfully saved derivative data. [2025-09-16T21:20:26.432546] [INFO ] [MAIN ] SAH: Successfully saved derivative data. [2025-09-16T21:20:26.434788] [INFO ] [MAIN ] Derivative Progress: 1585/2026 symbols completed. SAH took 0.9s. Estimated remaining: 2m 23s. Rate: 184.8 symbols/min [2025-09-16T21:20:26.436692] [INFO ] [MAIN ] Derivative Progress: 1586/2026 symbols completed. SAFE took 1.0s. Estimated remaining: 2m 23s. Rate: 184.9 symbols/min [2025-09-16T21:20:26.437093] [INFO ] [MAIN ] SAN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:26.437413] [INFO ] [MAIN ] SAND: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:26.448314] [DEBUG] [MAIN ] SAM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:26.449266] [INFO ] [MAIN ] SAM: Generated 1339 derivative records from 16309 primary records. [2025-09-16T21:20:26.449452] [DEBUG] [LOCAL ] SAM: Saving derivative data. [2025-09-16T21:20:26.462601] [DEBUG] [LOCAL ] SAM: Derivative data saved (1339 records). [2025-09-16T21:20:26.462772] [INFO ] [MAIN ] SAM: Successfully saved derivative data. [2025-09-16T21:20:26.465000] [INFO ] [MAIN ] Derivative Progress: 1587/2026 symbols completed. SAM took 0.9s. Estimated remaining: 2m 22s. Rate: 185.0 symbols/min [2025-09-16T21:20:26.465291] [INFO ] [MAIN ] SAP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:26.522587] [DEBUG] [LOCAL ] SAND: Loaded 38514 existing records from primary storage. [2025-09-16T21:20:26.522934] [INFO ] [MAIN ] SAND: Loaded 38514 primary data records. [2025-09-16T21:20:26.523360] [DEBUG] [LOCAL ] SAN: Loaded 39512 existing records from primary storage. [2025-09-16T21:20:26.523541] [INFO ] [MAIN ] SAN: Loaded 39512 primary data records. [2025-09-16T21:20:26.732485] [DEBUG] [LOCAL ] SAP: Loaded 36995 existing records from primary storage. [2025-09-16T21:20:26.748571] [INFO ] [MAIN ] SAP: Loaded 36995 primary data records. [2025-09-16T21:20:27.369380] [DEBUG] [MAIN ] SAN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:27.376084] [INFO ] [MAIN ] SAN: Generated 1339 derivative records from 39512 primary records. [2025-09-16T21:20:27.385494] [DEBUG] [LOCAL ] SAN: Saving derivative data. [2025-09-16T21:20:27.389840] [DEBUG] [MAIN ] SAND: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:27.390612] [INFO ] [MAIN ] SAND: Generated 1339 derivative records from 38514 primary records. [2025-09-16T21:20:27.389487] [DEBUG] [MAIN ] SAP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:27.391085] [DEBUG] [LOCAL ] SAND: Saving derivative data. [2025-09-16T21:20:27.391749] [INFO ] [MAIN ] SAP: Generated 1339 derivative records from 36995 primary records. [2025-09-16T21:20:27.392941] [DEBUG] [LOCAL ] SAP: Saving derivative data. [2025-09-16T21:20:27.424236] [DEBUG] [LOCAL ] SAP: Derivative data saved (1339 records). [2025-09-16T21:20:27.427304] [INFO ] [MAIN ] SAP: Successfully saved derivative data. [2025-09-16T21:20:27.429622] [INFO ] [MAIN ] Derivative Progress: 1588/2026 symbols completed. SAP took 1.0s. Estimated remaining: 2m 22s. Rate: 184.8 symbols/min [2025-09-16T21:20:27.427233] [DEBUG] [LOCAL ] SAND: Derivative data saved (1339 records). [2025-09-16T21:20:27.430681] [INFO ] [MAIN ] SAND: Successfully saved derivative data. [2025-09-16T21:20:27.432962] [INFO ] [MAIN ] Derivative Progress: 1589/2026 symbols completed. SAND took 1.0s. Estimated remaining: 2m 22s. Rate: 184.9 symbols/min [2025-09-16T21:20:27.433613] [DEBUG] [LOCAL ] SAN: Derivative data saved (1339 records). [2025-09-16T21:20:27.433825] [INFO ] [MAIN ] SAN: Successfully saved derivative data. [2025-09-16T21:20:27.435924] [INFO ] [MAIN ] Derivative Progress: 1590/2026 symbols completed. SAN took 1.0s. Estimated remaining: 2m 21s. Rate: 185.0 symbols/min [2025-09-16T21:20:27.436540] [INFO ] [MAIN ] SAR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:27.436683] [INFO ] [MAIN ] SARO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:27.436910] [INFO ] [MAIN ] SB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:27.450730] [DEBUG] [LOCAL ] SAR: Loaded 12205 existing records from primary storage. [2025-09-16T21:20:27.450929] [INFO ] [MAIN ] SAR: Loaded 12205 primary data records. [2025-09-16T21:20:27.673439] [DEBUG] [LOCAL ] SB: Loaded 24178 existing records from primary storage. [2025-09-16T21:20:27.751330] [INFO ] [MAIN ] SB: Loaded 24178 primary data records. [2025-09-16T21:20:27.759340] [DEBUG] [LOCAL ] SARO: Loaded 35849 existing records from primary storage. [2025-09-16T21:20:27.771467] [INFO ] [MAIN ] SARO: Loaded 35849 primary data records. [2025-09-16T21:20:28.375520] [DEBUG] [MAIN ] SAR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:28.378042] [INFO ] [MAIN ] SAR: Generated 1339 derivative records from 12205 primary records. [2025-09-16T21:20:28.378870] [DEBUG] [LOCAL ] SAR: Saving derivative data. [2025-09-16T21:20:28.393375] [DEBUG] [LOCAL ] SAR: Derivative data saved (1339 records). [2025-09-16T21:20:28.393717] [INFO ] [MAIN ] SAR: Successfully saved derivative data. [2025-09-16T21:20:28.395318] [INFO ] [MAIN ] Derivative Progress: 1591/2026 symbols completed. SAR took 1.0s. Estimated remaining: 2m 21s. Rate: 184.8 symbols/min [2025-09-16T21:20:28.396932] [INFO ] [MAIN ] SBH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:28.415480] [DEBUG] [MAIN ] SB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:28.417563] [INFO ] [MAIN ] SB: Generated 1339 derivative records from 24178 primary records. [2025-09-16T21:20:28.417849] [DEBUG] [LOCAL ] SB: Saving derivative data. [2025-09-16T21:20:28.433974] [DEBUG] [MAIN ] SARO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:28.449201] [INFO ] [MAIN ] SARO: Generated 1339 derivative records from 35849 primary records. [2025-09-16T21:20:28.449327] [DEBUG] [LOCAL ] SB: Derivative data saved (1339 records). [2025-09-16T21:20:28.449507] [INFO ] [MAIN ] SB: Successfully saved derivative data. [2025-09-16T21:20:28.451463] [INFO ] [MAIN ] Derivative Progress: 1592/2026 symbols completed. SB took 1.0s. Estimated remaining: 2m 21s. Rate: 184.9 symbols/min [2025-09-16T21:20:28.449558] [DEBUG] [LOCAL ] SARO: Saving derivative data. [2025-09-16T21:20:28.451775] [INFO ] [MAIN ] SBI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:28.467132] [DEBUG] [LOCAL ] SARO: Derivative data saved (1339 records). [2025-09-16T21:20:28.477788] [INFO ] [MAIN ] SARO: Successfully saved derivative data. [2025-09-16T21:20:28.479933] [INFO ] [MAIN ] Derivative Progress: 1593/2026 symbols completed. SARO took 1.0s. Estimated remaining: 2m 20s. Rate: 185.0 symbols/min [2025-09-16T21:20:28.480254] [INFO ] [MAIN ] SBR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:28.480881] [DEBUG] [LOCAL ] SBH: Loaded 36732 existing records from primary storage. [2025-09-16T21:20:28.484714] [INFO ] [MAIN ] SBH: Loaded 36732 primary data records. [2025-09-16T21:20:28.485166] [DEBUG] [LOCAL ] SBI: Loaded 5420 existing records from primary storage. [2025-09-16T21:20:28.523132] [INFO ] [MAIN ] SBI: Loaded 5420 primary data records. [2025-09-16T21:20:28.608440] [DEBUG] [LOCAL ] SBR: Loaded 5269 existing records from primary storage. [2025-09-16T21:20:28.621327] [INFO ] [MAIN ] SBR: Loaded 5269 primary data records. [2025-09-16T21:20:29.327872] [DEBUG] [MAIN ] SBH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:29.328906] [INFO ] [MAIN ] SBH: Generated 1339 derivative records from 36732 primary records. [2025-09-16T21:20:29.329277] [DEBUG] [LOCAL ] SBH: Saving derivative data. [2025-09-16T21:20:29.360126] [DEBUG] [MAIN ] SBR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:29.366779] [INFO ] [MAIN ] SBR: Generated 1339 derivative records from 5269 primary records. [2025-09-16T21:20:29.360283] [DEBUG] [LOCAL ] SBH: Derivative data saved (1339 records). [2025-09-16T21:20:29.370466] [INFO ] [MAIN ] SBH: Successfully saved derivative data. [2025-09-16T21:20:29.370616] [DEBUG] [LOCAL ] SBR: Saving derivative data. [2025-09-16T21:20:29.372540] [DEBUG] [MAIN ] SBI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:29.372223] [INFO ] [MAIN ] Derivative Progress: 1594/2026 symbols completed. SBH took 1.0s. Estimated remaining: 2m 20s. Rate: 184.8 symbols/min [2025-09-16T21:20:29.374297] [INFO ] [MAIN ] SBS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:29.374225] [INFO ] [MAIN ] SBI: Generated 1339 derivative records from 5420 primary records. [2025-09-16T21:20:29.384056] [DEBUG] [LOCAL ] SBI: Saving derivative data. [2025-09-16T21:20:29.386114] [DEBUG] [LOCAL ] SBR: Derivative data saved (1339 records). [2025-09-16T21:20:29.387032] [INFO ] [MAIN ] SBR: Successfully saved derivative data. [2025-09-16T21:20:29.389092] [INFO ] [MAIN ] Derivative Progress: 1595/2026 symbols completed. SBR took 0.9s. Estimated remaining: 2m 20s. Rate: 184.9 symbols/min [2025-09-16T21:20:29.389544] [INFO ] [MAIN ] SBSI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:29.400090] [DEBUG] [LOCAL ] SBI: Derivative data saved (1339 records). [2025-09-16T21:20:29.400512] [INFO ] [MAIN ] SBI: Successfully saved derivative data. [2025-09-16T21:20:29.402706] [INFO ] [MAIN ] Derivative Progress: 1596/2026 symbols completed. SBI took 1.0s. Estimated remaining: 2m 19s. Rate: 185.0 symbols/min [2025-09-16T21:20:29.403000] [INFO ] [MAIN ] SBSW: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:29.413509] [DEBUG] [LOCAL ] SBSI: Loaded 10476 existing records from primary storage. [2025-09-16T21:20:29.413734] [INFO ] [MAIN ] SBSI: Loaded 10476 primary data records. [2025-09-16T21:20:29.580744] [DEBUG] [LOCAL ] SBS: Loaded 36694 existing records from primary storage. [2025-09-16T21:20:29.598092] [INFO ] [MAIN ] SBS: Loaded 36694 primary data records. [2025-09-16T21:20:29.680392] [DEBUG] [LOCAL ] SBSW: Loaded 39565 existing records from primary storage. [2025-09-16T21:20:29.793146] [INFO ] [MAIN ] SBSW: Loaded 39565 primary data records. [2025-09-16T21:20:30.342598] [DEBUG] [MAIN ] SBSI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:30.343501] [INFO ] [MAIN ] SBSI: Generated 1339 derivative records from 10476 primary records. [2025-09-16T21:20:30.344950] [DEBUG] [LOCAL ] SBSI: Saving derivative data. [2025-09-16T21:20:30.357775] [DEBUG] [LOCAL ] SBSI: Derivative data saved (1339 records). [2025-09-16T21:20:30.358094] [INFO ] [MAIN ] SBSI: Successfully saved derivative data. [2025-09-16T21:20:30.359449] [INFO ] [MAIN ] Derivative Progress: 1597/2026 symbols completed. SBSI took 1.0s. Estimated remaining: 2m 19s. Rate: 184.8 symbols/min [2025-09-16T21:20:30.359885] [INFO ] [MAIN ] SCCO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:30.375123] [DEBUG] [MAIN ] SBSW: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:30.385024] [INFO ] [MAIN ] SBSW: Generated 1339 derivative records from 39565 primary records. [2025-09-16T21:20:30.385275] [DEBUG] [MAIN ] SBS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:30.385956] [DEBUG] [LOCAL ] SBSW: Saving derivative data. [2025-09-16T21:20:30.385912] [INFO ] [MAIN ] SBS: Generated 1339 derivative records from 36694 primary records. [2025-09-16T21:20:30.386629] [DEBUG] [LOCAL ] SBS: Saving derivative data. [2025-09-16T21:20:30.417937] [DEBUG] [LOCAL ] SBS: Derivative data saved (1339 records). [2025-09-16T21:20:30.417243] [DEBUG] [LOCAL ] SBSW: Derivative data saved (1339 records). [2025-09-16T21:20:30.418109] [INFO ] [MAIN ] SBSW: Successfully saved derivative data. [2025-09-16T21:20:30.420042] [INFO ] [MAIN ] Derivative Progress: 1598/2026 symbols completed. SBSW took 1.0s. Estimated remaining: 2m 19s. Rate: 184.9 symbols/min [2025-09-16T21:20:30.420707] [INFO ] [MAIN ] SCD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:30.418040] [INFO ] [MAIN ] SBS: Successfully saved derivative data. [2025-09-16T21:20:30.422813] [INFO ] [MAIN ] Derivative Progress: 1599/2026 symbols completed. SBS took 1.0s. Estimated remaining: 2m 18s. Rate: 185.0 symbols/min [2025-09-16T21:20:30.423080] [INFO ] [MAIN ] SCHW: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:30.435212] [DEBUG] [LOCAL ] SCCO: Loaded 36392 existing records from primary storage. [2025-09-16T21:20:30.435461] [INFO ] [MAIN ] SCCO: Loaded 36392 primary data records. [2025-09-16T21:20:30.556003] [DEBUG] [LOCAL ] SCD: Loaded 10312 existing records from primary storage. [2025-09-16T21:20:30.586761] [INFO ] [MAIN ] SCD: Loaded 10312 primary data records. [2025-09-16T21:20:30.843628] [DEBUG] [LOCAL ] SCHW: Loaded 40035 existing records from primary storage. [2025-09-16T21:20:30.875536] [INFO ] [MAIN ] SCHW: Loaded 40035 primary data records. [2025-09-16T21:20:31.280298] [DEBUG] [MAIN ] SCCO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:31.281130] [INFO ] [MAIN ] SCCO: Generated 1339 derivative records from 36392 primary records. [2025-09-16T21:20:31.281310] [DEBUG] [LOCAL ] SCCO: Saving derivative data. [2025-09-16T21:20:31.307284] [DEBUG] [MAIN ] SCD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:31.307354] [DEBUG] [LOCAL ] SCCO: Derivative data saved (1339 records). [2025-09-16T21:20:31.308367] [INFO ] [MAIN ] SCCO: Successfully saved derivative data. [2025-09-16T21:20:31.308134] [INFO ] [MAIN ] SCD: Generated 1339 derivative records from 10312 primary records. [2025-09-16T21:20:31.309952] [INFO ] [MAIN ] Derivative Progress: 1600/2026 symbols completed. SCCO took 1.0s. Estimated remaining: 2m 18s. Rate: 184.8 symbols/min [2025-09-16T21:20:31.310130] [INFO ] [MAIN ] SCI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:31.310318] [DEBUG] [LOCAL ] SCD: Saving derivative data. [2025-09-16T21:20:31.323220] [DEBUG] [LOCAL ] SCD: Derivative data saved (1339 records). [2025-09-16T21:20:31.323466] [INFO ] [MAIN ] SCD: Successfully saved derivative data. [2025-09-16T21:20:31.325979] [INFO ] [MAIN ] Derivative Progress: 1601/2026 symbols completed. SCD took 0.9s. Estimated remaining: 2m 18s. Rate: 184.9 symbols/min [2025-09-16T21:20:31.326281] [INFO ] [MAIN ] SCL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:31.338481] [DEBUG] [MAIN ] SCHW: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:31.339252] [INFO ] [MAIN ] SCHW: Generated 1339 derivative records from 40035 primary records. [2025-09-16T21:20:31.339333] [DEBUG] [LOCAL ] SCHW: Saving derivative data. [2025-09-16T21:20:31.361990] [DEBUG] [LOCAL ] SCHW: Derivative data saved (1339 records). [2025-09-16T21:20:31.366548] [DEBUG] [LOCAL ] SCL: Loaded 10807 existing records from primary storage. [2025-09-16T21:20:31.366607] [INFO ] [MAIN ] SCHW: Successfully saved derivative data. [2025-09-16T21:20:31.368763] [INFO ] [MAIN ] SCL: Loaded 10807 primary data records. [2025-09-16T21:20:31.368685] [INFO ] [MAIN ] Derivative Progress: 1602/2026 symbols completed. SCHW took 0.9s. Estimated remaining: 2m 18s. Rate: 185.0 symbols/min [2025-09-16T21:20:31.400362] [INFO ] [MAIN ] SCM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:31.470863] [DEBUG] [LOCAL ] SCI: Loaded 34725 existing records from primary storage. [2025-09-16T21:20:31.482056] [INFO ] [MAIN ] SCI: Loaded 34725 primary data records. [2025-09-16T21:20:31.648589] [DEBUG] [LOCAL ] SCM: Loaded 13659 existing records from primary storage. [2025-09-16T21:20:31.745839] [INFO ] [MAIN ] SCM: Loaded 13659 primary data records. [2025-09-16T21:20:32.191544] [DEBUG] [MAIN ] SCL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:32.194200] [INFO ] [MAIN ] SCL: Generated 1339 derivative records from 10807 primary records. [2025-09-16T21:20:32.194961] [DEBUG] [LOCAL ] SCL: Saving derivative data. [2025-09-16T21:20:32.210718] [DEBUG] [MAIN ] SCI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:32.216325] [DEBUG] [LOCAL ] SCL: Derivative data saved (1339 records). [2025-09-16T21:20:32.216914] [INFO ] [MAIN ] SCI: Generated 1339 derivative records from 34725 primary records. [2025-09-16T21:20:32.217052] [INFO ] [MAIN ] SCL: Successfully saved derivative data. [2025-09-16T21:20:32.217122] [DEBUG] [LOCAL ] SCI: Saving derivative data. [2025-09-16T21:20:32.218717] [INFO ] [MAIN ] Derivative Progress: 1603/2026 symbols completed. SCL took 0.9s. Estimated remaining: 2m 17s. Rate: 184.8 symbols/min [2025-09-16T21:20:32.232015] [DEBUG] [LOCAL ] SCI: Derivative data saved (1339 records). [2025-09-16T21:20:32.232562] [INFO ] [MAIN ] SCI: Successfully saved derivative data. [2025-09-16T21:20:32.235097] [INFO ] [MAIN ] Derivative Progress: 1604/2026 symbols completed. SCI took 0.9s. Estimated remaining: 2m 17s. Rate: 184.9 symbols/min [2025-09-16T21:20:32.244677] [DEBUG] [MAIN ] SCM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:32.245233] [INFO ] [MAIN ] SCM: Generated 1339 derivative records from 13659 primary records. [2025-09-16T21:20:32.245294] [DEBUG] [LOCAL ] SCM: Saving derivative data. [2025-09-16T21:20:32.256560] [DEBUG] [LOCAL ] SCM: Derivative data saved (1339 records). [2025-09-16T21:20:32.256624] [INFO ] [MAIN ] SCM: Successfully saved derivative data. [2025-09-16T21:20:32.258554] [INFO ] [MAIN ] Derivative Progress: 1605/2026 symbols completed. SCM took 0.9s. Estimated remaining: 2m 17s. Rate: 185.0 symbols/min [2025-09-16T21:20:32.258990] [INFO ] [MAIN ] SCS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:32.259194] [INFO ] [MAIN ] SDHC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:32.259084] [INFO ] [MAIN ] SD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:32.268661] [DEBUG] [LOCAL ] SDHC: Loaded 7272 existing records from primary storage. [2025-09-16T21:20:32.268975] [INFO ] [MAIN ] SDHC: Loaded 7272 primary data records. [2025-09-16T21:20:32.401132] [DEBUG] [LOCAL ] SD: Loaded 20834 existing records from primary storage. [2025-09-16T21:20:32.439179] [INFO ] [MAIN ] SD: Loaded 20834 primary data records. [2025-09-16T21:20:32.510462] [DEBUG] [LOCAL ] SCS: Loaded 31531 existing records from primary storage. [2025-09-16T21:20:32.669466] [INFO ] [MAIN ] SCS: Loaded 31531 primary data records. [2025-09-16T21:20:33.137108] [DEBUG] [MAIN ] SDHC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:33.138108] [INFO ] [MAIN ] SDHC: Generated 1339 derivative records from 7272 primary records. [2025-09-16T21:20:33.138388] [DEBUG] [LOCAL ] SDHC: Saving derivative data. [2025-09-16T21:20:33.153511] [DEBUG] [LOCAL ] SDHC: Derivative data saved (1339 records). [2025-09-16T21:20:33.163010] [INFO ] [MAIN ] SDHC: Successfully saved derivative data. [2025-09-16T21:20:33.164776] [INFO ] [MAIN ] Derivative Progress: 1606/2026 symbols completed. SDHC took 0.9s. Estimated remaining: 2m 16s. Rate: 184.8 symbols/min [2025-09-16T21:20:33.165321] [INFO ] [MAIN ] SDHY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:33.165125] [DEBUG] [MAIN ] SD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:33.167611] [INFO ] [MAIN ] SD: Generated 1339 derivative records from 20834 primary records. [2025-09-16T21:20:33.168365] [DEBUG] [LOCAL ] SD: Saving derivative data. [2025-09-16T21:20:33.188154] [DEBUG] [MAIN ] SCS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:33.192776] [INFO ] [MAIN ] SCS: Generated 1339 derivative records from 31531 primary records. [2025-09-16T21:20:33.193450] [DEBUG] [LOCAL ] SCS: Saving derivative data. [2025-09-16T21:20:33.194069] [DEBUG] [LOCAL ] SD: Derivative data saved (1339 records). [2025-09-16T21:20:33.194804] [INFO ] [MAIN ] SD: Successfully saved derivative data. [2025-09-16T21:20:33.197044] [INFO ] [MAIN ] Derivative Progress: 1607/2026 symbols completed. SD took 0.9s. Estimated remaining: 2m 16s. Rate: 184.9 symbols/min [2025-09-16T21:20:33.202779] [INFO ] [MAIN ] SDRL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:33.212913] [DEBUG] [LOCAL ] SDHY: Loaded 7757 existing records from primary storage. [2025-09-16T21:20:33.213599] [DEBUG] [LOCAL ] SCS: Derivative data saved (1339 records). [2025-09-16T21:20:33.213716] [INFO ] [MAIN ] SDHY: Loaded 7757 primary data records. [2025-09-16T21:20:33.225306] [INFO ] [MAIN ] SCS: Successfully saved derivative data. [2025-09-16T21:20:33.227484] [INFO ] [MAIN ] Derivative Progress: 1608/2026 symbols completed. SCS took 1.0s. Estimated remaining: 2m 16s. Rate: 185.0 symbols/min [2025-09-16T21:20:33.248134] [INFO ] [MAIN ] SEE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:33.519848] [DEBUG] [LOCAL ] SDRL: Loaded 30554 existing records from primary storage. [2025-09-16T21:20:33.520092] [INFO ] [MAIN ] SDRL: Loaded 30554 primary data records. [2025-09-16T21:20:33.637608] [DEBUG] [LOCAL ] SEE: Loaded 35487 existing records from primary storage. [2025-09-16T21:20:33.643512] [INFO ] [MAIN ] SEE: Loaded 35487 primary data records. [2025-09-16T21:20:34.080833] [DEBUG] [MAIN ] SDHY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:34.082030] [INFO ] [MAIN ] SDHY: Generated 1339 derivative records from 7757 primary records. [2025-09-16T21:20:34.082383] [DEBUG] [LOCAL ] SDHY: Saving derivative data. [2025-09-16T21:20:34.097013] [DEBUG] [LOCAL ] SDHY: Derivative data saved (1339 records). [2025-09-16T21:20:34.098387] [INFO ] [MAIN ] SDHY: Successfully saved derivative data. [2025-09-16T21:20:34.100470] [INFO ] [MAIN ] Derivative Progress: 1609/2026 symbols completed. SDHY took 0.9s. Estimated remaining: 2m 15s. Rate: 184.8 symbols/min [2025-09-16T21:20:34.106718] [INFO ] [MAIN ] SEG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:34.110871] [DEBUG] [MAIN ] SDRL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:34.111742] [INFO ] [MAIN ] SDRL: Generated 1339 derivative records from 30554 primary records. [2025-09-16T21:20:34.112001] [DEBUG] [LOCAL ] SDRL: Saving derivative data. [2025-09-16T21:20:34.125320] [DEBUG] [LOCAL ] SDRL: Derivative data saved (1339 records). [2025-09-16T21:20:34.128698] [INFO ] [MAIN ] SDRL: Successfully saved derivative data. [2025-09-16T21:20:34.130855] [INFO ] [MAIN ] Derivative Progress: 1610/2026 symbols completed. SDRL took 0.9s. Estimated remaining: 2m 15s. Rate: 184.9 symbols/min [2025-09-16T21:20:34.136990] [INFO ] [MAIN ] SEI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:34.141195] [DEBUG] [MAIN ] SEE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:34.146039] [DEBUG] [LOCAL ] SEG: Loaded 9675 existing records from primary storage. [2025-09-16T21:20:34.145826] [INFO ] [MAIN ] SEE: Generated 1339 derivative records from 35487 primary records. [2025-09-16T21:20:34.146220] [INFO ] [MAIN ] SEG: Loaded 9675 primary data records. [2025-09-16T21:20:34.146185] [DEBUG] [LOCAL ] SEE: Saving derivative data. [2025-09-16T21:20:34.289675] [DEBUG] [LOCAL ] SEE: Derivative data saved (1339 records). [2025-09-16T21:20:34.309790] [INFO ] [MAIN ] SEE: Successfully saved derivative data. [2025-09-16T21:20:34.341990] [INFO ] [MAIN ] Derivative Progress: 1611/2026 symbols completed. SEE took 1.1s. Estimated remaining: 2m 15s. Rate: 185.0 symbols/min [2025-09-16T21:20:34.356678] [INFO ] [MAIN ] SEM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:34.441500] [DEBUG] [LOCAL ] SEI: Loaded 36632 existing records from primary storage. [2025-09-16T21:20:34.441815] [INFO ] [MAIN ] SEI: Loaded 36632 primary data records. [2025-09-16T21:20:34.773462] [DEBUG] [LOCAL ] SEM: Loaded 32479 existing records from primary storage. [2025-09-16T21:20:34.774356] [INFO ] [MAIN ] SEM: Loaded 32479 primary data records. [2025-09-16T21:20:34.974154] [DEBUG] [MAIN ] SEG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:35.050815] [INFO ] [MAIN ] SEG: Generated 1339 derivative records from 9675 primary records. [2025-09-16T21:20:35.061854] [DEBUG] [LOCAL ] SEG: Saving derivative data. [2025-09-16T21:20:35.080063] [DEBUG] [LOCAL ] SEG: Derivative data saved (1339 records). [2025-09-16T21:20:35.090293] [INFO ] [MAIN ] SEG: Successfully saved derivative data. [2025-09-16T21:20:35.090783] [DEBUG] [MAIN ] SEI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:35.091422] [INFO ] [MAIN ] SEI: Generated 1339 derivative records from 36632 primary records. [2025-09-16T21:20:35.093705] [DEBUG] [LOCAL ] SEI: Saving derivative data. [2025-09-16T21:20:35.093227] [INFO ] [MAIN ] Derivative Progress: 1612/2026 symbols completed. SEG took 1.0s. Estimated remaining: 2m 14s. Rate: 184.8 symbols/min [2025-09-16T21:20:35.094581] [INFO ] [MAIN ] SEMR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:35.115117] [DEBUG] [LOCAL ] SEI: Derivative data saved (1339 records). [2025-09-16T21:20:35.115343] [INFO ] [MAIN ] SEI: Successfully saved derivative data. [2025-09-16T21:20:35.118069] [INFO ] [MAIN ] Derivative Progress: 1613/2026 symbols completed. SEI took 1.0s. Estimated remaining: 2m 14s. Rate: 184.9 symbols/min [2025-09-16T21:20:35.118413] [INFO ] [MAIN ] SES: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:35.133306] [DEBUG] [MAIN ] SEM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:35.134192] [INFO ] [MAIN ] SEM: Generated 1339 derivative records from 32479 primary records. [2025-09-16T21:20:35.141973] [DEBUG] [LOCAL ] SEM: Saving derivative data. [2025-09-16T21:20:35.156533] [DEBUG] [LOCAL ] SEM: Derivative data saved (1339 records). [2025-09-16T21:20:35.157249] [INFO ] [MAIN ] SEM: Successfully saved derivative data. [2025-09-16T21:20:35.159397] [INFO ] [MAIN ] Derivative Progress: 1614/2026 symbols completed. SEM took 0.8s. Estimated remaining: 2m 14s. Rate: 185.0 symbols/min [2025-09-16T21:20:35.159807] [INFO ] [MAIN ] SF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:35.170903] [DEBUG] [LOCAL ] SEMR: Loaded 30918 existing records from primary storage. [2025-09-16T21:20:35.178916] [INFO ] [MAIN ] SEMR: Loaded 30918 primary data records. [2025-09-16T21:20:35.296932] [DEBUG] [LOCAL ] SES: Loaded 38115 existing records from primary storage. [2025-09-16T21:20:35.308398] [INFO ] [MAIN ] SES: Loaded 38115 primary data records. [2025-09-16T21:20:35.592604] [DEBUG] [LOCAL ] SF: Loaded 30312 existing records from primary storage. [2025-09-16T21:20:35.609060] [INFO ] [MAIN ] SF: Loaded 30312 primary data records. [2025-09-16T21:20:36.042607] [DEBUG] [MAIN ] SEMR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:36.046193] [INFO ] [MAIN ] SEMR: Generated 1339 derivative records from 30918 primary records. [2025-09-16T21:20:36.046868] [DEBUG] [LOCAL ] SEMR: Saving derivative data. [2025-09-16T21:20:36.058576] [DEBUG] [MAIN ] SES: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:36.065620] [INFO ] [MAIN ] SES: Generated 1339 derivative records from 38115 primary records. [2025-09-16T21:20:36.069139] [DEBUG] [LOCAL ] SES: Saving derivative data. [2025-09-16T21:20:36.072184] [DEBUG] [LOCAL ] SEMR: Derivative data saved (1339 records). [2025-09-16T21:20:36.072554] [INFO ] [MAIN ] SEMR: Successfully saved derivative data. [2025-09-16T21:20:36.074631] [INFO ] [MAIN ] Derivative Progress: 1615/2026 symbols completed. SEMR took 1.0s. Estimated remaining: 2m 13s. Rate: 184.8 symbols/min [2025-09-16T21:20:36.084618] [INFO ] [MAIN ] SFB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:36.088583] [DEBUG] [LOCAL ] SES: Derivative data saved (1339 records). [2025-09-16T21:20:36.088924] [INFO ] [MAIN ] SES: Successfully saved derivative data. [2025-09-16T21:20:36.090755] [INFO ] [MAIN ] Derivative Progress: 1616/2026 symbols completed. SES took 1.0s. Estimated remaining: 2m 13s. Rate: 184.9 symbols/min [2025-09-16T21:20:36.090948] [INFO ] [MAIN ] SFBS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:36.095185] [DEBUG] [LOCAL ] SFB: Loaded 2592 existing records from primary storage. [2025-09-16T21:20:36.095504] [INFO ] [MAIN ] SFB: Loaded 2592 primary data records. [2025-09-16T21:20:36.210917] [DEBUG] [LOCAL ] SFBS: Loaded 15423 existing records from primary storage. [2025-09-16T21:20:36.216973] [INFO ] [MAIN ] SFBS: Loaded 15423 primary data records. [2025-09-16T21:20:36.272005] [DEBUG] [MAIN ] SF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:36.329906] [INFO ] [MAIN ] SF: Generated 1339 derivative records from 30312 primary records. [2025-09-16T21:20:36.353697] [DEBUG] [LOCAL ] SF: Saving derivative data. [2025-09-16T21:20:36.666811] [DEBUG] [LOCAL ] SF: Derivative data saved (1339 records). [2025-09-16T21:20:36.667441] [INFO ] [MAIN ] SF: Successfully saved derivative data. [2025-09-16T21:20:36.669863] [INFO ] [MAIN ] Derivative Progress: 1617/2026 symbols completed. SF took 1.5s. Estimated remaining: 2m 13s. Rate: 184.9 symbols/min [2025-09-16T21:20:36.670864] [INFO ] [MAIN ] SFL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:36.704825] [DEBUG] [MAIN ] SFB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:36.705818] [INFO ] [MAIN ] SFB: Generated 1339 derivative records from 2592 primary records. [2025-09-16T21:20:36.706748] [DEBUG] [LOCAL ] SFB: Saving derivative data. [2025-09-16T21:20:36.739071] [DEBUG] [LOCAL ] SFB: Derivative data saved (1339 records). [2025-09-16T21:20:36.739350] [INFO ] [MAIN ] SFB: Successfully saved derivative data. [2025-09-16T21:20:36.740346] [DEBUG] [LOCAL ] SFL: Loaded 33082 existing records from primary storage. [2025-09-16T21:20:36.739703] [DEBUG] [MAIN ] SFBS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:36.742024] [INFO ] [MAIN ] SFL: Loaded 33082 primary data records. [2025-09-16T21:20:36.741907] [INFO ] [MAIN ] Derivative Progress: 1618/2026 symbols completed. SFB took 0.7s. Estimated remaining: 2m 12s. Rate: 184.9 symbols/min [2025-09-16T21:20:36.742840] [INFO ] [MAIN ] SFBS: Generated 1339 derivative records from 15423 primary records. [2025-09-16T21:20:36.785762] [DEBUG] [LOCAL ] SFBS: Saving derivative data. [2025-09-16T21:20:36.857732] [DEBUG] [LOCAL ] SFBS: Derivative data saved (1339 records). [2025-09-16T21:20:36.863191] [INFO ] [MAIN ] SFBS: Successfully saved derivative data. [2025-09-16T21:20:36.876012] [INFO ] [MAIN ] Derivative Progress: 1619/2026 symbols completed. SFBS took 0.8s. Estimated remaining: 2m 12s. Rate: 185.0 symbols/min [2025-09-16T21:20:37.060543] [DEBUG] [MAIN ] SFL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:37.061191] [INFO ] [MAIN ] SFL: Generated 1339 derivative records from 33082 primary records. [2025-09-16T21:20:37.061254] [DEBUG] [LOCAL ] SFL: Saving derivative data. [2025-09-16T21:20:37.072935] [DEBUG] [LOCAL ] SFL: Derivative data saved (1339 records). [2025-09-16T21:20:37.073000] [INFO ] [MAIN ] SFL: Successfully saved derivative data. [2025-09-16T21:20:37.074686] [INFO ] [MAIN ] Derivative Progress: 1620/2026 symbols completed. SFL took 0.4s. Estimated remaining: 2m 12s. Rate: 185.1 symbols/min [2025-09-16T21:20:37.075515] [INFO ] [MAIN ] SGU: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:37.075362] [INFO ] [MAIN ] SG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:37.075819] [INFO ] [MAIN ] SGHC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:37.084175] [DEBUG] [LOCAL ] SGU: Loaded 5112 existing records from primary storage. [2025-09-16T21:20:37.084336] [INFO ] [MAIN ] SGU: Loaded 5112 primary data records. [2025-09-16T21:20:37.374992] [DEBUG] [LOCAL ] SGHC: Loaded 34694 existing records from primary storage. [2025-09-16T21:20:37.386543] [INFO ] [MAIN ] SGHC: Loaded 34694 primary data records. [2025-09-16T21:20:37.387346] [DEBUG] [LOCAL ] SG: Loaded 39909 existing records from primary storage. [2025-09-16T21:20:37.408291] [INFO ] [MAIN ] SG: Loaded 39909 primary data records. [2025-09-16T21:20:37.947035] [DEBUG] [MAIN ] SGU: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:37.948724] [INFO ] [MAIN ] SGU: Generated 1339 derivative records from 5112 primary records. [2025-09-16T21:20:37.948879] [DEBUG] [LOCAL ] SGU: Saving derivative data. [2025-09-16T21:20:37.964904] [DEBUG] [LOCAL ] SGU: Derivative data saved (1339 records). [2025-09-16T21:20:37.965498] [INFO ] [MAIN ] SGU: Successfully saved derivative data. [2025-09-16T21:20:37.967629] [INFO ] [MAIN ] Derivative Progress: 1621/2026 symbols completed. SGU took 0.9s. Estimated remaining: 2m 11s. Rate: 184.9 symbols/min [2025-09-16T21:20:37.968062] [INFO ] [MAIN ] SHAK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:37.984273] [DEBUG] [MAIN ] SGHC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:37.985307] [INFO ] [MAIN ] SGHC: Generated 1339 derivative records from 34694 primary records. [2025-09-16T21:20:37.985495] [DEBUG] [LOCAL ] SGHC: Saving derivative data. [2025-09-16T21:20:38.001832] [DEBUG] [MAIN ] SG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:38.003483] [INFO ] [MAIN ] SG: Generated 1339 derivative records from 39909 primary records. [2025-09-16T21:20:38.006302] [DEBUG] [LOCAL ] SG: Saving derivative data. [2025-09-16T21:20:38.030772] [DEBUG] [LOCAL ] SGHC: Derivative data saved (1339 records). [2025-09-16T21:20:38.031945] [INFO ] [MAIN ] SGHC: Successfully saved derivative data. [2025-09-16T21:20:38.032006] [DEBUG] [LOCAL ] SG: Derivative data saved (1339 records). [2025-09-16T21:20:38.033476] [INFO ] [MAIN ] Derivative Progress: 1622/2026 symbols completed. SGHC took 1.0s. Estimated remaining: 2m 11s. Rate: 184.9 symbols/min [2025-09-16T21:20:38.033635] [INFO ] [MAIN ] SG: Successfully saved derivative data. [2025-09-16T21:20:38.036358] [INFO ] [MAIN ] SHCO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:38.036474] [INFO ] [MAIN ] Derivative Progress: 1623/2026 symbols completed. SG took 1.0s. Estimated remaining: 2m 11s. Rate: 185.1 symbols/min [2025-09-16T21:20:38.037476] [INFO ] [MAIN ] SHG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:38.049314] [DEBUG] [LOCAL ] SHAK: Loaded 36372 existing records from primary storage. [2025-09-16T21:20:38.049602] [INFO ] [MAIN ] SHAK: Loaded 36372 primary data records. [2025-09-16T21:20:38.246439] [DEBUG] [LOCAL ] SHCO: Loaded 18339 existing records from primary storage. [2025-09-16T21:20:38.249117] [INFO ] [MAIN ] SHCO: Loaded 18339 primary data records. [2025-09-16T21:20:38.381438] [DEBUG] [LOCAL ] SHG: Loaded 19184 existing records from primary storage. [2025-09-16T21:20:38.404234] [INFO ] [MAIN ] SHG: Loaded 19184 primary data records. [2025-09-16T21:20:38.894987] [DEBUG] [MAIN ] SHAK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:38.896113] [INFO ] [MAIN ] SHAK: Generated 1339 derivative records from 36372 primary records. [2025-09-16T21:20:38.896221] [DEBUG] [LOCAL ] SHAK: Saving derivative data. [2025-09-16T21:20:38.911748] [DEBUG] [LOCAL ] SHAK: Derivative data saved (1339 records). [2025-09-16T21:20:38.912193] [INFO ] [MAIN ] SHAK: Successfully saved derivative data. [2025-09-16T21:20:38.914428] [INFO ] [MAIN ] Derivative Progress: 1624/2026 symbols completed. SHAK took 0.9s. Estimated remaining: 2m 10s. Rate: 184.9 symbols/min [2025-09-16T21:20:38.914784] [INFO ] [MAIN ] SHO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:38.928023] [DEBUG] [MAIN ] SHCO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:38.928900] [INFO ] [MAIN ] SHCO: Generated 1339 derivative records from 18339 primary records. [2025-09-16T21:20:38.929045] [DEBUG] [LOCAL ] SHCO: Saving derivative data. [2025-09-16T21:20:38.941294] [DEBUG] [MAIN ] SHG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:38.947539] [INFO ] [MAIN ] SHG: Generated 1339 derivative records from 19184 primary records. [2025-09-16T21:20:38.950527] [DEBUG] [LOCAL ] SHG: Saving derivative data. [2025-09-16T21:20:38.965942] [DEBUG] [LOCAL ] SHCO: Derivative data saved (1339 records). [2025-09-16T21:20:38.966589] [INFO ] [MAIN ] SHCO: Successfully saved derivative data. [2025-09-16T21:20:38.969461] [INFO ] [MAIN ] Derivative Progress: 1625/2026 symbols completed. SHCO took 0.9s. Estimated remaining: 2m 10s. Rate: 185.0 symbols/min [2025-09-16T21:20:38.970736] [INFO ] [MAIN ] SHOC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:38.980808] [DEBUG] [LOCAL ] SHG: Derivative data saved (1339 records). [2025-09-16T21:20:38.981047] [INFO ] [MAIN ] SHG: Successfully saved derivative data. [2025-09-16T21:20:38.983087] [INFO ] [MAIN ] Derivative Progress: 1626/2026 symbols completed. SHG took 0.9s. Estimated remaining: 2m 10s. Rate: 185.1 symbols/min [2025-09-16T21:20:38.983410] [INFO ] [MAIN ] SHW: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:38.987950] [DEBUG] [LOCAL ] SHOC: Loaded 2069 existing records from primary storage. [2025-09-16T21:20:38.988144] [INFO ] [MAIN ] SHOC: Loaded 2069 primary data records. [2025-09-16T21:20:39.106704] [DEBUG] [LOCAL ] SHO: Loaded 36918 existing records from primary storage. [2025-09-16T21:20:39.111319] [INFO ] [MAIN ] SHO: Loaded 36918 primary data records. [2025-09-16T21:20:39.328670] [DEBUG] [LOCAL ] SHW: Loaded 37355 existing records from primary storage. [2025-09-16T21:20:39.463858] [INFO ] [MAIN ] SHW: Loaded 37355 primary data records. [2025-09-16T21:20:39.890211] [DEBUG] [MAIN ] SHOC: Filtered 5181 bins outside market hours, 5780 incomplete bins [2025-09-16T21:20:39.899759] [DEBUG] [MAIN ] SHO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:39.900301] [INFO ] [MAIN ] SHOC: Generated 1338 derivative records from 2069 primary records. [2025-09-16T21:20:39.901034] [DEBUG] [LOCAL ] SHOC: Saving derivative data. [2025-09-16T21:20:39.900947] [INFO ] [MAIN ] SHO: Generated 1339 derivative records from 36918 primary records. [2025-09-16T21:20:39.902986] [DEBUG] [LOCAL ] SHO: Saving derivative data. [2025-09-16T21:20:39.931609] [DEBUG] [MAIN ] SHW: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:39.933253] [INFO ] [MAIN ] SHW: Generated 1339 derivative records from 37355 primary records. [2025-09-16T21:20:39.934062] [DEBUG] [LOCAL ] SHW: Saving derivative data. [2025-09-16T21:20:39.935728] [DEBUG] [LOCAL ] SHOC: Derivative data saved (1338 records). [2025-09-16T21:20:39.936145] [INFO ] [MAIN ] SHOC: Successfully saved derivative data. [2025-09-16T21:20:39.943816] [INFO ] [MAIN ] Derivative Progress: 1627/2026 symbols completed. SHOC took 1.0s. Estimated remaining: 2m 10s. Rate: 184.8 symbols/min [2025-09-16T21:20:39.946738] [DEBUG] [LOCAL ] SHO: Derivative data saved (1339 records). [2025-09-16T21:20:39.946609] [INFO ] [MAIN ] SID: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:39.947028] [INFO ] [MAIN ] SHO: Successfully saved derivative data. [2025-09-16T21:20:39.949096] [INFO ] [MAIN ] Derivative Progress: 1628/2026 symbols completed. SHO took 1.0s. Estimated remaining: 2m 9s. Rate: 185.0 symbols/min [2025-09-16T21:20:39.950037] [INFO ] [MAIN ] SIG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:39.952132] [DEBUG] [LOCAL ] SHW: Derivative data saved (1339 records). [2025-09-16T21:20:39.952378] [INFO ] [MAIN ] SHW: Successfully saved derivative data. [2025-09-16T21:20:39.954564] [INFO ] [MAIN ] Derivative Progress: 1629/2026 symbols completed. SHW took 1.0s. Estimated remaining: 2m 9s. Rate: 185.1 symbols/min [2025-09-16T21:20:39.954910] [INFO ] [MAIN ] SII: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:39.979017] [DEBUG] [LOCAL ] SII: Loaded 17013 existing records from primary storage. [2025-09-16T21:20:39.979265] [INFO ] [MAIN ] SII: Loaded 17013 primary data records. [2025-09-16T21:20:40.109502] [DEBUG] [LOCAL ] SID: Loaded 31673 existing records from primary storage. [2025-09-16T21:20:40.131104] [INFO ] [MAIN ] SID: Loaded 31673 primary data records. [2025-09-16T21:20:40.125930] [DEBUG] [LOCAL ] SIG: Loaded 34072 existing records from primary storage. [2025-09-16T21:20:40.181601] [INFO ] [MAIN ] SIG: Loaded 34072 primary data records. [2025-09-16T21:20:40.828376] [DEBUG] [MAIN ] SII: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:40.830602] [INFO ] [MAIN ] SII: Generated 1339 derivative records from 17013 primary records. [2025-09-16T21:20:40.830935] [DEBUG] [LOCAL ] SII: Saving derivative data. [2025-09-16T21:20:40.843881] [DEBUG] [LOCAL ] SII: Derivative data saved (1339 records). [2025-09-16T21:20:40.844283] [INFO ] [MAIN ] SII: Successfully saved derivative data. [2025-09-16T21:20:40.845830] [INFO ] [MAIN ] Derivative Progress: 1630/2026 symbols completed. SII took 0.9s. Estimated remaining: 2m 9s. Rate: 184.9 symbols/min [2025-09-16T21:20:40.846114] [INFO ] [MAIN ] SILA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:40.873029] [DEBUG] [MAIN ] SIG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:40.872821] [DEBUG] [MAIN ] SID: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:40.879916] [INFO ] [MAIN ] SID: Generated 1339 derivative records from 31673 primary records. [2025-09-16T21:20:40.879150] [INFO ] [MAIN ] SIG: Generated 1339 derivative records from 34072 primary records. [2025-09-16T21:20:40.880054] [DEBUG] [LOCAL ] SIG: Saving derivative data. [2025-09-16T21:20:40.880672] [DEBUG] [LOCAL ] SID: Saving derivative data. [2025-09-16T21:20:40.908065] [DEBUG] [LOCAL ] SILA: Loaded 22844 existing records from primary storage. [2025-09-16T21:20:40.908996] [INFO ] [MAIN ] SILA: Loaded 22844 primary data records. [2025-09-16T21:20:40.908486] [DEBUG] [LOCAL ] SID: Derivative data saved (1339 records). [2025-09-16T21:20:40.909751] [INFO ] [MAIN ] SID: Successfully saved derivative data. [2025-09-16T21:20:40.910945] [DEBUG] [LOCAL ] SIG: Derivative data saved (1339 records). [2025-09-16T21:20:40.919163] [INFO ] [MAIN ] SIG: Successfully saved derivative data. [2025-09-16T21:20:40.919092] [INFO ] [MAIN ] Derivative Progress: 1631/2026 symbols completed. SID took 1.0s. Estimated remaining: 2m 8s. Rate: 185.0 symbols/min [2025-09-16T21:20:40.947936] [INFO ] [MAIN ] SITC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:40.953128] [INFO ] [MAIN ] Derivative Progress: 1632/2026 symbols completed. SIG took 1.0s. Estimated remaining: 2m 8s. Rate: 185.1 symbols/min [2025-09-16T21:20:40.978547] [INFO ] [MAIN ] SITE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:41.212615] [DEBUG] [LOCAL ] SITC: Loaded 30627 existing records from primary storage. [2025-09-16T21:20:41.213040] [INFO ] [MAIN ] SITC: Loaded 30627 primary data records. [2025-09-16T21:20:41.307020] [DEBUG] [LOCAL ] SITE: Loaded 25828 existing records from primary storage. [2025-09-16T21:20:41.324520] [INFO ] [MAIN ] SITE: Loaded 25828 primary data records. [2025-09-16T21:20:41.788789] [DEBUG] [MAIN ] SILA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:41.789892] [INFO ] [MAIN ] SILA: Generated 1339 derivative records from 22844 primary records. [2025-09-16T21:20:41.790501] [DEBUG] [LOCAL ] SILA: Saving derivative data. [2025-09-16T21:20:41.805701] [DEBUG] [LOCAL ] SILA: Derivative data saved (1339 records). [2025-09-16T21:20:41.806580] [INFO ] [MAIN ] SILA: Successfully saved derivative data. [2025-09-16T21:20:41.808280] [INFO ] [MAIN ] Derivative Progress: 1633/2026 symbols completed. SILA took 1.0s. Estimated remaining: 2m 8s. Rate: 184.9 symbols/min [2025-09-16T21:20:41.824003] [DEBUG] [MAIN ] SITC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:41.824775] [INFO ] [MAIN ] SITC: Generated 1339 derivative records from 30627 primary records. [2025-09-16T21:20:41.824940] [DEBUG] [LOCAL ] SITC: Saving derivative data. [2025-09-16T21:20:41.838218] [DEBUG] [LOCAL ] SITC: Derivative data saved (1339 records). [2025-09-16T21:20:41.838384] [INFO ] [MAIN ] SITC: Successfully saved derivative data. [2025-09-16T21:20:41.849506] [INFO ] [MAIN ] Derivative Progress: 1634/2026 symbols completed. SITC took 0.9s. Estimated remaining: 2m 7s. Rate: 185.0 symbols/min [2025-09-16T21:20:41.849811] [DEBUG] [MAIN ] SITE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:41.850487] [INFO ] [MAIN ] SITE: Generated 1339 derivative records from 25828 primary records. [2025-09-16T21:20:41.850548] [DEBUG] [LOCAL ] SITE: Saving derivative data. [2025-09-16T21:20:41.862076] [DEBUG] [LOCAL ] SITE: Derivative data saved (1339 records). [2025-09-16T21:20:41.862132] [INFO ] [MAIN ] SITE: Successfully saved derivative data. [2025-09-16T21:20:41.863995] [INFO ] [MAIN ] Derivative Progress: 1635/2026 symbols completed. SITE took 0.9s. Estimated remaining: 2m 7s. Rate: 185.1 symbols/min [2025-09-16T21:20:41.864529] [INFO ] [MAIN ] SJM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:41.864660] [INFO ] [MAIN ] SKE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:41.864490] [INFO ] [MAIN ] SJT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:41.889086] [DEBUG] [LOCAL ] SJT: Loaded 16711 existing records from primary storage. [2025-09-16T21:20:41.889332] [INFO ] [MAIN ] SJT: Loaded 16711 primary data records. [2025-09-16T21:20:42.049116] [DEBUG] [LOCAL ] SKE: Loaded 25861 existing records from primary storage. [2025-09-16T21:20:42.100398] [INFO ] [MAIN ] SKE: Loaded 25861 primary data records. [2025-09-16T21:20:42.077159] [DEBUG] [LOCAL ] SJM: Loaded 37491 existing records from primary storage. [2025-09-16T21:20:42.206053] [INFO ] [MAIN ] SJM: Loaded 37491 primary data records. [2025-09-16T21:20:42.751604] [DEBUG] [MAIN ] SJT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:42.752694] [INFO ] [MAIN ] SJT: Generated 1339 derivative records from 16711 primary records. [2025-09-16T21:20:42.752775] [DEBUG] [LOCAL ] SJT: Saving derivative data. [2025-09-16T21:20:42.767866] [DEBUG] [LOCAL ] SJT: Derivative data saved (1339 records). [2025-09-16T21:20:42.769063] [INFO ] [MAIN ] SJT: Successfully saved derivative data. [2025-09-16T21:20:42.780121] [INFO ] [MAIN ] Derivative Progress: 1636/2026 symbols completed. SJT took 0.9s. Estimated remaining: 2m 7s. Rate: 184.9 symbols/min [2025-09-16T21:20:42.780437] [DEBUG] [MAIN ] SKE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:42.781138] [INFO ] [MAIN ] SKE: Generated 1339 derivative records from 25861 primary records. [2025-09-16T21:20:42.786934] [INFO ] [MAIN ] SKIL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:42.790438] [DEBUG] [LOCAL ] SKE: Saving derivative data. [2025-09-16T21:20:42.791899] [DEBUG] [MAIN ] SJM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:42.792700] [INFO ] [MAIN ] SJM: Generated 1339 derivative records from 37491 primary records. [2025-09-16T21:20:42.798713] [DEBUG] [LOCAL ] SJM: Saving derivative data. [2025-09-16T21:20:42.819181] [DEBUG] [LOCAL ] SKIL: Loaded 4546 existing records from primary storage. [2025-09-16T21:20:42.819030] [DEBUG] [LOCAL ] SKE: Derivative data saved (1339 records). [2025-09-16T21:20:42.819280] [INFO ] [MAIN ] SKIL: Loaded 4546 primary data records. [2025-09-16T21:20:42.840150] [INFO ] [MAIN ] SKE: Successfully saved derivative data. [2025-09-16T21:20:42.858289] [INFO ] [MAIN ] Derivative Progress: 1637/2026 symbols completed. SKE took 1.0s. Estimated remaining: 2m 6s. Rate: 185.0 symbols/min [2025-09-16T21:20:42.879750] [INFO ] [MAIN ] SKLZ: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:42.879667] [DEBUG] [LOCAL ] SJM: Derivative data saved (1339 records). [2025-09-16T21:20:42.900996] [INFO ] [MAIN ] SJM: Successfully saved derivative data. [2025-09-16T21:20:42.920101] [INFO ] [MAIN ] Derivative Progress: 1638/2026 symbols completed. SJM took 1.1s. Estimated remaining: 2m 6s. Rate: 185.0 symbols/min [2025-09-16T21:20:42.920314] [INFO ] [MAIN ] SKM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:43.009335] [DEBUG] [LOCAL ] SKLZ: Loaded 8571 existing records from primary storage. [2025-09-16T21:20:43.011885] [INFO ] [MAIN ] SKLZ: Loaded 8571 primary data records. [2025-09-16T21:20:43.239593] [DEBUG] [LOCAL ] SKM: Loaded 26304 existing records from primary storage. [2025-09-16T21:20:43.259295] [INFO ] [MAIN ] SKM: Loaded 26304 primary data records. [2025-09-16T21:20:43.701881] [DEBUG] [MAIN ] SKIL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:43.703525] [INFO ] [MAIN ] SKIL: Generated 1339 derivative records from 4546 primary records. [2025-09-16T21:20:43.703696] [DEBUG] [LOCAL ] SKIL: Saving derivative data. [2025-09-16T21:20:43.717689] [DEBUG] [LOCAL ] SKIL: Derivative data saved (1339 records). [2025-09-16T21:20:43.719239] [INFO ] [MAIN ] SKIL: Successfully saved derivative data. [2025-09-16T21:20:43.720870] [INFO ] [MAIN ] Derivative Progress: 1639/2026 symbols completed. SKIL took 0.9s. Estimated remaining: 2m 6s. Rate: 184.9 symbols/min [2025-09-16T21:20:43.722904] [INFO ] [MAIN ] SKT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:43.733596] [DEBUG] [MAIN ] SKLZ: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:43.734423] [INFO ] [MAIN ] SKLZ: Generated 1339 derivative records from 8571 primary records. [2025-09-16T21:20:43.734632] [DEBUG] [LOCAL ] SKLZ: Saving derivative data. [2025-09-16T21:20:43.747227] [DEBUG] [LOCAL ] SKLZ: Derivative data saved (1339 records). [2025-09-16T21:20:43.747528] [INFO ] [MAIN ] SKLZ: Successfully saved derivative data. [2025-09-16T21:20:43.749455] [INFO ] [MAIN ] Derivative Progress: 1640/2026 symbols completed. SKLZ took 0.9s. Estimated remaining: 2m 5s. Rate: 185.0 symbols/min [2025-09-16T21:20:43.749799] [INFO ] [MAIN ] SKY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:43.761921] [DEBUG] [MAIN ] SKM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:43.762631] [INFO ] [MAIN ] SKM: Generated 1339 derivative records from 26304 primary records. [2025-09-16T21:20:43.762773] [DEBUG] [LOCAL ] SKM: Saving derivative data. [2025-09-16T21:20:43.783320] [DEBUG] [LOCAL ] SKM: Derivative data saved (1339 records). [2025-09-16T21:20:43.784059] [INFO ] [MAIN ] SKM: Successfully saved derivative data. [2025-09-16T21:20:43.786079] [INFO ] [MAIN ] Derivative Progress: 1641/2026 symbols completed. SKM took 0.9s. Estimated remaining: 2m 5s. Rate: 185.1 symbols/min [2025-09-16T21:20:43.795744] [INFO ] [MAIN ] SKYH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:43.796660] [DEBUG] [LOCAL ] SKT: Loaded 31523 existing records from primary storage. [2025-09-16T21:20:43.803218] [INFO ] [MAIN ] SKT: Loaded 31523 primary data records. [2025-09-16T21:20:43.919866] [DEBUG] [LOCAL ] SKYH: Loaded 11462 existing records from primary storage. [2025-09-16T21:20:43.920813] [DEBUG] [LOCAL ] SKY: Loaded 28683 existing records from primary storage. [2025-09-16T21:20:43.920903] [INFO ] [MAIN ] SKYH: Loaded 11462 primary data records. [2025-09-16T21:20:43.982254] [INFO ] [MAIN ] SKY: Loaded 28683 primary data records. [2025-09-16T21:20:44.639404] [DEBUG] [MAIN ] SKT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:44.640234] [INFO ] [MAIN ] SKT: Generated 1339 derivative records from 31523 primary records. [2025-09-16T21:20:44.640379] [DEBUG] [LOCAL ] SKT: Saving derivative data. [2025-09-16T21:20:44.662105] [DEBUG] [MAIN ] SKYH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:44.665525] [INFO ] [MAIN ] SKYH: Generated 1339 derivative records from 11462 primary records. [2025-09-16T21:20:44.665865] [DEBUG] [LOCAL ] SKYH: Saving derivative data. [2025-09-16T21:20:44.667342] [DEBUG] [LOCAL ] SKT: Derivative data saved (1339 records). [2025-09-16T21:20:44.682590] [DEBUG] [MAIN ] SKY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:44.683393] [INFO ] [MAIN ] SKT: Successfully saved derivative data. [2025-09-16T21:20:44.687867] [INFO ] [MAIN ] Derivative Progress: 1642/2026 symbols completed. SKT took 1.0s. Estimated remaining: 2m 5s. Rate: 184.9 symbols/min [2025-09-16T21:20:44.686025] [INFO ] [MAIN ] SKY: Generated 1339 derivative records from 28683 primary records. [2025-09-16T21:20:44.688891] [DEBUG] [LOCAL ] SKY: Saving derivative data. [2025-09-16T21:20:44.691230] [INFO ] [MAIN ] SLB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:44.692015] [DEBUG] [LOCAL ] SKYH: Derivative data saved (1339 records). [2025-09-16T21:20:44.692231] [INFO ] [MAIN ] SKYH: Successfully saved derivative data. [2025-09-16T21:20:44.699504] [INFO ] [MAIN ] Derivative Progress: 1643/2026 symbols completed. SKYH took 0.9s. Estimated remaining: 2m 4s. Rate: 185.0 symbols/min [2025-09-16T21:20:44.702384] [INFO ] [MAIN ] SLF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:44.705424] [DEBUG] [LOCAL ] SKY: Derivative data saved (1339 records). [2025-09-16T21:20:44.705711] [INFO ] [MAIN ] SKY: Successfully saved derivative data. [2025-09-16T21:20:44.707916] [INFO ] [MAIN ] Derivative Progress: 1644/2026 symbols completed. SKY took 1.0s. Estimated remaining: 2m 4s. Rate: 185.1 symbols/min [2025-09-16T21:20:44.708324] [INFO ] [MAIN ] SLG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:44.777024] [DEBUG] [LOCAL ] SLB: Loaded 40047 existing records from primary storage. [2025-09-16T21:20:44.777138] [DEBUG] [LOCAL ] SLF: Loaded 28993 existing records from primary storage. [2025-09-16T21:20:44.777696] [DEBUG] [LOCAL ] SLG: Loaded 34057 existing records from primary storage. [2025-09-16T21:20:44.777887] [INFO ] [MAIN ] SLB: Loaded 40047 primary data records. [2025-09-16T21:20:44.777808] [INFO ] [MAIN ] SLF: Loaded 28993 primary data records. [2025-09-16T21:20:44.778099] [INFO ] [MAIN ] SLG: Loaded 34057 primary data records. [2025-09-16T21:20:45.599143] [DEBUG] [MAIN ] SLB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:45.600082] [INFO ] [MAIN ] SLB: Generated 1339 derivative records from 40047 primary records. [2025-09-16T21:20:45.610516] [DEBUG] [LOCAL ] SLB: Saving derivative data. [2025-09-16T21:20:45.612083] [DEBUG] [MAIN ] SLF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:45.613566] [INFO ] [MAIN ] SLF: Generated 1339 derivative records from 28993 primary records. [2025-09-16T21:20:45.632006] [DEBUG] [LOCAL ] SLF: Saving derivative data. [2025-09-16T21:20:45.633455] [DEBUG] [MAIN ] SLG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:45.640851] [INFO ] [MAIN ] SLG: Generated 1339 derivative records from 34057 primary records. [2025-09-16T21:20:45.642038] [DEBUG] [LOCAL ] SLG: Saving derivative data. [2025-09-16T21:20:45.647205] [DEBUG] [LOCAL ] SLB: Derivative data saved (1339 records). [2025-09-16T21:20:45.654306] [INFO ] [MAIN ] SLB: Successfully saved derivative data. [2025-09-16T21:20:45.654402] [DEBUG] [LOCAL ] SLF: Derivative data saved (1339 records). [2025-09-16T21:20:45.658189] [INFO ] [MAIN ] Derivative Progress: 1645/2026 symbols completed. SLB took 1.0s. Estimated remaining: 2m 4s. Rate: 184.9 symbols/min [2025-09-16T21:20:45.658378] [INFO ] [MAIN ] SLF: Successfully saved derivative data. [2025-09-16T21:20:45.659905] [INFO ] [MAIN ] Derivative Progress: 1646/2026 symbols completed. SLF took 1.0s. Estimated remaining: 2m 3s. Rate: 185.0 symbols/min [2025-09-16T21:20:45.660034] [INFO ] [MAIN ] SLGN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:45.663823] [INFO ] [MAIN ] SLQT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:45.669723] [DEBUG] [LOCAL ] SLG: Derivative data saved (1339 records). [2025-09-16T21:20:45.670050] [INFO ] [MAIN ] SLG: Successfully saved derivative data. [2025-09-16T21:20:45.671995] [INFO ] [MAIN ] Derivative Progress: 1647/2026 symbols completed. SLG took 1.0s. Estimated remaining: 2m 3s. Rate: 185.1 symbols/min [2025-09-16T21:20:45.672254] [INFO ] [MAIN ] SLVM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:45.719741] [DEBUG] [LOCAL ] SLQT: Loaded 32692 existing records from primary storage. [2025-09-16T21:20:45.720294] [DEBUG] [LOCAL ] SLVM: Loaded 20486 existing records from primary storage. [2025-09-16T21:20:45.719908] [INFO ] [MAIN ] SLQT: Loaded 32692 primary data records. [2025-09-16T21:20:45.729243] [INFO ] [MAIN ] SLVM: Loaded 20486 primary data records. [2025-09-16T21:20:45.765678] [DEBUG] [LOCAL ] SLGN: Loaded 29559 existing records from primary storage. [2025-09-16T21:20:45.803461] [INFO ] [MAIN ] SLGN: Loaded 29559 primary data records. [2025-09-16T21:20:46.615902] [DEBUG] [MAIN ] SLQT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:46.617188] [DEBUG] [MAIN ] SLVM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:46.619070] [INFO ] [MAIN ] SLQT: Generated 1339 derivative records from 32692 primary records. [2025-09-16T21:20:46.619910] [INFO ] [MAIN ] SLVM: Generated 1339 derivative records from 20486 primary records. [2025-09-16T21:20:46.619979] [DEBUG] [LOCAL ] SLQT: Saving derivative data. [2025-09-16T21:20:46.621100] [DEBUG] [LOCAL ] SLVM: Saving derivative data. [2025-09-16T21:20:46.650023] [DEBUG] [MAIN ] SLGN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:46.656499] [INFO ] [MAIN ] SLGN: Generated 1339 derivative records from 29559 primary records. [2025-09-16T21:20:46.655815] [DEBUG] [LOCAL ] SLQT: Derivative data saved (1339 records). [2025-09-16T21:20:46.656723] [INFO ] [MAIN ] SLQT: Successfully saved derivative data. [2025-09-16T21:20:46.652808] [DEBUG] [LOCAL ] SLVM: Derivative data saved (1339 records). [2025-09-16T21:20:46.656891] [INFO ] [MAIN ] SLVM: Successfully saved derivative data. [2025-09-16T21:20:46.659099] [INFO ] [MAIN ] Derivative Progress: 1648/2026 symbols completed. SLQT took 1.0s. Estimated remaining: 2m 3s. Rate: 184.9 symbols/min [2025-09-16T21:20:46.661413] [INFO ] [MAIN ] Derivative Progress: 1649/2026 symbols completed. SLVM took 1.0s. Estimated remaining: 2m 2s. Rate: 185.0 symbols/min [2025-09-16T21:20:46.661237] [DEBUG] [LOCAL ] SLGN: Saving derivative data. [2025-09-16T21:20:46.673430] [DEBUG] [LOCAL ] SLGN: Derivative data saved (1339 records). [2025-09-16T21:20:46.673494] [INFO ] [MAIN ] SLGN: Successfully saved derivative data. [2025-09-16T21:20:46.675372] [INFO ] [MAIN ] Derivative Progress: 1650/2026 symbols completed. SLGN took 1.0s. Estimated remaining: 2m 2s. Rate: 185.1 symbols/min [2025-09-16T21:20:46.676098] [INFO ] [MAIN ] SMC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:46.675937] [INFO ] [MAIN ] SMBK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:46.676007] [INFO ] [MAIN ] SM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:46.685534] [DEBUG] [LOCAL ] SMC: Loaded 7825 existing records from primary storage. [2025-09-16T21:20:46.687304] [INFO ] [MAIN ] SMC: Loaded 7825 primary data records. [2025-09-16T21:20:46.767291] [DEBUG] [LOCAL ] SMBK: Loaded 5935 existing records from primary storage. [2025-09-16T21:20:46.793233] [INFO ] [MAIN ] SMBK: Loaded 5935 primary data records. [2025-09-16T21:20:47.103333] [DEBUG] [LOCAL ] SM: Loaded 38863 existing records from primary storage. [2025-09-16T21:20:47.148936] [INFO ] [MAIN ] SM: Loaded 38863 primary data records. [2025-09-16T21:20:47.569718] [DEBUG] [MAIN ] SMC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:47.571965] [INFO ] [MAIN ] SMC: Generated 1339 derivative records from 7825 primary records. [2025-09-16T21:20:47.572198] [DEBUG] [LOCAL ] SMC: Saving derivative data. [2025-09-16T21:20:47.596338] [DEBUG] [LOCAL ] SMC: Derivative data saved (1339 records). [2025-09-16T21:20:47.595841] [DEBUG] [MAIN ] SMBK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:47.597187] [INFO ] [MAIN ] SMBK: Generated 1339 derivative records from 5935 primary records. [2025-09-16T21:20:47.597299] [INFO ] [MAIN ] SMC: Successfully saved derivative data. [2025-09-16T21:20:47.599104] [INFO ] [MAIN ] Derivative Progress: 1651/2026 symbols completed. SMC took 0.9s. Estimated remaining: 2m 2s. Rate: 184.9 symbols/min [2025-09-16T21:20:47.599262] [DEBUG] [LOCAL ] SMBK: Saving derivative data. [2025-09-16T21:20:47.600146] [INFO ] [MAIN ] SMFG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:47.613787] [DEBUG] [LOCAL ] SMBK: Derivative data saved (1339 records). [2025-09-16T21:20:47.614099] [INFO ] [MAIN ] SMBK: Successfully saved derivative data. [2025-09-16T21:20:47.616269] [INFO ] [MAIN ] Derivative Progress: 1652/2026 symbols completed. SMBK took 0.9s. Estimated remaining: 2m 1s. Rate: 185.0 symbols/min [2025-09-16T21:20:47.616721] [INFO ] [MAIN ] SMG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:47.629797] [DEBUG] [MAIN ] SM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:47.630424] [INFO ] [MAIN ] SM: Generated 1339 derivative records from 38863 primary records. [2025-09-16T21:20:47.630486] [DEBUG] [LOCAL ] SM: Saving derivative data. [2025-09-16T21:20:47.642704] [DEBUG] [LOCAL ] SM: Derivative data saved (1339 records). [2025-09-16T21:20:47.642772] [INFO ] [MAIN ] SM: Successfully saved derivative data. [2025-09-16T21:20:47.644634] [INFO ] [MAIN ] Derivative Progress: 1653/2026 symbols completed. SM took 1.0s. Estimated remaining: 2m 1s. Rate: 185.1 symbols/min [2025-09-16T21:20:47.644921] [INFO ] [MAIN ] SMHI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:47.669430] [DEBUG] [LOCAL ] SMHI: Loaded 9646 existing records from primary storage. [2025-09-16T21:20:47.677657] [INFO ] [MAIN ] SMHI: Loaded 9646 primary data records. [2025-09-16T21:20:47.746154] [DEBUG] [LOCAL ] SMFG: Loaded 35752 existing records from primary storage. [2025-09-16T21:20:47.747691] [INFO ] [MAIN ] SMFG: Loaded 35752 primary data records. [2025-09-16T21:20:47.904355] [DEBUG] [LOCAL ] SMG: Loaded 32250 existing records from primary storage. [2025-09-16T21:20:47.927714] [INFO ] [MAIN ] SMG: Loaded 32250 primary data records. [2025-09-16T21:20:48.589567] [DEBUG] [MAIN ] SMHI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:48.599582] [INFO ] [MAIN ] SMHI: Generated 1339 derivative records from 9646 primary records. [2025-09-16T21:20:48.599808] [DEBUG] [LOCAL ] SMHI: Saving derivative data. [2025-09-16T21:20:48.601375] [DEBUG] [MAIN ] SMFG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:48.602584] [INFO ] [MAIN ] SMFG: Generated 1339 derivative records from 35752 primary records. [2025-09-16T21:20:48.602712] [DEBUG] [LOCAL ] SMFG: Saving derivative data. [2025-09-16T21:20:48.615076] [DEBUG] [LOCAL ] SMHI: Derivative data saved (1339 records). [2025-09-16T21:20:48.615659] [INFO ] [MAIN ] SMHI: Successfully saved derivative data. [2025-09-16T21:20:48.626932] [INFO ] [MAIN ] Derivative Progress: 1654/2026 symbols completed. SMHI took 1.0s. Estimated remaining: 2m 1s. Rate: 184.9 symbols/min [2025-09-16T21:20:48.627657] [INFO ] [MAIN ] SMP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:48.627468] [DEBUG] [MAIN ] SMG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:48.639511] [DEBUG] [LOCAL ] SMFG: Derivative data saved (1339 records). [2025-09-16T21:20:48.639843] [INFO ] [MAIN ] SMFG: Successfully saved derivative data. [2025-09-16T21:20:48.643197] [INFO ] [MAIN ] Derivative Progress: 1655/2026 symbols completed. SMFG took 1.0s. Estimated remaining: 2m 0s. Rate: 185.0 symbols/min [2025-09-16T21:20:48.643468] [INFO ] [MAIN ] SMRT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:48.640538] [INFO ] [MAIN ] SMG: Generated 1339 derivative records from 32250 primary records. [2025-09-16T21:20:48.643983] [DEBUG] [LOCAL ] SMG: Saving derivative data. [2025-09-16T21:20:48.661449] [DEBUG] [LOCAL ] SMG: Derivative data saved (1339 records). [2025-09-16T21:20:48.661740] [INFO ] [MAIN ] SMG: Successfully saved derivative data. [2025-09-16T21:20:48.668872] [DEBUG] [LOCAL ] SMP: Loaded 13817 existing records from primary storage. [2025-09-16T21:20:48.668504] [INFO ] [MAIN ] Derivative Progress: 1656/2026 symbols completed. SMG took 1.1s. Estimated remaining: 1m 60s. Rate: 185.1 symbols/min [2025-09-16T21:20:48.669013] [INFO ] [MAIN ] SMP: Loaded 13817 primary data records. [2025-09-16T21:20:48.680090] [INFO ] [MAIN ] SMWB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:48.831059] [DEBUG] [LOCAL ] SMRT: Loaded 33024 existing records from primary storage. [2025-09-16T21:20:48.871367] [INFO ] [MAIN ] SMRT: Loaded 33024 primary data records. [2025-09-16T21:20:49.059445] [DEBUG] [LOCAL ] SMWB: Loaded 24814 existing records from primary storage. [2025-09-16T21:20:49.070740] [INFO ] [MAIN ] SMWB: Loaded 24814 primary data records. [2025-09-16T21:20:49.513575] [DEBUG] [MAIN ] SMP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:49.514522] [INFO ] [MAIN ] SMP: Generated 1339 derivative records from 13817 primary records. [2025-09-16T21:20:49.515239] [DEBUG] [LOCAL ] SMP: Saving derivative data. [2025-09-16T21:20:49.528887] [DEBUG] [LOCAL ] SMP: Derivative data saved (1339 records). [2025-09-16T21:20:49.529095] [INFO ] [MAIN ] SMP: Successfully saved derivative data. [2025-09-16T21:20:49.530695] [INFO ] [MAIN ] Derivative Progress: 1657/2026 symbols completed. SMP took 0.9s. Estimated remaining: 1m 60s. Rate: 184.9 symbols/min [2025-09-16T21:20:49.531055] [INFO ] [MAIN ] SN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:49.546206] [DEBUG] [MAIN ] SMRT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:49.546950] [INFO ] [MAIN ] SMRT: Generated 1339 derivative records from 33024 primary records. [2025-09-16T21:20:49.547143] [DEBUG] [LOCAL ] SMRT: Saving derivative data. [2025-09-16T21:20:49.580995] [DEBUG] [MAIN ] SMWB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:49.580631] [DEBUG] [LOCAL ] SMRT: Derivative data saved (1339 records). [2025-09-16T21:20:49.581130] [INFO ] [MAIN ] SMRT: Successfully saved derivative data. [2025-09-16T21:20:49.583786] [INFO ] [MAIN ] Derivative Progress: 1658/2026 symbols completed. SMRT took 0.9s. Estimated remaining: 1m 59s. Rate: 185.0 symbols/min [2025-09-16T21:20:49.584030] [INFO ] [MAIN ] SNA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:49.581749] [INFO ] [MAIN ] SMWB: Generated 1339 derivative records from 24814 primary records. [2025-09-16T21:20:49.584451] [DEBUG] [LOCAL ] SMWB: Saving derivative data. [2025-09-16T21:20:49.608294] [DEBUG] [LOCAL ] SMWB: Derivative data saved (1339 records). [2025-09-16T21:20:49.608504] [INFO ] [MAIN ] SMWB: Successfully saved derivative data. [2025-09-16T21:20:49.611353] [INFO ] [MAIN ] Derivative Progress: 1659/2026 symbols completed. SMWB took 0.9s. Estimated remaining: 1m 59s. Rate: 185.1 symbols/min [2025-09-16T21:20:49.612405] [DEBUG] [LOCAL ] SN: Loaded 37194 existing records from primary storage. [2025-09-16T21:20:49.612679] [INFO ] [MAIN ] SNAP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:49.612932] [INFO ] [MAIN ] SN: Loaded 37194 primary data records. [2025-09-16T21:20:49.731336] [DEBUG] [LOCAL ] SNA: Loaded 18449 existing records from primary storage. [2025-09-16T21:20:49.731914] [INFO ] [MAIN ] SNA: Loaded 18449 primary data records. [2025-09-16T21:20:50.020954] [DEBUG] [LOCAL ] SNAP: Loaded 40146 existing records from primary storage. [2025-09-16T21:20:50.036575] [INFO ] [MAIN ] SNAP: Loaded 40146 primary data records. [2025-09-16T21:20:50.516764] [DEBUG] [MAIN ] SN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:50.518487] [INFO ] [MAIN ] SN: Generated 1339 derivative records from 37194 primary records. [2025-09-16T21:20:50.518825] [DEBUG] [LOCAL ] SN: Saving derivative data. [2025-09-16T21:20:50.540476] [DEBUG] [LOCAL ] SN: Derivative data saved (1339 records). [2025-09-16T21:20:50.540292] [DEBUG] [MAIN ] SNA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:50.541148] [INFO ] [MAIN ] SNA: Generated 1339 derivative records from 18449 primary records. [2025-09-16T21:20:50.541256] [INFO ] [MAIN ] SN: Successfully saved derivative data. [2025-09-16T21:20:50.541298] [DEBUG] [LOCAL ] SNA: Saving derivative data. [2025-09-16T21:20:50.544047] [INFO ] [MAIN ] Derivative Progress: 1660/2026 symbols completed. SN took 1.0s. Estimated remaining: 1m 59s. Rate: 184.9 symbols/min [2025-09-16T21:20:50.550844] [INFO ] [MAIN ] SNDA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:50.558954] [DEBUG] [LOCAL ] SNA: Derivative data saved (1339 records). [2025-09-16T21:20:50.559054] [INFO ] [MAIN ] SNA: Successfully saved derivative data. [2025-09-16T21:20:50.563526] [INFO ] [MAIN ] Derivative Progress: 1661/2026 symbols completed. SNA took 1.0s. Estimated remaining: 1m 58s. Rate: 185.0 symbols/min [2025-09-16T21:20:50.561584] [DEBUG] [LOCAL ] SNDA: Loaded 3277 existing records from primary storage. [2025-09-16T21:20:50.563902] [INFO ] [MAIN ] SNDR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:50.564042] [INFO ] [MAIN ] SNDA: Loaded 3277 primary data records. [2025-09-16T21:20:50.681548] [DEBUG] [MAIN ] SNAP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:50.710930] [INFO ] [MAIN ] SNAP: Generated 1339 derivative records from 40146 primary records. [2025-09-16T21:20:50.742836] [DEBUG] [LOCAL ] SNAP: Saving derivative data. [2025-09-16T21:20:50.874326] [DEBUG] [LOCAL ] SNDR: Loaded 29750 existing records from primary storage. [2025-09-16T21:20:50.880190] [INFO ] [MAIN ] SNDR: Loaded 29750 primary data records. [2025-09-16T21:20:50.926173] [DEBUG] [LOCAL ] SNAP: Derivative data saved (1339 records). [2025-09-16T21:20:50.967112] [INFO ] [MAIN ] SNAP: Successfully saved derivative data. [2025-09-16T21:20:50.990724] [INFO ] [MAIN ] Derivative Progress: 1662/2026 symbols completed. SNAP took 1.4s. Estimated remaining: 1m 58s. Rate: 184.9 symbols/min [2025-09-16T21:20:51.003480] [INFO ] [MAIN ] SNN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:51.188319] [DEBUG] [MAIN ] SNDA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:51.190146] [INFO ] [MAIN ] SNDA: Generated 1339 derivative records from 3277 primary records. [2025-09-16T21:20:51.190597] [DEBUG] [LOCAL ] SNDA: Saving derivative data. [2025-09-16T21:20:51.214159] [DEBUG] [LOCAL ] SNDA: Derivative data saved (1339 records). [2025-09-16T21:20:51.215103] [DEBUG] [LOCAL ] SNN: Loaded 33254 existing records from primary storage. [2025-09-16T21:20:51.215196] [INFO ] [MAIN ] SNDA: Successfully saved derivative data. [2025-09-16T21:20:51.215258] [INFO ] [MAIN ] SNN: Loaded 33254 primary data records. [2025-09-16T21:20:51.217694] [INFO ] [MAIN ] Derivative Progress: 1663/2026 symbols completed. SNDA took 0.7s. Estimated remaining: 1m 58s. Rate: 185.0 symbols/min [2025-09-16T21:20:51.491508] [DEBUG] [MAIN ] SNDR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:51.492256] [INFO ] [MAIN ] SNDR: Generated 1339 derivative records from 29750 primary records. [2025-09-16T21:20:51.492402] [DEBUG] [LOCAL ] SNDR: Saving derivative data. [2025-09-16T21:20:51.506363] [DEBUG] [LOCAL ] SNDR: Derivative data saved (1339 records). [2025-09-16T21:20:51.506461] [INFO ] [MAIN ] SNDR: Successfully saved derivative data. [2025-09-16T21:20:51.508410] [INFO ] [MAIN ] Derivative Progress: 1664/2026 symbols completed. SNDR took 0.9s. Estimated remaining: 1m 57s. Rate: 185.0 symbols/min [2025-09-16T21:20:51.523312] [DEBUG] [MAIN ] SNN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:51.523869] [INFO ] [MAIN ] SNN: Generated 1339 derivative records from 33254 primary records. [2025-09-16T21:20:51.523957] [DEBUG] [LOCAL ] SNN: Saving derivative data. [2025-09-16T21:20:51.535474] [DEBUG] [LOCAL ] SNN: Derivative data saved (1339 records). [2025-09-16T21:20:51.535532] [INFO ] [MAIN ] SNN: Successfully saved derivative data. [2025-09-16T21:20:51.537231] [INFO ] [MAIN ] Derivative Progress: 1665/2026 symbols completed. SNN took 0.5s. Estimated remaining: 1m 57s. Rate: 185.1 symbols/min [2025-09-16T21:20:51.537706] [INFO ] [MAIN ] SNV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:51.537870] [INFO ] [MAIN ] SNX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:51.537939] [INFO ] [MAIN ] SOBO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:51.588665] [DEBUG] [LOCAL ] SNX: Loaded 27915 existing records from primary storage. [2025-09-16T21:20:51.589116] [DEBUG] [LOCAL ] SOBO: Loaded 28826 existing records from primary storage. [2025-09-16T21:20:51.589268] [INFO ] [MAIN ] SNX: Loaded 27915 primary data records. [2025-09-16T21:20:51.589321] [INFO ] [MAIN ] SOBO: Loaded 28826 primary data records. [2025-09-16T21:20:51.801979] [DEBUG] [LOCAL ] SNV: Loaded 35827 existing records from primary storage. [2025-09-16T21:20:51.833166] [INFO ] [MAIN ] SNV: Loaded 35827 primary data records. [2025-09-16T21:20:52.436877] [DEBUG] [MAIN ] SOBO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:52.440781] [DEBUG] [MAIN ] SNX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:52.441600] [INFO ] [MAIN ] SOBO: Generated 1339 derivative records from 28826 primary records. [2025-09-16T21:20:52.442362] [DEBUG] [LOCAL ] SOBO: Saving derivative data. [2025-09-16T21:20:52.442155] [INFO ] [MAIN ] SNX: Generated 1339 derivative records from 27915 primary records. [2025-09-16T21:20:52.442440] [DEBUG] [LOCAL ] SNX: Saving derivative data. [2025-09-16T21:20:52.465716] [DEBUG] [LOCAL ] SOBO: Derivative data saved (1339 records). [2025-09-16T21:20:52.466998] [INFO ] [MAIN ] SOBO: Successfully saved derivative data. [2025-09-16T21:20:52.469417] [INFO ] [MAIN ] Derivative Progress: 1666/2026 symbols completed. SOBO took 0.9s. Estimated remaining: 1m 57s. Rate: 184.9 symbols/min [2025-09-16T21:20:52.469503] [DEBUG] [LOCAL ] SNX: Derivative data saved (1339 records). [2025-09-16T21:20:52.469897] [INFO ] [MAIN ] SOC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:52.470524] [INFO ] [MAIN ] SNX: Successfully saved derivative data. [2025-09-16T21:20:52.472456] [INFO ] [MAIN ] Derivative Progress: 1667/2026 symbols completed. SNX took 0.9s. Estimated remaining: 1m 56s. Rate: 185.0 symbols/min [2025-09-16T21:20:52.474495] [INFO ] [MAIN ] SOJC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:52.485027] [DEBUG] [MAIN ] SNV: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:52.485671] [INFO ] [MAIN ] SNV: Generated 1339 derivative records from 35827 primary records. [2025-09-16T21:20:52.486658] [DEBUG] [LOCAL ] SNV: Saving derivative data. [2025-09-16T21:20:52.489835] [DEBUG] [LOCAL ] SOJC: Loaded 3394 existing records from primary storage. [2025-09-16T21:20:52.495403] [INFO ] [MAIN ] SOJC: Loaded 3394 primary data records. [2025-09-16T21:20:52.577901] [DEBUG] [LOCAL ] SNV: Derivative data saved (1339 records). [2025-09-16T21:20:52.583128] [INFO ] [MAIN ] SNV: Successfully saved derivative data. [2025-09-16T21:20:52.590885] [INFO ] [MAIN ] Derivative Progress: 1668/2026 symbols completed. SNV took 1.1s. Estimated remaining: 1m 56s. Rate: 185.1 symbols/min [2025-09-16T21:20:52.616041] [INFO ] [MAIN ] SOJD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:52.750687] [DEBUG] [LOCAL ] SOC: Loaded 37811 existing records from primary storage. [2025-09-16T21:20:52.816206] [INFO ] [MAIN ] SOC: Loaded 37811 primary data records. [2025-09-16T21:20:52.816529] [DEBUG] [LOCAL ] SOJD: Loaded 9281 existing records from primary storage. [2025-09-16T21:20:52.822233] [INFO ] [MAIN ] SOJD: Loaded 9281 primary data records. [2025-09-16T21:20:53.356976] [DEBUG] [MAIN ] SOJC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:53.358150] [INFO ] [MAIN ] SOJC: Generated 1339 derivative records from 3394 primary records. [2025-09-16T21:20:53.358686] [DEBUG] [LOCAL ] SOJC: Saving derivative data. [2025-09-16T21:20:53.374102] [DEBUG] [LOCAL ] SOJC: Derivative data saved (1339 records). [2025-09-16T21:20:53.374543] [INFO ] [MAIN ] SOJC: Successfully saved derivative data. [2025-09-16T21:20:53.376133] [INFO ] [MAIN ] Derivative Progress: 1669/2026 symbols completed. SOJC took 0.9s. Estimated remaining: 1m 56s. Rate: 184.9 symbols/min [2025-09-16T21:20:53.377018] [INFO ] [MAIN ] SOJE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:53.406925] [DEBUG] [MAIN ] SOJD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:53.407152] [DEBUG] [LOCAL ] SOJE: Loaded 6675 existing records from primary storage. [2025-09-16T21:20:53.408261] [INFO ] [MAIN ] SOJD: Generated 1339 derivative records from 9281 primary records. [2025-09-16T21:20:53.407706] [DEBUG] [MAIN ] SOC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:53.408390] [DEBUG] [LOCAL ] SOJD: Saving derivative data. [2025-09-16T21:20:53.408457] [INFO ] [MAIN ] SOJE: Loaded 6675 primary data records. [2025-09-16T21:20:53.409078] [INFO ] [MAIN ] SOC: Generated 1339 derivative records from 37811 primary records. [2025-09-16T21:20:53.409887] [DEBUG] [LOCAL ] SOC: Saving derivative data. [2025-09-16T21:20:53.502793] [DEBUG] [LOCAL ] SOJD: Derivative data saved (1339 records). [2025-09-16T21:20:53.509849] [INFO ] [MAIN ] SOJD: Successfully saved derivative data. [2025-09-16T21:20:53.518835] [INFO ] [MAIN ] Derivative Progress: 1670/2026 symbols completed. SOJD took 0.9s. Estimated remaining: 1m 55s. Rate: 185.0 symbols/min [2025-09-16T21:20:53.531255] [DEBUG] [LOCAL ] SOC: Derivative data saved (1339 records). [2025-09-16T21:20:53.531356] [INFO ] [MAIN ] SOJF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:53.542792] [INFO ] [MAIN ] SOC: Successfully saved derivative data. [2025-09-16T21:20:53.545758] [INFO ] [MAIN ] Derivative Progress: 1671/2026 symbols completed. SOC took 1.1s. Estimated remaining: 1m 55s. Rate: 185.1 symbols/min [2025-09-16T21:20:53.545972] [INFO ] [MAIN ] SOL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:53.629573] [DEBUG] [LOCAL ] SOJF: Loaded 5968 existing records from primary storage. [2025-09-16T21:20:53.717289] [INFO ] [MAIN ] SOJF: Loaded 5968 primary data records. [2025-09-16T21:20:53.747894] [DEBUG] [LOCAL ] SOL: Loaded 9672 existing records from primary storage. [2025-09-16T21:20:53.768266] [INFO ] [MAIN ] SOL: Loaded 9672 primary data records. [2025-09-16T21:20:54.280571] [DEBUG] [MAIN ] SOJE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:54.281384] [INFO ] [MAIN ] SOJE: Generated 1339 derivative records from 6675 primary records. [2025-09-16T21:20:54.282406] [DEBUG] [LOCAL ] SOJE: Saving derivative data. [2025-09-16T21:20:54.296986] [DEBUG] [LOCAL ] SOJE: Derivative data saved (1339 records). [2025-09-16T21:20:54.297118] [INFO ] [MAIN ] SOJE: Successfully saved derivative data. [2025-09-16T21:20:54.298743] [INFO ] [MAIN ] Derivative Progress: 1672/2026 symbols completed. SOJE took 0.9s. Estimated remaining: 1m 55s. Rate: 184.9 symbols/min [2025-09-16T21:20:54.299116] [INFO ] [MAIN ] SOLV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:54.313336] [DEBUG] [MAIN ] SOJF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:54.323043] [INFO ] [MAIN ] SOJF: Generated 1339 derivative records from 5968 primary records. [2025-09-16T21:20:54.323451] [DEBUG] [LOCAL ] SOJF: Saving derivative data. [2025-09-16T21:20:54.323406] [DEBUG] [MAIN ] SOL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:54.324544] [INFO ] [MAIN ] SOL: Generated 1339 derivative records from 9672 primary records. [2025-09-16T21:20:54.324804] [DEBUG] [LOCAL ] SOL: Saving derivative data. [2025-09-16T21:20:54.346265] [DEBUG] [LOCAL ] SOJF: Derivative data saved (1339 records). [2025-09-16T21:20:54.346602] [INFO ] [MAIN ] SOJF: Successfully saved derivative data. [2025-09-16T21:20:54.347536] [DEBUG] [LOCAL ] SOL: Derivative data saved (1339 records). [2025-09-16T21:20:54.347608] [INFO ] [MAIN ] SOL: Successfully saved derivative data. [2025-09-16T21:20:54.349758] [INFO ] [MAIN ] Derivative Progress: 1673/2026 symbols completed. SOJF took 0.8s. Estimated remaining: 1m 54s. Rate: 185.0 symbols/min [2025-09-16T21:20:54.350087] [INFO ] [MAIN ] SON: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:54.352163] [INFO ] [MAIN ] Derivative Progress: 1674/2026 symbols completed. SOL took 0.8s. Estimated remaining: 1m 54s. Rate: 185.1 symbols/min [2025-09-16T21:20:54.352346] [INFO ] [MAIN ] SONY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:54.375859] [DEBUG] [LOCAL ] SOLV: Loaded 32331 existing records from primary storage. [2025-09-16T21:20:54.376050] [INFO ] [MAIN ] SOLV: Loaded 32331 primary data records. [2025-09-16T21:20:54.598237] [DEBUG] [LOCAL ] SON: Loaded 31708 existing records from primary storage. [2025-09-16T21:20:54.614530] [INFO ] [MAIN ] SON: Loaded 31708 primary data records. [2025-09-16T21:20:54.690075] [DEBUG] [LOCAL ] SONY: Loaded 39777 existing records from primary storage. [2025-09-16T21:20:54.712447] [INFO ] [MAIN ] SONY: Loaded 39777 primary data records. [2025-09-16T21:20:55.284052] [DEBUG] [MAIN ] SOLV: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:55.285696] [INFO ] [MAIN ] SOLV: Generated 1339 derivative records from 32331 primary records. [2025-09-16T21:20:55.286105] [DEBUG] [LOCAL ] SOLV: Saving derivative data. [2025-09-16T21:20:55.303286] [DEBUG] [LOCAL ] SOLV: Derivative data saved (1339 records). [2025-09-16T21:20:55.303692] [INFO ] [MAIN ] SOLV: Successfully saved derivative data. [2025-09-16T21:20:55.305812] [INFO ] [MAIN ] Derivative Progress: 1675/2026 symbols completed. SOLV took 1.0s. Estimated remaining: 1m 54s. Rate: 184.9 symbols/min [2025-09-16T21:20:55.306376] [INFO ] [MAIN ] SOR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:55.322579] [DEBUG] [LOCAL ] SOR: Loaded 2187 existing records from primary storage. [2025-09-16T21:20:55.323241] [INFO ] [MAIN ] SOR: Loaded 2187 primary data records. [2025-09-16T21:20:55.323075] [DEBUG] [MAIN ] SON: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:55.347156] [INFO ] [MAIN ] SON: Generated 1339 derivative records from 31708 primary records. [2025-09-16T21:20:55.369498] [DEBUG] [LOCAL ] SON: Saving derivative data. [2025-09-16T21:20:55.441038] [DEBUG] [MAIN ] SONY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:55.471904] [INFO ] [MAIN ] SONY: Generated 1339 derivative records from 39777 primary records. [2025-09-16T21:20:55.491979] [DEBUG] [LOCAL ] SONY: Saving derivative data. [2025-09-16T21:20:55.510072] [DEBUG] [LOCAL ] SON: Derivative data saved (1339 records). [2025-09-16T21:20:55.526655] [INFO ] [MAIN ] SON: Successfully saved derivative data. [2025-09-16T21:20:55.529777] [INFO ] [MAIN ] Derivative Progress: 1676/2026 symbols completed. SON took 1.2s. Estimated remaining: 1m 54s. Rate: 185.0 symbols/min [2025-09-16T21:20:55.533698] [INFO ] [MAIN ] SOS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:55.636214] [DEBUG] [LOCAL ] SONY: Derivative data saved (1339 records). [2025-09-16T21:20:55.636855] [INFO ] [MAIN ] SONY: Successfully saved derivative data. [2025-09-16T21:20:55.639700] [INFO ] [MAIN ] Derivative Progress: 1677/2026 symbols completed. SONY took 1.3s. Estimated remaining: 1m 53s. Rate: 185.0 symbols/min [2025-09-16T21:20:55.644323] [INFO ] [MAIN ] SPB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:55.643696] [DEBUG] [LOCAL ] SOS: Loaded 6828 existing records from primary storage. [2025-09-16T21:20:55.644897] [INFO ] [MAIN ] SOS: Loaded 6828 primary data records. [2025-09-16T21:20:55.931418] [DEBUG] [LOCAL ] SPB: Loaded 26255 existing records from primary storage. [2025-09-16T21:20:55.931794] [INFO ] [MAIN ] SPB: Loaded 26255 primary data records. [2025-09-16T21:20:55.942177] [DEBUG] [MAIN ] SOR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:55.954520] [INFO ] [MAIN ] SOR: Generated 1339 derivative records from 2187 primary records. [2025-09-16T21:20:55.964508] [DEBUG] [LOCAL ] SOR: Saving derivative data. [2025-09-16T21:20:56.012038] [DEBUG] [LOCAL ] SOR: Derivative data saved (1339 records). [2025-09-16T21:20:56.040277] [INFO ] [MAIN ] SOR: Successfully saved derivative data. [2025-09-16T21:20:56.063732] [INFO ] [MAIN ] Derivative Progress: 1678/2026 symbols completed. SOR took 0.8s. Estimated remaining: 1m 53s. Rate: 185.0 symbols/min [2025-09-16T21:20:56.250821] [DEBUG] [MAIN ] SOS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:56.252259] [INFO ] [MAIN ] SOS: Generated 1339 derivative records from 6828 primary records. [2025-09-16T21:20:56.252442] [DEBUG] [LOCAL ] SOS: Saving derivative data. [2025-09-16T21:20:56.266280] [DEBUG] [LOCAL ] SOS: Derivative data saved (1339 records). [2025-09-16T21:20:56.266412] [INFO ] [MAIN ] SOS: Successfully saved derivative data. [2025-09-16T21:20:56.268371] [INFO ] [MAIN ] Derivative Progress: 1679/2026 symbols completed. SOS took 0.7s. Estimated remaining: 1m 53s. Rate: 185.0 symbols/min [2025-09-16T21:20:56.288776] [DEBUG] [MAIN ] SPB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:56.289617] [INFO ] [MAIN ] SPB: Generated 1339 derivative records from 26255 primary records. [2025-09-16T21:20:56.289724] [DEBUG] [LOCAL ] SPB: Saving derivative data. [2025-09-16T21:20:56.304104] [DEBUG] [LOCAL ] SPB: Derivative data saved (1339 records). [2025-09-16T21:20:56.304256] [INFO ] [MAIN ] SPB: Successfully saved derivative data. [2025-09-16T21:20:56.306536] [INFO ] [MAIN ] Derivative Progress: 1680/2026 symbols completed. SPB took 0.7s. Estimated remaining: 1m 52s. Rate: 185.1 symbols/min [2025-09-16T21:20:56.307443] [INFO ] [MAIN ] SPCE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:56.307524] [INFO ] [MAIN ] SPG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:56.307133] [INFO ] [MAIN ] SPE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:56.317319] [DEBUG] [LOCAL ] SPE: Loaded 4513 existing records from primary storage. [2025-09-16T21:20:56.317620] [INFO ] [MAIN ] SPE: Loaded 4513 primary data records. [2025-09-16T21:20:56.543506] [DEBUG] [LOCAL ] SPG: Loaded 37370 existing records from primary storage. [2025-09-16T21:20:56.561137] [INFO ] [MAIN ] SPG: Loaded 37370 primary data records. [2025-09-16T21:20:56.620720] [DEBUG] [LOCAL ] SPCE: Loaded 37032 existing records from primary storage. [2025-09-16T21:20:56.668687] [INFO ] [MAIN ] SPCE: Loaded 37032 primary data records. [2025-09-16T21:20:57.583382] [DEBUG] [MAIN ] SPE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:57.584325] [INFO ] [MAIN ] SPE: Generated 1339 derivative records from 4513 primary records. [2025-09-16T21:20:57.584528] [DEBUG] [LOCAL ] SPE: Saving derivative data. [2025-09-16T21:20:57.600029] [DEBUG] [LOCAL ] SPE: Derivative data saved (1339 records). [2025-09-16T21:20:57.600555] [INFO ] [MAIN ] SPE: Successfully saved derivative data. [2025-09-16T21:20:57.602159] [INFO ] [MAIN ] Derivative Progress: 1681/2026 symbols completed. SPE took 1.3s. Estimated remaining: 1m 52s. Rate: 184.8 symbols/min [2025-09-16T21:20:57.602724] [INFO ] [MAIN ] SPGI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:57.619199] [DEBUG] [MAIN ] SPG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:57.620165] [INFO ] [MAIN ] SPG: Generated 1339 derivative records from 37370 primary records. [2025-09-16T21:20:57.620534] [DEBUG] [LOCAL ] SPG: Saving derivative data. [2025-09-16T21:20:57.645975] [DEBUG] [LOCAL ] SPG: Derivative data saved (1339 records). [2025-09-16T21:20:57.646283] [INFO ] [MAIN ] SPG: Successfully saved derivative data. [2025-09-16T21:20:57.648875] [INFO ] [MAIN ] Derivative Progress: 1682/2026 symbols completed. SPG took 1.3s. Estimated remaining: 1m 52s. Rate: 184.9 symbols/min [2025-09-16T21:20:57.659579] [INFO ] [MAIN ] SPH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:57.659513] [DEBUG] [MAIN ] SPCE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:57.660401] [INFO ] [MAIN ] SPCE: Generated 1339 derivative records from 37032 primary records. [2025-09-16T21:20:57.660748] [DEBUG] [LOCAL ] SPCE: Saving derivative data. [2025-09-16T21:20:57.684553] [DEBUG] [LOCAL ] SPCE: Derivative data saved (1339 records). [2025-09-16T21:20:57.685555] [INFO ] [MAIN ] SPCE: Successfully saved derivative data. [2025-09-16T21:20:57.685475] [DEBUG] [LOCAL ] SPGI: Loaded 33166 existing records from primary storage. [2025-09-16T21:20:57.687885] [INFO ] [MAIN ] Derivative Progress: 1683/2026 symbols completed. SPCE took 1.4s. Estimated remaining: 1m 51s. Rate: 185.0 symbols/min [2025-09-16T21:20:57.688002] [INFO ] [MAIN ] SPGI: Loaded 33166 primary data records. [2025-09-16T21:20:57.688344] [INFO ] [MAIN ] SPHR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:57.815369] [DEBUG] [LOCAL ] SPH: Loaded 12796 existing records from primary storage. [2025-09-16T21:20:57.837009] [INFO ] [MAIN ] SPH: Loaded 12796 primary data records. [2025-09-16T21:20:58.114927] [DEBUG] [LOCAL ] SPHR: Loaded 28867 existing records from primary storage. [2025-09-16T21:20:58.118931] [INFO ] [MAIN ] SPHR: Loaded 28867 primary data records. [2025-09-16T21:20:58.582131] [DEBUG] [MAIN ] SPGI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:58.583170] [INFO ] [MAIN ] SPGI: Generated 1339 derivative records from 33166 primary records. [2025-09-16T21:20:58.583534] [DEBUG] [LOCAL ] SPGI: Saving derivative data. [2025-09-16T21:20:58.599137] [DEBUG] [LOCAL ] SPGI: Derivative data saved (1339 records). [2025-09-16T21:20:58.611963] [INFO ] [MAIN ] SPGI: Successfully saved derivative data. [2025-09-16T21:20:58.614123] [INFO ] [MAIN ] Derivative Progress: 1684/2026 symbols completed. SPGI took 1.0s. Estimated remaining: 1m 51s. Rate: 184.8 symbols/min [2025-09-16T21:20:58.612572] [DEBUG] [MAIN ] SPH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:58.615074] [INFO ] [MAIN ] SPIR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:58.616671] [INFO ] [MAIN ] SPH: Generated 1339 derivative records from 12796 primary records. [2025-09-16T21:20:58.617580] [DEBUG] [LOCAL ] SPH: Saving derivative data. [2025-09-16T21:20:58.639596] [DEBUG] [MAIN ] SPHR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:58.642090] [INFO ] [MAIN ] SPHR: Generated 1339 derivative records from 28867 primary records. [2025-09-16T21:20:58.643333] [DEBUG] [LOCAL ] SPHR: Saving derivative data. [2025-09-16T21:20:58.644487] [DEBUG] [LOCAL ] SPH: Derivative data saved (1339 records). [2025-09-16T21:20:58.645279] [INFO ] [MAIN ] SPH: Successfully saved derivative data. [2025-09-16T21:20:58.647894] [INFO ] [MAIN ] Derivative Progress: 1685/2026 symbols completed. SPH took 1.0s. Estimated remaining: 1m 51s. Rate: 184.9 symbols/min [2025-09-16T21:20:58.653686] [INFO ] [MAIN ] SPMC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:58.666816] [DEBUG] [LOCAL ] SPHR: Derivative data saved (1339 records). [2025-09-16T21:20:58.667285] [INFO ] [MAIN ] SPHR: Successfully saved derivative data. [2025-09-16T21:20:58.669233] [INFO ] [MAIN ] Derivative Progress: 1686/2026 symbols completed. SPHR took 1.0s. Estimated remaining: 1m 50s. Rate: 185.0 symbols/min [2025-09-16T21:20:58.669459] [INFO ] [MAIN ] SPNT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:58.681840] [DEBUG] [LOCAL ] SPIR: Loaded 27817 existing records from primary storage. [2025-09-16T21:20:58.685027] [INFO ] [MAIN ] SPIR: Loaded 27817 primary data records. [2025-09-16T21:20:58.684969] [DEBUG] [LOCAL ] SPMC: Loaded 3849 existing records from primary storage. [2025-09-16T21:20:58.685196] [INFO ] [MAIN ] SPMC: Loaded 3849 primary data records. [2025-09-16T21:20:58.947895] [DEBUG] [LOCAL ] SPNT: Loaded 25754 existing records from primary storage. [2025-09-16T21:20:58.999043] [INFO ] [MAIN ] SPNT: Loaded 25754 primary data records. [2025-09-16T21:20:59.566873] [DEBUG] [MAIN ] SPMC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:59.567881] [INFO ] [MAIN ] SPMC: Generated 1339 derivative records from 3849 primary records. [2025-09-16T21:20:59.573987] [DEBUG] [LOCAL ] SPMC: Saving derivative data. [2025-09-16T21:20:59.579458] [DEBUG] [MAIN ] SPIR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:59.589693] [INFO ] [MAIN ] SPIR: Generated 1339 derivative records from 27817 primary records. [2025-09-16T21:20:59.590476] [DEBUG] [LOCAL ] SPIR: Saving derivative data. [2025-09-16T21:20:59.604094] [DEBUG] [LOCAL ] SPMC: Derivative data saved (1339 records). [2025-09-16T21:20:59.610685] [INFO ] [MAIN ] SPMC: Successfully saved derivative data. [2025-09-16T21:20:59.610522] [DEBUG] [LOCAL ] SPIR: Derivative data saved (1339 records). [2025-09-16T21:20:59.621720] [INFO ] [MAIN ] Derivative Progress: 1687/2026 symbols completed. SPMC took 1.0s. Estimated remaining: 1m 50s. Rate: 184.8 symbols/min [2025-09-16T21:20:59.622236] [INFO ] [MAIN ] SPR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:59.621938] [INFO ] [MAIN ] SPIR: Successfully saved derivative data. [2025-09-16T21:20:59.622704] [DEBUG] [MAIN ] SPNT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:20:59.625797] [INFO ] [MAIN ] Derivative Progress: 1688/2026 symbols completed. SPIR took 1.0s. Estimated remaining: 1m 50s. Rate: 184.9 symbols/min [2025-09-16T21:20:59.623591] [INFO ] [MAIN ] SPNT: Generated 1339 derivative records from 25754 primary records. [2025-09-16T21:20:59.626389] [INFO ] [MAIN ] SPRU: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:59.626287] [DEBUG] [LOCAL ] SPNT: Saving derivative data. [2025-09-16T21:20:59.639738] [DEBUG] [LOCAL ] SPNT: Derivative data saved (1339 records). [2025-09-16T21:20:59.639916] [INFO ] [MAIN ] SPNT: Successfully saved derivative data. [2025-09-16T21:20:59.641935] [INFO ] [MAIN ] Derivative Progress: 1689/2026 symbols completed. SPNT took 1.0s. Estimated remaining: 1m 49s. Rate: 185.0 symbols/min [2025-09-16T21:20:59.644317] [INFO ] [MAIN ] SPXC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:20:59.649422] [DEBUG] [LOCAL ] SPRU: Loaded 6874 existing records from primary storage. [2025-09-16T21:20:59.649577] [INFO ] [MAIN ] SPRU: Loaded 6874 primary data records. [2025-09-16T21:20:59.792802] [DEBUG] [LOCAL ] SPXC: Loaded 16896 existing records from primary storage. [2025-09-16T21:20:59.793023] [INFO ] [MAIN ] SPXC: Loaded 16896 primary data records. [2025-09-16T21:20:59.793506] [DEBUG] [LOCAL ] SPR: Loaded 29941 existing records from primary storage. [2025-09-16T21:20:59.840678] [INFO ] [MAIN ] SPR: Loaded 29941 primary data records. [2025-09-16T21:21:00.551382] [DEBUG] [MAIN ] SPRU: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:00.553751] [INFO ] [MAIN ] SPRU: Generated 1339 derivative records from 6874 primary records. [2025-09-16T21:21:00.554413] [DEBUG] [LOCAL ] SPRU: Saving derivative data. [2025-09-16T21:21:00.573283] [DEBUG] [LOCAL ] SPRU: Derivative data saved (1339 records). [2025-09-16T21:21:00.577436] [INFO ] [MAIN ] SPRU: Successfully saved derivative data. [2025-09-16T21:21:00.578022] [DEBUG] [MAIN ] SPXC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:00.579622] [INFO ] [MAIN ] Derivative Progress: 1690/2026 symbols completed. SPRU took 1.0s. Estimated remaining: 1m 49s. Rate: 184.8 symbols/min [2025-09-16T21:21:00.580440] [INFO ] [MAIN ] SPXC: Generated 1339 derivative records from 16896 primary records. [2025-09-16T21:21:00.581155] [INFO ] [MAIN ] SPXX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:00.580933] [DEBUG] [LOCAL ] SPXC: Saving derivative data. [2025-09-16T21:21:00.598736] [DEBUG] [LOCAL ] SPXC: Derivative data saved (1339 records). [2025-09-16T21:21:00.599339] [INFO ] [MAIN ] SPXC: Successfully saved derivative data. [2025-09-16T21:21:00.601578] [INFO ] [MAIN ] Derivative Progress: 1691/2026 symbols completed. SPXC took 1.0s. Estimated remaining: 1m 49s. Rate: 184.9 symbols/min [2025-09-16T21:21:00.601782] [INFO ] [MAIN ] SQM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:00.605039] [DEBUG] [LOCAL ] SPXX: Loaded 5916 existing records from primary storage. [2025-09-16T21:21:00.605622] [INFO ] [MAIN ] SPXX: Loaded 5916 primary data records. [2025-09-16T21:21:00.655285] [DEBUG] [MAIN ] SPR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:00.677292] [INFO ] [MAIN ] SPR: Generated 1339 derivative records from 29941 primary records. [2025-09-16T21:21:00.697573] [DEBUG] [LOCAL ] SPR: Saving derivative data. [2025-09-16T21:21:00.819095] [DEBUG] [LOCAL ] SPR: Derivative data saved (1339 records). [2025-09-16T21:21:00.920816] [INFO ] [MAIN ] SPR: Successfully saved derivative data. [2025-09-16T21:21:00.924005] [DEBUG] [LOCAL ] SQM: Loaded 36168 existing records from primary storage. [2025-09-16T21:21:00.924145] [INFO ] [MAIN ] SQM: Loaded 36168 primary data records. [2025-09-16T21:21:00.923023] [INFO ] [MAIN ] Derivative Progress: 1692/2026 symbols completed. SPR took 1.3s. Estimated remaining: 1m 48s. Rate: 184.9 symbols/min [2025-09-16T21:21:00.924402] [INFO ] [MAIN ] SQNS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:01.131328] [DEBUG] [LOCAL ] SQNS: Loaded 23260 existing records from primary storage. [2025-09-16T21:21:01.205547] [INFO ] [MAIN ] SQNS: Loaded 23260 primary data records. [2025-09-16T21:21:01.362976] [DEBUG] [MAIN ] SPXX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:01.391424] [INFO ] [MAIN ] SPXX: Generated 1339 derivative records from 5916 primary records. [2025-09-16T21:21:01.423975] [DEBUG] [LOCAL ] SPXX: Saving derivative data. [2025-09-16T21:21:01.527554] [DEBUG] [LOCAL ] SPXX: Derivative data saved (1339 records). [2025-09-16T21:21:01.528468] [INFO ] [MAIN ] SPXX: Successfully saved derivative data. [2025-09-16T21:21:01.531921] [INFO ] [MAIN ] Derivative Progress: 1693/2026 symbols completed. SPXX took 1.0s. Estimated remaining: 1m 48s. Rate: 184.8 symbols/min [2025-09-16T21:21:01.542979] [DEBUG] [MAIN ] SQM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:01.543544] [INFO ] [MAIN ] SQM: Generated 1339 derivative records from 36168 primary records. [2025-09-16T21:21:01.543786] [DEBUG] [LOCAL ] SQM: Saving derivative data. [2025-09-16T21:21:01.556113] [DEBUG] [LOCAL ] SQM: Derivative data saved (1339 records). [2025-09-16T21:21:01.556212] [INFO ] [MAIN ] SQM: Successfully saved derivative data. [2025-09-16T21:21:01.558946] [INFO ] [MAIN ] Derivative Progress: 1694/2026 symbols completed. SQM took 1.0s. Estimated remaining: 1m 48s. Rate: 184.9 symbols/min [2025-09-16T21:21:01.570556] [DEBUG] [MAIN ] SQNS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:01.571145] [INFO ] [MAIN ] SQNS: Generated 1339 derivative records from 23260 primary records. [2025-09-16T21:21:01.571206] [DEBUG] [LOCAL ] SQNS: Saving derivative data. [2025-09-16T21:21:01.582379] [DEBUG] [LOCAL ] SQNS: Derivative data saved (1339 records). [2025-09-16T21:21:01.582435] [INFO ] [MAIN ] SQNS: Successfully saved derivative data. [2025-09-16T21:21:01.584367] [INFO ] [MAIN ] Derivative Progress: 1695/2026 symbols completed. SQNS took 0.7s. Estimated remaining: 1m 47s. Rate: 185.0 symbols/min [2025-09-16T21:21:01.584872] [INFO ] [MAIN ] SR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:01.585029] [INFO ] [MAIN ] SRFM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:01.585341] [INFO ] [MAIN ] SREA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:01.596596] [DEBUG] [LOCAL ] SREA: Loaded 7518 existing records from primary storage. [2025-09-16T21:21:01.596806] [INFO ] [MAIN ] SREA: Loaded 7518 primary data records. [2025-09-16T21:21:01.745595] [DEBUG] [LOCAL ] SRFM: Loaded 29197 existing records from primary storage. [2025-09-16T21:21:01.761415] [INFO ] [MAIN ] SRFM: Loaded 29197 primary data records. [2025-09-16T21:21:01.756242] [DEBUG] [LOCAL ] SR: Loaded 24257 existing records from primary storage. [2025-09-16T21:21:01.787220] [INFO ] [MAIN ] SR: Loaded 24257 primary data records. [2025-09-16T21:21:02.490703] [DEBUG] [MAIN ] SREA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:02.492913] [INFO ] [MAIN ] SREA: Generated 1339 derivative records from 7518 primary records. [2025-09-16T21:21:02.493519] [DEBUG] [LOCAL ] SREA: Saving derivative data. [2025-09-16T21:21:02.507668] [DEBUG] [LOCAL ] SREA: Derivative data saved (1339 records). [2025-09-16T21:21:02.507790] [INFO ] [MAIN ] SREA: Successfully saved derivative data. [2025-09-16T21:21:02.509393] [INFO ] [MAIN ] Derivative Progress: 1696/2026 symbols completed. SREA took 0.9s. Estimated remaining: 1m 47s. Rate: 184.8 symbols/min [2025-09-16T21:21:02.509827] [INFO ] [MAIN ] SRG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:02.527122] [DEBUG] [MAIN ] SR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:02.527839] [INFO ] [MAIN ] SR: Generated 1339 derivative records from 24257 primary records. [2025-09-16T21:21:02.536897] [DEBUG] [LOCAL ] SR: Saving derivative data. [2025-09-16T21:21:02.537231] [DEBUG] [MAIN ] SRFM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:02.547808] [INFO ] [MAIN ] SRFM: Generated 1339 derivative records from 29197 primary records. [2025-09-16T21:21:02.547907] [DEBUG] [LOCAL ] SRFM: Saving derivative data. [2025-09-16T21:21:02.551444] [DEBUG] [LOCAL ] SRG: Loaded 10612 existing records from primary storage. [2025-09-16T21:21:02.551940] [INFO ] [MAIN ] SRG: Loaded 10612 primary data records. [2025-09-16T21:21:02.580770] [DEBUG] [LOCAL ] SR: Derivative data saved (1339 records). [2025-09-16T21:21:02.600940] [INFO ] [MAIN ] SR: Successfully saved derivative data. [2025-09-16T21:21:02.610857] [INFO ] [MAIN ] Derivative Progress: 1697/2026 symbols completed. SR took 1.0s. Estimated remaining: 1m 47s. Rate: 184.9 symbols/min [2025-09-16T21:21:02.624216] [INFO ] [MAIN ] SRI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:02.679008] [DEBUG] [LOCAL ] SRFM: Derivative data saved (1339 records). [2025-09-16T21:21:02.700813] [INFO ] [MAIN ] SRFM: Successfully saved derivative data. [2025-09-16T21:21:02.729130] [INFO ] [MAIN ] Derivative Progress: 1698/2026 symbols completed. SRFM took 1.1s. Estimated remaining: 1m 46s. Rate: 184.9 symbols/min [2025-09-16T21:21:02.765228] [INFO ] [MAIN ] SRV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:02.868070] [DEBUG] [LOCAL ] SRI: Loaded 20511 existing records from primary storage. [2025-09-16T21:21:02.868477] [INFO ] [MAIN ] SRI: Loaded 20511 primary data records. [2025-09-16T21:21:02.982460] [DEBUG] [LOCAL ] SRV: Loaded 5351 existing records from primary storage. [2025-09-16T21:21:02.986291] [INFO ] [MAIN ] SRV: Loaded 5351 primary data records. [2025-09-16T21:21:03.429626] [DEBUG] [MAIN ] SRG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:03.430990] [INFO ] [MAIN ] SRG: Generated 1339 derivative records from 10612 primary records. [2025-09-16T21:21:03.431600] [DEBUG] [LOCAL ] SRG: Saving derivative data. [2025-09-16T21:21:03.444512] [DEBUG] [LOCAL ] SRG: Derivative data saved (1339 records). [2025-09-16T21:21:03.445758] [INFO ] [MAIN ] SRG: Successfully saved derivative data. [2025-09-16T21:21:03.447550] [INFO ] [MAIN ] Derivative Progress: 1699/2026 symbols completed. SRG took 0.9s. Estimated remaining: 1m 46s. Rate: 184.8 symbols/min [2025-09-16T21:21:03.447994] [INFO ] [MAIN ] SSB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:03.460949] [DEBUG] [MAIN ] SRI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:03.461710] [INFO ] [MAIN ] SRI: Generated 1339 derivative records from 20511 primary records. [2025-09-16T21:21:03.461889] [DEBUG] [LOCAL ] SRI: Saving derivative data. [2025-09-16T21:21:03.475073] [DEBUG] [LOCAL ] SRI: Derivative data saved (1339 records). [2025-09-16T21:21:03.476305] [INFO ] [MAIN ] SRI: Successfully saved derivative data. [2025-09-16T21:21:03.478826] [INFO ] [MAIN ] Derivative Progress: 1700/2026 symbols completed. SRI took 0.9s. Estimated remaining: 1m 46s. Rate: 184.9 symbols/min [2025-09-16T21:21:03.485512] [INFO ] [MAIN ] SSD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:03.498295] [DEBUG] [MAIN ] SRV: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:03.499099] [INFO ] [MAIN ] SRV: Generated 1339 derivative records from 5351 primary records. [2025-09-16T21:21:03.499321] [DEBUG] [LOCAL ] SRV: Saving derivative data. [2025-09-16T21:21:03.521047] [DEBUG] [LOCAL ] SRV: Derivative data saved (1339 records). [2025-09-16T21:21:03.521176] [INFO ] [MAIN ] SRV: Successfully saved derivative data. [2025-09-16T21:21:03.523189] [INFO ] [MAIN ] Derivative Progress: 1701/2026 symbols completed. SRV took 0.8s. Estimated remaining: 1m 45s. Rate: 185.0 symbols/min [2025-09-16T21:21:03.527681] [INFO ] [MAIN ] SSL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:03.523956] [DEBUG] [LOCAL ] SSB: Loaded 32137 existing records from primary storage. [2025-09-16T21:21:03.527854] [INFO ] [MAIN ] SSB: Loaded 32137 primary data records. [2025-09-16T21:21:03.637619] [DEBUG] [LOCAL ] SSD: Loaded 16733 existing records from primary storage. [2025-09-16T21:21:03.637781] [INFO ] [MAIN ] SSD: Loaded 16733 primary data records. [2025-09-16T21:21:03.843611] [DEBUG] [LOCAL ] SSL: Loaded 30474 existing records from primary storage. [2025-09-16T21:21:03.918984] [INFO ] [MAIN ] SSL: Loaded 30474 primary data records. [2025-09-16T21:21:04.428847] [DEBUG] [MAIN ] SSB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:04.430070] [INFO ] [MAIN ] SSB: Generated 1339 derivative records from 32137 primary records. [2025-09-16T21:21:04.431017] [DEBUG] [LOCAL ] SSB: Saving derivative data. [2025-09-16T21:21:04.456173] [DEBUG] [LOCAL ] SSB: Derivative data saved (1339 records). [2025-09-16T21:21:04.456468] [INFO ] [MAIN ] SSB: Successfully saved derivative data. [2025-09-16T21:21:04.456775] [DEBUG] [MAIN ] SSD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:04.459266] [INFO ] [MAIN ] Derivative Progress: 1702/2026 symbols completed. SSB took 1.0s. Estimated remaining: 1m 45s. Rate: 184.8 symbols/min [2025-09-16T21:21:04.457513] [INFO ] [MAIN ] SSD: Generated 1339 derivative records from 16733 primary records. [2025-09-16T21:21:04.459996] [INFO ] [MAIN ] SST: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:04.460373] [DEBUG] [LOCAL ] SSD: Saving derivative data. [2025-09-16T21:21:04.488713] [DEBUG] [LOCAL ] SSD: Derivative data saved (1339 records). [2025-09-16T21:21:04.489242] [INFO ] [MAIN ] SSD: Successfully saved derivative data. [2025-09-16T21:21:04.491294] [INFO ] [MAIN ] Derivative Progress: 1703/2026 symbols completed. SSD took 1.0s. Estimated remaining: 1m 45s. Rate: 184.9 symbols/min [2025-09-16T21:21:04.489149] [DEBUG] [MAIN ] SSL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:04.491535] [INFO ] [MAIN ] SSTK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:04.492484] [INFO ] [MAIN ] SSL: Generated 1339 derivative records from 30474 primary records. [2025-09-16T21:21:04.496510] [DEBUG] [LOCAL ] SSL: Saving derivative data. [2025-09-16T21:21:04.496470] [DEBUG] [LOCAL ] SST: Loaded 9722 existing records from primary storage. [2025-09-16T21:21:04.497333] [INFO ] [MAIN ] SST: Loaded 9722 primary data records. [2025-09-16T21:21:04.575802] [DEBUG] [LOCAL ] SSL: Derivative data saved (1339 records). [2025-09-16T21:21:04.603031] [INFO ] [MAIN ] SSL: Successfully saved derivative data. [2025-09-16T21:21:04.620385] [INFO ] [MAIN ] Derivative Progress: 1704/2026 symbols completed. SSL took 1.1s. Estimated remaining: 1m 44s. Rate: 184.9 symbols/min [2025-09-16T21:21:04.630932] [INFO ] [MAIN ] ST: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:04.630849] [DEBUG] [LOCAL ] SSTK: Loaded 18124 existing records from primary storage. [2025-09-16T21:21:04.636201] [INFO ] [MAIN ] SSTK: Loaded 18124 primary data records. [2025-09-16T21:21:05.089332] [DEBUG] [LOCAL ] ST: Loaded 36896 existing records from primary storage. [2025-09-16T21:21:05.090464] [INFO ] [MAIN ] ST: Loaded 36896 primary data records. [2025-09-16T21:21:05.374568] [DEBUG] [MAIN ] SST: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:05.386486] [INFO ] [MAIN ] SST: Generated 1339 derivative records from 9722 primary records. [2025-09-16T21:21:05.386604] [DEBUG] [LOCAL ] SST: Saving derivative data. [2025-09-16T21:21:05.398089] [DEBUG] [MAIN ] SSTK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:05.404691] [INFO ] [MAIN ] SSTK: Generated 1339 derivative records from 18124 primary records. [2025-09-16T21:21:05.410092] [DEBUG] [LOCAL ] SSTK: Saving derivative data. [2025-09-16T21:21:05.409848] [DEBUG] [LOCAL ] SST: Derivative data saved (1339 records). [2025-09-16T21:21:05.419886] [INFO ] [MAIN ] SST: Successfully saved derivative data. [2025-09-16T21:21:05.422234] [INFO ] [MAIN ] Derivative Progress: 1705/2026 symbols completed. SST took 1.0s. Estimated remaining: 1m 44s. Rate: 184.8 symbols/min [2025-09-16T21:21:05.424003] [INFO ] [MAIN ] STAG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:05.425425] [DEBUG] [LOCAL ] SSTK: Derivative data saved (1339 records). [2025-09-16T21:21:05.425886] [INFO ] [MAIN ] SSTK: Successfully saved derivative data. [2025-09-16T21:21:05.428397] [INFO ] [MAIN ] Derivative Progress: 1706/2026 symbols completed. SSTK took 0.9s. Estimated remaining: 1m 44s. Rate: 184.9 symbols/min [2025-09-16T21:21:05.428719] [INFO ] [MAIN ] STC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:05.456823] [DEBUG] [LOCAL ] STC: Loaded 13235 existing records from primary storage. [2025-09-16T21:21:05.457633] [INFO ] [MAIN ] STC: Loaded 13235 primary data records. [2025-09-16T21:21:05.457552] [DEBUG] [MAIN ] ST: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:05.489968] [INFO ] [MAIN ] ST: Generated 1339 derivative records from 36896 primary records. [2025-09-16T21:21:05.514456] [DEBUG] [LOCAL ] ST: Saving derivative data. [2025-09-16T21:21:05.622155] [DEBUG] [LOCAL ] ST: Derivative data saved (1339 records). [2025-09-16T21:21:05.645377] [DEBUG] [LOCAL ] STAG: Loaded 36988 existing records from primary storage. [2025-09-16T21:21:05.644574] [INFO ] [MAIN ] ST: Successfully saved derivative data. [2025-09-16T21:21:05.668730] [INFO ] [MAIN ] STAG: Loaded 36988 primary data records. [2025-09-16T21:21:05.684925] [INFO ] [MAIN ] Derivative Progress: 1707/2026 symbols completed. ST took 1.1s. Estimated remaining: 1m 44s. Rate: 184.9 symbols/min [2025-09-16T21:21:05.808557] [INFO ] [MAIN ] STE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:06.053261] [DEBUG] [LOCAL ] STE: Loaded 26260 existing records from primary storage. [2025-09-16T21:21:06.052769] [DEBUG] [MAIN ] STC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:06.054076] [INFO ] [MAIN ] STE: Loaded 26260 primary data records. [2025-09-16T21:21:06.054022] [INFO ] [MAIN ] STC: Generated 1339 derivative records from 13235 primary records. [2025-09-16T21:21:06.065484] [DEBUG] [LOCAL ] STC: Saving derivative data. [2025-09-16T21:21:06.169480] [DEBUG] [LOCAL ] STC: Derivative data saved (1339 records). [2025-09-16T21:21:06.180779] [INFO ] [MAIN ] STC: Successfully saved derivative data. [2025-09-16T21:21:06.187686] [INFO ] [MAIN ] Derivative Progress: 1708/2026 symbols completed. STC took 0.8s. Estimated remaining: 1m 43s. Rate: 184.9 symbols/min [2025-09-16T21:21:06.221908] [DEBUG] [MAIN ] STAG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:06.232049] [INFO ] [MAIN ] STAG: Generated 1339 derivative records from 36988 primary records. [2025-09-16T21:21:06.252859] [DEBUG] [LOCAL ] STAG: Saving derivative data. [2025-09-16T21:21:06.389104] [DEBUG] [LOCAL ] STAG: Derivative data saved (1339 records). [2025-09-16T21:21:06.390175] [INFO ] [MAIN ] STAG: Successfully saved derivative data. [2025-09-16T21:21:06.392397] [INFO ] [MAIN ] Derivative Progress: 1709/2026 symbols completed. STAG took 1.0s. Estimated remaining: 1m 43s. Rate: 184.9 symbols/min [2025-09-16T21:21:06.408334] [DEBUG] [MAIN ] STE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:06.408909] [INFO ] [MAIN ] STE: Generated 1339 derivative records from 26260 primary records. [2025-09-16T21:21:06.408970] [DEBUG] [LOCAL ] STE: Saving derivative data. [2025-09-16T21:21:06.420848] [DEBUG] [LOCAL ] STE: Derivative data saved (1339 records). [2025-09-16T21:21:06.420925] [INFO ] [MAIN ] STE: Successfully saved derivative data. [2025-09-16T21:21:06.422625] [INFO ] [MAIN ] Derivative Progress: 1710/2026 symbols completed. STE took 0.6s. Estimated remaining: 1m 42s. Rate: 185.0 symbols/min [2025-09-16T21:21:06.423065] [INFO ] [MAIN ] STEL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:06.423207] [INFO ] [MAIN ] STEM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:06.423339] [INFO ] [MAIN ] STEW: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:06.440292] [DEBUG] [LOCAL ] STEW: Loaded 11286 existing records from primary storage. [2025-09-16T21:21:06.440496] [INFO ] [MAIN ] STEW: Loaded 11286 primary data records. [2025-09-16T21:21:06.547952] [DEBUG] [LOCAL ] STEL: Loaded 16712 existing records from primary storage. [2025-09-16T21:21:06.558789] [INFO ] [MAIN ] STEL: Loaded 16712 primary data records. [2025-09-16T21:21:06.628332] [DEBUG] [LOCAL ] STEM: Loaded 28350 existing records from primary storage. [2025-09-16T21:21:06.699032] [INFO ] [MAIN ] STEM: Loaded 28350 primary data records. [2025-09-16T21:21:07.306733] [DEBUG] [MAIN ] STEW: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:07.307583] [INFO ] [MAIN ] STEW: Generated 1339 derivative records from 11286 primary records. [2025-09-16T21:21:07.308152] [DEBUG] [LOCAL ] STEW: Saving derivative data. [2025-09-16T21:21:07.321445] [DEBUG] [LOCAL ] STEW: Derivative data saved (1339 records). [2025-09-16T21:21:07.321980] [INFO ] [MAIN ] STEW: Successfully saved derivative data. [2025-09-16T21:21:07.323742] [INFO ] [MAIN ] Derivative Progress: 1711/2026 symbols completed. STEW took 0.9s. Estimated remaining: 1m 42s. Rate: 184.8 symbols/min [2025-09-16T21:21:07.324155] [INFO ] [MAIN ] STK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:07.340431] [DEBUG] [MAIN ] STEL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:07.342493] [INFO ] [MAIN ] STEL: Generated 1339 derivative records from 16712 primary records. [2025-09-16T21:21:07.342786] [DEBUG] [LOCAL ] STEL: Saving derivative data. [2025-09-16T21:21:07.352289] [DEBUG] [LOCAL ] STK: Loaded 6525 existing records from primary storage. [2025-09-16T21:21:07.356080] [INFO ] [MAIN ] STK: Loaded 6525 primary data records. [2025-09-16T21:21:07.385467] [DEBUG] [MAIN ] STEM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:07.402099] [INFO ] [MAIN ] STEM: Generated 1339 derivative records from 28350 primary records. [2025-09-16T21:21:07.409168] [DEBUG] [LOCAL ] STEM: Saving derivative data. [2025-09-16T21:21:07.443291] [DEBUG] [LOCAL ] STEL: Derivative data saved (1339 records). [2025-09-16T21:21:07.462565] [INFO ] [MAIN ] STEL: Successfully saved derivative data. [2025-09-16T21:21:07.470778] [INFO ] [MAIN ] Derivative Progress: 1712/2026 symbols completed. STEL took 1.0s. Estimated remaining: 1m 42s. Rate: 184.9 symbols/min [2025-09-16T21:21:07.482613] [INFO ] [MAIN ] STLA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:07.533281] [DEBUG] [LOCAL ] STEM: Derivative data saved (1339 records). [2025-09-16T21:21:07.559471] [INFO ] [MAIN ] STEM: Successfully saved derivative data. [2025-09-16T21:21:07.561575] [INFO ] [MAIN ] Derivative Progress: 1713/2026 symbols completed. STEM took 1.1s. Estimated remaining: 1m 42s. Rate: 184.9 symbols/min [2025-09-16T21:21:07.643536] [INFO ] [MAIN ] STM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:07.674416] [DEBUG] [MAIN ] STK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:07.675143] [INFO ] [MAIN ] STK: Generated 1339 derivative records from 6525 primary records. [2025-09-16T21:21:07.683348] [DEBUG] [LOCAL ] STK: Saving derivative data. [2025-09-16T21:21:07.707769] [DEBUG] [LOCAL ] STK: Derivative data saved (1339 records). [2025-09-16T21:21:07.708249] [INFO ] [MAIN ] STK: Successfully saved derivative data. [2025-09-16T21:21:07.710038] [INFO ] [MAIN ] Derivative Progress: 1714/2026 symbols completed. STK took 0.4s. Estimated remaining: 1m 41s. Rate: 185.0 symbols/min [2025-09-16T21:21:07.710975] [DEBUG] [LOCAL ] STLA: Loaded 39924 existing records from primary storage. [2025-09-16T21:21:07.721236] [INFO ] [MAIN ] STLA: Loaded 39924 primary data records. [2025-09-16T21:21:07.722199] [INFO ] [MAIN ] STN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:07.764942] [DEBUG] [LOCAL ] STM: Loaded 39950 existing records from primary storage. [2025-09-16T21:21:07.776910] [INFO ] [MAIN ] STM: Loaded 39950 primary data records. [2025-09-16T21:21:08.163161] [DEBUG] [LOCAL ] STN: Loaded 17015 existing records from primary storage. [2025-09-16T21:21:08.165872] [INFO ] [MAIN ] STN: Loaded 17015 primary data records. [2025-09-16T21:21:08.584934] [DEBUG] [MAIN ] STLA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:08.586180] [INFO ] [MAIN ] STLA: Generated 1339 derivative records from 39924 primary records. [2025-09-16T21:21:08.586334] [DEBUG] [LOCAL ] STLA: Saving derivative data. [2025-09-16T21:21:08.603873] [DEBUG] [MAIN ] STM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:08.609145] [DEBUG] [LOCAL ] STLA: Derivative data saved (1339 records). [2025-09-16T21:21:08.609326] [INFO ] [MAIN ] STLA: Successfully saved derivative data. [2025-09-16T21:21:08.611745] [INFO ] [MAIN ] Derivative Progress: 1715/2026 symbols completed. STLA took 1.1s. Estimated remaining: 1m 41s. Rate: 184.8 symbols/min [2025-09-16T21:21:08.610034] [INFO ] [MAIN ] STM: Generated 1339 derivative records from 39950 primary records. [2025-09-16T21:21:08.612004] [INFO ] [MAIN ] STNG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:08.612512] [DEBUG] [LOCAL ] STM: Saving derivative data. [2025-09-16T21:21:08.627591] [DEBUG] [LOCAL ] STM: Derivative data saved (1339 records). [2025-09-16T21:21:08.627805] [INFO ] [MAIN ] STM: Successfully saved derivative data. [2025-09-16T21:21:08.629985] [INFO ] [MAIN ] Derivative Progress: 1716/2026 symbols completed. STM took 1.1s. Estimated remaining: 1m 41s. Rate: 184.9 symbols/min [2025-09-16T21:21:08.639577] [INFO ] [MAIN ] STRV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:08.640020] [DEBUG] [MAIN ] STN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:08.640698] [INFO ] [MAIN ] STN: Generated 1339 derivative records from 17015 primary records. [2025-09-16T21:21:08.641038] [DEBUG] [LOCAL ] STN: Saving derivative data. [2025-09-16T21:21:08.661766] [DEBUG] [LOCAL ] STN: Derivative data saved (1339 records). [2025-09-16T21:21:08.663620] [INFO ] [MAIN ] STN: Successfully saved derivative data. [2025-09-16T21:21:08.665705] [INFO ] [MAIN ] Derivative Progress: 1717/2026 symbols completed. STN took 1.0s. Estimated remaining: 1m 40s. Rate: 185.0 symbols/min [2025-09-16T21:21:08.666032] [INFO ] [MAIN ] STVN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:08.671018] [DEBUG] [LOCAL ] STRV: Loaded 7657 existing records from primary storage. [2025-09-16T21:21:08.671205] [INFO ] [MAIN ] STRV: Loaded 7657 primary data records. [2025-09-16T21:21:08.791086] [DEBUG] [LOCAL ] STNG: Loaded 32590 existing records from primary storage. [2025-09-16T21:21:08.798381] [INFO ] [MAIN ] STNG: Loaded 32590 primary data records. [2025-09-16T21:21:08.831169] [DEBUG] [LOCAL ] STVN: Loaded 19497 existing records from primary storage. [2025-09-16T21:21:08.877770] [INFO ] [MAIN ] STVN: Loaded 19497 primary data records. [2025-09-16T21:21:09.516634] [DEBUG] [MAIN ] STRV: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:09.518018] [INFO ] [MAIN ] STRV: Generated 1339 derivative records from 7657 primary records. [2025-09-16T21:21:09.518231] [DEBUG] [LOCAL ] STRV: Saving derivative data. [2025-09-16T21:21:09.533850] [DEBUG] [LOCAL ] STRV: Derivative data saved (1339 records). [2025-09-16T21:21:09.534117] [INFO ] [MAIN ] STRV: Successfully saved derivative data. [2025-09-16T21:21:09.536016] [INFO ] [MAIN ] Derivative Progress: 1718/2026 symbols completed. STRV took 0.9s. Estimated remaining: 1m 40s. Rate: 184.8 symbols/min [2025-09-16T21:21:09.546307] [DEBUG] [MAIN ] STNG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:09.546431] [INFO ] [MAIN ] STWD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:09.547526] [INFO ] [MAIN ] STNG: Generated 1339 derivative records from 32590 primary records. [2025-09-16T21:21:09.548064] [DEBUG] [LOCAL ] STNG: Saving derivative data. [2025-09-16T21:21:09.565289] [DEBUG] [LOCAL ] STNG: Derivative data saved (1339 records). [2025-09-16T21:21:09.574718] [INFO ] [MAIN ] STNG: Successfully saved derivative data. [2025-09-16T21:21:09.576967] [INFO ] [MAIN ] Derivative Progress: 1719/2026 symbols completed. STNG took 1.0s. Estimated remaining: 1m 40s. Rate: 184.9 symbols/min [2025-09-16T21:21:09.577441] [DEBUG] [MAIN ] STVN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:09.577821] [INFO ] [MAIN ] STXD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:09.578551] [INFO ] [MAIN ] STVN: Generated 1339 derivative records from 19497 primary records. [2025-09-16T21:21:09.579048] [DEBUG] [LOCAL ] STVN: Saving derivative data. [2025-09-16T21:21:09.594137] [DEBUG] [LOCAL ] STVN: Derivative data saved (1339 records). [2025-09-16T21:21:09.593622] [DEBUG] [LOCAL ] STXD: Loaded 811 existing records from primary storage. [2025-09-16T21:21:09.594453] [INFO ] [MAIN ] STXD: Loaded 811 primary data records. [2025-09-16T21:21:09.594383] [INFO ] [MAIN ] STVN: Successfully saved derivative data. [2025-09-16T21:21:09.605340] [INFO ] [MAIN ] Derivative Progress: 1720/2026 symbols completed. STVN took 0.9s. Estimated remaining: 1m 39s. Rate: 185.0 symbols/min [2025-09-16T21:21:09.605712] [INFO ] [MAIN ] STXE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:09.732444] [DEBUG] [LOCAL ] STWD: Loaded 38509 existing records from primary storage. [2025-09-16T21:21:09.734801] [DEBUG] [LOCAL ] STXE: Loaded 1425 existing records from primary storage. [2025-09-16T21:21:09.735023] [INFO ] [MAIN ] STXE: Loaded 1425 primary data records. [2025-09-16T21:21:09.735142] [INFO ] [MAIN ] STWD: Loaded 38509 primary data records. [2025-09-16T21:21:10.476162] [DEBUG] [MAIN ] STXD: Filtered 5181 bins outside market hours, 5780 incomplete bins [2025-09-16T21:21:10.477163] [INFO ] [MAIN ] STXD: Generated 1338 derivative records from 811 primary records. [2025-09-16T21:21:10.479398] [DEBUG] [LOCAL ] STXD: Saving derivative data. [2025-09-16T21:21:10.498664] [DEBUG] [MAIN ] STWD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:10.501090] [INFO ] [MAIN ] STWD: Generated 1339 derivative records from 38509 primary records. [2025-09-16T21:21:10.501448] [DEBUG] [LOCAL ] STWD: Saving derivative data. [2025-09-16T21:21:10.503218] [DEBUG] [LOCAL ] STXD: Derivative data saved (1338 records). [2025-09-16T21:21:10.509414] [INFO ] [MAIN ] STXD: Successfully saved derivative data. [2025-09-16T21:21:10.520573] [INFO ] [MAIN ] Derivative Progress: 1721/2026 symbols completed. STXD took 0.9s. Estimated remaining: 1m 39s. Rate: 184.8 symbols/min [2025-09-16T21:21:10.521139] [DEBUG] [MAIN ] STXE: Filtered 5181 bins outside market hours, 5780 incomplete bins [2025-09-16T21:21:10.526593] [DEBUG] [LOCAL ] STWD: Derivative data saved (1339 records). [2025-09-16T21:21:10.526872] [INFO ] [MAIN ] STXG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:10.527823] [INFO ] [MAIN ] STXE: Generated 1338 derivative records from 1425 primary records. [2025-09-16T21:21:10.527053] [INFO ] [MAIN ] STWD: Successfully saved derivative data. [2025-09-16T21:21:10.527924] [DEBUG] [LOCAL ] STXE: Saving derivative data. [2025-09-16T21:21:10.531011] [INFO ] [MAIN ] Derivative Progress: 1722/2026 symbols completed. STWD took 1.0s. Estimated remaining: 1m 39s. Rate: 184.9 symbols/min [2025-09-16T21:21:10.531550] [INFO ] [MAIN ] STXK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:10.539929] [DEBUG] [LOCAL ] STXG: Loaded 1492 existing records from primary storage. [2025-09-16T21:21:10.540083] [INFO ] [MAIN ] STXG: Loaded 1492 primary data records. [2025-09-16T21:21:10.591045] [DEBUG] [LOCAL ] STXK: Loaded 959 existing records from primary storage. [2025-09-16T21:21:10.618410] [INFO ] [MAIN ] STXK: Loaded 959 primary data records. [2025-09-16T21:21:10.637547] [DEBUG] [LOCAL ] STXE: Derivative data saved (1338 records). [2025-09-16T21:21:10.656987] [INFO ] [MAIN ] STXE: Successfully saved derivative data. [2025-09-16T21:21:10.658846] [INFO ] [MAIN ] Derivative Progress: 1723/2026 symbols completed. STXE took 1.1s. Estimated remaining: 1m 38s. Rate: 185.0 symbols/min [2025-09-16T21:21:11.115951] [DEBUG] [MAIN ] STXG: Filtered 5181 bins outside market hours, 5780 incomplete bins [2025-09-16T21:21:11.116630] [INFO ] [MAIN ] STXG: Generated 1338 derivative records from 1492 primary records. [2025-09-16T21:21:11.116813] [DEBUG] [LOCAL ] STXG: Saving derivative data. [2025-09-16T21:21:11.126434] [DEBUG] [MAIN ] STXK: Filtered 5181 bins outside market hours, 5780 incomplete bins [2025-09-16T21:21:11.127118] [INFO ] [MAIN ] STXK: Generated 1338 derivative records from 959 primary records. [2025-09-16T21:21:11.134320] [DEBUG] [LOCAL ] STXK: Saving derivative data. [2025-09-16T21:21:11.136932] [DEBUG] [LOCAL ] STXG: Derivative data saved (1338 records). [2025-09-16T21:21:11.137131] [INFO ] [MAIN ] STXG: Successfully saved derivative data. [2025-09-16T21:21:11.138922] [INFO ] [MAIN ] Derivative Progress: 1724/2026 symbols completed. STXG took 0.6s. Estimated remaining: 1m 38s. Rate: 184.9 symbols/min [2025-09-16T21:21:11.147994] [DEBUG] [LOCAL ] STXK: Derivative data saved (1338 records). [2025-09-16T21:21:11.148053] [INFO ] [MAIN ] STXK: Successfully saved derivative data. [2025-09-16T21:21:11.149763] [INFO ] [MAIN ] Derivative Progress: 1725/2026 symbols completed. STXK took 0.6s. Estimated remaining: 1m 38s. Rate: 185.0 symbols/min [2025-09-16T21:21:11.150176] [INFO ] [MAIN ] STZ: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:11.150098] [INFO ] [MAIN ] STXV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:11.150663] [INFO ] [MAIN ] STXT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:11.153861] [DEBUG] [LOCAL ] STXV: Loaded 1101 existing records from primary storage. [2025-09-16T21:21:11.154546] [INFO ] [MAIN ] STXV: Loaded 1101 primary data records. [2025-09-16T21:21:11.188527] [DEBUG] [LOCAL ] STXT: Loaded 1919 existing records from primary storage. [2025-09-16T21:21:11.227254] [INFO ] [MAIN ] STXT: Loaded 1919 primary data records. [2025-09-16T21:21:11.709878] [DEBUG] [LOCAL ] STZ: Loaded 38935 existing records from primary storage. [2025-09-16T21:21:11.710983] [INFO ] [MAIN ] STZ: Loaded 38935 primary data records. [2025-09-16T21:21:11.991770] [DEBUG] [MAIN ] STXV: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:11.992588] [INFO ] [MAIN ] STXV: Generated 1339 derivative records from 1101 primary records. [2025-09-16T21:21:11.992790] [DEBUG] [LOCAL ] STXV: Saving derivative data. [2025-09-16T21:21:12.006719] [DEBUG] [LOCAL ] STXV: Derivative data saved (1339 records). [2025-09-16T21:21:12.007171] [INFO ] [MAIN ] STXV: Successfully saved derivative data. [2025-09-16T21:21:12.009207] [INFO ] [MAIN ] Derivative Progress: 1726/2026 symbols completed. STXV took 0.9s. Estimated remaining: 1m 37s. Rate: 184.9 symbols/min [2025-09-16T21:21:12.009460] [INFO ] [MAIN ] SU: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:12.020006] [DEBUG] [MAIN ] STXT: Filtered 5181 bins outside market hours, 5780 incomplete bins [2025-09-16T21:21:12.020824] [INFO ] [MAIN ] STXT: Generated 1338 derivative records from 1919 primary records. [2025-09-16T21:21:12.021245] [DEBUG] [LOCAL ] STXT: Saving derivative data. [2025-09-16T21:21:12.033384] [DEBUG] [LOCAL ] STXT: Derivative data saved (1338 records). [2025-09-16T21:21:12.033531] [INFO ] [MAIN ] STXT: Successfully saved derivative data. [2025-09-16T21:21:12.035293] [INFO ] [MAIN ] Derivative Progress: 1727/2026 symbols completed. STXT took 0.9s. Estimated remaining: 1m 37s. Rate: 185.0 symbols/min [2025-09-16T21:21:12.035661] [INFO ] [MAIN ] SUI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:12.049436] [DEBUG] [MAIN ] STZ: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:12.050161] [INFO ] [MAIN ] STZ: Generated 1339 derivative records from 38935 primary records. [2025-09-16T21:21:12.050249] [DEBUG] [LOCAL ] STZ: Saving derivative data. [2025-09-16T21:21:12.071718] [DEBUG] [LOCAL ] STZ: Derivative data saved (1339 records). [2025-09-16T21:21:12.071933] [INFO ] [MAIN ] STZ: Successfully saved derivative data. [2025-09-16T21:21:12.073914] [INFO ] [MAIN ] Derivative Progress: 1728/2026 symbols completed. STZ took 0.9s. Estimated remaining: 1m 37s. Rate: 185.1 symbols/min [2025-09-16T21:21:12.074260] [INFO ] [MAIN ] SUN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:12.096894] [DEBUG] [LOCAL ] SU: Loaded 39838 existing records from primary storage. [2025-09-16T21:21:12.097088] [INFO ] [MAIN ] SU: Loaded 39838 primary data records. [2025-09-16T21:21:12.219369] [DEBUG] [LOCAL ] SUI: Loaded 31654 existing records from primary storage. [2025-09-16T21:21:12.276003] [INFO ] [MAIN ] SUI: Loaded 31654 primary data records. [2025-09-16T21:21:12.300276] [DEBUG] [LOCAL ] SUN: Loaded 28477 existing records from primary storage. [2025-09-16T21:21:12.386370] [INFO ] [MAIN ] SUN: Loaded 28477 primary data records. [2025-09-16T21:21:12.970235] [DEBUG] [MAIN ] SU: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:12.971071] [INFO ] [MAIN ] SU: Generated 1339 derivative records from 39838 primary records. [2025-09-16T21:21:12.971741] [DEBUG] [LOCAL ] SU: Saving derivative data. [2025-09-16T21:21:12.984968] [DEBUG] [LOCAL ] SU: Derivative data saved (1339 records). [2025-09-16T21:21:12.985242] [INFO ] [MAIN ] SU: Successfully saved derivative data. [2025-09-16T21:21:12.986997] [INFO ] [MAIN ] Derivative Progress: 1729/2026 symbols completed. SU took 1.0s. Estimated remaining: 1m 36s. Rate: 184.9 symbols/min [2025-09-16T21:21:12.987510] [INFO ] [MAIN ] SUPV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:13.000322] [DEBUG] [MAIN ] SUI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:13.001089] [INFO ] [MAIN ] SUI: Generated 1339 derivative records from 31654 primary records. [2025-09-16T21:21:13.001800] [DEBUG] [LOCAL ] SUI: Saving derivative data. [2025-09-16T21:21:13.022980] [DEBUG] [MAIN ] SUN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:13.025087] [INFO ] [MAIN ] SUN: Generated 1339 derivative records from 28477 primary records. [2025-09-16T21:21:13.025855] [DEBUG] [LOCAL ] SUN: Saving derivative data. [2025-09-16T21:21:13.026953] [DEBUG] [LOCAL ] SUI: Derivative data saved (1339 records). [2025-09-16T21:21:13.027662] [INFO ] [MAIN ] SUI: Successfully saved derivative data. [2025-09-16T21:21:13.029590] [INFO ] [MAIN ] Derivative Progress: 1730/2026 symbols completed. SUI took 1.0s. Estimated remaining: 1m 36s. Rate: 185.0 symbols/min [2025-09-16T21:21:13.047155] [INFO ] [MAIN ] SUZ: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:13.050056] [DEBUG] [LOCAL ] SUN: Derivative data saved (1339 records). [2025-09-16T21:21:13.050468] [INFO ] [MAIN ] SUN: Successfully saved derivative data. [2025-09-16T21:21:13.052729] [INFO ] [MAIN ] Derivative Progress: 1731/2026 symbols completed. SUN took 1.0s. Estimated remaining: 1m 36s. Rate: 185.1 symbols/min [2025-09-16T21:21:13.053094] [INFO ] [MAIN ] SVV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:13.066602] [DEBUG] [LOCAL ] SUPV: Loaded 35144 existing records from primary storage. [2025-09-16T21:21:13.066795] [INFO ] [MAIN ] SUPV: Loaded 35144 primary data records. [2025-09-16T21:21:13.282737] [DEBUG] [LOCAL ] SVV: Loaded 28638 existing records from primary storage. [2025-09-16T21:21:13.363776] [INFO ] [MAIN ] SVV: Loaded 28638 primary data records. [2025-09-16T21:21:13.364912] [DEBUG] [LOCAL ] SUZ: Loaded 33932 existing records from primary storage. [2025-09-16T21:21:13.386104] [INFO ] [MAIN ] SUZ: Loaded 33932 primary data records. [2025-09-16T21:21:13.913902] [DEBUG] [MAIN ] SUPV: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:13.914901] [INFO ] [MAIN ] SUPV: Generated 1339 derivative records from 35144 primary records. [2025-09-16T21:21:13.915455] [DEBUG] [LOCAL ] SUPV: Saving derivative data. [2025-09-16T21:21:13.929425] [DEBUG] [LOCAL ] SUPV: Derivative data saved (1339 records). [2025-09-16T21:21:13.929692] [INFO ] [MAIN ] SUPV: Successfully saved derivative data. [2025-09-16T21:21:13.933470] [INFO ] [MAIN ] Derivative Progress: 1732/2026 symbols completed. SUPV took 0.9s. Estimated remaining: 1m 35s. Rate: 184.9 symbols/min [2025-09-16T21:21:13.935502] [INFO ] [MAIN ] SW: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:13.955773] [DEBUG] [MAIN ] SVV: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:13.956820] [INFO ] [MAIN ] SVV: Generated 1339 derivative records from 28638 primary records. [2025-09-16T21:21:13.957025] [DEBUG] [MAIN ] SUZ: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:13.957133] [DEBUG] [LOCAL ] SVV: Saving derivative data. [2025-09-16T21:21:13.958191] [INFO ] [MAIN ] SUZ: Generated 1339 derivative records from 33932 primary records. [2025-09-16T21:21:13.958464] [DEBUG] [LOCAL ] SUZ: Saving derivative data. [2025-09-16T21:21:13.975954] [DEBUG] [LOCAL ] SVV: Derivative data saved (1339 records). [2025-09-16T21:21:13.976105] [INFO ] [MAIN ] SVV: Successfully saved derivative data. [2025-09-16T21:21:13.978552] [INFO ] [MAIN ] Derivative Progress: 1733/2026 symbols completed. SVV took 0.9s. Estimated remaining: 1m 35s. Rate: 185.0 symbols/min [2025-09-16T21:21:13.980971] [INFO ] [MAIN ] SWK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:13.984066] [DEBUG] [LOCAL ] SUZ: Derivative data saved (1339 records). [2025-09-16T21:21:13.984148] [INFO ] [MAIN ] SUZ: Successfully saved derivative data. [2025-09-16T21:21:13.986086] [INFO ] [MAIN ] Derivative Progress: 1734/2026 symbols completed. SUZ took 0.9s. Estimated remaining: 1m 35s. Rate: 185.1 symbols/min [2025-09-16T21:21:13.986355] [INFO ] [MAIN ] SWX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:14.020536] [DEBUG] [LOCAL ] SW: Loaded 39567 existing records from primary storage. [2025-09-16T21:21:14.027585] [INFO ] [MAIN ] SW: Loaded 39567 primary data records. [2025-09-16T21:21:14.039239] [DEBUG] [LOCAL ] SWX: Loaded 23297 existing records from primary storage. [2025-09-16T21:21:14.082892] [INFO ] [MAIN ] SWX: Loaded 23297 primary data records. [2025-09-16T21:21:14.325845] [DEBUG] [LOCAL ] SWK: Loaded 39239 existing records from primary storage. [2025-09-16T21:21:14.330568] [INFO ] [MAIN ] SWK: Loaded 39239 primary data records. [2025-09-16T21:21:14.871878] [DEBUG] [MAIN ] SW: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:14.872859] [INFO ] [MAIN ] SW: Generated 1339 derivative records from 39567 primary records. [2025-09-16T21:21:14.875230] [DEBUG] [LOCAL ] SW: Saving derivative data. [2025-09-16T21:21:14.898223] [DEBUG] [LOCAL ] SW: Derivative data saved (1339 records). [2025-09-16T21:21:14.898424] [INFO ] [MAIN ] SW: Successfully saved derivative data. [2025-09-16T21:21:14.896336] [DEBUG] [MAIN ] SWX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:14.900976] [INFO ] [MAIN ] SWX: Generated 1339 derivative records from 23297 primary records. [2025-09-16T21:21:14.900204] [INFO ] [MAIN ] Derivative Progress: 1735/2026 symbols completed. SW took 1.0s. Estimated remaining: 1m 34s. Rate: 184.9 symbols/min [2025-09-16T21:21:14.901557] [INFO ] [MAIN ] SWZ: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:14.901678] [DEBUG] [LOCAL ] SWX: Saving derivative data. [2025-09-16T21:21:14.921031] [DEBUG] [LOCAL ] SWX: Derivative data saved (1339 records). [2025-09-16T21:21:14.920333] [DEBUG] [LOCAL ] SWZ: Loaded 4158 existing records from primary storage. [2025-09-16T21:21:14.927064] [INFO ] [MAIN ] SWX: Successfully saved derivative data. [2025-09-16T21:21:14.927127] [INFO ] [MAIN ] SWZ: Loaded 4158 primary data records. [2025-09-16T21:21:14.940179] [INFO ] [MAIN ] Derivative Progress: 1736/2026 symbols completed. SWX took 1.0s. Estimated remaining: 1m 34s. Rate: 185.0 symbols/min [2025-09-16T21:21:14.976358] [DEBUG] [MAIN ] SWK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:15.003008] [INFO ] [MAIN ] SWK: Generated 1339 derivative records from 39239 primary records. [2025-09-16T21:21:14.997273] [INFO ] [MAIN ] SXC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:15.020298] [DEBUG] [LOCAL ] SWK: Saving derivative data. [2025-09-16T21:21:15.251847] [DEBUG] [LOCAL ] SWK: Derivative data saved (1339 records). [2025-09-16T21:21:15.252012] [INFO ] [MAIN ] SWK: Successfully saved derivative data. [2025-09-16T21:21:15.254776] [INFO ] [MAIN ] Derivative Progress: 1737/2026 symbols completed. SWK took 1.3s. Estimated remaining: 1m 34s. Rate: 185.0 symbols/min [2025-09-16T21:21:15.255104] [INFO ] [MAIN ] SXI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:15.269096] [DEBUG] [LOCAL ] SXC: Loaded 30644 existing records from primary storage. [2025-09-16T21:21:15.271855] [INFO ] [MAIN ] SXC: Loaded 30644 primary data records. [2025-09-16T21:21:15.350105] [DEBUG] [LOCAL ] SXI: Loaded 8769 existing records from primary storage. [2025-09-16T21:21:15.368326] [INFO ] [MAIN ] SXI: Loaded 8769 primary data records. [2025-09-16T21:21:15.747480] [DEBUG] [MAIN ] SWZ: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:15.831148] [INFO ] [MAIN ] SWZ: Generated 1339 derivative records from 4158 primary records. [2025-09-16T21:21:15.832880] [DEBUG] [LOCAL ] SWZ: Saving derivative data. [2025-09-16T21:21:15.848281] [DEBUG] [LOCAL ] SWZ: Derivative data saved (1339 records). [2025-09-16T21:21:15.848972] [INFO ] [MAIN ] SWZ: Successfully saved derivative data. [2025-09-16T21:21:15.851831] [INFO ] [MAIN ] Derivative Progress: 1738/2026 symbols completed. SWZ took 1.0s. Estimated remaining: 1m 33s. Rate: 184.9 symbols/min [2025-09-16T21:21:15.869536] [DEBUG] [MAIN ] SXC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:15.878879] [DEBUG] [MAIN ] SXI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:15.879436] [INFO ] [MAIN ] SXC: Generated 1339 derivative records from 30644 primary records. [2025-09-16T21:21:15.879971] [INFO ] [MAIN ] SXI: Generated 1339 derivative records from 8769 primary records. [2025-09-16T21:21:15.880045] [DEBUG] [LOCAL ] SXC: Saving derivative data. [2025-09-16T21:21:15.880130] [DEBUG] [LOCAL ] SXI: Saving derivative data. [2025-09-16T21:21:15.902371] [DEBUG] [LOCAL ] SXI: Derivative data saved (1339 records). [2025-09-16T21:21:15.903046] [INFO ] [MAIN ] SXI: Successfully saved derivative data. [2025-09-16T21:21:15.902972] [DEBUG] [LOCAL ] SXC: Derivative data saved (1339 records). [2025-09-16T21:21:15.904982] [INFO ] [MAIN ] Derivative Progress: 1739/2026 symbols completed. SXI took 0.6s. Estimated remaining: 1m 33s. Rate: 185.0 symbols/min [2025-09-16T21:21:15.905058] [INFO ] [MAIN ] SXC: Successfully saved derivative data. [2025-09-16T21:21:15.907030] [INFO ] [MAIN ] Derivative Progress: 1740/2026 symbols completed. SXC took 0.9s. Estimated remaining: 1m 33s. Rate: 185.1 symbols/min [2025-09-16T21:21:15.907545] [INFO ] [MAIN ] TAC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:15.907493] [INFO ] [MAIN ] SXT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:15.907670] [INFO ] [MAIN ] TAK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:15.958790] [DEBUG] [LOCAL ] SXT: Loaded 21998 existing records from primary storage. [2025-09-16T21:21:15.959035] [INFO ] [MAIN ] SXT: Loaded 21998 primary data records. [2025-09-16T21:21:15.959551] [DEBUG] [LOCAL ] TAC: Loaded 31268 existing records from primary storage. [2025-09-16T21:21:15.971964] [INFO ] [MAIN ] TAC: Loaded 31268 primary data records. [2025-09-16T21:21:16.153935] [DEBUG] [LOCAL ] TAK: Loaded 37579 existing records from primary storage. [2025-09-16T21:21:16.173435] [INFO ] [MAIN ] TAK: Loaded 37579 primary data records. [2025-09-16T21:21:16.791449] [DEBUG] [MAIN ] SXT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:16.792811] [INFO ] [MAIN ] SXT: Generated 1339 derivative records from 21998 primary records. [2025-09-16T21:21:16.793764] [DEBUG] [LOCAL ] SXT: Saving derivative data. [2025-09-16T21:21:16.827244] [DEBUG] [LOCAL ] SXT: Derivative data saved (1339 records). [2025-09-16T21:21:16.827455] [INFO ] [MAIN ] SXT: Successfully saved derivative data. [2025-09-16T21:21:16.829193] [INFO ] [MAIN ] Derivative Progress: 1741/2026 symbols completed. SXT took 0.9s. Estimated remaining: 1m 32s. Rate: 184.9 symbols/min [2025-09-16T21:21:16.829496] [DEBUG] [MAIN ] TAC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:16.829969] [INFO ] [MAIN ] TAL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:16.829879] [DEBUG] [MAIN ] TAK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:16.830686] [INFO ] [MAIN ] TAC: Generated 1339 derivative records from 31268 primary records. [2025-09-16T21:21:16.831813] [DEBUG] [LOCAL ] TAC: Saving derivative data. [2025-09-16T21:21:16.831709] [INFO ] [MAIN ] TAK: Generated 1339 derivative records from 37579 primary records. [2025-09-16T21:21:16.832600] [DEBUG] [LOCAL ] TAK: Saving derivative data. [2025-09-16T21:21:16.854520] [DEBUG] [LOCAL ] TAK: Derivative data saved (1339 records). [2025-09-16T21:21:16.855331] [INFO ] [MAIN ] TAK: Successfully saved derivative data. [2025-09-16T21:21:16.858245] [INFO ] [MAIN ] Derivative Progress: 1742/2026 symbols completed. TAK took 1.0s. Estimated remaining: 1m 32s. Rate: 185.0 symbols/min [2025-09-16T21:21:16.859137] [INFO ] [MAIN ] TALO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:16.859434] [DEBUG] [LOCAL ] TAC: Derivative data saved (1339 records). [2025-09-16T21:21:16.860408] [INFO ] [MAIN ] TAC: Successfully saved derivative data. [2025-09-16T21:21:16.863072] [INFO ] [MAIN ] Derivative Progress: 1743/2026 symbols completed. TAC took 1.0s. Estimated remaining: 1m 32s. Rate: 185.1 symbols/min [2025-09-16T21:21:16.864341] [INFO ] [MAIN ] TAP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:16.893710] [DEBUG] [LOCAL ] TAL: Loaded 38618 existing records from primary storage. [2025-09-16T21:21:16.893861] [INFO ] [MAIN ] TAL: Loaded 38618 primary data records. [2025-09-16T21:21:17.053407] [DEBUG] [LOCAL ] TALO: Loaded 37968 existing records from primary storage. [2025-09-16T21:21:17.097833] [INFO ] [MAIN ] TALO: Loaded 37968 primary data records. [2025-09-16T21:21:17.259871] [DEBUG] [LOCAL ] TAP: Loaded 39488 existing records from primary storage. [2025-09-16T21:21:17.272173] [INFO ] [MAIN ] TAP: Loaded 39488 primary data records. [2025-09-16T21:21:17.793363] [DEBUG] [MAIN ] TAL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:17.795455] [INFO ] [MAIN ] TAL: Generated 1339 derivative records from 38618 primary records. [2025-09-16T21:21:17.796005] [DEBUG] [LOCAL ] TAL: Saving derivative data. [2025-09-16T21:21:17.811234] [DEBUG] [LOCAL ] TAL: Derivative data saved (1339 records). [2025-09-16T21:21:17.813499] [INFO ] [MAIN ] TAL: Successfully saved derivative data. [2025-09-16T21:21:17.817013] [INFO ] [MAIN ] Derivative Progress: 1744/2026 symbols completed. TAL took 1.0s. Estimated remaining: 1m 32s. Rate: 184.9 symbols/min [2025-09-16T21:21:17.817548] [INFO ] [MAIN ] TBB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:17.828136] [DEBUG] [MAIN ] TALO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:17.829239] [INFO ] [MAIN ] TALO: Generated 1339 derivative records from 37968 primary records. [2025-09-16T21:21:17.830249] [DEBUG] [LOCAL ] TALO: Saving derivative data. [2025-09-16T21:21:17.852717] [DEBUG] [LOCAL ] TALO: Derivative data saved (1339 records). [2025-09-16T21:21:17.856505] [INFO ] [MAIN ] TALO: Successfully saved derivative data. [2025-09-16T21:21:17.856910] [DEBUG] [MAIN ] TAP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:17.859056] [INFO ] [MAIN ] Derivative Progress: 1745/2026 symbols completed. TALO took 1.0s. Estimated remaining: 1m 31s. Rate: 185.0 symbols/min [2025-09-16T21:21:17.863144] [INFO ] [MAIN ] TBBB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:17.863815] [INFO ] [MAIN ] TAP: Generated 1339 derivative records from 39488 primary records. [2025-09-16T21:21:17.864048] [DEBUG] [LOCAL ] TAP: Saving derivative data. [2025-09-16T21:21:17.865366] [DEBUG] [LOCAL ] TBB: Loaded 8677 existing records from primary storage. [2025-09-16T21:21:17.865710] [INFO ] [MAIN ] TBB: Loaded 8677 primary data records. [2025-09-16T21:21:18.002754] [DEBUG] [LOCAL ] TAP: Derivative data saved (1339 records). [2025-09-16T21:21:18.011132] [INFO ] [MAIN ] TAP: Successfully saved derivative data. [2025-09-16T21:21:18.013787] [INFO ] [MAIN ] Derivative Progress: 1746/2026 symbols completed. TAP took 1.1s. Estimated remaining: 1m 31s. Rate: 185.0 symbols/min [2025-09-16T21:21:18.029917] [DEBUG] [LOCAL ] TBBB: Loaded 26199 existing records from primary storage. [2025-09-16T21:21:18.040523] [INFO ] [MAIN ] TBI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:18.062662] [INFO ] [MAIN ] TBBB: Loaded 26199 primary data records. [2025-09-16T21:21:18.345820] [DEBUG] [LOCAL ] TBI: Loaded 16333 existing records from primary storage. [2025-09-16T21:21:18.370629] [INFO ] [MAIN ] TBI: Loaded 16333 primary data records. [2025-09-16T21:21:18.739606] [DEBUG] [MAIN ] TBB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:18.740572] [INFO ] [MAIN ] TBB: Generated 1339 derivative records from 8677 primary records. [2025-09-16T21:21:18.741172] [DEBUG] [LOCAL ] TBB: Saving derivative data. [2025-09-16T21:21:18.755474] [DEBUG] [LOCAL ] TBB: Derivative data saved (1339 records). [2025-09-16T21:21:18.755737] [INFO ] [MAIN ] TBB: Successfully saved derivative data. [2025-09-16T21:21:18.757308] [INFO ] [MAIN ] Derivative Progress: 1747/2026 symbols completed. TBB took 0.9s. Estimated remaining: 1m 31s. Rate: 184.9 symbols/min [2025-09-16T21:21:18.757957] [INFO ] [MAIN ] TBN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:18.770039] [DEBUG] [LOCAL ] TBN: Loaded 2191 existing records from primary storage. [2025-09-16T21:21:18.773993] [INFO ] [MAIN ] TBN: Loaded 2191 primary data records. [2025-09-16T21:21:18.785459] [DEBUG] [MAIN ] TBBB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:18.786383] [INFO ] [MAIN ] TBBB: Generated 1339 derivative records from 26199 primary records. [2025-09-16T21:21:18.795822] [DEBUG] [LOCAL ] TBBB: Saving derivative data. [2025-09-16T21:21:18.874923] [DEBUG] [LOCAL ] TBBB: Derivative data saved (1339 records). [2025-09-16T21:21:18.888396] [INFO ] [MAIN ] TBBB: Successfully saved derivative data. [2025-09-16T21:21:18.894181] [INFO ] [MAIN ] Derivative Progress: 1748/2026 symbols completed. TBBB took 1.0s. Estimated remaining: 1m 30s. Rate: 184.9 symbols/min [2025-09-16T21:21:18.905350] [INFO ] [MAIN ] TD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:19.072682] [DEBUG] [MAIN ] TBI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:19.073809] [INFO ] [MAIN ] TBI: Generated 1339 derivative records from 16333 primary records. [2025-09-16T21:21:19.074255] [DEBUG] [LOCAL ] TBI: Saving derivative data. [2025-09-16T21:21:19.087634] [DEBUG] [LOCAL ] TBI: Derivative data saved (1339 records). [2025-09-16T21:21:19.087820] [INFO ] [MAIN ] TBI: Successfully saved derivative data. [2025-09-16T21:21:19.089887] [INFO ] [MAIN ] Derivative Progress: 1749/2026 symbols completed. TBI took 1.1s. Estimated remaining: 1m 30s. Rate: 185.0 symbols/min [2025-09-16T21:21:19.090213] [INFO ] [MAIN ] TDC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:19.127684] [DEBUG] [LOCAL ] TD: Loaded 38888 existing records from primary storage. [2025-09-16T21:21:19.127962] [DEBUG] [MAIN ] TBN: Filtered 5181 bins outside market hours, 5780 incomplete bins [2025-09-16T21:21:19.128678] [INFO ] [MAIN ] TBN: Generated 1338 derivative records from 2191 primary records. [2025-09-16T21:21:19.128823] [INFO ] [MAIN ] TD: Loaded 38888 primary data records. [2025-09-16T21:21:19.128867] [DEBUG] [LOCAL ] TBN: Saving derivative data. [2025-09-16T21:21:19.264172] [DEBUG] [LOCAL ] TBN: Derivative data saved (1338 records). [2025-09-16T21:21:19.284799] [INFO ] [MAIN ] TBN: Successfully saved derivative data. [2025-09-16T21:21:19.301994] [INFO ] [MAIN ] Derivative Progress: 1750/2026 symbols completed. TBN took 0.5s. Estimated remaining: 1m 30s. Rate: 185.0 symbols/min [2025-09-16T21:21:19.319628] [DEBUG] [LOCAL ] TDC: Loaded 34252 existing records from primary storage. [2025-09-16T21:21:19.334534] [INFO ] [MAIN ] TDF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:19.334796] [INFO ] [MAIN ] TDC: Loaded 34252 primary data records. [2025-09-16T21:21:19.560739] [DEBUG] [LOCAL ] TDF: Loaded 4186 existing records from primary storage. [2025-09-16T21:21:19.577539] [INFO ] [MAIN ] TDF: Loaded 4186 primary data records. [2025-09-16T21:21:20.050487] [DEBUG] [MAIN ] TD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:20.051412] [INFO ] [MAIN ] TD: Generated 1339 derivative records from 38888 primary records. [2025-09-16T21:21:20.051766] [DEBUG] [LOCAL ] TD: Saving derivative data. [2025-09-16T21:21:20.067085] [DEBUG] [LOCAL ] TD: Derivative data saved (1339 records). [2025-09-16T21:21:20.067407] [INFO ] [MAIN ] TD: Successfully saved derivative data. [2025-09-16T21:21:20.069143] [INFO ] [MAIN ] Derivative Progress: 1751/2026 symbols completed. TD took 1.2s. Estimated remaining: 1m 29s. Rate: 184.9 symbols/min [2025-09-16T21:21:20.069457] [INFO ] [MAIN ] TDG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:20.080604] [DEBUG] [MAIN ] TDC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:20.081789] [INFO ] [MAIN ] TDC: Generated 1339 derivative records from 34252 primary records. [2025-09-16T21:21:20.081885] [DEBUG] [LOCAL ] TDC: Saving derivative data. [2025-09-16T21:21:20.097884] [DEBUG] [LOCAL ] TDC: Derivative data saved (1339 records). [2025-09-16T21:21:20.098151] [INFO ] [MAIN ] TDC: Successfully saved derivative data. [2025-09-16T21:21:20.105851] [INFO ] [MAIN ] Derivative Progress: 1752/2026 symbols completed. TDC took 1.0s. Estimated remaining: 1m 29s. Rate: 185.0 symbols/min [2025-09-16T21:21:20.113782] [INFO ] [MAIN ] TDOC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:20.114314] [DEBUG] [MAIN ] TDF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:20.115313] [INFO ] [MAIN ] TDF: Generated 1339 derivative records from 4186 primary records. [2025-09-16T21:21:20.115569] [DEBUG] [LOCAL ] TDF: Saving derivative data. [2025-09-16T21:21:20.122493] [DEBUG] [LOCAL ] TDG: Loaded 16109 existing records from primary storage. [2025-09-16T21:21:20.130407] [INFO ] [MAIN ] TDG: Loaded 16109 primary data records. [2025-09-16T21:21:20.132939] [DEBUG] [LOCAL ] TDF: Derivative data saved (1339 records). [2025-09-16T21:21:20.133179] [INFO ] [MAIN ] TDF: Successfully saved derivative data. [2025-09-16T21:21:20.166717] [INFO ] [MAIN ] Derivative Progress: 1753/2026 symbols completed. TDF took 0.8s. Estimated remaining: 1m 29s. Rate: 185.1 symbols/min [2025-09-16T21:21:20.422239] [DEBUG] [LOCAL ] TDOC: Loaded 39754 existing records from primary storage. [2025-09-16T21:21:20.422423] [INFO ] [MAIN ] TDOC: Loaded 39754 primary data records. [2025-09-16T21:21:20.709219] [DEBUG] [MAIN ] TDG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:20.710510] [INFO ] [MAIN ] TDG: Generated 1339 derivative records from 16109 primary records. [2025-09-16T21:21:20.710760] [DEBUG] [LOCAL ] TDG: Saving derivative data. [2025-09-16T21:21:20.724331] [DEBUG] [LOCAL ] TDG: Derivative data saved (1339 records). [2025-09-16T21:21:20.724693] [INFO ] [MAIN ] TDG: Successfully saved derivative data. [2025-09-16T21:21:20.726405] [INFO ] [MAIN ] Derivative Progress: 1754/2026 symbols completed. TDG took 0.7s. Estimated remaining: 1m 28s. Rate: 185.0 symbols/min [2025-09-16T21:21:20.739989] [DEBUG] [MAIN ] TDOC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:20.740626] [INFO ] [MAIN ] TDOC: Generated 1339 derivative records from 39754 primary records. [2025-09-16T21:21:20.740705] [DEBUG] [LOCAL ] TDOC: Saving derivative data. [2025-09-16T21:21:20.752470] [DEBUG] [LOCAL ] TDOC: Derivative data saved (1339 records). [2025-09-16T21:21:20.752540] [INFO ] [MAIN ] TDOC: Successfully saved derivative data. [2025-09-16T21:21:20.754350] [INFO ] [MAIN ] Derivative Progress: 1755/2026 symbols completed. TDOC took 0.6s. Estimated remaining: 1m 28s. Rate: 185.1 symbols/min [2025-09-16T21:21:20.755061] [INFO ] [MAIN ] TDW: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:20.755374] [INFO ] [MAIN ] TDY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:20.755226] [INFO ] [MAIN ] TDS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:20.783971] [DEBUG] [LOCAL ] TDY: Loaded 16790 existing records from primary storage. [2025-09-16T21:21:20.792333] [INFO ] [MAIN ] TDY: Loaded 16790 primary data records. [2025-09-16T21:21:20.919263] [DEBUG] [LOCAL ] TDS: Loaded 31745 existing records from primary storage. [2025-09-16T21:21:20.918718] [DEBUG] [LOCAL ] TDW: Loaded 33219 existing records from primary storage. [2025-09-16T21:21:20.929863] [INFO ] [MAIN ] TDW: Loaded 33219 primary data records. [2025-09-16T21:21:20.940181] [INFO ] [MAIN ] TDS: Loaded 31745 primary data records. [2025-09-16T21:21:21.664990] [DEBUG] [MAIN ] TDY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:21.665985] [INFO ] [MAIN ] TDY: Generated 1339 derivative records from 16790 primary records. [2025-09-16T21:21:21.666291] [DEBUG] [LOCAL ] TDY: Saving derivative data. [2025-09-16T21:21:21.690221] [DEBUG] [LOCAL ] TDY: Derivative data saved (1339 records). [2025-09-16T21:21:21.690707] [DEBUG] [MAIN ] TDW: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:21.691322] [INFO ] [MAIN ] TDW: Generated 1339 derivative records from 33219 primary records. [2025-09-16T21:21:21.691403] [INFO ] [MAIN ] TDY: Successfully saved derivative data. [2025-09-16T21:21:21.693203] [INFO ] [MAIN ] Derivative Progress: 1756/2026 symbols completed. TDY took 0.9s. Estimated remaining: 1m 28s. Rate: 184.9 symbols/min [2025-09-16T21:21:21.691555] [DEBUG] [LOCAL ] TDW: Saving derivative data. [2025-09-16T21:21:21.694158] [INFO ] [MAIN ] TEAF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:21.718417] [DEBUG] [MAIN ] TDS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:21.719438] [DEBUG] [LOCAL ] TDW: Derivative data saved (1339 records). [2025-09-16T21:21:21.719523] [INFO ] [MAIN ] TDW: Successfully saved derivative data. [2025-09-16T21:21:21.721454] [INFO ] [MAIN ] Derivative Progress: 1757/2026 symbols completed. TDW took 1.0s. Estimated remaining: 1m 27s. Rate: 185.0 symbols/min [2025-09-16T21:21:21.722291] [INFO ] [MAIN ] TDS: Generated 1339 derivative records from 31745 primary records. [2025-09-16T21:21:21.722417] [INFO ] [MAIN ] TECK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:21.722465] [DEBUG] [LOCAL ] TDS: Saving derivative data. [2025-09-16T21:21:21.725580] [DEBUG] [LOCAL ] TEAF: Loaded 5025 existing records from primary storage. [2025-09-16T21:21:21.726301] [INFO ] [MAIN ] TEAF: Loaded 5025 primary data records. [2025-09-16T21:21:21.863600] [DEBUG] [LOCAL ] TDS: Derivative data saved (1339 records). [2025-09-16T21:21:21.879350] [INFO ] [MAIN ] TDS: Successfully saved derivative data. [2025-09-16T21:21:21.920135] [INFO ] [MAIN ] Derivative Progress: 1758/2026 symbols completed. TDS took 1.2s. Estimated remaining: 1m 27s. Rate: 185.0 symbols/min [2025-09-16T21:21:21.938966] [INFO ] [MAIN ] TEF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:22.072028] [DEBUG] [LOCAL ] TECK: Loaded 39817 existing records from primary storage. [2025-09-16T21:21:22.073080] [INFO ] [MAIN ] TECK: Loaded 39817 primary data records. [2025-09-16T21:21:22.368681] [DEBUG] [LOCAL ] TEF: Loaded 26843 existing records from primary storage. [2025-09-16T21:21:22.369588] [INFO ] [MAIN ] TEF: Loaded 26843 primary data records. [2025-09-16T21:21:22.569220] [DEBUG] [MAIN ] TEAF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:22.646587] [INFO ] [MAIN ] TEAF: Generated 1339 derivative records from 5025 primary records. [2025-09-16T21:21:22.658126] [DEBUG] [LOCAL ] TEAF: Saving derivative data. [2025-09-16T21:21:22.672552] [DEBUG] [LOCAL ] TEAF: Derivative data saved (1339 records). [2025-09-16T21:21:22.672886] [INFO ] [MAIN ] TEAF: Successfully saved derivative data. [2025-09-16T21:21:22.674537] [INFO ] [MAIN ] Derivative Progress: 1759/2026 symbols completed. TEAF took 1.0s. Estimated remaining: 1m 27s. Rate: 184.9 symbols/min [2025-09-16T21:21:22.674760] [INFO ] [MAIN ] TEI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:22.689130] [DEBUG] [MAIN ] TECK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:22.689930] [INFO ] [MAIN ] TECK: Generated 1339 derivative records from 39817 primary records. [2025-09-16T21:21:22.690166] [DEBUG] [LOCAL ] TECK: Saving derivative data. [2025-09-16T21:21:22.707105] [DEBUG] [LOCAL ] TECK: Derivative data saved (1339 records). [2025-09-16T21:21:22.707373] [INFO ] [MAIN ] TECK: Successfully saved derivative data. [2025-09-16T21:21:22.709933] [INFO ] [MAIN ] Derivative Progress: 1760/2026 symbols completed. TECK took 1.0s. Estimated remaining: 1m 26s. Rate: 185.0 symbols/min [2025-09-16T21:21:22.710234] [INFO ] [MAIN ] TEN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:22.718975] [DEBUG] [LOCAL ] TEI: Loaded 15194 existing records from primary storage. [2025-09-16T21:21:22.719451] [INFO ] [MAIN ] TEI: Loaded 15194 primary data records. [2025-09-16T21:21:22.763412] [DEBUG] [MAIN ] TEF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:22.803431] [INFO ] [MAIN ] TEF: Generated 1339 derivative records from 26843 primary records. [2025-09-16T21:21:22.833340] [DEBUG] [LOCAL ] TEF: Saving derivative data. [2025-09-16T21:21:22.945150] [DEBUG] [LOCAL ] TEN: Loaded 22445 existing records from primary storage. [2025-09-16T21:21:23.031891] [INFO ] [MAIN ] TEN: Loaded 22445 primary data records. [2025-09-16T21:21:23.052153] [DEBUG] [LOCAL ] TEF: Derivative data saved (1339 records). [2025-09-16T21:21:23.078052] [INFO ] [MAIN ] TEF: Successfully saved derivative data. [2025-09-16T21:21:23.115299] [INFO ] [MAIN ] Derivative Progress: 1761/2026 symbols completed. TEF took 1.2s. Estimated remaining: 1m 26s. Rate: 184.9 symbols/min [2025-09-16T21:21:23.149753] [INFO ] [MAIN ] TEO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:23.323738] [DEBUG] [LOCAL ] TEO: Loaded 16345 existing records from primary storage. [2025-09-16T21:21:23.333628] [INFO ] [MAIN ] TEO: Loaded 16345 primary data records. [2025-09-16T21:21:23.365362] [DEBUG] [MAIN ] TEI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:23.428531] [INFO ] [MAIN ] TEI: Generated 1339 derivative records from 15194 primary records. [2025-09-16T21:21:23.439451] [DEBUG] [LOCAL ] TEI: Saving derivative data. [2025-09-16T21:21:23.611128] [DEBUG] [LOCAL ] TEI: Derivative data saved (1339 records). [2025-09-16T21:21:23.612303] [INFO ] [MAIN ] TEI: Successfully saved derivative data. [2025-09-16T21:21:23.614445] [INFO ] [MAIN ] Derivative Progress: 1762/2026 symbols completed. TEI took 0.9s. Estimated remaining: 1m 26s. Rate: 184.9 symbols/min [2025-09-16T21:21:23.617065] [INFO ] [MAIN ] TEVA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:23.629051] [DEBUG] [MAIN ] TEN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:23.629812] [INFO ] [MAIN ] TEN: Generated 1339 derivative records from 22445 primary records. [2025-09-16T21:21:23.629959] [DEBUG] [LOCAL ] TEN: Saving derivative data. [2025-09-16T21:21:23.644109] [DEBUG] [LOCAL ] TEN: Derivative data saved (1339 records). [2025-09-16T21:21:23.644271] [INFO ] [MAIN ] TEN: Successfully saved derivative data. [2025-09-16T21:21:23.646489] [INFO ] [MAIN ] Derivative Progress: 1763/2026 symbols completed. TEN took 0.9s. Estimated remaining: 1m 25s. Rate: 185.0 symbols/min [2025-09-16T21:21:23.646828] [INFO ] [MAIN ] TEX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:23.662480] [DEBUG] [MAIN ] TEO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:23.663214] [INFO ] [MAIN ] TEO: Generated 1339 derivative records from 16345 primary records. [2025-09-16T21:21:23.663298] [DEBUG] [LOCAL ] TEO: Saving derivative data. [2025-09-16T21:21:23.692437] [DEBUG] [LOCAL ] TEO: Derivative data saved (1339 records). [2025-09-16T21:21:23.692578] [INFO ] [MAIN ] TEO: Successfully saved derivative data. [2025-09-16T21:21:23.694669] [INFO ] [MAIN ] Derivative Progress: 1764/2026 symbols completed. TEO took 0.5s. Estimated remaining: 1m 25s. Rate: 185.1 symbols/min [2025-09-16T21:21:23.695028] [INFO ] [MAIN ] TFII: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:23.718858] [DEBUG] [LOCAL ] TEVA: Loaded 39987 existing records from primary storage. [2025-09-16T21:21:23.718987] [INFO ] [MAIN ] TEVA: Loaded 39987 primary data records. [2025-09-16T21:21:23.717918] [DEBUG] [LOCAL ] TEX: Loaded 32728 existing records from primary storage. [2025-09-16T21:21:23.719076] [INFO ] [MAIN ] TEX: Loaded 32728 primary data records. [2025-09-16T21:21:23.939281] [DEBUG] [LOCAL ] TFII: Loaded 23958 existing records from primary storage. [2025-09-16T21:21:23.948890] [INFO ] [MAIN ] TFII: Loaded 23958 primary data records. [2025-09-16T21:21:24.585760] [DEBUG] [MAIN ] TEVA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:24.588142] [INFO ] [MAIN ] TEVA: Generated 1339 derivative records from 39987 primary records. [2025-09-16T21:21:24.588532] [DEBUG] [LOCAL ] TEVA: Saving derivative data. [2025-09-16T21:21:24.598604] [DEBUG] [MAIN ] TEX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:24.599417] [INFO ] [MAIN ] TEX: Generated 1339 derivative records from 32728 primary records. [2025-09-16T21:21:24.609762] [DEBUG] [LOCAL ] TEX: Saving derivative data. [2025-09-16T21:21:24.611330] [DEBUG] [LOCAL ] TEVA: Derivative data saved (1339 records). [2025-09-16T21:21:24.619566] [INFO ] [MAIN ] TEVA: Successfully saved derivative data. [2025-09-16T21:21:24.624256] [INFO ] [MAIN ] Derivative Progress: 1765/2026 symbols completed. TEVA took 1.0s. Estimated remaining: 1m 25s. Rate: 184.9 symbols/min [2025-09-16T21:21:24.626096] [DEBUG] [LOCAL ] TEX: Derivative data saved (1339 records). [2025-09-16T21:21:24.625508] [INFO ] [MAIN ] TFIN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:24.626420] [INFO ] [MAIN ] TEX: Successfully saved derivative data. [2025-09-16T21:21:24.628817] [INFO ] [MAIN ] Derivative Progress: 1766/2026 symbols completed. TEX took 1.0s. Estimated remaining: 1m 24s. Rate: 185.0 symbols/min [2025-09-16T21:21:24.629205] [INFO ] [MAIN ] TFPM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:24.639297] [DEBUG] [MAIN ] TFII: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:24.639961] [INFO ] [MAIN ] TFII: Generated 1339 derivative records from 23958 primary records. [2025-09-16T21:21:24.640092] [DEBUG] [LOCAL ] TFII: Saving derivative data. [2025-09-16T21:21:24.656612] [DEBUG] [LOCAL ] TFII: Derivative data saved (1339 records). [2025-09-16T21:21:24.656900] [INFO ] [MAIN ] TFII: Successfully saved derivative data. [2025-09-16T21:21:24.658962] [INFO ] [MAIN ] Derivative Progress: 1767/2026 symbols completed. TFII took 1.0s. Estimated remaining: 1m 24s. Rate: 185.1 symbols/min [2025-09-16T21:21:24.659185] [INFO ] [MAIN ] TFX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:24.666736] [DEBUG] [LOCAL ] TFIN: Loaded 17170 existing records from primary storage. [2025-09-16T21:21:24.667012] [INFO ] [MAIN ] TFIN: Loaded 17170 primary data records. [2025-09-16T21:21:24.836066] [DEBUG] [LOCAL ] TFPM: Loaded 28849 existing records from primary storage. [2025-09-16T21:21:24.859561] [INFO ] [MAIN ] TFPM: Loaded 28849 primary data records. [2025-09-16T21:21:24.926985] [DEBUG] [LOCAL ] TFX: Loaded 26181 existing records from primary storage. [2025-09-16T21:21:24.940489] [INFO ] [MAIN ] TFX: Loaded 26181 primary data records. [2025-09-16T21:21:25.534903] [DEBUG] [MAIN ] TFIN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:25.535758] [INFO ] [MAIN ] TFIN: Generated 1339 derivative records from 17170 primary records. [2025-09-16T21:21:25.536244] [DEBUG] [LOCAL ] TFIN: Saving derivative data. [2025-09-16T21:21:25.552297] [DEBUG] [LOCAL ] TFIN: Derivative data saved (1339 records). [2025-09-16T21:21:25.552490] [INFO ] [MAIN ] TFIN: Successfully saved derivative data. [2025-09-16T21:21:25.564141] [INFO ] [MAIN ] Derivative Progress: 1768/2026 symbols completed. TFIN took 0.9s. Estimated remaining: 1m 24s. Rate: 184.9 symbols/min [2025-09-16T21:21:25.564500] [DEBUG] [MAIN ] TFPM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:25.565546] [INFO ] [MAIN ] TFPM: Generated 1339 derivative records from 28849 primary records. [2025-09-16T21:21:25.565631] [DEBUG] [LOCAL ] TFPM: Saving derivative data. [2025-09-16T21:21:25.580180] [DEBUG] [LOCAL ] TFPM: Derivative data saved (1339 records). [2025-09-16T21:21:25.580284] [INFO ] [MAIN ] TFPM: Successfully saved derivative data. [2025-09-16T21:21:25.582749] [INFO ] [MAIN ] Derivative Progress: 1769/2026 symbols completed. TFPM took 1.0s. Estimated remaining: 1m 23s. Rate: 185.0 symbols/min [2025-09-16T21:21:25.592313] [DEBUG] [MAIN ] TFX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:25.592901] [INFO ] [MAIN ] TFX: Generated 1339 derivative records from 26181 primary records. [2025-09-16T21:21:25.592985] [DEBUG] [LOCAL ] TFX: Saving derivative data. [2025-09-16T21:21:25.604836] [DEBUG] [LOCAL ] TFX: Derivative data saved (1339 records). [2025-09-16T21:21:25.604892] [INFO ] [MAIN ] TFX: Successfully saved derivative data. [2025-09-16T21:21:25.606948] [INFO ] [MAIN ] Derivative Progress: 1770/2026 symbols completed. TFX took 0.9s. Estimated remaining: 1m 23s. Rate: 185.1 symbols/min [2025-09-16T21:21:25.607366] [INFO ] [MAIN ] TG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:25.607559] [INFO ] [MAIN ] TGLS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:25.607595] [INFO ] [MAIN ] TGNA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:25.616555] [DEBUG] [LOCAL ] TG: Loaded 7400 existing records from primary storage. [2025-09-16T21:21:25.616764] [INFO ] [MAIN ] TG: Loaded 7400 primary data records. [2025-09-16T21:21:25.915878] [DEBUG] [LOCAL ] TGLS: Loaded 20263 existing records from primary storage. [2025-09-16T21:21:25.916688] [DEBUG] [LOCAL ] TGNA: Loaded 35921 existing records from primary storage. [2025-09-16T21:21:25.916788] [INFO ] [MAIN ] TGLS: Loaded 20263 primary data records. [2025-09-16T21:21:25.916967] [INFO ] [MAIN ] TGNA: Loaded 35921 primary data records. [2025-09-16T21:21:26.521155] [DEBUG] [MAIN ] TG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:26.522000] [INFO ] [MAIN ] TG: Generated 1339 derivative records from 7400 primary records. [2025-09-16T21:21:26.522438] [DEBUG] [LOCAL ] TG: Saving derivative data. [2025-09-16T21:21:26.535221] [DEBUG] [LOCAL ] TG: Derivative data saved (1339 records). [2025-09-16T21:21:26.535672] [INFO ] [MAIN ] TG: Successfully saved derivative data. [2025-09-16T21:21:26.537498] [INFO ] [MAIN ] Derivative Progress: 1771/2026 symbols completed. TG took 0.9s. Estimated remaining: 1m 23s. Rate: 184.9 symbols/min [2025-09-16T21:21:26.538121] [INFO ] [MAIN ] TGS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:26.553114] [DEBUG] [MAIN ] TGLS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:26.555262] [INFO ] [MAIN ] TGLS: Generated 1339 derivative records from 20263 primary records. [2025-09-16T21:21:26.555581] [DEBUG] [LOCAL ] TGLS: Saving derivative data. [2025-09-16T21:21:26.579917] [DEBUG] [MAIN ] TGNA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:26.583604] [DEBUG] [LOCAL ] TGLS: Derivative data saved (1339 records). [2025-09-16T21:21:26.580937] [INFO ] [MAIN ] TGNA: Generated 1339 derivative records from 35921 primary records. [2025-09-16T21:21:26.583855] [INFO ] [MAIN ] TGLS: Successfully saved derivative data. [2025-09-16T21:21:26.583790] [DEBUG] [LOCAL ] TGNA: Saving derivative data. [2025-09-16T21:21:26.586112] [INFO ] [MAIN ] Derivative Progress: 1772/2026 symbols completed. TGLS took 1.0s. Estimated remaining: 1m 22s. Rate: 185.0 symbols/min [2025-09-16T21:21:26.586794] [INFO ] [MAIN ] TGT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:26.605744] [DEBUG] [LOCAL ] TGS: Loaded 23951 existing records from primary storage. [2025-09-16T21:21:26.606403] [INFO ] [MAIN ] TGS: Loaded 23951 primary data records. [2025-09-16T21:21:26.678233] [DEBUG] [LOCAL ] TGNA: Derivative data saved (1339 records). [2025-09-16T21:21:26.709303] [INFO ] [MAIN ] TGNA: Successfully saved derivative data. [2025-09-16T21:21:26.714892] [INFO ] [MAIN ] Derivative Progress: 1773/2026 symbols completed. TGNA took 1.1s. Estimated remaining: 1m 22s. Rate: 185.0 symbols/min [2025-09-16T21:21:26.736387] [INFO ] [MAIN ] THC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:26.911693] [DEBUG] [LOCAL ] TGT: Loaded 40128 existing records from primary storage. [2025-09-16T21:21:26.912695] [INFO ] [MAIN ] TGT: Loaded 40128 primary data records. [2025-09-16T21:21:27.199972] [DEBUG] [LOCAL ] THC: Loaded 35826 existing records from primary storage. [2025-09-16T21:21:27.200509] [INFO ] [MAIN ] THC: Loaded 35826 primary data records. [2025-09-16T21:21:27.337252] [DEBUG] [MAIN ] TGS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:27.364319] [INFO ] [MAIN ] TGS: Generated 1339 derivative records from 23951 primary records. [2025-09-16T21:21:27.380436] [DEBUG] [LOCAL ] TGS: Saving derivative data. [2025-09-16T21:21:27.501368] [DEBUG] [LOCAL ] TGS: Derivative data saved (1339 records). [2025-09-16T21:21:27.502116] [INFO ] [MAIN ] TGS: Successfully saved derivative data. [2025-09-16T21:21:27.504358] [INFO ] [MAIN ] Derivative Progress: 1774/2026 symbols completed. TGS took 1.0s. Estimated remaining: 1m 22s. Rate: 184.9 symbols/min [2025-09-16T21:21:27.505290] [INFO ] [MAIN ] THG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:27.516452] [DEBUG] [MAIN ] TGT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:27.517191] [INFO ] [MAIN ] TGT: Generated 1339 derivative records from 40128 primary records. [2025-09-16T21:21:27.517296] [DEBUG] [LOCAL ] TGT: Saving derivative data. [2025-09-16T21:21:27.531326] [DEBUG] [LOCAL ] TGT: Derivative data saved (1339 records). [2025-09-16T21:21:27.531591] [INFO ] [MAIN ] TGT: Successfully saved derivative data. [2025-09-16T21:21:27.533559] [INFO ] [MAIN ] Derivative Progress: 1775/2026 symbols completed. TGT took 0.9s. Estimated remaining: 1m 21s. Rate: 185.0 symbols/min [2025-09-16T21:21:27.537623] [INFO ] [MAIN ] THIR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:27.541490] [DEBUG] [LOCAL ] THIR: Loaded 1806 existing records from primary storage. [2025-09-16T21:21:27.541724] [INFO ] [MAIN ] THIR: Loaded 1806 primary data records. [2025-09-16T21:21:27.648657] [DEBUG] [LOCAL ] THG: Loaded 15613 existing records from primary storage. [2025-09-16T21:21:27.661308] [INFO ] [MAIN ] THG: Loaded 15613 primary data records. [2025-09-16T21:21:27.677473] [DEBUG] [MAIN ] THC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:27.703024] [INFO ] [MAIN ] THC: Generated 1339 derivative records from 35826 primary records. [2025-09-16T21:21:27.768596] [DEBUG] [LOCAL ] THC: Saving derivative data. [2025-09-16T21:21:27.998987] [DEBUG] [LOCAL ] THC: Derivative data saved (1339 records). [2025-09-16T21:21:28.028098] [INFO ] [MAIN ] THC: Successfully saved derivative data. [2025-09-16T21:21:28.034421] [INFO ] [MAIN ] Derivative Progress: 1776/2026 symbols completed. THC took 1.3s. Estimated remaining: 1m 21s. Rate: 184.9 symbols/min [2025-09-16T21:21:28.034725] [INFO ] [MAIN ] THLV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:28.120820] [DEBUG] [LOCAL ] THLV: Loaded 1090 existing records from primary storage. [2025-09-16T21:21:28.121268] [INFO ] [MAIN ] THLV: Loaded 1090 primary data records. [2025-09-16T21:21:28.262494] [DEBUG] [MAIN ] THIR: Filtered 5181 bins outside market hours, 5780 incomplete bins [2025-09-16T21:21:28.304193] [INFO ] [MAIN ] THIR: Generated 1338 derivative records from 1806 primary records. [2025-09-16T21:21:28.326407] [DEBUG] [LOCAL ] THIR: Saving derivative data. [2025-09-16T21:21:28.420714] [DEBUG] [LOCAL ] THIR: Derivative data saved (1338 records). [2025-09-16T21:21:28.421572] [INFO ] [MAIN ] THIR: Successfully saved derivative data. [2025-09-16T21:21:28.423629] [INFO ] [MAIN ] Derivative Progress: 1777/2026 symbols completed. THIR took 0.9s. Estimated remaining: 1m 21s. Rate: 184.9 symbols/min [2025-09-16T21:21:28.425662] [INFO ] [MAIN ] THO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:28.439041] [DEBUG] [MAIN ] THG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:28.439978] [INFO ] [MAIN ] THG: Generated 1339 derivative records from 15613 primary records. [2025-09-16T21:21:28.440194] [DEBUG] [LOCAL ] THG: Saving derivative data. [2025-09-16T21:21:28.453168] [DEBUG] [LOCAL ] THG: Derivative data saved (1339 records). [2025-09-16T21:21:28.453322] [INFO ] [MAIN ] THG: Successfully saved derivative data. [2025-09-16T21:21:28.455796] [INFO ] [MAIN ] Derivative Progress: 1778/2026 symbols completed. THG took 1.0s. Estimated remaining: 1m 20s. Rate: 185.0 symbols/min [2025-09-16T21:21:28.456687] [INFO ] [MAIN ] THQ: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:28.468341] [DEBUG] [MAIN ] THLV: Filtered 5181 bins outside market hours, 5780 incomplete bins [2025-09-16T21:21:28.469079] [INFO ] [MAIN ] THLV: Generated 1338 derivative records from 1090 primary records. [2025-09-16T21:21:28.478175] [DEBUG] [LOCAL ] THLV: Saving derivative data. [2025-09-16T21:21:28.489708] [DEBUG] [LOCAL ] THLV: Derivative data saved (1338 records). [2025-09-16T21:21:28.489898] [INFO ] [MAIN ] THLV: Successfully saved derivative data. [2025-09-16T21:21:28.500049] [INFO ] [MAIN ] Derivative Progress: 1779/2026 symbols completed. THLV took 0.5s. Estimated remaining: 1m 20s. Rate: 185.1 symbols/min [2025-09-16T21:21:28.501311] [INFO ] [MAIN ] THR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:28.506352] [DEBUG] [LOCAL ] THO: Loaded 30596 existing records from primary storage. [2025-09-16T21:21:28.506607] [INFO ] [MAIN ] THO: Loaded 30596 primary data records. [2025-09-16T21:21:28.600464] [DEBUG] [LOCAL ] THQ: Loaded 19445 existing records from primary storage. [2025-09-16T21:21:28.622907] [INFO ] [MAIN ] THQ: Loaded 19445 primary data records. [2025-09-16T21:21:28.665730] [DEBUG] [LOCAL ] THR: Loaded 14544 existing records from primary storage. [2025-09-16T21:21:28.678329] [INFO ] [MAIN ] THR: Loaded 14544 primary data records. [2025-09-16T21:21:29.397987] [DEBUG] [MAIN ] THQ: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:29.393428] [DEBUG] [MAIN ] THO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:29.400082] [INFO ] [MAIN ] THQ: Generated 1339 derivative records from 19445 primary records. [2025-09-16T21:21:29.400593] [INFO ] [MAIN ] THO: Generated 1339 derivative records from 30596 primary records. [2025-09-16T21:21:29.400833] [DEBUG] [LOCAL ] THO: Saving derivative data. [2025-09-16T21:21:29.400980] [DEBUG] [LOCAL ] THQ: Saving derivative data. [2025-09-16T21:21:29.422529] [DEBUG] [MAIN ] THR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:29.433815] [INFO ] [MAIN ] THR: Generated 1339 derivative records from 14544 primary records. [2025-09-16T21:21:29.435752] [DEBUG] [LOCAL ] THR: Saving derivative data. [2025-09-16T21:21:29.438363] [DEBUG] [LOCAL ] THQ: Derivative data saved (1339 records). [2025-09-16T21:21:29.438421] [DEBUG] [LOCAL ] THO: Derivative data saved (1339 records). [2025-09-16T21:21:29.438754] [INFO ] [MAIN ] THQ: Successfully saved derivative data. [2025-09-16T21:21:29.438848] [INFO ] [MAIN ] THO: Successfully saved derivative data. [2025-09-16T21:21:29.441358] [INFO ] [MAIN ] Derivative Progress: 1780/2026 symbols completed. THQ took 1.0s. Estimated remaining: 1m 20s. Rate: 184.9 symbols/min [2025-09-16T21:21:29.453090] [INFO ] [MAIN ] THS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:29.453036] [INFO ] [MAIN ] Derivative Progress: 1781/2026 symbols completed. THO took 1.0s. Estimated remaining: 1m 19s. Rate: 185.0 symbols/min [2025-09-16T21:21:29.455158] [INFO ] [MAIN ] THW: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:29.458764] [DEBUG] [LOCAL ] THR: Derivative data saved (1339 records). [2025-09-16T21:21:29.458926] [INFO ] [MAIN ] THR: Successfully saved derivative data. [2025-09-16T21:21:29.461727] [INFO ] [MAIN ] Derivative Progress: 1782/2026 symbols completed. THR took 1.0s. Estimated remaining: 1m 19s. Rate: 185.1 symbols/min [2025-09-16T21:21:29.462194] [INFO ] [MAIN ] TIMB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:29.484831] [DEBUG] [LOCAL ] THW: Loaded 14902 existing records from primary storage. [2025-09-16T21:21:29.484977] [INFO ] [MAIN ] THW: Loaded 14902 primary data records. [2025-09-16T21:21:29.604772] [DEBUG] [LOCAL ] THS: Loaded 28416 existing records from primary storage. [2025-09-16T21:21:29.633250] [INFO ] [MAIN ] THS: Loaded 28416 primary data records. [2025-09-16T21:21:29.628107] [DEBUG] [LOCAL ] TIMB: Loaded 26686 existing records from primary storage. [2025-09-16T21:21:29.660450] [INFO ] [MAIN ] TIMB: Loaded 26686 primary data records. [2025-09-16T21:21:30.318844] [DEBUG] [MAIN ] THW: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:30.319951] [INFO ] [MAIN ] THW: Generated 1339 derivative records from 14902 primary records. [2025-09-16T21:21:30.320262] [DEBUG] [LOCAL ] THW: Saving derivative data. [2025-09-16T21:21:30.337526] [DEBUG] [LOCAL ] THW: Derivative data saved (1339 records). [2025-09-16T21:21:30.343622] [INFO ] [MAIN ] THW: Successfully saved derivative data. [2025-09-16T21:21:30.358425] [INFO ] [MAIN ] Derivative Progress: 1783/2026 symbols completed. THW took 0.9s. Estimated remaining: 1m 19s. Rate: 184.9 symbols/min [2025-09-16T21:21:30.356604] [DEBUG] [MAIN ] TIMB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:30.356814] [DEBUG] [MAIN ] THS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:30.359809] [INFO ] [MAIN ] THS: Generated 1339 derivative records from 28416 primary records. [2025-09-16T21:21:30.359277] [INFO ] [MAIN ] TIMB: Generated 1339 derivative records from 26686 primary records. [2025-09-16T21:21:30.359899] [DEBUG] [LOCAL ] THS: Saving derivative data. [2025-09-16T21:21:30.359949] [DEBUG] [LOCAL ] TIMB: Saving derivative data. [2025-09-16T21:21:30.382408] [DEBUG] [LOCAL ] THS: Derivative data saved (1339 records). [2025-09-16T21:21:30.383166] [INFO ] [MAIN ] THS: Successfully saved derivative data. [2025-09-16T21:21:30.386100] [INFO ] [MAIN ] Derivative Progress: 1784/2026 symbols completed. THS took 0.9s. Estimated remaining: 1m 18s. Rate: 185.0 symbols/min [2025-09-16T21:21:30.386866] [DEBUG] [LOCAL ] TIMB: Derivative data saved (1339 records). [2025-09-16T21:21:30.386929] [INFO ] [MAIN ] TIMB: Successfully saved derivative data. [2025-09-16T21:21:30.388938] [INFO ] [MAIN ] Derivative Progress: 1785/2026 symbols completed. TIMB took 0.9s. Estimated remaining: 1m 18s. Rate: 185.1 symbols/min [2025-09-16T21:21:30.389361] [INFO ] [MAIN ] TISI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:30.389491] [INFO ] [MAIN ] TK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:30.389557] [INFO ] [MAIN ] TIXT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:30.394169] [DEBUG] [LOCAL ] TISI: Loaded 2147 existing records from primary storage. [2025-09-16T21:21:30.394278] [INFO ] [MAIN ] TISI: Loaded 2147 primary data records. [2025-09-16T21:21:30.594236] [DEBUG] [LOCAL ] TIXT: Loaded 24290 existing records from primary storage. [2025-09-16T21:21:30.605078] [INFO ] [MAIN ] TIXT: Loaded 24290 primary data records. [2025-09-16T21:21:30.721250] [DEBUG] [LOCAL ] TK: Loaded 29721 existing records from primary storage. [2025-09-16T21:21:30.755047] [INFO ] [MAIN ] TK: Loaded 29721 primary data records. [2025-09-16T21:21:31.286077] [DEBUG] [MAIN ] TISI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:31.288701] [INFO ] [MAIN ] TISI: Generated 1339 derivative records from 2147 primary records. [2025-09-16T21:21:31.289511] [DEBUG] [LOCAL ] TISI: Saving derivative data. [2025-09-16T21:21:31.310448] [DEBUG] [MAIN ] TIXT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:31.314703] [INFO ] [MAIN ] TIXT: Generated 1339 derivative records from 24290 primary records. [2025-09-16T21:21:31.315534] [DEBUG] [LOCAL ] TIXT: Saving derivative data. [2025-09-16T21:21:31.316258] [DEBUG] [LOCAL ] TISI: Derivative data saved (1339 records). [2025-09-16T21:21:31.316576] [INFO ] [MAIN ] TISI: Successfully saved derivative data. [2025-09-16T21:21:31.328929] [INFO ] [MAIN ] Derivative Progress: 1786/2026 symbols completed. TISI took 0.9s. Estimated remaining: 1m 18s. Rate: 184.9 symbols/min [2025-09-16T21:21:31.335723] [INFO ] [MAIN ] TKC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:31.342343] [DEBUG] [LOCAL ] TIXT: Derivative data saved (1339 records). [2025-09-16T21:21:31.342609] [DEBUG] [MAIN ] TK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:31.342812] [INFO ] [MAIN ] TIXT: Successfully saved derivative data. [2025-09-16T21:21:31.345045] [INFO ] [MAIN ] Derivative Progress: 1787/2026 symbols completed. TIXT took 1.0s. Estimated remaining: 1m 18s. Rate: 185.0 symbols/min [2025-09-16T21:21:31.346155] [INFO ] [MAIN ] TK: Generated 1339 derivative records from 29721 primary records. [2025-09-16T21:21:31.346288] [DEBUG] [LOCAL ] TK: Saving derivative data. [2025-09-16T21:21:31.346905] [INFO ] [MAIN ] TKR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:31.359905] [DEBUG] [LOCAL ] TK: Derivative data saved (1339 records). [2025-09-16T21:21:31.359983] [INFO ] [MAIN ] TK: Successfully saved derivative data. [2025-09-16T21:21:31.362144] [INFO ] [MAIN ] Derivative Progress: 1788/2026 symbols completed. TK took 1.0s. Estimated remaining: 1m 17s. Rate: 185.1 symbols/min [2025-09-16T21:21:31.362439] [INFO ] [MAIN ] TLK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:31.391940] [DEBUG] [LOCAL ] TKC: Loaded 28470 existing records from primary storage. [2025-09-16T21:21:31.392166] [INFO ] [MAIN ] TKC: Loaded 28470 primary data records. [2025-09-16T21:21:31.465857] [DEBUG] [LOCAL ] TKR: Loaded 28992 existing records from primary storage. [2025-09-16T21:21:31.487315] [INFO ] [MAIN ] TKR: Loaded 28992 primary data records. [2025-09-16T21:21:31.556992] [DEBUG] [LOCAL ] TLK: Loaded 28852 existing records from primary storage. [2025-09-16T21:21:31.595208] [INFO ] [MAIN ] TLK: Loaded 28852 primary data records. [2025-09-16T21:21:32.276043] [DEBUG] [MAIN ] TKC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:32.276947] [INFO ] [MAIN ] TKC: Generated 1339 derivative records from 28470 primary records. [2025-09-16T21:21:32.277273] [DEBUG] [LOCAL ] TKC: Saving derivative data. [2025-09-16T21:21:32.301919] [DEBUG] [MAIN ] TKR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:32.305725] [INFO ] [MAIN ] TKR: Generated 1339 derivative records from 28992 primary records. [2025-09-16T21:21:32.305824] [DEBUG] [LOCAL ] TKR: Saving derivative data. [2025-09-16T21:21:32.304554] [DEBUG] [LOCAL ] TKC: Derivative data saved (1339 records). [2025-09-16T21:21:32.306604] [INFO ] [MAIN ] TKC: Successfully saved derivative data. [2025-09-16T21:21:32.308672] [INFO ] [MAIN ] Derivative Progress: 1789/2026 symbols completed. TKC took 1.0s. Estimated remaining: 1m 17s. Rate: 184.9 symbols/min [2025-09-16T21:21:32.314486] [INFO ] [MAIN ] TLYS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:32.330244] [DEBUG] [MAIN ] TLK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:32.332778] [INFO ] [MAIN ] TLK: Generated 1339 derivative records from 28852 primary records. [2025-09-16T21:21:32.333293] [DEBUG] [LOCAL ] TKR: Derivative data saved (1339 records). [2025-09-16T21:21:32.333372] [DEBUG] [LOCAL ] TLK: Saving derivative data. [2025-09-16T21:21:32.333527] [INFO ] [MAIN ] TKR: Successfully saved derivative data. [2025-09-16T21:21:32.335771] [INFO ] [MAIN ] Derivative Progress: 1790/2026 symbols completed. TKR took 1.0s. Estimated remaining: 1m 17s. Rate: 185.0 symbols/min [2025-09-16T21:21:32.337190] [INFO ] [MAIN ] TM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:32.359572] [DEBUG] [LOCAL ] TLYS: Loaded 14099 existing records from primary storage. [2025-09-16T21:21:32.359956] [INFO ] [MAIN ] TLYS: Loaded 14099 primary data records. [2025-09-16T21:21:32.360300] [DEBUG] [LOCAL ] TLK: Derivative data saved (1339 records). [2025-09-16T21:21:32.371997] [INFO ] [MAIN ] TLK: Successfully saved derivative data. [2025-09-16T21:21:32.446335] [INFO ] [MAIN ] Derivative Progress: 1791/2026 symbols completed. TLK took 1.1s. Estimated remaining: 1m 16s. Rate: 185.1 symbols/min [2025-09-16T21:21:32.473326] [INFO ] [MAIN ] TME: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:32.542384] [DEBUG] [LOCAL ] TM: Loaded 27414 existing records from primary storage. [2025-09-16T21:21:32.558740] [INFO ] [MAIN ] TM: Loaded 27414 primary data records. [2025-09-16T21:21:32.922601] [DEBUG] [LOCAL ] TME: Loaded 39626 existing records from primary storage. [2025-09-16T21:21:32.933906] [INFO ] [MAIN ] TME: Loaded 39626 primary data records. [2025-09-16T21:21:33.261324] [DEBUG] [MAIN ] TLYS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:33.262527] [INFO ] [MAIN ] TLYS: Generated 1339 derivative records from 14099 primary records. [2025-09-16T21:21:33.262731] [DEBUG] [LOCAL ] TLYS: Saving derivative data. [2025-09-16T21:21:33.277778] [DEBUG] [LOCAL ] TLYS: Derivative data saved (1339 records). [2025-09-16T21:21:33.278068] [INFO ] [MAIN ] TLYS: Successfully saved derivative data. [2025-09-16T21:21:33.279919] [INFO ] [MAIN ] Derivative Progress: 1792/2026 symbols completed. TLYS took 1.0s. Estimated remaining: 1m 16s. Rate: 184.9 symbols/min [2025-09-16T21:21:33.282369] [INFO ] [MAIN ] TMHC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:33.292770] [DEBUG] [MAIN ] TM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:33.293811] [INFO ] [MAIN ] TM: Generated 1339 derivative records from 27414 primary records. [2025-09-16T21:21:33.294565] [DEBUG] [LOCAL ] TM: Saving derivative data. [2025-09-16T21:21:33.307959] [DEBUG] [LOCAL ] TM: Derivative data saved (1339 records). [2025-09-16T21:21:33.308689] [INFO ] [MAIN ] TM: Successfully saved derivative data. [2025-09-16T21:21:33.311723] [INFO ] [MAIN ] Derivative Progress: 1793/2026 symbols completed. TM took 1.0s. Estimated remaining: 1m 16s. Rate: 185.0 symbols/min [2025-09-16T21:21:33.312681] [INFO ] [MAIN ] TNC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:33.331980] [DEBUG] [MAIN ] TME: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:33.332573] [INFO ] [MAIN ] TME: Generated 1339 derivative records from 39626 primary records. [2025-09-16T21:21:33.332732] [DEBUG] [LOCAL ] TME: Saving derivative data. [2025-09-16T21:21:33.351099] [DEBUG] [LOCAL ] TNC: Loaded 10537 existing records from primary storage. [2025-09-16T21:21:33.351920] [INFO ] [MAIN ] TNC: Loaded 10537 primary data records. [2025-09-16T21:21:33.372482] [DEBUG] [LOCAL ] TME: Derivative data saved (1339 records). [2025-09-16T21:21:33.393944] [INFO ] [MAIN ] TME: Successfully saved derivative data. [2025-09-16T21:21:33.419442] [DEBUG] [LOCAL ] TMHC: Loaded 33787 existing records from primary storage. [2025-09-16T21:21:33.446164] [INFO ] [MAIN ] TMHC: Loaded 33787 primary data records. [2025-09-16T21:21:33.448345] [INFO ] [MAIN ] Derivative Progress: 1794/2026 symbols completed. TME took 1.0s. Estimated remaining: 1m 15s. Rate: 185.1 symbols/min [2025-09-16T21:21:33.503884] [INFO ] [MAIN ] TNET: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:33.822461] [DEBUG] [LOCAL ] TNET: Loaded 21161 existing records from primary storage. [2025-09-16T21:21:33.909060] [INFO ] [MAIN ] TNET: Loaded 21161 primary data records. [2025-09-16T21:21:34.189591] [DEBUG] [MAIN ] TNC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:34.192062] [INFO ] [MAIN ] TNC: Generated 1339 derivative records from 10537 primary records. [2025-09-16T21:21:34.192687] [DEBUG] [LOCAL ] TNC: Saving derivative data. [2025-09-16T21:21:34.212548] [DEBUG] [MAIN ] TMHC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:34.214598] [INFO ] [MAIN ] TMHC: Generated 1339 derivative records from 33787 primary records. [2025-09-16T21:21:34.214904] [DEBUG] [LOCAL ] TMHC: Saving derivative data. [2025-09-16T21:21:34.226421] [DEBUG] [LOCAL ] TNC: Derivative data saved (1339 records). [2025-09-16T21:21:34.228250] [INFO ] [MAIN ] TNC: Successfully saved derivative data. [2025-09-16T21:21:34.228781] [DEBUG] [LOCAL ] TMHC: Derivative data saved (1339 records). [2025-09-16T21:21:34.228865] [INFO ] [MAIN ] TMHC: Successfully saved derivative data. [2025-09-16T21:21:34.230633] [INFO ] [MAIN ] Derivative Progress: 1795/2026 symbols completed. TNC took 0.9s. Estimated remaining: 1m 15s. Rate: 184.9 symbols/min [2025-09-16T21:21:34.232955] [INFO ] [MAIN ] TNL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:34.233032] [INFO ] [MAIN ] Derivative Progress: 1796/2026 symbols completed. TMHC took 1.0s. Estimated remaining: 1m 15s. Rate: 185.0 symbols/min [2025-09-16T21:21:34.233903] [INFO ] [MAIN ] TOST: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:34.247083] [DEBUG] [MAIN ] TNET: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:34.247814] [INFO ] [MAIN ] TNET: Generated 1339 derivative records from 21161 primary records. [2025-09-16T21:21:34.247912] [DEBUG] [LOCAL ] TNET: Saving derivative data. [2025-09-16T21:21:34.261240] [DEBUG] [LOCAL ] TNET: Derivative data saved (1339 records). [2025-09-16T21:21:34.261437] [INFO ] [MAIN ] TNET: Successfully saved derivative data. [2025-09-16T21:21:34.263712] [INFO ] [MAIN ] Derivative Progress: 1797/2026 symbols completed. TNET took 0.8s. Estimated remaining: 1m 14s. Rate: 185.1 symbols/min [2025-09-16T21:21:34.264087] [INFO ] [MAIN ] TPB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:34.310749] [DEBUG] [LOCAL ] TNL: Loaded 30982 existing records from primary storage. [2025-09-16T21:21:34.311792] [INFO ] [MAIN ] TNL: Loaded 30982 primary data records. [2025-09-16T21:21:34.323878] [DEBUG] [LOCAL ] TOST: Loaded 40041 existing records from primary storage. [2025-09-16T21:21:34.355753] [INFO ] [MAIN ] TOST: Loaded 40041 primary data records. [2025-09-16T21:21:34.464857] [DEBUG] [LOCAL ] TPB: Loaded 19048 existing records from primary storage. [2025-09-16T21:21:34.501855] [INFO ] [MAIN ] TPB: Loaded 19048 primary data records. [2025-09-16T21:21:35.147456] [DEBUG] [MAIN ] TNL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:35.152600] [INFO ] [MAIN ] TNL: Generated 1339 derivative records from 30982 primary records. [2025-09-16T21:21:35.151358] [DEBUG] [MAIN ] TOST: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:35.153719] [DEBUG] [LOCAL ] TNL: Saving derivative data. [2025-09-16T21:21:35.154276] [INFO ] [MAIN ] TOST: Generated 1339 derivative records from 40041 primary records. [2025-09-16T21:21:35.160927] [DEBUG] [LOCAL ] TOST: Saving derivative data. [2025-09-16T21:21:35.173487] [DEBUG] [MAIN ] TPB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:35.180904] [INFO ] [MAIN ] TPB: Generated 1339 derivative records from 19048 primary records. [2025-09-16T21:21:35.186148] [DEBUG] [LOCAL ] TPB: Saving derivative data. [2025-09-16T21:21:35.186704] [DEBUG] [LOCAL ] TOST: Derivative data saved (1339 records). [2025-09-16T21:21:35.187693] [INFO ] [MAIN ] TOST: Successfully saved derivative data. [2025-09-16T21:21:35.190245] [INFO ] [MAIN ] Derivative Progress: 1798/2026 symbols completed. TOST took 1.0s. Estimated remaining: 1m 14s. Rate: 184.9 symbols/min [2025-09-16T21:21:35.196352] [DEBUG] [LOCAL ] TNL: Derivative data saved (1339 records). [2025-09-16T21:21:35.198996] [INFO ] [MAIN ] TNL: Successfully saved derivative data. [2025-09-16T21:21:35.201706] [INFO ] [MAIN ] Derivative Progress: 1799/2026 symbols completed. TNL took 1.0s. Estimated remaining: 1m 14s. Rate: 185.0 symbols/min [2025-09-16T21:21:35.204326] [DEBUG] [LOCAL ] TPB: Derivative data saved (1339 records). [2025-09-16T21:21:35.204388] [INFO ] [MAIN ] TPB: Successfully saved derivative data. [2025-09-16T21:21:35.206492] [INFO ] [MAIN ] Derivative Progress: 1800/2026 symbols completed. TPB took 0.9s. Estimated remaining: 1m 13s. Rate: 185.1 symbols/min [2025-09-16T21:21:35.206980] [INFO ] [MAIN ] TPC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:35.207073] [INFO ] [MAIN ] TPH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:35.207354] [INFO ] [MAIN ] TPR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:35.242422] [DEBUG] [LOCAL ] TPC: Loaded 29430 existing records from primary storage. [2025-09-16T21:21:35.250925] [INFO ] [MAIN ] TPC: Loaded 29430 primary data records. [2025-09-16T21:21:35.330587] [DEBUG] [LOCAL ] TPH: Loaded 33501 existing records from primary storage. [2025-09-16T21:21:35.353270] [INFO ] [MAIN ] TPH: Loaded 33501 primary data records. [2025-09-16T21:21:35.401610] [DEBUG] [LOCAL ] TPR: Loaded 39870 existing records from primary storage. [2025-09-16T21:21:35.445382] [INFO ] [MAIN ] TPR: Loaded 39870 primary data records. [2025-09-16T21:21:36.128126] [DEBUG] [MAIN ] TPC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:36.128924] [INFO ] [MAIN ] TPC: Generated 1339 derivative records from 29430 primary records. [2025-09-16T21:21:36.129045] [DEBUG] [LOCAL ] TPC: Saving derivative data. [2025-09-16T21:21:36.145736] [DEBUG] [MAIN ] TPH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:36.148359] [INFO ] [MAIN ] TPH: Generated 1339 derivative records from 33501 primary records. [2025-09-16T21:21:36.150603] [DEBUG] [LOCAL ] TPH: Saving derivative data. [2025-09-16T21:21:36.174422] [DEBUG] [LOCAL ] TPC: Derivative data saved (1339 records). [2025-09-16T21:21:36.170731] [DEBUG] [LOCAL ] TPH: Derivative data saved (1339 records). [2025-09-16T21:21:36.174566] [INFO ] [MAIN ] TPC: Successfully saved derivative data. [2025-09-16T21:21:36.176409] [INFO ] [MAIN ] Derivative Progress: 1801/2026 symbols completed. TPC took 1.0s. Estimated remaining: 1m 13s. Rate: 184.9 symbols/min [2025-09-16T21:21:36.174754] [INFO ] [MAIN ] TPH: Successfully saved derivative data. [2025-09-16T21:21:36.176702] [DEBUG] [MAIN ] TPR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:36.178981] [INFO ] [MAIN ] Derivative Progress: 1802/2026 symbols completed. TPH took 1.0s. Estimated remaining: 1m 13s. Rate: 185.0 symbols/min [2025-09-16T21:21:36.176943] [INFO ] [MAIN ] TPVG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:36.179313] [INFO ] [MAIN ] TPYP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:36.180044] [INFO ] [MAIN ] TPR: Generated 1339 derivative records from 39870 primary records. [2025-09-16T21:21:36.180465] [DEBUG] [LOCAL ] TPR: Saving derivative data. [2025-09-16T21:21:36.194848] [DEBUG] [LOCAL ] TPR: Derivative data saved (1339 records). [2025-09-16T21:21:36.195015] [INFO ] [MAIN ] TPR: Successfully saved derivative data. [2025-09-16T21:21:36.197193] [INFO ] [MAIN ] Derivative Progress: 1803/2026 symbols completed. TPR took 1.0s. Estimated remaining: 1m 12s. Rate: 185.1 symbols/min [2025-09-16T21:21:36.200554] [DEBUG] [LOCAL ] TPYP: Loaded 5830 existing records from primary storage. [2025-09-16T21:21:36.200845] [INFO ] [MAIN ] TPZ: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:36.201023] [INFO ] [MAIN ] TPYP: Loaded 5830 primary data records. [2025-09-16T21:21:36.298130] [DEBUG] [LOCAL ] TPZ: Loaded 3290 existing records from primary storage. [2025-09-16T21:21:36.321662] [INFO ] [MAIN ] TPZ: Loaded 3290 primary data records. [2025-09-16T21:21:36.322067] [DEBUG] [LOCAL ] TPVG: Loaded 19127 existing records from primary storage. [2025-09-16T21:21:36.334426] [INFO ] [MAIN ] TPVG: Loaded 19127 primary data records. [2025-09-16T21:21:37.054476] [DEBUG] [MAIN ] TPYP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:37.061290] [INFO ] [MAIN ] TPYP: Generated 1339 derivative records from 5830 primary records. [2025-09-16T21:21:37.065231] [DEBUG] [MAIN ] TPZ: Filtered 5181 bins outside market hours, 5780 incomplete bins [2025-09-16T21:21:37.066453] [INFO ] [MAIN ] TPZ: Generated 1338 derivative records from 3290 primary records. [2025-09-16T21:21:37.066656] [DEBUG] [LOCAL ] TPZ: Saving derivative data. [2025-09-16T21:21:37.066566] [DEBUG] [LOCAL ] TPYP: Saving derivative data. [2025-09-16T21:21:37.079854] [DEBUG] [LOCAL ] TPZ: Derivative data saved (1338 records). [2025-09-16T21:21:37.085221] [INFO ] [MAIN ] TPZ: Successfully saved derivative data. [2025-09-16T21:21:37.090815] [INFO ] [MAIN ] Derivative Progress: 1804/2026 symbols completed. TPZ took 0.9s. Estimated remaining: 1m 12s. Rate: 184.9 symbols/min [2025-09-16T21:21:37.098863] [INFO ] [MAIN ] TR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:37.098721] [DEBUG] [LOCAL ] TPYP: Derivative data saved (1339 records). [2025-09-16T21:21:37.102574] [INFO ] [MAIN ] TPYP: Successfully saved derivative data. [2025-09-16T21:21:37.104198] [INFO ] [MAIN ] Derivative Progress: 1805/2026 symbols completed. TPYP took 0.9s. Estimated remaining: 1m 12s. Rate: 185.0 symbols/min [2025-09-16T21:21:37.104999] [DEBUG] [MAIN ] TPVG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:37.105403] [INFO ] [MAIN ] TRAK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:37.106158] [INFO ] [MAIN ] TPVG: Generated 1339 derivative records from 19127 primary records. [2025-09-16T21:21:37.106415] [DEBUG] [LOCAL ] TPVG: Saving derivative data. [2025-09-16T21:21:37.129266] [DEBUG] [LOCAL ] TRAK: Loaded 6721 existing records from primary storage. [2025-09-16T21:21:37.134780] [DEBUG] [LOCAL ] TR: Loaded 14855 existing records from primary storage. [2025-09-16T21:21:37.134890] [INFO ] [MAIN ] TR: Loaded 14855 primary data records. [2025-09-16T21:21:37.134953] [INFO ] [MAIN ] TRAK: Loaded 6721 primary data records. [2025-09-16T21:21:37.134491] [DEBUG] [LOCAL ] TPVG: Derivative data saved (1339 records). [2025-09-16T21:21:37.150757] [INFO ] [MAIN ] TPVG: Successfully saved derivative data. [2025-09-16T21:21:37.184539] [INFO ] [MAIN ] Derivative Progress: 1806/2026 symbols completed. TPVG took 1.0s. Estimated remaining: 1m 11s. Rate: 185.1 symbols/min [2025-09-16T21:21:37.223716] [INFO ] [MAIN ] TRC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:37.579339] [DEBUG] [LOCAL ] TRC: Loaded 11443 existing records from primary storage. [2025-09-16T21:21:37.582563] [INFO ] [MAIN ] TRC: Loaded 11443 primary data records. [2025-09-16T21:21:37.996860] [DEBUG] [MAIN ] TR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:38.006844] [INFO ] [MAIN ] TR: Generated 1339 derivative records from 14855 primary records. [2025-09-16T21:21:38.007706] [DEBUG] [MAIN ] TRAK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:38.008510] [DEBUG] [LOCAL ] TR: Saving derivative data. [2025-09-16T21:21:38.008426] [INFO ] [MAIN ] TRAK: Generated 1339 derivative records from 6721 primary records. [2025-09-16T21:21:38.009063] [DEBUG] [LOCAL ] TRAK: Saving derivative data. [2025-09-16T21:21:38.030542] [DEBUG] [LOCAL ] TRAK: Derivative data saved (1339 records). [2025-09-16T21:21:38.031106] [INFO ] [MAIN ] TRAK: Successfully saved derivative data. [2025-09-16T21:21:38.033604] [INFO ] [MAIN ] Derivative Progress: 1807/2026 symbols completed. TRAK took 0.9s. Estimated remaining: 1m 11s. Rate: 184.9 symbols/min [2025-09-16T21:21:38.034703] [INFO ] [MAIN ] TREX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:38.036981] [DEBUG] [LOCAL ] TR: Derivative data saved (1339 records). [2025-09-16T21:21:38.037288] [INFO ] [MAIN ] TR: Successfully saved derivative data. [2025-09-16T21:21:38.038902] [INFO ] [MAIN ] Derivative Progress: 1808/2026 symbols completed. TR took 0.9s. Estimated remaining: 1m 11s. Rate: 185.0 symbols/min [2025-09-16T21:21:38.039093] [INFO ] [MAIN ] TRN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:38.052414] [DEBUG] [MAIN ] TRC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:38.053087] [INFO ] [MAIN ] TRC: Generated 1339 derivative records from 11443 primary records. [2025-09-16T21:21:38.053166] [DEBUG] [LOCAL ] TRC: Saving derivative data. [2025-09-16T21:21:38.075383] [DEBUG] [LOCAL ] TRC: Derivative data saved (1339 records). [2025-09-16T21:21:38.075516] [INFO ] [MAIN ] TRC: Successfully saved derivative data. [2025-09-16T21:21:38.077912] [INFO ] [MAIN ] Derivative Progress: 1809/2026 symbols completed. TRC took 0.9s. Estimated remaining: 1m 10s. Rate: 185.1 symbols/min [2025-09-16T21:21:38.084560] [INFO ] [MAIN ] TRNO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:38.107506] [DEBUG] [LOCAL ] TRN: Loaded 27550 existing records from primary storage. [2025-09-16T21:21:38.107680] [INFO ] [MAIN ] TRN: Loaded 27550 primary data records. [2025-09-16T21:21:38.108542] [DEBUG] [LOCAL ] TREX: Loaded 36864 existing records from primary storage. [2025-09-16T21:21:38.120147] [INFO ] [MAIN ] TREX: Loaded 36864 primary data records. [2025-09-16T21:21:38.383783] [DEBUG] [LOCAL ] TRNO: Loaded 32854 existing records from primary storage. [2025-09-16T21:21:38.407559] [INFO ] [MAIN ] TRNO: Loaded 32854 primary data records. [2025-09-16T21:21:38.978744] [DEBUG] [MAIN ] TRN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:38.979779] [INFO ] [MAIN ] TRN: Generated 1339 derivative records from 27550 primary records. [2025-09-16T21:21:38.989242] [DEBUG] [LOCAL ] TRN: Saving derivative data. [2025-09-16T21:21:38.990087] [DEBUG] [MAIN ] TREX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:38.991126] [INFO ] [MAIN ] TREX: Generated 1339 derivative records from 36864 primary records. [2025-09-16T21:21:38.991351] [DEBUG] [LOCAL ] TREX: Saving derivative data. [2025-09-16T21:21:39.013718] [DEBUG] [LOCAL ] TRN: Derivative data saved (1339 records). [2025-09-16T21:21:39.013908] [INFO ] [MAIN ] TRN: Successfully saved derivative data. [2025-09-16T21:21:39.016461] [DEBUG] [LOCAL ] TREX: Derivative data saved (1339 records). [2025-09-16T21:21:39.016675] [INFO ] [MAIN ] TREX: Successfully saved derivative data. [2025-09-16T21:21:39.016394] [INFO ] [MAIN ] Derivative Progress: 1810/2026 symbols completed. TRN took 1.0s. Estimated remaining: 1m 10s. Rate: 184.9 symbols/min [2025-09-16T21:21:39.018459] [INFO ] [MAIN ] TROX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:39.021201] [INFO ] [MAIN ] Derivative Progress: 1811/2026 symbols completed. TREX took 1.0s. Estimated remaining: 1m 10s. Rate: 185.0 symbols/min [2025-09-16T21:21:39.021771] [INFO ] [MAIN ] TRP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:39.032458] [DEBUG] [MAIN ] TRNO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:39.033190] [INFO ] [MAIN ] TRNO: Generated 1339 derivative records from 32854 primary records. [2025-09-16T21:21:39.033286] [DEBUG] [LOCAL ] TRNO: Saving derivative data. [2025-09-16T21:21:39.045782] [DEBUG] [LOCAL ] TRNO: Derivative data saved (1339 records). [2025-09-16T21:21:39.045850] [INFO ] [MAIN ] TRNO: Successfully saved derivative data. [2025-09-16T21:21:39.048118] [INFO ] [MAIN ] Derivative Progress: 1812/2026 symbols completed. TRNO took 1.0s. Estimated remaining: 1m 9s. Rate: 185.1 symbols/min [2025-09-16T21:21:39.048374] [INFO ] [MAIN ] TRTX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:39.102672] [DEBUG] [LOCAL ] TROX: Loaded 38819 existing records from primary storage. [2025-09-16T21:21:39.112713] [INFO ] [MAIN ] TROX: Loaded 38819 primary data records. [2025-09-16T21:21:39.113441] [DEBUG] [LOCAL ] TRP: Loaded 38806 existing records from primary storage. [2025-09-16T21:21:39.113842] [DEBUG] [LOCAL ] TRTX: Loaded 26718 existing records from primary storage. [2025-09-16T21:21:39.119484] [INFO ] [MAIN ] TRP: Loaded 38806 primary data records. [2025-09-16T21:21:39.136966] [INFO ] [MAIN ] TRTX: Loaded 26718 primary data records. [2025-09-16T21:21:39.996276] [DEBUG] [MAIN ] TROX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:39.998280] [INFO ] [MAIN ] TROX: Generated 1339 derivative records from 38819 primary records. [2025-09-16T21:21:39.998372] [DEBUG] [LOCAL ] TROX: Saving derivative data. [2025-09-16T21:21:40.027421] [DEBUG] [MAIN ] TRP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:40.030525] [INFO ] [MAIN ] TRP: Generated 1339 derivative records from 38806 primary records. [2025-09-16T21:21:40.032971] [DEBUG] [LOCAL ] TRP: Saving derivative data. [2025-09-16T21:21:40.032897] [DEBUG] [MAIN ] TRTX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:40.034973] [DEBUG] [LOCAL ] TROX: Derivative data saved (1339 records). [2025-09-16T21:21:40.033682] [INFO ] [MAIN ] TRTX: Generated 1339 derivative records from 26718 primary records. [2025-09-16T21:21:40.035497] [DEBUG] [LOCAL ] TRTX: Saving derivative data. [2025-09-16T21:21:40.035600] [INFO ] [MAIN ] TROX: Successfully saved derivative data. [2025-09-16T21:21:40.037137] [INFO ] [MAIN ] Derivative Progress: 1813/2026 symbols completed. TROX took 1.0s. Estimated remaining: 1m 9s. Rate: 184.9 symbols/min [2025-09-16T21:21:40.062301] [DEBUG] [LOCAL ] TRP: Derivative data saved (1339 records). [2025-09-16T21:21:40.063015] [INFO ] [MAIN ] TRP: Successfully saved derivative data. [2025-09-16T21:21:40.066395] [INFO ] [MAIN ] Derivative Progress: 1814/2026 symbols completed. TRP took 1.0s. Estimated remaining: 1m 9s. Rate: 185.0 symbols/min [2025-09-16T21:21:40.069271] [DEBUG] [LOCAL ] TRTX: Derivative data saved (1339 records). [2025-09-16T21:21:40.069410] [INFO ] [MAIN ] TRTX: Successfully saved derivative data. [2025-09-16T21:21:40.071994] [INFO ] [MAIN ] Derivative Progress: 1815/2026 symbols completed. TRTX took 1.0s. Estimated remaining: 1m 8s. Rate: 185.1 symbols/min [2025-09-16T21:21:40.072768] [INFO ] [MAIN ] TSE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:40.072851] [INFO ] [MAIN ] TRU: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:40.072999] [INFO ] [MAIN ] TS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:40.107225] [DEBUG] [LOCAL ] TSE: Loaded 21302 existing records from primary storage. [2025-09-16T21:21:40.107446] [INFO ] [MAIN ] TSE: Loaded 21302 primary data records. [2025-09-16T21:21:40.234340] [DEBUG] [LOCAL ] TS: Loaded 38422 existing records from primary storage. [2025-09-16T21:21:40.255894] [INFO ] [MAIN ] TS: Loaded 38422 primary data records. [2025-09-16T21:21:40.450631] [DEBUG] [LOCAL ] TRU: Loaded 37991 existing records from primary storage. [2025-09-16T21:21:40.488743] [INFO ] [MAIN ] TRU: Loaded 37991 primary data records. [2025-09-16T21:21:40.957528] [DEBUG] [MAIN ] TSE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:40.958460] [INFO ] [MAIN ] TSE: Generated 1339 derivative records from 21302 primary records. [2025-09-16T21:21:40.958781] [DEBUG] [LOCAL ] TSE: Saving derivative data. [2025-09-16T21:21:40.975344] [DEBUG] [LOCAL ] TSE: Derivative data saved (1339 records). [2025-09-16T21:21:40.982746] [INFO ] [MAIN ] TSE: Successfully saved derivative data. [2025-09-16T21:21:40.988292] [INFO ] [MAIN ] Derivative Progress: 1816/2026 symbols completed. TSE took 0.9s. Estimated remaining: 1m 8s. Rate: 184.9 symbols/min [2025-09-16T21:21:40.989925] [INFO ] [MAIN ] TSI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:40.989417] [DEBUG] [MAIN ] TS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:40.991500] [INFO ] [MAIN ] TS: Generated 1339 derivative records from 38422 primary records. [2025-09-16T21:21:40.992416] [DEBUG] [LOCAL ] TS: Saving derivative data. [2025-09-16T21:21:41.016320] [DEBUG] [LOCAL ] TS: Derivative data saved (1339 records). [2025-09-16T21:21:41.013809] [DEBUG] [MAIN ] TRU: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:41.017185] [INFO ] [MAIN ] TS: Successfully saved derivative data. [2025-09-16T21:21:41.017130] [INFO ] [MAIN ] TRU: Generated 1339 derivative records from 37991 primary records. [2025-09-16T21:21:41.019695] [DEBUG] [LOCAL ] TRU: Saving derivative data. [2025-09-16T21:21:41.019616] [INFO ] [MAIN ] Derivative Progress: 1817/2026 symbols completed. TS took 0.9s. Estimated remaining: 1m 8s. Rate: 185.0 symbols/min [2025-09-16T21:21:41.020032] [INFO ] [MAIN ] TSLX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:41.023987] [DEBUG] [LOCAL ] TSI: Loaded 5465 existing records from primary storage. [2025-09-16T21:21:41.024401] [INFO ] [MAIN ] TSI: Loaded 5465 primary data records. [2025-09-16T21:21:41.100468] [DEBUG] [LOCAL ] TRU: Derivative data saved (1339 records). [2025-09-16T21:21:41.139136] [INFO ] [MAIN ] TRU: Successfully saved derivative data. [2025-09-16T21:21:41.148040] [INFO ] [MAIN ] Derivative Progress: 1818/2026 symbols completed. TRU took 1.1s. Estimated remaining: 1m 7s. Rate: 185.1 symbols/min [2025-09-16T21:21:41.159286] [INFO ] [MAIN ] TSQ: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:41.234753] [DEBUG] [LOCAL ] TSLX: Loaded 25751 existing records from primary storage. [2025-09-16T21:21:41.320401] [INFO ] [MAIN ] TSLX: Loaded 25751 primary data records. [2025-09-16T21:21:41.363370] [DEBUG] [LOCAL ] TSQ: Loaded 9426 existing records from primary storage. [2025-09-16T21:21:41.371511] [INFO ] [MAIN ] TSQ: Loaded 9426 primary data records. [2025-09-16T21:21:41.909881] [DEBUG] [MAIN ] TSI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:41.911274] [INFO ] [MAIN ] TSI: Generated 1339 derivative records from 5465 primary records. [2025-09-16T21:21:41.911676] [DEBUG] [LOCAL ] TSI: Saving derivative data. [2025-09-16T21:21:41.923861] [DEBUG] [LOCAL ] TSI: Derivative data saved (1339 records). [2025-09-16T21:21:41.924072] [INFO ] [MAIN ] TSI: Successfully saved derivative data. [2025-09-16T21:21:41.925508] [INFO ] [MAIN ] Derivative Progress: 1819/2026 symbols completed. TSI took 0.9s. Estimated remaining: 1m 7s. Rate: 184.9 symbols/min [2025-09-16T21:21:41.927184] [INFO ] [MAIN ] TT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:41.946518] [DEBUG] [MAIN ] TSQ: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:41.947230] [INFO ] [MAIN ] TSQ: Generated 1339 derivative records from 9426 primary records. [2025-09-16T21:21:41.947329] [DEBUG] [LOCAL ] TSQ: Saving derivative data. [2025-09-16T21:21:41.966151] [DEBUG] [MAIN ] TSLX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:41.969588] [INFO ] [MAIN ] TSLX: Generated 1339 derivative records from 25751 primary records. [2025-09-16T21:21:41.970133] [DEBUG] [LOCAL ] TSQ: Derivative data saved (1339 records). [2025-09-16T21:21:41.970300] [INFO ] [MAIN ] TSQ: Successfully saved derivative data. [2025-09-16T21:21:41.972626] [INFO ] [MAIN ] Derivative Progress: 1820/2026 symbols completed. TSQ took 0.8s. Estimated remaining: 1m 7s. Rate: 185.0 symbols/min [2025-09-16T21:21:41.970362] [DEBUG] [LOCAL ] TSLX: Saving derivative data. [2025-09-16T21:21:41.972849] [INFO ] [MAIN ] TTAM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:41.994106] [DEBUG] [LOCAL ] TSLX: Derivative data saved (1339 records). [2025-09-16T21:21:41.994233] [INFO ] [MAIN ] TSLX: Successfully saved derivative data. [2025-09-16T21:21:41.996324] [INFO ] [MAIN ] Derivative Progress: 1821/2026 symbols completed. TSLX took 1.0s. Estimated remaining: 1m 6s. Rate: 185.1 symbols/min [2025-09-16T21:21:41.997123] [INFO ] [MAIN ] TTC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:42.012857] [DEBUG] [LOCAL ] TT: Loaded 34994 existing records from primary storage. [2025-09-16T21:21:42.013065] [INFO ] [MAIN ] TT: Loaded 34994 primary data records. [2025-09-16T21:21:42.126715] [DEBUG] [LOCAL ] TTAM: Loaded 20405 existing records from primary storage. [2025-09-16T21:21:42.154755] [INFO ] [MAIN ] TTAM: Loaded 20405 primary data records. [2025-09-16T21:21:42.446087] [DEBUG] [LOCAL ] TTC: Loaded 31230 existing records from primary storage. [2025-09-16T21:21:42.466839] [INFO ] [MAIN ] TTC: Loaded 31230 primary data records. [2025-09-16T21:21:42.911824] [DEBUG] [MAIN ] TT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:42.912709] [INFO ] [MAIN ] TT: Generated 1339 derivative records from 34994 primary records. [2025-09-16T21:21:42.912835] [DEBUG] [LOCAL ] TT: Saving derivative data. [2025-09-16T21:21:42.937467] [DEBUG] [MAIN ] TTAM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:42.937775] [DEBUG] [LOCAL ] TT: Derivative data saved (1339 records). [2025-09-16T21:21:42.937910] [INFO ] [MAIN ] TT: Successfully saved derivative data. [2025-09-16T21:21:42.940118] [INFO ] [MAIN ] Derivative Progress: 1822/2026 symbols completed. TT took 1.0s. Estimated remaining: 1m 6s. Rate: 184.9 symbols/min [2025-09-16T21:21:42.938566] [INFO ] [MAIN ] TTAM: Generated 1339 derivative records from 20405 primary records. [2025-09-16T21:21:42.940356] [DEBUG] [LOCAL ] TTAM: Saving derivative data. [2025-09-16T21:21:42.940524] [INFO ] [MAIN ] TTE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:42.955738] [DEBUG] [LOCAL ] TTAM: Derivative data saved (1339 records). [2025-09-16T21:21:42.956579] [INFO ] [MAIN ] TTAM: Successfully saved derivative data. [2025-09-16T21:21:42.959039] [INFO ] [MAIN ] Derivative Progress: 1823/2026 symbols completed. TTAM took 1.0s. Estimated remaining: 1m 6s. Rate: 185.0 symbols/min [2025-09-16T21:21:42.969002] [INFO ] [MAIN ] TTI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:42.969555] [DEBUG] [MAIN ] TTC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:42.970367] [INFO ] [MAIN ] TTC: Generated 1339 derivative records from 31230 primary records. [2025-09-16T21:21:42.970563] [DEBUG] [LOCAL ] TTC: Saving derivative data. [2025-09-16T21:21:42.984056] [DEBUG] [LOCAL ] TTC: Derivative data saved (1339 records). [2025-09-16T21:21:42.984200] [INFO ] [MAIN ] TTC: Successfully saved derivative data. [2025-09-16T21:21:42.986514] [INFO ] [MAIN ] Derivative Progress: 1824/2026 symbols completed. TTC took 1.0s. Estimated remaining: 1m 5s. Rate: 185.1 symbols/min [2025-09-16T21:21:42.995814] [INFO ] [MAIN ] TU: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:43.019761] [DEBUG] [LOCAL ] TTE: Loaded 38310 existing records from primary storage. [2025-09-16T21:21:43.019982] [INFO ] [MAIN ] TTE: Loaded 38310 primary data records. [2025-09-16T21:21:43.167808] [DEBUG] [LOCAL ] TTI: Loaded 33942 existing records from primary storage. [2025-09-16T21:21:43.223066] [INFO ] [MAIN ] TTI: Loaded 33942 primary data records. [2025-09-16T21:21:43.340582] [DEBUG] [LOCAL ] TU: Loaded 36881 existing records from primary storage. [2025-09-16T21:21:43.373520] [INFO ] [MAIN ] TU: Loaded 36881 primary data records. [2025-09-16T21:21:43.850956] [DEBUG] [MAIN ] TTE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:43.851785] [INFO ] [MAIN ] TTE: Generated 1339 derivative records from 38310 primary records. [2025-09-16T21:21:43.852159] [DEBUG] [LOCAL ] TTE: Saving derivative data. [2025-09-16T21:21:43.867524] [DEBUG] [LOCAL ] TTE: Derivative data saved (1339 records). [2025-09-16T21:21:43.877837] [INFO ] [MAIN ] TTE: Successfully saved derivative data. [2025-09-16T21:21:43.879865] [INFO ] [MAIN ] Derivative Progress: 1825/2026 symbols completed. TTE took 0.9s. Estimated remaining: 1m 5s. Rate: 184.9 symbols/min [2025-09-16T21:21:43.880722] [DEBUG] [MAIN ] TTI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:43.880762] [INFO ] [MAIN ] TUYA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:43.890436] [INFO ] [MAIN ] TTI: Generated 1339 derivative records from 33942 primary records. [2025-09-16T21:21:43.890832] [DEBUG] [MAIN ] TU: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:43.891126] [DEBUG] [LOCAL ] TTI: Saving derivative data. [2025-09-16T21:21:43.892107] [INFO ] [MAIN ] TU: Generated 1339 derivative records from 36881 primary records. [2025-09-16T21:21:43.898059] [DEBUG] [LOCAL ] TU: Saving derivative data. [2025-09-16T21:21:43.916049] [DEBUG] [LOCAL ] TU: Derivative data saved (1339 records). [2025-09-16T21:21:43.915997] [DEBUG] [LOCAL ] TTI: Derivative data saved (1339 records). [2025-09-16T21:21:43.916141] [INFO ] [MAIN ] TU: Successfully saved derivative data. [2025-09-16T21:21:43.918157] [INFO ] [MAIN ] Derivative Progress: 1826/2026 symbols completed. TU took 0.9s. Estimated remaining: 1m 5s. Rate: 185.0 symbols/min [2025-09-16T21:21:43.918417] [INFO ] [MAIN ] TV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:43.918254] [INFO ] [MAIN ] TTI: Successfully saved derivative data. [2025-09-16T21:21:43.920919] [INFO ] [MAIN ] Derivative Progress: 1827/2026 symbols completed. TTI took 1.0s. Estimated remaining: 1m 4s. Rate: 185.1 symbols/min [2025-09-16T21:21:43.921222] [INFO ] [MAIN ] TVC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:43.933672] [DEBUG] [LOCAL ] TVC: Loaded 2406 existing records from primary storage. [2025-09-16T21:21:43.933797] [INFO ] [MAIN ] TVC: Loaded 2406 primary data records. [2025-09-16T21:21:44.055721] [DEBUG] [LOCAL ] TUYA: Loaded 34277 existing records from primary storage. [2025-09-16T21:21:44.096532] [INFO ] [MAIN ] TUYA: Loaded 34277 primary data records. [2025-09-16T21:21:44.278859] [DEBUG] [LOCAL ] TV: Loaded 31597 existing records from primary storage. [2025-09-16T21:21:44.304628] [INFO ] [MAIN ] TV: Loaded 31597 primary data records. [2025-09-16T21:21:44.808346] [DEBUG] [MAIN ] TVC: Filtered 5181 bins outside market hours, 5781 incomplete bins [2025-09-16T21:21:44.809624] [INFO ] [MAIN ] TVC: Generated 1337 derivative records from 2406 primary records. [2025-09-16T21:21:44.809906] [DEBUG] [LOCAL ] TVC: Saving derivative data. [2025-09-16T21:21:44.825083] [DEBUG] [LOCAL ] TVC: Derivative data saved (1337 records). [2025-09-16T21:21:44.826699] [INFO ] [MAIN ] TVC: Successfully saved derivative data. [2025-09-16T21:21:44.829138] [INFO ] [MAIN ] Derivative Progress: 1828/2026 symbols completed. TVC took 0.9s. Estimated remaining: 1m 4s. Rate: 185.0 symbols/min [2025-09-16T21:21:44.840097] [DEBUG] [MAIN ] TUYA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:44.840780] [INFO ] [MAIN ] TUYA: Generated 1339 derivative records from 34277 primary records. [2025-09-16T21:21:44.841499] [DEBUG] [LOCAL ] TUYA: Saving derivative data. [2025-09-16T21:21:44.863221] [DEBUG] [MAIN ] TV: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:44.864739] [DEBUG] [LOCAL ] TUYA: Derivative data saved (1339 records). [2025-09-16T21:21:44.864697] [INFO ] [MAIN ] TV: Generated 1339 derivative records from 31597 primary records. [2025-09-16T21:21:44.864836] [INFO ] [MAIN ] TUYA: Successfully saved derivative data. [2025-09-16T21:21:44.864889] [DEBUG] [LOCAL ] TV: Saving derivative data. [2025-09-16T21:21:44.867388] [INFO ] [MAIN ] Derivative Progress: 1829/2026 symbols completed. TUYA took 1.0s. Estimated remaining: 1m 4s. Rate: 185.0 symbols/min [2025-09-16T21:21:44.879495] [DEBUG] [LOCAL ] TV: Derivative data saved (1339 records). [2025-09-16T21:21:44.879557] [INFO ] [MAIN ] TV: Successfully saved derivative data. [2025-09-16T21:21:44.881776] [INFO ] [MAIN ] Derivative Progress: 1830/2026 symbols completed. TV took 1.0s. Estimated remaining: 1m 4s. Rate: 185.1 symbols/min [2025-09-16T21:21:44.882604] [INFO ] [MAIN ] TWI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:44.882755] [INFO ] [MAIN ] TWLO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:44.882838] [INFO ] [MAIN ] TVE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:44.888131] [DEBUG] [LOCAL ] TVE: Loaded 1871 existing records from primary storage. [2025-09-16T21:21:44.888318] [INFO ] [MAIN ] TVE: Loaded 1871 primary data records. [2025-09-16T21:21:45.096329] [DEBUG] [LOCAL ] TWI: Loaded 24637 existing records from primary storage. [2025-09-16T21:21:45.139746] [INFO ] [MAIN ] TWI: Loaded 24637 primary data records. [2025-09-16T21:21:45.252610] [DEBUG] [LOCAL ] TWLO: Loaded 39340 existing records from primary storage. [2025-09-16T21:21:45.282541] [INFO ] [MAIN ] TWLO: Loaded 39340 primary data records. [2025-09-16T21:21:45.755452] [DEBUG] [MAIN ] TVE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:45.756672] [INFO ] [MAIN ] TVE: Generated 1339 derivative records from 1871 primary records. [2025-09-16T21:21:45.757138] [DEBUG] [LOCAL ] TVE: Saving derivative data. [2025-09-16T21:21:45.770615] [DEBUG] [LOCAL ] TVE: Derivative data saved (1339 records). [2025-09-16T21:21:45.771721] [INFO ] [MAIN ] TVE: Successfully saved derivative data. [2025-09-16T21:21:45.773606] [INFO ] [MAIN ] Derivative Progress: 1831/2026 symbols completed. TVE took 0.9s. Estimated remaining: 1m 3s. Rate: 185.0 symbols/min [2025-09-16T21:21:45.774076] [INFO ] [MAIN ] TWN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:45.780158] [DEBUG] [LOCAL ] TWN: Loaded 2061 existing records from primary storage. [2025-09-16T21:21:45.780350] [INFO ] [MAIN ] TWN: Loaded 2061 primary data records. [2025-09-16T21:21:45.835156] [DEBUG] [MAIN ] TWI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:45.868577] [INFO ] [MAIN ] TWI: Generated 1339 derivative records from 24637 primary records. [2025-09-16T21:21:45.883071] [DEBUG] [LOCAL ] TWI: Saving derivative data. [2025-09-16T21:21:45.902014] [DEBUG] [MAIN ] TWLO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:45.911924] [INFO ] [MAIN ] TWLO: Generated 1339 derivative records from 39340 primary records. [2025-09-16T21:21:45.917506] [DEBUG] [LOCAL ] TWLO: Saving derivative data. [2025-09-16T21:21:46.090484] [DEBUG] [LOCAL ] TWLO: Derivative data saved (1339 records). [2025-09-16T21:21:46.090577] [DEBUG] [LOCAL ] TWI: Derivative data saved (1339 records). [2025-09-16T21:21:46.090715] [INFO ] [MAIN ] TWI: Successfully saved derivative data. [2025-09-16T21:21:46.092424] [INFO ] [MAIN ] Derivative Progress: 1832/2026 symbols completed. TWI took 1.2s. Estimated remaining: 1m 3s. Rate: 185.0 symbols/min [2025-09-16T21:21:46.092557] [INFO ] [MAIN ] TWLO: Successfully saved derivative data. [2025-09-16T21:21:46.094942] [INFO ] [MAIN ] Derivative Progress: 1833/2026 symbols completed. TWLO took 1.2s. Estimated remaining: 1m 3s. Rate: 185.1 symbols/min [2025-09-16T21:21:46.092733] [INFO ] [MAIN ] TWO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:46.095211] [INFO ] [MAIN ] TX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:46.116672] [DEBUG] [LOCAL ] TX: Loaded 17035 existing records from primary storage. [2025-09-16T21:21:46.122570] [INFO ] [MAIN ] TX: Loaded 17035 primary data records. [2025-09-16T21:21:46.145898] [DEBUG] [MAIN ] TWN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:46.183766] [INFO ] [MAIN ] TWN: Generated 1339 derivative records from 2061 primary records. [2025-09-16T21:21:46.205378] [DEBUG] [LOCAL ] TWN: Saving derivative data. [2025-09-16T21:21:46.257241] [DEBUG] [LOCAL ] TWO: Loaded 35938 existing records from primary storage. [2025-09-16T21:21:46.264573] [INFO ] [MAIN ] TWO: Loaded 35938 primary data records. [2025-09-16T21:21:46.411217] [DEBUG] [LOCAL ] TWN: Derivative data saved (1339 records). [2025-09-16T21:21:46.519386] [INFO ] [MAIN ] TWN: Successfully saved derivative data. [2025-09-16T21:21:46.547734] [INFO ] [MAIN ] Derivative Progress: 1834/2026 symbols completed. TWN took 0.8s. Estimated remaining: 1m 2s. Rate: 185.0 symbols/min [2025-09-16T21:21:46.636110] [INFO ] [MAIN ] TXNM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:46.749784] [DEBUG] [MAIN ] TX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:46.750684] [INFO ] [MAIN ] TX: Generated 1339 derivative records from 17035 primary records. [2025-09-16T21:21:46.750837] [DEBUG] [LOCAL ] TX: Saving derivative data. [2025-09-16T21:21:46.763578] [DEBUG] [LOCAL ] TX: Derivative data saved (1339 records). [2025-09-16T21:21:46.771880] [INFO ] [MAIN ] TX: Successfully saved derivative data. [2025-09-16T21:21:46.773538] [INFO ] [MAIN ] Derivative Progress: 1835/2026 symbols completed. TX took 0.7s. Estimated remaining: 1m 2s. Rate: 185.1 symbols/min [2025-09-16T21:21:46.774671] [INFO ] [MAIN ] TXO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:46.776297] [DEBUG] [LOCAL ] TXNM: Loaded 32423 existing records from primary storage. [2025-09-16T21:21:46.776451] [INFO ] [MAIN ] TXNM: Loaded 32423 primary data records. [2025-09-16T21:21:46.893022] [DEBUG] [MAIN ] TWO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:46.893684] [INFO ] [MAIN ] TWO: Generated 1339 derivative records from 35938 primary records. [2025-09-16T21:21:46.899017] [DEBUG] [LOCAL ] TWO: Saving derivative data. [2025-09-16T21:21:46.925170] [DEBUG] [LOCAL ] TXO: Loaded 15226 existing records from primary storage. [2025-09-16T21:21:46.969119] [INFO ] [MAIN ] TXO: Loaded 15226 primary data records. [2025-09-16T21:21:47.195227] [DEBUG] [LOCAL ] TWO: Derivative data saved (1339 records). [2025-09-16T21:21:47.200593] [INFO ] [MAIN ] TWO: Successfully saved derivative data. [2025-09-16T21:21:47.248819] [INFO ] [MAIN ] Derivative Progress: 1836/2026 symbols completed. TWO took 1.2s. Estimated remaining: 1m 2s. Rate: 185.0 symbols/min [2025-09-16T21:21:47.334241] [INFO ] [MAIN ] TXT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:47.352024] [DEBUG] [MAIN ] TXNM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:47.354874] [INFO ] [MAIN ] TXNM: Generated 1339 derivative records from 32423 primary records. [2025-09-16T21:21:47.355099] [DEBUG] [LOCAL ] TXNM: Saving derivative data. [2025-09-16T21:21:47.368014] [DEBUG] [LOCAL ] TXNM: Derivative data saved (1339 records). [2025-09-16T21:21:47.368206] [INFO ] [MAIN ] TXNM: Successfully saved derivative data. [2025-09-16T21:21:47.369839] [INFO ] [MAIN ] Derivative Progress: 1837/2026 symbols completed. TXNM took 0.8s. Estimated remaining: 1m 1s. Rate: 185.1 symbols/min [2025-09-16T21:21:47.378850] [INFO ] [MAIN ] TY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:47.392658] [DEBUG] [MAIN ] TXO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:47.394482] [INFO ] [MAIN ] TXO: Generated 1339 derivative records from 15226 primary records. [2025-09-16T21:21:47.404091] [DEBUG] [LOCAL ] TXO: Saving derivative data. [2025-09-16T21:21:47.406231] [DEBUG] [LOCAL ] TXT: Loaded 36917 existing records from primary storage. [2025-09-16T21:21:47.411750] [INFO ] [MAIN ] TXT: Loaded 36917 primary data records. [2025-09-16T21:21:47.428771] [DEBUG] [LOCAL ] TY: Loaded 5517 existing records from primary storage. [2025-09-16T21:21:47.449226] [INFO ] [MAIN ] TY: Loaded 5517 primary data records. [2025-09-16T21:21:47.600322] [DEBUG] [LOCAL ] TXO: Derivative data saved (1339 records). [2025-09-16T21:21:47.625108] [INFO ] [MAIN ] TXO: Successfully saved derivative data. [2025-09-16T21:21:47.637870] [INFO ] [MAIN ] Derivative Progress: 1838/2026 symbols completed. TXO took 0.9s. Estimated remaining: 1m 1s. Rate: 185.1 symbols/min [2025-09-16T21:21:47.658939] [INFO ] [MAIN ] TYG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:47.965632] [DEBUG] [LOCAL ] TYG: Loaded 10386 existing records from primary storage. [2025-09-16T21:21:47.966214] [INFO ] [MAIN ] TYG: Loaded 10386 primary data records. [2025-09-16T21:21:48.260278] [DEBUG] [MAIN ] TXT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:48.263990] [INFO ] [MAIN ] TXT: Generated 1339 derivative records from 36917 primary records. [2025-09-16T21:21:48.264623] [DEBUG] [LOCAL ] TXT: Saving derivative data. [2025-09-16T21:21:48.284213] [DEBUG] [MAIN ] TY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:48.290265] [INFO ] [MAIN ] TY: Generated 1339 derivative records from 5517 primary records. [2025-09-16T21:21:48.290656] [DEBUG] [LOCAL ] TY: Saving derivative data. [2025-09-16T21:21:48.289489] [DEBUG] [LOCAL ] TXT: Derivative data saved (1339 records). [2025-09-16T21:21:48.290791] [INFO ] [MAIN ] TXT: Successfully saved derivative data. [2025-09-16T21:21:48.293291] [INFO ] [MAIN ] Derivative Progress: 1839/2026 symbols completed. TXT took 1.0s. Estimated remaining: 1m 1s. Rate: 185.0 symbols/min [2025-09-16T21:21:48.293851] [INFO ] [MAIN ] TYL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:48.305529] [DEBUG] [LOCAL ] TY: Derivative data saved (1339 records). [2025-09-16T21:21:48.305810] [INFO ] [MAIN ] TY: Successfully saved derivative data. [2025-09-16T21:21:48.307850] [INFO ] [MAIN ] Derivative Progress: 1840/2026 symbols completed. TY took 0.9s. Estimated remaining: 1m 0s. Rate: 185.1 symbols/min [2025-09-16T21:21:48.308280] [INFO ] [MAIN ] U: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:48.326474] [DEBUG] [MAIN ] TYG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:48.327169] [INFO ] [MAIN ] TYG: Generated 1339 derivative records from 10386 primary records. [2025-09-16T21:21:48.327318] [DEBUG] [LOCAL ] TYG: Saving derivative data. [2025-09-16T21:21:48.339432] [DEBUG] [LOCAL ] TYG: Derivative data saved (1339 records). [2025-09-16T21:21:48.346897] [INFO ] [MAIN ] TYG: Successfully saved derivative data. [2025-09-16T21:21:48.348944] [INFO ] [MAIN ] Derivative Progress: 1841/2026 symbols completed. TYG took 0.7s. Estimated remaining: 59.9s. Rate: 185.2 symbols/min [2025-09-16T21:21:48.349774] [DEBUG] [LOCAL ] TYL: Loaded 16482 existing records from primary storage. [2025-09-16T21:21:48.350077] [INFO ] [MAIN ] UA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:48.350335] [INFO ] [MAIN ] TYL: Loaded 16482 primary data records. [2025-09-16T21:21:48.560816] [DEBUG] [LOCAL ] U: Loaded 40149 existing records from primary storage. [2025-09-16T21:21:48.644947] [INFO ] [MAIN ] U: Loaded 40149 primary data records. [2025-09-16T21:21:48.728308] [DEBUG] [LOCAL ] UA: Loaded 37234 existing records from primary storage. [2025-09-16T21:21:48.733955] [INFO ] [MAIN ] UA: Loaded 37234 primary data records. [2025-09-16T21:21:49.283884] [DEBUG] [MAIN ] TYL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:49.285363] [INFO ] [MAIN ] TYL: Generated 1339 derivative records from 16482 primary records. [2025-09-16T21:21:49.285568] [DEBUG] [LOCAL ] TYL: Saving derivative data. [2025-09-16T21:21:49.309778] [DEBUG] [LOCAL ] TYL: Derivative data saved (1339 records). [2025-09-16T21:21:49.310875] [INFO ] [MAIN ] TYL: Successfully saved derivative data. [2025-09-16T21:21:49.313413] [INFO ] [MAIN ] Derivative Progress: 1842/2026 symbols completed. TYL took 1.0s. Estimated remaining: 59.7s. Rate: 185.0 symbols/min [2025-09-16T21:21:49.324158] [INFO ] [MAIN ] UAA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:49.324682] [DEBUG] [MAIN ] U: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:49.326499] [INFO ] [MAIN ] U: Generated 1339 derivative records from 40149 primary records. [2025-09-16T21:21:49.326865] [DEBUG] [LOCAL ] U: Saving derivative data. [2025-09-16T21:21:49.358082] [DEBUG] [MAIN ] UA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:49.359936] [DEBUG] [LOCAL ] U: Derivative data saved (1339 records). [2025-09-16T21:21:49.360124] [INFO ] [MAIN ] U: Successfully saved derivative data. [2025-09-16T21:21:49.362844] [INFO ] [MAIN ] Derivative Progress: 1843/2026 symbols completed. U took 1.1s. Estimated remaining: 59.3s. Rate: 185.1 symbols/min [2025-09-16T21:21:49.361042] [INFO ] [MAIN ] UA: Generated 1339 derivative records from 37234 primary records. [2025-09-16T21:21:49.363075] [DEBUG] [LOCAL ] UA: Saving derivative data. [2025-09-16T21:21:49.379436] [DEBUG] [LOCAL ] UA: Derivative data saved (1339 records). [2025-09-16T21:21:49.379597] [INFO ] [MAIN ] UA: Successfully saved derivative data. [2025-09-16T21:21:49.384179] [INFO ] [MAIN ] Derivative Progress: 1844/2026 symbols completed. UA took 1.0s. Estimated remaining: 59.0s. Rate: 185.2 symbols/min [2025-09-16T21:21:49.413009] [DEBUG] [LOCAL ] UAA: Loaded 39875 existing records from primary storage. [2025-09-16T21:21:49.413189] [INFO ] [MAIN ] UAA: Loaded 39875 primary data records. [2025-09-16T21:21:49.760751] [DEBUG] [MAIN ] UAA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:49.761826] [INFO ] [MAIN ] UAA: Generated 1339 derivative records from 39875 primary records. [2025-09-16T21:21:49.761935] [DEBUG] [LOCAL ] UAA: Saving derivative data. [2025-09-16T21:21:49.780411] [DEBUG] [LOCAL ] UAA: Derivative data saved (1339 records). [2025-09-16T21:21:49.780603] [INFO ] [MAIN ] UAA: Successfully saved derivative data. [2025-09-16T21:21:49.782784] [INFO ] [MAIN ] Derivative Progress: 1845/2026 symbols completed. UAA took 0.5s. Estimated remaining: 58.7s. Rate: 185.1 symbols/min [2025-09-16T21:21:49.783900] [INFO ] [MAIN ] UBS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:49.784139] [INFO ] [MAIN ] UCB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:49.784055] [INFO ] [MAIN ] UBER: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:49.830244] [DEBUG] [LOCAL ] UCB: Loaded 27510 existing records from primary storage. [2025-09-16T21:21:49.830845] [INFO ] [MAIN ] UCB: Loaded 27510 primary data records. [2025-09-16T21:21:50.031544] [DEBUG] [LOCAL ] UBER: Loaded 40156 existing records from primary storage. [2025-09-16T21:21:50.037264] [INFO ] [MAIN ] UBER: Loaded 40156 primary data records. [2025-09-16T21:21:50.063892] [DEBUG] [LOCAL ] UBS: Loaded 38933 existing records from primary storage. [2025-09-16T21:21:50.094754] [INFO ] [MAIN ] UBS: Loaded 38933 primary data records. [2025-09-16T21:21:50.897424] [DEBUG] [MAIN ] UCB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:50.908149] [INFO ] [MAIN ] UCB: Generated 1339 derivative records from 27510 primary records. [2025-09-16T21:21:50.908806] [DEBUG] [MAIN ] UBER: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:50.908890] [DEBUG] [LOCAL ] UCB: Saving derivative data. [2025-09-16T21:21:50.917344] [INFO ] [MAIN ] UBER: Generated 1339 derivative records from 40156 primary records. [2025-09-16T21:21:50.920972] [DEBUG] [LOCAL ] UBER: Saving derivative data. [2025-09-16T21:21:50.937415] [DEBUG] [LOCAL ] UBER: Derivative data saved (1339 records). [2025-09-16T21:21:50.937680] [INFO ] [MAIN ] UBER: Successfully saved derivative data. [2025-09-16T21:21:50.934630] [DEBUG] [LOCAL ] UCB: Derivative data saved (1339 records). [2025-09-16T21:21:50.945706] [INFO ] [MAIN ] Derivative Progress: 1846/2026 symbols completed. UBER took 1.2s. Estimated remaining: 58.4s. Rate: 184.9 symbols/min [2025-09-16T21:21:50.949316] [INFO ] [MAIN ] UCB: Successfully saved derivative data. [2025-09-16T21:21:50.951826] [INFO ] [MAIN ] UDR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:50.952002] [INFO ] [MAIN ] Derivative Progress: 1847/2026 symbols completed. UCB took 1.2s. Estimated remaining: 58.1s. Rate: 185.0 symbols/min [2025-09-16T21:21:50.952298] [DEBUG] [MAIN ] UBS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:50.953502] [INFO ] [MAIN ] UBS: Generated 1339 derivative records from 38933 primary records. [2025-09-16T21:21:50.953968] [INFO ] [MAIN ] UE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:50.956831] [DEBUG] [LOCAL ] UBS: Saving derivative data. [2025-09-16T21:21:50.970893] [DEBUG] [LOCAL ] UBS: Derivative data saved (1339 records). [2025-09-16T21:21:50.970986] [INFO ] [MAIN ] UBS: Successfully saved derivative data. [2025-09-16T21:21:50.973535] [INFO ] [MAIN ] Derivative Progress: 1848/2026 symbols completed. UBS took 1.2s. Estimated remaining: 57.7s. Rate: 185.1 symbols/min [2025-09-16T21:21:50.973847] [INFO ] [MAIN ] UFI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:50.999523] [DEBUG] [LOCAL ] UFI: Loaded 5514 existing records from primary storage. [2025-09-16T21:21:50.999676] [INFO ] [MAIN ] UFI: Loaded 5514 primary data records. [2025-09-16T21:21:51.125561] [DEBUG] [LOCAL ] UE: Loaded 31985 existing records from primary storage. [2025-09-16T21:21:51.126209] [DEBUG] [LOCAL ] UDR: Loaded 38694 existing records from primary storage. [2025-09-16T21:21:51.131924] [INFO ] [MAIN ] UE: Loaded 31985 primary data records. [2025-09-16T21:21:51.131866] [INFO ] [MAIN ] UDR: Loaded 38694 primary data records. [2025-09-16T21:21:51.875876] [DEBUG] [MAIN ] UFI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:51.877125] [INFO ] [MAIN ] UFI: Generated 1339 derivative records from 5514 primary records. [2025-09-16T21:21:51.877443] [DEBUG] [LOCAL ] UFI: Saving derivative data. [2025-09-16T21:21:51.893061] [DEBUG] [LOCAL ] UFI: Derivative data saved (1339 records). [2025-09-16T21:21:51.912091] [DEBUG] [MAIN ] UE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:51.913361] [DEBUG] [MAIN ] UDR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:51.913125] [INFO ] [MAIN ] UE: Generated 1339 derivative records from 31985 primary records. [2025-09-16T21:21:51.914055] [INFO ] [MAIN ] UDR: Generated 1339 derivative records from 38694 primary records. [2025-09-16T21:21:51.913427] [INFO ] [MAIN ] UFI: Successfully saved derivative data. [2025-09-16T21:21:51.915860] [INFO ] [MAIN ] Derivative Progress: 1849/2026 symbols completed. UFI took 0.9s. Estimated remaining: 57.4s. Rate: 184.9 symbols/min [2025-09-16T21:21:51.914150] [DEBUG] [LOCAL ] UE: Saving derivative data. [2025-09-16T21:21:51.914199] [DEBUG] [LOCAL ] UDR: Saving derivative data. [2025-09-16T21:21:51.917014] [INFO ] [MAIN ] UGI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:51.942701] [DEBUG] [LOCAL ] UDR: Derivative data saved (1339 records). [2025-09-16T21:21:51.944910] [INFO ] [MAIN ] UDR: Successfully saved derivative data. [2025-09-16T21:21:51.947021] [INFO ] [MAIN ] Derivative Progress: 1850/2026 symbols completed. UDR took 1.0s. Estimated remaining: 57.1s. Rate: 185.0 symbols/min [2025-09-16T21:21:51.947291] [INFO ] [MAIN ] UGP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:51.944817] [DEBUG] [LOCAL ] UE: Derivative data saved (1339 records). [2025-09-16T21:21:51.947775] [INFO ] [MAIN ] UE: Successfully saved derivative data. [2025-09-16T21:21:51.949910] [INFO ] [MAIN ] Derivative Progress: 1851/2026 symbols completed. UE took 1.0s. Estimated remaining: 56.7s. Rate: 185.1 symbols/min [2025-09-16T21:21:51.950263] [INFO ] [MAIN ] UHAL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:51.973193] [DEBUG] [LOCAL ] UHAL: Loaded 12408 existing records from primary storage. [2025-09-16T21:21:51.973441] [INFO ] [MAIN ] UHAL: Loaded 12408 primary data records. [2025-09-16T21:21:52.084500] [DEBUG] [LOCAL ] UGI: Loaded 37549 existing records from primary storage. [2025-09-16T21:21:52.094135] [INFO ] [MAIN ] UGI: Loaded 37549 primary data records. [2025-09-16T21:21:52.129827] [DEBUG] [LOCAL ] UGP: Loaded 31714 existing records from primary storage. [2025-09-16T21:21:52.199780] [INFO ] [MAIN ] UGP: Loaded 31714 primary data records. [2025-09-16T21:21:52.840797] [DEBUG] [MAIN ] UHAL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:52.841820] [INFO ] [MAIN ] UHAL: Generated 1339 derivative records from 12408 primary records. [2025-09-16T21:21:52.841928] [DEBUG] [LOCAL ] UHAL: Saving derivative data. [2025-09-16T21:21:52.867671] [DEBUG] [LOCAL ] UHAL: Derivative data saved (1339 records). [2025-09-16T21:21:52.877250] [INFO ] [MAIN ] UHAL: Successfully saved derivative data. [2025-09-16T21:21:52.879444] [INFO ] [MAIN ] Derivative Progress: 1852/2026 symbols completed. UHAL took 0.9s. Estimated remaining: 56.5s. Rate: 184.9 symbols/min [2025-09-16T21:21:52.877838] [DEBUG] [MAIN ] UGP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:52.880038] [DEBUG] [MAIN ] UGI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:52.881360] [INFO ] [MAIN ] UGP: Generated 1339 derivative records from 31714 primary records. [2025-09-16T21:21:52.879696] [INFO ] [MAIN ] UHS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:52.880878] [INFO ] [MAIN ] UGI: Generated 1339 derivative records from 37549 primary records. [2025-09-16T21:21:52.881510] [DEBUG] [LOCAL ] UGP: Saving derivative data. [2025-09-16T21:21:52.882257] [DEBUG] [LOCAL ] UGI: Saving derivative data. [2025-09-16T21:21:52.905021] [DEBUG] [LOCAL ] UGP: Derivative data saved (1339 records). [2025-09-16T21:21:52.907728] [DEBUG] [LOCAL ] UGI: Derivative data saved (1339 records). [2025-09-16T21:21:52.906795] [INFO ] [MAIN ] UGP: Successfully saved derivative data. [2025-09-16T21:21:52.909721] [INFO ] [MAIN ] UGI: Successfully saved derivative data. [2025-09-16T21:21:52.909660] [INFO ] [MAIN ] Derivative Progress: 1853/2026 symbols completed. UGP took 1.0s. Estimated remaining: 56.1s. Rate: 185.0 symbols/min [2025-09-16T21:21:52.912390] [INFO ] [MAIN ] Derivative Progress: 1854/2026 symbols completed. UGI took 1.0s. Estimated remaining: 55.8s. Rate: 185.1 symbols/min [2025-09-16T21:21:52.912707] [INFO ] [MAIN ] UI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:52.912499] [INFO ] [MAIN ] UHT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:52.937837] [DEBUG] [LOCAL ] UHT: Loaded 7210 existing records from primary storage. [2025-09-16T21:21:52.937994] [INFO ] [MAIN ] UHT: Loaded 7210 primary data records. [2025-09-16T21:21:53.008609] [DEBUG] [LOCAL ] UI: Loaded 9552 existing records from primary storage. [2025-09-16T21:21:53.031018] [INFO ] [MAIN ] UI: Loaded 9552 primary data records. [2025-09-16T21:21:53.068615] [DEBUG] [LOCAL ] UHS: Loaded 30267 existing records from primary storage. [2025-09-16T21:21:53.099426] [INFO ] [MAIN ] UHS: Loaded 30267 primary data records. [2025-09-16T21:21:53.805801] [DEBUG] [MAIN ] UHT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:53.806837] [INFO ] [MAIN ] UHT: Generated 1339 derivative records from 7210 primary records. [2025-09-16T21:21:53.807882] [DEBUG] [LOCAL ] UHT: Saving derivative data. [2025-09-16T21:21:53.830898] [DEBUG] [MAIN ] UI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:53.831928] [DEBUG] [LOCAL ] UHT: Derivative data saved (1339 records). [2025-09-16T21:21:53.832602] [INFO ] [MAIN ] UHT: Successfully saved derivative data. [2025-09-16T21:21:53.834350] [INFO ] [MAIN ] Derivative Progress: 1855/2026 symbols completed. UHT took 0.9s. Estimated remaining: 55.5s. Rate: 184.9 symbols/min [2025-09-16T21:21:53.832456] [INFO ] [MAIN ] UI: Generated 1339 derivative records from 9552 primary records. [2025-09-16T21:21:53.835451] [INFO ] [MAIN ] UIS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:53.834675] [DEBUG] [LOCAL ] UI: Saving derivative data. [2025-09-16T21:21:53.860487] [DEBUG] [MAIN ] UHS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:53.861237] [DEBUG] [LOCAL ] UI: Derivative data saved (1339 records). [2025-09-16T21:21:53.861927] [INFO ] [MAIN ] UHS: Generated 1339 derivative records from 30267 primary records. [2025-09-16T21:21:53.862006] [INFO ] [MAIN ] UI: Successfully saved derivative data. [2025-09-16T21:21:53.864368] [DEBUG] [LOCAL ] UHS: Saving derivative data. [2025-09-16T21:21:53.864285] [INFO ] [MAIN ] Derivative Progress: 1856/2026 symbols completed. UI took 1.0s. Estimated remaining: 55.1s. Rate: 185.0 symbols/min [2025-09-16T21:21:53.865668] [INFO ] [MAIN ] UL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:53.886790] [DEBUG] [LOCAL ] UHS: Derivative data saved (1339 records). [2025-09-16T21:21:53.886948] [INFO ] [MAIN ] UHS: Successfully saved derivative data. [2025-09-16T21:21:53.888953] [INFO ] [MAIN ] Derivative Progress: 1857/2026 symbols completed. UHS took 1.0s. Estimated remaining: 54.8s. Rate: 185.1 symbols/min [2025-09-16T21:21:53.889292] [INFO ] [MAIN ] ULS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:53.899522] [DEBUG] [LOCAL ] UIS: Loaded 27701 existing records from primary storage. [2025-09-16T21:21:53.899691] [INFO ] [MAIN ] UIS: Loaded 27701 primary data records. [2025-09-16T21:21:54.207564] [DEBUG] [LOCAL ] UL: Loaded 39494 existing records from primary storage. [2025-09-16T21:21:54.208160] [INFO ] [MAIN ] UL: Loaded 39494 primary data records. [2025-09-16T21:21:54.208751] [DEBUG] [LOCAL ] ULS: Loaded 29182 existing records from primary storage. [2025-09-16T21:21:54.208895] [INFO ] [MAIN ] ULS: Loaded 29182 primary data records. [2025-09-16T21:21:54.765540] [DEBUG] [MAIN ] UIS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:54.767287] [INFO ] [MAIN ] UIS: Generated 1339 derivative records from 27701 primary records. [2025-09-16T21:21:54.767563] [DEBUG] [LOCAL ] UIS: Saving derivative data. [2025-09-16T21:21:54.780770] [DEBUG] [LOCAL ] UIS: Derivative data saved (1339 records). [2025-09-16T21:21:54.780922] [INFO ] [MAIN ] UIS: Successfully saved derivative data. [2025-09-16T21:21:54.783028] [INFO ] [MAIN ] Derivative Progress: 1858/2026 symbols completed. UIS took 0.9s. Estimated remaining: 54.5s. Rate: 184.9 symbols/min [2025-09-16T21:21:54.796628] [DEBUG] [MAIN ] ULS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:54.797245] [INFO ] [MAIN ] ULS: Generated 1339 derivative records from 29182 primary records. [2025-09-16T21:21:54.797663] [DEBUG] [LOCAL ] ULS: Saving derivative data. [2025-09-16T21:21:54.817862] [DEBUG] [MAIN ] UL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:54.818794] [INFO ] [MAIN ] UL: Generated 1339 derivative records from 39494 primary records. [2025-09-16T21:21:54.819193] [DEBUG] [LOCAL ] UL: Saving derivative data. [2025-09-16T21:21:54.820371] [DEBUG] [LOCAL ] ULS: Derivative data saved (1339 records). [2025-09-16T21:21:54.820585] [INFO ] [MAIN ] ULS: Successfully saved derivative data. [2025-09-16T21:21:54.822249] [INFO ] [MAIN ] Derivative Progress: 1859/2026 symbols completed. ULS took 0.9s. Estimated remaining: 54.2s. Rate: 185.0 symbols/min [2025-09-16T21:21:54.833253] [DEBUG] [LOCAL ] UL: Derivative data saved (1339 records). [2025-09-16T21:21:54.833311] [INFO ] [MAIN ] UL: Successfully saved derivative data. [2025-09-16T21:21:54.836061] [INFO ] [MAIN ] Derivative Progress: 1860/2026 symbols completed. UL took 1.0s. Estimated remaining: 53.8s. Rate: 185.1 symbols/min [2025-09-16T21:21:54.836533] [INFO ] [MAIN ] UMC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:54.836759] [INFO ] [MAIN ] UMH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:54.836634] [INFO ] [MAIN ] UNF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:54.848528] [DEBUG] [LOCAL ] UNF: Loaded 7936 existing records from primary storage. [2025-09-16T21:21:54.848733] [INFO ] [MAIN ] UNF: Loaded 7936 primary data records. [2025-09-16T21:21:54.987290] [DEBUG] [LOCAL ] UMH: Loaded 24358 existing records from primary storage. [2025-09-16T21:21:55.002816] [INFO ] [MAIN ] UMH: Loaded 24358 primary data records. [2025-09-16T21:21:55.135815] [DEBUG] [LOCAL ] UMC: Loaded 39172 existing records from primary storage. [2025-09-16T21:21:55.247979] [INFO ] [MAIN ] UMC: Loaded 39172 primary data records. [2025-09-16T21:21:55.742239] [DEBUG] [MAIN ] UNF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:55.742892] [INFO ] [MAIN ] UNF: Generated 1339 derivative records from 7936 primary records. [2025-09-16T21:21:55.743103] [DEBUG] [LOCAL ] UNF: Saving derivative data. [2025-09-16T21:21:55.757161] [DEBUG] [LOCAL ] UNF: Derivative data saved (1339 records). [2025-09-16T21:21:55.757344] [INFO ] [MAIN ] UNF: Successfully saved derivative data. [2025-09-16T21:21:55.758890] [INFO ] [MAIN ] Derivative Progress: 1861/2026 symbols completed. UNF took 0.9s. Estimated remaining: 53.5s. Rate: 184.9 symbols/min [2025-09-16T21:21:55.769236] [INFO ] [MAIN ] UNFI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:55.768500] [DEBUG] [MAIN ] UMH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:55.771009] [INFO ] [MAIN ] UMH: Generated 1339 derivative records from 24358 primary records. [2025-09-16T21:21:55.771712] [DEBUG] [LOCAL ] UMH: Saving derivative data. [2025-09-16T21:21:55.788717] [DEBUG] [MAIN ] UMC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:55.794158] [DEBUG] [LOCAL ] UMH: Derivative data saved (1339 records). [2025-09-16T21:21:55.792352] [INFO ] [MAIN ] UMC: Generated 1339 derivative records from 39172 primary records. [2025-09-16T21:21:55.794303] [INFO ] [MAIN ] UMH: Successfully saved derivative data. [2025-09-16T21:21:55.796516] [INFO ] [MAIN ] Derivative Progress: 1862/2026 symbols completed. UMH took 1.0s. Estimated remaining: 53.2s. Rate: 185.0 symbols/min [2025-09-16T21:21:55.796601] [DEBUG] [LOCAL ] UMC: Saving derivative data. [2025-09-16T21:21:55.797842] [INFO ] [MAIN ] UNH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:55.819292] [DEBUG] [LOCAL ] UMC: Derivative data saved (1339 records). [2025-09-16T21:21:55.819515] [INFO ] [MAIN ] UMC: Successfully saved derivative data. [2025-09-16T21:21:55.821794] [INFO ] [MAIN ] Derivative Progress: 1863/2026 symbols completed. UMC took 1.0s. Estimated remaining: 52.8s. Rate: 185.1 symbols/min [2025-09-16T21:21:55.822089] [INFO ] [MAIN ] UNM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:55.835713] [DEBUG] [LOCAL ] UNFI: Loaded 31439 existing records from primary storage. [2025-09-16T21:21:55.836858] [INFO ] [MAIN ] UNFI: Loaded 31439 primary data records. [2025-09-16T21:21:56.137088] [DEBUG] [LOCAL ] UNH: Loaded 40169 existing records from primary storage. [2025-09-16T21:21:56.137594] [DEBUG] [LOCAL ] UNM: Loaded 35962 existing records from primary storage. [2025-09-16T21:21:56.137759] [INFO ] [MAIN ] UNH: Loaded 40169 primary data records. [2025-09-16T21:21:56.137796] [INFO ] [MAIN ] UNM: Loaded 35962 primary data records. [2025-09-16T21:21:56.683691] [DEBUG] [MAIN ] UNFI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:56.685275] [INFO ] [MAIN ] UNFI: Generated 1339 derivative records from 31439 primary records. [2025-09-16T21:21:56.686092] [DEBUG] [LOCAL ] UNFI: Saving derivative data. [2025-09-16T21:21:56.701481] [DEBUG] [LOCAL ] UNFI: Derivative data saved (1339 records). [2025-09-16T21:21:56.701824] [INFO ] [MAIN ] UNFI: Successfully saved derivative data. [2025-09-16T21:21:56.704188] [INFO ] [MAIN ] Derivative Progress: 1864/2026 symbols completed. UNFI took 0.9s. Estimated remaining: 52.6s. Rate: 184.9 symbols/min [2025-09-16T21:21:56.705018] [INFO ] [MAIN ] UNMA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:56.713540] [DEBUG] [LOCAL ] UNMA: Loaded 2628 existing records from primary storage. [2025-09-16T21:21:56.733252] [INFO ] [MAIN ] UNMA: Loaded 2628 primary data records. [2025-09-16T21:21:56.733800] [DEBUG] [MAIN ] UNM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:56.739552] [DEBUG] [MAIN ] UNH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:56.782581] [INFO ] [MAIN ] UNH: Generated 1339 derivative records from 40169 primary records. [2025-09-16T21:21:56.757730] [INFO ] [MAIN ] UNM: Generated 1339 derivative records from 35962 primary records. [2025-09-16T21:21:56.822391] [DEBUG] [LOCAL ] UNM: Saving derivative data. [2025-09-16T21:21:56.817217] [DEBUG] [LOCAL ] UNH: Saving derivative data. [2025-09-16T21:21:56.910025] [DEBUG] [LOCAL ] UNM: Derivative data saved (1339 records). [2025-09-16T21:21:56.917813] [INFO ] [MAIN ] UNM: Successfully saved derivative data. [2025-09-16T21:21:56.941857] [INFO ] [MAIN ] Derivative Progress: 1865/2026 symbols completed. UNM took 1.1s. Estimated remaining: 52.2s. Rate: 184.9 symbols/min [2025-09-16T21:21:57.029727] [INFO ] [MAIN ] UP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:57.029324] [DEBUG] [LOCAL ] UNH: Derivative data saved (1339 records). [2025-09-16T21:21:57.029980] [INFO ] [MAIN ] UNH: Successfully saved derivative data. [2025-09-16T21:21:57.031880] [INFO ] [MAIN ] Derivative Progress: 1866/2026 symbols completed. UNH took 1.2s. Estimated remaining: 51.9s. Rate: 185.0 symbols/min [2025-09-16T21:21:57.032177] [INFO ] [MAIN ] URI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:57.058682] [DEBUG] [MAIN ] UNMA: Filtered 5181 bins outside market hours, 5780 incomplete bins [2025-09-16T21:21:57.066024] [INFO ] [MAIN ] UNMA: Generated 1338 derivative records from 2628 primary records. [2025-09-16T21:21:57.066164] [DEBUG] [LOCAL ] UNMA: Saving derivative data. [2025-09-16T21:21:57.078044] [DEBUG] [LOCAL ] UNMA: Derivative data saved (1338 records). [2025-09-16T21:21:57.078219] [INFO ] [MAIN ] UNMA: Successfully saved derivative data. [2025-09-16T21:21:57.088017] [INFO ] [MAIN ] Derivative Progress: 1867/2026 symbols completed. UNMA took 0.4s. Estimated remaining: 51.5s. Rate: 185.1 symbols/min [2025-09-16T21:21:57.097111] [INFO ] [MAIN ] USA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:57.098222] [DEBUG] [LOCAL ] URI: Loaded 25957 existing records from primary storage. [2025-09-16T21:21:57.098404] [INFO ] [MAIN ] URI: Loaded 25957 primary data records. [2025-09-16T21:21:57.099038] [DEBUG] [LOCAL ] UP: Loaded 32050 existing records from primary storage. [2025-09-16T21:21:57.104844] [INFO ] [MAIN ] UP: Loaded 32050 primary data records. [2025-09-16T21:21:57.469402] [DEBUG] [LOCAL ] USA: Loaded 26152 existing records from primary storage. [2025-09-16T21:21:57.646718] [INFO ] [MAIN ] USA: Loaded 26152 primary data records. [2025-09-16T21:21:58.003002] [DEBUG] [MAIN ] UP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:58.004096] [INFO ] [MAIN ] UP: Generated 1339 derivative records from 32050 primary records. [2025-09-16T21:21:58.003468] [DEBUG] [MAIN ] URI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:58.004695] [INFO ] [MAIN ] URI: Generated 1339 derivative records from 25957 primary records. [2025-09-16T21:21:58.005369] [DEBUG] [LOCAL ] UP: Saving derivative data. [2025-09-16T21:21:58.005463] [DEBUG] [LOCAL ] URI: Saving derivative data. [2025-09-16T21:21:58.024292] [DEBUG] [LOCAL ] URI: Derivative data saved (1339 records). [2025-09-16T21:21:58.026252] [INFO ] [MAIN ] URI: Successfully saved derivative data. [2025-09-16T21:21:58.029092] [DEBUG] [LOCAL ] UP: Derivative data saved (1339 records). [2025-09-16T21:21:58.029263] [INFO ] [MAIN ] UP: Successfully saved derivative data. [2025-09-16T21:21:58.031431] [INFO ] [MAIN ] Derivative Progress: 1868/2026 symbols completed. URI took 1.0s. Estimated remaining: 51.3s. Rate: 184.9 symbols/min [2025-09-16T21:21:58.033331] [INFO ] [MAIN ] Derivative Progress: 1869/2026 symbols completed. UP took 1.0s. Estimated remaining: 50.9s. Rate: 185.0 symbols/min [2025-09-16T21:21:58.033147] [INFO ] [MAIN ] USAC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:58.033851] [INFO ] [MAIN ] USFD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:58.049009] [DEBUG] [MAIN ] USA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:58.049723] [INFO ] [MAIN ] USA: Generated 1339 derivative records from 26152 primary records. [2025-09-16T21:21:58.053825] [DEBUG] [LOCAL ] USA: Saving derivative data. [2025-09-16T21:21:58.072870] [DEBUG] [LOCAL ] USA: Derivative data saved (1339 records). [2025-09-16T21:21:58.072801] [DEBUG] [LOCAL ] USAC: Loaded 15856 existing records from primary storage. [2025-09-16T21:21:58.073007] [INFO ] [MAIN ] USA: Successfully saved derivative data. [2025-09-16T21:21:58.075060] [INFO ] [MAIN ] Derivative Progress: 1870/2026 symbols completed. USA took 1.0s. Estimated remaining: 50.6s. Rate: 185.1 symbols/min [2025-09-16T21:21:58.073074] [INFO ] [MAIN ] USAC: Loaded 15856 primary data records. [2025-09-16T21:21:58.075398] [INFO ] [MAIN ] USNA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:58.234887] [DEBUG] [LOCAL ] USFD: Loaded 38200 existing records from primary storage. [2025-09-16T21:21:58.263713] [INFO ] [MAIN ] USFD: Loaded 38200 primary data records. [2025-09-16T21:21:58.389566] [DEBUG] [LOCAL ] USNA: Loaded 12855 existing records from primary storage. [2025-09-16T21:21:58.414442] [INFO ] [MAIN ] USNA: Loaded 12855 primary data records. [2025-09-16T21:21:58.929004] [DEBUG] [MAIN ] USAC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:58.930030] [INFO ] [MAIN ] USAC: Generated 1339 derivative records from 15856 primary records. [2025-09-16T21:21:58.930288] [DEBUG] [LOCAL ] USAC: Saving derivative data. [2025-09-16T21:21:58.942814] [DEBUG] [LOCAL ] USAC: Derivative data saved (1339 records). [2025-09-16T21:21:58.943214] [INFO ] [MAIN ] USAC: Successfully saved derivative data. [2025-09-16T21:21:58.945306] [INFO ] [MAIN ] Derivative Progress: 1871/2026 symbols completed. USAC took 0.9s. Estimated remaining: 50.3s. Rate: 184.9 symbols/min [2025-09-16T21:21:58.946430] [INFO ] [MAIN ] USPH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:58.960857] [DEBUG] [MAIN ] USFD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:58.964547] [INFO ] [MAIN ] USFD: Generated 1339 derivative records from 38200 primary records. [2025-09-16T21:21:58.964784] [DEBUG] [LOCAL ] USFD: Saving derivative data. [2025-09-16T21:21:58.981617] [DEBUG] [LOCAL ] USPH: Loaded 12501 existing records from primary storage. [2025-09-16T21:21:58.985106] [INFO ] [MAIN ] USPH: Loaded 12501 primary data records. [2025-09-16T21:21:58.985043] [DEBUG] [LOCAL ] USFD: Derivative data saved (1339 records). [2025-09-16T21:21:59.015731] [DEBUG] [MAIN ] USNA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:58.994465] [INFO ] [MAIN ] USFD: Successfully saved derivative data. [2025-09-16T21:21:59.050320] [INFO ] [MAIN ] USNA: Generated 1339 derivative records from 12855 primary records. [2025-09-16T21:21:59.088602] [DEBUG] [LOCAL ] USNA: Saving derivative data. [2025-09-16T21:21:59.082999] [INFO ] [MAIN ] Derivative Progress: 1872/2026 symbols completed. USFD took 1.0s. Estimated remaining: 50.0s. Rate: 185.0 symbols/min [2025-09-16T21:21:59.099450] [INFO ] [MAIN ] UTF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:59.268439] [DEBUG] [LOCAL ] USNA: Derivative data saved (1339 records). [2025-09-16T21:21:59.269063] [INFO ] [MAIN ] USNA: Successfully saved derivative data. [2025-09-16T21:21:59.271028] [INFO ] [MAIN ] Derivative Progress: 1873/2026 symbols completed. USNA took 1.2s. Estimated remaining: 49.6s. Rate: 185.0 symbols/min [2025-09-16T21:21:59.286163] [DEBUG] [LOCAL ] UTF: Loaded 20137 existing records from primary storage. [2025-09-16T21:21:59.286849] [INFO ] [MAIN ] UTF: Loaded 20137 primary data records. [2025-09-16T21:21:59.560829] [DEBUG] [MAIN ] USPH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:59.561476] [INFO ] [MAIN ] USPH: Generated 1339 derivative records from 12501 primary records. [2025-09-16T21:21:59.561539] [DEBUG] [LOCAL ] USPH: Saving derivative data. [2025-09-16T21:21:59.574530] [DEBUG] [LOCAL ] USPH: Derivative data saved (1339 records). [2025-09-16T21:21:59.574805] [INFO ] [MAIN ] USPH: Successfully saved derivative data. [2025-09-16T21:21:59.576781] [INFO ] [MAIN ] Derivative Progress: 1874/2026 symbols completed. USPH took 0.6s. Estimated remaining: 49.3s. Rate: 185.0 symbols/min [2025-09-16T21:21:59.592368] [DEBUG] [MAIN ] UTF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:21:59.592972] [INFO ] [MAIN ] UTF: Generated 1339 derivative records from 20137 primary records. [2025-09-16T21:21:59.593032] [DEBUG] [LOCAL ] UTF: Saving derivative data. [2025-09-16T21:21:59.604680] [DEBUG] [LOCAL ] UTF: Derivative data saved (1339 records). [2025-09-16T21:21:59.604742] [INFO ] [MAIN ] UTF: Successfully saved derivative data. [2025-09-16T21:21:59.606976] [INFO ] [MAIN ] Derivative Progress: 1875/2026 symbols completed. UTF took 0.5s. Estimated remaining: 48.9s. Rate: 185.1 symbols/min [2025-09-16T21:21:59.607464] [INFO ] [MAIN ] UTI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:59.607576] [INFO ] [MAIN ] UTZ: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:59.607725] [INFO ] [MAIN ] UTL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:21:59.619116] [DEBUG] [LOCAL ] UTL: Loaded 8545 existing records from primary storage. [2025-09-16T21:21:59.619387] [INFO ] [MAIN ] UTL: Loaded 8545 primary data records. [2025-09-16T21:21:59.800692] [DEBUG] [LOCAL ] UTI: Loaded 30039 existing records from primary storage. [2025-09-16T21:21:59.816155] [INFO ] [MAIN ] UTI: Loaded 30039 primary data records. [2025-09-16T21:21:59.832759] [DEBUG] [LOCAL ] UTZ: Loaded 33183 existing records from primary storage. [2025-09-16T21:21:59.858418] [INFO ] [MAIN ] UTZ: Loaded 33183 primary data records. [2025-09-16T21:22:00.517945] [DEBUG] [MAIN ] UTL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:00.519138] [INFO ] [MAIN ] UTL: Generated 1339 derivative records from 8545 primary records. [2025-09-16T21:22:00.519242] [DEBUG] [LOCAL ] UTL: Saving derivative data. [2025-09-16T21:22:00.532226] [DEBUG] [LOCAL ] UTL: Derivative data saved (1339 records). [2025-09-16T21:22:00.532431] [INFO ] [MAIN ] UTL: Successfully saved derivative data. [2025-09-16T21:22:00.534074] [INFO ] [MAIN ] Derivative Progress: 1876/2026 symbols completed. UTL took 0.9s. Estimated remaining: 48.7s. Rate: 184.9 symbols/min [2025-09-16T21:22:00.534480] [INFO ] [MAIN ] UVE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:00.547334] [DEBUG] [MAIN ] UTI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:00.548031] [INFO ] [MAIN ] UTI: Generated 1339 derivative records from 30039 primary records. [2025-09-16T21:22:00.548112] [DEBUG] [LOCAL ] UTI: Saving derivative data. [2025-09-16T21:22:00.575329] [DEBUG] [LOCAL ] UTI: Derivative data saved (1339 records). [2025-09-16T21:22:00.575620] [INFO ] [MAIN ] UTI: Successfully saved derivative data. [2025-09-16T21:22:00.577998] [INFO ] [MAIN ] Derivative Progress: 1877/2026 symbols completed. UTI took 1.0s. Estimated remaining: 48.3s. Rate: 185.0 symbols/min [2025-09-16T21:22:00.575836] [DEBUG] [MAIN ] UTZ: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:00.584490] [INFO ] [MAIN ] UVV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:00.584135] [INFO ] [MAIN ] UTZ: Generated 1339 derivative records from 33183 primary records. [2025-09-16T21:22:00.585096] [DEBUG] [LOCAL ] UVE: Loaded 16896 existing records from primary storage. [2025-09-16T21:22:00.585192] [INFO ] [MAIN ] UVE: Loaded 16896 primary data records. [2025-09-16T21:22:00.584698] [DEBUG] [LOCAL ] UTZ: Saving derivative data. [2025-09-16T21:22:00.715090] [DEBUG] [LOCAL ] UTZ: Derivative data saved (1339 records). [2025-09-16T21:22:00.731751] [DEBUG] [LOCAL ] UVV: Loaded 17480 existing records from primary storage. [2025-09-16T21:22:00.720662] [INFO ] [MAIN ] UTZ: Successfully saved derivative data. [2025-09-16T21:22:00.766353] [INFO ] [MAIN ] Derivative Progress: 1878/2026 symbols completed. UTZ took 1.2s. Estimated remaining: 48.0s. Rate: 185.0 symbols/min [2025-09-16T21:22:00.742176] [INFO ] [MAIN ] UVV: Loaded 17480 primary data records. [2025-09-16T21:22:00.793192] [INFO ] [MAIN ] UWMC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:01.192246] [DEBUG] [LOCAL ] UWMC: Loaded 39396 existing records from primary storage. [2025-09-16T21:22:01.193008] [INFO ] [MAIN ] UWMC: Loaded 39396 primary data records. [2025-09-16T21:22:01.214345] [DEBUG] [MAIN ] UVE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:01.280711] [INFO ] [MAIN ] UVE: Generated 1339 derivative records from 16896 primary records. [2025-09-16T21:22:01.305167] [DEBUG] [LOCAL ] UVE: Saving derivative data. [2025-09-16T21:22:01.394604] [DEBUG] [LOCAL ] UVE: Derivative data saved (1339 records). [2025-09-16T21:22:01.394816] [INFO ] [MAIN ] UVE: Successfully saved derivative data. [2025-09-16T21:22:01.480324] [INFO ] [MAIN ] Derivative Progress: 1879/2026 symbols completed. UVE took 0.9s. Estimated remaining: 47.7s. Rate: 184.9 symbols/min [2025-09-16T21:22:01.483305] [INFO ] [MAIN ] UZD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:01.494413] [DEBUG] [MAIN ] UVV: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:01.495442] [INFO ] [MAIN ] UVV: Generated 1339 derivative records from 17480 primary records. [2025-09-16T21:22:01.495653] [DEBUG] [LOCAL ] UVV: Saving derivative data. [2025-09-16T21:22:01.509177] [DEBUG] [LOCAL ] UZD: Loaded 4704 existing records from primary storage. [2025-09-16T21:22:01.512143] [INFO ] [MAIN ] UZD: Loaded 4704 primary data records. [2025-09-16T21:22:01.512098] [DEBUG] [LOCAL ] UVV: Derivative data saved (1339 records). [2025-09-16T21:22:01.532843] [INFO ] [MAIN ] UVV: Successfully saved derivative data. [2025-09-16T21:22:01.557056] [INFO ] [MAIN ] Derivative Progress: 1880/2026 symbols completed. UVV took 1.0s. Estimated remaining: 47.4s. Rate: 185.0 symbols/min [2025-09-16T21:22:01.605875] [INFO ] [MAIN ] UZE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:01.706855] [DEBUG] [LOCAL ] UZE: Loaded 5629 existing records from primary storage. [2025-09-16T21:22:01.707391] [DEBUG] [MAIN ] UWMC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:01.791307] [INFO ] [MAIN ] UWMC: Generated 1339 derivative records from 39396 primary records. [2025-09-16T21:22:01.791420] [DEBUG] [LOCAL ] UWMC: Saving derivative data. [2025-09-16T21:22:01.791522] [INFO ] [MAIN ] UZE: Loaded 5629 primary data records. [2025-09-16T21:22:01.854200] [DEBUG] [LOCAL ] UWMC: Derivative data saved (1339 records). [2025-09-16T21:22:01.883193] [INFO ] [MAIN ] UWMC: Successfully saved derivative data. [2025-09-16T21:22:01.902907] [INFO ] [MAIN ] Derivative Progress: 1881/2026 symbols completed. UWMC took 1.1s. Estimated remaining: 47.0s. Rate: 185.0 symbols/min [2025-09-16T21:22:01.914726] [INFO ] [MAIN ] UZF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:02.082166] [DEBUG] [LOCAL ] UZF: Loaded 4680 existing records from primary storage. [2025-09-16T21:22:02.082556] [INFO ] [MAIN ] UZF: Loaded 4680 primary data records. [2025-09-16T21:22:02.221116] [DEBUG] [MAIN ] UZD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:02.237857] [INFO ] [MAIN ] UZD: Generated 1339 derivative records from 4704 primary records. [2025-09-16T21:22:02.238035] [DEBUG] [LOCAL ] UZD: Saving derivative data. [2025-09-16T21:22:02.309965] [DEBUG] [LOCAL ] UZD: Derivative data saved (1339 records). [2025-09-16T21:22:02.310731] [INFO ] [MAIN ] UZD: Successfully saved derivative data. [2025-09-16T21:22:02.312561] [INFO ] [MAIN ] Derivative Progress: 1882/2026 symbols completed. UZD took 0.8s. Estimated remaining: 46.7s. Rate: 185.0 symbols/min [2025-09-16T21:22:02.316274] [INFO ] [MAIN ] V: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:02.457981] [DEBUG] [MAIN ] UZE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:02.459177] [INFO ] [MAIN ] UZE: Generated 1339 derivative records from 5629 primary records. [2025-09-16T21:22:02.459504] [DEBUG] [LOCAL ] UZE: Saving derivative data. [2025-09-16T21:22:02.472008] [DEBUG] [LOCAL ] UZE: Derivative data saved (1339 records). [2025-09-16T21:22:02.472282] [INFO ] [MAIN ] UZE: Successfully saved derivative data. [2025-09-16T21:22:02.474315] [INFO ] [MAIN ] Derivative Progress: 1883/2026 symbols completed. UZE took 0.9s. Estimated remaining: 46.4s. Rate: 185.0 symbols/min [2025-09-16T21:22:02.475164] [INFO ] [MAIN ] VAC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:02.507615] [DEBUG] [MAIN ] UZF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:02.520560] [INFO ] [MAIN ] UZF: Generated 1339 derivative records from 4680 primary records. [2025-09-16T21:22:02.521529] [DEBUG] [LOCAL ] V: Loaded 40114 existing records from primary storage. [2025-09-16T21:22:02.521758] [DEBUG] [LOCAL ] UZF: Saving derivative data. [2025-09-16T21:22:02.522726] [INFO ] [MAIN ] V: Loaded 40114 primary data records. [2025-09-16T21:22:02.572918] [DEBUG] [LOCAL ] UZF: Derivative data saved (1339 records). [2025-09-16T21:22:02.586419] [INFO ] [MAIN ] UZF: Successfully saved derivative data. [2025-09-16T21:22:02.593496] [INFO ] [MAIN ] Derivative Progress: 1884/2026 symbols completed. UZF took 0.7s. Estimated remaining: 46.0s. Rate: 185.1 symbols/min [2025-09-16T21:22:02.613903] [INFO ] [MAIN ] VAL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:02.614462] [DEBUG] [LOCAL ] VAC: Loaded 25381 existing records from primary storage. [2025-09-16T21:22:02.630173] [INFO ] [MAIN ] VAC: Loaded 25381 primary data records. [2025-09-16T21:22:03.064951] [DEBUG] [LOCAL ] VAL: Loaded 37419 existing records from primary storage. [2025-09-16T21:22:03.101383] [INFO ] [MAIN ] VAL: Loaded 37419 primary data records. [2025-09-16T21:22:03.397212] [DEBUG] [MAIN ] V: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:03.398728] [INFO ] [MAIN ] V: Generated 1339 derivative records from 40114 primary records. [2025-09-16T21:22:03.399086] [DEBUG] [LOCAL ] V: Saving derivative data. [2025-09-16T21:22:03.415261] [DEBUG] [LOCAL ] V: Derivative data saved (1339 records). [2025-09-16T21:22:03.415893] [INFO ] [MAIN ] V: Successfully saved derivative data. [2025-09-16T21:22:03.418982] [INFO ] [MAIN ] Derivative Progress: 1885/2026 symbols completed. V took 1.1s. Estimated remaining: 45.7s. Rate: 184.9 symbols/min [2025-09-16T21:22:03.419201] [INFO ] [MAIN ] VALE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:03.431376] [DEBUG] [MAIN ] VAC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:03.432446] [INFO ] [MAIN ] VAC: Generated 1339 derivative records from 25381 primary records. [2025-09-16T21:22:03.432669] [DEBUG] [LOCAL ] VAC: Saving derivative data. [2025-09-16T21:22:03.445814] [DEBUG] [LOCAL ] VAC: Derivative data saved (1339 records). [2025-09-16T21:22:03.446837] [INFO ] [MAIN ] VAC: Successfully saved derivative data. [2025-09-16T21:22:03.449229] [INFO ] [MAIN ] Derivative Progress: 1886/2026 symbols completed. VAC took 1.0s. Estimated remaining: 45.4s. Rate: 185.0 symbols/min [2025-09-16T21:22:03.449728] [INFO ] [MAIN ] VATE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:03.461046] [DEBUG] [MAIN ] VAL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:03.461768] [INFO ] [MAIN ] VAL: Generated 1339 derivative records from 37419 primary records. [2025-09-16T21:22:03.462988] [DEBUG] [LOCAL ] VAL: Saving derivative data. [2025-09-16T21:22:03.476665] [DEBUG] [LOCAL ] VATE: Loaded 3713 existing records from primary storage. [2025-09-16T21:22:03.485402] [INFO ] [MAIN ] VATE: Loaded 3713 primary data records. [2025-09-16T21:22:03.604919] [DEBUG] [LOCAL ] VAL: Derivative data saved (1339 records). [2025-09-16T21:22:03.605351] [INFO ] [MAIN ] VAL: Successfully saved derivative data. [2025-09-16T21:22:03.616346] [DEBUG] [LOCAL ] VALE: Loaded 40045 existing records from primary storage. [2025-09-16T21:22:03.621533] [INFO ] [MAIN ] VALE: Loaded 40045 primary data records. [2025-09-16T21:22:03.667826] [INFO ] [MAIN ] Derivative Progress: 1887/2026 symbols completed. VAL took 1.1s. Estimated remaining: 45.1s. Rate: 185.0 symbols/min [2025-09-16T21:22:03.743521] [INFO ] [MAIN ] VBF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:03.933488] [DEBUG] [LOCAL ] VBF: Loaded 5071 existing records from primary storage. [2025-09-16T21:22:04.042218] [INFO ] [MAIN ] VBF: Loaded 5071 primary data records. [2025-09-16T21:22:04.328913] [DEBUG] [MAIN ] VATE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:04.330522] [INFO ] [MAIN ] VATE: Generated 1339 derivative records from 3713 primary records. [2025-09-16T21:22:04.331128] [DEBUG] [LOCAL ] VATE: Saving derivative data. [2025-09-16T21:22:04.345036] [DEBUG] [LOCAL ] VATE: Derivative data saved (1339 records). [2025-09-16T21:22:04.345370] [INFO ] [MAIN ] VATE: Successfully saved derivative data. [2025-09-16T21:22:04.356435] [INFO ] [MAIN ] Derivative Progress: 1888/2026 symbols completed. VATE took 0.9s. Estimated remaining: 44.8s. Rate: 184.9 symbols/min [2025-09-16T21:22:04.357425] [DEBUG] [MAIN ] VALE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:04.358406] [INFO ] [MAIN ] VALE: Generated 1339 derivative records from 40045 primary records. [2025-09-16T21:22:04.358630] [DEBUG] [LOCAL ] VALE: Saving derivative data. [2025-09-16T21:22:04.372049] [DEBUG] [LOCAL ] VALE: Derivative data saved (1339 records). [2025-09-16T21:22:04.372770] [INFO ] [MAIN ] VALE: Successfully saved derivative data. [2025-09-16T21:22:04.374616] [INFO ] [MAIN ] Derivative Progress: 1889/2026 symbols completed. VALE took 1.0s. Estimated remaining: 44.4s. Rate: 185.0 symbols/min [2025-09-16T21:22:04.384711] [DEBUG] [MAIN ] VBF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:04.385281] [INFO ] [MAIN ] VBF: Generated 1339 derivative records from 5071 primary records. [2025-09-16T21:22:04.385343] [DEBUG] [LOCAL ] VBF: Saving derivative data. [2025-09-16T21:22:04.396311] [DEBUG] [LOCAL ] VBF: Derivative data saved (1339 records). [2025-09-16T21:22:04.396372] [INFO ] [MAIN ] VBF: Successfully saved derivative data. [2025-09-16T21:22:04.398283] [INFO ] [MAIN ] Derivative Progress: 1890/2026 symbols completed. VBF took 0.7s. Estimated remaining: 44.1s. Rate: 185.1 symbols/min [2025-09-16T21:22:04.398740] [INFO ] [MAIN ] VCV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:04.399164] [INFO ] [MAIN ] VEEV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:04.398953] [INFO ] [MAIN ] VEL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:04.412165] [DEBUG] [LOCAL ] VEL: Loaded 8936 existing records from primary storage. [2025-09-16T21:22:04.416082] [INFO ] [MAIN ] VEL: Loaded 8936 primary data records. [2025-09-16T21:22:04.416399] [DEBUG] [LOCAL ] VCV: Loaded 10243 existing records from primary storage. [2025-09-16T21:22:04.436712] [INFO ] [MAIN ] VCV: Loaded 10243 primary data records. [2025-09-16T21:22:04.734909] [DEBUG] [LOCAL ] VEEV: Loaded 35243 existing records from primary storage. [2025-09-16T21:22:04.759791] [INFO ] [MAIN ] VEEV: Loaded 35243 primary data records. [2025-09-16T21:22:05.298719] [DEBUG] [MAIN ] VEL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:05.304260] [INFO ] [MAIN ] VEL: Generated 1339 derivative records from 8936 primary records. [2025-09-16T21:22:05.305035] [DEBUG] [LOCAL ] VEL: Saving derivative data. [2025-09-16T21:22:05.304877] [DEBUG] [MAIN ] VCV: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:05.307205] [INFO ] [MAIN ] VCV: Generated 1339 derivative records from 10243 primary records. [2025-09-16T21:22:05.316469] [DEBUG] [LOCAL ] VCV: Saving derivative data. [2025-09-16T21:22:05.334179] [DEBUG] [LOCAL ] VCV: Derivative data saved (1339 records). [2025-09-16T21:22:05.334912] [INFO ] [MAIN ] VCV: Successfully saved derivative data. [2025-09-16T21:22:05.335031] [DEBUG] [LOCAL ] VEL: Derivative data saved (1339 records). [2025-09-16T21:22:05.337198] [INFO ] [MAIN ] Derivative Progress: 1891/2026 symbols completed. VCV took 0.9s. Estimated remaining: 43.8s. Rate: 184.9 symbols/min [2025-09-16T21:22:05.346909] [INFO ] [MAIN ] VET: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:05.347219] [INFO ] [MAIN ] VEL: Successfully saved derivative data. [2025-09-16T21:22:05.347567] [DEBUG] [MAIN ] VEEV: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:05.350465] [INFO ] [MAIN ] VEEV: Generated 1339 derivative records from 35243 primary records. [2025-09-16T21:22:05.349548] [INFO ] [MAIN ] Derivative Progress: 1892/2026 symbols completed. VEL took 1.0s. Estimated remaining: 43.5s. Rate: 185.0 symbols/min [2025-09-16T21:22:05.350815] [INFO ] [MAIN ] VFC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:05.351066] [DEBUG] [LOCAL ] VEEV: Saving derivative data. [2025-09-16T21:22:05.364140] [DEBUG] [LOCAL ] VEEV: Derivative data saved (1339 records). [2025-09-16T21:22:05.364319] [INFO ] [MAIN ] VEEV: Successfully saved derivative data. [2025-09-16T21:22:05.366731] [INFO ] [MAIN ] Derivative Progress: 1893/2026 symbols completed. VEEV took 1.0s. Estimated remaining: 43.1s. Rate: 185.1 symbols/min [2025-09-16T21:22:05.367007] [INFO ] [MAIN ] VG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:05.401621] [DEBUG] [LOCAL ] VET: Loaded 32383 existing records from primary storage. [2025-09-16T21:22:05.401907] [INFO ] [MAIN ] VET: Loaded 32383 primary data records. [2025-09-16T21:22:05.526877] [DEBUG] [LOCAL ] VFC: Loaded 39970 existing records from primary storage. [2025-09-16T21:22:05.584249] [INFO ] [MAIN ] VFC: Loaded 39970 primary data records. [2025-09-16T21:22:05.585708] [DEBUG] [LOCAL ] VG: Loaded 39825 existing records from primary storage. [2025-09-16T21:22:05.602664] [INFO ] [MAIN ] VG: Loaded 39825 primary data records. [2025-09-16T21:22:06.268893] [DEBUG] [MAIN ] VET: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:06.269772] [INFO ] [MAIN ] VET: Generated 1339 derivative records from 32383 primary records. [2025-09-16T21:22:06.270125] [DEBUG] [LOCAL ] VET: Saving derivative data. [2025-09-16T21:22:06.284042] [DEBUG] [LOCAL ] VET: Derivative data saved (1339 records). [2025-09-16T21:22:06.284338] [INFO ] [MAIN ] VET: Successfully saved derivative data. [2025-09-16T21:22:06.286349] [INFO ] [MAIN ] Derivative Progress: 1894/2026 symbols completed. VET took 0.9s. Estimated remaining: 42.8s. Rate: 184.9 symbols/min [2025-09-16T21:22:06.298432] [INFO ] [MAIN ] VGI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:06.304547] [DEBUG] [MAIN ] VFC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:06.309185] [INFO ] [MAIN ] VFC: Generated 1339 derivative records from 39970 primary records. [2025-09-16T21:22:06.309481] [DEBUG] [LOCAL ] VFC: Saving derivative data. [2025-09-16T21:22:06.309697] [DEBUG] [MAIN ] VG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:06.311015] [INFO ] [MAIN ] VG: Generated 1339 derivative records from 39825 primary records. [2025-09-16T21:22:06.311398] [DEBUG] [LOCAL ] VG: Saving derivative data. [2025-09-16T21:22:06.325707] [DEBUG] [LOCAL ] VGI: Loaded 3918 existing records from primary storage. [2025-09-16T21:22:06.333070] [INFO ] [MAIN ] VGI: Loaded 3918 primary data records. [2025-09-16T21:22:06.356983] [DEBUG] [LOCAL ] VFC: Derivative data saved (1339 records). [2025-09-16T21:22:06.372483] [INFO ] [MAIN ] VFC: Successfully saved derivative data. [2025-09-16T21:22:06.380945] [DEBUG] [LOCAL ] VG: Derivative data saved (1339 records). [2025-09-16T21:22:06.394736] [INFO ] [MAIN ] Derivative Progress: 1895/2026 symbols completed. VFC took 1.0s. Estimated remaining: 42.5s. Rate: 185.0 symbols/min [2025-09-16T21:22:06.409119] [INFO ] [MAIN ] VGM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:06.408779] [INFO ] [MAIN ] VG: Successfully saved derivative data. [2025-09-16T21:22:06.423338] [INFO ] [MAIN ] Derivative Progress: 1896/2026 symbols completed. VG took 1.1s. Estimated remaining: 42.1s. Rate: 185.1 symbols/min [2025-09-16T21:22:06.429059] [INFO ] [MAIN ] VICI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:06.536786] [DEBUG] [LOCAL ] VGM: Loaded 14407 existing records from primary storage. [2025-09-16T21:22:06.619108] [INFO ] [MAIN ] VGM: Loaded 14407 primary data records. [2025-09-16T21:22:06.946302] [DEBUG] [LOCAL ] VICI: Loaded 40006 existing records from primary storage. [2025-09-16T21:22:06.957420] [INFO ] [MAIN ] VICI: Loaded 40006 primary data records. [2025-09-16T21:22:07.133658] [DEBUG] [MAIN ] VGI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:07.155004] [INFO ] [MAIN ] VGI: Generated 1339 derivative records from 3918 primary records. [2025-09-16T21:22:07.185787] [DEBUG] [LOCAL ] VGI: Saving derivative data. [2025-09-16T21:22:07.253364] [DEBUG] [LOCAL ] VGI: Derivative data saved (1339 records). [2025-09-16T21:22:07.253755] [INFO ] [MAIN ] VGI: Successfully saved derivative data. [2025-09-16T21:22:07.255560] [INFO ] [MAIN ] Derivative Progress: 1897/2026 symbols completed. VGI took 1.0s. Estimated remaining: 41.9s. Rate: 184.9 symbols/min [2025-09-16T21:22:07.256489] [INFO ] [MAIN ] VIK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:07.266958] [DEBUG] [MAIN ] VGM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:07.268610] [INFO ] [MAIN ] VGM: Generated 1339 derivative records from 14407 primary records. [2025-09-16T21:22:07.268921] [DEBUG] [LOCAL ] VGM: Saving derivative data. [2025-09-16T21:22:07.282091] [DEBUG] [LOCAL ] VGM: Derivative data saved (1339 records). [2025-09-16T21:22:07.282290] [INFO ] [MAIN ] VGM: Successfully saved derivative data. [2025-09-16T21:22:07.284510] [INFO ] [MAIN ] Derivative Progress: 1898/2026 symbols completed. VGM took 0.9s. Estimated remaining: 41.5s. Rate: 185.0 symbols/min [2025-09-16T21:22:07.284917] [INFO ] [MAIN ] VIPS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:07.302628] [DEBUG] [MAIN ] VICI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:07.303426] [INFO ] [MAIN ] VICI: Generated 1339 derivative records from 40006 primary records. [2025-09-16T21:22:07.303578] [DEBUG] [LOCAL ] VICI: Saving derivative data. [2025-09-16T21:22:07.325002] [DEBUG] [LOCAL ] VICI: Derivative data saved (1339 records). [2025-09-16T21:22:07.325157] [INFO ] [MAIN ] VICI: Successfully saved derivative data. [2025-09-16T21:22:07.327104] [INFO ] [MAIN ] Derivative Progress: 1899/2026 symbols completed. VICI took 0.9s. Estimated remaining: 41.2s. Rate: 185.1 symbols/min [2025-09-16T21:22:07.327968] [INFO ] [MAIN ] VIRT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:07.341290] [DEBUG] [LOCAL ] VIK: Loaded 39118 existing records from primary storage. [2025-09-16T21:22:07.341514] [INFO ] [MAIN ] VIK: Loaded 39118 primary data records. [2025-09-16T21:22:07.477954] [DEBUG] [LOCAL ] VIPS: Loaded 38049 existing records from primary storage. [2025-09-16T21:22:07.498705] [INFO ] [MAIN ] VIPS: Loaded 38049 primary data records. [2025-09-16T21:22:07.705860] [DEBUG] [LOCAL ] VIRT: Loaded 34659 existing records from primary storage. [2025-09-16T21:22:07.717903] [INFO ] [MAIN ] VIRT: Loaded 34659 primary data records. [2025-09-16T21:22:08.213138] [DEBUG] [MAIN ] VIK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:08.214261] [INFO ] [MAIN ] VIK: Generated 1339 derivative records from 39118 primary records. [2025-09-16T21:22:08.214876] [DEBUG] [LOCAL ] VIK: Saving derivative data. [2025-09-16T21:22:08.227724] [DEBUG] [LOCAL ] VIK: Derivative data saved (1339 records). [2025-09-16T21:22:08.227859] [INFO ] [MAIN ] VIK: Successfully saved derivative data. [2025-09-16T21:22:08.232159] [INFO ] [MAIN ] Derivative Progress: 1900/2026 symbols completed. VIK took 1.0s. Estimated remaining: 40.9s. Rate: 184.9 symbols/min [2025-09-16T21:22:08.233200] [INFO ] [MAIN ] VIST: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:08.244059] [DEBUG] [MAIN ] VIPS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:08.244851] [INFO ] [MAIN ] VIPS: Generated 1339 derivative records from 38049 primary records. [2025-09-16T21:22:08.245128] [DEBUG] [LOCAL ] VIPS: Saving derivative data. [2025-09-16T21:22:08.269771] [DEBUG] [LOCAL ] VIPS: Derivative data saved (1339 records). [2025-09-16T21:22:08.270268] [INFO ] [MAIN ] VIPS: Successfully saved derivative data. [2025-09-16T21:22:08.270155] [DEBUG] [MAIN ] VIRT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:08.272056] [INFO ] [MAIN ] Derivative Progress: 1901/2026 symbols completed. VIPS took 1.0s. Estimated remaining: 40.5s. Rate: 185.0 symbols/min [2025-09-16T21:22:08.272392] [INFO ] [MAIN ] VIV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:08.273213] [INFO ] [MAIN ] VIRT: Generated 1339 derivative records from 34659 primary records. [2025-09-16T21:22:08.273779] [DEBUG] [LOCAL ] VIRT: Saving derivative data. [2025-09-16T21:22:08.304660] [DEBUG] [LOCAL ] VIRT: Derivative data saved (1339 records). [2025-09-16T21:22:08.304755] [INFO ] [MAIN ] VIRT: Successfully saved derivative data. [2025-09-16T21:22:08.306897] [INFO ] [MAIN ] Derivative Progress: 1902/2026 symbols completed. VIRT took 1.0s. Estimated remaining: 40.2s. Rate: 185.1 symbols/min [2025-09-16T21:22:08.307539] [DEBUG] [LOCAL ] VIST: Loaded 34025 existing records from primary storage. [2025-09-16T21:22:08.308039] [INFO ] [MAIN ] VIST: Loaded 34025 primary data records. [2025-09-16T21:22:08.307876] [INFO ] [MAIN ] VKQ: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:08.577593] [DEBUG] [LOCAL ] VIV: Loaded 33811 existing records from primary storage. [2025-09-16T21:22:08.594904] [INFO ] [MAIN ] VIV: Loaded 33811 primary data records. [2025-09-16T21:22:08.595798] [DEBUG] [LOCAL ] VKQ: Loaded 13433 existing records from primary storage. [2025-09-16T21:22:08.617463] [INFO ] [MAIN ] VKQ: Loaded 13433 primary data records. [2025-09-16T21:22:09.233181] [DEBUG] [MAIN ] VIST: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:09.234161] [INFO ] [MAIN ] VIST: Generated 1339 derivative records from 34025 primary records. [2025-09-16T21:22:09.234321] [DEBUG] [LOCAL ] VIST: Saving derivative data. [2025-09-16T21:22:09.250554] [DEBUG] [LOCAL ] VIST: Derivative data saved (1339 records). [2025-09-16T21:22:09.251482] [INFO ] [MAIN ] VIST: Successfully saved derivative data. [2025-09-16T21:22:09.253141] [INFO ] [MAIN ] Derivative Progress: 1903/2026 symbols completed. VIST took 1.0s. Estimated remaining: 39.9s. Rate: 184.9 symbols/min [2025-09-16T21:22:09.263494] [DEBUG] [MAIN ] VIV: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:09.264445] [INFO ] [MAIN ] VIV: Generated 1339 derivative records from 33811 primary records. [2025-09-16T21:22:09.264654] [DEBUG] [LOCAL ] VIV: Saving derivative data. [2025-09-16T21:22:09.277921] [DEBUG] [LOCAL ] VIV: Derivative data saved (1339 records). [2025-09-16T21:22:09.278991] [INFO ] [MAIN ] VIV: Successfully saved derivative data. [2025-09-16T21:22:09.280902] [INFO ] [MAIN ] Derivative Progress: 1904/2026 symbols completed. VIV took 1.0s. Estimated remaining: 39.6s. Rate: 185.0 symbols/min [2025-09-16T21:22:09.292188] [DEBUG] [MAIN ] VKQ: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:09.292968] [INFO ] [MAIN ] VKQ: Generated 1339 derivative records from 13433 primary records. [2025-09-16T21:22:09.293035] [DEBUG] [LOCAL ] VKQ: Saving derivative data. [2025-09-16T21:22:09.305698] [DEBUG] [LOCAL ] VKQ: Derivative data saved (1339 records). [2025-09-16T21:22:09.305797] [INFO ] [MAIN ] VKQ: Successfully saved derivative data. [2025-09-16T21:22:09.307850] [INFO ] [MAIN ] Derivative Progress: 1905/2026 symbols completed. VKQ took 1.0s. Estimated remaining: 39.2s. Rate: 185.1 symbols/min [2025-09-16T21:22:09.308491] [INFO ] [MAIN ] VLRS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:09.308602] [INFO ] [MAIN ] VLN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:09.308810] [INFO ] [MAIN ] VLO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:09.336865] [DEBUG] [LOCAL ] VLN: Loaded 22121 existing records from primary storage. [2025-09-16T21:22:09.337000] [INFO ] [MAIN ] VLN: Loaded 22121 primary data records. [2025-09-16T21:22:09.426334] [DEBUG] [LOCAL ] VLRS: Loaded 29529 existing records from primary storage. [2025-09-16T21:22:09.443007] [INFO ] [MAIN ] VLRS: Loaded 29529 primary data records. [2025-09-16T21:22:09.741954] [DEBUG] [LOCAL ] VLO: Loaded 39583 existing records from primary storage. [2025-09-16T21:22:09.753304] [INFO ] [MAIN ] VLO: Loaded 39583 primary data records. [2025-09-16T21:22:10.230035] [DEBUG] [MAIN ] VLN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:10.230976] [INFO ] [MAIN ] VLN: Generated 1339 derivative records from 22121 primary records. [2025-09-16T21:22:10.231167] [DEBUG] [LOCAL ] VLN: Saving derivative data. [2025-09-16T21:22:10.247199] [DEBUG] [LOCAL ] VLN: Derivative data saved (1339 records). [2025-09-16T21:22:10.247584] [INFO ] [MAIN ] VLN: Successfully saved derivative data. [2025-09-16T21:22:10.249490] [INFO ] [MAIN ] Derivative Progress: 1906/2026 symbols completed. VLN took 0.9s. Estimated remaining: 38.9s. Rate: 184.9 symbols/min [2025-09-16T21:22:10.250114] [INFO ] [MAIN ] VLT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:10.262995] [DEBUG] [MAIN ] VLRS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:10.263971] [INFO ] [MAIN ] VLRS: Generated 1339 derivative records from 29529 primary records. [2025-09-16T21:22:10.264128] [DEBUG] [LOCAL ] VLRS: Saving derivative data. [2025-09-16T21:22:10.274677] [DEBUG] [LOCAL ] VLT: Loaded 3187 existing records from primary storage. [2025-09-16T21:22:10.276119] [INFO ] [MAIN ] VLT: Loaded 3187 primary data records. [2025-09-16T21:22:10.363854] [DEBUG] [LOCAL ] VLRS: Derivative data saved (1339 records). [2025-09-16T21:22:10.389913] [INFO ] [MAIN ] VLRS: Successfully saved derivative data. [2025-09-16T21:22:10.401661] [INFO ] [MAIN ] Derivative Progress: 1907/2026 symbols completed. VLRS took 1.1s. Estimated remaining: 38.6s. Rate: 185.0 symbols/min [2025-09-16T21:22:10.406729] [DEBUG] [MAIN ] VLO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:10.407328] [INFO ] [MAIN ] VLTO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:10.428815] [INFO ] [MAIN ] VLO: Generated 1339 derivative records from 39583 primary records. [2025-09-16T21:22:10.448983] [DEBUG] [LOCAL ] VLO: Saving derivative data. [2025-09-16T21:22:10.511035] [DEBUG] [LOCAL ] VLO: Derivative data saved (1339 records). [2025-09-16T21:22:10.595809] [INFO ] [MAIN ] VLO: Successfully saved derivative data. [2025-09-16T21:22:10.599211] [INFO ] [MAIN ] Derivative Progress: 1908/2026 symbols completed. VLO took 1.3s. Estimated remaining: 38.3s. Rate: 185.0 symbols/min [2025-09-16T21:22:10.599798] [INFO ] [MAIN ] VMC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:10.648837] [DEBUG] [LOCAL ] VLTO: Loaded 33945 existing records from primary storage. [2025-09-16T21:22:10.653620] [INFO ] [MAIN ] VLTO: Loaded 33945 primary data records. [2025-09-16T21:22:10.653481] [DEBUG] [MAIN ] VLT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:10.654600] [INFO ] [MAIN ] VLT: Generated 1339 derivative records from 3187 primary records. [2025-09-16T21:22:10.700577] [DEBUG] [LOCAL ] VLT: Saving derivative data. [2025-09-16T21:22:10.761802] [DEBUG] [LOCAL ] VMC: Loaded 31862 existing records from primary storage. [2025-09-16T21:22:10.774067] [INFO ] [MAIN ] VMC: Loaded 31862 primary data records. [2025-09-16T21:22:10.965512] [DEBUG] [LOCAL ] VLT: Derivative data saved (1339 records). [2025-09-16T21:22:11.040996] [INFO ] [MAIN ] VLT: Successfully saved derivative data. [2025-09-16T21:22:11.059982] [INFO ] [MAIN ] Derivative Progress: 1909/2026 symbols completed. VLT took 0.8s. Estimated remaining: 38.0s. Rate: 185.0 symbols/min [2025-09-16T21:22:11.076639] [INFO ] [MAIN ] VMI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:11.244525] [DEBUG] [LOCAL ] VMI: Loaded 11308 existing records from primary storage. [2025-09-16T21:22:11.245265] [INFO ] [MAIN ] VMI: Loaded 11308 primary data records. [2025-09-16T21:22:11.443454] [DEBUG] [MAIN ] VLTO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:11.565960] [INFO ] [MAIN ] VLTO: Generated 1339 derivative records from 33945 primary records. [2025-09-16T21:22:11.577690] [DEBUG] [LOCAL ] VLTO: Saving derivative data. [2025-09-16T21:22:11.599669] [DEBUG] [LOCAL ] VLTO: Derivative data saved (1339 records). [2025-09-16T21:22:11.603227] [INFO ] [MAIN ] VLTO: Successfully saved derivative data. [2025-09-16T21:22:11.603821] [DEBUG] [MAIN ] VMC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:11.606463] [INFO ] [MAIN ] VMC: Generated 1339 derivative records from 31862 primary records. [2025-09-16T21:22:11.606547] [DEBUG] [LOCAL ] VMC: Saving derivative data. [2025-09-16T21:22:11.605615] [INFO ] [MAIN ] Derivative Progress: 1910/2026 symbols completed. VLTO took 1.2s. Estimated remaining: 37.6s. Rate: 184.9 symbols/min [2025-09-16T21:22:11.608097] [INFO ] [MAIN ] VMO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:11.623155] [DEBUG] [LOCAL ] VMC: Derivative data saved (1339 records). [2025-09-16T21:22:11.623502] [INFO ] [MAIN ] VMC: Successfully saved derivative data. [2025-09-16T21:22:11.625403] [INFO ] [MAIN ] Derivative Progress: 1911/2026 symbols completed. VMC took 1.0s. Estimated remaining: 37.3s. Rate: 185.0 symbols/min [2025-09-16T21:22:11.625620] [INFO ] [MAIN ] VNCE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:11.640952] [DEBUG] [LOCAL ] VMO: Loaded 15362 existing records from primary storage. [2025-09-16T21:22:11.642941] [INFO ] [MAIN ] VMO: Loaded 15362 primary data records. [2025-09-16T21:22:11.645879] [DEBUG] [LOCAL ] VNCE: Loaded 4887 existing records from primary storage. [2025-09-16T21:22:11.663905] [INFO ] [MAIN ] VNCE: Loaded 4887 primary data records. [2025-09-16T21:22:11.724537] [DEBUG] [MAIN ] VMI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:11.792851] [INFO ] [MAIN ] VMI: Generated 1339 derivative records from 11308 primary records. [2025-09-16T21:22:11.825673] [DEBUG] [LOCAL ] VMI: Saving derivative data. [2025-09-16T21:22:12.070854] [DEBUG] [LOCAL ] VMI: Derivative data saved (1339 records). [2025-09-16T21:22:12.249189] [INFO ] [MAIN ] VMI: Successfully saved derivative data. [2025-09-16T21:22:12.251626] [INFO ] [MAIN ] Derivative Progress: 1912/2026 symbols completed. VMI took 1.2s. Estimated remaining: 37.0s. Rate: 184.9 symbols/min [2025-09-16T21:22:12.251992] [INFO ] [MAIN ] VNO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:12.290337] [DEBUG] [MAIN ] VMO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:12.289998] [DEBUG] [MAIN ] VNCE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:12.300306] [INFO ] [MAIN ] VMO: Generated 1339 derivative records from 15362 primary records. [2025-09-16T21:22:12.300435] [DEBUG] [LOCAL ] VMO: Saving derivative data. [2025-09-16T21:22:12.300965] [INFO ] [MAIN ] VNCE: Generated 1339 derivative records from 4887 primary records. [2025-09-16T21:22:12.301052] [DEBUG] [LOCAL ] VNCE: Saving derivative data. [2025-09-16T21:22:12.335739] [DEBUG] [LOCAL ] VMO: Derivative data saved (1339 records). [2025-09-16T21:22:12.336600] [INFO ] [MAIN ] VMO: Successfully saved derivative data. [2025-09-16T21:22:12.339165] [INFO ] [MAIN ] Derivative Progress: 1913/2026 symbols completed. VMO took 0.7s. Estimated remaining: 36.7s. Rate: 185.0 symbols/min [2025-09-16T21:22:12.337041] [DEBUG] [LOCAL ] VNCE: Derivative data saved (1339 records). [2025-09-16T21:22:12.339301] [INFO ] [MAIN ] VNCE: Successfully saved derivative data. [2025-09-16T21:22:12.340116] [DEBUG] [LOCAL ] VNO: Loaded 36612 existing records from primary storage. [2025-09-16T21:22:12.342259] [INFO ] [MAIN ] VNT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:12.342137] [INFO ] [MAIN ] Derivative Progress: 1914/2026 symbols completed. VNCE took 0.7s. Estimated remaining: 36.3s. Rate: 185.1 symbols/min [2025-09-16T21:22:12.342679] [INFO ] [MAIN ] VNO: Loaded 36612 primary data records. [2025-09-16T21:22:12.343033] [INFO ] [MAIN ] VOC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:12.468807] [DEBUG] [LOCAL ] VOC: Loaded 6945 existing records from primary storage. [2025-09-16T21:22:12.484604] [INFO ] [MAIN ] VOC: Loaded 6945 primary data records. [2025-09-16T21:22:12.751892] [DEBUG] [LOCAL ] VNT: Loaded 32549 existing records from primary storage. [2025-09-16T21:22:12.755912] [INFO ] [MAIN ] VNT: Loaded 32549 primary data records. [2025-09-16T21:22:13.213577] [DEBUG] [MAIN ] VNO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:13.216047] [INFO ] [MAIN ] VNO: Generated 1339 derivative records from 36612 primary records. [2025-09-16T21:22:13.216140] [DEBUG] [LOCAL ] VNO: Saving derivative data. [2025-09-16T21:22:13.231602] [DEBUG] [LOCAL ] VNO: Derivative data saved (1339 records). [2025-09-16T21:22:13.232559] [INFO ] [MAIN ] VNO: Successfully saved derivative data. [2025-09-16T21:22:13.235523] [INFO ] [MAIN ] Derivative Progress: 1915/2026 symbols completed. VNO took 1.0s. Estimated remaining: 36.0s. Rate: 184.9 symbols/min [2025-09-16T21:22:13.236116] [INFO ] [MAIN ] VOYA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:13.247232] [DEBUG] [MAIN ] VOC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:13.249131] [INFO ] [MAIN ] VOC: Generated 1339 derivative records from 6945 primary records. [2025-09-16T21:22:13.249377] [DEBUG] [LOCAL ] VOC: Saving derivative data. [2025-09-16T21:22:13.264930] [DEBUG] [LOCAL ] VOC: Derivative data saved (1339 records). [2025-09-16T21:22:13.265070] [INFO ] [MAIN ] VOC: Successfully saved derivative data. [2025-09-16T21:22:13.267105] [INFO ] [MAIN ] Derivative Progress: 1916/2026 symbols completed. VOC took 0.9s. Estimated remaining: 35.7s. Rate: 185.0 symbols/min [2025-09-16T21:22:13.267606] [INFO ] [MAIN ] VPG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:13.279047] [DEBUG] [MAIN ] VNT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:13.279891] [INFO ] [MAIN ] VNT: Generated 1339 derivative records from 32549 primary records. [2025-09-16T21:22:13.280081] [DEBUG] [LOCAL ] VNT: Saving derivative data. [2025-09-16T21:22:13.293785] [DEBUG] [LOCAL ] VNT: Derivative data saved (1339 records). [2025-09-16T21:22:13.305313] [INFO ] [MAIN ] VNT: Successfully saved derivative data. [2025-09-16T21:22:13.307358] [INFO ] [MAIN ] Derivative Progress: 1917/2026 symbols completed. VNT took 1.0s. Estimated remaining: 35.3s. Rate: 185.1 symbols/min [2025-09-16T21:22:13.307739] [INFO ] [MAIN ] VPV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:13.317831] [DEBUG] [LOCAL ] VPG: Loaded 12703 existing records from primary storage. [2025-09-16T21:22:13.318497] [INFO ] [MAIN ] VPG: Loaded 12703 primary data records. [2025-09-16T21:22:13.367682] [DEBUG] [LOCAL ] VPV: Loaded 3663 existing records from primary storage. [2025-09-16T21:22:13.408817] [DEBUG] [LOCAL ] VOYA: Loaded 31278 existing records from primary storage. [2025-09-16T21:22:13.408977] [INFO ] [MAIN ] VPV: Loaded 3663 primary data records. [2025-09-16T21:22:13.421212] [INFO ] [MAIN ] VOYA: Loaded 31278 primary data records. [2025-09-16T21:22:14.209328] [DEBUG] [MAIN ] VPG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:14.210363] [INFO ] [MAIN ] VPG: Generated 1339 derivative records from 12703 primary records. [2025-09-16T21:22:14.211051] [DEBUG] [LOCAL ] VPG: Saving derivative data. [2025-09-16T21:22:14.235055] [DEBUG] [LOCAL ] VPG: Derivative data saved (1339 records). [2025-09-16T21:22:14.249967] [INFO ] [MAIN ] VPG: Successfully saved derivative data. [2025-09-16T21:22:14.251890] [INFO ] [MAIN ] Derivative Progress: 1918/2026 symbols completed. VPG took 1.0s. Estimated remaining: 35.0s. Rate: 184.9 symbols/min [2025-09-16T21:22:14.252480] [DEBUG] [MAIN ] VOYA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:14.252194] [DEBUG] [MAIN ] VPV: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:14.253482] [INFO ] [MAIN ] VPV: Generated 1339 derivative records from 3663 primary records. [2025-09-16T21:22:14.254009] [INFO ] [MAIN ] VOYA: Generated 1339 derivative records from 31278 primary records. [2025-09-16T21:22:14.254127] [DEBUG] [LOCAL ] VOYA: Saving derivative data. [2025-09-16T21:22:14.254156] [DEBUG] [LOCAL ] VPV: Saving derivative data. [2025-09-16T21:22:14.277775] [DEBUG] [LOCAL ] VOYA: Derivative data saved (1339 records). [2025-09-16T21:22:14.277863] [INFO ] [MAIN ] VOYA: Successfully saved derivative data. [2025-09-16T21:22:14.277479] [DEBUG] [LOCAL ] VPV: Derivative data saved (1339 records). [2025-09-16T21:22:14.277947] [INFO ] [MAIN ] VPV: Successfully saved derivative data. [2025-09-16T21:22:14.279731] [INFO ] [MAIN ] Derivative Progress: 1919/2026 symbols completed. VOYA took 1.0s. Estimated remaining: 34.7s. Rate: 185.0 symbols/min [2025-09-16T21:22:14.282031] [INFO ] [MAIN ] Derivative Progress: 1920/2026 symbols completed. VPV took 1.0s. Estimated remaining: 34.4s. Rate: 185.1 symbols/min [2025-09-16T21:22:14.282792] [INFO ] [MAIN ] VRE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:14.282736] [INFO ] [MAIN ] VRTS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:14.282952] [INFO ] [MAIN ] VSCO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:14.296536] [DEBUG] [LOCAL ] VRTS: Loaded 7362 existing records from primary storage. [2025-09-16T21:22:14.296844] [INFO ] [MAIN ] VRTS: Loaded 7362 primary data records. [2025-09-16T21:22:14.495721] [DEBUG] [LOCAL ] VRE: Loaded 25937 existing records from primary storage. [2025-09-16T21:22:14.518724] [INFO ] [MAIN ] VRE: Loaded 25937 primary data records. [2025-09-16T21:22:14.545202] [DEBUG] [LOCAL ] VSCO: Loaded 39303 existing records from primary storage. [2025-09-16T21:22:14.627865] [INFO ] [MAIN ] VSCO: Loaded 39303 primary data records. [2025-09-16T21:22:15.156045] [DEBUG] [MAIN ] VRTS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:15.157095] [INFO ] [MAIN ] VRTS: Generated 1339 derivative records from 7362 primary records. [2025-09-16T21:22:15.158163] [DEBUG] [LOCAL ] VRTS: Saving derivative data. [2025-09-16T21:22:15.171796] [DEBUG] [LOCAL ] VRTS: Derivative data saved (1339 records). [2025-09-16T21:22:15.172764] [INFO ] [MAIN ] VRTS: Successfully saved derivative data. [2025-09-16T21:22:15.174486] [INFO ] [MAIN ] Derivative Progress: 1921/2026 symbols completed. VRTS took 0.9s. Estimated remaining: 34.1s. Rate: 184.9 symbols/min [2025-09-16T21:22:15.175941] [INFO ] [MAIN ] VSH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:15.189149] [DEBUG] [MAIN ] VRE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:15.189992] [INFO ] [MAIN ] VRE: Generated 1339 derivative records from 25937 primary records. [2025-09-16T21:22:15.190167] [DEBUG] [LOCAL ] VRE: Saving derivative data. [2025-09-16T21:22:15.200995] [DEBUG] [MAIN ] VSCO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:15.208386] [INFO ] [MAIN ] VSCO: Generated 1339 derivative records from 39303 primary records. [2025-09-16T21:22:15.213322] [DEBUG] [LOCAL ] VRE: Derivative data saved (1339 records). [2025-09-16T21:22:15.213445] [DEBUG] [LOCAL ] VSCO: Saving derivative data. [2025-09-16T21:22:15.213539] [INFO ] [MAIN ] VRE: Successfully saved derivative data. [2025-09-16T21:22:15.216131] [INFO ] [MAIN ] Derivative Progress: 1922/2026 symbols completed. VRE took 0.9s. Estimated remaining: 33.7s. Rate: 185.0 symbols/min [2025-09-16T21:22:15.216701] [INFO ] [MAIN ] VSTS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:15.228974] [DEBUG] [LOCAL ] VSCO: Derivative data saved (1339 records). [2025-09-16T21:22:15.229138] [INFO ] [MAIN ] VSCO: Successfully saved derivative data. [2025-09-16T21:22:15.231608] [INFO ] [MAIN ] Derivative Progress: 1923/2026 symbols completed. VSCO took 0.9s. Estimated remaining: 33.4s. Rate: 185.1 symbols/min [2025-09-16T21:22:15.232075] [INFO ] [MAIN ] VTEX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:15.261237] [DEBUG] [LOCAL ] VSH: Loaded 35897 existing records from primary storage. [2025-09-16T21:22:15.262097] [INFO ] [MAIN ] VSH: Loaded 35897 primary data records. [2025-09-16T21:22:15.418934] [DEBUG] [LOCAL ] VSTS: Loaded 36350 existing records from primary storage. [2025-09-16T21:22:15.481933] [INFO ] [MAIN ] VSTS: Loaded 36350 primary data records. [2025-09-16T21:22:15.494181] [DEBUG] [LOCAL ] VTEX: Loaded 32273 existing records from primary storage. [2025-09-16T21:22:15.592675] [INFO ] [MAIN ] VTEX: Loaded 32273 primary data records. [2025-09-16T21:22:16.174308] [DEBUG] [MAIN ] VSH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:16.176212] [INFO ] [MAIN ] VSH: Generated 1339 derivative records from 35897 primary records. [2025-09-16T21:22:16.176450] [DEBUG] [LOCAL ] VSH: Saving derivative data. [2025-09-16T21:22:16.192431] [DEBUG] [LOCAL ] VSH: Derivative data saved (1339 records). [2025-09-16T21:22:16.193231] [INFO ] [MAIN ] VSH: Successfully saved derivative data. [2025-09-16T21:22:16.195085] [INFO ] [MAIN ] Derivative Progress: 1924/2026 symbols completed. VSH took 1.0s. Estimated remaining: 33.1s. Rate: 184.9 symbols/min [2025-09-16T21:22:16.195763] [INFO ] [MAIN ] VTLE: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:16.206441] [DEBUG] [MAIN ] VSTS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:16.208109] [INFO ] [MAIN ] VSTS: Generated 1339 derivative records from 36350 primary records. [2025-09-16T21:22:16.209511] [DEBUG] [LOCAL ] VSTS: Saving derivative data. [2025-09-16T21:22:16.231584] [DEBUG] [LOCAL ] VSTS: Derivative data saved (1339 records). [2025-09-16T21:22:16.232091] [INFO ] [MAIN ] VSTS: Successfully saved derivative data. [2025-09-16T21:22:16.234030] [INFO ] [MAIN ] Derivative Progress: 1925/2026 symbols completed. VSTS took 1.0s. Estimated remaining: 32.8s. Rate: 185.0 symbols/min [2025-09-16T21:22:16.232022] [DEBUG] [MAIN ] VTEX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:16.235431] [INFO ] [MAIN ] VTEX: Generated 1339 derivative records from 32273 primary records. [2025-09-16T21:22:16.235510] [DEBUG] [LOCAL ] VTEX: Saving derivative data. [2025-09-16T21:22:16.234418] [INFO ] [MAIN ] VTMX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:16.249153] [DEBUG] [LOCAL ] VTEX: Derivative data saved (1339 records). [2025-09-16T21:22:16.258326] [INFO ] [MAIN ] VTEX: Successfully saved derivative data. [2025-09-16T21:22:16.260667] [INFO ] [MAIN ] Derivative Progress: 1926/2026 symbols completed. VTEX took 1.0s. Estimated remaining: 32.4s. Rate: 185.1 symbols/min [2025-09-16T21:22:16.261028] [INFO ] [MAIN ] VTN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:16.274228] [DEBUG] [LOCAL ] VTMX: Loaded 13067 existing records from primary storage. [2025-09-16T21:22:16.284344] [INFO ] [MAIN ] VTMX: Loaded 13067 primary data records. [2025-09-16T21:22:16.325060] [DEBUG] [LOCAL ] VTN: Loaded 5082 existing records from primary storage. [2025-09-16T21:22:16.344680] [DEBUG] [LOCAL ] VTLE: Loaded 36084 existing records from primary storage. [2025-09-16T21:22:16.344781] [INFO ] [MAIN ] VTN: Loaded 5082 primary data records. [2025-09-16T21:22:16.367290] [INFO ] [MAIN ] VTLE: Loaded 36084 primary data records. [2025-09-16T21:22:17.129479] [DEBUG] [MAIN ] VTMX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:17.130621] [INFO ] [MAIN ] VTMX: Generated 1339 derivative records from 13067 primary records. [2025-09-16T21:22:17.130984] [DEBUG] [LOCAL ] VTMX: Saving derivative data. [2025-09-16T21:22:17.147129] [DEBUG] [LOCAL ] VTMX: Derivative data saved (1339 records). [2025-09-16T21:22:17.147613] [INFO ] [MAIN ] VTMX: Successfully saved derivative data. [2025-09-16T21:22:17.149430] [INFO ] [MAIN ] Derivative Progress: 1927/2026 symbols completed. VTMX took 0.9s. Estimated remaining: 32.1s. Rate: 184.9 symbols/min [2025-09-16T21:22:17.159314] [INFO ] [MAIN ] VTOL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:17.160136] [DEBUG] [MAIN ] VTN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:17.169736] [DEBUG] [MAIN ] VTLE: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:17.170768] [INFO ] [MAIN ] VTN: Generated 1339 derivative records from 5082 primary records. [2025-09-16T21:22:17.171266] [INFO ] [MAIN ] VTLE: Generated 1339 derivative records from 36084 primary records. [2025-09-16T21:22:17.171418] [DEBUG] [LOCAL ] VTN: Saving derivative data. [2025-09-16T21:22:17.171488] [DEBUG] [LOCAL ] VTLE: Saving derivative data. [2025-09-16T21:22:17.192492] [DEBUG] [LOCAL ] VTN: Derivative data saved (1339 records). [2025-09-16T21:22:17.196982] [INFO ] [MAIN ] VTN: Successfully saved derivative data. [2025-09-16T21:22:17.199117] [INFO ] [MAIN ] Derivative Progress: 1928/2026 symbols completed. VTN took 0.9s. Estimated remaining: 31.8s. Rate: 185.0 symbols/min [2025-09-16T21:22:17.200167] [INFO ] [MAIN ] VTR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:17.207371] [DEBUG] [LOCAL ] VTLE: Derivative data saved (1339 records). [2025-09-16T21:22:17.207798] [DEBUG] [LOCAL ] VTOL: Loaded 14677 existing records from primary storage. [2025-09-16T21:22:17.207855] [INFO ] [MAIN ] VTLE: Successfully saved derivative data. [2025-09-16T21:22:17.210296] [INFO ] [MAIN ] Derivative Progress: 1929/2026 symbols completed. VTLE took 1.0s. Estimated remaining: 31.4s. Rate: 185.1 symbols/min [2025-09-16T21:22:17.210417] [INFO ] [MAIN ] VTOL: Loaded 14677 primary data records. [2025-09-16T21:22:17.222766] [INFO ] [MAIN ] VTS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:17.519434] [DEBUG] [LOCAL ] VTR: Loaded 39315 existing records from primary storage. [2025-09-16T21:22:17.519665] [DEBUG] [LOCAL ] VTS: Loaded 21848 existing records from primary storage. [2025-09-16T21:22:17.519890] [INFO ] [MAIN ] VTR: Loaded 39315 primary data records. [2025-09-16T21:22:17.519840] [INFO ] [MAIN ] VTS: Loaded 21848 primary data records. [2025-09-16T21:22:18.103294] [DEBUG] [MAIN ] VTOL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:18.105625] [INFO ] [MAIN ] VTOL: Generated 1339 derivative records from 14677 primary records. [2025-09-16T21:22:18.106039] [DEBUG] [LOCAL ] VTOL: Saving derivative data. [2025-09-16T21:22:18.119790] [DEBUG] [LOCAL ] VTOL: Derivative data saved (1339 records). [2025-09-16T21:22:18.121190] [INFO ] [MAIN ] VTOL: Successfully saved derivative data. [2025-09-16T21:22:18.123486] [INFO ] [MAIN ] Derivative Progress: 1930/2026 symbols completed. VTOL took 1.0s. Estimated remaining: 31.2s. Rate: 184.9 symbols/min [2025-09-16T21:22:18.124300] [INFO ] [MAIN ] VVR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:18.137588] [DEBUG] [MAIN ] VTS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:18.138273] [INFO ] [MAIN ] VTS: Generated 1339 derivative records from 21848 primary records. [2025-09-16T21:22:18.138484] [DEBUG] [LOCAL ] VTS: Saving derivative data. [2025-09-16T21:22:18.158729] [DEBUG] [LOCAL ] VTS: Derivative data saved (1339 records). [2025-09-16T21:22:18.158951] [INFO ] [MAIN ] VTS: Successfully saved derivative data. [2025-09-16T21:22:18.160662] [INFO ] [MAIN ] Derivative Progress: 1931/2026 symbols completed. VTS took 1.0s. Estimated remaining: 30.8s. Rate: 185.0 symbols/min [2025-09-16T21:22:18.160964] [INFO ] [MAIN ] VVV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:18.179123] [DEBUG] [MAIN ] VTR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:18.180393] [INFO ] [MAIN ] VTR: Generated 1339 derivative records from 39315 primary records. [2025-09-16T21:22:18.179694] [DEBUG] [LOCAL ] VVR: Loaded 21685 existing records from primary storage. [2025-09-16T21:22:18.180602] [DEBUG] [LOCAL ] VTR: Saving derivative data. [2025-09-16T21:22:18.180732] [INFO ] [MAIN ] VVR: Loaded 21685 primary data records. [2025-09-16T21:22:18.259422] [DEBUG] [LOCAL ] VTR: Derivative data saved (1339 records). [2025-09-16T21:22:18.281846] [INFO ] [MAIN ] VTR: Successfully saved derivative data. [2025-09-16T21:22:18.297131] [INFO ] [MAIN ] Derivative Progress: 1932/2026 symbols completed. VTR took 1.1s. Estimated remaining: 30.5s. Rate: 185.0 symbols/min [2025-09-16T21:22:18.301457] [INFO ] [MAIN ] VVX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:18.515697] [DEBUG] [LOCAL ] VVV: Loaded 37484 existing records from primary storage. [2025-09-16T21:22:18.516000] [INFO ] [MAIN ] VVV: Loaded 37484 primary data records. [2025-09-16T21:22:18.600946] [DEBUG] [LOCAL ] VVX: Loaded 17316 existing records from primary storage. [2025-09-16T21:22:18.617871] [INFO ] [MAIN ] VVX: Loaded 17316 primary data records. [2025-09-16T21:22:19.079715] [DEBUG] [MAIN ] VVR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:19.081548] [INFO ] [MAIN ] VVR: Generated 1339 derivative records from 21685 primary records. [2025-09-16T21:22:19.082535] [DEBUG] [LOCAL ] VVR: Saving derivative data. [2025-09-16T21:22:19.096508] [DEBUG] [LOCAL ] VVR: Derivative data saved (1339 records). [2025-09-16T21:22:19.096886] [INFO ] [MAIN ] VVR: Successfully saved derivative data. [2025-09-16T21:22:19.098687] [INFO ] [MAIN ] Derivative Progress: 1933/2026 symbols completed. VVR took 1.0s. Estimated remaining: 30.2s. Rate: 184.9 symbols/min [2025-09-16T21:22:19.115895] [DEBUG] [MAIN ] VVV: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:19.117503] [INFO ] [MAIN ] VVV: Generated 1339 derivative records from 37484 primary records. [2025-09-16T21:22:19.117699] [DEBUG] [LOCAL ] VVV: Saving derivative data. [2025-09-16T21:22:19.133377] [DEBUG] [MAIN ] VVX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:19.137104] [INFO ] [MAIN ] VVX: Generated 1339 derivative records from 17316 primary records. [2025-09-16T21:22:19.138854] [DEBUG] [LOCAL ] VVX: Saving derivative data. [2025-09-16T21:22:19.140007] [DEBUG] [LOCAL ] VVV: Derivative data saved (1339 records). [2025-09-16T21:22:19.140278] [INFO ] [MAIN ] VVV: Successfully saved derivative data. [2025-09-16T21:22:19.143280] [INFO ] [MAIN ] Derivative Progress: 1934/2026 symbols completed. VVV took 1.0s. Estimated remaining: 29.8s. Rate: 185.0 symbols/min [2025-09-16T21:22:19.154234] [DEBUG] [LOCAL ] VVX: Derivative data saved (1339 records). [2025-09-16T21:22:19.154294] [INFO ] [MAIN ] VVX: Successfully saved derivative data. [2025-09-16T21:22:19.156133] [INFO ] [MAIN ] Derivative Progress: 1935/2026 symbols completed. VVX took 0.9s. Estimated remaining: 29.5s. Rate: 185.1 symbols/min [2025-09-16T21:22:19.156700] [INFO ] [MAIN ] VYX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:19.156799] [INFO ] [MAIN ] W: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:19.157248] [INFO ] [MAIN ] WAB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:19.220731] [DEBUG] [LOCAL ] VYX: Loaded 36254 existing records from primary storage. [2025-09-16T21:22:19.220923] [INFO ] [MAIN ] VYX: Loaded 36254 primary data records. [2025-09-16T21:22:19.221357] [DEBUG] [LOCAL ] WAB: Loaded 32519 existing records from primary storage. [2025-09-16T21:22:19.257947] [INFO ] [MAIN ] WAB: Loaded 32519 primary data records. [2025-09-16T21:22:19.379214] [DEBUG] [LOCAL ] W: Loaded 39909 existing records from primary storage. [2025-09-16T21:22:19.402993] [INFO ] [MAIN ] W: Loaded 39909 primary data records. [2025-09-16T21:22:20.069100] [DEBUG] [MAIN ] VYX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:20.079542] [INFO ] [MAIN ] VYX: Generated 1339 derivative records from 36254 primary records. [2025-09-16T21:22:20.079981] [DEBUG] [LOCAL ] VYX: Saving derivative data. [2025-09-16T21:22:20.079856] [DEBUG] [MAIN ] WAB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:20.081020] [INFO ] [MAIN ] WAB: Generated 1339 derivative records from 32519 primary records. [2025-09-16T21:22:20.081214] [DEBUG] [LOCAL ] WAB: Saving derivative data. [2025-09-16T21:22:20.107801] [DEBUG] [LOCAL ] VYX: Derivative data saved (1339 records). [2025-09-16T21:22:20.108409] [DEBUG] [LOCAL ] WAB: Derivative data saved (1339 records). [2025-09-16T21:22:20.117919] [INFO ] [MAIN ] WAB: Successfully saved derivative data. [2025-09-16T21:22:20.119969] [INFO ] [MAIN ] Derivative Progress: 1936/2026 symbols completed. WAB took 1.0s. Estimated remaining: 29.2s. Rate: 184.9 symbols/min [2025-09-16T21:22:20.117839] [INFO ] [MAIN ] VYX: Successfully saved derivative data. [2025-09-16T21:22:20.121981] [INFO ] [MAIN ] Derivative Progress: 1937/2026 symbols completed. VYX took 1.0s. Estimated remaining: 28.9s. Rate: 185.0 symbols/min [2025-09-16T21:22:20.120469] [DEBUG] [MAIN ] W: Filtered 5181 bins outside market hours, 5780 incomplete bins [2025-09-16T21:22:20.123010] [INFO ] [MAIN ] W: Generated 1338 derivative records from 39909 primary records. [2025-09-16T21:22:20.122184] [INFO ] [MAIN ] WAL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:20.123152] [INFO ] [MAIN ] WAT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:20.123312] [DEBUG] [LOCAL ] W: Saving derivative data. [2025-09-16T21:22:20.136422] [DEBUG] [LOCAL ] W: Derivative data saved (1338 records). [2025-09-16T21:22:20.136559] [INFO ] [MAIN ] W: Successfully saved derivative data. [2025-09-16T21:22:20.138294] [INFO ] [MAIN ] Derivative Progress: 1938/2026 symbols completed. W took 1.0s. Estimated remaining: 28.5s. Rate: 185.1 symbols/min [2025-09-16T21:22:20.138551] [INFO ] [MAIN ] WBS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:20.170294] [DEBUG] [LOCAL ] WAT: Loaded 26221 existing records from primary storage. [2025-09-16T21:22:20.170436] [INFO ] [MAIN ] WAT: Loaded 26221 primary data records. [2025-09-16T21:22:20.295266] [DEBUG] [LOCAL ] WAL: Loaded 33162 existing records from primary storage. [2025-09-16T21:22:20.306055] [INFO ] [MAIN ] WAL: Loaded 33162 primary data records. [2025-09-16T21:22:20.307206] [DEBUG] [LOCAL ] WBS: Loaded 36149 existing records from primary storage. [2025-09-16T21:22:20.328932] [INFO ] [MAIN ] WBS: Loaded 36149 primary data records. [2025-09-16T21:22:21.061364] [DEBUG] [MAIN ] WAT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:21.063601] [INFO ] [MAIN ] WAT: Generated 1339 derivative records from 26221 primary records. [2025-09-16T21:22:21.063907] [DEBUG] [LOCAL ] WAT: Saving derivative data. [2025-09-16T21:22:21.079484] [DEBUG] [MAIN ] WAL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:21.084564] [DEBUG] [MAIN ] WBS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:21.090835] [INFO ] [MAIN ] WAL: Generated 1339 derivative records from 33162 primary records. [2025-09-16T21:22:21.095548] [INFO ] [MAIN ] WBS: Generated 1339 derivative records from 36149 primary records. [2025-09-16T21:22:21.094503] [DEBUG] [LOCAL ] WAL: Saving derivative data. [2025-09-16T21:22:21.096083] [DEBUG] [LOCAL ] WBS: Saving derivative data. [2025-09-16T21:22:21.110521] [DEBUG] [LOCAL ] WAT: Derivative data saved (1339 records). [2025-09-16T21:22:21.116325] [DEBUG] [LOCAL ] WBS: Derivative data saved (1339 records). [2025-09-16T21:22:21.117243] [INFO ] [MAIN ] WBS: Successfully saved derivative data. [2025-09-16T21:22:21.116480] [INFO ] [MAIN ] WAT: Successfully saved derivative data. [2025-09-16T21:22:21.121658] [INFO ] [MAIN ] Derivative Progress: 1939/2026 symbols completed. WBS took 1.0s. Estimated remaining: 28.2s. Rate: 184.9 symbols/min [2025-09-16T21:22:21.126559] [INFO ] [MAIN ] WBX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:21.126759] [DEBUG] [LOCAL ] WAL: Derivative data saved (1339 records). [2025-09-16T21:22:21.126461] [INFO ] [MAIN ] Derivative Progress: 1940/2026 symbols completed. WAT took 1.0s. Estimated remaining: 27.9s. Rate: 185.0 symbols/min [2025-09-16T21:22:21.126965] [INFO ] [MAIN ] WAL: Successfully saved derivative data. [2025-09-16T21:22:21.129203] [INFO ] [MAIN ] Derivative Progress: 1941/2026 symbols completed. WAL took 1.0s. Estimated remaining: 27.6s. Rate: 185.1 symbols/min [2025-09-16T21:22:21.129367] [INFO ] [MAIN ] WCC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:21.129553] [INFO ] [MAIN ] WCN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:21.142700] [DEBUG] [LOCAL ] WBX: Loaded 7488 existing records from primary storage. [2025-09-16T21:22:21.142995] [INFO ] [MAIN ] WBX: Loaded 7488 primary data records. [2025-09-16T21:22:21.279767] [DEBUG] [LOCAL ] WCC: Loaded 29047 existing records from primary storage. [2025-09-16T21:22:21.285554] [INFO ] [MAIN ] WCC: Loaded 29047 primary data records. [2025-09-16T21:22:21.554786] [DEBUG] [LOCAL ] WCN: Loaded 35591 existing records from primary storage. [2025-09-16T21:22:21.561221] [INFO ] [MAIN ] WCN: Loaded 35591 primary data records. [2025-09-16T21:22:22.014086] [DEBUG] [MAIN ] WBX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:22.015014] [INFO ] [MAIN ] WBX: Generated 1339 derivative records from 7488 primary records. [2025-09-16T21:22:22.015266] [DEBUG] [LOCAL ] WBX: Saving derivative data. [2025-09-16T21:22:22.029800] [DEBUG] [LOCAL ] WBX: Derivative data saved (1339 records). [2025-09-16T21:22:22.039236] [INFO ] [MAIN ] WBX: Successfully saved derivative data. [2025-09-16T21:22:22.041521] [INFO ] [MAIN ] Derivative Progress: 1942/2026 symbols completed. WBX took 0.9s. Estimated remaining: 27.3s. Rate: 184.9 symbols/min [2025-09-16T21:22:22.039820] [DEBUG] [MAIN ] WCC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:22.042332] [INFO ] [MAIN ] WCC: Generated 1339 derivative records from 29047 primary records. [2025-09-16T21:22:22.042491] [INFO ] [MAIN ] WD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:22.042696] [DEBUG] [LOCAL ] WCC: Saving derivative data. [2025-09-16T21:22:22.055739] [DEBUG] [LOCAL ] WCC: Derivative data saved (1339 records). [2025-09-16T21:22:22.055901] [INFO ] [MAIN ] WCC: Successfully saved derivative data. [2025-09-16T21:22:22.057468] [INFO ] [MAIN ] Derivative Progress: 1943/2026 symbols completed. WCC took 0.9s. Estimated remaining: 26.9s. Rate: 185.0 symbols/min [2025-09-16T21:22:22.057800] [INFO ] [MAIN ] WDH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:22.075084] [DEBUG] [MAIN ] WCN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:22.078489] [INFO ] [MAIN ] WCN: Generated 1339 derivative records from 35591 primary records. [2025-09-16T21:22:22.078630] [DEBUG] [LOCAL ] WCN: Saving derivative data. [2025-09-16T21:22:22.099751] [DEBUG] [LOCAL ] WDH: Loaded 12206 existing records from primary storage. [2025-09-16T21:22:22.099262] [DEBUG] [LOCAL ] WD: Loaded 17197 existing records from primary storage. [2025-09-16T21:22:22.101948] [DEBUG] [LOCAL ] WCN: Derivative data saved (1339 records). [2025-09-16T21:22:22.102035] [INFO ] [MAIN ] WCN: Successfully saved derivative data. [2025-09-16T21:22:22.102111] [INFO ] [MAIN ] WD: Loaded 17197 primary data records. [2025-09-16T21:22:22.102266] [INFO ] [MAIN ] WDH: Loaded 12206 primary data records. [2025-09-16T21:22:22.125359] [INFO ] [MAIN ] Derivative Progress: 1944/2026 symbols completed. WCN took 1.0s. Estimated remaining: 26.6s. Rate: 185.1 symbols/min [2025-09-16T21:22:22.250676] [INFO ] [MAIN ] WDI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:22.633294] [DEBUG] [LOCAL ] WDI: Loaded 15400 existing records from primary storage. [2025-09-16T21:22:22.656158] [INFO ] [MAIN ] WDI: Loaded 15400 primary data records. [2025-09-16T21:22:23.012380] [DEBUG] [MAIN ] WDH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:23.012845] [DEBUG] [MAIN ] WD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:23.013554] [INFO ] [MAIN ] WD: Generated 1339 derivative records from 17197 primary records. [2025-09-16T21:22:23.014623] [DEBUG] [LOCAL ] WD: Saving derivative data. [2025-09-16T21:22:23.014208] [INFO ] [MAIN ] WDH: Generated 1339 derivative records from 12206 primary records. [2025-09-16T21:22:23.014881] [DEBUG] [LOCAL ] WDH: Saving derivative data. [2025-09-16T21:22:23.037382] [DEBUG] [LOCAL ] WD: Derivative data saved (1339 records). [2025-09-16T21:22:23.037928] [INFO ] [MAIN ] WD: Successfully saved derivative data. [2025-09-16T21:22:23.040022] [INFO ] [MAIN ] Derivative Progress: 1945/2026 symbols completed. WD took 1.0s. Estimated remaining: 26.3s. Rate: 184.9 symbols/min [2025-09-16T21:22:23.041728] [INFO ] [MAIN ] WDS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:23.042603] [DEBUG] [LOCAL ] WDH: Derivative data saved (1339 records). [2025-09-16T21:22:23.042979] [INFO ] [MAIN ] WDH: Successfully saved derivative data. [2025-09-16T21:22:23.045460] [INFO ] [MAIN ] Derivative Progress: 1946/2026 symbols completed. WDH took 1.0s. Estimated remaining: 25.9s. Rate: 185.0 symbols/min [2025-09-16T21:22:23.046296] [INFO ] [MAIN ] WEA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:23.062714] [DEBUG] [MAIN ] WDI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:23.066233] [DEBUG] [LOCAL ] WEA: Loaded 6181 existing records from primary storage. [2025-09-16T21:22:23.067171] [INFO ] [MAIN ] WEA: Loaded 6181 primary data records. [2025-09-16T21:22:23.067049] [INFO ] [MAIN ] WDI: Generated 1339 derivative records from 15400 primary records. [2025-09-16T21:22:23.080069] [DEBUG] [LOCAL ] WDI: Saving derivative data. [2025-09-16T21:22:23.204424] [DEBUG] [LOCAL ] WDS: Loaded 31569 existing records from primary storage. [2025-09-16T21:22:23.206342] [DEBUG] [LOCAL ] WDI: Derivative data saved (1339 records). [2025-09-16T21:22:23.206796] [INFO ] [MAIN ] WDS: Loaded 31569 primary data records. [2025-09-16T21:22:23.227455] [INFO ] [MAIN ] WDI: Successfully saved derivative data. [2025-09-16T21:22:23.229865] [INFO ] [MAIN ] Derivative Progress: 1947/2026 symbols completed. WDI took 1.0s. Estimated remaining: 25.6s. Rate: 185.0 symbols/min [2025-09-16T21:22:23.255760] [INFO ] [MAIN ] WEAV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:23.670566] [DEBUG] [LOCAL ] WEAV: Loaded 31145 existing records from primary storage. [2025-09-16T21:22:23.671939] [INFO ] [MAIN ] WEAV: Loaded 31145 primary data records. [2025-09-16T21:22:23.986747] [DEBUG] [MAIN ] WEA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:23.987570] [INFO ] [MAIN ] WEA: Generated 1339 derivative records from 6181 primary records. [2025-09-16T21:22:23.987692] [DEBUG] [LOCAL ] WEA: Saving derivative data. [2025-09-16T21:22:24.005781] [DEBUG] [LOCAL ] WEA: Derivative data saved (1339 records). [2025-09-16T21:22:24.012427] [INFO ] [MAIN ] WEA: Successfully saved derivative data. [2025-09-16T21:22:24.014047] [INFO ] [MAIN ] Derivative Progress: 1948/2026 symbols completed. WEA took 1.0s. Estimated remaining: 25.3s. Rate: 184.9 symbols/min [2025-09-16T21:22:24.018147] [DEBUG] [MAIN ] WDS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:24.019167] [INFO ] [MAIN ] WDS: Generated 1339 derivative records from 31569 primary records. [2025-09-16T21:22:24.019325] [DEBUG] [LOCAL ] WDS: Saving derivative data. [2025-09-16T21:22:24.032870] [DEBUG] [LOCAL ] WDS: Derivative data saved (1339 records). [2025-09-16T21:22:24.032982] [INFO ] [MAIN ] WDS: Successfully saved derivative data. [2025-09-16T21:22:24.035130] [INFO ] [MAIN ] Derivative Progress: 1949/2026 symbols completed. WDS took 1.0s. Estimated remaining: 25.0s. Rate: 185.0 symbols/min [2025-09-16T21:22:24.048371] [DEBUG] [MAIN ] WEAV: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:24.049011] [INFO ] [MAIN ] WEAV: Generated 1339 derivative records from 31145 primary records. [2025-09-16T21:22:24.049073] [DEBUG] [LOCAL ] WEAV: Saving derivative data. [2025-09-16T21:22:24.060691] [DEBUG] [LOCAL ] WEAV: Derivative data saved (1339 records). [2025-09-16T21:22:24.060752] [INFO ] [MAIN ] WEAV: Successfully saved derivative data. [2025-09-16T21:22:24.062472] [INFO ] [MAIN ] Derivative Progress: 1950/2026 symbols completed. WEAV took 0.8s. Estimated remaining: 24.6s. Rate: 185.1 symbols/min [2025-09-16T21:22:24.063062] [INFO ] [MAIN ] WES: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:24.062998] [INFO ] [MAIN ] WEC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:24.063301] [INFO ] [MAIN ] WELL: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:24.128821] [DEBUG] [LOCAL ] WES: Loaded 35771 existing records from primary storage. [2025-09-16T21:22:24.130490] [INFO ] [MAIN ] WES: Loaded 35771 primary data records. [2025-09-16T21:22:24.131031] [DEBUG] [LOCAL ] WELL: Loaded 38889 existing records from primary storage. [2025-09-16T21:22:24.141912] [INFO ] [MAIN ] WELL: Loaded 38889 primary data records. [2025-09-16T21:22:24.199010] [DEBUG] [LOCAL ] WEC: Loaded 38901 existing records from primary storage. [2025-09-16T21:22:24.221477] [INFO ] [MAIN ] WEC: Loaded 38901 primary data records. [2025-09-16T21:22:25.000387] [DEBUG] [MAIN ] WELL: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:25.019509] [INFO ] [MAIN ] WELL: Generated 1339 derivative records from 38889 primary records. [2025-09-16T21:22:25.019862] [DEBUG] [LOCAL ] WELL: Saving derivative data. [2025-09-16T21:22:25.020014] [DEBUG] [MAIN ] WEC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:25.020955] [DEBUG] [MAIN ] WES: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:25.021678] [INFO ] [MAIN ] WEC: Generated 1339 derivative records from 38901 primary records. [2025-09-16T21:22:25.031267] [DEBUG] [LOCAL ] WEC: Saving derivative data. [2025-09-16T21:22:25.029071] [INFO ] [MAIN ] WES: Generated 1339 derivative records from 35771 primary records. [2025-09-16T21:22:25.034727] [DEBUG] [LOCAL ] WELL: Derivative data saved (1339 records). [2025-09-16T21:22:25.034989] [INFO ] [MAIN ] WELL: Successfully saved derivative data. [2025-09-16T21:22:25.037675] [INFO ] [MAIN ] Derivative Progress: 1951/2026 symbols completed. WELL took 1.0s. Estimated remaining: 24.3s. Rate: 184.9 symbols/min [2025-09-16T21:22:25.034947] [DEBUG] [LOCAL ] WES: Saving derivative data. [2025-09-16T21:22:25.047163] [INFO ] [MAIN ] WEX: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:25.050522] [DEBUG] [LOCAL ] WEC: Derivative data saved (1339 records). [2025-09-16T21:22:25.057070] [INFO ] [MAIN ] WEC: Successfully saved derivative data. [2025-09-16T21:22:25.059366] [INFO ] [MAIN ] Derivative Progress: 1952/2026 symbols completed. WEC took 1.0s. Estimated remaining: 24.0s. Rate: 185.0 symbols/min [2025-09-16T21:22:25.061977] [INFO ] [MAIN ] WF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:25.066536] [DEBUG] [LOCAL ] WES: Derivative data saved (1339 records). [2025-09-16T21:22:25.066702] [INFO ] [MAIN ] WES: Successfully saved derivative data. [2025-09-16T21:22:25.071056] [INFO ] [MAIN ] Derivative Progress: 1953/2026 symbols completed. WES took 1.0s. Estimated remaining: 23.7s. Rate: 185.0 symbols/min [2025-09-16T21:22:25.071364] [INFO ] [MAIN ] WFG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:25.079592] [DEBUG] [LOCAL ] WF: Loaded 8075 existing records from primary storage. [2025-09-16T21:22:25.079754] [INFO ] [MAIN ] WF: Loaded 8075 primary data records. [2025-09-16T21:22:25.252710] [DEBUG] [LOCAL ] WEX: Loaded 24346 existing records from primary storage. [2025-09-16T21:22:25.313227] [DEBUG] [LOCAL ] WFG: Loaded 18005 existing records from primary storage. [2025-09-16T21:22:25.312636] [INFO ] [MAIN ] WEX: Loaded 24346 primary data records. [2025-09-16T21:22:25.396319] [INFO ] [MAIN ] WFG: Loaded 18005 primary data records. [2025-09-16T21:22:25.973123] [DEBUG] [MAIN ] WF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:25.974022] [INFO ] [MAIN ] WF: Generated 1339 derivative records from 8075 primary records. [2025-09-16T21:22:25.974104] [DEBUG] [LOCAL ] WF: Saving derivative data. [2025-09-16T21:22:25.988375] [DEBUG] [LOCAL ] WF: Derivative data saved (1339 records). [2025-09-16T21:22:25.988469] [INFO ] [MAIN ] WF: Successfully saved derivative data. [2025-09-16T21:22:25.989886] [INFO ] [MAIN ] Derivative Progress: 1954/2026 symbols completed. WF took 0.9s. Estimated remaining: 23.4s. Rate: 184.9 symbols/min [2025-09-16T21:22:25.990307] [INFO ] [MAIN ] WGO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:26.017365] [DEBUG] [MAIN ] WEX: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:26.017870] [DEBUG] [MAIN ] WFG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:26.018758] [INFO ] [MAIN ] WEX: Generated 1339 derivative records from 24346 primary records. [2025-09-16T21:22:26.019841] [INFO ] [MAIN ] WFG: Generated 1339 derivative records from 18005 primary records. [2025-09-16T21:22:26.019907] [DEBUG] [LOCAL ] WEX: Saving derivative data. [2025-09-16T21:22:26.020718] [DEBUG] [LOCAL ] WFG: Saving derivative data. [2025-09-16T21:22:26.040171] [DEBUG] [LOCAL ] WEX: Derivative data saved (1339 records). [2025-09-16T21:22:26.040518] [INFO ] [MAIN ] WEX: Successfully saved derivative data. [2025-09-16T21:22:26.048060] [INFO ] [MAIN ] Derivative Progress: 1955/2026 symbols completed. WEX took 1.0s. Estimated remaining: 23.0s. Rate: 184.9 symbols/min [2025-09-16T21:22:26.048361] [INFO ] [MAIN ] WH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:26.055187] [DEBUG] [LOCAL ] WFG: Derivative data saved (1339 records). [2025-09-16T21:22:26.055841] [INFO ] [MAIN ] WFG: Successfully saved derivative data. [2025-09-16T21:22:26.057726] [INFO ] [MAIN ] Derivative Progress: 1956/2026 symbols completed. WFG took 1.0s. Estimated remaining: 22.7s. Rate: 185.0 symbols/min [2025-09-16T21:22:26.058034] [INFO ] [MAIN ] WHD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:26.067436] [DEBUG] [LOCAL ] WGO: Loaded 28067 existing records from primary storage. [2025-09-16T21:22:26.067681] [INFO ] [MAIN ] WGO: Loaded 28067 primary data records. [2025-09-16T21:22:26.351549] [DEBUG] [LOCAL ] WH: Loaded 34050 existing records from primary storage. [2025-09-16T21:22:26.362763] [INFO ] [MAIN ] WH: Loaded 34050 primary data records. [2025-09-16T21:22:26.437490] [DEBUG] [LOCAL ] WHD: Loaded 29279 existing records from primary storage. [2025-09-16T21:22:26.450626] [INFO ] [MAIN ] WHD: Loaded 29279 primary data records. [2025-09-16T21:22:26.940418] [DEBUG] [MAIN ] WGO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:26.941671] [INFO ] [MAIN ] WGO: Generated 1339 derivative records from 28067 primary records. [2025-09-16T21:22:26.942248] [DEBUG] [LOCAL ] WGO: Saving derivative data. [2025-09-16T21:22:26.958153] [DEBUG] [LOCAL ] WGO: Derivative data saved (1339 records). [2025-09-16T21:22:26.959856] [INFO ] [MAIN ] WGO: Successfully saved derivative data. [2025-09-16T21:22:26.961659] [INFO ] [MAIN ] Derivative Progress: 1957/2026 symbols completed. WGO took 1.0s. Estimated remaining: 22.4s. Rate: 184.9 symbols/min [2025-09-16T21:22:26.962210] [INFO ] [MAIN ] WHG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:26.973205] [DEBUG] [MAIN ] WH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:26.974025] [INFO ] [MAIN ] WH: Generated 1339 derivative records from 34050 primary records. [2025-09-16T21:22:26.974888] [DEBUG] [LOCAL ] WH: Saving derivative data. [2025-09-16T21:22:26.984757] [DEBUG] [LOCAL ] WHG: Loaded 2596 existing records from primary storage. [2025-09-16T21:22:26.988121] [INFO ] [MAIN ] WHG: Loaded 2596 primary data records. [2025-09-16T21:22:27.066752] [DEBUG] [LOCAL ] WH: Derivative data saved (1339 records). [2025-09-16T21:22:27.066991] [INFO ] [MAIN ] WH: Successfully saved derivative data. [2025-09-16T21:22:27.067312] [DEBUG] [MAIN ] WHD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:27.069075] [INFO ] [MAIN ] Derivative Progress: 1958/2026 symbols completed. WH took 1.0s. Estimated remaining: 22.1s. Rate: 184.9 symbols/min [2025-09-16T21:22:27.070117] [INFO ] [MAIN ] WHD: Generated 1339 derivative records from 29279 primary records. [2025-09-16T21:22:27.082715] [DEBUG] [LOCAL ] WHD: Saving derivative data. [2025-09-16T21:22:27.093432] [INFO ] [MAIN ] WHR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:27.150666] [DEBUG] [LOCAL ] WHD: Derivative data saved (1339 records). [2025-09-16T21:22:27.155939] [INFO ] [MAIN ] WHD: Successfully saved derivative data. [2025-09-16T21:22:27.170861] [INFO ] [MAIN ] Derivative Progress: 1959/2026 symbols completed. WHD took 1.1s. Estimated remaining: 21.7s. Rate: 185.0 symbols/min [2025-09-16T21:22:27.205856] [INFO ] [MAIN ] WIA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:27.336534] [DEBUG] [LOCAL ] WIA: Loaded 3615 existing records from primary storage. [2025-09-16T21:22:27.337019] [INFO ] [MAIN ] WIA: Loaded 3615 primary data records. [2025-09-16T21:22:27.520030] [DEBUG] [LOCAL ] WHR: Loaded 36249 existing records from primary storage. [2025-09-16T21:22:27.536030] [INFO ] [MAIN ] WHR: Loaded 36249 primary data records. [2025-09-16T21:22:27.902894] [DEBUG] [MAIN ] WHG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:27.904423] [INFO ] [MAIN ] WHG: Generated 1339 derivative records from 2596 primary records. [2025-09-16T21:22:27.904620] [DEBUG] [LOCAL ] WHG: Saving derivative data. [2025-09-16T21:22:27.917486] [DEBUG] [LOCAL ] WHG: Derivative data saved (1339 records). [2025-09-16T21:22:27.918479] [INFO ] [MAIN ] WHG: Successfully saved derivative data. [2025-09-16T21:22:27.920209] [INFO ] [MAIN ] Derivative Progress: 1960/2026 symbols completed. WHG took 1.0s. Estimated remaining: 21.4s. Rate: 184.9 symbols/min [2025-09-16T21:22:27.920414] [INFO ] [MAIN ] WINN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:27.934356] [DEBUG] [MAIN ] WIA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:27.937227] [INFO ] [MAIN ] WIA: Generated 1339 derivative records from 3615 primary records. [2025-09-16T21:22:27.937472] [DEBUG] [LOCAL ] WIA: Saving derivative data. [2025-09-16T21:22:27.952660] [DEBUG] [LOCAL ] WIA: Derivative data saved (1339 records). [2025-09-16T21:22:27.952776] [INFO ] [MAIN ] WIA: Successfully saved derivative data. [2025-09-16T21:22:27.954899] [INFO ] [MAIN ] Derivative Progress: 1961/2026 symbols completed. WIA took 0.7s. Estimated remaining: 21.1s. Rate: 185.0 symbols/min [2025-09-16T21:22:27.951454] [DEBUG] [LOCAL ] WINN: Loaded 8042 existing records from primary storage. [2025-09-16T21:22:27.955399] [INFO ] [MAIN ] WINN: Loaded 8042 primary data records. [2025-09-16T21:22:27.955579] [INFO ] [MAIN ] WIT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:28.088256] [DEBUG] [MAIN ] WHR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:28.123184] [INFO ] [MAIN ] WHR: Generated 1339 derivative records from 36249 primary records. [2025-09-16T21:22:28.147323] [DEBUG] [LOCAL ] WHR: Saving derivative data. [2025-09-16T21:22:28.263787] [DEBUG] [LOCAL ] WHR: Derivative data saved (1339 records). [2025-09-16T21:22:28.276479] [INFO ] [MAIN ] WHR: Successfully saved derivative data. [2025-09-16T21:22:28.277672] [DEBUG] [LOCAL ] WIT: Loaded 39032 existing records from primary storage. [2025-09-16T21:22:28.277871] [INFO ] [MAIN ] WIT: Loaded 39032 primary data records. [2025-09-16T21:22:28.280394] [INFO ] [MAIN ] Derivative Progress: 1962/2026 symbols completed. WHR took 1.2s. Estimated remaining: 20.8s. Rate: 185.0 symbols/min [2025-09-16T21:22:28.285947] [INFO ] [MAIN ] WIW: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:28.478678] [DEBUG] [LOCAL ] WIW: Loaded 15447 existing records from primary storage. [2025-09-16T21:22:28.479508] [INFO ] [MAIN ] WIW: Loaded 15447 primary data records. [2025-09-16T21:22:28.662402] [DEBUG] [MAIN ] WINN: Filtered 5181 bins outside market hours, 5780 incomplete bins [2025-09-16T21:22:28.676281] [INFO ] [MAIN ] WINN: Generated 1338 derivative records from 8042 primary records. [2025-09-16T21:22:28.688395] [DEBUG] [LOCAL ] WINN: Saving derivative data. [2025-09-16T21:22:28.701413] [DEBUG] [LOCAL ] WINN: Derivative data saved (1338 records). [2025-09-16T21:22:28.707075] [INFO ] [MAIN ] WINN: Successfully saved derivative data. [2025-09-16T21:22:28.724243] [INFO ] [MAIN ] Derivative Progress: 1963/2026 symbols completed. WINN took 0.8s. Estimated remaining: 20.4s. Rate: 184.9 symbols/min [2025-09-16T21:22:28.884910] [DEBUG] [MAIN ] WIT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:28.886004] [INFO ] [MAIN ] WIT: Generated 1339 derivative records from 39032 primary records. [2025-09-16T21:22:28.886203] [DEBUG] [LOCAL ] WIT: Saving derivative data. [2025-09-16T21:22:28.901323] [DEBUG] [LOCAL ] WIT: Derivative data saved (1339 records). [2025-09-16T21:22:28.901515] [INFO ] [MAIN ] WIT: Successfully saved derivative data. [2025-09-16T21:22:28.903460] [INFO ] [MAIN ] Derivative Progress: 1964/2026 symbols completed. WIT took 0.9s. Estimated remaining: 20.1s. Rate: 185.0 symbols/min [2025-09-16T21:22:28.913211] [DEBUG] [MAIN ] WIW: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:28.913782] [INFO ] [MAIN ] WIW: Generated 1339 derivative records from 15447 primary records. [2025-09-16T21:22:28.913842] [DEBUG] [LOCAL ] WIW: Saving derivative data. [2025-09-16T21:22:28.925397] [DEBUG] [LOCAL ] WIW: Derivative data saved (1339 records). [2025-09-16T21:22:28.925461] [INFO ] [MAIN ] WIW: Successfully saved derivative data. [2025-09-16T21:22:28.927196] [INFO ] [MAIN ] Derivative Progress: 1965/2026 symbols completed. WIW took 0.6s. Estimated remaining: 19.8s. Rate: 185.1 symbols/min [2025-09-16T21:22:28.927689] [INFO ] [MAIN ] WLK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:28.927583] [INFO ] [MAIN ] WK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:28.927842] [INFO ] [MAIN ] WKC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:28.976412] [DEBUG] [LOCAL ] WKC: Loaded 25862 existing records from primary storage. [2025-09-16T21:22:28.968961] [DEBUG] [LOCAL ] WK: Loaded 26749 existing records from primary storage. [2025-09-16T21:22:28.976680] [INFO ] [MAIN ] WK: Loaded 26749 primary data records. [2025-09-16T21:22:28.976622] [INFO ] [MAIN ] WKC: Loaded 25862 primary data records. [2025-09-16T21:22:29.207428] [DEBUG] [LOCAL ] WLK: Loaded 34384 existing records from primary storage. [2025-09-16T21:22:29.260121] [INFO ] [MAIN ] WLK: Loaded 34384 primary data records. [2025-09-16T21:22:29.853230] [DEBUG] [MAIN ] WKC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:29.863431] [DEBUG] [MAIN ] WK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:29.863113] [INFO ] [MAIN ] WKC: Generated 1339 derivative records from 25862 primary records. [2025-09-16T21:22:29.864225] [INFO ] [MAIN ] WK: Generated 1339 derivative records from 26749 primary records. [2025-09-16T21:22:29.864328] [DEBUG] [LOCAL ] WKC: Saving derivative data. [2025-09-16T21:22:29.864790] [DEBUG] [LOCAL ] WK: Saving derivative data. [2025-09-16T21:22:29.889667] [DEBUG] [LOCAL ] WKC: Derivative data saved (1339 records). [2025-09-16T21:22:29.889953] [INFO ] [MAIN ] WKC: Successfully saved derivative data. [2025-09-16T21:22:29.890029] [DEBUG] [LOCAL ] WK: Derivative data saved (1339 records). [2025-09-16T21:22:29.892185] [INFO ] [MAIN ] Derivative Progress: 1966/2026 symbols completed. WKC took 1.0s. Estimated remaining: 19.5s. Rate: 184.9 symbols/min [2025-09-16T21:22:29.892964] [INFO ] [MAIN ] WK: Successfully saved derivative data. [2025-09-16T21:22:29.893000] [INFO ] [MAIN ] WLKP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:29.895392] [INFO ] [MAIN ] Derivative Progress: 1967/2026 symbols completed. WK took 1.0s. Estimated remaining: 19.1s. Rate: 185.0 symbols/min [2025-09-16T21:22:29.895720] [INFO ] [MAIN ] WLTG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:29.907082] [DEBUG] [MAIN ] WLK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:29.908049] [INFO ] [MAIN ] WLK: Generated 1339 derivative records from 34384 primary records. [2025-09-16T21:22:29.909767] [DEBUG] [LOCAL ] WLK: Saving derivative data. [2025-09-16T21:22:29.909697] [DEBUG] [LOCAL ] WLTG: Loaded 892 existing records from primary storage. [2025-09-16T21:22:29.909894] [INFO ] [MAIN ] WLTG: Loaded 892 primary data records. [2025-09-16T21:22:29.983027] [DEBUG] [LOCAL ] WLKP: Loaded 4973 existing records from primary storage. [2025-09-16T21:22:29.998195] [INFO ] [MAIN ] WLKP: Loaded 4973 primary data records. [2025-09-16T21:22:30.058825] [DEBUG] [LOCAL ] WLK: Derivative data saved (1339 records). [2025-09-16T21:22:30.096608] [INFO ] [MAIN ] WLK: Successfully saved derivative data. [2025-09-16T21:22:30.131711] [INFO ] [MAIN ] Derivative Progress: 1968/2026 symbols completed. WLK took 1.2s. Estimated remaining: 18.8s. Rate: 185.0 symbols/min [2025-09-16T21:22:30.191143] [INFO ] [MAIN ] WLY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:30.503662] [DEBUG] [LOCAL ] WLY: Loaded 22463 existing records from primary storage. [2025-09-16T21:22:30.504152] [INFO ] [MAIN ] WLY: Loaded 22463 primary data records. [2025-09-16T21:22:30.624006] [DEBUG] [MAIN ] WLTG: Filtered 5181 bins outside market hours, 5781 incomplete bins [2025-09-16T21:22:30.625444] [INFO ] [MAIN ] WLTG: Generated 1337 derivative records from 892 primary records. [2025-09-16T21:22:30.625992] [DEBUG] [LOCAL ] WLTG: Saving derivative data. [2025-09-16T21:22:30.676589] [DEBUG] [MAIN ] WLKP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:30.722517] [INFO ] [MAIN ] WLKP: Generated 1339 derivative records from 4973 primary records. [2025-09-16T21:22:30.720774] [DEBUG] [LOCAL ] WLTG: Derivative data saved (1337 records). [2025-09-16T21:22:30.801420] [INFO ] [MAIN ] WLTG: Successfully saved derivative data. [2025-09-16T21:22:30.812543] [DEBUG] [LOCAL ] WLKP: Saving derivative data. [2025-09-16T21:22:30.815044] [INFO ] [MAIN ] Derivative Progress: 1969/2026 symbols completed. WLTG took 0.9s. Estimated remaining: 18.5s. Rate: 184.9 symbols/min [2025-09-16T21:22:30.815659] [INFO ] [MAIN ] WMK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:30.829715] [DEBUG] [LOCAL ] WLKP: Derivative data saved (1339 records). [2025-09-16T21:22:30.829943] [INFO ] [MAIN ] WLKP: Successfully saved derivative data. [2025-09-16T21:22:30.832229] [INFO ] [MAIN ] Derivative Progress: 1970/2026 symbols completed. WLKP took 0.9s. Estimated remaining: 18.2s. Rate: 185.0 symbols/min [2025-09-16T21:22:30.832599] [INFO ] [MAIN ] WMS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:30.842343] [DEBUG] [LOCAL ] WMK: Loaded 10884 existing records from primary storage. [2025-09-16T21:22:30.842466] [INFO ] [MAIN ] WMK: Loaded 10884 primary data records. [2025-09-16T21:22:31.150001] [DEBUG] [MAIN ] WLY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:31.150094] [DEBUG] [LOCAL ] WMS: Loaded 29675 existing records from primary storage. [2025-09-16T21:22:31.150894] [INFO ] [MAIN ] WLY: Generated 1339 derivative records from 22463 primary records. [2025-09-16T21:22:31.150822] [INFO ] [MAIN ] WMS: Loaded 29675 primary data records. [2025-09-16T21:22:31.151068] [DEBUG] [LOCAL ] WLY: Saving derivative data. [2025-09-16T21:22:31.261017] [DEBUG] [LOCAL ] WLY: Derivative data saved (1339 records). [2025-09-16T21:22:31.261161] [INFO ] [MAIN ] WLY: Successfully saved derivative data. [2025-09-16T21:22:31.268887] [INFO ] [MAIN ] Derivative Progress: 1971/2026 symbols completed. WLY took 1.1s. Estimated remaining: 17.8s. Rate: 184.9 symbols/min [2025-09-16T21:22:31.280102] [INFO ] [MAIN ] WNC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:31.485754] [DEBUG] [MAIN ] WMK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:31.487310] [INFO ] [MAIN ] WMK: Generated 1339 derivative records from 10884 primary records. [2025-09-16T21:22:31.487794] [DEBUG] [LOCAL ] WMK: Saving derivative data. [2025-09-16T21:22:31.502698] [DEBUG] [LOCAL ] WMK: Derivative data saved (1339 records). [2025-09-16T21:22:31.502947] [INFO ] [MAIN ] WMK: Successfully saved derivative data. [2025-09-16T21:22:31.513100] [INFO ] [MAIN ] Derivative Progress: 1972/2026 symbols completed. WMK took 0.7s. Estimated remaining: 17.5s. Rate: 185.0 symbols/min [2025-09-16T21:22:31.514676] [INFO ] [MAIN ] WNS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:31.515383] [DEBUG] [LOCAL ] WNC: Loaded 28820 existing records from primary storage. [2025-09-16T21:22:31.515764] [INFO ] [MAIN ] WNC: Loaded 28820 primary data records. [2025-09-16T21:22:31.701820] [DEBUG] [MAIN ] WMS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:31.729302] [INFO ] [MAIN ] WMS: Generated 1339 derivative records from 29675 primary records. [2025-09-16T21:22:31.729447] [DEBUG] [LOCAL ] WMS: Saving derivative data. [2025-09-16T21:22:31.732684] [DEBUG] [LOCAL ] WNS: Loaded 30095 existing records from primary storage. [2025-09-16T21:22:31.859152] [INFO ] [MAIN ] WNS: Loaded 30095 primary data records. [2025-09-16T21:22:31.979024] [DEBUG] [LOCAL ] WMS: Derivative data saved (1339 records). [2025-09-16T21:22:31.984327] [INFO ] [MAIN ] WMS: Successfully saved derivative data. [2025-09-16T21:22:31.991741] [INFO ] [MAIN ] Derivative Progress: 1973/2026 symbols completed. WMS took 1.2s. Estimated remaining: 17.2s. Rate: 184.9 symbols/min [2025-09-16T21:22:32.008873] [INFO ] [MAIN ] WOLF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:32.215003] [DEBUG] [MAIN ] WNC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:32.216086] [INFO ] [MAIN ] WNC: Generated 1339 derivative records from 28820 primary records. [2025-09-16T21:22:32.216295] [DEBUG] [LOCAL ] WNC: Saving derivative data. [2025-09-16T21:22:32.244188] [DEBUG] [LOCAL ] WNC: Derivative data saved (1339 records). [2025-09-16T21:22:32.246192] [INFO ] [MAIN ] WNC: Successfully saved derivative data. [2025-09-16T21:22:32.248614] [INFO ] [MAIN ] Derivative Progress: 1974/2026 symbols completed. WNC took 1.0s. Estimated remaining: 16.9s. Rate: 184.9 symbols/min [2025-09-16T21:22:32.245853] [DEBUG] [LOCAL ] WOLF: Loaded 39889 existing records from primary storage. [2025-09-16T21:22:32.248937] [INFO ] [MAIN ] WOR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:32.249388] [INFO ] [MAIN ] WOLF: Loaded 39889 primary data records. [2025-09-16T21:22:32.440885] [DEBUG] [MAIN ] WNS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:32.470996] [DEBUG] [LOCAL ] WOR: Loaded 16781 existing records from primary storage. [2025-09-16T21:22:32.471260] [INFO ] [MAIN ] WOR: Loaded 16781 primary data records. [2025-09-16T21:22:32.472422] [INFO ] [MAIN ] WNS: Generated 1339 derivative records from 30095 primary records. [2025-09-16T21:22:32.590009] [DEBUG] [LOCAL ] WNS: Saving derivative data. [2025-09-16T21:22:32.677900] [DEBUG] [LOCAL ] WNS: Derivative data saved (1339 records). [2025-09-16T21:22:32.736273] [INFO ] [MAIN ] WNS: Successfully saved derivative data. [2025-09-16T21:22:32.760404] [INFO ] [MAIN ] Derivative Progress: 1975/2026 symbols completed. WNS took 1.2s. Estimated remaining: 16.6s. Rate: 184.9 symbols/min [2025-09-16T21:22:32.855144] [INFO ] [MAIN ] WOW: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:32.883519] [DEBUG] [MAIN ] WOLF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:32.885040] [INFO ] [MAIN ] WOLF: Generated 1339 derivative records from 39889 primary records. [2025-09-16T21:22:32.885171] [DEBUG] [LOCAL ] WOLF: Saving derivative data. [2025-09-16T21:22:32.907946] [DEBUG] [LOCAL ] WOW: Loaded 21995 existing records from primary storage. [2025-09-16T21:22:32.909264] [INFO ] [MAIN ] WOW: Loaded 21995 primary data records. [2025-09-16T21:22:32.953621] [DEBUG] [LOCAL ] WOLF: Derivative data saved (1339 records). [2025-09-16T21:22:32.977635] [INFO ] [MAIN ] WOLF: Successfully saved derivative data. [2025-09-16T21:22:32.979590] [INFO ] [MAIN ] Derivative Progress: 1976/2026 symbols completed. WOLF took 1.0s. Estimated remaining: 16.2s. Rate: 184.9 symbols/min [2025-09-16T21:22:32.980808] [INFO ] [MAIN ] WPC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:33.078506] [DEBUG] [MAIN ] WOR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:33.131045] [INFO ] [MAIN ] WOR: Generated 1339 derivative records from 16781 primary records. [2025-09-16T21:22:33.138375] [DEBUG] [LOCAL ] WOR: Saving derivative data. [2025-09-16T21:22:33.259170] [DEBUG] [LOCAL ] WOR: Derivative data saved (1339 records). [2025-09-16T21:22:33.260544] [INFO ] [MAIN ] WOR: Successfully saved derivative data. [2025-09-16T21:22:33.262548] [INFO ] [MAIN ] Derivative Progress: 1977/2026 symbols completed. WOR took 1.0s. Estimated remaining: 15.9s. Rate: 184.9 symbols/min [2025-09-16T21:22:33.263870] [INFO ] [MAIN ] WPM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:33.277694] [DEBUG] [LOCAL ] WPC: Loaded 36004 existing records from primary storage. [2025-09-16T21:22:33.279047] [INFO ] [MAIN ] WPC: Loaded 36004 primary data records. [2025-09-16T21:22:33.592661] [DEBUG] [MAIN ] WOW: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:33.608013] [INFO ] [MAIN ] WOW: Generated 1339 derivative records from 21995 primary records. [2025-09-16T21:22:33.608139] [DEBUG] [LOCAL ] WOW: Saving derivative data. [2025-09-16T21:22:33.609118] [DEBUG] [LOCAL ] WPM: Loaded 39229 existing records from primary storage. [2025-09-16T21:22:33.610922] [INFO ] [MAIN ] WPM: Loaded 39229 primary data records. [2025-09-16T21:22:33.670970] [DEBUG] [LOCAL ] WOW: Derivative data saved (1339 records). [2025-09-16T21:22:33.685045] [INFO ] [MAIN ] WOW: Successfully saved derivative data. [2025-09-16T21:22:33.687087] [INFO ] [MAIN ] Derivative Progress: 1978/2026 symbols completed. WOW took 0.8s. Estimated remaining: 15.6s. Rate: 184.9 symbols/min [2025-09-16T21:22:33.938343] [DEBUG] [MAIN ] WPC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:33.939633] [INFO ] [MAIN ] WPC: Generated 1339 derivative records from 36004 primary records. [2025-09-16T21:22:33.939898] [DEBUG] [LOCAL ] WPC: Saving derivative data. [2025-09-16T21:22:33.953216] [DEBUG] [LOCAL ] WPC: Derivative data saved (1339 records). [2025-09-16T21:22:33.953316] [INFO ] [MAIN ] WPC: Successfully saved derivative data. [2025-09-16T21:22:33.955234] [INFO ] [MAIN ] Derivative Progress: 1979/2026 symbols completed. WPC took 1.0s. Estimated remaining: 15.3s. Rate: 184.9 symbols/min [2025-09-16T21:22:33.969023] [DEBUG] [MAIN ] WPM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:33.969917] [INFO ] [MAIN ] WPM: Generated 1339 derivative records from 39229 primary records. [2025-09-16T21:22:33.969985] [DEBUG] [LOCAL ] WPM: Saving derivative data. [2025-09-16T21:22:33.982705] [DEBUG] [LOCAL ] WPM: Derivative data saved (1339 records). [2025-09-16T21:22:33.982774] [INFO ] [MAIN ] WPM: Successfully saved derivative data. [2025-09-16T21:22:33.984650] [INFO ] [MAIN ] Derivative Progress: 1980/2026 symbols completed. WPM took 0.7s. Estimated remaining: 14.9s. Rate: 185.0 symbols/min [2025-09-16T21:22:33.985191] [INFO ] [MAIN ] WPP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:33.985350] [INFO ] [MAIN ] WRB: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:33.985482] [INFO ] [MAIN ] WRBY: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:34.011977] [DEBUG] [LOCAL ] WPP: Loaded 24838 existing records from primary storage. [2025-09-16T21:22:34.012155] [INFO ] [MAIN ] WPP: Loaded 24838 primary data records. [2025-09-16T21:22:34.215176] [DEBUG] [LOCAL ] WRBY: Loaded 37611 existing records from primary storage. [2025-09-16T21:22:34.217693] [DEBUG] [LOCAL ] WRB: Loaded 37551 existing records from primary storage. [2025-09-16T21:22:34.235475] [INFO ] [MAIN ] WRB: Loaded 37551 primary data records. [2025-09-16T21:22:34.239317] [INFO ] [MAIN ] WRBY: Loaded 37611 primary data records. [2025-09-16T21:22:34.972518] [DEBUG] [MAIN ] WPP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:34.973849] [INFO ] [MAIN ] WPP: Generated 1339 derivative records from 24838 primary records. [2025-09-16T21:22:34.975098] [DEBUG] [LOCAL ] WPP: Saving derivative data. [2025-09-16T21:22:34.989467] [DEBUG] [LOCAL ] WPP: Derivative data saved (1339 records). [2025-09-16T21:22:34.989877] [INFO ] [MAIN ] WPP: Successfully saved derivative data. [2025-09-16T21:22:34.991535] [INFO ] [MAIN ] Derivative Progress: 1981/2026 symbols completed. WPP took 1.0s. Estimated remaining: 14.6s. Rate: 184.8 symbols/min [2025-09-16T21:22:34.991984] [INFO ] [MAIN ] WS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:35.007241] [DEBUG] [MAIN ] WRB: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:35.013669] [INFO ] [MAIN ] WRB: Generated 1339 derivative records from 37551 primary records. [2025-09-16T21:22:35.013894] [DEBUG] [LOCAL ] WRB: Saving derivative data. [2025-09-16T21:22:35.041086] [DEBUG] [MAIN ] WRBY: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:35.042806] [INFO ] [MAIN ] WRBY: Generated 1339 derivative records from 37611 primary records. [2025-09-16T21:22:35.043228] [DEBUG] [LOCAL ] WRBY: Saving derivative data. [2025-09-16T21:22:35.043162] [DEBUG] [LOCAL ] WRB: Derivative data saved (1339 records). [2025-09-16T21:22:35.042222] [DEBUG] [LOCAL ] WS: Loaded 16884 existing records from primary storage. [2025-09-16T21:22:35.043853] [INFO ] [MAIN ] WRB: Successfully saved derivative data. [2025-09-16T21:22:35.044106] [INFO ] [MAIN ] WS: Loaded 16884 primary data records. [2025-09-16T21:22:35.052054] [INFO ] [MAIN ] Derivative Progress: 1982/2026 symbols completed. WRB took 1.1s. Estimated remaining: 14.3s. Rate: 184.9 symbols/min [2025-09-16T21:22:35.054684] [INFO ] [MAIN ] WSM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:35.175169] [DEBUG] [LOCAL ] WRBY: Derivative data saved (1339 records). [2025-09-16T21:22:35.205961] [INFO ] [MAIN ] WRBY: Successfully saved derivative data. [2025-09-16T21:22:35.242922] [INFO ] [MAIN ] Derivative Progress: 1983/2026 symbols completed. WRBY took 1.3s. Estimated remaining: 14.0s. Rate: 184.9 symbols/min [2025-09-16T21:22:35.343358] [INFO ] [MAIN ] WSO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:35.361373] [DEBUG] [LOCAL ] WSM: Loaded 36902 existing records from primary storage. [2025-09-16T21:22:35.362079] [INFO ] [MAIN ] WSM: Loaded 36902 primary data records. [2025-09-16T21:22:35.457604] [DEBUG] [LOCAL ] WSO: Loaded 18610 existing records from primary storage. [2025-09-16T21:22:35.468233] [INFO ] [MAIN ] WSO: Loaded 18610 primary data records. [2025-09-16T21:22:35.684665] [DEBUG] [MAIN ] WS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:35.796474] [INFO ] [MAIN ] WS: Generated 1339 derivative records from 16884 primary records. [2025-09-16T21:22:35.835763] [DEBUG] [LOCAL ] WS: Saving derivative data. [2025-09-16T21:22:35.891099] [DEBUG] [LOCAL ] WS: Derivative data saved (1339 records). [2025-09-16T21:22:35.891420] [INFO ] [MAIN ] WS: Successfully saved derivative data. [2025-09-16T21:22:35.979868] [INFO ] [MAIN ] Derivative Progress: 1984/2026 symbols completed. WS took 1.0s. Estimated remaining: 13.6s. Rate: 184.8 symbols/min [2025-09-16T21:22:35.991990] [INFO ] [MAIN ] WSR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:36.019019] [DEBUG] [MAIN ] WSM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:36.020023] [INFO ] [MAIN ] WSM: Generated 1339 derivative records from 36902 primary records. [2025-09-16T21:22:36.020215] [DEBUG] [LOCAL ] WSM: Saving derivative data. [2025-09-16T21:22:36.039423] [DEBUG] [LOCAL ] WSM: Derivative data saved (1339 records). [2025-09-16T21:22:36.039892] [DEBUG] [LOCAL ] WSR: Loaded 16799 existing records from primary storage. [2025-09-16T21:22:36.042017] [INFO ] [MAIN ] WSR: Loaded 16799 primary data records. [2025-09-16T21:22:36.041945] [INFO ] [MAIN ] WSM: Successfully saved derivative data. [2025-09-16T21:22:36.049709] [INFO ] [MAIN ] Derivative Progress: 1985/2026 symbols completed. WSM took 1.0s. Estimated remaining: 13.3s. Rate: 184.9 symbols/min [2025-09-16T21:22:36.050028] [INFO ] [MAIN ] WST: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:36.105951] [DEBUG] [MAIN ] WSO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:36.128740] [INFO ] [MAIN ] WSO: Generated 1339 derivative records from 18610 primary records. [2025-09-16T21:22:36.162860] [DEBUG] [LOCAL ] WSO: Saving derivative data. [2025-09-16T21:22:36.348680] [DEBUG] [LOCAL ] WSO: Derivative data saved (1339 records). [2025-09-16T21:22:36.348913] [INFO ] [MAIN ] WSO: Successfully saved derivative data. [2025-09-16T21:22:36.350608] [INFO ] [MAIN ] Derivative Progress: 1986/2026 symbols completed. WSO took 1.0s. Estimated remaining: 13.0s. Rate: 184.9 symbols/min [2025-09-16T21:22:36.351363] [INFO ] [MAIN ] WT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:36.362575] [DEBUG] [LOCAL ] WST: Loaded 27018 existing records from primary storage. [2025-09-16T21:22:36.363102] [INFO ] [MAIN ] WST: Loaded 27018 primary data records. [2025-09-16T21:22:36.712577] [DEBUG] [LOCAL ] WT: Loaded 35275 existing records from primary storage. [2025-09-16T21:22:36.714455] [INFO ] [MAIN ] WT: Loaded 35275 primary data records. [2025-09-16T21:22:36.763209] [DEBUG] [MAIN ] WSR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:36.776633] [INFO ] [MAIN ] WSR: Generated 1339 derivative records from 16799 primary records. [2025-09-16T21:22:36.793281] [DEBUG] [LOCAL ] WSR: Saving derivative data. [2025-09-16T21:22:36.873577] [DEBUG] [LOCAL ] WSR: Derivative data saved (1339 records). [2025-09-16T21:22:36.926358] [INFO ] [MAIN ] WSR: Successfully saved derivative data. [2025-09-16T21:22:36.928334] [INFO ] [MAIN ] Derivative Progress: 1987/2026 symbols completed. WSR took 0.9s. Estimated remaining: 12.7s. Rate: 184.8 symbols/min [2025-09-16T21:22:37.020044] [INFO ] [MAIN ] WTI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:37.036725] [DEBUG] [MAIN ] WST: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:37.037481] [INFO ] [MAIN ] WST: Generated 1339 derivative records from 27018 primary records. [2025-09-16T21:22:37.037613] [DEBUG] [LOCAL ] WST: Saving derivative data. [2025-09-16T21:22:37.052667] [DEBUG] [LOCAL ] WST: Derivative data saved (1339 records). [2025-09-16T21:22:37.061396] [INFO ] [MAIN ] WST: Successfully saved derivative data. [2025-09-16T21:22:37.063965] [INFO ] [MAIN ] Derivative Progress: 1988/2026 symbols completed. WST took 1.0s. Estimated remaining: 12.3s. Rate: 184.9 symbols/min [2025-09-16T21:22:37.064352] [INFO ] [MAIN ] WTRG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:37.089850] [DEBUG] [LOCAL ] WTI: Loaded 32866 existing records from primary storage. [2025-09-16T21:22:37.090155] [DEBUG] [MAIN ] WT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:37.090815] [INFO ] [MAIN ] WT: Generated 1339 derivative records from 35275 primary records. [2025-09-16T21:22:37.090947] [INFO ] [MAIN ] WTI: Loaded 32866 primary data records. [2025-09-16T21:22:37.090913] [DEBUG] [LOCAL ] WT: Saving derivative data. [2025-09-16T21:22:37.235131] [DEBUG] [LOCAL ] WT: Derivative data saved (1339 records). [2025-09-16T21:22:37.262032] [INFO ] [MAIN ] WT: Successfully saved derivative data. [2025-09-16T21:22:37.297966] [INFO ] [MAIN ] Derivative Progress: 1989/2026 symbols completed. WT took 0.9s. Estimated remaining: 12.0s. Rate: 184.9 symbols/min [2025-09-16T21:22:37.381638] [INFO ] [MAIN ] WTS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:37.383007] [DEBUG] [LOCAL ] WTRG: Loaded 37901 existing records from primary storage. [2025-09-16T21:22:37.383181] [INFO ] [MAIN ] WTRG: Loaded 37901 primary data records. [2025-09-16T21:22:37.512289] [DEBUG] [LOCAL ] WTS: Loaded 13467 existing records from primary storage. [2025-09-16T21:22:37.522655] [INFO ] [MAIN ] WTS: Loaded 13467 primary data records. [2025-09-16T21:22:37.946204] [DEBUG] [MAIN ] WTI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:37.947562] [INFO ] [MAIN ] WTI: Generated 1339 derivative records from 32866 primary records. [2025-09-16T21:22:37.948757] [DEBUG] [LOCAL ] WTI: Saving derivative data. [2025-09-16T21:22:37.964947] [DEBUG] [LOCAL ] WTI: Derivative data saved (1339 records). [2025-09-16T21:22:37.965385] [INFO ] [MAIN ] WTI: Successfully saved derivative data. [2025-09-16T21:22:37.967411] [INFO ] [MAIN ] Derivative Progress: 1990/2026 symbols completed. WTI took 1.0s. Estimated remaining: 11.7s. Rate: 184.8 symbols/min [2025-09-16T21:22:37.977271] [INFO ] [MAIN ] WTTR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:37.979200] [DEBUG] [MAIN ] WTRG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:37.980144] [INFO ] [MAIN ] WTRG: Generated 1339 derivative records from 37901 primary records. [2025-09-16T21:22:37.980400] [DEBUG] [LOCAL ] WTRG: Saving derivative data. [2025-09-16T21:22:37.993009] [DEBUG] [LOCAL ] WTRG: Derivative data saved (1339 records). [2025-09-16T21:22:37.993072] [INFO ] [MAIN ] WTRG: Successfully saved derivative data. [2025-09-16T21:22:37.995152] [INFO ] [MAIN ] Derivative Progress: 1991/2026 symbols completed. WTRG took 0.9s. Estimated remaining: 11.4s. Rate: 184.9 symbols/min [2025-09-16T21:22:37.995408] [INFO ] [MAIN ] WU: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:38.008188] [DEBUG] [MAIN ] WTS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:38.008828] [INFO ] [MAIN ] WTS: Generated 1339 derivative records from 13467 primary records. [2025-09-16T21:22:38.017462] [DEBUG] [LOCAL ] WTS: Saving derivative data. [2025-09-16T21:22:38.041383] [DEBUG] [LOCAL ] WTS: Derivative data saved (1339 records). [2025-09-16T21:22:38.042687] [DEBUG] [LOCAL ] WTTR: Loaded 32517 existing records from primary storage. [2025-09-16T21:22:38.041616] [INFO ] [MAIN ] WTS: Successfully saved derivative data. [2025-09-16T21:22:38.042821] [INFO ] [MAIN ] WTTR: Loaded 32517 primary data records. [2025-09-16T21:22:38.044912] [INFO ] [MAIN ] Derivative Progress: 1992/2026 symbols completed. WTS took 0.7s. Estimated remaining: 11.0s. Rate: 184.9 symbols/min [2025-09-16T21:22:38.053454] [INFO ] [MAIN ] WWW: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:38.225118] [DEBUG] [LOCAL ] WU: Loaded 39873 existing records from primary storage. [2025-09-16T21:22:38.256507] [INFO ] [MAIN ] WU: Loaded 39873 primary data records. [2025-09-16T21:22:38.403240] [DEBUG] [LOCAL ] WWW: Loaded 36583 existing records from primary storage. [2025-09-16T21:22:38.415228] [INFO ] [MAIN ] WWW: Loaded 36583 primary data records. [2025-09-16T21:22:38.964226] [DEBUG] [MAIN ] WTTR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:38.965389] [INFO ] [MAIN ] WTTR: Generated 1339 derivative records from 32517 primary records. [2025-09-16T21:22:38.965689] [DEBUG] [LOCAL ] WTTR: Saving derivative data. [2025-09-16T21:22:38.979388] [DEBUG] [LOCAL ] WTTR: Derivative data saved (1339 records). [2025-09-16T21:22:38.982070] [INFO ] [MAIN ] WTTR: Successfully saved derivative data. [2025-09-16T21:22:38.985032] [INFO ] [MAIN ] Derivative Progress: 1993/2026 symbols completed. WTTR took 1.0s. Estimated remaining: 10.7s. Rate: 184.8 symbols/min [2025-09-16T21:22:38.996179] [DEBUG] [MAIN ] WU: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:38.996893] [INFO ] [MAIN ] WU: Generated 1339 derivative records from 39873 primary records. [2025-09-16T21:22:39.005853] [DEBUG] [LOCAL ] WU: Saving derivative data. [2025-09-16T21:22:39.006076] [DEBUG] [MAIN ] WWW: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:39.006794] [INFO ] [MAIN ] WWW: Generated 1339 derivative records from 36583 primary records. [2025-09-16T21:22:39.007164] [DEBUG] [LOCAL ] WWW: Saving derivative data. [2025-09-16T21:22:39.028569] [DEBUG] [LOCAL ] WU: Derivative data saved (1339 records). [2025-09-16T21:22:39.028848] [INFO ] [MAIN ] WU: Successfully saved derivative data. [2025-09-16T21:22:39.030742] [INFO ] [MAIN ] Derivative Progress: 1994/2026 symbols completed. WU took 1.0s. Estimated remaining: 10.4s. Rate: 184.9 symbols/min [2025-09-16T21:22:39.031722] [DEBUG] [LOCAL ] WWW: Derivative data saved (1339 records). [2025-09-16T21:22:39.031780] [INFO ] [MAIN ] WWW: Successfully saved derivative data. [2025-09-16T21:22:39.033496] [INFO ] [MAIN ] Derivative Progress: 1995/2026 symbols completed. WWW took 1.0s. Estimated remaining: 10.1s. Rate: 184.9 symbols/min [2025-09-16T21:22:39.034110] [INFO ] [MAIN ] XIFR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:39.034207] [INFO ] [MAIN ] XFLT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:39.034414] [INFO ] [MAIN ] XHR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:39.074443] [DEBUG] [LOCAL ] XFLT: Loaded 21740 existing records from primary storage. [2025-09-16T21:22:39.074710] [INFO ] [MAIN ] XFLT: Loaded 21740 primary data records. [2025-09-16T21:22:39.170466] [DEBUG] [LOCAL ] XIFR: Loaded 33036 existing records from primary storage. [2025-09-16T21:22:39.185718] [INFO ] [MAIN ] XIFR: Loaded 33036 primary data records. [2025-09-16T21:22:39.271842] [DEBUG] [LOCAL ] XHR: Loaded 32834 existing records from primary storage. [2025-09-16T21:22:39.314627] [INFO ] [MAIN ] XHR: Loaded 32834 primary data records. [2025-09-16T21:22:39.936124] [DEBUG] [MAIN ] XFLT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:39.937292] [INFO ] [MAIN ] XFLT: Generated 1339 derivative records from 21740 primary records. [2025-09-16T21:22:39.937460] [DEBUG] [LOCAL ] XFLT: Saving derivative data. [2025-09-16T21:22:39.951467] [DEBUG] [LOCAL ] XFLT: Derivative data saved (1339 records). [2025-09-16T21:22:39.951967] [INFO ] [MAIN ] XFLT: Successfully saved derivative data. [2025-09-16T21:22:39.953537] [INFO ] [MAIN ] Derivative Progress: 1996/2026 symbols completed. XFLT took 0.9s. Estimated remaining: 9.7s. Rate: 184.8 symbols/min [2025-09-16T21:22:39.955107] [INFO ] [MAIN ] XPER: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:39.969608] [DEBUG] [MAIN ] XHR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:39.979955] [INFO ] [MAIN ] XHR: Generated 1339 derivative records from 32834 primary records. [2025-09-16T21:22:39.980282] [DEBUG] [LOCAL ] XHR: Saving derivative data. [2025-09-16T21:22:39.980197] [DEBUG] [MAIN ] XIFR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:39.981431] [INFO ] [MAIN ] XIFR: Generated 1339 derivative records from 33036 primary records. [2025-09-16T21:22:39.987272] [DEBUG] [LOCAL ] XIFR: Saving derivative data. [2025-09-16T21:22:39.993586] [DEBUG] [LOCAL ] XHR: Derivative data saved (1339 records). [2025-09-16T21:22:39.999268] [INFO ] [MAIN ] XHR: Successfully saved derivative data. [2025-09-16T21:22:40.009057] [INFO ] [MAIN ] Derivative Progress: 1997/2026 symbols completed. XHR took 1.0s. Estimated remaining: 9.4s. Rate: 184.9 symbols/min [2025-09-16T21:22:40.010041] [INFO ] [MAIN ] XPEV: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:40.021929] [DEBUG] [LOCAL ] XIFR: Derivative data saved (1339 records). [2025-09-16T21:22:40.022398] [DEBUG] [LOCAL ] XPER: Loaded 21940 existing records from primary storage. [2025-09-16T21:22:40.022677] [INFO ] [MAIN ] XIFR: Successfully saved derivative data. [2025-09-16T21:22:40.022574] [INFO ] [MAIN ] XPER: Loaded 21940 primary data records. [2025-09-16T21:22:40.024744] [INFO ] [MAIN ] Derivative Progress: 1998/2026 symbols completed. XIFR took 1.0s. Estimated remaining: 9.1s. Rate: 184.9 symbols/min [2025-09-16T21:22:40.024992] [INFO ] [MAIN ] XPOF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:40.247617] [DEBUG] [LOCAL ] XPEV: Loaded 39998 existing records from primary storage. [2025-09-16T21:22:40.248399] [INFO ] [MAIN ] XPEV: Loaded 39998 primary data records. [2025-09-16T21:22:40.281993] [DEBUG] [LOCAL ] XPOF: Loaded 28233 existing records from primary storage. [2025-09-16T21:22:40.399398] [INFO ] [MAIN ] XPOF: Loaded 28233 primary data records. [2025-09-16T21:22:40.889573] [DEBUG] [MAIN ] XPER: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:40.890588] [INFO ] [MAIN ] XPER: Generated 1339 derivative records from 21940 primary records. [2025-09-16T21:22:40.891019] [DEBUG] [LOCAL ] XPER: Saving derivative data. [2025-09-16T21:22:40.905449] [DEBUG] [LOCAL ] XPER: Derivative data saved (1339 records). [2025-09-16T21:22:40.905826] [INFO ] [MAIN ] XPER: Successfully saved derivative data. [2025-09-16T21:22:40.908241] [INFO ] [MAIN ] Derivative Progress: 1999/2026 symbols completed. XPER took 1.0s. Estimated remaining: 8.8s. Rate: 184.8 symbols/min [2025-09-16T21:22:40.909679] [INFO ] [MAIN ] XPRO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:40.922458] [DEBUG] [MAIN ] XPEV: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:40.924540] [INFO ] [MAIN ] XPEV: Generated 1339 derivative records from 39998 primary records. [2025-09-16T21:22:40.924716] [DEBUG] [LOCAL ] XPEV: Saving derivative data. [2025-09-16T21:22:40.941976] [DEBUG] [MAIN ] XPOF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:40.947807] [DEBUG] [LOCAL ] XPEV: Derivative data saved (1339 records). [2025-09-16T21:22:40.948822] [INFO ] [MAIN ] XPOF: Generated 1339 derivative records from 28233 primary records. [2025-09-16T21:22:40.949043] [INFO ] [MAIN ] XPEV: Successfully saved derivative data. [2025-09-16T21:22:40.951132] [INFO ] [MAIN ] Derivative Progress: 2000/2026 symbols completed. XPEV took 0.9s. Estimated remaining: 8.4s. Rate: 184.9 symbols/min [2025-09-16T21:22:40.948990] [DEBUG] [LOCAL ] XPOF: Saving derivative data. [2025-09-16T21:22:40.952292] [INFO ] [MAIN ] XYF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:40.974333] [DEBUG] [LOCAL ] XPOF: Derivative data saved (1339 records). [2025-09-16T21:22:40.974482] [INFO ] [MAIN ] XPOF: Successfully saved derivative data. [2025-09-16T21:22:40.976958] [INFO ] [MAIN ] Derivative Progress: 2001/2026 symbols completed. XPOF took 1.0s. Estimated remaining: 8.1s. Rate: 184.9 symbols/min [2025-09-16T21:22:40.977924] [INFO ] [MAIN ] XYZ: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:40.994122] [DEBUG] [LOCAL ] XPRO: Loaded 34015 existing records from primary storage. [2025-09-16T21:22:40.994516] [INFO ] [MAIN ] XPRO: Loaded 34015 primary data records. [2025-09-16T21:22:41.104439] [DEBUG] [LOCAL ] XYF: Loaded 21809 existing records from primary storage. [2025-09-16T21:22:41.115392] [INFO ] [MAIN ] XYF: Loaded 21809 primary data records. [2025-09-16T21:22:41.453693] [DEBUG] [LOCAL ] XYZ: Loaded 40104 existing records from primary storage. [2025-09-16T21:22:41.506302] [INFO ] [MAIN ] XYZ: Loaded 40104 primary data records. [2025-09-16T21:22:41.923911] [DEBUG] [MAIN ] XPRO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:41.941937] [INFO ] [MAIN ] XPRO: Generated 1339 derivative records from 34015 primary records. [2025-09-16T21:22:41.942273] [DEBUG] [MAIN ] XYF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:41.942562] [DEBUG] [LOCAL ] XPRO: Saving derivative data. [2025-09-16T21:22:41.956115] [INFO ] [MAIN ] XYF: Generated 1339 derivative records from 21809 primary records. [2025-09-16T21:22:41.961834] [DEBUG] [LOCAL ] XYF: Saving derivative data. [2025-09-16T21:22:41.964355] [DEBUG] [LOCAL ] XPRO: Derivative data saved (1339 records). [2025-09-16T21:22:41.965232] [INFO ] [MAIN ] XPRO: Successfully saved derivative data. [2025-09-16T21:22:41.967534] [INFO ] [MAIN ] Derivative Progress: 2002/2026 symbols completed. XPRO took 1.1s. Estimated remaining: 7.8s. Rate: 184.8 symbols/min [2025-09-16T21:22:41.967876] [INFO ] [MAIN ] YALA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:41.984602] [DEBUG] [LOCAL ] XYF: Derivative data saved (1339 records). [2025-09-16T21:22:41.985268] [INFO ] [MAIN ] XYF: Successfully saved derivative data. [2025-09-16T21:22:41.987683] [INFO ] [MAIN ] Derivative Progress: 2003/2026 symbols completed. XYF took 1.0s. Estimated remaining: 7.5s. Rate: 184.8 symbols/min [2025-09-16T21:22:41.988336] [INFO ] [MAIN ] YELP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:42.007991] [DEBUG] [MAIN ] XYZ: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:42.008932] [INFO ] [MAIN ] XYZ: Generated 1339 derivative records from 40104 primary records. [2025-09-16T21:22:42.009139] [DEBUG] [LOCAL ] XYZ: Saving derivative data. [2025-09-16T21:22:42.038633] [DEBUG] [LOCAL ] XYZ: Derivative data saved (1339 records). [2025-09-16T21:22:42.039854] [INFO ] [MAIN ] XYZ: Successfully saved derivative data. [2025-09-16T21:22:42.043709] [INFO ] [MAIN ] Derivative Progress: 2004/2026 symbols completed. XYZ took 1.1s. Estimated remaining: 7.1s. Rate: 184.9 symbols/min [2025-09-16T21:22:42.044441] [INFO ] [MAIN ] YETI: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:42.074482] [DEBUG] [LOCAL ] YALA: Loaded 28536 existing records from primary storage. [2025-09-16T21:22:42.074849] [INFO ] [MAIN ] YALA: Loaded 28536 primary data records. [2025-09-16T21:22:42.184902] [DEBUG] [LOCAL ] YELP: Loaded 33499 existing records from primary storage. [2025-09-16T21:22:42.185152] [INFO ] [MAIN ] YELP: Loaded 33499 primary data records. [2025-09-16T21:22:42.449028] [DEBUG] [LOCAL ] YETI: Loaded 39396 existing records from primary storage. [2025-09-16T21:22:42.459982] [INFO ] [MAIN ] YETI: Loaded 39396 primary data records. [2025-09-16T21:22:43.267161] [DEBUG] [MAIN ] YALA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:43.268445] [INFO ] [MAIN ] YALA: Generated 1339 derivative records from 28536 primary records. [2025-09-16T21:22:43.269919] [DEBUG] [LOCAL ] YALA: Saving derivative data. [2025-09-16T21:22:43.293234] [DEBUG] [LOCAL ] YALA: Derivative data saved (1339 records). [2025-09-16T21:22:43.293689] [DEBUG] [MAIN ] YELP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:43.293803] [INFO ] [MAIN ] YALA: Successfully saved derivative data. [2025-09-16T21:22:43.296123] [INFO ] [MAIN ] Derivative Progress: 2005/2026 symbols completed. YALA took 1.3s. Estimated remaining: 6.8s. Rate: 184.7 symbols/min [2025-09-16T21:22:43.294449] [INFO ] [MAIN ] YELP: Generated 1339 derivative records from 33499 primary records. [2025-09-16T21:22:43.296381] [INFO ] [MAIN ] YEXT: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:43.296566] [DEBUG] [LOCAL ] YELP: Saving derivative data. [2025-09-16T21:22:43.324946] [DEBUG] [LOCAL ] YELP: Derivative data saved (1339 records). [2025-09-16T21:22:43.324873] [DEBUG] [MAIN ] YETI: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:43.325703] [INFO ] [MAIN ] YELP: Successfully saved derivative data. [2025-09-16T21:22:43.327708] [INFO ] [MAIN ] Derivative Progress: 2006/2026 symbols completed. YELP took 1.3s. Estimated remaining: 6.5s. Rate: 184.7 symbols/min [2025-09-16T21:22:43.325609] [INFO ] [MAIN ] YETI: Generated 1339 derivative records from 39396 primary records. [2025-09-16T21:22:43.327940] [INFO ] [MAIN ] YMM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:43.328173] [DEBUG] [LOCAL ] YETI: Saving derivative data. [2025-09-16T21:22:43.340902] [DEBUG] [LOCAL ] YETI: Derivative data saved (1339 records). [2025-09-16T21:22:43.348393] [INFO ] [MAIN ] YETI: Successfully saved derivative data. [2025-09-16T21:22:43.351143] [INFO ] [MAIN ] Derivative Progress: 2007/2026 symbols completed. YETI took 1.3s. Estimated remaining: 6.2s. Rate: 184.8 symbols/min [2025-09-16T21:22:43.351525] [INFO ] [MAIN ] YOU: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:43.364851] [DEBUG] [LOCAL ] YEXT: Loaded 31636 existing records from primary storage. [2025-09-16T21:22:43.365055] [INFO ] [MAIN ] YEXT: Loaded 31636 primary data records. [2025-09-16T21:22:43.578385] [DEBUG] [LOCAL ] YMM: Loaded 39200 existing records from primary storage. [2025-09-16T21:22:43.667532] [INFO ] [MAIN ] YMM: Loaded 39200 primary data records. [2025-09-16T21:22:43.724090] [DEBUG] [LOCAL ] YOU: Loaded 36926 existing records from primary storage. [2025-09-16T21:22:43.764182] [INFO ] [MAIN ] YOU: Loaded 36926 primary data records. [2025-09-16T21:22:44.359578] [DEBUG] [MAIN ] YEXT: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:44.361286] [INFO ] [MAIN ] YEXT: Generated 1339 derivative records from 31636 primary records. [2025-09-16T21:22:44.361436] [DEBUG] [LOCAL ] YEXT: Saving derivative data. [2025-09-16T21:22:44.376546] [DEBUG] [LOCAL ] YEXT: Derivative data saved (1339 records). [2025-09-16T21:22:44.377514] [INFO ] [MAIN ] YEXT: Successfully saved derivative data. [2025-09-16T21:22:44.380191] [INFO ] [MAIN ] Derivative Progress: 2008/2026 symbols completed. YEXT took 1.1s. Estimated remaining: 5.8s. Rate: 184.6 symbols/min [2025-09-16T21:22:44.412709] [DEBUG] [MAIN ] YOU: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:44.413484] [INFO ] [MAIN ] YOU: Generated 1339 derivative records from 36926 primary records. [2025-09-16T21:22:44.412413] [DEBUG] [MAIN ] YMM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:44.413610] [DEBUG] [LOCAL ] YOU: Saving derivative data. [2025-09-16T21:22:44.414240] [INFO ] [MAIN ] YMM: Generated 1339 derivative records from 39200 primary records. [2025-09-16T21:22:44.414990] [DEBUG] [LOCAL ] YMM: Saving derivative data. [2025-09-16T21:22:44.437537] [DEBUG] [LOCAL ] YMM: Derivative data saved (1339 records). [2025-09-16T21:22:44.439826] [INFO ] [MAIN ] YMM: Successfully saved derivative data. [2025-09-16T21:22:44.442314] [INFO ] [MAIN ] Derivative Progress: 2009/2026 symbols completed. YMM took 1.1s. Estimated remaining: 5.5s. Rate: 184.7 symbols/min [2025-09-16T21:22:44.440015] [DEBUG] [LOCAL ] YOU: Derivative data saved (1339 records). [2025-09-16T21:22:44.442442] [INFO ] [MAIN ] YOU: Successfully saved derivative data. [2025-09-16T21:22:44.445443] [INFO ] [MAIN ] Derivative Progress: 2010/2026 symbols completed. YOU took 1.1s. Estimated remaining: 5.2s. Rate: 184.8 symbols/min [2025-09-16T21:22:44.446122] [INFO ] [MAIN ] YRD: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:44.446268] [INFO ] [MAIN ] YPF: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:44.446299] [INFO ] [MAIN ] YSG: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:44.458129] [DEBUG] [LOCAL ] YRD: Loaded 7983 existing records from primary storage. [2025-09-16T21:22:44.458422] [INFO ] [MAIN ] YRD: Loaded 7983 primary data records. [2025-09-16T21:22:44.586047] [DEBUG] [LOCAL ] YSG: Loaded 19736 existing records from primary storage. [2025-09-16T21:22:44.607584] [INFO ] [MAIN ] YSG: Loaded 19736 primary data records. [2025-09-16T21:22:44.723455] [DEBUG] [LOCAL ] YPF: Loaded 37391 existing records from primary storage. [2025-09-16T21:22:44.840203] [INFO ] [MAIN ] YPF: Loaded 37391 primary data records. [2025-09-16T21:22:45.339311] [DEBUG] [MAIN ] YRD: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:45.340731] [INFO ] [MAIN ] YRD: Generated 1339 derivative records from 7983 primary records. [2025-09-16T21:22:45.341095] [DEBUG] [LOCAL ] YRD: Saving derivative data. [2025-09-16T21:22:45.365255] [DEBUG] [LOCAL ] YRD: Derivative data saved (1339 records). [2025-09-16T21:22:45.375434] [INFO ] [MAIN ] YRD: Successfully saved derivative data. [2025-09-16T21:22:45.377777] [INFO ] [MAIN ] Derivative Progress: 2011/2026 symbols completed. YRD took 0.9s. Estimated remaining: 4.9s. Rate: 184.6 symbols/min [2025-09-16T21:22:45.387439] [INFO ] [MAIN ] YUMC: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:45.387828] [DEBUG] [MAIN ] YPF: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:45.388783] [INFO ] [MAIN ] YPF: Generated 1339 derivative records from 37391 primary records. [2025-09-16T21:22:45.389391] [DEBUG] [LOCAL ] YPF: Saving derivative data. [2025-09-16T21:22:45.390776] [DEBUG] [MAIN ] YSG: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:45.391719] [INFO ] [MAIN ] YSG: Generated 1339 derivative records from 19736 primary records. [2025-09-16T21:22:45.400942] [DEBUG] [LOCAL ] YSG: Saving derivative data. [2025-09-16T21:22:45.414842] [DEBUG] [LOCAL ] YPF: Derivative data saved (1339 records). [2025-09-16T21:22:45.417043] [DEBUG] [LOCAL ] YSG: Derivative data saved (1339 records). [2025-09-16T21:22:45.417125] [INFO ] [MAIN ] YSG: Successfully saved derivative data. [2025-09-16T21:22:45.416678] [INFO ] [MAIN ] YPF: Successfully saved derivative data. [2025-09-16T21:22:45.419434] [INFO ] [MAIN ] Derivative Progress: 2012/2026 symbols completed. YSG took 1.0s. Estimated remaining: 4.5s. Rate: 184.7 symbols/min [2025-09-16T21:22:45.422111] [INFO ] [MAIN ] ZBH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:45.421991] [INFO ] [MAIN ] Derivative Progress: 2013/2026 symbols completed. YPF took 1.0s. Estimated remaining: 4.2s. Rate: 184.8 symbols/min [2025-09-16T21:22:45.424056] [INFO ] [MAIN ] ZEPP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:45.451872] [DEBUG] [LOCAL ] ZEPP: Loaded 14833 existing records from primary storage. [2025-09-16T21:22:45.452030] [INFO ] [MAIN ] ZEPP: Loaded 14833 primary data records. [2025-09-16T21:22:45.570636] [DEBUG] [LOCAL ] YUMC: Loaded 39174 existing records from primary storage. [2025-09-16T21:22:45.582076] [INFO ] [MAIN ] YUMC: Loaded 39174 primary data records. [2025-09-16T21:22:45.674988] [DEBUG] [LOCAL ] ZBH: Loaded 38056 existing records from primary storage. [2025-09-16T21:22:45.712088] [INFO ] [MAIN ] ZBH: Loaded 38056 primary data records. [2025-09-16T21:22:46.370070] [DEBUG] [MAIN ] ZEPP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:46.371373] [INFO ] [MAIN ] ZEPP: Generated 1339 derivative records from 14833 primary records. [2025-09-16T21:22:46.371838] [DEBUG] [LOCAL ] ZEPP: Saving derivative data. [2025-09-16T21:22:46.385516] [DEBUG] [LOCAL ] ZEPP: Derivative data saved (1339 records). [2025-09-16T21:22:46.385723] [INFO ] [MAIN ] ZEPP: Successfully saved derivative data. [2025-09-16T21:22:46.389880] [INFO ] [MAIN ] Derivative Progress: 2014/2026 symbols completed. ZEPP took 1.0s. Estimated remaining: 3.9s. Rate: 184.6 symbols/min [2025-09-16T21:22:46.391859] [INFO ] [MAIN ] ZGN: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:46.406592] [DEBUG] [MAIN ] YUMC: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:46.407766] [INFO ] [MAIN ] YUMC: Generated 1339 derivative records from 39174 primary records. [2025-09-16T21:22:46.408054] [DEBUG] [LOCAL ] YUMC: Saving derivative data. [2025-09-16T21:22:46.434006] [DEBUG] [LOCAL ] YUMC: Derivative data saved (1339 records). [2025-09-16T21:22:46.433898] [DEBUG] [MAIN ] ZBH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:46.441613] [INFO ] [MAIN ] YUMC: Successfully saved derivative data. [2025-09-16T21:22:46.444768] [INFO ] [MAIN ] Derivative Progress: 2015/2026 symbols completed. YUMC took 1.1s. Estimated remaining: 3.6s. Rate: 184.7 symbols/min [2025-09-16T21:22:46.442510] [INFO ] [MAIN ] ZBH: Generated 1339 derivative records from 38056 primary records. [2025-09-16T21:22:46.445088] [INFO ] [MAIN ] ZH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:46.445211] [DEBUG] [LOCAL ] ZBH: Saving derivative data. [2025-09-16T21:22:46.468689] [DEBUG] [LOCAL ] ZBH: Derivative data saved (1339 records). [2025-09-16T21:22:46.468874] [INFO ] [MAIN ] ZBH: Successfully saved derivative data. [2025-09-16T21:22:46.471037] [INFO ] [MAIN ] Derivative Progress: 2016/2026 symbols completed. ZBH took 1.1s. Estimated remaining: 3.2s. Rate: 184.8 symbols/min [2025-09-16T21:22:46.471763] [DEBUG] [LOCAL ] ZGN: Loaded 30276 existing records from primary storage. [2025-09-16T21:22:46.471915] [INFO ] [MAIN ] ZGN: Loaded 30276 primary data records. [2025-09-16T21:22:46.475846] [INFO ] [MAIN ] ZIM: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:46.589684] [DEBUG] [LOCAL ] ZH: Loaded 17989 existing records from primary storage. [2025-09-16T21:22:46.595478] [INFO ] [MAIN ] ZH: Loaded 17989 primary data records. [2025-09-16T21:22:47.044591] [DEBUG] [LOCAL ] ZIM: Loaded 39916 existing records from primary storage. [2025-09-16T21:22:47.044844] [INFO ] [MAIN ] ZIM: Loaded 39916 primary data records. [2025-09-16T21:22:47.325455] [DEBUG] [MAIN ] ZGN: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:47.326382] [INFO ] [MAIN ] ZGN: Generated 1339 derivative records from 30276 primary records. [2025-09-16T21:22:47.326722] [DEBUG] [LOCAL ] ZGN: Saving derivative data. [2025-09-16T21:22:47.339706] [DEBUG] [LOCAL ] ZGN: Derivative data saved (1339 records). [2025-09-16T21:22:47.339834] [INFO ] [MAIN ] ZGN: Successfully saved derivative data. [2025-09-16T21:22:47.341617] [INFO ] [MAIN ] Derivative Progress: 2017/2026 symbols completed. ZGN took 1.0s. Estimated remaining: 2.9s. Rate: 184.6 symbols/min [2025-09-16T21:22:47.343119] [INFO ] [MAIN ] ZIP: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:47.355891] [DEBUG] [MAIN ] ZH: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:47.356776] [INFO ] [MAIN ] ZH: Generated 1339 derivative records from 17989 primary records. [2025-09-16T21:22:47.356966] [DEBUG] [LOCAL ] ZH: Saving derivative data. [2025-09-16T21:22:47.372437] [DEBUG] [LOCAL ] ZH: Derivative data saved (1339 records). [2025-09-16T21:22:47.381181] [INFO ] [MAIN ] ZH: Successfully saved derivative data. [2025-09-16T21:22:47.390286] [INFO ] [MAIN ] Derivative Progress: 2018/2026 symbols completed. ZH took 0.9s. Estimated remaining: 2.6s. Rate: 184.7 symbols/min [2025-09-16T21:22:47.394542] [INFO ] [MAIN ] ZK: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:47.394881] [DEBUG] [MAIN ] ZIM: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:47.395858] [INFO ] [MAIN ] ZIM: Generated 1339 derivative records from 39916 primary records. [2025-09-16T21:22:47.396032] [DEBUG] [LOCAL ] ZIM: Saving derivative data. [2025-09-16T21:22:47.419961] [DEBUG] [LOCAL ] ZIP: Loaded 32337 existing records from primary storage. [2025-09-16T21:22:47.420323] [INFO ] [MAIN ] ZIP: Loaded 32337 primary data records. [2025-09-16T21:22:47.428662] [DEBUG] [LOCAL ] ZIM: Derivative data saved (1339 records). [2025-09-16T21:22:47.504205] [INFO ] [MAIN ] ZIM: Successfully saved derivative data. [2025-09-16T21:22:47.529772] [INFO ] [MAIN ] Derivative Progress: 2019/2026 symbols completed. ZIM took 1.1s. Estimated remaining: 2.3s. Rate: 184.7 symbols/min [2025-09-16T21:22:47.549140] [INFO ] [MAIN ] ZKH: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:47.579581] [DEBUG] [LOCAL ] ZK: Loaded 28414 existing records from primary storage. [2025-09-16T21:22:47.631272] [INFO ] [MAIN ] ZK: Loaded 28414 primary data records. [2025-09-16T21:22:47.788314] [DEBUG] [LOCAL ] ZKH: Loaded 5809 existing records from primary storage. [2025-09-16T21:22:47.805868] [INFO ] [MAIN ] ZKH: Loaded 5809 primary data records. [2025-09-16T21:22:48.316737] [DEBUG] [MAIN ] ZIP: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:48.318232] [INFO ] [MAIN ] ZIP: Generated 1339 derivative records from 32337 primary records. [2025-09-16T21:22:48.318853] [DEBUG] [LOCAL ] ZIP: Saving derivative data. [2025-09-16T21:22:48.335569] [DEBUG] [LOCAL ] ZIP: Derivative data saved (1339 records). [2025-09-16T21:22:48.335979] [INFO ] [MAIN ] ZIP: Successfully saved derivative data. [2025-09-16T21:22:48.338010] [INFO ] [MAIN ] Derivative Progress: 2020/2026 symbols completed. ZIP took 1.0s. Estimated remaining: 2.0s. Rate: 184.6 symbols/min [2025-09-16T21:22:48.340954] [INFO ] [MAIN ] ZTO: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:48.359438] [DEBUG] [MAIN ] ZK: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:48.360748] [INFO ] [MAIN ] ZK: Generated 1339 derivative records from 28414 primary records. [2025-09-16T21:22:48.360882] [DEBUG] [LOCAL ] ZK: Saving derivative data. [2025-09-16T21:22:48.375415] [DEBUG] [LOCAL ] ZK: Derivative data saved (1339 records). [2025-09-16T21:22:48.377101] [INFO ] [MAIN ] ZK: Successfully saved derivative data. [2025-09-16T21:22:48.380239] [INFO ] [MAIN ] Derivative Progress: 2021/2026 symbols completed. ZK took 1.0s. Estimated remaining: 1.6s. Rate: 184.7 symbols/min [2025-09-16T21:22:48.380487] [INFO ] [MAIN ] ZTR: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:48.401561] [DEBUG] [MAIN ] ZKH: Filtered 5181 bins outside market hours, 5781 incomplete bins [2025-09-16T21:22:48.402484] [INFO ] [MAIN ] ZKH: Generated 1337 derivative records from 5809 primary records. [2025-09-16T21:22:48.402618] [DEBUG] [LOCAL ] ZKH: Saving derivative data. [2025-09-16T21:22:48.422206] [DEBUG] [LOCAL ] ZKH: Derivative data saved (1337 records). [2025-09-16T21:22:48.432756] [DEBUG] [LOCAL ] ZTR: Loaded 12251 existing records from primary storage. [2025-09-16T21:22:48.433549] [INFO ] [MAIN ] ZKH: Successfully saved derivative data. [2025-09-16T21:22:48.436186] [INFO ] [MAIN ] Derivative Progress: 2022/2026 symbols completed. ZKH took 0.9s. Estimated remaining: 1.3s. Rate: 184.8 symbols/min [2025-09-16T21:22:48.433674] [INFO ] [MAIN ] ZTR: Loaded 12251 primary data records. [2025-09-16T21:22:48.459726] [DEBUG] [LOCAL ] ZTO: Loaded 36806 existing records from primary storage. [2025-09-16T21:22:48.473475] [INFO ] [MAIN ] ZVIA: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:48.486122] [INFO ] [MAIN ] ZTO: Loaded 36806 primary data records. [2025-09-16T21:22:48.933737] [DEBUG] [LOCAL ] ZVIA: Loaded 27081 existing records from primary storage. [2025-09-16T21:22:48.956435] [INFO ] [MAIN ] ZVIA: Loaded 27081 primary data records. [2025-09-16T21:22:49.399439] [DEBUG] [MAIN ] ZTR: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:49.407261] [INFO ] [MAIN ] ZTR: Generated 1339 derivative records from 12251 primary records. [2025-09-16T21:22:49.411666] [DEBUG] [MAIN ] ZTO: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:49.411935] [DEBUG] [LOCAL ] ZTR: Saving derivative data. [2025-09-16T21:22:49.413345] [INFO ] [MAIN ] ZTO: Generated 1339 derivative records from 36806 primary records. [2025-09-16T21:22:49.415173] [DEBUG] [LOCAL ] ZTO: Saving derivative data. [2025-09-16T21:22:49.447431] [DEBUG] [LOCAL ] ZTO: Derivative data saved (1339 records). [2025-09-16T21:22:49.448615] [INFO ] [MAIN ] ZTO: Successfully saved derivative data. [2025-09-16T21:22:49.452441] [DEBUG] [LOCAL ] ZTR: Derivative data saved (1339 records). [2025-09-16T21:22:49.452766] [INFO ] [MAIN ] ZTR: Successfully saved derivative data. [2025-09-16T21:22:49.451907] [INFO ] [MAIN ] Derivative Progress: 2023/2026 symbols completed. ZTO took 1.1s. Estimated remaining: 1.0s. Rate: 184.6 symbols/min [2025-09-16T21:22:49.458431] [INFO ] [MAIN ] Derivative Progress: 2024/2026 symbols completed. ZTR took 1.1s. Estimated remaining: 0.6s. Rate: 184.7 symbols/min [2025-09-16T21:22:49.469622] [DEBUG] [MAIN ] ZVIA: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:49.470535] [INFO ] [MAIN ] ZVIA: Generated 1339 derivative records from 27081 primary records. [2025-09-16T21:22:49.470599] [DEBUG] [LOCAL ] ZVIA: Saving derivative data. [2025-09-16T21:22:49.488457] [DEBUG] [LOCAL ] ZVIA: Derivative data saved (1339 records). [2025-09-16T21:22:49.488605] [INFO ] [MAIN ] ZVIA: Successfully saved derivative data. [2025-09-16T21:22:49.491069] [INFO ] [MAIN ] Derivative Progress: 2025/2026 symbols completed. ZVIA took 1.1s. Estimated remaining: 0.3s. Rate: 184.7 symbols/min [2025-09-16T21:22:49.491533] [INFO ] [MAIN ] ZWS: Starting derivative data generation with 30-minute intervals. [2025-09-16T21:22:49.531779] [DEBUG] [LOCAL ] ZWS: Loaded 31021 existing records from primary storage. [2025-09-16T21:22:49.531963] [INFO ] [MAIN ] ZWS: Loaded 31021 primary data records. [2025-09-16T21:22:49.822197] [DEBUG] [MAIN ] ZWS: Filtered 5181 bins outside market hours, 5779 incomplete bins [2025-09-16T21:22:49.822985] [INFO ] [MAIN ] ZWS: Generated 1339 derivative records from 31021 primary records. [2025-09-16T21:22:49.823112] [DEBUG] [LOCAL ] ZWS: Saving derivative data. [2025-09-16T21:22:49.835185] [DEBUG] [LOCAL ] ZWS: Derivative data saved (1339 records). [2025-09-16T21:22:49.835312] [INFO ] [MAIN ] ZWS: Successfully saved derivative data. [2025-09-16T21:22:49.837068] [INFO ] [MAIN ] Derivative Progress: 2026/2026 symbols completed. ZWS took 0.3s. Estimated remaining: 0.0s. Rate: 184.7 symbols/min [2025-09-16T21:22:49.838097] [INFO ] [MAIN ] Parallel derivative generation completed in 10m 58s [2025-09-16T21:22:49.838199] [INFO ] [MAIN ] Derivative generation success rate: 100.0% (2026/2026 symbols) [2025-09-16T21:22:50.502940] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Derivative Generation Completed (2026/2026 @ 100.00%)' [2025-09-16T21:22:50.503782] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-09-16T21:22:50.504017] [INFO ] [STATE ] Last completion updated: 2025-09-16T21:22:50.503874